2024-04-25T02:08:00.506 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-25T02:08:00.507 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672379 --description fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} --name teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi --owner scheduled_teuthology@teuthology --verbose -- /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672379/orig.config.yaml 2024-04-25T02:08:00.564 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T02:08:00.649 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672379 branch: squid description: fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7672379' kernel: kdb: 1 sha1: distro ktype: distro last_in_suite: false machine_type: smithi meta: - desc: 'install ceph/octopus latest ' name: teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi no_nested_subset: false nuke-on-error: false openstack: - volumes: count: 4 size: 10 os_type: centos os_version: 8.stream overrides: admin_socket: branch: squid ceph: cephfs: max_mds: 2 conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: bluestore warn on legacy statfs: false bluestore warn on no per pool omap: false mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on osd down out interval zero: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - scrub mismatch - ScrubResult - wrongly marked - \(POOL_APP_NOT_ENABLED\) - \(SLOW_OPS\) - overall HEALTH_ - \(MON_MSGR2_NOT_ENABLED\) - slow request - missing required features sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 nuke-on-error: false selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.b - mon.c - mgr.x - mgr.y - mds.a - mds.b - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - - client.0 - - client.1 seed: 8528 sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 sleep_before_teardown: 0 subset: 122/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 targets: smithi111.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPERtPLPbjh+ore3r8rrFFjeMLL/8p/vObStZuJkoLwlAf/d0FkQgcnHL525JUjIS7AmXD3mX2ThtWumF5OK/7I= smithi114.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOT85DpUXsx4TEQFhFoE4PIakOMeAwivZx/rP1jG1yhvj82ceb6QXNZd5sePXZA0XN7beKoTid06U4UOSh3GG9U= smithi186.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCfUx0GMcqkgFw1FYWmH1+4HajG+pleNLK8MOUK5h/rfo8VDgmrVbPJ1yuVjUdztxnNHVOOEdaV53SGzTXbYeGI= tasks: - install: branch: octopus exclude_packages: - librados3 - ceph-mgr-dashboard - ceph-mgr-diskprediction-local - ceph-mgr-rook - ceph-mgr-cephadm - cephadm - ceph-volume extra_packages: - librados2 - print: '**** done installing octopus' - ceph: conf: global: mon warn on pool no app: false ms bind msgr2: false log-ignorelist: - overall HEALTH_ - \(FS_ - \(MDS_ - \(OSD_ - \(MON_DOWN\) - \(CACHE_POOL_ - \(POOL_ - \(MGR_DOWN\) - \(PG_ - \(SMALLER_PGP_NUM\) - Monitor daemon marked osd - Behind on trimming - Manager daemon - exec: osd.0: - ceph osd set-require-min-compat-client octopus - print: '**** done ceph' - ceph-fuse: null - print: '**** done octopus client' - print: '**** done fsstress' - mds_pre_upgrade: null - print: '**** done mds pre-upgrade sequence' - install.upgrade: mon.a: branch: quincy - print: '**** done install.upgrade the host' - ceph.restart: daemons: - mon.* - mgr.* mon-health-to-clog: false wait-for-healthy: false - ceph.healthy: null - ceph.restart: daemons: - osd.* wait-for-healthy: false wait-for-osds-up: true - ceph.stop: - mds.* - ceph.restart: daemons: - mds.* wait-for-healthy: false wait-for-osds-up: true - exec: mon.a: - ceph versions - ceph osd dump -f json-pretty - ceph osd require-osd-release quincy - for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done - ceph.healthy: null - print: '**** done ceph.restart' - install.upgrade: client.0: branch: quincy - print: '**** done install.upgrade on client.0' - ceph-fuse: client.0: mounted: false client.1: skip: true - ceph-fuse: client.0: null client.1: skip: true - print: '**** done remount client' - exec: mon.a: - ceph fs dump --format=json-pretty - ceph fs required_client_features cephfs add metric_collect - sleep: duration: 5 - fs.clients_evicted: clients: client.0: false client.1: true - workunit: clients: client.0: - suites/fsstress.sh - print: '**** done fsstress' teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-24_21:24:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-25T02:08:00.649 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa; will attempt to use it 2024-04-25T02:08:00.650 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa/tasks 2024-04-25T02:08:00.650 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-25T02:08:00.652 INFO:teuthology.task.internal:Checking packages... 2024-04-25T02:08:00.675 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'd2c45d977142e024a59b68a8f1dce8f0b9840551' 2024-04-25T02:08:00.676 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T02:08:00.676 INFO:teuthology.packaging:ref: None 2024-04-25T02:08:00.676 INFO:teuthology.packaging:tag: None 2024-04-25T02:08:00.676 INFO:teuthology.packaging:branch: squid 2024-04-25T02:08:00.676 INFO:teuthology.packaging:sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T02:08:00.676 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=squid 2024-04-25T02:08:00.979 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2445.gd2c45d97 2024-04-25T02:08:00.981 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-25T02:08:00.988 INFO:teuthology.task.internal:no buildpackages task found 2024-04-25T02:08:00.988 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-25T02:08:01.059 INFO:teuthology.task.internal:Saving configuration 2024-04-25T02:08:01.078 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-25T02:08:01.133 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-25T02:08:01.159 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi111.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672379', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 02:02:28.162273', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPERtPLPbjh+ore3r8rrFFjeMLL/8p/vObStZuJkoLwlAf/d0FkQgcnHL525JUjIS7AmXD3mX2ThtWumF5OK/7I='} 2024-04-25T02:08:01.182 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi114.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672379', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 02:02:28.163565', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOT85DpUXsx4TEQFhFoE4PIakOMeAwivZx/rP1jG1yhvj82ceb6QXNZd5sePXZA0XN7beKoTid06U4UOSh3GG9U='} 2024-04-25T02:08:01.202 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi186.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672379', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-25 02:02:28.159904', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCfUx0GMcqkgFw1FYWmH1+4HajG+pleNLK8MOUK5h/rfo8VDgmrVbPJ1yuVjUdztxnNHVOOEdaV53SGzTXbYeGI='} 2024-04-25T02:08:01.202 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-25T02:08:01.264 INFO:teuthology.task.internal:roles: ubuntu@smithi111.front.sepia.ceph.com - ['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'mds.b', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'] 2024-04-25T02:08:01.264 INFO:teuthology.task.internal:roles: ubuntu@smithi114.front.sepia.ceph.com - ['client.0'] 2024-04-25T02:08:01.264 INFO:teuthology.task.internal:roles: ubuntu@smithi186.front.sepia.ceph.com - ['client.1'] 2024-04-25T02:08:01.264 INFO:teuthology.run_tasks:Running task console_log... 2024-04-25T02:08:01.414 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f7046b2c160>, signals=[15]) 2024-04-25T02:08:01.414 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-25T02:08:01.420 INFO:teuthology.task.internal:Opening connections... 2024-04-25T02:08:01.420 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi111.front.sepia.ceph.com 2024-04-25T02:08:01.422 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T02:08:01.496 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi114.front.sepia.ceph.com 2024-04-25T02:08:01.497 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T02:08:01.570 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi186.front.sepia.ceph.com 2024-04-25T02:08:01.571 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T02:08:01.643 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-25T02:08:01.649 DEBUG:teuthology.orchestra.run.smithi111:> uname -m 2024-04-25T02:08:01.672 INFO:teuthology.orchestra.run.smithi111.stdout:x86_64 2024-04-25T02:08:01.672 DEBUG:teuthology.orchestra.run.smithi111:> cat /etc/os-release 2024-04-25T02:08:01.733 INFO:teuthology.orchestra.run.smithi111.stdout:NAME="CentOS Stream" 2024-04-25T02:08:01.733 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION="8" 2024-04-25T02:08:01.733 INFO:teuthology.orchestra.run.smithi111.stdout:ID="centos" 2024-04-25T02:08:01.733 INFO:teuthology.orchestra.run.smithi111.stdout:ID_LIKE="rhel fedora" 2024-04-25T02:08:01.733 INFO:teuthology.orchestra.run.smithi111.stdout:VERSION_ID="8" 2024-04-25T02:08:01.733 INFO:teuthology.orchestra.run.smithi111.stdout:PLATFORM_ID="platform:el8" 2024-04-25T02:08:01.734 INFO:teuthology.orchestra.run.smithi111.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-25T02:08:01.734 INFO:teuthology.orchestra.run.smithi111.stdout:ANSI_COLOR="0;31" 2024-04-25T02:08:01.734 INFO:teuthology.orchestra.run.smithi111.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-25T02:08:01.734 INFO:teuthology.orchestra.run.smithi111.stdout:HOME_URL="https://centos.org/" 2024-04-25T02:08:01.734 INFO:teuthology.orchestra.run.smithi111.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T02:08:01.734 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-25T02:08:01.734 INFO:teuthology.orchestra.run.smithi111.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T02:08:01.735 INFO:teuthology.lock.ops:Updating smithi111.front.sepia.ceph.com on lock server 2024-04-25T02:08:01.759 DEBUG:teuthology.orchestra.run.smithi114:> uname -m 2024-04-25T02:08:01.782 INFO:teuthology.orchestra.run.smithi114.stdout:x86_64 2024-04-25T02:08:01.782 DEBUG:teuthology.orchestra.run.smithi114:> cat /etc/os-release 2024-04-25T02:08:01.843 INFO:teuthology.orchestra.run.smithi114.stdout:NAME="CentOS Stream" 2024-04-25T02:08:01.843 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION="8" 2024-04-25T02:08:01.844 INFO:teuthology.orchestra.run.smithi114.stdout:ID="centos" 2024-04-25T02:08:01.844 INFO:teuthology.orchestra.run.smithi114.stdout:ID_LIKE="rhel fedora" 2024-04-25T02:08:01.844 INFO:teuthology.orchestra.run.smithi114.stdout:VERSION_ID="8" 2024-04-25T02:08:01.844 INFO:teuthology.orchestra.run.smithi114.stdout:PLATFORM_ID="platform:el8" 2024-04-25T02:08:01.844 INFO:teuthology.orchestra.run.smithi114.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-25T02:08:01.844 INFO:teuthology.orchestra.run.smithi114.stdout:ANSI_COLOR="0;31" 2024-04-25T02:08:01.844 INFO:teuthology.orchestra.run.smithi114.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-25T02:08:01.844 INFO:teuthology.orchestra.run.smithi114.stdout:HOME_URL="https://centos.org/" 2024-04-25T02:08:01.844 INFO:teuthology.orchestra.run.smithi114.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T02:08:01.844 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-25T02:08:01.844 INFO:teuthology.orchestra.run.smithi114.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T02:08:01.844 INFO:teuthology.lock.ops:Updating smithi114.front.sepia.ceph.com on lock server 2024-04-25T02:08:01.867 DEBUG:teuthology.orchestra.run.smithi186:> uname -m 2024-04-25T02:08:01.890 INFO:teuthology.orchestra.run.smithi186.stdout:x86_64 2024-04-25T02:08:01.890 DEBUG:teuthology.orchestra.run.smithi186:> cat /etc/os-release 2024-04-25T02:08:01.951 INFO:teuthology.orchestra.run.smithi186.stdout:NAME="CentOS Stream" 2024-04-25T02:08:01.951 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION="8" 2024-04-25T02:08:01.951 INFO:teuthology.orchestra.run.smithi186.stdout:ID="centos" 2024-04-25T02:08:01.951 INFO:teuthology.orchestra.run.smithi186.stdout:ID_LIKE="rhel fedora" 2024-04-25T02:08:01.951 INFO:teuthology.orchestra.run.smithi186.stdout:VERSION_ID="8" 2024-04-25T02:08:01.952 INFO:teuthology.orchestra.run.smithi186.stdout:PLATFORM_ID="platform:el8" 2024-04-25T02:08:01.952 INFO:teuthology.orchestra.run.smithi186.stdout:PRETTY_NAME="CentOS Stream 8" 2024-04-25T02:08:01.952 INFO:teuthology.orchestra.run.smithi186.stdout:ANSI_COLOR="0;31" 2024-04-25T02:08:01.952 INFO:teuthology.orchestra.run.smithi186.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-04-25T02:08:01.952 INFO:teuthology.orchestra.run.smithi186.stdout:HOME_URL="https://centos.org/" 2024-04-25T02:08:01.952 INFO:teuthology.orchestra.run.smithi186.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-04-25T02:08:01.952 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-04-25T02:08:01.952 INFO:teuthology.orchestra.run.smithi186.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-04-25T02:08:01.952 INFO:teuthology.lock.ops:Updating smithi186.front.sepia.ceph.com on lock server 2024-04-25T02:08:01.976 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-25T02:08:01.986 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-25T02:08:02.035 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-25T02:08:02.035 DEBUG:teuthology.orchestra.run.smithi111:> test '!' -e /home/ubuntu/cephtest 2024-04-25T02:08:02.038 DEBUG:teuthology.orchestra.run.smithi114:> test '!' -e /home/ubuntu/cephtest 2024-04-25T02:08:02.040 DEBUG:teuthology.orchestra.run.smithi186:> test '!' -e /home/ubuntu/cephtest 2024-04-25T02:08:02.060 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-25T02:08:02.100 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-25T02:08:02.101 DEBUG:teuthology.orchestra.run.smithi111:> test -z $(ls -A /var/lib/ceph) 2024-04-25T02:08:02.103 DEBUG:teuthology.orchestra.run.smithi114:> test -z $(ls -A /var/lib/ceph) 2024-04-25T02:08:02.105 DEBUG:teuthology.orchestra.run.smithi186:> test -z $(ls -A /var/lib/ceph) 2024-04-25T02:08:02.134 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-25T02:08:02.223 INFO:teuthology.run_tasks:Running task kernel... 2024-04-25T02:08:02.237 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-04-25T02:08:02.237 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'client.0': {'kdb': 1, 'sha1': 'distro'}, 'client.1': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-04-25T02:08:02.238 DEBUG:teuthology.orchestra.run.smithi111:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T02:08:02.238 DEBUG:teuthology.orchestra.run.smithi114:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T02:08:02.239 DEBUG:teuthology.orchestra.run.smithi186:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-25T02:08:02.259 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:08:02.260 DEBUG:teuthology.orchestra.run.smithi111:> uname -r 2024-04-25T02:08:02.261 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:08:02.261 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:08:02.261 DEBUG:teuthology.orchestra.run.smithi114:> uname -r 2024-04-25T02:08:02.262 DEBUG:teuthology.orchestra.run.smithi186:> uname -r 2024-04-25T02:08:02.322 INFO:teuthology.orchestra.run.smithi111.stdout:4.18.0-489.el8.x86_64 2024-04-25T02:08:02.322 INFO:teuthology.task.kernel:Running kernel on smithi111: 4.18.0-489.el8.x86_64 2024-04-25T02:08:02.323 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum install -y kernel 2024-04-25T02:08:02.325 INFO:teuthology.orchestra.run.smithi114.stdout:4.18.0-489.el8.x86_64 2024-04-25T02:08:02.325 INFO:teuthology.orchestra.run.smithi186.stdout:4.18.0-489.el8.x86_64 2024-04-25T02:08:02.325 INFO:teuthology.task.kernel:Running kernel on smithi114: 4.18.0-489.el8.x86_64 2024-04-25T02:08:02.326 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum install -y kernel 2024-04-25T02:08:02.326 INFO:teuthology.task.kernel:Running kernel on smithi186: 4.18.0-489.el8.x86_64 2024-04-25T02:08:02.326 DEBUG:teuthology.orchestra.run.smithi186:> sudo yum install -y kernel 2024-04-25T02:08:05.518 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 8 - AppStream 41 MB/s | 28 MB 00:00 2024-04-25T02:08:05.559 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 8 - AppStream 39 MB/s | 28 MB 00:00 2024-04-25T02:08:05.793 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 8 - AppStream 34 MB/s | 28 MB 00:00 2024-04-25T02:08:11.135 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 8 - BaseOS 19 MB/s | 10 MB 00:00 2024-04-25T02:08:11.468 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 8 - BaseOS 11 MB/s | 10 MB 00:00 2024-04-25T02:08:11.494 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 8 - BaseOS 14 MB/s | 10 MB 00:00 2024-04-25T02:08:13.152 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 8 - Extras 43 kB/s | 18 kB 00:00 2024-04-25T02:08:13.619 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 8 - Extras common packages 21 kB/s | 7.7 kB 00:00 2024-04-25T02:08:13.627 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 8 - Extras 34 kB/s | 18 kB 00:00 2024-04-25T02:08:13.636 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 8 - Extras 33 kB/s | 18 kB 00:00 2024-04-25T02:08:13.854 INFO:teuthology.orchestra.run.smithi111.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2024-04-25T02:08:13.953 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 8 - Extras common packages 37 kB/s | 7.7 kB 00:00 2024-04-25T02:08:14.061 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 8 - Extras common packages 24 kB/s | 7.7 kB 00:00 2024-04-25T02:08:14.180 INFO:teuthology.orchestra.run.smithi186.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2024-04-25T02:08:14.305 INFO:teuthology.orchestra.run.smithi114.stdout:Copr repo for python3-asyncssh owned by ceph 23 kB/s | 3.5 kB 00:00 2024-04-25T02:08:15.307 INFO:teuthology.orchestra.run.smithi114.stdout:Extra Packages for Enterprise Linux 18 MB/s | 16 MB 00:00 2024-04-25T02:08:19.163 INFO:teuthology.orchestra.run.smithi114.stdout:lab-extras 487 kB/s | 24 kB 00:00 2024-04-25T02:08:21.547 INFO:teuthology.orchestra.run.smithi186.stdout:Extra Packages for Enterprise Linux 2.2 MB/s | 16 MB 00:07 2024-04-25T02:08:22.235 INFO:teuthology.orchestra.run.smithi114.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-04-25T02:08:22.235 INFO:teuthology.orchestra.run.smithi114.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-04-25T02:08:22.341 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-04-25T02:08:22.342 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-04-25T02:08:22.342 INFO:teuthology.orchestra.run.smithi114.stdout: Package Architecture Version Repository Size 2024-04-25T02:08:22.342 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-04-25T02:08:22.342 INFO:teuthology.orchestra.run.smithi114.stdout:Installing: 2024-04-25T02:08:22.342 INFO:teuthology.orchestra.run.smithi114.stdout: kernel x86_64 4.18.0-552.el8 baseos 10 M 2024-04-25T02:08:22.342 INFO:teuthology.orchestra.run.smithi114.stdout:Installing dependencies: 2024-04-25T02:08:22.342 INFO:teuthology.orchestra.run.smithi114.stdout: kernel-core x86_64 4.18.0-552.el8 baseos 44 M 2024-04-25T02:08:22.342 INFO:teuthology.orchestra.run.smithi114.stdout: kernel-modules x86_64 4.18.0-552.el8 baseos 36 M 2024-04-25T02:08:22.342 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:08:22.342 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2024-04-25T02:08:22.342 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-04-25T02:08:22.342 INFO:teuthology.orchestra.run.smithi114.stdout:Install 3 Packages 2024-04-25T02:08:22.343 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:08:22.343 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 90 M 2024-04-25T02:08:22.343 INFO:teuthology.orchestra.run.smithi114.stdout:Installed size: 96 M 2024-04-25T02:08:22.343 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading Packages: 2024-04-25T02:08:23.057 INFO:teuthology.orchestra.run.smithi114.stdout:(1/3): kernel-4.18.0-552.el8.x86_64.rpm 16 MB/s | 10 MB 00:00 2024-04-25T02:08:23.765 INFO:teuthology.orchestra.run.smithi114.stdout:(2/3): kernel-modules-4.18.0-552.el8.x86_64.rpm 27 MB/s | 36 MB 00:01 2024-04-25T02:08:24.232 INFO:teuthology.orchestra.run.smithi114.stdout:(3/3): kernel-core-4.18.0-552.el8.x86_64.rpm 24 MB/s | 44 MB 00:01 2024-04-25T02:08:24.232 INFO:teuthology.orchestra.run.smithi114.stdout:-------------------------------------------------------------------------------- 2024-04-25T02:08:24.233 INFO:teuthology.orchestra.run.smithi114.stdout:Total 48 MB/s | 90 MB 00:01 2024-04-25T02:08:24.911 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2024-04-25T02:08:25.338 INFO:teuthology.orchestra.run.smithi186.stdout:lab-extras 369 kB/s | 24 kB 00:00 2024-04-25T02:08:25.349 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction check succeeded. 2024-04-25T02:08:25.350 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2024-04-25T02:08:26.595 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded. 2024-04-25T02:08:26.620 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2024-04-25T02:08:28.435 INFO:teuthology.orchestra.run.smithi186.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-04-25T02:08:28.435 INFO:teuthology.orchestra.run.smithi186.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-04-25T02:08:28.558 INFO:teuthology.orchestra.run.smithi186.stdout:Dependencies resolved. 2024-04-25T02:08:28.558 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2024-04-25T02:08:28.559 INFO:teuthology.orchestra.run.smithi186.stdout: Package Architecture Version Repository Size 2024-04-25T02:08:28.559 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2024-04-25T02:08:28.559 INFO:teuthology.orchestra.run.smithi186.stdout:Installing: 2024-04-25T02:08:28.559 INFO:teuthology.orchestra.run.smithi186.stdout: kernel x86_64 4.18.0-552.el8 baseos 10 M 2024-04-25T02:08:28.559 INFO:teuthology.orchestra.run.smithi186.stdout:Installing dependencies: 2024-04-25T02:08:28.559 INFO:teuthology.orchestra.run.smithi186.stdout: kernel-core x86_64 4.18.0-552.el8 baseos 44 M 2024-04-25T02:08:28.559 INFO:teuthology.orchestra.run.smithi186.stdout: kernel-modules x86_64 4.18.0-552.el8 baseos 36 M 2024-04-25T02:08:28.559 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:08:28.559 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction Summary 2024-04-25T02:08:28.559 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2024-04-25T02:08:28.559 INFO:teuthology.orchestra.run.smithi186.stdout:Install 3 Packages 2024-04-25T02:08:28.559 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:08:28.560 INFO:teuthology.orchestra.run.smithi186.stdout:Total download size: 90 M 2024-04-25T02:08:28.560 INFO:teuthology.orchestra.run.smithi186.stdout:Installed size: 96 M 2024-04-25T02:08:28.560 INFO:teuthology.orchestra.run.smithi186.stdout:Downloading Packages: 2024-04-25T02:08:29.369 INFO:teuthology.orchestra.run.smithi114.stdout: Preparing : 1/1 2024-04-25T02:08:29.723 INFO:teuthology.orchestra.run.smithi186.stdout:(1/3): kernel-4.18.0-552.el8.x86_64.rpm 11 MB/s | 10 MB 00:00 2024-04-25T02:08:29.842 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-25T02:08:30.390 INFO:teuthology.orchestra.run.smithi186.stdout:(2/3): kernel-modules-4.18.0-552.el8.x86_64.rpm 22 MB/s | 36 MB 00:01 2024-04-25T02:08:30.806 INFO:teuthology.orchestra.run.smithi186.stdout:(3/3): kernel-core-4.18.0-552.el8.x86_64.rpm 21 MB/s | 44 MB 00:02 2024-04-25T02:08:30.807 INFO:teuthology.orchestra.run.smithi186.stdout:-------------------------------------------------------------------------------- 2024-04-25T02:08:30.807 INFO:teuthology.orchestra.run.smithi186.stdout:Total 40 MB/s | 90 MB 00:02 2024-04-25T02:08:31.490 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction check 2024-04-25T02:08:31.594 INFO:teuthology.orchestra.run.smithi111.stdout:Extra Packages for Enterprise Linux 945 kB/s | 16 MB 00:17 2024-04-25T02:08:31.917 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction check succeeded. 2024-04-25T02:08:31.917 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction test 2024-04-25T02:08:33.177 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction test succeeded. 2024-04-25T02:08:33.194 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction 2024-04-25T02:08:33.399 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-25T02:08:33.767 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-25T02:08:35.328 INFO:teuthology.orchestra.run.smithi111.stdout:lab-extras 447 kB/s | 24 kB 00:00 2024-04-25T02:08:36.032 INFO:teuthology.orchestra.run.smithi186.stdout: Preparing : 1/1 2024-04-25T02:08:36.547 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-25T02:08:37.198 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-25T02:08:37.569 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : kernel-4.18.0-552.el8.x86_64 3/3 2024-04-25T02:08:38.366 INFO:teuthology.orchestra.run.smithi111.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-04-25T02:08:38.366 INFO:teuthology.orchestra.run.smithi111.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-04-25T02:08:38.475 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-04-25T02:08:38.475 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-04-25T02:08:38.475 INFO:teuthology.orchestra.run.smithi111.stdout: Package Architecture Version Repository Size 2024-04-25T02:08:38.475 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-04-25T02:08:38.476 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-04-25T02:08:38.476 INFO:teuthology.orchestra.run.smithi111.stdout: kernel x86_64 4.18.0-552.el8 baseos 10 M 2024-04-25T02:08:38.476 INFO:teuthology.orchestra.run.smithi111.stdout:Installing dependencies: 2024-04-25T02:08:38.476 INFO:teuthology.orchestra.run.smithi111.stdout: kernel-core x86_64 4.18.0-552.el8 baseos 44 M 2024-04-25T02:08:38.476 INFO:teuthology.orchestra.run.smithi111.stdout: kernel-modules x86_64 4.18.0-552.el8 baseos 36 M 2024-04-25T02:08:38.476 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:08:38.476 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-04-25T02:08:38.476 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-04-25T02:08:38.476 INFO:teuthology.orchestra.run.smithi111.stdout:Install 3 Packages 2024-04-25T02:08:38.476 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:08:38.477 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 90 M 2024-04-25T02:08:38.477 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 96 M 2024-04-25T02:08:38.477 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-04-25T02:08:39.366 INFO:teuthology.orchestra.run.smithi111.stdout:(1/3): kernel-4.18.0-552.el8.x86_64.rpm 15 MB/s | 10 MB 00:00 2024-04-25T02:08:40.055 INFO:teuthology.orchestra.run.smithi111.stdout:(2/3): kernel-modules-4.18.0-552.el8.x86_64.rpm 27 MB/s | 36 MB 00:01 2024-04-25T02:08:40.125 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-25T02:08:40.513 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-25T02:08:40.563 INFO:teuthology.orchestra.run.smithi111.stdout:(3/3): kernel-core-4.18.0-552.el8.x86_64.rpm 23 MB/s | 44 MB 00:01 2024-04-25T02:08:40.564 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-04-25T02:08:40.564 INFO:teuthology.orchestra.run.smithi111.stdout:Total 43 MB/s | 90 MB 00:02 2024-04-25T02:08:41.249 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-04-25T02:08:41.649 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-04-25T02:08:41.649 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-04-25T02:08:42.896 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-04-25T02:08:42.919 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-04-25T02:08:43.954 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-25T02:08:44.254 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : kernel-4.18.0-552.el8.x86_64 3/3 2024-04-25T02:08:45.681 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-04-25T02:08:46.286 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-25T02:08:49.848 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 1/3 2024-04-25T02:08:50.194 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-25T02:08:53.628 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 2/3 2024-04-25T02:08:53.934 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : kernel-4.18.0-552.el8.x86_64 3/3 2024-04-25T02:08:59.490 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 3/3 2024-04-25T02:08:59.514 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-25T02:08:59.877 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: kernel-4.18.0-552.el8.x86_64 3/3 2024-04-25T02:08:59.878 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : kernel-4.18.0-552.el8.x86_64 1/3 2024-04-25T02:08:59.878 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : kernel-core-4.18.0-552.el8.x86_64 2/3 2024-04-25T02:09:00.388 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-25T02:09:00.388 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:09:00.388 INFO:teuthology.orchestra.run.smithi114.stdout:Installed: 2024-04-25T02:09:00.388 INFO:teuthology.orchestra.run.smithi114.stdout: kernel-4.18.0-552.el8.x86_64 kernel-core-4.18.0-552.el8.x86_64 2024-04-25T02:09:00.388 INFO:teuthology.orchestra.run.smithi114.stdout: kernel-modules-4.18.0-552.el8.x86_64 2024-04-25T02:09:00.388 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:09:00.388 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-04-25T02:09:00.541 DEBUG:teuthology.orchestra.run.smithi114:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T02:09:00.756 INFO:teuthology.orchestra.run.smithi114.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-25T02:09:00.757 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-25T02:09:00.757 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-552.el8.x86_64 2024-04-25T02:09:00.757 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-25T02:09:00.757 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-25T02:09:00.757 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-04-25T02:09:00.757 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi114.front.sepia.ceph.com, path=None, version=distro) 2024-04-25T02:09:00.757 DEBUG:teuthology.orchestra.run.smithi114:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T02:09:00.967 INFO:teuthology.orchestra.run.smithi114.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-25T02:09:00.967 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-25T02:09:00.968 DEBUG:teuthology.orchestra.run.smithi114:> sudo rpm -qi grub2-tools 2024-04-25T02:09:01.001 INFO:teuthology.orchestra.run.smithi114.stdout:Name : grub2-tools 2024-04-25T02:09:01.001 INFO:teuthology.orchestra.run.smithi114.stdout:Epoch : 1 2024-04-25T02:09:01.001 INFO:teuthology.orchestra.run.smithi114.stdout:Version : 2.02 2024-04-25T02:09:01.001 INFO:teuthology.orchestra.run.smithi114.stdout:Release : 129.el8 2024-04-25T02:09:01.002 INFO:teuthology.orchestra.run.smithi114.stdout:Architecture: x86_64 2024-04-25T02:09:01.002 INFO:teuthology.orchestra.run.smithi114.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-04-25T02:09:01.002 INFO:teuthology.orchestra.run.smithi114.stdout:Group : System Environment/Base 2024-04-25T02:09:01.002 INFO:teuthology.orchestra.run.smithi114.stdout:Size : 9265586 2024-04-25T02:09:01.002 INFO:teuthology.orchestra.run.smithi114.stdout:License : GPLv3+ 2024-04-25T02:09:01.002 INFO:teuthology.orchestra.run.smithi114.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-04-25T02:09:01.002 INFO:teuthology.orchestra.run.smithi114.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-04-25T02:09:01.002 INFO:teuthology.orchestra.run.smithi114.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-04-25T02:09:01.002 INFO:teuthology.orchestra.run.smithi114.stdout:Build Host : kbuilder.bsys.centos.org 2024-04-25T02:09:01.002 INFO:teuthology.orchestra.run.smithi114.stdout:Relocations : (not relocatable) 2024-04-25T02:09:01.002 INFO:teuthology.orchestra.run.smithi114.stdout:Packager : CentOS BuildSystem 2024-04-25T02:09:01.002 INFO:teuthology.orchestra.run.smithi114.stdout:Vendor : CentOS 2024-04-25T02:09:01.002 INFO:teuthology.orchestra.run.smithi114.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-25T02:09:01.002 INFO:teuthology.orchestra.run.smithi114.stdout:Summary : Support tools for GRUB. 2024-04-25T02:09:01.003 INFO:teuthology.orchestra.run.smithi114.stdout:Description : 2024-04-25T02:09:01.003 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:09:01.003 INFO:teuthology.orchestra.run.smithi114.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-25T02:09:01.003 INFO:teuthology.orchestra.run.smithi114.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-25T02:09:01.003 INFO:teuthology.orchestra.run.smithi114.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-25T02:09:01.003 INFO:teuthology.orchestra.run.smithi114.stdout:hardware devices. 2024-04-25T02:09:01.003 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:09:01.003 INFO:teuthology.orchestra.run.smithi114.stdout:This subpackage provides tools for support of all platforms. 2024-04-25T02:09:01.004 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-25T02:09:01.004 INFO:teuthology.task.kernel:Updating grub on smithi114 to boot 4.18.0-552.el8.x86_64 2024-04-25T02:09:01.004 DEBUG:teuthology.orchestra.run.smithi114:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-25T02:09:02.438 INFO:teuthology.orchestra.run.smithi114.stderr:Generating grub configuration file ... 2024-04-25T02:09:04.215 INFO:teuthology.orchestra.run.smithi114.stderr:done 2024-04-25T02:09:04.217 DEBUG:teuthology.orchestra.run.smithi114:> mktemp 2024-04-25T02:09:04.249 INFO:teuthology.orchestra.run.smithi114.stdout:/tmp/tmp.Fw9YvMmLrb 2024-04-25T02:09:04.250 DEBUG:teuthology.orchestra.run.smithi114:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Fw9YvMmLrb 2024-04-25T02:09:04.338 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 0666 /tmp/tmp.Fw9YvMmLrb 2024-04-25T02:09:04.435 DEBUG:teuthology.orchestra.remote:smithi114:/tmp/tmp.Fw9YvMmLrb is 6KB 2024-04-25T02:09:04.482 DEBUG:teuthology.orchestra.run.smithi114:> rm -fr /tmp/tmp.Fw9YvMmLrb 2024-04-25T02:09:04.500 DEBUG:teuthology.orchestra.run.smithi114:> sudo /bin/ls /boot/loader/entries || true 2024-04-25T02:09:04.575 INFO:teuthology.orchestra.run.smithi114.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-04-25T02:09:04.575 INFO:teuthology.orchestra.run.smithi114.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-04-25T02:09:04.575 INFO:teuthology.orchestra.run.smithi114.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-04-25T02:09:04.575 INFO:teuthology.orchestra.run.smithi114.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64.conf 2024-04-25T02:09:04.576 DEBUG:teuthology.orchestra.run.smithi114:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64 2024-04-25T02:09:04.753 DEBUG:teuthology.orchestra.run.smithi114:> sudo shutdown -r now 2024-04-25T02:09:06.246 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 3/3 2024-04-25T02:09:06.270 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-25T02:09:06.896 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: kernel-4.18.0-552.el8.x86_64 3/3 2024-04-25T02:09:06.896 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : kernel-4.18.0-552.el8.x86_64 1/3 2024-04-25T02:09:06.896 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : kernel-core-4.18.0-552.el8.x86_64 2/3 2024-04-25T02:09:07.411 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-25T02:09:07.411 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:09:07.412 INFO:teuthology.orchestra.run.smithi186.stdout:Installed: 2024-04-25T02:09:07.412 INFO:teuthology.orchestra.run.smithi186.stdout: kernel-4.18.0-552.el8.x86_64 kernel-core-4.18.0-552.el8.x86_64 2024-04-25T02:09:07.412 INFO:teuthology.orchestra.run.smithi186.stdout: kernel-modules-4.18.0-552.el8.x86_64 2024-04-25T02:09:07.412 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:09:07.412 INFO:teuthology.orchestra.run.smithi186.stdout:Complete! 2024-04-25T02:09:07.565 DEBUG:teuthology.orchestra.run.smithi186:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T02:09:07.782 INFO:teuthology.orchestra.run.smithi186.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-25T02:09:07.782 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-25T02:09:07.783 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-552.el8.x86_64 2024-04-25T02:09:07.783 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-25T02:09:07.783 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-25T02:09:07.783 INFO:teuthology.task.kernel:Installing distro kernel on client.1... 2024-04-25T02:09:07.783 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi186.front.sepia.ceph.com, path=None, version=distro) 2024-04-25T02:09:07.783 DEBUG:teuthology.orchestra.run.smithi186:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T02:09:07.996 INFO:teuthology.orchestra.run.smithi186.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-25T02:09:07.996 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-25T02:09:07.996 DEBUG:teuthology.orchestra.run.smithi186:> sudo rpm -qi grub2-tools 2024-04-25T02:09:08.030 INFO:teuthology.orchestra.run.smithi186.stdout:Name : grub2-tools 2024-04-25T02:09:08.030 INFO:teuthology.orchestra.run.smithi186.stdout:Epoch : 1 2024-04-25T02:09:08.031 INFO:teuthology.orchestra.run.smithi186.stdout:Version : 2.02 2024-04-25T02:09:08.031 INFO:teuthology.orchestra.run.smithi186.stdout:Release : 129.el8 2024-04-25T02:09:08.031 INFO:teuthology.orchestra.run.smithi186.stdout:Architecture: x86_64 2024-04-25T02:09:08.031 INFO:teuthology.orchestra.run.smithi186.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-04-25T02:09:08.031 INFO:teuthology.orchestra.run.smithi186.stdout:Group : System Environment/Base 2024-04-25T02:09:08.031 INFO:teuthology.orchestra.run.smithi186.stdout:Size : 9265586 2024-04-25T02:09:08.031 INFO:teuthology.orchestra.run.smithi186.stdout:License : GPLv3+ 2024-04-25T02:09:08.031 INFO:teuthology.orchestra.run.smithi186.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-04-25T02:09:08.031 INFO:teuthology.orchestra.run.smithi186.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-04-25T02:09:08.031 INFO:teuthology.orchestra.run.smithi186.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-04-25T02:09:08.031 INFO:teuthology.orchestra.run.smithi186.stdout:Build Host : kbuilder.bsys.centos.org 2024-04-25T02:09:08.031 INFO:teuthology.orchestra.run.smithi186.stdout:Relocations : (not relocatable) 2024-04-25T02:09:08.031 INFO:teuthology.orchestra.run.smithi186.stdout:Packager : CentOS BuildSystem 2024-04-25T02:09:08.032 INFO:teuthology.orchestra.run.smithi186.stdout:Vendor : CentOS 2024-04-25T02:09:08.032 INFO:teuthology.orchestra.run.smithi186.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-25T02:09:08.032 INFO:teuthology.orchestra.run.smithi186.stdout:Summary : Support tools for GRUB. 2024-04-25T02:09:08.032 INFO:teuthology.orchestra.run.smithi186.stdout:Description : 2024-04-25T02:09:08.032 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:09:08.032 INFO:teuthology.orchestra.run.smithi186.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-25T02:09:08.032 INFO:teuthology.orchestra.run.smithi186.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-25T02:09:08.032 INFO:teuthology.orchestra.run.smithi186.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-25T02:09:08.032 INFO:teuthology.orchestra.run.smithi186.stdout:hardware devices. 2024-04-25T02:09:08.032 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:09:08.032 INFO:teuthology.orchestra.run.smithi186.stdout:This subpackage provides tools for support of all platforms. 2024-04-25T02:09:08.033 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-25T02:09:08.033 INFO:teuthology.task.kernel:Updating grub on smithi186 to boot 4.18.0-552.el8.x86_64 2024-04-25T02:09:08.033 DEBUG:teuthology.orchestra.run.smithi186:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-25T02:09:09.576 INFO:teuthology.orchestra.run.smithi186.stderr:Generating grub configuration file ... 2024-04-25T02:09:12.034 INFO:teuthology.orchestra.run.smithi186.stderr:done 2024-04-25T02:09:12.036 DEBUG:teuthology.orchestra.run.smithi186:> mktemp 2024-04-25T02:09:12.077 INFO:teuthology.orchestra.run.smithi186.stdout:/tmp/tmp.Gish8SxjLQ 2024-04-25T02:09:12.077 DEBUG:teuthology.orchestra.run.smithi186:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Gish8SxjLQ 2024-04-25T02:09:12.154 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod 0666 /tmp/tmp.Gish8SxjLQ 2024-04-25T02:09:12.304 DEBUG:teuthology.orchestra.remote:smithi186:/tmp/tmp.Gish8SxjLQ is 6KB 2024-04-25T02:09:12.352 DEBUG:teuthology.orchestra.run.smithi186:> rm -fr /tmp/tmp.Gish8SxjLQ 2024-04-25T02:09:12.370 DEBUG:teuthology.orchestra.run.smithi186:> sudo /bin/ls /boot/loader/entries || true 2024-04-25T02:09:12.443 INFO:teuthology.orchestra.run.smithi186.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-04-25T02:09:12.443 INFO:teuthology.orchestra.run.smithi186.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-04-25T02:09:12.444 INFO:teuthology.orchestra.run.smithi186.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-04-25T02:09:12.444 INFO:teuthology.orchestra.run.smithi186.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64.conf 2024-04-25T02:09:12.445 DEBUG:teuthology.orchestra.run.smithi186:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64 2024-04-25T02:09:12.607 DEBUG:teuthology.orchestra.run.smithi186:> sudo shutdown -r now 2024-04-25T02:09:15.775 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: kernel-core-4.18.0-552.el8.x86_64 3/3 2024-04-25T02:09:15.797 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-25T02:09:16.126 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: kernel-4.18.0-552.el8.x86_64 3/3 2024-04-25T02:09:16.127 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : kernel-4.18.0-552.el8.x86_64 1/3 2024-04-25T02:09:16.127 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : kernel-core-4.18.0-552.el8.x86_64 2/3 2024-04-25T02:09:16.648 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : kernel-modules-4.18.0-552.el8.x86_64 3/3 2024-04-25T02:09:16.648 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:09:16.648 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-04-25T02:09:16.648 INFO:teuthology.orchestra.run.smithi111.stdout: kernel-4.18.0-552.el8.x86_64 kernel-core-4.18.0-552.el8.x86_64 2024-04-25T02:09:16.648 INFO:teuthology.orchestra.run.smithi111.stdout: kernel-modules-4.18.0-552.el8.x86_64 2024-04-25T02:09:16.648 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:09:16.648 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-04-25T02:09:16.792 DEBUG:teuthology.orchestra.run.smithi111:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T02:09:17.053 INFO:teuthology.orchestra.run.smithi111.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-25T02:09:17.053 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-25T02:09:17.053 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-552.el8.x86_64 2024-04-25T02:09:17.053 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-25T02:09:17.053 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-25T02:09:17.053 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-25T02:09:17.053 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi111.front.sepia.ceph.com, path=None, version=distro) 2024-04-25T02:09:17.054 DEBUG:teuthology.orchestra.run.smithi111:> rpm -q kernel | sort -rV | head -n 1 2024-04-25T02:09:17.264 INFO:teuthology.orchestra.run.smithi111.stdout:kernel-4.18.0-552.el8.x86_64 2024-04-25T02:09:17.264 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-552.el8.x86_64 2024-04-25T02:09:17.264 DEBUG:teuthology.orchestra.run.smithi111:> sudo rpm -qi grub2-tools 2024-04-25T02:09:17.297 INFO:teuthology.orchestra.run.smithi111.stdout:Name : grub2-tools 2024-04-25T02:09:17.298 INFO:teuthology.orchestra.run.smithi111.stdout:Epoch : 1 2024-04-25T02:09:17.298 INFO:teuthology.orchestra.run.smithi111.stdout:Version : 2.02 2024-04-25T02:09:17.298 INFO:teuthology.orchestra.run.smithi111.stdout:Release : 129.el8 2024-04-25T02:09:17.298 INFO:teuthology.orchestra.run.smithi111.stdout:Architecture: x86_64 2024-04-25T02:09:17.298 INFO:teuthology.orchestra.run.smithi111.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-04-25T02:09:17.298 INFO:teuthology.orchestra.run.smithi111.stdout:Group : System Environment/Base 2024-04-25T02:09:17.298 INFO:teuthology.orchestra.run.smithi111.stdout:Size : 9265586 2024-04-25T02:09:17.298 INFO:teuthology.orchestra.run.smithi111.stdout:License : GPLv3+ 2024-04-25T02:09:17.298 INFO:teuthology.orchestra.run.smithi111.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-04-25T02:09:17.298 INFO:teuthology.orchestra.run.smithi111.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-04-25T02:09:17.298 INFO:teuthology.orchestra.run.smithi111.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-04-25T02:09:17.298 INFO:teuthology.orchestra.run.smithi111.stdout:Build Host : kbuilder.bsys.centos.org 2024-04-25T02:09:17.299 INFO:teuthology.orchestra.run.smithi111.stdout:Relocations : (not relocatable) 2024-04-25T02:09:17.299 INFO:teuthology.orchestra.run.smithi111.stdout:Packager : CentOS BuildSystem 2024-04-25T02:09:17.299 INFO:teuthology.orchestra.run.smithi111.stdout:Vendor : CentOS 2024-04-25T02:09:17.299 INFO:teuthology.orchestra.run.smithi111.stdout:URL : http://www.gnu.org/software/grub/ 2024-04-25T02:09:17.299 INFO:teuthology.orchestra.run.smithi111.stdout:Summary : Support tools for GRUB. 2024-04-25T02:09:17.299 INFO:teuthology.orchestra.run.smithi111.stdout:Description : 2024-04-25T02:09:17.299 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:09:17.299 INFO:teuthology.orchestra.run.smithi111.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-04-25T02:09:17.299 INFO:teuthology.orchestra.run.smithi111.stdout:customizable bootloader with modular architecture. It supports a rich 2024-04-25T02:09:17.299 INFO:teuthology.orchestra.run.smithi111.stdout:variety of kernel formats, file systems, computer architectures and 2024-04-25T02:09:17.299 INFO:teuthology.orchestra.run.smithi111.stdout:hardware devices. 2024-04-25T02:09:17.299 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:09:17.299 INFO:teuthology.orchestra.run.smithi111.stdout:This subpackage provides tools for support of all platforms. 2024-04-25T02:09:17.300 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-04-25T02:09:17.301 INFO:teuthology.task.kernel:Updating grub on smithi111 to boot 4.18.0-552.el8.x86_64 2024-04-25T02:09:17.301 DEBUG:teuthology.orchestra.run.smithi111:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-04-25T02:09:18.983 INFO:teuthology.orchestra.run.smithi111.stderr:Generating grub configuration file ... 2024-04-25T02:09:21.553 INFO:teuthology.orchestra.run.smithi111.stderr:done 2024-04-25T02:09:21.554 DEBUG:teuthology.orchestra.run.smithi111:> mktemp 2024-04-25T02:09:21.592 INFO:teuthology.orchestra.run.smithi111.stdout:/tmp/tmp.waLGsvRxEj 2024-04-25T02:09:21.592 DEBUG:teuthology.orchestra.run.smithi111:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.waLGsvRxEj 2024-04-25T02:09:21.665 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 0666 /tmp/tmp.waLGsvRxEj 2024-04-25T02:09:21.807 DEBUG:teuthology.orchestra.remote:smithi111:/tmp/tmp.waLGsvRxEj is 6KB 2024-04-25T02:09:21.855 DEBUG:teuthology.orchestra.run.smithi111:> rm -fr /tmp/tmp.waLGsvRxEj 2024-04-25T02:09:21.872 DEBUG:teuthology.orchestra.run.smithi111:> sudo /bin/ls /boot/loader/entries || true 2024-04-25T02:09:21.946 INFO:teuthology.orchestra.run.smithi111.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-04-25T02:09:21.946 INFO:teuthology.orchestra.run.smithi111.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-04-25T02:09:21.946 INFO:teuthology.orchestra.run.smithi111.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-04-25T02:09:21.946 INFO:teuthology.orchestra.run.smithi111.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64.conf 2024-04-25T02:09:21.947 DEBUG:teuthology.orchestra.run.smithi111:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-552.el8.x86_64 2024-04-25T02:09:22.092 DEBUG:teuthology.orchestra.run.smithi111:> sudo shutdown -r now 2024-04-25T02:09:34.768 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-04-25T02:09:34.769 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-04-25T02:09:34.770 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T02:09:42.617 INFO:teuthology.task.kernel:Checking client client.1 for new kernel version... 2024-04-25T02:09:42.618 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2024-04-25T02:09:42.622 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T02:09:52.102 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-25T02:09:52.102 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-04-25T02:09:52.103 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T02:09:53.182 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.114 2024-04-25T02:10:01.118 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.186 2024-04-25T02:10:02.185 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-04-25T02:10:02.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T02:10:05.246 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.114 2024-04-25T02:10:10.124 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2024-04-25T02:10:10.124 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T02:10:10.590 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-04-25T02:10:13.182 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.186 2024-04-25T02:10:17.250 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-04-25T02:10:17.251 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T02:10:19.592 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-04-25T02:10:19.593 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T02:10:22.654 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-04-25T02:10:25.184 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2024-04-25T02:10:25.185 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T02:10:34.662 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-04-25T02:10:34.663 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T02:10:37.726 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-04-25T02:10:43.614 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.186 2024-04-25T02:10:50.189 DEBUG:teuthology.orchestra.run.smithi114:> true 2024-04-25T02:10:50.812 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-04-25T02:10:50.812 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "4.18.0-552.el8.x86_64"... 2024-04-25T02:10:50.813 DEBUG:teuthology.orchestra.run.smithi114:> uname -r 2024-04-25T02:10:50.828 INFO:teuthology.orchestra.run.smithi114.stdout:4.18.0-552.el8.x86_64 2024-04-25T02:10:50.828 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-552.el8.x86_64 vs 4.18.0-552.el8.x86_64 2024-04-25T02:10:50.829 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-25T02:10:50.829 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-25T02:10:51.830 INFO:teuthology.task.kernel:Enabling kdb on client.0... 2024-04-25T02:10:51.830 DEBUG:teuthology.orchestra.run.smithi114:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T02:10:51.913 INFO:teuthology.orchestra.run.smithi114.stdout:ttyS1 2024-04-25T02:10:51.928 DEBUG:teuthology.parallel:result is None 2024-04-25T02:10:52.727 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-04-25T02:10:52.728 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T02:10:58.615 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2024-04-25T02:10:58.616 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T02:10:59.061 DEBUG:teuthology.orchestra.run.smithi186:> true 2024-04-25T02:10:59.393 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi186.front.sepia.ceph.com' 2024-04-25T02:10:59.394 INFO:teuthology.task.kernel:Checking kernel version of client.1, want "4.18.0-552.el8.x86_64"... 2024-04-25T02:10:59.394 DEBUG:teuthology.orchestra.run.smithi186:> uname -r 2024-04-25T02:10:59.410 INFO:teuthology.orchestra.run.smithi186.stdout:4.18.0-552.el8.x86_64 2024-04-25T02:10:59.410 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-552.el8.x86_64 vs 4.18.0-552.el8.x86_64 2024-04-25T02:10:59.410 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-25T02:10:59.410 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-25T02:11:00.411 INFO:teuthology.task.kernel:Enabling kdb on client.1... 2024-04-25T02:11:00.411 DEBUG:teuthology.orchestra.run.smithi186:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T02:11:00.531 INFO:teuthology.orchestra.run.smithi186.stdout:ttyS1 2024-04-25T02:11:00.544 DEBUG:teuthology.parallel:result is None 2024-04-25T02:11:11.263 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.111 2024-04-25T02:11:29.264 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-04-25T02:11:29.265 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T02:11:29.584 DEBUG:teuthology.orchestra.run.smithi111:> true 2024-04-25T02:11:29.875 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-04-25T02:11:29.875 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "4.18.0-552.el8.x86_64"... 2024-04-25T02:11:29.875 DEBUG:teuthology.orchestra.run.smithi111:> uname -r 2024-04-25T02:11:29.896 INFO:teuthology.orchestra.run.smithi111.stdout:4.18.0-552.el8.x86_64 2024-04-25T02:11:29.896 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-552.el8.x86_64 vs 4.18.0-552.el8.x86_64 2024-04-25T02:11:29.896 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-25T02:11:29.896 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-04-25T02:11:30.897 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-25T02:11:30.898 DEBUG:teuthology.orchestra.run.smithi111:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-25T02:11:30.975 INFO:teuthology.orchestra.run.smithi111.stdout:ttyS1 2024-04-25T02:11:30.990 DEBUG:teuthology.parallel:result is None 2024-04-25T02:11:30.990 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-25T02:11:30.997 INFO:teuthology.task.internal:Creating test directory... 2024-04-25T02:11:30.997 DEBUG:teuthology.orchestra.run.smithi111:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T02:11:31.000 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T02:11:31.002 DEBUG:teuthology.orchestra.run.smithi186:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-25T02:11:31.026 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-25T02:11:31.051 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-25T02:11:31.196 INFO:teuthology.task.internal:Creating archive directory... 2024-04-25T02:11:31.196 DEBUG:teuthology.orchestra.run.smithi111:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T02:11:31.199 DEBUG:teuthology.orchestra.run.smithi114:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T02:11:31.201 DEBUG:teuthology.orchestra.run.smithi186:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-25T02:11:31.248 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-25T02:11:31.265 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-25T02:11:31.265 DEBUG:teuthology.orchestra.run.smithi111:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T02:11:31.277 DEBUG:teuthology.orchestra.run.smithi114:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T02:11:31.279 DEBUG:teuthology.orchestra.run.smithi186:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-25T02:11:31.310 INFO:teuthology.orchestra.run.smithi111.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T02:11:31.320 INFO:teuthology.orchestra.run.smithi114.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T02:11:31.321 INFO:teuthology.orchestra.run.smithi111.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T02:11:31.326 INFO:teuthology.orchestra.run.smithi186.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T02:11:31.335 INFO:teuthology.orchestra.run.smithi114.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T02:11:31.338 INFO:teuthology.orchestra.run.smithi186.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-25T02:11:31.340 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-25T02:11:31.497 INFO:teuthology.task.internal:Configuring sudo... 2024-04-25T02:11:31.497 DEBUG:teuthology.orchestra.run.smithi111:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T02:11:31.500 DEBUG:teuthology.orchestra.run.smithi114:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T02:11:31.502 DEBUG:teuthology.orchestra.run.smithi186:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-25T02:11:31.534 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-25T02:11:31.569 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-25T02:11:31.569 DEBUG:teuthology.orchestra.run.smithi111:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T02:11:31.571 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T02:11:31.575 DEBUG:teuthology.orchestra.run.smithi186:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-25T02:11:31.596 DEBUG:teuthology.orchestra.run.smithi111:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T02:11:31.678 DEBUG:teuthology.orchestra.run.smithi111:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T02:11:31.724 DEBUG:teuthology.orchestra.run.smithi111:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T02:11:31.810 DEBUG:teuthology.orchestra.run.smithi111:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T02:11:31.853 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-25T02:11:31.854 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T02:11:31.921 DEBUG:teuthology.orchestra.run.smithi114:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T02:11:31.969 DEBUG:teuthology.orchestra.run.smithi114:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T02:11:32.026 DEBUG:teuthology.orchestra.run.smithi114:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T02:11:32.113 DEBUG:teuthology.orchestra.run.smithi114:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T02:11:32.157 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-25T02:11:32.157 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T02:11:32.226 DEBUG:teuthology.orchestra.run.smithi186:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T02:11:32.276 DEBUG:teuthology.orchestra.run.smithi186:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-25T02:11:32.342 DEBUG:teuthology.orchestra.run.smithi186:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T02:11:32.390 DEBUG:teuthology.orchestra.run.smithi186:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-25T02:11:32.433 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T02:11:32.433 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-25T02:11:32.501 DEBUG:teuthology.orchestra.run.smithi111:> sudo service rsyslog restart 2024-04-25T02:11:32.504 DEBUG:teuthology.orchestra.run.smithi114:> sudo service rsyslog restart 2024-04-25T02:11:32.506 DEBUG:teuthology.orchestra.run.smithi186:> sudo service rsyslog restart 2024-04-25T02:11:32.555 INFO:teuthology.orchestra.run.smithi111.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T02:11:32.576 INFO:teuthology.orchestra.run.smithi114.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T02:11:32.605 INFO:teuthology.orchestra.run.smithi186.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T02:11:33.043 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-25T02:11:33.050 INFO:teuthology.task.internal:Starting timer... 2024-04-25T02:11:33.050 INFO:teuthology.run_tasks:Running task pcp... 2024-04-25T02:11:33.111 INFO:teuthology.run_tasks:Running task selinux... 2024-04-25T02:11:33.191 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-04-25T02:11:33.192 DEBUG:teuthology.orchestra.run.smithi111:> sudo service auditd rotate 2024-04-25T02:11:33.266 INFO:teuthology.orchestra.run.smithi111.stdout:Rotating logs: 2024-04-25T02:11:33.267 DEBUG:teuthology.orchestra.run.smithi114:> sudo service auditd rotate 2024-04-25T02:11:33.340 INFO:teuthology.orchestra.run.smithi114.stdout:Rotating logs: 2024-04-25T02:11:33.342 DEBUG:teuthology.orchestra.run.smithi186:> sudo service auditd rotate 2024-04-25T02:11:33.433 INFO:teuthology.orchestra.run.smithi186.stdout:Rotating logs: 2024-04-25T02:11:33.435 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-25T02:11:33.435 DEBUG:teuthology.orchestra.run.smithi111:> /usr/sbin/getenforce 2024-04-25T02:11:33.470 INFO:teuthology.orchestra.run.smithi111.stdout:Permissive 2024-04-25T02:11:33.470 DEBUG:teuthology.orchestra.run.smithi114:> /usr/sbin/getenforce 2024-04-25T02:11:33.519 INFO:teuthology.orchestra.run.smithi114.stdout:Permissive 2024-04-25T02:11:33.520 DEBUG:teuthology.orchestra.run.smithi186:> /usr/sbin/getenforce 2024-04-25T02:11:33.618 INFO:teuthology.orchestra.run.smithi186.stdout:Permissive 2024-04-25T02:11:33.618 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi111.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi114.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi186.front.sepia.ceph.com': 'permissive'} 2024-04-25T02:11:33.618 DEBUG:teuthology.orchestra.run.smithi111:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-04-25T02:11:33.647 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:11:33.647 DEBUG:teuthology.orchestra.run.smithi114:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-04-25T02:11:33.677 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:11:33.677 DEBUG:teuthology.orchestra.run.smithi186:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-04-25T02:11:33.705 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:11:33.705 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-25T02:11:33.705 DEBUG:teuthology.orchestra.run.smithi111:> sudo /usr/sbin/setenforce permissive 2024-04-25T02:11:33.744 DEBUG:teuthology.orchestra.run.smithi114:> sudo /usr/sbin/setenforce permissive 2024-04-25T02:11:33.771 DEBUG:teuthology.orchestra.run.smithi186:> sudo /usr/sbin/setenforce permissive 2024-04-25T02:11:33.798 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-25T02:11:33.807 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-04-25T02:11:33.813 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-04-25T02:11:33.972 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-25T02:11:33.989 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-25T02:11:33.990 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi111.front.sepia.ceph.com,smithi114.front.sepia.ceph.com,smithi186.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-25T02:17:27.550 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi111.front.sepia.ceph.com'), Remote(name='ubuntu@smithi114.front.sepia.ceph.com'), Remote(name='ubuntu@smithi186.front.sepia.ceph.com')] 2024-04-25T02:17:27.554 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-04-25T02:17:27.556 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi111.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T02:17:27.630 DEBUG:teuthology.orchestra.run.smithi111:> true 2024-04-25T02:17:27.701 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi111.front.sepia.ceph.com' 2024-04-25T02:17:27.701 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-04-25T02:17:27.701 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi114.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T02:17:27.777 DEBUG:teuthology.orchestra.run.smithi114:> true 2024-04-25T02:17:27.844 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi114.front.sepia.ceph.com' 2024-04-25T02:17:27.845 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi186.front.sepia.ceph.com' 2024-04-25T02:17:27.845 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi186.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-25T02:17:27.917 DEBUG:teuthology.orchestra.run.smithi186:> true 2024-04-25T02:17:27.985 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi186.front.sepia.ceph.com' 2024-04-25T02:17:27.985 INFO:teuthology.run_tasks:Running task clock... 2024-04-25T02:17:27.998 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-25T02:17:27.998 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T02:17:27.999 DEBUG:teuthology.orchestra.run.smithi111:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T02:17:28.001 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T02:17:28.001 DEBUG:teuthology.orchestra.run.smithi114:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T02:17:28.003 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-25T02:17:28.003 DEBUG:teuthology.orchestra.run.smithi186:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T02:17:28.033 INFO:teuthology.orchestra.run.smithi111.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T02:17:28.033 INFO:teuthology.orchestra.run.smithi114.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T02:17:28.047 INFO:teuthology.orchestra.run.smithi114.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T02:17:28.047 INFO:teuthology.orchestra.run.smithi111.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T02:17:28.057 INFO:teuthology.orchestra.run.smithi186.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-04-25T02:17:28.071 INFO:teuthology.orchestra.run.smithi186.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-04-25T02:17:28.113 INFO:teuthology.orchestra.run.smithi111.stderr:sudo: ntpd: command not found 2024-04-25T02:17:28.122 INFO:teuthology.orchestra.run.smithi114.stderr:sudo: ntpd: command not found 2024-04-25T02:17:28.124 INFO:teuthology.orchestra.run.smithi111.stdout:506 Cannot talk to daemon 2024-04-25T02:17:28.132 INFO:teuthology.orchestra.run.smithi186.stderr:sudo: ntpd: command not found 2024-04-25T02:17:28.133 INFO:teuthology.orchestra.run.smithi114.stdout:506 Cannot talk to daemon 2024-04-25T02:17:28.137 INFO:teuthology.orchestra.run.smithi111.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T02:17:28.143 INFO:teuthology.orchestra.run.smithi186.stdout:506 Cannot talk to daemon 2024-04-25T02:17:28.146 INFO:teuthology.orchestra.run.smithi114.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T02:17:28.151 INFO:teuthology.orchestra.run.smithi111.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T02:17:28.156 INFO:teuthology.orchestra.run.smithi186.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-04-25T02:17:28.159 INFO:teuthology.orchestra.run.smithi114.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T02:17:28.170 INFO:teuthology.orchestra.run.smithi186.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-04-25T02:17:28.217 INFO:teuthology.orchestra.run.smithi111.stderr:bash: ntpq: command not found 2024-04-25T02:17:28.220 INFO:teuthology.orchestra.run.smithi111.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T02:17:28.220 INFO:teuthology.orchestra.run.smithi111.stdout:=============================================================================== 2024-04-25T02:17:28.220 INFO:teuthology.orchestra.run.smithi111.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:17:28.220 INFO:teuthology.orchestra.run.smithi111.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:17:28.220 INFO:teuthology.orchestra.run.smithi111.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:17:28.220 INFO:teuthology.orchestra.run.smithi111.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:17:28.232 INFO:teuthology.orchestra.run.smithi114.stderr:bash: ntpq: command not found 2024-04-25T02:17:28.235 INFO:teuthology.orchestra.run.smithi114.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T02:17:28.235 INFO:teuthology.orchestra.run.smithi114.stdout:=============================================================================== 2024-04-25T02:17:28.235 INFO:teuthology.orchestra.run.smithi114.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:17:28.235 INFO:teuthology.orchestra.run.smithi114.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:17:28.235 INFO:teuthology.orchestra.run.smithi114.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:17:28.236 INFO:teuthology.orchestra.run.smithi114.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:17:28.237 INFO:teuthology.orchestra.run.smithi186.stderr:bash: ntpq: command not found 2024-04-25T02:17:28.241 INFO:teuthology.orchestra.run.smithi186.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T02:17:28.241 INFO:teuthology.orchestra.run.smithi186.stdout:=============================================================================== 2024-04-25T02:17:28.241 INFO:teuthology.orchestra.run.smithi186.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:17:28.242 INFO:teuthology.orchestra.run.smithi186.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:17:28.242 INFO:teuthology.orchestra.run.smithi186.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:17:28.242 INFO:teuthology.orchestra.run.smithi186.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:17:28.242 INFO:teuthology.run_tasks:Running task install... 2024-04-25T02:17:28.253 DEBUG:teuthology.task.install:project ceph 2024-04-25T02:17:28.253 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}} 2024-04-25T02:17:28.253 DEBUG:teuthology.task.install:config {'branch': 'octopus', 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-volume'], 'extra_packages': ['librados2'], 'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'} 2024-04-25T02:17:28.253 INFO:teuthology.task.install:Using flavor: default 2024-04-25T02:17:28.259 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-25T02:17:28.260 INFO:teuthology.task.install:extra packages: ['librados2'] 2024-04-25T02:17:28.260 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'octopus', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-volume'], 'extra_packages': ['librados2'], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'tag': None, 'wait_for_package': False} 2024-04-25T02:17:28.260 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T02:17:28.260 INFO:teuthology.packaging:ref: None 2024-04-25T02:17:28.261 INFO:teuthology.packaging:tag: None 2024-04-25T02:17:28.261 INFO:teuthology.packaging:branch: octopus 2024-04-25T02:17:28.261 INFO:teuthology.packaging:sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T02:17:28.261 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=octopus 2024-04-25T02:17:28.263 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'octopus', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-volume'], 'extra_packages': ['librados2'], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'tag': None, 'wait_for_package': False} 2024-04-25T02:17:28.263 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T02:17:28.263 INFO:teuthology.packaging:ref: None 2024-04-25T02:17:28.263 INFO:teuthology.packaging:tag: None 2024-04-25T02:17:28.263 INFO:teuthology.packaging:branch: octopus 2024-04-25T02:17:28.263 INFO:teuthology.packaging:sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T02:17:28.263 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=octopus 2024-04-25T02:17:28.264 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'octopus', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-volume'], 'extra_packages': ['librados2'], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'tag': None, 'wait_for_package': False} 2024-04-25T02:17:28.264 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T02:17:28.265 INFO:teuthology.packaging:ref: None 2024-04-25T02:17:28.265 INFO:teuthology.packaging:tag: None 2024-04-25T02:17:28.265 INFO:teuthology.packaging:branch: octopus 2024-04-25T02:17:28.265 INFO:teuthology.packaging:sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T02:17:28.265 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=octopus 2024-04-25T02:17:28.488 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/ 2024-04-25T02:17:28.488 INFO:teuthology.task.install.rpm:Package version is 15.2.17-0 2024-04-25T02:17:28.501 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/ 2024-04-25T02:17:28.501 INFO:teuthology.task.install.rpm:Package version is 15.2.17-0 2024-04-25T02:17:28.533 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T02:17:28.533 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-25T02:17:28.533 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T02:17:28.541 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T02:17:28.541 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T02:17:28.541 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T02:17:28.560 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-immutable-object-cache, ceph-mgr, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, librados2 on remote rpm x86_64 2024-04-25T02:17:28.560 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T02:17:28.560 INFO:teuthology.packaging:ref: None 2024-04-25T02:17:28.560 INFO:teuthology.packaging:tag: None 2024-04-25T02:17:28.561 INFO:teuthology.packaging:branch: octopus 2024-04-25T02:17:28.561 INFO:teuthology.packaging:sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T02:17:28.561 DEBUG:teuthology.orchestra.run.smithi114:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/octopus/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T02:17:28.569 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-immutable-object-cache, ceph-mgr, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, librados2 on remote rpm x86_64 2024-04-25T02:17:28.570 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T02:17:28.570 INFO:teuthology.packaging:ref: None 2024-04-25T02:17:28.570 INFO:teuthology.packaging:tag: None 2024-04-25T02:17:28.570 INFO:teuthology.packaging:branch: octopus 2024-04-25T02:17:28.570 INFO:teuthology.packaging:sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T02:17:28.570 DEBUG:teuthology.orchestra.run.smithi186:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/octopus/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T02:17:28.605 INFO:teuthology.task.install.rpm:Pulling from https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/ 2024-04-25T02:17:28.606 INFO:teuthology.task.install.rpm:Package version is 15.2.17-0 2024-04-25T02:17:28.628 DEBUG:teuthology.orchestra.run.smithi114:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T02:17:28.631 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://chacra.ceph.com/r/ceph/octopus/8a82819d84cf884bd39c17e3236e0632ac146dc4/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T02:17:28.632 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-25T02:17:28.632 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T02:17:28.644 DEBUG:teuthology.orchestra.run.smithi186:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T02:17:28.662 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, ceph-immutable-object-cache, ceph-mgr, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, librados2 on remote rpm x86_64 2024-04-25T02:17:28.662 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T02:17:28.662 INFO:teuthology.packaging:ref: None 2024-04-25T02:17:28.662 INFO:teuthology.packaging:tag: None 2024-04-25T02:17:28.662 INFO:teuthology.packaging:branch: octopus 2024-04-25T02:17:28.662 INFO:teuthology.packaging:sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T02:17:28.662 DEBUG:teuthology.orchestra.run.smithi111:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/octopus/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T02:17:28.705 DEBUG:teuthology.orchestra.run.smithi114:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T02:17:28.721 DEBUG:teuthology.orchestra.run.smithi186:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T02:17:28.729 DEBUG:teuthology.orchestra.run.smithi111:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T02:17:28.772 INFO:teuthology.orchestra.run.smithi114.stdout:check_obsoletes = 1 2024-04-25T02:17:28.773 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum clean all 2024-04-25T02:17:28.787 INFO:teuthology.orchestra.run.smithi186.stdout:check_obsoletes = 1 2024-04-25T02:17:28.789 DEBUG:teuthology.orchestra.run.smithi186:> sudo yum clean all 2024-04-25T02:17:28.806 DEBUG:teuthology.orchestra.run.smithi111:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T02:17:28.871 INFO:teuthology.orchestra.run.smithi111.stdout:check_obsoletes = 1 2024-04-25T02:17:28.873 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum clean all 2024-04-25T02:17:29.038 INFO:teuthology.orchestra.run.smithi114.stdout:78 files removed 2024-04-25T02:17:29.056 INFO:teuthology.orchestra.run.smithi186.stdout:78 files removed 2024-04-25T02:17:29.066 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum -y install ceph-radosgw 2024-04-25T02:17:29.084 DEBUG:teuthology.orchestra.run.smithi186:> sudo yum -y install ceph-radosgw 2024-04-25T02:17:29.142 INFO:teuthology.orchestra.run.smithi111.stdout:78 files removed 2024-04-25T02:17:29.170 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-radosgw 2024-04-25T02:17:29.556 INFO:teuthology.orchestra.run.smithi114.stdout:ceph packages for x86_64 805 kB/s | 68 kB 00:00 2024-04-25T02:17:29.580 INFO:teuthology.orchestra.run.smithi186.stdout:ceph packages for x86_64 739 kB/s | 68 kB 00:00 2024-04-25T02:17:29.659 INFO:teuthology.orchestra.run.smithi111.stdout:ceph packages for x86_64 812 kB/s | 68 kB 00:00 2024-04-25T02:17:29.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph noarch packages 210 kB/s | 15 kB 00:00 2024-04-25T02:17:29.731 INFO:teuthology.orchestra.run.smithi186.stdout:ceph noarch packages 132 kB/s | 15 kB 00:00 2024-04-25T02:17:29.758 INFO:teuthology.orchestra.run.smithi114.stdout:ceph source packages 27 kB/s | 1.7 kB 00:00 2024-04-25T02:17:29.793 INFO:teuthology.orchestra.run.smithi111.stdout:ceph noarch packages 155 kB/s | 15 kB 00:00 2024-04-25T02:17:29.832 INFO:teuthology.orchestra.run.smithi186.stdout:ceph source packages 24 kB/s | 1.7 kB 00:00 2024-04-25T02:17:29.894 INFO:teuthology.orchestra.run.smithi111.stdout:ceph source packages 24 kB/s | 1.7 kB 00:00 2024-04-25T02:17:30.591 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 8 - AppStream 35 MB/s | 28 MB 00:00 2024-04-25T02:17:30.644 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 8 - AppStream 39 MB/s | 28 MB 00:00 2024-04-25T02:17:30.716 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 8 - AppStream 33 MB/s | 28 MB 00:00 2024-04-25T02:17:36.334 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 8 - BaseOS 13 MB/s | 10 MB 00:00 2024-04-25T02:17:36.382 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 8 - BaseOS 14 MB/s | 10 MB 00:00 2024-04-25T02:17:36.575 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 8 - BaseOS 12 MB/s | 10 MB 00:00 2024-04-25T02:17:38.403 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 8 - Extras 45 kB/s | 18 kB 00:00 2024-04-25T02:17:38.434 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 8 - Extras 35 kB/s | 18 kB 00:00 2024-04-25T02:17:38.690 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 8 - Extras common packages 44 kB/s | 7.7 kB 00:00 2024-04-25T02:17:38.734 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 8 - Extras common packages 40 kB/s | 7.7 kB 00:00 2024-04-25T02:17:38.741 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 8 - Extras 32 kB/s | 18 kB 00:00 2024-04-25T02:17:39.034 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 8 - Extras common packages 42 kB/s | 7.7 kB 00:00 2024-04-25T02:17:39.297 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 8 - PowerTools 9.6 MB/s | 5.0 MB 00:00 2024-04-25T02:17:39.528 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 8 - PowerTools 7.0 MB/s | 5.0 MB 00:00 2024-04-25T02:17:39.660 INFO:teuthology.orchestra.run.smithi186.stdout:CentOS Stream 8 - PowerTools 9.3 MB/s | 5.0 MB 00:00 2024-04-25T02:17:40.432 INFO:teuthology.orchestra.run.smithi111.stdout:Copr repo for python3-asyncssh owned by ceph 17 kB/s | 3.5 kB 00:00 2024-04-25T02:17:40.596 INFO:teuthology.orchestra.run.smithi114.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2024-04-25T02:17:40.754 INFO:teuthology.orchestra.run.smithi186.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2024-04-25T02:17:41.918 INFO:teuthology.orchestra.run.smithi111.stdout:Extra Packages for Enterprise Linux 12 MB/s | 16 MB 00:01 2024-04-25T02:17:42.888 INFO:teuthology.orchestra.run.smithi114.stdout:Extra Packages for Enterprise Linux 7.4 MB/s | 16 MB 00:02 2024-04-25T02:17:43.521 INFO:teuthology.orchestra.run.smithi186.stdout:Extra Packages for Enterprise Linux 6.1 MB/s | 16 MB 00:02 2024-04-25T02:17:45.742 INFO:teuthology.orchestra.run.smithi111.stdout:lab-extras 410 kB/s | 24 kB 00:00 2024-04-25T02:17:47.014 INFO:teuthology.orchestra.run.smithi114.stdout:lab-extras 72 kB/s | 24 kB 00:00 2024-04-25T02:17:47.322 INFO:teuthology.orchestra.run.smithi186.stdout:lab-extras 384 kB/s | 24 kB 00:00 2024-04-25T02:17:49.733 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-04-25T02:17:49.735 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-04-25T02:17:49.735 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repository Size 2024-04-25T02:17:49.735 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-04-25T02:17:49.735 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-04-25T02:17:49.736 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-radosgw x86_64 2:15.2.17-0.el8 ceph 9.9 M 2024-04-25T02:17:49.736 INFO:teuthology.orchestra.run.smithi111.stdout:Upgrading: 2024-04-25T02:17:49.736 INFO:teuthology.orchestra.run.smithi111.stdout: librados2 x86_64 2:15.2.17-0.el8 ceph 3.5 M 2024-04-25T02:17:49.736 INFO:teuthology.orchestra.run.smithi111.stdout: librbd1 x86_64 2:15.2.17-0.el8 ceph 1.9 M 2024-04-25T02:17:49.736 INFO:teuthology.orchestra.run.smithi111.stdout:Installing dependencies: 2024-04-25T02:17:49.736 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-base x86_64 2:15.2.17-0.el8 ceph 5.6 M 2024-04-25T02:17:49.736 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-common x86_64 2:15.2.17-0.el8 ceph 21 M 2024-04-25T02:17:49.736 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-selinux x86_64 2:15.2.17-0.el8 ceph 25 k 2024-04-25T02:17:49.736 INFO:teuthology.orchestra.run.smithi111.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2024-04-25T02:17:49.736 INFO:teuthology.orchestra.run.smithi111.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-25T02:17:49.736 INFO:teuthology.orchestra.run.smithi111.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2024-04-25T02:17:49.736 INFO:teuthology.orchestra.run.smithi111.stdout: libcephfs2 x86_64 2:15.2.17-0.el8 ceph 508 k 2024-04-25T02:17:49.736 INFO:teuthology.orchestra.run.smithi111.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-25T02:17:49.737 INFO:teuthology.orchestra.run.smithi111.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-04-25T02:17:49.737 INFO:teuthology.orchestra.run.smithi111.stdout: libradosstriper1 x86_64 2:15.2.17-0.el8 ceph 380 k 2024-04-25T02:17:49.737 INFO:teuthology.orchestra.run.smithi111.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-04-25T02:17:49.737 INFO:teuthology.orchestra.run.smithi111.stdout: librgw2 x86_64 2:15.2.17-0.el8 ceph 3.2 M 2024-04-25T02:17:49.737 INFO:teuthology.orchestra.run.smithi111.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-25T02:17:49.737 INFO:teuthology.orchestra.run.smithi111.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-04-25T02:17:49.737 INFO:teuthology.orchestra.run.smithi111.stdout: python3-ceph-argparse x86_64 2:15.2.17-0.el8 ceph 40 k 2024-04-25T02:17:49.737 INFO:teuthology.orchestra.run.smithi111.stdout: python3-ceph-common x86_64 2:15.2.17-0.el8 ceph 77 k 2024-04-25T02:17:49.737 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cephfs x86_64 2:15.2.17-0.el8 ceph 164 k 2024-04-25T02:17:49.737 INFO:teuthology.orchestra.run.smithi111.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-04-25T02:17:49.737 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rados x86_64 2:15.2.17-0.el8 ceph 364 k 2024-04-25T02:17:49.737 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rbd x86_64 2:15.2.17-0.el8 ceph 349 k 2024-04-25T02:17:49.737 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rgw x86_64 2:15.2.17-0.el8 ceph 113 k 2024-04-25T02:17:49.737 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:17:49.738 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-04-25T02:17:49.738 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-04-25T02:17:49.738 INFO:teuthology.orchestra.run.smithi111.stdout:Install 22 Packages 2024-04-25T02:17:49.738 INFO:teuthology.orchestra.run.smithi111.stdout:Upgrade 2 Packages 2024-04-25T02:17:49.738 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:17:49.738 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 49 M 2024-04-25T02:17:49.739 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-04-25T02:17:50.100 INFO:teuthology.orchestra.run.smithi111.stdout:(1/24): ceph-base-15.2.17-0.el8.x86_64.rpm 38 MB/s | 5.6 MB 00:00 2024-04-25T02:17:50.127 INFO:teuthology.orchestra.run.smithi111.stdout:(2/24): ceph-selinux-15.2.17-0.el8.x86_64.rpm 970 kB/s | 25 kB 00:00 2024-04-25T02:17:50.160 INFO:teuthology.orchestra.run.smithi111.stdout:(3/24): libcephfs2-15.2.17-0.el8.x86_64.rpm 15 MB/s | 508 kB 00:00 2024-04-25T02:17:50.186 INFO:teuthology.orchestra.run.smithi111.stdout:(4/24): libradosstriper1-15.2.17-0.el8.x86_64.r 15 MB/s | 380 kB 00:00 2024-04-25T02:17:50.261 INFO:teuthology.orchestra.run.smithi111.stdout:(5/24): librgw2-15.2.17-0.el8.x86_64.rpm 43 MB/s | 3.2 MB 00:00 2024-04-25T02:17:50.286 INFO:teuthology.orchestra.run.smithi111.stdout:(6/24): python3-ceph-argparse-15.2.17-0.el8.x86 1.6 MB/s | 40 kB 00:00 2024-04-25T02:17:50.320 INFO:teuthology.orchestra.run.smithi111.stdout:(7/24): python3-ceph-common-15.2.17-0.el8.x86_6 2.2 MB/s | 77 kB 00:00 2024-04-25T02:17:50.345 INFO:teuthology.orchestra.run.smithi111.stdout:(8/24): python3-cephfs-15.2.17-0.el8.x86_64.rpm 6.4 MB/s | 164 kB 00:00 2024-04-25T02:17:50.371 INFO:teuthology.orchestra.run.smithi111.stdout:(9/24): python3-rados-15.2.17-0.el8.x86_64.rpm 14 MB/s | 364 kB 00:00 2024-04-25T02:17:50.404 INFO:teuthology.orchestra.run.smithi111.stdout:(10/24): python3-rbd-15.2.17-0.el8.x86_64.rpm 10 MB/s | 349 kB 00:00 2024-04-25T02:17:50.430 INFO:teuthology.orchestra.run.smithi111.stdout:(11/24): python3-rgw-15.2.17-0.el8.x86_64.rpm 4.4 MB/s | 113 kB 00:00 2024-04-25T02:17:50.547 INFO:teuthology.orchestra.run.smithi111.stdout:(12/24): ceph-radosgw-15.2.17-0.el8.x86_64.rpm 17 MB/s | 9.9 MB 00:00 2024-04-25T02:17:50.710 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-04-25T02:17:50.713 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-04-25T02:17:50.713 INFO:teuthology.orchestra.run.smithi114.stdout: Package Arch Version Repository Size 2024-04-25T02:17:50.713 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-04-25T02:17:50.713 INFO:teuthology.orchestra.run.smithi114.stdout:Installing: 2024-04-25T02:17:50.713 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-radosgw x86_64 2:15.2.17-0.el8 ceph 9.9 M 2024-04-25T02:17:50.713 INFO:teuthology.orchestra.run.smithi114.stdout:Upgrading: 2024-04-25T02:17:50.713 INFO:teuthology.orchestra.run.smithi114.stdout: librados2 x86_64 2:15.2.17-0.el8 ceph 3.5 M 2024-04-25T02:17:50.713 INFO:teuthology.orchestra.run.smithi114.stdout: librbd1 x86_64 2:15.2.17-0.el8 ceph 1.9 M 2024-04-25T02:17:50.713 INFO:teuthology.orchestra.run.smithi114.stdout:Installing dependencies: 2024-04-25T02:17:50.713 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-base x86_64 2:15.2.17-0.el8 ceph 5.6 M 2024-04-25T02:17:50.713 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-common x86_64 2:15.2.17-0.el8 ceph 21 M 2024-04-25T02:17:50.713 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-selinux x86_64 2:15.2.17-0.el8 ceph 25 k 2024-04-25T02:17:50.713 INFO:teuthology.orchestra.run.smithi114.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2024-04-25T02:17:50.714 INFO:teuthology.orchestra.run.smithi114.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-25T02:17:50.714 INFO:teuthology.orchestra.run.smithi114.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2024-04-25T02:17:50.714 INFO:teuthology.orchestra.run.smithi114.stdout: libcephfs2 x86_64 2:15.2.17-0.el8 ceph 508 k 2024-04-25T02:17:50.714 INFO:teuthology.orchestra.run.smithi114.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-25T02:17:50.714 INFO:teuthology.orchestra.run.smithi114.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-04-25T02:17:50.714 INFO:teuthology.orchestra.run.smithi114.stdout: libradosstriper1 x86_64 2:15.2.17-0.el8 ceph 380 k 2024-04-25T02:17:50.714 INFO:teuthology.orchestra.run.smithi114.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-04-25T02:17:50.714 INFO:teuthology.orchestra.run.smithi114.stdout: librgw2 x86_64 2:15.2.17-0.el8 ceph 3.2 M 2024-04-25T02:17:50.714 INFO:teuthology.orchestra.run.smithi114.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-25T02:17:50.714 INFO:teuthology.orchestra.run.smithi114.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-04-25T02:17:50.714 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-argparse x86_64 2:15.2.17-0.el8 ceph 40 k 2024-04-25T02:17:50.714 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-common x86_64 2:15.2.17-0.el8 ceph 77 k 2024-04-25T02:17:50.715 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cephfs x86_64 2:15.2.17-0.el8 ceph 164 k 2024-04-25T02:17:50.715 INFO:teuthology.orchestra.run.smithi114.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-04-25T02:17:50.715 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rados x86_64 2:15.2.17-0.el8 ceph 364 k 2024-04-25T02:17:50.715 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rbd x86_64 2:15.2.17-0.el8 ceph 349 k 2024-04-25T02:17:50.715 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rgw x86_64 2:15.2.17-0.el8 ceph 113 k 2024-04-25T02:17:50.715 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:17:50.715 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2024-04-25T02:17:50.715 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-04-25T02:17:50.715 INFO:teuthology.orchestra.run.smithi114.stdout:Install 22 Packages 2024-04-25T02:17:50.715 INFO:teuthology.orchestra.run.smithi114.stdout:Upgrade 2 Packages 2024-04-25T02:17:50.715 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:17:50.716 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 49 M 2024-04-25T02:17:50.716 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading Packages: 2024-04-25T02:17:50.814 INFO:teuthology.orchestra.run.smithi111.stdout:(13/24): ceph-common-15.2.17-0.el8.x86_64.rpm 24 MB/s | 21 MB 00:00 2024-04-25T02:17:50.856 INFO:teuthology.orchestra.run.smithi111.stdout:(14/24): lttng-ust-2.8.1-11.el8.x86_64.rpm 841 kB/s | 259 kB 00:00 2024-04-25T02:17:50.915 INFO:teuthology.orchestra.run.smithi111.stdout:(15/24): librdkafka-1.6.1-1.el8.x86_64.rpm 1.4 MB/s | 677 kB 00:00 2024-04-25T02:17:50.940 INFO:teuthology.orchestra.run.smithi111.stdout:(16/24): python3-prettytable-0.7.2-14.el8.noarc 350 kB/s | 44 kB 00:00 2024-04-25T02:17:50.982 INFO:teuthology.orchestra.run.smithi111.stdout:(17/24): librabbitmq-0.9.0-5.el8.x86_64.rpm 374 kB/s | 47 kB 00:00 2024-04-25T02:17:51.037 INFO:teuthology.orchestra.run.smithi186.stdout:Dependencies resolved. 2024-04-25T02:17:51.039 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2024-04-25T02:17:51.040 INFO:teuthology.orchestra.run.smithi186.stdout: Package Arch Version Repository Size 2024-04-25T02:17:51.040 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2024-04-25T02:17:51.040 INFO:teuthology.orchestra.run.smithi186.stdout:Installing: 2024-04-25T02:17:51.040 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-radosgw x86_64 2:15.2.17-0.el8 ceph 9.9 M 2024-04-25T02:17:51.040 INFO:teuthology.orchestra.run.smithi186.stdout:Upgrading: 2024-04-25T02:17:51.040 INFO:teuthology.orchestra.run.smithi186.stdout: librados2 x86_64 2:15.2.17-0.el8 ceph 3.5 M 2024-04-25T02:17:51.040 INFO:teuthology.orchestra.run.smithi186.stdout: librbd1 x86_64 2:15.2.17-0.el8 ceph 1.9 M 2024-04-25T02:17:51.040 INFO:teuthology.orchestra.run.smithi186.stdout:Installing dependencies: 2024-04-25T02:17:51.040 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-base x86_64 2:15.2.17-0.el8 ceph 5.6 M 2024-04-25T02:17:51.040 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-common x86_64 2:15.2.17-0.el8 ceph 21 M 2024-04-25T02:17:51.040 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-selinux x86_64 2:15.2.17-0.el8 ceph 25 k 2024-04-25T02:17:51.040 INFO:teuthology.orchestra.run.smithi186.stdout: fmt x86_64 6.2.1-1.el8 epel 116 k 2024-04-25T02:17:51.040 INFO:teuthology.orchestra.run.smithi186.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-04-25T02:17:51.041 INFO:teuthology.orchestra.run.smithi186.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2024-04-25T02:17:51.041 INFO:teuthology.orchestra.run.smithi186.stdout: libcephfs2 x86_64 2:15.2.17-0.el8 ceph 508 k 2024-04-25T02:17:51.041 INFO:teuthology.orchestra.run.smithi186.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-04-25T02:17:51.041 INFO:teuthology.orchestra.run.smithi186.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-04-25T02:17:51.041 INFO:teuthology.orchestra.run.smithi186.stdout: libradosstriper1 x86_64 2:15.2.17-0.el8 ceph 380 k 2024-04-25T02:17:51.041 INFO:teuthology.orchestra.run.smithi186.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-04-25T02:17:51.041 INFO:teuthology.orchestra.run.smithi186.stdout: librgw2 x86_64 2:15.2.17-0.el8 ceph 3.2 M 2024-04-25T02:17:51.041 INFO:teuthology.orchestra.run.smithi186.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-04-25T02:17:51.041 INFO:teuthology.orchestra.run.smithi186.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-04-25T02:17:51.041 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ceph-argparse x86_64 2:15.2.17-0.el8 ceph 40 k 2024-04-25T02:17:51.041 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ceph-common x86_64 2:15.2.17-0.el8 ceph 77 k 2024-04-25T02:17:51.041 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cephfs x86_64 2:15.2.17-0.el8 ceph 164 k 2024-04-25T02:17:51.041 INFO:teuthology.orchestra.run.smithi186.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-04-25T02:17:51.041 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rados x86_64 2:15.2.17-0.el8 ceph 364 k 2024-04-25T02:17:51.042 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rbd x86_64 2:15.2.17-0.el8 ceph 349 k 2024-04-25T02:17:51.042 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rgw x86_64 2:15.2.17-0.el8 ceph 113 k 2024-04-25T02:17:51.042 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:17:51.042 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction Summary 2024-04-25T02:17:51.042 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2024-04-25T02:17:51.042 INFO:teuthology.orchestra.run.smithi186.stdout:Install 22 Packages 2024-04-25T02:17:51.042 INFO:teuthology.orchestra.run.smithi186.stdout:Upgrade 2 Packages 2024-04-25T02:17:51.042 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:17:51.043 INFO:teuthology.orchestra.run.smithi186.stdout:Total download size: 49 M 2024-04-25T02:17:51.043 INFO:teuthology.orchestra.run.smithi186.stdout:Downloading Packages: 2024-04-25T02:17:51.132 INFO:teuthology.orchestra.run.smithi111.stdout:(18/24): fmt-6.2.1-1.el8.x86_64.rpm 535 kB/s | 116 kB 00:00 2024-04-25T02:17:51.166 INFO:teuthology.orchestra.run.smithi111.stdout:(19/24): leveldb-1.22-1.el8.x86_64.rpm 985 kB/s | 181 kB 00:00 2024-04-25T02:17:51.191 INFO:teuthology.orchestra.run.smithi111.stdout:(20/24): gperftools-libs-2.7-9.el8.x86_64.rpm 1.2 MB/s | 306 kB 00:00 2024-04-25T02:17:51.216 INFO:teuthology.orchestra.run.smithi111.stdout:(21/24): liboath-2.6.2-3.el8.x86_64.rpm 701 kB/s | 59 kB 00:00 2024-04-25T02:17:51.242 INFO:teuthology.orchestra.run.smithi111.stdout:(22/24): libunwind-1.3.1-3.el8.x86_64.rpm 994 kB/s | 75 kB 00:00 2024-04-25T02:17:51.249 INFO:teuthology.orchestra.run.smithi114.stdout:(1/24): ceph-base-15.2.17-0.el8.x86_64.rpm 36 MB/s | 5.6 MB 00:00 2024-04-25T02:17:51.274 INFO:teuthology.orchestra.run.smithi114.stdout:(2/24): ceph-selinux-15.2.17-0.el8.x86_64.rpm 1.0 MB/s | 25 kB 00:00 2024-04-25T02:17:51.292 INFO:teuthology.orchestra.run.smithi111.stdout:(23/24): librbd1-15.2.17-0.el8.x86_64.rpm 26 MB/s | 1.9 MB 00:00 2024-04-25T02:17:51.307 INFO:teuthology.orchestra.run.smithi114.stdout:(3/24): libcephfs2-15.2.17-0.el8.x86_64.rpm 15 MB/s | 508 kB 00:00 2024-04-25T02:17:51.341 INFO:teuthology.orchestra.run.smithi114.stdout:(4/24): libradosstriper1-15.2.17-0.el8.x86_64.r 11 MB/s | 380 kB 00:00 2024-04-25T02:17:51.350 INFO:teuthology.orchestra.run.smithi111.stdout:(24/24): librados2-15.2.17-0.el8.x86_64.rpm 22 MB/s | 3.5 MB 00:00 2024-04-25T02:17:51.352 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-04-25T02:17:51.352 INFO:teuthology.orchestra.run.smithi111.stdout:Total 30 MB/s | 49 MB 00:01 2024-04-25T02:17:51.391 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-04-25T02:17:51.416 INFO:teuthology.orchestra.run.smithi114.stdout:(5/24): librgw2-15.2.17-0.el8.x86_64.rpm 43 MB/s | 3.2 MB 00:00 2024-04-25T02:17:51.435 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-04-25T02:17:51.435 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-04-25T02:17:51.442 INFO:teuthology.orchestra.run.smithi114.stdout:(6/24): python3-ceph-argparse-15.2.17-0.el8.x86 1.6 MB/s | 40 kB 00:00 2024-04-25T02:17:51.467 INFO:teuthology.orchestra.run.smithi114.stdout:(7/24): python3-ceph-common-15.2.17-0.el8.x86_6 3.0 MB/s | 77 kB 00:00 2024-04-25T02:17:51.493 INFO:teuthology.orchestra.run.smithi114.stdout:(8/24): python3-cephfs-15.2.17-0.el8.x86_64.rpm 6.3 MB/s | 164 kB 00:00 2024-04-25T02:17:51.518 INFO:teuthology.orchestra.run.smithi114.stdout:(9/24): python3-rados-15.2.17-0.el8.x86_64.rpm 14 MB/s | 364 kB 00:00 2024-04-25T02:17:51.543 INFO:teuthology.orchestra.run.smithi114.stdout:(10/24): python3-rbd-15.2.17-0.el8.x86_64.rpm 14 MB/s | 349 kB 00:00 2024-04-25T02:17:51.652 INFO:teuthology.orchestra.run.smithi114.stdout:(11/24): ceph-radosgw-15.2.17-0.el8.x86_64.rpm 18 MB/s | 9.9 MB 00:00 2024-04-25T02:17:51.669 INFO:teuthology.orchestra.run.smithi114.stdout:(12/24): python3-rgw-15.2.17-0.el8.x86_64.rpm 905 kB/s | 113 kB 00:00 2024-04-25T02:17:51.746 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-04-25T02:17:51.749 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-04-25T02:17:51.773 INFO:teuthology.orchestra.run.smithi186.stdout:(1/24): ceph-base-15.2.17-0.el8.x86_64.rpm 41 MB/s | 5.6 MB 00:00 2024-04-25T02:17:51.799 INFO:teuthology.orchestra.run.smithi186.stdout:(2/24): ceph-selinux-15.2.17-0.el8.x86_64.rpm 1.0 MB/s | 25 kB 00:00 2024-04-25T02:17:51.857 INFO:teuthology.orchestra.run.smithi186.stdout:(3/24): libcephfs2-15.2.17-0.el8.x86_64.rpm 8.6 MB/s | 508 kB 00:00 2024-04-25T02:17:51.890 INFO:teuthology.orchestra.run.smithi186.stdout:(4/24): libradosstriper1-15.2.17-0.el8.x86_64.r 11 MB/s | 380 kB 00:00 2024-04-25T02:17:51.928 INFO:teuthology.orchestra.run.smithi114.stdout:(13/24): ceph-common-15.2.17-0.el8.x86_64.rpm 25 MB/s | 21 MB 00:00 2024-04-25T02:17:51.970 INFO:teuthology.orchestra.run.smithi114.stdout:(14/24): lttng-ust-2.8.1-11.el8.x86_64.rpm 864 kB/s | 259 kB 00:00 2024-04-25T02:17:51.974 INFO:teuthology.orchestra.run.smithi186.stdout:(5/24): librgw2-15.2.17-0.el8.x86_64.rpm 39 MB/s | 3.2 MB 00:00 2024-04-25T02:17:51.999 INFO:teuthology.orchestra.run.smithi186.stdout:(6/24): python3-ceph-argparse-15.2.17-0.el8.x86 1.6 MB/s | 40 kB 00:00 2024-04-25T02:17:52.020 INFO:teuthology.orchestra.run.smithi114.stdout:(15/24): python3-prettytable-0.7.2-14.el8.noarc 478 kB/s | 44 kB 00:00 2024-04-25T02:17:52.025 INFO:teuthology.orchestra.run.smithi186.stdout:(7/24): python3-ceph-common-15.2.17-0.el8.x86_6 3.0 MB/s | 77 kB 00:00 2024-04-25T02:17:52.045 INFO:teuthology.orchestra.run.smithi114.stdout:(16/24): librdkafka-1.6.1-1.el8.x86_64.rpm 1.7 MB/s | 677 kB 00:00 2024-04-25T02:17:52.129 INFO:teuthology.orchestra.run.smithi114.stdout:(17/24): librabbitmq-0.9.0-5.el8.x86_64.rpm 296 kB/s | 47 kB 00:00 2024-04-25T02:17:52.158 INFO:teuthology.orchestra.run.smithi186.stdout:(8/24): ceph-radosgw-15.2.17-0.el8.x86_64.rpm 19 MB/s | 9.9 MB 00:00 2024-04-25T02:17:52.184 INFO:teuthology.orchestra.run.smithi186.stdout:(9/24): python3-cephfs-15.2.17-0.el8.x86_64.rpm 1.0 MB/s | 164 kB 00:00 2024-04-25T02:17:52.209 INFO:teuthology.orchestra.run.smithi186.stdout:(10/24): python3-rados-15.2.17-0.el8.x86_64.rpm 7.1 MB/s | 364 kB 00:00 2024-04-25T02:17:52.234 INFO:teuthology.orchestra.run.smithi186.stdout:(11/24): python3-rbd-15.2.17-0.el8.x86_64.rpm 6.8 MB/s | 349 kB 00:00 2024-04-25T02:17:52.259 INFO:teuthology.orchestra.run.smithi186.stdout:(12/24): python3-rgw-15.2.17-0.el8.x86_64.rpm 2.2 MB/s | 113 kB 00:00 2024-04-25T02:17:52.271 INFO:teuthology.orchestra.run.smithi114.stdout:(18/24): fmt-6.2.1-1.el8.x86_64.rpm 464 kB/s | 116 kB 00:00 2024-04-25T02:17:52.296 INFO:teuthology.orchestra.run.smithi114.stdout:(19/24): gperftools-libs-2.7-9.el8.x86_64.rpm 1.2 MB/s | 306 kB 00:00 2024-04-25T02:17:52.346 INFO:teuthology.orchestra.run.smithi114.stdout:(20/24): liboath-2.6.2-3.el8.x86_64.rpm 780 kB/s | 59 kB 00:00 2024-04-25T02:17:52.380 INFO:teuthology.orchestra.run.smithi114.stdout:(21/24): leveldb-1.22-1.el8.x86_64.rpm 721 kB/s | 181 kB 00:00 2024-04-25T02:17:52.405 INFO:teuthology.orchestra.run.smithi114.stdout:(22/24): libunwind-1.3.1-3.el8.x86_64.rpm 689 kB/s | 75 kB 00:00 2024-04-25T02:17:52.464 INFO:teuthology.orchestra.run.smithi114.stdout:(23/24): librbd1-15.2.17-0.el8.x86_64.rpm 23 MB/s | 1.9 MB 00:00 2024-04-25T02:17:52.514 INFO:teuthology.orchestra.run.smithi114.stdout:(24/24): librados2-15.2.17-0.el8.x86_64.rpm 21 MB/s | 3.5 MB 00:00 2024-04-25T02:17:52.516 INFO:teuthology.orchestra.run.smithi114.stdout:-------------------------------------------------------------------------------- 2024-04-25T02:17:52.516 INFO:teuthology.orchestra.run.smithi114.stdout:Total 27 MB/s | 49 MB 00:01 2024-04-25T02:17:52.527 INFO:teuthology.orchestra.run.smithi186.stdout:(13/24): ceph-common-15.2.17-0.el8.x86_64.rpm 23 MB/s | 21 MB 00:00 2024-04-25T02:17:52.559 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2024-04-25T02:17:52.568 INFO:teuthology.orchestra.run.smithi186.stdout:(14/24): lttng-ust-2.8.1-11.el8.x86_64.rpm 841 kB/s | 259 kB 00:00 2024-04-25T02:17:52.602 INFO:teuthology.orchestra.run.smithi186.stdout:(15/24): librdkafka-1.6.1-1.el8.x86_64.rpm 1.9 MB/s | 677 kB 00:00 2024-04-25T02:17:52.605 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction check succeeded. 2024-04-25T02:17:52.606 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2024-04-25T02:17:52.638 INFO:teuthology.orchestra.run.smithi186.stdout:(16/24): python3-prettytable-0.7.2-14.el8.noarc 405 kB/s | 44 kB 00:00 2024-04-25T02:17:52.728 INFO:teuthology.orchestra.run.smithi186.stdout:(17/24): librabbitmq-0.9.0-5.el8.x86_64.rpm 296 kB/s | 47 kB 00:00 2024-04-25T02:17:52.740 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-04-25T02:17:52.913 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded. 2024-04-25T02:17:52.916 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2024-04-25T02:17:52.947 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/26 2024-04-25T02:17:53.020 INFO:teuthology.orchestra.run.smithi186.stdout:(18/24): fmt-6.2.1-1.el8.x86_64.rpm 279 kB/s | 116 kB 00:00 2024-04-25T02:17:53.112 INFO:teuthology.orchestra.run.smithi186.stdout:(19/24): gperftools-libs-2.7-9.el8.x86_64.rpm 643 kB/s | 306 kB 00:00 2024-04-25T02:17:53.137 INFO:teuthology.orchestra.run.smithi186.stdout:(20/24): leveldb-1.22-1.el8.x86_64.rpm 442 kB/s | 181 kB 00:00 2024-04-25T02:17:53.159 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/26 2024-04-25T02:17:53.171 INFO:teuthology.orchestra.run.smithi186.stdout:(21/24): liboath-2.6.2-3.el8.x86_64.rpm 390 kB/s | 59 kB 00:00 2024-04-25T02:17:53.254 INFO:teuthology.orchestra.run.smithi186.stdout:(22/24): librbd1-15.2.17-0.el8.x86_64.rpm 23 MB/s | 1.9 MB 00:00 2024-04-25T02:17:53.288 INFO:teuthology.orchestra.run.smithi186.stdout:(23/24): libunwind-1.3.1-3.el8.x86_64.rpm 427 kB/s | 75 kB 00:00 2024-04-25T02:17:53.355 INFO:teuthology.orchestra.run.smithi186.stdout:(24/24): librados2-15.2.17-0.el8.x86_64.rpm 16 MB/s | 3.5 MB 00:00 2024-04-25T02:17:53.360 INFO:teuthology.orchestra.run.smithi186.stdout:-------------------------------------------------------------------------------- 2024-04-25T02:17:53.360 INFO:teuthology.orchestra.run.smithi186.stdout:Total 21 MB/s | 49 MB 00:02 2024-04-25T02:17:53.372 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/26 2024-04-25T02:17:53.404 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction check 2024-04-25T02:17:53.451 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction check succeeded. 2024-04-25T02:17:53.451 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction test 2024-04-25T02:17:53.736 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/26 2024-04-25T02:17:53.759 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction test succeeded. 2024-04-25T02:17:53.762 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction 2024-04-25T02:17:53.955 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : librados2-2:15.2.17-0.el8.x86_64 4/26 2024-04-25T02:17:53.964 INFO:teuthology.orchestra.run.smithi114.stdout: Preparing : 1/1 2024-04-25T02:17:54.057 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: librados2-2:15.2.17-0.el8.x86_64 4/26 2024-04-25T02:17:54.194 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/26 2024-04-25T02:17:54.311 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-rados-2:15.2.17-0.el8.x86_64 5/26 2024-04-25T02:17:54.397 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/26 2024-04-25T02:17:54.495 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libcephfs2-2:15.2.17-0.el8.x86_64 6/26 2024-04-25T02:17:54.552 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/26 2024-04-25T02:17:54.719 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: libcephfs2-2:15.2.17-0.el8.x86_64 6/26 2024-04-25T02:17:54.832 INFO:teuthology.orchestra.run.smithi186.stdout: Preparing : 1/1 2024-04-25T02:17:54.926 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/26 2024-04-25T02:17:55.077 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : fmt-6.2.1-1.el8.x86_64 1/26 2024-04-25T02:17:55.118 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : librados2-2:15.2.17-0.el8.x86_64 4/26 2024-04-25T02:17:55.213 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librados2-2:15.2.17-0.el8.x86_64 4/26 2024-04-25T02:17:55.310 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : librbd1-2:15.2.17-0.el8.x86_64 7/26 2024-04-25T02:17:55.339 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : liboath-2.6.2-3.el8.x86_64 2/26 2024-04-25T02:17:55.357 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: librbd1-2:15.2.17-0.el8.x86_64 7/26 2024-04-25T02:17:55.492 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-rados-2:15.2.17-0.el8.x86_64 5/26 2024-04-25T02:17:55.543 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 3/26 2024-04-25T02:17:55.573 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 8/26 2024-04-25T02:17:55.660 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libcephfs2-2:15.2.17-0.el8.x86_64 6/26 2024-04-25T02:17:55.893 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: libcephfs2-2:15.2.17-0.el8.x86_64 6/26 2024-04-25T02:17:55.903 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 3/26 2024-04-25T02:17:56.002 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 9/26 2024-04-25T02:17:56.093 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : librbd1-2:15.2.17-0.el8.x86_64 7/26 2024-04-25T02:17:56.094 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : librados2-2:15.2.17-0.el8.x86_64 4/26 2024-04-25T02:17:56.155 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : librgw2-2:15.2.17-0.el8.x86_64 10/26 2024-04-25T02:17:56.162 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librbd1-2:15.2.17-0.el8.x86_64 7/26 2024-04-25T02:17:56.186 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: librados2-2:15.2.17-0.el8.x86_64 4/26 2024-04-25T02:17:56.229 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: librgw2-2:15.2.17-0.el8.x86_64 10/26 2024-04-25T02:17:56.386 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 8/26 2024-04-25T02:17:56.442 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : leveldb-1.22-1.el8.x86_64 11/26 2024-04-25T02:17:56.450 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-rados-2:15.2.17-0.el8.x86_64 5/26 2024-04-25T02:17:56.606 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-ceph-argparse-2:15.2.17-0.el8.x86_64 12/26 2024-04-25T02:17:56.660 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libcephfs2-2:15.2.17-0.el8.x86_64 6/26 2024-04-25T02:17:56.783 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-cephfs-2:15.2.17-0.el8.x86_64 13/26 2024-04-25T02:17:56.856 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 9/26 2024-04-25T02:17:56.890 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libcephfs2-2:15.2.17-0.el8.x86_64 6/26 2024-04-25T02:17:56.988 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-rgw-2:15.2.17-0.el8.x86_64 14/26 2024-04-25T02:17:57.018 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : librgw2-2:15.2.17-0.el8.x86_64 10/26 2024-04-25T02:17:57.135 INFO:teuthology.orchestra.run.smithi186.stdout: Upgrading : librbd1-2:15.2.17-0.el8.x86_64 7/26 2024-04-25T02:17:57.138 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librgw2-2:15.2.17-0.el8.x86_64 10/26 2024-04-25T02:17:57.194 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: librbd1-2:15.2.17-0.el8.x86_64 7/26 2024-04-25T02:17:57.211 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-rbd-2:15.2.17-0.el8.x86_64 15/26 2024-04-25T02:17:57.346 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libradosstriper1-2:15.2.17-0.el8.x86_64 16/26 2024-04-25T02:17:57.348 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : leveldb-1.22-1.el8.x86_64 11/26 2024-04-25T02:17:57.411 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 8/26 2024-04-25T02:17:57.417 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: libradosstriper1-2:15.2.17-0.el8.x86_64 16/26 2024-04-25T02:17:57.502 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-ceph-argparse-2:15.2.17-0.el8.x86_64 12/26 2024-04-25T02:17:57.630 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 17/26 2024-04-25T02:17:57.667 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cephfs-2:15.2.17-0.el8.x86_64 13/26 2024-04-25T02:17:57.846 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 18/26 2024-04-25T02:17:57.884 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-rgw-2:15.2.17-0.el8.x86_64 14/26 2024-04-25T02:17:57.888 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 9/26 2024-04-25T02:17:58.030 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 19/26 2024-04-25T02:17:58.077 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : librgw2-2:15.2.17-0.el8.x86_64 10/26 2024-04-25T02:17:58.111 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-rbd-2:15.2.17-0.el8.x86_64 15/26 2024-04-25T02:17:58.150 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: librgw2-2:15.2.17-0.el8.x86_64 10/26 2024-04-25T02:17:58.213 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-ceph-common-2:15.2.17-0.el8.x86_64 20/26 2024-04-25T02:17:58.285 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libradosstriper1-2:15.2.17-0.el8.x86_64 16/26 2024-04-25T02:17:58.347 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: libradosstriper1-2:15.2.17-0.el8.x86_64 16/26 2024-04-25T02:17:58.348 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : leveldb-1.22-1.el8.x86_64 11/26 2024-04-25T02:17:58.535 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-ceph-argparse-2:15.2.17-0.el8.x86_64 12/26 2024-04-25T02:17:58.578 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 17/26 2024-04-25T02:17:58.705 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cephfs-2:15.2.17-0.el8.x86_64 13/26 2024-04-25T02:17:58.759 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 18/26 2024-04-25T02:17:58.918 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-rgw-2:15.2.17-0.el8.x86_64 14/26 2024-04-25T02:17:58.978 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 19/26 2024-04-25T02:17:59.143 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-rbd-2:15.2.17-0.el8.x86_64 15/26 2024-04-25T02:17:59.185 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-ceph-common-2:15.2.17-0.el8.x86_64 20/26 2024-04-25T02:17:59.268 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libradosstriper1-2:15.2.17-0.el8.x86_64 16/26 2024-04-25T02:17:59.363 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libradosstriper1-2:15.2.17-0.el8.x86_64 16/26 2024-04-25T02:17:59.619 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 17/26 2024-04-25T02:17:59.801 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 18/26 2024-04-25T02:17:59.984 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 19/26 2024-04-25T02:18:00.185 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-ceph-common-2:15.2.17-0.el8.x86_64 20/26 2024-04-25T02:18:00.353 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-common-2:15.2.17-0.el8.x86_64 21/26 2024-04-25T02:18:00.613 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-common-2:15.2.17-0.el8.x86_64 21/26 2024-04-25T02:18:01.259 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-common-2:15.2.17-0.el8.x86_64 21/26 2024-04-25T02:18:01.395 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-common-2:15.2.17-0.el8.x86_64 21/26 2024-04-25T02:18:01.535 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-base-2:15.2.17-0.el8.x86_64 22/26 2024-04-25T02:18:01.601 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-common-2:15.2.17-0.el8.x86_64 21/26 2024-04-25T02:18:01.639 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-base-2:15.2.17-0.el8.x86_64 22/26 2024-04-25T02:18:01.787 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-selinux-2:15.2.17-0.el8.x86_64 23/26 2024-04-25T02:18:02.242 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-common-2:15.2.17-0.el8.x86_64 21/26 2024-04-25T02:18:02.486 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-common-2:15.2.17-0.el8.x86_64 21/26 2024-04-25T02:18:02.570 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-base-2:15.2.17-0.el8.x86_64 22/26 2024-04-25T02:18:02.662 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-base-2:15.2.17-0.el8.x86_64 22/26 2024-04-25T02:18:02.726 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-common-2:15.2.17-0.el8.x86_64 21/26 2024-04-25T02:18:02.793 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-selinux-2:15.2.17-0.el8.x86_64 23/26 2024-04-25T02:18:03.385 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-common-2:15.2.17-0.el8.x86_64 21/26 2024-04-25T02:18:03.656 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-base-2:15.2.17-0.el8.x86_64 22/26 2024-04-25T02:18:03.795 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-base-2:15.2.17-0.el8.x86_64 22/26 2024-04-25T02:18:03.909 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-selinux-2:15.2.17-0.el8.x86_64 23/26 2024-04-25T02:18:21.341 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-selinux-2:15.2.17-0.el8.x86_64 23/26 2024-04-25T02:18:21.341 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /sys 2024-04-25T02:18:21.341 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /proc 2024-04-25T02:18:21.341 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /dev 2024-04-25T02:18:21.341 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /run 2024-04-25T02:18:21.341 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /mnt 2024-04-25T02:18:21.341 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /var/tmp 2024-04-25T02:18:21.341 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /home 2024-04-25T02:18:21.341 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /tmp 2024-04-25T02:18:21.341 INFO:teuthology.orchestra.run.smithi114.stdout:skipping the directory /dev 2024-04-25T02:18:21.341 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:18:21.369 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-selinux-2:15.2.17-0.el8.x86_64 23/26 2024-04-25T02:18:21.369 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /sys 2024-04-25T02:18:21.369 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /proc 2024-04-25T02:18:21.369 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /dev 2024-04-25T02:18:21.369 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /run 2024-04-25T02:18:21.370 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /mnt 2024-04-25T02:18:21.370 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /var/tmp 2024-04-25T02:18:21.370 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /home 2024-04-25T02:18:21.370 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /tmp 2024-04-25T02:18:21.370 INFO:teuthology.orchestra.run.smithi111.stdout:skipping the directory /dev 2024-04-25T02:18:21.370 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:18:22.367 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-radosgw-2:15.2.17-0.el8.x86_64 24/26 2024-04-25T02:18:22.446 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-radosgw-2:15.2.17-0.el8.x86_64 24/26 2024-04-25T02:18:22.446 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 25/26 2024-04-25T02:18:22.448 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-radosgw-2:15.2.17-0.el8.x86_64 24/26 2024-04-25T02:18:22.523 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-radosgw-2:15.2.17-0.el8.x86_64 24/26 2024-04-25T02:18:22.523 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 25/26 2024-04-25T02:18:22.650 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 25/26 2024-04-25T02:18:22.650 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 26/26 2024-04-25T02:18:22.711 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 25/26 2024-04-25T02:18:22.711 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 26/26 2024-04-25T02:18:22.926 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-selinux-2:15.2.17-0.el8.x86_64 23/26 2024-04-25T02:18:22.926 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /sys 2024-04-25T02:18:22.926 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /proc 2024-04-25T02:18:22.926 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /dev 2024-04-25T02:18:22.926 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /run 2024-04-25T02:18:22.926 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /mnt 2024-04-25T02:18:22.926 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /var/tmp 2024-04-25T02:18:22.926 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /home 2024-04-25T02:18:22.926 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /tmp 2024-04-25T02:18:22.926 INFO:teuthology.orchestra.run.smithi186.stdout:skipping the directory /dev 2024-04-25T02:18:22.927 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:18:23.317 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 26/26 2024-04-25T02:18:23.317 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-base-2:15.2.17-0.el8.x86_64 1/26 2024-04-25T02:18:23.317 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-common-2:15.2.17-0.el8.x86_64 2/26 2024-04-25T02:18:23.317 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-radosgw-2:15.2.17-0.el8.x86_64 3/26 2024-04-25T02:18:23.317 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-selinux-2:15.2.17-0.el8.x86_64 4/26 2024-04-25T02:18:23.318 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libcephfs2-2:15.2.17-0.el8.x86_64 5/26 2024-04-25T02:18:23.318 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libradosstriper1-2:15.2.17-0.el8.x86_64 6/26 2024-04-25T02:18:23.318 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librgw2-2:15.2.17-0.el8.x86_64 7/26 2024-04-25T02:18:23.318 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-ceph-argparse-2:15.2.17-0.el8.x86_64 8/26 2024-04-25T02:18:23.318 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-ceph-common-2:15.2.17-0.el8.x86_64 9/26 2024-04-25T02:18:23.318 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cephfs-2:15.2.17-0.el8.x86_64 10/26 2024-04-25T02:18:23.318 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-rados-2:15.2.17-0.el8.x86_64 11/26 2024-04-25T02:18:23.318 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-rbd-2:15.2.17-0.el8.x86_64 12/26 2024-04-25T02:18:23.318 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-rgw-2:15.2.17-0.el8.x86_64 13/26 2024-04-25T02:18:23.318 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 14/26 2024-04-25T02:18:23.318 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/26 2024-04-25T02:18:23.318 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/26 2024-04-25T02:18:23.318 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 17/26 2024-04-25T02:18:23.319 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 18/26 2024-04-25T02:18:23.319 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 19/26 2024-04-25T02:18:23.319 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : leveldb-1.22-1.el8.x86_64 20/26 2024-04-25T02:18:23.319 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 21/26 2024-04-25T02:18:23.319 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 22/26 2024-04-25T02:18:23.319 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librados2-2:15.2.17-0.el8.x86_64 23/26 2024-04-25T02:18:23.319 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 24/26 2024-04-25T02:18:23.319 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librbd1-2:15.2.17-0.el8.x86_64 25/26 2024-04-25T02:18:23.371 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 26/26 2024-04-25T02:18:23.371 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-base-2:15.2.17-0.el8.x86_64 1/26 2024-04-25T02:18:23.372 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-common-2:15.2.17-0.el8.x86_64 2/26 2024-04-25T02:18:23.372 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-radosgw-2:15.2.17-0.el8.x86_64 3/26 2024-04-25T02:18:23.372 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-selinux-2:15.2.17-0.el8.x86_64 4/26 2024-04-25T02:18:23.372 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libcephfs2-2:15.2.17-0.el8.x86_64 5/26 2024-04-25T02:18:23.372 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libradosstriper1-2:15.2.17-0.el8.x86_64 6/26 2024-04-25T02:18:23.372 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librgw2-2:15.2.17-0.el8.x86_64 7/26 2024-04-25T02:18:23.372 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-ceph-argparse-2:15.2.17-0.el8.x86_64 8/26 2024-04-25T02:18:23.372 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-ceph-common-2:15.2.17-0.el8.x86_64 9/26 2024-04-25T02:18:23.372 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-cephfs-2:15.2.17-0.el8.x86_64 10/26 2024-04-25T02:18:23.372 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-rados-2:15.2.17-0.el8.x86_64 11/26 2024-04-25T02:18:23.372 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-rbd-2:15.2.17-0.el8.x86_64 12/26 2024-04-25T02:18:23.372 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-rgw-2:15.2.17-0.el8.x86_64 13/26 2024-04-25T02:18:23.372 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 14/26 2024-04-25T02:18:23.372 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/26 2024-04-25T02:18:23.373 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/26 2024-04-25T02:18:23.373 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 17/26 2024-04-25T02:18:23.373 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 18/26 2024-04-25T02:18:23.373 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 19/26 2024-04-25T02:18:23.373 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : leveldb-1.22-1.el8.x86_64 20/26 2024-04-25T02:18:23.373 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 21/26 2024-04-25T02:18:23.373 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 22/26 2024-04-25T02:18:23.373 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librados2-2:15.2.17-0.el8.x86_64 23/26 2024-04-25T02:18:23.373 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 24/26 2024-04-25T02:18:23.373 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librbd1-2:15.2.17-0.el8.x86_64 25/26 2024-04-25T02:18:23.969 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-radosgw-2:15.2.17-0.el8.x86_64 24/26 2024-04-25T02:18:24.035 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-radosgw-2:15.2.17-0.el8.x86_64 24/26 2024-04-25T02:18:24.035 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 25/26 2024-04-25T02:18:24.253 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 26/26 2024-04-25T02:18:24.253 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:18:24.253 INFO:teuthology.orchestra.run.smithi114.stdout:Upgraded: 2024-04-25T02:18:24.253 INFO:teuthology.orchestra.run.smithi114.stdout: librados2-2:15.2.17-0.el8.x86_64 librbd1-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:24.253 INFO:teuthology.orchestra.run.smithi114.stdout:Installed: 2024-04-25T02:18:24.253 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-base-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:24.253 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-common-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:24.254 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-radosgw-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:24.254 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-selinux-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:24.254 INFO:teuthology.orchestra.run.smithi114.stdout: fmt-6.2.1-1.el8.x86_64 2024-04-25T02:18:24.254 INFO:teuthology.orchestra.run.smithi114.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-25T02:18:24.254 INFO:teuthology.orchestra.run.smithi114.stdout: leveldb-1.22-1.el8.x86_64 2024-04-25T02:18:24.254 INFO:teuthology.orchestra.run.smithi114.stdout: libcephfs2-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:24.254 INFO:teuthology.orchestra.run.smithi114.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-25T02:18:24.254 INFO:teuthology.orchestra.run.smithi114.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-04-25T02:18:24.254 INFO:teuthology.orchestra.run.smithi114.stdout: libradosstriper1-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:24.254 INFO:teuthology.orchestra.run.smithi114.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-04-25T02:18:24.255 INFO:teuthology.orchestra.run.smithi114.stdout: librgw2-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:24.255 INFO:teuthology.orchestra.run.smithi114.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-25T02:18:24.255 INFO:teuthology.orchestra.run.smithi114.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-25T02:18:24.255 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-argparse-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:24.255 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-common-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:24.255 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cephfs-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:24.255 INFO:teuthology.orchestra.run.smithi114.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-25T02:18:24.255 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rados-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:24.255 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rbd-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:24.255 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rgw-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:24.255 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:18:24.255 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-04-25T02:18:24.266 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 25/26 2024-04-25T02:18:24.266 INFO:teuthology.orchestra.run.smithi186.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 26/26 2024-04-25T02:18:24.289 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 26/26 2024-04-25T02:18:24.289 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:18:24.289 INFO:teuthology.orchestra.run.smithi111.stdout:Upgraded: 2024-04-25T02:18:24.289 INFO:teuthology.orchestra.run.smithi111.stdout: librados2-2:15.2.17-0.el8.x86_64 librbd1-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:24.289 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-04-25T02:18:24.289 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-base-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:24.289 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-common-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:24.290 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-radosgw-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:24.290 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-selinux-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:24.290 INFO:teuthology.orchestra.run.smithi111.stdout: fmt-6.2.1-1.el8.x86_64 2024-04-25T02:18:24.290 INFO:teuthology.orchestra.run.smithi111.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-25T02:18:24.290 INFO:teuthology.orchestra.run.smithi111.stdout: leveldb-1.22-1.el8.x86_64 2024-04-25T02:18:24.290 INFO:teuthology.orchestra.run.smithi111.stdout: libcephfs2-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:24.290 INFO:teuthology.orchestra.run.smithi111.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-25T02:18:24.291 INFO:teuthology.orchestra.run.smithi111.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-04-25T02:18:24.291 INFO:teuthology.orchestra.run.smithi111.stdout: libradosstriper1-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:24.291 INFO:teuthology.orchestra.run.smithi111.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-04-25T02:18:24.291 INFO:teuthology.orchestra.run.smithi111.stdout: librgw2-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:24.291 INFO:teuthology.orchestra.run.smithi111.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-25T02:18:24.291 INFO:teuthology.orchestra.run.smithi111.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-25T02:18:24.291 INFO:teuthology.orchestra.run.smithi111.stdout: python3-ceph-argparse-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:24.291 INFO:teuthology.orchestra.run.smithi111.stdout: python3-ceph-common-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:24.292 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cephfs-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:24.292 INFO:teuthology.orchestra.run.smithi111.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-25T02:18:24.292 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rados-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:24.292 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rbd-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:24.292 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rgw-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:24.292 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:18:24.292 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-04-25T02:18:24.538 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum -y install ceph-test 2024-04-25T02:18:24.590 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-test 2024-04-25T02:18:24.960 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 26/26 2024-04-25T02:18:24.960 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-base-2:15.2.17-0.el8.x86_64 1/26 2024-04-25T02:18:24.960 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-common-2:15.2.17-0.el8.x86_64 2/26 2024-04-25T02:18:24.960 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-radosgw-2:15.2.17-0.el8.x86_64 3/26 2024-04-25T02:18:24.960 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-selinux-2:15.2.17-0.el8.x86_64 4/26 2024-04-25T02:18:24.960 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libcephfs2-2:15.2.17-0.el8.x86_64 5/26 2024-04-25T02:18:24.960 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libradosstriper1-2:15.2.17-0.el8.x86_64 6/26 2024-04-25T02:18:24.960 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librgw2-2:15.2.17-0.el8.x86_64 7/26 2024-04-25T02:18:24.961 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-ceph-argparse-2:15.2.17-0.el8.x86_64 8/26 2024-04-25T02:18:24.961 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-ceph-common-2:15.2.17-0.el8.x86_64 9/26 2024-04-25T02:18:24.961 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cephfs-2:15.2.17-0.el8.x86_64 10/26 2024-04-25T02:18:24.961 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-rados-2:15.2.17-0.el8.x86_64 11/26 2024-04-25T02:18:24.961 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-rbd-2:15.2.17-0.el8.x86_64 12/26 2024-04-25T02:18:24.961 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-rgw-2:15.2.17-0.el8.x86_64 13/26 2024-04-25T02:18:24.961 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 14/26 2024-04-25T02:18:24.961 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/26 2024-04-25T02:18:24.961 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/26 2024-04-25T02:18:24.961 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 17/26 2024-04-25T02:18:24.961 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : fmt-6.2.1-1.el8.x86_64 18/26 2024-04-25T02:18:24.961 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 19/26 2024-04-25T02:18:24.961 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : leveldb-1.22-1.el8.x86_64 20/26 2024-04-25T02:18:24.962 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 21/26 2024-04-25T02:18:24.962 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 22/26 2024-04-25T02:18:24.962 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librados2-2:15.2.17-0.el8.x86_64 23/26 2024-04-25T02:18:24.962 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 24/26 2024-04-25T02:18:24.962 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librbd1-2:15.2.17-0.el8.x86_64 25/26 2024-04-25T02:18:25.266 INFO:teuthology.orchestra.run.smithi114.stdout:Last metadata expiration check: 0:00:39 ago on Thu 25 Apr 2024 02:17:46 AM UTC. 2024-04-25T02:18:25.316 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:00:40 ago on Thu 25 Apr 2024 02:17:45 AM UTC. 2024-04-25T02:18:25.865 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 26/26 2024-04-25T02:18:25.865 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:18:25.865 INFO:teuthology.orchestra.run.smithi186.stdout:Upgraded: 2024-04-25T02:18:25.865 INFO:teuthology.orchestra.run.smithi186.stdout: librados2-2:15.2.17-0.el8.x86_64 librbd1-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:25.865 INFO:teuthology.orchestra.run.smithi186.stdout:Installed: 2024-04-25T02:18:25.865 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-base-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:25.865 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-common-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:25.865 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-radosgw-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:25.866 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-selinux-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:25.866 INFO:teuthology.orchestra.run.smithi186.stdout: fmt-6.2.1-1.el8.x86_64 2024-04-25T02:18:25.866 INFO:teuthology.orchestra.run.smithi186.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-04-25T02:18:25.866 INFO:teuthology.orchestra.run.smithi186.stdout: leveldb-1.22-1.el8.x86_64 2024-04-25T02:18:25.866 INFO:teuthology.orchestra.run.smithi186.stdout: libcephfs2-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:25.866 INFO:teuthology.orchestra.run.smithi186.stdout: liboath-2.6.2-3.el8.x86_64 2024-04-25T02:18:25.866 INFO:teuthology.orchestra.run.smithi186.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-04-25T02:18:25.866 INFO:teuthology.orchestra.run.smithi186.stdout: libradosstriper1-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:25.866 INFO:teuthology.orchestra.run.smithi186.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-04-25T02:18:25.866 INFO:teuthology.orchestra.run.smithi186.stdout: librgw2-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:25.866 INFO:teuthology.orchestra.run.smithi186.stdout: libunwind-1.3.1-3.el8.x86_64 2024-04-25T02:18:25.866 INFO:teuthology.orchestra.run.smithi186.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-04-25T02:18:25.866 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ceph-argparse-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:25.866 INFO:teuthology.orchestra.run.smithi186.stdout: python3-ceph-common-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:25.867 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cephfs-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:25.867 INFO:teuthology.orchestra.run.smithi186.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-04-25T02:18:25.867 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rados-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:25.867 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rbd-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:25.867 INFO:teuthology.orchestra.run.smithi186.stdout: python3-rgw-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:25.867 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:18:25.867 INFO:teuthology.orchestra.run.smithi186.stdout:Complete! 2024-04-25T02:18:26.223 DEBUG:teuthology.orchestra.run.smithi186:> sudo yum -y install ceph-test 2024-04-25T02:18:26.932 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-04-25T02:18:26.933 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-04-25T02:18:26.933 INFO:teuthology.orchestra.run.smithi114.stdout: Package Architecture Version Repository Size 2024-04-25T02:18:26.933 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-04-25T02:18:26.933 INFO:teuthology.orchestra.run.smithi114.stdout:Installing: 2024-04-25T02:18:26.933 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-test x86_64 2:15.2.17-0.el8 ceph 42 M 2024-04-25T02:18:26.934 INFO:teuthology.orchestra.run.smithi114.stdout:Installing dependencies: 2024-04-25T02:18:26.934 INFO:teuthology.orchestra.run.smithi114.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-04-25T02:18:26.934 INFO:teuthology.orchestra.run.smithi114.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-04-25T02:18:26.934 INFO:teuthology.orchestra.run.smithi114.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-04-25T02:18:26.934 INFO:teuthology.orchestra.run.smithi114.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-04-25T02:18:26.934 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:18:26.935 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2024-04-25T02:18:26.935 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-04-25T02:18:26.935 INFO:teuthology.orchestra.run.smithi114.stdout:Install 5 Packages 2024-04-25T02:18:26.935 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:18:26.936 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 43 M 2024-04-25T02:18:26.936 INFO:teuthology.orchestra.run.smithi114.stdout:Installed size: 155 M 2024-04-25T02:18:26.936 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading Packages: 2024-04-25T02:18:26.956 INFO:teuthology.orchestra.run.smithi186.stdout:Last metadata expiration check: 0:00:39 ago on Thu 25 Apr 2024 02:17:47 AM UTC. 2024-04-25T02:18:26.967 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-04-25T02:18:26.968 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-04-25T02:18:26.968 INFO:teuthology.orchestra.run.smithi111.stdout: Package Architecture Version Repository Size 2024-04-25T02:18:26.968 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-04-25T02:18:26.968 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-04-25T02:18:26.969 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-test x86_64 2:15.2.17-0.el8 ceph 42 M 2024-04-25T02:18:26.969 INFO:teuthology.orchestra.run.smithi111.stdout:Installing dependencies: 2024-04-25T02:18:26.969 INFO:teuthology.orchestra.run.smithi111.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-04-25T02:18:26.969 INFO:teuthology.orchestra.run.smithi111.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-04-25T02:18:26.969 INFO:teuthology.orchestra.run.smithi111.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-04-25T02:18:26.969 INFO:teuthology.orchestra.run.smithi111.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-04-25T02:18:26.969 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:18:26.969 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-04-25T02:18:26.969 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-04-25T02:18:26.969 INFO:teuthology.orchestra.run.smithi111.stdout:Install 5 Packages 2024-04-25T02:18:26.969 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:18:26.970 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 43 M 2024-04-25T02:18:26.970 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 155 M 2024-04-25T02:18:26.970 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-04-25T02:18:27.121 INFO:teuthology.orchestra.run.smithi114.stdout:(1/5): oniguruma-6.8.2-3.el8.x86_64.rpm 1.5 MB/s | 188 kB 00:00 2024-04-25T02:18:27.146 INFO:teuthology.orchestra.run.smithi114.stdout:(2/5): jq-1.6-8.el8.x86_64.rpm 1.3 MB/s | 203 kB 00:00 2024-04-25T02:18:27.188 INFO:teuthology.orchestra.run.smithi114.stdout:(3/5): socat-1.7.4.1-1.el8.x86_64.rpm 4.7 MB/s | 323 kB 00:00 2024-04-25T02:18:27.213 INFO:teuthology.orchestra.run.smithi114.stdout:(4/5): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.0 MB/s | 71 kB 00:00 2024-04-25T02:18:27.300 INFO:teuthology.orchestra.run.smithi111.stdout:(1/5): oniguruma-6.8.2-3.el8.x86_64.rpm 1.4 MB/s | 188 kB 00:00 2024-04-25T02:18:27.325 INFO:teuthology.orchestra.run.smithi111.stdout:(2/5): jq-1.6-8.el8.x86_64.rpm 1.3 MB/s | 203 kB 00:00 2024-04-25T02:18:27.367 INFO:teuthology.orchestra.run.smithi111.stdout:(3/5): socat-1.7.4.1-1.el8.x86_64.rpm 4.8 MB/s | 323 kB 00:00 2024-04-25T02:18:27.392 INFO:teuthology.orchestra.run.smithi111.stdout:(4/5): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.0 MB/s | 71 kB 00:00 2024-04-25T02:18:27.647 INFO:teuthology.orchestra.run.smithi114.stdout:(5/5): ceph-test-15.2.17-0.el8.x86_64.rpm 65 MB/s | 42 MB 00:00 2024-04-25T02:18:27.648 INFO:teuthology.orchestra.run.smithi114.stdout:-------------------------------------------------------------------------------- 2024-04-25T02:18:27.648 INFO:teuthology.orchestra.run.smithi114.stdout:Total 60 MB/s | 43 MB 00:00 2024-04-25T02:18:27.689 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2024-04-25T02:18:27.709 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction check succeeded. 2024-04-25T02:18:27.709 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2024-04-25T02:18:27.818 INFO:teuthology.orchestra.run.smithi111.stdout:(5/5): ceph-test-15.2.17-0.el8.x86_64.rpm 65 MB/s | 42 MB 00:00 2024-04-25T02:18:27.819 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-04-25T02:18:27.819 INFO:teuthology.orchestra.run.smithi111.stdout:Total 50 MB/s | 43 MB 00:00 2024-04-25T02:18:27.860 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-04-25T02:18:27.879 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-04-25T02:18:27.880 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-04-25T02:18:27.984 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded. 2024-04-25T02:18:27.987 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2024-04-25T02:18:28.159 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-04-25T02:18:28.162 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-04-25T02:18:28.409 INFO:teuthology.orchestra.run.smithi114.stdout: Preparing : 1/1 2024-04-25T02:18:28.567 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-04-25T02:18:28.579 INFO:teuthology.orchestra.run.smithi186.stdout:Dependencies resolved. 2024-04-25T02:18:28.580 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2024-04-25T02:18:28.581 INFO:teuthology.orchestra.run.smithi186.stdout: Package Architecture Version Repository Size 2024-04-25T02:18:28.581 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2024-04-25T02:18:28.581 INFO:teuthology.orchestra.run.smithi186.stdout:Installing: 2024-04-25T02:18:28.581 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-test x86_64 2:15.2.17-0.el8 ceph 42 M 2024-04-25T02:18:28.581 INFO:teuthology.orchestra.run.smithi186.stdout:Installing dependencies: 2024-04-25T02:18:28.581 INFO:teuthology.orchestra.run.smithi186.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-04-25T02:18:28.581 INFO:teuthology.orchestra.run.smithi186.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-04-25T02:18:28.581 INFO:teuthology.orchestra.run.smithi186.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-04-25T02:18:28.581 INFO:teuthology.orchestra.run.smithi186.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-04-25T02:18:28.581 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:18:28.581 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction Summary 2024-04-25T02:18:28.581 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2024-04-25T02:18:28.581 INFO:teuthology.orchestra.run.smithi186.stdout:Install 5 Packages 2024-04-25T02:18:28.581 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:18:28.582 INFO:teuthology.orchestra.run.smithi186.stdout:Total download size: 43 M 2024-04-25T02:18:28.582 INFO:teuthology.orchestra.run.smithi186.stdout:Installed size: 155 M 2024-04-25T02:18:28.582 INFO:teuthology.orchestra.run.smithi186.stdout:Downloading Packages: 2024-04-25T02:18:28.625 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/5 2024-04-25T02:18:28.778 INFO:teuthology.orchestra.run.smithi186.stdout:(1/5): oniguruma-6.8.2-3.el8.x86_64.rpm 1.4 MB/s | 188 kB 00:00 2024-04-25T02:18:28.823 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/5 2024-04-25T02:18:28.823 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/5 2024-04-25T02:18:28.823 INFO:teuthology.orchestra.run.smithi186.stdout:(2/5): jq-1.6-8.el8.x86_64.rpm 1.3 MB/s | 203 kB 00:00 2024-04-25T02:18:28.845 INFO:teuthology.orchestra.run.smithi186.stdout:(3/5): socat-1.7.4.1-1.el8.x86_64.rpm 4.7 MB/s | 323 kB 00:00 2024-04-25T02:18:28.900 INFO:teuthology.orchestra.run.smithi186.stdout:(4/5): xmlstarlet-1.6.1-20.el8.x86_64.rpm 724 kB/s | 71 kB 00:00 2024-04-25T02:18:28.939 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 3/5 2024-04-25T02:18:28.986 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/5 2024-04-25T02:18:29.018 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 3/5 2024-04-25T02:18:29.108 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 3/5 2024-04-25T02:18:29.189 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 3/5 2024-04-25T02:18:29.353 INFO:teuthology.orchestra.run.smithi186.stdout:(5/5): ceph-test-15.2.17-0.el8.x86_64.rpm 60 MB/s | 42 MB 00:00 2024-04-25T02:18:29.355 INFO:teuthology.orchestra.run.smithi186.stdout:-------------------------------------------------------------------------------- 2024-04-25T02:18:29.355 INFO:teuthology.orchestra.run.smithi186.stdout:Total 55 MB/s | 43 MB 00:00 2024-04-25T02:18:29.398 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction check 2024-04-25T02:18:29.417 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction check succeeded. 2024-04-25T02:18:29.417 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction test 2024-04-25T02:18:29.700 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction test succeeded. 2024-04-25T02:18:29.703 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction 2024-04-25T02:18:30.124 INFO:teuthology.orchestra.run.smithi186.stdout: Preparing : 1/1 2024-04-25T02:18:30.372 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/5 2024-04-25T02:18:30.583 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/5 2024-04-25T02:18:30.711 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 3/5 2024-04-25T02:18:30.800 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 3/5 2024-04-25T02:18:32.877 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : jq-1.6-8.el8.x86_64 4/5 2024-04-25T02:18:33.071 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : jq-1.6-8.el8.x86_64 4/5 2024-04-25T02:18:33.095 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-test-2:15.2.17-0.el8.x86_64 5/5 2024-04-25T02:18:33.322 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-test-2:15.2.17-0.el8.x86_64 5/5 2024-04-25T02:18:33.378 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-test-2:15.2.17-0.el8.x86_64 5/5 2024-04-25T02:18:33.378 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-test-2:15.2.17-0.el8.x86_64 1/5 2024-04-25T02:18:33.378 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : jq-1.6-8.el8.x86_64 2/5 2024-04-25T02:18:33.378 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 3/5 2024-04-25T02:18:33.378 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 4/5 2024-04-25T02:18:33.605 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-test-2:15.2.17-0.el8.x86_64 5/5 2024-04-25T02:18:33.605 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-test-2:15.2.17-0.el8.x86_64 1/5 2024-04-25T02:18:33.605 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : jq-1.6-8.el8.x86_64 2/5 2024-04-25T02:18:33.605 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 3/5 2024-04-25T02:18:33.605 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 4/5 2024-04-25T02:18:33.814 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 5/5 2024-04-25T02:18:33.814 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:18:33.814 INFO:teuthology.orchestra.run.smithi114.stdout:Installed: 2024-04-25T02:18:33.814 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-test-2:15.2.17-0.el8.x86_64 jq-1.6-8.el8.x86_64 2024-04-25T02:18:33.814 INFO:teuthology.orchestra.run.smithi114.stdout: oniguruma-6.8.2-3.el8.x86_64 socat-1.7.4.1-1.el8.x86_64 2024-04-25T02:18:33.814 INFO:teuthology.orchestra.run.smithi114.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-04-25T02:18:33.814 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:18:33.814 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-04-25T02:18:34.077 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum -y install ceph 2024-04-25T02:18:34.091 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 5/5 2024-04-25T02:18:34.091 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:18:34.091 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-04-25T02:18:34.091 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-test-2:15.2.17-0.el8.x86_64 jq-1.6-8.el8.x86_64 2024-04-25T02:18:34.091 INFO:teuthology.orchestra.run.smithi111.stdout: oniguruma-6.8.2-3.el8.x86_64 socat-1.7.4.1-1.el8.x86_64 2024-04-25T02:18:34.091 INFO:teuthology.orchestra.run.smithi111.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-04-25T02:18:34.091 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:18:34.091 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-04-25T02:18:34.289 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph 2024-04-25T02:18:34.674 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : jq-1.6-8.el8.x86_64 4/5 2024-04-25T02:18:34.812 INFO:teuthology.orchestra.run.smithi114.stdout:Last metadata expiration check: 0:00:48 ago on Thu 25 Apr 2024 02:17:46 AM UTC. 2024-04-25T02:18:34.945 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-test-2:15.2.17-0.el8.x86_64 5/5 2024-04-25T02:18:35.020 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:00:50 ago on Thu 25 Apr 2024 02:17:45 AM UTC. 2024-04-25T02:18:35.237 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-test-2:15.2.17-0.el8.x86_64 5/5 2024-04-25T02:18:35.237 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-test-2:15.2.17-0.el8.x86_64 1/5 2024-04-25T02:18:35.238 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : jq-1.6-8.el8.x86_64 2/5 2024-04-25T02:18:35.238 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 3/5 2024-04-25T02:18:35.238 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 4/5 2024-04-25T02:18:35.658 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 5/5 2024-04-25T02:18:35.658 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:18:35.658 INFO:teuthology.orchestra.run.smithi186.stdout:Installed: 2024-04-25T02:18:35.658 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-test-2:15.2.17-0.el8.x86_64 jq-1.6-8.el8.x86_64 2024-04-25T02:18:35.658 INFO:teuthology.orchestra.run.smithi186.stdout: oniguruma-6.8.2-3.el8.x86_64 socat-1.7.4.1-1.el8.x86_64 2024-04-25T02:18:35.658 INFO:teuthology.orchestra.run.smithi186.stdout: xmlstarlet-1.6.1-20.el8.x86_64 2024-04-25T02:18:35.658 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:18:35.658 INFO:teuthology.orchestra.run.smithi186.stdout:Complete! 2024-04-25T02:18:35.869 DEBUG:teuthology.orchestra.run.smithi186:> sudo yum -y install ceph 2024-04-25T02:18:36.455 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-04-25T02:18:36.458 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-04-25T02:18:36.459 INFO:teuthology.orchestra.run.smithi114.stdout: Package Arch Version Repository Size 2024-04-25T02:18:36.459 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-04-25T02:18:36.459 INFO:teuthology.orchestra.run.smithi114.stdout:Installing: 2024-04-25T02:18:36.459 INFO:teuthology.orchestra.run.smithi114.stdout: ceph x86_64 2:15.2.17-0.el8 ceph 6.3 k 2024-04-25T02:18:36.459 INFO:teuthology.orchestra.run.smithi114.stdout:Installing dependencies: 2024-04-25T02:18:36.459 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mds x86_64 2:15.2.17-0.el8 ceph 2.0 M 2024-04-25T02:18:36.459 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr x86_64 2:15.2.17-0.el8 ceph 1.4 M 2024-04-25T02:18:36.459 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-modules-core noarch 2:15.2.17-0.el8 ceph-noarch 193 k 2024-04-25T02:18:36.459 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mon x86_64 2:15.2.17-0.el8 ceph 4.3 M 2024-04-25T02:18:36.459 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-osd x86_64 2:15.2.17-0.el8 ceph 17 M 2024-04-25T02:18:36.459 INFO:teuthology.orchestra.run.smithi114.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-25T02:18:36.459 INFO:teuthology.orchestra.run.smithi114.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-25T02:18:36.459 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-04-25T02:18:36.459 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-25T02:18:36.460 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-25T02:18:36.460 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-04-25T02:18:36.460 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-25T02:18:36.460 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-25T02:18:36.460 INFO:teuthology.orchestra.run.smithi114.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-25T02:18:36.460 INFO:teuthology.orchestra.run.smithi114.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-04-25T02:18:36.460 INFO:teuthology.orchestra.run.smithi114.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-04-25T02:18:36.460 INFO:teuthology.orchestra.run.smithi114.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-25T02:18:36.460 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-25T02:18:36.460 INFO:teuthology.orchestra.run.smithi114.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-25T02:18:36.460 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-04-25T02:18:36.460 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-04-25T02:18:36.460 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-04-25T02:18:36.460 INFO:teuthology.orchestra.run.smithi114.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-25T02:18:36.461 INFO:teuthology.orchestra.run.smithi114.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-25T02:18:36.461 INFO:teuthology.orchestra.run.smithi114.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-25T02:18:36.461 INFO:teuthology.orchestra.run.smithi114.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-25T02:18:36.461 INFO:teuthology.orchestra.run.smithi114.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-25T02:18:36.461 INFO:teuthology.orchestra.run.smithi114.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-25T02:18:36.461 INFO:teuthology.orchestra.run.smithi114.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-25T02:18:36.461 INFO:teuthology.orchestra.run.smithi114.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-04-25T02:18:36.461 INFO:teuthology.orchestra.run.smithi114.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-25T02:18:36.461 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:18:36.461 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2024-04-25T02:18:36.461 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-04-25T02:18:36.461 INFO:teuthology.orchestra.run.smithi114.stdout:Install 32 Packages 2024-04-25T02:18:36.461 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:18:36.462 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 28 M 2024-04-25T02:18:36.462 INFO:teuthology.orchestra.run.smithi114.stdout:Installed size: 91 M 2024-04-25T02:18:36.462 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading Packages: 2024-04-25T02:18:36.599 INFO:teuthology.orchestra.run.smithi186.stdout:Last metadata expiration check: 0:00:49 ago on Thu 25 Apr 2024 02:17:47 AM UTC. 2024-04-25T02:18:36.675 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-04-25T02:18:36.678 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-04-25T02:18:36.678 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repository Size 2024-04-25T02:18:36.678 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-04-25T02:18:36.678 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-04-25T02:18:36.678 INFO:teuthology.orchestra.run.smithi111.stdout: ceph x86_64 2:15.2.17-0.el8 ceph 6.3 k 2024-04-25T02:18:36.678 INFO:teuthology.orchestra.run.smithi111.stdout:Installing dependencies: 2024-04-25T02:18:36.678 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mds x86_64 2:15.2.17-0.el8 ceph 2.0 M 2024-04-25T02:18:36.679 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr x86_64 2:15.2.17-0.el8 ceph 1.4 M 2024-04-25T02:18:36.679 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-modules-core noarch 2:15.2.17-0.el8 ceph-noarch 193 k 2024-04-25T02:18:36.679 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mon x86_64 2:15.2.17-0.el8 ceph 4.3 M 2024-04-25T02:18:36.679 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-osd x86_64 2:15.2.17-0.el8 ceph 17 M 2024-04-25T02:18:36.679 INFO:teuthology.orchestra.run.smithi111.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-25T02:18:36.679 INFO:teuthology.orchestra.run.smithi111.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-25T02:18:36.679 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-04-25T02:18:36.679 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-25T02:18:36.679 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-25T02:18:36.679 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-04-25T02:18:36.679 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-25T02:18:36.679 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-25T02:18:36.679 INFO:teuthology.orchestra.run.smithi111.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-25T02:18:36.680 INFO:teuthology.orchestra.run.smithi111.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-04-25T02:18:36.680 INFO:teuthology.orchestra.run.smithi111.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-04-25T02:18:36.680 INFO:teuthology.orchestra.run.smithi111.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-25T02:18:36.680 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-25T02:18:36.680 INFO:teuthology.orchestra.run.smithi111.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-25T02:18:36.680 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-04-25T02:18:36.680 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-04-25T02:18:36.680 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-04-25T02:18:36.680 INFO:teuthology.orchestra.run.smithi111.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-25T02:18:36.680 INFO:teuthology.orchestra.run.smithi111.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-25T02:18:36.680 INFO:teuthology.orchestra.run.smithi111.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-25T02:18:36.680 INFO:teuthology.orchestra.run.smithi111.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-25T02:18:36.681 INFO:teuthology.orchestra.run.smithi111.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-25T02:18:36.681 INFO:teuthology.orchestra.run.smithi111.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-25T02:18:36.681 INFO:teuthology.orchestra.run.smithi111.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-25T02:18:36.681 INFO:teuthology.orchestra.run.smithi111.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-04-25T02:18:36.681 INFO:teuthology.orchestra.run.smithi111.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-25T02:18:36.681 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:18:36.681 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-04-25T02:18:36.681 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-04-25T02:18:36.681 INFO:teuthology.orchestra.run.smithi111.stdout:Install 32 Packages 2024-04-25T02:18:36.681 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:18:36.682 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 28 M 2024-04-25T02:18:36.682 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 91 M 2024-04-25T02:18:36.682 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-04-25T02:18:37.448 INFO:teuthology.orchestra.run.smithi114.stdout:(1/32): ceph-15.2.17-0.el8.x86_64.rpm 145 kB/s | 6.3 kB 00:00 2024-04-25T02:18:37.499 INFO:teuthology.orchestra.run.smithi114.stdout:(2/32): ceph-mgr-15.2.17-0.el8.x86_64.rpm 15 MB/s | 1.4 MB 00:00 2024-04-25T02:18:37.549 INFO:teuthology.orchestra.run.smithi114.stdout:(3/32): ceph-mds-15.2.17-0.el8.x86_64.rpm 14 MB/s | 2.0 MB 00:00 2024-04-25T02:18:37.570 INFO:teuthology.orchestra.run.smithi111.stdout:(1/32): ceph-15.2.17-0.el8.x86_64.rpm 128 kB/s | 6.3 kB 00:00 2024-04-25T02:18:37.582 INFO:teuthology.orchestra.run.smithi114.stdout:(4/32): ceph-mgr-modules-core-15.2.17-0.el8.noa 5.7 MB/s | 193 kB 00:00 2024-04-25T02:18:37.620 INFO:teuthology.orchestra.run.smithi111.stdout:(2/32): ceph-mgr-15.2.17-0.el8.x86_64.rpm 14 MB/s | 1.4 MB 00:00 2024-04-25T02:18:37.658 INFO:teuthology.orchestra.run.smithi114.stdout:(5/32): ceph-mon-15.2.17-0.el8.x86_64.rpm 21 MB/s | 4.3 MB 00:00 2024-04-25T02:18:37.679 INFO:teuthology.orchestra.run.smithi111.stdout:(3/32): ceph-mds-15.2.17-0.el8.x86_64.rpm 13 MB/s | 2.0 MB 00:00 2024-04-25T02:18:37.712 INFO:teuthology.orchestra.run.smithi111.stdout:(4/32): ceph-mgr-modules-core-15.2.17-0.el8.noa 5.7 MB/s | 193 kB 00:00 2024-04-25T02:18:37.741 INFO:teuthology.orchestra.run.smithi114.stdout:(6/32): python3-markupsafe-0.23-19.el8.x86_64.r 466 kB/s | 39 kB 00:00 2024-04-25T02:18:37.767 INFO:teuthology.orchestra.run.smithi114.stdout:(7/32): python3-mako-1.0.6-14.el8.noarch.rpm 854 kB/s | 157 kB 00:00 2024-04-25T02:18:37.788 INFO:teuthology.orchestra.run.smithi111.stdout:(5/32): ceph-mon-15.2.17-0.el8.x86_64.rpm 20 MB/s | 4.3 MB 00:00 2024-04-25T02:18:37.934 INFO:teuthology.orchestra.run.smithi114.stdout:(8/32): ceph-osd-15.2.17-0.el8.x86_64.rpm 39 MB/s | 17 MB 00:00 2024-04-25T02:18:37.959 INFO:teuthology.orchestra.run.smithi114.stdout:(9/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 476 kB/s | 103 kB 00:00 2024-04-25T02:18:38.005 INFO:teuthology.orchestra.run.smithi111.stdout:(6/32): ceph-osd-15.2.17-0.el8.x86_64.rpm 44 MB/s | 17 MB 00:00 2024-04-25T02:18:38.012 INFO:teuthology.orchestra.run.smithi114.stdout:(10/32): python3-pytz-2017.2-11.el8.noarch.rpm 233 kB/s | 57 kB 00:00 2024-04-25T02:18:38.030 INFO:teuthology.orchestra.run.smithi111.stdout:(7/32): python3-markupsafe-0.23-19.el8.x86_64.r 160 kB/s | 39 kB 00:00 2024-04-25T02:18:38.055 INFO:teuthology.orchestra.run.smithi111.stdout:(8/32): python3-mako-1.0.6-14.el8.noarch.rpm 458 kB/s | 157 kB 00:00 2024-04-25T02:18:38.089 INFO:teuthology.orchestra.run.smithi111.stdout:(9/32): python3-pytz-2017.2-11.el8.noarch.rpm 971 kB/s | 57 kB 00:00 2024-04-25T02:18:38.114 INFO:teuthology.orchestra.run.smithi111.stdout:(10/32): python3-pyOpenSSL-19.0.0-1.el8.noarch. 949 kB/s | 103 kB 00:00 2024-04-25T02:18:38.143 INFO:teuthology.orchestra.run.smithi114.stdout:(11/32): python3-werkzeug-0.12.2-4.el8.noarch.r 2.1 MB/s | 457 kB 00:00 2024-04-25T02:18:38.164 INFO:teuthology.orchestra.run.smithi111.stdout:(11/32): python3-werkzeug-0.12.2-4.el8.noarch.r 4.1 MB/s | 457 kB 00:00 2024-04-25T02:18:38.193 INFO:teuthology.orchestra.run.smithi114.stdout:(12/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.3 MB/s | 249 kB 00:00 2024-04-25T02:18:38.268 INFO:teuthology.orchestra.run.smithi114.stdout:(13/32): python3-cryptography-3.2.1-7.el8.x86_6 2.4 MB/s | 641 kB 00:00 2024-04-25T02:18:38.333 INFO:teuthology.orchestra.run.smithi186.stdout:Dependencies resolved. 2024-04-25T02:18:38.337 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2024-04-25T02:18:38.337 INFO:teuthology.orchestra.run.smithi186.stdout: Package Arch Version Repository Size 2024-04-25T02:18:38.337 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2024-04-25T02:18:38.338 INFO:teuthology.orchestra.run.smithi186.stdout:Installing: 2024-04-25T02:18:38.338 INFO:teuthology.orchestra.run.smithi186.stdout: ceph x86_64 2:15.2.17-0.el8 ceph 6.3 k 2024-04-25T02:18:38.338 INFO:teuthology.orchestra.run.smithi186.stdout:Installing dependencies: 2024-04-25T02:18:38.338 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mds x86_64 2:15.2.17-0.el8 ceph 2.0 M 2024-04-25T02:18:38.338 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr x86_64 2:15.2.17-0.el8 ceph 1.4 M 2024-04-25T02:18:38.338 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-modules-core noarch 2:15.2.17-0.el8 ceph-noarch 193 k 2024-04-25T02:18:38.338 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mon x86_64 2:15.2.17-0.el8 ceph 4.3 M 2024-04-25T02:18:38.338 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-osd x86_64 2:15.2.17-0.el8 ceph 17 M 2024-04-25T02:18:38.338 INFO:teuthology.orchestra.run.smithi186.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-04-25T02:18:38.338 INFO:teuthology.orchestra.run.smithi186.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-04-25T02:18:38.338 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-04-25T02:18:38.338 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-04-25T02:18:38.338 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-04-25T02:18:38.339 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-04-25T02:18:38.339 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-04-25T02:18:38.339 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-04-25T02:18:38.339 INFO:teuthology.orchestra.run.smithi186.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-04-25T02:18:38.339 INFO:teuthology.orchestra.run.smithi186.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-04-25T02:18:38.339 INFO:teuthology.orchestra.run.smithi186.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-04-25T02:18:38.339 INFO:teuthology.orchestra.run.smithi186.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-04-25T02:18:38.339 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-04-25T02:18:38.339 INFO:teuthology.orchestra.run.smithi186.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-04-25T02:18:38.339 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-04-25T02:18:38.339 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-04-25T02:18:38.339 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-04-25T02:18:38.339 INFO:teuthology.orchestra.run.smithi186.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-04-25T02:18:38.340 INFO:teuthology.orchestra.run.smithi186.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-04-25T02:18:38.340 INFO:teuthology.orchestra.run.smithi186.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-04-25T02:18:38.340 INFO:teuthology.orchestra.run.smithi186.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-04-25T02:18:38.340 INFO:teuthology.orchestra.run.smithi186.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-04-25T02:18:38.340 INFO:teuthology.orchestra.run.smithi186.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-04-25T02:18:38.340 INFO:teuthology.orchestra.run.smithi186.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-04-25T02:18:38.340 INFO:teuthology.orchestra.run.smithi186.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-04-25T02:18:38.340 INFO:teuthology.orchestra.run.smithi186.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-04-25T02:18:38.340 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:18:38.340 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction Summary 2024-04-25T02:18:38.340 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2024-04-25T02:18:38.340 INFO:teuthology.orchestra.run.smithi186.stdout:Install 32 Packages 2024-04-25T02:18:38.340 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:18:38.341 INFO:teuthology.orchestra.run.smithi186.stdout:Total download size: 28 M 2024-04-25T02:18:38.341 INFO:teuthology.orchestra.run.smithi186.stdout:Installed size: 91 M 2024-04-25T02:18:38.341 INFO:teuthology.orchestra.run.smithi186.stdout:Downloading Packages: 2024-04-25T02:18:38.365 INFO:teuthology.orchestra.run.smithi111.stdout:(12/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 902 kB/s | 249 kB 00:00 2024-04-25T02:18:38.423 INFO:teuthology.orchestra.run.smithi111.stdout:(13/32): python3-pycparser-2.14-14.el8.noarch.r 422 kB/s | 109 kB 00:00 2024-04-25T02:18:38.427 INFO:teuthology.orchestra.run.smithi114.stdout:(14/32): python3-pycparser-2.14-14.el8.noarch.r 384 kB/s | 109 kB 00:00 2024-04-25T02:18:38.477 INFO:teuthology.orchestra.run.smithi114.stdout:(15/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 153 kB/s | 44 kB 00:00 2024-04-25T02:18:38.686 INFO:teuthology.orchestra.run.smithi114.stdout:(16/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 444 kB/s | 185 kB 00:00 2024-04-25T02:18:38.761 INFO:teuthology.orchestra.run.smithi114.stdout:(17/32): python3-cherrypy-18.4.0-1.el8.noarch.r 1.3 MB/s | 384 kB 00:00 2024-04-25T02:18:38.775 INFO:teuthology.orchestra.run.smithi111.stdout:(14/32): python3-cryptography-3.2.1-7.el8.x86_6 970 kB/s | 641 kB 00:00 2024-04-25T02:18:38.787 INFO:teuthology.orchestra.run.smithi114.stdout:(18/32): python3-jaraco-6.2-6.el8.noarch.rpm 111 kB/s | 11 kB 00:00 2024-04-25T02:18:38.807 INFO:teuthology.orchestra.run.smithi111.stdout:(15/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 99 kB/s | 44 kB 00:00 2024-04-25T02:18:38.812 INFO:teuthology.orchestra.run.smithi114.stdout:(19/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 449 kB/s | 173 kB 00:00 2024-04-25T02:18:38.837 INFO:teuthology.orchestra.run.smithi114.stdout:(20/32): python3-jaraco-functools-2.0-4.el8.noa 233 kB/s | 18 kB 00:00 2024-04-25T02:18:38.847 INFO:teuthology.orchestra.run.smithi186.stdout:(1/32): ceph-15.2.17-0.el8.x86_64.rpm 162 kB/s | 6.3 kB 00:00 2024-04-25T02:18:38.871 INFO:teuthology.orchestra.run.smithi114.stdout:(21/32): python3-logutils-0.3.5-11.el8.noarch.r 582 kB/s | 49 kB 00:00 2024-04-25T02:18:38.897 INFO:teuthology.orchestra.run.smithi186.stdout:(2/32): ceph-mgr-15.2.17-0.el8.x86_64.rpm 16 MB/s | 1.4 MB 00:00 2024-04-25T02:18:38.913 INFO:teuthology.orchestra.run.smithi114.stdout:(22/32): python3-more-itertools-7.2.0-3.el8.noa 584 kB/s | 59 kB 00:00 2024-04-25T02:18:38.946 INFO:teuthology.orchestra.run.smithi114.stdout:(23/32): python3-pecan-1.3.2-9.el8.noarch.rpm 2.5 MB/s | 283 kB 00:00 2024-04-25T02:18:38.957 INFO:teuthology.orchestra.run.smithi111.stdout:(16/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 347 kB/s | 185 kB 00:00 2024-04-25T02:18:38.959 INFO:teuthology.orchestra.run.smithi186.stdout:(3/32): ceph-mds-15.2.17-0.el8.x86_64.rpm 13 MB/s | 2.0 MB 00:00 2024-04-25T02:18:38.972 INFO:teuthology.orchestra.run.smithi114.stdout:(24/32): python3-portend-2.6-1.el8.noarch.rpm 155 kB/s | 16 kB 00:00 2024-04-25T02:18:38.990 INFO:teuthology.orchestra.run.smithi186.stdout:(4/32): ceph-mgr-modules-core-15.2.17-0.el8.noa 6.4 MB/s | 193 kB 00:00 2024-04-25T02:18:38.997 INFO:teuthology.orchestra.run.smithi114.stdout:(25/32): python3-simplegeneric-0.8.1-17.el8.noa 223 kB/s | 19 kB 00:00 2024-04-25T02:18:39.022 INFO:teuthology.orchestra.run.smithi114.stdout:(26/32): python3-singledispatch-3.4.0.3-18.el8. 315 kB/s | 24 kB 00:00 2024-04-25T02:18:39.048 INFO:teuthology.orchestra.run.smithi114.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 385 kB/s | 29 kB 00:00 2024-04-25T02:18:39.057 INFO:teuthology.orchestra.run.smithi186.stdout:(5/32): ceph-mon-15.2.17-0.el8.x86_64.rpm 21 MB/s | 4.3 MB 00:00 2024-04-25T02:18:39.073 INFO:teuthology.orchestra.run.smithi114.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 362 kB/s | 27 kB 00:00 2024-04-25T02:18:39.075 INFO:teuthology.orchestra.run.smithi111.stdout:(17/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 577 kB/s | 173 kB 00:00 2024-04-25T02:18:39.100 INFO:teuthology.orchestra.run.smithi111.stdout:(18/32): python3-jaraco-6.2-6.el8.noarch.rpm 78 kB/s | 11 kB 00:00 2024-04-25T02:18:39.157 INFO:teuthology.orchestra.run.smithi114.stdout:(29/32): python3-waitress-1.4.3-1.el8.noarch.rp 1.9 MB/s | 255 kB 00:00 2024-04-25T02:18:39.182 INFO:teuthology.orchestra.run.smithi114.stdout:(30/32): python3-webtest-2.0.33-1.el8.noarch.rp 786 kB/s | 85 kB 00:00 2024-04-25T02:18:39.192 INFO:teuthology.orchestra.run.smithi111.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 150 kB/s | 18 kB 00:00 2024-04-25T02:18:39.224 INFO:teuthology.orchestra.run.smithi114.stdout:(31/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 1.4 MB/s | 251 kB 00:00 2024-04-25T02:18:39.226 INFO:teuthology.orchestra.run.smithi111.stdout:(20/32): python3-logutils-0.3.5-11.el8.noarch.r 389 kB/s | 49 kB 00:00 2024-04-25T02:18:39.241 INFO:teuthology.orchestra.run.smithi114.stdout:(32/32): python3-zc-lockfile-2.0-2.el8.noarch.r 274 kB/s | 23 kB 00:00 2024-04-25T02:18:39.242 INFO:teuthology.orchestra.run.smithi114.stdout:-------------------------------------------------------------------------------- 2024-04-25T02:18:39.242 INFO:teuthology.orchestra.run.smithi114.stdout:Total 10 MB/s | 28 MB 00:02 2024-04-25T02:18:39.307 INFO:teuthology.orchestra.run.smithi186.stdout:(6/32): ceph-osd-15.2.17-0.el8.x86_64.rpm 41 MB/s | 17 MB 00:00 2024-04-25T02:18:39.318 INFO:teuthology.orchestra.run.smithi111.stdout:(21/32): python3-more-itertools-7.2.0-3.el8.noa 468 kB/s | 59 kB 00:00 2024-04-25T02:18:39.322 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2024-04-25T02:18:39.332 INFO:teuthology.orchestra.run.smithi186.stdout:(7/32): python3-markupsafe-0.23-19.el8.x86_64.r 141 kB/s | 39 kB 00:00 2024-04-25T02:18:39.357 INFO:teuthology.orchestra.run.smithi186.stdout:(8/32): python3-mako-1.0.6-14.el8.noarch.rpm 427 kB/s | 157 kB 00:00 2024-04-25T02:18:39.359 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction check succeeded. 2024-04-25T02:18:39.359 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2024-04-25T02:18:39.383 INFO:teuthology.orchestra.run.smithi186.stdout:(9/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 1.3 MB/s | 103 kB 00:00 2024-04-25T02:18:39.433 INFO:teuthology.orchestra.run.smithi186.stdout:(10/32): python3-pytz-2017.2-11.el8.noarch.rpm 567 kB/s | 57 kB 00:00 2024-04-25T02:18:39.443 INFO:teuthology.orchestra.run.smithi111.stdout:(22/32): python3-cherrypy-18.4.0-1.el8.noarch.r 605 kB/s | 384 kB 00:00 2024-04-25T02:18:39.458 INFO:teuthology.orchestra.run.smithi186.stdout:(11/32): python3-werkzeug-0.12.2-4.el8.noarch.r 4.4 MB/s | 457 kB 00:00 2024-04-25T02:18:39.468 INFO:teuthology.orchestra.run.smithi111.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 103 kB/s | 16 kB 00:00 2024-04-25T02:18:39.494 INFO:teuthology.orchestra.run.smithi111.stdout:(24/32): python3-pecan-1.3.2-9.el8.noarch.rpm 1.0 MB/s | 283 kB 00:00 2024-04-25T02:18:39.552 INFO:teuthology.orchestra.run.smithi111.stdout:(25/32): python3-simplegeneric-0.8.1-17.el8.noa 172 kB/s | 19 kB 00:00 2024-04-25T02:18:39.578 INFO:teuthology.orchestra.run.smithi111.stdout:(26/32): python3-singledispatch-3.4.0.3-18.el8. 219 kB/s | 24 kB 00:00 2024-04-25T02:18:39.584 INFO:teuthology.orchestra.run.smithi186.stdout:(12/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 1.2 MB/s | 249 kB 00:00 2024-04-25T02:18:39.603 INFO:teuthology.orchestra.run.smithi111.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 268 kB/s | 29 kB 00:00 2024-04-25T02:18:39.643 INFO:teuthology.orchestra.run.smithi186.stdout:(13/32): python3-pycparser-2.14-14.el8.noarch.r 594 kB/s | 109 kB 00:00 2024-04-25T02:18:39.655 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded. 2024-04-25T02:18:39.658 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2024-04-25T02:18:39.661 INFO:teuthology.orchestra.run.smithi111.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 252 kB/s | 27 kB 00:00 2024-04-25T02:18:39.693 INFO:teuthology.orchestra.run.smithi186.stdout:(14/32): python3-cryptography-3.2.1-7.el8.x86_6 2.4 MB/s | 641 kB 00:00 2024-04-25T02:18:39.718 INFO:teuthology.orchestra.run.smithi186.stdout:(15/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 325 kB/s | 44 kB 00:00 2024-04-25T02:18:39.720 INFO:teuthology.orchestra.run.smithi111.stdout:(29/32): python3-waitress-1.4.3-1.el8.noarch.rp 1.8 MB/s | 255 kB 00:00 2024-04-25T02:18:39.754 INFO:teuthology.orchestra.run.smithi111.stdout:(30/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 1.6 MB/s | 251 kB 00:00 2024-04-25T02:18:39.787 INFO:teuthology.orchestra.run.smithi111.stdout:(31/32): python3-webtest-2.0.33-1.el8.noarch.rp 681 kB/s | 85 kB 00:00 2024-04-25T02:18:39.821 INFO:teuthology.orchestra.run.smithi186.stdout:(16/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 1.0 MB/s | 185 kB 00:00 2024-04-25T02:18:39.829 INFO:teuthology.orchestra.run.smithi111.stdout:(32/32): python3-zc-lockfile-2.0-2.el8.noarch.r 211 kB/s | 23 kB 00:00 2024-04-25T02:18:39.831 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-04-25T02:18:39.831 INFO:teuthology.orchestra.run.smithi111.stdout:Total 9.0 MB/s | 28 MB 00:03 2024-04-25T02:18:39.877 INFO:teuthology.orchestra.run.smithi186.stdout:(17/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 937 kB/s | 173 kB 00:00 2024-04-25T02:18:39.903 INFO:teuthology.orchestra.run.smithi186.stdout:(18/32): python3-jaraco-6.2-6.el8.noarch.rpm 136 kB/s | 11 kB 00:00 2024-04-25T02:18:39.913 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-04-25T02:18:39.928 INFO:teuthology.orchestra.run.smithi186.stdout:(19/32): python3-cherrypy-18.4.0-1.el8.noarch.r 1.8 MB/s | 384 kB 00:00 2024-04-25T02:18:39.952 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-04-25T02:18:39.952 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-04-25T02:18:39.953 INFO:teuthology.orchestra.run.smithi186.stdout:(20/32): python3-jaraco-functools-2.0-4.el8.noa 233 kB/s | 18 kB 00:00 2024-04-25T02:18:39.979 INFO:teuthology.orchestra.run.smithi186.stdout:(21/32): python3-logutils-0.3.5-11.el8.noarch.r 645 kB/s | 49 kB 00:00 2024-04-25T02:18:40.004 INFO:teuthology.orchestra.run.smithi186.stdout:(22/32): python3-more-itertools-7.2.0-3.el8.noa 781 kB/s | 59 kB 00:00 2024-04-25T02:18:40.038 INFO:teuthology.orchestra.run.smithi186.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 266 kB/s | 16 kB 00:00 2024-04-25T02:18:40.062 INFO:teuthology.orchestra.run.smithi186.stdout:(24/32): python3-simplegeneric-0.8.1-17.el8.noa 319 kB/s | 19 kB 00:00 2024-04-25T02:18:40.107 INFO:teuthology.orchestra.run.smithi186.stdout:(25/32): python3-singledispatch-3.4.0.3-18.el8. 344 kB/s | 24 kB 00:00 2024-04-25T02:18:40.138 INFO:teuthology.orchestra.run.smithi186.stdout:(26/32): python3-pecan-1.3.2-9.el8.noarch.rpm 1.5 MB/s | 283 kB 00:00 2024-04-25T02:18:40.164 INFO:teuthology.orchestra.run.smithi186.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 290 kB/s | 29 kB 00:00 2024-04-25T02:18:40.189 INFO:teuthology.orchestra.run.smithi186.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 340 kB/s | 27 kB 00:00 2024-04-25T02:18:40.214 INFO:teuthology.orchestra.run.smithi186.stdout:(29/32): python3-waitress-1.4.3-1.el8.noarch.rp 3.3 MB/s | 255 kB 00:00 2024-04-25T02:18:40.239 INFO:teuthology.orchestra.run.smithi186.stdout:(30/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 3.3 MB/s | 251 kB 00:00 2024-04-25T02:18:40.244 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-04-25T02:18:40.247 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-04-25T02:18:40.265 INFO:teuthology.orchestra.run.smithi186.stdout:(31/32): python3-webtest-2.0.33-1.el8.noarch.rp 1.1 MB/s | 85 kB 00:00 2024-04-25T02:18:40.281 INFO:teuthology.orchestra.run.smithi186.stdout:(32/32): python3-zc-lockfile-2.0-2.el8.noarch.r 343 kB/s | 23 kB 00:00 2024-04-25T02:18:40.283 INFO:teuthology.orchestra.run.smithi186.stdout:-------------------------------------------------------------------------------- 2024-04-25T02:18:40.283 INFO:teuthology.orchestra.run.smithi186.stdout:Total 15 MB/s | 28 MB 00:01 2024-04-25T02:18:40.366 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction check 2024-04-25T02:18:40.404 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction check succeeded. 2024-04-25T02:18:40.404 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction test 2024-04-25T02:18:40.710 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction test succeeded. 2024-04-25T02:18:40.713 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction 2024-04-25T02:18:40.780 INFO:teuthology.orchestra.run.smithi114.stdout: Preparing : 1/1 2024-04-25T02:18:41.034 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2024-04-25T02:18:41.236 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2024-04-25T02:18:41.338 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-04-25T02:18:41.462 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2024-04-25T02:18:41.544 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2024-04-25T02:18:41.717 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2024-04-25T02:18:41.738 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2024-04-25T02:18:41.877 INFO:teuthology.orchestra.run.smithi186.stdout: Preparing : 1/1 2024-04-25T02:18:41.908 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2024-04-25T02:18:41.972 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2024-04-25T02:18:42.106 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2024-04-25T02:18:42.117 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2024-04-25T02:18:42.239 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2024-04-25T02:18:42.298 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2024-04-25T02:18:42.309 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2024-04-25T02:18:42.469 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2024-04-25T02:18:42.476 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2024-04-25T02:18:42.494 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2024-04-25T02:18:42.640 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2024-04-25T02:18:42.743 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2024-04-25T02:18:42.791 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2024-04-25T02:18:42.800 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2024-04-25T02:18:42.961 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2024-04-25T02:18:42.991 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2024-04-25T02:18:43.006 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2024-04-25T02:18:43.187 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2024-04-25T02:18:43.203 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2024-04-25T02:18:43.269 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2024-04-25T02:18:43.356 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2024-04-25T02:18:43.457 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2024-04-25T02:18:43.492 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2024-04-25T02:18:43.542 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2024-04-25T02:18:43.677 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2024-04-25T02:18:43.793 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2024-04-25T02:18:43.862 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2024-04-25T02:18:43.953 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2024-04-25T02:18:44.064 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2024-04-25T02:18:44.097 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 14/32 2024-04-25T02:18:44.294 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2024-04-25T02:18:44.312 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2024-04-25T02:18:44.357 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2024-04-25T02:18:44.508 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2024-04-25T02:18:44.575 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 14/32 2024-04-25T02:18:44.594 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2024-04-25T02:18:44.768 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2024-04-25T02:18:44.804 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-04-25T02:18:44.866 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2024-04-25T02:18:45.029 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2024-04-25T02:18:45.122 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 14/32 2024-04-25T02:18:45.139 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2024-04-25T02:18:45.214 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-04-25T02:18:45.319 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2024-04-25T02:18:45.333 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2024-04-25T02:18:45.497 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2024-04-25T02:18:45.514 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2024-04-25T02:18:45.553 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2024-04-25T02:18:45.724 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2024-04-25T02:18:45.727 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2024-04-25T02:18:45.762 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-04-25T02:18:45.891 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2024-04-25T02:18:45.967 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2024-04-25T02:18:46.069 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2024-04-25T02:18:46.081 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2024-04-25T02:18:46.232 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2024-04-25T02:18:46.283 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2024-04-25T02:18:46.303 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2024-04-25T02:18:46.448 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2024-04-25T02:18:46.488 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2024-04-25T02:18:46.534 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2024-04-25T02:18:46.641 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2024-04-25T02:18:46.748 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2024-04-25T02:18:46.772 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2024-04-25T02:18:46.895 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2024-04-25T02:18:47.055 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2024-04-25T02:18:47.084 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2024-04-25T02:18:47.131 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2024-04-25T02:18:47.348 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2024-04-25T02:18:47.356 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2024-04-25T02:18:47.425 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 27/32 2024-04-25T02:18:47.605 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mgr-2:15.2.17-0.el8.x86_64 28/32 2024-04-25T02:18:47.675 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2024-04-25T02:18:47.731 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 27/32 2024-04-25T02:18:47.894 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-mgr-2:15.2.17-0.el8.x86_64 28/32 2024-04-25T02:18:47.971 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2024-04-25T02:18:48.336 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 27/32 2024-04-25T02:18:48.524 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mgr-2:15.2.17-0.el8.x86_64 28/32 2024-04-25T02:18:48.966 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mgr-2:15.2.17-0.el8.x86_64 28/32 2024-04-25T02:18:49.170 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-osd-2:15.2.17-0.el8.x86_64 29/32 2024-04-25T02:18:49.253 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-mgr-2:15.2.17-0.el8.x86_64 28/32 2024-04-25T02:18:49.463 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-osd-2:15.2.17-0.el8.x86_64 29/32 2024-04-25T02:18:49.549 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-osd-2:15.2.17-0.el8.x86_64 29/32 2024-04-25T02:18:49.745 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mon-2:15.2.17-0.el8.x86_64 30/32 2024-04-25T02:18:49.841 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-osd-2:15.2.17-0.el8.x86_64 29/32 2024-04-25T02:18:49.887 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mgr-2:15.2.17-0.el8.x86_64 28/32 2024-04-25T02:18:49.927 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mon-2:15.2.17-0.el8.x86_64 30/32 2024-04-25T02:18:50.055 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-mon-2:15.2.17-0.el8.x86_64 30/32 2024-04-25T02:18:50.094 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-osd-2:15.2.17-0.el8.x86_64 29/32 2024-04-25T02:18:50.095 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-mds-2:15.2.17-0.el8.x86_64 31/32 2024-04-25T02:18:50.112 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mds-2:15.2.17-0.el8.x86_64 31/32 2024-04-25T02:18:50.237 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-mon-2:15.2.17-0.el8.x86_64 30/32 2024-04-25T02:18:50.252 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-2:15.2.17-0.el8.x86_64 32/32 2024-04-25T02:18:50.430 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-mds-2:15.2.17-0.el8.x86_64 31/32 2024-04-25T02:18:50.447 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-mds-2:15.2.17-0.el8.x86_64 31/32 2024-04-25T02:18:50.475 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-osd-2:15.2.17-0.el8.x86_64 29/32 2024-04-25T02:18:50.579 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-2:15.2.17-0.el8.x86_64 32/32 2024-04-25T02:18:50.653 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-2:15.2.17-0.el8.x86_64 32/32 2024-04-25T02:18:50.653 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-2:15.2.17-0.el8.x86_64 1/32 2024-04-25T02:18:50.653 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mds-2:15.2.17-0.el8.x86_64 2/32 2024-04-25T02:18:50.653 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-2:15.2.17-0.el8.x86_64 3/32 2024-04-25T02:18:50.653 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mon-2:15.2.17-0.el8.x86_64 4/32 2024-04-25T02:18:50.653 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-osd-2:15.2.17-0.el8.x86_64 5/32 2024-04-25T02:18:50.653 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 6/32 2024-04-25T02:18:50.653 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2024-04-25T02:18:50.653 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2024-04-25T02:18:50.653 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2024-04-25T02:18:50.654 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2024-04-25T02:18:50.654 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2024-04-25T02:18:50.654 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2024-04-25T02:18:50.654 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 13/32 2024-04-25T02:18:50.654 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2024-04-25T02:18:50.654 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2024-04-25T02:18:50.654 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2024-04-25T02:18:50.654 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-04-25T02:18:50.654 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2024-04-25T02:18:50.654 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2024-04-25T02:18:50.654 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2024-04-25T02:18:50.654 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2024-04-25T02:18:50.654 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2024-04-25T02:18:50.654 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2024-04-25T02:18:50.655 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2024-04-25T02:18:50.655 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2024-04-25T02:18:50.655 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2024-04-25T02:18:50.655 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2024-04-25T02:18:50.655 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2024-04-25T02:18:50.655 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2024-04-25T02:18:50.655 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2024-04-25T02:18:50.655 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2024-04-25T02:18:50.669 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mon-2:15.2.17-0.el8.x86_64 30/32 2024-04-25T02:18:50.853 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mon-2:15.2.17-0.el8.x86_64 30/32 2024-04-25T02:18:51.010 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-2:15.2.17-0.el8.x86_64 32/32 2024-04-25T02:18:51.010 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-2:15.2.17-0.el8.x86_64 1/32 2024-04-25T02:18:51.011 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mds-2:15.2.17-0.el8.x86_64 2/32 2024-04-25T02:18:51.011 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mgr-2:15.2.17-0.el8.x86_64 3/32 2024-04-25T02:18:51.011 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mon-2:15.2.17-0.el8.x86_64 4/32 2024-04-25T02:18:51.011 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-osd-2:15.2.17-0.el8.x86_64 5/32 2024-04-25T02:18:51.011 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 6/32 2024-04-25T02:18:51.011 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2024-04-25T02:18:51.011 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2024-04-25T02:18:51.011 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2024-04-25T02:18:51.011 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2024-04-25T02:18:51.011 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2024-04-25T02:18:51.011 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2024-04-25T02:18:51.011 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 13/32 2024-04-25T02:18:51.011 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2024-04-25T02:18:51.012 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2024-04-25T02:18:51.012 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2024-04-25T02:18:51.012 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-04-25T02:18:51.012 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2024-04-25T02:18:51.012 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2024-04-25T02:18:51.012 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2024-04-25T02:18:51.012 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2024-04-25T02:18:51.012 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2024-04-25T02:18:51.012 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2024-04-25T02:18:51.012 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2024-04-25T02:18:51.012 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2024-04-25T02:18:51.013 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2024-04-25T02:18:51.013 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2024-04-25T02:18:51.013 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2024-04-25T02:18:51.013 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2024-04-25T02:18:51.013 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2024-04-25T02:18:51.014 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2024-04-25T02:18:51.044 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-mds-2:15.2.17-0.el8.x86_64 31/32 2024-04-25T02:18:51.062 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-mds-2:15.2.17-0.el8.x86_64 31/32 2024-04-25T02:18:51.193 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-2:15.2.17-0.el8.x86_64 32/32 2024-04-25T02:18:51.509 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2024-04-25T02:18:51.509 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:18:51.509 INFO:teuthology.orchestra.run.smithi114.stdout:Installed: 2024-04-25T02:18:51.509 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:51.510 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mds-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:51.510 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:51.510 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 2024-04-25T02:18:51.510 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mon-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:51.510 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-osd-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:51.510 INFO:teuthology.orchestra.run.smithi114.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-25T02:18:51.510 INFO:teuthology.orchestra.run.smithi114.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-25T02:18:51.510 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-25T02:18:51.510 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-25T02:18:51.510 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-25T02:18:51.510 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-04-25T02:18:51.510 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-25T02:18:51.510 INFO:teuthology.orchestra.run.smithi114.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-25T02:18:51.511 INFO:teuthology.orchestra.run.smithi114.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-25T02:18:51.511 INFO:teuthology.orchestra.run.smithi114.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-25T02:18:51.511 INFO:teuthology.orchestra.run.smithi114.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-25T02:18:51.511 INFO:teuthology.orchestra.run.smithi114.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-25T02:18:51.511 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-25T02:18:51.511 INFO:teuthology.orchestra.run.smithi114.stdout: python3-portend-2.6-1.el8.noarch 2024-04-25T02:18:51.511 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-25T02:18:51.511 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-25T02:18:51.511 INFO:teuthology.orchestra.run.smithi114.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-25T02:18:51.511 INFO:teuthology.orchestra.run.smithi114.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-25T02:18:51.511 INFO:teuthology.orchestra.run.smithi114.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-25T02:18:51.511 INFO:teuthology.orchestra.run.smithi114.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-25T02:18:51.511 INFO:teuthology.orchestra.run.smithi114.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-25T02:18:51.512 INFO:teuthology.orchestra.run.smithi114.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-25T02:18:51.512 INFO:teuthology.orchestra.run.smithi114.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-25T02:18:51.512 INFO:teuthology.orchestra.run.smithi114.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-25T02:18:51.512 INFO:teuthology.orchestra.run.smithi114.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-25T02:18:51.512 INFO:teuthology.orchestra.run.smithi114.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-25T02:18:51.512 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:18:51.512 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-04-25T02:18:51.600 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-2:15.2.17-0.el8.x86_64 32/32 2024-04-25T02:18:51.600 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-2:15.2.17-0.el8.x86_64 1/32 2024-04-25T02:18:51.601 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mds-2:15.2.17-0.el8.x86_64 2/32 2024-04-25T02:18:51.601 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-2:15.2.17-0.el8.x86_64 3/32 2024-04-25T02:18:51.601 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mon-2:15.2.17-0.el8.x86_64 4/32 2024-04-25T02:18:51.601 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-osd-2:15.2.17-0.el8.x86_64 5/32 2024-04-25T02:18:51.601 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 6/32 2024-04-25T02:18:51.601 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2024-04-25T02:18:51.601 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2024-04-25T02:18:51.601 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2024-04-25T02:18:51.601 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2024-04-25T02:18:51.601 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2024-04-25T02:18:51.601 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2024-04-25T02:18:51.601 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 13/32 2024-04-25T02:18:51.601 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2024-04-25T02:18:51.602 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2024-04-25T02:18:51.602 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2024-04-25T02:18:51.602 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-04-25T02:18:51.602 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2024-04-25T02:18:51.602 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2024-04-25T02:18:51.602 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2024-04-25T02:18:51.602 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2024-04-25T02:18:51.602 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2024-04-25T02:18:51.602 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2024-04-25T02:18:51.602 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2024-04-25T02:18:51.602 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2024-04-25T02:18:51.603 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2024-04-25T02:18:51.603 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2024-04-25T02:18:51.603 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2024-04-25T02:18:51.603 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2024-04-25T02:18:51.603 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2024-04-25T02:18:51.603 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2024-04-25T02:18:51.757 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum -y install ceph-base 2024-04-25T02:18:51.924 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2024-04-25T02:18:51.925 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:18:51.925 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-04-25T02:18:51.925 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:51.925 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mds-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:51.925 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:51.925 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 2024-04-25T02:18:51.925 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mon-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:51.925 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-osd-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:51.925 INFO:teuthology.orchestra.run.smithi111.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-25T02:18:51.925 INFO:teuthology.orchestra.run.smithi111.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-25T02:18:51.925 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-25T02:18:51.925 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-25T02:18:51.926 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-25T02:18:51.926 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-04-25T02:18:51.926 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-25T02:18:51.926 INFO:teuthology.orchestra.run.smithi111.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-25T02:18:51.926 INFO:teuthology.orchestra.run.smithi111.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-25T02:18:51.926 INFO:teuthology.orchestra.run.smithi111.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-25T02:18:51.926 INFO:teuthology.orchestra.run.smithi111.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-25T02:18:51.926 INFO:teuthology.orchestra.run.smithi111.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-25T02:18:51.926 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-25T02:18:51.926 INFO:teuthology.orchestra.run.smithi111.stdout: python3-portend-2.6-1.el8.noarch 2024-04-25T02:18:51.926 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-25T02:18:51.926 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-25T02:18:51.926 INFO:teuthology.orchestra.run.smithi111.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-25T02:18:51.927 INFO:teuthology.orchestra.run.smithi111.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-25T02:18:51.927 INFO:teuthology.orchestra.run.smithi111.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-25T02:18:51.927 INFO:teuthology.orchestra.run.smithi111.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-25T02:18:51.927 INFO:teuthology.orchestra.run.smithi111.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-25T02:18:51.927 INFO:teuthology.orchestra.run.smithi111.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-25T02:18:51.927 INFO:teuthology.orchestra.run.smithi111.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-25T02:18:51.927 INFO:teuthology.orchestra.run.smithi111.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-25T02:18:51.927 INFO:teuthology.orchestra.run.smithi111.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-25T02:18:51.927 INFO:teuthology.orchestra.run.smithi111.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-25T02:18:51.927 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:18:51.927 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-04-25T02:18:52.170 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-base 2024-04-25T02:18:52.486 INFO:teuthology.orchestra.run.smithi114.stdout:Last metadata expiration check: 0:01:06 ago on Thu 25 Apr 2024 02:17:46 AM UTC. 2024-04-25T02:18:52.512 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2024-04-25T02:18:52.512 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:18:52.512 INFO:teuthology.orchestra.run.smithi186.stdout:Installed: 2024-04-25T02:18:52.512 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:52.512 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mds-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:52.512 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:52.512 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 2024-04-25T02:18:52.512 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-mon-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:52.512 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-osd-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:52.512 INFO:teuthology.orchestra.run.smithi186.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-04-25T02:18:52.512 INFO:teuthology.orchestra.run.smithi186.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-04-25T02:18:52.512 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-04-25T02:18:52.513 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-04-25T02:18:52.513 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-04-25T02:18:52.513 INFO:teuthology.orchestra.run.smithi186.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-04-25T02:18:52.513 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-6.2-6.el8.noarch 2024-04-25T02:18:52.513 INFO:teuthology.orchestra.run.smithi186.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-04-25T02:18:52.513 INFO:teuthology.orchestra.run.smithi186.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-04-25T02:18:52.513 INFO:teuthology.orchestra.run.smithi186.stdout: python3-mako-1.0.6-14.el8.noarch 2024-04-25T02:18:52.513 INFO:teuthology.orchestra.run.smithi186.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-04-25T02:18:52.513 INFO:teuthology.orchestra.run.smithi186.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-04-25T02:18:52.513 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-04-25T02:18:52.513 INFO:teuthology.orchestra.run.smithi186.stdout: python3-portend-2.6-1.el8.noarch 2024-04-25T02:18:52.513 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-04-25T02:18:52.513 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pycparser-2.14-14.el8.noarch 2024-04-25T02:18:52.513 INFO:teuthology.orchestra.run.smithi186.stdout: python3-pytz-2017.2-11.el8.noarch 2024-04-25T02:18:52.514 INFO:teuthology.orchestra.run.smithi186.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-04-25T02:18:52.514 INFO:teuthology.orchestra.run.smithi186.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-04-25T02:18:52.514 INFO:teuthology.orchestra.run.smithi186.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-04-25T02:18:52.514 INFO:teuthology.orchestra.run.smithi186.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-04-25T02:18:52.514 INFO:teuthology.orchestra.run.smithi186.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-04-25T02:18:52.514 INFO:teuthology.orchestra.run.smithi186.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-04-25T02:18:52.514 INFO:teuthology.orchestra.run.smithi186.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-04-25T02:18:52.514 INFO:teuthology.orchestra.run.smithi186.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-04-25T02:18:52.514 INFO:teuthology.orchestra.run.smithi186.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-04-25T02:18:52.514 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:18:52.514 INFO:teuthology.orchestra.run.smithi186.stdout:Complete! 2024-04-25T02:18:52.815 DEBUG:teuthology.orchestra.run.smithi186:> sudo yum -y install ceph-base 2024-04-25T02:18:52.909 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:07 ago on Thu 25 Apr 2024 02:17:45 AM UTC. 2024-04-25T02:18:53.557 INFO:teuthology.orchestra.run.smithi186.stdout:Last metadata expiration check: 0:01:06 ago on Thu 25 Apr 2024 02:17:47 AM UTC. 2024-04-25T02:18:54.080 INFO:teuthology.orchestra.run.smithi114.stdout:Package ceph-base-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-25T02:18:54.127 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-04-25T02:18:54.128 INFO:teuthology.orchestra.run.smithi114.stdout:Nothing to do. 2024-04-25T02:18:54.128 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-04-25T02:18:54.241 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum -y install ceph-immutable-object-cache 2024-04-25T02:18:54.509 INFO:teuthology.orchestra.run.smithi111.stdout:Package ceph-base-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-25T02:18:54.559 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-04-25T02:18:54.560 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2024-04-25T02:18:54.560 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-04-25T02:18:54.657 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-immutable-object-cache 2024-04-25T02:18:54.959 INFO:teuthology.orchestra.run.smithi114.stdout:Last metadata expiration check: 0:01:08 ago on Thu 25 Apr 2024 02:17:46 AM UTC. 2024-04-25T02:18:55.156 INFO:teuthology.orchestra.run.smithi186.stdout:Package ceph-base-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-25T02:18:55.204 INFO:teuthology.orchestra.run.smithi186.stdout:Dependencies resolved. 2024-04-25T02:18:55.206 INFO:teuthology.orchestra.run.smithi186.stdout:Nothing to do. 2024-04-25T02:18:55.206 INFO:teuthology.orchestra.run.smithi186.stdout:Complete! 2024-04-25T02:18:55.322 DEBUG:teuthology.orchestra.run.smithi186:> sudo yum -y install ceph-immutable-object-cache 2024-04-25T02:18:55.383 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:10 ago on Thu 25 Apr 2024 02:17:45 AM UTC. 2024-04-25T02:18:56.047 INFO:teuthology.orchestra.run.smithi186.stdout:Last metadata expiration check: 0:01:09 ago on Thu 25 Apr 2024 02:17:47 AM UTC. 2024-04-25T02:18:56.618 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-04-25T02:18:56.619 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-04-25T02:18:56.619 INFO:teuthology.orchestra.run.smithi114.stdout: Package Arch Version Repo Size 2024-04-25T02:18:56.619 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-04-25T02:18:56.619 INFO:teuthology.orchestra.run.smithi114.stdout:Installing: 2024-04-25T02:18:56.619 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-immutable-object-cache x86_64 2:15.2.17-0.el8 ceph 203 k 2024-04-25T02:18:56.619 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:18:56.620 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2024-04-25T02:18:56.620 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-04-25T02:18:56.620 INFO:teuthology.orchestra.run.smithi114.stdout:Install 1 Package 2024-04-25T02:18:56.620 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:18:56.620 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 203 k 2024-04-25T02:18:56.620 INFO:teuthology.orchestra.run.smithi114.stdout:Installed size: 599 k 2024-04-25T02:18:56.620 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading Packages: 2024-04-25T02:18:56.665 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-immutable-object-cache-15.2.17-0.el8.x86_6 4.6 MB/s | 203 kB 00:00 2024-04-25T02:18:56.665 INFO:teuthology.orchestra.run.smithi114.stdout:-------------------------------------------------------------------------------- 2024-04-25T02:18:56.665 INFO:teuthology.orchestra.run.smithi114.stdout:Total 4.4 MB/s | 203 kB 00:00 2024-04-25T02:18:56.665 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2024-04-25T02:18:56.676 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction check succeeded. 2024-04-25T02:18:56.676 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2024-04-25T02:18:56.724 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded. 2024-04-25T02:18:56.727 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2024-04-25T02:18:56.843 INFO:teuthology.orchestra.run.smithi114.stdout: Preparing : 1/1 2024-04-25T02:18:57.010 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 1/1 2024-04-25T02:18:57.027 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-04-25T02:18:57.027 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-04-25T02:18:57.027 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repo Size 2024-04-25T02:18:57.027 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-04-25T02:18:57.028 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-04-25T02:18:57.028 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-immutable-object-cache x86_64 2:15.2.17-0.el8 ceph 203 k 2024-04-25T02:18:57.028 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:18:57.028 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-04-25T02:18:57.028 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-04-25T02:18:57.028 INFO:teuthology.orchestra.run.smithi111.stdout:Install 1 Package 2024-04-25T02:18:57.028 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:18:57.029 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 203 k 2024-04-25T02:18:57.029 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 599 k 2024-04-25T02:18:57.029 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-04-25T02:18:57.078 INFO:teuthology.orchestra.run.smithi111.stdout:ceph-immutable-object-cache-15.2.17-0.el8.x86_6 4.0 MB/s | 203 kB 00:00 2024-04-25T02:18:57.079 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-04-25T02:18:57.079 INFO:teuthology.orchestra.run.smithi111.stdout:Total 3.9 MB/s | 203 kB 00:00 2024-04-25T02:18:57.079 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-04-25T02:18:57.089 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-04-25T02:18:57.090 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-04-25T02:18:57.137 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-04-25T02:18:57.140 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-04-25T02:18:57.258 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-04-25T02:18:57.405 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 1/1 2024-04-25T02:18:57.420 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 1/1 2024-04-25T02:18:57.693 INFO:teuthology.orchestra.run.smithi186.stdout:Dependencies resolved. 2024-04-25T02:18:57.694 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2024-04-25T02:18:57.694 INFO:teuthology.orchestra.run.smithi186.stdout: Package Arch Version Repo Size 2024-04-25T02:18:57.694 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2024-04-25T02:18:57.694 INFO:teuthology.orchestra.run.smithi186.stdout:Installing: 2024-04-25T02:18:57.694 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-immutable-object-cache x86_64 2:15.2.17-0.el8 ceph 203 k 2024-04-25T02:18:57.694 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:18:57.695 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction Summary 2024-04-25T02:18:57.695 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2024-04-25T02:18:57.695 INFO:teuthology.orchestra.run.smithi186.stdout:Install 1 Package 2024-04-25T02:18:57.695 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:18:57.695 INFO:teuthology.orchestra.run.smithi186.stdout:Total download size: 203 k 2024-04-25T02:18:57.695 INFO:teuthology.orchestra.run.smithi186.stdout:Installed size: 599 k 2024-04-25T02:18:57.695 INFO:teuthology.orchestra.run.smithi186.stdout:Downloading Packages: 2024-04-25T02:18:57.738 INFO:teuthology.orchestra.run.smithi186.stdout:ceph-immutable-object-cache-15.2.17-0.el8.x86_6 4.7 MB/s | 203 kB 00:00 2024-04-25T02:18:57.739 INFO:teuthology.orchestra.run.smithi186.stdout:-------------------------------------------------------------------------------- 2024-04-25T02:18:57.739 INFO:teuthology.orchestra.run.smithi186.stdout:Total 4.5 MB/s | 203 kB 00:00 2024-04-25T02:18:57.739 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction check 2024-04-25T02:18:57.750 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction check succeeded. 2024-04-25T02:18:57.750 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction test 2024-04-25T02:18:57.771 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 1/1 2024-04-25T02:18:57.771 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:18:57.771 INFO:teuthology.orchestra.run.smithi114.stdout:Installed: 2024-04-25T02:18:57.771 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:57.771 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:18:57.771 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-04-25T02:18:57.798 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction test succeeded. 2024-04-25T02:18:57.801 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction 2024-04-25T02:18:57.818 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 1/1 2024-04-25T02:18:58.000 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum -y install ceph-mgr 2024-04-25T02:18:58.207 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 1/1 2024-04-25T02:18:58.207 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:18:58.207 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-04-25T02:18:58.208 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:58.208 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:18:58.208 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-04-25T02:18:58.287 INFO:teuthology.orchestra.run.smithi186.stdout: Preparing : 1/1 2024-04-25T02:18:58.412 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-mgr 2024-04-25T02:18:58.685 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 1/1 2024-04-25T02:18:58.731 INFO:teuthology.orchestra.run.smithi114.stdout:Last metadata expiration check: 0:01:12 ago on Thu 25 Apr 2024 02:17:46 AM UTC. 2024-04-25T02:18:59.105 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 1/1 2024-04-25T02:18:59.145 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:14 ago on Thu 25 Apr 2024 02:17:45 AM UTC. 2024-04-25T02:18:59.559 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 1/1 2024-04-25T02:18:59.559 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:18:59.559 INFO:teuthology.orchestra.run.smithi186.stdout:Installed: 2024-04-25T02:18:59.560 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 2024-04-25T02:18:59.560 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:18:59.560 INFO:teuthology.orchestra.run.smithi186.stdout:Complete! 2024-04-25T02:18:59.845 DEBUG:teuthology.orchestra.run.smithi186:> sudo yum -y install ceph-mgr 2024-04-25T02:19:00.337 INFO:teuthology.orchestra.run.smithi114.stdout:Package ceph-mgr-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-25T02:19:00.385 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-04-25T02:19:00.386 INFO:teuthology.orchestra.run.smithi114.stdout:Nothing to do. 2024-04-25T02:19:00.386 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-04-25T02:19:00.490 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum -y install ceph-fuse 2024-04-25T02:19:00.583 INFO:teuthology.orchestra.run.smithi186.stdout:Last metadata expiration check: 0:01:13 ago on Thu 25 Apr 2024 02:17:47 AM UTC. 2024-04-25T02:19:00.739 INFO:teuthology.orchestra.run.smithi111.stdout:Package ceph-mgr-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-25T02:19:00.787 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-04-25T02:19:00.788 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2024-04-25T02:19:00.788 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-04-25T02:19:00.882 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install ceph-fuse 2024-04-25T02:19:01.213 INFO:teuthology.orchestra.run.smithi114.stdout:Last metadata expiration check: 0:01:15 ago on Thu 25 Apr 2024 02:17:46 AM UTC. 2024-04-25T02:19:01.605 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:16 ago on Thu 25 Apr 2024 02:17:45 AM UTC. 2024-04-25T02:19:02.206 INFO:teuthology.orchestra.run.smithi186.stdout:Package ceph-mgr-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-25T02:19:02.254 INFO:teuthology.orchestra.run.smithi186.stdout:Dependencies resolved. 2024-04-25T02:19:02.256 INFO:teuthology.orchestra.run.smithi186.stdout:Nothing to do. 2024-04-25T02:19:02.256 INFO:teuthology.orchestra.run.smithi186.stdout:Complete! 2024-04-25T02:19:02.381 DEBUG:teuthology.orchestra.run.smithi186:> sudo yum -y install ceph-fuse 2024-04-25T02:19:02.858 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-04-25T02:19:02.859 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-04-25T02:19:02.859 INFO:teuthology.orchestra.run.smithi114.stdout: Package Architecture Version Repository Size 2024-04-25T02:19:02.859 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-04-25T02:19:02.859 INFO:teuthology.orchestra.run.smithi114.stdout:Installing: 2024-04-25T02:19:02.860 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-fuse x86_64 2:15.2.17-0.el8 ceph 572 k 2024-04-25T02:19:02.860 INFO:teuthology.orchestra.run.smithi114.stdout:Installing dependencies: 2024-04-25T02:19:02.860 INFO:teuthology.orchestra.run.smithi114.stdout: fuse x86_64 2.9.7-19.el8 baseos 83 k 2024-04-25T02:19:02.860 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:19:02.860 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2024-04-25T02:19:02.860 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-04-25T02:19:02.860 INFO:teuthology.orchestra.run.smithi114.stdout:Install 2 Packages 2024-04-25T02:19:02.860 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:19:02.861 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 656 k 2024-04-25T02:19:02.861 INFO:teuthology.orchestra.run.smithi114.stdout:Installed size: 1.8 M 2024-04-25T02:19:02.861 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading Packages: 2024-04-25T02:19:03.107 INFO:teuthology.orchestra.run.smithi186.stdout:Last metadata expiration check: 0:01:16 ago on Thu 25 Apr 2024 02:17:47 AM UTC. 2024-04-25T02:19:03.117 INFO:teuthology.orchestra.run.smithi114.stdout:(1/2): ceph-fuse-15.2.17-0.el8.x86_64.rpm 8.7 MB/s | 572 kB 00:00 2024-04-25T02:19:03.217 INFO:teuthology.orchestra.run.smithi114.stdout:(2/2): fuse-2.9.7-19.el8.x86_64.rpm 507 kB/s | 83 kB 00:00 2024-04-25T02:19:03.218 INFO:teuthology.orchestra.run.smithi114.stdout:-------------------------------------------------------------------------------- 2024-04-25T02:19:03.218 INFO:teuthology.orchestra.run.smithi114.stdout:Total 1.8 MB/s | 656 kB 00:00 2024-04-25T02:19:03.228 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2024-04-25T02:19:03.248 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction check succeeded. 2024-04-25T02:19:03.248 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2024-04-25T02:19:03.258 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-04-25T02:19:03.259 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-04-25T02:19:03.259 INFO:teuthology.orchestra.run.smithi111.stdout: Package Architecture Version Repository Size 2024-04-25T02:19:03.259 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-04-25T02:19:03.259 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-04-25T02:19:03.259 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-fuse x86_64 2:15.2.17-0.el8 ceph 572 k 2024-04-25T02:19:03.260 INFO:teuthology.orchestra.run.smithi111.stdout:Installing dependencies: 2024-04-25T02:19:03.260 INFO:teuthology.orchestra.run.smithi111.stdout: fuse x86_64 2.9.7-19.el8 baseos 83 k 2024-04-25T02:19:03.260 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:19:03.260 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-04-25T02:19:03.260 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-04-25T02:19:03.260 INFO:teuthology.orchestra.run.smithi111.stdout:Install 2 Packages 2024-04-25T02:19:03.260 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:19:03.260 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 656 k 2024-04-25T02:19:03.260 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 1.8 M 2024-04-25T02:19:03.261 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-04-25T02:19:03.328 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded. 2024-04-25T02:19:03.332 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2024-04-25T02:19:03.494 INFO:teuthology.orchestra.run.smithi114.stdout: Preparing : 1/1 2024-04-25T02:19:03.505 INFO:teuthology.orchestra.run.smithi111.stdout:(1/2): ceph-fuse-15.2.17-0.el8.x86_64.rpm 11 MB/s | 572 kB 00:00 2024-04-25T02:19:03.622 INFO:teuthology.orchestra.run.smithi111.stdout:(2/2): fuse-2.9.7-19.el8.x86_64.rpm 494 kB/s | 83 kB 00:00 2024-04-25T02:19:03.623 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-04-25T02:19:03.623 INFO:teuthology.orchestra.run.smithi111.stdout:Total 1.8 MB/s | 656 kB 00:00 2024-04-25T02:19:03.633 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-04-25T02:19:03.653 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-04-25T02:19:03.653 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-04-25T02:19:03.722 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : fuse-2.9.7-19.el8.x86_64 1/2 2024-04-25T02:19:03.735 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-04-25T02:19:03.738 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-04-25T02:19:03.866 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : ceph-fuse-2:15.2.17-0.el8.x86_64 2/2 2024-04-25T02:19:03.927 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-04-25T02:19:04.140 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : fuse-2.9.7-19.el8.x86_64 1/2 2024-04-25T02:19:04.256 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-fuse-2:15.2.17-0.el8.x86_64 2/2 2024-04-25T02:19:04.256 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-fuse-2:15.2.17-0.el8.x86_64 1/2 2024-04-25T02:19:04.302 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : ceph-fuse-2:15.2.17-0.el8.x86_64 2/2 2024-04-25T02:19:04.639 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : fuse-2.9.7-19.el8.x86_64 2/2 2024-04-25T02:19:04.639 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:19:04.639 INFO:teuthology.orchestra.run.smithi114.stdout:Installed: 2024-04-25T02:19:04.639 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-fuse-2:15.2.17-0.el8.x86_64 fuse-2.9.7-19.el8.x86_64 2024-04-25T02:19:04.639 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:19:04.639 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-04-25T02:19:04.700 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-fuse-2:15.2.17-0.el8.x86_64 2/2 2024-04-25T02:19:04.700 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-fuse-2:15.2.17-0.el8.x86_64 1/2 2024-04-25T02:19:04.748 INFO:teuthology.orchestra.run.smithi186.stdout:Dependencies resolved. 2024-04-25T02:19:04.749 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2024-04-25T02:19:04.749 INFO:teuthology.orchestra.run.smithi186.stdout: Package Architecture Version Repository Size 2024-04-25T02:19:04.749 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2024-04-25T02:19:04.749 INFO:teuthology.orchestra.run.smithi186.stdout:Installing: 2024-04-25T02:19:04.749 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-fuse x86_64 2:15.2.17-0.el8 ceph 572 k 2024-04-25T02:19:04.749 INFO:teuthology.orchestra.run.smithi186.stdout:Installing dependencies: 2024-04-25T02:19:04.749 INFO:teuthology.orchestra.run.smithi186.stdout: fuse x86_64 2.9.7-19.el8 baseos 83 k 2024-04-25T02:19:04.749 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:19:04.749 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction Summary 2024-04-25T02:19:04.749 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2024-04-25T02:19:04.749 INFO:teuthology.orchestra.run.smithi186.stdout:Install 2 Packages 2024-04-25T02:19:04.750 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:19:04.750 INFO:teuthology.orchestra.run.smithi186.stdout:Total download size: 656 k 2024-04-25T02:19:04.750 INFO:teuthology.orchestra.run.smithi186.stdout:Installed size: 1.8 M 2024-04-25T02:19:04.750 INFO:teuthology.orchestra.run.smithi186.stdout:Downloading Packages: 2024-04-25T02:19:04.856 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum -y install librados-devel 2024-04-25T02:19:04.866 INFO:teuthology.orchestra.run.smithi186.stdout:(1/2): ceph-fuse-15.2.17-0.el8.x86_64.rpm 9.7 MB/s | 572 kB 00:00 2024-04-25T02:19:04.967 INFO:teuthology.orchestra.run.smithi186.stdout:(2/2): fuse-2.9.7-19.el8.x86_64.rpm 528 kB/s | 83 kB 00:00 2024-04-25T02:19:04.967 INFO:teuthology.orchestra.run.smithi186.stdout:-------------------------------------------------------------------------------- 2024-04-25T02:19:04.967 INFO:teuthology.orchestra.run.smithi186.stdout:Total 2.9 MB/s | 656 kB 00:00 2024-04-25T02:19:04.977 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction check 2024-04-25T02:19:04.997 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction check succeeded. 2024-04-25T02:19:04.997 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction test 2024-04-25T02:19:05.079 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction test succeeded. 2024-04-25T02:19:05.082 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction 2024-04-25T02:19:05.137 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : fuse-2.9.7-19.el8.x86_64 2/2 2024-04-25T02:19:05.137 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:19:05.137 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-04-25T02:19:05.137 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-fuse-2:15.2.17-0.el8.x86_64 fuse-2.9.7-19.el8.x86_64 2024-04-25T02:19:05.137 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:19:05.138 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-04-25T02:19:05.252 INFO:teuthology.orchestra.run.smithi186.stdout: Preparing : 1/1 2024-04-25T02:19:05.316 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install librados-devel 2024-04-25T02:19:05.471 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : fuse-2.9.7-19.el8.x86_64 1/2 2024-04-25T02:19:05.593 INFO:teuthology.orchestra.run.smithi114.stdout:Last metadata expiration check: 0:01:19 ago on Thu 25 Apr 2024 02:17:46 AM UTC. 2024-04-25T02:19:05.649 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : ceph-fuse-2:15.2.17-0.el8.x86_64 2/2 2024-04-25T02:19:06.041 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: ceph-fuse-2:15.2.17-0.el8.x86_64 2/2 2024-04-25T02:19:06.041 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : ceph-fuse-2:15.2.17-0.el8.x86_64 1/2 2024-04-25T02:19:06.054 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:21 ago on Thu 25 Apr 2024 02:17:45 AM UTC. 2024-04-25T02:19:06.416 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : fuse-2.9.7-19.el8.x86_64 2/2 2024-04-25T02:19:06.416 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:19:06.416 INFO:teuthology.orchestra.run.smithi186.stdout:Installed: 2024-04-25T02:19:06.416 INFO:teuthology.orchestra.run.smithi186.stdout: ceph-fuse-2:15.2.17-0.el8.x86_64 fuse-2.9.7-19.el8.x86_64 2024-04-25T02:19:06.416 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:19:06.416 INFO:teuthology.orchestra.run.smithi186.stdout:Complete! 2024-04-25T02:19:06.633 DEBUG:teuthology.orchestra.run.smithi186:> sudo yum -y install librados-devel 2024-04-25T02:19:07.219 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-04-25T02:19:07.219 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-04-25T02:19:07.219 INFO:teuthology.orchestra.run.smithi114.stdout: Package Architecture Version Repository Size 2024-04-25T02:19:07.219 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-04-25T02:19:07.220 INFO:teuthology.orchestra.run.smithi114.stdout:Installing: 2024-04-25T02:19:07.220 INFO:teuthology.orchestra.run.smithi114.stdout: librados-devel x86_64 2:15.2.17-0.el8 ceph 140 k 2024-04-25T02:19:07.220 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:19:07.220 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2024-04-25T02:19:07.220 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-04-25T02:19:07.220 INFO:teuthology.orchestra.run.smithi114.stdout:Install 1 Package 2024-04-25T02:19:07.220 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:19:07.221 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 140 k 2024-04-25T02:19:07.221 INFO:teuthology.orchestra.run.smithi114.stdout:Installed size: 478 k 2024-04-25T02:19:07.221 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading Packages: 2024-04-25T02:19:07.272 INFO:teuthology.orchestra.run.smithi114.stdout:librados-devel-15.2.17-0.el8.x86_64.rpm 2.7 MB/s | 140 kB 00:00 2024-04-25T02:19:07.273 INFO:teuthology.orchestra.run.smithi114.stdout:-------------------------------------------------------------------------------- 2024-04-25T02:19:07.273 INFO:teuthology.orchestra.run.smithi114.stdout:Total 2.6 MB/s | 140 kB 00:00 2024-04-25T02:19:07.273 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2024-04-25T02:19:07.278 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction check succeeded. 2024-04-25T02:19:07.278 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2024-04-25T02:19:07.324 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded. 2024-04-25T02:19:07.327 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2024-04-25T02:19:07.374 INFO:teuthology.orchestra.run.smithi186.stdout:Last metadata expiration check: 0:01:20 ago on Thu 25 Apr 2024 02:17:47 AM UTC. 2024-04-25T02:19:07.435 INFO:teuthology.orchestra.run.smithi114.stdout: Preparing : 1/1 2024-04-25T02:19:07.599 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : librados-devel-2:15.2.17-0.el8.x86_64 1/1 2024-04-25T02:19:07.693 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-04-25T02:19:07.694 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-04-25T02:19:07.694 INFO:teuthology.orchestra.run.smithi111.stdout: Package Architecture Version Repository Size 2024-04-25T02:19:07.694 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-04-25T02:19:07.694 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-04-25T02:19:07.694 INFO:teuthology.orchestra.run.smithi111.stdout: librados-devel x86_64 2:15.2.17-0.el8 ceph 140 k 2024-04-25T02:19:07.694 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:19:07.694 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-04-25T02:19:07.694 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-04-25T02:19:07.694 INFO:teuthology.orchestra.run.smithi111.stdout:Install 1 Package 2024-04-25T02:19:07.694 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:19:07.695 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 140 k 2024-04-25T02:19:07.695 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 478 k 2024-04-25T02:19:07.695 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-04-25T02:19:07.742 INFO:teuthology.orchestra.run.smithi111.stdout:librados-devel-15.2.17-0.el8.x86_64.rpm 2.9 MB/s | 140 kB 00:00 2024-04-25T02:19:07.743 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-04-25T02:19:07.743 INFO:teuthology.orchestra.run.smithi111.stdout:Total 2.8 MB/s | 140 kB 00:00 2024-04-25T02:19:07.743 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-04-25T02:19:07.748 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-04-25T02:19:07.748 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-04-25T02:19:07.794 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-04-25T02:19:07.797 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-04-25T02:19:07.870 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librados-devel-2:15.2.17-0.el8.x86_64 1/1 2024-04-25T02:19:07.901 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-04-25T02:19:08.067 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : librados-devel-2:15.2.17-0.el8.x86_64 1/1 2024-04-25T02:19:08.245 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librados-devel-2:15.2.17-0.el8.x86_64 1/1 2024-04-25T02:19:08.245 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:19:08.245 INFO:teuthology.orchestra.run.smithi114.stdout:Installed: 2024-04-25T02:19:08.245 INFO:teuthology.orchestra.run.smithi114.stdout: librados-devel-2:15.2.17-0.el8.x86_64 2024-04-25T02:19:08.245 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:19:08.245 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-04-25T02:19:08.440 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: librados-devel-2:15.2.17-0.el8.x86_64 1/1 2024-04-25T02:19:08.483 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum -y install libcephfs2 2024-04-25T02:19:08.833 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librados-devel-2:15.2.17-0.el8.x86_64 1/1 2024-04-25T02:19:08.833 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:19:08.834 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-04-25T02:19:08.834 INFO:teuthology.orchestra.run.smithi111.stdout: librados-devel-2:15.2.17-0.el8.x86_64 2024-04-25T02:19:08.834 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:19:08.834 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-04-25T02:19:09.026 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install libcephfs2 2024-04-25T02:19:09.035 INFO:teuthology.orchestra.run.smithi186.stdout:Dependencies resolved. 2024-04-25T02:19:09.035 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2024-04-25T02:19:09.035 INFO:teuthology.orchestra.run.smithi186.stdout: Package Architecture Version Repository Size 2024-04-25T02:19:09.036 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2024-04-25T02:19:09.036 INFO:teuthology.orchestra.run.smithi186.stdout:Installing: 2024-04-25T02:19:09.036 INFO:teuthology.orchestra.run.smithi186.stdout: librados-devel x86_64 2:15.2.17-0.el8 ceph 140 k 2024-04-25T02:19:09.036 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:19:09.036 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction Summary 2024-04-25T02:19:09.036 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2024-04-25T02:19:09.036 INFO:teuthology.orchestra.run.smithi186.stdout:Install 1 Package 2024-04-25T02:19:09.036 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:19:09.037 INFO:teuthology.orchestra.run.smithi186.stdout:Total download size: 140 k 2024-04-25T02:19:09.037 INFO:teuthology.orchestra.run.smithi186.stdout:Installed size: 478 k 2024-04-25T02:19:09.037 INFO:teuthology.orchestra.run.smithi186.stdout:Downloading Packages: 2024-04-25T02:19:09.087 INFO:teuthology.orchestra.run.smithi186.stdout:librados-devel-15.2.17-0.el8.x86_64.rpm 2.8 MB/s | 140 kB 00:00 2024-04-25T02:19:09.088 INFO:teuthology.orchestra.run.smithi186.stdout:-------------------------------------------------------------------------------- 2024-04-25T02:19:09.088 INFO:teuthology.orchestra.run.smithi186.stdout:Total 2.7 MB/s | 140 kB 00:00 2024-04-25T02:19:09.088 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction check 2024-04-25T02:19:09.093 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction check succeeded. 2024-04-25T02:19:09.093 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction test 2024-04-25T02:19:09.141 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction test succeeded. 2024-04-25T02:19:09.144 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction 2024-04-25T02:19:09.211 INFO:teuthology.orchestra.run.smithi114.stdout:Last metadata expiration check: 0:01:23 ago on Thu 25 Apr 2024 02:17:46 AM UTC. 2024-04-25T02:19:09.256 INFO:teuthology.orchestra.run.smithi186.stdout: Preparing : 1/1 2024-04-25T02:19:09.456 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : librados-devel-2:15.2.17-0.el8.x86_64 1/1 2024-04-25T02:19:09.754 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:24 ago on Thu 25 Apr 2024 02:17:45 AM UTC. 2024-04-25T02:19:09.840 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: librados-devel-2:15.2.17-0.el8.x86_64 1/1 2024-04-25T02:19:10.148 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : librados-devel-2:15.2.17-0.el8.x86_64 1/1 2024-04-25T02:19:10.149 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:19:10.149 INFO:teuthology.orchestra.run.smithi186.stdout:Installed: 2024-04-25T02:19:10.149 INFO:teuthology.orchestra.run.smithi186.stdout: librados-devel-2:15.2.17-0.el8.x86_64 2024-04-25T02:19:10.149 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:19:10.149 INFO:teuthology.orchestra.run.smithi186.stdout:Complete! 2024-04-25T02:19:10.407 DEBUG:teuthology.orchestra.run.smithi186:> sudo yum -y install libcephfs2 2024-04-25T02:19:10.796 INFO:teuthology.orchestra.run.smithi114.stdout:Package libcephfs2-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-25T02:19:10.844 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-04-25T02:19:10.845 INFO:teuthology.orchestra.run.smithi114.stdout:Nothing to do. 2024-04-25T02:19:10.845 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-04-25T02:19:10.948 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum -y install libcephfs-devel 2024-04-25T02:19:11.145 INFO:teuthology.orchestra.run.smithi186.stdout:Last metadata expiration check: 0:01:24 ago on Thu 25 Apr 2024 02:17:47 AM UTC. 2024-04-25T02:19:11.346 INFO:teuthology.orchestra.run.smithi111.stdout:Package libcephfs2-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-25T02:19:11.394 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-04-25T02:19:11.395 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2024-04-25T02:19:11.395 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-04-25T02:19:11.492 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install libcephfs-devel 2024-04-25T02:19:11.663 INFO:teuthology.orchestra.run.smithi114.stdout:Last metadata expiration check: 0:01:25 ago on Thu 25 Apr 2024 02:17:46 AM UTC. 2024-04-25T02:19:12.214 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:27 ago on Thu 25 Apr 2024 02:17:45 AM UTC. 2024-04-25T02:19:12.749 INFO:teuthology.orchestra.run.smithi186.stdout:Package libcephfs2-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-25T02:19:12.798 INFO:teuthology.orchestra.run.smithi186.stdout:Dependencies resolved. 2024-04-25T02:19:12.799 INFO:teuthology.orchestra.run.smithi186.stdout:Nothing to do. 2024-04-25T02:19:12.799 INFO:teuthology.orchestra.run.smithi186.stdout:Complete! 2024-04-25T02:19:12.917 DEBUG:teuthology.orchestra.run.smithi186:> sudo yum -y install libcephfs-devel 2024-04-25T02:19:13.322 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-04-25T02:19:13.323 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-04-25T02:19:13.323 INFO:teuthology.orchestra.run.smithi114.stdout: Package Architecture Version Repository Size 2024-04-25T02:19:13.323 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-04-25T02:19:13.323 INFO:teuthology.orchestra.run.smithi114.stdout:Installing: 2024-04-25T02:19:13.323 INFO:teuthology.orchestra.run.smithi114.stdout: libcephfs-devel x86_64 2:15.2.17-0.el8 ceph 22 k 2024-04-25T02:19:13.323 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:19:13.323 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2024-04-25T02:19:13.323 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-04-25T02:19:13.323 INFO:teuthology.orchestra.run.smithi114.stdout:Install 1 Package 2024-04-25T02:19:13.323 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:19:13.324 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 22 k 2024-04-25T02:19:13.324 INFO:teuthology.orchestra.run.smithi114.stdout:Installed size: 78 k 2024-04-25T02:19:13.324 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading Packages: 2024-04-25T02:19:13.375 INFO:teuthology.orchestra.run.smithi114.stdout:libcephfs-devel-15.2.17-0.el8.x86_64.rpm 424 kB/s | 22 kB 00:00 2024-04-25T02:19:13.376 INFO:teuthology.orchestra.run.smithi114.stdout:-------------------------------------------------------------------------------- 2024-04-25T02:19:13.376 INFO:teuthology.orchestra.run.smithi114.stdout:Total 414 kB/s | 22 kB 00:00 2024-04-25T02:19:13.376 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2024-04-25T02:19:13.379 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction check succeeded. 2024-04-25T02:19:13.379 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2024-04-25T02:19:13.381 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded. 2024-04-25T02:19:13.384 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2024-04-25T02:19:13.428 INFO:teuthology.orchestra.run.smithi114.stdout: Preparing : 1/1 2024-04-25T02:19:13.581 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libcephfs-devel-2:15.2.17-0.el8.x86_64 1/1 2024-04-25T02:19:13.638 INFO:teuthology.orchestra.run.smithi186.stdout:Last metadata expiration check: 0:01:26 ago on Thu 25 Apr 2024 02:17:47 AM UTC. 2024-04-25T02:19:13.840 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: libcephfs-devel-2:15.2.17-0.el8.x86_64 1/1 2024-04-25T02:19:13.870 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-04-25T02:19:13.871 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-04-25T02:19:13.871 INFO:teuthology.orchestra.run.smithi111.stdout: Package Architecture Version Repository Size 2024-04-25T02:19:13.871 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-04-25T02:19:13.871 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-04-25T02:19:13.871 INFO:teuthology.orchestra.run.smithi111.stdout: libcephfs-devel x86_64 2:15.2.17-0.el8 ceph 22 k 2024-04-25T02:19:13.871 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:19:13.871 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-04-25T02:19:13.871 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-04-25T02:19:13.871 INFO:teuthology.orchestra.run.smithi111.stdout:Install 1 Package 2024-04-25T02:19:13.871 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:19:13.872 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 22 k 2024-04-25T02:19:13.872 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 78 k 2024-04-25T02:19:13.872 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-04-25T02:19:13.912 INFO:teuthology.orchestra.run.smithi111.stdout:libcephfs-devel-15.2.17-0.el8.x86_64.rpm 547 kB/s | 22 kB 00:00 2024-04-25T02:19:13.912 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-04-25T02:19:13.912 INFO:teuthology.orchestra.run.smithi111.stdout:Total 532 kB/s | 22 kB 00:00 2024-04-25T02:19:13.913 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-04-25T02:19:13.916 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-04-25T02:19:13.916 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-04-25T02:19:13.918 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-04-25T02:19:13.921 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-04-25T02:19:13.969 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-04-25T02:19:14.116 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libcephfs-devel-2:15.2.17-0.el8.x86_64 1/1 2024-04-25T02:19:14.170 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libcephfs-devel-2:15.2.17-0.el8.x86_64 1/1 2024-04-25T02:19:14.171 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:19:14.171 INFO:teuthology.orchestra.run.smithi114.stdout:Installed: 2024-04-25T02:19:14.171 INFO:teuthology.orchestra.run.smithi114.stdout: libcephfs-devel-2:15.2.17-0.el8.x86_64 2024-04-25T02:19:14.171 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:19:14.171 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-04-25T02:19:14.300 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum -y install librados2 2024-04-25T02:19:14.379 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: libcephfs-devel-2:15.2.17-0.el8.x86_64 1/1 2024-04-25T02:19:14.731 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libcephfs-devel-2:15.2.17-0.el8.x86_64 1/1 2024-04-25T02:19:14.732 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:19:14.732 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-04-25T02:19:14.732 INFO:teuthology.orchestra.run.smithi111.stdout: libcephfs-devel-2:15.2.17-0.el8.x86_64 2024-04-25T02:19:14.732 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:19:14.732 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-04-25T02:19:14.855 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install librados2 2024-04-25T02:19:15.027 INFO:teuthology.orchestra.run.smithi114.stdout:Last metadata expiration check: 0:01:29 ago on Thu 25 Apr 2024 02:17:46 AM UTC. 2024-04-25T02:19:15.289 INFO:teuthology.orchestra.run.smithi186.stdout:Dependencies resolved. 2024-04-25T02:19:15.290 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2024-04-25T02:19:15.290 INFO:teuthology.orchestra.run.smithi186.stdout: Package Architecture Version Repository Size 2024-04-25T02:19:15.290 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2024-04-25T02:19:15.290 INFO:teuthology.orchestra.run.smithi186.stdout:Installing: 2024-04-25T02:19:15.290 INFO:teuthology.orchestra.run.smithi186.stdout: libcephfs-devel x86_64 2:15.2.17-0.el8 ceph 22 k 2024-04-25T02:19:15.290 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:19:15.290 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction Summary 2024-04-25T02:19:15.290 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2024-04-25T02:19:15.290 INFO:teuthology.orchestra.run.smithi186.stdout:Install 1 Package 2024-04-25T02:19:15.290 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:19:15.291 INFO:teuthology.orchestra.run.smithi186.stdout:Total download size: 22 k 2024-04-25T02:19:15.291 INFO:teuthology.orchestra.run.smithi186.stdout:Installed size: 78 k 2024-04-25T02:19:15.291 INFO:teuthology.orchestra.run.smithi186.stdout:Downloading Packages: 2024-04-25T02:19:15.349 INFO:teuthology.orchestra.run.smithi186.stdout:libcephfs-devel-15.2.17-0.el8.x86_64.rpm 373 kB/s | 22 kB 00:00 2024-04-25T02:19:15.349 INFO:teuthology.orchestra.run.smithi186.stdout:-------------------------------------------------------------------------------- 2024-04-25T02:19:15.350 INFO:teuthology.orchestra.run.smithi186.stdout:Total 365 kB/s | 22 kB 00:00 2024-04-25T02:19:15.350 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction check 2024-04-25T02:19:15.353 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction check succeeded. 2024-04-25T02:19:15.354 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction test 2024-04-25T02:19:15.355 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction test succeeded. 2024-04-25T02:19:15.358 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction 2024-04-25T02:19:15.406 INFO:teuthology.orchestra.run.smithi186.stdout: Preparing : 1/1 2024-04-25T02:19:15.572 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : libcephfs-devel-2:15.2.17-0.el8.x86_64 1/1 2024-04-25T02:19:15.595 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:30 ago on Thu 25 Apr 2024 02:17:45 AM UTC. 2024-04-25T02:19:15.833 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: libcephfs-devel-2:15.2.17-0.el8.x86_64 1/1 2024-04-25T02:19:16.198 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : libcephfs-devel-2:15.2.17-0.el8.x86_64 1/1 2024-04-25T02:19:16.198 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:19:16.198 INFO:teuthology.orchestra.run.smithi186.stdout:Installed: 2024-04-25T02:19:16.198 INFO:teuthology.orchestra.run.smithi186.stdout: libcephfs-devel-2:15.2.17-0.el8.x86_64 2024-04-25T02:19:16.198 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:19:16.198 INFO:teuthology.orchestra.run.smithi186.stdout:Complete! 2024-04-25T02:19:16.364 DEBUG:teuthology.orchestra.run.smithi186:> sudo yum -y install librados2 2024-04-25T02:19:16.598 INFO:teuthology.orchestra.run.smithi114.stdout:Package librados2-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-25T02:19:16.646 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-04-25T02:19:16.647 INFO:teuthology.orchestra.run.smithi114.stdout:Nothing to do. 2024-04-25T02:19:16.647 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-04-25T02:19:16.746 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum -y install librbd1 2024-04-25T02:19:17.092 INFO:teuthology.orchestra.run.smithi186.stdout:Last metadata expiration check: 0:01:30 ago on Thu 25 Apr 2024 02:17:47 AM UTC. 2024-04-25T02:19:17.199 INFO:teuthology.orchestra.run.smithi111.stdout:Package librados2-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-25T02:19:17.247 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-04-25T02:19:17.249 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2024-04-25T02:19:17.249 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-04-25T02:19:17.347 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install librbd1 2024-04-25T02:19:17.469 INFO:teuthology.orchestra.run.smithi114.stdout:Last metadata expiration check: 0:01:31 ago on Thu 25 Apr 2024 02:17:46 AM UTC. 2024-04-25T02:19:18.071 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:33 ago on Thu 25 Apr 2024 02:17:45 AM UTC. 2024-04-25T02:19:18.685 INFO:teuthology.orchestra.run.smithi186.stdout:Package librados2-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-25T02:19:18.734 INFO:teuthology.orchestra.run.smithi186.stdout:Dependencies resolved. 2024-04-25T02:19:18.735 INFO:teuthology.orchestra.run.smithi186.stdout:Nothing to do. 2024-04-25T02:19:18.735 INFO:teuthology.orchestra.run.smithi186.stdout:Complete! 2024-04-25T02:19:18.858 DEBUG:teuthology.orchestra.run.smithi186:> sudo yum -y install librbd1 2024-04-25T02:19:19.089 INFO:teuthology.orchestra.run.smithi114.stdout:Package librbd1-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-25T02:19:19.138 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-04-25T02:19:19.139 INFO:teuthology.orchestra.run.smithi114.stdout:Nothing to do. 2024-04-25T02:19:19.139 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-04-25T02:19:19.242 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum -y install python3-rados 2024-04-25T02:19:19.594 INFO:teuthology.orchestra.run.smithi186.stdout:Last metadata expiration check: 0:01:32 ago on Thu 25 Apr 2024 02:17:47 AM UTC. 2024-04-25T02:19:19.672 INFO:teuthology.orchestra.run.smithi111.stdout:Package librbd1-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-25T02:19:19.722 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-04-25T02:19:19.723 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2024-04-25T02:19:19.723 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-04-25T02:19:19.820 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install python3-rados 2024-04-25T02:19:19.967 INFO:teuthology.orchestra.run.smithi114.stdout:Last metadata expiration check: 0:01:33 ago on Thu 25 Apr 2024 02:17:46 AM UTC. 2024-04-25T02:19:20.549 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:35 ago on Thu 25 Apr 2024 02:17:45 AM UTC. 2024-04-25T02:19:21.220 INFO:teuthology.orchestra.run.smithi186.stdout:Package librbd1-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-25T02:19:21.268 INFO:teuthology.orchestra.run.smithi186.stdout:Dependencies resolved. 2024-04-25T02:19:21.269 INFO:teuthology.orchestra.run.smithi186.stdout:Nothing to do. 2024-04-25T02:19:21.269 INFO:teuthology.orchestra.run.smithi186.stdout:Complete! 2024-04-25T02:19:21.385 DEBUG:teuthology.orchestra.run.smithi186:> sudo yum -y install python3-rados 2024-04-25T02:19:21.580 INFO:teuthology.orchestra.run.smithi114.stdout:Package python3-rados-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-25T02:19:21.629 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-04-25T02:19:21.630 INFO:teuthology.orchestra.run.smithi114.stdout:Nothing to do. 2024-04-25T02:19:21.630 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-04-25T02:19:21.744 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum -y install python3-rgw 2024-04-25T02:19:22.111 INFO:teuthology.orchestra.run.smithi186.stdout:Last metadata expiration check: 0:01:35 ago on Thu 25 Apr 2024 02:17:47 AM UTC. 2024-04-25T02:19:22.132 INFO:teuthology.orchestra.run.smithi111.stdout:Package python3-rados-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-25T02:19:22.180 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-04-25T02:19:22.181 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2024-04-25T02:19:22.181 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-04-25T02:19:22.280 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install python3-rgw 2024-04-25T02:19:22.463 INFO:teuthology.orchestra.run.smithi114.stdout:Last metadata expiration check: 0:01:36 ago on Thu 25 Apr 2024 02:17:46 AM UTC. 2024-04-25T02:19:23.005 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:38 ago on Thu 25 Apr 2024 02:17:45 AM UTC. 2024-04-25T02:19:23.726 INFO:teuthology.orchestra.run.smithi186.stdout:Package python3-rados-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-25T02:19:23.774 INFO:teuthology.orchestra.run.smithi186.stdout:Dependencies resolved. 2024-04-25T02:19:23.775 INFO:teuthology.orchestra.run.smithi186.stdout:Nothing to do. 2024-04-25T02:19:23.776 INFO:teuthology.orchestra.run.smithi186.stdout:Complete! 2024-04-25T02:19:23.901 DEBUG:teuthology.orchestra.run.smithi186:> sudo yum -y install python3-rgw 2024-04-25T02:19:24.072 INFO:teuthology.orchestra.run.smithi114.stdout:Package python3-rgw-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-25T02:19:24.120 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-04-25T02:19:24.121 INFO:teuthology.orchestra.run.smithi114.stdout:Nothing to do. 2024-04-25T02:19:24.121 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-04-25T02:19:24.340 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum -y install python3-cephfs 2024-04-25T02:19:24.571 INFO:teuthology.orchestra.run.smithi111.stdout:Package python3-rgw-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-25T02:19:24.618 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-04-25T02:19:24.619 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2024-04-25T02:19:24.620 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-04-25T02:19:24.628 INFO:teuthology.orchestra.run.smithi186.stdout:Last metadata expiration check: 0:01:37 ago on Thu 25 Apr 2024 02:17:47 AM UTC. 2024-04-25T02:19:24.717 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install python3-cephfs 2024-04-25T02:19:25.062 INFO:teuthology.orchestra.run.smithi114.stdout:Last metadata expiration check: 0:01:39 ago on Thu 25 Apr 2024 02:17:46 AM UTC. 2024-04-25T02:19:25.439 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:40 ago on Thu 25 Apr 2024 02:17:45 AM UTC. 2024-04-25T02:19:26.220 INFO:teuthology.orchestra.run.smithi186.stdout:Package python3-rgw-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-25T02:19:26.267 INFO:teuthology.orchestra.run.smithi186.stdout:Dependencies resolved. 2024-04-25T02:19:26.268 INFO:teuthology.orchestra.run.smithi186.stdout:Nothing to do. 2024-04-25T02:19:26.268 INFO:teuthology.orchestra.run.smithi186.stdout:Complete! 2024-04-25T02:19:26.384 DEBUG:teuthology.orchestra.run.smithi186:> sudo yum -y install python3-cephfs 2024-04-25T02:19:26.673 INFO:teuthology.orchestra.run.smithi114.stdout:Package python3-cephfs-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-25T02:19:26.720 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-04-25T02:19:26.721 INFO:teuthology.orchestra.run.smithi114.stdout:Nothing to do. 2024-04-25T02:19:26.721 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-04-25T02:19:26.819 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum -y install python3-rbd 2024-04-25T02:19:27.028 INFO:teuthology.orchestra.run.smithi111.stdout:Package python3-cephfs-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-25T02:19:27.076 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-04-25T02:19:27.077 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2024-04-25T02:19:27.077 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-04-25T02:19:27.108 INFO:teuthology.orchestra.run.smithi186.stdout:Last metadata expiration check: 0:01:40 ago on Thu 25 Apr 2024 02:17:47 AM UTC. 2024-04-25T02:19:27.173 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install python3-rbd 2024-04-25T02:19:27.538 INFO:teuthology.orchestra.run.smithi114.stdout:Last metadata expiration check: 0:01:41 ago on Thu 25 Apr 2024 02:17:46 AM UTC. 2024-04-25T02:19:27.912 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:42 ago on Thu 25 Apr 2024 02:17:45 AM UTC. 2024-04-25T02:19:28.712 INFO:teuthology.orchestra.run.smithi186.stdout:Package python3-cephfs-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-25T02:19:28.760 INFO:teuthology.orchestra.run.smithi186.stdout:Dependencies resolved. 2024-04-25T02:19:28.761 INFO:teuthology.orchestra.run.smithi186.stdout:Nothing to do. 2024-04-25T02:19:28.761 INFO:teuthology.orchestra.run.smithi186.stdout:Complete! 2024-04-25T02:19:28.885 DEBUG:teuthology.orchestra.run.smithi186:> sudo yum -y install python3-rbd 2024-04-25T02:19:29.147 INFO:teuthology.orchestra.run.smithi114.stdout:Package python3-rbd-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-25T02:19:29.195 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-04-25T02:19:29.197 INFO:teuthology.orchestra.run.smithi114.stdout:Nothing to do. 2024-04-25T02:19:29.197 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-04-25T02:19:29.310 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum -y install rbd-fuse 2024-04-25T02:19:29.507 INFO:teuthology.orchestra.run.smithi111.stdout:Package python3-rbd-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-25T02:19:29.554 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-04-25T02:19:29.556 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2024-04-25T02:19:29.556 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-04-25T02:19:29.611 INFO:teuthology.orchestra.run.smithi186.stdout:Last metadata expiration check: 0:01:42 ago on Thu 25 Apr 2024 02:17:47 AM UTC. 2024-04-25T02:19:29.680 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install rbd-fuse 2024-04-25T02:19:30.035 INFO:teuthology.orchestra.run.smithi114.stdout:Last metadata expiration check: 0:01:44 ago on Thu 25 Apr 2024 02:17:46 AM UTC. 2024-04-25T02:19:30.406 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:45 ago on Thu 25 Apr 2024 02:17:45 AM UTC. 2024-04-25T02:19:31.222 INFO:teuthology.orchestra.run.smithi186.stdout:Package python3-rbd-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-25T02:19:31.270 INFO:teuthology.orchestra.run.smithi186.stdout:Dependencies resolved. 2024-04-25T02:19:31.271 INFO:teuthology.orchestra.run.smithi186.stdout:Nothing to do. 2024-04-25T02:19:31.271 INFO:teuthology.orchestra.run.smithi186.stdout:Complete! 2024-04-25T02:19:31.390 DEBUG:teuthology.orchestra.run.smithi186:> sudo yum -y install rbd-fuse 2024-04-25T02:19:31.686 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-04-25T02:19:31.687 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-04-25T02:19:31.687 INFO:teuthology.orchestra.run.smithi114.stdout: Package Architecture Version Repository Size 2024-04-25T02:19:31.687 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-04-25T02:19:31.688 INFO:teuthology.orchestra.run.smithi114.stdout:Installing: 2024-04-25T02:19:31.688 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-fuse x86_64 2:15.2.17-0.el8 ceph 73 k 2024-04-25T02:19:31.688 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:19:31.688 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2024-04-25T02:19:31.688 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-04-25T02:19:31.688 INFO:teuthology.orchestra.run.smithi114.stdout:Install 1 Package 2024-04-25T02:19:31.688 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:19:31.688 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 73 k 2024-04-25T02:19:31.688 INFO:teuthology.orchestra.run.smithi114.stdout:Installed size: 188 k 2024-04-25T02:19:31.688 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading Packages: 2024-04-25T02:19:31.746 INFO:teuthology.orchestra.run.smithi114.stdout:rbd-fuse-15.2.17-0.el8.x86_64.rpm 1.2 MB/s | 73 kB 00:00 2024-04-25T02:19:31.746 INFO:teuthology.orchestra.run.smithi114.stdout:-------------------------------------------------------------------------------- 2024-04-25T02:19:31.747 INFO:teuthology.orchestra.run.smithi114.stdout:Total 1.2 MB/s | 73 kB 00:00 2024-04-25T02:19:31.747 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2024-04-25T02:19:31.756 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction check succeeded. 2024-04-25T02:19:31.756 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2024-04-25T02:19:31.804 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded. 2024-04-25T02:19:31.807 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2024-04-25T02:19:31.908 INFO:teuthology.orchestra.run.smithi114.stdout: Preparing : 1/1 2024-04-25T02:19:32.057 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-04-25T02:19:32.057 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-04-25T02:19:32.057 INFO:teuthology.orchestra.run.smithi111.stdout: Package Architecture Version Repository Size 2024-04-25T02:19:32.057 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-04-25T02:19:32.057 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-04-25T02:19:32.058 INFO:teuthology.orchestra.run.smithi111.stdout: rbd-fuse x86_64 2:15.2.17-0.el8 ceph 73 k 2024-04-25T02:19:32.058 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:19:32.058 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-04-25T02:19:32.058 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-04-25T02:19:32.058 INFO:teuthology.orchestra.run.smithi111.stdout:Install 1 Package 2024-04-25T02:19:32.058 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:19:32.059 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 73 k 2024-04-25T02:19:32.059 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 188 k 2024-04-25T02:19:32.059 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-04-25T02:19:32.086 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : rbd-fuse-2:15.2.17-0.el8.x86_64 1/1 2024-04-25T02:19:32.108 INFO:teuthology.orchestra.run.smithi111.stdout:rbd-fuse-15.2.17-0.el8.x86_64.rpm 1.4 MB/s | 73 kB 00:00 2024-04-25T02:19:32.108 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-04-25T02:19:32.108 INFO:teuthology.orchestra.run.smithi111.stdout:Total 1.4 MB/s | 73 kB 00:00 2024-04-25T02:19:32.109 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-04-25T02:19:32.118 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-04-25T02:19:32.118 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-04-25T02:19:32.122 INFO:teuthology.orchestra.run.smithi186.stdout:Last metadata expiration check: 0:01:45 ago on Thu 25 Apr 2024 02:17:47 AM UTC. 2024-04-25T02:19:32.165 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-04-25T02:19:32.168 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-04-25T02:19:32.266 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-04-25T02:19:32.400 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: rbd-fuse-2:15.2.17-0.el8.x86_64 1/1 2024-04-25T02:19:32.446 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : rbd-fuse-2:15.2.17-0.el8.x86_64 1/1 2024-04-25T02:19:32.743 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: rbd-fuse-2:15.2.17-0.el8.x86_64 1/1 2024-04-25T02:19:32.769 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : rbd-fuse-2:15.2.17-0.el8.x86_64 1/1 2024-04-25T02:19:32.769 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:19:32.769 INFO:teuthology.orchestra.run.smithi114.stdout:Installed: 2024-04-25T02:19:32.769 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-fuse-2:15.2.17-0.el8.x86_64 2024-04-25T02:19:32.769 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:19:32.769 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-04-25T02:19:32.986 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum -y install rbd-mirror 2024-04-25T02:19:33.106 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : rbd-fuse-2:15.2.17-0.el8.x86_64 1/1 2024-04-25T02:19:33.106 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:19:33.106 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-04-25T02:19:33.106 INFO:teuthology.orchestra.run.smithi111.stdout: rbd-fuse-2:15.2.17-0.el8.x86_64 2024-04-25T02:19:33.106 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:19:33.106 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-04-25T02:19:33.331 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install rbd-mirror 2024-04-25T02:19:33.722 INFO:teuthology.orchestra.run.smithi114.stdout:Last metadata expiration check: 0:01:47 ago on Thu 25 Apr 2024 02:17:46 AM UTC. 2024-04-25T02:19:33.756 INFO:teuthology.orchestra.run.smithi186.stdout:Dependencies resolved. 2024-04-25T02:19:33.756 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2024-04-25T02:19:33.757 INFO:teuthology.orchestra.run.smithi186.stdout: Package Architecture Version Repository Size 2024-04-25T02:19:33.757 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2024-04-25T02:19:33.757 INFO:teuthology.orchestra.run.smithi186.stdout:Installing: 2024-04-25T02:19:33.757 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-fuse x86_64 2:15.2.17-0.el8 ceph 73 k 2024-04-25T02:19:33.757 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:19:33.757 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction Summary 2024-04-25T02:19:33.757 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2024-04-25T02:19:33.757 INFO:teuthology.orchestra.run.smithi186.stdout:Install 1 Package 2024-04-25T02:19:33.757 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:19:33.757 INFO:teuthology.orchestra.run.smithi186.stdout:Total download size: 73 k 2024-04-25T02:19:33.757 INFO:teuthology.orchestra.run.smithi186.stdout:Installed size: 188 k 2024-04-25T02:19:33.757 INFO:teuthology.orchestra.run.smithi186.stdout:Downloading Packages: 2024-04-25T02:19:33.822 INFO:teuthology.orchestra.run.smithi186.stdout:rbd-fuse-15.2.17-0.el8.x86_64.rpm 1.1 MB/s | 73 kB 00:00 2024-04-25T02:19:33.822 INFO:teuthology.orchestra.run.smithi186.stdout:-------------------------------------------------------------------------------- 2024-04-25T02:19:33.822 INFO:teuthology.orchestra.run.smithi186.stdout:Total 1.1 MB/s | 73 kB 00:00 2024-04-25T02:19:33.823 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction check 2024-04-25T02:19:33.832 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction check succeeded. 2024-04-25T02:19:33.832 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction test 2024-04-25T02:19:33.878 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction test succeeded. 2024-04-25T02:19:33.881 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction 2024-04-25T02:19:33.985 INFO:teuthology.orchestra.run.smithi186.stdout: Preparing : 1/1 2024-04-25T02:19:34.068 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:49 ago on Thu 25 Apr 2024 02:17:45 AM UTC. 2024-04-25T02:19:34.160 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : rbd-fuse-2:15.2.17-0.el8.x86_64 1/1 2024-04-25T02:19:34.445 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: rbd-fuse-2:15.2.17-0.el8.x86_64 1/1 2024-04-25T02:19:34.820 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : rbd-fuse-2:15.2.17-0.el8.x86_64 1/1 2024-04-25T02:19:34.820 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:19:34.820 INFO:teuthology.orchestra.run.smithi186.stdout:Installed: 2024-04-25T02:19:34.820 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-fuse-2:15.2.17-0.el8.x86_64 2024-04-25T02:19:34.820 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:19:34.820 INFO:teuthology.orchestra.run.smithi186.stdout:Complete! 2024-04-25T02:19:35.103 DEBUG:teuthology.orchestra.run.smithi186:> sudo yum -y install rbd-mirror 2024-04-25T02:19:35.374 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-04-25T02:19:35.378 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-04-25T02:19:35.378 INFO:teuthology.orchestra.run.smithi114.stdout: Package Architecture Version Repository Size 2024-04-25T02:19:35.378 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-04-25T02:19:35.379 INFO:teuthology.orchestra.run.smithi114.stdout:Installing: 2024-04-25T02:19:35.379 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-mirror x86_64 2:15.2.17-0.el8 ceph 2.7 M 2024-04-25T02:19:35.379 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:19:35.379 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2024-04-25T02:19:35.379 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-04-25T02:19:35.379 INFO:teuthology.orchestra.run.smithi114.stdout:Install 1 Package 2024-04-25T02:19:35.379 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:19:35.379 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 2.7 M 2024-04-25T02:19:35.379 INFO:teuthology.orchestra.run.smithi114.stdout:Installed size: 9.8 M 2024-04-25T02:19:35.379 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading Packages: 2024-04-25T02:19:35.448 INFO:teuthology.orchestra.run.smithi114.stdout:rbd-mirror-15.2.17-0.el8.x86_64.rpm 38 MB/s | 2.7 MB 00:00 2024-04-25T02:19:35.449 INFO:teuthology.orchestra.run.smithi114.stdout:-------------------------------------------------------------------------------- 2024-04-25T02:19:35.449 INFO:teuthology.orchestra.run.smithi114.stdout:Total 37 MB/s | 2.7 MB 00:00 2024-04-25T02:19:35.450 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2024-04-25T02:19:35.461 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction check succeeded. 2024-04-25T02:19:35.461 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2024-04-25T02:19:35.516 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded. 2024-04-25T02:19:35.519 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2024-04-25T02:19:35.723 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-04-25T02:19:35.723 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-04-25T02:19:35.724 INFO:teuthology.orchestra.run.smithi111.stdout: Package Architecture Version Repository Size 2024-04-25T02:19:35.724 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-04-25T02:19:35.724 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-04-25T02:19:35.724 INFO:teuthology.orchestra.run.smithi111.stdout: rbd-mirror x86_64 2:15.2.17-0.el8 ceph 2.7 M 2024-04-25T02:19:35.724 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:19:35.724 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-04-25T02:19:35.724 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-04-25T02:19:35.724 INFO:teuthology.orchestra.run.smithi111.stdout:Install 1 Package 2024-04-25T02:19:35.724 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:19:35.725 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 2.7 M 2024-04-25T02:19:35.725 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 9.8 M 2024-04-25T02:19:35.725 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-04-25T02:19:35.802 INFO:teuthology.orchestra.run.smithi111.stdout:rbd-mirror-15.2.17-0.el8.x86_64.rpm 35 MB/s | 2.7 MB 00:00 2024-04-25T02:19:35.803 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-04-25T02:19:35.803 INFO:teuthology.orchestra.run.smithi111.stdout:Total 35 MB/s | 2.7 MB 00:00 2024-04-25T02:19:35.803 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-04-25T02:19:35.814 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-04-25T02:19:35.814 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-04-25T02:19:35.841 INFO:teuthology.orchestra.run.smithi186.stdout:Last metadata expiration check: 0:01:48 ago on Thu 25 Apr 2024 02:17:47 AM UTC. 2024-04-25T02:19:35.862 INFO:teuthology.orchestra.run.smithi114.stdout: Preparing : 1/1 2024-04-25T02:19:35.871 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-04-25T02:19:35.874 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-04-25T02:19:36.038 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : rbd-mirror-2:15.2.17-0.el8.x86_64 1/1 2024-04-25T02:19:36.235 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-04-25T02:19:36.406 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : rbd-mirror-2:15.2.17-0.el8.x86_64 1/1 2024-04-25T02:19:36.446 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: rbd-mirror-2:15.2.17-0.el8.x86_64 1/1 2024-04-25T02:19:36.802 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: rbd-mirror-2:15.2.17-0.el8.x86_64 1/1 2024-04-25T02:19:36.807 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : rbd-mirror-2:15.2.17-0.el8.x86_64 1/1 2024-04-25T02:19:36.807 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:19:36.807 INFO:teuthology.orchestra.run.smithi114.stdout:Installed: 2024-04-25T02:19:36.807 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-mirror-2:15.2.17-0.el8.x86_64 2024-04-25T02:19:36.807 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:19:36.808 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-04-25T02:19:37.007 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum -y install rbd-nbd 2024-04-25T02:19:37.180 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : rbd-mirror-2:15.2.17-0.el8.x86_64 1/1 2024-04-25T02:19:37.180 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:19:37.180 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-04-25T02:19:37.181 INFO:teuthology.orchestra.run.smithi111.stdout: rbd-mirror-2:15.2.17-0.el8.x86_64 2024-04-25T02:19:37.181 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:19:37.181 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-04-25T02:19:37.398 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install rbd-nbd 2024-04-25T02:19:37.477 INFO:teuthology.orchestra.run.smithi186.stdout:Dependencies resolved. 2024-04-25T02:19:37.477 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2024-04-25T02:19:37.477 INFO:teuthology.orchestra.run.smithi186.stdout: Package Architecture Version Repository Size 2024-04-25T02:19:37.477 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2024-04-25T02:19:37.477 INFO:teuthology.orchestra.run.smithi186.stdout:Installing: 2024-04-25T02:19:37.477 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-mirror x86_64 2:15.2.17-0.el8 ceph 2.7 M 2024-04-25T02:19:37.477 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:19:37.477 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction Summary 2024-04-25T02:19:37.478 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2024-04-25T02:19:37.478 INFO:teuthology.orchestra.run.smithi186.stdout:Install 1 Package 2024-04-25T02:19:37.478 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:19:37.478 INFO:teuthology.orchestra.run.smithi186.stdout:Total download size: 2.7 M 2024-04-25T02:19:37.478 INFO:teuthology.orchestra.run.smithi186.stdout:Installed size: 9.8 M 2024-04-25T02:19:37.478 INFO:teuthology.orchestra.run.smithi186.stdout:Downloading Packages: 2024-04-25T02:19:37.547 INFO:teuthology.orchestra.run.smithi186.stdout:rbd-mirror-15.2.17-0.el8.x86_64.rpm 39 MB/s | 2.7 MB 00:00 2024-04-25T02:19:37.548 INFO:teuthology.orchestra.run.smithi186.stdout:-------------------------------------------------------------------------------- 2024-04-25T02:19:37.548 INFO:teuthology.orchestra.run.smithi186.stdout:Total 39 MB/s | 2.7 MB 00:00 2024-04-25T02:19:37.549 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction check 2024-04-25T02:19:37.559 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction check succeeded. 2024-04-25T02:19:37.559 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction test 2024-04-25T02:19:37.617 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction test succeeded. 2024-04-25T02:19:37.620 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction 2024-04-25T02:19:37.736 INFO:teuthology.orchestra.run.smithi114.stdout:Last metadata expiration check: 0:01:51 ago on Thu 25 Apr 2024 02:17:46 AM UTC. 2024-04-25T02:19:37.981 INFO:teuthology.orchestra.run.smithi186.stdout: Preparing : 1/1 2024-04-25T02:19:38.128 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : rbd-mirror-2:15.2.17-0.el8.x86_64 1/1 2024-04-25T02:19:38.135 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:53 ago on Thu 25 Apr 2024 02:17:45 AM UTC. 2024-04-25T02:19:38.579 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: rbd-mirror-2:15.2.17-0.el8.x86_64 1/1 2024-04-25T02:19:38.942 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : rbd-mirror-2:15.2.17-0.el8.x86_64 1/1 2024-04-25T02:19:38.942 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:19:38.942 INFO:teuthology.orchestra.run.smithi186.stdout:Installed: 2024-04-25T02:19:38.943 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-mirror-2:15.2.17-0.el8.x86_64 2024-04-25T02:19:38.943 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:19:38.943 INFO:teuthology.orchestra.run.smithi186.stdout:Complete! 2024-04-25T02:19:39.182 DEBUG:teuthology.orchestra.run.smithi186:> sudo yum -y install rbd-nbd 2024-04-25T02:19:39.383 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-04-25T02:19:39.383 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-04-25T02:19:39.383 INFO:teuthology.orchestra.run.smithi114.stdout: Package Architecture Version Repository Size 2024-04-25T02:19:39.383 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-04-25T02:19:39.383 INFO:teuthology.orchestra.run.smithi114.stdout:Installing: 2024-04-25T02:19:39.383 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-nbd x86_64 2:15.2.17-0.el8 ceph 140 k 2024-04-25T02:19:39.383 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:19:39.383 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2024-04-25T02:19:39.384 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-04-25T02:19:39.384 INFO:teuthology.orchestra.run.smithi114.stdout:Install 1 Package 2024-04-25T02:19:39.384 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:19:39.384 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 140 k 2024-04-25T02:19:39.384 INFO:teuthology.orchestra.run.smithi114.stdout:Installed size: 418 k 2024-04-25T02:19:39.384 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading Packages: 2024-04-25T02:19:39.426 INFO:teuthology.orchestra.run.smithi114.stdout:rbd-nbd-15.2.17-0.el8.x86_64.rpm 3.3 MB/s | 140 kB 00:00 2024-04-25T02:19:39.427 INFO:teuthology.orchestra.run.smithi114.stdout:-------------------------------------------------------------------------------- 2024-04-25T02:19:39.427 INFO:teuthology.orchestra.run.smithi114.stdout:Total 3.2 MB/s | 140 kB 00:00 2024-04-25T02:19:39.427 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2024-04-25T02:19:39.436 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction check succeeded. 2024-04-25T02:19:39.436 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2024-04-25T02:19:39.482 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded. 2024-04-25T02:19:39.485 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2024-04-25T02:19:39.596 INFO:teuthology.orchestra.run.smithi114.stdout: Preparing : 1/1 2024-04-25T02:19:39.782 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-04-25T02:19:39.782 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-04-25T02:19:39.782 INFO:teuthology.orchestra.run.smithi111.stdout: Package Architecture Version Repository Size 2024-04-25T02:19:39.782 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-04-25T02:19:39.783 INFO:teuthology.orchestra.run.smithi111.stdout:Installing: 2024-04-25T02:19:39.783 INFO:teuthology.orchestra.run.smithi111.stdout: rbd-nbd x86_64 2:15.2.17-0.el8 ceph 140 k 2024-04-25T02:19:39.783 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:19:39.783 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-04-25T02:19:39.783 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-04-25T02:19:39.783 INFO:teuthology.orchestra.run.smithi111.stdout:Install 1 Package 2024-04-25T02:19:39.783 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:19:39.784 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 140 k 2024-04-25T02:19:39.784 INFO:teuthology.orchestra.run.smithi111.stdout:Installed size: 418 k 2024-04-25T02:19:39.784 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-04-25T02:19:39.810 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : rbd-nbd-2:15.2.17-0.el8.x86_64 1/1 2024-04-25T02:19:39.854 INFO:teuthology.orchestra.run.smithi111.stdout:rbd-nbd-15.2.17-0.el8.x86_64.rpm 1.9 MB/s | 140 kB 00:00 2024-04-25T02:19:39.855 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-04-25T02:19:39.855 INFO:teuthology.orchestra.run.smithi111.stdout:Total 1.9 MB/s | 140 kB 00:00 2024-04-25T02:19:39.855 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-04-25T02:19:39.864 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-04-25T02:19:39.864 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-04-25T02:19:39.910 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-04-25T02:19:39.913 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-04-25T02:19:39.922 INFO:teuthology.orchestra.run.smithi186.stdout:Last metadata expiration check: 0:01:52 ago on Thu 25 Apr 2024 02:17:47 AM UTC. 2024-04-25T02:19:40.020 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-04-25T02:19:40.111 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: rbd-nbd-2:15.2.17-0.el8.x86_64 1/1 2024-04-25T02:19:40.212 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : rbd-nbd-2:15.2.17-0.el8.x86_64 1/1 2024-04-25T02:19:40.486 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : rbd-nbd-2:15.2.17-0.el8.x86_64 1/1 2024-04-25T02:19:40.487 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:19:40.487 INFO:teuthology.orchestra.run.smithi114.stdout:Installed: 2024-04-25T02:19:40.487 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-nbd-2:15.2.17-0.el8.x86_64 2024-04-25T02:19:40.487 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:19:40.487 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-04-25T02:19:40.488 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: rbd-nbd-2:15.2.17-0.el8.x86_64 1/1 2024-04-25T02:19:40.695 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum -y install librados2 2024-04-25T02:19:40.865 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : rbd-nbd-2:15.2.17-0.el8.x86_64 1/1 2024-04-25T02:19:40.865 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:19:40.865 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-04-25T02:19:40.865 INFO:teuthology.orchestra.run.smithi111.stdout: rbd-nbd-2:15.2.17-0.el8.x86_64 2024-04-25T02:19:40.865 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:19:40.866 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-04-25T02:19:41.097 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y install librados2 2024-04-25T02:19:41.431 INFO:teuthology.orchestra.run.smithi114.stdout:Last metadata expiration check: 0:01:55 ago on Thu 25 Apr 2024 02:17:46 AM UTC. 2024-04-25T02:19:41.605 INFO:teuthology.orchestra.run.smithi186.stdout:Dependencies resolved. 2024-04-25T02:19:41.605 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2024-04-25T02:19:41.605 INFO:teuthology.orchestra.run.smithi186.stdout: Package Architecture Version Repository Size 2024-04-25T02:19:41.605 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2024-04-25T02:19:41.605 INFO:teuthology.orchestra.run.smithi186.stdout:Installing: 2024-04-25T02:19:41.606 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-nbd x86_64 2:15.2.17-0.el8 ceph 140 k 2024-04-25T02:19:41.606 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:19:41.606 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction Summary 2024-04-25T02:19:41.606 INFO:teuthology.orchestra.run.smithi186.stdout:================================================================================ 2024-04-25T02:19:41.606 INFO:teuthology.orchestra.run.smithi186.stdout:Install 1 Package 2024-04-25T02:19:41.606 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:19:41.606 INFO:teuthology.orchestra.run.smithi186.stdout:Total download size: 140 k 2024-04-25T02:19:41.607 INFO:teuthology.orchestra.run.smithi186.stdout:Installed size: 418 k 2024-04-25T02:19:41.607 INFO:teuthology.orchestra.run.smithi186.stdout:Downloading Packages: 2024-04-25T02:19:41.667 INFO:teuthology.orchestra.run.smithi186.stdout:rbd-nbd-15.2.17-0.el8.x86_64.rpm 2.3 MB/s | 140 kB 00:00 2024-04-25T02:19:41.667 INFO:teuthology.orchestra.run.smithi186.stdout:-------------------------------------------------------------------------------- 2024-04-25T02:19:41.667 INFO:teuthology.orchestra.run.smithi186.stdout:Total 2.2 MB/s | 140 kB 00:00 2024-04-25T02:19:41.668 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction check 2024-04-25T02:19:41.677 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction check succeeded. 2024-04-25T02:19:41.677 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction test 2024-04-25T02:19:41.725 INFO:teuthology.orchestra.run.smithi186.stdout:Transaction test succeeded. 2024-04-25T02:19:41.728 INFO:teuthology.orchestra.run.smithi186.stdout:Running transaction 2024-04-25T02:19:41.829 INFO:teuthology.orchestra.run.smithi111.stdout:Last metadata expiration check: 0:01:56 ago on Thu 25 Apr 2024 02:17:45 AM UTC. 2024-04-25T02:19:41.859 INFO:teuthology.orchestra.run.smithi186.stdout: Preparing : 1/1 2024-04-25T02:19:42.068 INFO:teuthology.orchestra.run.smithi186.stdout: Installing : rbd-nbd-2:15.2.17-0.el8.x86_64 1/1 2024-04-25T02:19:42.350 INFO:teuthology.orchestra.run.smithi186.stdout: Running scriptlet: rbd-nbd-2:15.2.17-0.el8.x86_64 1/1 2024-04-25T02:19:42.735 INFO:teuthology.orchestra.run.smithi186.stdout: Verifying : rbd-nbd-2:15.2.17-0.el8.x86_64 1/1 2024-04-25T02:19:42.735 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:19:42.735 INFO:teuthology.orchestra.run.smithi186.stdout:Installed: 2024-04-25T02:19:42.735 INFO:teuthology.orchestra.run.smithi186.stdout: rbd-nbd-2:15.2.17-0.el8.x86_64 2024-04-25T02:19:42.736 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:19:42.736 INFO:teuthology.orchestra.run.smithi186.stdout:Complete! 2024-04-25T02:19:43.010 DEBUG:teuthology.orchestra.run.smithi186:> sudo yum -y install librados2 2024-04-25T02:19:43.031 INFO:teuthology.orchestra.run.smithi114.stdout:Package librados2-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-25T02:19:43.080 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-04-25T02:19:43.081 INFO:teuthology.orchestra.run.smithi114.stdout:Nothing to do. 2024-04-25T02:19:43.082 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-04-25T02:19:43.189 DEBUG:teuthology.parallel:result is None 2024-04-25T02:19:43.424 INFO:teuthology.orchestra.run.smithi111.stdout:Package librados2-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-25T02:19:43.471 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-04-25T02:19:43.473 INFO:teuthology.orchestra.run.smithi111.stdout:Nothing to do. 2024-04-25T02:19:43.473 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-04-25T02:19:43.578 DEBUG:teuthology.parallel:result is None 2024-04-25T02:19:43.740 INFO:teuthology.orchestra.run.smithi186.stdout:Last metadata expiration check: 0:01:56 ago on Thu 25 Apr 2024 02:17:47 AM UTC. 2024-04-25T02:19:45.345 INFO:teuthology.orchestra.run.smithi186.stdout:Package librados2-2:15.2.17-0.el8.x86_64 is already installed. 2024-04-25T02:19:45.394 INFO:teuthology.orchestra.run.smithi186.stdout:Dependencies resolved. 2024-04-25T02:19:45.395 INFO:teuthology.orchestra.run.smithi186.stdout:Nothing to do. 2024-04-25T02:19:45.395 INFO:teuthology.orchestra.run.smithi186.stdout:Complete! 2024-04-25T02:19:45.516 DEBUG:teuthology.parallel:result is None 2024-04-25T02:19:45.516 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T02:19:45.516 INFO:teuthology.packaging:ref: None 2024-04-25T02:19:45.516 INFO:teuthology.packaging:tag: None 2024-04-25T02:19:45.517 INFO:teuthology.packaging:branch: octopus 2024-04-25T02:19:45.517 INFO:teuthology.packaging:sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T02:19:45.517 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=octopus 2024-04-25T02:19:45.897 DEBUG:teuthology.orchestra.run.smithi111:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T02:19:45.925 INFO:teuthology.orchestra.run.smithi111.stdout:15.2.17-0.el8 2024-04-25T02:19:45.925 INFO:teuthology.packaging:The installed version of ceph is 15.2.17-0.el8 2024-04-25T02:19:45.926 INFO:teuthology.task.install:The correct ceph version 15.2.17-0 is installed. 2024-04-25T02:19:45.927 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T02:19:45.928 INFO:teuthology.packaging:ref: None 2024-04-25T02:19:45.928 INFO:teuthology.packaging:tag: None 2024-04-25T02:19:45.928 INFO:teuthology.packaging:branch: octopus 2024-04-25T02:19:45.928 INFO:teuthology.packaging:sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T02:19:45.928 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=octopus 2024-04-25T02:19:46.148 DEBUG:teuthology.orchestra.run.smithi114:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T02:19:46.175 INFO:teuthology.orchestra.run.smithi114.stdout:15.2.17-0.el8 2024-04-25T02:19:46.175 INFO:teuthology.packaging:The installed version of ceph is 15.2.17-0.el8 2024-04-25T02:19:46.175 INFO:teuthology.task.install:The correct ceph version 15.2.17-0 is installed. 2024-04-25T02:19:46.177 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-25T02:19:46.177 INFO:teuthology.packaging:ref: None 2024-04-25T02:19:46.177 INFO:teuthology.packaging:tag: None 2024-04-25T02:19:46.177 INFO:teuthology.packaging:branch: octopus 2024-04-25T02:19:46.177 INFO:teuthology.packaging:sha1: d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T02:19:46.177 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=octopus 2024-04-25T02:19:46.393 DEBUG:teuthology.orchestra.run.smithi186:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T02:19:46.418 INFO:teuthology.orchestra.run.smithi186.stdout:15.2.17-0.el8 2024-04-25T02:19:46.418 INFO:teuthology.packaging:The installed version of ceph is 15.2.17-0.el8 2024-04-25T02:19:46.419 INFO:teuthology.task.install:The correct ceph version 15.2.17-0 is installed. 2024-04-25T02:19:46.420 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-25T02:19:46.421 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-25T02:19:46.421 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T02:19:46.453 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-25T02:19:46.453 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T02:19:46.485 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T02:19:46.485 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-25T02:19:46.515 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-25T02:19:46.516 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-25T02:19:46.516 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T02:19:46.548 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T02:19:46.617 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-25T02:19:46.617 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T02:19:46.649 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T02:19:46.719 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T02:19:46.719 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/usr/bin/daemon-helper 2024-04-25T02:19:46.750 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-25T02:19:46.820 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-25T02:19:46.821 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-25T02:19:46.821 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T02:19:46.851 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T02:19:46.921 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-25T02:19:46.921 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T02:19:46.953 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T02:19:47.024 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T02:19:47.025 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-25T02:19:47.054 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-25T02:19:47.123 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-25T02:19:47.123 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-25T02:19:47.124 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T02:19:47.154 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T02:19:47.223 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-25T02:19:47.223 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T02:19:47.255 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T02:19:47.327 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T02:19:47.327 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/usr/bin/stdin-killer 2024-04-25T02:19:47.356 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-25T02:19:47.425 INFO:teuthology.run_tasks:Running task print... 2024-04-25T02:19:47.433 INFO:teuthology.task.print:**** done installing octopus 2024-04-25T02:19:47.433 INFO:teuthology.run_tasks:Running task ceph... 2024-04-25T02:19:47.509 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-25T02:19:47.509 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 777 /var/log/ceph 2024-04-25T02:19:47.512 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 777 /var/log/ceph 2024-04-25T02:19:47.514 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod 777 /var/log/ceph 2024-04-25T02:19:47.544 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-25T02:19:47.544 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T02:19:47.583 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T02:19:47.586 DEBUG:teuthology.orchestra.run.smithi186:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-25T02:19:47.615 INFO:tasks.ceph:Creating extra log directories... 2024-04-25T02:19:47.615 DEBUG:teuthology.orchestra.run.smithi111:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T02:19:47.652 DEBUG:teuthology.orchestra.run.smithi114:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T02:19:47.657 DEBUG:teuthology.orchestra.run.smithi186:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-25T02:19:47.696 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-25T02:19:47.696 INFO:tasks.ceph:config {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request', 'missing required features'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-25T02:19:47.696 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672379', 'branch': 'squid', 'description': 'fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}}', 'email': 'ceph-qa@ceph.com', 'first_in_suite': False, 'job_id': '7672379', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'meta': [{'desc': 'install ceph/octopus latest\n'}], 'name': 'teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': False, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'centos', 'os_version': '8.stream', 'overrides': {'admin_socket': {'branch': 'squid'}, 'ceph': {'cephfs': {'max_mds': 2}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request', 'missing required features'], 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}}, 'nuke-on-error': False, 'selinux': {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0']}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'squid', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}}, 'owner': 'scheduled_teuthology@teuthology', 'priority': 100, 'repo': 'https://git.ceph.com/ceph.git', 'roles': [['mon.a', 'mon.b', 'mon.c', 'mgr.x', 'mgr.y', 'mds.a', 'mds.b', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3'], ['client.0'], ['client.1']], 'seed': 8528, 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'sleep_before_teardown': 0, 'subset': '122/512', 'suite': 'fs', 'suite_branch': 'squid', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph_d2c45d977142e024a59b68a8f1dce8f0b9840551/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph.git', 'suite_sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'targets': {'smithi111.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBPERtPLPbjh+ore3r8rrFFjeMLL/8p/vObStZuJkoLwlAf/d0FkQgcnHL525JUjIS7AmXD3mX2ThtWumF5OK/7I=', 'smithi114.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOT85DpUXsx4TEQFhFoE4PIakOMeAwivZx/rP1jG1yhvj82ceb6QXNZd5sePXZA0XN7beKoTid06U4UOSh3GG9U=', 'smithi186.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCfUx0GMcqkgFw1FYWmH1+4HajG+pleNLK8MOUK5h/rfo8VDgmrVbPJ1yuVjUdztxnNHVOOEdaV53SGzTXbYeGI='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'branch': 'octopus', 'exclude_packages': ['librados3', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'cephadm', 'ceph-volume'], 'extra_packages': ['librados2'], 'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'}}, {'print': '**** done installing octopus'}, {'ceph': {'conf': {'global': {'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'log-ignorelist': ['overall HEALTH_', '\\(FS_', '\\(MDS_', '\\(OSD_', '\\(MON_DOWN\\)', '\\(CACHE_POOL_', '\\(POOL_', '\\(MGR_DOWN\\)', '\\(PG_', '\\(SMALLER_PGP_NUM\\)', 'Monitor daemon marked osd', 'Behind on trimming', 'Manager daemon', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'scrub mismatch', 'ScrubResult', 'wrongly marked', '\\(POOL_APP_NOT_ENABLED\\)', '\\(SLOW_OPS\\)', 'overall HEALTH_', '\\(MON_MSGR2_NOT_ENABLED\\)', 'slow request', 'missing required features'], 'cephfs': {'max_mds': 2}, 'flavor': 'default', 'fs': 'xfs', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551', 'cluster': 'ceph'}}, {'exec': {'osd.0': ['ceph osd set-require-min-compat-client octopus']}}, {'print': '**** done ceph'}, {'ceph-fuse': None}, {'print': '**** done octopus client'}, {'print': '**** done fsstress'}, {'mds_pre_upgrade': None}, {'print': '**** done mds pre-upgrade sequence'}, {'install.upgrade': {'mon.a': {'branch': 'quincy'}}}, {'print': '**** done install.upgrade the host'}, {'ceph.restart': {'daemons': ['mon.*', 'mgr.*'], 'mon-health-to-clog': False, 'wait-for-healthy': False}}, {'ceph.healthy': None}, {'ceph.restart': {'daemons': ['osd.*'], 'wait-for-healthy': False, 'wait-for-osds-up': True}}, {'ceph.stop': ['mds.*']}, {'ceph.restart': {'daemons': ['mds.*'], 'wait-for-healthy': False, 'wait-for-osds-up': True}}, {'exec': {'mon.a': ['ceph versions', 'ceph osd dump -f json-pretty', 'ceph osd require-osd-release quincy', 'for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done']}}, {'ceph.healthy': None}, {'print': '**** done ceph.restart'}, {'install.upgrade': {'client.0': {'branch': 'quincy'}}}, {'print': '**** done install.upgrade on client.0'}, {'ceph-fuse': {'client.0': {'mounted': False}, 'client.1': {'skip': True}}}, {'ceph-fuse': {'client.0': None, 'client.1': {'skip': True}}}, {'print': '**** done remount client'}, {'exec': {'mon.a': ['ceph fs dump --format=json-pretty', 'ceph fs required_client_features cephfs add metric_collect']}}, {'sleep': {'duration': 5}}, {'fs.clients_evicted': {'clients': {'client.0': False, 'client.1': True}}}, {'workunit': {'clients': {'client.0': ['suites/fsstress.sh']}}}, {'print': '**** done fsstress'}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-24_21:24:02', 'tube': 'smithi', 'user': 'teuthology', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-25T02:19:47.697 DEBUG:teuthology.orchestra.run.smithi111:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T02:19:47.721 DEBUG:teuthology.orchestra.run.smithi114:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T02:19:47.729 DEBUG:teuthology.orchestra.run.smithi186:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-25T02:19:47.747 DEBUG:teuthology.orchestra.run.smithi111:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T02:19:47.780 DEBUG:teuthology.orchestra.run.smithi114:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T02:19:47.789 DEBUG:teuthology.orchestra.run.smithi186:> sudo install -d -m0777 -- /var/run/ceph 2024-04-25T02:19:47.817 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-25T02:19:47.817 DEBUG:teuthology.orchestra.run.smithi111:> dd if=/scratch_devs of=/dev/stdout 2024-04-25T02:19:47.864 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-25T02:19:47.864 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_1 2024-04-25T02:19:47.921 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-25T02:19:47.922 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T02:19:47.922 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 6h/6d Inode: 167568 Links: 1 2024-04-25T02:19:47.922 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T02:19:47.922 INFO:teuthology.orchestra.run.smithi111.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T02:19:47.922 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2024-04-25 02:19:36.556467006 +0000 2024-04-25T02:19:47.922 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2024-04-25 02:16:58.423522285 +0000 2024-04-25T02:19:47.922 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2024-04-25 02:16:58.423522285 +0000 2024-04-25T02:19:47.922 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: - 2024-04-25T02:19:47.923 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-25T02:19:47.987 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2024-04-25T02:19:47.987 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2024-04-25T02:19:47.987 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.00017683 s, 2.9 MB/s 2024-04-25T02:19:47.988 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-25T02:19:48.046 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_2 2024-04-25T02:19:48.103 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-25T02:19:48.103 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T02:19:48.104 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 6h/6d Inode: 168172 Links: 1 2024-04-25T02:19:48.104 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T02:19:48.104 INFO:teuthology.orchestra.run.smithi111.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T02:19:48.104 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2024-04-25 02:19:36.556467006 +0000 2024-04-25T02:19:48.104 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2024-04-25 02:16:58.780516126 +0000 2024-04-25T02:19:48.104 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2024-04-25 02:16:58.780516126 +0000 2024-04-25T02:19:48.104 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: - 2024-04-25T02:19:48.104 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-25T02:19:48.169 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2024-04-25T02:19:48.169 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2024-04-25T02:19:48.169 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000206338 s, 2.5 MB/s 2024-04-25T02:19:48.170 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-25T02:19:48.228 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_3 2024-04-25T02:19:48.286 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-25T02:19:48.286 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T02:19:48.286 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 6h/6d Inode: 166822 Links: 1 2024-04-25T02:19:48.286 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T02:19:48.287 INFO:teuthology.orchestra.run.smithi111.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T02:19:48.287 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2024-04-25 02:19:36.556467006 +0000 2024-04-25T02:19:48.287 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2024-04-25 02:16:59.128510122 +0000 2024-04-25T02:19:48.287 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2024-04-25 02:16:59.128510122 +0000 2024-04-25T02:19:48.287 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: - 2024-04-25T02:19:48.287 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-25T02:19:48.353 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2024-04-25T02:19:48.353 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2024-04-25T02:19:48.354 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000217997 s, 2.3 MB/s 2024-04-25T02:19:48.354 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-25T02:19:48.413 DEBUG:teuthology.orchestra.run.smithi111:> stat /dev/vg_nvme/lv_4 2024-04-25T02:19:48.472 INFO:teuthology.orchestra.run.smithi111.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-25T02:19:48.472 INFO:teuthology.orchestra.run.smithi111.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-25T02:19:48.472 INFO:teuthology.orchestra.run.smithi111.stdout:Device: 6h/6d Inode: 167826 Links: 1 2024-04-25T02:19:48.472 INFO:teuthology.orchestra.run.smithi111.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T02:19:48.472 INFO:teuthology.orchestra.run.smithi111.stdout:Context: system_u:object_r:device_t:s0 2024-04-25T02:19:48.472 INFO:teuthology.orchestra.run.smithi111.stdout:Access: 2024-04-25 02:19:36.556467006 +0000 2024-04-25T02:19:48.472 INFO:teuthology.orchestra.run.smithi111.stdout:Modify: 2024-04-25 02:16:59.469504239 +0000 2024-04-25T02:19:48.472 INFO:teuthology.orchestra.run.smithi111.stdout:Change: 2024-04-25 02:16:59.469504239 +0000 2024-04-25T02:19:48.472 INFO:teuthology.orchestra.run.smithi111.stdout: Birth: - 2024-04-25T02:19:48.472 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-25T02:19:48.536 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records in 2024-04-25T02:19:48.536 INFO:teuthology.orchestra.run.smithi111.stderr:1+0 records out 2024-04-25T02:19:48.536 INFO:teuthology.orchestra.run.smithi111.stderr:512 bytes copied, 0.000230441 s, 2.2 MB/s 2024-04-25T02:19:48.537 DEBUG:teuthology.orchestra.run.smithi111:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-25T02:19:48.596 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T02:19:48.596 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi111.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2024-04-25T02:19:48.596 INFO:tasks.ceph:Generating config... 2024-04-25T02:19:48.598 INFO:tasks.ceph:[global] mon warn on pool no app = False 2024-04-25T02:19:48.598 INFO:tasks.ceph:[global] ms bind msgr2 = False 2024-04-25T02:19:48.598 INFO:tasks.ceph:[global] bluestore warn on legacy statfs = False 2024-04-25T02:19:48.598 INFO:tasks.ceph:[global] bluestore warn on no per pool omap = False 2024-04-25T02:19:48.598 INFO:tasks.ceph:[global] mon pg warn min per osd = 0 2024-04-25T02:19:48.598 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-25T02:19:48.598 INFO:tasks.ceph:[client] debug client = 20 2024-04-25T02:19:48.598 INFO:tasks.ceph:[client] debug ms = 1 2024-04-25T02:19:48.598 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-25T02:19:48.598 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-25T02:19:48.598 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-25T02:19:48.598 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-25T02:19:48.599 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-25T02:19:48.599 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-25T02:19:48.599 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-25T02:19:48.599 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-25T02:19:48.599 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-25T02:19:48.599 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-25T02:19:48.599 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-25T02:19:48.599 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-25T02:19:48.599 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-25T02:19:48.599 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-25T02:19:48.599 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-25T02:19:48.599 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-25T02:19:48.599 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-25T02:19:48.599 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-25T02:19:48.599 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-25T02:19:48.600 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-25T02:19:48.600 INFO:tasks.ceph:[mon] mon warn on osd down out interval zero = False 2024-04-25T02:19:48.600 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-25T02:19:48.600 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-25T02:19:48.600 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-25T02:19:48.600 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-25T02:19:48.600 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-25T02:19:48.600 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-25T02:19:48.600 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-25T02:19:48.600 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-25T02:19:48.600 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-25T02:19:48.600 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-25T02:19:48.600 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-25T02:19:48.600 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-25T02:19:48.600 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-25T02:19:48.600 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-25T02:19:48.601 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-25T02:19:48.601 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-25T02:19:48.601 INFO:tasks.ceph:Setting up mon.a... 2024-04-25T02:19:48.601 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-25T02:19:48.780 INFO:teuthology.orchestra.run.smithi111.stdout:creating /etc/ceph/ceph.keyring 2024-04-25T02:19:48.783 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-25T02:19:48.822 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T02:19:48.888 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.111'), ('mon.b', '[v2:172.21.15.111:3301,v1:172.21.15.111:6790]'), ('mon.c', '[v2:172.21.15.111:3302,v1:172.21.15.111:6791]')] 2024-04-25T02:19:48.888 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.111,[v2:172.21.15.111:3301,v1:172.21.15.111:6790],[v2:172.21.15.111:3302,v1:172.21.15.111:6791]', 'mon warn on pool no app': False, 'ms bind msgr2': False, 'bluestore warn on legacy statfs': False, 'bluestore warn on no per pool omap': False, 'mon pg warn min per osd': 0}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on osd down out interval zero': False}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.b': {}, 'mds.c': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-25T02:19:48.889 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-25T02:19:48.889 DEBUG:teuthology.orchestra.run.smithi111:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T02:19:48.946 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.111 --addv b '[v2:172.21.15.111:3301,v1:172.21.15.111:6790]' --addv c '[v2:172.21.15.111:3302,v1:172.21.15.111:6791]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:19:49.029 INFO:teuthology.orchestra.run.smithi111.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:19:49.029 INFO:teuthology.orchestra.run.smithi111.stdout:monmaptool: generated fsid 4643f974-f93a-4436-93b8-460ff320e62e 2024-04-25T02:19:49.029 INFO:teuthology.orchestra.run.smithi111.stdout:epoch 0 2024-04-25T02:19:49.029 INFO:teuthology.orchestra.run.smithi111.stdout:fsid 4643f974-f93a-4436-93b8-460ff320e62e 2024-04-25T02:19:49.029 INFO:teuthology.orchestra.run.smithi111.stdout:last_changed 2024-04-25T02:19:49.026494+0000 2024-04-25T02:19:49.030 INFO:teuthology.orchestra.run.smithi111.stdout:created 2024-04-25T02:19:49.026494+0000 2024-04-25T02:19:49.030 INFO:teuthology.orchestra.run.smithi111.stdout:min_mon_release 0 (unknown) 2024-04-25T02:19:49.030 INFO:teuthology.orchestra.run.smithi111.stdout:0: [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] mon.a 2024-04-25T02:19:49.030 INFO:teuthology.orchestra.run.smithi111.stdout:1: [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] mon.b 2024-04-25T02:19:49.030 INFO:teuthology.orchestra.run.smithi111.stdout:2: [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] mon.c 2024-04-25T02:19:49.030 INFO:teuthology.orchestra.run.smithi111.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-25T02:19:49.031 DEBUG:teuthology.orchestra.run.smithi111:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-25T02:19:49.088 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 4643f974-f93a-4436-93b8-460ff320e62e... 2024-04-25T02:19:49.089 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T02:19:49.131 DEBUG:teuthology.orchestra.run.smithi114:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T02:19:49.134 DEBUG:teuthology.orchestra.run.smithi186:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-25T02:19:49.173 INFO:teuthology.orchestra.run.smithi111.stdout:[global] 2024-04-25T02:19:49.173 INFO:teuthology.orchestra.run.smithi111.stdout: chdir = "" 2024-04-25T02:19:49.173 INFO:teuthology.orchestra.run.smithi111.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T02:19:49.173 INFO:teuthology.orchestra.run.smithi111.stdout: auth supported = cephx 2024-04-25T02:19:49.173 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:19:49.173 INFO:teuthology.orchestra.run.smithi111.stdout: filestore xattr use omap = true 2024-04-25T02:19:49.173 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:19:49.173 INFO:teuthology.orchestra.run.smithi111.stdout: mon clock drift allowed = 1.000 2024-04-25T02:19:49.173 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:19:49.174 INFO:teuthology.orchestra.run.smithi111.stdout: osd crush chooseleaf type = 0 2024-04-25T02:19:49.174 INFO:teuthology.orchestra.run.smithi111.stdout: auth debug = true 2024-04-25T02:19:49.174 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:19:49.174 INFO:teuthology.orchestra.run.smithi111.stdout: ms die on old message = true 2024-04-25T02:19:49.174 INFO:teuthology.orchestra.run.smithi111.stdout: ms die on bug = true 2024-04-25T02:19:49.174 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:19:49.174 INFO:teuthology.orchestra.run.smithi111.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T02:19:49.174 INFO:teuthology.orchestra.run.smithi111.stdout: mon pg warn max object skew = 0 2024-04-25T02:19:49.174 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:19:49.174 INFO:teuthology.orchestra.run.smithi111.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T02:19:49.174 INFO:teuthology.orchestra.run.smithi111.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T02:19:49.174 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:19:49.174 INFO:teuthology.orchestra.run.smithi111.stdout: osd pool default size = 2 2024-04-25T02:19:49.174 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:19:49.175 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd allow primary affinity = true 2024-04-25T02:19:49.175 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd allow pg remap = true 2024-04-25T02:19:49.175 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on legacy crush tunables = false 2024-04-25T02:19:49.175 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on crush straw calc version zero = false 2024-04-25T02:19:49.175 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on no sortbitwise = false 2024-04-25T02:19:49.175 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on osd down out interval zero = false 2024-04-25T02:19:49.175 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on too few osds = false 2024-04-25T02:19:49.175 INFO:teuthology.orchestra.run.smithi111.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T02:19:49.175 INFO:teuthology.orchestra.run.smithi111.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T02:19:49.175 INFO:teuthology.orchestra.run.smithi111.stdout: mon_allow_pool_size_one = true 2024-04-25T02:19:49.175 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:19:49.175 INFO:teuthology.orchestra.run.smithi111.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T02:19:49.175 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:19:49.175 INFO:teuthology.orchestra.run.smithi111.stdout: osd default data pool replay window = 5 2024-04-25T02:19:49.176 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:19:49.176 INFO:teuthology.orchestra.run.smithi111.stdout: mon allow pool delete = true 2024-04-25T02:19:49.176 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:19:49.176 INFO:teuthology.orchestra.run.smithi111.stdout: mon cluster log file level = debug 2024-04-25T02:19:49.176 INFO:teuthology.orchestra.run.smithi111.stdout: debug asserts on shutdown = true 2024-04-25T02:19:49.176 INFO:teuthology.orchestra.run.smithi111.stdout: mon health detail to clog = false 2024-04-25T02:19:49.176 INFO:teuthology.orchestra.run.smithi111.stdout: mon host = "172.21.15.111,[v2:172.21.15.111:3301,v1:172.21.15.111:6790],[v2:172.21.15.111:3302,v1:172.21.15.111:6791]" 2024-04-25T02:19:49.176 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on pool no app = False 2024-04-25T02:19:49.176 INFO:teuthology.orchestra.run.smithi111.stdout: ms bind msgr2 = False 2024-04-25T02:19:49.176 INFO:teuthology.orchestra.run.smithi111.stdout: bluestore warn on legacy statfs = False 2024-04-25T02:19:49.176 INFO:teuthology.orchestra.run.smithi111.stdout: bluestore warn on no per pool omap = False 2024-04-25T02:19:49.176 INFO:teuthology.orchestra.run.smithi111.stdout: mon pg warn min per osd = 0 2024-04-25T02:19:49.176 INFO:teuthology.orchestra.run.smithi111.stdout: fsid = 4643f974-f93a-4436-93b8-460ff320e62e 2024-04-25T02:19:49.176 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:19:49.177 INFO:teuthology.orchestra.run.smithi111.stdout:[osd] 2024-04-25T02:19:49.177 INFO:teuthology.orchestra.run.smithi111.stdout: osd journal size = 100 2024-04-25T02:19:49.177 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:19:49.177 INFO:teuthology.orchestra.run.smithi111.stdout: osd scrub load threshold = 5.0 2024-04-25T02:19:49.177 INFO:teuthology.orchestra.run.smithi111.stdout: osd scrub max interval = 600 2024-04-25T02:19:49.177 INFO:teuthology.orchestra.run.smithi111.stdout: osd mclock profile = high_recovery_ops 2024-04-25T02:19:49.177 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:19:49.177 INFO:teuthology.orchestra.run.smithi111.stdout: osd recover clone overlap = true 2024-04-25T02:19:49.177 INFO:teuthology.orchestra.run.smithi111.stdout: osd recovery max chunk = 1048576 2024-04-25T02:19:49.177 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:19:49.177 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug shutdown = true 2024-04-25T02:19:49.177 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug op order = true 2024-04-25T02:19:49.177 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug verify stray on activate = true 2024-04-25T02:19:49.177 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug trim objects = true 2024-04-25T02:19:49.177 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:19:49.178 INFO:teuthology.orchestra.run.smithi111.stdout: osd open classes on start = true 2024-04-25T02:19:49.178 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug pg log writeout = true 2024-04-25T02:19:49.178 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:19:49.178 INFO:teuthology.orchestra.run.smithi111.stdout: osd deep scrub update digest min age = 30 2024-04-25T02:19:49.178 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:19:49.178 INFO:teuthology.orchestra.run.smithi111.stdout: osd map max advance = 10 2024-04-25T02:19:49.178 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:19:49.178 INFO:teuthology.orchestra.run.smithi111.stdout: journal zero on create = true 2024-04-25T02:19:49.178 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:19:49.178 INFO:teuthology.orchestra.run.smithi111.stdout: filestore ondisk finisher threads = 3 2024-04-25T02:19:49.178 INFO:teuthology.orchestra.run.smithi111.stdout: filestore apply finisher threads = 3 2024-04-25T02:19:49.178 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:19:49.178 INFO:teuthology.orchestra.run.smithi111.stdout: bdev debug aio = true 2024-04-25T02:19:49.178 INFO:teuthology.orchestra.run.smithi111.stdout: osd debug misdirected ops = true 2024-04-25T02:19:49.179 INFO:teuthology.orchestra.run.smithi111.stdout: bdev async discard = True 2024-04-25T02:19:49.179 INFO:teuthology.orchestra.run.smithi111.stdout: bdev enable discard = True 2024-04-25T02:19:49.179 INFO:teuthology.orchestra.run.smithi111.stdout: bluestore allocator = bitmap 2024-04-25T02:19:49.179 INFO:teuthology.orchestra.run.smithi111.stdout: bluestore block size = 96636764160 2024-04-25T02:19:49.179 INFO:teuthology.orchestra.run.smithi111.stdout: bluestore fsck on mount = True 2024-04-25T02:19:49.179 INFO:teuthology.orchestra.run.smithi111.stdout: debug bluefs = 1/20 2024-04-25T02:19:49.179 INFO:teuthology.orchestra.run.smithi111.stdout: debug bluestore = 1/20 2024-04-25T02:19:49.179 INFO:teuthology.orchestra.run.smithi111.stdout: debug ms = 1 2024-04-25T02:19:49.179 INFO:teuthology.orchestra.run.smithi111.stdout: debug osd = 20 2024-04-25T02:19:49.179 INFO:teuthology.orchestra.run.smithi111.stdout: debug rocksdb = 4/10 2024-04-25T02:19:49.179 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T02:19:49.179 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd full ratio = 0.9 2024-04-25T02:19:49.179 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd nearfull ratio = 0.8 2024-04-25T02:19:49.179 INFO:teuthology.orchestra.run.smithi111.stdout: osd failsafe full ratio = 0.95 2024-04-25T02:19:49.179 INFO:teuthology.orchestra.run.smithi111.stdout: osd objectstore = bluestore 2024-04-25T02:19:49.180 INFO:teuthology.orchestra.run.smithi111.stdout: osd op complaint time = 180 2024-04-25T02:19:49.180 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:19:49.180 INFO:teuthology.orchestra.run.smithi111.stdout:[mgr] 2024-04-25T02:19:49.180 INFO:teuthology.orchestra.run.smithi111.stdout: debug ms = 1 2024-04-25T02:19:49.180 INFO:teuthology.orchestra.run.smithi111.stdout: debug mgr = 20 2024-04-25T02:19:49.180 INFO:teuthology.orchestra.run.smithi111.stdout: debug mon = 20 2024-04-25T02:19:49.180 INFO:teuthology.orchestra.run.smithi111.stdout: debug auth = 20 2024-04-25T02:19:49.180 INFO:teuthology.orchestra.run.smithi111.stdout: mon reweight min pgs per osd = 4 2024-04-25T02:19:49.180 INFO:teuthology.orchestra.run.smithi111.stdout: mon reweight min bytes per osd = 10 2024-04-25T02:19:49.180 INFO:teuthology.orchestra.run.smithi111.stdout: mgr/telemetry/nag = false 2024-04-25T02:19:49.180 INFO:teuthology.orchestra.run.smithi111.stdout: debug client = 20 2024-04-25T02:19:49.180 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:19:49.180 INFO:teuthology.orchestra.run.smithi111.stdout:[mon] 2024-04-25T02:19:49.180 INFO:teuthology.orchestra.run.smithi111.stdout: debug ms = 1 2024-04-25T02:19:49.181 INFO:teuthology.orchestra.run.smithi111.stdout: debug mon = 20 2024-04-25T02:19:49.181 INFO:teuthology.orchestra.run.smithi111.stdout: debug paxos = 20 2024-04-25T02:19:49.181 INFO:teuthology.orchestra.run.smithi111.stdout: debug auth = 20 2024-04-25T02:19:49.181 INFO:teuthology.orchestra.run.smithi111.stdout: mon data avail warn = 5 2024-04-25T02:19:49.181 INFO:teuthology.orchestra.run.smithi111.stdout: mon mgr mkfs grace = 240 2024-04-25T02:19:49.181 INFO:teuthology.orchestra.run.smithi111.stdout: mon reweight min pgs per osd = 4 2024-04-25T02:19:49.181 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd reporter subtree level = osd 2024-04-25T02:19:49.181 INFO:teuthology.orchestra.run.smithi111.stdout: mon osd prime pg temp = true 2024-04-25T02:19:49.181 INFO:teuthology.orchestra.run.smithi111.stdout: mon reweight min bytes per osd = 10 2024-04-25T02:19:49.181 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:19:49.181 INFO:teuthology.orchestra.run.smithi111.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T02:19:49.181 INFO:teuthology.orchestra.run.smithi111.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T02:19:49.181 INFO:teuthology.orchestra.run.smithi111.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T02:19:49.181 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:19:49.181 INFO:teuthology.orchestra.run.smithi111.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T02:19:49.182 INFO:teuthology.orchestra.run.smithi111.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T02:19:49.182 INFO:teuthology.orchestra.run.smithi111.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T02:19:49.182 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:19:49.182 INFO:teuthology.orchestra.run.smithi111.stdout: # 1m isn't quite enough 2024-04-25T02:19:49.182 INFO:teuthology.orchestra.run.smithi111.stdout: mon_down_mkfs_grace = 2m 2024-04-25T02:19:49.182 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:19:49.182 INFO:teuthology.orchestra.run.smithi111.stdout: mon_warn_on_filestore_osds = false 2024-04-25T02:19:49.182 INFO:teuthology.orchestra.run.smithi111.stdout: mon down mkfs grace = 300 2024-04-25T02:19:49.182 INFO:teuthology.orchestra.run.smithi111.stdout: mon op complaint time = 120 2024-04-25T02:19:49.182 INFO:teuthology.orchestra.run.smithi111.stdout: mon warn on osd down out interval zero = False 2024-04-25T02:19:49.182 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:19:49.183 INFO:teuthology.orchestra.run.smithi111.stdout:[client] 2024-04-25T02:19:49.183 INFO:teuthology.orchestra.run.smithi111.stdout: rgw cache enabled = true 2024-04-25T02:19:49.183 INFO:teuthology.orchestra.run.smithi111.stdout: rgw enable ops log = true 2024-04-25T02:19:49.183 INFO:teuthology.orchestra.run.smithi111.stdout: rgw enable usage log = true 2024-04-25T02:19:49.183 INFO:teuthology.orchestra.run.smithi111.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T02:19:49.183 INFO:teuthology.orchestra.run.smithi111.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T02:19:49.183 INFO:teuthology.orchestra.run.smithi111.stdout: client mount timeout = 600 2024-04-25T02:19:49.183 INFO:teuthology.orchestra.run.smithi111.stdout: debug client = 20 2024-04-25T02:19:49.183 INFO:teuthology.orchestra.run.smithi111.stdout: debug ms = 1 2024-04-25T02:19:49.183 INFO:teuthology.orchestra.run.smithi111.stdout: rados mon op timeout = 900 2024-04-25T02:19:49.183 INFO:teuthology.orchestra.run.smithi111.stdout: rados osd op timeout = 900 2024-04-25T02:19:49.183 INFO:teuthology.orchestra.run.smithi111.stdout:[mon.a] 2024-04-25T02:19:49.183 INFO:teuthology.orchestra.run.smithi111.stdout:[mon.b] 2024-04-25T02:19:49.183 INFO:teuthology.orchestra.run.smithi111.stdout:[mon.c] 2024-04-25T02:19:49.183 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.a] 2024-04-25T02:19:49.184 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.b] 2024-04-25T02:19:49.184 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.c] 2024-04-25T02:19:49.184 INFO:teuthology.orchestra.run.smithi111.stdout:[mds] 2024-04-25T02:19:49.184 INFO:teuthology.orchestra.run.smithi111.stdout: debug mds = 20 2024-04-25T02:19:49.184 INFO:teuthology.orchestra.run.smithi111.stdout: debug mds balancer = 20 2024-04-25T02:19:49.184 INFO:teuthology.orchestra.run.smithi111.stdout: debug ms = 1 2024-04-25T02:19:49.184 INFO:teuthology.orchestra.run.smithi111.stdout: mds debug frag = True 2024-04-25T02:19:49.184 INFO:teuthology.orchestra.run.smithi111.stdout: mds debug scatterstat = True 2024-04-25T02:19:49.184 INFO:teuthology.orchestra.run.smithi111.stdout: mds op complaint time = 180 2024-04-25T02:19:49.184 INFO:teuthology.orchestra.run.smithi111.stdout: mds verify scatter = True 2024-04-25T02:19:49.184 INFO:teuthology.orchestra.run.smithi111.stdout: osd op complaint time = 180 2024-04-25T02:19:49.184 INFO:teuthology.orchestra.run.smithi111.stdout: rados mon op timeout = 900 2024-04-25T02:19:49.184 INFO:teuthology.orchestra.run.smithi111.stdout: rados osd op timeout = 900 2024-04-25T02:19:49.185 INFO:teuthology.orchestra.run.smithi114.stdout:[global] 2024-04-25T02:19:49.185 INFO:teuthology.orchestra.run.smithi114.stdout: chdir = "" 2024-04-25T02:19:49.185 INFO:teuthology.orchestra.run.smithi114.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T02:19:49.185 INFO:teuthology.orchestra.run.smithi114.stdout: auth supported = cephx 2024-04-25T02:19:49.185 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:19:49.185 INFO:teuthology.orchestra.run.smithi114.stdout: filestore xattr use omap = true 2024-04-25T02:19:49.185 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:19:49.185 INFO:teuthology.orchestra.run.smithi114.stdout: mon clock drift allowed = 1.000 2024-04-25T02:19:49.186 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:19:49.186 INFO:teuthology.orchestra.run.smithi114.stdout: osd crush chooseleaf type = 0 2024-04-25T02:19:49.186 INFO:teuthology.orchestra.run.smithi114.stdout: auth debug = true 2024-04-25T02:19:49.186 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:19:49.186 INFO:teuthology.orchestra.run.smithi114.stdout: ms die on old message = true 2024-04-25T02:19:49.186 INFO:teuthology.orchestra.run.smithi114.stdout: ms die on bug = true 2024-04-25T02:19:49.186 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:19:49.186 INFO:teuthology.orchestra.run.smithi114.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T02:19:49.186 INFO:teuthology.orchestra.run.smithi114.stdout: mon pg warn max object skew = 0 2024-04-25T02:19:49.186 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:19:49.186 INFO:teuthology.orchestra.run.smithi114.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T02:19:49.186 INFO:teuthology.orchestra.run.smithi114.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T02:19:49.186 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:19:49.186 INFO:teuthology.orchestra.run.smithi114.stdout: osd pool default size = 2 2024-04-25T02:19:49.187 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:19:49.187 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd allow primary affinity = true 2024-04-25T02:19:49.187 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd allow pg remap = true 2024-04-25T02:19:49.187 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on legacy crush tunables = false 2024-04-25T02:19:49.187 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on crush straw calc version zero = false 2024-04-25T02:19:49.187 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on no sortbitwise = false 2024-04-25T02:19:49.187 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on osd down out interval zero = false 2024-04-25T02:19:49.187 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on too few osds = false 2024-04-25T02:19:49.187 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T02:19:49.187 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T02:19:49.187 INFO:teuthology.orchestra.run.smithi114.stdout: mon_allow_pool_size_one = true 2024-04-25T02:19:49.187 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:19:49.187 INFO:teuthology.orchestra.run.smithi114.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T02:19:49.187 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:19:49.187 INFO:teuthology.orchestra.run.smithi114.stdout: osd default data pool replay window = 5 2024-04-25T02:19:49.187 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:19:49.188 INFO:teuthology.orchestra.run.smithi114.stdout: mon allow pool delete = true 2024-04-25T02:19:49.188 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:19:49.188 INFO:teuthology.orchestra.run.smithi114.stdout: mon cluster log file level = debug 2024-04-25T02:19:49.188 INFO:teuthology.orchestra.run.smithi114.stdout: debug asserts on shutdown = true 2024-04-25T02:19:49.188 INFO:teuthology.orchestra.run.smithi114.stdout: mon health detail to clog = false 2024-04-25T02:19:49.188 INFO:teuthology.orchestra.run.smithi114.stdout: mon host = "172.21.15.111,[v2:172.21.15.111:3301,v1:172.21.15.111:6790],[v2:172.21.15.111:3302,v1:172.21.15.111:6791]" 2024-04-25T02:19:49.188 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on pool no app = False 2024-04-25T02:19:49.188 INFO:teuthology.orchestra.run.smithi114.stdout: ms bind msgr2 = False 2024-04-25T02:19:49.188 INFO:teuthology.orchestra.run.smithi114.stdout: bluestore warn on legacy statfs = False 2024-04-25T02:19:49.188 INFO:teuthology.orchestra.run.smithi114.stdout: bluestore warn on no per pool omap = False 2024-04-25T02:19:49.188 INFO:teuthology.orchestra.run.smithi114.stdout: mon pg warn min per osd = 0 2024-04-25T02:19:49.188 INFO:teuthology.orchestra.run.smithi114.stdout: fsid = 4643f974-f93a-4436-93b8-460ff320e62e 2024-04-25T02:19:49.188 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:19:49.188 INFO:teuthology.orchestra.run.smithi114.stdout:[osd] 2024-04-25T02:19:49.188 INFO:teuthology.orchestra.run.smithi114.stdout: osd journal size = 100 2024-04-25T02:19:49.189 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:19:49.189 INFO:teuthology.orchestra.run.smithi114.stdout: osd scrub load threshold = 5.0 2024-04-25T02:19:49.189 INFO:teuthology.orchestra.run.smithi114.stdout: osd scrub max interval = 600 2024-04-25T02:19:49.189 INFO:teuthology.orchestra.run.smithi114.stdout: osd mclock profile = high_recovery_ops 2024-04-25T02:19:49.189 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:19:49.189 INFO:teuthology.orchestra.run.smithi114.stdout: osd recover clone overlap = true 2024-04-25T02:19:49.189 INFO:teuthology.orchestra.run.smithi114.stdout: osd recovery max chunk = 1048576 2024-04-25T02:19:49.189 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:19:49.189 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug shutdown = true 2024-04-25T02:19:49.189 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug op order = true 2024-04-25T02:19:49.189 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug verify stray on activate = true 2024-04-25T02:19:49.189 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug trim objects = true 2024-04-25T02:19:49.189 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:19:49.189 INFO:teuthology.orchestra.run.smithi114.stdout: osd open classes on start = true 2024-04-25T02:19:49.189 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug pg log writeout = true 2024-04-25T02:19:49.189 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:19:49.190 INFO:teuthology.orchestra.run.smithi114.stdout: osd deep scrub update digest min age = 30 2024-04-25T02:19:49.190 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:19:49.190 INFO:teuthology.orchestra.run.smithi114.stdout: osd map max advance = 10 2024-04-25T02:19:49.190 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:19:49.190 INFO:teuthology.orchestra.run.smithi114.stdout: journal zero on create = true 2024-04-25T02:19:49.190 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:19:49.190 INFO:teuthology.orchestra.run.smithi114.stdout: filestore ondisk finisher threads = 3 2024-04-25T02:19:49.190 INFO:teuthology.orchestra.run.smithi114.stdout: filestore apply finisher threads = 3 2024-04-25T02:19:49.190 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:19:49.190 INFO:teuthology.orchestra.run.smithi114.stdout: bdev debug aio = true 2024-04-25T02:19:49.190 INFO:teuthology.orchestra.run.smithi114.stdout: osd debug misdirected ops = true 2024-04-25T02:19:49.190 INFO:teuthology.orchestra.run.smithi114.stdout: bdev async discard = True 2024-04-25T02:19:49.190 INFO:teuthology.orchestra.run.smithi114.stdout: bdev enable discard = True 2024-04-25T02:19:49.190 INFO:teuthology.orchestra.run.smithi114.stdout: bluestore allocator = bitmap 2024-04-25T02:19:49.191 INFO:teuthology.orchestra.run.smithi114.stdout: bluestore block size = 96636764160 2024-04-25T02:19:49.191 INFO:teuthology.orchestra.run.smithi114.stdout: bluestore fsck on mount = True 2024-04-25T02:19:49.191 INFO:teuthology.orchestra.run.smithi114.stdout: debug bluefs = 1/20 2024-04-25T02:19:49.191 INFO:teuthology.orchestra.run.smithi114.stdout: debug bluestore = 1/20 2024-04-25T02:19:49.191 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-04-25T02:19:49.191 INFO:teuthology.orchestra.run.smithi114.stdout: debug osd = 20 2024-04-25T02:19:49.191 INFO:teuthology.orchestra.run.smithi114.stdout: debug rocksdb = 4/10 2024-04-25T02:19:49.191 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T02:19:49.191 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd full ratio = 0.9 2024-04-25T02:19:49.191 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd nearfull ratio = 0.8 2024-04-25T02:19:49.191 INFO:teuthology.orchestra.run.smithi114.stdout: osd failsafe full ratio = 0.95 2024-04-25T02:19:49.191 INFO:teuthology.orchestra.run.smithi114.stdout: osd objectstore = bluestore 2024-04-25T02:19:49.191 INFO:teuthology.orchestra.run.smithi114.stdout: osd op complaint time = 180 2024-04-25T02:19:49.191 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:19:49.191 INFO:teuthology.orchestra.run.smithi114.stdout:[mgr] 2024-04-25T02:19:49.191 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-04-25T02:19:49.192 INFO:teuthology.orchestra.run.smithi114.stdout: debug mgr = 20 2024-04-25T02:19:49.192 INFO:teuthology.orchestra.run.smithi114.stdout: debug mon = 20 2024-04-25T02:19:49.192 INFO:teuthology.orchestra.run.smithi114.stdout: debug auth = 20 2024-04-25T02:19:49.192 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min pgs per osd = 4 2024-04-25T02:19:49.192 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min bytes per osd = 10 2024-04-25T02:19:49.192 INFO:teuthology.orchestra.run.smithi114.stdout: mgr/telemetry/nag = false 2024-04-25T02:19:49.192 INFO:teuthology.orchestra.run.smithi114.stdout: debug client = 20 2024-04-25T02:19:49.192 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:19:49.192 INFO:teuthology.orchestra.run.smithi114.stdout:[mon] 2024-04-25T02:19:49.192 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-04-25T02:19:49.192 INFO:teuthology.orchestra.run.smithi114.stdout: debug mon = 20 2024-04-25T02:19:49.192 INFO:teuthology.orchestra.run.smithi114.stdout: debug paxos = 20 2024-04-25T02:19:49.192 INFO:teuthology.orchestra.run.smithi114.stdout: debug auth = 20 2024-04-25T02:19:49.192 INFO:teuthology.orchestra.run.smithi114.stdout: mon data avail warn = 5 2024-04-25T02:19:49.192 INFO:teuthology.orchestra.run.smithi114.stdout: mon mgr mkfs grace = 240 2024-04-25T02:19:49.193 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min pgs per osd = 4 2024-04-25T02:19:49.193 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd reporter subtree level = osd 2024-04-25T02:19:49.193 INFO:teuthology.orchestra.run.smithi114.stdout: mon osd prime pg temp = true 2024-04-25T02:19:49.193 INFO:teuthology.orchestra.run.smithi114.stdout: mon reweight min bytes per osd = 10 2024-04-25T02:19:49.193 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:19:49.193 INFO:teuthology.orchestra.run.smithi114.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T02:19:49.193 INFO:teuthology.orchestra.run.smithi114.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T02:19:49.193 INFO:teuthology.orchestra.run.smithi114.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T02:19:49.193 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:19:49.193 INFO:teuthology.orchestra.run.smithi114.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T02:19:49.193 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T02:19:49.193 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T02:19:49.193 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:19:49.193 INFO:teuthology.orchestra.run.smithi114.stdout: # 1m isn't quite enough 2024-04-25T02:19:49.194 INFO:teuthology.orchestra.run.smithi114.stdout: mon_down_mkfs_grace = 2m 2024-04-25T02:19:49.194 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:19:49.194 INFO:teuthology.orchestra.run.smithi114.stdout: mon_warn_on_filestore_osds = false 2024-04-25T02:19:49.194 INFO:teuthology.orchestra.run.smithi114.stdout: mon down mkfs grace = 300 2024-04-25T02:19:49.194 INFO:teuthology.orchestra.run.smithi114.stdout: mon op complaint time = 120 2024-04-25T02:19:49.194 INFO:teuthology.orchestra.run.smithi114.stdout: mon warn on osd down out interval zero = False 2024-04-25T02:19:49.194 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:19:49.194 INFO:teuthology.orchestra.run.smithi114.stdout:[client] 2024-04-25T02:19:49.194 INFO:teuthology.orchestra.run.smithi114.stdout: rgw cache enabled = true 2024-04-25T02:19:49.194 INFO:teuthology.orchestra.run.smithi114.stdout: rgw enable ops log = true 2024-04-25T02:19:49.194 INFO:teuthology.orchestra.run.smithi114.stdout: rgw enable usage log = true 2024-04-25T02:19:49.194 INFO:teuthology.orchestra.run.smithi114.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T02:19:49.194 INFO:teuthology.orchestra.run.smithi114.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T02:19:49.195 INFO:teuthology.orchestra.run.smithi114.stdout: client mount timeout = 600 2024-04-25T02:19:49.195 INFO:teuthology.orchestra.run.smithi114.stdout: debug client = 20 2024-04-25T02:19:49.195 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-04-25T02:19:49.195 INFO:teuthology.orchestra.run.smithi114.stdout: rados mon op timeout = 900 2024-04-25T02:19:49.195 INFO:teuthology.orchestra.run.smithi114.stdout: rados osd op timeout = 900 2024-04-25T02:19:49.195 INFO:teuthology.orchestra.run.smithi114.stdout:[mon.a] 2024-04-25T02:19:49.195 INFO:teuthology.orchestra.run.smithi114.stdout:[mon.b] 2024-04-25T02:19:49.195 INFO:teuthology.orchestra.run.smithi114.stdout:[mon.c] 2024-04-25T02:19:49.195 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.a] 2024-04-25T02:19:49.195 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.b] 2024-04-25T02:19:49.195 INFO:teuthology.orchestra.run.smithi114.stdout:[mds.c] 2024-04-25T02:19:49.195 INFO:teuthology.orchestra.run.smithi114.stdout:[mds] 2024-04-25T02:19:49.195 INFO:teuthology.orchestra.run.smithi114.stdout: debug mds = 20 2024-04-25T02:19:49.195 INFO:teuthology.orchestra.run.smithi114.stdout: debug mds balancer = 20 2024-04-25T02:19:49.196 INFO:teuthology.orchestra.run.smithi114.stdout: debug ms = 1 2024-04-25T02:19:49.196 INFO:teuthology.orchestra.run.smithi114.stdout: mds debug frag = True 2024-04-25T02:19:49.196 INFO:teuthology.orchestra.run.smithi114.stdout: mds debug scatterstat = True 2024-04-25T02:19:49.196 INFO:teuthology.orchestra.run.smithi114.stdout: mds op complaint time = 180 2024-04-25T02:19:49.196 INFO:teuthology.orchestra.run.smithi114.stdout: mds verify scatter = True 2024-04-25T02:19:49.196 INFO:teuthology.orchestra.run.smithi114.stdout: osd op complaint time = 180 2024-04-25T02:19:49.196 INFO:teuthology.orchestra.run.smithi114.stdout: rados mon op timeout = 900 2024-04-25T02:19:49.196 INFO:teuthology.orchestra.run.smithi114.stdout: rados osd op timeout = 900 2024-04-25T02:19:49.197 INFO:teuthology.orchestra.run.smithi186.stdout:[global] 2024-04-25T02:19:49.197 INFO:teuthology.orchestra.run.smithi186.stdout: chdir = "" 2024-04-25T02:19:49.197 INFO:teuthology.orchestra.run.smithi186.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-25T02:19:49.197 INFO:teuthology.orchestra.run.smithi186.stdout: auth supported = cephx 2024-04-25T02:19:49.197 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:19:49.197 INFO:teuthology.orchestra.run.smithi186.stdout: filestore xattr use omap = true 2024-04-25T02:19:49.197 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:19:49.197 INFO:teuthology.orchestra.run.smithi186.stdout: mon clock drift allowed = 1.000 2024-04-25T02:19:49.198 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:19:49.198 INFO:teuthology.orchestra.run.smithi186.stdout: osd crush chooseleaf type = 0 2024-04-25T02:19:49.198 INFO:teuthology.orchestra.run.smithi186.stdout: auth debug = true 2024-04-25T02:19:49.198 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:19:49.198 INFO:teuthology.orchestra.run.smithi186.stdout: ms die on old message = true 2024-04-25T02:19:49.198 INFO:teuthology.orchestra.run.smithi186.stdout: ms die on bug = true 2024-04-25T02:19:49.198 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:19:49.198 INFO:teuthology.orchestra.run.smithi186.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-25T02:19:49.198 INFO:teuthology.orchestra.run.smithi186.stdout: mon pg warn max object skew = 0 2024-04-25T02:19:49.198 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:19:49.198 INFO:teuthology.orchestra.run.smithi186.stdout: # disable pg_autoscaler by default for new pools 2024-04-25T02:19:49.198 INFO:teuthology.orchestra.run.smithi186.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-25T02:19:49.198 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:19:49.198 INFO:teuthology.orchestra.run.smithi186.stdout: osd pool default size = 2 2024-04-25T02:19:49.199 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:19:49.199 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd allow primary affinity = true 2024-04-25T02:19:49.199 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd allow pg remap = true 2024-04-25T02:19:49.199 INFO:teuthology.orchestra.run.smithi186.stdout: mon warn on legacy crush tunables = false 2024-04-25T02:19:49.199 INFO:teuthology.orchestra.run.smithi186.stdout: mon warn on crush straw calc version zero = false 2024-04-25T02:19:49.199 INFO:teuthology.orchestra.run.smithi186.stdout: mon warn on no sortbitwise = false 2024-04-25T02:19:49.199 INFO:teuthology.orchestra.run.smithi186.stdout: mon warn on osd down out interval zero = false 2024-04-25T02:19:49.199 INFO:teuthology.orchestra.run.smithi186.stdout: mon warn on too few osds = false 2024-04-25T02:19:49.199 INFO:teuthology.orchestra.run.smithi186.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-25T02:19:49.199 INFO:teuthology.orchestra.run.smithi186.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-25T02:19:49.199 INFO:teuthology.orchestra.run.smithi186.stdout: mon_allow_pool_size_one = true 2024-04-25T02:19:49.199 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:19:49.199 INFO:teuthology.orchestra.run.smithi186.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-25T02:19:49.200 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:19:49.200 INFO:teuthology.orchestra.run.smithi186.stdout: osd default data pool replay window = 5 2024-04-25T02:19:49.200 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:19:49.200 INFO:teuthology.orchestra.run.smithi186.stdout: mon allow pool delete = true 2024-04-25T02:19:49.200 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:19:49.200 INFO:teuthology.orchestra.run.smithi186.stdout: mon cluster log file level = debug 2024-04-25T02:19:49.200 INFO:teuthology.orchestra.run.smithi186.stdout: debug asserts on shutdown = true 2024-04-25T02:19:49.200 INFO:teuthology.orchestra.run.smithi186.stdout: mon health detail to clog = false 2024-04-25T02:19:49.200 INFO:teuthology.orchestra.run.smithi186.stdout: mon host = "172.21.15.111,[v2:172.21.15.111:3301,v1:172.21.15.111:6790],[v2:172.21.15.111:3302,v1:172.21.15.111:6791]" 2024-04-25T02:19:49.200 INFO:teuthology.orchestra.run.smithi186.stdout: mon warn on pool no app = False 2024-04-25T02:19:49.200 INFO:teuthology.orchestra.run.smithi186.stdout: ms bind msgr2 = False 2024-04-25T02:19:49.200 INFO:teuthology.orchestra.run.smithi186.stdout: bluestore warn on legacy statfs = False 2024-04-25T02:19:49.200 INFO:teuthology.orchestra.run.smithi186.stdout: bluestore warn on no per pool omap = False 2024-04-25T02:19:49.200 INFO:teuthology.orchestra.run.smithi186.stdout: mon pg warn min per osd = 0 2024-04-25T02:19:49.200 INFO:teuthology.orchestra.run.smithi186.stdout: fsid = 4643f974-f93a-4436-93b8-460ff320e62e 2024-04-25T02:19:49.201 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:19:49.201 INFO:teuthology.orchestra.run.smithi186.stdout:[osd] 2024-04-25T02:19:49.201 INFO:teuthology.orchestra.run.smithi186.stdout: osd journal size = 100 2024-04-25T02:19:49.201 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:19:49.201 INFO:teuthology.orchestra.run.smithi186.stdout: osd scrub load threshold = 5.0 2024-04-25T02:19:49.201 INFO:teuthology.orchestra.run.smithi186.stdout: osd scrub max interval = 600 2024-04-25T02:19:49.201 INFO:teuthology.orchestra.run.smithi186.stdout: osd mclock profile = high_recovery_ops 2024-04-25T02:19:49.201 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:19:49.201 INFO:teuthology.orchestra.run.smithi186.stdout: osd recover clone overlap = true 2024-04-25T02:19:49.201 INFO:teuthology.orchestra.run.smithi186.stdout: osd recovery max chunk = 1048576 2024-04-25T02:19:49.201 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:19:49.201 INFO:teuthology.orchestra.run.smithi186.stdout: osd debug shutdown = true 2024-04-25T02:19:49.201 INFO:teuthology.orchestra.run.smithi186.stdout: osd debug op order = true 2024-04-25T02:19:49.201 INFO:teuthology.orchestra.run.smithi186.stdout: osd debug verify stray on activate = true 2024-04-25T02:19:49.201 INFO:teuthology.orchestra.run.smithi186.stdout: osd debug trim objects = true 2024-04-25T02:19:49.201 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:19:49.202 INFO:teuthology.orchestra.run.smithi186.stdout: osd open classes on start = true 2024-04-25T02:19:49.202 INFO:teuthology.orchestra.run.smithi186.stdout: osd debug pg log writeout = true 2024-04-25T02:19:49.202 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:19:49.202 INFO:teuthology.orchestra.run.smithi186.stdout: osd deep scrub update digest min age = 30 2024-04-25T02:19:49.202 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:19:49.202 INFO:teuthology.orchestra.run.smithi186.stdout: osd map max advance = 10 2024-04-25T02:19:49.202 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:19:49.202 INFO:teuthology.orchestra.run.smithi186.stdout: journal zero on create = true 2024-04-25T02:19:49.202 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:19:49.202 INFO:teuthology.orchestra.run.smithi186.stdout: filestore ondisk finisher threads = 3 2024-04-25T02:19:49.202 INFO:teuthology.orchestra.run.smithi186.stdout: filestore apply finisher threads = 3 2024-04-25T02:19:49.202 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:19:49.202 INFO:teuthology.orchestra.run.smithi186.stdout: bdev debug aio = true 2024-04-25T02:19:49.202 INFO:teuthology.orchestra.run.smithi186.stdout: osd debug misdirected ops = true 2024-04-25T02:19:49.203 INFO:teuthology.orchestra.run.smithi186.stdout: bdev async discard = True 2024-04-25T02:19:49.203 INFO:teuthology.orchestra.run.smithi186.stdout: bdev enable discard = True 2024-04-25T02:19:49.203 INFO:teuthology.orchestra.run.smithi186.stdout: bluestore allocator = bitmap 2024-04-25T02:19:49.203 INFO:teuthology.orchestra.run.smithi186.stdout: bluestore block size = 96636764160 2024-04-25T02:19:49.203 INFO:teuthology.orchestra.run.smithi186.stdout: bluestore fsck on mount = True 2024-04-25T02:19:49.203 INFO:teuthology.orchestra.run.smithi186.stdout: debug bluefs = 1/20 2024-04-25T02:19:49.203 INFO:teuthology.orchestra.run.smithi186.stdout: debug bluestore = 1/20 2024-04-25T02:19:49.203 INFO:teuthology.orchestra.run.smithi186.stdout: debug ms = 1 2024-04-25T02:19:49.203 INFO:teuthology.orchestra.run.smithi186.stdout: debug osd = 20 2024-04-25T02:19:49.203 INFO:teuthology.orchestra.run.smithi186.stdout: debug rocksdb = 4/10 2024-04-25T02:19:49.203 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd backfillfull_ratio = 0.85 2024-04-25T02:19:49.203 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd full ratio = 0.9 2024-04-25T02:19:49.203 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd nearfull ratio = 0.8 2024-04-25T02:19:49.203 INFO:teuthology.orchestra.run.smithi186.stdout: osd failsafe full ratio = 0.95 2024-04-25T02:19:49.203 INFO:teuthology.orchestra.run.smithi186.stdout: osd objectstore = bluestore 2024-04-25T02:19:49.204 INFO:teuthology.orchestra.run.smithi186.stdout: osd op complaint time = 180 2024-04-25T02:19:49.204 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:19:49.204 INFO:teuthology.orchestra.run.smithi186.stdout:[mgr] 2024-04-25T02:19:49.204 INFO:teuthology.orchestra.run.smithi186.stdout: debug ms = 1 2024-04-25T02:19:49.204 INFO:teuthology.orchestra.run.smithi186.stdout: debug mgr = 20 2024-04-25T02:19:49.204 INFO:teuthology.orchestra.run.smithi186.stdout: debug mon = 20 2024-04-25T02:19:49.204 INFO:teuthology.orchestra.run.smithi186.stdout: debug auth = 20 2024-04-25T02:19:49.204 INFO:teuthology.orchestra.run.smithi186.stdout: mon reweight min pgs per osd = 4 2024-04-25T02:19:49.204 INFO:teuthology.orchestra.run.smithi186.stdout: mon reweight min bytes per osd = 10 2024-04-25T02:19:49.204 INFO:teuthology.orchestra.run.smithi186.stdout: mgr/telemetry/nag = false 2024-04-25T02:19:49.204 INFO:teuthology.orchestra.run.smithi186.stdout: debug client = 20 2024-04-25T02:19:49.204 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:19:49.204 INFO:teuthology.orchestra.run.smithi186.stdout:[mon] 2024-04-25T02:19:49.204 INFO:teuthology.orchestra.run.smithi186.stdout: debug ms = 1 2024-04-25T02:19:49.204 INFO:teuthology.orchestra.run.smithi186.stdout: debug mon = 20 2024-04-25T02:19:49.204 INFO:teuthology.orchestra.run.smithi186.stdout: debug paxos = 20 2024-04-25T02:19:49.205 INFO:teuthology.orchestra.run.smithi186.stdout: debug auth = 20 2024-04-25T02:19:49.205 INFO:teuthology.orchestra.run.smithi186.stdout: mon data avail warn = 5 2024-04-25T02:19:49.205 INFO:teuthology.orchestra.run.smithi186.stdout: mon mgr mkfs grace = 240 2024-04-25T02:19:49.205 INFO:teuthology.orchestra.run.smithi186.stdout: mon reweight min pgs per osd = 4 2024-04-25T02:19:49.205 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd reporter subtree level = osd 2024-04-25T02:19:49.205 INFO:teuthology.orchestra.run.smithi186.stdout: mon osd prime pg temp = true 2024-04-25T02:19:49.205 INFO:teuthology.orchestra.run.smithi186.stdout: mon reweight min bytes per osd = 10 2024-04-25T02:19:49.205 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:19:49.205 INFO:teuthology.orchestra.run.smithi186.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-25T02:19:49.205 INFO:teuthology.orchestra.run.smithi186.stdout: auth mon ticket ttl = 660 # 11m 2024-04-25T02:19:49.205 INFO:teuthology.orchestra.run.smithi186.stdout: auth service ticket ttl = 240 # 4m 2024-04-25T02:19:49.205 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:19:49.205 INFO:teuthology.orchestra.run.smithi186.stdout: # don't complain about insecure global_id in the test suite 2024-04-25T02:19:49.205 INFO:teuthology.orchestra.run.smithi186.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-25T02:19:49.205 INFO:teuthology.orchestra.run.smithi186.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-25T02:19:49.205 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:19:49.206 INFO:teuthology.orchestra.run.smithi186.stdout: # 1m isn't quite enough 2024-04-25T02:19:49.206 INFO:teuthology.orchestra.run.smithi186.stdout: mon_down_mkfs_grace = 2m 2024-04-25T02:19:49.206 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:19:49.206 INFO:teuthology.orchestra.run.smithi186.stdout: mon_warn_on_filestore_osds = false 2024-04-25T02:19:49.206 INFO:teuthology.orchestra.run.smithi186.stdout: mon down mkfs grace = 300 2024-04-25T02:19:49.206 INFO:teuthology.orchestra.run.smithi186.stdout: mon op complaint time = 120 2024-04-25T02:19:49.206 INFO:teuthology.orchestra.run.smithi186.stdout: mon warn on osd down out interval zero = False 2024-04-25T02:19:49.206 INFO:teuthology.orchestra.run.smithi186.stdout: 2024-04-25T02:19:49.206 INFO:teuthology.orchestra.run.smithi186.stdout:[client] 2024-04-25T02:19:49.206 INFO:teuthology.orchestra.run.smithi186.stdout: rgw cache enabled = true 2024-04-25T02:19:49.206 INFO:teuthology.orchestra.run.smithi186.stdout: rgw enable ops log = true 2024-04-25T02:19:49.206 INFO:teuthology.orchestra.run.smithi186.stdout: rgw enable usage log = true 2024-04-25T02:19:49.206 INFO:teuthology.orchestra.run.smithi186.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-25T02:19:49.206 INFO:teuthology.orchestra.run.smithi186.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-25T02:19:49.206 INFO:teuthology.orchestra.run.smithi186.stdout: client mount timeout = 600 2024-04-25T02:19:49.207 INFO:teuthology.orchestra.run.smithi186.stdout: debug client = 20 2024-04-25T02:19:49.207 INFO:teuthology.orchestra.run.smithi186.stdout: debug ms = 1 2024-04-25T02:19:49.207 INFO:teuthology.orchestra.run.smithi186.stdout: rados mon op timeout = 900 2024-04-25T02:19:49.207 INFO:teuthology.orchestra.run.smithi186.stdout: rados osd op timeout = 900 2024-04-25T02:19:49.207 INFO:teuthology.orchestra.run.smithi186.stdout:[mon.a] 2024-04-25T02:19:49.207 INFO:teuthology.orchestra.run.smithi186.stdout:[mon.b] 2024-04-25T02:19:49.207 INFO:teuthology.orchestra.run.smithi186.stdout:[mon.c] 2024-04-25T02:19:49.207 INFO:teuthology.orchestra.run.smithi186.stdout:[mds.a] 2024-04-25T02:19:49.207 INFO:teuthology.orchestra.run.smithi186.stdout:[mds.b] 2024-04-25T02:19:49.207 INFO:teuthology.orchestra.run.smithi186.stdout:[mds.c] 2024-04-25T02:19:49.207 INFO:teuthology.orchestra.run.smithi186.stdout:[mds] 2024-04-25T02:19:49.207 INFO:teuthology.orchestra.run.smithi186.stdout: debug mds = 20 2024-04-25T02:19:49.207 INFO:teuthology.orchestra.run.smithi186.stdout: debug mds balancer = 20 2024-04-25T02:19:49.207 INFO:teuthology.orchestra.run.smithi186.stdout: debug ms = 1 2024-04-25T02:19:49.207 INFO:teuthology.orchestra.run.smithi186.stdout: mds debug frag = True 2024-04-25T02:19:49.208 INFO:teuthology.orchestra.run.smithi186.stdout: mds debug scatterstat = True 2024-04-25T02:19:49.208 INFO:teuthology.orchestra.run.smithi186.stdout: mds op complaint time = 180 2024-04-25T02:19:49.208 INFO:teuthology.orchestra.run.smithi186.stdout: mds verify scatter = True 2024-04-25T02:19:49.208 INFO:teuthology.orchestra.run.smithi186.stdout: osd op complaint time = 180 2024-04-25T02:19:49.208 INFO:teuthology.orchestra.run.smithi186.stdout: rados mon op timeout = 900 2024-04-25T02:19:49.208 INFO:teuthology.orchestra.run.smithi186.stdout: rados osd op timeout = 900 2024-04-25T02:19:49.209 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-25T02:19:49.209 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-25T02:19:49.287 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-25T02:19:49.288 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-25T02:19:49.288 DEBUG:teuthology.orchestra.run.smithi111:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-25T02:19:49.305 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-25T02:19:49.305 DEBUG:teuthology.orchestra.run.smithi111:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-25T02:19:49.366 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi111.front.sepia.ceph.com 2024-04-25T02:19:49.366 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-25T02:19:49.366 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T02:19:49.366 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T02:19:49.442 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-25T02:19:49.442 DEBUG:teuthology.orchestra.run.smithi111:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:19:49.499 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi114.front.sepia.ceph.com 2024-04-25T02:19:49.499 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-25T02:19:49.500 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T02:19:49.500 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T02:19:49.542 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-25T02:19:49.542 DEBUG:teuthology.orchestra.run.smithi114:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:19:49.603 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi186.front.sepia.ceph.com 2024-04-25T02:19:49.603 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T02:19:49.603 DEBUG:teuthology.orchestra.run.smithi186:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-25T02:19:49.603 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-25T02:19:49.647 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T02:19:49.647 DEBUG:teuthology.orchestra.run.smithi186:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:19:49.707 INFO:tasks.ceph:Setting up mon nodes... 2024-04-25T02:19:49.708 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-25T02:19:49.708 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T02:19:49.756 INFO:teuthology.orchestra.run.smithi111.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-25T02:19:49.759 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T02:19:49.806 INFO:teuthology.orchestra.run.smithi111.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-25T02:19:49.808 INFO:tasks.ceph:Setting up mds nodes... 2024-04-25T02:19:49.809 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T02:19:49.856 INFO:teuthology.orchestra.run.smithi111.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-25T02:19:49.858 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-25T02:19:49.884 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T02:19:49.973 INFO:teuthology.orchestra.run.smithi111.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-25T02:19:49.975 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-25T02:19:50.001 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-25T02:19:50.089 INFO:teuthology.orchestra.run.smithi111.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-25T02:19:50.091 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-25T02:19:50.117 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-25T02:19:50.117 DEBUG:teuthology.orchestra.run.smithi114:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-25T02:19:50.230 INFO:teuthology.orchestra.run.smithi114.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-25T02:19:50.244 DEBUG:teuthology.orchestra.run.smithi186:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-25T02:19:50.376 INFO:teuthology.orchestra.run.smithi186.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-25T02:19:50.391 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-25T02:19:50.391 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi111.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}} 2024-04-25T02:19:50.391 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-25T02:19:50.417 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T02:19:50.418 INFO:tasks.ceph:role: osd.0 2024-04-25T02:19:50.418 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi111.front.sepia.ceph.com 2024-04-25T02:19:50.418 DEBUG:teuthology.orchestra.run.smithi111:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-25T02:19:50.492 INFO:teuthology.orchestra.run.smithi111.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T02:19:50.492 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T02:19:50.492 INFO:teuthology.orchestra.run.smithi111.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T02:19:50.492 INFO:teuthology.orchestra.run.smithi111.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T02:19:50.492 INFO:teuthology.orchestra.run.smithi111.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T02:19:50.492 INFO:teuthology.orchestra.run.smithi111.stdout: = sunit=0 swidth=0 blks 2024-04-25T02:19:50.492 INFO:teuthology.orchestra.run.smithi111.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T02:19:50.492 INFO:teuthology.orchestra.run.smithi111.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T02:19:50.492 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T02:19:50.492 INFO:teuthology.orchestra.run.smithi111.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T02:19:50.923 INFO:teuthology.orchestra.run.smithi111.stdout:Discarding blocks...Done. 2024-04-25T02:19:50.925 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi111.front.sepia.ceph.com -o noatime 2024-04-25T02:19:50.925 DEBUG:teuthology.orchestra.run.smithi111:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-25T02:19:51.083 DEBUG:teuthology.orchestra.run.smithi111:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-25T02:19:51.115 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-25T02:19:51.182 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T02:19:51.182 INFO:tasks.ceph:role: osd.1 2024-04-25T02:19:51.182 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi111.front.sepia.ceph.com 2024-04-25T02:19:51.183 DEBUG:teuthology.orchestra.run.smithi111:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-25T02:19:51.256 INFO:teuthology.orchestra.run.smithi111.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T02:19:51.257 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T02:19:51.257 INFO:teuthology.orchestra.run.smithi111.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T02:19:51.257 INFO:teuthology.orchestra.run.smithi111.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T02:19:51.257 INFO:teuthology.orchestra.run.smithi111.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T02:19:51.257 INFO:teuthology.orchestra.run.smithi111.stdout: = sunit=0 swidth=0 blks 2024-04-25T02:19:51.257 INFO:teuthology.orchestra.run.smithi111.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T02:19:51.257 INFO:teuthology.orchestra.run.smithi111.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T02:19:51.257 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T02:19:51.257 INFO:teuthology.orchestra.run.smithi111.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T02:19:51.684 INFO:teuthology.orchestra.run.smithi111.stdout:Discarding blocks...Done. 2024-04-25T02:19:51.686 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi111.front.sepia.ceph.com -o noatime 2024-04-25T02:19:51.686 DEBUG:teuthology.orchestra.run.smithi111:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-25T02:19:51.803 DEBUG:teuthology.orchestra.run.smithi111:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-25T02:19:51.833 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-25T02:19:51.901 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T02:19:51.901 INFO:tasks.ceph:role: osd.2 2024-04-25T02:19:51.901 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi111.front.sepia.ceph.com 2024-04-25T02:19:51.901 DEBUG:teuthology.orchestra.run.smithi111:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-25T02:19:51.974 INFO:teuthology.orchestra.run.smithi111.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T02:19:51.974 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T02:19:51.974 INFO:teuthology.orchestra.run.smithi111.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T02:19:51.974 INFO:teuthology.orchestra.run.smithi111.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T02:19:51.975 INFO:teuthology.orchestra.run.smithi111.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T02:19:51.975 INFO:teuthology.orchestra.run.smithi111.stdout: = sunit=0 swidth=0 blks 2024-04-25T02:19:51.975 INFO:teuthology.orchestra.run.smithi111.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T02:19:51.975 INFO:teuthology.orchestra.run.smithi111.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T02:19:51.975 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T02:19:51.975 INFO:teuthology.orchestra.run.smithi111.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T02:19:52.422 INFO:teuthology.orchestra.run.smithi111.stdout:Discarding blocks...Done. 2024-04-25T02:19:52.423 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi111.front.sepia.ceph.com -o noatime 2024-04-25T02:19:52.424 DEBUG:teuthology.orchestra.run.smithi111:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-25T02:19:52.587 DEBUG:teuthology.orchestra.run.smithi111:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-25T02:19:52.618 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-25T02:19:52.686 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-25T02:19:52.687 INFO:tasks.ceph:role: osd.3 2024-04-25T02:19:52.687 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi111.front.sepia.ceph.com 2024-04-25T02:19:52.687 DEBUG:teuthology.orchestra.run.smithi111:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-25T02:19:52.761 INFO:teuthology.orchestra.run.smithi111.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-25T02:19:52.761 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-25T02:19:52.761 INFO:teuthology.orchestra.run.smithi111.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-25T02:19:52.761 INFO:teuthology.orchestra.run.smithi111.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-25T02:19:52.761 INFO:teuthology.orchestra.run.smithi111.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-25T02:19:52.761 INFO:teuthology.orchestra.run.smithi111.stdout: = sunit=0 swidth=0 blks 2024-04-25T02:19:52.761 INFO:teuthology.orchestra.run.smithi111.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-25T02:19:52.761 INFO:teuthology.orchestra.run.smithi111.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-25T02:19:52.761 INFO:teuthology.orchestra.run.smithi111.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-25T02:19:52.761 INFO:teuthology.orchestra.run.smithi111.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-25T02:19:53.201 INFO:teuthology.orchestra.run.smithi111.stdout:Discarding blocks...Done. 2024-04-25T02:19:53.203 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi111.front.sepia.ceph.com -o noatime 2024-04-25T02:19:53.203 DEBUG:teuthology.orchestra.run.smithi111:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-25T02:19:53.356 DEBUG:teuthology.orchestra.run.smithi111:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-25T02:19:53.387 DEBUG:teuthology.orchestra.run.smithi111:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:19:53.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:19:53.474+0000 7fbc7cec2f00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-25T02:19:53.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:19:53.474+0000 7fbc7cec2f00 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-25T02:19:53.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:19:53.474+0000 7fbc7cec2f00 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T02:19:53.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:19:53.475+0000 7fbc7cec2f00 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T02:19:53.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:19:53.475+0000 7fbc7cec2f00 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-25T02:19:53.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:19:53.475+0000 7fbc7cec2f00 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-25T02:19:53.490 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:19:53.487+0000 7fbc7cec2f00 -1 freelist read_size_meta_from_db missing size meta in DB 2024-04-25T02:19:55.807 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-25T02:19:55.883 DEBUG:teuthology.orchestra.run.smithi111:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:19:55.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:19:55.970+0000 7fa9aa40df00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-25T02:19:55.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:19:55.970+0000 7fa9aa40df00 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-25T02:19:55.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:19:55.970+0000 7fa9aa40df00 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T02:19:55.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:19:55.970+0000 7fa9aa40df00 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T02:19:55.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:19:55.970+0000 7fa9aa40df00 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-25T02:19:55.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:19:55.970+0000 7fa9aa40df00 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-25T02:19:55.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:19:55.981+0000 7fa9aa40df00 -1 freelist read_size_meta_from_db missing size meta in DB 2024-04-25T02:19:58.310 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-25T02:19:58.341 DEBUG:teuthology.orchestra.run.smithi111:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:19:58.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:19:58.425+0000 7f8bcb9ccf00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-25T02:19:58.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:19:58.425+0000 7f8bcb9ccf00 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-25T02:19:58.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:19:58.425+0000 7f8bcb9ccf00 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T02:19:58.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:19:58.425+0000 7f8bcb9ccf00 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T02:19:58.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:19:58.425+0000 7f8bcb9ccf00 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-25T02:19:58.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:19:58.425+0000 7f8bcb9ccf00 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-25T02:19:58.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:19:58.433+0000 7f8bcb9ccf00 -1 freelist read_size_meta_from_db missing size meta in DB 2024-04-25T02:20:00.764 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-25T02:20:00.795 DEBUG:teuthology.orchestra.run.smithi111:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:20:00.883 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:00.879+0000 7fc3660a3f00 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-25T02:20:00.883 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:00.880+0000 7fc3660a3f00 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-25T02:20:00.883 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:00.880+0000 7fc3660a3f00 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T02:20:00.883 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:00.880+0000 7fc3660a3f00 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T02:20:00.883 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:00.880+0000 7fc3660a3f00 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-25T02:20:00.884 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:00.880+0000 7fc3660a3f00 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-25T02:20:00.889 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:00.886+0000 7fc3660a3f00 -1 freelist read_size_meta_from_db missing size meta in DB 2024-04-25T02:20:03.211 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-25T02:20:03.243 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-25T02:20:03.243 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-25T02:20:03.243 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-25T02:20:03.312 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-25T02:20:03.312 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-25T02:20:03.380 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-25T02:20:03.380 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-25T02:20:03.448 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-25T02:20:03.448 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-25T02:20:03.516 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-25T02:20:03.516 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-25T02:20:03.583 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-25T02:20:03.584 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-25T02:20:03.650 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-25T02:20:03.650 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-25T02:20:03.717 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-25T02:20:03.718 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-25T02:20:03.783 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-25T02:20:03.783 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-25T02:20:03.850 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-25T02:20:03.850 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-25T02:20:03.873 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T02:20:03.873 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-25T02:20:03.895 INFO:tasks.ceph:Adding keys to all mons... 2024-04-25T02:20:03.896 DEBUG:teuthology.orchestra.run.smithi111:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-25T02:20:03.920 INFO:teuthology.orchestra.run.smithi111.stdout:[mgr.x] 2024-04-25T02:20:03.920 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQDFvSlmdcfzLBAAmslGOWtz5p+hcbEssKh5tQ== 2024-04-25T02:20:03.920 INFO:teuthology.orchestra.run.smithi111.stdout:[mgr.y] 2024-04-25T02:20:03.921 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQDFvSlmO4TrLxAAItNsCEDdXC3Y5ccEiGl+6A== 2024-04-25T02:20:03.921 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.a] 2024-04-25T02:20:03.921 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQDFvSlmH8biMhAAGsKJMSIZZ89l4Oz6mBGVTA== 2024-04-25T02:20:03.921 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.b] 2024-04-25T02:20:03.921 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQDFvSlmrEnXORAArkU8D0gnj4AZoiUMe+Td6w== 2024-04-25T02:20:03.921 INFO:teuthology.orchestra.run.smithi111.stdout:[mds.c] 2024-04-25T02:20:03.921 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQDGvSlm9HQlBRAAIjWhcztdxbV//Fc1JrQ0qw== 2024-04-25T02:20:03.921 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.0] 2024-04-25T02:20:03.921 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQDJvSlmXjRQHBAA9QE3Bhgljj2ld1TGXeBF+g== 2024-04-25T02:20:03.921 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.1] 2024-04-25T02:20:03.921 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQDLvSlm4szVORAA5w5T5tHBm7Ce0wgNlRvQ0w== 2024-04-25T02:20:03.921 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.2] 2024-04-25T02:20:03.921 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQDOvSlmFVlZGRAAJ/wKUw0OJ0BRj9aP5TdOlg== 2024-04-25T02:20:03.921 INFO:teuthology.orchestra.run.smithi111.stdout:[osd.3] 2024-04-25T02:20:03.922 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQDQvSlmKr12NBAALODEK+LhcSHSIWUYO9ShOw== 2024-04-25T02:20:03.922 INFO:teuthology.orchestra.run.smithi111.stdout:[client.0] 2024-04-25T02:20:03.922 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQDGvSlm48SJDRAASohJU+HGOhU9GPFBCbgMAw== 2024-04-25T02:20:03.922 INFO:teuthology.orchestra.run.smithi111.stdout:[client.1] 2024-04-25T02:20:03.922 INFO:teuthology.orchestra.run.smithi111.stdout: key = AQDGvSlm4QNFFhAAiFOBsB6HfSQbBW7MnFufaw== 2024-04-25T02:20:03.923 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T02:20:04.010 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-25T02:20:04.057 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T02:20:04.107 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T02:20:04.157 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-25T02:20:04.207 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T02:20:04.255 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T02:20:04.302 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T02:20:04.349 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-25T02:20:04.397 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T02:20:04.446 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-25T02:20:04.496 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-25T02:20:04.496 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-25T02:20:04.523 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T02:20:04.615 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-25T02:20:04.641 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-25T02:20:04.707 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T02:20:04.799 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-25T02:20:04.825 DEBUG:teuthology.orchestra.run.smithi111:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-25T02:20:04.891 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-25T02:20:04.983 DEBUG:teuthology.orchestra.run.smithi111:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-25T02:20:05.010 DEBUG:teuthology.orchestra.run.smithi111:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-25T02:20:05.067 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-25T02:20:05.067 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-25T02:20:05.068 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-25T02:20:05.109 INFO:tasks.ceph.mon.a:Started 2024-04-25T02:20:05.109 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-25T02:20:05.109 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-25T02:20:05.111 INFO:tasks.ceph.mon.b:Started 2024-04-25T02:20:05.111 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-25T02:20:05.111 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-25T02:20:05.113 INFO:tasks.ceph.mon.c:Started 2024-04-25T02:20:05.113 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-25T02:20:05.113 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-25T02:20:05.114 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-25T02:20:05.115 INFO:tasks.ceph.mgr.x:Started 2024-04-25T02:20:05.116 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-25T02:20:05.116 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-25T02:20:05.118 INFO:tasks.ceph.mgr.y:Started 2024-04-25T02:20:05.118 INFO:tasks.ceph:Setting crush tunables to default 2024-04-25T02:20:05.118 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph --cluster ceph osd crush tunables default 2024-04-25T02:20:05.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.237+0000 7f6190dce700 1 Processor -- start 2024-04-25T02:20:05.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.237+0000 7f6190dce700 1 -- start start 2024-04-25T02:20:05.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.238+0000 7f6190dce700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f618c1361a0 0x7f618c093080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:05.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.238+0000 7f6190dce700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f618c092780 0x7f618c140a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:05.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.238+0000 7f6190dce700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f618c092c10 con 0x7f618c06ca40 2024-04-25T02:20:05.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.238+0000 7f6190dce700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f618c06ce20 con 0x7f618c092780 2024-04-25T02:20:05.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.238+0000 7f6190dce700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f618c099cb0 con 0x7f618c1361a0 2024-04-25T02:20:05.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.238+0000 7f618a59c700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f618c06ca40 0x7f618c067a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:49682/0 (socket says 172.21.15.111:49682) 2024-04-25T02:20:05.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.238+0000 7f618a59c700 1 -- 172.21.15.111:0/3922898061 learned_addr learned my addr 172.21.15.111:0/3922898061 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:20:05.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.238+0000 7f6189d9b700 1 --2- 172.21.15.111:0/3922898061 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f618c1361a0 0x7f618c093080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:05.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.238+0000 7f618ad9d700 1 --2- 172.21.15.111:0/3922898061 >> v2:172.21.15.111:3300/0 conn(0x7f618c092780 0x7f618c140a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:05.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.238+0000 7f6189d9b700 1 -- 172.21.15.111:0/3922898061 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f618c1361a0 msgr2=0x7f618c093080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T02:20:05.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.238+0000 7f6189d9b700 1 -- 172.21.15.111:0/3922898061 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f618c1361a0 msgr2=0x7f618c093080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T02:20:05.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.238+0000 7f6189d9b700 1 --2- 172.21.15.111:0/3922898061 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f618c1361a0 0x7f618c093080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-25T02:20:05.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.238+0000 7f6189d9b700 1 --2- 172.21.15.111:0/3922898061 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f618c1361a0 0x7f618c093080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2024-04-25T02:20:05.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.238+0000 7f618ad9d700 1 -- 172.21.15.111:0/3922898061 >> v2:172.21.15.111:3300/0 conn(0x7f618c092780 msgr2=0x7f618c140a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T02:20:05.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.238+0000 7f618ad9d700 1 -- 172.21.15.111:0/3922898061 >> v2:172.21.15.111:3300/0 conn(0x7f618c092780 msgr2=0x7f618c140a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T02:20:05.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.238+0000 7f618ad9d700 1 --2- 172.21.15.111:0/3922898061 >> v2:172.21.15.111:3300/0 conn(0x7f618c092780 0x7f618c140a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-25T02:20:05.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.238+0000 7f618ad9d700 1 --2- 172.21.15.111:0/3922898061 >> v2:172.21.15.111:3300/0 conn(0x7f618c092780 0x7f618c140a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2024-04-25T02:20:05.443 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.439+0000 7f618ad9d700 1 --2- 172.21.15.111:0/3922898061 >> v2:172.21.15.111:3300/0 conn(0x7f618c092780 0x7f618c140a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:05.443 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.439+0000 7f6189d9b700 1 --2- 172.21.15.111:0/3922898061 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f618c1361a0 0x7f618c093080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:05.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.439+0000 7f618ad9d700 1 -- 172.21.15.111:0/3922898061 >> v2:172.21.15.111:3300/0 conn(0x7f618c092780 msgr2=0x7f618c140a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2024-04-25T02:20:05.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.439+0000 7f618ad9d700 1 -- 172.21.15.111:0/3922898061 >> v2:172.21.15.111:3300/0 conn(0x7f618c092780 msgr2=0x7f618c140a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T02:20:05.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.439+0000 7f618ad9d700 1 --2- 172.21.15.111:0/3922898061 >> v2:172.21.15.111:3300/0 conn(0x7f618c092780 0x7f618c140a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-25T02:20:05.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.439+0000 7f6189d9b700 1 -- 172.21.15.111:0/3922898061 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f618c1361a0 msgr2=0x7f618c093080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T02:20:05.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.439+0000 7f6189d9b700 1 -- 172.21.15.111:0/3922898061 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f618c1361a0 msgr2=0x7f618c093080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T02:20:05.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.439+0000 7f6189d9b700 1 --2- 172.21.15.111:0/3922898061 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f618c1361a0 0x7f618c093080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-25T02:20:05.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.439+0000 7f618ad9d700 1 --2- 172.21.15.111:0/3922898061 >> v2:172.21.15.111:3300/0 conn(0x7f618c092780 0x7f618c140a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2024-04-25T02:20:05.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.439+0000 7f6189d9b700 1 --2- 172.21.15.111:0/3922898061 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f618c1361a0 0x7f618c093080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0)._fault waiting 0.400000 2024-04-25T02:20:05.467 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.460+0000 7f618959a700 1 -- 172.21.15.111:0/3922898061 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2298636305 0 0) 0x7f618c092c10 con 0x7f618c06ca40 2024-04-25T02:20:05.467 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.460+0000 7f618959a700 1 -- 172.21.15.111:0/3922898061 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6170003260 con 0x7f618c06ca40 2024-04-25T02:20:05.467 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.461+0000 7f618959a700 1 -- 172.21.15.111:0/3922898061 <== mon.0 v1:172.21.15.111:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3018616561 0 0) 0x7f6170003260 con 0x7f618c06ca40 2024-04-25T02:20:05.467 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.461+0000 7f618959a700 1 -- 172.21.15.111:0/3922898061 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f618c1361a0 msgr2=0x7f618c093080 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T02:20:05.467 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.461+0000 7f618959a700 1 --2- 172.21.15.111:0/3922898061 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f618c1361a0 0x7f618c093080 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:05.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.461+0000 7f618959a700 1 -- 172.21.15.111:0/3922898061 >> v2:172.21.15.111:3300/0 conn(0x7f618c092780 msgr2=0x7f618c140a30 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T02:20:05.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.461+0000 7f618959a700 1 --2- 172.21.15.111:0/3922898061 >> v2:172.21.15.111:3300/0 conn(0x7f618c092780 0x7f618c140a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:05.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.461+0000 7f618959a700 1 -- 172.21.15.111:0/3922898061 --> v1:172.21.15.111:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f618c093b90 con 0x7f618c06ca40 2024-04-25T02:20:05.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.461+0000 7f618959a700 1 -- 172.21.15.111:0/3922898061 <== mon.0 v1:172.21.15.111:6789/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (unknown 3749439343 0 0) 0x7f6180001660 con 0x7f618c06ca40 2024-04-25T02:20:05.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.461+0000 7f618959a700 1 -- 172.21.15.111:0/3922898061 >> v1:172.21.15.111:6789/0 conn(0x7f618c06ca40 legacy=0x7f618c067a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:05.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.461+0000 7f618959a700 1 --2- 172.21.15.111:0/3922898061 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6170003750 0x7f6170003b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:05.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.461+0000 7f618959a700 1 --2- 172.21.15.111:0/3922898061 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f618c1361a0 0x7f6170004500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:05.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.461+0000 7f618959a700 1 --2- 172.21.15.111:0/3922898061 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f61700049f0 0x7f6170004e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:05.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.461+0000 7f618959a700 1 -- 172.21.15.111:0/3922898061 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f618c06ce20 con 0x7f6170003750 2024-04-25T02:20:05.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.461+0000 7f618959a700 1 -- 172.21.15.111:0/3922898061 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f618c099cb0 con 0x7f61700049f0 2024-04-25T02:20:05.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.461+0000 7f618959a700 1 -- 172.21.15.111:0/3922898061 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f617000b780 con 0x7f618c1361a0 2024-04-25T02:20:05.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.461+0000 7f618a59c700 1 --2- 172.21.15.111:0/3922898061 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6170003750 0x7f6170003b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:05.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.461+0000 7f618ad9d700 1 --2- 172.21.15.111:0/3922898061 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f61700049f0 0x7f6170004e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:05.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.461+0000 7f6189d9b700 1 --2- 172.21.15.111:0/3922898061 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f618c1361a0 0x7f6170004500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:05.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.461+0000 7f618a59c700 1 -- 172.21.15.111:0/3922898061 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f618c1361a0 msgr2=0x7f6170004500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:05.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.461+0000 7f618a59c700 1 --2- 172.21.15.111:0/3922898061 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f618c1361a0 0x7f6170004500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:05.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.461+0000 7f618a59c700 1 -- 172.21.15.111:0/3922898061 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f61700049f0 msgr2=0x7f6170004e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:05.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.461+0000 7f618a59c700 1 --2- 172.21.15.111:0/3922898061 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f61700049f0 0x7f6170004e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:05.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.461+0000 7f618a59c700 1 -- 172.21.15.111:0/3922898061 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6170003260 con 0x7f6170003750 2024-04-25T02:20:05.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.461+0000 7f618a59c700 1 --2- 172.21.15.111:0/3922898061 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6170003750 0x7f6170003b70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f6180001370 tx=0x7f6180001e50).ready entity=mon.0 client_cookie=8ea4eb98a03d8171 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:05.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.462+0000 7f618959a700 1 -- 172.21.15.111:0/3922898061 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f61800070d0 con 0x7f6170003750 2024-04-25T02:20:05.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.462+0000 7f618959a700 1 -- 172.21.15.111:0/3922898061 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6180007230 con 0x7f6170003750 2024-04-25T02:20:05.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.462+0000 7f618959a700 1 -- 172.21.15.111:0/3922898061 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f618000c9c0 con 0x7f6170003750 2024-04-25T02:20:05.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.462+0000 7f6190dce700 1 -- 172.21.15.111:0/3922898061 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6170003750 msgr2=0x7f6170003b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:05.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.462+0000 7f6190dce700 1 --2- 172.21.15.111:0/3922898061 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6170003750 0x7f6170003b70 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f6180001370 tx=0x7f6180001e50).stop 2024-04-25T02:20:05.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.462+0000 7f618ad9d700 1 -- 172.21.15.111:0/3922898061 reap_dead start 2024-04-25T02:20:05.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.462+0000 7f6190dce700 1 -- 172.21.15.111:0/3922898061 shutdown_connections 2024-04-25T02:20:05.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.463+0000 7f6190dce700 1 -- 172.21.15.111:0/3922898061 >> 172.21.15.111:0/3922898061 conn(0x7f618c060340 msgr2=0x7f618c06c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:05.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.463+0000 7f6190dce700 1 -- 172.21.15.111:0/3922898061 shutdown_connections 2024-04-25T02:20:05.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.463+0000 7f6190dce700 1 -- 172.21.15.111:0/3922898061 wait complete. 2024-04-25T02:20:05.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.464+0000 7f6190dce700 1 Processor -- start 2024-04-25T02:20:05.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.464+0000 7f6190dce700 1 -- start start 2024-04-25T02:20:05.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.465+0000 7f6190dce700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6170003750 0x7f618c066830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:05.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.465+0000 7f6190dce700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f618c09cab0 0x7f618c148f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:05.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.465+0000 7f6190dce700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f618c066d20 0x7f618c149450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:05.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.465+0000 7f6190dce700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f618c09bda0 con 0x7f618c09cab0 2024-04-25T02:20:05.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.465+0000 7f6190dce700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f618c09c080 con 0x7f6170003750 2024-04-25T02:20:05.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.465+0000 7f6190dce700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f618c067200 con 0x7f618c066d20 2024-04-25T02:20:05.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.465+0000 7f618a59c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6170003750 0x7f618c066830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:05.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.465+0000 7f618ad9d700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f618c066d20 0x7f618c149450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:05.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.465+0000 7f6189d9b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f618c09cab0 0x7f618c148f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:05.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.465+0000 7f618ad9d700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f618c066d20 0x7f618c149450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:42934/0 (socket says 172.21.15.111:42934) 2024-04-25T02:20:05.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.465+0000 7f618ad9d700 1 -- 172.21.15.111:0/856812627 learned_addr learned my addr 172.21.15.111:0/856812627 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:05.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.465+0000 7f618ad9d700 1 -- 172.21.15.111:0/856812627 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6170003750 msgr2=0x7f618c066830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:05.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.465+0000 7f618ad9d700 1 --2- 172.21.15.111:0/856812627 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6170003750 0x7f618c066830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:05.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.465+0000 7f618ad9d700 1 -- 172.21.15.111:0/856812627 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f618c09cab0 msgr2=0x7f618c148f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:05.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.465+0000 7f618ad9d700 1 --2- 172.21.15.111:0/856812627 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f618c09cab0 0x7f618c148f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:05.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.465+0000 7f618ad9d700 1 -- 172.21.15.111:0/856812627 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f618c063b20 con 0x7f618c066d20 2024-04-25T02:20:05.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.465+0000 7f6189d9b700 1 --2- 172.21.15.111:0/856812627 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f618c09cab0 0x7f618c148f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:05.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.465+0000 7f618ad9d700 1 --2- 172.21.15.111:0/856812627 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f618c066d20 0x7f618c149450 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f618400a000 tx=0x7f6184008040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:05.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.465+0000 7f617b7fe700 1 -- 172.21.15.111:0/856812627 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6184002780 con 0x7f618c066d20 2024-04-25T02:20:05.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.465+0000 7f617b7fe700 1 -- 172.21.15.111:0/856812627 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f618400c070 con 0x7f618c066d20 2024-04-25T02:20:05.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.465+0000 7f6190dce700 1 -- 172.21.15.111:0/856812627 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f618c0656b0 con 0x7f618c066d20 2024-04-25T02:20:05.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.465+0000 7f617b7fe700 1 -- 172.21.15.111:0/856812627 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6184002ad0 con 0x7f618c066d20 2024-04-25T02:20:05.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.465+0000 7f6190dce700 1 -- 172.21.15.111:0/856812627 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f618c067c00 con 0x7f618c066d20 2024-04-25T02:20:05.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.466+0000 7f617b7fe700 1 -- 172.21.15.111:0/856812627 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f6184012040 con 0x7f618c066d20 2024-04-25T02:20:05.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.466+0000 7f617b7fe700 1 -- 172.21.15.111:0/856812627 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f6184020890 con 0x7f618c066d20 2024-04-25T02:20:05.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.467+0000 7f6190dce700 1 -- 172.21.15.111:0/856812627 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f618c136710 con 0x7f618c066d20 2024-04-25T02:20:05.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.469+0000 7f617b7fe700 1 -- 172.21.15.111:0/856812627 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f618400f040 con 0x7f618c066d20 2024-04-25T02:20:05.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.536+0000 7f6190dce700 1 -- 172.21.15.111:0/856812627 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f618c057a60 con 0x7f618c066d20 2024-04-25T02:20:05.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.544+0000 7f617b7fe700 1 -- 172.21.15.111:0/856812627 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7f6184020a50 con 0x7f618c066d20 2024-04-25T02:20:05.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.545+0000 7f6190dce700 1 -- 172.21.15.111:0/856812627 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f618c066d20 msgr2=0x7f618c149450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:05.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.545+0000 7f6190dce700 1 --2- 172.21.15.111:0/856812627 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f618c066d20 0x7f618c149450 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f618400a000 tx=0x7f6184008040).stop 2024-04-25T02:20:05.550 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.545+0000 7f6190dce700 1 -- 172.21.15.111:0/856812627 shutdown_connections 2024-04-25T02:20:05.550 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.545+0000 7f6190dce700 1 --2- 172.21.15.111:0/856812627 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f618c066d20 0x7f618c149450 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:05.550 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.545+0000 7f6190dce700 1 --2- 172.21.15.111:0/856812627 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6170003750 0x7f618c066830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:05.550 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.545+0000 7f6190dce700 1 --2- 172.21.15.111:0/856812627 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f618c09cab0 0x7f618c148f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:05.550 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.545+0000 7f6190dce700 1 -- 172.21.15.111:0/856812627 >> 172.21.15.111:0/856812627 conn(0x7f618c060340 msgr2=0x7f618c0a8900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:05.550 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.545+0000 7f6190dce700 1 -- 172.21.15.111:0/856812627 shutdown_connections 2024-04-25T02:20:05.550 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.545+0000 7f6190dce700 1 -- 172.21.15.111:0/856812627 wait complete. 2024-04-25T02:20:05.550 INFO:teuthology.orchestra.run.smithi111.stderr:adjusted tunables profile to default 2024-04-25T02:20:05.559 INFO:tasks.ceph:check_enable_crimson: False 2024-04-25T02:20:05.559 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-25T02:20:05.559 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-25T02:20:05.559 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-25T02:20:05.585 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-25T02:20:05.586 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-25T02:20:05.652 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-25T02:20:05.652 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-25T02:20:05.719 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-25T02:20:05.720 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-25T02:20:05.786 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph --cluster ceph osd new df3f17ca-3b12-42c8-8cf7-8f1b7189e587 0 2024-04-25T02:20:05.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.940+0000 7fabc3772700 1 Processor -- start 2024-04-25T02:20:05.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.940+0000 7fabc3772700 1 -- start start 2024-04-25T02:20:05.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.941+0000 7fabc3772700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fabbc067c20 0x7fabbc067040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:05.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.941+0000 7fabc3772700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fabbc066170 0x7fabbc05c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:05.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.941+0000 7fabc3772700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabbc065c90 con 0x7fabbc05c1a0 2024-04-25T02:20:05.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.941+0000 7fabc3772700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabbc05ca70 con 0x7fabbc066170 2024-04-25T02:20:05.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.941+0000 7fabc3772700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc067680 con 0x7fabbc067c20 2024-04-25T02:20:05.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.941+0000 7fabc1d0f700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fabbc066170 0x7fabbc05c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:05.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.941+0000 7fabc0d0d700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fabbc067c20 0x7fabbc067040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:05.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.941+0000 7fabc0d0d700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fabbc067c20 0x7fabbc067040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:56902/0 (socket says 172.21.15.111:56902) 2024-04-25T02:20:05.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.941+0000 7fabc1d0f700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fabbc066170 0x7fabbc05c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:56200/0 (socket says 172.21.15.111:56200) 2024-04-25T02:20:05.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.941+0000 7fabc150e700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7fabbc05c1a0 0x7fabbc136350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:49692/0 (socket says 172.21.15.111:49692) 2024-04-25T02:20:05.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.941+0000 7fabc0d0d700 1 -- 172.21.15.111:0/942969130 learned_addr learned my addr 172.21.15.111:0/942969130 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:05.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.942+0000 7fabc1d0f700 1 -- 172.21.15.111:0/942969130 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fabbc067c20 msgr2=0x7fabbc067040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:05.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.942+0000 7fabc1d0f700 1 --2- 172.21.15.111:0/942969130 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fabbc067c20 0x7fabbc067040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:05.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.942+0000 7fabc1d0f700 1 -- 172.21.15.111:0/942969130 >> v1:172.21.15.111:6789/0 conn(0x7fabbc05c1a0 legacy=0x7fabbc136350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:05.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.942+0000 7fababfff700 1 -- 172.21.15.111:0/942969130 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 219346156 0 0) 0x7fabbc065c90 con 0x7fabbc05c1a0 2024-04-25T02:20:05.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.942+0000 7fabc1d0f700 1 -- 172.21.15.111:0/942969130 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabbc05ba50 con 0x7fabbc066170 2024-04-25T02:20:05.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.942+0000 7fabc0d0d700 1 --2- 172.21.15.111:0/942969130 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fabbc067c20 0x7fabbc067040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:05.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.942+0000 7fabc1d0f700 1 --2- 172.21.15.111:0/942969130 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fabbc066170 0x7fabbc05c580 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fabb40032f0 tx=0x7fabb40091d0).ready entity=mon.0 client_cookie=af8e8e0531e45db6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:05.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.942+0000 7fababfff700 1 -- 172.21.15.111:0/942969130 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabb400b6c0 con 0x7fabbc066170 2024-04-25T02:20:05.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.942+0000 7fababfff700 1 -- 172.21.15.111:0/942969130 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabb400b820 con 0x7fabbc066170 2024-04-25T02:20:05.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.942+0000 7fababfff700 1 -- 172.21.15.111:0/942969130 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabb400b990 con 0x7fabbc066170 2024-04-25T02:20:05.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.943+0000 7fabc3772700 1 -- 172.21.15.111:0/942969130 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fabbc066170 msgr2=0x7fabbc05c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:05.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.943+0000 7fabc3772700 1 --2- 172.21.15.111:0/942969130 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fabbc066170 0x7fabbc05c580 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fabb40032f0 tx=0x7fabb40091d0).stop 2024-04-25T02:20:05.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.943+0000 7fabc3772700 1 -- 172.21.15.111:0/942969130 shutdown_connections 2024-04-25T02:20:05.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.943+0000 7fabc3772700 1 --2- 172.21.15.111:0/942969130 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fabbc066170 0x7fabbc05c580 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:05.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.943+0000 7fabc3772700 1 --2- 172.21.15.111:0/942969130 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fabbc067c20 0x7fabbc067040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:05.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.943+0000 7fabc3772700 1 -- 172.21.15.111:0/942969130 >> 172.21.15.111:0/942969130 conn(0x7fabbc0a8a00 msgr2=0x7fabbc0a8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:05.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.943+0000 7fabc3772700 1 -- 172.21.15.111:0/942969130 shutdown_connections 2024-04-25T02:20:05.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.943+0000 7fabc3772700 1 -- 172.21.15.111:0/942969130 wait complete. 2024-04-25T02:20:05.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.944+0000 7fabc3772700 1 Processor -- start 2024-04-25T02:20:05.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.944+0000 7fabc3772700 1 -- start start 2024-04-25T02:20:05.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.945+0000 7fabc3772700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fabbc05c1a0 0x7fabbc096040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:05.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.945+0000 7fabc3772700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fabbc066170 0x7fabbc146570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:05.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.945+0000 7fabc3772700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fabbc067c20 0x7fabbc0925a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:05.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.945+0000 7fabc3772700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc146f40 con 0x7fabbc067c20 2024-04-25T02:20:05.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.945+0000 7fabc3772700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc092150 con 0x7fabbc066170 2024-04-25T02:20:05.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.945+0000 7fabc3772700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc146070 con 0x7fabbc05c1a0 2024-04-25T02:20:05.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.945+0000 7fabc150e700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fabbc05c1a0 0x7fabbc096040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:05.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.945+0000 7fabc0d0d700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fabbc066170 0x7fabbc146570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:05.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.945+0000 7fabc150e700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fabbc05c1a0 0x7fabbc096040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:42958/0 (socket says 172.21.15.111:42958) 2024-04-25T02:20:05.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.945+0000 7fabc0d0d700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fabbc066170 0x7fabbc146570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:56908/0 (socket says 172.21.15.111:56908) 2024-04-25T02:20:05.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.945+0000 7fabc150e700 1 -- 172.21.15.111:0/1583912967 learned_addr learned my addr 172.21.15.111:0/1583912967 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:05.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.946+0000 7fabc1d0f700 1 --2- 172.21.15.111:0/1583912967 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fabbc067c20 0x7fabbc0925a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:05.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.946+0000 7fabc0d0d700 1 -- 172.21.15.111:0/1583912967 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fabbc05c1a0 msgr2=0x7fabbc096040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:05.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.946+0000 7fabc0d0d700 1 --2- 172.21.15.111:0/1583912967 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fabbc05c1a0 0x7fabbc096040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:05.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.946+0000 7fabc0d0d700 1 -- 172.21.15.111:0/1583912967 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fabbc067c20 msgr2=0x7fabbc0925a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:05.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.946+0000 7fabc0d0d700 1 --2- 172.21.15.111:0/1583912967 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fabbc067c20 0x7fabbc0925a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:05.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.946+0000 7fabc0d0d700 1 -- 172.21.15.111:0/1583912967 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabac00b1e0 con 0x7fabbc066170 2024-04-25T02:20:05.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.946+0000 7fabc150e700 1 --2- 172.21.15.111:0/1583912967 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fabbc05c1a0 0x7fabbc096040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:05.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.946+0000 7fabc1d0f700 1 --2- 172.21.15.111:0/1583912967 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fabbc067c20 0x7fabbc0925a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:20:05.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.946+0000 7fabc0d0d700 1 --2- 172.21.15.111:0/1583912967 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fabbc066170 0x7fabbc146570 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fabac00c000 tx=0x7fabac006eb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:05.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.946+0000 7fabaa7fc700 1 -- 172.21.15.111:0/1583912967 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabac012600 con 0x7fabbc066170 2024-04-25T02:20:05.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.946+0000 7fabaa7fc700 1 -- 172.21.15.111:0/1583912967 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabac012760 con 0x7fabbc066170 2024-04-25T02:20:05.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.946+0000 7fabc3772700 1 -- 172.21.15.111:0/1583912967 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabb4009470 con 0x7fabbc066170 2024-04-25T02:20:05.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.946+0000 7fabaa7fc700 1 -- 172.21.15.111:0/1583912967 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fabac012ac0 con 0x7fabbc066170 2024-04-25T02:20:05.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.946+0000 7fabaa7fc700 1 -- 172.21.15.111:0/1583912967 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7fabac01b400 con 0x7fabbc066170 2024-04-25T02:20:05.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.946+0000 7fabc3772700 1 -- 172.21.15.111:0/1583912967 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabbc0937e0 con 0x7fabbc066170 2024-04-25T02:20:05.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.946+0000 7fabaa7fc700 1 -- 172.21.15.111:0/1583912967 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 721+0+0 (secure 0 0 0) 0x7fabac012df0 con 0x7fabbc066170 2024-04-25T02:20:05.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.947+0000 7fabc3772700 1 -- 172.21.15.111:0/1583912967 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabbc146290 con 0x7fabbc066170 2024-04-25T02:20:05.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:05.949+0000 7fabaa7fc700 1 -- 172.21.15.111:0/1583912967 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7fabac016020 con 0x7fabbc066170 2024-04-25T02:20:06.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.024+0000 7fabc3772700 1 -- 172.21.15.111:0/1583912967 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd new", "uuid": "df3f17ca-3b12-42c8-8cf7-8f1b7189e587", "id": 0} v 0) v1 -- 0x7fabbc05e4b0 con 0x7fabbc066170 2024-04-25T02:20:06.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.035+0000 7fabaa7fc700 1 -- 172.21.15.111:0/1583912967 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "df3f17ca-3b12-42c8-8cf7-8f1b7189e587", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7fabac024430 con 0x7fabbc066170 2024-04-25T02:20:06.039 INFO:teuthology.orchestra.run.smithi111.stdout:0 2024-04-25T02:20:06.040 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.036+0000 7fabc3772700 1 -- 172.21.15.111:0/1583912967 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fabbc066170 msgr2=0x7fabbc146570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:06.040 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.036+0000 7fabc3772700 1 --2- 172.21.15.111:0/1583912967 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fabbc066170 0x7fabbc146570 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fabac00c000 tx=0x7fabac006eb0).stop 2024-04-25T02:20:06.040 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.036+0000 7fabc3772700 1 -- 172.21.15.111:0/1583912967 shutdown_connections 2024-04-25T02:20:06.040 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.036+0000 7fabc3772700 1 --2- 172.21.15.111:0/1583912967 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fabbc067c20 0x7fabbc0925a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:06.040 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.036+0000 7fabc3772700 1 --2- 172.21.15.111:0/1583912967 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fabbc05c1a0 0x7fabbc096040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:06.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.036+0000 7fabc3772700 1 --2- 172.21.15.111:0/1583912967 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fabbc066170 0x7fabbc146570 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:06.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.036+0000 7fabc3772700 1 -- 172.21.15.111:0/1583912967 >> 172.21.15.111:0/1583912967 conn(0x7fabbc0a8a00 msgr2=0x7fabbc0a4580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:06.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.036+0000 7fabc3772700 1 -- 172.21.15.111:0/1583912967 shutdown_connections 2024-04-25T02:20:06.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.036+0000 7fabc3772700 1 -- 172.21.15.111:0/1583912967 wait complete. 2024-04-25T02:20:06.051 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph --cluster ceph osd new 93d54815-f215-4285-bba6-32f2d1cabf10 1 2024-04-25T02:20:06.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.150+0000 7f68616fc700 1 Processor -- start 2024-04-25T02:20:06.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.150+0000 7f68616fc700 1 -- start start 2024-04-25T02:20:06.156 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.150+0000 7f68616fc700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f685c05c020 0x7f685c061c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:06.156 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.150+0000 7f68616fc700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f685c05c7e0 0x7f685c13ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:06.156 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.150+0000 7f68616fc700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f685c0a7280 con 0x7f685c05c400 2024-04-25T02:20:06.156 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.150+0000 7f68616fc700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f685c0a7500 con 0x7f685c05c020 2024-04-25T02:20:06.156 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.150+0000 7f68616fc700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f685c067f10 con 0x7f685c05c7e0 2024-04-25T02:20:06.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.151+0000 7f685a7fc700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f685c05c400 0x7f685c0a6b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:49694/0 (socket says 172.21.15.111:49694) 2024-04-25T02:20:06.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.151+0000 7f685a7fc700 1 -- 172.21.15.111:0/796606498 learned_addr learned my addr 172.21.15.111:0/796606498 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:20:06.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.151+0000 7f685affd700 1 --2- 172.21.15.111:0/796606498 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f685c05c020 0x7f685c061c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:06.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.151+0000 7f685b7fe700 1 --2- 172.21.15.111:0/796606498 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f685c05c7e0 0x7f685c13ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:06.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.151+0000 7f6859ffb700 1 -- 172.21.15.111:0/796606498 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 937143553 0 0) 0x7f685c0a7280 con 0x7f685c05c400 2024-04-25T02:20:06.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.151+0000 7f6859ffb700 1 -- 172.21.15.111:0/796606498 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6840003260 con 0x7f685c05c400 2024-04-25T02:20:06.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.151+0000 7f685affd700 1 -- 172.21.15.111:0/796606498 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f685c05c7e0 msgr2=0x7f685c13ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:06.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.151+0000 7f685affd700 1 --2- 172.21.15.111:0/796606498 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f685c05c7e0 0x7f685c13ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:06.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.151+0000 7f685affd700 1 -- 172.21.15.111:0/796606498 >> v1:172.21.15.111:6789/0 conn(0x7f685c05c400 legacy=0x7f685c0a6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:06.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.151+0000 7f685affd700 1 -- 172.21.15.111:0/796606498 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f685c062130 con 0x7f685c05c020 2024-04-25T02:20:06.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.151+0000 7f685b7fe700 1 --2- 172.21.15.111:0/796606498 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f685c05c7e0 0x7f685c13ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:06.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.151+0000 7f685affd700 1 --2- 172.21.15.111:0/796606498 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f685c05c020 0x7f685c061c40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f684c002f70 tx=0x7f684c006df0).ready entity=mon.1 client_cookie=8f83b114dfb14dd3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:06.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.151+0000 7f6859ffb700 1 -- 172.21.15.111:0/796606498 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f684c00d570 con 0x7f685c05c020 2024-04-25T02:20:06.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.151+0000 7f6859ffb700 1 -- 172.21.15.111:0/796606498 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f684c000e90 con 0x7f685c05c020 2024-04-25T02:20:06.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.151+0000 7f6859ffb700 1 -- 172.21.15.111:0/796606498 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f684c00d8c0 con 0x7f685c05c020 2024-04-25T02:20:06.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.152+0000 7f68616fc700 1 -- 172.21.15.111:0/796606498 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f685c05c020 msgr2=0x7f685c061c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:06.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.152+0000 7f68616fc700 1 --2- 172.21.15.111:0/796606498 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f685c05c020 0x7f685c061c40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f684c002f70 tx=0x7f684c006df0).stop 2024-04-25T02:20:06.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.152+0000 7f68616fc700 1 -- 172.21.15.111:0/796606498 shutdown_connections 2024-04-25T02:20:06.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.152+0000 7f68616fc700 1 --2- 172.21.15.111:0/796606498 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f685c05c7e0 0x7f685c13ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:06.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.152+0000 7f68616fc700 1 --2- 172.21.15.111:0/796606498 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f685c05c020 0x7f685c061c40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:06.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.152+0000 7f68616fc700 1 -- 172.21.15.111:0/796606498 >> 172.21.15.111:0/796606498 conn(0x7f685c0a8a00 msgr2=0x7f685c0a8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:06.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.152+0000 7f68616fc700 1 -- 172.21.15.111:0/796606498 shutdown_connections 2024-04-25T02:20:06.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.152+0000 7f68616fc700 1 -- 172.21.15.111:0/796606498 wait complete. 2024-04-25T02:20:06.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.153+0000 7f68616fc700 1 Processor -- start 2024-04-25T02:20:06.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.153+0000 7f68616fc700 1 -- start start 2024-04-25T02:20:06.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.154+0000 7f68616fc700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f685c05c020 0x7f685c093780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:06.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.154+0000 7f68616fc700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f685c05c400 0x7f685c064a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:06.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.154+0000 7f68616fc700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f685c05c7e0 0x7f685c064ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:06.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.154+0000 7f68616fc700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f685c066bd0 con 0x7f685c05c020 2024-04-25T02:20:06.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.154+0000 7f68616fc700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f685c093280 con 0x7f685c05c7e0 2024-04-25T02:20:06.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.154+0000 7f68616fc700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f685c066e00 con 0x7f685c05c400 2024-04-25T02:20:06.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.154+0000 7f685affd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f685c05c020 0x7f685c093780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:06.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.154+0000 7f685b7fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f685c05c7e0 0x7f685c064ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:06.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.154+0000 7f685affd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f685c05c020 0x7f685c093780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:56216/0 (socket says 172.21.15.111:56216) 2024-04-25T02:20:06.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.154+0000 7f685affd700 1 -- 172.21.15.111:0/11752284 learned_addr learned my addr 172.21.15.111:0/11752284 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:06.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.154+0000 7f685a7fc700 1 --2- 172.21.15.111:0/11752284 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f685c05c400 0x7f685c064a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:06.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.154+0000 7f685b7fe700 1 -- 172.21.15.111:0/11752284 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f685c05c400 msgr2=0x7f685c064a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:06.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.154+0000 7f685b7fe700 1 --2- 172.21.15.111:0/11752284 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f685c05c400 0x7f685c064a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:06.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.154+0000 7f685b7fe700 1 -- 172.21.15.111:0/11752284 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f685c05c020 msgr2=0x7f685c093780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:06.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.154+0000 7f685b7fe700 1 --2- 172.21.15.111:0/11752284 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f685c05c020 0x7f685c093780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:06.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.154+0000 7f685b7fe700 1 -- 172.21.15.111:0/11752284 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6854009470 con 0x7f685c05c7e0 2024-04-25T02:20:06.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.154+0000 7f685b7fe700 1 --2- 172.21.15.111:0/11752284 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f685c05c7e0 0x7f685c064ef0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f685400c000 tx=0x7f68540091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:06.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.155+0000 7f684bfff700 1 -- 172.21.15.111:0/11752284 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6854013b80 con 0x7f685c05c7e0 2024-04-25T02:20:06.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.155+0000 7f68616fc700 1 -- 172.21.15.111:0/11752284 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f684c00b180 con 0x7f685c05c7e0 2024-04-25T02:20:06.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.155+0000 7f684bfff700 1 -- 172.21.15.111:0/11752284 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6854013ce0 con 0x7f685c05c7e0 2024-04-25T02:20:06.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.155+0000 7f684bfff700 1 -- 172.21.15.111:0/11752284 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f685401c660 con 0x7f685c05c7e0 2024-04-25T02:20:06.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.155+0000 7f68616fc700 1 -- 172.21.15.111:0/11752284 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f685c065da0 con 0x7f685c05c7e0 2024-04-25T02:20:06.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.155+0000 7f684bfff700 1 -- 172.21.15.111:0/11752284 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f685401c990 con 0x7f685c05c7e0 2024-04-25T02:20:06.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.155+0000 7f684bfff700 1 -- 172.21.15.111:0/11752284 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 836+0+0 (secure 0 0 0) 0x7f685401b790 con 0x7f685c05c7e0 2024-04-25T02:20:06.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.156+0000 7f68616fc700 1 -- 172.21.15.111:0/11752284 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f685c093e30 con 0x7f685c05c7e0 2024-04-25T02:20:06.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.160+0000 7f684bfff700 1 -- 172.21.15.111:0/11752284 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f6854021020 con 0x7f685c05c7e0 2024-04-25T02:20:06.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.234+0000 7f68616fc700 1 -- 172.21.15.111:0/11752284 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd new", "uuid": "93d54815-f215-4285-bba6-32f2d1cabf10", "id": 1} v 0) v1 -- 0x7f685c0a2e60 con 0x7f685c05c7e0 2024-04-25T02:20:06.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.242+0000 7f684bfff700 1 -- 172.21.15.111:0/11752284 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "93d54815-f215-4285-bba6-32f2d1cabf10", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f6854005a70 con 0x7f685c05c7e0 2024-04-25T02:20:06.246 INFO:teuthology.orchestra.run.smithi111.stdout:1 2024-04-25T02:20:06.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.243+0000 7f68616fc700 1 -- 172.21.15.111:0/11752284 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f685c05c7e0 msgr2=0x7f685c064ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:06.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.243+0000 7f68616fc700 1 --2- 172.21.15.111:0/11752284 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f685c05c7e0 0x7f685c064ef0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f685400c000 tx=0x7f68540091d0).stop 2024-04-25T02:20:06.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.243+0000 7f68616fc700 1 -- 172.21.15.111:0/11752284 shutdown_connections 2024-04-25T02:20:06.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.243+0000 7f68616fc700 1 --2- 172.21.15.111:0/11752284 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f685c05c7e0 0x7f685c064ef0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:06.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.243+0000 7f68616fc700 1 --2- 172.21.15.111:0/11752284 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f685c05c020 0x7f685c093780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:06.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.243+0000 7f68616fc700 1 --2- 172.21.15.111:0/11752284 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f685c05c400 0x7f685c064a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:06.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.243+0000 7f68616fc700 1 -- 172.21.15.111:0/11752284 >> 172.21.15.111:0/11752284 conn(0x7f685c0a8a00 msgr2=0x7f685c0a6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:06.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.243+0000 7f68616fc700 1 -- 172.21.15.111:0/11752284 shutdown_connections 2024-04-25T02:20:06.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.243+0000 7f68616fc700 1 -- 172.21.15.111:0/11752284 wait complete. 2024-04-25T02:20:06.257 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph --cluster ceph osd new b26b2104-2a2e-408f-9ce7-3587a32a2ebe 2 2024-04-25T02:20:06.362 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.358+0000 7f9d2b849700 1 Processor -- start 2024-04-25T02:20:06.362 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.358+0000 7f9d2b849700 1 -- start start 2024-04-25T02:20:06.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.359+0000 7f9d2b849700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9d2405c020 0x7f9d24061c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:06.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.359+0000 7f9d2b849700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9d2405c7e0 0x7f9d2413ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:06.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.359+0000 7f9d2b849700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d240a7280 con 0x7f9d2405c400 2024-04-25T02:20:06.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.359+0000 7f9d2b849700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d240a7500 con 0x7f9d2405c7e0 2024-04-25T02:20:06.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.359+0000 7f9d2b849700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d24067f10 con 0x7f9d2405c020 2024-04-25T02:20:06.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.359+0000 7f9d29de6700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9d2405c7e0 0x7f9d2413ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:06.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.359+0000 7f9d29de6700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9d2405c7e0 0x7f9d2413ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:56926/0 (socket says 172.21.15.111:56926) 2024-04-25T02:20:06.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.359+0000 7f9d295e5700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9d2405c020 0x7f9d24061c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:06.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.359+0000 7f9d29de6700 1 -- 172.21.15.111:0/1341446692 learned_addr learned my addr 172.21.15.111:0/1341446692 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:06.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.359+0000 7f9d295e5700 1 -- 172.21.15.111:0/1341446692 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9d2405c7e0 msgr2=0x7f9d2413ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:06.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.359+0000 7f9d295e5700 1 --2- 172.21.15.111:0/1341446692 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9d2405c7e0 0x7f9d2413ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:06.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.359+0000 7f9d295e5700 1 -- 172.21.15.111:0/1341446692 >> v1:172.21.15.111:6789/0 conn(0x7f9d2405c400 legacy=0x7f9d240a6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:06.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.359+0000 7f9d295e5700 1 -- 172.21.15.111:0/1341446692 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d24062130 con 0x7f9d2405c020 2024-04-25T02:20:06.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.359+0000 7f9d29de6700 1 --2- 172.21.15.111:0/1341446692 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9d2405c7e0 0x7f9d2413ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:06.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.359+0000 7f9d295e5700 1 --2- 172.21.15.111:0/1341446692 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9d2405c020 0x7f9d24061c40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f9d24061b90 tx=0x7f9d20006df0).ready entity=mon.2 client_cookie=57492ccbad14b71a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:06.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.360+0000 7f9d13fff700 1 -- 172.21.15.111:0/1341446692 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d2000d570 con 0x7f9d2405c020 2024-04-25T02:20:06.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.360+0000 7f9d13fff700 1 -- 172.21.15.111:0/1341446692 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d20000e90 con 0x7f9d2405c020 2024-04-25T02:20:06.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.360+0000 7f9d13fff700 1 -- 172.21.15.111:0/1341446692 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d2000d8c0 con 0x7f9d2405c020 2024-04-25T02:20:06.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.360+0000 7f9d2b849700 1 -- 172.21.15.111:0/1341446692 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9d2405c020 msgr2=0x7f9d24061c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:06.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.360+0000 7f9d2b849700 1 --2- 172.21.15.111:0/1341446692 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9d2405c020 0x7f9d24061c40 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f9d24061b90 tx=0x7f9d20006df0).stop 2024-04-25T02:20:06.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.360+0000 7f9d2b849700 1 -- 172.21.15.111:0/1341446692 shutdown_connections 2024-04-25T02:20:06.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.360+0000 7f9d2b849700 1 --2- 172.21.15.111:0/1341446692 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9d2405c020 0x7f9d24061c40 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:06.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.360+0000 7f9d2b849700 1 --2- 172.21.15.111:0/1341446692 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9d2405c7e0 0x7f9d2413ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:06.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.360+0000 7f9d2b849700 1 -- 172.21.15.111:0/1341446692 >> 172.21.15.111:0/1341446692 conn(0x7f9d240a8a00 msgr2=0x7f9d240a8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:06.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.360+0000 7f9d2b849700 1 -- 172.21.15.111:0/1341446692 shutdown_connections 2024-04-25T02:20:06.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.360+0000 7f9d2b849700 1 -- 172.21.15.111:0/1341446692 wait complete. 2024-04-25T02:20:06.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.361+0000 7f9d2b849700 1 Processor -- start 2024-04-25T02:20:06.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.361+0000 7f9d2b849700 1 -- start start 2024-04-25T02:20:06.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.362+0000 7f9d2b849700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9d2405c020 0x7f9d24093380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:06.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.362+0000 7f9d2b849700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9d2405c400 0x7f9d24095000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:06.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.362+0000 7f9d2b849700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d2405c7e0 0x7f9d240669f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:06.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.362+0000 7f9d2b849700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d24147e50 con 0x7f9d2405c7e0 2024-04-25T02:20:06.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.362+0000 7f9d2b849700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d24093a40 con 0x7f9d2405c020 2024-04-25T02:20:06.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.362+0000 7f9d2b849700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d24093d00 con 0x7f9d2405c400 2024-04-25T02:20:06.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.362+0000 7f9d295e5700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9d2405c020 0x7f9d24093380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:06.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.362+0000 7f9d28de4700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9d2405c400 0x7f9d24095000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:06.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.362+0000 7f9d295e5700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9d2405c020 0x7f9d24093380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:56940/0 (socket says 172.21.15.111:56940) 2024-04-25T02:20:06.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.362+0000 7f9d295e5700 1 -- 172.21.15.111:0/2872575052 learned_addr learned my addr 172.21.15.111:0/2872575052 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:06.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.362+0000 7f9d29de6700 1 --2- 172.21.15.111:0/2872575052 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d2405c7e0 0x7f9d240669f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:06.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.363+0000 7f9d295e5700 1 -- 172.21.15.111:0/2872575052 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9d2405c400 msgr2=0x7f9d24095000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:06.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.363+0000 7f9d295e5700 1 --2- 172.21.15.111:0/2872575052 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9d2405c400 0x7f9d24095000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:06.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.363+0000 7f9d295e5700 1 -- 172.21.15.111:0/2872575052 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d2405c7e0 msgr2=0x7f9d240669f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:06.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.363+0000 7f9d295e5700 1 --2- 172.21.15.111:0/2872575052 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d2405c7e0 0x7f9d240669f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:06.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.363+0000 7f9d295e5700 1 -- 172.21.15.111:0/2872575052 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d1c009530 con 0x7f9d2405c020 2024-04-25T02:20:06.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.363+0000 7f9d28de4700 1 --2- 172.21.15.111:0/2872575052 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9d2405c400 0x7f9d24095000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:06.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.363+0000 7f9d29de6700 1 --2- 172.21.15.111:0/2872575052 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d2405c7e0 0x7f9d240669f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:06.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.363+0000 7f9d295e5700 1 --2- 172.21.15.111:0/2872575052 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9d2405c020 0x7f9d24093380 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f9d24061b90 tx=0x7f9d20014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:06.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.363+0000 7f9d127fc700 1 -- 172.21.15.111:0/2872575052 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d20013de0 con 0x7f9d2405c020 2024-04-25T02:20:06.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.363+0000 7f9d127fc700 1 -- 172.21.15.111:0/2872575052 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d20002f70 con 0x7f9d2405c020 2024-04-25T02:20:06.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.363+0000 7f9d2b849700 1 -- 172.21.15.111:0/2872575052 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d2000b180 con 0x7f9d2405c020 2024-04-25T02:20:06.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.363+0000 7f9d127fc700 1 -- 172.21.15.111:0/2872575052 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9d2001e5f0 con 0x7f9d2405c020 2024-04-25T02:20:06.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.363+0000 7f9d2b849700 1 -- 172.21.15.111:0/2872575052 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d24141c30 con 0x7f9d2405c020 2024-04-25T02:20:06.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.363+0000 7f9d127fc700 1 -- 172.21.15.111:0/2872575052 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f9d20025030 con 0x7f9d2405c020 2024-04-25T02:20:06.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.363+0000 7f9d127fc700 1 -- 172.21.15.111:0/2872575052 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 951+0+0 (secure 0 0 0) 0x7f9d2001e920 con 0x7f9d2405c020 2024-04-25T02:20:06.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.364+0000 7f9d2b849700 1 -- 172.21.15.111:0/2872575052 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d240a2e60 con 0x7f9d2405c020 2024-04-25T02:20:06.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.366+0000 7f9d127fc700 1 -- 172.21.15.111:0/2872575052 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f9d20023070 con 0x7f9d2405c020 2024-04-25T02:20:06.446 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.442+0000 7f9d2b849700 1 -- 172.21.15.111:0/2872575052 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd new", "uuid": "b26b2104-2a2e-408f-9ce7-3587a32a2ebe", "id": 2} v 0) v1 -- 0x7f9d24057a60 con 0x7f9d2405c020 2024-04-25T02:20:06.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.450+0000 7f9d127fc700 1 -- 172.21.15.111:0/2872575052 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "b26b2104-2a2e-408f-9ce7-3587a32a2ebe", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f9d20019030 con 0x7f9d2405c020 2024-04-25T02:20:06.454 INFO:teuthology.orchestra.run.smithi111.stdout:2 2024-04-25T02:20:06.455 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.451+0000 7f9d2b849700 1 -- 172.21.15.111:0/2872575052 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9d2405c020 msgr2=0x7f9d24093380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:06.455 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.451+0000 7f9d2b849700 1 --2- 172.21.15.111:0/2872575052 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9d2405c020 0x7f9d24093380 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f9d24061b90 tx=0x7f9d20014000).stop 2024-04-25T02:20:06.455 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.451+0000 7f9d2b849700 1 -- 172.21.15.111:0/2872575052 shutdown_connections 2024-04-25T02:20:06.456 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.451+0000 7f9d2b849700 1 --2- 172.21.15.111:0/2872575052 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d2405c7e0 0x7f9d240669f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:06.456 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.451+0000 7f9d2b849700 1 --2- 172.21.15.111:0/2872575052 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9d2405c020 0x7f9d24093380 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:06.456 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.451+0000 7f9d2b849700 1 --2- 172.21.15.111:0/2872575052 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9d2405c400 0x7f9d24095000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:06.456 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.451+0000 7f9d2b849700 1 -- 172.21.15.111:0/2872575052 >> 172.21.15.111:0/2872575052 conn(0x7f9d240a8a00 msgr2=0x7f9d2406ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:06.456 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.451+0000 7f9d2b849700 1 -- 172.21.15.111:0/2872575052 shutdown_connections 2024-04-25T02:20:06.456 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.451+0000 7f9d2b849700 1 -- 172.21.15.111:0/2872575052 wait complete. 2024-04-25T02:20:06.467 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph --cluster ceph osd new 43c25820-1edc-4031-badf-72e87dd6bf15 3 2024-04-25T02:20:06.569 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.565+0000 7f4c779c9700 1 Processor -- start 2024-04-25T02:20:06.569 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.565+0000 7f4c779c9700 1 -- start start 2024-04-25T02:20:06.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.565+0000 7f4c779c9700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f4c70137a10 0x7f4c70137df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:06.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.565+0000 7f4c779c9700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4c70064380 0x7f4c700a98b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:06.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.565+0000 7f4c779c9700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4c700a9da0 0x7f4c7005ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:06.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.565+0000 7f4c779c9700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c701373c0 con 0x7f4c70137a10 2024-04-25T02:20:06.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.565+0000 7f4c779c9700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c701382e0 con 0x7f4c70064380 2024-04-25T02:20:06.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.565+0000 7f4c779c9700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c70064b60 con 0x7f4c700a9da0 2024-04-25T02:20:06.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.566+0000 7f4c75765700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f4c70137a10 0x7f4c70137df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:06.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.566+0000 7f4c75f66700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4c700a9da0 0x7f4c7005ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:06.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.566+0000 7f4c75765700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f4c70137a10 0x7f4c70137df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:56220/0 (socket says 172.21.15.111:56220) 2024-04-25T02:20:06.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.566+0000 7f4c75765700 1 -- 172.21.15.111:0/3436354497 learned_addr learned my addr 172.21.15.111:0/3436354497 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:06.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.566+0000 7f4c74f64700 1 --2- 172.21.15.111:0/3436354497 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4c70064380 0x7f4c700a98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:06.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.566+0000 7f4c75765700 1 -- 172.21.15.111:0/3436354497 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4c700a9da0 msgr2=0x7f4c7005ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:06.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.566+0000 7f4c75765700 1 --2- 172.21.15.111:0/3436354497 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4c700a9da0 0x7f4c7005ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:06.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.566+0000 7f4c75765700 1 -- 172.21.15.111:0/3436354497 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4c70064380 msgr2=0x7f4c700a98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:06.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.566+0000 7f4c75765700 1 --2- 172.21.15.111:0/3436354497 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4c70064380 0x7f4c700a98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:06.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.566+0000 7f4c75765700 1 -- 172.21.15.111:0/3436354497 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c701375e0 con 0x7f4c70137a10 2024-04-25T02:20:06.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.566+0000 7f4c75f66700 1 --2- 172.21.15.111:0/3436354497 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4c700a9da0 0x7f4c7005ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:06.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.566+0000 7f4c74f64700 1 --2- 172.21.15.111:0/3436354497 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4c70064380 0x7f4c700a98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:06.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.566+0000 7f4c75765700 1 --2- 172.21.15.111:0/3436354497 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4c70137a10 0x7f4c70137df0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f4c6c002f70 tx=0x7f4c6c006eb0).ready entity=mon.0 client_cookie=d86f75de998c5c50 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:06.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.566+0000 7f4c5ffff700 1 -- 172.21.15.111:0/3436354497 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c6c00d570 con 0x7f4c70137a10 2024-04-25T02:20:06.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.566+0000 7f4c5ffff700 1 -- 172.21.15.111:0/3436354497 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c6c000e90 con 0x7f4c70137a10 2024-04-25T02:20:06.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.566+0000 7f4c5ffff700 1 -- 172.21.15.111:0/3436354497 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c6c00d8c0 con 0x7f4c70137a10 2024-04-25T02:20:06.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.567+0000 7f4c779c9700 1 -- 172.21.15.111:0/3436354497 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4c70137a10 msgr2=0x7f4c70137df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:06.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.567+0000 7f4c779c9700 1 --2- 172.21.15.111:0/3436354497 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4c70137a10 0x7f4c70137df0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f4c6c002f70 tx=0x7f4c6c006eb0).stop 2024-04-25T02:20:06.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.567+0000 7f4c779c9700 1 -- 172.21.15.111:0/3436354497 shutdown_connections 2024-04-25T02:20:06.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.567+0000 7f4c779c9700 1 --2- 172.21.15.111:0/3436354497 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4c700a9da0 0x7f4c7005ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:06.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.567+0000 7f4c779c9700 1 --2- 172.21.15.111:0/3436354497 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4c70137a10 0x7f4c70137df0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:06.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.567+0000 7f4c779c9700 1 --2- 172.21.15.111:0/3436354497 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4c70064380 0x7f4c700a98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:06.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.567+0000 7f4c779c9700 1 -- 172.21.15.111:0/3436354497 >> 172.21.15.111:0/3436354497 conn(0x7f4c700614e0 msgr2=0x7f4c7006c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:06.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.567+0000 7f4c779c9700 1 -- 172.21.15.111:0/3436354497 shutdown_connections 2024-04-25T02:20:06.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.567+0000 7f4c779c9700 1 -- 172.21.15.111:0/3436354497 wait complete. 2024-04-25T02:20:06.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.568+0000 7f4c779c9700 1 Processor -- start 2024-04-25T02:20:06.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.568+0000 7f4c779c9700 1 -- start start 2024-04-25T02:20:06.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.569+0000 7f4c779c9700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4c70064380 0x7f4c70093ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:06.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.569+0000 7f4c779c9700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4c700a9da0 0x7f4c700928d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:06.578 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.569+0000 7f4c779c9700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4c70137a10 0x7f4c70144940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:06.578 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.569+0000 7f4c779c9700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c700937a0 con 0x7f4c700a9da0 2024-04-25T02:20:06.578 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.569+0000 7f4c779c9700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c701446e0 con 0x7f4c70137a10 2024-04-25T02:20:06.578 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.569+0000 7f4c779c9700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c70133b40 con 0x7f4c70064380 2024-04-25T02:20:06.578 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.569+0000 7f4c75765700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4c70064380 0x7f4c70093ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:06.578 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.569+0000 7f4c75765700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4c70064380 0x7f4c70093ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:43008/0 (socket says 172.21.15.111:43008) 2024-04-25T02:20:06.578 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.569+0000 7f4c75765700 1 -- 172.21.15.111:0/3849044869 learned_addr learned my addr 172.21.15.111:0/3849044869 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:06.578 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.569+0000 7f4c75f66700 1 --2- 172.21.15.111:0/3849044869 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4c70137a10 0x7f4c70144940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:06.578 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.569+0000 7f4c74f64700 1 --2- 172.21.15.111:0/3849044869 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4c700a9da0 0x7f4c700928d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:06.578 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.569+0000 7f4c75765700 1 -- 172.21.15.111:0/3849044869 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4c70137a10 msgr2=0x7f4c70144940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:06.578 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.569+0000 7f4c75765700 1 --2- 172.21.15.111:0/3849044869 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4c70137a10 0x7f4c70144940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:06.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.569+0000 7f4c75765700 1 -- 172.21.15.111:0/3849044869 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4c700a9da0 msgr2=0x7f4c700928d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:06.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.569+0000 7f4c75765700 1 --2- 172.21.15.111:0/3849044869 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4c700a9da0 0x7f4c700928d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:06.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.569+0000 7f4c75765700 1 -- 172.21.15.111:0/3849044869 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c6000b180 con 0x7f4c70064380 2024-04-25T02:20:06.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.569+0000 7f4c75765700 1 --2- 172.21.15.111:0/3849044869 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4c70064380 0x7f4c70093ca0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f4c6c002f70 tx=0x7f4c6c015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:06.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.569+0000 7f4c5e7fc700 1 -- 172.21.15.111:0/3849044869 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c6c011b00 con 0x7f4c70064380 2024-04-25T02:20:06.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.570+0000 7f4c5e7fc700 1 -- 172.21.15.111:0/3849044869 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c6c011c60 con 0x7f4c70064380 2024-04-25T02:20:06.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.570+0000 7f4c779c9700 1 -- 172.21.15.111:0/3849044869 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c6800d910 con 0x7f4c70064380 2024-04-25T02:20:06.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.570+0000 7f4c5e7fc700 1 -- 172.21.15.111:0/3849044869 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4c6c01e460 con 0x7f4c70064380 2024-04-25T02:20:06.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.570+0000 7f4c779c9700 1 -- 172.21.15.111:0/3849044869 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c6c00b1e0 con 0x7f4c70064380 2024-04-25T02:20:06.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.570+0000 7f4c5e7fc700 1 -- 172.21.15.111:0/3849044869 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f4c6c025030 con 0x7f4c70064380 2024-04-25T02:20:06.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.570+0000 7f4c5e7fc700 1 -- 172.21.15.111:0/3849044869 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1066+0+0 (secure 0 0 0) 0x7f4c6c01e790 con 0x7f4c70064380 2024-04-25T02:20:06.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.571+0000 7f4c779c9700 1 -- 172.21.15.111:0/3849044869 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c70065870 con 0x7f4c70064380 2024-04-25T02:20:06.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.573+0000 7f4c5e7fc700 1 -- 172.21.15.111:0/3849044869 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f4c6c023070 con 0x7f4c70064380 2024-04-25T02:20:06.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.647+0000 7f4c779c9700 1 -- 172.21.15.111:0/3849044869 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "osd new", "uuid": "43c25820-1edc-4031-badf-72e87dd6bf15", "id": 3} v 0) v1 -- 0x7f4c700a8e80 con 0x7f4c70064380 2024-04-25T02:20:06.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.658+0000 7f4c5e7fc700 1 -- 172.21.15.111:0/3849044869 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "43c25820-1edc-4031-badf-72e87dd6bf15", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f4c6c028440 con 0x7f4c70064380 2024-04-25T02:20:06.662 INFO:teuthology.orchestra.run.smithi111.stdout:3 2024-04-25T02:20:06.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.659+0000 7f4c779c9700 1 -- 172.21.15.111:0/3849044869 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4c70064380 msgr2=0x7f4c70093ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:06.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.659+0000 7f4c779c9700 1 --2- 172.21.15.111:0/3849044869 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4c70064380 0x7f4c70093ca0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f4c6c002f70 tx=0x7f4c6c015000).stop 2024-04-25T02:20:06.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.659+0000 7f4c779c9700 1 -- 172.21.15.111:0/3849044869 shutdown_connections 2024-04-25T02:20:06.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.659+0000 7f4c779c9700 1 --2- 172.21.15.111:0/3849044869 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4c70137a10 0x7f4c70144940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:06.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.659+0000 7f4c779c9700 1 --2- 172.21.15.111:0/3849044869 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4c70064380 0x7f4c70093ca0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:06.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.659+0000 7f4c779c9700 1 --2- 172.21.15.111:0/3849044869 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4c700a9da0 0x7f4c700928d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:06.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.659+0000 7f4c779c9700 1 -- 172.21.15.111:0/3849044869 >> 172.21.15.111:0/3849044869 conn(0x7f4c700614e0 msgr2=0x7f4c70135e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:06.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.659+0000 7f4c779c9700 1 -- 172.21.15.111:0/3849044869 shutdown_connections 2024-04-25T02:20:06.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.659+0000 7f4c779c9700 1 -- 172.21.15.111:0/3849044869 wait complete. 2024-04-25T02:20:06.674 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-25T02:20:06.674 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-25T02:20:06.676 INFO:tasks.ceph.osd.0:Started 2024-04-25T02:20:06.677 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-25T02:20:06.677 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-25T02:20:06.679 INFO:tasks.ceph.osd.1:Started 2024-04-25T02:20:06.679 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-25T02:20:06.679 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-25T02:20:06.681 INFO:tasks.ceph.osd.2:Started 2024-04-25T02:20:06.681 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-25T02:20:06.681 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-25T02:20:06.683 INFO:tasks.ceph.osd.3:Started 2024-04-25T02:20:06.684 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:20:06.856 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.852+0000 7f2b21eaa700 1 Processor -- start 2024-04-25T02:20:06.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.852+0000 7f2b21eaa700 1 -- start start 2024-04-25T02:20:06.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.853+0000 7f2b21eaa700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f2b1c0a6810 0x7f2b1c0a24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:06.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.853+0000 7f2b21eaa700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2b1c0a6bf0 0x7f2b1c0a7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:06.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.853+0000 7f2b21eaa700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b1c0a18e0 con 0x7f2b1c0a7500 2024-04-25T02:20:06.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.853+0000 7f2b21eaa700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b1c0a13e0 con 0x7f2b1c0a6810 2024-04-25T02:20:06.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.853+0000 7f2b21eaa700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c0a7ce0 con 0x7f2b1c0a6bf0 2024-04-25T02:20:06.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.853+0000 7f2b1affd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2b1c0a6bf0 0x7f2b1c0a7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:06.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.853+0000 7f2b1b7fe700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f2b1c0a6810 0x7f2b1c0a24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:06.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.853+0000 7f2b1bfff700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f2b1c0a7500 0x7f2b1c136210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:49708/0 (socket says 172.21.15.111:49708) 2024-04-25T02:20:06.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.853+0000 7f2b1bfff700 1 -- 172.21.15.111:0/1360638650 learned_addr learned my addr 172.21.15.111:0/1360638650 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:20:06.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.853+0000 7f2b1b7fe700 1 -- 172.21.15.111:0/1360638650 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2b1c0a6bf0 msgr2=0x7f2b1c0a7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:06.860 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.853+0000 7f2b1b7fe700 1 --2- 172.21.15.111:0/1360638650 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2b1c0a6bf0 0x7f2b1c0a7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:06.860 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.853+0000 7f2b1b7fe700 1 -- 172.21.15.111:0/1360638650 >> v1:172.21.15.111:6789/0 conn(0x7f2b1c0a7500 legacy=0x7f2b1c136210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:06.860 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.853+0000 7f2b1a7fc700 1 -- 172.21.15.111:0/1360638650 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3488604493 0 0) 0x7f2b1c0a18e0 con 0x7f2b1c0a7500 2024-04-25T02:20:06.860 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.853+0000 7f2b1b7fe700 1 -- 172.21.15.111:0/1360638650 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b1c0a1b30 con 0x7f2b1c0a6810 2024-04-25T02:20:06.860 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.853+0000 7f2b1affd700 1 --2- 172.21.15.111:0/1360638650 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2b1c0a6bf0 0x7f2b1c0a7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:06.860 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.853+0000 7f2b1b7fe700 1 --2- 172.21.15.111:0/1360638650 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b1c0a6810 0x7f2b1c0a24c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f2b0c002f70 tx=0x7f2b0c006e80).ready entity=mon.0 client_cookie=9ba2c0a045a03b15 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:06.860 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.854+0000 7f2b1a7fc700 1 -- 172.21.15.111:0/1360638650 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b0c00b7d0 con 0x7f2b1c0a6810 2024-04-25T02:20:06.860 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.854+0000 7f2b1a7fc700 1 -- 172.21.15.111:0/1360638650 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b0c00b930 con 0x7f2b1c0a6810 2024-04-25T02:20:06.860 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.854+0000 7f2b1a7fc700 1 -- 172.21.15.111:0/1360638650 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b0c00bc90 con 0x7f2b1c0a6810 2024-04-25T02:20:06.860 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.854+0000 7f2b21eaa700 1 -- 172.21.15.111:0/1360638650 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b1c0a6810 msgr2=0x7f2b1c0a24c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:06.860 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.854+0000 7f2b21eaa700 1 --2- 172.21.15.111:0/1360638650 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b1c0a6810 0x7f2b1c0a24c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f2b0c002f70 tx=0x7f2b0c006e80).stop 2024-04-25T02:20:06.860 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.854+0000 7f2b21eaa700 1 -- 172.21.15.111:0/1360638650 shutdown_connections 2024-04-25T02:20:06.860 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.854+0000 7f2b21eaa700 1 --2- 172.21.15.111:0/1360638650 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b1c0a6810 0x7f2b1c0a24c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:06.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.854+0000 7f2b21eaa700 1 --2- 172.21.15.111:0/1360638650 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2b1c0a6bf0 0x7f2b1c0a7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:06.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.854+0000 7f2b21eaa700 1 -- 172.21.15.111:0/1360638650 >> 172.21.15.111:0/1360638650 conn(0x7f2b1c0a8a00 msgr2=0x7f2b1c0a8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:06.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.855+0000 7f2b21eaa700 1 -- 172.21.15.111:0/1360638650 shutdown_connections 2024-04-25T02:20:06.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.855+0000 7f2b21eaa700 1 -- 172.21.15.111:0/1360638650 wait complete. 2024-04-25T02:20:06.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.855+0000 7f2b21eaa700 1 Processor -- start 2024-04-25T02:20:06.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.856+0000 7f2b21eaa700 1 -- start start 2024-04-25T02:20:06.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.856+0000 7f2b21eaa700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2b1c0a6810 0x7f2b1c096b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:06.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.856+0000 7f2b21eaa700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b1c0a6bf0 0x7f2b1c145740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:06.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.856+0000 7f2b21eaa700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2b1c0a7500 0x7f2b1c145c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:06.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.856+0000 7f2b21eaa700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c143170 con 0x7f2b1c0a6bf0 2024-04-25T02:20:06.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.856+0000 7f2b21eaa700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c097920 con 0x7f2b1c0a7500 2024-04-25T02:20:06.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.856+0000 7f2b21eaa700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b1c0966f0 con 0x7f2b1c0a6810 2024-04-25T02:20:06.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.856+0000 7f2b1affd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b1c0a6bf0 0x7f2b1c145740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:06.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.856+0000 7f2b1affd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b1c0a6bf0 0x7f2b1c145740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:56292/0 (socket says 172.21.15.111:56292) 2024-04-25T02:20:06.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.856+0000 7f2b1affd700 1 -- 172.21.15.111:0/468113004 learned_addr learned my addr 172.21.15.111:0/468113004 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:06.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.856+0000 7f2b1bfff700 1 --2- 172.21.15.111:0/468113004 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2b1c0a7500 0x7f2b1c145c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:06.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.856+0000 7f2b1b7fe700 1 --2- 172.21.15.111:0/468113004 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2b1c0a6810 0x7f2b1c096b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:06.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.857+0000 7f2b1affd700 1 -- 172.21.15.111:0/468113004 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2b1c0a6810 msgr2=0x7f2b1c096b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:06.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.857+0000 7f2b1affd700 1 --2- 172.21.15.111:0/468113004 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2b1c0a6810 0x7f2b1c096b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:06.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.857+0000 7f2b1affd700 1 -- 172.21.15.111:0/468113004 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2b1c0a7500 msgr2=0x7f2b1c145c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:06.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.857+0000 7f2b1affd700 1 --2- 172.21.15.111:0/468113004 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2b1c0a7500 0x7f2b1c145c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:06.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.857+0000 7f2b1affd700 1 -- 172.21.15.111:0/468113004 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b1000b180 con 0x7f2b1c0a6bf0 2024-04-25T02:20:06.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.857+0000 7f2b1affd700 1 --2- 172.21.15.111:0/468113004 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b1c0a6bf0 0x7f2b1c145740 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f2b1000c000 tx=0x7f2b10006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:06.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.857+0000 7f2b18ff9700 1 -- 172.21.15.111:0/468113004 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b1000c7e0 con 0x7f2b1c0a6bf0 2024-04-25T02:20:06.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.857+0000 7f2b18ff9700 1 -- 172.21.15.111:0/468113004 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b1000c940 con 0x7f2b1c0a6bf0 2024-04-25T02:20:06.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.857+0000 7f2b18ff9700 1 -- 172.21.15.111:0/468113004 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2b1000cca0 con 0x7f2b1c0a6bf0 2024-04-25T02:20:06.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.857+0000 7f2b21eaa700 1 -- 172.21.15.111:0/468113004 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b0c00d410 con 0x7f2b1c0a6bf0 2024-04-25T02:20:06.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.857+0000 7f2b21eaa700 1 -- 172.21.15.111:0/468113004 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b1c145500 con 0x7f2b1c0a6bf0 2024-04-25T02:20:06.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.857+0000 7f2b18ff9700 1 -- 172.21.15.111:0/468113004 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 1) v1 ==== 345+0+0 (secure 0 0 0) 0x7f2b1001c460 con 0x7f2b1c0a6bf0 2024-04-25T02:20:06.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.857+0000 7f2b18ff9700 1 -- 172.21.15.111:0/468113004 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7f2b1001c6f0 con 0x7f2b1c0a6bf0 2024-04-25T02:20:06.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.858+0000 7f2b21eaa700 1 -- 172.21.15.111:0/468113004 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b1c09fb50 con 0x7f2b1c0a6bf0 2024-04-25T02:20:06.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.862+0000 7f2b18ff9700 1 -- 172.21.15.111:0/468113004 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7f2b1c145500 con 0x7f2b1c0a6bf0 2024-04-25T02:20:06.930 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.924+0000 7f2b21eaa700 1 -- 172.21.15.111:0/468113004 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b1c057a60 con 0x7f2b1c0a6bf0 2024-04-25T02:20:06.930 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.924+0000 7f2b18ff9700 1 -- 172.21.15.111:0/468113004 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+3913 (secure 0 0 0) 0x7f2b1001cb50 con 0x7f2b1c0a6bf0 2024-04-25T02:20:06.930 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:20:06.930 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":6,"fsid":"4643f974-f93a-4436-93b8-460ff320e62e","created":"2024-04-25T02:20:05.450475+0000","modified":"2024-04-25T02:20:06.649522+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"df3f17ca-3b12-42c8-8cf7-8f1b7189e587","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"93d54815-f215-4285-bba6-32f2d1cabf10","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b26b2104-2a2e-408f-9ce7-3587a32a2ebe","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"43c25820-1edc-4031-badf-72e87dd6bf15","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-25T02:20:06.931 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.925+0000 7f2b21eaa700 1 -- 172.21.15.111:0/468113004 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b1c0a6bf0 msgr2=0x7f2b1c145740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:06.931 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.925+0000 7f2b21eaa700 1 --2- 172.21.15.111:0/468113004 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b1c0a6bf0 0x7f2b1c145740 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f2b1000c000 tx=0x7f2b10006df0).stop 2024-04-25T02:20:06.931 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.925+0000 7f2b21eaa700 1 -- 172.21.15.111:0/468113004 shutdown_connections 2024-04-25T02:20:06.931 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.925+0000 7f2b21eaa700 1 --2- 172.21.15.111:0/468113004 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2b1c0a7500 0x7f2b1c145c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:06.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.925+0000 7f2b21eaa700 1 --2- 172.21.15.111:0/468113004 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2b1c0a6810 0x7f2b1c096b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:06.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.925+0000 7f2b21eaa700 1 --2- 172.21.15.111:0/468113004 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b1c0a6bf0 0x7f2b1c145740 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:06.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.925+0000 7f2b21eaa700 1 -- 172.21.15.111:0/468113004 >> 172.21.15.111:0/468113004 conn(0x7f2b1c0a8a00 msgr2=0x7f2b1c06ac80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:06.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.925+0000 7f2b21eaa700 1 -- 172.21.15.111:0/468113004 shutdown_connections 2024-04-25T02:20:06.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:06.925+0000 7f2b21eaa700 1 -- 172.21.15.111:0/468113004 wait complete. 2024-04-25T02:20:06.940 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-25T02:20:06.940 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-25T02:20:07.303 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-25T02:20:07.299+0000 7fa678acff00 -1 Falling back to public interface 2024-04-25T02:20:07.304 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-25T02:20:07.301+0000 7f80a45aef00 -1 Falling back to public interface 2024-04-25T02:20:07.309 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-25T02:20:07.305+0000 7fe53f1b3f00 -1 Falling back to public interface 2024-04-25T02:20:07.313 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-25T02:20:07.309+0000 7f163891ef00 -1 Falling back to public interface 2024-04-25T02:20:07.344 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T02:20:07.442 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.437+0000 7fd14c252700 1 Processor -- start 2024-04-25T02:20:07.442 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.438+0000 7fd14c252700 1 -- start start 2024-04-25T02:20:07.444 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.438+0000 7fd14c252700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fd144139eb0 0x7fd1440a9d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:07.444 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.438+0000 7fd14c252700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd14413a290 0x7fd14405c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:07.444 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.438+0000 7fd14c252700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd144096d70 con 0x7fd144097980 2024-04-25T02:20:07.444 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.438+0000 7fd14c252700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd144099650 con 0x7fd144139eb0 2024-04-25T02:20:07.444 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.438+0000 7fd14c252700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1441399d0 con 0x7fd14413a290 2024-04-25T02:20:07.444 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.438+0000 7fd14a7ef700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd14413a290 0x7fd14405c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:07.444 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.438+0000 7fd149fee700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fd144139eb0 0x7fd1440a9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:07.444 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.438+0000 7fd149fee700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fd144139eb0 0x7fd1440a9d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:56302/0 (socket says 172.21.15.111:56302) 2024-04-25T02:20:07.445 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.438+0000 7fd14a7ef700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd14413a290 0x7fd14405c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:57008/0 (socket says 172.21.15.111:57008) 2024-04-25T02:20:07.445 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.439+0000 7fd149fee700 1 -- 172.21.15.111:0/2604940875 learned_addr learned my addr 172.21.15.111:0/2604940875 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:07.445 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.439+0000 7fd149fee700 1 -- 172.21.15.111:0/2604940875 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd14413a290 msgr2=0x7fd14405c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:07.445 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.439+0000 7fd149fee700 1 --2- 172.21.15.111:0/2604940875 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd14413a290 0x7fd14405c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:07.445 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.439+0000 7fd149fee700 1 -- 172.21.15.111:0/2604940875 >> v1:172.21.15.111:6789/0 conn(0x7fd144097980 legacy=0x7fd14405ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:07.445 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.439+0000 7fd149fee700 1 -- 172.21.15.111:0/2604940875 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd144139c90 con 0x7fd144139eb0 2024-04-25T02:20:07.445 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.439+0000 7fd14a7ef700 1 --2- 172.21.15.111:0/2604940875 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd14413a290 0x7fd14405c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:07.445 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.439+0000 7fd149fee700 1 --2- 172.21.15.111:0/2604940875 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd144139eb0 0x7fd1440a9d70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fd140002f70 tx=0x7fd140006eb0).ready entity=mon.0 client_cookie=e9e1f069b9593d09 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:07.445 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.439+0000 7fd148fec700 1 -- 172.21.15.111:0/2604940875 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd14000d570 con 0x7fd144139eb0 2024-04-25T02:20:07.445 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.439+0000 7fd148fec700 1 -- 172.21.15.111:0/2604940875 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd140000e90 con 0x7fd144139eb0 2024-04-25T02:20:07.445 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.439+0000 7fd148fec700 1 -- 172.21.15.111:0/2604940875 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd14000d900 con 0x7fd144139eb0 2024-04-25T02:20:07.445 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.440+0000 7fd14c252700 1 -- 172.21.15.111:0/2604940875 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd144139eb0 msgr2=0x7fd1440a9d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:07.445 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.440+0000 7fd14c252700 1 --2- 172.21.15.111:0/2604940875 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd144139eb0 0x7fd1440a9d70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fd140002f70 tx=0x7fd140006eb0).stop 2024-04-25T02:20:07.446 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.440+0000 7fd14c252700 1 -- 172.21.15.111:0/2604940875 shutdown_connections 2024-04-25T02:20:07.446 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.440+0000 7fd14c252700 1 --2- 172.21.15.111:0/2604940875 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd144139eb0 0x7fd1440a9d70 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:07.446 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.440+0000 7fd14c252700 1 --2- 172.21.15.111:0/2604940875 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd14413a290 0x7fd14405c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:07.446 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.440+0000 7fd14c252700 1 -- 172.21.15.111:0/2604940875 >> 172.21.15.111:0/2604940875 conn(0x7fd1440614c0 msgr2=0x7fd14406c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:07.446 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.440+0000 7fd14c252700 1 -- 172.21.15.111:0/2604940875 shutdown_connections 2024-04-25T02:20:07.446 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.440+0000 7fd14c252700 1 -- 172.21.15.111:0/2604940875 wait complete. 2024-04-25T02:20:07.448 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.441+0000 7fd14c252700 1 Processor -- start 2024-04-25T02:20:07.448 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.441+0000 7fd14c252700 1 -- start start 2024-04-25T02:20:07.448 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.441+0000 7fd14c252700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd144097980 0x7fd1441468f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:07.449 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.441+0000 7fd14c252700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd144139eb0 0x7fd14409cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:07.449 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.441+0000 7fd14c252700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd14413a290 0x7fd144066a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:07.449 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.441+0000 7fd14c252700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd144067a80 con 0x7fd14413a290 2024-04-25T02:20:07.449 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.441+0000 7fd14c252700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd144146290 con 0x7fd144097980 2024-04-25T02:20:07.449 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.441+0000 7fd14c252700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd144146460 con 0x7fd144139eb0 2024-04-25T02:20:07.449 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.441+0000 7fd149fee700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd144097980 0x7fd1441468f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:07.449 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.441+0000 7fd14a7ef700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd14413a290 0x7fd144066a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:07.449 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.441+0000 7fd1497ed700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd144139eb0 0x7fd14409cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:07.449 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.441+0000 7fd14a7ef700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd14413a290 0x7fd144066a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:56316/0 (socket says 172.21.15.111:56316) 2024-04-25T02:20:07.449 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.441+0000 7fd149fee700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd144097980 0x7fd1441468f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:57014/0 (socket says 172.21.15.111:57014) 2024-04-25T02:20:07.449 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.441+0000 7fd14a7ef700 1 -- 172.21.15.111:0/2723259344 learned_addr learned my addr 172.21.15.111:0/2723259344 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:07.449 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.442+0000 7fd14a7ef700 1 -- 172.21.15.111:0/2723259344 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd144139eb0 msgr2=0x7fd14409cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:07.449 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.442+0000 7fd14a7ef700 1 --2- 172.21.15.111:0/2723259344 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd144139eb0 0x7fd14409cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:07.450 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.442+0000 7fd14a7ef700 1 -- 172.21.15.111:0/2723259344 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd144097980 msgr2=0x7fd1441468f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:07.450 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.442+0000 7fd14a7ef700 1 --2- 172.21.15.111:0/2723259344 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd144097980 0x7fd1441468f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:07.450 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.442+0000 7fd14a7ef700 1 -- 172.21.15.111:0/2723259344 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd13c009470 con 0x7fd14413a290 2024-04-25T02:20:07.450 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.442+0000 7fd149fee700 1 --2- 172.21.15.111:0/2723259344 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd144097980 0x7fd1441468f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:07.450 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.442+0000 7fd1497ed700 1 --2- 172.21.15.111:0/2723259344 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd144139eb0 0x7fd14409cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:07.450 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.442+0000 7fd14a7ef700 1 --2- 172.21.15.111:0/2723259344 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd14413a290 0x7fd144066a60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fd13c00c000 tx=0x7fd13c0091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:07.450 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.442+0000 7fd132ffd700 1 -- 172.21.15.111:0/2723259344 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd13c0096b0 con 0x7fd14413a290 2024-04-25T02:20:07.450 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.442+0000 7fd132ffd700 1 -- 172.21.15.111:0/2723259344 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd13c00c6a0 con 0x7fd14413a290 2024-04-25T02:20:07.450 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.442+0000 7fd14c252700 1 -- 172.21.15.111:0/2723259344 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd14000b1e0 con 0x7fd14413a290 2024-04-25T02:20:07.450 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.442+0000 7fd132ffd700 1 -- 172.21.15.111:0/2723259344 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd13c00ca00 con 0x7fd14413a290 2024-04-25T02:20:07.450 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.442+0000 7fd14c252700 1 -- 172.21.15.111:0/2723259344 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd144064e80 con 0x7fd14413a290 2024-04-25T02:20:07.450 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.443+0000 7fd132ffd700 1 -- 172.21.15.111:0/2723259344 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 2) v1 ==== 20942+0+0 (secure 0 0 0) 0x7fd13c022070 con 0x7fd14413a290 2024-04-25T02:20:07.450 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.443+0000 7fd132ffd700 1 -- 172.21.15.111:0/2723259344 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1181+0+0 (secure 0 0 0) 0x7fd13c02a370 con 0x7fd14413a290 2024-04-25T02:20:07.450 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.443+0000 7fd14c252700 1 -- 172.21.15.111:0/2723259344 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1441465d0 con 0x7fd14413a290 2024-04-25T02:20:07.451 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.445+0000 7fd132ffd700 1 -- 172.21.15.111:0/2723259344 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+67674 (secure 0 0 0) 0x7fd13c016070 con 0x7fd14413a290 2024-04-25T02:20:07.519 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.515+0000 7fd14c252700 1 -- 172.21.15.111:0/2723259344 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd144057a60 con 0x7fd14413a290 2024-04-25T02:20:07.519 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.515+0000 7fd132ffd700 1 -- 172.21.15.111:0/2723259344 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) v1 ==== 74+0+3913 (secure 0 0 0) 0x7fd13c016020 con 0x7fd14413a290 2024-04-25T02:20:07.520 INFO:teuthology.misc.health.smithi111.stdout: 2024-04-25T02:20:07.520 INFO:teuthology.misc.health.smithi111.stdout:{"epoch":6,"fsid":"4643f974-f93a-4436-93b8-460ff320e62e","created":"2024-04-25T02:20:05.450475+0000","modified":"2024-04-25T02:20:06.649522+0000","last_up_change":"0.000000","last_in_change":"0.000000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[],"osds":[{"osd":0,"uuid":"df3f17ca-3b12-42c8-8cf7-8f1b7189e587","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"93d54815-f215-4285-bba6-32f2d1cabf10","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"b26b2104-2a2e-408f-9ce7-3587a32a2ebe","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"43c25820-1edc-4031-badf-72e87dd6bf15","up":0,"in":0,"weight":0,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-25T02:20:07.521 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.516+0000 7fd14c252700 1 -- 172.21.15.111:0/2723259344 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd14413a290 msgr2=0x7fd144066a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:07.521 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.516+0000 7fd14c252700 1 --2- 172.21.15.111:0/2723259344 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd14413a290 0x7fd144066a60 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fd13c00c000 tx=0x7fd13c0091d0).stop 2024-04-25T02:20:07.521 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.516+0000 7fd14c252700 1 -- 172.21.15.111:0/2723259344 shutdown_connections 2024-04-25T02:20:07.521 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.516+0000 7fd14c252700 1 --2- 172.21.15.111:0/2723259344 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd14413a290 0x7fd144066a60 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:07.521 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.516+0000 7fd14c252700 1 --2- 172.21.15.111:0/2723259344 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd144097980 0x7fd1441468f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:07.521 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.516+0000 7fd14c252700 1 --2- 172.21.15.111:0/2723259344 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd144139eb0 0x7fd14409cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:07.521 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.516+0000 7fd14c252700 1 -- 172.21.15.111:0/2723259344 >> 172.21.15.111:0/2723259344 conn(0x7fd1440614c0 msgr2=0x7fd14409b450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:07.521 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.516+0000 7fd14c252700 1 -- 172.21.15.111:0/2723259344 shutdown_connections 2024-04-25T02:20:07.522 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:07.516+0000 7fd14c252700 1 -- 172.21.15.111:0/2723259344 wait complete. 2024-04-25T02:20:07.530 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-04-25T02:20:08.370 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-25T02:20:08.365+0000 7fa678acff00 -1 osd.0 0 log_to_monitors {default=true} 2024-04-25T02:20:08.374 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-25T02:20:08.370+0000 7f80a45aef00 -1 osd.2 0 log_to_monitors {default=true} 2024-04-25T02:20:08.398 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-25T02:20:08.394+0000 7fe53f1b3f00 -1 osd.3 0 log_to_monitors {default=true} 2024-04-25T02:20:08.401 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-25T02:20:08.397+0000 7f163891ef00 -1 osd.1 0 log_to_monitors {default=true} 2024-04-25T02:20:09.448 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-25T02:20:09.444+0000 7f808ca79700 -1 osd.2 0 waiting for initial osdmap 2024-04-25T02:20:09.448 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-25T02:20:09.444+0000 7fe52767e700 -1 osd.3 0 waiting for initial osdmap 2024-04-25T02:20:09.449 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-25T02:20:09.444+0000 7f1620de9700 -1 osd.1 0 waiting for initial osdmap 2024-04-25T02:20:09.449 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-25T02:20:09.444+0000 7fa660f9a700 -1 osd.0 0 waiting for initial osdmap 2024-04-25T02:20:09.455 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-25T02:20:09.450+0000 7f8098496700 -1 osd.2 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:20:09.458 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-25T02:20:09.454+0000 7fa66c9b7700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:20:09.458 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-25T02:20:09.454+0000 7fe53309b700 -1 osd.3 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:20:09.461 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-25T02:20:09.457+0000 7f162c806700 -1 osd.1 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:20:13.935 DEBUG:teuthology.orchestra.run.smithi111:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-25T02:20:14.041 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.036+0000 7f9c21889700 1 Processor -- start 2024-04-25T02:20:14.041 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.036+0000 7f9c21889700 1 -- start start 2024-04-25T02:20:14.046 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.037+0000 7f9c21889700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f9c1c139eb0 0x7f9c1c0a9d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:14.046 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.037+0000 7f9c21889700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9c1c097980 0x7f9c1c05ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:14.047 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.037+0000 7f9c21889700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c1c096d70 con 0x7f9c1c13a290 2024-04-25T02:20:14.047 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.037+0000 7f9c21889700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c1c099650 con 0x7f9c1c139eb0 2024-04-25T02:20:14.047 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.037+0000 7f9c21889700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1c1399d0 con 0x7f9c1c097980 2024-04-25T02:20:14.047 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.037+0000 7f9c1a7fc700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9c1c097980 0x7f9c1c05ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:14.047 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.037+0000 7f9c1affd700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f9c1c139eb0 0x7f9c1c0a9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:14.047 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.037+0000 7f9c1a7fc700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9c1c097980 0x7f9c1c05ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:51128/0 (socket says 172.21.15.111:51128) 2024-04-25T02:20:14.047 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.037+0000 7f9c1a7fc700 1 -- 172.21.15.111:0/2309895370 learned_addr learned my addr 172.21.15.111:0/2309895370 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:14.048 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.038+0000 7f9c1affd700 1 -- 172.21.15.111:0/2309895370 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9c1c097980 msgr2=0x7f9c1c05ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:14.048 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.038+0000 7f9c1affd700 1 --2- 172.21.15.111:0/2309895370 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9c1c097980 0x7f9c1c05ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:14.048 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.038+0000 7f9c1affd700 1 -- 172.21.15.111:0/2309895370 >> v1:172.21.15.111:6789/0 conn(0x7f9c1c13a290 legacy=0x7f9c1c05bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:14.048 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.038+0000 7f9c1affd700 1 -- 172.21.15.111:0/2309895370 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c1c139c90 con 0x7f9c1c139eb0 2024-04-25T02:20:14.048 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.038+0000 7f9c19ffb700 1 -- 172.21.15.111:0/2309895370 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1852245645 0 0) 0x7f9c1c096d70 con 0x7f9c1c13a290 2024-04-25T02:20:14.048 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.038+0000 7f9c1a7fc700 1 --2- 172.21.15.111:0/2309895370 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9c1c097980 0x7f9c1c05ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:14.048 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.038+0000 7f9c1affd700 1 --2- 172.21.15.111:0/2309895370 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9c1c139eb0 0x7f9c1c0a9d70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f9c10002f70 tx=0x7f9c10006df0).ready entity=mon.0 client_cookie=5afbc9eba51d8625 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:14.048 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.038+0000 7f9c19ffb700 1 -- 172.21.15.111:0/2309895370 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c1000d570 con 0x7f9c1c139eb0 2024-04-25T02:20:14.048 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.038+0000 7f9c19ffb700 1 -- 172.21.15.111:0/2309895370 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c10000e90 con 0x7f9c1c139eb0 2024-04-25T02:20:14.049 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.038+0000 7f9c19ffb700 1 -- 172.21.15.111:0/2309895370 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c1000d8c0 con 0x7f9c1c139eb0 2024-04-25T02:20:14.049 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.039+0000 7f9c21889700 1 -- 172.21.15.111:0/2309895370 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9c1c139eb0 msgr2=0x7f9c1c0a9d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:14.049 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.039+0000 7f9c21889700 1 --2- 172.21.15.111:0/2309895370 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9c1c139eb0 0x7f9c1c0a9d70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f9c10002f70 tx=0x7f9c10006df0).stop 2024-04-25T02:20:14.049 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.039+0000 7f9c21889700 1 -- 172.21.15.111:0/2309895370 shutdown_connections 2024-04-25T02:20:14.049 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.039+0000 7f9c21889700 1 --2- 172.21.15.111:0/2309895370 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9c1c139eb0 0x7f9c1c0a9d70 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:14.049 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.039+0000 7f9c21889700 1 --2- 172.21.15.111:0/2309895370 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9c1c097980 0x7f9c1c05ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:14.049 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.039+0000 7f9c21889700 1 -- 172.21.15.111:0/2309895370 >> 172.21.15.111:0/2309895370 conn(0x7f9c1c0614c0 msgr2=0x7f9c1c06c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:14.049 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.039+0000 7f9c21889700 1 -- 172.21.15.111:0/2309895370 shutdown_connections 2024-04-25T02:20:14.050 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.039+0000 7f9c21889700 1 -- 172.21.15.111:0/2309895370 wait complete. 2024-04-25T02:20:14.050 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.040+0000 7f9c21889700 1 Processor -- start 2024-04-25T02:20:14.050 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.040+0000 7f9c21889700 1 -- start start 2024-04-25T02:20:14.050 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.040+0000 7f9c21889700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9c1c097980 0x7f9c1c066890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:14.050 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.040+0000 7f9c21889700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9c1c139eb0 0x7f9c1c130df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:14.050 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.040+0000 7f9c21889700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9c1c13a290 0x7f9c1c1312e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:14.050 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.040+0000 7f9c21889700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1c065860 con 0x7f9c1c13a290 2024-04-25T02:20:14.050 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.040+0000 7f9c21889700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1c0644a0 con 0x7f9c1c139eb0 2024-04-25T02:20:14.051 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.040+0000 7f9c21889700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1c064760 con 0x7f9c1c097980 2024-04-25T02:20:14.051 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.040+0000 7f9c1affd700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9c1c097980 0x7f9c1c066890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:14.051 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.040+0000 7f9c1affd700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9c1c097980 0x7f9c1c066890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:51130/0 (socket says 172.21.15.111:51130) 2024-04-25T02:20:14.051 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.040+0000 7f9c1affd700 1 -- 172.21.15.111:0/2980189233 learned_addr learned my addr 172.21.15.111:0/2980189233 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:14.051 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.040+0000 7f9c1a7fc700 1 --2- 172.21.15.111:0/2980189233 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9c1c139eb0 0x7f9c1c130df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:14.051 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.040+0000 7f9c1b7fe700 1 --2- 172.21.15.111:0/2980189233 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9c1c13a290 0x7f9c1c1312e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:14.051 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.041+0000 7f9c1affd700 1 -- 172.21.15.111:0/2980189233 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9c1c139eb0 msgr2=0x7f9c1c130df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:14.051 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.041+0000 7f9c1affd700 1 --2- 172.21.15.111:0/2980189233 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9c1c139eb0 0x7f9c1c130df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:14.052 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.041+0000 7f9c1affd700 1 -- 172.21.15.111:0/2980189233 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9c1c13a290 msgr2=0x7f9c1c1312e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:14.052 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.041+0000 7f9c1affd700 1 --2- 172.21.15.111:0/2980189233 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9c1c13a290 0x7f9c1c1312e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:14.052 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.041+0000 7f9c1affd700 1 -- 172.21.15.111:0/2980189233 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c0c00b1e0 con 0x7f9c1c097980 2024-04-25T02:20:14.052 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.041+0000 7f9c1affd700 1 --2- 172.21.15.111:0/2980189233 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9c1c097980 0x7f9c1c066890 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f9c10002f70 tx=0x7f9c10014000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:14.052 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.041+0000 7f9c0bfff700 1 -- 172.21.15.111:0/2980189233 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c10016070 con 0x7f9c1c097980 2024-04-25T02:20:14.052 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.041+0000 7f9c0bfff700 1 -- 172.21.15.111:0/2980189233 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c100139c0 con 0x7f9c1c097980 2024-04-25T02:20:14.052 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.041+0000 7f9c21889700 1 -- 172.21.15.111:0/2980189233 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c1000b180 con 0x7f9c1c097980 2024-04-25T02:20:14.053 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.041+0000 7f9c0bfff700 1 -- 172.21.15.111:0/2980189233 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9c10013d20 con 0x7f9c1c097980 2024-04-25T02:20:14.053 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.041+0000 7f9c21889700 1 -- 172.21.15.111:0/2980189233 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c1c063440 con 0x7f9c1c097980 2024-04-25T02:20:14.053 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.042+0000 7f9c0bfff700 1 -- 172.21.15.111:0/2980189233 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f9c10025030 con 0x7f9c1c097980 2024-04-25T02:20:14.053 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.042+0000 7f9c0bfff700 1 -- 172.21.15.111:0/2980189233 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2469+0+0 (secure 0 0 0) 0x7f9c1004b390 con 0x7f9c1c097980 2024-04-25T02:20:14.053 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.042+0000 7f9c21889700 1 -- 172.21.15.111:0/2980189233 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c1c065b40 con 0x7f9c1c097980 2024-04-25T02:20:14.054 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.045+0000 7f9c0bfff700 1 -- 172.21.15.111:0/2980189233 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f9c10023030 con 0x7f9c1c097980 2024-04-25T02:20:14.159 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.155+0000 7f9c21889700 1 -- 172.21.15.111:0/2980189233 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c1c057a60 con 0x7f9c1c097980 2024-04-25T02:20:14.160 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.156+0000 7f9c0bfff700 1 -- 172.21.15.111:0/2980189233 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+6269 (secure 0 0 0) 0x7f9c10028610 con 0x7f9c1c097980 2024-04-25T02:20:14.160 INFO:teuthology.misc.health.smithi111.stdout: 2024-04-25T02:20:14.160 INFO:teuthology.misc.health.smithi111.stdout:{"epoch":11,"fsid":"4643f974-f93a-4436-93b8-460ff320e62e","created":"2024-04-25T02:20:05.450475+0000","modified":"2024-04-25T02:20:12.459262+0000","last_up_change":"2024-04-25T02:20:10.439204+0000","last_in_change":"2024-04-25T02:20:10.439204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-25T02:20:07.471248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"df3f17ca-3b12-42c8-8cf7-8f1b7189e587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6800","nonce":40214}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6801","nonce":40214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6803","nonce":40214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6802","nonce":40214}]},"public_addr":"172.21.15.111:6800/40214","cluster_addr":"172.21.15.111:6801/40214","heartbeat_back_addr":"172.21.15.111:6803/40214","heartbeat_front_addr":"172.21.15.111:6802/40214","state":["exists","up"]},{"osd":1,"uuid":"93d54815-f215-4285-bba6-32f2d1cabf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":9,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6812","nonce":40216}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6813","nonce":40216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6815","nonce":40216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6814","nonce":40216}]},"public_addr":"172.21.15.111:6812/40216","cluster_addr":"172.21.15.111:6813/40216","heartbeat_back_addr":"172.21.15.111:6815/40216","heartbeat_front_addr":"172.21.15.111:6814/40216","state":["exists","up"]},{"osd":2,"uuid":"b26b2104-2a2e-408f-9ce7-3587a32a2ebe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6804","nonce":40215}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6805","nonce":40215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6807","nonce":40215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6806","nonce":40215}]},"public_addr":"172.21.15.111:6804/40215","cluster_addr":"172.21.15.111:6805/40215","heartbeat_back_addr":"172.21.15.111:6807/40215","heartbeat_front_addr":"172.21.15.111:6806/40215","state":["exists","up"]},{"osd":3,"uuid":"43c25820-1edc-4031-badf-72e87dd6bf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6808","nonce":40213}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6809","nonce":40213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6811","nonce":40213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6810","nonce":40213}]},"public_addr":"172.21.15.111:6808/40213","cluster_addr":"172.21.15.111:6809/40213","heartbeat_back_addr":"172.21.15.111:6811/40213","heartbeat_front_addr":"172.21.15.111:6810/40213","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.372427+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.411480+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.361508+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.377212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-25T02:20:14.161 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.157+0000 7f9c21889700 1 -- 172.21.15.111:0/2980189233 >> v1:172.21.15.111:6816/39585 conn(0x7f9bf8038da0 legacy=0x7f9bf803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:14.161 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.157+0000 7f9c21889700 1 -- 172.21.15.111:0/2980189233 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9c1c097980 msgr2=0x7f9c1c066890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:14.161 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.157+0000 7f9c21889700 1 --2- 172.21.15.111:0/2980189233 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9c1c097980 0x7f9c1c066890 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f9c10002f70 tx=0x7f9c10014000).stop 2024-04-25T02:20:14.161 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.157+0000 7f9c21889700 1 -- 172.21.15.111:0/2980189233 shutdown_connections 2024-04-25T02:20:14.161 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.157+0000 7f9c21889700 1 --2- 172.21.15.111:0/2980189233 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9c1c13a290 0x7f9c1c1312e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:14.161 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.157+0000 7f9c21889700 1 --2- 172.21.15.111:0/2980189233 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9c1c097980 0x7f9c1c066890 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:14.162 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.157+0000 7f9c21889700 1 --2- 172.21.15.111:0/2980189233 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9c1c139eb0 0x7f9c1c130df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:14.162 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.157+0000 7f9c21889700 1 -- 172.21.15.111:0/2980189233 >> 172.21.15.111:0/2980189233 conn(0x7f9c1c0614c0 msgr2=0x7f9c1c05c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:14.162 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.157+0000 7f9c21889700 1 -- 172.21.15.111:0/2980189233 shutdown_connections 2024-04-25T02:20:14.162 INFO:teuthology.misc.health.smithi111.stderr:2024-04-25T02:20:14.157+0000 7f9c21889700 1 -- 172.21.15.111:0/2980189233 wait complete. 2024-04-25T02:20:14.171 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-04-25T02:20:14.171 INFO:tasks.ceph:Creating RBD pool 2024-04-25T02:20:14.171 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-25T02:20:14.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.269+0000 7f110a11d700 1 Processor -- start 2024-04-25T02:20:14.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.269+0000 7f110a11d700 1 -- start start 2024-04-25T02:20:14.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.270+0000 7f110a11d700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f110405c020 0x7f1104061c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:14.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.270+0000 7f110a11d700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f110405c7e0 0x7f110413ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:14.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.270+0000 7f110a11d700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11040a7280 con 0x7f110405c400 2024-04-25T02:20:14.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.270+0000 7f110a11d700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11040a7500 con 0x7f110405c7e0 2024-04-25T02:20:14.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.270+0000 7f110a11d700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1104067f10 con 0x7f110405c020 2024-04-25T02:20:14.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.270+0000 7f1103fff700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f110405c7e0 0x7f110413ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:14.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.270+0000 7f11037fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f110405c020 0x7f1104061c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:14.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.270+0000 7f1103fff700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f110405c7e0 0x7f110413ea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44374/0 (socket says 172.21.15.111:44374) 2024-04-25T02:20:14.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.270+0000 7f1103fff700 1 -- 172.21.15.111:0/3091863344 learned_addr learned my addr 172.21.15.111:0/3091863344 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:14.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.270+0000 7f1103fff700 1 -- 172.21.15.111:0/3091863344 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f110405c020 msgr2=0x7f1104061c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:14.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.270+0000 7f1103fff700 1 --2- 172.21.15.111:0/3091863344 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f110405c020 0x7f1104061c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:14.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.270+0000 7f1103fff700 1 -- 172.21.15.111:0/3091863344 >> v1:172.21.15.111:6789/0 conn(0x7f110405c400 legacy=0x7f11040a6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:14.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.270+0000 7f1103fff700 1 -- 172.21.15.111:0/3091863344 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1104062130 con 0x7f110405c7e0 2024-04-25T02:20:14.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.270+0000 7f11027fc700 1 -- 172.21.15.111:0/3091863344 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4091778987 0 0) 0x7f11040a7280 con 0x7f110405c400 2024-04-25T02:20:14.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.270+0000 7f11037fe700 1 --2- 172.21.15.111:0/3091863344 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f110405c020 0x7f1104061c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:14.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.270+0000 7f1103fff700 1 --2- 172.21.15.111:0/3091863344 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f110405c7e0 0x7f110413ea60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f10fc0032f0 tx=0x7f10fc009290).ready entity=mon.0 client_cookie=2663a1c8149a5da server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:14.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.270+0000 7f11027fc700 1 -- 172.21.15.111:0/3091863344 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10fc00b8a0 con 0x7f110405c7e0 2024-04-25T02:20:14.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.270+0000 7f11027fc700 1 -- 172.21.15.111:0/3091863344 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10fc00ba00 con 0x7f110405c7e0 2024-04-25T02:20:14.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.270+0000 7f11027fc700 1 -- 172.21.15.111:0/3091863344 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10fc00bb70 con 0x7f110405c7e0 2024-04-25T02:20:14.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.271+0000 7f110a11d700 1 -- 172.21.15.111:0/3091863344 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f110405c7e0 msgr2=0x7f110413ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:14.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.271+0000 7f110a11d700 1 --2- 172.21.15.111:0/3091863344 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f110405c7e0 0x7f110413ea60 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f10fc0032f0 tx=0x7f10fc009290).stop 2024-04-25T02:20:14.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.271+0000 7f110a11d700 1 -- 172.21.15.111:0/3091863344 shutdown_connections 2024-04-25T02:20:14.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.271+0000 7f110a11d700 1 --2- 172.21.15.111:0/3091863344 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f110405c7e0 0x7f110413ea60 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:14.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.271+0000 7f110a11d700 1 --2- 172.21.15.111:0/3091863344 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f110405c020 0x7f1104061c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:14.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.271+0000 7f110a11d700 1 -- 172.21.15.111:0/3091863344 >> 172.21.15.111:0/3091863344 conn(0x7f11040a8a00 msgr2=0x7f11040a8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:14.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.271+0000 7f110a11d700 1 -- 172.21.15.111:0/3091863344 shutdown_connections 2024-04-25T02:20:14.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.271+0000 7f110a11d700 1 -- 172.21.15.111:0/3091863344 wait complete. 2024-04-25T02:20:14.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.272+0000 7f110a11d700 1 Processor -- start 2024-04-25T02:20:14.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.272+0000 7f110a11d700 1 -- start start 2024-04-25T02:20:14.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.273+0000 7f110a11d700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f110405c020 0x7f11040a0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:14.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.273+0000 7f110a11d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f110405c400 0x7f1104094eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:14.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.273+0000 7f110a11d700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f110405c7e0 0x7f1104093ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:14.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.273+0000 7f110a11d700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110409f020 con 0x7f110405c400 2024-04-25T02:20:14.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.273+0000 7f110a11d700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11040958a0 con 0x7f110405c020 2024-04-25T02:20:14.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.273+0000 7f110a11d700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1104145db0 con 0x7f110405c7e0 2024-04-25T02:20:14.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.273+0000 7f1103fff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f110405c7e0 0x7f1104093ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:14.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.273+0000 7f11037fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f110405c020 0x7f11040a0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:14.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.273+0000 7f1103fff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f110405c7e0 0x7f1104093ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:51142/0 (socket says 172.21.15.111:51142) 2024-04-25T02:20:14.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.273+0000 7f1103fff700 1 -- 172.21.15.111:0/2378901831 learned_addr learned my addr 172.21.15.111:0/2378901831 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:14.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.273+0000 7f1102ffd700 1 --2- 172.21.15.111:0/2378901831 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f110405c400 0x7f1104094eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:14.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.273+0000 7f1103fff700 1 -- 172.21.15.111:0/2378901831 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f110405c020 msgr2=0x7f11040a0ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:14.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.273+0000 7f1103fff700 1 --2- 172.21.15.111:0/2378901831 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f110405c020 0x7f11040a0ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:14.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.273+0000 7f1103fff700 1 -- 172.21.15.111:0/2378901831 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f110405c400 msgr2=0x7f1104094eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:14.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.273+0000 7f1103fff700 1 --2- 172.21.15.111:0/2378901831 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f110405c400 0x7f1104094eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:14.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.273+0000 7f1103fff700 1 -- 172.21.15.111:0/2378901831 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f400b180 con 0x7f110405c7e0 2024-04-25T02:20:14.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.273+0000 7f1103fff700 1 --2- 172.21.15.111:0/2378901831 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f110405c7e0 0x7f1104093ea0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f110409f160 tx=0x7f10fc016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:14.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.273+0000 7f1100ff9700 1 -- 172.21.15.111:0/2378901831 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10fc00b8a0 con 0x7f110405c7e0 2024-04-25T02:20:14.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.273+0000 7f1100ff9700 1 -- 172.21.15.111:0/2378901831 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10fc021630 con 0x7f110405c7e0 2024-04-25T02:20:14.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.273+0000 7f1100ff9700 1 -- 172.21.15.111:0/2378901831 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f10fc021990 con 0x7f110405c7e0 2024-04-25T02:20:14.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.273+0000 7f110a11d700 1 -- 172.21.15.111:0/2378901831 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10fc009530 con 0x7f110405c7e0 2024-04-25T02:20:14.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.273+0000 7f110a11d700 1 -- 172.21.15.111:0/2378901831 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1104094750 con 0x7f110405c7e0 2024-04-25T02:20:14.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.274+0000 7f1100ff9700 1 -- 172.21.15.111:0/2378901831 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f10fc00f070 con 0x7f110405c7e0 2024-04-25T02:20:14.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.274+0000 7f110a11d700 1 -- 172.21.15.111:0/2378901831 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11040a2e60 con 0x7f110405c7e0 2024-04-25T02:20:14.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.274+0000 7f1100ff9700 1 -- 172.21.15.111:0/2378901831 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 2469+0+0 (secure 0 0 0) 0x7f10fc04b5b0 con 0x7f110405c7e0 2024-04-25T02:20:14.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.277+0000 7f1100ff9700 1 -- 172.21.15.111:0/2378901831 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f10fc002450 con 0x7f110405c7e0 2024-04-25T02:20:14.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.387+0000 7f110a11d700 1 -- 172.21.15.111:0/2378901831 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) v1 -- 0x7f1104057a60 con 0x7f110405c7e0 2024-04-25T02:20:14.476 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.472+0000 7f1100ff9700 1 -- 172.21.15.111:0/2378901831 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v12) v1 ==== 109+0+0 (secure 0 0 0) 0x7f10fc015030 con 0x7f110405c7e0 2024-04-25T02:20:14.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.474+0000 7f110a11d700 1 -- 172.21.15.111:0/2378901831 >> v1:172.21.15.111:6816/39585 conn(0x7f10e8038dd0 legacy=0x7f10e803b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:14.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.474+0000 7f110a11d700 1 -- 172.21.15.111:0/2378901831 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f110405c7e0 msgr2=0x7f1104093ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:14.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.474+0000 7f110a11d700 1 --2- 172.21.15.111:0/2378901831 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f110405c7e0 0x7f1104093ea0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f110409f160 tx=0x7f10fc016000).stop 2024-04-25T02:20:14.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.474+0000 7f110a11d700 1 -- 172.21.15.111:0/2378901831 shutdown_connections 2024-04-25T02:20:14.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.474+0000 7f110a11d700 1 --2- 172.21.15.111:0/2378901831 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f110405c7e0 0x7f1104093ea0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:14.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.474+0000 7f110a11d700 1 --2- 172.21.15.111:0/2378901831 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f110405c020 0x7f11040a0ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:14.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.474+0000 7f110a11d700 1 --2- 172.21.15.111:0/2378901831 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f110405c400 0x7f1104094eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:14.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.474+0000 7f110a11d700 1 -- 172.21.15.111:0/2378901831 >> 172.21.15.111:0/2378901831 conn(0x7f11040a8a00 msgr2=0x7f11040a6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:14.479 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.474+0000 7f110a11d700 1 -- 172.21.15.111:0/2378901831 shutdown_connections 2024-04-25T02:20:14.479 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.474+0000 7f110a11d700 1 -- 172.21.15.111:0/2378901831 wait complete. 2024-04-25T02:20:14.479 INFO:teuthology.orchestra.run.smithi111.stderr:pool 'rbd' created 2024-04-25T02:20:14.489 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-25T02:20:14.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.588+0000 7f2dfa9bf700 1 Processor -- start 2024-04-25T02:20:14.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.588+0000 7f2dfa9bf700 1 -- start start 2024-04-25T02:20:14.597 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.589+0000 7f2dfa9bf700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f2df40a6810 0x7f2df40a24c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:14.597 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.589+0000 7f2dfa9bf700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2df40a6bf0 0x7f2df40a7010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:14.597 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.589+0000 7f2dfa9bf700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2df40a7500 0x7f2df4136210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:14.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.589+0000 7f2dfa9bf700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2df40a18e0 con 0x7f2df40a6810 2024-04-25T02:20:14.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.589+0000 7f2dfa9bf700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df40a13e0 con 0x7f2df40a6bf0 2024-04-25T02:20:14.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.589+0000 7f2dfa9bf700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2df40a7ce0 con 0x7f2df40a7500 2024-04-25T02:20:14.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.589+0000 7f2df37fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2df40a6bf0 0x7f2df40a7010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:14.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.589+0000 7f2df8f5c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2df40a7500 0x7f2df4136210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:14.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.589+0000 7f2df3fff700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f2df40a6810 0x7f2df40a24c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:14.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.589+0000 7f2df8f5c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2df40a7500 0x7f2df4136210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:51158/0 (socket says 172.21.15.111:51158) 2024-04-25T02:20:14.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.589+0000 7f2df37fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2df40a6bf0 0x7f2df40a7010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:36936/0 (socket says 172.21.15.111:36936) 2024-04-25T02:20:14.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.589+0000 7f2df8f5c700 1 -- 172.21.15.111:0/3689464447 learned_addr learned my addr 172.21.15.111:0/3689464447 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:14.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.589+0000 7f2df8f5c700 1 -- 172.21.15.111:0/3689464447 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2df40a6bf0 msgr2=0x7f2df40a7010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:14.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.589+0000 7f2df8f5c700 1 --2- 172.21.15.111:0/3689464447 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2df40a6bf0 0x7f2df40a7010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:14.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.589+0000 7f2df8f5c700 1 -- 172.21.15.111:0/3689464447 >> v2:172.21.15.111:3300/0 conn(0x7f2df40a6810 msgr2=0x7f2df40a24c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:14.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.589+0000 7f2df8f5c700 1 --2- 172.21.15.111:0/3689464447 >> v2:172.21.15.111:3300/0 conn(0x7f2df40a6810 0x7f2df40a24c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:14.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.589+0000 7f2df8f5c700 1 -- 172.21.15.111:0/3689464447 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df40a1b30 con 0x7f2df40a7500 2024-04-25T02:20:14.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.589+0000 7f2df3fff700 1 --2- 172.21.15.111:0/3689464447 >> v2:172.21.15.111:3300/0 conn(0x7f2df40a6810 0x7f2df40a24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:14.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.589+0000 7f2df8f5c700 1 --2- 172.21.15.111:0/3689464447 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2df40a7500 0x7f2df4136210 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f2dec0032f0 tx=0x7f2dec00a370).ready entity=mon.2 client_cookie=30fe0ede2b0c9bb9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:14.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.589+0000 7f2df2ffd700 1 -- 172.21.15.111:0/3689464447 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2dec00aea0 con 0x7f2df40a7500 2024-04-25T02:20:14.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.590+0000 7f2df2ffd700 1 -- 172.21.15.111:0/3689464447 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dec00b980 con 0x7f2df40a7500 2024-04-25T02:20:14.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.590+0000 7f2df2ffd700 1 -- 172.21.15.111:0/3689464447 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2dec00bce0 con 0x7f2df40a7500 2024-04-25T02:20:14.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.590+0000 7f2dfa9bf700 1 -- 172.21.15.111:0/3689464447 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2df40a7500 msgr2=0x7f2df4136210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:14.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.590+0000 7f2dfa9bf700 1 --2- 172.21.15.111:0/3689464447 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2df40a7500 0x7f2df4136210 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f2dec0032f0 tx=0x7f2dec00a370).stop 2024-04-25T02:20:14.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.590+0000 7f2dfa9bf700 1 -- 172.21.15.111:0/3689464447 shutdown_connections 2024-04-25T02:20:14.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.590+0000 7f2dfa9bf700 1 --2- 172.21.15.111:0/3689464447 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2df40a7500 0x7f2df4136210 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:14.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.590+0000 7f2dfa9bf700 1 --2- 172.21.15.111:0/3689464447 >> v2:172.21.15.111:3300/0 conn(0x7f2df40a6810 0x7f2df40a24c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:14.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.590+0000 7f2dfa9bf700 1 --2- 172.21.15.111:0/3689464447 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2df40a6bf0 0x7f2df40a7010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:14.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.590+0000 7f2dfa9bf700 1 -- 172.21.15.111:0/3689464447 >> 172.21.15.111:0/3689464447 conn(0x7f2df40a8a00 msgr2=0x7f2df40a8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:14.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.590+0000 7f2dfa9bf700 1 -- 172.21.15.111:0/3689464447 shutdown_connections 2024-04-25T02:20:14.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.590+0000 7f2dfa9bf700 1 -- 172.21.15.111:0/3689464447 wait complete. 2024-04-25T02:20:14.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.591+0000 7f2dfa9bf700 1 Processor -- start 2024-04-25T02:20:14.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.591+0000 7f2dfa9bf700 1 -- start start 2024-04-25T02:20:14.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.592+0000 7f2dfa9bf700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2df40a6810 0x7f2df4066e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:14.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.592+0000 7f2dfa9bf700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2df40a6bf0 0x7f2df4094000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:14.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.592+0000 7f2dfa9bf700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2df40a7500 0x7f2df4141670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:14.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.592+0000 7f2dfa9bf700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df4093820 con 0x7f2df40a6810 2024-04-25T02:20:14.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.592+0000 7f2dfa9bf700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df4093b00 con 0x7f2df40a6bf0 2024-04-25T02:20:14.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.592+0000 7f2dfa9bf700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2df4141340 con 0x7f2df40a7500 2024-04-25T02:20:14.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.592+0000 7f2df3fff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2df40a6810 0x7f2df4066e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:14.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.592+0000 7f2df3fff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2df40a6810 0x7f2df4066e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44400/0 (socket says 172.21.15.111:44400) 2024-04-25T02:20:14.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.592+0000 7f2df37fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2df40a6bf0 0x7f2df4094000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:14.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.592+0000 7f2df3fff700 1 -- 172.21.15.111:0/1388352208 learned_addr learned my addr 172.21.15.111:0/1388352208 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:14.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.592+0000 7f2df8f5c700 1 --2- 172.21.15.111:0/1388352208 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2df40a7500 0x7f2df4141670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:14.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.592+0000 7f2df3fff700 1 -- 172.21.15.111:0/1388352208 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2df40a7500 msgr2=0x7f2df4141670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:14.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.592+0000 7f2df3fff700 1 --2- 172.21.15.111:0/1388352208 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2df40a7500 0x7f2df4141670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:14.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.592+0000 7f2df3fff700 1 -- 172.21.15.111:0/1388352208 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2df40a6bf0 msgr2=0x7f2df4094000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:14.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.592+0000 7f2df3fff700 1 --2- 172.21.15.111:0/1388352208 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2df40a6bf0 0x7f2df4094000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:14.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.592+0000 7f2df3fff700 1 -- 172.21.15.111:0/1388352208 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2de800b180 con 0x7f2df40a6810 2024-04-25T02:20:14.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.592+0000 7f2df37fe700 1 --2- 172.21.15.111:0/1388352208 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2df40a6bf0 0x7f2df4094000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:14.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.592+0000 7f2df8f5c700 1 --2- 172.21.15.111:0/1388352208 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2df40a7500 0x7f2df4141670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:14.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.592+0000 7f2df3fff700 1 --2- 172.21.15.111:0/1388352208 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2df40a6810 0x7f2df4066e70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f2de800c000 tx=0x7f2de8006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:14.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.592+0000 7f2df17fa700 1 -- 172.21.15.111:0/1388352208 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2de800c7e0 con 0x7f2df40a6810 2024-04-25T02:20:14.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.592+0000 7f2df17fa700 1 -- 172.21.15.111:0/1388352208 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2de800c940 con 0x7f2df40a6810 2024-04-25T02:20:14.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.592+0000 7f2dfa9bf700 1 -- 172.21.15.111:0/1388352208 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dec00a5d0 con 0x7f2df40a6810 2024-04-25T02:20:14.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.592+0000 7f2df17fa700 1 -- 172.21.15.111:0/1388352208 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2de800cca0 con 0x7f2df40a6810 2024-04-25T02:20:14.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.592+0000 7f2dfa9bf700 1 -- 172.21.15.111:0/1388352208 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2df40930f0 con 0x7f2df40a6810 2024-04-25T02:20:14.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.593+0000 7f2df17fa700 1 -- 172.21.15.111:0/1388352208 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f2de801c460 con 0x7f2df40a6810 2024-04-25T02:20:14.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.593+0000 7f2dfa9bf700 1 -- 172.21.15.111:0/1388352208 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2df409fb50 con 0x7f2df40a6810 2024-04-25T02:20:14.602 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.594+0000 7f2df17fa700 1 -- 172.21.15.111:0/1388352208 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(12..12 src has 1..12) v4 ==== 2811+0+0 (secure 0 0 0) 0x7f2de804aaa0 con 0x7f2df40a6810 2024-04-25T02:20:14.602 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.597+0000 7f2df17fa700 1 -- 172.21.15.111:0/1388352208 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f2de8033730 con 0x7f2df40a6810 2024-04-25T02:20:14.712 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:14.708+0000 7f2dfa9bf700 1 -- 172.21.15.111:0/1388352208 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f2df4057a60 con 0x7f2df40a6810 2024-04-25T02:20:15.485 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.481+0000 7f2df17fa700 1 -- 172.21.15.111:0/1388352208 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "rbd", "app": "rbd", "yes_i_really_mean_it": true}]=0 enabled application 'rbd' on pool 'rbd' v13) v1 ==== 173+0+0 (secure 0 0 0) 0x7f2de800ce00 con 0x7f2df40a6810 2024-04-25T02:20:15.490 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.486+0000 7f2dfa9bf700 1 -- 172.21.15.111:0/1388352208 >> v1:172.21.15.111:6816/39585 conn(0x7f2dd4038da0 legacy=0x7f2dd403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:15.491 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.486+0000 7f2dfa9bf700 1 -- 172.21.15.111:0/1388352208 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2df40a6810 msgr2=0x7f2df4066e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:15.491 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.486+0000 7f2dfa9bf700 1 --2- 172.21.15.111:0/1388352208 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2df40a6810 0x7f2df4066e70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f2de800c000 tx=0x7f2de8006df0).stop 2024-04-25T02:20:15.491 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.486+0000 7f2dfa9bf700 1 -- 172.21.15.111:0/1388352208 shutdown_connections 2024-04-25T02:20:15.491 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.486+0000 7f2dfa9bf700 1 --2- 172.21.15.111:0/1388352208 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2df40a7500 0x7f2df4141670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:15.491 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.486+0000 7f2dfa9bf700 1 --2- 172.21.15.111:0/1388352208 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2df40a6810 0x7f2df4066e70 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:15.491 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.486+0000 7f2dfa9bf700 1 --2- 172.21.15.111:0/1388352208 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2df40a6bf0 0x7f2df4094000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:15.491 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.486+0000 7f2dfa9bf700 1 -- 172.21.15.111:0/1388352208 >> 172.21.15.111:0/1388352208 conn(0x7f2df40a8a00 msgr2=0x7f2df40a30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:15.491 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.487+0000 7f2dfa9bf700 1 -- 172.21.15.111:0/1388352208 shutdown_connections 2024-04-25T02:20:15.491 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.487+0000 7f2dfa9bf700 1 -- 172.21.15.111:0/1388352208 wait complete. 2024-04-25T02:20:15.492 INFO:teuthology.orchestra.run.smithi111.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-25T02:20:15.504 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-25T02:20:15.505 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T02:20:15.505 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T02:20:15.507 INFO:tasks.ceph.mds.a:Started 2024-04-25T02:20:15.507 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T02:20:15.507 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T02:20:15.510 INFO:tasks.ceph.mds.b:Started 2024-04-25T02:20:15.510 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T02:20:15.510 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T02:20:15.512 INFO:tasks.ceph.mds.c:Started 2024-04-25T02:20:15.512 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-25T02:20:15.512 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:20:15.588 INFO:tasks.ceph.mds.a.smithi111.stdout:starting mds.a at 2024-04-25T02:20:15.593 INFO:tasks.ceph.mds.c.smithi111.stdout:starting mds.c at 2024-04-25T02:20:15.594 INFO:tasks.ceph.mds.b.smithi111.stdout:starting mds.b at 2024-04-25T02:20:15.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.626+0000 7f5bb5d95700 1 Processor -- start 2024-04-25T02:20:15.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.626+0000 7f5bb5d95700 1 -- start start 2024-04-25T02:20:15.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.626+0000 7f5bb5d95700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f5bb005c1a0 0x7f5bb0067040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:15.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.626+0000 7f5bb5d95700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5bb0066170 0x7f5bb005c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:15.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.626+0000 7f5bb5d95700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5bb0065c90 con 0x7f5bb0067c20 2024-04-25T02:20:15.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.626+0000 7f5bb5d95700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bb005ca70 con 0x7f5bb005c1a0 2024-04-25T02:20:15.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.626+0000 7f5bb5d95700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb0067680 con 0x7f5bb0066170 2024-04-25T02:20:15.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.626+0000 7f5baf7fe700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f5bb005c1a0 0x7f5bb0067040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:15.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.626+0000 7f5baeffd700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f5bb0067c20 0x7f5bb0136350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:32816/0 (socket says 172.21.15.111:32816) 2024-04-25T02:20:15.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.626+0000 7f5baeffd700 1 -- 172.21.15.111:0/3313741227 learned_addr learned my addr 172.21.15.111:0/3313741227 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:20:15.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.626+0000 7f5baffff700 1 --2- 172.21.15.111:0/3313741227 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5bb0066170 0x7f5bb005c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:15.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.627+0000 7f5baf7fe700 1 -- 172.21.15.111:0/3313741227 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5bb0066170 msgr2=0x7f5bb005c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:15.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.627+0000 7f5baf7fe700 1 --2- 172.21.15.111:0/3313741227 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5bb0066170 0x7f5bb005c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:15.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.627+0000 7f5baf7fe700 1 -- 172.21.15.111:0/3313741227 >> v1:172.21.15.111:6789/0 conn(0x7f5bb0067c20 legacy=0x7f5bb0136350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:15.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.627+0000 7f5bae7fc700 1 -- 172.21.15.111:0/3313741227 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 948616611 0 0) 0x7f5bb0065c90 con 0x7f5bb0067c20 2024-04-25T02:20:15.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.627+0000 7f5baf7fe700 1 -- 172.21.15.111:0/3313741227 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb005ba50 con 0x7f5bb005c1a0 2024-04-25T02:20:15.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.627+0000 7f5baf7fe700 1 --2- 172.21.15.111:0/3313741227 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5bb005c1a0 0x7f5bb0067040 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f5bb00a6e90 tx=0x7f5ba0006df0).ready entity=mon.0 client_cookie=33196dbf48836f92 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:15.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.627+0000 7f5bae7fc700 1 -- 172.21.15.111:0/3313741227 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ba000d570 con 0x7f5bb005c1a0 2024-04-25T02:20:15.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.627+0000 7f5bae7fc700 1 -- 172.21.15.111:0/3313741227 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ba0000e90 con 0x7f5bb005c1a0 2024-04-25T02:20:15.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.627+0000 7f5bae7fc700 1 -- 172.21.15.111:0/3313741227 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ba000d8c0 con 0x7f5bb005c1a0 2024-04-25T02:20:15.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.627+0000 7f5bb5d95700 1 -- 172.21.15.111:0/3313741227 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5bb005c1a0 msgr2=0x7f5bb0067040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:15.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.627+0000 7f5bb5d95700 1 --2- 172.21.15.111:0/3313741227 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5bb005c1a0 0x7f5bb0067040 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f5bb00a6e90 tx=0x7f5ba0006df0).stop 2024-04-25T02:20:15.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.627+0000 7f5bb5d95700 1 -- 172.21.15.111:0/3313741227 shutdown_connections 2024-04-25T02:20:15.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.627+0000 7f5bb5d95700 1 --2- 172.21.15.111:0/3313741227 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5bb0066170 0x7f5bb005c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:15.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.627+0000 7f5bb5d95700 1 --2- 172.21.15.111:0/3313741227 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5bb005c1a0 0x7f5bb0067040 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:15.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.627+0000 7f5bb5d95700 1 -- 172.21.15.111:0/3313741227 >> 172.21.15.111:0/3313741227 conn(0x7f5bb00a8a00 msgr2=0x7f5bb00a8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:15.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.627+0000 7f5bb5d95700 1 -- 172.21.15.111:0/3313741227 shutdown_connections 2024-04-25T02:20:15.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.627+0000 7f5bb5d95700 1 -- 172.21.15.111:0/3313741227 wait complete. 2024-04-25T02:20:15.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.628+0000 7f5bb5d95700 1 Processor -- start 2024-04-25T02:20:15.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.628+0000 7f5bb5d95700 1 -- start start 2024-04-25T02:20:15.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.629+0000 7f5bb5d95700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5bb005c1a0 0x7f5bb0137620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:15.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.629+0000 7f5bb5d95700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5bb0066170 0x7f5bb0138350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:15.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.629+0000 7f5bb5d95700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5bb0067c20 0x7f5bb0138840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:15.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.629+0000 7f5bb5d95700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb0137c40 con 0x7f5bb0066170 2024-04-25T02:20:15.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.629+0000 7f5bb5d95700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb0137f00 con 0x7f5bb0067c20 2024-04-25T02:20:15.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.629+0000 7f5bb5d95700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5bb0135f90 con 0x7f5bb005c1a0 2024-04-25T02:20:15.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.629+0000 7f5baf7fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5bb005c1a0 0x7f5bb0137620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:15.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.629+0000 7f5baf7fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5bb005c1a0 0x7f5bb0137620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:51216/0 (socket says 172.21.15.111:51216) 2024-04-25T02:20:15.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.629+0000 7f5baf7fe700 1 -- 172.21.15.111:0/4170942638 learned_addr learned my addr 172.21.15.111:0/4170942638 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:15.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.629+0000 7f5baeffd700 1 --2- 172.21.15.111:0/4170942638 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5bb0066170 0x7f5bb0138350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:15.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.629+0000 7f5baffff700 1 --2- 172.21.15.111:0/4170942638 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5bb0067c20 0x7f5bb0138840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:15.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.629+0000 7f5baeffd700 1 -- 172.21.15.111:0/4170942638 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5bb005c1a0 msgr2=0x7f5bb0137620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:15.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.629+0000 7f5baeffd700 1 --2- 172.21.15.111:0/4170942638 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5bb005c1a0 0x7f5bb0137620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:15.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.629+0000 7f5baeffd700 1 -- 172.21.15.111:0/4170942638 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5bb0067c20 msgr2=0x7f5bb0138840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:15.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.629+0000 7f5baeffd700 1 --2- 172.21.15.111:0/4170942638 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5bb0067c20 0x7f5bb0138840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:15.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.629+0000 7f5baeffd700 1 -- 172.21.15.111:0/4170942638 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ba000b180 con 0x7f5bb0066170 2024-04-25T02:20:15.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.629+0000 7f5baf7fe700 1 --2- 172.21.15.111:0/4170942638 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5bb005c1a0 0x7f5bb0137620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:15.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.630+0000 7f5baeffd700 1 --2- 172.21.15.111:0/4170942638 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5bb0066170 0x7f5bb0138350 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f5ba4000bc0 tx=0x7f5ba4007c00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:15.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.630+0000 7f5bacff9700 1 -- 172.21.15.111:0/4170942638 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ba4001d30 con 0x7f5bb0066170 2024-04-25T02:20:15.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.630+0000 7f5bacff9700 1 -- 172.21.15.111:0/4170942638 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ba40070d0 con 0x7f5bb0066170 2024-04-25T02:20:15.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.630+0000 7f5bb5d95700 1 -- 172.21.15.111:0/4170942638 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bb0093880 con 0x7f5bb0066170 2024-04-25T02:20:15.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.630+0000 7f5bacff9700 1 -- 172.21.15.111:0/4170942638 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5ba4007430 con 0x7f5bb0066170 2024-04-25T02:20:15.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.630+0000 7f5bb5d95700 1 -- 172.21.15.111:0/4170942638 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bb00920b0 con 0x7f5bb0066170 2024-04-25T02:20:15.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.631+0000 7f5bacff9700 1 -- 172.21.15.111:0/4170942638 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f5ba401a060 con 0x7f5bb0066170 2024-04-25T02:20:15.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.631+0000 7f5bb5d95700 1 -- 172.21.15.111:0/4170942638 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bb005e470 con 0x7f5bb0066170 2024-04-25T02:20:15.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.631+0000 7f5bacff9700 1 -- 172.21.15.111:0/4170942638 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2822+0+0 (secure 0 0 0) 0x7f5ba40499e0 con 0x7f5bb0066170 2024-04-25T02:20:15.639 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.634+0000 7f5bacff9700 1 -- 172.21.15.111:0/4170942638 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f5ba402ec30 con 0x7f5bb0066170 2024-04-25T02:20:15.749 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.745+0000 7f5bb5d95700 1 -- 172.21.15.111:0/4170942638 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5bb0057a60 con 0x7f5bb0066170 2024-04-25T02:20:15.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.746+0000 7f5bacff9700 1 -- 172.21.15.111:0/4170942638 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v13) v1 ==== 74+0+7654 (secure 0 0 0) 0x7f5ba4018030 con 0x7f5bb0066170 2024-04-25T02:20:15.750 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:20:15.750 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":13,"fsid":"4643f974-f93a-4436-93b8-460ff320e62e","created":"2024-04-25T02:20:05.450475+0000","modified":"2024-04-25T02:20:15.476157+0000","last_up_change":"2024-04-25T02:20:10.439204+0000","last_in_change":"2024-04-25T02:20:10.439204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-25T02:20:07.471248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:20:14.420378+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"13","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"df3f17ca-3b12-42c8-8cf7-8f1b7189e587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6800","nonce":40214}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6801","nonce":40214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6803","nonce":40214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6802","nonce":40214}]},"public_addr":"172.21.15.111:6800/40214","cluster_addr":"172.21.15.111:6801/40214","heartbeat_back_addr":"172.21.15.111:6803/40214","heartbeat_front_addr":"172.21.15.111:6802/40214","state":["exists","up"]},{"osd":1,"uuid":"93d54815-f215-4285-bba6-32f2d1cabf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6812","nonce":40216}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6813","nonce":40216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6815","nonce":40216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6814","nonce":40216}]},"public_addr":"172.21.15.111:6812/40216","cluster_addr":"172.21.15.111:6813/40216","heartbeat_back_addr":"172.21.15.111:6815/40216","heartbeat_front_addr":"172.21.15.111:6814/40216","state":["exists","up"]},{"osd":2,"uuid":"b26b2104-2a2e-408f-9ce7-3587a32a2ebe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6804","nonce":40215}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6805","nonce":40215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6807","nonce":40215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6806","nonce":40215}]},"public_addr":"172.21.15.111:6804/40215","cluster_addr":"172.21.15.111:6805/40215","heartbeat_back_addr":"172.21.15.111:6807/40215","heartbeat_front_addr":"172.21.15.111:6806/40215","state":["exists","up"]},{"osd":3,"uuid":"43c25820-1edc-4031-badf-72e87dd6bf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6808","nonce":40213}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6809","nonce":40213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6811","nonce":40213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6810","nonce":40213}]},"public_addr":"172.21.15.111:6808/40213","cluster_addr":"172.21.15.111:6809/40213","heartbeat_back_addr":"172.21.15.111:6811/40213","heartbeat_front_addr":"172.21.15.111:6810/40213","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.372427+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.411480+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.361508+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.377212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-25T02:20:15.751 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.747+0000 7f5bb5d95700 1 -- 172.21.15.111:0/4170942638 >> v1:172.21.15.111:6816/39585 conn(0x7f5b90038da0 legacy=0x7f5b9003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:15.751 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.747+0000 7f5bb5d95700 1 -- 172.21.15.111:0/4170942638 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5bb0066170 msgr2=0x7f5bb0138350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:15.752 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.747+0000 7f5bb5d95700 1 --2- 172.21.15.111:0/4170942638 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5bb0066170 0x7f5bb0138350 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f5ba4000bc0 tx=0x7f5ba4007c00).stop 2024-04-25T02:20:15.752 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.747+0000 7f5bb5d95700 1 -- 172.21.15.111:0/4170942638 shutdown_connections 2024-04-25T02:20:15.752 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.747+0000 7f5bb5d95700 1 --2- 172.21.15.111:0/4170942638 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5bb0067c20 0x7f5bb0138840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:15.752 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.747+0000 7f5bb5d95700 1 --2- 172.21.15.111:0/4170942638 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5bb005c1a0 0x7f5bb0137620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:15.752 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.747+0000 7f5bb5d95700 1 --2- 172.21.15.111:0/4170942638 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5bb0066170 0x7f5bb0138350 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:15.752 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.747+0000 7f5bb5d95700 1 -- 172.21.15.111:0/4170942638 >> 172.21.15.111:0/4170942638 conn(0x7f5bb00a8a00 msgr2=0x7f5bb0136bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:15.752 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.747+0000 7f5bb5d95700 1 -- 172.21.15.111:0/4170942638 shutdown_connections 2024-04-25T02:20:15.752 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.747+0000 7f5bb5d95700 1 -- 172.21.15.111:0/4170942638 wait complete. 2024-04-25T02:20:15.762 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-04-25T02:20:07.471248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T02:20:14.420378+0000', 'flags': 32769, 'flags_names': 'hashpspool,creating', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '13', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2024-04-25T02:20:15.762 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-04-25T02:20:15.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.863+0000 7fb722637700 1 Processor -- start 2024-04-25T02:20:15.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.863+0000 7fb722637700 1 -- start start 2024-04-25T02:20:15.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.863+0000 7fb722637700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fb71c05c1a0 0x7fb71c067040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:15.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.863+0000 7fb722637700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb71c067c20 0x7fb71c05c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:15.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.863+0000 7fb722637700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb71c065c90 con 0x7fb71c066170 2024-04-25T02:20:15.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.863+0000 7fb722637700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb71c05ca70 con 0x7fb71c05c1a0 2024-04-25T02:20:15.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.863+0000 7fb722637700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c067680 con 0x7fb71c067c20 2024-04-25T02:20:15.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.864+0000 7fb71b7fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb71c067c20 0x7fb71c05c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:15.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.864+0000 7fb71b7fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb71c067c20 0x7fb71c05c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:36974/0 (socket says 172.21.15.111:36974) 2024-04-25T02:20:15.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.864+0000 7fb71b7fe700 1 -- 172.21.15.111:0/3838393512 learned_addr learned my addr 172.21.15.111:0/3838393512 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:15.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.864+0000 7fb71bfff700 1 --2- 172.21.15.111:0/3838393512 >> v2:172.21.15.111:3300/0 conn(0x7fb71c05c1a0 0x7fb71c067040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:15.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.864+0000 7fb71bfff700 1 -- 172.21.15.111:0/3838393512 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb71c067c20 msgr2=0x7fb71c05c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:15.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.864+0000 7fb71bfff700 1 --2- 172.21.15.111:0/3838393512 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb71c067c20 0x7fb71c05c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:15.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.864+0000 7fb71bfff700 1 -- 172.21.15.111:0/3838393512 >> v1:172.21.15.111:6789/0 conn(0x7fb71c066170 legacy=0x7fb71c136350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:15.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.864+0000 7fb71bfff700 1 -- 172.21.15.111:0/3838393512 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb71c05ba50 con 0x7fb71c05c1a0 2024-04-25T02:20:15.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.864+0000 7fb71affd700 1 -- 172.21.15.111:0/3838393512 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1641424336 0 0) 0x7fb71c065c90 con 0x7fb71c066170 2024-04-25T02:20:15.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.864+0000 7fb71b7fe700 1 --2- 172.21.15.111:0/3838393512 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb71c067c20 0x7fb71c05c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:15.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.864+0000 7fb71bfff700 1 --2- 172.21.15.111:0/3838393512 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb71c05c1a0 0x7fb71c067040 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fb70c002f70 tx=0x7fb70c006df0).ready entity=mon.0 client_cookie=808debdfc8bbdc83 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:15.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.864+0000 7fb71affd700 1 -- 172.21.15.111:0/3838393512 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb70c00d570 con 0x7fb71c05c1a0 2024-04-25T02:20:15.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.864+0000 7fb71affd700 1 -- 172.21.15.111:0/3838393512 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb70c000e90 con 0x7fb71c05c1a0 2024-04-25T02:20:15.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.864+0000 7fb71affd700 1 -- 172.21.15.111:0/3838393512 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb70c00d8c0 con 0x7fb71c05c1a0 2024-04-25T02:20:15.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.865+0000 7fb722637700 1 -- 172.21.15.111:0/3838393512 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb71c05c1a0 msgr2=0x7fb71c067040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:15.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.865+0000 7fb722637700 1 --2- 172.21.15.111:0/3838393512 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb71c05c1a0 0x7fb71c067040 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fb70c002f70 tx=0x7fb70c006df0).stop 2024-04-25T02:20:15.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.865+0000 7fb722637700 1 -- 172.21.15.111:0/3838393512 shutdown_connections 2024-04-25T02:20:15.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.865+0000 7fb722637700 1 --2- 172.21.15.111:0/3838393512 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb71c05c1a0 0x7fb71c067040 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:15.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.865+0000 7fb722637700 1 --2- 172.21.15.111:0/3838393512 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb71c067c20 0x7fb71c05c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:15.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.865+0000 7fb722637700 1 -- 172.21.15.111:0/3838393512 >> 172.21.15.111:0/3838393512 conn(0x7fb71c0a8a00 msgr2=0x7fb71c0a8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:15.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.865+0000 7fb722637700 1 -- 172.21.15.111:0/3838393512 shutdown_connections 2024-04-25T02:20:15.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.865+0000 7fb722637700 1 -- 172.21.15.111:0/3838393512 wait complete. 2024-04-25T02:20:15.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.866+0000 7fb722637700 1 Processor -- start 2024-04-25T02:20:15.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.866+0000 7fb722637700 1 -- start start 2024-04-25T02:20:15.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.866+0000 7fb722637700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb71c05c1a0 0x7fb71c0937e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:15.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.866+0000 7fb722637700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb71c066170 0x7fb71c149150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:15.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.866+0000 7fb722637700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb71c067c20 0x7fb71c149640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:15.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.866+0000 7fb722637700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c0a1fc0 con 0x7fb71c067c20 2024-04-25T02:20:15.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.866+0000 7fb722637700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c0a2280 con 0x7fb71c05c1a0 2024-04-25T02:20:15.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.866+0000 7fb722637700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb71c0920b0 con 0x7fb71c066170 2024-04-25T02:20:15.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.866+0000 7fb71b7fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb71c066170 0x7fb71c149150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:15.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.866+0000 7fb720bd4700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb71c067c20 0x7fb71c149640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:15.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.866+0000 7fb71b7fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb71c066170 0x7fb71c149150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:51224/0 (socket says 172.21.15.111:51224) 2024-04-25T02:20:15.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.866+0000 7fb720bd4700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb71c067c20 0x7fb71c149640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44462/0 (socket says 172.21.15.111:44462) 2024-04-25T02:20:15.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.866+0000 7fb71b7fe700 1 -- 172.21.15.111:0/73930556 learned_addr learned my addr 172.21.15.111:0/73930556 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:15.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.867+0000 7fb71bfff700 1 --2- 172.21.15.111:0/73930556 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb71c05c1a0 0x7fb71c0937e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:15.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.867+0000 7fb720bd4700 1 -- 172.21.15.111:0/73930556 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb71c066170 msgr2=0x7fb71c149150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:15.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.867+0000 7fb720bd4700 1 --2- 172.21.15.111:0/73930556 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb71c066170 0x7fb71c149150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:15.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.867+0000 7fb720bd4700 1 -- 172.21.15.111:0/73930556 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb71c05c1a0 msgr2=0x7fb71c0937e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:15.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.867+0000 7fb720bd4700 1 --2- 172.21.15.111:0/73930556 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb71c05c1a0 0x7fb71c0937e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:15.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.867+0000 7fb720bd4700 1 -- 172.21.15.111:0/73930556 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb71000b1e0 con 0x7fb71c067c20 2024-04-25T02:20:15.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.867+0000 7fb71b7fe700 1 --2- 172.21.15.111:0/73930556 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb71c066170 0x7fb71c149150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:15.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.867+0000 7fb720bd4700 1 --2- 172.21.15.111:0/73930556 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb71c067c20 0x7fb71c149640 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fb714001250 tx=0x7fb714007d30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:15.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.867+0000 7fb7197fa700 1 -- 172.21.15.111:0/73930556 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb71400f470 con 0x7fb71c067c20 2024-04-25T02:20:15.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.867+0000 7fb7197fa700 1 -- 172.21.15.111:0/73930556 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb71400f5d0 con 0x7fb71c067c20 2024-04-25T02:20:15.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.867+0000 7fb7197fa700 1 -- 172.21.15.111:0/73930556 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb71400f930 con 0x7fb71c067c20 2024-04-25T02:20:15.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.867+0000 7fb722637700 1 -- 172.21.15.111:0/73930556 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb70c00b180 con 0x7fb71c067c20 2024-04-25T02:20:15.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.867+0000 7fb722637700 1 -- 172.21.15.111:0/73930556 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb71c13a210 con 0x7fb71c067c20 2024-04-25T02:20:15.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.868+0000 7fb7197fa700 1 -- 172.21.15.111:0/73930556 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fb714019030 con 0x7fb71c067c20 2024-04-25T02:20:15.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.868+0000 7fb722637700 1 -- 172.21.15.111:0/73930556 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb71c0930c0 con 0x7fb71c067c20 2024-04-25T02:20:15.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.868+0000 7fb7197fa700 1 -- 172.21.15.111:0/73930556 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2822+0+0 (secure 0 0 0) 0x7fb714049b60 con 0x7fb71c067c20 2024-04-25T02:20:15.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.871+0000 7fb7197fa700 1 -- 172.21.15.111:0/73930556 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fb71402edb0 con 0x7fb71c067c20 2024-04-25T02:20:15.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.981+0000 7fb722637700 1 -- 172.21.15.111:0/73930556 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fb71c05e4b0 con 0x7fb71c067c20 2024-04-25T02:20:15.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.981+0000 7fb7197fa700 1 -- 172.21.15.111:0/73930556 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v13) v1 ==== 110+0+10 (secure 0 0 0) 0x7fb7140323d0 con 0x7fb71c067c20 2024-04-25T02:20:15.986 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 1 2024-04-25T02:20:15.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.983+0000 7fb722637700 1 -- 172.21.15.111:0/73930556 >> v1:172.21.15.111:6816/39585 conn(0x7fb6fc038da0 legacy=0x7fb6fc03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:15.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.983+0000 7fb722637700 1 -- 172.21.15.111:0/73930556 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb71c067c20 msgr2=0x7fb71c149640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:15.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.983+0000 7fb722637700 1 --2- 172.21.15.111:0/73930556 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb71c067c20 0x7fb71c149640 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7fb714001250 tx=0x7fb714007d30).stop 2024-04-25T02:20:15.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.983+0000 7fb722637700 1 -- 172.21.15.111:0/73930556 shutdown_connections 2024-04-25T02:20:15.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.983+0000 7fb722637700 1 --2- 172.21.15.111:0/73930556 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb71c067c20 0x7fb71c149640 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:15.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.983+0000 7fb722637700 1 --2- 172.21.15.111:0/73930556 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb71c05c1a0 0x7fb71c0937e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:15.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.983+0000 7fb722637700 1 --2- 172.21.15.111:0/73930556 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb71c066170 0x7fb71c149150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:15.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.983+0000 7fb722637700 1 -- 172.21.15.111:0/73930556 >> 172.21.15.111:0/73930556 conn(0x7fb71c0a8a00 msgr2=0x7fb71c134a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:15.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.983+0000 7fb722637700 1 -- 172.21.15.111:0/73930556 shutdown_connections 2024-04-25T02:20:15.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:15.983+0000 7fb722637700 1 -- 172.21.15.111:0/73930556 wait complete. 2024-04-25T02:20:15.997 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T02:20:16.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.098+0000 7fe64624a700 1 Processor -- start 2024-04-25T02:20:16.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.098+0000 7fe64624a700 1 -- start start 2024-04-25T02:20:16.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.099+0000 7fe64624a700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe6401363c0 0x7fe6400a1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:16.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.099+0000 7fe64624a700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe6401367a0 0x7fe640136be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:16.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.099+0000 7fe64624a700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fe6401331e0 0x7fe640133690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:16.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.099+0000 7fe64624a700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6400a1a60 con 0x7fe6401331e0 2024-04-25T02:20:16.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.099+0000 7fe64624a700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6400a1570 con 0x7fe6401367a0 2024-04-25T02:20:16.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.099+0000 7fe64624a700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe6400a1ce0 con 0x7fe6401363c0 2024-04-25T02:20:16.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.099+0000 7fe63effd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe6401367a0 0x7fe640136be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:16.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.099+0000 7fe63ffff700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fe6401331e0 0x7fe640133690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:16.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.099+0000 7fe63effd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe6401367a0 0x7fe640136be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:36990/0 (socket says 172.21.15.111:36990) 2024-04-25T02:20:16.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.099+0000 7fe63effd700 1 -- 172.21.15.111:0/2731121371 learned_addr learned my addr 172.21.15.111:0/2731121371 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:16.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.099+0000 7fe63f7fe700 1 --2- 172.21.15.111:0/2731121371 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe6401363c0 0x7fe6400a1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:16.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.099+0000 7fe63effd700 1 -- 172.21.15.111:0/2731121371 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe6401363c0 msgr2=0x7fe6400a1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:16.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.099+0000 7fe63effd700 1 --2- 172.21.15.111:0/2731121371 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe6401363c0 0x7fe6400a1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:16.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.099+0000 7fe63effd700 1 -- 172.21.15.111:0/2731121371 >> v2:172.21.15.111:3300/0 conn(0x7fe6401331e0 msgr2=0x7fe640133690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:16.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.099+0000 7fe63effd700 1 --2- 172.21.15.111:0/2731121371 >> v2:172.21.15.111:3300/0 conn(0x7fe6401331e0 0x7fe640133690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:16.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.099+0000 7fe63effd700 1 -- 172.21.15.111:0/2731121371 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6400a2620 con 0x7fe6401367a0 2024-04-25T02:20:16.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.099+0000 7fe63ffff700 1 --2- 172.21.15.111:0/2731121371 >> v2:172.21.15.111:3300/0 conn(0x7fe6401331e0 0x7fe640133690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:16.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.099+0000 7fe63f7fe700 1 --2- 172.21.15.111:0/2731121371 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe6401363c0 0x7fe6400a1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:16.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.099+0000 7fe63effd700 1 --2- 172.21.15.111:0/2731121371 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe6401367a0 0x7fe640136be0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fe630002f70 tx=0x7fe630006eb0).ready entity=mon.1 client_cookie=a0a9af9745e9b8a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:16.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.099+0000 7fe63e7fc700 1 -- 172.21.15.111:0/2731121371 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe63000d570 con 0x7fe6401367a0 2024-04-25T02:20:16.111 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.099+0000 7fe63e7fc700 1 -- 172.21.15.111:0/2731121371 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe630000e90 con 0x7fe6401367a0 2024-04-25T02:20:16.111 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.099+0000 7fe63e7fc700 1 -- 172.21.15.111:0/2731121371 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe63000d900 con 0x7fe6401367a0 2024-04-25T02:20:16.111 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.100+0000 7fe64624a700 1 -- 172.21.15.111:0/2731121371 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe6401367a0 msgr2=0x7fe640136be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:16.111 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.100+0000 7fe64624a700 1 --2- 172.21.15.111:0/2731121371 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe6401367a0 0x7fe640136be0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fe630002f70 tx=0x7fe630006eb0).stop 2024-04-25T02:20:16.111 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.100+0000 7fe64624a700 1 -- 172.21.15.111:0/2731121371 shutdown_connections 2024-04-25T02:20:16.111 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.100+0000 7fe64624a700 1 --2- 172.21.15.111:0/2731121371 >> v2:172.21.15.111:3300/0 conn(0x7fe6401331e0 0x7fe640133690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:16.111 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.100+0000 7fe64624a700 1 --2- 172.21.15.111:0/2731121371 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe6401363c0 0x7fe6400a1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:16.111 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.100+0000 7fe64624a700 1 --2- 172.21.15.111:0/2731121371 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe6401367a0 0x7fe640136be0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:16.111 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.100+0000 7fe64624a700 1 -- 172.21.15.111:0/2731121371 >> 172.21.15.111:0/2731121371 conn(0x7fe6400a8a00 msgr2=0x7fe6400a8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:16.111 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.100+0000 7fe64624a700 1 -- 172.21.15.111:0/2731121371 shutdown_connections 2024-04-25T02:20:16.111 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.100+0000 7fe64624a700 1 -- 172.21.15.111:0/2731121371 wait complete. 2024-04-25T02:20:16.111 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.101+0000 7fe64624a700 1 Processor -- start 2024-04-25T02:20:16.111 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.101+0000 7fe64624a700 1 -- start start 2024-04-25T02:20:16.111 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.101+0000 7fe64624a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe6401331e0 0x7fe640062810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:16.112 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.101+0000 7fe64624a700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe6401363c0 0x7fe640062d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:16.112 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.101+0000 7fe64624a700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe6401367a0 0x7fe6400631f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:16.112 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.101+0000 7fe64624a700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6400636e0 con 0x7fe6401331e0 2024-04-25T02:20:16.112 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.101+0000 7fe64624a700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe640066e00 con 0x7fe6401367a0 2024-04-25T02:20:16.112 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.101+0000 7fe64624a700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe640066620 con 0x7fe6401363c0 2024-04-25T02:20:16.112 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.102+0000 7fe63effd700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe6401363c0 0x7fe640062d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:16.112 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.102+0000 7fe63effd700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe6401363c0 0x7fe640062d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:51240/0 (socket says 172.21.15.111:51240) 2024-04-25T02:20:16.112 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.102+0000 7fe63effd700 1 -- 172.21.15.111:0/3582867460 learned_addr learned my addr 172.21.15.111:0/3582867460 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:16.112 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.102+0000 7fe63ffff700 1 --2- 172.21.15.111:0/3582867460 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe6401367a0 0x7fe6400631f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:16.112 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.102+0000 7fe63f7fe700 1 --2- 172.21.15.111:0/3582867460 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe6401331e0 0x7fe640062810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:16.112 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.102+0000 7fe63effd700 1 -- 172.21.15.111:0/3582867460 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe6401367a0 msgr2=0x7fe6400631f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:16.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.102+0000 7fe63effd700 1 --2- 172.21.15.111:0/3582867460 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe6401367a0 0x7fe6400631f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:16.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.102+0000 7fe63effd700 1 -- 172.21.15.111:0/3582867460 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe6401331e0 msgr2=0x7fe640062810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:16.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.102+0000 7fe63effd700 1 --2- 172.21.15.111:0/3582867460 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe6401331e0 0x7fe640062810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:16.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.102+0000 7fe63effd700 1 -- 172.21.15.111:0/3582867460 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe63800b520 con 0x7fe6401363c0 2024-04-25T02:20:16.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.102+0000 7fe63f7fe700 1 --2- 172.21.15.111:0/3582867460 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe6401331e0 0x7fe640062810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:16.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.102+0000 7fe63ffff700 1 --2- 172.21.15.111:0/3582867460 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe6401367a0 0x7fe6400631f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:16.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.102+0000 7fe63effd700 1 --2- 172.21.15.111:0/3582867460 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe6401363c0 0x7fe640062d00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fe630002f70 tx=0x7fe630015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:16.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.102+0000 7fe63cff9700 1 -- 172.21.15.111:0/3582867460 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe6300116e0 con 0x7fe6401363c0 2024-04-25T02:20:16.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.102+0000 7fe63cff9700 1 -- 172.21.15.111:0/3582867460 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe630011840 con 0x7fe6401363c0 2024-04-25T02:20:16.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.102+0000 7fe64624a700 1 -- 172.21.15.111:0/3582867460 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe63400d590 con 0x7fe6401363c0 2024-04-25T02:20:16.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.102+0000 7fe63cff9700 1 -- 172.21.15.111:0/3582867460 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe630011ba0 con 0x7fe6401363c0 2024-04-25T02:20:16.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.102+0000 7fe64624a700 1 -- 172.21.15.111:0/3582867460 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe63000b1e0 con 0x7fe6401363c0 2024-04-25T02:20:16.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.103+0000 7fe63cff9700 1 -- 172.21.15.111:0/3582867460 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fe63001a040 con 0x7fe6401363c0 2024-04-25T02:20:16.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.103+0000 7fe64624a700 1 -- 172.21.15.111:0/3582867460 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe640066fd0 con 0x7fe6401363c0 2024-04-25T02:20:16.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.103+0000 7fe63cff9700 1 -- 172.21.15.111:0/3582867460 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2822+0+0 (secure 0 0 0) 0x7fe63004b1b0 con 0x7fe6401363c0 2024-04-25T02:20:16.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.106+0000 7fe63cff9700 1 -- 172.21.15.111:0/3582867460 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fe640066fd0 con 0x7fe6401363c0 2024-04-25T02:20:16.221 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.217+0000 7fe64624a700 1 -- 172.21.15.111:0/3582867460 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe6400a2620 con 0x7fe6401363c0 2024-04-25T02:20:16.221 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.217+0000 7fe63cff9700 1 -- 172.21.15.111:0/3582867460 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v13) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe6400a2620 con 0x7fe6401363c0 2024-04-25T02:20:16.222 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 8 2024-04-25T02:20:16.223 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.218+0000 7fe64624a700 1 -- 172.21.15.111:0/3582867460 >> v1:172.21.15.111:6816/39585 conn(0x7fe620038e60 legacy=0x7fe62003b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:16.223 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.218+0000 7fe64624a700 1 -- 172.21.15.111:0/3582867460 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe6401363c0 msgr2=0x7fe640062d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:16.223 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.218+0000 7fe64624a700 1 --2- 172.21.15.111:0/3582867460 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe6401363c0 0x7fe640062d00 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fe630002f70 tx=0x7fe630015000).stop 2024-04-25T02:20:16.223 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.218+0000 7fe64624a700 1 -- 172.21.15.111:0/3582867460 shutdown_connections 2024-04-25T02:20:16.223 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.219+0000 7fe64624a700 1 --2- 172.21.15.111:0/3582867460 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe6401367a0 0x7fe6400631f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:16.223 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.219+0000 7fe64624a700 1 --2- 172.21.15.111:0/3582867460 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe6401331e0 0x7fe640062810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:16.223 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.219+0000 7fe64624a700 1 --2- 172.21.15.111:0/3582867460 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe6401363c0 0x7fe640062d00 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:16.223 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.219+0000 7fe64624a700 1 -- 172.21.15.111:0/3582867460 >> 172.21.15.111:0/3582867460 conn(0x7fe6400a8a00 msgr2=0x7fe640130a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:16.223 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.219+0000 7fe64624a700 1 -- 172.21.15.111:0/3582867460 shutdown_connections 2024-04-25T02:20:16.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.219+0000 7fe64624a700 1 -- 172.21.15.111:0/3582867460 wait complete. 2024-04-25T02:20:16.234 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:20:16.342 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.332+0000 7fdfd58d9700 1 Processor -- start 2024-04-25T02:20:16.342 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.332+0000 7fdfd58d9700 1 -- start start 2024-04-25T02:20:16.342 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.332+0000 7fdfd58d9700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fdfd005da60 0x7fdfd013eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:16.342 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.332+0000 7fdfd58d9700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdfd012c6f0 0x7fdfd0141070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:16.342 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.332+0000 7fdfd58d9700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdfd01377e0 con 0x7fdfd012c310 2024-04-25T02:20:16.342 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.332+0000 7fdfd58d9700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdfd013a760 con 0x7fdfd005da60 2024-04-25T02:20:16.342 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.332+0000 7fdfd58d9700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd00a7770 con 0x7fdfd012c6f0 2024-04-25T02:20:16.342 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.333+0000 7fdfce7fc700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fdfd005da60 0x7fdfd013eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:16.342 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.333+0000 7fdfcf7fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdfd012c6f0 0x7fdfd0141070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:16.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.333+0000 7fdfceffd700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7fdfd012c310 0x7fdfd005cfa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:32834/0 (socket says 172.21.15.111:32834) 2024-04-25T02:20:16.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.333+0000 7fdfceffd700 1 -- 172.21.15.111:0/3163181899 learned_addr learned my addr 172.21.15.111:0/3163181899 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:20:16.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.333+0000 7fdfcdffb700 1 -- 172.21.15.111:0/3163181899 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1103984179 0 0) 0x7fdfd01377e0 con 0x7fdfd012c310 2024-04-25T02:20:16.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.333+0000 7fdfcf7fe700 1 -- 172.21.15.111:0/3163181899 >> v2:172.21.15.111:3300/0 conn(0x7fdfd005da60 msgr2=0x7fdfd013eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:16.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.333+0000 7fdfcf7fe700 1 --2- 172.21.15.111:0/3163181899 >> v2:172.21.15.111:3300/0 conn(0x7fdfd005da60 0x7fdfd013eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:16.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.333+0000 7fdfcf7fe700 1 -- 172.21.15.111:0/3163181899 >> v1:172.21.15.111:6789/0 conn(0x7fdfd012c310 legacy=0x7fdfd005cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:16.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.333+0000 7fdfcf7fe700 1 -- 172.21.15.111:0/3163181899 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfd005c420 con 0x7fdfd012c6f0 2024-04-25T02:20:16.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.333+0000 7fdfce7fc700 1 --2- 172.21.15.111:0/3163181899 >> v2:172.21.15.111:3300/0 conn(0x7fdfd005da60 0x7fdfd013eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:16.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.333+0000 7fdfcf7fe700 1 --2- 172.21.15.111:0/3163181899 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdfd012c6f0 0x7fdfd0141070 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fdfc80032f0 tx=0x7fdfc80091d0).ready entity=mon.1 client_cookie=9290dbef7e6d839d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:16.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.333+0000 7fdfcdffb700 1 -- 172.21.15.111:0/3163181899 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfc800b6c0 con 0x7fdfd012c6f0 2024-04-25T02:20:16.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.333+0000 7fdfcdffb700 1 -- 172.21.15.111:0/3163181899 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc800b820 con 0x7fdfd012c6f0 2024-04-25T02:20:16.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.333+0000 7fdfcdffb700 1 -- 172.21.15.111:0/3163181899 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfc800b990 con 0x7fdfd012c6f0 2024-04-25T02:20:16.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.334+0000 7fdfd58d9700 1 -- 172.21.15.111:0/3163181899 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdfd012c6f0 msgr2=0x7fdfd0141070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:16.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.334+0000 7fdfd58d9700 1 --2- 172.21.15.111:0/3163181899 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdfd012c6f0 0x7fdfd0141070 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fdfc80032f0 tx=0x7fdfc80091d0).stop 2024-04-25T02:20:16.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.334+0000 7fdfd58d9700 1 -- 172.21.15.111:0/3163181899 shutdown_connections 2024-04-25T02:20:16.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.334+0000 7fdfd58d9700 1 --2- 172.21.15.111:0/3163181899 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdfd012c6f0 0x7fdfd0141070 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:16.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.334+0000 7fdfd58d9700 1 --2- 172.21.15.111:0/3163181899 >> v2:172.21.15.111:3300/0 conn(0x7fdfd005da60 0x7fdfd013eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:16.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.334+0000 7fdfd58d9700 1 -- 172.21.15.111:0/3163181899 >> 172.21.15.111:0/3163181899 conn(0x7fdfd0066b10 msgr2=0x7fdfd006c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:16.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.334+0000 7fdfd58d9700 1 -- 172.21.15.111:0/3163181899 shutdown_connections 2024-04-25T02:20:16.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.334+0000 7fdfd58d9700 1 -- 172.21.15.111:0/3163181899 wait complete. 2024-04-25T02:20:16.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.335+0000 7fdfd58d9700 1 Processor -- start 2024-04-25T02:20:16.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.335+0000 7fdfd58d9700 1 -- start start 2024-04-25T02:20:16.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.335+0000 7fdfd58d9700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fdfd012c310 0x7fdfd00a5540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:16.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.335+0000 7fdfd58d9700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdfd012c6f0 0x7fdfd01490e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:16.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.335+0000 7fdfd58d9700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdfd00a5a30 0x7fdfd01495d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:16.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.335+0000 7fdfd58d9700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd012d3d0 con 0x7fdfd012c6f0 2024-04-25T02:20:16.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.335+0000 7fdfd58d9700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd00a2480 con 0x7fdfd00a5a30 2024-04-25T02:20:16.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.335+0000 7fdfd58d9700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdfd00a5030 con 0x7fdfd012c310 2024-04-25T02:20:16.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.335+0000 7fdfce7fc700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdfd012c6f0 0x7fdfd01490e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:16.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.335+0000 7fdfcf7fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdfd00a5a30 0x7fdfd01495d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:16.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.335+0000 7fdfce7fc700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdfd012c6f0 0x7fdfd01490e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44500/0 (socket says 172.21.15.111:44500) 2024-04-25T02:20:16.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.335+0000 7fdfce7fc700 1 -- 172.21.15.111:0/2003539464 learned_addr learned my addr 172.21.15.111:0/2003539464 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:16.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.335+0000 7fdfcf7fe700 1 --2- 172.21.15.111:0/2003539464 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdfd00a5a30 0x7fdfd01495d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:37014/0 (socket says 172.21.15.111:37014) 2024-04-25T02:20:16.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.335+0000 7fdfceffd700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fdfd012c310 0x7fdfd00a5540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:16.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.335+0000 7fdfce7fc700 1 -- 172.21.15.111:0/2003539464 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fdfd012c310 msgr2=0x7fdfd00a5540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:16.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.335+0000 7fdfce7fc700 1 --2- 172.21.15.111:0/2003539464 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fdfd012c310 0x7fdfd00a5540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:16.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.335+0000 7fdfce7fc700 1 -- 172.21.15.111:0/2003539464 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdfd00a5a30 msgr2=0x7fdfd01495d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:16.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.336+0000 7fdfce7fc700 1 --2- 172.21.15.111:0/2003539464 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdfd00a5a30 0x7fdfd01495d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:16.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.336+0000 7fdfce7fc700 1 -- 172.21.15.111:0/2003539464 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdfc400b180 con 0x7fdfd012c6f0 2024-04-25T02:20:16.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.336+0000 7fdfce7fc700 1 --2- 172.21.15.111:0/2003539464 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdfd012c6f0 0x7fdfd01490e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fdfc400c000 tx=0x7fdfc4006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:16.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.336+0000 7fdfbffff700 1 -- 172.21.15.111:0/2003539464 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfc400c5f0 con 0x7fdfd012c6f0 2024-04-25T02:20:16.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.336+0000 7fdfbffff700 1 -- 172.21.15.111:0/2003539464 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdfc400c750 con 0x7fdfd012c6f0 2024-04-25T02:20:16.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.336+0000 7fdfbffff700 1 -- 172.21.15.111:0/2003539464 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdfc400cab0 con 0x7fdfd012c6f0 2024-04-25T02:20:16.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.336+0000 7fdfd58d9700 1 -- 172.21.15.111:0/2003539464 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdfc8009470 con 0x7fdfd012c6f0 2024-04-25T02:20:16.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.336+0000 7fdfd58d9700 1 -- 172.21.15.111:0/2003539464 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdfd00a6550 con 0x7fdfd012c6f0 2024-04-25T02:20:16.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.337+0000 7fdfbffff700 1 -- 172.21.15.111:0/2003539464 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fdfc400cc10 con 0x7fdfd012c6f0 2024-04-25T02:20:16.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.337+0000 7fdfd58d9700 1 -- 172.21.15.111:0/2003539464 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdfd0137cb0 con 0x7fdfd012c6f0 2024-04-25T02:20:16.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.337+0000 7fdfbffff700 1 -- 172.21.15.111:0/2003539464 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(13..13 src has 1..13) v4 ==== 2822+0+0 (secure 0 0 0) 0x7fdfc404aa40 con 0x7fdfd012c6f0 2024-04-25T02:20:16.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.340+0000 7fdfbffff700 1 -- 172.21.15.111:0/2003539464 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fdfc40336c0 con 0x7fdfd012c6f0 2024-04-25T02:20:16.488 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.484+0000 7fdfd58d9700 1 -- 172.21.15.111:0/2003539464 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdfd0061c50 con 0x7fdfd012c6f0 2024-04-25T02:20:16.488 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.484+0000 7fdfbffff700 1 -- 172.21.15.111:0/2003539464 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+796 (secure 0 0 0) 0x7fdfc40332b0 con 0x7fdfd012c6f0 2024-04-25T02:20:16.488 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:20:16.488 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4193,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6817/3699616235","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6817","nonce":3699616235}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[]} 2024-04-25T02:20:16.490 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.486+0000 7fdfd58d9700 1 -- 172.21.15.111:0/2003539464 >> v1:172.21.15.111:6816/39585 conn(0x7fdfac038da0 legacy=0x7fdfac03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:16.490 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.486+0000 7fdfd58d9700 1 -- 172.21.15.111:0/2003539464 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdfd012c6f0 msgr2=0x7fdfd01490e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:16.490 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.486+0000 7fdfd58d9700 1 --2- 172.21.15.111:0/2003539464 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdfd012c6f0 0x7fdfd01490e0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fdfc400c000 tx=0x7fdfc4006df0).stop 2024-04-25T02:20:16.490 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.486+0000 7fdfd58d9700 1 -- 172.21.15.111:0/2003539464 shutdown_connections 2024-04-25T02:20:16.491 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.486+0000 7fdfd58d9700 1 --2- 172.21.15.111:0/2003539464 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdfd00a5a30 0x7fdfd01495d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:16.491 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.486+0000 7fdfd58d9700 1 --2- 172.21.15.111:0/2003539464 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fdfd012c310 0x7fdfd00a5540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:16.491 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.486+0000 7fdfd58d9700 1 --2- 172.21.15.111:0/2003539464 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdfd012c6f0 0x7fdfd01490e0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:16.491 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.486+0000 7fdfd58d9700 1 -- 172.21.15.111:0/2003539464 >> 172.21.15.111:0/2003539464 conn(0x7fdfd0066b10 msgr2=0x7fdfd005ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:16.491 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.486+0000 7fdfd58d9700 1 -- 172.21.15.111:0/2003539464 shutdown_connections 2024-04-25T02:20:16.491 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:16.486+0000 7fdfd58d9700 1 -- 172.21.15.111:0/2003539464 wait complete. 2024-04-25T02:20:16.491 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 2 2024-04-25T02:20:18.502 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:20:18.617 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.613+0000 7f60b410d700 1 Processor -- start 2024-04-25T02:20:18.618 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.614+0000 7f60b410d700 1 -- start start 2024-04-25T02:20:18.620 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.614+0000 7f60b410d700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f60ac139c10 0x7f60ac139ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:18.620 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.614+0000 7f60b410d700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f60ac097990 0x7f60ac05c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:18.620 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.614+0000 7f60b410d700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60ac13a4e0 con 0x7f60ac097580 2024-04-25T02:20:18.620 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.614+0000 7f60b410d700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60ac099610 con 0x7f60ac139c10 2024-04-25T02:20:18.620 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.614+0000 7f60b410d700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f60ac096f80 con 0x7f60ac097990 2024-04-25T02:20:18.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.614+0000 7f60b26aa700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f60ac097990 0x7f60ac05c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:18.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.614+0000 7f60b1ea9700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f60ac139c10 0x7f60ac139ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:18.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.614+0000 7f60b16a8700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f60ac097580 0x7f60ac05ba50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:32846/0 (socket says 172.21.15.111:32846) 2024-04-25T02:20:18.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.614+0000 7f60b16a8700 1 -- 172.21.15.111:0/2888451575 learned_addr learned my addr 172.21.15.111:0/2888451575 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:20:18.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.615+0000 7f60b26aa700 1 -- 172.21.15.111:0/2888451575 >> v2:172.21.15.111:3300/0 conn(0x7f60ac139c10 msgr2=0x7f60ac139ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:18.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.615+0000 7f60b26aa700 1 --2- 172.21.15.111:0/2888451575 >> v2:172.21.15.111:3300/0 conn(0x7f60ac139c10 0x7f60ac139ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:18.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.615+0000 7f60b26aa700 1 -- 172.21.15.111:0/2888451575 >> v1:172.21.15.111:6789/0 conn(0x7f60ac097580 legacy=0x7f60ac05ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:18.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.615+0000 7f60b26aa700 1 -- 172.21.15.111:0/2888451575 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60ac139730 con 0x7f60ac097990 2024-04-25T02:20:18.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.615+0000 7f60b0ea7700 1 -- 172.21.15.111:0/2888451575 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1215943082 0 0) 0x7f60ac13a4e0 con 0x7f60ac097580 2024-04-25T02:20:18.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.615+0000 7f60b1ea9700 1 --2- 172.21.15.111:0/2888451575 >> v2:172.21.15.111:3300/0 conn(0x7f60ac139c10 0x7f60ac139ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:18.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.615+0000 7f60b26aa700 1 --2- 172.21.15.111:0/2888451575 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f60ac097990 0x7f60ac05c160 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f60a40032f0 tx=0x7f60a40091d0).ready entity=mon.2 client_cookie=d664c01e07724f13 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:18.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.615+0000 7f60b0ea7700 1 -- 172.21.15.111:0/2888451575 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60a400b6c0 con 0x7f60ac097990 2024-04-25T02:20:18.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.615+0000 7f60b0ea7700 1 -- 172.21.15.111:0/2888451575 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a400b820 con 0x7f60ac097990 2024-04-25T02:20:18.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.615+0000 7f60b0ea7700 1 -- 172.21.15.111:0/2888451575 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60a400b990 con 0x7f60ac097990 2024-04-25T02:20:18.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.615+0000 7f60b410d700 1 -- 172.21.15.111:0/2888451575 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f60ac097990 msgr2=0x7f60ac05c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:18.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.615+0000 7f60b410d700 1 --2- 172.21.15.111:0/2888451575 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f60ac097990 0x7f60ac05c160 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f60a40032f0 tx=0x7f60a40091d0).stop 2024-04-25T02:20:18.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.615+0000 7f60b410d700 1 -- 172.21.15.111:0/2888451575 shutdown_connections 2024-04-25T02:20:18.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.615+0000 7f60b410d700 1 --2- 172.21.15.111:0/2888451575 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f60ac097990 0x7f60ac05c160 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:18.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.615+0000 7f60b410d700 1 --2- 172.21.15.111:0/2888451575 >> v2:172.21.15.111:3300/0 conn(0x7f60ac139c10 0x7f60ac139ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:18.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.615+0000 7f60b410d700 1 -- 172.21.15.111:0/2888451575 >> 172.21.15.111:0/2888451575 conn(0x7f60ac0614e0 msgr2=0x7f60ac06c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:18.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.616+0000 7f60b410d700 1 -- 172.21.15.111:0/2888451575 shutdown_connections 2024-04-25T02:20:18.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.616+0000 7f60b410d700 1 -- 172.21.15.111:0/2888451575 wait complete. 2024-04-25T02:20:18.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.616+0000 7f60b410d700 1 Processor -- start 2024-04-25T02:20:18.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.616+0000 7f60b410d700 1 -- start start 2024-04-25T02:20:18.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.617+0000 7f60b410d700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f60ac097580 0x7f60ac135310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:18.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.617+0000 7f60b410d700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f60ac097990 0x7f60ac145fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:18.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.617+0000 7f60b410d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f60ac139c10 0x7f60ac062d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:18.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.617+0000 7f60b410d700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60ac063a20 con 0x7f60ac139c10 2024-04-25T02:20:18.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.617+0000 7f60b410d700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60ac1458c0 con 0x7f60ac097580 2024-04-25T02:20:18.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.617+0000 7f60b410d700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f60ac145b60 con 0x7f60ac097990 2024-04-25T02:20:18.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.617+0000 7f60b16a8700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f60ac097990 0x7f60ac145fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:18.625 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.617+0000 7f60b26aa700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f60ac139c10 0x7f60ac062d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:18.625 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.617+0000 7f60b26aa700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f60ac139c10 0x7f60ac062d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44514/0 (socket says 172.21.15.111:44514) 2024-04-25T02:20:18.625 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.617+0000 7f60b26aa700 1 -- 172.21.15.111:0/1371267857 learned_addr learned my addr 172.21.15.111:0/1371267857 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:18.625 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.617+0000 7f60b1ea9700 1 --2- 172.21.15.111:0/1371267857 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f60ac097580 0x7f60ac135310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:18.625 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.617+0000 7f60b26aa700 1 -- 172.21.15.111:0/1371267857 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f60ac097990 msgr2=0x7f60ac145fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:18.625 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.617+0000 7f60b26aa700 1 --2- 172.21.15.111:0/1371267857 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f60ac097990 0x7f60ac145fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:18.625 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.617+0000 7f60b26aa700 1 -- 172.21.15.111:0/1371267857 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f60ac097580 msgr2=0x7f60ac135310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:18.625 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.617+0000 7f60b26aa700 1 --2- 172.21.15.111:0/1371267857 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f60ac097580 0x7f60ac135310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:18.625 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.617+0000 7f60b26aa700 1 -- 172.21.15.111:0/1371267857 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f609c00b180 con 0x7f60ac139c10 2024-04-25T02:20:18.625 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.617+0000 7f60b16a8700 1 --2- 172.21.15.111:0/1371267857 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f60ac097990 0x7f60ac145fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:18.625 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.617+0000 7f60b26aa700 1 --2- 172.21.15.111:0/1371267857 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f60ac139c10 0x7f60ac062d70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f60a40032f0 tx=0x7f60a4016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:18.625 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.618+0000 7f609affd700 1 -- 172.21.15.111:0/1371267857 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60a400b990 con 0x7f60ac139c10 2024-04-25T02:20:18.625 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.618+0000 7f609affd700 1 -- 172.21.15.111:0/1371267857 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60a4021630 con 0x7f60ac139c10 2024-04-25T02:20:18.625 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.618+0000 7f60b410d700 1 -- 172.21.15.111:0/1371267857 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60a4009470 con 0x7f60ac139c10 2024-04-25T02:20:18.626 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.618+0000 7f609affd700 1 -- 172.21.15.111:0/1371267857 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f60a400b6c0 con 0x7f60ac139c10 2024-04-25T02:20:18.626 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.618+0000 7f60b410d700 1 -- 172.21.15.111:0/1371267857 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60ac1390d0 con 0x7f60ac139c10 2024-04-25T02:20:18.626 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.619+0000 7f609affd700 1 -- 172.21.15.111:0/1371267857 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f60a4027020 con 0x7f60ac139c10 2024-04-25T02:20:18.626 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.619+0000 7f609affd700 1 -- 172.21.15.111:0/1371267857 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2822+0+0 (secure 0 0 0) 0x7f60a404b960 con 0x7f60ac139c10 2024-04-25T02:20:18.626 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.619+0000 7f60b410d700 1 -- 172.21.15.111:0/1371267857 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60ac1399f0 con 0x7f60ac139c10 2024-04-25T02:20:18.626 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.622+0000 7f609affd700 1 -- 172.21.15.111:0/1371267857 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f60a4021bc0 con 0x7f60ac139c10 2024-04-25T02:20:18.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.761+0000 7f60b410d700 1 -- 172.21.15.111:0/1371267857 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f60ac057a60 con 0x7f60ac139c10 2024-04-25T02:20:18.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.762+0000 7f609affd700 1 -- 172.21.15.111:0/1371267857 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+796 (secure 0 0 0) 0x7f60a4008e10 con 0x7f60ac139c10 2024-04-25T02:20:18.766 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:20:18.766 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4193,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6817/3699616235","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6817","nonce":3699616235}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[]} 2024-04-25T02:20:18.768 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.763+0000 7f60b410d700 1 -- 172.21.15.111:0/1371267857 >> v1:172.21.15.111:6816/39585 conn(0x7f608c038da0 legacy=0x7f608c03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:18.768 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.763+0000 7f60b410d700 1 -- 172.21.15.111:0/1371267857 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f60ac139c10 msgr2=0x7f60ac062d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:18.768 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.763+0000 7f60b410d700 1 --2- 172.21.15.111:0/1371267857 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f60ac139c10 0x7f60ac062d70 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f60a40032f0 tx=0x7f60a4016000).stop 2024-04-25T02:20:18.768 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.763+0000 7f60b410d700 1 -- 172.21.15.111:0/1371267857 shutdown_connections 2024-04-25T02:20:18.768 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.763+0000 7f60b410d700 1 --2- 172.21.15.111:0/1371267857 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f60ac139c10 0x7f60ac062d70 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:18.768 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.763+0000 7f60b410d700 1 --2- 172.21.15.111:0/1371267857 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f60ac097580 0x7f60ac135310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:18.768 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.763+0000 7f60b410d700 1 --2- 172.21.15.111:0/1371267857 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f60ac097990 0x7f60ac145fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:18.768 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.763+0000 7f60b410d700 1 -- 172.21.15.111:0/1371267857 >> 172.21.15.111:0/1371267857 conn(0x7f60ac0614e0 msgr2=0x7f60ac0983b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:18.768 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.763+0000 7f60b410d700 1 -- 172.21.15.111:0/1371267857 shutdown_connections 2024-04-25T02:20:18.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:18.763+0000 7f60b410d700 1 -- 172.21.15.111:0/1371267857 wait complete. 2024-04-25T02:20:18.769 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 2 2024-04-25T02:20:20.778 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:20:20.894 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.890+0000 7fea46887700 1 Processor -- start 2024-04-25T02:20:20.894 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.890+0000 7fea46887700 1 -- start start 2024-04-25T02:20:20.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.890+0000 7fea46887700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fea4005c1a0 0x7fea40067040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:20.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.890+0000 7fea46887700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fea40066170 0x7fea4005c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:20.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.890+0000 7fea46887700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea40065c90 con 0x7fea40067c20 2024-04-25T02:20:20.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.890+0000 7fea46887700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea4005ca70 con 0x7fea4005c1a0 2024-04-25T02:20:20.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.890+0000 7fea46887700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea40067680 con 0x7fea40066170 2024-04-25T02:20:20.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.890+0000 7fea44e24700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fea40066170 0x7fea4005c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:20.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.890+0000 7fea3ffff700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fea4005c1a0 0x7fea40067040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:20.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.890+0000 7fea44e24700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fea40066170 0x7fea4005c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:59910/0 (socket says 172.21.15.111:59910) 2024-04-25T02:20:20.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.890+0000 7fea44e24700 1 -- 172.21.15.111:0/2139401642 learned_addr learned my addr 172.21.15.111:0/2139401642 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:20.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.890+0000 7fea3f7fe700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7fea40067c20 0x7fea40136350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:44162/0 (socket says 172.21.15.111:44162) 2024-04-25T02:20:20.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.891+0000 7fea44e24700 1 -- 172.21.15.111:0/2139401642 >> v2:172.21.15.111:3300/0 conn(0x7fea4005c1a0 msgr2=0x7fea40067040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:20.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.891+0000 7fea44e24700 1 --2- 172.21.15.111:0/2139401642 >> v2:172.21.15.111:3300/0 conn(0x7fea4005c1a0 0x7fea40067040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:20.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.891+0000 7fea44e24700 1 -- 172.21.15.111:0/2139401642 >> v1:172.21.15.111:6789/0 conn(0x7fea40067c20 legacy=0x7fea40136350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:20.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.891+0000 7fea44e24700 1 -- 172.21.15.111:0/2139401642 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea4005ba50 con 0x7fea40066170 2024-04-25T02:20:20.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.891+0000 7fea3effd700 1 -- 172.21.15.111:0/2139401642 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 186171941 0 0) 0x7fea40065c90 con 0x7fea40067c20 2024-04-25T02:20:20.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.891+0000 7fea3ffff700 1 --2- 172.21.15.111:0/2139401642 >> v2:172.21.15.111:3300/0 conn(0x7fea4005c1a0 0x7fea40067040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:20.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.891+0000 7fea44e24700 1 --2- 172.21.15.111:0/2139401642 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fea40066170 0x7fea4005c580 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fea400a6e90 tx=0x7fea38009290).ready entity=mon.2 client_cookie=8b7cb7bba4146952 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:20.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.891+0000 7fea3effd700 1 -- 172.21.15.111:0/2139401642 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea3800b820 con 0x7fea40066170 2024-04-25T02:20:20.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.891+0000 7fea3effd700 1 -- 172.21.15.111:0/2139401642 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea3800b980 con 0x7fea40066170 2024-04-25T02:20:20.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.891+0000 7fea3effd700 1 -- 172.21.15.111:0/2139401642 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea3800baf0 con 0x7fea40066170 2024-04-25T02:20:20.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.891+0000 7fea46887700 1 -- 172.21.15.111:0/2139401642 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fea40066170 msgr2=0x7fea4005c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:20.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.892+0000 7fea46887700 1 --2- 172.21.15.111:0/2139401642 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fea40066170 0x7fea4005c580 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fea400a6e90 tx=0x7fea38009290).stop 2024-04-25T02:20:20.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.892+0000 7fea46887700 1 -- 172.21.15.111:0/2139401642 shutdown_connections 2024-04-25T02:20:20.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.892+0000 7fea46887700 1 --2- 172.21.15.111:0/2139401642 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fea40066170 0x7fea4005c580 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:20.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.892+0000 7fea46887700 1 --2- 172.21.15.111:0/2139401642 >> v2:172.21.15.111:3300/0 conn(0x7fea4005c1a0 0x7fea40067040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:20.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.892+0000 7fea46887700 1 -- 172.21.15.111:0/2139401642 >> 172.21.15.111:0/2139401642 conn(0x7fea400a8a00 msgr2=0x7fea400a8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:20.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.892+0000 7fea46887700 1 -- 172.21.15.111:0/2139401642 shutdown_connections 2024-04-25T02:20:20.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.892+0000 7fea46887700 1 -- 172.21.15.111:0/2139401642 wait complete. 2024-04-25T02:20:20.900 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.893+0000 7fea46887700 1 Processor -- start 2024-04-25T02:20:20.900 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.893+0000 7fea46887700 1 -- start start 2024-04-25T02:20:20.900 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.894+0000 7fea46887700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fea4005c1a0 0x7fea40094bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:20.900 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.894+0000 7fea46887700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fea40066170 0x7fea40096090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:20.900 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.894+0000 7fea46887700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fea40067c20 0x7fea400920b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:20.900 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.894+0000 7fea46887700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea400950a0 con 0x7fea40067c20 2024-04-25T02:20:20.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.894+0000 7fea46887700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea40095970 con 0x7fea40066170 2024-04-25T02:20:20.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.894+0000 7fea46887700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fea400937a0 con 0x7fea4005c1a0 2024-04-25T02:20:20.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.894+0000 7fea3ffff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fea4005c1a0 0x7fea40094bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:20.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.894+0000 7fea44e24700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fea40067c20 0x7fea400920b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:20.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.894+0000 7fea3ffff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fea4005c1a0 0x7fea40094bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:59914/0 (socket says 172.21.15.111:59914) 2024-04-25T02:20:20.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.894+0000 7fea3ffff700 1 -- 172.21.15.111:0/1447217800 learned_addr learned my addr 172.21.15.111:0/1447217800 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:20.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.894+0000 7fea3f7fe700 1 --2- 172.21.15.111:0/1447217800 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fea40066170 0x7fea40096090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:20.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.894+0000 7fea44e24700 1 -- 172.21.15.111:0/1447217800 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fea4005c1a0 msgr2=0x7fea40094bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:20.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.894+0000 7fea44e24700 1 --2- 172.21.15.111:0/1447217800 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fea4005c1a0 0x7fea40094bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:20.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.894+0000 7fea44e24700 1 -- 172.21.15.111:0/1447217800 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fea40066170 msgr2=0x7fea40096090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:20.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.894+0000 7fea44e24700 1 --2- 172.21.15.111:0/1447217800 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fea40066170 0x7fea40096090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:20.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.894+0000 7fea44e24700 1 -- 172.21.15.111:0/1447217800 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea3000b180 con 0x7fea40067c20 2024-04-25T02:20:20.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.894+0000 7fea3ffff700 1 --2- 172.21.15.111:0/1447217800 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fea4005c1a0 0x7fea40094bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:20.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.894+0000 7fea3f7fe700 1 --2- 172.21.15.111:0/1447217800 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fea40066170 0x7fea40096090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:20.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.894+0000 7fea44e24700 1 --2- 172.21.15.111:0/1447217800 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fea40067c20 0x7fea400920b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fea400a6e90 tx=0x7fea38016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:20.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.894+0000 7fea3d7fa700 1 -- 172.21.15.111:0/1447217800 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea38021630 con 0x7fea40067c20 2024-04-25T02:20:20.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.894+0000 7fea3d7fa700 1 -- 172.21.15.111:0/1447217800 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea38021790 con 0x7fea40067c20 2024-04-25T02:20:20.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.894+0000 7fea46887700 1 -- 172.21.15.111:0/1447217800 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea38009530 con 0x7fea40067c20 2024-04-25T02:20:20.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.894+0000 7fea3d7fa700 1 -- 172.21.15.111:0/1447217800 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fea38021b30 con 0x7fea40067c20 2024-04-25T02:20:20.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.894+0000 7fea46887700 1 -- 172.21.15.111:0/1447217800 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea40096580 con 0x7fea40067c20 2024-04-25T02:20:20.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.895+0000 7fea3d7fa700 1 -- 172.21.15.111:0/1447217800 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fea3800f070 con 0x7fea40067c20 2024-04-25T02:20:20.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.895+0000 7fea46887700 1 -- 172.21.15.111:0/1447217800 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea4005e470 con 0x7fea40067c20 2024-04-25T02:20:20.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.895+0000 7fea3d7fa700 1 -- 172.21.15.111:0/1447217800 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2822+0+0 (secure 0 0 0) 0x7fea3804bb50 con 0x7fea40067c20 2024-04-25T02:20:20.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:20.898+0000 7fea3d7fa700 1 -- 172.21.15.111:0/1447217800 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fea38002450 con 0x7fea40067c20 2024-04-25T02:20:21.042 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.038+0000 7fea46887700 1 -- 172.21.15.111:0/1447217800 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fea400a5710 con 0x7fea40067c20 2024-04-25T02:20:21.043 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.039+0000 7fea3d7fa700 1 -- 172.21.15.111:0/1447217800 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+1384 (secure 0 0 0) 0x7fea38015020 con 0x7fea40067c20 2024-04-25T02:20:21.043 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:20:21.043 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4193,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6817/3699616235","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6817","nonce":3699616235}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2},{"gid":4236,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.111:6818/2165982859","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6818","nonce":2165982859}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3},{"gid":4239,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":2,"addr":"172.21.15.111:6819/4003866251","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6819","nonce":4003866251}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":3}],"filesystems":[]} 2024-04-25T02:20:21.044 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.040+0000 7fea46887700 1 -- 172.21.15.111:0/1447217800 >> v1:172.21.15.111:6816/39585 conn(0x7fea20038da0 legacy=0x7fea2003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:21.044 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.040+0000 7fea46887700 1 -- 172.21.15.111:0/1447217800 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fea40067c20 msgr2=0x7fea400920b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:21.045 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.040+0000 7fea46887700 1 --2- 172.21.15.111:0/1447217800 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fea40067c20 0x7fea400920b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fea400a6e90 tx=0x7fea38016000).stop 2024-04-25T02:20:21.045 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.040+0000 7fea46887700 1 -- 172.21.15.111:0/1447217800 shutdown_connections 2024-04-25T02:20:21.045 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.040+0000 7fea46887700 1 --2- 172.21.15.111:0/1447217800 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fea40067c20 0x7fea400920b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:21.045 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.040+0000 7fea46887700 1 --2- 172.21.15.111:0/1447217800 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fea4005c1a0 0x7fea40094bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:21.045 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.040+0000 7fea46887700 1 --2- 172.21.15.111:0/1447217800 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fea40066170 0x7fea40096090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:21.045 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.040+0000 7fea46887700 1 -- 172.21.15.111:0/1447217800 >> 172.21.15.111:0/1447217800 conn(0x7fea400a8a00 msgr2=0x7fea4013a290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:21.045 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.040+0000 7fea46887700 1 -- 172.21.15.111:0/1447217800 shutdown_connections 2024-04-25T02:20:21.045 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.040+0000 7fea46887700 1 -- 172.21.15.111:0/1447217800 wait complete. 2024-04-25T02:20:21.045 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 3 2024-04-25T02:20:21.055 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:20:21.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.153+0000 7fbcbaef5700 1 Processor -- start 2024-04-25T02:20:21.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.153+0000 7fbcbaef5700 1 -- start start 2024-04-25T02:20:21.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.154+0000 7fbcbaef5700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbcb4139c10 0x7fbcb4139ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:21.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.154+0000 7fbcbaef5700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fbcb4097580 0x7fbcb405ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:21.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.154+0000 7fbcbaef5700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fbcb4097960 0x7fbcb405bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:21.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.154+0000 7fbcbaef5700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbcb4099610 con 0x7fbcb4097580 2024-04-25T02:20:21.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.154+0000 7fbcbaef5700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb413a4e0 con 0x7fbcb4139c10 2024-04-25T02:20:21.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.154+0000 7fbcbaef5700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb4096f80 con 0x7fbcb4097960 2024-04-25T02:20:21.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.154+0000 7fbcb3fff700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fbcb4097580 0x7fbcb405ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:21.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.154+0000 7fbcb8c91700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbcb4139c10 0x7fbcb4139ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:21.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.154+0000 7fbcb9492700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fbcb4097960 0x7fbcb405bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:21.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.154+0000 7fbcb8c91700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbcb4139c10 0x7fbcb4139ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:57116/0 (socket says 172.21.15.111:57116) 2024-04-25T02:20:21.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.154+0000 7fbcb3fff700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fbcb4097580 0x7fbcb405ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:39414/0 (socket says 172.21.15.111:39414) 2024-04-25T02:20:21.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.154+0000 7fbcb8c91700 1 -- 172.21.15.111:0/1486679201 learned_addr learned my addr 172.21.15.111:0/1486679201 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:21.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.154+0000 7fbcb9492700 1 -- 172.21.15.111:0/1486679201 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbcb4139c10 msgr2=0x7fbcb4139ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:21.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.154+0000 7fbcb9492700 1 --2- 172.21.15.111:0/1486679201 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbcb4139c10 0x7fbcb4139ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:21.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.154+0000 7fbcb9492700 1 -- 172.21.15.111:0/1486679201 >> v2:172.21.15.111:3300/0 conn(0x7fbcb4097580 msgr2=0x7fbcb405ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:21.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.154+0000 7fbcb9492700 1 --2- 172.21.15.111:0/1486679201 >> v2:172.21.15.111:3300/0 conn(0x7fbcb4097580 0x7fbcb405ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:21.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.154+0000 7fbcb9492700 1 -- 172.21.15.111:0/1486679201 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcb4139730 con 0x7fbcb4097960 2024-04-25T02:20:21.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.154+0000 7fbcb3fff700 1 --2- 172.21.15.111:0/1486679201 >> v2:172.21.15.111:3300/0 conn(0x7fbcb4097580 0x7fbcb405ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:21.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.154+0000 7fbcb8c91700 1 --2- 172.21.15.111:0/1486679201 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbcb4139c10 0x7fbcb4139ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:21.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.154+0000 7fbcb9492700 1 --2- 172.21.15.111:0/1486679201 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fbcb4097960 0x7fbcb405bf40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fbcb4060f80 tx=0x7fbcac0091d0).ready entity=mon.2 client_cookie=ab5bb29574e6dcad server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:21.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.154+0000 7fbcb37fe700 1 -- 172.21.15.111:0/1486679201 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcac00b600 con 0x7fbcb4097960 2024-04-25T02:20:21.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.155+0000 7fbcb37fe700 1 -- 172.21.15.111:0/1486679201 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcac00b760 con 0x7fbcb4097960 2024-04-25T02:20:21.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.155+0000 7fbcb37fe700 1 -- 172.21.15.111:0/1486679201 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbcac00b8d0 con 0x7fbcb4097960 2024-04-25T02:20:21.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.155+0000 7fbcbaef5700 1 -- 172.21.15.111:0/1486679201 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fbcb4097960 msgr2=0x7fbcb405bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:21.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.155+0000 7fbcbaef5700 1 --2- 172.21.15.111:0/1486679201 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fbcb4097960 0x7fbcb405bf40 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fbcb4060f80 tx=0x7fbcac0091d0).stop 2024-04-25T02:20:21.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.155+0000 7fbcbaef5700 1 -- 172.21.15.111:0/1486679201 shutdown_connections 2024-04-25T02:20:21.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.155+0000 7fbcbaef5700 1 --2- 172.21.15.111:0/1486679201 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fbcb4097960 0x7fbcb405bf40 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:21.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.155+0000 7fbcbaef5700 1 --2- 172.21.15.111:0/1486679201 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbcb4139c10 0x7fbcb4139ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:21.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.155+0000 7fbcbaef5700 1 --2- 172.21.15.111:0/1486679201 >> v2:172.21.15.111:3300/0 conn(0x7fbcb4097580 0x7fbcb405ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:21.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.155+0000 7fbcbaef5700 1 -- 172.21.15.111:0/1486679201 >> 172.21.15.111:0/1486679201 conn(0x7fbcb40614e0 msgr2=0x7fbcb406c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:21.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.155+0000 7fbcbaef5700 1 -- 172.21.15.111:0/1486679201 shutdown_connections 2024-04-25T02:20:21.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.155+0000 7fbcbaef5700 1 -- 172.21.15.111:0/1486679201 wait complete. 2024-04-25T02:20:21.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.156+0000 7fbcbaef5700 1 Processor -- start 2024-04-25T02:20:21.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.156+0000 7fbcbaef5700 1 -- start start 2024-04-25T02:20:21.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.157+0000 7fbcbaef5700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbcb4097580 0x7fbcb4067660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:21.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.157+0000 7fbcbaef5700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbcb4097960 0x7fbcb4130a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:21.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.157+0000 7fbcbaef5700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fbcb4139c10 0x7fbcb4130f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:21.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.157+0000 7fbcbaef5700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb4066a70 con 0x7fbcb4097580 2024-04-25T02:20:21.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.157+0000 7fbcbaef5700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb4149230 con 0x7fbcb4097960 2024-04-25T02:20:21.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.157+0000 7fbcbaef5700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbcb41494f0 con 0x7fbcb4139c10 2024-04-25T02:20:21.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.157+0000 7fbcb8c91700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbcb4097580 0x7fbcb4067660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:21.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.157+0000 7fbcb8c91700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbcb4097580 0x7fbcb4067660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:39422/0 (socket says 172.21.15.111:39422) 2024-04-25T02:20:21.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.157+0000 7fbcb8c91700 1 -- 172.21.15.111:0/297700577 learned_addr learned my addr 172.21.15.111:0/297700577 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:21.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.157+0000 7fbcb9492700 1 --2- 172.21.15.111:0/297700577 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fbcb4139c10 0x7fbcb4130f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:21.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.157+0000 7fbcb3fff700 1 --2- 172.21.15.111:0/297700577 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbcb4097960 0x7fbcb4130a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:21.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.157+0000 7fbcb8c91700 1 -- 172.21.15.111:0/297700577 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fbcb4139c10 msgr2=0x7fbcb4130f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:21.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.157+0000 7fbcb8c91700 1 --2- 172.21.15.111:0/297700577 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fbcb4139c10 0x7fbcb4130f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:21.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.157+0000 7fbcb8c91700 1 -- 172.21.15.111:0/297700577 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbcb4097960 msgr2=0x7fbcb4130a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:21.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.157+0000 7fbcb8c91700 1 --2- 172.21.15.111:0/297700577 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbcb4097960 0x7fbcb4130a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:21.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.157+0000 7fbcb8c91700 1 -- 172.21.15.111:0/297700577 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbca000b180 con 0x7fbcb4097580 2024-04-25T02:20:21.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.157+0000 7fbcb8c91700 1 --2- 172.21.15.111:0/297700577 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbcb4097580 0x7fbcb4067660 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fbca800c000 tx=0x7fbca8006eb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:21.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.158+0000 7fbcb1ffb700 1 -- 172.21.15.111:0/297700577 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbca8012600 con 0x7fbcb4097580 2024-04-25T02:20:21.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.158+0000 7fbcb1ffb700 1 -- 172.21.15.111:0/297700577 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbca8012760 con 0x7fbcb4097580 2024-04-25T02:20:21.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.158+0000 7fbcbaef5700 1 -- 172.21.15.111:0/297700577 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbca800b1e0 con 0x7fbcb4097580 2024-04-25T02:20:21.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.158+0000 7fbcb1ffb700 1 -- 172.21.15.111:0/297700577 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbca8012ac0 con 0x7fbcb4097580 2024-04-25T02:20:21.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.158+0000 7fbcbaef5700 1 -- 172.21.15.111:0/297700577 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbcac009470 con 0x7fbcb4097580 2024-04-25T02:20:21.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.158+0000 7fbcb1ffb700 1 -- 172.21.15.111:0/297700577 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fbca8022070 con 0x7fbcb4097580 2024-04-25T02:20:21.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.159+0000 7fbcbaef5700 1 -- 172.21.15.111:0/297700577 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbcb4065e30 con 0x7fbcb4097580 2024-04-25T02:20:21.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.159+0000 7fbcb1ffb700 1 -- 172.21.15.111:0/297700577 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2822+0+0 (secure 0 0 0) 0x7fbca804a8e0 con 0x7fbcb4097580 2024-04-25T02:20:21.167 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.162+0000 7fbcb1ffb700 1 -- 172.21.15.111:0/297700577 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fbcb4065e30 con 0x7fbcb4097580 2024-04-25T02:20:21.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.272+0000 7fbcbaef5700 1 -- 172.21.15.111:0/297700577 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbcb4065e30 con 0x7fbcb4097580 2024-04-25T02:20:21.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.272+0000 7fbcb1ffb700 1 -- 172.21.15.111:0/297700577 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v14) v1 ==== 74+0+7641 (secure 0 0 0) 0x7fbcb4065e30 con 0x7fbcb4097580 2024-04-25T02:20:21.277 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:20:21.277 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":14,"fsid":"4643f974-f93a-4436-93b8-460ff320e62e","created":"2024-04-25T02:20:05.450475+0000","modified":"2024-04-25T02:20:16.480095+0000","last_up_change":"2024-04-25T02:20:10.439204+0000","last_in_change":"2024-04-25T02:20:10.439204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-25T02:20:07.471248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:20:14.420378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}}],"osds":[{"osd":0,"uuid":"df3f17ca-3b12-42c8-8cf7-8f1b7189e587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6800","nonce":40214}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6801","nonce":40214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6803","nonce":40214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6802","nonce":40214}]},"public_addr":"172.21.15.111:6800/40214","cluster_addr":"172.21.15.111:6801/40214","heartbeat_back_addr":"172.21.15.111:6803/40214","heartbeat_front_addr":"172.21.15.111:6802/40214","state":["exists","up"]},{"osd":1,"uuid":"93d54815-f215-4285-bba6-32f2d1cabf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6812","nonce":40216}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6813","nonce":40216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6815","nonce":40216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6814","nonce":40216}]},"public_addr":"172.21.15.111:6812/40216","cluster_addr":"172.21.15.111:6813/40216","heartbeat_back_addr":"172.21.15.111:6815/40216","heartbeat_front_addr":"172.21.15.111:6814/40216","state":["exists","up"]},{"osd":2,"uuid":"b26b2104-2a2e-408f-9ce7-3587a32a2ebe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6804","nonce":40215}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6805","nonce":40215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6807","nonce":40215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6806","nonce":40215}]},"public_addr":"172.21.15.111:6804/40215","cluster_addr":"172.21.15.111:6805/40215","heartbeat_back_addr":"172.21.15.111:6807/40215","heartbeat_front_addr":"172.21.15.111:6806/40215","state":["exists","up"]},{"osd":3,"uuid":"43c25820-1edc-4031-badf-72e87dd6bf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":12,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6808","nonce":40213}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6809","nonce":40213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6811","nonce":40213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6810","nonce":40213}]},"public_addr":"172.21.15.111:6808/40213","cluster_addr":"172.21.15.111:6809/40213","heartbeat_back_addr":"172.21.15.111:6811/40213","heartbeat_front_addr":"172.21.15.111:6810/40213","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.372427+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.411480+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.361508+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.377212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-25T02:20:21.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.273+0000 7fbcbaef5700 1 -- 172.21.15.111:0/297700577 >> v1:172.21.15.111:6816/39585 conn(0x7fbc94038e60 legacy=0x7fbc9403b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:21.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.273+0000 7fbcbaef5700 1 -- 172.21.15.111:0/297700577 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbcb4097580 msgr2=0x7fbcb4067660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:21.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.273+0000 7fbcbaef5700 1 --2- 172.21.15.111:0/297700577 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbcb4097580 0x7fbcb4067660 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fbca800c000 tx=0x7fbca8006eb0).stop 2024-04-25T02:20:21.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.274+0000 7fbcbaef5700 1 -- 172.21.15.111:0/297700577 shutdown_connections 2024-04-25T02:20:21.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.274+0000 7fbcbaef5700 1 --2- 172.21.15.111:0/297700577 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fbcb4139c10 0x7fbcb4130f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:21.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.274+0000 7fbcbaef5700 1 --2- 172.21.15.111:0/297700577 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbcb4097580 0x7fbcb4067660 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:21.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.274+0000 7fbcbaef5700 1 --2- 172.21.15.111:0/297700577 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbcb4097960 0x7fbcb4130a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:21.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.274+0000 7fbcbaef5700 1 -- 172.21.15.111:0/297700577 >> 172.21.15.111:0/297700577 conn(0x7fbcb40614e0 msgr2=0x7fbcb40999b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:21.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.274+0000 7fbcbaef5700 1 -- 172.21.15.111:0/297700577 shutdown_connections 2024-04-25T02:20:21.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.274+0000 7fbcbaef5700 1 -- 172.21.15.111:0/297700577 wait complete. 2024-04-25T02:20:21.288 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-04-25T02:20:07.471248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T02:20:14.420378+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}] 2024-04-25T02:20:21.289 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-04-25T02:20:21.394 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.389+0000 7f2674303700 1 Processor -- start 2024-04-25T02:20:21.394 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.389+0000 7f2674303700 1 -- start start 2024-04-25T02:20:21.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.390+0000 7f2674303700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f266c05c1a0 0x7f266c067040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:21.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.390+0000 7f2674303700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f266c067c20 0x7f266c05c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:21.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.390+0000 7f2674303700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f266c065c90 con 0x7f266c066170 2024-04-25T02:20:21.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.390+0000 7f2674303700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f266c05ca70 con 0x7f266c067c20 2024-04-25T02:20:21.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.390+0000 7f2674303700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f266c067680 con 0x7f266c05c1a0 2024-04-25T02:20:21.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.390+0000 7f267209f700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f266c05c1a0 0x7f266c067040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:21.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.390+0000 7f267189e700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f266c067c20 0x7f266c05c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:21.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.390+0000 7f26728a0700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f266c066170 0x7f266c136350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:44164/0 (socket says 172.21.15.111:44164) 2024-04-25T02:20:21.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.390+0000 7f26728a0700 1 -- 172.21.15.111:0/1910425114 learned_addr learned my addr 172.21.15.111:0/1910425114 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:20:21.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.390+0000 7f267109d700 1 -- 172.21.15.111:0/1910425114 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1046416168 0 0) 0x7f266c065c90 con 0x7f266c066170 2024-04-25T02:20:21.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.391+0000 7f267189e700 1 -- 172.21.15.111:0/1910425114 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f266c05c1a0 msgr2=0x7f266c067040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:21.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.391+0000 7f267189e700 1 --2- 172.21.15.111:0/1910425114 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f266c05c1a0 0x7f266c067040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:21.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.391+0000 7f267189e700 1 -- 172.21.15.111:0/1910425114 >> v1:172.21.15.111:6789/0 conn(0x7f266c066170 legacy=0x7f266c136350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:21.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.391+0000 7f267189e700 1 -- 172.21.15.111:0/1910425114 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f266c05ba50 con 0x7f266c067c20 2024-04-25T02:20:21.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.391+0000 7f267209f700 1 --2- 172.21.15.111:0/1910425114 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f266c05c1a0 0x7f266c067040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:21.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.391+0000 7f267189e700 1 --2- 172.21.15.111:0/1910425114 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f266c067c20 0x7f266c05c580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f2668002f70 tx=0x7f2668006df0).ready entity=mon.1 client_cookie=a41709453869b273 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:21.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.391+0000 7f267109d700 1 -- 172.21.15.111:0/1910425114 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f266800d570 con 0x7f266c067c20 2024-04-25T02:20:21.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.391+0000 7f267109d700 1 -- 172.21.15.111:0/1910425114 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2668000e90 con 0x7f266c067c20 2024-04-25T02:20:21.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.391+0000 7f267109d700 1 -- 172.21.15.111:0/1910425114 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f266800d8c0 con 0x7f266c067c20 2024-04-25T02:20:21.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.391+0000 7f2674303700 1 -- 172.21.15.111:0/1910425114 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f266c067c20 msgr2=0x7f266c05c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:21.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.391+0000 7f2674303700 1 --2- 172.21.15.111:0/1910425114 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f266c067c20 0x7f266c05c580 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f2668002f70 tx=0x7f2668006df0).stop 2024-04-25T02:20:21.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.391+0000 7f2674303700 1 -- 172.21.15.111:0/1910425114 shutdown_connections 2024-04-25T02:20:21.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.391+0000 7f2674303700 1 --2- 172.21.15.111:0/1910425114 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f266c05c1a0 0x7f266c067040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:21.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.391+0000 7f2674303700 1 --2- 172.21.15.111:0/1910425114 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f266c067c20 0x7f266c05c580 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:21.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.391+0000 7f2674303700 1 -- 172.21.15.111:0/1910425114 >> 172.21.15.111:0/1910425114 conn(0x7f266c0a8a00 msgr2=0x7f266c0a8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:21.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.391+0000 7f2674303700 1 -- 172.21.15.111:0/1910425114 shutdown_connections 2024-04-25T02:20:21.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.391+0000 7f2674303700 1 -- 172.21.15.111:0/1910425114 wait complete. 2024-04-25T02:20:21.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.392+0000 7f2674303700 1 Processor -- start 2024-04-25T02:20:21.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.392+0000 7f2674303700 1 -- start start 2024-04-25T02:20:21.400 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.393+0000 7f2674303700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f266c05c1a0 0x7f266c0944e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:21.400 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.393+0000 7f2674303700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f266c066170 0x7f266c149e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:21.400 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.393+0000 7f2674303700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f266c067c20 0x7f266c0929a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:21.400 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.393+0000 7f2674303700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f266c0a5950 con 0x7f266c05c1a0 2024-04-25T02:20:21.400 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.393+0000 7f2674303700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f266c09f8a0 con 0x7f266c067c20 2024-04-25T02:20:21.401 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.393+0000 7f2674303700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f266c0926e0 con 0x7f266c066170 2024-04-25T02:20:21.401 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.393+0000 7f267209f700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f266c05c1a0 0x7f266c0944e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:21.401 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.393+0000 7f267209f700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f266c05c1a0 0x7f266c0944e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:39428/0 (socket says 172.21.15.111:39428) 2024-04-25T02:20:21.401 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.393+0000 7f267209f700 1 -- 172.21.15.111:0/1130944601 learned_addr learned my addr 172.21.15.111:0/1130944601 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:21.401 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.393+0000 7f26728a0700 1 --2- 172.21.15.111:0/1130944601 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f266c067c20 0x7f266c0929a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:21.401 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.393+0000 7f267189e700 1 --2- 172.21.15.111:0/1130944601 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f266c066170 0x7f266c149e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:21.401 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.393+0000 7f26728a0700 1 -- 172.21.15.111:0/1130944601 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f266c066170 msgr2=0x7f266c149e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:21.401 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.393+0000 7f26728a0700 1 --2- 172.21.15.111:0/1130944601 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f266c066170 0x7f266c149e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:21.401 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.393+0000 7f26728a0700 1 -- 172.21.15.111:0/1130944601 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f266c05c1a0 msgr2=0x7f266c0944e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:21.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.393+0000 7f26728a0700 1 --2- 172.21.15.111:0/1130944601 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f266c05c1a0 0x7f266c0944e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:21.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.393+0000 7f26728a0700 1 -- 172.21.15.111:0/1130944601 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f265c00b180 con 0x7f266c067c20 2024-04-25T02:20:21.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.393+0000 7f267209f700 1 --2- 172.21.15.111:0/1130944601 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f266c05c1a0 0x7f266c0944e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:21.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.393+0000 7f26728a0700 1 --2- 172.21.15.111:0/1130944601 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f266c067c20 0x7f266c0929a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f2664001250 tx=0x7f2664007d00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:21.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.393+0000 7f265b7fe700 1 -- 172.21.15.111:0/1130944601 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2664005ba0 con 0x7f266c067c20 2024-04-25T02:20:21.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.393+0000 7f265b7fe700 1 -- 172.21.15.111:0/1130944601 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2664005d00 con 0x7f266c067c20 2024-04-25T02:20:21.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.393+0000 7f265b7fe700 1 -- 172.21.15.111:0/1130944601 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2664004a90 con 0x7f266c067c20 2024-04-25T02:20:21.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.393+0000 7f2674303700 1 -- 172.21.15.111:0/1130944601 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f266800b180 con 0x7f266c067c20 2024-04-25T02:20:21.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.394+0000 7f2674303700 1 -- 172.21.15.111:0/1130944601 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f266c1498b0 con 0x7f266c067c20 2024-04-25T02:20:21.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.395+0000 7f265b7fe700 1 -- 172.21.15.111:0/1130944601 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f2664004bf0 con 0x7f266c067c20 2024-04-25T02:20:21.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.395+0000 7f2674303700 1 -- 172.21.15.111:0/1130944601 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f266c149b30 con 0x7f266c067c20 2024-04-25T02:20:21.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.395+0000 7f265b7fe700 1 -- 172.21.15.111:0/1130944601 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2822+0+0 (secure 0 0 0) 0x7f266404a060 con 0x7f266c067c20 2024-04-25T02:20:21.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.398+0000 7f265b7fe700 1 -- 172.21.15.111:0/1130944601 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f266402f2b0 con 0x7f266c067c20 2024-04-25T02:20:21.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.510+0000 7f2674303700 1 -- 172.21.15.111:0/1130944601 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f266c05e500 con 0x7f266c067c20 2024-04-25T02:20:21.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.511+0000 7f265b7fe700 1 -- 172.21.15.111:0/1130944601 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v14) v1 ==== 110+0+10 (secure 0 0 0) 0x7f26640328d0 con 0x7f266c067c20 2024-04-25T02:20:21.515 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 1 2024-04-25T02:20:21.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.512+0000 7f2674303700 1 -- 172.21.15.111:0/1130944601 >> v1:172.21.15.111:6816/39585 conn(0x7f264c038da0 legacy=0x7f264c03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:21.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.512+0000 7f2674303700 1 -- 172.21.15.111:0/1130944601 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f266c067c20 msgr2=0x7f266c0929a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:21.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.512+0000 7f2674303700 1 --2- 172.21.15.111:0/1130944601 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f266c067c20 0x7f266c0929a0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f2664001250 tx=0x7f2664007d00).stop 2024-04-25T02:20:21.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.512+0000 7f2674303700 1 -- 172.21.15.111:0/1130944601 shutdown_connections 2024-04-25T02:20:21.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.512+0000 7f2674303700 1 --2- 172.21.15.111:0/1130944601 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f266c067c20 0x7f266c0929a0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:21.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.512+0000 7f2674303700 1 --2- 172.21.15.111:0/1130944601 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f266c05c1a0 0x7f266c0944e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:21.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.512+0000 7f2674303700 1 --2- 172.21.15.111:0/1130944601 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f266c066170 0x7f266c149e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:21.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.512+0000 7f2674303700 1 -- 172.21.15.111:0/1130944601 >> 172.21.15.111:0/1130944601 conn(0x7f266c0a8a00 msgr2=0x7f266c133bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:21.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.512+0000 7f2674303700 1 -- 172.21.15.111:0/1130944601 shutdown_connections 2024-04-25T02:20:21.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.512+0000 7f2674303700 1 -- 172.21.15.111:0/1130944601 wait complete. 2024-04-25T02:20:21.527 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T02:20:21.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.628+0000 7f0056eec700 1 Processor -- start 2024-04-25T02:20:21.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.628+0000 7f0056eec700 1 -- start start 2024-04-25T02:20:21.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.628+0000 7f0056eec700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f005005c020 0x7f0050061c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:21.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.628+0000 7f0056eec700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f005005c400 0x7f00500a6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:21.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.628+0000 7f0056eec700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f005005c810 0x7f00501376c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:21.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.628+0000 7f0056eec700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00500a7500 con 0x7f005005c020 2024-04-25T02:20:21.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.628+0000 7f0056eec700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0050067f10 con 0x7f005005c400 2024-04-25T02:20:21.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.628+0000 7f0056eec700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0050062130 con 0x7f005005c810 2024-04-25T02:20:21.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.629+0000 7f0055489700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f005005c810 0x7f00501376c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:21.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.629+0000 7f004ffff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f005005c400 0x7f00500a6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:21.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.629+0000 7f0054c88700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f005005c020 0x7f0050061c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:21.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.629+0000 7f0055489700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f005005c810 0x7f00501376c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:59960/0 (socket says 172.21.15.111:59960) 2024-04-25T02:20:21.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.629+0000 7f004ffff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f005005c400 0x7f00500a6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:57146/0 (socket says 172.21.15.111:57146) 2024-04-25T02:20:21.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.629+0000 7f0054c88700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f005005c020 0x7f0050061c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:39436/0 (socket says 172.21.15.111:39436) 2024-04-25T02:20:21.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.629+0000 7f0055489700 1 -- 172.21.15.111:0/1992893629 learned_addr learned my addr 172.21.15.111:0/1992893629 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:21.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.629+0000 7f0055489700 1 -- 172.21.15.111:0/1992893629 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f005005c400 msgr2=0x7f00500a6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:21.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.629+0000 7f0055489700 1 --2- 172.21.15.111:0/1992893629 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f005005c400 0x7f00500a6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:21.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.629+0000 7f0055489700 1 -- 172.21.15.111:0/1992893629 >> v2:172.21.15.111:3300/0 conn(0x7f005005c020 msgr2=0x7f0050061c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:21.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.629+0000 7f0055489700 1 --2- 172.21.15.111:0/1992893629 >> v2:172.21.15.111:3300/0 conn(0x7f005005c020 0x7f0050061c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:21.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.629+0000 7f0055489700 1 -- 172.21.15.111:0/1992893629 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f005005bbd0 con 0x7f005005c810 2024-04-25T02:20:21.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.629+0000 7f004ffff700 1 --2- 172.21.15.111:0/1992893629 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f005005c400 0x7f00500a6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:21.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.629+0000 7f0055489700 1 --2- 172.21.15.111:0/1992893629 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f005005c810 0x7f00501376c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f0050061b90 tx=0x7f0048009290).ready entity=mon.2 client_cookie=2ed7f1e68b35937a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:21.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.629+0000 7f004f7fe700 1 -- 172.21.15.111:0/1992893629 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f004800b6b0 con 0x7f005005c810 2024-04-25T02:20:21.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.629+0000 7f004f7fe700 1 -- 172.21.15.111:0/1992893629 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f004800b810 con 0x7f005005c810 2024-04-25T02:20:21.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.629+0000 7f004f7fe700 1 -- 172.21.15.111:0/1992893629 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f004800b980 con 0x7f005005c810 2024-04-25T02:20:21.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.630+0000 7f0056eec700 1 -- 172.21.15.111:0/1992893629 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f005005c810 msgr2=0x7f00501376c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:21.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.630+0000 7f0056eec700 1 --2- 172.21.15.111:0/1992893629 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f005005c810 0x7f00501376c0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f0050061b90 tx=0x7f0048009290).stop 2024-04-25T02:20:21.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.630+0000 7f0056eec700 1 -- 172.21.15.111:0/1992893629 shutdown_connections 2024-04-25T02:20:21.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.630+0000 7f0056eec700 1 --2- 172.21.15.111:0/1992893629 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f005005c810 0x7f00501376c0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:21.638 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.630+0000 7f0056eec700 1 --2- 172.21.15.111:0/1992893629 >> v2:172.21.15.111:3300/0 conn(0x7f005005c020 0x7f0050061c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:21.639 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.630+0000 7f0056eec700 1 --2- 172.21.15.111:0/1992893629 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f005005c400 0x7f00500a6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:21.639 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.630+0000 7f0056eec700 1 -- 172.21.15.111:0/1992893629 >> 172.21.15.111:0/1992893629 conn(0x7f00500a8a00 msgr2=0x7f00500a8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:21.639 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.630+0000 7f0056eec700 1 -- 172.21.15.111:0/1992893629 shutdown_connections 2024-04-25T02:20:21.639 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.630+0000 7f0056eec700 1 -- 172.21.15.111:0/1992893629 wait complete. 2024-04-25T02:20:21.639 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.631+0000 7f0056eec700 1 Processor -- start 2024-04-25T02:20:21.639 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.631+0000 7f0056eec700 1 -- start start 2024-04-25T02:20:21.639 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.631+0000 7f0056eec700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f005005c020 0x7f00500934f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:21.639 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.631+0000 7f0056eec700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f005005c400 0x7f0050146d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:21.639 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.631+0000 7f0056eec700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f005005c810 0x7f0050147280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:21.639 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.631+0000 7f0056eec700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0050093bb0 con 0x7f005005c810 2024-04-25T02:20:21.639 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.631+0000 7f0056eec700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0050093e70 con 0x7f005005c020 2024-04-25T02:20:21.639 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.631+0000 7f0056eec700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f00500670e0 con 0x7f005005c400 2024-04-25T02:20:21.639 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.631+0000 7f0054c88700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f005005c020 0x7f00500934f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:21.639 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.631+0000 7f004ffff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f005005c400 0x7f0050146d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:21.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.631+0000 7f0054c88700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f005005c020 0x7f00500934f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:57162/0 (socket says 172.21.15.111:57162) 2024-04-25T02:20:21.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.631+0000 7f0055489700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f005005c810 0x7f0050147280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:21.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.631+0000 7f0054c88700 1 -- 172.21.15.111:0/2426148375 learned_addr learned my addr 172.21.15.111:0/2426148375 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:21.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.632+0000 7f0054c88700 1 -- 172.21.15.111:0/2426148375 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f005005c400 msgr2=0x7f0050146d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:21.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.632+0000 7f0054c88700 1 --2- 172.21.15.111:0/2426148375 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f005005c400 0x7f0050146d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:21.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.632+0000 7f0054c88700 1 -- 172.21.15.111:0/2426148375 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f005005c810 msgr2=0x7f0050147280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:21.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.632+0000 7f0054c88700 1 --2- 172.21.15.111:0/2426148375 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f005005c810 0x7f0050147280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:21.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.632+0000 7f0054c88700 1 -- 172.21.15.111:0/2426148375 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f003c00b180 con 0x7f005005c020 2024-04-25T02:20:21.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.632+0000 7f004ffff700 1 --2- 172.21.15.111:0/2426148375 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f005005c400 0x7f0050146d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:21.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.632+0000 7f0054c88700 1 --2- 172.21.15.111:0/2426148375 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f005005c020 0x7f00500934f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f004400c000 tx=0x7f0044006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:21.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.632+0000 7f004dffb700 1 -- 172.21.15.111:0/2426148375 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0044010780 con 0x7f005005c020 2024-04-25T02:20:21.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.632+0000 7f004dffb700 1 -- 172.21.15.111:0/2426148375 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00440108e0 con 0x7f005005c020 2024-04-25T02:20:21.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.632+0000 7f0056eec700 1 -- 172.21.15.111:0/2426148375 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0048009530 con 0x7f005005c020 2024-04-25T02:20:21.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.632+0000 7f004dffb700 1 -- 172.21.15.111:0/2426148375 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0044010c40 con 0x7f005005c020 2024-04-25T02:20:21.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.632+0000 7f0056eec700 1 -- 172.21.15.111:0/2426148375 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0050095bc0 con 0x7f005005c020 2024-04-25T02:20:21.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.633+0000 7f0056eec700 1 -- 172.21.15.111:0/2426148375 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0050095810 con 0x7f005005c020 2024-04-25T02:20:21.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.633+0000 7f004dffb700 1 -- 172.21.15.111:0/2426148375 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f004401c460 con 0x7f005005c020 2024-04-25T02:20:21.642 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.633+0000 7f004dffb700 1 -- 172.21.15.111:0/2426148375 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2822+0+0 (secure 0 0 0) 0x7f004404a870 con 0x7f005005c020 2024-04-25T02:20:21.642 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.636+0000 7f004dffb700 1 -- 172.21.15.111:0/2426148375 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f00440334f0 con 0x7f005005c020 2024-04-25T02:20:21.752 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.747+0000 7f0056eec700 1 -- 172.21.15.111:0/2426148375 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f0050095e10 con 0x7f005005c020 2024-04-25T02:20:21.752 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.748+0000 7f004dffb700 1 -- 172.21.15.111:0/2426148375 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v14) v1 ==== 92+0+10 (secure 0 0 0) 0x7f004401c6f0 con 0x7f005005c020 2024-04-25T02:20:21.752 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 8 2024-04-25T02:20:21.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.749+0000 7f0056eec700 1 -- 172.21.15.111:0/2426148375 >> v1:172.21.15.111:6816/39585 conn(0x7f0030038ec0 legacy=0x7f003003b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:21.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.749+0000 7f0056eec700 1 -- 172.21.15.111:0/2426148375 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f005005c020 msgr2=0x7f00500934f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:21.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.749+0000 7f0056eec700 1 --2- 172.21.15.111:0/2426148375 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f005005c020 0x7f00500934f0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f004400c000 tx=0x7f0044006df0).stop 2024-04-25T02:20:21.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.749+0000 7f0056eec700 1 -- 172.21.15.111:0/2426148375 shutdown_connections 2024-04-25T02:20:21.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.749+0000 7f0056eec700 1 --2- 172.21.15.111:0/2426148375 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f005005c810 0x7f0050147280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:21.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.749+0000 7f0056eec700 1 --2- 172.21.15.111:0/2426148375 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f005005c020 0x7f00500934f0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:21.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.749+0000 7f0056eec700 1 --2- 172.21.15.111:0/2426148375 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f005005c400 0x7f0050146d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:21.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.749+0000 7f0056eec700 1 -- 172.21.15.111:0/2426148375 >> 172.21.15.111:0/2426148375 conn(0x7f00500a8a00 msgr2=0x7f00500a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:21.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.749+0000 7f0056eec700 1 -- 172.21.15.111:0/2426148375 shutdown_connections 2024-04-25T02:20:21.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.749+0000 7f0056eec700 1 -- 172.21.15.111:0/2426148375 wait complete. 2024-04-25T02:20:21.764 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-25T02:20:21.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.863+0000 7f54b863c700 1 Processor -- start 2024-04-25T02:20:21.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.864+0000 7f54b863c700 1 -- start start 2024-04-25T02:20:21.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.864+0000 7f54b863c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f54b005c1a0 0x7f54b0067040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:21.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.864+0000 7f54b863c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f54b0067c20 0x7f54b005c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:21.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.864+0000 7f54b863c700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f54b0066170 0x7f54b00a7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:21.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.864+0000 7f54b863c700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54b005ca70 con 0x7f54b0066170 2024-04-25T02:20:21.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.864+0000 7f54b863c700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54b0065c90 con 0x7f54b005c1a0 2024-04-25T02:20:21.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.864+0000 7f54b863c700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f54b00a7fe0 con 0x7f54b0067c20 2024-04-25T02:20:21.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.864+0000 7f54b5bd7700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f54b0067c20 0x7f54b005c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:21.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.864+0000 7f54b6bd9700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f54b0066170 0x7f54b00a7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:21.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.864+0000 7f54b63d8700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f54b005c1a0 0x7f54b0067040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:21.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.864+0000 7f54b5bd7700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f54b0067c20 0x7f54b005c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:59978/0 (socket says 172.21.15.111:59978) 2024-04-25T02:20:21.878 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.864+0000 7f54b63d8700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f54b005c1a0 0x7f54b0067040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:57178/0 (socket says 172.21.15.111:57178) 2024-04-25T02:20:21.878 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.864+0000 7f54b6bd9700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f54b0066170 0x7f54b00a7af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:39446/0 (socket says 172.21.15.111:39446) 2024-04-25T02:20:21.878 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.864+0000 7f54b5bd7700 1 -- 172.21.15.111:0/3834373443 learned_addr learned my addr 172.21.15.111:0/3834373443 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:21.878 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.865+0000 7f54b6bd9700 1 -- 172.21.15.111:0/3834373443 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f54b0067c20 msgr2=0x7f54b005c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:21.879 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.865+0000 7f54b6bd9700 1 --2- 172.21.15.111:0/3834373443 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f54b0067c20 0x7f54b005c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:21.879 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.865+0000 7f54b6bd9700 1 -- 172.21.15.111:0/3834373443 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f54b005c1a0 msgr2=0x7f54b0067040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:21.879 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.865+0000 7f54b6bd9700 1 --2- 172.21.15.111:0/3834373443 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f54b005c1a0 0x7f54b0067040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:21.879 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.865+0000 7f54b6bd9700 1 -- 172.21.15.111:0/3834373443 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54b0067680 con 0x7f54b0066170 2024-04-25T02:20:21.879 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.865+0000 7f54b5bd7700 1 --2- 172.21.15.111:0/3834373443 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f54b0067c20 0x7f54b005c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:21.880 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.865+0000 7f54b63d8700 1 --2- 172.21.15.111:0/3834373443 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f54b005c1a0 0x7f54b0067040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:21.880 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.865+0000 7f54b6bd9700 1 --2- 172.21.15.111:0/3834373443 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f54b0066170 0x7f54b00a7af0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f54a80032f0 tx=0x7f54a80091d0).ready entity=mon.0 client_cookie=983aa2ab82332fc4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:21.880 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.865+0000 7f54b53d6700 1 -- 172.21.15.111:0/3834373443 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54a800b600 con 0x7f54b0066170 2024-04-25T02:20:21.880 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.865+0000 7f54b53d6700 1 -- 172.21.15.111:0/3834373443 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a800b760 con 0x7f54b0066170 2024-04-25T02:20:21.880 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.865+0000 7f54b53d6700 1 -- 172.21.15.111:0/3834373443 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54a800b8d0 con 0x7f54b0066170 2024-04-25T02:20:21.881 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.865+0000 7f54b863c700 1 -- 172.21.15.111:0/3834373443 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f54b0066170 msgr2=0x7f54b00a7af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:21.881 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.865+0000 7f54b863c700 1 --2- 172.21.15.111:0/3834373443 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f54b0066170 0x7f54b00a7af0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f54a80032f0 tx=0x7f54a80091d0).stop 2024-04-25T02:20:21.881 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.866+0000 7f54b863c700 1 -- 172.21.15.111:0/3834373443 shutdown_connections 2024-04-25T02:20:21.881 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.866+0000 7f54b863c700 1 --2- 172.21.15.111:0/3834373443 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f54b0066170 0x7f54b00a7af0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:21.881 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.866+0000 7f54b863c700 1 --2- 172.21.15.111:0/3834373443 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f54b005c1a0 0x7f54b0067040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:21.882 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.866+0000 7f54b863c700 1 --2- 172.21.15.111:0/3834373443 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f54b0067c20 0x7f54b005c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:21.882 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.866+0000 7f54b863c700 1 -- 172.21.15.111:0/3834373443 >> 172.21.15.111:0/3834373443 conn(0x7f54b00a8a00 msgr2=0x7f54b00a8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:21.882 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.866+0000 7f54b863c700 1 -- 172.21.15.111:0/3834373443 shutdown_connections 2024-04-25T02:20:21.882 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.866+0000 7f54b863c700 1 -- 172.21.15.111:0/3834373443 wait complete. 2024-04-25T02:20:21.883 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.866+0000 7f54b863c700 1 Processor -- start 2024-04-25T02:20:21.883 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.867+0000 7f54b863c700 1 -- start start 2024-04-25T02:20:21.883 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.867+0000 7f54b863c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f54b005c1a0 0x7f54b0149d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:21.883 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.867+0000 7f54b863c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f54b0066170 0x7f54b0096210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:21.883 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.867+0000 7f54b863c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f54b0067c20 0x7f54b0096700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:21.884 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.867+0000 7f54b863c700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54b0097470 con 0x7f54b005c1a0 2024-04-25T02:20:21.884 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.867+0000 7f54b863c700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54b0149850 con 0x7f54b0067c20 2024-04-25T02:20:21.884 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.867+0000 7f54b863c700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f54b014a210 con 0x7f54b0066170 2024-04-25T02:20:21.884 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.867+0000 7f54b63d8700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f54b005c1a0 0x7f54b0149d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:21.885 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.867+0000 7f54b6bd9700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f54b0067c20 0x7f54b0096700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:21.885 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.867+0000 7f54b63d8700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f54b005c1a0 0x7f54b0149d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:39454/0 (socket says 172.21.15.111:39454) 2024-04-25T02:20:21.885 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.867+0000 7f54b63d8700 1 -- 172.21.15.111:0/1078971654 learned_addr learned my addr 172.21.15.111:0/1078971654 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:21.885 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.867+0000 7f54b5bd7700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f54b0066170 0x7f54b0096210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:21.885 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.867+0000 7f54b63d8700 1 -- 172.21.15.111:0/1078971654 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f54b0066170 msgr2=0x7f54b0096210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:21.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.867+0000 7f54b63d8700 1 --2- 172.21.15.111:0/1078971654 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f54b0066170 0x7f54b0096210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:21.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.867+0000 7f54b63d8700 1 -- 172.21.15.111:0/1078971654 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f54b0067c20 msgr2=0x7f54b0096700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:21.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.867+0000 7f54b63d8700 1 --2- 172.21.15.111:0/1078971654 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f54b0067c20 0x7f54b0096700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:21.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.867+0000 7f54b63d8700 1 -- 172.21.15.111:0/1078971654 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54a000b180 con 0x7f54b005c1a0 2024-04-25T02:20:21.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.867+0000 7f54b6bd9700 1 --2- 172.21.15.111:0/1078971654 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f54b0067c20 0x7f54b0096700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:21.887 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.867+0000 7f54b5bd7700 1 --2- 172.21.15.111:0/1078971654 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f54b0066170 0x7f54b0096210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:21.887 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.868+0000 7f54b63d8700 1 --2- 172.21.15.111:0/1078971654 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f54b005c1a0 0x7f54b0149d20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f54a000c000 tx=0x7f54a0006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:21.887 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.868+0000 7f549f7fe700 1 -- 172.21.15.111:0/1078971654 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54a000c890 con 0x7f54b005c1a0 2024-04-25T02:20:21.887 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.868+0000 7f549f7fe700 1 -- 172.21.15.111:0/1078971654 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f54a000c9f0 con 0x7f54b005c1a0 2024-04-25T02:20:21.887 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.868+0000 7f549f7fe700 1 -- 172.21.15.111:0/1078971654 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f54a000cd50 con 0x7f54b005c1a0 2024-04-25T02:20:21.888 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.868+0000 7f54b863c700 1 -- 172.21.15.111:0/1078971654 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54ac00b1e0 con 0x7f54b005c1a0 2024-04-25T02:20:21.888 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.868+0000 7f54b863c700 1 -- 172.21.15.111:0/1078971654 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54a8009470 con 0x7f54b005c1a0 2024-04-25T02:20:21.888 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.869+0000 7f549f7fe700 1 -- 172.21.15.111:0/1078971654 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f54a001c460 con 0x7f54b005c1a0 2024-04-25T02:20:21.888 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.869+0000 7f549f7fe700 1 -- 172.21.15.111:0/1078971654 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2822+0+0 (secure 0 0 0) 0x7f54a004ab70 con 0x7f54b005c1a0 2024-04-25T02:20:21.888 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.869+0000 7f54b863c700 1 -- 172.21.15.111:0/1078971654 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54b0057a60 con 0x7f54b005c1a0 2024-04-25T02:20:21.889 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.872+0000 7f549f7fe700 1 -- 172.21.15.111:0/1078971654 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f54a00337f0 con 0x7f54b005c1a0 2024-04-25T02:20:21.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.983+0000 7f54b863c700 1 -- 172.21.15.111:0/1078971654 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f54b00a4340 con 0x7f54b005c1a0 2024-04-25T02:20:21.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.983+0000 7f549f7fe700 1 -- 172.21.15.111:0/1078971654 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v14) v1 ==== 84+0+143 (secure 0 0 0) 0x7f54a002b090 con 0x7f54b005c1a0 2024-04-25T02:20:21.988 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:20:21.988 INFO:teuthology.orchestra.run.smithi111.stdout:[ 2024-04-25T02:20:21.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-25T02:20:21.988 INFO:teuthology.orchestra.run.smithi111.stdout: "poolnum": 1, 2024-04-25T02:20:21.988 INFO:teuthology.orchestra.run.smithi111.stdout: "poolname": "device_health_metrics" 2024-04-25T02:20:21.988 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:20:21.988 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-25T02:20:21.988 INFO:teuthology.orchestra.run.smithi111.stdout: "poolnum": 2, 2024-04-25T02:20:21.988 INFO:teuthology.orchestra.run.smithi111.stdout: "poolname": "rbd" 2024-04-25T02:20:21.989 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-25T02:20:21.989 INFO:teuthology.orchestra.run.smithi111.stdout:] 2024-04-25T02:20:21.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.985+0000 7f54b863c700 1 -- 172.21.15.111:0/1078971654 >> v1:172.21.15.111:6816/39585 conn(0x7f5490038da0 legacy=0x7f549003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:21.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.985+0000 7f54b863c700 1 -- 172.21.15.111:0/1078971654 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f54b005c1a0 msgr2=0x7f54b0149d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:21.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.985+0000 7f54b863c700 1 --2- 172.21.15.111:0/1078971654 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f54b005c1a0 0x7f54b0149d20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f54a000c000 tx=0x7f54a0006df0).stop 2024-04-25T02:20:21.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.985+0000 7f54b863c700 1 -- 172.21.15.111:0/1078971654 shutdown_connections 2024-04-25T02:20:21.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.985+0000 7f54b863c700 1 --2- 172.21.15.111:0/1078971654 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f54b0067c20 0x7f54b0096700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:21.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.985+0000 7f54b863c700 1 --2- 172.21.15.111:0/1078971654 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f54b005c1a0 0x7f54b0149d20 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:21.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.985+0000 7f54b863c700 1 --2- 172.21.15.111:0/1078971654 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f54b0066170 0x7f54b0096210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:21.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.985+0000 7f54b863c700 1 -- 172.21.15.111:0/1078971654 >> 172.21.15.111:0/1078971654 conn(0x7f54b00a8a00 msgr2=0x7f54b0136b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:21.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.985+0000 7f54b863c700 1 -- 172.21.15.111:0/1078971654 shutdown_connections 2024-04-25T02:20:21.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:21.985+0000 7f54b863c700 1 -- 172.21.15.111:0/1078971654 wait complete. 2024-04-25T02:20:21.999 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-25T02:20:21.999 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-25T02:20:22.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.100+0000 7faa3b2b5700 1 Processor -- start 2024-04-25T02:20:22.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.100+0000 7faa3b2b5700 1 -- start start 2024-04-25T02:20:22.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.101+0000 7faa3b2b5700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7faa3405c1a0 0x7faa34067040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:22.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.101+0000 7faa3b2b5700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7faa34067c20 0x7faa3405c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:22.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.101+0000 7faa3b2b5700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa34065c90 con 0x7faa34066170 2024-04-25T02:20:22.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.101+0000 7faa3b2b5700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa3405ca70 con 0x7faa34067c20 2024-04-25T02:20:22.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.101+0000 7faa3b2b5700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa34067680 con 0x7faa3405c1a0 2024-04-25T02:20:22.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.101+0000 7faa38850700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7faa34067c20 0x7faa3405c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:22.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.101+0000 7faa39051700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7faa3405c1a0 0x7faa34067040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:22.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.101+0000 7faa39852700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7faa34066170 0x7faa34136350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:44178/0 (socket says 172.21.15.111:44178) 2024-04-25T02:20:22.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.101+0000 7faa39852700 1 -- 172.21.15.111:0/2888062861 learned_addr learned my addr 172.21.15.111:0/2888062861 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:20:22.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.101+0000 7faa38850700 1 -- 172.21.15.111:0/2888062861 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7faa3405c1a0 msgr2=0x7faa34067040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:22.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.101+0000 7faa38850700 1 --2- 172.21.15.111:0/2888062861 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7faa3405c1a0 0x7faa34067040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:22.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.101+0000 7faa38850700 1 -- 172.21.15.111:0/2888062861 >> v1:172.21.15.111:6789/0 conn(0x7faa34066170 legacy=0x7faa34136350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:22.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.101+0000 7faa38850700 1 -- 172.21.15.111:0/2888062861 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa3405ba50 con 0x7faa34067c20 2024-04-25T02:20:22.119 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.101+0000 7faa23fff700 1 -- 172.21.15.111:0/2888062861 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 193702498 0 0) 0x7faa34065c90 con 0x7faa34066170 2024-04-25T02:20:22.119 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.101+0000 7faa39051700 1 --2- 172.21.15.111:0/2888062861 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7faa3405c1a0 0x7faa34067040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:22.119 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.101+0000 7faa38850700 1 --2- 172.21.15.111:0/2888062861 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faa34067c20 0x7faa3405c580 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7faa30002f70 tx=0x7faa30006df0).ready entity=mon.0 client_cookie=bba041123da2147f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:22.119 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.102+0000 7faa23fff700 1 -- 172.21.15.111:0/2888062861 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa3000d570 con 0x7faa34067c20 2024-04-25T02:20:22.119 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.102+0000 7faa23fff700 1 -- 172.21.15.111:0/2888062861 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa30000e90 con 0x7faa34067c20 2024-04-25T02:20:22.119 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.102+0000 7faa23fff700 1 -- 172.21.15.111:0/2888062861 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa3000d8c0 con 0x7faa34067c20 2024-04-25T02:20:22.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.102+0000 7faa3b2b5700 1 -- 172.21.15.111:0/2888062861 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faa34067c20 msgr2=0x7faa3405c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:22.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.102+0000 7faa3b2b5700 1 --2- 172.21.15.111:0/2888062861 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faa34067c20 0x7faa3405c580 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7faa30002f70 tx=0x7faa30006df0).stop 2024-04-25T02:20:22.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.102+0000 7faa3b2b5700 1 -- 172.21.15.111:0/2888062861 shutdown_connections 2024-04-25T02:20:22.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.102+0000 7faa3b2b5700 1 --2- 172.21.15.111:0/2888062861 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7faa3405c1a0 0x7faa34067040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:22.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.102+0000 7faa3b2b5700 1 --2- 172.21.15.111:0/2888062861 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faa34067c20 0x7faa3405c580 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:22.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.102+0000 7faa3b2b5700 1 -- 172.21.15.111:0/2888062861 >> 172.21.15.111:0/2888062861 conn(0x7faa340a8a00 msgr2=0x7faa340a8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:22.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.102+0000 7faa3b2b5700 1 -- 172.21.15.111:0/2888062861 shutdown_connections 2024-04-25T02:20:22.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.102+0000 7faa3b2b5700 1 -- 172.21.15.111:0/2888062861 wait complete. 2024-04-25T02:20:22.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.103+0000 7faa3b2b5700 1 Processor -- start 2024-04-25T02:20:22.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.103+0000 7faa3b2b5700 1 -- start start 2024-04-25T02:20:22.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.104+0000 7faa3b2b5700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7faa3405c1a0 0x7faa34095c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:22.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.104+0000 7faa3b2b5700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faa34066170 0x7faa341325a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:22.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.104+0000 7faa3b2b5700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7faa34067c20 0x7faa34132a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:22.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.104+0000 7faa3b2b5700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa340a2690 con 0x7faa34066170 2024-04-25T02:20:22.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.104+0000 7faa3b2b5700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa340954b0 con 0x7faa3405c1a0 2024-04-25T02:20:22.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.104+0000 7faa3b2b5700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa34094c40 con 0x7faa34067c20 2024-04-25T02:20:22.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.104+0000 7faa39051700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7faa3405c1a0 0x7faa34095c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:22.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.104+0000 7faa38850700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faa34066170 0x7faa341325a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:22.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.104+0000 7faa39051700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7faa3405c1a0 0x7faa34095c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:57206/0 (socket says 172.21.15.111:57206) 2024-04-25T02:20:22.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.104+0000 7faa39051700 1 -- 172.21.15.111:0/678985387 learned_addr learned my addr 172.21.15.111:0/678985387 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:22.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.104+0000 7faa39852700 1 --2- 172.21.15.111:0/678985387 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7faa34067c20 0x7faa34132a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:22.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.104+0000 7faa39051700 1 -- 172.21.15.111:0/678985387 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7faa34067c20 msgr2=0x7faa34132a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:22.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.104+0000 7faa39051700 1 --2- 172.21.15.111:0/678985387 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7faa34067c20 0x7faa34132a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:22.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.104+0000 7faa39051700 1 -- 172.21.15.111:0/678985387 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faa34066170 msgr2=0x7faa341325a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:22.124 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.104+0000 7faa39051700 1 --2- 172.21.15.111:0/678985387 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faa34066170 0x7faa341325a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:22.124 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.104+0000 7faa39051700 1 -- 172.21.15.111:0/678985387 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa2400b180 con 0x7faa3405c1a0 2024-04-25T02:20:22.124 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.104+0000 7faa38850700 1 --2- 172.21.15.111:0/678985387 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faa34066170 0x7faa341325a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:22.124 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.104+0000 7faa39051700 1 --2- 172.21.15.111:0/678985387 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7faa3405c1a0 0x7faa34095c90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7faa2400c000 tx=0x7faa24006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:22.124 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.104+0000 7faa227fc700 1 -- 172.21.15.111:0/678985387 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa2400c7e0 con 0x7faa3405c1a0 2024-04-25T02:20:22.124 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.104+0000 7faa227fc700 1 -- 172.21.15.111:0/678985387 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa2400c940 con 0x7faa3405c1a0 2024-04-25T02:20:22.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.104+0000 7faa3b2b5700 1 -- 172.21.15.111:0/678985387 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa3000b180 con 0x7faa3405c1a0 2024-04-25T02:20:22.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.104+0000 7faa227fc700 1 -- 172.21.15.111:0/678985387 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7faa2400cca0 con 0x7faa3405c1a0 2024-04-25T02:20:22.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.104+0000 7faa3b2b5700 1 -- 172.21.15.111:0/678985387 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa34093930 con 0x7faa3405c1a0 2024-04-25T02:20:22.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.105+0000 7faa227fc700 1 -- 172.21.15.111:0/678985387 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7faa2401c460 con 0x7faa3405c1a0 2024-04-25T02:20:22.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.105+0000 7faa227fc700 1 -- 172.21.15.111:0/678985387 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(14..14 src has 1..14) v4 ==== 2822+0+0 (secure 0 0 0) 0x7faa2404aaa0 con 0x7faa3405c1a0 2024-04-25T02:20:22.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.105+0000 7faa3b2b5700 1 -- 172.21.15.111:0/678985387 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa3405e4b0 con 0x7faa3405c1a0 2024-04-25T02:20:22.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.108+0000 7faa227fc700 1 -- 172.21.15.111:0/678985387 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7faa24033720 con 0x7faa3405c1a0 2024-04-25T02:20:22.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.219+0000 7faa3b2b5700 1 -- 172.21.15.111:0/678985387 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7faa34057a60 con 0x7faa3405c1a0 2024-04-25T02:20:22.846 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.842+0000 7faa227fc700 1 -- 172.21.15.111:0/678985387 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v15) v1 ==== 138+0+0 (secure 0 0 0) 0x7faa2400ce00 con 0x7faa3405c1a0 2024-04-25T02:20:22.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.845+0000 7faa3b2b5700 1 -- 172.21.15.111:0/678985387 >> v1:172.21.15.111:6816/39585 conn(0x7faa14038da0 legacy=0x7faa1403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:22.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.845+0000 7faa3b2b5700 1 -- 172.21.15.111:0/678985387 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7faa3405c1a0 msgr2=0x7faa34095c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:22.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.845+0000 7faa3b2b5700 1 --2- 172.21.15.111:0/678985387 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7faa3405c1a0 0x7faa34095c90 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7faa2400c000 tx=0x7faa24006df0).stop 2024-04-25T02:20:22.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.849+0000 7faa3b2b5700 1 -- 172.21.15.111:0/678985387 shutdown_connections 2024-04-25T02:20:22.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.849+0000 7faa3b2b5700 1 --2- 172.21.15.111:0/678985387 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7faa34067c20 0x7faa34132a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:22.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.849+0000 7faa3b2b5700 1 --2- 172.21.15.111:0/678985387 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7faa3405c1a0 0x7faa34095c90 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:22.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.849+0000 7faa3b2b5700 1 --2- 172.21.15.111:0/678985387 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faa34066170 0x7faa341325a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:22.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.849+0000 7faa3b2b5700 1 -- 172.21.15.111:0/678985387 >> 172.21.15.111:0/678985387 conn(0x7faa340a8a00 msgr2=0x7faa34135960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:22.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.850+0000 7faa3b2b5700 1 -- 172.21.15.111:0/678985387 shutdown_connections 2024-04-25T02:20:22.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.850+0000 7faa3b2b5700 1 -- 172.21.15.111:0/678985387 wait complete. 2024-04-25T02:20:22.855 INFO:teuthology.orchestra.run.smithi111.stderr:pool 'cephfs_metadata' created 2024-04-25T02:20:22.867 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-04-25T02:20:22.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.976+0000 7fa298ff7700 1 Processor -- start 2024-04-25T02:20:22.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.976+0000 7fa298ff7700 1 -- start start 2024-04-25T02:20:22.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.977+0000 7fa298ff7700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa29405c020 0x7fa294061c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:22.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.977+0000 7fa298ff7700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa29405c7e0 0x7fa29413ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:22.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.977+0000 7fa298ff7700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2940a7280 con 0x7fa29405c400 2024-04-25T02:20:22.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.977+0000 7fa298ff7700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2940a7500 con 0x7fa29405c7e0 2024-04-25T02:20:22.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.977+0000 7fa298ff7700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa294067f10 con 0x7fa29405c020 2024-04-25T02:20:22.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.977+0000 7fa292d9d700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa29405c7e0 0x7fa29413ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:22.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.977+0000 7fa29259c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa29405c020 0x7fa294061c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:22.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.977+0000 7fa291d9b700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7fa29405c400 0x7fa2940a6b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:44190/0 (socket says 172.21.15.111:44190) 2024-04-25T02:20:22.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.977+0000 7fa291d9b700 1 -- 172.21.15.111:0/4250605679 learned_addr learned my addr 172.21.15.111:0/4250605679 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:20:22.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.977+0000 7fa292d9d700 1 -- 172.21.15.111:0/4250605679 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa29405c020 msgr2=0x7fa294061c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:22.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.977+0000 7fa292d9d700 1 --2- 172.21.15.111:0/4250605679 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa29405c020 0x7fa294061c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:22.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.977+0000 7fa29159a700 1 -- 172.21.15.111:0/4250605679 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 128334375 0 0) 0x7fa2940a7280 con 0x7fa29405c400 2024-04-25T02:20:22.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.977+0000 7fa292d9d700 1 -- 172.21.15.111:0/4250605679 >> v1:172.21.15.111:6789/0 conn(0x7fa29405c400 legacy=0x7fa2940a6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:22.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.977+0000 7fa292d9d700 1 -- 172.21.15.111:0/4250605679 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa294062130 con 0x7fa29405c7e0 2024-04-25T02:20:22.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.977+0000 7fa29259c700 1 --2- 172.21.15.111:0/4250605679 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa29405c020 0x7fa294061c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:22.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.978+0000 7fa292d9d700 1 --2- 172.21.15.111:0/4250605679 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa29405c7e0 0x7fa29413ea60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fa28c0032f0 tx=0x7fa28c0091d0).ready entity=mon.1 client_cookie=fb665220079df142 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:22.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.978+0000 7fa29159a700 1 -- 172.21.15.111:0/4250605679 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa28c00b6c0 con 0x7fa29405c7e0 2024-04-25T02:20:22.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.978+0000 7fa29159a700 1 -- 172.21.15.111:0/4250605679 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa28c00b820 con 0x7fa29405c7e0 2024-04-25T02:20:22.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.978+0000 7fa29159a700 1 -- 172.21.15.111:0/4250605679 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa28c00b990 con 0x7fa29405c7e0 2024-04-25T02:20:22.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.978+0000 7fa298ff7700 1 -- 172.21.15.111:0/4250605679 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa29405c7e0 msgr2=0x7fa29413ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:22.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.978+0000 7fa298ff7700 1 --2- 172.21.15.111:0/4250605679 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa29405c7e0 0x7fa29413ea60 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fa28c0032f0 tx=0x7fa28c0091d0).stop 2024-04-25T02:20:22.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.978+0000 7fa298ff7700 1 -- 172.21.15.111:0/4250605679 shutdown_connections 2024-04-25T02:20:22.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.978+0000 7fa298ff7700 1 --2- 172.21.15.111:0/4250605679 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa29405c020 0x7fa294061c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:22.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.978+0000 7fa298ff7700 1 --2- 172.21.15.111:0/4250605679 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa29405c7e0 0x7fa29413ea60 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:22.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.978+0000 7fa298ff7700 1 -- 172.21.15.111:0/4250605679 >> 172.21.15.111:0/4250605679 conn(0x7fa2940a8a00 msgr2=0x7fa2940a8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:22.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.978+0000 7fa298ff7700 1 -- 172.21.15.111:0/4250605679 shutdown_connections 2024-04-25T02:20:22.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.978+0000 7fa298ff7700 1 -- 172.21.15.111:0/4250605679 wait complete. 2024-04-25T02:20:22.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.979+0000 7fa298ff7700 1 Processor -- start 2024-04-25T02:20:22.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.979+0000 7fa298ff7700 1 -- start start 2024-04-25T02:20:22.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.980+0000 7fa298ff7700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa29405c020 0x7fa294066560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:22.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.980+0000 7fa298ff7700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa29405c400 0x7fa29409fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:22.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.980+0000 7fa298ff7700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa29405c7e0 0x7fa2940a03b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:22.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.980+0000 7fa298ff7700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa294063910 con 0x7fa29405c400 2024-04-25T02:20:22.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.980+0000 7fa298ff7700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa294063f00 con 0x7fa29405c020 2024-04-25T02:20:22.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.980+0000 7fa298ff7700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa29409efa0 con 0x7fa29405c7e0 2024-04-25T02:20:22.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.980+0000 7fa29259c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa29405c020 0x7fa294066560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:22.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.980+0000 7fa29259c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa29405c020 0x7fa294066560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:57226/0 (socket says 172.21.15.111:57226) 2024-04-25T02:20:22.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.980+0000 7fa29259c700 1 -- 172.21.15.111:0/2873369665 learned_addr learned my addr 172.21.15.111:0/2873369665 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:22.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.980+0000 7fa291d9b700 1 --2- 172.21.15.111:0/2873369665 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa29405c400 0x7fa29409fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:22.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.980+0000 7fa292d9d700 1 --2- 172.21.15.111:0/2873369665 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa29405c7e0 0x7fa2940a03b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:22.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.980+0000 7fa29259c700 1 -- 172.21.15.111:0/2873369665 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa29405c7e0 msgr2=0x7fa2940a03b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:22.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.980+0000 7fa29259c700 1 --2- 172.21.15.111:0/2873369665 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa29405c7e0 0x7fa2940a03b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:22.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.980+0000 7fa29259c700 1 -- 172.21.15.111:0/2873369665 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa29405c400 msgr2=0x7fa29409fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:22.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.980+0000 7fa29259c700 1 --2- 172.21.15.111:0/2873369665 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa29405c400 0x7fa29409fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:22.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.980+0000 7fa29259c700 1 -- 172.21.15.111:0/2873369665 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa28800b180 con 0x7fa29405c020 2024-04-25T02:20:22.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.980+0000 7fa29259c700 1 --2- 172.21.15.111:0/2873369665 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa29405c020 0x7fa294066560 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fa2941364e0 tx=0x7fa288006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:22.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.980+0000 7fa2837fe700 1 -- 172.21.15.111:0/2873369665 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa28800c5f0 con 0x7fa29405c020 2024-04-25T02:20:22.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.980+0000 7fa2837fe700 1 -- 172.21.15.111:0/2873369665 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa28800c750 con 0x7fa29405c020 2024-04-25T02:20:22.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.980+0000 7fa298ff7700 1 -- 172.21.15.111:0/2873369665 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa28c009470 con 0x7fa29405c020 2024-04-25T02:20:22.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.980+0000 7fa2837fe700 1 -- 172.21.15.111:0/2873369665 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa28800cab0 con 0x7fa29405c020 2024-04-25T02:20:22.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.980+0000 7fa298ff7700 1 -- 172.21.15.111:0/2873369665 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa294065e70 con 0x7fa29405c020 2024-04-25T02:20:22.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.981+0000 7fa2837fe700 1 -- 172.21.15.111:0/2873369665 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fa28800cc10 con 0x7fa29405c020 2024-04-25T02:20:22.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.981+0000 7fa2837fe700 1 -- 172.21.15.111:0/2873369665 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 3192+0+0 (secure 0 0 0) 0x7fa28804abf0 con 0x7fa29405c020 2024-04-25T02:20:22.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.982+0000 7fa298ff7700 1 -- 172.21.15.111:0/2873369665 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2940a2e60 con 0x7fa29405c020 2024-04-25T02:20:22.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:22.985+0000 7fa2837fe700 1 -- 172.21.15.111:0/2873369665 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fa288033660 con 0x7fa29405c020 2024-04-25T02:20:23.099 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:23.095+0000 7fa298ff7700 1 -- 172.21.15.111:0/2873369665 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa294065830 con 0x7fa29405c020 2024-04-25T02:20:23.862 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:23.856+0000 7fa2837fe700 1 -- 172.21.15.111:0/2873369665 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v16) v1 ==== 170+0+0 (secure 0 0 0) 0x7fa288033250 con 0x7fa29405c020 2024-04-25T02:20:23.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:23.870+0000 7fa298ff7700 1 -- 172.21.15.111:0/2873369665 >> v1:172.21.15.111:6816/39585 conn(0x7fa270038da0 legacy=0x7fa27003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:23.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:23.870+0000 7fa298ff7700 1 -- 172.21.15.111:0/2873369665 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa29405c020 msgr2=0x7fa294066560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:23.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:23.870+0000 7fa298ff7700 1 --2- 172.21.15.111:0/2873369665 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa29405c020 0x7fa294066560 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fa2941364e0 tx=0x7fa288006df0).stop 2024-04-25T02:20:23.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:23.871+0000 7fa298ff7700 1 -- 172.21.15.111:0/2873369665 shutdown_connections 2024-04-25T02:20:23.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:23.871+0000 7fa298ff7700 1 --2- 172.21.15.111:0/2873369665 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa29405c7e0 0x7fa2940a03b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:23.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:23.871+0000 7fa298ff7700 1 --2- 172.21.15.111:0/2873369665 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa29405c020 0x7fa294066560 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:23.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:23.871+0000 7fa298ff7700 1 --2- 172.21.15.111:0/2873369665 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa29405c400 0x7fa29409fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:23.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:23.871+0000 7fa298ff7700 1 -- 172.21.15.111:0/2873369665 >> 172.21.15.111:0/2873369665 conn(0x7fa2940a8a00 msgr2=0x7fa294136740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:23.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:23.871+0000 7fa298ff7700 1 -- 172.21.15.111:0/2873369665 shutdown_connections 2024-04-25T02:20:23.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:23.871+0000 7fa298ff7700 1 -- 172.21.15.111:0/2873369665 wait complete. 2024-04-25T02:20:23.877 INFO:teuthology.orchestra.run.smithi111.stderr:pool 'cephfs_data' created 2024-04-25T02:20:23.896 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-25T02:20:24.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.001+0000 7ff91c8a9700 1 Processor -- start 2024-04-25T02:20:24.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.001+0000 7ff91c8a9700 1 -- start start 2024-04-25T02:20:24.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.001+0000 7ff91c8a9700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff918139ff0 0x7ff91813e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:24.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.001+0000 7ff91c8a9700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff91813ee30 0x7ff918141220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:24.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.001+0000 7ff91c8a9700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff918096f80 con 0x7ff918139c10 2024-04-25T02:20:24.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.001+0000 7ff91c8a9700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff918097c90 con 0x7ff918139ff0 2024-04-25T02:20:24.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.001+0000 7ff91c8a9700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff918099610 con 0x7ff91813ee30 2024-04-25T02:20:24.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.002+0000 7ff916d9d700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff91813ee30 0x7ff918141220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:24.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.002+0000 7ff915d9b700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff918139ff0 0x7ff91813e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:24.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.002+0000 7ff91659c700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7ff918139c10 0x7ff918097580 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:44194/0 (socket says 172.21.15.111:44194) 2024-04-25T02:20:24.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.002+0000 7ff91659c700 1 -- 172.21.15.111:0/3850708520 learned_addr learned my addr 172.21.15.111:0/3850708520 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:20:24.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.002+0000 7ff91559a700 1 -- 172.21.15.111:0/3850708520 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2679005785 0 0) 0x7ff918096f80 con 0x7ff918139c10 2024-04-25T02:20:24.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.002+0000 7ff915d9b700 1 -- 172.21.15.111:0/3850708520 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff91813ee30 msgr2=0x7ff918141220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:24.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.002+0000 7ff915d9b700 1 --2- 172.21.15.111:0/3850708520 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff91813ee30 0x7ff918141220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:24.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.002+0000 7ff915d9b700 1 -- 172.21.15.111:0/3850708520 >> v1:172.21.15.111:6789/0 conn(0x7ff918139c10 legacy=0x7ff918097580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:24.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.002+0000 7ff915d9b700 1 -- 172.21.15.111:0/3850708520 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff918139730 con 0x7ff918139ff0 2024-04-25T02:20:24.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.002+0000 7ff916d9d700 1 --2- 172.21.15.111:0/3850708520 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff91813ee30 0x7ff918141220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:24.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.002+0000 7ff915d9b700 1 --2- 172.21.15.111:0/3850708520 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff918139ff0 0x7ff91813e940 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7ff90c002f70 tx=0x7ff90c006df0).ready entity=mon.1 client_cookie=a6d0225839bfadbc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:24.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.002+0000 7ff91559a700 1 -- 172.21.15.111:0/3850708520 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff90c00d570 con 0x7ff918139ff0 2024-04-25T02:20:24.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.002+0000 7ff91559a700 1 -- 172.21.15.111:0/3850708520 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff90c000e90 con 0x7ff918139ff0 2024-04-25T02:20:24.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.002+0000 7ff91559a700 1 -- 172.21.15.111:0/3850708520 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff90c00d8c0 con 0x7ff918139ff0 2024-04-25T02:20:24.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.003+0000 7ff91c8a9700 1 -- 172.21.15.111:0/3850708520 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff918139ff0 msgr2=0x7ff91813e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:24.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.003+0000 7ff91c8a9700 1 --2- 172.21.15.111:0/3850708520 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff918139ff0 0x7ff91813e940 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7ff90c002f70 tx=0x7ff90c006df0).stop 2024-04-25T02:20:24.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.003+0000 7ff91c8a9700 1 -- 172.21.15.111:0/3850708520 shutdown_connections 2024-04-25T02:20:24.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.003+0000 7ff91c8a9700 1 --2- 172.21.15.111:0/3850708520 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff91813ee30 0x7ff918141220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:24.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.003+0000 7ff91c8a9700 1 --2- 172.21.15.111:0/3850708520 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff918139ff0 0x7ff91813e940 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:24.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.003+0000 7ff91c8a9700 1 -- 172.21.15.111:0/3850708520 >> 172.21.15.111:0/3850708520 conn(0x7ff9180614e0 msgr2=0x7ff91806c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:24.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.003+0000 7ff91c8a9700 1 -- 172.21.15.111:0/3850708520 shutdown_connections 2024-04-25T02:20:24.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.003+0000 7ff91c8a9700 1 -- 172.21.15.111:0/3850708520 wait complete. 2024-04-25T02:20:24.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.004+0000 7ff91c8a9700 1 Processor -- start 2024-04-25T02:20:24.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.004+0000 7ff91c8a9700 1 -- start start 2024-04-25T02:20:24.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.004+0000 7ff91c8a9700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff918139c10 0x7ff918062fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:24.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.004+0000 7ff91c8a9700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff918139ff0 0x7ff91813e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:24.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.004+0000 7ff91c8a9700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff91813ee30 0x7ff918145a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:24.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.004+0000 7ff91c8a9700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9180623d0 con 0x7ff91813ee30 2024-04-25T02:20:24.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.004+0000 7ff91c8a9700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9181457c0 con 0x7ff918139ff0 2024-04-25T02:20:24.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.004+0000 7ff91c8a9700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff918062620 con 0x7ff918139c10 2024-04-25T02:20:24.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.004+0000 7ff916d9d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff91813ee30 0x7ff918145a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:24.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.004+0000 7ff91659c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff918139c10 0x7ff918062fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:24.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.004+0000 7ff916d9d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff91813ee30 0x7ff918145a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:39494/0 (socket says 172.21.15.111:39494) 2024-04-25T02:20:24.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.004+0000 7ff91659c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff918139c10 0x7ff918062fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:60040/0 (socket says 172.21.15.111:60040) 2024-04-25T02:20:24.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.004+0000 7ff91659c700 1 -- 172.21.15.111:0/3435286043 learned_addr learned my addr 172.21.15.111:0/3435286043 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:24.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.004+0000 7ff915d9b700 1 --2- 172.21.15.111:0/3435286043 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff918139ff0 0x7ff91813e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:24.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.004+0000 7ff91659c700 1 -- 172.21.15.111:0/3435286043 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff918139ff0 msgr2=0x7ff91813e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:24.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.004+0000 7ff91659c700 1 --2- 172.21.15.111:0/3435286043 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff918139ff0 0x7ff91813e490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:24.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.004+0000 7ff91659c700 1 -- 172.21.15.111:0/3435286043 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff91813ee30 msgr2=0x7ff918145a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:24.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.004+0000 7ff91659c700 1 --2- 172.21.15.111:0/3435286043 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff91813ee30 0x7ff918145a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:24.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.005+0000 7ff91659c700 1 -- 172.21.15.111:0/3435286043 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff910009470 con 0x7ff918139c10 2024-04-25T02:20:24.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.005+0000 7ff91659c700 1 --2- 172.21.15.111:0/3435286043 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff918139c10 0x7ff918062fe0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7ff908000bc0 tx=0x7ff908007a60).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:24.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.005+0000 7ff9077fe700 1 -- 172.21.15.111:0/3435286043 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff9080070d0 con 0x7ff918139c10 2024-04-25T02:20:24.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.005+0000 7ff9077fe700 1 -- 172.21.15.111:0/3435286043 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff908007230 con 0x7ff918139c10 2024-04-25T02:20:24.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.005+0000 7ff9077fe700 1 -- 172.21.15.111:0/3435286043 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff908005610 con 0x7ff918139c10 2024-04-25T02:20:24.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.005+0000 7ff91c8a9700 1 -- 172.21.15.111:0/3435286043 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff90c00b180 con 0x7ff918139c10 2024-04-25T02:20:24.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.005+0000 7ff91c8a9700 1 -- 172.21.15.111:0/3435286043 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff91813e980 con 0x7ff918139c10 2024-04-25T02:20:24.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.006+0000 7ff9077fe700 1 -- 172.21.15.111:0/3435286043 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7ff908010070 con 0x7ff918139c10 2024-04-25T02:20:24.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.006+0000 7ff9077fe700 1 -- 172.21.15.111:0/3435286043 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 3574+0+0 (secure 0 0 0) 0x7ff908049f00 con 0x7ff918139c10 2024-04-25T02:20:24.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.006+0000 7ff91c8a9700 1 -- 172.21.15.111:0/3435286043 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff918062760 con 0x7ff918139c10 2024-04-25T02:20:24.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.009+0000 7ff9077fe700 1 -- 172.21.15.111:0/3435286043 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7ff918062760 con 0x7ff918139c10 2024-04-25T02:20:24.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.148+0000 7ff91c8a9700 1 -- 172.21.15.111:0/3435286043 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7ff918062760 con 0x7ff918139c10 2024-04-25T02:20:24.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.154+0000 7ff9077fe700 1 -- 172.21.15.111:0/3435286043 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 3 and data pool 4 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7ff918062760 con 0x7ff918139c10 2024-04-25T02:20:24.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.165+0000 7ff91c8a9700 1 -- 172.21.15.111:0/3435286043 >> v1:172.21.15.111:6816/39585 conn(0x7ff8f4038da0 legacy=0x7ff8f403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:24.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.165+0000 7ff91c8a9700 1 -- 172.21.15.111:0/3435286043 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff918139c10 msgr2=0x7ff918062fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:24.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.165+0000 7ff91c8a9700 1 --2- 172.21.15.111:0/3435286043 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff918139c10 0x7ff918062fe0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7ff908000bc0 tx=0x7ff908007a60).stop 2024-04-25T02:20:24.172 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.168+0000 7ff91c8a9700 1 -- 172.21.15.111:0/3435286043 shutdown_connections 2024-04-25T02:20:24.172 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.168+0000 7ff91c8a9700 1 --2- 172.21.15.111:0/3435286043 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff91813ee30 0x7ff918145a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:24.172 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.168+0000 7ff91c8a9700 1 --2- 172.21.15.111:0/3435286043 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff918139c10 0x7ff918062fe0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:24.172 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.168+0000 7ff91c8a9700 1 --2- 172.21.15.111:0/3435286043 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff918139ff0 0x7ff91813e490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:24.172 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.168+0000 7ff91c8a9700 1 -- 172.21.15.111:0/3435286043 >> 172.21.15.111:0/3435286043 conn(0x7ff9180614e0 msgr2=0x7ff918097510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:24.172 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.168+0000 7ff91c8a9700 1 -- 172.21.15.111:0/3435286043 shutdown_connections 2024-04-25T02:20:24.172 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.168+0000 7ff91c8a9700 1 -- 172.21.15.111:0/3435286043 wait complete. 2024-04-25T02:20:24.184 INFO:teuthology.orchestra.run.smithi111.stderr:new fs with metadata pool 3 and data pool 4 2024-04-25T02:20:24.192 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:20:24.303 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.297+0000 7f746e74e700 1 Processor -- start 2024-04-25T02:20:24.303 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.297+0000 7f746e74e700 1 -- start start 2024-04-25T02:20:24.303 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.297+0000 7f746e74e700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f746805c020 0x7f7468061c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:24.303 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.297+0000 7f746e74e700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f746805c400 0x7f74680a6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:24.303 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.297+0000 7f746e74e700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f74680a7060 0x7f74681376c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:24.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.297+0000 7f746e74e700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74680a7500 con 0x7f74680a7060 2024-04-25T02:20:24.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.297+0000 7f746e74e700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7468067f10 con 0x7f746805c020 2024-04-25T02:20:24.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.297+0000 7f746e74e700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7468062130 con 0x7f746805c400 2024-04-25T02:20:24.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.297+0000 7f7467fff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f746805c020 0x7f7468061c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:24.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.298+0000 7f74677fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f746805c400 0x7f74680a6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:24.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.298+0000 7f746cceb700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f74680a7060 0x7f74681376c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:24.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.298+0000 7f7467fff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f746805c020 0x7f7468061c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:57258/0 (socket says 172.21.15.111:57258) 2024-04-25T02:20:24.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.298+0000 7f7467fff700 1 -- 172.21.15.111:0/2299087186 learned_addr learned my addr 172.21.15.111:0/2299087186 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:24.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.298+0000 7f74677fe700 1 -- 172.21.15.111:0/2299087186 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f746805c020 msgr2=0x7f7468061c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:24.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.298+0000 7f74677fe700 1 --2- 172.21.15.111:0/2299087186 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f746805c020 0x7f7468061c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:24.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.298+0000 7f74677fe700 1 -- 172.21.15.111:0/2299087186 >> v2:172.21.15.111:3300/0 conn(0x7f74680a7060 msgr2=0x7f74681376c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:24.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.298+0000 7f74677fe700 1 --2- 172.21.15.111:0/2299087186 >> v2:172.21.15.111:3300/0 conn(0x7f74680a7060 0x7f74681376c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:24.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.298+0000 7f74677fe700 1 -- 172.21.15.111:0/2299087186 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f746805bbd0 con 0x7f746805c400 2024-04-25T02:20:24.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.298+0000 7f7467fff700 1 --2- 172.21.15.111:0/2299087186 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f746805c020 0x7f7468061c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:24.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.298+0000 7f74677fe700 1 --2- 172.21.15.111:0/2299087186 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f746805c400 0x7f74680a6b70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f7468061b90 tx=0x7f745c006df0).ready entity=mon.2 client_cookie=eada33a10b821293 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:24.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.298+0000 7f7466ffd700 1 -- 172.21.15.111:0/2299087186 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f745c00d4a0 con 0x7f746805c400 2024-04-25T02:20:24.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.298+0000 7f7466ffd700 1 -- 172.21.15.111:0/2299087186 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f745c000e90 con 0x7f746805c400 2024-04-25T02:20:24.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.298+0000 7f7466ffd700 1 -- 172.21.15.111:0/2299087186 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f745c00d7f0 con 0x7f746805c400 2024-04-25T02:20:24.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.299+0000 7f746e74e700 1 -- 172.21.15.111:0/2299087186 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f746805c400 msgr2=0x7f74680a6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:24.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.299+0000 7f746e74e700 1 --2- 172.21.15.111:0/2299087186 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f746805c400 0x7f74680a6b70 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f7468061b90 tx=0x7f745c006df0).stop 2024-04-25T02:20:24.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.299+0000 7f746e74e700 1 -- 172.21.15.111:0/2299087186 shutdown_connections 2024-04-25T02:20:24.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.299+0000 7f746e74e700 1 --2- 172.21.15.111:0/2299087186 >> v2:172.21.15.111:3300/0 conn(0x7f74680a7060 0x7f74681376c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:24.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.299+0000 7f746e74e700 1 --2- 172.21.15.111:0/2299087186 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f746805c020 0x7f7468061c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:24.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.299+0000 7f746e74e700 1 --2- 172.21.15.111:0/2299087186 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f746805c400 0x7f74680a6b70 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:24.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.299+0000 7f746e74e700 1 -- 172.21.15.111:0/2299087186 >> 172.21.15.111:0/2299087186 conn(0x7f74680a8a00 msgr2=0x7f74680a8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:24.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.299+0000 7f746e74e700 1 -- 172.21.15.111:0/2299087186 shutdown_connections 2024-04-25T02:20:24.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.299+0000 7f746e74e700 1 -- 172.21.15.111:0/2299087186 wait complete. 2024-04-25T02:20:24.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.300+0000 7f746e74e700 1 Processor -- start 2024-04-25T02:20:24.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.300+0000 7f746e74e700 1 -- start start 2024-04-25T02:20:24.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.300+0000 7f746e74e700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f746805c020 0x7f7468095b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:24.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.301+0000 7f746e74e700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f746805c400 0x7f7468144270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:24.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.301+0000 7f746e74e700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f74680a7060 0x7f7468147390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:24.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.301+0000 7f746e74e700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7468143de0 con 0x7f746805c400 2024-04-25T02:20:24.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.301+0000 7f746e74e700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74681470d0 con 0x7f74680a7060 2024-04-25T02:20:24.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.301+0000 7f746e74e700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f74680939d0 con 0x7f746805c020 2024-04-25T02:20:24.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.301+0000 7f7467fff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f746805c020 0x7f7468095b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:24.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.301+0000 7f7467fff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f746805c020 0x7f7468095b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:60064/0 (socket says 172.21.15.111:60064) 2024-04-25T02:20:24.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.301+0000 7f74677fe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f746805c400 0x7f7468144270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:24.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.301+0000 7f7467fff700 1 -- 172.21.15.111:0/903643169 learned_addr learned my addr 172.21.15.111:0/903643169 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:24.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.301+0000 7f746cceb700 1 --2- 172.21.15.111:0/903643169 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f74680a7060 0x7f7468147390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:24.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.301+0000 7f7467fff700 1 -- 172.21.15.111:0/903643169 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f74680a7060 msgr2=0x7f7468147390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:24.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.301+0000 7f7467fff700 1 --2- 172.21.15.111:0/903643169 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f74680a7060 0x7f7468147390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:24.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.301+0000 7f7467fff700 1 -- 172.21.15.111:0/903643169 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f746805c400 msgr2=0x7f7468144270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:24.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.301+0000 7f7467fff700 1 --2- 172.21.15.111:0/903643169 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f746805c400 0x7f7468144270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:24.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.301+0000 7f7467fff700 1 -- 172.21.15.111:0/903643169 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f745800b1e0 con 0x7f746805c020 2024-04-25T02:20:24.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.301+0000 7f746cceb700 1 --2- 172.21.15.111:0/903643169 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f74680a7060 0x7f7468147390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:24.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.301+0000 7f74677fe700 1 --2- 172.21.15.111:0/903643169 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f746805c400 0x7f7468144270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:24.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.301+0000 7f7467fff700 1 --2- 172.21.15.111:0/903643169 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f746805c020 0x7f7468095b90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f745800c000 tx=0x7f7458006eb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:24.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.301+0000 7f74657fa700 1 -- 172.21.15.111:0/903643169 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7458012600 con 0x7f746805c020 2024-04-25T02:20:24.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.301+0000 7f74657fa700 1 -- 172.21.15.111:0/903643169 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7458012760 con 0x7f746805c020 2024-04-25T02:20:24.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.301+0000 7f746e74e700 1 -- 172.21.15.111:0/903643169 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f745c00b180 con 0x7f746805c020 2024-04-25T02:20:24.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.301+0000 7f74657fa700 1 -- 172.21.15.111:0/903643169 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7458012ac0 con 0x7f746805c020 2024-04-25T02:20:24.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.301+0000 7f746e74e700 1 -- 172.21.15.111:0/903643169 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7468144760 con 0x7f746805c020 2024-04-25T02:20:24.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.302+0000 7f74657fa700 1 -- 172.21.15.111:0/903643169 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f7458022070 con 0x7f746805c020 2024-04-25T02:20:24.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.302+0000 7f746e74e700 1 -- 172.21.15.111:0/903643169 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74680a7f70 con 0x7f746805c020 2024-04-25T02:20:24.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.302+0000 7f74657fa700 1 -- 172.21.15.111:0/903643169 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f745804ace0 con 0x7f746805c020 2024-04-25T02:20:24.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.305+0000 7f74657fa700 1 -- 172.21.15.111:0/903643169 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f7458033610 con 0x7f746805c020 2024-04-25T02:20:24.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.418+0000 7f746e74e700 1 -- 172.21.15.111:0/903643169 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7468093b10 con 0x7f746805c020 2024-04-25T02:20:24.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.418+0000 7f74657fa700 1 -- 172.21.15.111:0/903643169 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+10577 (secure 0 0 0) 0x7f7468093b10 con 0x7f746805c020 2024-04-25T02:20:24.423 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:20:24.423 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":17,"fsid":"4643f974-f93a-4436-93b8-460ff320e62e","created":"2024-04-25T02:20:05.450475+0000","modified":"2024-04-25T02:20:24.150507+0000","last_up_change":"2024-04-25T02:20:10.439204+0000","last_in_change":"2024-04-25T02:20:10.439204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-25T02:20:07.471248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:20:14.420378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:20:22.251868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T02:20:23.128289+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"df3f17ca-3b12-42c8-8cf7-8f1b7189e587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6800","nonce":40214}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6801","nonce":40214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6803","nonce":40214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6802","nonce":40214}]},"public_addr":"172.21.15.111:6800/40214","cluster_addr":"172.21.15.111:6801/40214","heartbeat_back_addr":"172.21.15.111:6803/40214","heartbeat_front_addr":"172.21.15.111:6802/40214","state":["exists","up"]},{"osd":1,"uuid":"93d54815-f215-4285-bba6-32f2d1cabf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6812","nonce":40216}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6813","nonce":40216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6815","nonce":40216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6814","nonce":40216}]},"public_addr":"172.21.15.111:6812/40216","cluster_addr":"172.21.15.111:6813/40216","heartbeat_back_addr":"172.21.15.111:6815/40216","heartbeat_front_addr":"172.21.15.111:6814/40216","state":["exists","up"]},{"osd":2,"uuid":"b26b2104-2a2e-408f-9ce7-3587a32a2ebe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6804","nonce":40215}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6805","nonce":40215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6807","nonce":40215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6806","nonce":40215}]},"public_addr":"172.21.15.111:6804/40215","cluster_addr":"172.21.15.111:6805/40215","heartbeat_back_addr":"172.21.15.111:6807/40215","heartbeat_front_addr":"172.21.15.111:6806/40215","state":["exists","up"]},{"osd":3,"uuid":"43c25820-1edc-4031-badf-72e87dd6bf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6808","nonce":40213}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6809","nonce":40213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6811","nonce":40213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6810","nonce":40213}]},"public_addr":"172.21.15.111:6808/40213","cluster_addr":"172.21.15.111:6809/40213","heartbeat_back_addr":"172.21.15.111:6811/40213","heartbeat_front_addr":"172.21.15.111:6810/40213","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.372427+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.411480+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.361508+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.377212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-25T02:20:24.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.419+0000 7f746e74e700 1 -- 172.21.15.111:0/903643169 >> v1:172.21.15.111:6816/39585 conn(0x7f7448038da0 legacy=0x7f744803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:24.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.419+0000 7f746e74e700 1 -- 172.21.15.111:0/903643169 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f746805c020 msgr2=0x7f7468095b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:24.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.419+0000 7f746e74e700 1 --2- 172.21.15.111:0/903643169 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f746805c020 0x7f7468095b90 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f745800c000 tx=0x7f7458006eb0).stop 2024-04-25T02:20:24.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.420+0000 7f746e74e700 1 -- 172.21.15.111:0/903643169 shutdown_connections 2024-04-25T02:20:24.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.420+0000 7f746e74e700 1 --2- 172.21.15.111:0/903643169 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f74680a7060 0x7f7468147390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:24.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.420+0000 7f746e74e700 1 --2- 172.21.15.111:0/903643169 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f746805c020 0x7f7468095b90 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:24.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.420+0000 7f746e74e700 1 --2- 172.21.15.111:0/903643169 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f746805c400 0x7f7468144270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:24.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.420+0000 7f746e74e700 1 -- 172.21.15.111:0/903643169 >> 172.21.15.111:0/903643169 conn(0x7f74680a8a00 msgr2=0x7f7468137fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:24.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.420+0000 7f746e74e700 1 -- 172.21.15.111:0/903643169 shutdown_connections 2024-04-25T02:20:24.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.420+0000 7f746e74e700 1 -- 172.21.15.111:0/903643169 wait complete. 2024-04-25T02:20:24.434 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:20:24.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.531+0000 7fb1e0edf700 1 Processor -- start 2024-04-25T02:20:24.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.531+0000 7fb1e0edf700 1 -- start start 2024-04-25T02:20:24.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.532+0000 7fb1e0edf700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fb1dc05c1a0 0x7fb1dc067040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:24.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.532+0000 7fb1e0edf700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb1dc067c20 0x7fb1dc05c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:24.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.532+0000 7fb1e0edf700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb1dc065c90 con 0x7fb1dc066170 2024-04-25T02:20:24.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.532+0000 7fb1e0edf700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb1dc05ca70 con 0x7fb1dc05c1a0 2024-04-25T02:20:24.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.532+0000 7fb1e0edf700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb1dc067680 con 0x7fb1dc067c20 2024-04-25T02:20:24.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.532+0000 7fb1d9d9b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb1dc067c20 0x7fb1dc05c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:24.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.532+0000 7fb1da59c700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fb1dc05c1a0 0x7fb1dc067040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:24.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.532+0000 7fb1d9d9b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb1dc067c20 0x7fb1dc05c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:60074/0 (socket says 172.21.15.111:60074) 2024-04-25T02:20:24.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.532+0000 7fb1dad9d700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7fb1dc066170 0x7fb1dc136350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:44210/0 (socket says 172.21.15.111:44210) 2024-04-25T02:20:24.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.532+0000 7fb1d9d9b700 1 -- 172.21.15.111:0/1981882050 learned_addr learned my addr 172.21.15.111:0/1981882050 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:24.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.532+0000 7fb1da59c700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fb1dc05c1a0 0x7fb1dc067040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:39522/0 (socket says 172.21.15.111:39522) 2024-04-25T02:20:24.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.532+0000 7fb1da59c700 1 -- 172.21.15.111:0/1981882050 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb1dc067c20 msgr2=0x7fb1dc05c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:24.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.532+0000 7fb1da59c700 1 --2- 172.21.15.111:0/1981882050 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb1dc067c20 0x7fb1dc05c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:24.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.532+0000 7fb1da59c700 1 -- 172.21.15.111:0/1981882050 >> v1:172.21.15.111:6789/0 conn(0x7fb1dc066170 legacy=0x7fb1dc136350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:24.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.532+0000 7fb1d959a700 1 -- 172.21.15.111:0/1981882050 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 979274873 0 0) 0x7fb1dc065c90 con 0x7fb1dc066170 2024-04-25T02:20:24.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.533+0000 7fb1da59c700 1 -- 172.21.15.111:0/1981882050 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1dc05ba50 con 0x7fb1dc05c1a0 2024-04-25T02:20:24.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.533+0000 7fb1d9d9b700 1 --2- 172.21.15.111:0/1981882050 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb1dc067c20 0x7fb1dc05c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:24.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.533+0000 7fb1da59c700 1 --2- 172.21.15.111:0/1981882050 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb1dc05c1a0 0x7fb1dc067040 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fb1d0002f70 tx=0x7fb1d0006df0).ready entity=mon.0 client_cookie=102f9da78b709b2c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:24.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.533+0000 7fb1d959a700 1 -- 172.21.15.111:0/1981882050 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1d000d570 con 0x7fb1dc05c1a0 2024-04-25T02:20:24.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.533+0000 7fb1d959a700 1 -- 172.21.15.111:0/1981882050 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d0000e90 con 0x7fb1dc05c1a0 2024-04-25T02:20:24.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.533+0000 7fb1d959a700 1 -- 172.21.15.111:0/1981882050 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1d000d8c0 con 0x7fb1dc05c1a0 2024-04-25T02:20:24.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.533+0000 7fb1e0edf700 1 -- 172.21.15.111:0/1981882050 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb1dc05c1a0 msgr2=0x7fb1dc067040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:24.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.533+0000 7fb1e0edf700 1 --2- 172.21.15.111:0/1981882050 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb1dc05c1a0 0x7fb1dc067040 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fb1d0002f70 tx=0x7fb1d0006df0).stop 2024-04-25T02:20:24.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.533+0000 7fb1e0edf700 1 -- 172.21.15.111:0/1981882050 shutdown_connections 2024-04-25T02:20:24.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.533+0000 7fb1e0edf700 1 --2- 172.21.15.111:0/1981882050 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb1dc05c1a0 0x7fb1dc067040 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:24.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.533+0000 7fb1e0edf700 1 --2- 172.21.15.111:0/1981882050 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb1dc067c20 0x7fb1dc05c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:24.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.533+0000 7fb1e0edf700 1 -- 172.21.15.111:0/1981882050 >> 172.21.15.111:0/1981882050 conn(0x7fb1dc0a8a00 msgr2=0x7fb1dc0a8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:24.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.533+0000 7fb1e0edf700 1 -- 172.21.15.111:0/1981882050 shutdown_connections 2024-04-25T02:20:24.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.533+0000 7fb1e0edf700 1 -- 172.21.15.111:0/1981882050 wait complete. 2024-04-25T02:20:24.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.534+0000 7fb1e0edf700 1 Processor -- start 2024-04-25T02:20:24.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.534+0000 7fb1e0edf700 1 -- start start 2024-04-25T02:20:24.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.535+0000 7fb1e0edf700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb1dc05c1a0 0x7fb1dc097960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:24.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.535+0000 7fb1e0edf700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb1dc066170 0x7fb1dc095870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:24.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.535+0000 7fb1e0edf700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb1dc067c20 0x7fb1dc0925b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:24.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.535+0000 7fb1e0edf700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1dc097e50 con 0x7fb1dc067c20 2024-04-25T02:20:24.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.535+0000 7fb1e0edf700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1dc134ba0 con 0x7fb1dc05c1a0 2024-04-25T02:20:24.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.535+0000 7fb1e0edf700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb1dc134e40 con 0x7fb1dc066170 2024-04-25T02:20:24.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.535+0000 7fb1d9d9b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb1dc066170 0x7fb1dc095870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:24.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.535+0000 7fb1dad9d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb1dc067c20 0x7fb1dc0925b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:24.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.535+0000 7fb1da59c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb1dc05c1a0 0x7fb1dc097960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:24.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.535+0000 7fb1dad9d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb1dc067c20 0x7fb1dc0925b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:39526/0 (socket says 172.21.15.111:39526) 2024-04-25T02:20:24.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.535+0000 7fb1d9d9b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb1dc066170 0x7fb1dc095870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:60086/0 (socket says 172.21.15.111:60086) 2024-04-25T02:20:24.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.535+0000 7fb1dad9d700 1 -- 172.21.15.111:0/1706878035 learned_addr learned my addr 172.21.15.111:0/1706878035 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:24.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.535+0000 7fb1da59c700 1 --2- 172.21.15.111:0/1706878035 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb1dc05c1a0 0x7fb1dc097960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:57270/0 (socket says 172.21.15.111:57270) 2024-04-25T02:20:24.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.535+0000 7fb1da59c700 1 -- 172.21.15.111:0/1706878035 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb1dc066170 msgr2=0x7fb1dc095870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:24.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.535+0000 7fb1da59c700 1 --2- 172.21.15.111:0/1706878035 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb1dc066170 0x7fb1dc095870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:24.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.535+0000 7fb1da59c700 1 -- 172.21.15.111:0/1706878035 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb1dc067c20 msgr2=0x7fb1dc0925b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:24.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.535+0000 7fb1da59c700 1 --2- 172.21.15.111:0/1706878035 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb1dc067c20 0x7fb1dc0925b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:24.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.535+0000 7fb1da59c700 1 -- 172.21.15.111:0/1706878035 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1cc00b1e0 con 0x7fb1dc05c1a0 2024-04-25T02:20:24.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.535+0000 7fb1dad9d700 1 --2- 172.21.15.111:0/1706878035 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb1dc067c20 0x7fb1dc0925b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:24.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.535+0000 7fb1d9d9b700 1 --2- 172.21.15.111:0/1706878035 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb1dc066170 0x7fb1dc095870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:24.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.535+0000 7fb1da59c700 1 --2- 172.21.15.111:0/1706878035 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb1dc05c1a0 0x7fb1dc097960 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fb1d0002f70 tx=0x7fb1d0014000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:24.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.535+0000 7fb1cb7fe700 1 -- 172.21.15.111:0/1706878035 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1d0016070 con 0x7fb1dc05c1a0 2024-04-25T02:20:24.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.535+0000 7fb1cb7fe700 1 -- 172.21.15.111:0/1706878035 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb1d0013980 con 0x7fb1dc05c1a0 2024-04-25T02:20:24.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.535+0000 7fb1e0edf700 1 -- 172.21.15.111:0/1706878035 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1d000b180 con 0x7fb1dc05c1a0 2024-04-25T02:20:24.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.535+0000 7fb1cb7fe700 1 -- 172.21.15.111:0/1706878035 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb1d0013ce0 con 0x7fb1dc05c1a0 2024-04-25T02:20:24.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.535+0000 7fb1e0edf700 1 -- 172.21.15.111:0/1706878035 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1dc134860 con 0x7fb1dc05c1a0 2024-04-25T02:20:24.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.536+0000 7fb1cb7fe700 1 -- 172.21.15.111:0/1706878035 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fb1d0025030 con 0x7fb1dc05c1a0 2024-04-25T02:20:24.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.536+0000 7fb1cb7fe700 1 -- 172.21.15.111:0/1706878035 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fb1d004b810 con 0x7fb1dc05c1a0 2024-04-25T02:20:24.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.537+0000 7fb1e0edf700 1 -- 172.21.15.111:0/1706878035 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb1dc05e4b0 con 0x7fb1dc05c1a0 2024-04-25T02:20:24.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.540+0000 7fb1cb7fe700 1 -- 172.21.15.111:0/1706878035 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fb1d0023030 con 0x7fb1dc05c1a0 2024-04-25T02:20:24.654 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.650+0000 7fb1e0edf700 1 -- 172.21.15.111:0/1706878035 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb1dc057a60 con 0x7fb1dc05c1a0 2024-04-25T02:20:24.655 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.651+0000 7fb1cb7fe700 1 -- 172.21.15.111:0/1706878035 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v17) v1 ==== 74+0+10577 (secure 0 0 0) 0x7fb1d0020440 con 0x7fb1dc05c1a0 2024-04-25T02:20:24.655 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:20:24.655 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":17,"fsid":"4643f974-f93a-4436-93b8-460ff320e62e","created":"2024-04-25T02:20:05.450475+0000","modified":"2024-04-25T02:20:24.150507+0000","last_up_change":"2024-04-25T02:20:10.439204+0000","last_in_change":"2024-04-25T02:20:10.439204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-25T02:20:07.471248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:20:14.420378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:20:22.251868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T02:20:23.128289+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"df3f17ca-3b12-42c8-8cf7-8f1b7189e587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6800","nonce":40214}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6801","nonce":40214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6803","nonce":40214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6802","nonce":40214}]},"public_addr":"172.21.15.111:6800/40214","cluster_addr":"172.21.15.111:6801/40214","heartbeat_back_addr":"172.21.15.111:6803/40214","heartbeat_front_addr":"172.21.15.111:6802/40214","state":["exists","up"]},{"osd":1,"uuid":"93d54815-f215-4285-bba6-32f2d1cabf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6812","nonce":40216}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6813","nonce":40216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6815","nonce":40216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6814","nonce":40216}]},"public_addr":"172.21.15.111:6812/40216","cluster_addr":"172.21.15.111:6813/40216","heartbeat_back_addr":"172.21.15.111:6815/40216","heartbeat_front_addr":"172.21.15.111:6814/40216","state":["exists","up"]},{"osd":2,"uuid":"b26b2104-2a2e-408f-9ce7-3587a32a2ebe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6804","nonce":40215}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6805","nonce":40215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6807","nonce":40215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6806","nonce":40215}]},"public_addr":"172.21.15.111:6804/40215","cluster_addr":"172.21.15.111:6805/40215","heartbeat_back_addr":"172.21.15.111:6807/40215","heartbeat_front_addr":"172.21.15.111:6806/40215","state":["exists","up"]},{"osd":3,"uuid":"43c25820-1edc-4031-badf-72e87dd6bf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6808","nonce":40213}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6809","nonce":40213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6811","nonce":40213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6810","nonce":40213}]},"public_addr":"172.21.15.111:6808/40213","cluster_addr":"172.21.15.111:6809/40213","heartbeat_back_addr":"172.21.15.111:6811/40213","heartbeat_front_addr":"172.21.15.111:6810/40213","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.372427+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.411480+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.361508+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.377212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-25T02:20:24.657 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.652+0000 7fb1e0edf700 1 -- 172.21.15.111:0/1706878035 >> v1:172.21.15.111:6816/39585 conn(0x7fb1b8038da0 legacy=0x7fb1b803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:24.657 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.652+0000 7fb1e0edf700 1 -- 172.21.15.111:0/1706878035 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb1dc05c1a0 msgr2=0x7fb1dc097960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:24.657 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.652+0000 7fb1e0edf700 1 --2- 172.21.15.111:0/1706878035 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb1dc05c1a0 0x7fb1dc097960 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fb1d0002f70 tx=0x7fb1d0014000).stop 2024-04-25T02:20:24.657 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.652+0000 7fb1e0edf700 1 -- 172.21.15.111:0/1706878035 shutdown_connections 2024-04-25T02:20:24.657 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.652+0000 7fb1e0edf700 1 --2- 172.21.15.111:0/1706878035 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb1dc067c20 0x7fb1dc0925b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:24.657 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.652+0000 7fb1e0edf700 1 --2- 172.21.15.111:0/1706878035 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb1dc05c1a0 0x7fb1dc097960 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:24.657 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.652+0000 7fb1e0edf700 1 --2- 172.21.15.111:0/1706878035 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb1dc066170 0x7fb1dc095870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:24.657 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.652+0000 7fb1e0edf700 1 -- 172.21.15.111:0/1706878035 >> 172.21.15.111:0/1706878035 conn(0x7fb1dc0a8a00 msgr2=0x7fb1dc09fdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:24.657 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.652+0000 7fb1e0edf700 1 -- 172.21.15.111:0/1706878035 shutdown_connections 2024-04-25T02:20:24.657 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.652+0000 7fb1e0edf700 1 -- 172.21.15.111:0/1706878035 wait complete. 2024-04-25T02:20:24.667 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-25T02:20:24.771 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.767+0000 7f9cf93c7700 1 Processor -- start 2024-04-25T02:20:24.771 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.767+0000 7f9cf93c7700 1 -- start start 2024-04-25T02:20:24.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.768+0000 7f9cf93c7700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f9cf412c310 0x7f9cf405cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:24.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.768+0000 7f9cf93c7700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9cf405da60 0x7f9cf40a8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:24.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.768+0000 7f9cf93c7700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9cf412c6f0 0x7f9cf40a93d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:24.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.768+0000 7f9cf93c7700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cf413a760 con 0x7f9cf412c310 2024-04-25T02:20:24.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.768+0000 7f9cf93c7700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf41377e0 con 0x7f9cf405da60 2024-04-25T02:20:24.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.768+0000 7f9cf93c7700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf405c420 con 0x7f9cf412c6f0 2024-04-25T02:20:24.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.768+0000 7f9cf37fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9cf412c6f0 0x7f9cf40a93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:24.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.768+0000 7f9cf27fc700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9cf405da60 0x7f9cf40a8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:24.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.768+0000 7f9cf2ffd700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f9cf412c310 0x7f9cf405cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:24.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.768+0000 7f9cf37fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9cf412c6f0 0x7f9cf40a93d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:60094/0 (socket says 172.21.15.111:60094) 2024-04-25T02:20:24.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.768+0000 7f9cf27fc700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9cf405da60 0x7f9cf40a8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:57278/0 (socket says 172.21.15.111:57278) 2024-04-25T02:20:24.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.768+0000 7f9cf37fe700 1 -- 172.21.15.111:0/285694658 learned_addr learned my addr 172.21.15.111:0/285694658 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:24.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.768+0000 7f9cf27fc700 1 -- 172.21.15.111:0/285694658 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9cf412c6f0 msgr2=0x7f9cf40a93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:24.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.768+0000 7f9cf27fc700 1 --2- 172.21.15.111:0/285694658 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9cf412c6f0 0x7f9cf40a93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:24.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.768+0000 7f9cf27fc700 1 -- 172.21.15.111:0/285694658 >> v2:172.21.15.111:3300/0 conn(0x7f9cf412c310 msgr2=0x7f9cf405cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:24.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.768+0000 7f9cf27fc700 1 --2- 172.21.15.111:0/285694658 >> v2:172.21.15.111:3300/0 conn(0x7f9cf412c310 0x7f9cf405cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:24.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.768+0000 7f9cf27fc700 1 -- 172.21.15.111:0/285694658 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf40a7770 con 0x7f9cf405da60 2024-04-25T02:20:24.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.768+0000 7f9cf37fe700 1 --2- 172.21.15.111:0/285694658 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9cf412c6f0 0x7f9cf40a93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:24.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.768+0000 7f9cf2ffd700 1 --2- 172.21.15.111:0/285694658 >> v2:172.21.15.111:3300/0 conn(0x7f9cf412c310 0x7f9cf405cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:24.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.768+0000 7f9cf27fc700 1 --2- 172.21.15.111:0/285694658 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9cf405da60 0x7f9cf40a8ee0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f9cf40a7610 tx=0x7f9ce4006df0).ready entity=mon.1 client_cookie=cfb070acd2ac7e89 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:24.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.768+0000 7f9cf1ffb700 1 -- 172.21.15.111:0/285694658 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ce400d570 con 0x7f9cf405da60 2024-04-25T02:20:24.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.769+0000 7f9cf1ffb700 1 -- 172.21.15.111:0/285694658 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce4000e90 con 0x7f9cf405da60 2024-04-25T02:20:24.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.769+0000 7f9cf1ffb700 1 -- 172.21.15.111:0/285694658 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ce400d8c0 con 0x7f9cf405da60 2024-04-25T02:20:24.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.769+0000 7f9cf93c7700 1 -- 172.21.15.111:0/285694658 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9cf405da60 msgr2=0x7f9cf40a8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:24.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.769+0000 7f9cf93c7700 1 --2- 172.21.15.111:0/285694658 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9cf405da60 0x7f9cf40a8ee0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f9cf40a7610 tx=0x7f9ce4006df0).stop 2024-04-25T02:20:24.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.769+0000 7f9cf93c7700 1 -- 172.21.15.111:0/285694658 shutdown_connections 2024-04-25T02:20:24.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.769+0000 7f9cf93c7700 1 --2- 172.21.15.111:0/285694658 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9cf412c6f0 0x7f9cf40a93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:24.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.769+0000 7f9cf93c7700 1 --2- 172.21.15.111:0/285694658 >> v2:172.21.15.111:3300/0 conn(0x7f9cf412c310 0x7f9cf405cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:24.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.769+0000 7f9cf93c7700 1 --2- 172.21.15.111:0/285694658 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9cf405da60 0x7f9cf40a8ee0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:24.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.769+0000 7f9cf93c7700 1 -- 172.21.15.111:0/285694658 >> 172.21.15.111:0/285694658 conn(0x7f9cf4066b10 msgr2=0x7f9cf406c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:24.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.769+0000 7f9cf93c7700 1 -- 172.21.15.111:0/285694658 shutdown_connections 2024-04-25T02:20:24.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.769+0000 7f9cf93c7700 1 -- 172.21.15.111:0/285694658 wait complete. 2024-04-25T02:20:24.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.770+0000 7f9cf93c7700 1 Processor -- start 2024-04-25T02:20:24.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.770+0000 7f9cf93c7700 1 -- start start 2024-04-25T02:20:24.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.770+0000 7f9cf93c7700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9cf412c310 0x7f9cf4149660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:24.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.771+0000 7f9cf93c7700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9cf412c6f0 0x7f9cf4149e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:24.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.771+0000 7f9cf93c7700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9cf40a6710 0x7f9cf40a4eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:24.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.771+0000 7f9cf93c7700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf40a8d00 con 0x7f9cf40a6710 2024-04-25T02:20:24.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.771+0000 7f9cf93c7700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf412d5a0 con 0x7f9cf412c6f0 2024-04-25T02:20:24.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.771+0000 7f9cf93c7700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf414a320 con 0x7f9cf412c310 2024-04-25T02:20:24.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.771+0000 7f9cf2ffd700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9cf412c310 0x7f9cf4149660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:24.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.771+0000 7f9cf27fc700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9cf412c6f0 0x7f9cf4149e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:24.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.771+0000 7f9cf2ffd700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9cf412c310 0x7f9cf4149660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:60098/0 (socket says 172.21.15.111:60098) 2024-04-25T02:20:24.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.771+0000 7f9cf2ffd700 1 -- 172.21.15.111:0/755666222 learned_addr learned my addr 172.21.15.111:0/755666222 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:24.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.771+0000 7f9cf37fe700 1 --2- 172.21.15.111:0/755666222 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9cf40a6710 0x7f9cf40a4eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:24.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.771+0000 7f9cf2ffd700 1 -- 172.21.15.111:0/755666222 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9cf412c6f0 msgr2=0x7f9cf4149e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:24.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.771+0000 7f9cf2ffd700 1 --2- 172.21.15.111:0/755666222 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9cf412c6f0 0x7f9cf4149e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:24.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.771+0000 7f9cf2ffd700 1 -- 172.21.15.111:0/755666222 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9cf40a6710 msgr2=0x7f9cf40a4eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:24.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.771+0000 7f9cf2ffd700 1 --2- 172.21.15.111:0/755666222 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9cf40a6710 0x7f9cf40a4eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:24.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.771+0000 7f9cf2ffd700 1 -- 172.21.15.111:0/755666222 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce800b180 con 0x7f9cf412c310 2024-04-25T02:20:24.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.771+0000 7f9cf27fc700 1 --2- 172.21.15.111:0/755666222 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9cf412c6f0 0x7f9cf4149e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:24.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.771+0000 7f9cf2ffd700 1 --2- 172.21.15.111:0/755666222 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9cf412c310 0x7f9cf4149660 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f9ce800c000 tx=0x7f9ce8006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:24.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.771+0000 7f9ce3fff700 1 -- 172.21.15.111:0/755666222 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ce800c7e0 con 0x7f9cf412c310 2024-04-25T02:20:24.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.771+0000 7f9ce3fff700 1 -- 172.21.15.111:0/755666222 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ce800c940 con 0x7f9cf412c310 2024-04-25T02:20:24.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.771+0000 7f9cf93c7700 1 -- 172.21.15.111:0/755666222 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cec009530 con 0x7f9cf412c310 2024-04-25T02:20:24.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.771+0000 7f9ce3fff700 1 -- 172.21.15.111:0/755666222 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9ce800cca0 con 0x7f9cf412c310 2024-04-25T02:20:24.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.771+0000 7f9cf93c7700 1 -- 172.21.15.111:0/755666222 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ce400b180 con 0x7f9cf412c310 2024-04-25T02:20:24.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.772+0000 7f9ce3fff700 1 -- 172.21.15.111:0/755666222 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f9ce801c460 con 0x7f9cf412c310 2024-04-25T02:20:24.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.772+0000 7f9cf93c7700 1 -- 172.21.15.111:0/755666222 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cf4137cb0 con 0x7f9cf412c310 2024-04-25T02:20:24.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.772+0000 7f9ce3fff700 1 -- 172.21.15.111:0/755666222 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f9ce804adf0 con 0x7f9cf412c310 2024-04-25T02:20:24.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.775+0000 7f9ce3fff700 1 -- 172.21.15.111:0/755666222 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f9ce8030150 con 0x7f9cf412c310 2024-04-25T02:20:24.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:24.920+0000 7f9cf93c7700 1 -- 172.21.15.111:0/755666222 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f9cf4139ab0 con 0x7f9cf412c310 2024-04-25T02:20:25.159 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.155+0000 7f9ce3fff700 1 -- 172.21.15.111:0/755666222 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7f9ce800ce00 con 0x7f9cf412c310 2024-04-25T02:20:25.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.157+0000 7f9cf93c7700 1 -- 172.21.15.111:0/755666222 >> v1:172.21.15.111:6816/39585 conn(0x7f9cd0038da0 legacy=0x7f9cd003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:25.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.157+0000 7f9cf93c7700 1 -- 172.21.15.111:0/755666222 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9cf412c310 msgr2=0x7f9cf4149660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:25.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.157+0000 7f9cf93c7700 1 --2- 172.21.15.111:0/755666222 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9cf412c310 0x7f9cf4149660 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f9ce800c000 tx=0x7f9ce8006df0).stop 2024-04-25T02:20:25.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.157+0000 7f9cf93c7700 1 -- 172.21.15.111:0/755666222 shutdown_connections 2024-04-25T02:20:25.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.157+0000 7f9cf93c7700 1 --2- 172.21.15.111:0/755666222 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9cf40a6710 0x7f9cf40a4eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:25.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.157+0000 7f9cf93c7700 1 --2- 172.21.15.111:0/755666222 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9cf412c310 0x7f9cf4149660 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:25.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.157+0000 7f9cf93c7700 1 --2- 172.21.15.111:0/755666222 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9cf412c6f0 0x7f9cf4149e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:25.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.157+0000 7f9cf93c7700 1 -- 172.21.15.111:0/755666222 >> 172.21.15.111:0/755666222 conn(0x7f9cf4066b10 msgr2=0x7f9cf405ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:25.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.157+0000 7f9cf93c7700 1 -- 172.21.15.111:0/755666222 shutdown_connections 2024-04-25T02:20:25.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.157+0000 7f9cf93c7700 1 -- 172.21.15.111:0/755666222 wait complete. 2024-04-25T02:20:25.173 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 2} 2024-04-25T02:20:25.174 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 2 2024-04-25T02:20:25.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.275+0000 7f710c04b700 1 Processor -- start 2024-04-25T02:20:25.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.275+0000 7f710c04b700 1 -- start start 2024-04-25T02:20:25.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.276+0000 7f710c04b700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f71040633b0 0x7f71040642e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:25.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.276+0000 7f710c04b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7104062590 0x7f710413d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:25.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.276+0000 7f710c04b700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71041363d0 con 0x7f7104136800 2024-04-25T02:20:25.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.276+0000 7f710c04b700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71041372f0 con 0x7f71040633b0 2024-04-25T02:20:25.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.276+0000 7f7109de7700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f7104136800 0x7f7104136be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:44226/0 (socket says 172.21.15.111:44226) 2024-04-25T02:20:25.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.276+0000 7f710c04b700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71040647d0 con 0x7f7104062590 2024-04-25T02:20:25.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.276+0000 7f710a5e8700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7104062590 0x7f710413d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:25.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.276+0000 7f7109de7700 1 -- 172.21.15.111:0/1235702854 learned_addr learned my addr 172.21.15.111:0/1235702854 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:20:25.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.277+0000 7f71095e6700 1 --2- 172.21.15.111:0/1235702854 >> v2:172.21.15.111:3300/0 conn(0x7f71040633b0 0x7f71040642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:25.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.277+0000 7f7108de5700 1 -- 172.21.15.111:0/1235702854 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3879921739 0 0) 0x7f71041363d0 con 0x7f7104136800 2024-04-25T02:20:25.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.277+0000 7f7108de5700 1 -- 172.21.15.111:0/1235702854 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f70ec003260 con 0x7f7104136800 2024-04-25T02:20:25.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.277+0000 7f71095e6700 1 -- 172.21.15.111:0/1235702854 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7104062590 msgr2=0x7f710413d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:25.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.277+0000 7f71095e6700 1 --2- 172.21.15.111:0/1235702854 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7104062590 0x7f710413d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:25.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.277+0000 7f71095e6700 1 -- 172.21.15.111:0/1235702854 >> v1:172.21.15.111:6789/0 conn(0x7f7104136800 legacy=0x7f7104136be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:25.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.277+0000 7f71095e6700 1 -- 172.21.15.111:0/1235702854 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7104136600 con 0x7f71040633b0 2024-04-25T02:20:25.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.277+0000 7f710a5e8700 1 --2- 172.21.15.111:0/1235702854 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7104062590 0x7f710413d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:25.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.277+0000 7f71095e6700 1 --2- 172.21.15.111:0/1235702854 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f71040633b0 0x7f71040642e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f70f4001110 tx=0x7f7100006df0).ready entity=mon.0 client_cookie=e129907fdaf8bc73 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:25.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.277+0000 7f7108de5700 1 -- 172.21.15.111:0/1235702854 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7100014070 con 0x7f71040633b0 2024-04-25T02:20:25.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.277+0000 7f7108de5700 1 -- 172.21.15.111:0/1235702854 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7100000e90 con 0x7f71040633b0 2024-04-25T02:20:25.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.277+0000 7f7108de5700 1 -- 172.21.15.111:0/1235702854 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f710000fa90 con 0x7f71040633b0 2024-04-25T02:20:25.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.278+0000 7f710c04b700 1 -- 172.21.15.111:0/1235702854 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f71040633b0 msgr2=0x7f71040642e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:25.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.278+0000 7f710c04b700 1 --2- 172.21.15.111:0/1235702854 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f71040633b0 0x7f71040642e0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f70f4001110 tx=0x7f7100006df0).stop 2024-04-25T02:20:25.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.279+0000 7f710c04b700 1 -- 172.21.15.111:0/1235702854 shutdown_connections 2024-04-25T02:20:25.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.279+0000 7f710c04b700 1 --2- 172.21.15.111:0/1235702854 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7104062590 0x7f710413d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:25.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.279+0000 7f710c04b700 1 --2- 172.21.15.111:0/1235702854 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f71040633b0 0x7f71040642e0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:25.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.279+0000 7f710c04b700 1 -- 172.21.15.111:0/1235702854 >> 172.21.15.111:0/1235702854 conn(0x7f71040614e0 msgr2=0x7f710406c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:25.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.279+0000 7f710c04b700 1 -- 172.21.15.111:0/1235702854 shutdown_connections 2024-04-25T02:20:25.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.279+0000 7f710c04b700 1 -- 172.21.15.111:0/1235702854 wait complete. 2024-04-25T02:20:25.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.280+0000 7f710c04b700 1 Processor -- start 2024-04-25T02:20:25.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.280+0000 7f710c04b700 1 -- start start 2024-04-25T02:20:25.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.281+0000 7f710c04b700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7104062590 0x7f710409d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:25.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.281+0000 7f710c04b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f71040633b0 0x7f710412fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:25.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.281+0000 7f710c04b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7104136800 0x7f7104130360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:25.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.281+0000 7f710c04b700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71041370a0 con 0x7f7104136800 2024-04-25T02:20:25.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.281+0000 7f710c04b700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7104044d20 con 0x7f7104062590 2024-04-25T02:20:25.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.281+0000 7f710c04b700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7104067940 con 0x7f71040633b0 2024-04-25T02:20:25.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.281+0000 7f71095e6700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f71040633b0 0x7f710412fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:25.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.281+0000 7f71095e6700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f71040633b0 0x7f710412fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:60118/0 (socket says 172.21.15.111:60118) 2024-04-25T02:20:25.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.281+0000 7f71095e6700 1 -- 172.21.15.111:0/3857749343 learned_addr learned my addr 172.21.15.111:0/3857749343 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:25.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.281+0000 7f7109de7700 1 --2- 172.21.15.111:0/3857749343 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7104062590 0x7f710409d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:25.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.281+0000 7f710a5e8700 1 --2- 172.21.15.111:0/3857749343 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7104136800 0x7f7104130360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:25.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.281+0000 7f71095e6700 1 -- 172.21.15.111:0/3857749343 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7104062590 msgr2=0x7f710409d3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:25.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.281+0000 7f71095e6700 1 --2- 172.21.15.111:0/3857749343 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7104062590 0x7f710409d3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:25.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.281+0000 7f71095e6700 1 -- 172.21.15.111:0/3857749343 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7104136800 msgr2=0x7f7104130360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:25.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.281+0000 7f71095e6700 1 --2- 172.21.15.111:0/3857749343 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7104136800 0x7f7104130360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:25.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.281+0000 7f71095e6700 1 -- 172.21.15.111:0/3857749343 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70fc009470 con 0x7f71040633b0 2024-04-25T02:20:25.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.281+0000 7f71095e6700 1 --2- 172.21.15.111:0/3857749343 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f71040633b0 0x7f710412fe70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f70f4001110 tx=0x7f7100016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:25.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.281+0000 7f70f2ffd700 1 -- 172.21.15.111:0/3857749343 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7100002f70 con 0x7f71040633b0 2024-04-25T02:20:25.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.281+0000 7f70f2ffd700 1 -- 172.21.15.111:0/3857749343 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7100010ca0 con 0x7f71040633b0 2024-04-25T02:20:25.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.281+0000 7f70f2ffd700 1 -- 172.21.15.111:0/3857749343 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f710001c440 con 0x7f71040633b0 2024-04-25T02:20:25.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.281+0000 7f710c04b700 1 -- 172.21.15.111:0/3857749343 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f710000b180 con 0x7f71040633b0 2024-04-25T02:20:25.288 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.281+0000 7f710c04b700 1 -- 172.21.15.111:0/3857749343 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7104096820 con 0x7f71040633b0 2024-04-25T02:20:25.288 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.282+0000 7f70f2ffd700 1 -- 172.21.15.111:0/3857749343 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f7100022020 con 0x7f71040633b0 2024-04-25T02:20:25.288 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.283+0000 7f70f2ffd700 1 -- 172.21.15.111:0/3857749343 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f710004c190 con 0x7f71040633b0 2024-04-25T02:20:25.288 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.283+0000 7f710c04b700 1 -- 172.21.15.111:0/3857749343 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7104098de0 con 0x7f71040633b0 2024-04-25T02:20:25.289 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.286+0000 7f70f2ffd700 1 -- 172.21.15.111:0/3857749343 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f7104098de0 con 0x7f71040633b0 2024-04-25T02:20:25.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:25.428+0000 7f710c04b700 1 -- 172.21.15.111:0/3857749343 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7f7104098de0 con 0x7f71040633b0 2024-04-25T02:20:26.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.230+0000 7f70f2ffd700 1 -- 172.21.15.111:0/3857749343 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7f7104098de0 con 0x7f71040633b0 2024-04-25T02:20:26.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.232+0000 7f710c04b700 1 -- 172.21.15.111:0/3857749343 >> v1:172.21.15.111:6816/39585 conn(0x7f70e4038e30 legacy=0x7f70e403b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:26.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.232+0000 7f710c04b700 1 -- 172.21.15.111:0/3857749343 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f71040633b0 msgr2=0x7f710412fe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:26.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.232+0000 7f710c04b700 1 --2- 172.21.15.111:0/3857749343 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f71040633b0 0x7f710412fe70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f70f4001110 tx=0x7f7100016000).stop 2024-04-25T02:20:26.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.232+0000 7f710c04b700 1 -- 172.21.15.111:0/3857749343 shutdown_connections 2024-04-25T02:20:26.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.232+0000 7f710c04b700 1 --2- 172.21.15.111:0/3857749343 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7104136800 0x7f7104130360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:26.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.232+0000 7f710c04b700 1 --2- 172.21.15.111:0/3857749343 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7104062590 0x7f710409d3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:26.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.232+0000 7f710c04b700 1 --2- 172.21.15.111:0/3857749343 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f71040633b0 0x7f710412fe70 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:26.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.232+0000 7f710c04b700 1 -- 172.21.15.111:0/3857749343 >> 172.21.15.111:0/3857749343 conn(0x7f71040614e0 msgr2=0x7f710405ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:26.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.233+0000 7f710c04b700 1 -- 172.21.15.111:0/3857749343 shutdown_connections 2024-04-25T02:20:26.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.233+0000 7f710c04b700 1 -- 172.21.15.111:0/3857749343 wait complete. 2024-04-25T02:20:26.255 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T02:20:26.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.361+0000 7fed26aee700 1 Processor -- start 2024-04-25T02:20:26.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.361+0000 7fed26aee700 1 -- start start 2024-04-25T02:20:26.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.362+0000 7fed26aee700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fed20139c70 0x7fed20061a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:26.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.362+0000 7fed26aee700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fed20060e70 0x7fed2013a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:26.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.362+0000 7fed26aee700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed201395b0 con 0x7fed2009c010 2024-04-25T02:20:26.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.362+0000 7fed26aee700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed20061610 con 0x7fed20139c70 2024-04-25T02:20:26.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.362+0000 7fed26aee700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed2009c860 con 0x7fed20060e70 2024-04-25T02:20:26.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.362+0000 7fed1ffff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fed20060e70 0x7fed2013a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:26.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.362+0000 7fed2488a700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fed20139c70 0x7fed20061a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:26.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.362+0000 7fed1ffff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fed20060e70 0x7fed2013a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:60134/0 (socket says 172.21.15.111:60134) 2024-04-25T02:20:26.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.362+0000 7fed2508b700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7fed2009c010 0x7fed20136040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:44236/0 (socket says 172.21.15.111:44236) 2024-04-25T02:20:26.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.362+0000 7fed1ffff700 1 -- 172.21.15.111:0/2039984744 learned_addr learned my addr 172.21.15.111:0/2039984744 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:26.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.362+0000 7fed2488a700 1 -- 172.21.15.111:0/2039984744 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fed20060e70 msgr2=0x7fed2013a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:26.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.362+0000 7fed2488a700 1 --2- 172.21.15.111:0/2039984744 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fed20060e70 0x7fed2013a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:26.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.362+0000 7fed2488a700 1 -- 172.21.15.111:0/2039984744 >> v1:172.21.15.111:6789/0 conn(0x7fed2009c010 legacy=0x7fed20136040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:26.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.362+0000 7fed2488a700 1 -- 172.21.15.111:0/2039984744 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed20060690 con 0x7fed20139c70 2024-04-25T02:20:26.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.362+0000 7fed1f7fe700 1 -- 172.21.15.111:0/2039984744 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 70394590 0 0) 0x7fed201395b0 con 0x7fed2009c010 2024-04-25T02:20:26.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.362+0000 7fed1ffff700 1 --2- 172.21.15.111:0/2039984744 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fed20060e70 0x7fed2013a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:26.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.362+0000 7fed2488a700 1 --2- 172.21.15.111:0/2039984744 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fed20139c70 0x7fed20061a60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fed14002f70 tx=0x7fed14006df0).ready entity=mon.0 client_cookie=27a798933985ff77 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:26.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.362+0000 7fed1f7fe700 1 -- 172.21.15.111:0/2039984744 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed1400d570 con 0x7fed20139c70 2024-04-25T02:20:26.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.362+0000 7fed1f7fe700 1 -- 172.21.15.111:0/2039984744 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed14000e90 con 0x7fed20139c70 2024-04-25T02:20:26.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.362+0000 7fed1f7fe700 1 -- 172.21.15.111:0/2039984744 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed1400d8c0 con 0x7fed20139c70 2024-04-25T02:20:26.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.363+0000 7fed26aee700 1 -- 172.21.15.111:0/2039984744 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fed20139c70 msgr2=0x7fed20061a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:26.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.363+0000 7fed26aee700 1 --2- 172.21.15.111:0/2039984744 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fed20139c70 0x7fed20061a60 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fed14002f70 tx=0x7fed14006df0).stop 2024-04-25T02:20:26.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.363+0000 7fed26aee700 1 -- 172.21.15.111:0/2039984744 shutdown_connections 2024-04-25T02:20:26.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.363+0000 7fed26aee700 1 --2- 172.21.15.111:0/2039984744 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fed20139c70 0x7fed20061a60 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:26.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.363+0000 7fed26aee700 1 --2- 172.21.15.111:0/2039984744 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fed20060e70 0x7fed2013a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:26.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.363+0000 7fed26aee700 1 -- 172.21.15.111:0/2039984744 >> 172.21.15.111:0/2039984744 conn(0x7fed2005d070 msgr2=0x7fed200625e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:26.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.363+0000 7fed26aee700 1 -- 172.21.15.111:0/2039984744 shutdown_connections 2024-04-25T02:20:26.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.363+0000 7fed26aee700 1 -- 172.21.15.111:0/2039984744 wait complete. 2024-04-25T02:20:26.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.364+0000 7fed26aee700 1 Processor -- start 2024-04-25T02:20:26.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.364+0000 7fed26aee700 1 -- start start 2024-04-25T02:20:26.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.365+0000 7fed26aee700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fed20060e70 0x7fed20096780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:26.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.365+0000 7fed26aee700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fed2009c010 0x7fed20095e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:26.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.365+0000 7fed26aee700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fed20139c70 0x7fed20094050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:26.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.365+0000 7fed26aee700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed20145a40 con 0x7fed20139c70 2024-04-25T02:20:26.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.365+0000 7fed26aee700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed20097560 con 0x7fed20060e70 2024-04-25T02:20:26.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.365+0000 7fed26aee700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed20145c30 con 0x7fed2009c010 2024-04-25T02:20:26.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.365+0000 7fed1ffff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fed2009c010 0x7fed20095e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:26.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.365+0000 7fed2508b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fed20139c70 0x7fed20094050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:26.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.365+0000 7fed2488a700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fed20060e70 0x7fed20096780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:26.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.365+0000 7fed1ffff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fed2009c010 0x7fed20095e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:60140/0 (socket says 172.21.15.111:60140) 2024-04-25T02:20:26.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.365+0000 7fed1ffff700 1 -- 172.21.15.111:0/540868951 learned_addr learned my addr 172.21.15.111:0/540868951 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:26.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.365+0000 7fed2508b700 1 -- 172.21.15.111:0/540868951 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fed2009c010 msgr2=0x7fed20095e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:26.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.365+0000 7fed2508b700 1 --2- 172.21.15.111:0/540868951 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fed2009c010 0x7fed20095e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:26.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.365+0000 7fed2508b700 1 -- 172.21.15.111:0/540868951 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fed20060e70 msgr2=0x7fed20096780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:26.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.365+0000 7fed2508b700 1 --2- 172.21.15.111:0/540868951 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fed20060e70 0x7fed20096780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:26.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.365+0000 7fed2508b700 1 -- 172.21.15.111:0/540868951 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed0c00b1e0 con 0x7fed20139c70 2024-04-25T02:20:26.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.365+0000 7fed1ffff700 1 --2- 172.21.15.111:0/540868951 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fed2009c010 0x7fed20095e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:26.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.365+0000 7fed2488a700 1 --2- 172.21.15.111:0/540868951 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fed20060e70 0x7fed20096780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:26.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.365+0000 7fed2508b700 1 --2- 172.21.15.111:0/540868951 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fed20139c70 0x7fed20094050 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fed18001250 tx=0x7fed18007d00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:26.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.366+0000 7fed1dffb700 1 -- 172.21.15.111:0/540868951 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed18005ae0 con 0x7fed20139c70 2024-04-25T02:20:26.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.366+0000 7fed1dffb700 1 -- 172.21.15.111:0/540868951 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed18005c40 con 0x7fed20139c70 2024-04-25T02:20:26.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.366+0000 7fed26aee700 1 -- 172.21.15.111:0/540868951 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed1400b180 con 0x7fed20139c70 2024-04-25T02:20:26.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.366+0000 7fed1dffb700 1 -- 172.21.15.111:0/540868951 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed180070d0 con 0x7fed20139c70 2024-04-25T02:20:26.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.366+0000 7fed26aee700 1 -- 172.21.15.111:0/540868951 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed20145f80 con 0x7fed20139c70 2024-04-25T02:20:26.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.366+0000 7fed1dffb700 1 -- 172.21.15.111:0/540868951 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fed1801a060 con 0x7fed20139c70 2024-04-25T02:20:26.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.366+0000 7fed26aee700 1 -- 172.21.15.111:0/540868951 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed20096500 con 0x7fed20139c70 2024-04-25T02:20:26.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.367+0000 7fed1dffb700 1 -- 172.21.15.111:0/540868951 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fed1804a150 con 0x7fed20139c70 2024-04-25T02:20:26.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.370+0000 7fed1dffb700 1 -- 172.21.15.111:0/540868951 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fed1802f050 con 0x7fed20139c70 2024-04-25T02:20:26.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:26.513+0000 7fed26aee700 1 -- 172.21.15.111:0/540868951 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fed20062cf0 con 0x7fed20139c70 2024-04-25T02:20:27.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.236+0000 7fed1dffb700 1 -- 172.21.15.111:0/540868951 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fed18018030 con 0x7fed20139c70 2024-04-25T02:20:27.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.238+0000 7fed26aee700 1 -- 172.21.15.111:0/540868951 >> v1:172.21.15.111:6816/39585 conn(0x7fed00038da0 legacy=0x7fed0003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:27.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.238+0000 7fed26aee700 1 -- 172.21.15.111:0/540868951 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fed20139c70 msgr2=0x7fed20094050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:27.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.238+0000 7fed26aee700 1 --2- 172.21.15.111:0/540868951 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fed20139c70 0x7fed20094050 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fed18001250 tx=0x7fed18007d00).stop 2024-04-25T02:20:27.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.238+0000 7fed26aee700 1 -- 172.21.15.111:0/540868951 shutdown_connections 2024-04-25T02:20:27.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.238+0000 7fed26aee700 1 --2- 172.21.15.111:0/540868951 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fed20139c70 0x7fed20094050 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:27.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.238+0000 7fed26aee700 1 --2- 172.21.15.111:0/540868951 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fed20060e70 0x7fed20096780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:27.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.238+0000 7fed26aee700 1 --2- 172.21.15.111:0/540868951 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fed2009c010 0x7fed20095e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:27.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.238+0000 7fed26aee700 1 -- 172.21.15.111:0/540868951 >> 172.21.15.111:0/540868951 conn(0x7fed2005d070 msgr2=0x7fed201332d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:27.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.238+0000 7fed26aee700 1 -- 172.21.15.111:0/540868951 shutdown_connections 2024-04-25T02:20:27.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.238+0000 7fed26aee700 1 -- 172.21.15.111:0/540868951 wait complete. 2024-04-25T02:20:27.255 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-25T02:20:27.255 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:20:27.362 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.358+0000 7f6b92a84700 1 Processor -- start 2024-04-25T02:20:27.363 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.358+0000 7f6b92a84700 1 -- start start 2024-04-25T02:20:27.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.359+0000 7f6b92a84700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f6b8c05c1a0 0x7f6b8c067040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:27.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.359+0000 7f6b92a84700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6b8c067c20 0x7f6b8c05c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:27.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.359+0000 7f6b92a84700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b8c065c90 con 0x7f6b8c066170 2024-04-25T02:20:27.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.359+0000 7f6b92a84700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b8c05ca70 con 0x7f6b8c05c1a0 2024-04-25T02:20:27.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.359+0000 7f6b92a84700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8c067680 con 0x7f6b8c067c20 2024-04-25T02:20:27.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.359+0000 7f6b8bfff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6b8c067c20 0x7f6b8c05c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:27.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.359+0000 7f6b90820700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f6b8c05c1a0 0x7f6b8c067040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:27.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.359+0000 7f6b91021700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f6b8c066170 0x7f6b8c136350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:44246/0 (socket says 172.21.15.111:44246) 2024-04-25T02:20:27.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.359+0000 7f6b91021700 1 -- 172.21.15.111:0/3430150112 learned_addr learned my addr 172.21.15.111:0/3430150112 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:20:27.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.359+0000 7f6b90820700 1 -- 172.21.15.111:0/3430150112 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6b8c067c20 msgr2=0x7f6b8c05c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:27.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.359+0000 7f6b90820700 1 --2- 172.21.15.111:0/3430150112 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6b8c067c20 0x7f6b8c05c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:27.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.359+0000 7f6b90820700 1 -- 172.21.15.111:0/3430150112 >> v1:172.21.15.111:6789/0 conn(0x7f6b8c066170 legacy=0x7f6b8c136350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:27.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.360+0000 7f6b90820700 1 -- 172.21.15.111:0/3430150112 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b8c05ba50 con 0x7f6b8c05c1a0 2024-04-25T02:20:27.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.360+0000 7f6b8b7fe700 1 -- 172.21.15.111:0/3430150112 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3306941960 0 0) 0x7f6b8c065c90 con 0x7f6b8c066170 2024-04-25T02:20:27.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.360+0000 7f6b8bfff700 1 --2- 172.21.15.111:0/3430150112 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6b8c067c20 0x7f6b8c05c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:27.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.360+0000 7f6b90820700 1 --2- 172.21.15.111:0/3430150112 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6b8c05c1a0 0x7f6b8c067040 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f6b80002f70 tx=0x7f6b80006df0).ready entity=mon.0 client_cookie=4baf492e931f472c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:27.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.360+0000 7f6b8b7fe700 1 -- 172.21.15.111:0/3430150112 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b8000d570 con 0x7f6b8c05c1a0 2024-04-25T02:20:27.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.360+0000 7f6b8b7fe700 1 -- 172.21.15.111:0/3430150112 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b80000e90 con 0x7f6b8c05c1a0 2024-04-25T02:20:27.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.360+0000 7f6b8b7fe700 1 -- 172.21.15.111:0/3430150112 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b8000d8c0 con 0x7f6b8c05c1a0 2024-04-25T02:20:27.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.360+0000 7f6b92a84700 1 -- 172.21.15.111:0/3430150112 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6b8c05c1a0 msgr2=0x7f6b8c067040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:27.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.360+0000 7f6b92a84700 1 --2- 172.21.15.111:0/3430150112 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6b8c05c1a0 0x7f6b8c067040 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f6b80002f70 tx=0x7f6b80006df0).stop 2024-04-25T02:20:27.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.360+0000 7f6b92a84700 1 -- 172.21.15.111:0/3430150112 shutdown_connections 2024-04-25T02:20:27.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.360+0000 7f6b92a84700 1 --2- 172.21.15.111:0/3430150112 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6b8c05c1a0 0x7f6b8c067040 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:27.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.360+0000 7f6b92a84700 1 --2- 172.21.15.111:0/3430150112 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6b8c067c20 0x7f6b8c05c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:27.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.360+0000 7f6b92a84700 1 -- 172.21.15.111:0/3430150112 >> 172.21.15.111:0/3430150112 conn(0x7f6b8c0a8a00 msgr2=0x7f6b8c0a8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:27.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.360+0000 7f6b92a84700 1 -- 172.21.15.111:0/3430150112 shutdown_connections 2024-04-25T02:20:27.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.360+0000 7f6b92a84700 1 -- 172.21.15.111:0/3430150112 wait complete. 2024-04-25T02:20:27.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.361+0000 7f6b92a84700 1 Processor -- start 2024-04-25T02:20:27.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.361+0000 7f6b92a84700 1 -- start start 2024-04-25T02:20:27.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.362+0000 7f6b92a84700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6b8c05c1a0 0x7f6b8c0937e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:27.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.362+0000 7f6b92a84700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6b8c066170 0x7f6b8c149150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:27.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.362+0000 7f6b92a84700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6b8c067c20 0x7f6b8c149640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:27.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.362+0000 7f6b92a84700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8c0a1fc0 con 0x7f6b8c067c20 2024-04-25T02:20:27.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.362+0000 7f6b92a84700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8c0a2280 con 0x7f6b8c066170 2024-04-25T02:20:27.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.362+0000 7f6b92a84700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b8c0920b0 con 0x7f6b8c05c1a0 2024-04-25T02:20:27.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.362+0000 7f6b90820700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6b8c05c1a0 0x7f6b8c0937e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:27.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.362+0000 7f6b91021700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6b8c067c20 0x7f6b8c149640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:27.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.362+0000 7f6b90820700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6b8c05c1a0 0x7f6b8c0937e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:60164/0 (socket says 172.21.15.111:60164) 2024-04-25T02:20:27.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.362+0000 7f6b90820700 1 -- 172.21.15.111:0/3243230167 learned_addr learned my addr 172.21.15.111:0/3243230167 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:27.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.362+0000 7f6b8bfff700 1 --2- 172.21.15.111:0/3243230167 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6b8c066170 0x7f6b8c149150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:27.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.362+0000 7f6b90820700 1 -- 172.21.15.111:0/3243230167 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6b8c066170 msgr2=0x7f6b8c149150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:27.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.362+0000 7f6b90820700 1 --2- 172.21.15.111:0/3243230167 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6b8c066170 0x7f6b8c149150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:27.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.362+0000 7f6b90820700 1 -- 172.21.15.111:0/3243230167 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6b8c067c20 msgr2=0x7f6b8c149640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:27.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.362+0000 7f6b90820700 1 --2- 172.21.15.111:0/3243230167 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6b8c067c20 0x7f6b8c149640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:27.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.362+0000 7f6b90820700 1 -- 172.21.15.111:0/3243230167 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b7800b180 con 0x7f6b8c05c1a0 2024-04-25T02:20:27.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.362+0000 7f6b91021700 1 --2- 172.21.15.111:0/3243230167 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6b8c067c20 0x7f6b8c149640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:27.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.362+0000 7f6b8bfff700 1 --2- 172.21.15.111:0/3243230167 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6b8c066170 0x7f6b8c149150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:27.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.362+0000 7f6b90820700 1 --2- 172.21.15.111:0/3243230167 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6b8c05c1a0 0x7f6b8c0937e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f6b80002f70 tx=0x7f6b80014000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:27.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.363+0000 7f6b89ffb700 1 -- 172.21.15.111:0/3243230167 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b80013e10 con 0x7f6b8c05c1a0 2024-04-25T02:20:27.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.363+0000 7f6b89ffb700 1 -- 172.21.15.111:0/3243230167 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b8001e400 con 0x7f6b8c05c1a0 2024-04-25T02:20:27.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.363+0000 7f6b92a84700 1 -- 172.21.15.111:0/3243230167 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b8000b180 con 0x7f6b8c05c1a0 2024-04-25T02:20:27.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.363+0000 7f6b89ffb700 1 -- 172.21.15.111:0/3243230167 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6b8001e760 con 0x7f6b8c05c1a0 2024-04-25T02:20:27.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.363+0000 7f6b92a84700 1 -- 172.21.15.111:0/3243230167 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b8c13a210 con 0x7f6b8c05c1a0 2024-04-25T02:20:27.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.363+0000 7f6b89ffb700 1 -- 172.21.15.111:0/3243230167 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f6b80025030 con 0x7f6b8c05c1a0 2024-04-25T02:20:27.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.364+0000 7f6b89ffb700 1 -- 172.21.15.111:0/3243230167 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f6b8004b6b0 con 0x7f6b8c05c1a0 2024-04-25T02:20:27.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.364+0000 7f6b92a84700 1 -- 172.21.15.111:0/3243230167 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b8c0930c0 con 0x7f6b8c05c1a0 2024-04-25T02:20:27.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.367+0000 7f6b89ffb700 1 -- 172.21.15.111:0/3243230167 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f6b800058c0 con 0x7f6b8c05c1a0 2024-04-25T02:20:27.513 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.508+0000 7f6b92a84700 1 -- 172.21.15.111:0/3243230167 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6b8c13a430 con 0x7f6b8c05c1a0 2024-04-25T02:20:27.513 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.508+0000 7f6b89ffb700 1 -- 172.21.15.111:0/3243230167 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+2326 (secure 0 0 0) 0x7f6b80023930 con 0x7f6b8c05c1a0 2024-04-25T02:20:27.514 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:20:27.514 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4193,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6817/3699616235","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6817","nonce":3699616235}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:20:24.150791+0000","modified":"2024-04-25T02:20:27.234975+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":4239,"mds_1":4236},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4236":{"gid":4236,"name":"c","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.111:6818/2165982859","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6818","nonce":2165982859}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4239":{"gid":4239,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.111:6819/4003866251","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6819","nonce":4003866251}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-25T02:20:27.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.510+0000 7f6b92a84700 1 -- 172.21.15.111:0/3243230167 >> v1:172.21.15.111:6816/39585 conn(0x7f6b6c038da0 legacy=0x7f6b6c03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:27.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.510+0000 7f6b92a84700 1 -- 172.21.15.111:0/3243230167 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6b8c05c1a0 msgr2=0x7f6b8c0937e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:27.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.510+0000 7f6b92a84700 1 --2- 172.21.15.111:0/3243230167 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6b8c05c1a0 0x7f6b8c0937e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f6b80002f70 tx=0x7f6b80014000).stop 2024-04-25T02:20:27.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.510+0000 7f6b92a84700 1 -- 172.21.15.111:0/3243230167 shutdown_connections 2024-04-25T02:20:27.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.510+0000 7f6b92a84700 1 --2- 172.21.15.111:0/3243230167 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6b8c067c20 0x7f6b8c149640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:27.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.510+0000 7f6b92a84700 1 --2- 172.21.15.111:0/3243230167 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6b8c05c1a0 0x7f6b8c0937e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:27.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.510+0000 7f6b92a84700 1 --2- 172.21.15.111:0/3243230167 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6b8c066170 0x7f6b8c149150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:27.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.510+0000 7f6b92a84700 1 -- 172.21.15.111:0/3243230167 >> 172.21.15.111:0/3243230167 conn(0x7f6b8c0a8a00 msgr2=0x7f6b8c134a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:27.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.510+0000 7f6b92a84700 1 -- 172.21.15.111:0/3243230167 shutdown_connections 2024-04-25T02:20:27.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.510+0000 7f6b92a84700 1 -- 172.21.15.111:0/3243230167 wait complete. 2024-04-25T02:20:27.518 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 8 2024-04-25T02:20:27.525 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:20:27.628 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.624+0000 7f6533cb9700 1 Processor -- start 2024-04-25T02:20:27.628 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.624+0000 7f6533cb9700 1 -- start start 2024-04-25T02:20:27.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.625+0000 7f6533cb9700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f652c136800 0x7f652c0642e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:27.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.625+0000 7f6533cb9700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f652c0633b0 0x7f652c136be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:27.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.625+0000 7f6533cb9700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f652c1363d0 con 0x7f652c062590 2024-04-25T02:20:27.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.625+0000 7f6533cb9700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f652c0647d0 con 0x7f652c136800 2024-04-25T02:20:27.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.625+0000 7f6533cb9700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f652c136600 con 0x7f652c0633b0 2024-04-25T02:20:27.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.625+0000 7f6531254700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f652c0633b0 0x7f652c136be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:27.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.625+0000 7f6531a55700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f652c136800 0x7f652c0642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:27.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.625+0000 7f6532256700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f652c062590 0x7f652c0a82a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:44256/0 (socket says 172.21.15.111:44256) 2024-04-25T02:20:27.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.625+0000 7f6532256700 1 -- 172.21.15.111:0/2442464773 learned_addr learned my addr 172.21.15.111:0/2442464773 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:20:27.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.625+0000 7f6531254700 1 -- 172.21.15.111:0/2442464773 >> v2:172.21.15.111:3300/0 conn(0x7f652c136800 msgr2=0x7f652c0642e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:27.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.625+0000 7f6531254700 1 --2- 172.21.15.111:0/2442464773 >> v2:172.21.15.111:3300/0 conn(0x7f652c136800 0x7f652c0642e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:27.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.625+0000 7f6531254700 1 -- 172.21.15.111:0/2442464773 >> v1:172.21.15.111:6789/0 conn(0x7f652c062590 legacy=0x7f652c0a82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:27.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.625+0000 7f6531254700 1 -- 172.21.15.111:0/2442464773 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f652c0a9d70 con 0x7f652c0633b0 2024-04-25T02:20:27.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.625+0000 7f6530a53700 1 -- 172.21.15.111:0/2442464773 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2753893462 0 0) 0x7f652c1363d0 con 0x7f652c062590 2024-04-25T02:20:27.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.625+0000 7f6531a55700 1 --2- 172.21.15.111:0/2442464773 >> v2:172.21.15.111:3300/0 conn(0x7f652c136800 0x7f652c0642e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:27.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.625+0000 7f6531254700 1 --2- 172.21.15.111:0/2442464773 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f652c0633b0 0x7f652c136be0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f6528002f70 tx=0x7f6528006df0).ready entity=mon.1 client_cookie=55f05c0e56976671 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:27.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.625+0000 7f6530a53700 1 -- 172.21.15.111:0/2442464773 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f652800d570 con 0x7f652c0633b0 2024-04-25T02:20:27.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.625+0000 7f6530a53700 1 -- 172.21.15.111:0/2442464773 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6528000e90 con 0x7f652c0633b0 2024-04-25T02:20:27.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.626+0000 7f6530a53700 1 -- 172.21.15.111:0/2442464773 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f652800d8c0 con 0x7f652c0633b0 2024-04-25T02:20:27.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.626+0000 7f6533cb9700 1 -- 172.21.15.111:0/2442464773 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f652c0633b0 msgr2=0x7f652c136be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:27.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.626+0000 7f6533cb9700 1 --2- 172.21.15.111:0/2442464773 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f652c0633b0 0x7f652c136be0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f6528002f70 tx=0x7f6528006df0).stop 2024-04-25T02:20:27.635 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.626+0000 7f6533cb9700 1 -- 172.21.15.111:0/2442464773 shutdown_connections 2024-04-25T02:20:27.635 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.626+0000 7f6533cb9700 1 --2- 172.21.15.111:0/2442464773 >> v2:172.21.15.111:3300/0 conn(0x7f652c136800 0x7f652c0642e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:27.635 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.626+0000 7f6533cb9700 1 --2- 172.21.15.111:0/2442464773 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f652c0633b0 0x7f652c136be0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:27.635 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.626+0000 7f6533cb9700 1 -- 172.21.15.111:0/2442464773 >> 172.21.15.111:0/2442464773 conn(0x7f652c0614e0 msgr2=0x7f652c06c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:27.635 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.626+0000 7f6533cb9700 1 -- 172.21.15.111:0/2442464773 shutdown_connections 2024-04-25T02:20:27.635 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.626+0000 7f6533cb9700 1 -- 172.21.15.111:0/2442464773 wait complete. 2024-04-25T02:20:27.635 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.627+0000 7f6533cb9700 1 Processor -- start 2024-04-25T02:20:27.635 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.627+0000 7f6533cb9700 1 -- start start 2024-04-25T02:20:27.635 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.627+0000 7f6533cb9700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f652c062590 0x7f652c0677a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:27.635 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.627+0000 7f6533cb9700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f652c0633b0 0x7f652c148dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:27.635 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.627+0000 7f6533cb9700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f652c136800 0x7f652c1492c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:27.635 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.627+0000 7f6533cb9700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f652c0923f0 con 0x7f652c0633b0 2024-04-25T02:20:27.635 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.627+0000 7f6533cb9700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f652c093060 con 0x7f652c062590 2024-04-25T02:20:27.635 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.627+0000 7f6533cb9700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f652c092da0 con 0x7f652c136800 2024-04-25T02:20:27.635 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.628+0000 7f6531a55700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f652c062590 0x7f652c0677a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:27.635 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.628+0000 7f6531254700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f652c0633b0 0x7f652c148dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:27.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.628+0000 7f6531a55700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f652c062590 0x7f652c0677a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:57324/0 (socket says 172.21.15.111:57324) 2024-04-25T02:20:27.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.628+0000 7f6531254700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f652c0633b0 0x7f652c148dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:39604/0 (socket says 172.21.15.111:39604) 2024-04-25T02:20:27.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.628+0000 7f6531a55700 1 -- 172.21.15.111:0/3094577950 learned_addr learned my addr 172.21.15.111:0/3094577950 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:27.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.628+0000 7f6532256700 1 --2- 172.21.15.111:0/3094577950 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f652c136800 0x7f652c1492c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:27.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.628+0000 7f6531254700 1 -- 172.21.15.111:0/3094577950 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f652c136800 msgr2=0x7f652c1492c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:27.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.628+0000 7f6531254700 1 --2- 172.21.15.111:0/3094577950 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f652c136800 0x7f652c1492c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:27.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.628+0000 7f6531254700 1 -- 172.21.15.111:0/3094577950 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f652c062590 msgr2=0x7f652c0677a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:27.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.628+0000 7f6531254700 1 --2- 172.21.15.111:0/3094577950 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f652c062590 0x7f652c0677a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:27.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.628+0000 7f6531254700 1 -- 172.21.15.111:0/3094577950 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f651c00b180 con 0x7f652c0633b0 2024-04-25T02:20:27.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.628+0000 7f6531a55700 1 --2- 172.21.15.111:0/3094577950 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f652c062590 0x7f652c0677a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:27.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.628+0000 7f6531254700 1 --2- 172.21.15.111:0/3094577950 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f652c0633b0 0x7f652c148dd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f6528002f70 tx=0x7f6528014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:27.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.628+0000 7f651affd700 1 -- 172.21.15.111:0/3094577950 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6528013de0 con 0x7f652c0633b0 2024-04-25T02:20:27.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.628+0000 7f651affd700 1 -- 172.21.15.111:0/3094577950 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f652801e400 con 0x7f652c0633b0 2024-04-25T02:20:27.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.628+0000 7f6533cb9700 1 -- 172.21.15.111:0/3094577950 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f652800b180 con 0x7f652c0633b0 2024-04-25T02:20:27.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.628+0000 7f651affd700 1 -- 172.21.15.111:0/3094577950 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f652801e760 con 0x7f652c0633b0 2024-04-25T02:20:27.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.628+0000 7f6533cb9700 1 -- 172.21.15.111:0/3094577950 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f652c098df0 con 0x7f652c0633b0 2024-04-25T02:20:27.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.629+0000 7f651affd700 1 -- 172.21.15.111:0/3094577950 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f6528025030 con 0x7f652c0633b0 2024-04-25T02:20:27.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.629+0000 7f6533cb9700 1 -- 172.21.15.111:0/3094577950 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f652c0675a0 con 0x7f652c0633b0 2024-04-25T02:20:27.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.629+0000 7f651affd700 1 -- 172.21.15.111:0/3094577950 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f652804b580 con 0x7f652c0633b0 2024-04-25T02:20:27.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.632+0000 7f651affd700 1 -- 172.21.15.111:0/3094577950 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f6528028610 con 0x7f652c0633b0 2024-04-25T02:20:27.748 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.744+0000 7f6533cb9700 1 -- 172.21.15.111:0/3094577950 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f652c067fc0 con 0x7f652c0633b0 2024-04-25T02:20:27.749 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.745+0000 7f651affd700 1 -- 172.21.15.111:0/3094577950 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+10564 (secure 0 0 0) 0x7f65280204b0 con 0x7f652c0633b0 2024-04-25T02:20:27.749 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:20:27.749 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":18,"fsid":"4643f974-f93a-4436-93b8-460ff320e62e","created":"2024-04-25T02:20:05.450475+0000","modified":"2024-04-25T02:20:25.151994+0000","last_up_change":"2024-04-25T02:20:10.439204+0000","last_in_change":"2024-04-25T02:20:10.439204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-25T02:20:07.471248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:20:14.420378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:20:22.251868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T02:20:23.128289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"df3f17ca-3b12-42c8-8cf7-8f1b7189e587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6800","nonce":40214}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6801","nonce":40214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6803","nonce":40214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6802","nonce":40214}]},"public_addr":"172.21.15.111:6800/40214","cluster_addr":"172.21.15.111:6801/40214","heartbeat_back_addr":"172.21.15.111:6803/40214","heartbeat_front_addr":"172.21.15.111:6802/40214","state":["exists","up"]},{"osd":1,"uuid":"93d54815-f215-4285-bba6-32f2d1cabf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6812","nonce":40216}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6813","nonce":40216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6815","nonce":40216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6814","nonce":40216}]},"public_addr":"172.21.15.111:6812/40216","cluster_addr":"172.21.15.111:6813/40216","heartbeat_back_addr":"172.21.15.111:6815/40216","heartbeat_front_addr":"172.21.15.111:6814/40216","state":["exists","up"]},{"osd":2,"uuid":"b26b2104-2a2e-408f-9ce7-3587a32a2ebe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6804","nonce":40215}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6805","nonce":40215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6807","nonce":40215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6806","nonce":40215}]},"public_addr":"172.21.15.111:6804/40215","cluster_addr":"172.21.15.111:6805/40215","heartbeat_back_addr":"172.21.15.111:6807/40215","heartbeat_front_addr":"172.21.15.111:6806/40215","state":["exists","up"]},{"osd":3,"uuid":"43c25820-1edc-4031-badf-72e87dd6bf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6808","nonce":40213}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6809","nonce":40213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6811","nonce":40213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6810","nonce":40213}]},"public_addr":"172.21.15.111:6808/40213","cluster_addr":"172.21.15.111:6809/40213","heartbeat_back_addr":"172.21.15.111:6811/40213","heartbeat_front_addr":"172.21.15.111:6810/40213","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.372427+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.411480+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.361508+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.377212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-25T02:20:27.751 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.746+0000 7f6533cb9700 1 -- 172.21.15.111:0/3094577950 >> v1:172.21.15.111:6816/39585 conn(0x7f650c038da0 legacy=0x7f650c03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:27.751 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.746+0000 7f6533cb9700 1 -- 172.21.15.111:0/3094577950 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f652c0633b0 msgr2=0x7f652c148dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:27.751 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.746+0000 7f6533cb9700 1 --2- 172.21.15.111:0/3094577950 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f652c0633b0 0x7f652c148dd0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f6528002f70 tx=0x7f6528014000).stop 2024-04-25T02:20:27.751 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.746+0000 7f6533cb9700 1 -- 172.21.15.111:0/3094577950 shutdown_connections 2024-04-25T02:20:27.751 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.746+0000 7f6533cb9700 1 --2- 172.21.15.111:0/3094577950 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f652c136800 0x7f652c1492c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:27.751 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.746+0000 7f6533cb9700 1 --2- 172.21.15.111:0/3094577950 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f652c062590 0x7f652c0677a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:27.751 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.746+0000 7f6533cb9700 1 --2- 172.21.15.111:0/3094577950 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f652c0633b0 0x7f652c148dd0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:27.751 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.746+0000 7f6533cb9700 1 -- 172.21.15.111:0/3094577950 >> 172.21.15.111:0/3094577950 conn(0x7f652c0614e0 msgr2=0x7f652c131980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:27.751 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.746+0000 7f6533cb9700 1 -- 172.21.15.111:0/3094577950 shutdown_connections 2024-04-25T02:20:27.751 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.746+0000 7f6533cb9700 1 -- 172.21.15.111:0/3094577950 wait complete. 2024-04-25T02:20:27.761 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-25T02:20:27.761 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:20:27.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.859+0000 7f56fc2e3700 1 Processor -- start 2024-04-25T02:20:27.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.859+0000 7f56fc2e3700 1 -- start start 2024-04-25T02:20:27.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.860+0000 7f56fc2e3700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f56f405c020 0x7f56f4061c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:27.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.860+0000 7f56fc2e3700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f56f405c7e0 0x7f56f413ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:27.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.860+0000 7f56fc2e3700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56f40a7280 con 0x7f56f405c400 2024-04-25T02:20:27.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.860+0000 7f56fc2e3700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56f40a7500 con 0x7f56f405c020 2024-04-25T02:20:27.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.860+0000 7f56fc2e3700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56f4067f10 con 0x7f56f405c7e0 2024-04-25T02:20:27.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.860+0000 7f56fa07f700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f56f405c020 0x7f56f4061c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:27.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.860+0000 7f56fa880700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f56f405c7e0 0x7f56f413ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:27.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.860+0000 7f56f987e700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f56f405c400 0x7f56f40a6b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:44268/0 (socket says 172.21.15.111:44268) 2024-04-25T02:20:27.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.860+0000 7f56f987e700 1 -- 172.21.15.111:0/2438019029 learned_addr learned my addr 172.21.15.111:0/2438019029 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:20:27.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.860+0000 7f56f907d700 1 -- 172.21.15.111:0/2438019029 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1312466868 0 0) 0x7f56f40a7280 con 0x7f56f405c400 2024-04-25T02:20:27.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.860+0000 7f56fa07f700 1 -- 172.21.15.111:0/2438019029 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f56f405c7e0 msgr2=0x7f56f413ea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:27.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.860+0000 7f56fa07f700 1 --2- 172.21.15.111:0/2438019029 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f56f405c7e0 0x7f56f413ea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:27.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.860+0000 7f56fa07f700 1 -- 172.21.15.111:0/2438019029 >> v1:172.21.15.111:6789/0 conn(0x7f56f405c400 legacy=0x7f56f40a6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:27.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.860+0000 7f56fa07f700 1 -- 172.21.15.111:0/2438019029 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56f4062130 con 0x7f56f405c020 2024-04-25T02:20:27.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.860+0000 7f56fa880700 1 --2- 172.21.15.111:0/2438019029 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f56f405c7e0 0x7f56f413ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:27.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.860+0000 7f56fa07f700 1 --2- 172.21.15.111:0/2438019029 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f56f405c020 0x7f56f4061c40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f56f0002f70 tx=0x7f56f0006df0).ready entity=mon.1 client_cookie=17f8bf2437b7484b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:27.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.860+0000 7f56f907d700 1 -- 172.21.15.111:0/2438019029 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56f000d570 con 0x7f56f405c020 2024-04-25T02:20:27.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.860+0000 7f56f907d700 1 -- 172.21.15.111:0/2438019029 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56f0000e90 con 0x7f56f405c020 2024-04-25T02:20:27.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.860+0000 7f56f907d700 1 -- 172.21.15.111:0/2438019029 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56f000d8c0 con 0x7f56f405c020 2024-04-25T02:20:27.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.861+0000 7f56fc2e3700 1 -- 172.21.15.111:0/2438019029 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f56f405c020 msgr2=0x7f56f4061c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:27.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.861+0000 7f56fc2e3700 1 --2- 172.21.15.111:0/2438019029 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f56f405c020 0x7f56f4061c40 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f56f0002f70 tx=0x7f56f0006df0).stop 2024-04-25T02:20:27.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.861+0000 7f56fc2e3700 1 -- 172.21.15.111:0/2438019029 shutdown_connections 2024-04-25T02:20:27.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.861+0000 7f56fc2e3700 1 --2- 172.21.15.111:0/2438019029 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f56f405c7e0 0x7f56f413ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:27.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.861+0000 7f56fc2e3700 1 --2- 172.21.15.111:0/2438019029 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f56f405c020 0x7f56f4061c40 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:27.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.861+0000 7f56fc2e3700 1 -- 172.21.15.111:0/2438019029 >> 172.21.15.111:0/2438019029 conn(0x7f56f40a8a00 msgr2=0x7f56f40a8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:27.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.861+0000 7f56fc2e3700 1 -- 172.21.15.111:0/2438019029 shutdown_connections 2024-04-25T02:20:27.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.861+0000 7f56fc2e3700 1 -- 172.21.15.111:0/2438019029 wait complete. 2024-04-25T02:20:27.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.862+0000 7f56fc2e3700 1 Processor -- start 2024-04-25T02:20:27.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.862+0000 7f56fc2e3700 1 -- start start 2024-04-25T02:20:27.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.862+0000 7f56fc2e3700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f56f405c020 0x7f56f4094250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:27.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.862+0000 7f56fc2e3700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f56f405c400 0x7f56f4092350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:27.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.862+0000 7f56fc2e3700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f56f405c7e0 0x7f56f4144090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:27.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.862+0000 7f56fc2e3700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56f4093890 con 0x7f56f405c020 2024-04-25T02:20:27.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.862+0000 7f56fc2e3700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56f4067740 con 0x7f56f405c7e0 2024-04-25T02:20:27.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.862+0000 7f56fc2e3700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f56f4143d60 con 0x7f56f405c400 2024-04-25T02:20:27.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.862+0000 7f56fa07f700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f56f405c020 0x7f56f4094250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:27.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.862+0000 7f56fa880700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f56f405c7e0 0x7f56f4144090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:27.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.862+0000 7f56fa07f700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f56f405c020 0x7f56f4094250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:39610/0 (socket says 172.21.15.111:39610) 2024-04-25T02:20:27.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.862+0000 7f56fa07f700 1 -- 172.21.15.111:0/792665930 learned_addr learned my addr 172.21.15.111:0/792665930 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:27.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.862+0000 7f56f987e700 1 --2- 172.21.15.111:0/792665930 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f56f405c400 0x7f56f4092350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:27.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.863+0000 7f56fa07f700 1 -- 172.21.15.111:0/792665930 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f56f405c400 msgr2=0x7f56f4092350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:27.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.863+0000 7f56fa07f700 1 --2- 172.21.15.111:0/792665930 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f56f405c400 0x7f56f4092350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:27.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.863+0000 7f56fa07f700 1 -- 172.21.15.111:0/792665930 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f56f405c7e0 msgr2=0x7f56f4144090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:27.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.863+0000 7f56fa07f700 1 --2- 172.21.15.111:0/792665930 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f56f405c7e0 0x7f56f4144090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:27.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.863+0000 7f56fa07f700 1 -- 172.21.15.111:0/792665930 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56ec009470 con 0x7f56f405c020 2024-04-25T02:20:27.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.863+0000 7f56fa880700 1 --2- 172.21.15.111:0/792665930 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f56f405c7e0 0x7f56f4144090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:27.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.863+0000 7f56fa07f700 1 --2- 172.21.15.111:0/792665930 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f56f405c020 0x7f56f4094250 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f56f0002f70 tx=0x7f56f0014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:27.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.863+0000 7f56e37fe700 1 -- 172.21.15.111:0/792665930 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56f0016070 con 0x7f56f405c020 2024-04-25T02:20:27.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.863+0000 7f56e37fe700 1 -- 172.21.15.111:0/792665930 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56f0013c60 con 0x7f56f405c020 2024-04-25T02:20:27.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.863+0000 7f56fc2e3700 1 -- 172.21.15.111:0/792665930 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56f000b180 con 0x7f56f405c020 2024-04-25T02:20:27.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.863+0000 7f56e37fe700 1 -- 172.21.15.111:0/792665930 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f56f000dea0 con 0x7f56f405c020 2024-04-25T02:20:27.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.863+0000 7f56fc2e3700 1 -- 172.21.15.111:0/792665930 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56f409f3e0 con 0x7f56f405c020 2024-04-25T02:20:27.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.864+0000 7f56e37fe700 1 -- 172.21.15.111:0/792665930 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f56f0025030 con 0x7f56f405c020 2024-04-25T02:20:27.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.864+0000 7f56e37fe700 1 -- 172.21.15.111:0/792665930 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f56f004b9d0 con 0x7f56f405c020 2024-04-25T02:20:27.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.864+0000 7f56fc2e3700 1 -- 172.21.15.111:0/792665930 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56f40a2e60 con 0x7f56f405c020 2024-04-25T02:20:27.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.867+0000 7f56e37fe700 1 -- 172.21.15.111:0/792665930 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f56f0006010 con 0x7f56f405c020 2024-04-25T02:20:27.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.977+0000 7f56fc2e3700 1 -- 172.21.15.111:0/792665930 --> v1:172.21.15.111:6816/39585 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f56f4065ec0 con 0x7f56d4038dd0 2024-04-25T02:20:27.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.983+0000 7f56e37fe700 1 -- 172.21.15.111:0/792665930 <== mgr.4099 v1:172.21.15.111:6816/39585 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246975 (unknown 2965378022 0 1189155938) 0x7f56f4065ec0 con 0x7f56d4038dd0 2024-04-25T02:20:27.991 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:20:27.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.985+0000 7f56fc2e3700 1 -- 172.21.15.111:0/792665930 >> v1:172.21.15.111:6816/39585 conn(0x7f56d4038dd0 legacy=0x7f56d403b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:27.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.986+0000 7f56fc2e3700 1 -- 172.21.15.111:0/792665930 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f56f405c020 msgr2=0x7f56f4094250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:27.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.986+0000 7f56fc2e3700 1 --2- 172.21.15.111:0/792665930 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f56f405c020 0x7f56f4094250 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f56f0002f70 tx=0x7f56f0014000).stop 2024-04-25T02:20:27.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.986+0000 7f56fc2e3700 1 -- 172.21.15.111:0/792665930 shutdown_connections 2024-04-25T02:20:27.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.986+0000 7f56fc2e3700 1 --2- 172.21.15.111:0/792665930 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f56f405c7e0 0x7f56f4144090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:27.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.986+0000 7f56fc2e3700 1 --2- 172.21.15.111:0/792665930 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f56f405c020 0x7f56f4094250 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:27.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.986+0000 7f56fc2e3700 1 --2- 172.21.15.111:0/792665930 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f56f405c400 0x7f56f4092350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:27.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.986+0000 7f56fc2e3700 1 -- 172.21.15.111:0/792665930 >> 172.21.15.111:0/792665930 conn(0x7f56f40a8a00 msgr2=0x7f56f40a6b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:27.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.986+0000 7f56fc2e3700 1 -- 172.21.15.111:0/792665930 shutdown_connections 2024-04-25T02:20:27.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:27.986+0000 7f56fc2e3700 1 -- 172.21.15.111:0/792665930 wait complete. 2024-04-25T02:20:27.994 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2024-04-25T02:20:28.000 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-04-25T02:20:27.437351+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3633,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":108,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":4195040,"kb_used_data":704,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292320,"statfs":{"total":386547056640,"available":382251335680,"internally_reserved":4294967296,"allocated":720896,"data_stored":209441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3633,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.595621"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.197225+0000","last_change":"2024-04-25T02:20:24.195706+0000","last_active":"2024-04-25T02:20:24.197225+0000","last_peered":"2024-04-25T02:20:24.197225+0000","last_clean":"2024-04-25T02:20:24.197225+0000","last_became_active":"2024-04-25T02:20:24.195349+0000","last_became_peered":"2024-04-25T02:20:24.195349+0000","last_unstale":"2024-04-25T02:20:24.197225+0000","last_undegraded":"2024-04-25T02:20:24.197225+0000","last_fullsized":"2024-04-25T02:20:24.197225+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.183813+0000","last_change":"2024-04-25T02:20:24.170636+0000","last_active":"2024-04-25T02:20:24.183813+0000","last_peered":"2024-04-25T02:20:24.183813+0000","last_clean":"2024-04-25T02:20:24.183813+0000","last_became_active":"2024-04-25T02:20:24.170426+0000","last_became_peered":"2024-04-25T02:20:24.170426+0000","last_unstale":"2024-04-25T02:20:24.183813+0000","last_undegraded":"2024-04-25T02:20:24.183813+0000","last_fullsized":"2024-04-25T02:20:24.183813+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.197995+0000","last_change":"2024-04-25T02:20:24.190781+0000","last_active":"2024-04-25T02:20:24.197995+0000","last_peered":"2024-04-25T02:20:24.197995+0000","last_clean":"2024-04-25T02:20:24.197995+0000","last_became_active":"2024-04-25T02:20:24.190114+0000","last_became_peered":"2024-04-25T02:20:24.190114+0000","last_unstale":"2024-04-25T02:20:24.197995+0000","last_undegraded":"2024-04-25T02:20:24.197995+0000","last_fullsized":"2024-04-25T02:20:24.197995+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.197275+0000","last_change":"2024-04-25T02:20:24.192016+0000","last_active":"2024-04-25T02:20:24.197275+0000","last_peered":"2024-04-25T02:20:24.197275+0000","last_clean":"2024-04-25T02:20:24.197275+0000","last_became_active":"2024-04-25T02:20:24.191694+0000","last_became_peered":"2024-04-25T02:20:24.191694+0000","last_unstale":"2024-04-25T02:20:24.197275+0000","last_undegraded":"2024-04-25T02:20:24.197275+0000","last_fullsized":"2024-04-25T02:20:24.197275+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.198818+0000","last_change":"2024-04-25T02:20:24.195316+0000","last_active":"2024-04-25T02:20:24.198818+0000","last_peered":"2024-04-25T02:20:24.198818+0000","last_clean":"2024-04-25T02:20:24.198818+0000","last_became_active":"2024-04-25T02:20:24.194996+0000","last_became_peered":"2024-04-25T02:20:24.194996+0000","last_unstale":"2024-04-25T02:20:24.198818+0000","last_undegraded":"2024-04-25T02:20:24.198818+0000","last_fullsized":"2024-04-25T02:20:24.198818+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.194022+0000","last_change":"2024-04-25T02:20:24.188215+0000","last_active":"2024-04-25T02:20:24.194022+0000","last_peered":"2024-04-25T02:20:24.194022+0000","last_clean":"2024-04-25T02:20:24.194022+0000","last_became_active":"2024-04-25T02:20:24.186345+0000","last_became_peered":"2024-04-25T02:20:24.186345+0000","last_unstale":"2024-04-25T02:20:24.194022+0000","last_undegraded":"2024-04-25T02:20:24.194022+0000","last_fullsized":"2024-04-25T02:20:24.194022+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.193607+0000","last_change":"2024-04-25T02:20:24.186090+0000","last_active":"2024-04-25T02:20:24.193607+0000","last_peered":"2024-04-25T02:20:24.193607+0000","last_clean":"2024-04-25T02:20:24.193607+0000","last_became_active":"2024-04-25T02:20:24.185481+0000","last_became_peered":"2024-04-25T02:20:24.185481+0000","last_unstale":"2024-04-25T02:20:24.193607+0000","last_undegraded":"2024-04-25T02:20:24.193607+0000","last_fullsized":"2024-04-25T02:20:24.193607+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.187860+0000","last_change":"2024-04-25T02:20:24.176292+0000","last_active":"2024-04-25T02:20:24.187860+0000","last_peered":"2024-04-25T02:20:24.187860+0000","last_clean":"2024-04-25T02:20:24.187860+0000","last_became_active":"2024-04-25T02:20:24.175187+0000","last_became_peered":"2024-04-25T02:20:24.175187+0000","last_unstale":"2024-04-25T02:20:24.187860+0000","last_undegraded":"2024-04-25T02:20:24.187860+0000","last_fullsized":"2024-04-25T02:20:24.187860+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.199827+0000","last_change":"2024-04-25T02:20:24.192327+0000","last_active":"2024-04-25T02:20:24.199827+0000","last_peered":"2024-04-25T02:20:24.199827+0000","last_clean":"2024-04-25T02:20:24.199827+0000","last_became_active":"2024-04-25T02:20:24.191616+0000","last_became_peered":"2024-04-25T02:20:24.191616+0000","last_unstale":"2024-04-25T02:20:24.199827+0000","last_undegraded":"2024-04-25T02:20:24.199827+0000","last_fullsized":"2024-04-25T02:20:24.199827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.187908+0000","last_change":"2024-04-25T02:20:24.178072+0000","last_active":"2024-04-25T02:20:24.187908+0000","last_peered":"2024-04-25T02:20:24.187908+0000","last_clean":"2024-04-25T02:20:24.187908+0000","last_became_active":"2024-04-25T02:20:24.177766+0000","last_became_peered":"2024-04-25T02:20:24.177766+0000","last_unstale":"2024-04-25T02:20:24.187908+0000","last_undegraded":"2024-04-25T02:20:24.187908+0000","last_fullsized":"2024-04-25T02:20:24.187908+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.187027+0000","last_change":"2024-04-25T02:20:24.179040+0000","last_active":"2024-04-25T02:20:24.187027+0000","last_peered":"2024-04-25T02:20:24.187027+0000","last_clean":"2024-04-25T02:20:24.187027+0000","last_became_active":"2024-04-25T02:20:24.178732+0000","last_became_peered":"2024-04-25T02:20:24.178732+0000","last_unstale":"2024-04-25T02:20:24.187027+0000","last_undegraded":"2024-04-25T02:20:24.187027+0000","last_fullsized":"2024-04-25T02:20:24.187027+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.197294+0000","last_change":"2024-04-25T02:20:24.195853+0000","last_active":"2024-04-25T02:20:24.197294+0000","last_peered":"2024-04-25T02:20:24.197294+0000","last_clean":"2024-04-25T02:20:24.197294+0000","last_became_active":"2024-04-25T02:20:24.195544+0000","last_became_peered":"2024-04-25T02:20:24.195544+0000","last_unstale":"2024-04-25T02:20:24.197294+0000","last_undegraded":"2024-04-25T02:20:24.197294+0000","last_fullsized":"2024-04-25T02:20:24.197294+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.199249+0000","last_change":"2024-04-25T02:20:24.196840+0000","last_active":"2024-04-25T02:20:24.199249+0000","last_peered":"2024-04-25T02:20:24.199249+0000","last_clean":"2024-04-25T02:20:24.199249+0000","last_became_active":"2024-04-25T02:20:24.196155+0000","last_became_peered":"2024-04-25T02:20:24.196155+0000","last_unstale":"2024-04-25T02:20:24.199249+0000","last_undegraded":"2024-04-25T02:20:24.199249+0000","last_fullsized":"2024-04-25T02:20:24.199249+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.178645+0000","last_change":"2024-04-25T02:20:24.171853+0000","last_active":"2024-04-25T02:20:24.178645+0000","last_peered":"2024-04-25T02:20:24.178645+0000","last_clean":"2024-04-25T02:20:24.178645+0000","last_became_active":"2024-04-25T02:20:24.171522+0000","last_became_peered":"2024-04-25T02:20:24.171522+0000","last_unstale":"2024-04-25T02:20:24.178645+0000","last_undegraded":"2024-04-25T02:20:24.178645+0000","last_fullsized":"2024-04-25T02:20:24.178645+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.193847+0000","last_change":"2024-04-25T02:20:24.185905+0000","last_active":"2024-04-25T02:20:24.193847+0000","last_peered":"2024-04-25T02:20:24.193847+0000","last_clean":"2024-04-25T02:20:24.193847+0000","last_became_active":"2024-04-25T02:20:24.185440+0000","last_became_peered":"2024-04-25T02:20:24.185440+0000","last_unstale":"2024-04-25T02:20:24.193847+0000","last_undegraded":"2024-04-25T02:20:24.193847+0000","last_fullsized":"2024-04-25T02:20:24.193847+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.187908+0000","last_change":"2024-04-25T02:20:24.183619+0000","last_active":"2024-04-25T02:20:24.187908+0000","last_peered":"2024-04-25T02:20:24.187908+0000","last_clean":"2024-04-25T02:20:24.187908+0000","last_became_active":"2024-04-25T02:20:24.183299+0000","last_became_peered":"2024-04-25T02:20:24.183299+0000","last_unstale":"2024-04-25T02:20:24.187908+0000","last_undegraded":"2024-04-25T02:20:24.187908+0000","last_fullsized":"2024-04-25T02:20:24.187908+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.199849+0000","last_change":"2024-04-25T02:20:24.194408+0000","last_active":"2024-04-25T02:20:24.199849+0000","last_peered":"2024-04-25T02:20:24.199849+0000","last_clean":"2024-04-25T02:20:24.199849+0000","last_became_active":"2024-04-25T02:20:24.192031+0000","last_became_peered":"2024-04-25T02:20:24.192031+0000","last_unstale":"2024-04-25T02:20:24.199849+0000","last_undegraded":"2024-04-25T02:20:24.199849+0000","last_fullsized":"2024-04-25T02:20:24.199849+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.179767+0000","last_change":"2024-04-25T02:20:24.175814+0000","last_active":"2024-04-25T02:20:24.179767+0000","last_peered":"2024-04-25T02:20:24.179767+0000","last_clean":"2024-04-25T02:20:24.179767+0000","last_became_active":"2024-04-25T02:20:24.174411+0000","last_became_peered":"2024-04-25T02:20:24.174411+0000","last_unstale":"2024-04-25T02:20:24.179767+0000","last_undegraded":"2024-04-25T02:20:24.179767+0000","last_fullsized":"2024-04-25T02:20:24.179767+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.197264+0000","last_change":"2024-04-25T02:20:24.195764+0000","last_active":"2024-04-25T02:20:24.197264+0000","last_peered":"2024-04-25T02:20:24.197264+0000","last_clean":"2024-04-25T02:20:24.197264+0000","last_became_active":"2024-04-25T02:20:24.195463+0000","last_became_peered":"2024-04-25T02:20:24.195463+0000","last_unstale":"2024-04-25T02:20:24.197264+0000","last_undegraded":"2024-04-25T02:20:24.197264+0000","last_fullsized":"2024-04-25T02:20:24.197264+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.204216+0000","last_change":"2024-04-25T02:20:24.200557+0000","last_active":"2024-04-25T02:20:24.204216+0000","last_peered":"2024-04-25T02:20:24.204216+0000","last_clean":"2024-04-25T02:20:24.204216+0000","last_became_active":"2024-04-25T02:20:24.200289+0000","last_became_peered":"2024-04-25T02:20:24.200289+0000","last_unstale":"2024-04-25T02:20:24.204216+0000","last_undegraded":"2024-04-25T02:20:24.204216+0000","last_fullsized":"2024-04-25T02:20:24.204216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.190365+0000","last_change":"2024-04-25T02:20:24.185144+0000","last_active":"2024-04-25T02:20:24.190365+0000","last_peered":"2024-04-25T02:20:24.190365+0000","last_clean":"2024-04-25T02:20:24.190365+0000","last_became_active":"2024-04-25T02:20:24.184668+0000","last_became_peered":"2024-04-25T02:20:24.184668+0000","last_unstale":"2024-04-25T02:20:24.190365+0000","last_undegraded":"2024-04-25T02:20:24.190365+0000","last_fullsized":"2024-04-25T02:20:24.190365+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.191297+0000","last_change":"2024-04-25T02:20:24.185079+0000","last_active":"2024-04-25T02:20:24.191297+0000","last_peered":"2024-04-25T02:20:24.191297+0000","last_clean":"2024-04-25T02:20:24.191297+0000","last_became_active":"2024-04-25T02:20:24.184748+0000","last_became_peered":"2024-04-25T02:20:24.184748+0000","last_unstale":"2024-04-25T02:20:24.191297+0000","last_undegraded":"2024-04-25T02:20:24.191297+0000","last_fullsized":"2024-04-25T02:20:24.191297+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.193584+0000","last_change":"2024-04-25T02:20:24.185898+0000","last_active":"2024-04-25T02:20:24.193584+0000","last_peered":"2024-04-25T02:20:24.193584+0000","last_clean":"2024-04-25T02:20:24.193584+0000","last_became_active":"2024-04-25T02:20:24.185153+0000","last_became_peered":"2024-04-25T02:20:24.185153+0000","last_unstale":"2024-04-25T02:20:24.193584+0000","last_undegraded":"2024-04-25T02:20:24.193584+0000","last_fullsized":"2024-04-25T02:20:24.193584+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.190967+0000","last_change":"2024-04-25T02:20:24.183879+0000","last_active":"2024-04-25T02:20:24.190967+0000","last_peered":"2024-04-25T02:20:24.190967+0000","last_clean":"2024-04-25T02:20:24.190967+0000","last_became_active":"2024-04-25T02:20:24.183565+0000","last_became_peered":"2024-04-25T02:20:24.183565+0000","last_unstale":"2024-04-25T02:20:24.190967+0000","last_undegraded":"2024-04-25T02:20:24.190967+0000","last_fullsized":"2024-04-25T02:20:24.190967+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.192186+0000","last_change":"2024-04-25T02:20:24.186601+0000","last_active":"2024-04-25T02:20:24.192186+0000","last_peered":"2024-04-25T02:20:24.192186+0000","last_clean":"2024-04-25T02:20:24.192186+0000","last_became_active":"2024-04-25T02:20:24.184553+0000","last_became_peered":"2024-04-25T02:20:24.184553+0000","last_unstale":"2024-04-25T02:20:24.192186+0000","last_undegraded":"2024-04-25T02:20:24.192186+0000","last_fullsized":"2024-04-25T02:20:24.192186+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.177547+0000","last_change":"2024-04-25T02:20:24.167579+0000","last_active":"2024-04-25T02:20:24.177547+0000","last_peered":"2024-04-25T02:20:24.177547+0000","last_clean":"2024-04-25T02:20:24.177547+0000","last_became_active":"2024-04-25T02:20:24.167170+0000","last_became_peered":"2024-04-25T02:20:24.167170+0000","last_unstale":"2024-04-25T02:20:24.177547+0000","last_undegraded":"2024-04-25T02:20:24.177547+0000","last_fullsized":"2024-04-25T02:20:24.177547+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.198565+0000","last_change":"2024-04-25T02:20:24.189023+0000","last_active":"2024-04-25T02:20:24.198565+0000","last_peered":"2024-04-25T02:20:24.198565+0000","last_clean":"2024-04-25T02:20:24.198565+0000","last_became_active":"2024-04-25T02:20:24.188203+0000","last_became_peered":"2024-04-25T02:20:24.188203+0000","last_unstale":"2024-04-25T02:20:24.198565+0000","last_undegraded":"2024-04-25T02:20:24.198565+0000","last_fullsized":"2024-04-25T02:20:24.198565+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.170956+0000","last_change":"2024-04-25T02:20:23.878198+0000","last_active":"2024-04-25T02:20:24.170956+0000","last_peered":"2024-04-25T02:20:24.170956+0000","last_clean":"2024-04-25T02:20:24.170956+0000","last_became_active":"2024-04-25T02:20:23.877819+0000","last_became_peered":"2024-04-25T02:20:23.877819+0000","last_unstale":"2024-04-25T02:20:24.170956+0000","last_undegraded":"2024-04-25T02:20:24.170956+0000","last_fullsized":"2024-04-25T02:20:24.170956+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.198584+0000","last_change":"2024-04-25T02:20:24.191107+0000","last_active":"2024-04-25T02:20:24.198584+0000","last_peered":"2024-04-25T02:20:24.198584+0000","last_clean":"2024-04-25T02:20:24.198584+0000","last_became_active":"2024-04-25T02:20:24.190019+0000","last_became_peered":"2024-04-25T02:20:24.190019+0000","last_unstale":"2024-04-25T02:20:24.198584+0000","last_undegraded":"2024-04-25T02:20:24.198584+0000","last_fullsized":"2024-04-25T02:20:24.198584+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.156633+0000","last_change":"2024-04-25T02:20:23.879347+0000","last_active":"2024-04-25T02:20:24.156633+0000","last_peered":"2024-04-25T02:20:24.156633+0000","last_clean":"2024-04-25T02:20:24.156633+0000","last_became_active":"2024-04-25T02:20:23.879065+0000","last_became_peered":"2024-04-25T02:20:23.879065+0000","last_unstale":"2024-04-25T02:20:24.156633+0000","last_undegraded":"2024-04-25T02:20:24.156633+0000","last_fullsized":"2024-04-25T02:20:24.156633+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.194862+0000","last_change":"2024-04-25T02:20:24.190744+0000","last_active":"2024-04-25T02:20:24.194862+0000","last_peered":"2024-04-25T02:20:24.194862+0000","last_clean":"2024-04-25T02:20:24.194862+0000","last_became_active":"2024-04-25T02:20:24.190410+0000","last_became_peered":"2024-04-25T02:20:24.190410+0000","last_unstale":"2024-04-25T02:20:24.194862+0000","last_undegraded":"2024-04-25T02:20:24.194862+0000","last_fullsized":"2024-04-25T02:20:24.194862+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.281449+0000","last_change":"2024-04-25T02:20:23.890094+0000","last_active":"2024-04-25T02:20:25.281449+0000","last_peered":"2024-04-25T02:20:25.281449+0000","last_clean":"2024-04-25T02:20:25.281449+0000","last_became_active":"2024-04-25T02:20:23.889715+0000","last_became_peered":"2024-04-25T02:20:23.889715+0000","last_unstale":"2024-04-25T02:20:25.281449+0000","last_undegraded":"2024-04-25T02:20:25.281449+0000","last_fullsized":"2024-04-25T02:20:25.281449+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.199764+0000","last_change":"2024-04-25T02:20:24.196642+0000","last_active":"2024-04-25T02:20:24.199764+0000","last_peered":"2024-04-25T02:20:24.199764+0000","last_clean":"2024-04-25T02:20:24.199764+0000","last_became_active":"2024-04-25T02:20:24.196137+0000","last_became_peered":"2024-04-25T02:20:24.196137+0000","last_unstale":"2024-04-25T02:20:24.199764+0000","last_undegraded":"2024-04-25T02:20:24.199764+0000","last_fullsized":"2024-04-25T02:20:24.199764+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"18'3","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.250025+0000","last_change":"2024-04-25T02:20:23.877498+0000","last_active":"2024-04-25T02:20:26.250025+0000","last_peered":"2024-04-25T02:20:26.250025+0000","last_clean":"2024-04-25T02:20:26.250025+0000","last_became_active":"2024-04-25T02:20:23.876803+0000","last_became_peered":"2024-04-25T02:20:23.876803+0000","last_unstale":"2024-04-25T02:20:26.250025+0000","last_undegraded":"2024-04-25T02:20:26.250025+0000","last_fullsized":"2024-04-25T02:20:26.250025+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.196580+0000","last_change":"2024-04-25T02:20:24.192558+0000","last_active":"2024-04-25T02:20:24.196580+0000","last_peered":"2024-04-25T02:20:24.196580+0000","last_clean":"2024-04-25T02:20:24.196580+0000","last_became_active":"2024-04-25T02:20:24.191880+0000","last_became_peered":"2024-04-25T02:20:24.191880+0000","last_unstale":"2024-04-25T02:20:24.196580+0000","last_undegraded":"2024-04-25T02:20:24.196580+0000","last_fullsized":"2024-04-25T02:20:24.196580+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.249543+0000","last_change":"2024-04-25T02:20:23.885888+0000","last_active":"2024-04-25T02:20:26.249543+0000","last_peered":"2024-04-25T02:20:26.249543+0000","last_clean":"2024-04-25T02:20:26.249543+0000","last_became_active":"2024-04-25T02:20:23.885589+0000","last_became_peered":"2024-04-25T02:20:23.885589+0000","last_unstale":"2024-04-25T02:20:26.249543+0000","last_undegraded":"2024-04-25T02:20:26.249543+0000","last_fullsized":"2024-04-25T02:20:26.249543+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.201755+0000","last_change":"2024-04-25T02:20:24.198607+0000","last_active":"2024-04-25T02:20:24.201755+0000","last_peered":"2024-04-25T02:20:24.201755+0000","last_clean":"2024-04-25T02:20:24.201755+0000","last_became_active":"2024-04-25T02:20:24.196892+0000","last_became_peered":"2024-04-25T02:20:24.196892+0000","last_unstale":"2024-04-25T02:20:24.201755+0000","last_undegraded":"2024-04-25T02:20:24.201755+0000","last_fullsized":"2024-04-25T02:20:24.201755+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.167790+0000","last_change":"2024-04-25T02:20:23.883408+0000","last_active":"2024-04-25T02:20:25.167790+0000","last_peered":"2024-04-25T02:20:25.167790+0000","last_clean":"2024-04-25T02:20:25.167790+0000","last_became_active":"2024-04-25T02:20:23.882488+0000","last_became_peered":"2024-04-25T02:20:23.882488+0000","last_unstale":"2024-04-25T02:20:25.167790+0000","last_undegraded":"2024-04-25T02:20:25.167790+0000","last_fullsized":"2024-04-25T02:20:25.167790+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.188614+0000","last_change":"2024-04-25T02:20:24.180953+0000","last_active":"2024-04-25T02:20:24.188614+0000","last_peered":"2024-04-25T02:20:24.188614+0000","last_clean":"2024-04-25T02:20:24.188614+0000","last_became_active":"2024-04-25T02:20:24.180646+0000","last_became_peered":"2024-04-25T02:20:24.180646+0000","last_unstale":"2024-04-25T02:20:24.188614+0000","last_undegraded":"2024-04-25T02:20:24.188614+0000","last_fullsized":"2024-04-25T02:20:24.188614+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"18'8","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.244995+0000","last_change":"2024-04-25T02:20:23.890383+0000","last_active":"2024-04-25T02:20:26.244995+0000","last_peered":"2024-04-25T02:20:26.244995+0000","last_clean":"2024-04-25T02:20:26.244995+0000","last_became_active":"2024-04-25T02:20:23.890015+0000","last_became_peered":"2024-04-25T02:20:23.890015+0000","last_unstale":"2024-04-25T02:20:26.244995+0000","last_undegraded":"2024-04-25T02:20:26.244995+0000","last_fullsized":"2024-04-25T02:20:26.244995+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.193067+0000","last_change":"2024-04-25T02:20:24.186645+0000","last_active":"2024-04-25T02:20:24.193067+0000","last_peered":"2024-04-25T02:20:24.193067+0000","last_clean":"2024-04-25T02:20:24.193067+0000","last_became_active":"2024-04-25T02:20:24.186336+0000","last_became_peered":"2024-04-25T02:20:24.186336+0000","last_unstale":"2024-04-25T02:20:24.193067+0000","last_undegraded":"2024-04-25T02:20:24.193067+0000","last_fullsized":"2024-04-25T02:20:24.193067+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.248214+0000","last_change":"2024-04-25T02:20:23.882583+0000","last_active":"2024-04-25T02:20:26.248214+0000","last_peered":"2024-04-25T02:20:26.248214+0000","last_clean":"2024-04-25T02:20:26.248214+0000","last_became_active":"2024-04-25T02:20:23.882254+0000","last_became_peered":"2024-04-25T02:20:23.882254+0000","last_unstale":"2024-04-25T02:20:26.248214+0000","last_undegraded":"2024-04-25T02:20:26.248214+0000","last_fullsized":"2024-04-25T02:20:26.248214+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.197776+0000","last_change":"2024-04-25T02:20:24.191415+0000","last_active":"2024-04-25T02:20:24.197776+0000","last_peered":"2024-04-25T02:20:24.197776+0000","last_clean":"2024-04-25T02:20:24.197776+0000","last_became_active":"2024-04-25T02:20:24.191024+0000","last_became_peered":"2024-04-25T02:20:24.191024+0000","last_unstale":"2024-04-25T02:20:24.197776+0000","last_undegraded":"2024-04-25T02:20:24.197776+0000","last_fullsized":"2024-04-25T02:20:24.197776+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"18'3","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.248576+0000","last_change":"2024-04-25T02:20:23.881482+0000","last_active":"2024-04-25T02:20:26.248576+0000","last_peered":"2024-04-25T02:20:26.248576+0000","last_clean":"2024-04-25T02:20:26.248576+0000","last_became_active":"2024-04-25T02:20:23.881128+0000","last_became_peered":"2024-04-25T02:20:23.881128+0000","last_unstale":"2024-04-25T02:20:26.248576+0000","last_undegraded":"2024-04-25T02:20:26.248576+0000","last_fullsized":"2024-04-25T02:20:26.248576+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.199346+0000","last_change":"2024-04-25T02:20:24.197800+0000","last_active":"2024-04-25T02:20:24.199346+0000","last_peered":"2024-04-25T02:20:24.199346+0000","last_clean":"2024-04-25T02:20:24.199346+0000","last_became_active":"2024-04-25T02:20:24.188621+0000","last_became_peered":"2024-04-25T02:20:24.188621+0000","last_unstale":"2024-04-25T02:20:24.199346+0000","last_undegraded":"2024-04-25T02:20:24.199346+0000","last_fullsized":"2024-04-25T02:20:24.199346+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.169346+0000","last_change":"2024-04-25T02:20:23.890803+0000","last_active":"2024-04-25T02:20:24.169346+0000","last_peered":"2024-04-25T02:20:24.169346+0000","last_clean":"2024-04-25T02:20:24.169346+0000","last_became_active":"2024-04-25T02:20:23.890114+0000","last_became_peered":"2024-04-25T02:20:23.890114+0000","last_unstale":"2024-04-25T02:20:24.169346+0000","last_undegraded":"2024-04-25T02:20:24.169346+0000","last_fullsized":"2024-04-25T02:20:24.169346+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.192424+0000","last_change":"2024-04-25T02:20:24.186816+0000","last_active":"2024-04-25T02:20:24.192424+0000","last_peered":"2024-04-25T02:20:24.192424+0000","last_clean":"2024-04-25T02:20:24.192424+0000","last_became_active":"2024-04-25T02:20:24.185644+0000","last_became_peered":"2024-04-25T02:20:24.185644+0000","last_unstale":"2024-04-25T02:20:24.192424+0000","last_undegraded":"2024-04-25T02:20:24.192424+0000","last_fullsized":"2024-04-25T02:20:24.192424+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'10","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.250313+0000","last_change":"2024-04-25T02:20:23.873213+0000","last_active":"2024-04-25T02:20:26.250313+0000","last_peered":"2024-04-25T02:20:26.250313+0000","last_clean":"2024-04-25T02:20:26.250313+0000","last_became_active":"2024-04-25T02:20:23.872886+0000","last_became_peered":"2024-04-25T02:20:23.872886+0000","last_unstale":"2024-04-25T02:20:26.250313+0000","last_undegraded":"2024-04-25T02:20:26.250313+0000","last_fullsized":"2024-04-25T02:20:26.250313+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.199743+0000","last_change":"2024-04-25T02:20:24.196436+0000","last_active":"2024-04-25T02:20:24.199743+0000","last_peered":"2024-04-25T02:20:24.199743+0000","last_clean":"2024-04-25T02:20:24.199743+0000","last_became_active":"2024-04-25T02:20:24.195763+0000","last_became_peered":"2024-04-25T02:20:24.195763+0000","last_unstale":"2024-04-25T02:20:24.199743+0000","last_undegraded":"2024-04-25T02:20:24.199743+0000","last_fullsized":"2024-04-25T02:20:24.199743+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.187972+0000","last_change":"2024-04-25T02:20:23.872612+0000","last_active":"2024-04-25T02:20:24.187972+0000","last_peered":"2024-04-25T02:20:24.187972+0000","last_clean":"2024-04-25T02:20:24.187972+0000","last_became_active":"2024-04-25T02:20:23.872266+0000","last_became_peered":"2024-04-25T02:20:23.872266+0000","last_unstale":"2024-04-25T02:20:24.187972+0000","last_undegraded":"2024-04-25T02:20:24.187972+0000","last_fullsized":"2024-04-25T02:20:24.187972+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.197208+0000","last_change":"2024-04-25T02:20:24.194953+0000","last_active":"2024-04-25T02:20:24.197208+0000","last_peered":"2024-04-25T02:20:24.197208+0000","last_clean":"2024-04-25T02:20:24.197208+0000","last_became_active":"2024-04-25T02:20:24.194637+0000","last_became_peered":"2024-04-25T02:20:24.194637+0000","last_unstale":"2024-04-25T02:20:24.197208+0000","last_undegraded":"2024-04-25T02:20:24.197208+0000","last_fullsized":"2024-04-25T02:20:24.197208+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.183925+0000","last_change":"2024-04-25T02:20:23.876382+0000","last_active":"2024-04-25T02:20:24.183925+0000","last_peered":"2024-04-25T02:20:24.183925+0000","last_clean":"2024-04-25T02:20:24.183925+0000","last_became_active":"2024-04-25T02:20:23.875806+0000","last_became_peered":"2024-04-25T02:20:23.875806+0000","last_unstale":"2024-04-25T02:20:24.183925+0000","last_undegraded":"2024-04-25T02:20:24.183925+0000","last_fullsized":"2024-04-25T02:20:24.183925+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.194532+0000","last_change":"2024-04-25T02:20:24.190109+0000","last_active":"2024-04-25T02:20:24.194532+0000","last_peered":"2024-04-25T02:20:24.194532+0000","last_clean":"2024-04-25T02:20:24.194532+0000","last_became_active":"2024-04-25T02:20:24.189801+0000","last_became_peered":"2024-04-25T02:20:24.189801+0000","last_unstale":"2024-04-25T02:20:24.194532+0000","last_undegraded":"2024-04-25T02:20:24.194532+0000","last_fullsized":"2024-04-25T02:20:24.194532+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.199086+0000","last_change":"2024-04-25T02:20:23.885537+0000","last_active":"2024-04-25T02:20:24.199086+0000","last_peered":"2024-04-25T02:20:24.199086+0000","last_clean":"2024-04-25T02:20:24.199086+0000","last_became_active":"2024-04-25T02:20:23.885190+0000","last_became_peered":"2024-04-25T02:20:23.885190+0000","last_unstale":"2024-04-25T02:20:24.199086+0000","last_undegraded":"2024-04-25T02:20:24.199086+0000","last_fullsized":"2024-04-25T02:20:24.199086+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.193670+0000","last_change":"2024-04-25T02:20:24.188326+0000","last_active":"2024-04-25T02:20:24.193670+0000","last_peered":"2024-04-25T02:20:24.193670+0000","last_clean":"2024-04-25T02:20:24.193670+0000","last_became_active":"2024-04-25T02:20:24.187661+0000","last_became_peered":"2024-04-25T02:20:24.187661+0000","last_unstale":"2024-04-25T02:20:24.193670+0000","last_undegraded":"2024-04-25T02:20:24.193670+0000","last_fullsized":"2024-04-25T02:20:24.193670+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.168528+0000","last_change":"2024-04-25T02:20:23.877401+0000","last_active":"2024-04-25T02:20:24.168528+0000","last_peered":"2024-04-25T02:20:24.168528+0000","last_clean":"2024-04-25T02:20:24.168528+0000","last_became_active":"2024-04-25T02:20:23.876871+0000","last_became_peered":"2024-04-25T02:20:23.876871+0000","last_unstale":"2024-04-25T02:20:24.168528+0000","last_undegraded":"2024-04-25T02:20:24.168528+0000","last_fullsized":"2024-04-25T02:20:24.168528+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.193968+0000","last_change":"2024-04-25T02:20:24.185293+0000","last_active":"2024-04-25T02:20:24.193968+0000","last_peered":"2024-04-25T02:20:24.193968+0000","last_clean":"2024-04-25T02:20:24.193968+0000","last_became_active":"2024-04-25T02:20:24.184978+0000","last_became_peered":"2024-04-25T02:20:24.184978+0000","last_unstale":"2024-04-25T02:20:24.193968+0000","last_undegraded":"2024-04-25T02:20:24.193968+0000","last_fullsized":"2024-04-25T02:20:24.193968+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.248087+0000","last_change":"2024-04-25T02:20:23.886478+0000","last_active":"2024-04-25T02:20:26.248087+0000","last_peered":"2024-04-25T02:20:26.248087+0000","last_clean":"2024-04-25T02:20:26.248087+0000","last_became_active":"2024-04-25T02:20:23.886157+0000","last_became_peered":"2024-04-25T02:20:23.886157+0000","last_unstale":"2024-04-25T02:20:26.248087+0000","last_undegraded":"2024-04-25T02:20:26.248087+0000","last_fullsized":"2024-04-25T02:20:26.248087+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.204062+0000","last_change":"2024-04-25T02:20:24.199344+0000","last_active":"2024-04-25T02:20:24.204062+0000","last_peered":"2024-04-25T02:20:24.204062+0000","last_clean":"2024-04-25T02:20:24.204062+0000","last_became_active":"2024-04-25T02:20:24.199010+0000","last_became_peered":"2024-04-25T02:20:24.199010+0000","last_unstale":"2024-04-25T02:20:24.204062+0000","last_undegraded":"2024-04-25T02:20:24.204062+0000","last_fullsized":"2024-04-25T02:20:24.204062+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.161596+0000","last_change":"2024-04-25T02:20:23.884331+0000","last_active":"2024-04-25T02:20:24.161596+0000","last_peered":"2024-04-25T02:20:24.161596+0000","last_clean":"2024-04-25T02:20:24.161596+0000","last_became_active":"2024-04-25T02:20:23.883987+0000","last_became_peered":"2024-04-25T02:20:23.883987+0000","last_unstale":"2024-04-25T02:20:24.161596+0000","last_undegraded":"2024-04-25T02:20:24.161596+0000","last_fullsized":"2024-04-25T02:20:24.161596+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.198604+0000","last_change":"2024-04-25T02:20:24.191297+0000","last_active":"2024-04-25T02:20:24.198604+0000","last_peered":"2024-04-25T02:20:24.198604+0000","last_clean":"2024-04-25T02:20:24.198604+0000","last_became_active":"2024-04-25T02:20:24.190401+0000","last_became_peered":"2024-04-25T02:20:24.190401+0000","last_unstale":"2024-04-25T02:20:24.198604+0000","last_undegraded":"2024-04-25T02:20:24.198604+0000","last_fullsized":"2024-04-25T02:20:24.198604+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"18'3","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.250453+0000","last_change":"2024-04-25T02:20:23.881257+0000","last_active":"2024-04-25T02:20:26.250453+0000","last_peered":"2024-04-25T02:20:26.250453+0000","last_clean":"2024-04-25T02:20:26.250453+0000","last_became_active":"2024-04-25T02:20:23.880935+0000","last_became_peered":"2024-04-25T02:20:23.880935+0000","last_unstale":"2024-04-25T02:20:26.250453+0000","last_undegraded":"2024-04-25T02:20:26.250453+0000","last_fullsized":"2024-04-25T02:20:26.250453+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.193753+0000","last_change":"2024-04-25T02:20:24.189432+0000","last_active":"2024-04-25T02:20:24.193753+0000","last_peered":"2024-04-25T02:20:24.193753+0000","last_clean":"2024-04-25T02:20:24.193753+0000","last_became_active":"2024-04-25T02:20:24.189016+0000","last_became_peered":"2024-04-25T02:20:24.189016+0000","last_unstale":"2024-04-25T02:20:24.193753+0000","last_undegraded":"2024-04-25T02:20:24.193753+0000","last_fullsized":"2024-04-25T02:20:24.193753+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.247109+0000","last_change":"2024-04-25T02:20:23.885274+0000","last_active":"2024-04-25T02:20:26.247109+0000","last_peered":"2024-04-25T02:20:26.247109+0000","last_clean":"2024-04-25T02:20:26.247109+0000","last_became_active":"2024-04-25T02:20:23.884934+0000","last_became_peered":"2024-04-25T02:20:23.884934+0000","last_unstale":"2024-04-25T02:20:26.247109+0000","last_undegraded":"2024-04-25T02:20:26.247109+0000","last_fullsized":"2024-04-25T02:20:26.247109+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.194522+0000","last_change":"2024-04-25T02:20:24.192355+0000","last_active":"2024-04-25T02:20:24.194522+0000","last_peered":"2024-04-25T02:20:24.194522+0000","last_clean":"2024-04-25T02:20:24.194522+0000","last_became_active":"2024-04-25T02:20:24.191909+0000","last_became_peered":"2024-04-25T02:20:24.191909+0000","last_unstale":"2024-04-25T02:20:24.194522+0000","last_undegraded":"2024-04-25T02:20:24.194522+0000","last_fullsized":"2024-04-25T02:20:24.194522+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.161935+0000","last_change":"2024-04-25T02:20:15.491093+0000","last_active":"2024-04-25T02:20:24.161935+0000","last_peered":"2024-04-25T02:20:24.161935+0000","last_clean":"2024-04-25T02:20:24.161935+0000","last_became_active":"2024-04-25T02:20:15.490770+0000","last_became_peered":"2024-04-25T02:20:15.490770+0000","last_unstale":"2024-04-25T02:20:24.161935+0000","last_undegraded":"2024-04-25T02:20:24.161935+0000","last_fullsized":"2024-04-25T02:20:24.161935+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.167026+0000","last_change":"2024-04-25T02:20:23.885604+0000","last_active":"2024-04-25T02:20:25.167026+0000","last_peered":"2024-04-25T02:20:25.167026+0000","last_clean":"2024-04-25T02:20:25.167026+0000","last_became_active":"2024-04-25T02:20:23.885298+0000","last_became_peered":"2024-04-25T02:20:23.885298+0000","last_unstale":"2024-04-25T02:20:25.167026+0000","last_undegraded":"2024-04-25T02:20:25.167026+0000","last_fullsized":"2024-04-25T02:20:25.167026+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.194944+0000","last_change":"2024-04-25T02:20:24.189688+0000","last_active":"2024-04-25T02:20:24.194944+0000","last_peered":"2024-04-25T02:20:24.194944+0000","last_clean":"2024-04-25T02:20:24.194944+0000","last_became_active":"2024-04-25T02:20:24.189417+0000","last_became_peered":"2024-04-25T02:20:24.189417+0000","last_unstale":"2024-04-25T02:20:24.194944+0000","last_undegraded":"2024-04-25T02:20:24.194944+0000","last_fullsized":"2024-04-25T02:20:24.194944+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.162049+0000","last_change":"2024-04-25T02:20:15.489991+0000","last_active":"2024-04-25T02:20:24.162049+0000","last_peered":"2024-04-25T02:20:24.162049+0000","last_clean":"2024-04-25T02:20:24.162049+0000","last_became_active":"2024-04-25T02:20:15.489641+0000","last_became_peered":"2024-04-25T02:20:15.489641+0000","last_unstale":"2024-04-25T02:20:24.162049+0000","last_undegraded":"2024-04-25T02:20:24.162049+0000","last_fullsized":"2024-04-25T02:20:24.162049+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.250313+0000","last_change":"2024-04-25T02:20:23.875583+0000","last_active":"2024-04-25T02:20:26.250313+0000","last_peered":"2024-04-25T02:20:26.250313+0000","last_clean":"2024-04-25T02:20:26.250313+0000","last_became_active":"2024-04-25T02:20:23.875234+0000","last_became_peered":"2024-04-25T02:20:23.875234+0000","last_unstale":"2024-04-25T02:20:26.250313+0000","last_undegraded":"2024-04-25T02:20:26.250313+0000","last_fullsized":"2024-04-25T02:20:26.250313+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.179030+0000","last_change":"2024-04-25T02:20:24.172708+0000","last_active":"2024-04-25T02:20:24.179030+0000","last_peered":"2024-04-25T02:20:24.179030+0000","last_clean":"2024-04-25T02:20:24.179030+0000","last_became_active":"2024-04-25T02:20:24.172138+0000","last_became_peered":"2024-04-25T02:20:24.172138+0000","last_unstale":"2024-04-25T02:20:24.179030+0000","last_undegraded":"2024-04-25T02:20:24.179030+0000","last_fullsized":"2024-04-25T02:20:24.179030+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.159793+0000","last_change":"2024-04-25T02:20:15.488908+0000","last_active":"2024-04-25T02:20:24.159793+0000","last_peered":"2024-04-25T02:20:24.159793+0000","last_clean":"2024-04-25T02:20:24.159793+0000","last_became_active":"2024-04-25T02:20:15.488569+0000","last_became_peered":"2024-04-25T02:20:15.488569+0000","last_unstale":"2024-04-25T02:20:24.159793+0000","last_undegraded":"2024-04-25T02:20:24.159793+0000","last_fullsized":"2024-04-25T02:20:24.159793+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.279870+0000","last_change":"2024-04-25T02:20:23.872080+0000","last_active":"2024-04-25T02:20:25.279870+0000","last_peered":"2024-04-25T02:20:25.279870+0000","last_clean":"2024-04-25T02:20:25.279870+0000","last_became_active":"2024-04-25T02:20:23.871751+0000","last_became_peered":"2024-04-25T02:20:23.871751+0000","last_unstale":"2024-04-25T02:20:25.279870+0000","last_undegraded":"2024-04-25T02:20:25.279870+0000","last_fullsized":"2024-04-25T02:20:25.279870+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.183350+0000","last_change":"2024-04-25T02:20:24.174377+0000","last_active":"2024-04-25T02:20:24.183350+0000","last_peered":"2024-04-25T02:20:24.183350+0000","last_clean":"2024-04-25T02:20:24.183350+0000","last_became_active":"2024-04-25T02:20:24.174100+0000","last_became_peered":"2024-04-25T02:20:24.174100+0000","last_unstale":"2024-04-25T02:20:24.183350+0000","last_undegraded":"2024-04-25T02:20:24.183350+0000","last_fullsized":"2024-04-25T02:20:24.183350+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.159203+0000","last_change":"2024-04-25T02:20:15.487675+0000","last_active":"2024-04-25T02:20:24.159203+0000","last_peered":"2024-04-25T02:20:24.159203+0000","last_clean":"2024-04-25T02:20:24.159203+0000","last_became_active":"2024-04-25T02:20:15.487331+0000","last_became_peered":"2024-04-25T02:20:15.487331+0000","last_unstale":"2024-04-25T02:20:24.159203+0000","last_undegraded":"2024-04-25T02:20:24.159203+0000","last_fullsized":"2024-04-25T02:20:24.159203+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"10'1","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.164063+0000","last_change":"2024-04-25T02:20:11.467819+0000","last_active":"2024-04-25T02:20:24.164063+0000","last_peered":"2024-04-25T02:20:24.164063+0000","last_clean":"2024-04-25T02:20:24.164063+0000","last_became_active":"2024-04-25T02:20:11.467259+0000","last_became_peered":"2024-04-25T02:20:11.467259+0000","last_unstale":"2024-04-25T02:20:24.164063+0000","last_undegraded":"2024-04-25T02:20:24.164063+0000","last_fullsized":"2024-04-25T02:20:24.164063+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:08.432182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:08.432182+0000","last_clean_scrub_stamp":"2024-04-25T02:20:08.432182+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.161484+0000","last_change":"2024-04-25T02:20:23.891327+0000","last_active":"2024-04-25T02:20:24.161484+0000","last_peered":"2024-04-25T02:20:24.161484+0000","last_clean":"2024-04-25T02:20:24.161484+0000","last_became_active":"2024-04-25T02:20:23.891033+0000","last_became_peered":"2024-04-25T02:20:23.891033+0000","last_unstale":"2024-04-25T02:20:24.161484+0000","last_undegraded":"2024-04-25T02:20:24.161484+0000","last_fullsized":"2024-04-25T02:20:24.161484+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.198627+0000","last_change":"2024-04-25T02:20:24.191472+0000","last_active":"2024-04-25T02:20:24.198627+0000","last_peered":"2024-04-25T02:20:24.198627+0000","last_clean":"2024-04-25T02:20:24.198627+0000","last_became_active":"2024-04-25T02:20:24.190777+0000","last_became_peered":"2024-04-25T02:20:24.190777+0000","last_unstale":"2024-04-25T02:20:24.198627+0000","last_undegraded":"2024-04-25T02:20:24.198627+0000","last_fullsized":"2024-04-25T02:20:24.198627+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.160031+0000","last_change":"2024-04-25T02:20:15.490166+0000","last_active":"2024-04-25T02:20:24.160031+0000","last_peered":"2024-04-25T02:20:24.160031+0000","last_clean":"2024-04-25T02:20:24.160031+0000","last_became_active":"2024-04-25T02:20:15.489795+0000","last_became_peered":"2024-04-25T02:20:15.489795+0000","last_unstale":"2024-04-25T02:20:24.160031+0000","last_undegraded":"2024-04-25T02:20:24.160031+0000","last_fullsized":"2024-04-25T02:20:24.160031+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.165306+0000","last_change":"2024-04-25T02:20:23.875637+0000","last_active":"2024-04-25T02:20:25.165306+0000","last_peered":"2024-04-25T02:20:25.165306+0000","last_clean":"2024-04-25T02:20:25.165306+0000","last_became_active":"2024-04-25T02:20:23.875042+0000","last_became_peered":"2024-04-25T02:20:23.875042+0000","last_unstale":"2024-04-25T02:20:25.165306+0000","last_undegraded":"2024-04-25T02:20:25.165306+0000","last_fullsized":"2024-04-25T02:20:25.165306+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.194840+0000","last_change":"2024-04-25T02:20:24.190630+0000","last_active":"2024-04-25T02:20:24.194840+0000","last_peered":"2024-04-25T02:20:24.194840+0000","last_clean":"2024-04-25T02:20:24.194840+0000","last_became_active":"2024-04-25T02:20:24.190288+0000","last_became_peered":"2024-04-25T02:20:24.190288+0000","last_unstale":"2024-04-25T02:20:24.194840+0000","last_undegraded":"2024-04-25T02:20:24.194840+0000","last_fullsized":"2024-04-25T02:20:24.194840+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.163172+0000","last_change":"2024-04-25T02:20:15.485725+0000","last_active":"2024-04-25T02:20:24.163172+0000","last_peered":"2024-04-25T02:20:24.163172+0000","last_clean":"2024-04-25T02:20:24.163172+0000","last_became_active":"2024-04-25T02:20:15.485352+0000","last_became_peered":"2024-04-25T02:20:15.485352+0000","last_unstale":"2024-04-25T02:20:24.163172+0000","last_undegraded":"2024-04-25T02:20:24.163172+0000","last_fullsized":"2024-04-25T02:20:24.163172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.161324+0000","last_change":"2024-04-25T02:20:23.879989+0000","last_active":"2024-04-25T02:20:24.161324+0000","last_peered":"2024-04-25T02:20:24.161324+0000","last_clean":"2024-04-25T02:20:24.161324+0000","last_became_active":"2024-04-25T02:20:23.877442+0000","last_became_peered":"2024-04-25T02:20:23.877442+0000","last_unstale":"2024-04-25T02:20:24.161324+0000","last_undegraded":"2024-04-25T02:20:24.161324+0000","last_fullsized":"2024-04-25T02:20:24.161324+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.180879+0000","last_change":"2024-04-25T02:20:24.176550+0000","last_active":"2024-04-25T02:20:24.180879+0000","last_peered":"2024-04-25T02:20:24.180879+0000","last_clean":"2024-04-25T02:20:24.180879+0000","last_became_active":"2024-04-25T02:20:24.176249+0000","last_became_peered":"2024-04-25T02:20:24.176249+0000","last_unstale":"2024-04-25T02:20:24.180879+0000","last_undegraded":"2024-04-25T02:20:24.180879+0000","last_fullsized":"2024-04-25T02:20:24.180879+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.243563+0000","last_change":"2024-04-25T02:20:23.884258+0000","last_active":"2024-04-25T02:20:26.243563+0000","last_peered":"2024-04-25T02:20:26.243563+0000","last_clean":"2024-04-25T02:20:26.243563+0000","last_became_active":"2024-04-25T02:20:23.883867+0000","last_became_peered":"2024-04-25T02:20:23.883867+0000","last_unstale":"2024-04-25T02:20:26.243563+0000","last_undegraded":"2024-04-25T02:20:26.243563+0000","last_fullsized":"2024-04-25T02:20:26.243563+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.160757+0000","last_change":"2024-04-25T02:20:15.490162+0000","last_active":"2024-04-25T02:20:24.160757+0000","last_peered":"2024-04-25T02:20:24.160757+0000","last_clean":"2024-04-25T02:20:24.160757+0000","last_became_active":"2024-04-25T02:20:15.489760+0000","last_became_peered":"2024-04-25T02:20:15.489760+0000","last_unstale":"2024-04-25T02:20:24.160757+0000","last_undegraded":"2024-04-25T02:20:24.160757+0000","last_fullsized":"2024-04-25T02:20:24.160757+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.197090+0000","last_change":"2024-04-25T02:20:24.192993+0000","last_active":"2024-04-25T02:20:24.197090+0000","last_peered":"2024-04-25T02:20:24.197090+0000","last_clean":"2024-04-25T02:20:24.197090+0000","last_became_active":"2024-04-25T02:20:24.192258+0000","last_became_peered":"2024-04-25T02:20:24.192258+0000","last_unstale":"2024-04-25T02:20:24.197090+0000","last_undegraded":"2024-04-25T02:20:24.197090+0000","last_fullsized":"2024-04-25T02:20:24.197090+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.169672+0000","last_change":"2024-04-25T02:20:15.488540+0000","last_active":"2024-04-25T02:20:24.169672+0000","last_peered":"2024-04-25T02:20:24.169672+0000","last_clean":"2024-04-25T02:20:24.169672+0000","last_became_active":"2024-04-25T02:20:15.488148+0000","last_became_peered":"2024-04-25T02:20:15.488148+0000","last_unstale":"2024-04-25T02:20:24.169672+0000","last_undegraded":"2024-04-25T02:20:24.169672+0000","last_fullsized":"2024-04-25T02:20:24.169672+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.165485+0000","last_change":"2024-04-25T02:20:23.882042+0000","last_active":"2024-04-25T02:20:25.165485+0000","last_peered":"2024-04-25T02:20:25.165485+0000","last_clean":"2024-04-25T02:20:25.165485+0000","last_became_active":"2024-04-25T02:20:23.881660+0000","last_became_peered":"2024-04-25T02:20:23.881660+0000","last_unstale":"2024-04-25T02:20:25.165485+0000","last_undegraded":"2024-04-25T02:20:25.165485+0000","last_fullsized":"2024-04-25T02:20:25.165485+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.193640+0000","last_change":"2024-04-25T02:20:24.188573+0000","last_active":"2024-04-25T02:20:24.193640+0000","last_peered":"2024-04-25T02:20:24.193640+0000","last_clean":"2024-04-25T02:20:24.193640+0000","last_became_active":"2024-04-25T02:20:24.188251+0000","last_became_peered":"2024-04-25T02:20:24.188251+0000","last_unstale":"2024-04-25T02:20:24.193640+0000","last_undegraded":"2024-04-25T02:20:24.193640+0000","last_fullsized":"2024-04-25T02:20:24.193640+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'5","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.248784+0000","last_change":"2024-04-25T02:20:23.883575+0000","last_active":"2024-04-25T02:20:26.248784+0000","last_peered":"2024-04-25T02:20:26.248784+0000","last_clean":"2024-04-25T02:20:26.248784+0000","last_became_active":"2024-04-25T02:20:23.883144+0000","last_became_peered":"2024-04-25T02:20:23.883144+0000","last_unstale":"2024-04-25T02:20:26.248784+0000","last_undegraded":"2024-04-25T02:20:26.248784+0000","last_fullsized":"2024-04-25T02:20:26.248784+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.185264+0000","last_change":"2024-04-25T02:20:24.170678+0000","last_active":"2024-04-25T02:20:24.185264+0000","last_peered":"2024-04-25T02:20:24.185264+0000","last_clean":"2024-04-25T02:20:24.185264+0000","last_became_active":"2024-04-25T02:20:24.170488+0000","last_became_peered":"2024-04-25T02:20:24.170488+0000","last_unstale":"2024-04-25T02:20:24.185264+0000","last_undegraded":"2024-04-25T02:20:24.185264+0000","last_fullsized":"2024-04-25T02:20:24.185264+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.179405+0000","last_change":"2024-04-25T02:20:23.881809+0000","last_active":"2024-04-25T02:20:24.179405+0000","last_peered":"2024-04-25T02:20:24.179405+0000","last_clean":"2024-04-25T02:20:24.179405+0000","last_became_active":"2024-04-25T02:20:23.878991+0000","last_became_peered":"2024-04-25T02:20:23.878991+0000","last_unstale":"2024-04-25T02:20:24.179405+0000","last_undegraded":"2024-04-25T02:20:24.179405+0000","last_fullsized":"2024-04-25T02:20:24.179405+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.201609+0000","last_change":"2024-04-25T02:20:24.197009+0000","last_active":"2024-04-25T02:20:24.201609+0000","last_peered":"2024-04-25T02:20:24.201609+0000","last_clean":"2024-04-25T02:20:24.201609+0000","last_became_active":"2024-04-25T02:20:24.196535+0000","last_became_peered":"2024-04-25T02:20:24.196535+0000","last_unstale":"2024-04-25T02:20:24.201609+0000","last_undegraded":"2024-04-25T02:20:24.201609+0000","last_fullsized":"2024-04-25T02:20:24.201609+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.199642+0000","last_change":"2024-04-25T02:20:23.888031+0000","last_active":"2024-04-25T02:20:24.199642+0000","last_peered":"2024-04-25T02:20:24.199642+0000","last_clean":"2024-04-25T02:20:24.199642+0000","last_became_active":"2024-04-25T02:20:23.887730+0000","last_became_peered":"2024-04-25T02:20:23.887730+0000","last_unstale":"2024-04-25T02:20:24.199642+0000","last_undegraded":"2024-04-25T02:20:24.199642+0000","last_fullsized":"2024-04-25T02:20:24.199642+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.193693+0000","last_change":"2024-04-25T02:20:24.188502+0000","last_active":"2024-04-25T02:20:24.193693+0000","last_peered":"2024-04-25T02:20:24.193693+0000","last_clean":"2024-04-25T02:20:24.193693+0000","last_became_active":"2024-04-25T02:20:24.188102+0000","last_became_peered":"2024-04-25T02:20:24.188102+0000","last_unstale":"2024-04-25T02:20:24.193693+0000","last_undegraded":"2024-04-25T02:20:24.193693+0000","last_fullsized":"2024-04-25T02:20:24.193693+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.190792+0000","last_change":"2024-04-25T02:20:23.890367+0000","last_active":"2024-04-25T02:20:24.190792+0000","last_peered":"2024-04-25T02:20:24.190792+0000","last_clean":"2024-04-25T02:20:24.190792+0000","last_became_active":"2024-04-25T02:20:23.889958+0000","last_became_peered":"2024-04-25T02:20:23.889958+0000","last_unstale":"2024-04-25T02:20:24.190792+0000","last_undegraded":"2024-04-25T02:20:24.190792+0000","last_fullsized":"2024-04-25T02:20:24.190792+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.198626+0000","last_change":"2024-04-25T02:20:24.194271+0000","last_active":"2024-04-25T02:20:24.198626+0000","last_peered":"2024-04-25T02:20:24.198626+0000","last_clean":"2024-04-25T02:20:24.198626+0000","last_became_active":"2024-04-25T02:20:24.193729+0000","last_became_peered":"2024-04-25T02:20:24.193729+0000","last_unstale":"2024-04-25T02:20:24.198626+0000","last_undegraded":"2024-04-25T02:20:24.198626+0000","last_fullsized":"2024-04-25T02:20:24.198626+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.187833+0000","last_change":"2024-04-25T02:20:23.882173+0000","last_active":"2024-04-25T02:20:24.187833+0000","last_peered":"2024-04-25T02:20:24.187833+0000","last_clean":"2024-04-25T02:20:24.187833+0000","last_became_active":"2024-04-25T02:20:23.881840+0000","last_became_peered":"2024-04-25T02:20:23.881840+0000","last_unstale":"2024-04-25T02:20:24.187833+0000","last_undegraded":"2024-04-25T02:20:24.187833+0000","last_fullsized":"2024-04-25T02:20:24.187833+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":553,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.185324+0000","last_change":"2024-04-25T02:20:24.171268+0000","last_active":"2024-04-25T02:20:24.185324+0000","last_peered":"2024-04-25T02:20:24.185324+0000","last_clean":"2024-04-25T02:20:24.185324+0000","last_became_active":"2024-04-25T02:20:24.170957+0000","last_became_peered":"2024-04-25T02:20:24.170957+0000","last_unstale":"2024-04-25T02:20:24.185324+0000","last_undegraded":"2024-04-25T02:20:24.185324+0000","last_fullsized":"2024-04-25T02:20:24.185324+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.178516+0000","last_change":"2024-04-25T02:20:24.167991+0000","last_active":"2024-04-25T02:20:24.178516+0000","last_peered":"2024-04-25T02:20:24.178516+0000","last_clean":"2024-04-25T02:20:24.178516+0000","last_became_active":"2024-04-25T02:20:24.167659+0000","last_became_peered":"2024-04-25T02:20:24.167659+0000","last_unstale":"2024-04-25T02:20:24.178516+0000","last_undegraded":"2024-04-25T02:20:24.178516+0000","last_fullsized":"2024-04-25T02:20:24.178516+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.198601+0000","last_change":"2024-04-25T02:20:24.194043+0000","last_active":"2024-04-25T02:20:24.198601+0000","last_peered":"2024-04-25T02:20:24.198601+0000","last_clean":"2024-04-25T02:20:24.198601+0000","last_became_active":"2024-04-25T02:20:24.193386+0000","last_became_peered":"2024-04-25T02:20:24.193386+0000","last_unstale":"2024-04-25T02:20:24.198601+0000","last_undegraded":"2024-04-25T02:20:24.198601+0000","last_fullsized":"2024-04-25T02:20:24.198601+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.193815+0000","last_change":"2024-04-25T02:20:24.189262+0000","last_active":"2024-04-25T02:20:24.193815+0000","last_peered":"2024-04-25T02:20:24.193815+0000","last_clean":"2024-04-25T02:20:24.193815+0000","last_became_active":"2024-04-25T02:20:24.188938+0000","last_became_peered":"2024-04-25T02:20:24.188938+0000","last_unstale":"2024-04-25T02:20:24.193815+0000","last_undegraded":"2024-04-25T02:20:24.193815+0000","last_fullsized":"2024-04-25T02:20:24.193815+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.194151+0000","last_change":"2024-04-25T02:20:24.189965+0000","last_active":"2024-04-25T02:20:24.194151+0000","last_peered":"2024-04-25T02:20:24.194151+0000","last_clean":"2024-04-25T02:20:24.194151+0000","last_became_active":"2024-04-25T02:20:24.189042+0000","last_became_peered":"2024-04-25T02:20:24.189042+0000","last_unstale":"2024-04-25T02:20:24.194151+0000","last_undegraded":"2024-04-25T02:20:24.194151+0000","last_fullsized":"2024-04-25T02:20:24.194151+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.179008+0000","last_change":"2024-04-25T02:20:24.172462+0000","last_active":"2024-04-25T02:20:24.179008+0000","last_peered":"2024-04-25T02:20:24.179008+0000","last_clean":"2024-04-25T02:20:24.179008+0000","last_became_active":"2024-04-25T02:20:24.171736+0000","last_became_peered":"2024-04-25T02:20:24.171736+0000","last_unstale":"2024-04-25T02:20:24.179008+0000","last_undegraded":"2024-04-25T02:20:24.179008+0000","last_fullsized":"2024-04-25T02:20:24.179008+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3633,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":7266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73,"ondisk_log_size":73,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705668,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048784,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323056,"statfs":{"total":96636764160,"available":95562809344,"internally_reserved":1073741824,"allocated":204800,"data_stored":53906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.218}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26600000000000001}]}]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":52495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.224}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26900000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048752,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323088,"statfs":{"total":96636764160,"available":95562842112,"internally_reserved":1073741824,"allocated":172032,"data_stored":51547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]}]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048748,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323092,"statfs":{"total":96636764160,"available":95562846208,"internally_reserved":1073741824,"allocated":167936,"data_stored":51493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.248}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23799999999999999}]}]}]}} 2024-04-25T02:20:28.008 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:20:28.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.138+0000 7fed9f68e700 1 Processor -- start 2024-04-25T02:20:28.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.139+0000 7fed9f68e700 1 -- start start 2024-04-25T02:20:28.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.139+0000 7fed9f68e700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fed98136a40 0x7fed98136e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:28.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.139+0000 7fed9f68e700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fed980951b0 0x7fed98093e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:28.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.139+0000 7fed9f68e700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed98098370 con 0x7fed98099970 2024-04-25T02:20:28.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.139+0000 7fed9f68e700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed98094d20 con 0x7fed98136a40 2024-04-25T02:20:28.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.139+0000 7fed9f68e700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed98137310 con 0x7fed980951b0 2024-04-25T02:20:28.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.139+0000 7fed9cc29700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fed980951b0 0x7fed98093e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:28.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.139+0000 7fed9d42a700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fed98136a40 0x7fed98136e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:28.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.139+0000 7fed9d42a700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fed98136a40 0x7fed98136e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:39624/0 (socket says 172.21.15.111:39624) 2024-04-25T02:20:28.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.139+0000 7fed9cc29700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fed980951b0 0x7fed98093e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:57354/0 (socket says 172.21.15.111:57354) 2024-04-25T02:20:28.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.139+0000 7fed9d42a700 1 -- 172.21.15.111:0/1722014639 learned_addr learned my addr 172.21.15.111:0/1722014639 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:28.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.140+0000 7fed9d42a700 1 -- 172.21.15.111:0/1722014639 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fed980951b0 msgr2=0x7fed98093e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:28.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.140+0000 7fed9d42a700 1 --2- 172.21.15.111:0/1722014639 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fed980951b0 0x7fed98093e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:28.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.140+0000 7fed9d42a700 1 -- 172.21.15.111:0/1722014639 >> v1:172.21.15.111:6789/0 conn(0x7fed98099970 legacy=0x7fed98099e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:28.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.140+0000 7fed87fff700 1 -- 172.21.15.111:0/1722014639 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 387498796 0 0) 0x7fed90001490 con 0x7fed98099970 2024-04-25T02:20:28.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.140+0000 7fed9d42a700 1 -- 172.21.15.111:0/1722014639 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed980958a0 con 0x7fed98136a40 2024-04-25T02:20:28.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.140+0000 7fed9cc29700 1 --2- 172.21.15.111:0/1722014639 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fed980951b0 0x7fed98093e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:28.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.140+0000 7fed9d42a700 1 --2- 172.21.15.111:0/1722014639 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fed98136a40 0x7fed98136e20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fed88002f70 tx=0x7fed88006eb0).ready entity=mon.0 client_cookie=ea4e1783b09ed8fc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:28.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.140+0000 7fed87fff700 1 -- 172.21.15.111:0/1722014639 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed8800d570 con 0x7fed98136a40 2024-04-25T02:20:28.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.140+0000 7fed87fff700 1 -- 172.21.15.111:0/1722014639 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed88000e90 con 0x7fed98136a40 2024-04-25T02:20:28.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.140+0000 7fed87fff700 1 -- 172.21.15.111:0/1722014639 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed8800d8c0 con 0x7fed98136a40 2024-04-25T02:20:28.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.140+0000 7fed9f68e700 1 -- 172.21.15.111:0/1722014639 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fed98136a40 msgr2=0x7fed98136e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:28.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.140+0000 7fed9f68e700 1 --2- 172.21.15.111:0/1722014639 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fed98136a40 0x7fed98136e20 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fed88002f70 tx=0x7fed88006eb0).stop 2024-04-25T02:20:28.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.140+0000 7fed9f68e700 1 -- 172.21.15.111:0/1722014639 shutdown_connections 2024-04-25T02:20:28.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.140+0000 7fed9f68e700 1 --2- 172.21.15.111:0/1722014639 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fed98136a40 0x7fed98136e20 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:28.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.140+0000 7fed9f68e700 1 --2- 172.21.15.111:0/1722014639 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fed980951b0 0x7fed98093e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:28.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.140+0000 7fed9f68e700 1 -- 172.21.15.111:0/1722014639 >> 172.21.15.111:0/1722014639 conn(0x7fed98060340 msgr2=0x7fed9806c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:28.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.141+0000 7fed9f68e700 1 -- 172.21.15.111:0/1722014639 shutdown_connections 2024-04-25T02:20:28.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.141+0000 7fed9f68e700 1 -- 172.21.15.111:0/1722014639 wait complete. 2024-04-25T02:20:28.150 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.142+0000 7fed9f68e700 1 Processor -- start 2024-04-25T02:20:28.150 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.142+0000 7fed9f68e700 1 -- start start 2024-04-25T02:20:28.150 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.142+0000 7fed9f68e700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fed980951b0 0x7fed98066e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:28.150 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.142+0000 7fed9f68e700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fed98099970 0x7fed98146c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:28.150 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.142+0000 7fed9f68e700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fed98136a40 0x7fed98147110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:28.150 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.142+0000 7fed9f68e700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed980646d0 con 0x7fed980951b0 2024-04-25T02:20:28.150 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.142+0000 7fed9f68e700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed98064ff0 con 0x7fed98099970 2024-04-25T02:20:28.150 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.142+0000 7fed9f68e700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed98066630 con 0x7fed98136a40 2024-04-25T02:20:28.150 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.142+0000 7fed9d42a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fed980951b0 0x7fed98066e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:28.150 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.142+0000 7fed9d42a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fed980951b0 0x7fed98066e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:39640/0 (socket says 172.21.15.111:39640) 2024-04-25T02:20:28.150 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.142+0000 7fed9d42a700 1 -- 172.21.15.111:0/3896609708 learned_addr learned my addr 172.21.15.111:0/3896609708 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:28.150 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.142+0000 7fed9cc29700 1 --2- 172.21.15.111:0/3896609708 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fed98099970 0x7fed98146c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:28.151 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.143+0000 7fed9dc2b700 1 --2- 172.21.15.111:0/3896609708 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fed98136a40 0x7fed98147110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:28.151 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.143+0000 7fed9cc29700 1 -- 172.21.15.111:0/3896609708 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fed98136a40 msgr2=0x7fed98147110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:28.151 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.143+0000 7fed9cc29700 1 --2- 172.21.15.111:0/3896609708 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fed98136a40 0x7fed98147110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:28.151 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.143+0000 7fed9cc29700 1 -- 172.21.15.111:0/3896609708 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fed980951b0 msgr2=0x7fed98066e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:28.151 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.143+0000 7fed9cc29700 1 --2- 172.21.15.111:0/3896609708 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fed980951b0 0x7fed98066e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:28.151 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.143+0000 7fed9cc29700 1 -- 172.21.15.111:0/3896609708 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed9400b180 con 0x7fed98099970 2024-04-25T02:20:28.151 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.143+0000 7fed9dc2b700 1 --2- 172.21.15.111:0/3896609708 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fed98136a40 0x7fed98147110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:20:28.151 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.143+0000 7fed9d42a700 1 --2- 172.21.15.111:0/3896609708 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fed980951b0 0x7fed98066e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:28.151 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.143+0000 7fed9cc29700 1 --2- 172.21.15.111:0/3896609708 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fed98099970 0x7fed98146c20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fed9400c000 tx=0x7fed94006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:28.151 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.143+0000 7fed867fc700 1 -- 172.21.15.111:0/3896609708 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed94010780 con 0x7fed98099970 2024-04-25T02:20:28.151 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.143+0000 7fed867fc700 1 -- 172.21.15.111:0/3896609708 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed940108e0 con 0x7fed98099970 2024-04-25T02:20:28.151 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.143+0000 7fed9f68e700 1 -- 172.21.15.111:0/3896609708 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed8800b1e0 con 0x7fed98099970 2024-04-25T02:20:28.151 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.143+0000 7fed867fc700 1 -- 172.21.15.111:0/3896609708 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fed94010c40 con 0x7fed98099970 2024-04-25T02:20:28.151 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.143+0000 7fed9f68e700 1 -- 172.21.15.111:0/3896609708 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed980656d0 con 0x7fed98099970 2024-04-25T02:20:28.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.144+0000 7fed867fc700 1 -- 172.21.15.111:0/3896609708 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fed9401c460 con 0x7fed98099970 2024-04-25T02:20:28.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.144+0000 7fed9f68e700 1 -- 172.21.15.111:0/3896609708 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed98136560 con 0x7fed98099970 2024-04-25T02:20:28.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.144+0000 7fed867fc700 1 -- 172.21.15.111:0/3896609708 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fed9404ae10 con 0x7fed98099970 2024-04-25T02:20:28.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.147+0000 7fed867fc700 1 -- 172.21.15.111:0/3896609708 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fed940667c0 con 0x7fed98099970 2024-04-25T02:20:28.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.257+0000 7fed9f68e700 1 -- 172.21.15.111:0/3896609708 --> v1:172.21.15.111:6816/39585 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fed98065c60 con 0x7fed78038dd0 2024-04-25T02:20:28.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.263+0000 7fed867fc700 1 -- 172.21.15.111:0/3896609708 <== mgr.4099 v1:172.21.15.111:6816/39585 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246975 (unknown 2965378022 0 1189155938) 0x7fed88006940 con 0x7fed78038dd0 2024-04-25T02:20:28.270 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:20:28.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.265+0000 7fed9f68e700 1 -- 172.21.15.111:0/3896609708 >> v1:172.21.15.111:6816/39585 conn(0x7fed78038dd0 legacy=0x7fed7803b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:28.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.265+0000 7fed9f68e700 1 -- 172.21.15.111:0/3896609708 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fed98099970 msgr2=0x7fed98146c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:28.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.265+0000 7fed9f68e700 1 --2- 172.21.15.111:0/3896609708 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fed98099970 0x7fed98146c20 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fed9400c000 tx=0x7fed94006df0).stop 2024-04-25T02:20:28.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.265+0000 7fed9f68e700 1 -- 172.21.15.111:0/3896609708 shutdown_connections 2024-04-25T02:20:28.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.265+0000 7fed9f68e700 1 --2- 172.21.15.111:0/3896609708 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fed98136a40 0x7fed98147110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:28.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.265+0000 7fed9f68e700 1 --2- 172.21.15.111:0/3896609708 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fed980951b0 0x7fed98066e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:28.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.265+0000 7fed9f68e700 1 --2- 172.21.15.111:0/3896609708 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fed98099970 0x7fed98146c20 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:28.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.265+0000 7fed9f68e700 1 -- 172.21.15.111:0/3896609708 >> 172.21.15.111:0/3896609708 conn(0x7fed98060340 msgr2=0x7fed98093e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:28.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.265+0000 7fed9f68e700 1 -- 172.21.15.111:0/3896609708 shutdown_connections 2024-04-25T02:20:28.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.265+0000 7fed9f68e700 1 -- 172.21.15.111:0/3896609708 wait complete. 2024-04-25T02:20:28.275 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2024-04-25T02:20:28.280 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-04-25T02:20:27.437351+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3633,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":108,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":4195040,"kb_used_data":704,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292320,"statfs":{"total":386547056640,"available":382251335680,"internally_reserved":4294967296,"allocated":720896,"data_stored":209441,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3633,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.595621"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.197225+0000","last_change":"2024-04-25T02:20:24.195706+0000","last_active":"2024-04-25T02:20:24.197225+0000","last_peered":"2024-04-25T02:20:24.197225+0000","last_clean":"2024-04-25T02:20:24.197225+0000","last_became_active":"2024-04-25T02:20:24.195349+0000","last_became_peered":"2024-04-25T02:20:24.195349+0000","last_unstale":"2024-04-25T02:20:24.197225+0000","last_undegraded":"2024-04-25T02:20:24.197225+0000","last_fullsized":"2024-04-25T02:20:24.197225+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.183813+0000","last_change":"2024-04-25T02:20:24.170636+0000","last_active":"2024-04-25T02:20:24.183813+0000","last_peered":"2024-04-25T02:20:24.183813+0000","last_clean":"2024-04-25T02:20:24.183813+0000","last_became_active":"2024-04-25T02:20:24.170426+0000","last_became_peered":"2024-04-25T02:20:24.170426+0000","last_unstale":"2024-04-25T02:20:24.183813+0000","last_undegraded":"2024-04-25T02:20:24.183813+0000","last_fullsized":"2024-04-25T02:20:24.183813+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.197995+0000","last_change":"2024-04-25T02:20:24.190781+0000","last_active":"2024-04-25T02:20:24.197995+0000","last_peered":"2024-04-25T02:20:24.197995+0000","last_clean":"2024-04-25T02:20:24.197995+0000","last_became_active":"2024-04-25T02:20:24.190114+0000","last_became_peered":"2024-04-25T02:20:24.190114+0000","last_unstale":"2024-04-25T02:20:24.197995+0000","last_undegraded":"2024-04-25T02:20:24.197995+0000","last_fullsized":"2024-04-25T02:20:24.197995+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.197275+0000","last_change":"2024-04-25T02:20:24.192016+0000","last_active":"2024-04-25T02:20:24.197275+0000","last_peered":"2024-04-25T02:20:24.197275+0000","last_clean":"2024-04-25T02:20:24.197275+0000","last_became_active":"2024-04-25T02:20:24.191694+0000","last_became_peered":"2024-04-25T02:20:24.191694+0000","last_unstale":"2024-04-25T02:20:24.197275+0000","last_undegraded":"2024-04-25T02:20:24.197275+0000","last_fullsized":"2024-04-25T02:20:24.197275+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.198818+0000","last_change":"2024-04-25T02:20:24.195316+0000","last_active":"2024-04-25T02:20:24.198818+0000","last_peered":"2024-04-25T02:20:24.198818+0000","last_clean":"2024-04-25T02:20:24.198818+0000","last_became_active":"2024-04-25T02:20:24.194996+0000","last_became_peered":"2024-04-25T02:20:24.194996+0000","last_unstale":"2024-04-25T02:20:24.198818+0000","last_undegraded":"2024-04-25T02:20:24.198818+0000","last_fullsized":"2024-04-25T02:20:24.198818+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.194022+0000","last_change":"2024-04-25T02:20:24.188215+0000","last_active":"2024-04-25T02:20:24.194022+0000","last_peered":"2024-04-25T02:20:24.194022+0000","last_clean":"2024-04-25T02:20:24.194022+0000","last_became_active":"2024-04-25T02:20:24.186345+0000","last_became_peered":"2024-04-25T02:20:24.186345+0000","last_unstale":"2024-04-25T02:20:24.194022+0000","last_undegraded":"2024-04-25T02:20:24.194022+0000","last_fullsized":"2024-04-25T02:20:24.194022+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.193607+0000","last_change":"2024-04-25T02:20:24.186090+0000","last_active":"2024-04-25T02:20:24.193607+0000","last_peered":"2024-04-25T02:20:24.193607+0000","last_clean":"2024-04-25T02:20:24.193607+0000","last_became_active":"2024-04-25T02:20:24.185481+0000","last_became_peered":"2024-04-25T02:20:24.185481+0000","last_unstale":"2024-04-25T02:20:24.193607+0000","last_undegraded":"2024-04-25T02:20:24.193607+0000","last_fullsized":"2024-04-25T02:20:24.193607+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.187860+0000","last_change":"2024-04-25T02:20:24.176292+0000","last_active":"2024-04-25T02:20:24.187860+0000","last_peered":"2024-04-25T02:20:24.187860+0000","last_clean":"2024-04-25T02:20:24.187860+0000","last_became_active":"2024-04-25T02:20:24.175187+0000","last_became_peered":"2024-04-25T02:20:24.175187+0000","last_unstale":"2024-04-25T02:20:24.187860+0000","last_undegraded":"2024-04-25T02:20:24.187860+0000","last_fullsized":"2024-04-25T02:20:24.187860+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.199827+0000","last_change":"2024-04-25T02:20:24.192327+0000","last_active":"2024-04-25T02:20:24.199827+0000","last_peered":"2024-04-25T02:20:24.199827+0000","last_clean":"2024-04-25T02:20:24.199827+0000","last_became_active":"2024-04-25T02:20:24.191616+0000","last_became_peered":"2024-04-25T02:20:24.191616+0000","last_unstale":"2024-04-25T02:20:24.199827+0000","last_undegraded":"2024-04-25T02:20:24.199827+0000","last_fullsized":"2024-04-25T02:20:24.199827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.187908+0000","last_change":"2024-04-25T02:20:24.178072+0000","last_active":"2024-04-25T02:20:24.187908+0000","last_peered":"2024-04-25T02:20:24.187908+0000","last_clean":"2024-04-25T02:20:24.187908+0000","last_became_active":"2024-04-25T02:20:24.177766+0000","last_became_peered":"2024-04-25T02:20:24.177766+0000","last_unstale":"2024-04-25T02:20:24.187908+0000","last_undegraded":"2024-04-25T02:20:24.187908+0000","last_fullsized":"2024-04-25T02:20:24.187908+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.187027+0000","last_change":"2024-04-25T02:20:24.179040+0000","last_active":"2024-04-25T02:20:24.187027+0000","last_peered":"2024-04-25T02:20:24.187027+0000","last_clean":"2024-04-25T02:20:24.187027+0000","last_became_active":"2024-04-25T02:20:24.178732+0000","last_became_peered":"2024-04-25T02:20:24.178732+0000","last_unstale":"2024-04-25T02:20:24.187027+0000","last_undegraded":"2024-04-25T02:20:24.187027+0000","last_fullsized":"2024-04-25T02:20:24.187027+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.197294+0000","last_change":"2024-04-25T02:20:24.195853+0000","last_active":"2024-04-25T02:20:24.197294+0000","last_peered":"2024-04-25T02:20:24.197294+0000","last_clean":"2024-04-25T02:20:24.197294+0000","last_became_active":"2024-04-25T02:20:24.195544+0000","last_became_peered":"2024-04-25T02:20:24.195544+0000","last_unstale":"2024-04-25T02:20:24.197294+0000","last_undegraded":"2024-04-25T02:20:24.197294+0000","last_fullsized":"2024-04-25T02:20:24.197294+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.199249+0000","last_change":"2024-04-25T02:20:24.196840+0000","last_active":"2024-04-25T02:20:24.199249+0000","last_peered":"2024-04-25T02:20:24.199249+0000","last_clean":"2024-04-25T02:20:24.199249+0000","last_became_active":"2024-04-25T02:20:24.196155+0000","last_became_peered":"2024-04-25T02:20:24.196155+0000","last_unstale":"2024-04-25T02:20:24.199249+0000","last_undegraded":"2024-04-25T02:20:24.199249+0000","last_fullsized":"2024-04-25T02:20:24.199249+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.178645+0000","last_change":"2024-04-25T02:20:24.171853+0000","last_active":"2024-04-25T02:20:24.178645+0000","last_peered":"2024-04-25T02:20:24.178645+0000","last_clean":"2024-04-25T02:20:24.178645+0000","last_became_active":"2024-04-25T02:20:24.171522+0000","last_became_peered":"2024-04-25T02:20:24.171522+0000","last_unstale":"2024-04-25T02:20:24.178645+0000","last_undegraded":"2024-04-25T02:20:24.178645+0000","last_fullsized":"2024-04-25T02:20:24.178645+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.193847+0000","last_change":"2024-04-25T02:20:24.185905+0000","last_active":"2024-04-25T02:20:24.193847+0000","last_peered":"2024-04-25T02:20:24.193847+0000","last_clean":"2024-04-25T02:20:24.193847+0000","last_became_active":"2024-04-25T02:20:24.185440+0000","last_became_peered":"2024-04-25T02:20:24.185440+0000","last_unstale":"2024-04-25T02:20:24.193847+0000","last_undegraded":"2024-04-25T02:20:24.193847+0000","last_fullsized":"2024-04-25T02:20:24.193847+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.187908+0000","last_change":"2024-04-25T02:20:24.183619+0000","last_active":"2024-04-25T02:20:24.187908+0000","last_peered":"2024-04-25T02:20:24.187908+0000","last_clean":"2024-04-25T02:20:24.187908+0000","last_became_active":"2024-04-25T02:20:24.183299+0000","last_became_peered":"2024-04-25T02:20:24.183299+0000","last_unstale":"2024-04-25T02:20:24.187908+0000","last_undegraded":"2024-04-25T02:20:24.187908+0000","last_fullsized":"2024-04-25T02:20:24.187908+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.199849+0000","last_change":"2024-04-25T02:20:24.194408+0000","last_active":"2024-04-25T02:20:24.199849+0000","last_peered":"2024-04-25T02:20:24.199849+0000","last_clean":"2024-04-25T02:20:24.199849+0000","last_became_active":"2024-04-25T02:20:24.192031+0000","last_became_peered":"2024-04-25T02:20:24.192031+0000","last_unstale":"2024-04-25T02:20:24.199849+0000","last_undegraded":"2024-04-25T02:20:24.199849+0000","last_fullsized":"2024-04-25T02:20:24.199849+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.179767+0000","last_change":"2024-04-25T02:20:24.175814+0000","last_active":"2024-04-25T02:20:24.179767+0000","last_peered":"2024-04-25T02:20:24.179767+0000","last_clean":"2024-04-25T02:20:24.179767+0000","last_became_active":"2024-04-25T02:20:24.174411+0000","last_became_peered":"2024-04-25T02:20:24.174411+0000","last_unstale":"2024-04-25T02:20:24.179767+0000","last_undegraded":"2024-04-25T02:20:24.179767+0000","last_fullsized":"2024-04-25T02:20:24.179767+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.197264+0000","last_change":"2024-04-25T02:20:24.195764+0000","last_active":"2024-04-25T02:20:24.197264+0000","last_peered":"2024-04-25T02:20:24.197264+0000","last_clean":"2024-04-25T02:20:24.197264+0000","last_became_active":"2024-04-25T02:20:24.195463+0000","last_became_peered":"2024-04-25T02:20:24.195463+0000","last_unstale":"2024-04-25T02:20:24.197264+0000","last_undegraded":"2024-04-25T02:20:24.197264+0000","last_fullsized":"2024-04-25T02:20:24.197264+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.204216+0000","last_change":"2024-04-25T02:20:24.200557+0000","last_active":"2024-04-25T02:20:24.204216+0000","last_peered":"2024-04-25T02:20:24.204216+0000","last_clean":"2024-04-25T02:20:24.204216+0000","last_became_active":"2024-04-25T02:20:24.200289+0000","last_became_peered":"2024-04-25T02:20:24.200289+0000","last_unstale":"2024-04-25T02:20:24.204216+0000","last_undegraded":"2024-04-25T02:20:24.204216+0000","last_fullsized":"2024-04-25T02:20:24.204216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.190365+0000","last_change":"2024-04-25T02:20:24.185144+0000","last_active":"2024-04-25T02:20:24.190365+0000","last_peered":"2024-04-25T02:20:24.190365+0000","last_clean":"2024-04-25T02:20:24.190365+0000","last_became_active":"2024-04-25T02:20:24.184668+0000","last_became_peered":"2024-04-25T02:20:24.184668+0000","last_unstale":"2024-04-25T02:20:24.190365+0000","last_undegraded":"2024-04-25T02:20:24.190365+0000","last_fullsized":"2024-04-25T02:20:24.190365+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.191297+0000","last_change":"2024-04-25T02:20:24.185079+0000","last_active":"2024-04-25T02:20:24.191297+0000","last_peered":"2024-04-25T02:20:24.191297+0000","last_clean":"2024-04-25T02:20:24.191297+0000","last_became_active":"2024-04-25T02:20:24.184748+0000","last_became_peered":"2024-04-25T02:20:24.184748+0000","last_unstale":"2024-04-25T02:20:24.191297+0000","last_undegraded":"2024-04-25T02:20:24.191297+0000","last_fullsized":"2024-04-25T02:20:24.191297+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.193584+0000","last_change":"2024-04-25T02:20:24.185898+0000","last_active":"2024-04-25T02:20:24.193584+0000","last_peered":"2024-04-25T02:20:24.193584+0000","last_clean":"2024-04-25T02:20:24.193584+0000","last_became_active":"2024-04-25T02:20:24.185153+0000","last_became_peered":"2024-04-25T02:20:24.185153+0000","last_unstale":"2024-04-25T02:20:24.193584+0000","last_undegraded":"2024-04-25T02:20:24.193584+0000","last_fullsized":"2024-04-25T02:20:24.193584+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.190967+0000","last_change":"2024-04-25T02:20:24.183879+0000","last_active":"2024-04-25T02:20:24.190967+0000","last_peered":"2024-04-25T02:20:24.190967+0000","last_clean":"2024-04-25T02:20:24.190967+0000","last_became_active":"2024-04-25T02:20:24.183565+0000","last_became_peered":"2024-04-25T02:20:24.183565+0000","last_unstale":"2024-04-25T02:20:24.190967+0000","last_undegraded":"2024-04-25T02:20:24.190967+0000","last_fullsized":"2024-04-25T02:20:24.190967+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.192186+0000","last_change":"2024-04-25T02:20:24.186601+0000","last_active":"2024-04-25T02:20:24.192186+0000","last_peered":"2024-04-25T02:20:24.192186+0000","last_clean":"2024-04-25T02:20:24.192186+0000","last_became_active":"2024-04-25T02:20:24.184553+0000","last_became_peered":"2024-04-25T02:20:24.184553+0000","last_unstale":"2024-04-25T02:20:24.192186+0000","last_undegraded":"2024-04-25T02:20:24.192186+0000","last_fullsized":"2024-04-25T02:20:24.192186+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.177547+0000","last_change":"2024-04-25T02:20:24.167579+0000","last_active":"2024-04-25T02:20:24.177547+0000","last_peered":"2024-04-25T02:20:24.177547+0000","last_clean":"2024-04-25T02:20:24.177547+0000","last_became_active":"2024-04-25T02:20:24.167170+0000","last_became_peered":"2024-04-25T02:20:24.167170+0000","last_unstale":"2024-04-25T02:20:24.177547+0000","last_undegraded":"2024-04-25T02:20:24.177547+0000","last_fullsized":"2024-04-25T02:20:24.177547+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.198565+0000","last_change":"2024-04-25T02:20:24.189023+0000","last_active":"2024-04-25T02:20:24.198565+0000","last_peered":"2024-04-25T02:20:24.198565+0000","last_clean":"2024-04-25T02:20:24.198565+0000","last_became_active":"2024-04-25T02:20:24.188203+0000","last_became_peered":"2024-04-25T02:20:24.188203+0000","last_unstale":"2024-04-25T02:20:24.198565+0000","last_undegraded":"2024-04-25T02:20:24.198565+0000","last_fullsized":"2024-04-25T02:20:24.198565+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.170956+0000","last_change":"2024-04-25T02:20:23.878198+0000","last_active":"2024-04-25T02:20:24.170956+0000","last_peered":"2024-04-25T02:20:24.170956+0000","last_clean":"2024-04-25T02:20:24.170956+0000","last_became_active":"2024-04-25T02:20:23.877819+0000","last_became_peered":"2024-04-25T02:20:23.877819+0000","last_unstale":"2024-04-25T02:20:24.170956+0000","last_undegraded":"2024-04-25T02:20:24.170956+0000","last_fullsized":"2024-04-25T02:20:24.170956+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.198584+0000","last_change":"2024-04-25T02:20:24.191107+0000","last_active":"2024-04-25T02:20:24.198584+0000","last_peered":"2024-04-25T02:20:24.198584+0000","last_clean":"2024-04-25T02:20:24.198584+0000","last_became_active":"2024-04-25T02:20:24.190019+0000","last_became_peered":"2024-04-25T02:20:24.190019+0000","last_unstale":"2024-04-25T02:20:24.198584+0000","last_undegraded":"2024-04-25T02:20:24.198584+0000","last_fullsized":"2024-04-25T02:20:24.198584+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.156633+0000","last_change":"2024-04-25T02:20:23.879347+0000","last_active":"2024-04-25T02:20:24.156633+0000","last_peered":"2024-04-25T02:20:24.156633+0000","last_clean":"2024-04-25T02:20:24.156633+0000","last_became_active":"2024-04-25T02:20:23.879065+0000","last_became_peered":"2024-04-25T02:20:23.879065+0000","last_unstale":"2024-04-25T02:20:24.156633+0000","last_undegraded":"2024-04-25T02:20:24.156633+0000","last_fullsized":"2024-04-25T02:20:24.156633+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.194862+0000","last_change":"2024-04-25T02:20:24.190744+0000","last_active":"2024-04-25T02:20:24.194862+0000","last_peered":"2024-04-25T02:20:24.194862+0000","last_clean":"2024-04-25T02:20:24.194862+0000","last_became_active":"2024-04-25T02:20:24.190410+0000","last_became_peered":"2024-04-25T02:20:24.190410+0000","last_unstale":"2024-04-25T02:20:24.194862+0000","last_undegraded":"2024-04-25T02:20:24.194862+0000","last_fullsized":"2024-04-25T02:20:24.194862+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.281449+0000","last_change":"2024-04-25T02:20:23.890094+0000","last_active":"2024-04-25T02:20:25.281449+0000","last_peered":"2024-04-25T02:20:25.281449+0000","last_clean":"2024-04-25T02:20:25.281449+0000","last_became_active":"2024-04-25T02:20:23.889715+0000","last_became_peered":"2024-04-25T02:20:23.889715+0000","last_unstale":"2024-04-25T02:20:25.281449+0000","last_undegraded":"2024-04-25T02:20:25.281449+0000","last_fullsized":"2024-04-25T02:20:25.281449+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.199764+0000","last_change":"2024-04-25T02:20:24.196642+0000","last_active":"2024-04-25T02:20:24.199764+0000","last_peered":"2024-04-25T02:20:24.199764+0000","last_clean":"2024-04-25T02:20:24.199764+0000","last_became_active":"2024-04-25T02:20:24.196137+0000","last_became_peered":"2024-04-25T02:20:24.196137+0000","last_unstale":"2024-04-25T02:20:24.199764+0000","last_undegraded":"2024-04-25T02:20:24.199764+0000","last_fullsized":"2024-04-25T02:20:24.199764+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"18'3","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.250025+0000","last_change":"2024-04-25T02:20:23.877498+0000","last_active":"2024-04-25T02:20:26.250025+0000","last_peered":"2024-04-25T02:20:26.250025+0000","last_clean":"2024-04-25T02:20:26.250025+0000","last_became_active":"2024-04-25T02:20:23.876803+0000","last_became_peered":"2024-04-25T02:20:23.876803+0000","last_unstale":"2024-04-25T02:20:26.250025+0000","last_undegraded":"2024-04-25T02:20:26.250025+0000","last_fullsized":"2024-04-25T02:20:26.250025+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.196580+0000","last_change":"2024-04-25T02:20:24.192558+0000","last_active":"2024-04-25T02:20:24.196580+0000","last_peered":"2024-04-25T02:20:24.196580+0000","last_clean":"2024-04-25T02:20:24.196580+0000","last_became_active":"2024-04-25T02:20:24.191880+0000","last_became_peered":"2024-04-25T02:20:24.191880+0000","last_unstale":"2024-04-25T02:20:24.196580+0000","last_undegraded":"2024-04-25T02:20:24.196580+0000","last_fullsized":"2024-04-25T02:20:24.196580+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.249543+0000","last_change":"2024-04-25T02:20:23.885888+0000","last_active":"2024-04-25T02:20:26.249543+0000","last_peered":"2024-04-25T02:20:26.249543+0000","last_clean":"2024-04-25T02:20:26.249543+0000","last_became_active":"2024-04-25T02:20:23.885589+0000","last_became_peered":"2024-04-25T02:20:23.885589+0000","last_unstale":"2024-04-25T02:20:26.249543+0000","last_undegraded":"2024-04-25T02:20:26.249543+0000","last_fullsized":"2024-04-25T02:20:26.249543+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.201755+0000","last_change":"2024-04-25T02:20:24.198607+0000","last_active":"2024-04-25T02:20:24.201755+0000","last_peered":"2024-04-25T02:20:24.201755+0000","last_clean":"2024-04-25T02:20:24.201755+0000","last_became_active":"2024-04-25T02:20:24.196892+0000","last_became_peered":"2024-04-25T02:20:24.196892+0000","last_unstale":"2024-04-25T02:20:24.201755+0000","last_undegraded":"2024-04-25T02:20:24.201755+0000","last_fullsized":"2024-04-25T02:20:24.201755+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.167790+0000","last_change":"2024-04-25T02:20:23.883408+0000","last_active":"2024-04-25T02:20:25.167790+0000","last_peered":"2024-04-25T02:20:25.167790+0000","last_clean":"2024-04-25T02:20:25.167790+0000","last_became_active":"2024-04-25T02:20:23.882488+0000","last_became_peered":"2024-04-25T02:20:23.882488+0000","last_unstale":"2024-04-25T02:20:25.167790+0000","last_undegraded":"2024-04-25T02:20:25.167790+0000","last_fullsized":"2024-04-25T02:20:25.167790+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.188614+0000","last_change":"2024-04-25T02:20:24.180953+0000","last_active":"2024-04-25T02:20:24.188614+0000","last_peered":"2024-04-25T02:20:24.188614+0000","last_clean":"2024-04-25T02:20:24.188614+0000","last_became_active":"2024-04-25T02:20:24.180646+0000","last_became_peered":"2024-04-25T02:20:24.180646+0000","last_unstale":"2024-04-25T02:20:24.188614+0000","last_undegraded":"2024-04-25T02:20:24.188614+0000","last_fullsized":"2024-04-25T02:20:24.188614+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"18'8","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.244995+0000","last_change":"2024-04-25T02:20:23.890383+0000","last_active":"2024-04-25T02:20:26.244995+0000","last_peered":"2024-04-25T02:20:26.244995+0000","last_clean":"2024-04-25T02:20:26.244995+0000","last_became_active":"2024-04-25T02:20:23.890015+0000","last_became_peered":"2024-04-25T02:20:23.890015+0000","last_unstale":"2024-04-25T02:20:26.244995+0000","last_undegraded":"2024-04-25T02:20:26.244995+0000","last_fullsized":"2024-04-25T02:20:26.244995+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.193067+0000","last_change":"2024-04-25T02:20:24.186645+0000","last_active":"2024-04-25T02:20:24.193067+0000","last_peered":"2024-04-25T02:20:24.193067+0000","last_clean":"2024-04-25T02:20:24.193067+0000","last_became_active":"2024-04-25T02:20:24.186336+0000","last_became_peered":"2024-04-25T02:20:24.186336+0000","last_unstale":"2024-04-25T02:20:24.193067+0000","last_undegraded":"2024-04-25T02:20:24.193067+0000","last_fullsized":"2024-04-25T02:20:24.193067+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.248214+0000","last_change":"2024-04-25T02:20:23.882583+0000","last_active":"2024-04-25T02:20:26.248214+0000","last_peered":"2024-04-25T02:20:26.248214+0000","last_clean":"2024-04-25T02:20:26.248214+0000","last_became_active":"2024-04-25T02:20:23.882254+0000","last_became_peered":"2024-04-25T02:20:23.882254+0000","last_unstale":"2024-04-25T02:20:26.248214+0000","last_undegraded":"2024-04-25T02:20:26.248214+0000","last_fullsized":"2024-04-25T02:20:26.248214+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.197776+0000","last_change":"2024-04-25T02:20:24.191415+0000","last_active":"2024-04-25T02:20:24.197776+0000","last_peered":"2024-04-25T02:20:24.197776+0000","last_clean":"2024-04-25T02:20:24.197776+0000","last_became_active":"2024-04-25T02:20:24.191024+0000","last_became_peered":"2024-04-25T02:20:24.191024+0000","last_unstale":"2024-04-25T02:20:24.197776+0000","last_undegraded":"2024-04-25T02:20:24.197776+0000","last_fullsized":"2024-04-25T02:20:24.197776+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"18'3","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.248576+0000","last_change":"2024-04-25T02:20:23.881482+0000","last_active":"2024-04-25T02:20:26.248576+0000","last_peered":"2024-04-25T02:20:26.248576+0000","last_clean":"2024-04-25T02:20:26.248576+0000","last_became_active":"2024-04-25T02:20:23.881128+0000","last_became_peered":"2024-04-25T02:20:23.881128+0000","last_unstale":"2024-04-25T02:20:26.248576+0000","last_undegraded":"2024-04-25T02:20:26.248576+0000","last_fullsized":"2024-04-25T02:20:26.248576+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.199346+0000","last_change":"2024-04-25T02:20:24.197800+0000","last_active":"2024-04-25T02:20:24.199346+0000","last_peered":"2024-04-25T02:20:24.199346+0000","last_clean":"2024-04-25T02:20:24.199346+0000","last_became_active":"2024-04-25T02:20:24.188621+0000","last_became_peered":"2024-04-25T02:20:24.188621+0000","last_unstale":"2024-04-25T02:20:24.199346+0000","last_undegraded":"2024-04-25T02:20:24.199346+0000","last_fullsized":"2024-04-25T02:20:24.199346+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.169346+0000","last_change":"2024-04-25T02:20:23.890803+0000","last_active":"2024-04-25T02:20:24.169346+0000","last_peered":"2024-04-25T02:20:24.169346+0000","last_clean":"2024-04-25T02:20:24.169346+0000","last_became_active":"2024-04-25T02:20:23.890114+0000","last_became_peered":"2024-04-25T02:20:23.890114+0000","last_unstale":"2024-04-25T02:20:24.169346+0000","last_undegraded":"2024-04-25T02:20:24.169346+0000","last_fullsized":"2024-04-25T02:20:24.169346+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.192424+0000","last_change":"2024-04-25T02:20:24.186816+0000","last_active":"2024-04-25T02:20:24.192424+0000","last_peered":"2024-04-25T02:20:24.192424+0000","last_clean":"2024-04-25T02:20:24.192424+0000","last_became_active":"2024-04-25T02:20:24.185644+0000","last_became_peered":"2024-04-25T02:20:24.185644+0000","last_unstale":"2024-04-25T02:20:24.192424+0000","last_undegraded":"2024-04-25T02:20:24.192424+0000","last_fullsized":"2024-04-25T02:20:24.192424+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'10","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.250313+0000","last_change":"2024-04-25T02:20:23.873213+0000","last_active":"2024-04-25T02:20:26.250313+0000","last_peered":"2024-04-25T02:20:26.250313+0000","last_clean":"2024-04-25T02:20:26.250313+0000","last_became_active":"2024-04-25T02:20:23.872886+0000","last_became_peered":"2024-04-25T02:20:23.872886+0000","last_unstale":"2024-04-25T02:20:26.250313+0000","last_undegraded":"2024-04-25T02:20:26.250313+0000","last_fullsized":"2024-04-25T02:20:26.250313+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.199743+0000","last_change":"2024-04-25T02:20:24.196436+0000","last_active":"2024-04-25T02:20:24.199743+0000","last_peered":"2024-04-25T02:20:24.199743+0000","last_clean":"2024-04-25T02:20:24.199743+0000","last_became_active":"2024-04-25T02:20:24.195763+0000","last_became_peered":"2024-04-25T02:20:24.195763+0000","last_unstale":"2024-04-25T02:20:24.199743+0000","last_undegraded":"2024-04-25T02:20:24.199743+0000","last_fullsized":"2024-04-25T02:20:24.199743+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.187972+0000","last_change":"2024-04-25T02:20:23.872612+0000","last_active":"2024-04-25T02:20:24.187972+0000","last_peered":"2024-04-25T02:20:24.187972+0000","last_clean":"2024-04-25T02:20:24.187972+0000","last_became_active":"2024-04-25T02:20:23.872266+0000","last_became_peered":"2024-04-25T02:20:23.872266+0000","last_unstale":"2024-04-25T02:20:24.187972+0000","last_undegraded":"2024-04-25T02:20:24.187972+0000","last_fullsized":"2024-04-25T02:20:24.187972+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.197208+0000","last_change":"2024-04-25T02:20:24.194953+0000","last_active":"2024-04-25T02:20:24.197208+0000","last_peered":"2024-04-25T02:20:24.197208+0000","last_clean":"2024-04-25T02:20:24.197208+0000","last_became_active":"2024-04-25T02:20:24.194637+0000","last_became_peered":"2024-04-25T02:20:24.194637+0000","last_unstale":"2024-04-25T02:20:24.197208+0000","last_undegraded":"2024-04-25T02:20:24.197208+0000","last_fullsized":"2024-04-25T02:20:24.197208+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.183925+0000","last_change":"2024-04-25T02:20:23.876382+0000","last_active":"2024-04-25T02:20:24.183925+0000","last_peered":"2024-04-25T02:20:24.183925+0000","last_clean":"2024-04-25T02:20:24.183925+0000","last_became_active":"2024-04-25T02:20:23.875806+0000","last_became_peered":"2024-04-25T02:20:23.875806+0000","last_unstale":"2024-04-25T02:20:24.183925+0000","last_undegraded":"2024-04-25T02:20:24.183925+0000","last_fullsized":"2024-04-25T02:20:24.183925+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.194532+0000","last_change":"2024-04-25T02:20:24.190109+0000","last_active":"2024-04-25T02:20:24.194532+0000","last_peered":"2024-04-25T02:20:24.194532+0000","last_clean":"2024-04-25T02:20:24.194532+0000","last_became_active":"2024-04-25T02:20:24.189801+0000","last_became_peered":"2024-04-25T02:20:24.189801+0000","last_unstale":"2024-04-25T02:20:24.194532+0000","last_undegraded":"2024-04-25T02:20:24.194532+0000","last_fullsized":"2024-04-25T02:20:24.194532+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.199086+0000","last_change":"2024-04-25T02:20:23.885537+0000","last_active":"2024-04-25T02:20:24.199086+0000","last_peered":"2024-04-25T02:20:24.199086+0000","last_clean":"2024-04-25T02:20:24.199086+0000","last_became_active":"2024-04-25T02:20:23.885190+0000","last_became_peered":"2024-04-25T02:20:23.885190+0000","last_unstale":"2024-04-25T02:20:24.199086+0000","last_undegraded":"2024-04-25T02:20:24.199086+0000","last_fullsized":"2024-04-25T02:20:24.199086+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.193670+0000","last_change":"2024-04-25T02:20:24.188326+0000","last_active":"2024-04-25T02:20:24.193670+0000","last_peered":"2024-04-25T02:20:24.193670+0000","last_clean":"2024-04-25T02:20:24.193670+0000","last_became_active":"2024-04-25T02:20:24.187661+0000","last_became_peered":"2024-04-25T02:20:24.187661+0000","last_unstale":"2024-04-25T02:20:24.193670+0000","last_undegraded":"2024-04-25T02:20:24.193670+0000","last_fullsized":"2024-04-25T02:20:24.193670+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.168528+0000","last_change":"2024-04-25T02:20:23.877401+0000","last_active":"2024-04-25T02:20:24.168528+0000","last_peered":"2024-04-25T02:20:24.168528+0000","last_clean":"2024-04-25T02:20:24.168528+0000","last_became_active":"2024-04-25T02:20:23.876871+0000","last_became_peered":"2024-04-25T02:20:23.876871+0000","last_unstale":"2024-04-25T02:20:24.168528+0000","last_undegraded":"2024-04-25T02:20:24.168528+0000","last_fullsized":"2024-04-25T02:20:24.168528+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.193968+0000","last_change":"2024-04-25T02:20:24.185293+0000","last_active":"2024-04-25T02:20:24.193968+0000","last_peered":"2024-04-25T02:20:24.193968+0000","last_clean":"2024-04-25T02:20:24.193968+0000","last_became_active":"2024-04-25T02:20:24.184978+0000","last_became_peered":"2024-04-25T02:20:24.184978+0000","last_unstale":"2024-04-25T02:20:24.193968+0000","last_undegraded":"2024-04-25T02:20:24.193968+0000","last_fullsized":"2024-04-25T02:20:24.193968+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.248087+0000","last_change":"2024-04-25T02:20:23.886478+0000","last_active":"2024-04-25T02:20:26.248087+0000","last_peered":"2024-04-25T02:20:26.248087+0000","last_clean":"2024-04-25T02:20:26.248087+0000","last_became_active":"2024-04-25T02:20:23.886157+0000","last_became_peered":"2024-04-25T02:20:23.886157+0000","last_unstale":"2024-04-25T02:20:26.248087+0000","last_undegraded":"2024-04-25T02:20:26.248087+0000","last_fullsized":"2024-04-25T02:20:26.248087+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.204062+0000","last_change":"2024-04-25T02:20:24.199344+0000","last_active":"2024-04-25T02:20:24.204062+0000","last_peered":"2024-04-25T02:20:24.204062+0000","last_clean":"2024-04-25T02:20:24.204062+0000","last_became_active":"2024-04-25T02:20:24.199010+0000","last_became_peered":"2024-04-25T02:20:24.199010+0000","last_unstale":"2024-04-25T02:20:24.204062+0000","last_undegraded":"2024-04-25T02:20:24.204062+0000","last_fullsized":"2024-04-25T02:20:24.204062+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.161596+0000","last_change":"2024-04-25T02:20:23.884331+0000","last_active":"2024-04-25T02:20:24.161596+0000","last_peered":"2024-04-25T02:20:24.161596+0000","last_clean":"2024-04-25T02:20:24.161596+0000","last_became_active":"2024-04-25T02:20:23.883987+0000","last_became_peered":"2024-04-25T02:20:23.883987+0000","last_unstale":"2024-04-25T02:20:24.161596+0000","last_undegraded":"2024-04-25T02:20:24.161596+0000","last_fullsized":"2024-04-25T02:20:24.161596+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.198604+0000","last_change":"2024-04-25T02:20:24.191297+0000","last_active":"2024-04-25T02:20:24.198604+0000","last_peered":"2024-04-25T02:20:24.198604+0000","last_clean":"2024-04-25T02:20:24.198604+0000","last_became_active":"2024-04-25T02:20:24.190401+0000","last_became_peered":"2024-04-25T02:20:24.190401+0000","last_unstale":"2024-04-25T02:20:24.198604+0000","last_undegraded":"2024-04-25T02:20:24.198604+0000","last_fullsized":"2024-04-25T02:20:24.198604+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"18'3","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.250453+0000","last_change":"2024-04-25T02:20:23.881257+0000","last_active":"2024-04-25T02:20:26.250453+0000","last_peered":"2024-04-25T02:20:26.250453+0000","last_clean":"2024-04-25T02:20:26.250453+0000","last_became_active":"2024-04-25T02:20:23.880935+0000","last_became_peered":"2024-04-25T02:20:23.880935+0000","last_unstale":"2024-04-25T02:20:26.250453+0000","last_undegraded":"2024-04-25T02:20:26.250453+0000","last_fullsized":"2024-04-25T02:20:26.250453+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.193753+0000","last_change":"2024-04-25T02:20:24.189432+0000","last_active":"2024-04-25T02:20:24.193753+0000","last_peered":"2024-04-25T02:20:24.193753+0000","last_clean":"2024-04-25T02:20:24.193753+0000","last_became_active":"2024-04-25T02:20:24.189016+0000","last_became_peered":"2024-04-25T02:20:24.189016+0000","last_unstale":"2024-04-25T02:20:24.193753+0000","last_undegraded":"2024-04-25T02:20:24.193753+0000","last_fullsized":"2024-04-25T02:20:24.193753+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.247109+0000","last_change":"2024-04-25T02:20:23.885274+0000","last_active":"2024-04-25T02:20:26.247109+0000","last_peered":"2024-04-25T02:20:26.247109+0000","last_clean":"2024-04-25T02:20:26.247109+0000","last_became_active":"2024-04-25T02:20:23.884934+0000","last_became_peered":"2024-04-25T02:20:23.884934+0000","last_unstale":"2024-04-25T02:20:26.247109+0000","last_undegraded":"2024-04-25T02:20:26.247109+0000","last_fullsized":"2024-04-25T02:20:26.247109+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.194522+0000","last_change":"2024-04-25T02:20:24.192355+0000","last_active":"2024-04-25T02:20:24.194522+0000","last_peered":"2024-04-25T02:20:24.194522+0000","last_clean":"2024-04-25T02:20:24.194522+0000","last_became_active":"2024-04-25T02:20:24.191909+0000","last_became_peered":"2024-04-25T02:20:24.191909+0000","last_unstale":"2024-04-25T02:20:24.194522+0000","last_undegraded":"2024-04-25T02:20:24.194522+0000","last_fullsized":"2024-04-25T02:20:24.194522+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.161935+0000","last_change":"2024-04-25T02:20:15.491093+0000","last_active":"2024-04-25T02:20:24.161935+0000","last_peered":"2024-04-25T02:20:24.161935+0000","last_clean":"2024-04-25T02:20:24.161935+0000","last_became_active":"2024-04-25T02:20:15.490770+0000","last_became_peered":"2024-04-25T02:20:15.490770+0000","last_unstale":"2024-04-25T02:20:24.161935+0000","last_undegraded":"2024-04-25T02:20:24.161935+0000","last_fullsized":"2024-04-25T02:20:24.161935+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.167026+0000","last_change":"2024-04-25T02:20:23.885604+0000","last_active":"2024-04-25T02:20:25.167026+0000","last_peered":"2024-04-25T02:20:25.167026+0000","last_clean":"2024-04-25T02:20:25.167026+0000","last_became_active":"2024-04-25T02:20:23.885298+0000","last_became_peered":"2024-04-25T02:20:23.885298+0000","last_unstale":"2024-04-25T02:20:25.167026+0000","last_undegraded":"2024-04-25T02:20:25.167026+0000","last_fullsized":"2024-04-25T02:20:25.167026+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.194944+0000","last_change":"2024-04-25T02:20:24.189688+0000","last_active":"2024-04-25T02:20:24.194944+0000","last_peered":"2024-04-25T02:20:24.194944+0000","last_clean":"2024-04-25T02:20:24.194944+0000","last_became_active":"2024-04-25T02:20:24.189417+0000","last_became_peered":"2024-04-25T02:20:24.189417+0000","last_unstale":"2024-04-25T02:20:24.194944+0000","last_undegraded":"2024-04-25T02:20:24.194944+0000","last_fullsized":"2024-04-25T02:20:24.194944+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.162049+0000","last_change":"2024-04-25T02:20:15.489991+0000","last_active":"2024-04-25T02:20:24.162049+0000","last_peered":"2024-04-25T02:20:24.162049+0000","last_clean":"2024-04-25T02:20:24.162049+0000","last_became_active":"2024-04-25T02:20:15.489641+0000","last_became_peered":"2024-04-25T02:20:15.489641+0000","last_unstale":"2024-04-25T02:20:24.162049+0000","last_undegraded":"2024-04-25T02:20:24.162049+0000","last_fullsized":"2024-04-25T02:20:24.162049+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.250313+0000","last_change":"2024-04-25T02:20:23.875583+0000","last_active":"2024-04-25T02:20:26.250313+0000","last_peered":"2024-04-25T02:20:26.250313+0000","last_clean":"2024-04-25T02:20:26.250313+0000","last_became_active":"2024-04-25T02:20:23.875234+0000","last_became_peered":"2024-04-25T02:20:23.875234+0000","last_unstale":"2024-04-25T02:20:26.250313+0000","last_undegraded":"2024-04-25T02:20:26.250313+0000","last_fullsized":"2024-04-25T02:20:26.250313+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.179030+0000","last_change":"2024-04-25T02:20:24.172708+0000","last_active":"2024-04-25T02:20:24.179030+0000","last_peered":"2024-04-25T02:20:24.179030+0000","last_clean":"2024-04-25T02:20:24.179030+0000","last_became_active":"2024-04-25T02:20:24.172138+0000","last_became_peered":"2024-04-25T02:20:24.172138+0000","last_unstale":"2024-04-25T02:20:24.179030+0000","last_undegraded":"2024-04-25T02:20:24.179030+0000","last_fullsized":"2024-04-25T02:20:24.179030+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.159793+0000","last_change":"2024-04-25T02:20:15.488908+0000","last_active":"2024-04-25T02:20:24.159793+0000","last_peered":"2024-04-25T02:20:24.159793+0000","last_clean":"2024-04-25T02:20:24.159793+0000","last_became_active":"2024-04-25T02:20:15.488569+0000","last_became_peered":"2024-04-25T02:20:15.488569+0000","last_unstale":"2024-04-25T02:20:24.159793+0000","last_undegraded":"2024-04-25T02:20:24.159793+0000","last_fullsized":"2024-04-25T02:20:24.159793+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.279870+0000","last_change":"2024-04-25T02:20:23.872080+0000","last_active":"2024-04-25T02:20:25.279870+0000","last_peered":"2024-04-25T02:20:25.279870+0000","last_clean":"2024-04-25T02:20:25.279870+0000","last_became_active":"2024-04-25T02:20:23.871751+0000","last_became_peered":"2024-04-25T02:20:23.871751+0000","last_unstale":"2024-04-25T02:20:25.279870+0000","last_undegraded":"2024-04-25T02:20:25.279870+0000","last_fullsized":"2024-04-25T02:20:25.279870+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.183350+0000","last_change":"2024-04-25T02:20:24.174377+0000","last_active":"2024-04-25T02:20:24.183350+0000","last_peered":"2024-04-25T02:20:24.183350+0000","last_clean":"2024-04-25T02:20:24.183350+0000","last_became_active":"2024-04-25T02:20:24.174100+0000","last_became_peered":"2024-04-25T02:20:24.174100+0000","last_unstale":"2024-04-25T02:20:24.183350+0000","last_undegraded":"2024-04-25T02:20:24.183350+0000","last_fullsized":"2024-04-25T02:20:24.183350+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.159203+0000","last_change":"2024-04-25T02:20:15.487675+0000","last_active":"2024-04-25T02:20:24.159203+0000","last_peered":"2024-04-25T02:20:24.159203+0000","last_clean":"2024-04-25T02:20:24.159203+0000","last_became_active":"2024-04-25T02:20:15.487331+0000","last_became_peered":"2024-04-25T02:20:15.487331+0000","last_unstale":"2024-04-25T02:20:24.159203+0000","last_undegraded":"2024-04-25T02:20:24.159203+0000","last_fullsized":"2024-04-25T02:20:24.159203+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"10'1","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.164063+0000","last_change":"2024-04-25T02:20:11.467819+0000","last_active":"2024-04-25T02:20:24.164063+0000","last_peered":"2024-04-25T02:20:24.164063+0000","last_clean":"2024-04-25T02:20:24.164063+0000","last_became_active":"2024-04-25T02:20:11.467259+0000","last_became_peered":"2024-04-25T02:20:11.467259+0000","last_unstale":"2024-04-25T02:20:24.164063+0000","last_undegraded":"2024-04-25T02:20:24.164063+0000","last_fullsized":"2024-04-25T02:20:24.164063+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:08.432182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:08.432182+0000","last_clean_scrub_stamp":"2024-04-25T02:20:08.432182+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.161484+0000","last_change":"2024-04-25T02:20:23.891327+0000","last_active":"2024-04-25T02:20:24.161484+0000","last_peered":"2024-04-25T02:20:24.161484+0000","last_clean":"2024-04-25T02:20:24.161484+0000","last_became_active":"2024-04-25T02:20:23.891033+0000","last_became_peered":"2024-04-25T02:20:23.891033+0000","last_unstale":"2024-04-25T02:20:24.161484+0000","last_undegraded":"2024-04-25T02:20:24.161484+0000","last_fullsized":"2024-04-25T02:20:24.161484+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.198627+0000","last_change":"2024-04-25T02:20:24.191472+0000","last_active":"2024-04-25T02:20:24.198627+0000","last_peered":"2024-04-25T02:20:24.198627+0000","last_clean":"2024-04-25T02:20:24.198627+0000","last_became_active":"2024-04-25T02:20:24.190777+0000","last_became_peered":"2024-04-25T02:20:24.190777+0000","last_unstale":"2024-04-25T02:20:24.198627+0000","last_undegraded":"2024-04-25T02:20:24.198627+0000","last_fullsized":"2024-04-25T02:20:24.198627+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.160031+0000","last_change":"2024-04-25T02:20:15.490166+0000","last_active":"2024-04-25T02:20:24.160031+0000","last_peered":"2024-04-25T02:20:24.160031+0000","last_clean":"2024-04-25T02:20:24.160031+0000","last_became_active":"2024-04-25T02:20:15.489795+0000","last_became_peered":"2024-04-25T02:20:15.489795+0000","last_unstale":"2024-04-25T02:20:24.160031+0000","last_undegraded":"2024-04-25T02:20:24.160031+0000","last_fullsized":"2024-04-25T02:20:24.160031+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.165306+0000","last_change":"2024-04-25T02:20:23.875637+0000","last_active":"2024-04-25T02:20:25.165306+0000","last_peered":"2024-04-25T02:20:25.165306+0000","last_clean":"2024-04-25T02:20:25.165306+0000","last_became_active":"2024-04-25T02:20:23.875042+0000","last_became_peered":"2024-04-25T02:20:23.875042+0000","last_unstale":"2024-04-25T02:20:25.165306+0000","last_undegraded":"2024-04-25T02:20:25.165306+0000","last_fullsized":"2024-04-25T02:20:25.165306+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.194840+0000","last_change":"2024-04-25T02:20:24.190630+0000","last_active":"2024-04-25T02:20:24.194840+0000","last_peered":"2024-04-25T02:20:24.194840+0000","last_clean":"2024-04-25T02:20:24.194840+0000","last_became_active":"2024-04-25T02:20:24.190288+0000","last_became_peered":"2024-04-25T02:20:24.190288+0000","last_unstale":"2024-04-25T02:20:24.194840+0000","last_undegraded":"2024-04-25T02:20:24.194840+0000","last_fullsized":"2024-04-25T02:20:24.194840+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.163172+0000","last_change":"2024-04-25T02:20:15.485725+0000","last_active":"2024-04-25T02:20:24.163172+0000","last_peered":"2024-04-25T02:20:24.163172+0000","last_clean":"2024-04-25T02:20:24.163172+0000","last_became_active":"2024-04-25T02:20:15.485352+0000","last_became_peered":"2024-04-25T02:20:15.485352+0000","last_unstale":"2024-04-25T02:20:24.163172+0000","last_undegraded":"2024-04-25T02:20:24.163172+0000","last_fullsized":"2024-04-25T02:20:24.163172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.161324+0000","last_change":"2024-04-25T02:20:23.879989+0000","last_active":"2024-04-25T02:20:24.161324+0000","last_peered":"2024-04-25T02:20:24.161324+0000","last_clean":"2024-04-25T02:20:24.161324+0000","last_became_active":"2024-04-25T02:20:23.877442+0000","last_became_peered":"2024-04-25T02:20:23.877442+0000","last_unstale":"2024-04-25T02:20:24.161324+0000","last_undegraded":"2024-04-25T02:20:24.161324+0000","last_fullsized":"2024-04-25T02:20:24.161324+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.180879+0000","last_change":"2024-04-25T02:20:24.176550+0000","last_active":"2024-04-25T02:20:24.180879+0000","last_peered":"2024-04-25T02:20:24.180879+0000","last_clean":"2024-04-25T02:20:24.180879+0000","last_became_active":"2024-04-25T02:20:24.176249+0000","last_became_peered":"2024-04-25T02:20:24.176249+0000","last_unstale":"2024-04-25T02:20:24.180879+0000","last_undegraded":"2024-04-25T02:20:24.180879+0000","last_fullsized":"2024-04-25T02:20:24.180879+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.243563+0000","last_change":"2024-04-25T02:20:23.884258+0000","last_active":"2024-04-25T02:20:26.243563+0000","last_peered":"2024-04-25T02:20:26.243563+0000","last_clean":"2024-04-25T02:20:26.243563+0000","last_became_active":"2024-04-25T02:20:23.883867+0000","last_became_peered":"2024-04-25T02:20:23.883867+0000","last_unstale":"2024-04-25T02:20:26.243563+0000","last_undegraded":"2024-04-25T02:20:26.243563+0000","last_fullsized":"2024-04-25T02:20:26.243563+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.160757+0000","last_change":"2024-04-25T02:20:15.490162+0000","last_active":"2024-04-25T02:20:24.160757+0000","last_peered":"2024-04-25T02:20:24.160757+0000","last_clean":"2024-04-25T02:20:24.160757+0000","last_became_active":"2024-04-25T02:20:15.489760+0000","last_became_peered":"2024-04-25T02:20:15.489760+0000","last_unstale":"2024-04-25T02:20:24.160757+0000","last_undegraded":"2024-04-25T02:20:24.160757+0000","last_fullsized":"2024-04-25T02:20:24.160757+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.197090+0000","last_change":"2024-04-25T02:20:24.192993+0000","last_active":"2024-04-25T02:20:24.197090+0000","last_peered":"2024-04-25T02:20:24.197090+0000","last_clean":"2024-04-25T02:20:24.197090+0000","last_became_active":"2024-04-25T02:20:24.192258+0000","last_became_peered":"2024-04-25T02:20:24.192258+0000","last_unstale":"2024-04-25T02:20:24.197090+0000","last_undegraded":"2024-04-25T02:20:24.197090+0000","last_fullsized":"2024-04-25T02:20:24.197090+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.169672+0000","last_change":"2024-04-25T02:20:15.488540+0000","last_active":"2024-04-25T02:20:24.169672+0000","last_peered":"2024-04-25T02:20:24.169672+0000","last_clean":"2024-04-25T02:20:24.169672+0000","last_became_active":"2024-04-25T02:20:15.488148+0000","last_became_peered":"2024-04-25T02:20:15.488148+0000","last_unstale":"2024-04-25T02:20:24.169672+0000","last_undegraded":"2024-04-25T02:20:24.169672+0000","last_fullsized":"2024-04-25T02:20:24.169672+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.165485+0000","last_change":"2024-04-25T02:20:23.882042+0000","last_active":"2024-04-25T02:20:25.165485+0000","last_peered":"2024-04-25T02:20:25.165485+0000","last_clean":"2024-04-25T02:20:25.165485+0000","last_became_active":"2024-04-25T02:20:23.881660+0000","last_became_peered":"2024-04-25T02:20:23.881660+0000","last_unstale":"2024-04-25T02:20:25.165485+0000","last_undegraded":"2024-04-25T02:20:25.165485+0000","last_fullsized":"2024-04-25T02:20:25.165485+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.193640+0000","last_change":"2024-04-25T02:20:24.188573+0000","last_active":"2024-04-25T02:20:24.193640+0000","last_peered":"2024-04-25T02:20:24.193640+0000","last_clean":"2024-04-25T02:20:24.193640+0000","last_became_active":"2024-04-25T02:20:24.188251+0000","last_became_peered":"2024-04-25T02:20:24.188251+0000","last_unstale":"2024-04-25T02:20:24.193640+0000","last_undegraded":"2024-04-25T02:20:24.193640+0000","last_fullsized":"2024-04-25T02:20:24.193640+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'5","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.248784+0000","last_change":"2024-04-25T02:20:23.883575+0000","last_active":"2024-04-25T02:20:26.248784+0000","last_peered":"2024-04-25T02:20:26.248784+0000","last_clean":"2024-04-25T02:20:26.248784+0000","last_became_active":"2024-04-25T02:20:23.883144+0000","last_became_peered":"2024-04-25T02:20:23.883144+0000","last_unstale":"2024-04-25T02:20:26.248784+0000","last_undegraded":"2024-04-25T02:20:26.248784+0000","last_fullsized":"2024-04-25T02:20:26.248784+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.185264+0000","last_change":"2024-04-25T02:20:24.170678+0000","last_active":"2024-04-25T02:20:24.185264+0000","last_peered":"2024-04-25T02:20:24.185264+0000","last_clean":"2024-04-25T02:20:24.185264+0000","last_became_active":"2024-04-25T02:20:24.170488+0000","last_became_peered":"2024-04-25T02:20:24.170488+0000","last_unstale":"2024-04-25T02:20:24.185264+0000","last_undegraded":"2024-04-25T02:20:24.185264+0000","last_fullsized":"2024-04-25T02:20:24.185264+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.179405+0000","last_change":"2024-04-25T02:20:23.881809+0000","last_active":"2024-04-25T02:20:24.179405+0000","last_peered":"2024-04-25T02:20:24.179405+0000","last_clean":"2024-04-25T02:20:24.179405+0000","last_became_active":"2024-04-25T02:20:23.878991+0000","last_became_peered":"2024-04-25T02:20:23.878991+0000","last_unstale":"2024-04-25T02:20:24.179405+0000","last_undegraded":"2024-04-25T02:20:24.179405+0000","last_fullsized":"2024-04-25T02:20:24.179405+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.201609+0000","last_change":"2024-04-25T02:20:24.197009+0000","last_active":"2024-04-25T02:20:24.201609+0000","last_peered":"2024-04-25T02:20:24.201609+0000","last_clean":"2024-04-25T02:20:24.201609+0000","last_became_active":"2024-04-25T02:20:24.196535+0000","last_became_peered":"2024-04-25T02:20:24.196535+0000","last_unstale":"2024-04-25T02:20:24.201609+0000","last_undegraded":"2024-04-25T02:20:24.201609+0000","last_fullsized":"2024-04-25T02:20:24.201609+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.199642+0000","last_change":"2024-04-25T02:20:23.888031+0000","last_active":"2024-04-25T02:20:24.199642+0000","last_peered":"2024-04-25T02:20:24.199642+0000","last_clean":"2024-04-25T02:20:24.199642+0000","last_became_active":"2024-04-25T02:20:23.887730+0000","last_became_peered":"2024-04-25T02:20:23.887730+0000","last_unstale":"2024-04-25T02:20:24.199642+0000","last_undegraded":"2024-04-25T02:20:24.199642+0000","last_fullsized":"2024-04-25T02:20:24.199642+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.193693+0000","last_change":"2024-04-25T02:20:24.188502+0000","last_active":"2024-04-25T02:20:24.193693+0000","last_peered":"2024-04-25T02:20:24.193693+0000","last_clean":"2024-04-25T02:20:24.193693+0000","last_became_active":"2024-04-25T02:20:24.188102+0000","last_became_peered":"2024-04-25T02:20:24.188102+0000","last_unstale":"2024-04-25T02:20:24.193693+0000","last_undegraded":"2024-04-25T02:20:24.193693+0000","last_fullsized":"2024-04-25T02:20:24.193693+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.190792+0000","last_change":"2024-04-25T02:20:23.890367+0000","last_active":"2024-04-25T02:20:24.190792+0000","last_peered":"2024-04-25T02:20:24.190792+0000","last_clean":"2024-04-25T02:20:24.190792+0000","last_became_active":"2024-04-25T02:20:23.889958+0000","last_became_peered":"2024-04-25T02:20:23.889958+0000","last_unstale":"2024-04-25T02:20:24.190792+0000","last_undegraded":"2024-04-25T02:20:24.190792+0000","last_fullsized":"2024-04-25T02:20:24.190792+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.198626+0000","last_change":"2024-04-25T02:20:24.194271+0000","last_active":"2024-04-25T02:20:24.198626+0000","last_peered":"2024-04-25T02:20:24.198626+0000","last_clean":"2024-04-25T02:20:24.198626+0000","last_became_active":"2024-04-25T02:20:24.193729+0000","last_became_peered":"2024-04-25T02:20:24.193729+0000","last_unstale":"2024-04-25T02:20:24.198626+0000","last_undegraded":"2024-04-25T02:20:24.198626+0000","last_fullsized":"2024-04-25T02:20:24.198626+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.187833+0000","last_change":"2024-04-25T02:20:23.882173+0000","last_active":"2024-04-25T02:20:24.187833+0000","last_peered":"2024-04-25T02:20:24.187833+0000","last_clean":"2024-04-25T02:20:24.187833+0000","last_became_active":"2024-04-25T02:20:23.881840+0000","last_became_peered":"2024-04-25T02:20:23.881840+0000","last_unstale":"2024-04-25T02:20:24.187833+0000","last_undegraded":"2024-04-25T02:20:24.187833+0000","last_fullsized":"2024-04-25T02:20:24.187833+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":553,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.185324+0000","last_change":"2024-04-25T02:20:24.171268+0000","last_active":"2024-04-25T02:20:24.185324+0000","last_peered":"2024-04-25T02:20:24.185324+0000","last_clean":"2024-04-25T02:20:24.185324+0000","last_became_active":"2024-04-25T02:20:24.170957+0000","last_became_peered":"2024-04-25T02:20:24.170957+0000","last_unstale":"2024-04-25T02:20:24.185324+0000","last_undegraded":"2024-04-25T02:20:24.185324+0000","last_fullsized":"2024-04-25T02:20:24.185324+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.178516+0000","last_change":"2024-04-25T02:20:24.167991+0000","last_active":"2024-04-25T02:20:24.178516+0000","last_peered":"2024-04-25T02:20:24.178516+0000","last_clean":"2024-04-25T02:20:24.178516+0000","last_became_active":"2024-04-25T02:20:24.167659+0000","last_became_peered":"2024-04-25T02:20:24.167659+0000","last_unstale":"2024-04-25T02:20:24.178516+0000","last_undegraded":"2024-04-25T02:20:24.178516+0000","last_fullsized":"2024-04-25T02:20:24.178516+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.198601+0000","last_change":"2024-04-25T02:20:24.194043+0000","last_active":"2024-04-25T02:20:24.198601+0000","last_peered":"2024-04-25T02:20:24.198601+0000","last_clean":"2024-04-25T02:20:24.198601+0000","last_became_active":"2024-04-25T02:20:24.193386+0000","last_became_peered":"2024-04-25T02:20:24.193386+0000","last_unstale":"2024-04-25T02:20:24.198601+0000","last_undegraded":"2024-04-25T02:20:24.198601+0000","last_fullsized":"2024-04-25T02:20:24.198601+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.193815+0000","last_change":"2024-04-25T02:20:24.189262+0000","last_active":"2024-04-25T02:20:24.193815+0000","last_peered":"2024-04-25T02:20:24.193815+0000","last_clean":"2024-04-25T02:20:24.193815+0000","last_became_active":"2024-04-25T02:20:24.188938+0000","last_became_peered":"2024-04-25T02:20:24.188938+0000","last_unstale":"2024-04-25T02:20:24.193815+0000","last_undegraded":"2024-04-25T02:20:24.193815+0000","last_fullsized":"2024-04-25T02:20:24.193815+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.194151+0000","last_change":"2024-04-25T02:20:24.189965+0000","last_active":"2024-04-25T02:20:24.194151+0000","last_peered":"2024-04-25T02:20:24.194151+0000","last_clean":"2024-04-25T02:20:24.194151+0000","last_became_active":"2024-04-25T02:20:24.189042+0000","last_became_peered":"2024-04-25T02:20:24.189042+0000","last_unstale":"2024-04-25T02:20:24.194151+0000","last_undegraded":"2024-04-25T02:20:24.194151+0000","last_fullsized":"2024-04-25T02:20:24.194151+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.179008+0000","last_change":"2024-04-25T02:20:24.172462+0000","last_active":"2024-04-25T02:20:24.179008+0000","last_peered":"2024-04-25T02:20:24.179008+0000","last_clean":"2024-04-25T02:20:24.179008+0000","last_became_active":"2024-04-25T02:20:24.171736+0000","last_became_peered":"2024-04-25T02:20:24.171736+0000","last_unstale":"2024-04-25T02:20:24.179008+0000","last_undegraded":"2024-04-25T02:20:24.179008+0000","last_fullsized":"2024-04-25T02:20:24.179008+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3633,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":7266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73,"ondisk_log_size":73,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705668,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048784,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323056,"statfs":{"total":96636764160,"available":95562809344,"internally_reserved":1073741824,"allocated":204800,"data_stored":53906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.218}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25800000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26600000000000001}]}]},{"osd":2,"up_from":9,"seq":38654705670,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":52495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.224}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26900000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705668,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048752,"kb_used_data":168,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323088,"statfs":{"total":96636764160,"available":95562842112,"internally_reserved":1073741824,"allocated":172032,"data_stored":51547,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]}]},{"osd":1,"up_from":9,"seq":38654705669,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048748,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323092,"statfs":{"total":96636764160,"available":95562846208,"internally_reserved":1073741824,"allocated":167936,"data_stored":51493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.248}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23799999999999999}]}]}]}} 2024-04-25T02:20:28.284 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-25T02:20:28.284 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-25T02:20:28.284 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-25T02:20:28.285 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-25T02:20:28.285 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-25T02:20:28.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.418+0000 7f1e9c5d5700 1 Processor -- start 2024-04-25T02:20:28.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.419+0000 7f1e9c5d5700 1 -- start start 2024-04-25T02:20:28.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.419+0000 7f1e9c5d5700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1e94138120 0x7f1e941349e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:28.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.419+0000 7f1e9c5d5700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f1e940657d0 0x7f1e94133ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:28.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.419+0000 7f1e9c5d5700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e941343c0 con 0x7f1e94137d40 2024-04-25T02:20:28.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.419+0000 7f1e9c5d5700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e940684b0 con 0x7f1e940657d0 2024-04-25T02:20:28.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.419+0000 7f1e9c5d5700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e94137880 con 0x7f1e94138120 2024-04-25T02:20:28.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.419+0000 7f1e9a371700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f1e94137d40 0x7f1e9409a9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:44288/0 (socket says 172.21.15.111:44288) 2024-04-25T02:20:28.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.419+0000 7f1e99b70700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1e94138120 0x7f1e941349e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:28.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.419+0000 7f1e9a371700 1 -- 172.21.15.111:0/3190677047 learned_addr learned my addr 172.21.15.111:0/3190677047 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:20:28.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.419+0000 7f1e9ab72700 1 --2- 172.21.15.111:0/3190677047 >> v2:172.21.15.111:3300/0 conn(0x7f1e940657d0 0x7f1e94133ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:28.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.420+0000 7f1e9936f700 1 -- 172.21.15.111:0/3190677047 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4213309232 0 0) 0x7f1e941343c0 con 0x7f1e94137d40 2024-04-25T02:20:28.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.420+0000 7f1e9936f700 1 -- 172.21.15.111:0/3190677047 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1e7c003260 con 0x7f1e94137d40 2024-04-25T02:20:28.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.420+0000 7f1e99b70700 1 -- 172.21.15.111:0/3190677047 >> v2:172.21.15.111:3300/0 conn(0x7f1e940657d0 msgr2=0x7f1e94133ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:28.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.420+0000 7f1e99b70700 1 --2- 172.21.15.111:0/3190677047 >> v2:172.21.15.111:3300/0 conn(0x7f1e940657d0 0x7f1e94133ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:28.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.420+0000 7f1e99b70700 1 -- 172.21.15.111:0/3190677047 >> v1:172.21.15.111:6789/0 conn(0x7f1e94137d40 legacy=0x7f1e9409a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:28.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.420+0000 7f1e99b70700 1 -- 172.21.15.111:0/3190677047 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e94137b20 con 0x7f1e94138120 2024-04-25T02:20:28.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.420+0000 7f1e9ab72700 1 --2- 172.21.15.111:0/3190677047 >> v2:172.21.15.111:3300/0 conn(0x7f1e940657d0 0x7f1e94133ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:28.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.420+0000 7f1e99b70700 1 --2- 172.21.15.111:0/3190677047 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1e94138120 0x7f1e941349e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f1e90002f70 tx=0x7f1e90006df0).ready entity=mon.2 client_cookie=9a12c9faa6cc3d24 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:28.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.420+0000 7f1e9936f700 1 -- 172.21.15.111:0/3190677047 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e9000d4a0 con 0x7f1e94138120 2024-04-25T02:20:28.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.420+0000 7f1e9936f700 1 -- 172.21.15.111:0/3190677047 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e90000e90 con 0x7f1e94138120 2024-04-25T02:20:28.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.420+0000 7f1e9936f700 1 -- 172.21.15.111:0/3190677047 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e9000d7f0 con 0x7f1e94138120 2024-04-25T02:20:28.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.420+0000 7f1e9c5d5700 1 -- 172.21.15.111:0/3190677047 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1e94138120 msgr2=0x7f1e941349e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:28.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.420+0000 7f1e9c5d5700 1 --2- 172.21.15.111:0/3190677047 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1e94138120 0x7f1e941349e0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f1e90002f70 tx=0x7f1e90006df0).stop 2024-04-25T02:20:28.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.421+0000 7f1e9c5d5700 1 -- 172.21.15.111:0/3190677047 shutdown_connections 2024-04-25T02:20:28.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.421+0000 7f1e9c5d5700 1 --2- 172.21.15.111:0/3190677047 >> v2:172.21.15.111:3300/0 conn(0x7f1e940657d0 0x7f1e94133ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:28.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.421+0000 7f1e9c5d5700 1 --2- 172.21.15.111:0/3190677047 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1e94138120 0x7f1e941349e0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:28.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.421+0000 7f1e9c5d5700 1 -- 172.21.15.111:0/3190677047 >> 172.21.15.111:0/3190677047 conn(0x7f1e9405d070 msgr2=0x7f1e940625e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:28.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.421+0000 7f1e9c5d5700 1 -- 172.21.15.111:0/3190677047 shutdown_connections 2024-04-25T02:20:28.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.421+0000 7f1e9c5d5700 1 -- 172.21.15.111:0/3190677047 wait complete. 2024-04-25T02:20:28.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.421+0000 7f1e9c5d5700 1 Processor -- start 2024-04-25T02:20:28.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.421+0000 7f1e9c5d5700 1 -- start start 2024-04-25T02:20:28.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.422+0000 7f1e9c5d5700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1e940657d0 0x7f1e9405fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:28.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.422+0000 7f1e9c5d5700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1e94137d40 0x7f1e94060270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:28.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.422+0000 7f1e9c5d5700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1e94138120 0x7f1e94060760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:28.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.422+0000 7f1e9c5d5700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e94060c50 con 0x7f1e94137d40 2024-04-25T02:20:28.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.422+0000 7f1e9c5d5700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e94061040 con 0x7f1e94138120 2024-04-25T02:20:28.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.422+0000 7f1e9c5d5700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1e940964c0 con 0x7f1e940657d0 2024-04-25T02:20:28.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.422+0000 7f1e9a371700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1e940657d0 0x7f1e9405fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:28.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.422+0000 7f1e99b70700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1e94137d40 0x7f1e94060270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:28.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.422+0000 7f1e9ab72700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1e94138120 0x7f1e94060760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:28.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.422+0000 7f1e9a371700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1e940657d0 0x7f1e9405fd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:60214/0 (socket says 172.21.15.111:60214) 2024-04-25T02:20:28.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.422+0000 7f1e9a371700 1 -- 172.21.15.111:0/2354309703 learned_addr learned my addr 172.21.15.111:0/2354309703 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:28.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.422+0000 7f1e99b70700 1 -- 172.21.15.111:0/2354309703 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1e940657d0 msgr2=0x7f1e9405fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:28.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.422+0000 7f1e99b70700 1 --2- 172.21.15.111:0/2354309703 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1e940657d0 0x7f1e9405fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:28.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.422+0000 7f1e99b70700 1 -- 172.21.15.111:0/2354309703 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1e94138120 msgr2=0x7f1e94060760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:28.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.422+0000 7f1e99b70700 1 --2- 172.21.15.111:0/2354309703 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1e94138120 0x7f1e94060760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:28.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.422+0000 7f1e99b70700 1 -- 172.21.15.111:0/2354309703 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e8c009470 con 0x7f1e94137d40 2024-04-25T02:20:28.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.422+0000 7f1e9a371700 1 --2- 172.21.15.111:0/2354309703 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1e940657d0 0x7f1e9405fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:28.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.422+0000 7f1e9ab72700 1 --2- 172.21.15.111:0/2354309703 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1e94138120 0x7f1e94060760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:28.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.423+0000 7f1e99b70700 1 --2- 172.21.15.111:0/2354309703 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1e94137d40 0x7f1e94060270 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f1e90002f70 tx=0x7f1e90014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:28.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.423+0000 7f1e837fe700 1 -- 172.21.15.111:0/2354309703 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e90013ac0 con 0x7f1e94137d40 2024-04-25T02:20:28.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.423+0000 7f1e837fe700 1 -- 172.21.15.111:0/2354309703 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e90013c20 con 0x7f1e94137d40 2024-04-25T02:20:28.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.423+0000 7f1e9c5d5700 1 -- 172.21.15.111:0/2354309703 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e9000b180 con 0x7f1e94137d40 2024-04-25T02:20:28.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.423+0000 7f1e837fe700 1 -- 172.21.15.111:0/2354309703 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1e9001e400 con 0x7f1e94137d40 2024-04-25T02:20:28.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.423+0000 7f1e9c5d5700 1 -- 172.21.15.111:0/2354309703 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e94061510 con 0x7f1e94137d40 2024-04-25T02:20:28.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.424+0000 7f1e837fe700 1 -- 172.21.15.111:0/2354309703 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f1e9001c070 con 0x7f1e94137d40 2024-04-25T02:20:28.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.424+0000 7f1e837fe700 1 -- 172.21.15.111:0/2354309703 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f1e9004b310 con 0x7f1e94137d40 2024-04-25T02:20:28.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.424+0000 7f1e9c5d5700 1 -- 172.21.15.111:0/2354309703 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e94096600 con 0x7f1e94137d40 2024-04-25T02:20:28.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.427+0000 7f1e837fe700 1 -- 172.21.15.111:0/2354309703 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f1e90023070 con 0x7f1e94137d40 2024-04-25T02:20:28.560 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.556+0000 7f1e9c5d5700 1 -- 172.21.15.111:0/2354309703 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f1e94137460 con 0x7f1e94137d40 2024-04-25T02:20:28.562 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.558+0000 7f1e837fe700 1 -- 172.21.15.111:0/2354309703 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+84884 (secure 0 0 0) 0x7f1e90023070 con 0x7f1e94137d40 2024-04-25T02:20:28.563 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:20:28.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.559+0000 7f1e9c5d5700 1 -- 172.21.15.111:0/2354309703 >> v1:172.21.15.111:6816/39585 conn(0x7f1e74038da0 legacy=0x7f1e7403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:28.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.559+0000 7f1e9c5d5700 1 -- 172.21.15.111:0/2354309703 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1e94137d40 msgr2=0x7f1e94060270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:28.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.559+0000 7f1e9c5d5700 1 --2- 172.21.15.111:0/2354309703 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1e94137d40 0x7f1e94060270 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f1e90002f70 tx=0x7f1e90014000).stop 2024-04-25T02:20:28.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.559+0000 7f1e9c5d5700 1 -- 172.21.15.111:0/2354309703 shutdown_connections 2024-04-25T02:20:28.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.559+0000 7f1e9c5d5700 1 --2- 172.21.15.111:0/2354309703 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1e94138120 0x7f1e94060760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:28.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.559+0000 7f1e9c5d5700 1 --2- 172.21.15.111:0/2354309703 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1e940657d0 0x7f1e9405fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:28.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.559+0000 7f1e9c5d5700 1 --2- 172.21.15.111:0/2354309703 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1e94137d40 0x7f1e94060270 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:28.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.559+0000 7f1e9c5d5700 1 -- 172.21.15.111:0/2354309703 >> 172.21.15.111:0/2354309703 conn(0x7f1e9405d070 msgr2=0x7f1e9406c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:28.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.559+0000 7f1e9c5d5700 1 -- 172.21.15.111:0/2354309703 shutdown_connections 2024-04-25T02:20:28.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.559+0000 7f1e9c5d5700 1 -- 172.21.15.111:0/2354309703 wait complete. 2024-04-25T02:20:28.573 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":5,"active_gid":4099,"active_name":"y","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6816","nonce":39585}]},"active_addr":"172.21.15.111:6816/39585","active_change":"2024-04-25T02:20:07.430202+0000","active_mgr_features":4540138292840890367,"available":true,"standbys":[{"gid":4113,"name":"x","mgr_features":4540138292840890367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":0,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.111:0","nonce":1276843622}]},{"addrvec":[{"type":"v2","addr":"172.21.15.111:0","nonce":2148931273}]},{"addrvec":[{"type":"v2","addr":"172.21.15.111:0","nonce":3911588907}]}]}} 2024-04-25T02:20:28.575 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-25T02:20:28.575 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-25T02:20:28.575 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:20:28.678 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.673+0000 7f2250bce700 1 Processor -- start 2024-04-25T02:20:28.678 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.674+0000 7f2250bce700 1 -- start start 2024-04-25T02:20:28.680 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.674+0000 7f2250bce700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f224c05c020 0x7f224c061c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:28.680 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.674+0000 7f2250bce700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f224c05c400 0x7f224c0a6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:28.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.674+0000 7f2250bce700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f224c062130 con 0x7f224c0a7060 2024-04-25T02:20:28.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.674+0000 7f2250bce700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f224c0a7500 con 0x7f224c05c020 2024-04-25T02:20:28.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.674+0000 7f2250bce700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f224c067f10 con 0x7f224c05c400 2024-04-25T02:20:28.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.674+0000 7f2249d9b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f224c05c400 0x7f224c0a6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:28.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.674+0000 7f224ad9d700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f224c0a7060 0x7f224c1376c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:44292/0 (socket says 172.21.15.111:44292) 2024-04-25T02:20:28.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.674+0000 7f224ad9d700 1 -- 172.21.15.111:0/3781586551 learned_addr learned my addr 172.21.15.111:0/3781586551 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:20:28.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.674+0000 7f224a59c700 1 --2- 172.21.15.111:0/3781586551 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f224c05c020 0x7f224c061c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:28.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.675+0000 7f224a59c700 1 -- 172.21.15.111:0/3781586551 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f224c05c400 msgr2=0x7f224c0a6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:28.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.675+0000 7f224a59c700 1 --2- 172.21.15.111:0/3781586551 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f224c05c400 0x7f224c0a6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:28.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.675+0000 7f224a59c700 1 -- 172.21.15.111:0/3781586551 >> v1:172.21.15.111:6789/0 conn(0x7f224c0a7060 legacy=0x7f224c1376c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:28.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.675+0000 7f224a59c700 1 -- 172.21.15.111:0/3781586551 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f224c05bbd0 con 0x7f224c05c020 2024-04-25T02:20:28.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.675+0000 7f224959a700 1 -- 172.21.15.111:0/3781586551 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3299964065 0 0) 0x7f224c062130 con 0x7f224c0a7060 2024-04-25T02:20:28.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.675+0000 7f2249d9b700 1 --2- 172.21.15.111:0/3781586551 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f224c05c400 0x7f224c0a6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:28.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.675+0000 7f224a59c700 1 --2- 172.21.15.111:0/3781586551 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f224c05c020 0x7f224c061c40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f224c061b90 tx=0x7f2240006df0).ready entity=mon.1 client_cookie=6a7054b5bfd31263 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:28.681 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.675+0000 7f224959a700 1 -- 172.21.15.111:0/3781586551 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f224000d570 con 0x7f224c05c020 2024-04-25T02:20:28.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.675+0000 7f224959a700 1 -- 172.21.15.111:0/3781586551 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2240000e90 con 0x7f224c05c020 2024-04-25T02:20:28.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.675+0000 7f224959a700 1 -- 172.21.15.111:0/3781586551 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f224000d8c0 con 0x7f224c05c020 2024-04-25T02:20:28.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.675+0000 7f2250bce700 1 -- 172.21.15.111:0/3781586551 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f224c05c020 msgr2=0x7f224c061c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:28.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.675+0000 7f2250bce700 1 --2- 172.21.15.111:0/3781586551 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f224c05c020 0x7f224c061c40 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f224c061b90 tx=0x7f2240006df0).stop 2024-04-25T02:20:28.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.675+0000 7f2250bce700 1 -- 172.21.15.111:0/3781586551 shutdown_connections 2024-04-25T02:20:28.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.675+0000 7f2250bce700 1 --2- 172.21.15.111:0/3781586551 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f224c05c020 0x7f224c061c40 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:28.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.675+0000 7f2250bce700 1 --2- 172.21.15.111:0/3781586551 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f224c05c400 0x7f224c0a6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:28.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.675+0000 7f2250bce700 1 -- 172.21.15.111:0/3781586551 >> 172.21.15.111:0/3781586551 conn(0x7f224c0a8a00 msgr2=0x7f224c0a8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:28.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.675+0000 7f2250bce700 1 -- 172.21.15.111:0/3781586551 shutdown_connections 2024-04-25T02:20:28.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.676+0000 7f2250bce700 1 -- 172.21.15.111:0/3781586551 wait complete. 2024-04-25T02:20:28.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.676+0000 7f2250bce700 1 Processor -- start 2024-04-25T02:20:28.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.676+0000 7f2250bce700 1 -- start start 2024-04-25T02:20:28.685 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.677+0000 7f2250bce700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f224c05c020 0x7f224c066ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:28.685 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.677+0000 7f2250bce700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f224c05c400 0x7f224c143f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:28.685 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.677+0000 7f2250bce700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f224c0a7060 0x7f224c1443f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:28.685 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.677+0000 7f2250bce700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f224c1448e0 con 0x7f224c05c020 2024-04-25T02:20:28.685 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.677+0000 7f2250bce700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f224c0920b0 con 0x7f224c0a7060 2024-04-25T02:20:28.685 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.677+0000 7f2250bce700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f224c064e40 con 0x7f224c05c400 2024-04-25T02:20:28.685 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.677+0000 7f224a59c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f224c05c020 0x7f224c066ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:28.685 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.677+0000 7f2249d9b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f224c05c400 0x7f224c143f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:28.685 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.677+0000 7f2249d9b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f224c05c400 0x7f224c143f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:60234/0 (socket says 172.21.15.111:60234) 2024-04-25T02:20:28.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.677+0000 7f2249d9b700 1 -- 172.21.15.111:0/979610081 learned_addr learned my addr 172.21.15.111:0/979610081 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:28.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.677+0000 7f224a59c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f224c05c020 0x7f224c066ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:39664/0 (socket says 172.21.15.111:39664) 2024-04-25T02:20:28.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.677+0000 7f224ad9d700 1 --2- 172.21.15.111:0/979610081 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f224c0a7060 0x7f224c1443f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:28.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.677+0000 7f2249d9b700 1 -- 172.21.15.111:0/979610081 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f224c0a7060 msgr2=0x7f224c1443f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:28.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.677+0000 7f2249d9b700 1 --2- 172.21.15.111:0/979610081 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f224c0a7060 0x7f224c1443f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:28.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.677+0000 7f2249d9b700 1 -- 172.21.15.111:0/979610081 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f224c05c020 msgr2=0x7f224c066ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:28.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.677+0000 7f2249d9b700 1 --2- 172.21.15.111:0/979610081 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f224c05c020 0x7f224c066ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:28.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.677+0000 7f2249d9b700 1 -- 172.21.15.111:0/979610081 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f223c00b180 con 0x7f224c05c400 2024-04-25T02:20:28.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.677+0000 7f224ad9d700 1 --2- 172.21.15.111:0/979610081 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f224c0a7060 0x7f224c1443f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:20:28.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.677+0000 7f224a59c700 1 --2- 172.21.15.111:0/979610081 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f224c05c020 0x7f224c066ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:28.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.677+0000 7f2249d9b700 1 --2- 172.21.15.111:0/979610081 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f224c05c400 0x7f224c143f00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f224c144a20 tx=0x7f223c006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:28.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.678+0000 7f223b7fe700 1 -- 172.21.15.111:0/979610081 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f223c00c890 con 0x7f224c05c400 2024-04-25T02:20:28.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.678+0000 7f223b7fe700 1 -- 172.21.15.111:0/979610081 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f223c00c9f0 con 0x7f224c05c400 2024-04-25T02:20:28.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.678+0000 7f2250bce700 1 -- 172.21.15.111:0/979610081 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f224000b180 con 0x7f224c05c400 2024-04-25T02:20:28.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.678+0000 7f223b7fe700 1 -- 172.21.15.111:0/979610081 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f223c00cd50 con 0x7f224c05c400 2024-04-25T02:20:28.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.678+0000 7f2250bce700 1 -- 172.21.15.111:0/979610081 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f224c143c40 con 0x7f224c05c400 2024-04-25T02:20:28.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.678+0000 7f223b7fe700 1 -- 172.21.15.111:0/979610081 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f223c01c460 con 0x7f224c05c400 2024-04-25T02:20:28.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.679+0000 7f223b7fe700 1 -- 172.21.15.111:0/979610081 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f223c04aee0 con 0x7f224c05c400 2024-04-25T02:20:28.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.679+0000 7f2250bce700 1 -- 172.21.15.111:0/979610081 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f224c0921f0 con 0x7f224c05c400 2024-04-25T02:20:28.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.682+0000 7f223b7fe700 1 -- 172.21.15.111:0/979610081 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f223c0303d0 con 0x7f224c05c400 2024-04-25T02:20:28.796 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.792+0000 7f2250bce700 1 -- 172.21.15.111:0/979610081 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f224c057a60 con 0x7f224c05c400 2024-04-25T02:20:28.796 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.792+0000 7f223b7fe700 1 -- 172.21.15.111:0/979610081 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+10564 (secure 0 0 0) 0x7f223c02b090 con 0x7f224c05c400 2024-04-25T02:20:28.796 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:20:28.797 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":18,"fsid":"4643f974-f93a-4436-93b8-460ff320e62e","created":"2024-04-25T02:20:05.450475+0000","modified":"2024-04-25T02:20:25.151994+0000","last_up_change":"2024-04-25T02:20:10.439204+0000","last_in_change":"2024-04-25T02:20:10.439204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-25T02:20:07.471248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:20:14.420378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:20:22.251868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T02:20:23.128289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"df3f17ca-3b12-42c8-8cf7-8f1b7189e587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6800","nonce":40214}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6801","nonce":40214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6803","nonce":40214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6802","nonce":40214}]},"public_addr":"172.21.15.111:6800/40214","cluster_addr":"172.21.15.111:6801/40214","heartbeat_back_addr":"172.21.15.111:6803/40214","heartbeat_front_addr":"172.21.15.111:6802/40214","state":["exists","up"]},{"osd":1,"uuid":"93d54815-f215-4285-bba6-32f2d1cabf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6812","nonce":40216}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6813","nonce":40216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6815","nonce":40216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6814","nonce":40216}]},"public_addr":"172.21.15.111:6812/40216","cluster_addr":"172.21.15.111:6813/40216","heartbeat_back_addr":"172.21.15.111:6815/40216","heartbeat_front_addr":"172.21.15.111:6814/40216","state":["exists","up"]},{"osd":2,"uuid":"b26b2104-2a2e-408f-9ce7-3587a32a2ebe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6804","nonce":40215}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6805","nonce":40215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6807","nonce":40215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6806","nonce":40215}]},"public_addr":"172.21.15.111:6804/40215","cluster_addr":"172.21.15.111:6805/40215","heartbeat_back_addr":"172.21.15.111:6807/40215","heartbeat_front_addr":"172.21.15.111:6806/40215","state":["exists","up"]},{"osd":3,"uuid":"43c25820-1edc-4031-badf-72e87dd6bf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6808","nonce":40213}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6809","nonce":40213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6811","nonce":40213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6810","nonce":40213}]},"public_addr":"172.21.15.111:6808/40213","cluster_addr":"172.21.15.111:6809/40213","heartbeat_back_addr":"172.21.15.111:6811/40213","heartbeat_front_addr":"172.21.15.111:6810/40213","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.372427+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.411480+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.361508+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.377212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-25T02:20:28.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.794+0000 7f2250bce700 1 -- 172.21.15.111:0/979610081 >> v1:172.21.15.111:6816/39585 conn(0x7f2228038da0 legacy=0x7f222803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:28.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.794+0000 7f2250bce700 1 -- 172.21.15.111:0/979610081 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f224c05c400 msgr2=0x7f224c143f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:28.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.794+0000 7f2250bce700 1 --2- 172.21.15.111:0/979610081 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f224c05c400 0x7f224c143f00 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f224c144a20 tx=0x7f223c006df0).stop 2024-04-25T02:20:28.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.794+0000 7f2250bce700 1 -- 172.21.15.111:0/979610081 shutdown_connections 2024-04-25T02:20:28.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.794+0000 7f2250bce700 1 --2- 172.21.15.111:0/979610081 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f224c0a7060 0x7f224c1443f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:28.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.794+0000 7f2250bce700 1 --2- 172.21.15.111:0/979610081 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f224c05c020 0x7f224c066ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:28.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.794+0000 7f2250bce700 1 --2- 172.21.15.111:0/979610081 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f224c05c400 0x7f224c143f00 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:28.799 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.794+0000 7f2250bce700 1 -- 172.21.15.111:0/979610081 >> 172.21.15.111:0/979610081 conn(0x7f224c0a8a00 msgr2=0x7f224c0a2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:28.799 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.794+0000 7f2250bce700 1 -- 172.21.15.111:0/979610081 shutdown_connections 2024-04-25T02:20:28.799 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.794+0000 7f2250bce700 1 -- 172.21.15.111:0/979610081 wait complete. 2024-04-25T02:20:28.808 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-25T02:20:28.808 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:20:28.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.906+0000 7fb03d03c700 1 Processor -- start 2024-04-25T02:20:28.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.906+0000 7fb03d03c700 1 -- start start 2024-04-25T02:20:28.915 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.907+0000 7fb03d03c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb038067c20 0x7fb038067040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:28.915 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.907+0000 7fb03d03c700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fb038066170 0x7fb03805c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:28.915 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.907+0000 7fb03d03c700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb038065c90 con 0x7fb03805c1a0 2024-04-25T02:20:28.915 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.907+0000 7fb03d03c700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb03805ca70 con 0x7fb038066170 2024-04-25T02:20:28.916 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.907+0000 7fb03d03c700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb038067680 con 0x7fb038067c20 2024-04-25T02:20:28.916 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.907+0000 7fb03659c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb038067c20 0x7fb038067040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:28.916 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.907+0000 7fb03759e700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fb038066170 0x7fb03805c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:28.916 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.907+0000 7fb036d9d700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7fb03805c1a0 0x7fb038136350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:44302/0 (socket says 172.21.15.111:44302) 2024-04-25T02:20:28.916 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.907+0000 7fb036d9d700 1 -- 172.21.15.111:0/1568581605 learned_addr learned my addr 172.21.15.111:0/1568581605 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:20:28.916 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.907+0000 7fb03759e700 1 -- 172.21.15.111:0/1568581605 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb038067c20 msgr2=0x7fb038067040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:28.916 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.907+0000 7fb03759e700 1 --2- 172.21.15.111:0/1568581605 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb038067c20 0x7fb038067040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:28.916 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.907+0000 7fb03759e700 1 -- 172.21.15.111:0/1568581605 >> v1:172.21.15.111:6789/0 conn(0x7fb03805c1a0 legacy=0x7fb038136350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:28.916 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.907+0000 7fb035d9b700 1 -- 172.21.15.111:0/1568581605 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1668176147 0 0) 0x7fb038065c90 con 0x7fb03805c1a0 2024-04-25T02:20:28.916 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.907+0000 7fb03759e700 1 -- 172.21.15.111:0/1568581605 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb03805ba50 con 0x7fb038066170 2024-04-25T02:20:28.916 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.907+0000 7fb03659c700 1 --2- 172.21.15.111:0/1568581605 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb038067c20 0x7fb038067040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:28.916 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.908+0000 7fb03759e700 1 --2- 172.21.15.111:0/1568581605 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb038066170 0x7fb03805c580 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fb0300032f0 tx=0x7fb0300091d0).ready entity=mon.0 client_cookie=c419f28e76a26255 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:28.916 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.908+0000 7fb035d9b700 1 -- 172.21.15.111:0/1568581605 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb03000b6c0 con 0x7fb038066170 2024-04-25T02:20:28.916 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.908+0000 7fb035d9b700 1 -- 172.21.15.111:0/1568581605 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03000b820 con 0x7fb038066170 2024-04-25T02:20:28.916 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.908+0000 7fb035d9b700 1 -- 172.21.15.111:0/1568581605 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb03000b990 con 0x7fb038066170 2024-04-25T02:20:28.917 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.908+0000 7fb03d03c700 1 -- 172.21.15.111:0/1568581605 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb038066170 msgr2=0x7fb03805c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:28.917 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.908+0000 7fb03d03c700 1 --2- 172.21.15.111:0/1568581605 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb038066170 0x7fb03805c580 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fb0300032f0 tx=0x7fb0300091d0).stop 2024-04-25T02:20:28.917 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.908+0000 7fb03d03c700 1 -- 172.21.15.111:0/1568581605 shutdown_connections 2024-04-25T02:20:28.917 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.908+0000 7fb03d03c700 1 --2- 172.21.15.111:0/1568581605 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb038066170 0x7fb03805c580 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:28.917 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.908+0000 7fb03d03c700 1 --2- 172.21.15.111:0/1568581605 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb038067c20 0x7fb038067040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:28.917 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.908+0000 7fb03d03c700 1 -- 172.21.15.111:0/1568581605 >> 172.21.15.111:0/1568581605 conn(0x7fb0380a8a00 msgr2=0x7fb0380a8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:28.917 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.908+0000 7fb03d03c700 1 -- 172.21.15.111:0/1568581605 shutdown_connections 2024-04-25T02:20:28.917 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.908+0000 7fb03d03c700 1 -- 172.21.15.111:0/1568581605 wait complete. 2024-04-25T02:20:28.917 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.909+0000 7fb03d03c700 1 Processor -- start 2024-04-25T02:20:28.917 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.909+0000 7fb03d03c700 1 -- start start 2024-04-25T02:20:28.917 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.910+0000 7fb03d03c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb03805c1a0 0x7fb038095320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:28.917 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.910+0000 7fb03d03c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb038066170 0x7fb038149190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:28.917 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.910+0000 7fb03d03c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb038067c20 0x7fb038149680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:28.917 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.910+0000 7fb03d03c700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb038096ff0 con 0x7fb03805c1a0 2024-04-25T02:20:28.917 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.910+0000 7fb03d03c700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb038095d10 con 0x7fb038066170 2024-04-25T02:20:28.918 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.910+0000 7fb03d03c700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb038095fd0 con 0x7fb038067c20 2024-04-25T02:20:28.918 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.910+0000 7fb03659c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb038066170 0x7fb038149190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:28.918 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.910+0000 7fb036d9d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb03805c1a0 0x7fb038095320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:28.918 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.910+0000 7fb03659c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb038066170 0x7fb038149190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:57414/0 (socket says 172.21.15.111:57414) 2024-04-25T02:20:28.918 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.910+0000 7fb03659c700 1 -- 172.21.15.111:0/1757992837 learned_addr learned my addr 172.21.15.111:0/1757992837 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:28.918 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.910+0000 7fb03759e700 1 --2- 172.21.15.111:0/1757992837 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb038067c20 0x7fb038149680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:28.918 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.910+0000 7fb03659c700 1 -- 172.21.15.111:0/1757992837 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb038067c20 msgr2=0x7fb038149680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:28.918 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.910+0000 7fb03659c700 1 --2- 172.21.15.111:0/1757992837 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb038067c20 0x7fb038149680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:28.918 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.910+0000 7fb03659c700 1 -- 172.21.15.111:0/1757992837 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb03805c1a0 msgr2=0x7fb038095320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:28.919 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.910+0000 7fb03659c700 1 --2- 172.21.15.111:0/1757992837 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb03805c1a0 0x7fb038095320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:28.919 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.910+0000 7fb03659c700 1 -- 172.21.15.111:0/1757992837 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb02800b180 con 0x7fb038066170 2024-04-25T02:20:28.919 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.910+0000 7fb03659c700 1 --2- 172.21.15.111:0/1757992837 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb038066170 0x7fb038149190 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fb02800c000 tx=0x7fb028006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:28.919 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.910+0000 7fb027fff700 1 -- 172.21.15.111:0/1757992837 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb028010780 con 0x7fb038066170 2024-04-25T02:20:28.919 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.910+0000 7fb027fff700 1 -- 172.21.15.111:0/1757992837 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0280108e0 con 0x7fb038066170 2024-04-25T02:20:28.919 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.910+0000 7fb03d03c700 1 -- 172.21.15.111:0/1757992837 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb030009470 con 0x7fb038066170 2024-04-25T02:20:28.919 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.910+0000 7fb027fff700 1 -- 172.21.15.111:0/1757992837 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb028010c40 con 0x7fb038066170 2024-04-25T02:20:28.919 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.910+0000 7fb03d03c700 1 -- 172.21.15.111:0/1757992837 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb038097c90 con 0x7fb038066170 2024-04-25T02:20:28.919 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.911+0000 7fb027fff700 1 -- 172.21.15.111:0/1757992837 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fb02801c460 con 0x7fb038066170 2024-04-25T02:20:28.919 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.911+0000 7fb03d03c700 1 -- 172.21.15.111:0/1757992837 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb038097ee0 con 0x7fb038066170 2024-04-25T02:20:28.919 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.911+0000 7fb027fff700 1 -- 172.21.15.111:0/1757992837 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fb02804ade0 con 0x7fb038066170 2024-04-25T02:20:28.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:28.914+0000 7fb027fff700 1 -- 172.21.15.111:0/1757992837 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fb028033670 con 0x7fb038066170 2024-04-25T02:20:29.029 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.025+0000 7fb03d03c700 1 -- 172.21.15.111:0/1757992837 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb03805e4b0 con 0x7fb038066170 2024-04-25T02:20:29.029 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.025+0000 7fb027fff700 1 -- 172.21.15.111:0/1757992837 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+10564 (secure 0 0 0) 0x7fb028033260 con 0x7fb038066170 2024-04-25T02:20:29.030 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:20:29.030 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":18,"fsid":"4643f974-f93a-4436-93b8-460ff320e62e","created":"2024-04-25T02:20:05.450475+0000","modified":"2024-04-25T02:20:25.151994+0000","last_up_change":"2024-04-25T02:20:10.439204+0000","last_in_change":"2024-04-25T02:20:10.439204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-25T02:20:07.471248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:20:14.420378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:20:22.251868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T02:20:23.128289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"df3f17ca-3b12-42c8-8cf7-8f1b7189e587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6800","nonce":40214}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6801","nonce":40214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6803","nonce":40214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6802","nonce":40214}]},"public_addr":"172.21.15.111:6800/40214","cluster_addr":"172.21.15.111:6801/40214","heartbeat_back_addr":"172.21.15.111:6803/40214","heartbeat_front_addr":"172.21.15.111:6802/40214","state":["exists","up"]},{"osd":1,"uuid":"93d54815-f215-4285-bba6-32f2d1cabf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6812","nonce":40216}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6813","nonce":40216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6815","nonce":40216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6814","nonce":40216}]},"public_addr":"172.21.15.111:6812/40216","cluster_addr":"172.21.15.111:6813/40216","heartbeat_back_addr":"172.21.15.111:6815/40216","heartbeat_front_addr":"172.21.15.111:6814/40216","state":["exists","up"]},{"osd":2,"uuid":"b26b2104-2a2e-408f-9ce7-3587a32a2ebe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6804","nonce":40215}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6805","nonce":40215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6807","nonce":40215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6806","nonce":40215}]},"public_addr":"172.21.15.111:6804/40215","cluster_addr":"172.21.15.111:6805/40215","heartbeat_back_addr":"172.21.15.111:6807/40215","heartbeat_front_addr":"172.21.15.111:6806/40215","state":["exists","up"]},{"osd":3,"uuid":"43c25820-1edc-4031-badf-72e87dd6bf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6808","nonce":40213}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6809","nonce":40213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6811","nonce":40213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6810","nonce":40213}]},"public_addr":"172.21.15.111:6808/40213","cluster_addr":"172.21.15.111:6809/40213","heartbeat_back_addr":"172.21.15.111:6811/40213","heartbeat_front_addr":"172.21.15.111:6810/40213","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.372427+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.411480+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.361508+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.377212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-25T02:20:29.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.027+0000 7fb03d03c700 1 -- 172.21.15.111:0/1757992837 >> v1:172.21.15.111:6816/39585 conn(0x7fb014038dd0 legacy=0x7fb01403b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:29.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.027+0000 7fb03d03c700 1 -- 172.21.15.111:0/1757992837 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb038066170 msgr2=0x7fb038149190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:29.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.027+0000 7fb03d03c700 1 --2- 172.21.15.111:0/1757992837 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb038066170 0x7fb038149190 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7fb02800c000 tx=0x7fb028006df0).stop 2024-04-25T02:20:29.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.027+0000 7fb03d03c700 1 -- 172.21.15.111:0/1757992837 shutdown_connections 2024-04-25T02:20:29.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.027+0000 7fb03d03c700 1 --2- 172.21.15.111:0/1757992837 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb038067c20 0x7fb038149680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:29.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.027+0000 7fb03d03c700 1 --2- 172.21.15.111:0/1757992837 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb03805c1a0 0x7fb038095320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:29.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.027+0000 7fb03d03c700 1 --2- 172.21.15.111:0/1757992837 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb038066170 0x7fb038149190 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:29.032 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.027+0000 7fb03d03c700 1 -- 172.21.15.111:0/1757992837 >> 172.21.15.111:0/1757992837 conn(0x7fb0380a8a00 msgr2=0x7fb03813a190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:29.032 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.027+0000 7fb03d03c700 1 -- 172.21.15.111:0/1757992837 shutdown_connections 2024-04-25T02:20:29.032 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.027+0000 7fb03d03c700 1 -- 172.21.15.111:0/1757992837 wait complete. 2024-04-25T02:20:29.041 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-25T02:20:29.042 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-25T02:20:29.042 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-25T02:20:29.043 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-25T02:20:29.153 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.149+0000 7f62b9a4a700 1 Processor -- start 2024-04-25T02:20:29.153 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.149+0000 7f650af90700 1 Processor -- start 2024-04-25T02:20:29.153 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.149+0000 7f62b9a4a700 1 -- start start 2024-04-25T02:20:29.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.149+0000 7f650af90700 1 -- start start 2024-04-25T02:20:29.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.149+0000 7f650af90700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f6504138120 0x7f65041349e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:29.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.149+0000 7f650af90700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f65040657d0 0x7f6504133ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:29.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.149+0000 7f650af90700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65041343c0 con 0x7f6504137d40 2024-04-25T02:20:29.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.149+0000 7f650af90700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65040684b0 con 0x7f6504138120 2024-04-25T02:20:29.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.149+0000 7f650af90700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6504137880 con 0x7f65040657d0 2024-04-25T02:20:29.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.149+0000 7f6503fff700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f6504138120 0x7f65041349e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:29.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.149+0000 7f6508d2c700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f6504137d40 0x7f650409a9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:44318/0 (socket says 172.21.15.111:44318) 2024-04-25T02:20:29.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.149+0000 7f6508d2c700 1 -- 172.21.15.111:0/3659373782 learned_addr learned my addr 172.21.15.111:0/3659373782 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:20:29.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.150+0000 7f62b9a4a700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f62b4139c10 0x7f62b4139ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:29.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.150+0000 7f62b9a4a700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f62b4097580 0x7f62b405ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:29.156 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.150+0000 7f6503fff700 1 -- 172.21.15.111:0/3659373782 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f65040657d0 msgr2=0x7f6504133ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:29.156 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.150+0000 7f6503fff700 1 --2- 172.21.15.111:0/3659373782 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f65040657d0 0x7f6504133ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-25T02:20:29.156 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.150+0000 7f6503fff700 1 -- 172.21.15.111:0/3659373782 >> v1:172.21.15.111:6789/0 conn(0x7f6504137d40 legacy=0x7f650409a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:29.156 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.150+0000 7f6503fff700 1 -- 172.21.15.111:0/3659373782 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6504137b20 con 0x7f6504138120 2024-04-25T02:20:29.156 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.150+0000 7f62b9a4a700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62b413a4e0 con 0x7f62b4097960 2024-04-25T02:20:29.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.150+0000 7f6503fff700 1 --2- 172.21.15.111:0/3659373782 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6504138120 0x7f65041349e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f64f0002f70 tx=0x7f64f0006df0).ready entity=mon.0 client_cookie=b70c510b370b18c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:29.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.150+0000 7f62b9a4a700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62b4099610 con 0x7f62b4139c10 2024-04-25T02:20:29.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.150+0000 7f62b9a4a700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62b4096f80 con 0x7f62b4097580 2024-04-25T02:20:29.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.150+0000 7f62b2ffd700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f62b4139c10 0x7f62b4139ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:29.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.150+0000 7f62b2ffd700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f62b4139c10 0x7f62b4139ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:39708/0 (socket says 172.21.15.111:39708) 2024-04-25T02:20:29.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.150+0000 7f62b2ffd700 1 -- 172.21.15.111:0/1912087939 learned_addr learned my addr 172.21.15.111:0/1912087939 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:29.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.150+0000 7f62b2ffd700 1 -- 172.21.15.111:0/1912087939 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f62b4097580 msgr2=0x7f62b405ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:29.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.150+0000 7f62b2ffd700 1 --2- 172.21.15.111:0/1912087939 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f62b4097580 0x7f62b405ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-25T02:20:29.159 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.150+0000 7f62b2ffd700 1 -- 172.21.15.111:0/1912087939 >> v1:172.21.15.111:6789/0 conn(0x7f62b4097960 legacy=0x7f62b405bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:29.159 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.150+0000 7f62b2ffd700 1 -- 172.21.15.111:0/1912087939 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b4139730 con 0x7f62b4139c10 2024-04-25T02:20:29.159 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.150+0000 7f62b2ffd700 1 --2- 172.21.15.111:0/1912087939 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62b4139c10 0x7f62b4139ff0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f62a4002f70 tx=0x7f62a4006eb0).ready entity=mon.0 client_cookie=57b4c830dcb451ba server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:29.159 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.151+0000 7f65037fe700 1 -- 172.21.15.111:0/3659373782 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64f000d570 con 0x7f6504138120 2024-04-25T02:20:29.159 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.151+0000 7f65037fe700 1 -- 172.21.15.111:0/3659373782 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64f0000e90 con 0x7f6504138120 2024-04-25T02:20:29.159 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.151+0000 7f65037fe700 1 -- 172.21.15.111:0/3659373782 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64f000d8c0 con 0x7f6504138120 2024-04-25T02:20:29.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.151+0000 7f62b1ffb700 1 -- 172.21.15.111:0/1912087939 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62a400d5c0 con 0x7f62b4139c10 2024-04-25T02:20:29.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.151+0000 7f62b1ffb700 1 -- 172.21.15.111:0/1912087939 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a4000e90 con 0x7f62b4139c10 2024-04-25T02:20:29.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.151+0000 7f62b1ffb700 1 -- 172.21.15.111:0/1912087939 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62a400d950 con 0x7f62b4139c10 2024-04-25T02:20:29.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.151+0000 7f650af90700 1 -- 172.21.15.111:0/3659373782 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6504138120 msgr2=0x7f65041349e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:29.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.151+0000 7f650af90700 1 --2- 172.21.15.111:0/3659373782 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6504138120 0x7f65041349e0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f64f0002f70 tx=0x7f64f0006df0).stop 2024-04-25T02:20:29.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.151+0000 7f650af90700 1 -- 172.21.15.111:0/3659373782 shutdown_connections 2024-04-25T02:20:29.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.151+0000 7f650af90700 1 --2- 172.21.15.111:0/3659373782 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f65040657d0 0x7f6504133ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-25T02:20:29.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.151+0000 7f650af90700 1 --2- 172.21.15.111:0/3659373782 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6504138120 0x7f65041349e0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:29.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.151+0000 7f650af90700 1 -- 172.21.15.111:0/3659373782 >> 172.21.15.111:0/3659373782 conn(0x7f650405d070 msgr2=0x7f65040625e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:29.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.152+0000 7f62b9a4a700 1 -- 172.21.15.111:0/1912087939 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62b4139c10 msgr2=0x7f62b4139ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:29.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.151+0000 7f650af90700 1 -- 172.21.15.111:0/3659373782 shutdown_connections 2024-04-25T02:20:29.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.151+0000 7f650af90700 1 -- 172.21.15.111:0/3659373782 wait complete. 2024-04-25T02:20:29.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.152+0000 7f62b9a4a700 1 --2- 172.21.15.111:0/1912087939 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62b4139c10 0x7f62b4139ff0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f62a4002f70 tx=0x7f62a4006eb0).stop 2024-04-25T02:20:29.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.152+0000 7f650af90700 1 Processor -- start 2024-04-25T02:20:29.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.152+0000 7f650af90700 1 -- start start 2024-04-25T02:20:29.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.153+0000 7f650af90700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f65040657d0 0x7f6504136aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:29.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.153+0000 7f650af90700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6504137d40 0x7f65040612c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:29.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.153+0000 7f650af90700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6504138120 0x7f65041497c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:29.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.153+0000 7f650af90700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6504096890 con 0x7f6504137d40 2024-04-25T02:20:29.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.153+0000 7f650af90700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65041493b0 con 0x7f6504138120 2024-04-25T02:20:29.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.153+0000 7f650af90700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6504061c90 con 0x7f65040657d0 2024-04-25T02:20:29.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.153+0000 7f6503fff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6504137d40 0x7f65040612c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:29.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.153+0000 7f6503fff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6504137d40 0x7f65040612c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:39724/0 (socket says 172.21.15.111:39724) 2024-04-25T02:20:29.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.153+0000 7f6503fff700 1 -- 172.21.15.111:0/3227996523 learned_addr learned my addr 172.21.15.111:0/3227996523 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:29.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.153+0000 7f650952d700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6504138120 0x7f65041497c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:29.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.153+0000 7f6508d2c700 1 --2- 172.21.15.111:0/3227996523 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f65040657d0 0x7f6504136aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:29.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.153+0000 7f62b9a4a700 1 -- 172.21.15.111:0/1912087939 shutdown_connections 2024-04-25T02:20:29.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.153+0000 7f62b9a4a700 1 --2- 172.21.15.111:0/1912087939 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62b4139c10 0x7f62b4139ff0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:29.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.153+0000 7f62b9a4a700 1 --2- 172.21.15.111:0/1912087939 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f62b4097580 0x7f62b405ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-25T02:20:29.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.153+0000 7f62b9a4a700 1 -- 172.21.15.111:0/1912087939 >> 172.21.15.111:0/1912087939 conn(0x7f62b40614e0 msgr2=0x7f62b406c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:29.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.154+0000 7f6503fff700 1 -- 172.21.15.111:0/3227996523 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f65040657d0 msgr2=0x7f6504136aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:29.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.154+0000 7f6503fff700 1 --2- 172.21.15.111:0/3227996523 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f65040657d0 0x7f6504136aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:29.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.154+0000 7f6503fff700 1 -- 172.21.15.111:0/3227996523 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6504138120 msgr2=0x7f65041497c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:29.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.154+0000 7f6503fff700 1 --2- 172.21.15.111:0/3227996523 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6504138120 0x7f65041497c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:29.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.154+0000 7f6503fff700 1 -- 172.21.15.111:0/3227996523 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64f000b180 con 0x7f6504137d40 2024-04-25T02:20:29.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.154+0000 7f650952d700 1 --2- 172.21.15.111:0/3227996523 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6504138120 0x7f65041497c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:29.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.154+0000 7f6503fff700 1 --2- 172.21.15.111:0/3227996523 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6504137d40 0x7f65040612c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f64f0002f70 tx=0x7f64f0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:29.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.154+0000 7f62b9a4a700 1 -- 172.21.15.111:0/1912087939 shutdown_connections 2024-04-25T02:20:29.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.154+0000 7f62b9a4a700 1 -- 172.21.15.111:0/1912087939 wait complete. 2024-04-25T02:20:29.167 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.154+0000 7f6501ffb700 1 -- 172.21.15.111:0/3227996523 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64f000d8f0 con 0x7f6504137d40 2024-04-25T02:20:29.167 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.154+0000 7f6501ffb700 1 -- 172.21.15.111:0/3227996523 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f64f0011b80 con 0x7f6504137d40 2024-04-25T02:20:29.167 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.154+0000 7f6501ffb700 1 -- 172.21.15.111:0/3227996523 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f64f001e460 con 0x7f6504137d40 2024-04-25T02:20:29.167 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.154+0000 7f650af90700 1 -- 172.21.15.111:0/3227996523 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6504060400 con 0x7f6504137d40 2024-04-25T02:20:29.167 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.154+0000 7f650af90700 1 -- 172.21.15.111:0/3227996523 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6504133da0 con 0x7f6504137d40 2024-04-25T02:20:29.167 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.155+0000 7f650af90700 1 -- 172.21.15.111:0/3227996523 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6504137460 con 0x7f6504137d40 2024-04-25T02:20:29.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.155+0000 7f62b9a4a700 1 Processor -- start 2024-04-25T02:20:29.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.155+0000 7f62b9a4a700 1 -- start start 2024-04-25T02:20:29.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.155+0000 7f6501ffb700 1 -- 172.21.15.111:0/3227996523 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f64f0025030 con 0x7f6504137d40 2024-04-25T02:20:29.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.156+0000 7f6501ffb700 1 -- 172.21.15.111:0/3227996523 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f64f004bc50 con 0x7f6504137d40 2024-04-25T02:20:29.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.156+0000 7f6501ffb700 1 -- 172.21.15.111:0/3227996523 --> v1:172.21.15.111:6808/40213 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f64e4045630 con 0x7f64e4041940 2024-04-25T02:20:29.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.156+0000 7f6501ffb700 1 -- 172.21.15.111:0/3227996523 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f64f0051250 con 0x7f6504137d40 2024-04-25T02:20:29.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.156+0000 7f62b9a4a700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f62b4097580 0x7f62b414a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:29.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.156+0000 7f62b9a4a700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f62b4097960 0x7f62b414d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:29.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.156+0000 7f62b9a4a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62b4139c10 0x7f62b414dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:29.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.156+0000 7f62b9a4a700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b4095620 con 0x7f62b4139c10 2024-04-25T02:20:29.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.156+0000 7f62b9a4a700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62b40938d0 con 0x7f62b4097580 2024-04-25T02:20:29.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.156+0000 7f62b9a4a700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f62b414e280 con 0x7f62b4097960 2024-04-25T02:20:29.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.156+0000 7f62b27fc700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f62b4097960 0x7f62b414d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:29.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.156+0000 7f62b27fc700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f62b4097960 0x7f62b414d8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:60274/0 (socket says 172.21.15.111:60274) 2024-04-25T02:20:29.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.156+0000 7f62b27fc700 1 -- 172.21.15.111:0/838512602 learned_addr learned my addr 172.21.15.111:0/838512602 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:29.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.156+0000 7f9976d46700 1 Processor -- start 2024-04-25T02:20:29.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.156+0000 7f62b2ffd700 1 --2- 172.21.15.111:0/838512602 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f62b4097580 0x7f62b414a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:29.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.156+0000 7f62b37fe700 1 --2- 172.21.15.111:0/838512602 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62b4139c10 0x7f62b414dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:29.172 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.157+0000 7f62b2ffd700 1 -- 172.21.15.111:0/838512602 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f62b4097960 msgr2=0x7f62b414d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:29.172 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.157+0000 7f62b2ffd700 1 --2- 172.21.15.111:0/838512602 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f62b4097960 0x7f62b414d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:29.172 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.157+0000 7f62b2ffd700 1 -- 172.21.15.111:0/838512602 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62b4139c10 msgr2=0x7f62b414dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:29.172 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.157+0000 7f62b2ffd700 1 --2- 172.21.15.111:0/838512602 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f62b4139c10 0x7f62b414dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:29.172 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.157+0000 7f62b2ffd700 1 -- 172.21.15.111:0/838512602 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a400b1e0 con 0x7f62b4097580 2024-04-25T02:20:29.172 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.156+0000 7f9976d46700 1 -- start start 2024-04-25T02:20:29.172 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.157+0000 7f62b2ffd700 1 --2- 172.21.15.111:0/838512602 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f62b4097580 0x7f62b414a0f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f62b4149e10 tx=0x7f62a4015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:29.173 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.157+0000 7f6501ffb700 1 -- 172.21.15.111:0/3227996523 <== osd.3 v1:172.21.15.111:6808/40213 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (unknown 0 0 2423311318) 0x7f64e4045630 con 0x7f64e4041940 2024-04-25T02:20:29.173 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.157+0000 7f9976d46700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f997005d8a0 0x7f9970139ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:29.173 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.157+0000 7f9976d46700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f997013a3b0 0x7f9970141b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:29.173 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.157+0000 7f62a3fff700 1 -- 172.21.15.111:0/838512602 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62a4011990 con 0x7f62b4097580 2024-04-25T02:20:29.174 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.157+0000 7f62a3fff700 1 -- 172.21.15.111:0/838512602 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a4011af0 con 0x7f62b4097580 2024-04-25T02:20:29.174 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.157+0000 7f62a3fff700 1 -- 172.21.15.111:0/838512602 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62a4011e50 con 0x7f62b4097580 2024-04-25T02:20:29.174 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.157+0000 7f9976d46700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f997012c4c0 con 0x7f99700acd00 2024-04-25T02:20:29.174 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.157+0000 7f9976d46700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f997005c790 con 0x7f997013a3b0 2024-04-25T02:20:29.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.157+0000 7f9976d46700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f997005c520 con 0x7f997005d8a0 2024-04-25T02:20:29.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.157+0000 7f99752e3700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f997013a3b0 0x7f9970141b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:29.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.157+0000 7f99752e3700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f997013a3b0 0x7f9970141b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:57436/0 (socket says 172.21.15.111:57436) 2024-04-25T02:20:29.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.157+0000 7f99752e3700 1 -- 172.21.15.111:0/2445421044 learned_addr learned my addr 172.21.15.111:0/2445421044 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:29.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.158+0000 7fe746126700 1 Processor -- start 2024-04-25T02:20:29.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.158+0000 7fe746126700 1 -- start start 2024-04-25T02:20:29.176 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.158+0000 7f99752e3700 1 -- 172.21.15.111:0/2445421044 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f997005d8a0 msgr2=0x7f9970139ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:29.176 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.158+0000 7f99752e3700 1 --2- 172.21.15.111:0/2445421044 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f997005d8a0 0x7f9970139ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-25T02:20:29.176 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.158+0000 7f99752e3700 1 -- 172.21.15.111:0/2445421044 >> v1:172.21.15.111:6789/0 conn(0x7f99700acd00 legacy=0x7f99701397b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:29.176 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.158+0000 7f996f7fe700 1 -- 172.21.15.111:0/2445421044 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3923142771 0 0) 0x7f997012c4c0 con 0x7f99700acd00 2024-04-25T02:20:29.176 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.158+0000 7f99752e3700 1 -- 172.21.15.111:0/2445421044 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f997005d1d0 con 0x7f997013a3b0 2024-04-25T02:20:29.176 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.158+0000 7f99752e3700 1 --2- 172.21.15.111:0/2445421044 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f997013a3b0 0x7f9970141b40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f99680032f0 tx=0x7f9968009290).ready entity=mon.1 client_cookie=b5ee61b712ebabb4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:29.177 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.158+0000 7f996f7fe700 1 -- 172.21.15.111:0/2445421044 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f996800b8a0 con 0x7f997013a3b0 2024-04-25T02:20:29.177 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.158+0000 7f996f7fe700 1 -- 172.21.15.111:0/2445421044 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f996800ba00 con 0x7f997013a3b0 2024-04-25T02:20:29.177 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.158+0000 7f996f7fe700 1 -- 172.21.15.111:0/2445421044 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f996800bb70 con 0x7f997013a3b0 2024-04-25T02:20:29.177 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.158+0000 7f62b9a4a700 1 -- 172.21.15.111:0/838512602 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62b4093a60 con 0x7f62b4097580 2024-04-25T02:20:29.177 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.158+0000 7f62b9a4a700 1 -- 172.21.15.111:0/838512602 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62b4095830 con 0x7f62b4097580 2024-04-25T02:20:29.178 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.158+0000 7fe746126700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe7400acd00 0x7fe7401397b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:29.178 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.159+0000 7fe746126700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fe74013a3b0 0x7fe740141b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:29.178 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.159+0000 7fe746126700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe74012c4c0 con 0x7fe74005d8a0 2024-04-25T02:20:29.178 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.159+0000 7fe746126700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe74005c790 con 0x7fe74013a3b0 2024-04-25T02:20:29.178 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.159+0000 7fe746126700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe74005c520 con 0x7fe7400acd00 2024-04-25T02:20:29.178 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.159+0000 7fe73f7fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe7400acd00 0x7fe7401397b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:29.178 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.159+0000 7fe73f7fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe7400acd00 0x7fe7401397b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:57452/0 (socket says 172.21.15.111:57452) 2024-04-25T02:20:29.178 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.159+0000 7fe73f7fe700 1 -- 172.21.15.111:0/3789948575 learned_addr learned my addr 172.21.15.111:0/3789948575 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:29.178 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.159+0000 7fe73f7fe700 1 -- 172.21.15.111:0/3789948575 >> v2:172.21.15.111:3300/0 conn(0x7fe74013a3b0 msgr2=0x7fe740141b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:29.178 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.159+0000 7fe73f7fe700 1 --2- 172.21.15.111:0/3789948575 >> v2:172.21.15.111:3300/0 conn(0x7fe74013a3b0 0x7fe740141b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-25T02:20:29.178 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.159+0000 7fe73f7fe700 1 -- 172.21.15.111:0/3789948575 >> v1:172.21.15.111:6789/0 conn(0x7fe74005d8a0 legacy=0x7fe740139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:29.179 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.159+0000 7fe73f7fe700 1 -- 172.21.15.111:0/3789948575 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe74005d1d0 con 0x7fe7400acd00 2024-04-25T02:20:29.179 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.159+0000 7f9976d46700 1 -- 172.21.15.111:0/2445421044 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f997013a3b0 msgr2=0x7f9970141b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:29.179 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.159+0000 7f9976d46700 1 --2- 172.21.15.111:0/2445421044 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f997013a3b0 0x7f9970141b40 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f99680032f0 tx=0x7f9968009290).stop 2024-04-25T02:20:29.179 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.159+0000 7fe73f7fe700 1 --2- 172.21.15.111:0/3789948575 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe7400acd00 0x7fe7401397b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fe7400a7a40 tx=0x7fe730006eb0).ready entity=mon.1 client_cookie=565bd148f2a43948 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:29.179 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.159+0000 7fe73effd700 1 -- 172.21.15.111:0/3789948575 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe73000d570 con 0x7fe7400acd00 2024-04-25T02:20:29.180 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.160+0000 7f9976d46700 1 -- 172.21.15.111:0/2445421044 shutdown_connections 2024-04-25T02:20:29.180 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.160+0000 7f9976d46700 1 --2- 172.21.15.111:0/2445421044 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f997013a3b0 0x7f9970141b40 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:29.180 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.160+0000 7f9976d46700 1 --2- 172.21.15.111:0/2445421044 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f997005d8a0 0x7f9970139ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-25T02:20:29.180 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.160+0000 7f9976d46700 1 -- 172.21.15.111:0/2445421044 >> 172.21.15.111:0/2445421044 conn(0x7f997005dfb0 msgr2=0x7f9970066ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:29.180 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.160+0000 7f9976d46700 1 -- 172.21.15.111:0/2445421044 shutdown_connections 2024-04-25T02:20:29.180 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.160+0000 7f9976d46700 1 -- 172.21.15.111:0/2445421044 wait complete. 2024-04-25T02:20:29.180 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.159+0000 7f62b9a4a700 1 -- 172.21.15.111:0/838512602 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f6294003660 con 0x7f62b4097580 2024-04-25T02:20:29.181 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.159+0000 7fe73effd700 1 -- 172.21.15.111:0/3789948575 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe730000e90 con 0x7fe7400acd00 2024-04-25T02:20:29.181 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.159+0000 7fe73effd700 1 -- 172.21.15.111:0/3789948575 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe73000d900 con 0x7fe7400acd00 2024-04-25T02:20:29.181 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.160+0000 7fe746126700 1 -- 172.21.15.111:0/3789948575 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe7400acd00 msgr2=0x7fe7401397b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:29.182 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.160+0000 7fe746126700 1 --2- 172.21.15.111:0/3789948575 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe7400acd00 0x7fe7401397b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fe7400a7a40 tx=0x7fe730006eb0).stop 2024-04-25T02:20:29.182 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.160+0000 7fe746126700 1 -- 172.21.15.111:0/3789948575 shutdown_connections 2024-04-25T02:20:29.182 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.160+0000 7fe746126700 1 --2- 172.21.15.111:0/3789948575 >> v2:172.21.15.111:3300/0 conn(0x7fe74013a3b0 0x7fe740141b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-25T02:20:29.182 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.160+0000 7fe746126700 1 --2- 172.21.15.111:0/3789948575 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe7400acd00 0x7fe7401397b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:29.182 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.160+0000 7fe746126700 1 -- 172.21.15.111:0/3789948575 >> 172.21.15.111:0/3789948575 conn(0x7fe74005dfb0 msgr2=0x7fe740066ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:29.182 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.160+0000 7fe746126700 1 -- 172.21.15.111:0/3789948575 shutdown_connections 2024-04-25T02:20:29.182 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.160+0000 7fe746126700 1 -- 172.21.15.111:0/3789948575 wait complete. 2024-04-25T02:20:29.182 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.160+0000 7f62a3fff700 1 -- 172.21.15.111:0/838512602 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f62a401a040 con 0x7f62b4097580 2024-04-25T02:20:29.183 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.160+0000 7f62a3fff700 1 -- 172.21.15.111:0/838512602 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f62a404c010 con 0x7f62b4097580 2024-04-25T02:20:29.183 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.161+0000 7f62a3fff700 1 -- 172.21.15.111:0/838512602 --> v1:172.21.15.111:6804/40215 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6290045600 con 0x7f6290041910 2024-04-25T02:20:29.183 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.161+0000 7f62a3fff700 1 -- 172.21.15.111:0/838512602 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f62a404c3f0 con 0x7f62b4097580 2024-04-25T02:20:29.183 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.161+0000 7f9976d46700 1 Processor -- start 2024-04-25T02:20:29.183 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.161+0000 7f9976d46700 1 -- start start 2024-04-25T02:20:29.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.161+0000 7fe746126700 1 Processor -- start 2024-04-25T02:20:29.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.161+0000 7fe746126700 1 -- start start 2024-04-25T02:20:29.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.162+0000 7fe746126700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe74005d8a0 0x7fe74013e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:29.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.162+0000 7fe746126700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe7400acd00 0x7fe7400a0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:29.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.162+0000 7fe746126700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe74013a3b0 0x7fe7400a1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:29.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.162+0000 7f9976d46700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f997005d8a0 0x7f99700a53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:29.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.162+0000 7f9976d46700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f99700acd00 0x7f9970127730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:29.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.162+0000 7f9976d46700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f997013a3b0 0x7f9970127c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:29.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.162+0000 7f9976d46700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f997012dfb0 con 0x7f997005d8a0 2024-04-25T02:20:29.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.162+0000 7f9976d46700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9970128110 con 0x7f99700acd00 2024-04-25T02:20:29.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.162+0000 7f9976d46700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f99700a66c0 con 0x7f997013a3b0 2024-04-25T02:20:29.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.162+0000 7fe746126700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7400a1dc0 con 0x7fe74013a3b0 2024-04-25T02:20:29.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.162+0000 7fe746126700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7400a5320 con 0x7fe74005d8a0 2024-04-25T02:20:29.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.162+0000 7fe746126700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe7400a55e0 con 0x7fe7400acd00 2024-04-25T02:20:29.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.162+0000 7fe73f7fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe74005d8a0 0x7fe74013e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:29.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.162+0000 7fe73f7fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe74005d8a0 0x7fe74013e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:57464/0 (socket says 172.21.15.111:57464) 2024-04-25T02:20:29.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.162+0000 7fe73f7fe700 1 -- 172.21.15.111:0/1530429200 learned_addr learned my addr 172.21.15.111:0/1530429200 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:29.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.162+0000 7fe73ffff700 1 --2- 172.21.15.111:0/1530429200 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe74013a3b0 0x7fe7400a1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:29.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.162+0000 7f99752e3700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f997013a3b0 0x7f9970127c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:29.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.162+0000 7f99752e3700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f997013a3b0 0x7f9970127c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:60284/0 (socket says 172.21.15.111:60284) 2024-04-25T02:20:29.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.162+0000 7f99752e3700 1 -- 172.21.15.111:0/688274079 learned_addr learned my addr 172.21.15.111:0/688274079 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:29.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.162+0000 7f9974ae2700 1 --2- 172.21.15.111:0/688274079 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f997005d8a0 0x7f99700a53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:29.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.163+0000 7fe73f7fe700 1 -- 172.21.15.111:0/1530429200 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe7400acd00 msgr2=0x7fe7400a0b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T02:20:29.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.163+0000 7f99752e3700 1 -- 172.21.15.111:0/688274079 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f99700acd00 msgr2=0x7f9970127730 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T02:20:29.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.163+0000 7f99752e3700 1 --2- 172.21.15.111:0/688274079 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f99700acd00 0x7f9970127730 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-25T02:20:29.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.163+0000 7f99752e3700 1 -- 172.21.15.111:0/688274079 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f997005d8a0 msgr2=0x7f99700a53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:29.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.163+0000 7f99752e3700 1 --2- 172.21.15.111:0/688274079 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f997005d8a0 0x7f99700a53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:29.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.163+0000 7f99752e3700 1 -- 172.21.15.111:0/688274079 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9968009530 con 0x7f997013a3b0 2024-04-25T02:20:29.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.163+0000 7f9974ae2700 1 --2- 172.21.15.111:0/688274079 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f997005d8a0 0x7f99700a53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:20:29.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.163+0000 7fe73f7fe700 1 --2- 172.21.15.111:0/1530429200 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe7400acd00 0x7fe7400a0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-25T02:20:29.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.163+0000 7fe73f7fe700 1 -- 172.21.15.111:0/1530429200 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe74013a3b0 msgr2=0x7fe7400a1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:29.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.163+0000 7fe73f7fe700 1 --2- 172.21.15.111:0/1530429200 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe74013a3b0 0x7fe7400a1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:29.189 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.163+0000 7fe73f7fe700 1 -- 172.21.15.111:0/1530429200 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe73000b1e0 con 0x7fe74005d8a0 2024-04-25T02:20:29.189 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.163+0000 7f62a3fff700 1 -- 172.21.15.111:0/838512602 <== osd.2 v1:172.21.15.111:6804/40215 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (unknown 0 0 2423311318) 0x7f6290045600 con 0x7f6290041910 2024-04-25T02:20:29.189 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.163+0000 7fe73ffff700 1 --2- 172.21.15.111:0/1530429200 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe74013a3b0 0x7fe7400a1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:29.189 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.163+0000 7f99752e3700 1 --2- 172.21.15.111:0/688274079 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f997013a3b0 0x7f9970127c20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f9970145be0 tx=0x7f9968016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:29.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.163+0000 7fe73f7fe700 1 --2- 172.21.15.111:0/1530429200 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe74005d8a0 0x7fe74013e020 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fe7400a7a40 tx=0x7fe730015000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:29.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.163+0000 7fe73d7fa700 1 -- 172.21.15.111:0/1530429200 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe730006b60 con 0x7fe74005d8a0 2024-04-25T02:20:29.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.163+0000 7fe73d7fa700 1 -- 172.21.15.111:0/1530429200 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe73000de10 con 0x7fe74005d8a0 2024-04-25T02:20:29.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.163+0000 7fe73d7fa700 1 -- 172.21.15.111:0/1530429200 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe730011e20 con 0x7fe74005d8a0 2024-04-25T02:20:29.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.163+0000 7fe746126700 1 -- 172.21.15.111:0/1530429200 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7400a5010 con 0x7fe74005d8a0 2024-04-25T02:20:29.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.163+0000 7fe746126700 1 -- 172.21.15.111:0/1530429200 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7400a5c20 con 0x7fe74005d8a0 2024-04-25T02:20:29.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.164+0000 7fe746126700 1 -- 172.21.15.111:0/1530429200 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe74013deb0 con 0x7fe74005d8a0 2024-04-25T02:20:29.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.163+0000 7f996dffb700 1 -- 172.21.15.111:0/688274079 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9968021670 con 0x7f997013a3b0 2024-04-25T02:20:29.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.163+0000 7f996dffb700 1 -- 172.21.15.111:0/688274079 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99680217d0 con 0x7f997013a3b0 2024-04-25T02:20:29.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.163+0000 7f996dffb700 1 -- 172.21.15.111:0/688274079 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9968021b30 con 0x7f997013a3b0 2024-04-25T02:20:29.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.165+0000 7f9976d46700 1 -- 172.21.15.111:0/688274079 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99700a5950 con 0x7f997013a3b0 2024-04-25T02:20:29.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.165+0000 7f9976d46700 1 -- 172.21.15.111:0/688274079 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99700a4ca0 con 0x7f997013a3b0 2024-04-25T02:20:29.192 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.165+0000 7fe73d7fa700 1 -- 172.21.15.111:0/1530429200 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fe73000f070 con 0x7fe74005d8a0 2024-04-25T02:20:29.192 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.165+0000 7fe73d7fa700 1 -- 172.21.15.111:0/1530429200 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fe73004cf10 con 0x7fe74005d8a0 2024-04-25T02:20:29.192 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.165+0000 7fe73d7fa700 1 -- 172.21.15.111:0/1530429200 --> v1:172.21.15.111:6800/40214 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe724045600 con 0x7fe724041910 2024-04-25T02:20:29.192 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.165+0000 7fe73d7fa700 1 -- 172.21.15.111:0/1530429200 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe73004d220 con 0x7fe74005d8a0 2024-04-25T02:20:29.193 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.165+0000 7f9976d46700 1 -- 172.21.15.111:0/688274079 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f997012e100 con 0x7f997013a3b0 2024-04-25T02:20:29.193 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.166+0000 7f996dffb700 1 -- 172.21.15.111:0/688274079 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f996800f070 con 0x7f997013a3b0 2024-04-25T02:20:29.193 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.166+0000 7f996dffb700 1 -- 172.21.15.111:0/688274079 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f996804c0a0 con 0x7f997013a3b0 2024-04-25T02:20:29.193 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.166+0000 7f996dffb700 1 -- 172.21.15.111:0/688274079 --> v1:172.21.15.111:6812/40216 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f99500455e0 con 0x7f9950041990 2024-04-25T02:20:29.193 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.166+0000 7f996dffb700 1 -- 172.21.15.111:0/688274079 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_get_version_reply(handle=1 version=18) v2 ==== 24+0+0 (secure 0 0 0) 0x7f996804f470 con 0x7f997013a3b0 2024-04-25T02:20:29.193 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.167+0000 7f996dffb700 1 -- 172.21.15.111:0/688274079 <== osd.1 v1:172.21.15.111:6812/40216 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (unknown 0 0 2423311318) 0x7f99500455e0 con 0x7f9950041990 2024-04-25T02:20:29.193 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.171+0000 7fe73d7fa700 1 -- 172.21.15.111:0/1530429200 <== osd.0 v1:172.21.15.111:6800/40214 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (unknown 0 0 2423311318) 0x7fe724045600 con 0x7fe724041910 2024-04-25T02:20:29.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.182+0000 7f9976d46700 1 -- 172.21.15.111:0/688274079 --> v1:172.21.15.111:6812/40216 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f997013a0f0 con 0x7f9950041990 2024-04-25T02:20:29.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.183+0000 7f996dffb700 1 -- 172.21.15.111:0/688274079 <== osd.1 v1:172.21.15.111:6812/40216 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 1129848789) 0x7f997013a0f0 con 0x7f9950041990 2024-04-25T02:20:29.195 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.183+0000 7f9976d46700 1 -- 172.21.15.111:0/688274079 >> v1:172.21.15.111:6812/40216 conn(0x7f9950041990 legacy=0x7f9950043e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:29.195 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.183+0000 7f9976d46700 1 -- 172.21.15.111:0/688274079 >> v1:172.21.15.111:6816/39585 conn(0x7f9950038ec0 legacy=0x7f995003b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:29.195 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.183+0000 7f9976d46700 1 -- 172.21.15.111:0/688274079 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f997013a3b0 msgr2=0x7f9970127c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:29.195 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.183+0000 7f9976d46700 1 --2- 172.21.15.111:0/688274079 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f997013a3b0 0x7f9970127c20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f9970145be0 tx=0x7f9968016000).stop 2024-04-25T02:20:29.196 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.183+0000 7f99752e3700 1 -- 172.21.15.111:0/688274079 reap_dead start 2024-04-25T02:20:29.196 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.184+0000 7f9976d46700 1 -- 172.21.15.111:0/688274079 shutdown_connections 2024-04-25T02:20:29.196 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.184+0000 7f9976d46700 1 -- 172.21.15.111:0/688274079 >> 172.21.15.111:0/688274079 conn(0x7f997005dfb0 msgr2=0x7f997012a4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:29.196 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.184+0000 7f9976d46700 1 -- 172.21.15.111:0/688274079 shutdown_connections 2024-04-25T02:20:29.196 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.184+0000 7f9976d46700 1 -- 172.21.15.111:0/688274079 wait complete. 2024-04-25T02:20:29.196 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.187+0000 7f650af90700 1 -- 172.21.15.111:0/3227996523 --> v1:172.21.15.111:6808/40213 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6504057a60 con 0x7f64e4041940 2024-04-25T02:20:29.196 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.188+0000 7f6501ffb700 1 -- 172.21.15.111:0/3227996523 <== osd.3 v1:172.21.15.111:6808/40213 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 675830894) 0x7f6504057a60 con 0x7f64e4041940 2024-04-25T02:20:29.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.188+0000 7f650af90700 1 -- 172.21.15.111:0/3227996523 >> v1:172.21.15.111:6808/40213 conn(0x7f64e4041940 legacy=0x7f64e4043dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:29.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.188+0000 7f650af90700 1 -- 172.21.15.111:0/3227996523 >> v1:172.21.15.111:6816/39585 conn(0x7f64e4038dd0 legacy=0x7f64e403b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:29.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.188+0000 7f650af90700 1 -- 172.21.15.111:0/3227996523 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6504137d40 msgr2=0x7f65040612c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:29.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.188+0000 7f650af90700 1 --2- 172.21.15.111:0/3227996523 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6504137d40 0x7f65040612c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f64f0002f70 tx=0x7f64f0015000).stop 2024-04-25T02:20:29.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.188+0000 7f650952d700 1 -- 172.21.15.111:0/3227996523 reap_dead start 2024-04-25T02:20:29.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.187+0000 7fe746126700 1 -- 172.21.15.111:0/1530429200 --> v1:172.21.15.111:6800/40214 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe7400a96e0 con 0x7fe724041910 2024-04-25T02:20:29.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.189+0000 7f650af90700 1 -- 172.21.15.111:0/3227996523 shutdown_connections 2024-04-25T02:20:29.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.189+0000 7f650af90700 1 -- 172.21.15.111:0/3227996523 >> 172.21.15.111:0/3227996523 conn(0x7f650405d070 msgr2=0x7f650406c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:29.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.189+0000 7f650af90700 1 -- 172.21.15.111:0/3227996523 shutdown_connections 2024-04-25T02:20:29.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.189+0000 7f650af90700 1 -- 172.21.15.111:0/3227996523 wait complete. 2024-04-25T02:20:29.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.191+0000 7fe73d7fa700 1 -- 172.21.15.111:0/1530429200 <== osd.0 v1:172.21.15.111:6800/40214 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 675830894) 0x7fe7400a96e0 con 0x7fe724041910 2024-04-25T02:20:29.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.191+0000 7f62b9a4a700 1 -- 172.21.15.111:0/838512602 --> v1:172.21.15.111:6804/40215 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6294002810 con 0x7f6290041910 2024-04-25T02:20:29.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.191+0000 7f62a3fff700 1 -- 172.21.15.111:0/838512602 <== osd.2 v1:172.21.15.111:6804/40215 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 2972949718) 0x7f6294002810 con 0x7f6290041910 2024-04-25T02:20:29.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.191+0000 7fe746126700 1 -- 172.21.15.111:0/1530429200 >> v1:172.21.15.111:6800/40214 conn(0x7fe724041910 legacy=0x7fe724043d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:29.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.192+0000 7fe746126700 1 -- 172.21.15.111:0/1530429200 >> v1:172.21.15.111:6816/39585 conn(0x7fe724038da0 legacy=0x7fe72403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:29.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.192+0000 7fe746126700 1 -- 172.21.15.111:0/1530429200 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe74005d8a0 msgr2=0x7fe74013e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:29.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.192+0000 7fe746126700 1 --2- 172.21.15.111:0/1530429200 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe74005d8a0 0x7fe74013e020 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fe7400a7a40 tx=0x7fe730015000).stop 2024-04-25T02:20:29.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.192+0000 7fe73ffff700 1 -- 172.21.15.111:0/1530429200 reap_dead start 2024-04-25T02:20:29.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.192+0000 7fe746126700 1 -- 172.21.15.111:0/1530429200 shutdown_connections 2024-04-25T02:20:29.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.192+0000 7fe746126700 1 -- 172.21.15.111:0/1530429200 >> 172.21.15.111:0/1530429200 conn(0x7fe74005dfb0 msgr2=0x7fe7401375e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:29.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.192+0000 7fe746126700 1 -- 172.21.15.111:0/1530429200 shutdown_connections 2024-04-25T02:20:29.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.192+0000 7fe746126700 1 -- 172.21.15.111:0/1530429200 wait complete. 2024-04-25T02:20:29.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.194+0000 7f62b9a4a700 1 -- 172.21.15.111:0/838512602 >> v1:172.21.15.111:6804/40215 conn(0x7f6290041910 legacy=0x7f6290043d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:29.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.194+0000 7f62b9a4a700 1 -- 172.21.15.111:0/838512602 >> v1:172.21.15.111:6816/39585 conn(0x7f6290038da0 legacy=0x7f629003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:29.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.194+0000 7f62b9a4a700 1 -- 172.21.15.111:0/838512602 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f62b4097580 msgr2=0x7f62b414a0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:29.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.194+0000 7f62b9a4a700 1 --2- 172.21.15.111:0/838512602 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f62b4097580 0x7f62b414a0f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f62b4149e10 tx=0x7f62a4015000).stop 2024-04-25T02:20:29.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.194+0000 7f62b37fe700 1 -- 172.21.15.111:0/838512602 reap_dead start 2024-04-25T02:20:29.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.194+0000 7f62b9a4a700 1 -- 172.21.15.111:0/838512602 shutdown_connections 2024-04-25T02:20:29.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.194+0000 7f62b9a4a700 1 -- 172.21.15.111:0/838512602 >> 172.21.15.111:0/838512602 conn(0x7f62b40614e0 msgr2=0x7f62b40a79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:29.203 INFO:teuthology.orchestra.run.smithi111.stdout:38654705670 2024-04-25T02:20:29.204 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T02:20:29.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.196+0000 7f62b9a4a700 1 -- 172.21.15.111:0/838512602 shutdown_connections 2024-04-25T02:20:29.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.196+0000 7f62b9a4a700 1 -- 172.21.15.111:0/838512602 wait complete. 2024-04-25T02:20:29.207 INFO:teuthology.orchestra.run.smithi111.stdout:38654705669 2024-04-25T02:20:29.208 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T02:20:29.211 INFO:teuthology.orchestra.run.smithi111.stdout:38654705669 2024-04-25T02:20:29.212 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T02:20:29.212 INFO:teuthology.orchestra.run.smithi111.stdout:38654705671 2024-04-25T02:20:29.213 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T02:20:29.329 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.324+0000 7fd11aa49700 1 Processor -- start 2024-04-25T02:20:29.329 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.324+0000 7fd11aa49700 1 -- start start 2024-04-25T02:20:29.331 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.325+0000 7fd11aa49700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd114139c10 0x7fd114139ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:29.331 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.325+0000 7fd11aa49700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd114097580 0x7fd11405ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:29.331 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.325+0000 7fd11aa49700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd11413a4e0 con 0x7fd114097960 2024-04-25T02:20:29.331 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.325+0000 7fd11aa49700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd114099610 con 0x7fd114097580 2024-04-25T02:20:29.332 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.325+0000 7fd11aa49700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd114096f80 con 0x7fd114139c10 2024-04-25T02:20:29.332 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.326+0000 7fd113fff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd114139c10 0x7fd114139ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:29.332 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.326+0000 7fd113fff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd114139c10 0x7fd114139ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:60300/0 (socket says 172.21.15.111:60300) 2024-04-25T02:20:29.332 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.326+0000 7fd1137fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd114097580 0x7fd11405ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:29.332 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.326+0000 7fd113fff700 1 -- 172.21.15.111:0/3555752318 learned_addr learned my addr 172.21.15.111:0/3555752318 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:29.332 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.326+0000 7fd1137fe700 1 -- 172.21.15.111:0/3555752318 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd114139c10 msgr2=0x7fd114139ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:29.332 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.326+0000 7fd1137fe700 1 --2- 172.21.15.111:0/3555752318 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd114139c10 0x7fd114139ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:29.332 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.326+0000 7fd1137fe700 1 -- 172.21.15.111:0/3555752318 >> v1:172.21.15.111:6789/0 conn(0x7fd114097960 legacy=0x7fd11405bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:29.332 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.326+0000 7fd1137fe700 1 -- 172.21.15.111:0/3555752318 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd114139730 con 0x7fd114097580 2024-04-25T02:20:29.332 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.326+0000 7fd1137fe700 1 --2- 172.21.15.111:0/3555752318 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd114097580 0x7fd11405ba50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fd108002f70 tx=0x7fd108006df0).ready entity=mon.1 client_cookie=ff617666b1c6c6de server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:29.332 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.326+0000 7fd112ffd700 1 -- 172.21.15.111:0/3555752318 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd10800d570 con 0x7fd114097580 2024-04-25T02:20:29.332 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.326+0000 7fd112ffd700 1 -- 172.21.15.111:0/3555752318 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd108000e90 con 0x7fd114097580 2024-04-25T02:20:29.332 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.326+0000 7fd112ffd700 1 -- 172.21.15.111:0/3555752318 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd10800d8c0 con 0x7fd114097580 2024-04-25T02:20:29.332 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.327+0000 7fd11aa49700 1 -- 172.21.15.111:0/3555752318 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd114097580 msgr2=0x7fd11405ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:29.333 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.327+0000 7fd11aa49700 1 --2- 172.21.15.111:0/3555752318 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd114097580 0x7fd11405ba50 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fd108002f70 tx=0x7fd108006df0).stop 2024-04-25T02:20:29.333 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.327+0000 7fd11aa49700 1 -- 172.21.15.111:0/3555752318 shutdown_connections 2024-04-25T02:20:29.333 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.327+0000 7fd11aa49700 1 --2- 172.21.15.111:0/3555752318 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd114139c10 0x7fd114139ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:29.333 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.327+0000 7fd11aa49700 1 --2- 172.21.15.111:0/3555752318 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd114097580 0x7fd11405ba50 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:29.333 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.327+0000 7fd11aa49700 1 -- 172.21.15.111:0/3555752318 >> 172.21.15.111:0/3555752318 conn(0x7fd1140614e0 msgr2=0x7fd11406c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:29.333 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.327+0000 7fd11aa49700 1 -- 172.21.15.111:0/3555752318 shutdown_connections 2024-04-25T02:20:29.333 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.327+0000 7fd11aa49700 1 -- 172.21.15.111:0/3555752318 wait complete. 2024-04-25T02:20:29.334 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.328+0000 7fd11aa49700 1 Processor -- start 2024-04-25T02:20:29.335 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.328+0000 7fd11aa49700 1 -- start start 2024-04-25T02:20:29.335 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.329+0000 7fd11aa49700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd114097580 0x7fd114063130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:29.335 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.329+0000 7fd11aa49700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd114097960 0x7fd1141492d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:29.335 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.329+0000 7fd11aa49700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd114139c10 0x7fd1141497c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:29.335 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.329+0000 7fd11aa49700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd114064b00 con 0x7fd114139c10 2024-04-25T02:20:29.335 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.329+0000 7fd11aa49700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd114062930 con 0x7fd114097580 2024-04-25T02:20:29.335 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.329+0000 7fd11aa49700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd1141390b0 con 0x7fd114097960 2024-04-25T02:20:29.335 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.329+0000 7fd1137fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd114097960 0x7fd1141492d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:29.335 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.329+0000 7fd113fff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd114097580 0x7fd114063130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:29.335 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.329+0000 7fd1137fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd114097960 0x7fd1141492d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:60302/0 (socket says 172.21.15.111:60302) 2024-04-25T02:20:29.335 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.329+0000 7fd1137fe700 1 -- 172.21.15.111:0/4006570892 learned_addr learned my addr 172.21.15.111:0/4006570892 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:29.335 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.330+0000 7fd1137fe700 1 -- 172.21.15.111:0/4006570892 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd114097580 msgr2=0x7fd114063130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:29.336 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.330+0000 7fd1137fe700 1 --2- 172.21.15.111:0/4006570892 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd114097580 0x7fd114063130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:29.336 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.330+0000 7fd1137fe700 1 -- 172.21.15.111:0/4006570892 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd114139c10 msgr2=0x7fd1141497c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:29.336 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.330+0000 7fd1137fe700 1 --2- 172.21.15.111:0/4006570892 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd114139c10 0x7fd1141497c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-25T02:20:29.336 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.330+0000 7fd1137fe700 1 -- 172.21.15.111:0/4006570892 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd10800b180 con 0x7fd114097960 2024-04-25T02:20:29.336 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.330+0000 7fd113fff700 1 --2- 172.21.15.111:0/4006570892 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd114097580 0x7fd114063130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:29.336 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.330+0000 7fd1137fe700 1 --2- 172.21.15.111:0/4006570892 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd114097960 0x7fd1141492d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fd108002f70 tx=0x7fd108014000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:29.336 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.330+0000 7fd1117fa700 1 -- 172.21.15.111:0/4006570892 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd10800de60 con 0x7fd114097960 2024-04-25T02:20:29.336 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.330+0000 7fd1117fa700 1 -- 172.21.15.111:0/4006570892 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd10801e400 con 0x7fd114097960 2024-04-25T02:20:29.336 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.330+0000 7fd1117fa700 1 -- 172.21.15.111:0/4006570892 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd10801e760 con 0x7fd114097960 2024-04-25T02:20:29.336 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.330+0000 7fd11aa49700 1 -- 172.21.15.111:0/4006570892 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd114064070 con 0x7fd114097960 2024-04-25T02:20:29.336 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.330+0000 7fd11aa49700 1 -- 172.21.15.111:0/4006570892 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1140637e0 con 0x7fd114097960 2024-04-25T02:20:29.337 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.331+0000 7fd11aa49700 1 -- 172.21.15.111:0/4006570892 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1141399f0 con 0x7fd114097960 2024-04-25T02:20:29.337 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.331+0000 7fd1117fa700 1 -- 172.21.15.111:0/4006570892 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fd10801c070 con 0x7fd114097960 2024-04-25T02:20:29.337 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.332+0000 7fd1117fa700 1 -- 172.21.15.111:0/4006570892 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fd10804b4e0 con 0x7fd114097960 2024-04-25T02:20:29.341 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.337+0000 7fd1117fa700 1 -- 172.21.15.111:0/4006570892 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fd108005e20 con 0x7fd114097960 2024-04-25T02:20:29.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.368+0000 7f1a6be98700 1 Processor -- start 2024-04-25T02:20:29.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.368+0000 7f1a6be98700 1 -- start start 2024-04-25T02:20:29.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.368+0000 7f524650b700 1 Processor -- start 2024-04-25T02:20:29.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.368+0000 7f524650b700 1 -- start start 2024-04-25T02:20:29.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.369+0000 7f1a6be98700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f1a64136800 0x7f1a640642e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:29.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.369+0000 7f1a6be98700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1a640633b0 0x7f1a64136be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:29.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.369+0000 7f1a6be98700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1a641363d0 con 0x7f1a64062590 2024-04-25T02:20:29.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.369+0000 7f1a6be98700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1a640647d0 con 0x7f1a64136800 2024-04-25T02:20:29.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.369+0000 7f1a6be98700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a64136600 con 0x7f1a640633b0 2024-04-25T02:20:29.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.369+0000 7f1a69c34700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f1a64136800 0x7f1a640642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:29.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.369+0000 7f1a6a435700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f1a64062590 0x7f1a640a82a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:44386/0 (socket says 172.21.15.111:44386) 2024-04-25T02:20:29.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.369+0000 7f1a6a435700 1 -- 172.21.15.111:0/3928852237 learned_addr learned my addr 172.21.15.111:0/3928852237 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:20:29.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.369+0000 7f1a69433700 1 --2- 172.21.15.111:0/3928852237 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1a640633b0 0x7f1a64136be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:29.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.370+0000 7f1a69433700 1 -- 172.21.15.111:0/3928852237 >> v2:172.21.15.111:3300/0 conn(0x7f1a64136800 msgr2=0x7f1a640642e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:29.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.370+0000 7f1a69433700 1 --2- 172.21.15.111:0/3928852237 >> v2:172.21.15.111:3300/0 conn(0x7f1a64136800 0x7f1a640642e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:29.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.370+0000 7f1a69433700 1 -- 172.21.15.111:0/3928852237 >> v1:172.21.15.111:6789/0 conn(0x7f1a64062590 legacy=0x7f1a640a82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:29.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.370+0000 7f1a69433700 1 -- 172.21.15.111:0/3928852237 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a640a9d70 con 0x7f1a640633b0 2024-04-25T02:20:29.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.370+0000 7f1a69c34700 1 --2- 172.21.15.111:0/3928852237 >> v2:172.21.15.111:3300/0 conn(0x7f1a64136800 0x7f1a640642e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:29.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.369+0000 7f524650b700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5240137a10 0x7f5240137df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:29.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.369+0000 7f524650b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f524013c760 0x7f524013eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:29.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.369+0000 7f524650b700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52401382e0 con 0x7f5240064380 2024-04-25T02:20:29.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.369+0000 7f524650b700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52401373c0 con 0x7f5240137a10 2024-04-25T02:20:29.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.369+0000 7f524650b700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5240064b60 con 0x7f524013c760 2024-04-25T02:20:29.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.369+0000 7f5244aa8700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f524013c760 0x7f524013eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:29.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.369+0000 7f523ffff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5240137a10 0x7f5240137df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:29.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.369+0000 7f5244aa8700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f524013c760 0x7f524013eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:60304/0 (socket says 172.21.15.111:60304) 2024-04-25T02:20:29.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.369+0000 7f523f7fe700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f5240064380 0x7f52400a98b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:44392/0 (socket says 172.21.15.111:44392) 2024-04-25T02:20:29.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.369+0000 7f5244aa8700 1 -- 172.21.15.111:0/2162955270 learned_addr learned my addr 172.21.15.111:0/2162955270 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:29.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.370+0000 7f1a69433700 1 --2- 172.21.15.111:0/3928852237 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1a640633b0 0x7f1a64136be0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f1a5c001490 tx=0x7f1a54006df0).ready entity=mon.1 client_cookie=e9c0123b5add799b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:29.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.370+0000 7f523ffff700 1 -- 172.21.15.111:0/2162955270 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f524013c760 msgr2=0x7f524013eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:29.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.370+0000 7f523ffff700 1 --2- 172.21.15.111:0/2162955270 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f524013c760 0x7f524013eb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:29.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.370+0000 7f523ffff700 1 -- 172.21.15.111:0/2162955270 >> v1:172.21.15.111:6789/0 conn(0x7f5240064380 legacy=0x7f52400a98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:29.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.370+0000 7f523ffff700 1 -- 172.21.15.111:0/2162955270 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52401375e0 con 0x7f5240137a10 2024-04-25T02:20:29.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.370+0000 7f5244aa8700 1 --2- 172.21.15.111:0/2162955270 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f524013c760 0x7f524013eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:29.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.370+0000 7f1a68c32700 1 -- 172.21.15.111:0/3928852237 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a5400d4a0 con 0x7f1a640633b0 2024-04-25T02:20:29.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.370+0000 7f1a68c32700 1 -- 172.21.15.111:0/3928852237 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a54000e90 con 0x7f1a640633b0 2024-04-25T02:20:29.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.370+0000 7f1a68c32700 1 -- 172.21.15.111:0/3928852237 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a5400d7f0 con 0x7f1a640633b0 2024-04-25T02:20:29.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.370+0000 7f523ffff700 1 --2- 172.21.15.111:0/2162955270 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5240137a10 0x7f5240137df0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f5230002f70 tx=0x7f5230006df0).ready entity=mon.1 client_cookie=dc91e89a6c37bee6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:29.379 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.370+0000 7f523effd700 1 -- 172.21.15.111:0/2162955270 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f523000d570 con 0x7f5240137a10 2024-04-25T02:20:29.379 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.370+0000 7f523effd700 1 -- 172.21.15.111:0/2162955270 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5230000e90 con 0x7f5240137a10 2024-04-25T02:20:29.379 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.370+0000 7f523effd700 1 -- 172.21.15.111:0/2162955270 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f523000d8c0 con 0x7f5240137a10 2024-04-25T02:20:29.379 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.371+0000 7f1a6be98700 1 -- 172.21.15.111:0/3928852237 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1a640633b0 msgr2=0x7f1a64136be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:29.379 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.371+0000 7f1a6be98700 1 --2- 172.21.15.111:0/3928852237 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1a640633b0 0x7f1a64136be0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f1a5c001490 tx=0x7f1a54006df0).stop 2024-04-25T02:20:29.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.371+0000 7f1a6be98700 1 -- 172.21.15.111:0/3928852237 shutdown_connections 2024-04-25T02:20:29.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.371+0000 7f1a6be98700 1 --2- 172.21.15.111:0/3928852237 >> v2:172.21.15.111:3300/0 conn(0x7f1a64136800 0x7f1a640642e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:29.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.371+0000 7f1a6be98700 1 --2- 172.21.15.111:0/3928852237 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1a640633b0 0x7f1a64136be0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:29.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.371+0000 7f1a6be98700 1 -- 172.21.15.111:0/3928852237 >> 172.21.15.111:0/3928852237 conn(0x7f1a640614e0 msgr2=0x7f1a6406c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:29.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.371+0000 7f524650b700 1 -- 172.21.15.111:0/2162955270 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5240137a10 msgr2=0x7f5240137df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:29.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.371+0000 7f524650b700 1 --2- 172.21.15.111:0/2162955270 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5240137a10 0x7f5240137df0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f5230002f70 tx=0x7f5230006df0).stop 2024-04-25T02:20:29.381 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.371+0000 7f1a6be98700 1 -- 172.21.15.111:0/3928852237 shutdown_connections 2024-04-25T02:20:29.381 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.371+0000 7f524650b700 1 -- 172.21.15.111:0/2162955270 shutdown_connections 2024-04-25T02:20:29.381 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.371+0000 7f524650b700 1 --2- 172.21.15.111:0/2162955270 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f524013c760 0x7f524013eb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:29.381 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.371+0000 7f524650b700 1 --2- 172.21.15.111:0/2162955270 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5240137a10 0x7f5240137df0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:29.381 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.371+0000 7f524650b700 1 -- 172.21.15.111:0/2162955270 >> 172.21.15.111:0/2162955270 conn(0x7f52400614e0 msgr2=0x7f524006c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:29.381 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.371+0000 7f524650b700 1 -- 172.21.15.111:0/2162955270 shutdown_connections 2024-04-25T02:20:29.382 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.371+0000 7f1a6be98700 1 -- 172.21.15.111:0/3928852237 wait complete. 2024-04-25T02:20:29.382 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.371+0000 7f524650b700 1 -- 172.21.15.111:0/2162955270 wait complete. 2024-04-25T02:20:29.382 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.372+0000 7f1a6be98700 1 Processor -- start 2024-04-25T02:20:29.383 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.372+0000 7f1a6be98700 1 -- start start 2024-04-25T02:20:29.383 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.372+0000 7f524650b700 1 Processor -- start 2024-04-25T02:20:29.383 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.372+0000 7f524650b700 1 -- start start 2024-04-25T02:20:29.384 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.373+0000 7f1a6be98700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1a64062590 0x7f1a64145f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:29.384 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.373+0000 7f1a6be98700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1a640633b0 0x7f1a64096910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:29.384 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.373+0000 7f1a6be98700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1a64136800 0x7f1a64096e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:29.384 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.373+0000 7f1a6be98700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a64145b10 con 0x7f1a64062590 2024-04-25T02:20:29.384 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.373+0000 7f1a6be98700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1a64097760 con 0x7f1a64136800 2024-04-25T02:20:29.384 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.373+0000 7f1a6be98700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1a64146930 con 0x7f1a640633b0 2024-04-25T02:20:29.385 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.373+0000 7f1a6a435700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1a64136800 0x7f1a64096e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:29.385 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.373+0000 7f1a6a435700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1a64136800 0x7f1a64096e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:57502/0 (socket says 172.21.15.111:57502) 2024-04-25T02:20:29.385 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.373+0000 7f1a6a435700 1 -- 172.21.15.111:0/2851424889 learned_addr learned my addr 172.21.15.111:0/2851424889 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:29.385 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.373+0000 7f1a69433700 1 --2- 172.21.15.111:0/2851424889 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1a640633b0 0x7f1a64096910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:29.385 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.373+0000 7f524650b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5240064380 0x7f52401492e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:29.385 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.373+0000 7f524650b700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5240137a10 0x7f5240145540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:29.385 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.373+0000 7f524650b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f524013c760 0x7f5240145a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:29.385 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.373+0000 7f524650b700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5240136020 con 0x7f524013c760 2024-04-25T02:20:29.386 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.373+0000 7f524650b700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5240063e60 con 0x7f5240137a10 2024-04-25T02:20:29.386 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.373+0000 7f524650b700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5240063fd0 con 0x7f5240064380 2024-04-25T02:20:29.386 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.373+0000 7f5244aa8700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f524013c760 0x7f5240145a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:29.386 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.373+0000 7f5244aa8700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f524013c760 0x7f5240145a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:39788/0 (socket says 172.21.15.111:39788) 2024-04-25T02:20:29.386 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.373+0000 7f5244aa8700 1 -- 172.21.15.111:0/2990495182 learned_addr learned my addr 172.21.15.111:0/2990495182 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:29.386 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.373+0000 7f523f7fe700 1 --2- 172.21.15.111:0/2990495182 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5240137a10 0x7f5240145540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:29.386 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.373+0000 7f523ffff700 1 --2- 172.21.15.111:0/2990495182 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5240064380 0x7f52401492e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:29.386 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.373+0000 7f1a6a435700 1 -- 172.21.15.111:0/2851424889 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1a640633b0 msgr2=0x7f1a64096910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:29.387 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.373+0000 7f1a6a435700 1 --2- 172.21.15.111:0/2851424889 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1a640633b0 0x7f1a64096910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:29.387 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.373+0000 7f1a6a435700 1 -- 172.21.15.111:0/2851424889 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1a64062590 msgr2=0x7f1a64145f60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T02:20:29.387 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.373+0000 7f1a6a435700 1 --2- 172.21.15.111:0/2851424889 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1a64062590 0x7f1a64145f60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-25T02:20:29.387 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.373+0000 7f1a6a435700 1 -- 172.21.15.111:0/2851424889 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a6000d410 con 0x7f1a64136800 2024-04-25T02:20:29.387 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.373+0000 7f1a6a435700 1 --2- 172.21.15.111:0/2851424889 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1a64136800 0x7f1a64096e00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f1a5c001550 tx=0x7f1a5c007f00).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:29.387 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.374+0000 7f523f7fe700 1 -- 172.21.15.111:0/2990495182 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5240064380 msgr2=0x7f52401492e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:29.387 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.374+0000 7f523f7fe700 1 --2- 172.21.15.111:0/2990495182 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5240064380 0x7f52401492e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:29.387 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.374+0000 7f523f7fe700 1 -- 172.21.15.111:0/2990495182 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f524013c760 msgr2=0x7f5240145a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:29.387 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.374+0000 7f523f7fe700 1 --2- 172.21.15.111:0/2990495182 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f524013c760 0x7f5240145a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:29.387 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.374+0000 7f523f7fe700 1 -- 172.21.15.111:0/2990495182 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5238009530 con 0x7f5240137a10 2024-04-25T02:20:29.388 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.374+0000 7f1a52ffd700 1 -- 172.21.15.111:0/2851424889 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a5c005ba0 con 0x7f1a64136800 2024-04-25T02:20:29.388 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.374+0000 7f1a52ffd700 1 -- 172.21.15.111:0/2851424889 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1a5c005d00 con 0x7f1a64136800 2024-04-25T02:20:29.388 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.374+0000 7f1a52ffd700 1 -- 172.21.15.111:0/2851424889 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f1a5c007300 con 0x7f1a64136800 2024-04-25T02:20:29.388 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.374+0000 7f1a6be98700 1 -- 172.21.15.111:0/2851424889 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a5400b180 con 0x7f1a64136800 2024-04-25T02:20:29.388 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.374+0000 7f1a6be98700 1 -- 172.21.15.111:0/2851424889 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a640669e0 con 0x7f1a64136800 2024-04-25T02:20:29.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.374+0000 7f523f7fe700 1 --2- 172.21.15.111:0/2990495182 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5240137a10 0x7f5240145540 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f524005ce80 tx=0x7f5234007b80).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:29.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.375+0000 7f5fa3927700 1 Processor -- start 2024-04-25T02:20:29.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.374+0000 7f523d7fa700 1 -- 172.21.15.111:0/2990495182 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f52340070d0 con 0x7f5240137a10 2024-04-25T02:20:29.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.374+0000 7f523d7fa700 1 -- 172.21.15.111:0/2990495182 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5234007230 con 0x7f5240137a10 2024-04-25T02:20:29.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.374+0000 7f523d7fa700 1 -- 172.21.15.111:0/2990495182 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5234005550 con 0x7f5240137a10 2024-04-25T02:20:29.389 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.375+0000 7f524650b700 1 -- 172.21.15.111:0/2990495182 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f523000b180 con 0x7f5240137a10 2024-04-25T02:20:29.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.375+0000 7f524650b700 1 -- 172.21.15.111:0/2990495182 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5240135810 con 0x7f5240137a10 2024-04-25T02:20:29.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.375+0000 7f1a52ffd700 1 -- 172.21.15.111:0/2851424889 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f1a5c010030 con 0x7f1a64136800 2024-04-25T02:20:29.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.375+0000 7f1a6be98700 1 -- 172.21.15.111:0/2851424889 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a64057a60 con 0x7f1a64136800 2024-04-25T02:20:29.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.375+0000 7f1a52ffd700 1 -- 172.21.15.111:0/2851424889 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f1a5c04aae0 con 0x7f1a64136800 2024-04-25T02:20:29.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.375+0000 7f5fa3927700 1 -- start start 2024-04-25T02:20:29.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.376+0000 7f5fa3927700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5f9c05ba50 0x7f5f9c0a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:29.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.376+0000 7f5fa3927700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f5f9c05c540 0x7f5f9c145640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:29.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.376+0000 7f5fa3927700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5f9c0a1270 con 0x7f5f9c0a7ea0 2024-04-25T02:20:29.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.376+0000 7f5fa3927700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5f9c0a0a90 con 0x7f5f9c05c540 2024-04-25T02:20:29.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.376+0000 7f5fa3927700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9c0a0d70 con 0x7f5f9c05ba50 2024-04-25T02:20:29.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.376+0000 7f5fa16c3700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5f9c05ba50 0x7f5f9c0a16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:29.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.376+0000 7f5fa16c3700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5f9c05ba50 0x7f5f9c0a16a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:60318/0 (socket says 172.21.15.111:60318) 2024-04-25T02:20:29.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.376+0000 7f5fa16c3700 1 -- 172.21.15.111:0/2843210557 learned_addr learned my addr 172.21.15.111:0/2843210557 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:29.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.376+0000 7f524650b700 1 -- 172.21.15.111:0/2990495182 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5240149990 con 0x7f5240137a10 2024-04-25T02:20:29.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.377+0000 7f5fa16c3700 1 -- 172.21.15.111:0/2843210557 >> v2:172.21.15.111:3300/0 conn(0x7f5f9c05c540 msgr2=0x7f5f9c145640 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T02:20:29.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.377+0000 7f5fa16c3700 1 --2- 172.21.15.111:0/2843210557 >> v2:172.21.15.111:3300/0 conn(0x7f5f9c05c540 0x7f5f9c145640 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-25T02:20:29.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.377+0000 7f5fa16c3700 1 -- 172.21.15.111:0/2843210557 >> v1:172.21.15.111:6789/0 conn(0x7f5f9c0a7ea0 legacy=0x7f5f9c05be30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:29.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.377+0000 7f5fa16c3700 1 -- 172.21.15.111:0/2843210557 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f9c0a8330 con 0x7f5f9c05ba50 2024-04-25T02:20:29.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.377+0000 7f5fa16c3700 1 --2- 172.21.15.111:0/2843210557 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5f9c05ba50 0x7f5f9c0a16a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f5f9c06d180 tx=0x7f5f8c006eb0).ready entity=mon.2 client_cookie=d5a2bb0806c41de server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:29.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.377+0000 7f5f8bfff700 1 -- 172.21.15.111:0/2843210557 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f8c00d570 con 0x7f5f9c05ba50 2024-04-25T02:20:29.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.377+0000 7f5f8bfff700 1 -- 172.21.15.111:0/2843210557 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f8c000e90 con 0x7f5f9c05ba50 2024-04-25T02:20:29.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.377+0000 7f5f8bfff700 1 -- 172.21.15.111:0/2843210557 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f8c00d8c0 con 0x7f5f9c05ba50 2024-04-25T02:20:29.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.378+0000 7f5fa3927700 1 -- 172.21.15.111:0/2843210557 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5f9c05ba50 msgr2=0x7f5f9c0a16a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:29.394 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.378+0000 7f5fa3927700 1 --2- 172.21.15.111:0/2843210557 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5f9c05ba50 0x7f5f9c0a16a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f5f9c06d180 tx=0x7f5f8c006eb0).stop 2024-04-25T02:20:29.394 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.379+0000 7f5fa3927700 1 -- 172.21.15.111:0/2843210557 shutdown_connections 2024-04-25T02:20:29.394 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.379+0000 7f5fa3927700 1 --2- 172.21.15.111:0/2843210557 >> v2:172.21.15.111:3300/0 conn(0x7f5f9c05c540 0x7f5f9c145640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-25T02:20:29.394 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.379+0000 7f5fa3927700 1 --2- 172.21.15.111:0/2843210557 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5f9c05ba50 0x7f5f9c0a16a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:29.394 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.379+0000 7f5fa3927700 1 -- 172.21.15.111:0/2843210557 >> 172.21.15.111:0/2843210557 conn(0x7f5f9c0a8a00 msgr2=0x7f5f9c0a8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:29.394 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.379+0000 7f5fa3927700 1 -- 172.21.15.111:0/2843210557 shutdown_connections 2024-04-25T02:20:29.395 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.379+0000 7f523d7fa700 1 -- 172.21.15.111:0/2990495182 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f5234010070 con 0x7f5240137a10 2024-04-25T02:20:29.395 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.380+0000 7f523d7fa700 1 -- 172.21.15.111:0/2990495182 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f5234049cf0 con 0x7f5240137a10 2024-04-25T02:20:29.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.379+0000 7f5fa3927700 1 -- 172.21.15.111:0/2843210557 wait complete. 2024-04-25T02:20:29.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.380+0000 7f5fa3927700 1 Processor -- start 2024-04-25T02:20:29.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.380+0000 7f5fa3927700 1 -- start start 2024-04-25T02:20:29.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.380+0000 7f5fa3927700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5f9c05ba50 0x7f5f9c13f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:29.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.380+0000 7f5fa3927700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5f9c05c540 0x7f5f9c13fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:29.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.380+0000 7f5fa3927700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5f9c138990 0x7f5f9c138e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:29.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.380+0000 7f5fa3927700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9c140970 con 0x7f5f9c138990 2024-04-25T02:20:29.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.380+0000 7f5fa3927700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9c13f6f0 con 0x7f5f9c05ba50 2024-04-25T02:20:29.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.380+0000 7f5fa3927700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5f9c13f990 con 0x7f5f9c05c540 2024-04-25T02:20:29.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.381+0000 7f5fa1ec4700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5f9c138990 0x7f5f9c138e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:29.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.381+0000 7f5fa1ec4700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5f9c138990 0x7f5f9c138e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:39798/0 (socket says 172.21.15.111:39798) 2024-04-25T02:20:29.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.381+0000 7f5fa1ec4700 1 -- 172.21.15.111:0/2653652379 learned_addr learned my addr 172.21.15.111:0/2653652379 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:29.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.381+0000 7f5fa0ec2700 1 --2- 172.21.15.111:0/2653652379 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5f9c05c540 0x7f5f9c13fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:29.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.381+0000 7f5fa0ec2700 1 -- 172.21.15.111:0/2653652379 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5f9c05ba50 msgr2=0x7f5f9c13f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:29.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.381+0000 7f5fa0ec2700 1 --2- 172.21.15.111:0/2653652379 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5f9c05ba50 0x7f5f9c13f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-25T02:20:29.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.381+0000 7f5fa0ec2700 1 -- 172.21.15.111:0/2653652379 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5f9c138990 msgr2=0x7f5f9c138e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:29.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.381+0000 7f5fa0ec2700 1 --2- 172.21.15.111:0/2653652379 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5f9c138990 0x7f5f9c138e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:29.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.381+0000 7f5fa0ec2700 1 -- 172.21.15.111:0/2653652379 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f8c00b1e0 con 0x7f5f9c05c540 2024-04-25T02:20:29.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.381+0000 7f5fa1ec4700 1 --2- 172.21.15.111:0/2653652379 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5f9c138990 0x7f5f9c138e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:29.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.381+0000 7f5fa0ec2700 1 --2- 172.21.15.111:0/2653652379 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5f9c05c540 0x7f5f9c13fd80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f5f98002ef0 tx=0x7f5f98006cb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:29.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.381+0000 7f5f8a7fc700 1 -- 172.21.15.111:0/2653652379 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f98012410 con 0x7f5f9c05c540 2024-04-25T02:20:29.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.382+0000 7f523d7fa700 1 -- 172.21.15.111:0/2990495182 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f523402ebf0 con 0x7f5240137a10 2024-04-25T02:20:29.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.382+0000 7f1a52ffd700 1 -- 172.21.15.111:0/2851424889 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f1a5c02f8d0 con 0x7f1a64136800 2024-04-25T02:20:29.399 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.381+0000 7f5fa3927700 1 -- 172.21.15.111:0/2653652379 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f9c1465e0 con 0x7f5f9c05c540 2024-04-25T02:20:29.399 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.382+0000 7f5fa3927700 1 -- 172.21.15.111:0/2653652379 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f9c140270 con 0x7f5f9c05c540 2024-04-25T02:20:29.399 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.383+0000 7f5fa3927700 1 -- 172.21.15.111:0/2653652379 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f9c0a2e70 con 0x7f5f9c05c540 2024-04-25T02:20:29.399 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.383+0000 7f5f8a7fc700 1 -- 172.21.15.111:0/2653652379 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5f98012570 con 0x7f5f9c05c540 2024-04-25T02:20:29.400 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.383+0000 7f5f8a7fc700 1 -- 172.21.15.111:0/2653652379 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5f980128d0 con 0x7f5f9c05c540 2024-04-25T02:20:29.400 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.385+0000 7f5f8a7fc700 1 -- 172.21.15.111:0/2653652379 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f5f9800f030 con 0x7f5f9c05c540 2024-04-25T02:20:29.400 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.387+0000 7f5f8a7fc700 1 -- 172.21.15.111:0/2653652379 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f5f980316f0 con 0x7f5f9c05c540 2024-04-25T02:20:29.400 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.390+0000 7f5f8a7fc700 1 -- 172.21.15.111:0/2653652379 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f5f9802f970 con 0x7f5f9c05c540 2024-04-25T02:20:29.467 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.462+0000 7fd11aa49700 1 -- 172.21.15.111:0/4006570892 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd114097e70 con 0x7fd114097960 2024-04-25T02:20:29.467 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.463+0000 7fd1117fa700 1 -- 172.21.15.111:0/4006570892 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd108023030 con 0x7fd114097960 2024-04-25T02:20:29.467 INFO:teuthology.orchestra.run.smithi111.stdout:38654705669 2024-04-25T02:20:29.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.464+0000 7fd11aa49700 1 -- 172.21.15.111:0/4006570892 >> v1:172.21.15.111:6816/39585 conn(0x7fd0f4038da0 legacy=0x7fd0f403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:29.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.464+0000 7fd11aa49700 1 -- 172.21.15.111:0/4006570892 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd114097960 msgr2=0x7fd1141492d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:29.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.464+0000 7fd11aa49700 1 --2- 172.21.15.111:0/4006570892 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd114097960 0x7fd1141492d0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7fd108002f70 tx=0x7fd108014000).stop 2024-04-25T02:20:29.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.464+0000 7fd11aa49700 1 -- 172.21.15.111:0/4006570892 shutdown_connections 2024-04-25T02:20:29.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.464+0000 7fd11aa49700 1 --2- 172.21.15.111:0/4006570892 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd114139c10 0x7fd1141497c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-25T02:20:29.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.464+0000 7fd11aa49700 1 --2- 172.21.15.111:0/4006570892 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd114097580 0x7fd114063130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:29.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.464+0000 7fd11aa49700 1 --2- 172.21.15.111:0/4006570892 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd114097960 0x7fd1141492d0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:29.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.464+0000 7fd11aa49700 1 -- 172.21.15.111:0/4006570892 >> 172.21.15.111:0/4006570892 conn(0x7fd1140614e0 msgr2=0x7fd1140a79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:29.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.465+0000 7fd11aa49700 1 -- 172.21.15.111:0/4006570892 shutdown_connections 2024-04-25T02:20:29.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.465+0000 7fd11aa49700 1 -- 172.21.15.111:0/4006570892 wait complete. 2024-04-25T02:20:29.479 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705669 for osd.1 2024-04-25T02:20:29.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.499+0000 7f1a6be98700 1 -- 172.21.15.111:0/2851424889 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f1a64145c80 con 0x7f1a64136800 2024-04-25T02:20:29.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.499+0000 7f1a52ffd700 1 -- 172.21.15.111:0/2851424889 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1a64145c80 con 0x7f1a64136800 2024-04-25T02:20:29.504 INFO:teuthology.orchestra.run.smithi111.stdout:38654705668 2024-04-25T02:20:29.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.501+0000 7f1a6be98700 1 -- 172.21.15.111:0/2851424889 >> v1:172.21.15.111:6816/39585 conn(0x7f1a44038df0 legacy=0x7f1a4403b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:29.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.501+0000 7f1a6be98700 1 -- 172.21.15.111:0/2851424889 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1a64136800 msgr2=0x7f1a64096e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:29.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.501+0000 7f1a6be98700 1 --2- 172.21.15.111:0/2851424889 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1a64136800 0x7f1a64096e00 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f1a5c001550 tx=0x7f1a5c007f00).stop 2024-04-25T02:20:29.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.501+0000 7f1a6be98700 1 -- 172.21.15.111:0/2851424889 shutdown_connections 2024-04-25T02:20:29.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.501+0000 7f1a6be98700 1 --2- 172.21.15.111:0/2851424889 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1a64136800 0x7f1a64096e00 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:29.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.501+0000 7f1a6be98700 1 --2- 172.21.15.111:0/2851424889 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1a64062590 0x7f1a64145f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-25T02:20:29.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.501+0000 7f1a6be98700 1 --2- 172.21.15.111:0/2851424889 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1a640633b0 0x7f1a64096910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:29.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.501+0000 7f1a6be98700 1 -- 172.21.15.111:0/2851424889 >> 172.21.15.111:0/2851424889 conn(0x7f1a640614e0 msgr2=0x7f1a6405ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:29.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.501+0000 7f1a6be98700 1 -- 172.21.15.111:0/2851424889 shutdown_connections 2024-04-25T02:20:29.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.501+0000 7f1a6be98700 1 -- 172.21.15.111:0/2851424889 wait complete. 2024-04-25T02:20:29.515 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.3 2024-04-25T02:20:29.528 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.523+0000 7f524650b700 1 -- 172.21.15.111:0/2990495182 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f5240149990 con 0x7f5240137a10 2024-04-25T02:20:29.528 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.524+0000 7f523d7fa700 1 -- 172.21.15.111:0/2990495182 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5240149990 con 0x7f5240137a10 2024-04-25T02:20:29.528 INFO:teuthology.orchestra.run.smithi111.stdout:38654705670 2024-04-25T02:20:29.529 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.525+0000 7f524650b700 1 -- 172.21.15.111:0/2990495182 >> v1:172.21.15.111:6816/39585 conn(0x7f5220038df0 legacy=0x7f522003b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:29.529 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.525+0000 7f524650b700 1 -- 172.21.15.111:0/2990495182 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5240137a10 msgr2=0x7f5240145540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:29.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.525+0000 7f524650b700 1 --2- 172.21.15.111:0/2990495182 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5240137a10 0x7f5240145540 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f524005ce80 tx=0x7f5234007b80).stop 2024-04-25T02:20:29.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.525+0000 7f524650b700 1 -- 172.21.15.111:0/2990495182 shutdown_connections 2024-04-25T02:20:29.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.525+0000 7f524650b700 1 --2- 172.21.15.111:0/2990495182 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f524013c760 0x7f5240145a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:29.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.525+0000 7f524650b700 1 --2- 172.21.15.111:0/2990495182 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5240064380 0x7f52401492e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:29.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.525+0000 7f524650b700 1 --2- 172.21.15.111:0/2990495182 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5240137a10 0x7f5240145540 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:29.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.525+0000 7f524650b700 1 -- 172.21.15.111:0/2990495182 >> 172.21.15.111:0/2990495182 conn(0x7f52400614e0 msgr2=0x7f524009a4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:29.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.525+0000 7f524650b700 1 -- 172.21.15.111:0/2990495182 shutdown_connections 2024-04-25T02:20:29.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.525+0000 7f524650b700 1 -- 172.21.15.111:0/2990495182 wait complete. 2024-04-25T02:20:29.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.528+0000 7f5fa3927700 1 -- 172.21.15.111:0/2653652379 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f5f9c057a60 con 0x7f5f9c05c540 2024-04-25T02:20:29.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.529+0000 7f5f8a7fc700 1 -- 172.21.15.111:0/2653652379 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5f98032f10 con 0x7f5f9c05c540 2024-04-25T02:20:29.533 INFO:teuthology.orchestra.run.smithi111.stdout:38654705668 2024-04-25T02:20:29.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.530+0000 7f5fa3927700 1 -- 172.21.15.111:0/2653652379 >> v1:172.21.15.111:6816/39585 conn(0x7f5f7c038e30 legacy=0x7f5f7c03b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:29.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.530+0000 7f5fa3927700 1 -- 172.21.15.111:0/2653652379 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5f9c05c540 msgr2=0x7f5f9c13fd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:29.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.530+0000 7f5fa3927700 1 --2- 172.21.15.111:0/2653652379 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5f9c05c540 0x7f5f9c13fd80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f5f98002ef0 tx=0x7f5f98006cb0).stop 2024-04-25T02:20:29.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.530+0000 7f5fa3927700 1 -- 172.21.15.111:0/2653652379 shutdown_connections 2024-04-25T02:20:29.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.530+0000 7f5fa3927700 1 --2- 172.21.15.111:0/2653652379 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5f9c138990 0x7f5f9c138e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:29.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.530+0000 7f5fa3927700 1 --2- 172.21.15.111:0/2653652379 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5f9c05ba50 0x7f5f9c13f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-25T02:20:29.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.530+0000 7f5fa3927700 1 --2- 172.21.15.111:0/2653652379 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5f9c05c540 0x7f5f9c13fd80 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:29.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.530+0000 7f5fa3927700 1 -- 172.21.15.111:0/2653652379 >> 172.21.15.111:0/2653652379 conn(0x7f5f9c0a8a00 msgr2=0x7f5f9c062950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:29.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.530+0000 7f5fa3927700 1 -- 172.21.15.111:0/2653652379 shutdown_connections 2024-04-25T02:20:29.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:29.530+0000 7f5fa3927700 1 -- 172.21.15.111:0/2653652379 wait complete. 2024-04-25T02:20:29.540 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705670 for osd.2 2024-04-25T02:20:29.545 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.0 2024-04-25T02:20:30.480 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T02:20:30.517 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T02:20:30.541 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T02:20:30.546 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T02:20:30.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.599+0000 7fb8f8a47700 1 Processor -- start 2024-04-25T02:20:30.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.599+0000 7fb8f8a47700 1 -- start start 2024-04-25T02:20:30.605 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.600+0000 7fb8f8a47700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb8f4136800 0x7fb8f40642e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:30.605 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.600+0000 7fb8f8a47700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb8f40633b0 0x7fb8f4136be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:30.605 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.600+0000 7fb8f8a47700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fb8f4062590 0x7fb8f40a82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:30.605 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.600+0000 7fb8f8a47700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8f41363d0 con 0x7fb8f4062590 2024-04-25T02:20:30.605 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.600+0000 7fb8f8a47700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f40647d0 con 0x7fb8f4136800 2024-04-25T02:20:30.605 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.600+0000 7fb8f8a47700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f4136600 con 0x7fb8f40633b0 2024-04-25T02:20:30.605 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.600+0000 7fb8f259c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb8f4136800 0x7fb8f40642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:30.605 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.600+0000 7fb8f2d9d700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fb8f4062590 0x7fb8f40a82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:30.605 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.600+0000 7fb8f259c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb8f4136800 0x7fb8f40642e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:51342/0 (socket says 172.21.15.111:51342) 2024-04-25T02:20:30.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.600+0000 7fb8f259c700 1 -- 172.21.15.111:0/1379949144 learned_addr learned my addr 172.21.15.111:0/1379949144 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:30.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.600+0000 7fb8f2d9d700 1 -- 172.21.15.111:0/1379949144 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb8f40633b0 msgr2=0x7fb8f4136be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:30.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.600+0000 7fb8f2d9d700 1 --2- 172.21.15.111:0/1379949144 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb8f40633b0 0x7fb8f4136be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-25T02:20:30.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.600+0000 7fb8f2d9d700 1 -- 172.21.15.111:0/1379949144 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb8f4136800 msgr2=0x7fb8f40642e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:30.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.600+0000 7fb8f2d9d700 1 --2- 172.21.15.111:0/1379949144 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb8f4136800 0x7fb8f40642e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:30.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.600+0000 7fb8f2d9d700 1 -- 172.21.15.111:0/1379949144 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8f40a9d70 con 0x7fb8f4062590 2024-04-25T02:20:30.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.600+0000 7fb8f259c700 1 --2- 172.21.15.111:0/1379949144 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb8f4136800 0x7fb8f40642e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:30.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.601+0000 7fb8f2d9d700 1 --2- 172.21.15.111:0/1379949144 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb8f4062590 0x7fb8f40a82a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fb8ec0032f0 tx=0x7fb8ec0091d0).ready entity=mon.0 client_cookie=73005addec9b9c61 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:30.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.601+0000 7fb8f159a700 1 -- 172.21.15.111:0/1379949144 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8ec00b660 con 0x7fb8f4062590 2024-04-25T02:20:30.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.601+0000 7fb8f159a700 1 -- 172.21.15.111:0/1379949144 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8ec00b7c0 con 0x7fb8f4062590 2024-04-25T02:20:30.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.601+0000 7fb8f159a700 1 -- 172.21.15.111:0/1379949144 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8ec00b930 con 0x7fb8f4062590 2024-04-25T02:20:30.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.602+0000 7fb8f8a47700 1 -- 172.21.15.111:0/1379949144 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb8f4062590 msgr2=0x7fb8f40a82a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:30.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.602+0000 7fb8f8a47700 1 --2- 172.21.15.111:0/1379949144 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb8f4062590 0x7fb8f40a82a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fb8ec0032f0 tx=0x7fb8ec0091d0).stop 2024-04-25T02:20:30.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.602+0000 7fb8f8a47700 1 -- 172.21.15.111:0/1379949144 shutdown_connections 2024-04-25T02:20:30.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.602+0000 7fb8f8a47700 1 --2- 172.21.15.111:0/1379949144 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb8f4062590 0x7fb8f40a82a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:30.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.602+0000 7fb8f8a47700 1 --2- 172.21.15.111:0/1379949144 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb8f4136800 0x7fb8f40642e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:30.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.602+0000 7fb8f8a47700 1 --2- 172.21.15.111:0/1379949144 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb8f40633b0 0x7fb8f4136be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-25T02:20:30.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.602+0000 7fb8f8a47700 1 -- 172.21.15.111:0/1379949144 >> 172.21.15.111:0/1379949144 conn(0x7fb8f40614e0 msgr2=0x7fb8f406c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:30.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.602+0000 7fb8f8a47700 1 -- 172.21.15.111:0/1379949144 shutdown_connections 2024-04-25T02:20:30.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.602+0000 7fb8f8a47700 1 -- 172.21.15.111:0/1379949144 wait complete. 2024-04-25T02:20:30.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.603+0000 7fb8f8a47700 1 Processor -- start 2024-04-25T02:20:30.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.603+0000 7fb8f8a47700 1 -- start start 2024-04-25T02:20:30.611 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.604+0000 7fb8f8a47700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb8f4062590 0x7fb8f4066d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:30.611 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.604+0000 7fb8f8a47700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb8f40633b0 0x7fb8f4149140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:30.611 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.604+0000 7fb8f8a47700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb8f4136800 0x7fb8f4149630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:30.611 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.604+0000 7fb8f8a47700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f4133360 con 0x7fb8f4136800 2024-04-25T02:20:30.611 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.604+0000 7fb8f8a47700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f4131140 con 0x7fb8f4062590 2024-04-25T02:20:30.611 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.604+0000 7fb8f8a47700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb8f41313e0 con 0x7fb8f40633b0 2024-04-25T02:20:30.611 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.604+0000 7fb8f1d9b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb8f40633b0 0x7fb8f4149140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:30.611 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.604+0000 7fb8f1d9b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb8f40633b0 0x7fb8f4149140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:57012/0 (socket says 172.21.15.111:57012) 2024-04-25T02:20:30.611 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.604+0000 7fb8f1d9b700 1 -- 172.21.15.111:0/543789596 learned_addr learned my addr 172.21.15.111:0/543789596 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:30.611 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.604+0000 7fb8f2d9d700 1 --2- 172.21.15.111:0/543789596 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb8f4136800 0x7fb8f4149630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:30.611 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.604+0000 7fb8f259c700 1 --2- 172.21.15.111:0/543789596 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb8f4062590 0x7fb8f4066d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:30.611 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.605+0000 7fb8f2d9d700 1 -- 172.21.15.111:0/543789596 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb8f40633b0 msgr2=0x7fb8f4149140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:30.611 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.605+0000 7fb8f2d9d700 1 --2- 172.21.15.111:0/543789596 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb8f40633b0 0x7fb8f4149140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:30.611 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.605+0000 7fb8f2d9d700 1 -- 172.21.15.111:0/543789596 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb8f4062590 msgr2=0x7fb8f4066d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:30.611 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.605+0000 7fb8f2d9d700 1 --2- 172.21.15.111:0/543789596 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb8f4062590 0x7fb8f4066d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:30.612 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.605+0000 7fb8f2d9d700 1 -- 172.21.15.111:0/543789596 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8e400b1e0 con 0x7fb8f4136800 2024-04-25T02:20:30.612 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.605+0000 7fb8f1d9b700 1 --2- 172.21.15.111:0/543789596 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb8f40633b0 0x7fb8f4149140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:30.612 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.605+0000 7fb8f259c700 1 --2- 172.21.15.111:0/543789596 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb8f4062590 0x7fb8f4066d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:30.612 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.605+0000 7fb8f2d9d700 1 --2- 172.21.15.111:0/543789596 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb8f4136800 0x7fb8f4149630 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fb8ec0032f0 tx=0x7fb8ec016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:30.612 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.605+0000 7fb8e37fe700 1 -- 172.21.15.111:0/543789596 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8ec00b660 con 0x7fb8f4136800 2024-04-25T02:20:30.612 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.605+0000 7fb8e37fe700 1 -- 172.21.15.111:0/543789596 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8ec00b030 con 0x7fb8f4136800 2024-04-25T02:20:30.612 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.605+0000 7fb8f8a47700 1 -- 172.21.15.111:0/543789596 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8ec009470 con 0x7fb8f4136800 2024-04-25T02:20:30.612 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.605+0000 7fb8e37fe700 1 -- 172.21.15.111:0/543789596 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb8ec021860 con 0x7fb8f4136800 2024-04-25T02:20:30.612 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.605+0000 7fb8f8a47700 1 -- 172.21.15.111:0/543789596 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8f4067db0 con 0x7fb8f4136800 2024-04-25T02:20:30.612 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.606+0000 7fb8e37fe700 1 -- 172.21.15.111:0/543789596 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fb8ec028070 con 0x7fb8f4136800 2024-04-25T02:20:30.612 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.606+0000 7fb8f8a47700 1 -- 172.21.15.111:0/543789596 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8f4066ab0 con 0x7fb8f4136800 2024-04-25T02:20:30.612 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.607+0000 7fb8e37fe700 1 -- 172.21.15.111:0/543789596 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fb8ec04b330 con 0x7fb8f4136800 2024-04-25T02:20:30.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.610+0000 7fb8e37fe700 1 -- 172.21.15.111:0/543789596 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fb8ec005a70 con 0x7fb8f4136800 2024-04-25T02:20:30.643 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.639+0000 7f50765cf700 1 Processor -- start 2024-04-25T02:20:30.643 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.639+0000 7f50765cf700 1 -- start start 2024-04-25T02:20:30.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.640+0000 7f50765cf700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f5070136800 0x7f50700642e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:30.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.640+0000 7f50765cf700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f50700633b0 0x7f5070136be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:30.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.640+0000 7f50765cf700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f50701363d0 con 0x7f5070062590 2024-04-25T02:20:30.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.640+0000 7f50765cf700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f50700647d0 con 0x7f5070136800 2024-04-25T02:20:30.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.640+0000 7f50765cf700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5070136600 con 0x7f50700633b0 2024-04-25T02:20:30.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.640+0000 7f506f7fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f50700633b0 0x7f5070136be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:30.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.640+0000 7f506f7fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f50700633b0 0x7f5070136be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:51352/0 (socket says 172.21.15.111:51352) 2024-04-25T02:20:30.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.640+0000 7f5074b6c700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f5070062590 0x7f50700a82a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:55812/0 (socket says 172.21.15.111:55812) 2024-04-25T02:20:30.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.640+0000 7f506f7fe700 1 -- 172.21.15.111:0/1150697608 learned_addr learned my addr 172.21.15.111:0/1150697608 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:30.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.640+0000 7f506ffff700 1 --2- 172.21.15.111:0/1150697608 >> v2:172.21.15.111:3300/0 conn(0x7f5070136800 0x7f50700642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:30.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.640+0000 7f506f7fe700 1 -- 172.21.15.111:0/1150697608 >> v2:172.21.15.111:3300/0 conn(0x7f5070136800 msgr2=0x7f50700642e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:30.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.640+0000 7f506f7fe700 1 --2- 172.21.15.111:0/1150697608 >> v2:172.21.15.111:3300/0 conn(0x7f5070136800 0x7f50700642e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:30.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.640+0000 7f506f7fe700 1 -- 172.21.15.111:0/1150697608 >> v1:172.21.15.111:6789/0 conn(0x7f5070062590 legacy=0x7f50700a82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:30.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.640+0000 7f506f7fe700 1 -- 172.21.15.111:0/1150697608 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50700a9d70 con 0x7f50700633b0 2024-04-25T02:20:30.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.640+0000 7f506f7fe700 1 --2- 172.21.15.111:0/1150697608 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f50700633b0 0x7f5070136be0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f5064002f70 tx=0x7f5064006eb0).ready entity=mon.1 client_cookie=e9f88feb53829d0f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:30.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.641+0000 7f506effd700 1 -- 172.21.15.111:0/1150697608 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f506400d570 con 0x7f50700633b0 2024-04-25T02:20:30.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.641+0000 7f506effd700 1 -- 172.21.15.111:0/1150697608 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5064000e90 con 0x7f50700633b0 2024-04-25T02:20:30.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.641+0000 7f506effd700 1 -- 172.21.15.111:0/1150697608 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f506400d900 con 0x7f50700633b0 2024-04-25T02:20:30.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.641+0000 7f50765cf700 1 -- 172.21.15.111:0/1150697608 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f50700633b0 msgr2=0x7f5070136be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:30.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.641+0000 7f50765cf700 1 --2- 172.21.15.111:0/1150697608 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f50700633b0 0x7f5070136be0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f5064002f70 tx=0x7f5064006eb0).stop 2024-04-25T02:20:30.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.641+0000 7f50765cf700 1 -- 172.21.15.111:0/1150697608 shutdown_connections 2024-04-25T02:20:30.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.641+0000 7f50765cf700 1 --2- 172.21.15.111:0/1150697608 >> v2:172.21.15.111:3300/0 conn(0x7f5070136800 0x7f50700642e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:30.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.641+0000 7f50765cf700 1 --2- 172.21.15.111:0/1150697608 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f50700633b0 0x7f5070136be0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:30.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.641+0000 7f50765cf700 1 -- 172.21.15.111:0/1150697608 >> 172.21.15.111:0/1150697608 conn(0x7f50700614e0 msgr2=0x7f507006c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:30.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.641+0000 7f50765cf700 1 -- 172.21.15.111:0/1150697608 shutdown_connections 2024-04-25T02:20:30.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.641+0000 7f50765cf700 1 -- 172.21.15.111:0/1150697608 wait complete. 2024-04-25T02:20:30.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.642+0000 7f50765cf700 1 Processor -- start 2024-04-25T02:20:30.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.642+0000 7f50765cf700 1 -- start start 2024-04-25T02:20:30.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.643+0000 7f50765cf700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5070062590 0x7f50700966e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:30.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.643+0000 7f50765cf700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f50700633b0 0x7f5070097b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:30.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.643+0000 7f50765cf700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5070136800 0x7f5070096f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:30.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.643+0000 7f50765cf700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5070145f80 con 0x7f5070062590 2024-04-25T02:20:30.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.643+0000 7f50765cf700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5070146240 con 0x7f5070136800 2024-04-25T02:20:30.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.643+0000 7f50765cf700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5070145b60 con 0x7f50700633b0 2024-04-25T02:20:30.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.643+0000 7f5074b6c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5070136800 0x7f5070096f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:30.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.643+0000 7f5074b6c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5070136800 0x7f5070096f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:51360/0 (socket says 172.21.15.111:51360) 2024-04-25T02:20:30.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.643+0000 7f5074b6c700 1 -- 172.21.15.111:0/2857620855 learned_addr learned my addr 172.21.15.111:0/2857620855 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:30.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.643+0000 7f506ffff700 1 --2- 172.21.15.111:0/2857620855 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5070062590 0x7f50700966e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:30.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.643+0000 7f506f7fe700 1 --2- 172.21.15.111:0/2857620855 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f50700633b0 0x7f5070097b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:30.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.644+0000 7f5074b6c700 1 -- 172.21.15.111:0/2857620855 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f50700633b0 msgr2=0x7f5070097b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:30.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.644+0000 7f5074b6c700 1 --2- 172.21.15.111:0/2857620855 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f50700633b0 0x7f5070097b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:30.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.644+0000 7f5074b6c700 1 -- 172.21.15.111:0/2857620855 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5070062590 msgr2=0x7f50700966e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:30.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.644+0000 7f5074b6c700 1 --2- 172.21.15.111:0/2857620855 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5070062590 0x7f50700966e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:30.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.644+0000 7f5074b6c700 1 -- 172.21.15.111:0/2857620855 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f506400b1e0 con 0x7f5070136800 2024-04-25T02:20:30.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.644+0000 7f506ffff700 1 --2- 172.21.15.111:0/2857620855 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5070062590 0x7f50700966e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:30.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.644+0000 7f5074b6c700 1 --2- 172.21.15.111:0/2857620855 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5070136800 0x7f5070096f80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f50700a9320 tx=0x7f5068007f40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:30.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.644+0000 7f506d7fa700 1 -- 172.21.15.111:0/2857620855 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5068005ae0 con 0x7f5070136800 2024-04-25T02:20:30.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.644+0000 7f506d7fa700 1 -- 172.21.15.111:0/2857620855 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5068005c40 con 0x7f5070136800 2024-04-25T02:20:30.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.644+0000 7f50765cf700 1 -- 172.21.15.111:0/2857620855 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5070097470 con 0x7f5070136800 2024-04-25T02:20:30.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.644+0000 7f506d7fa700 1 -- 172.21.15.111:0/2857620855 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f50680070d0 con 0x7f5070136800 2024-04-25T02:20:30.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.644+0000 7f50765cf700 1 -- 172.21.15.111:0/2857620855 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5070098ee0 con 0x7f5070136800 2024-04-25T02:20:30.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.645+0000 7f50765cf700 1 -- 172.21.15.111:0/2857620855 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5070057a60 con 0x7f5070136800 2024-04-25T02:20:30.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.645+0000 7f506d7fa700 1 -- 172.21.15.111:0/2857620855 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f506801a060 con 0x7f5070136800 2024-04-25T02:20:30.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.645+0000 7f506d7fa700 1 -- 172.21.15.111:0/2857620855 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f506804a290 con 0x7f5070136800 2024-04-25T02:20:30.652 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.648+0000 7f506d7fa700 1 -- 172.21.15.111:0/2857620855 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f506802f190 con 0x7f5070136800 2024-04-25T02:20:30.713 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.709+0000 7f53e6b9a700 1 Processor -- start 2024-04-25T02:20:30.713 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.709+0000 7f53e6b9a700 1 -- start start 2024-04-25T02:20:30.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.710+0000 7f53e6b9a700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f53e01363c0 0x7f53e00a1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:30.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.710+0000 7f53e6b9a700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f53e013ba00 0x7f53e013ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:30.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.710+0000 7f53e6b9a700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53e00a1c60 con 0x7f53e01367a0 2024-04-25T02:20:30.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.710+0000 7f53e6b9a700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53e00a1540 con 0x7f53e013ba00 2024-04-25T02:20:30.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.710+0000 7f53e6b9a700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f53e00a25a0 con 0x7f53e01363c0 2024-04-25T02:20:30.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.710+0000 7f53e4936700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f53e01363c0 0x7f53e00a1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:30.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.710+0000 7f53dffff700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f53e01367a0 0x7f53e0136be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:55820/0 (socket says 172.21.15.111:55820) 2024-04-25T02:20:30.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.710+0000 7f53e4936700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f53e01363c0 0x7f53e00a1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:57030/0 (socket says 172.21.15.111:57030) 2024-04-25T02:20:30.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.710+0000 7f53dffff700 1 -- 172.21.15.111:0/2402806752 learned_addr learned my addr 172.21.15.111:0/2402806752 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:20:30.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.710+0000 7f53e5137700 1 --2- 172.21.15.111:0/2402806752 >> v2:172.21.15.111:3300/0 conn(0x7f53e013ba00 0x7f53e013ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:30.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.710+0000 7f53e5137700 1 -- 172.21.15.111:0/2402806752 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f53e01363c0 msgr2=0x7f53e00a1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:30.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.710+0000 7f53e5137700 1 --2- 172.21.15.111:0/2402806752 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f53e01363c0 0x7f53e00a1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:30.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.710+0000 7f53e5137700 1 -- 172.21.15.111:0/2402806752 >> v1:172.21.15.111:6789/0 conn(0x7f53e01367a0 legacy=0x7f53e0136be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:30.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.710+0000 7f53df7fe700 1 -- 172.21.15.111:0/2402806752 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3799622762 0 0) 0x7f53e00a1c60 con 0x7f53e01367a0 2024-04-25T02:20:30.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.710+0000 7f53e5137700 1 -- 172.21.15.111:0/2402806752 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53e00a2860 con 0x7f53e013ba00 2024-04-25T02:20:30.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.710+0000 7f53e4936700 1 --2- 172.21.15.111:0/2402806752 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f53e01363c0 0x7f53e00a1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:30.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.710+0000 7f53e5137700 1 --2- 172.21.15.111:0/2402806752 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f53e013ba00 0x7f53e013ddf0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f53d80032f0 tx=0x7f53d80091d0).ready entity=mon.0 client_cookie=87800a2eb03b1379 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:30.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.711+0000 7f53df7fe700 1 -- 172.21.15.111:0/2402806752 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53d800b6c0 con 0x7f53e013ba00 2024-04-25T02:20:30.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.711+0000 7f53df7fe700 1 -- 172.21.15.111:0/2402806752 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53d800b820 con 0x7f53e013ba00 2024-04-25T02:20:30.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.711+0000 7f53df7fe700 1 -- 172.21.15.111:0/2402806752 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53d800b990 con 0x7f53e013ba00 2024-04-25T02:20:30.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.711+0000 7f53e6b9a700 1 -- 172.21.15.111:0/2402806752 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f53e013ba00 msgr2=0x7f53e013ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:30.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.711+0000 7f53e6b9a700 1 --2- 172.21.15.111:0/2402806752 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f53e013ba00 0x7f53e013ddf0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f53d80032f0 tx=0x7f53d80091d0).stop 2024-04-25T02:20:30.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.711+0000 7f53e6b9a700 1 -- 172.21.15.111:0/2402806752 shutdown_connections 2024-04-25T02:20:30.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.711+0000 7f53e6b9a700 1 --2- 172.21.15.111:0/2402806752 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f53e013ba00 0x7f53e013ddf0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:30.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.711+0000 7f53e6b9a700 1 --2- 172.21.15.111:0/2402806752 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f53e01363c0 0x7f53e00a1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:30.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.711+0000 7f53e6b9a700 1 -- 172.21.15.111:0/2402806752 >> 172.21.15.111:0/2402806752 conn(0x7f53e00a8a00 msgr2=0x7f53e00a8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:30.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.711+0000 7f53e6b9a700 1 -- 172.21.15.111:0/2402806752 shutdown_connections 2024-04-25T02:20:30.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.711+0000 7f53e6b9a700 1 -- 172.21.15.111:0/2402806752 wait complete. 2024-04-25T02:20:30.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.712+0000 7f53e6b9a700 1 Processor -- start 2024-04-25T02:20:30.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.712+0000 7f53e6b9a700 1 -- start start 2024-04-25T02:20:30.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.712+0000 7f9f15c12700 1 Processor -- start 2024-04-25T02:20:30.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.712+0000 7f9f15c12700 1 -- start start 2024-04-25T02:20:30.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.713+0000 7f9f15c12700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f9f1005c1a0 0x7f9f10067040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:30.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.713+0000 7f9f15c12700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9f10067c20 0x7f9f1005c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:30.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.713+0000 7f53e6b9a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f53e01363c0 0x7f53e013b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:30.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.713+0000 7f53e6b9a700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f53e01367a0 0x7f53e0155ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:30.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.713+0000 7f53e6b9a700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f53e013ba00 0x7f53e01529c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:30.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.713+0000 7f53e6b9a700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e013b7e0 con 0x7f53e01363c0 2024-04-25T02:20:30.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.713+0000 7f53e6b9a700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53e01502c0 con 0x7f53e01367a0 2024-04-25T02:20:30.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.713+0000 7f53e6b9a700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f53e0065100 con 0x7f53e013ba00 2024-04-25T02:20:30.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.713+0000 7f9f15c12700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f10065c90 con 0x7f9f10066170 2024-04-25T02:20:30.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.713+0000 7f9f15c12700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f1005ca70 con 0x7f9f1005c1a0 2024-04-25T02:20:30.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.713+0000 7f9f15c12700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f10067680 con 0x7f9f10067c20 2024-04-25T02:20:30.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.714+0000 7f9f0ffff700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f9f10066170 0x7f9f10136350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:55822/0 (socket says 172.21.15.111:55822) 2024-04-25T02:20:30.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.714+0000 7f9f0ffff700 1 -- 172.21.15.111:0/1442527940 learned_addr learned my addr 172.21.15.111:0/1442527940 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:20:30.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.714+0000 7f53e5137700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f53e013ba00 0x7f53e01529c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:30.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.714+0000 7f53e5137700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f53e013ba00 0x7f53e01529c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:57046/0 (socket says 172.21.15.111:57046) 2024-04-25T02:20:30.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.714+0000 7f53e5137700 1 -- 172.21.15.111:0/1515485140 learned_addr learned my addr 172.21.15.111:0/1515485140 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:30.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.714+0000 7f9f0effd700 1 --2- 172.21.15.111:0/1442527940 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9f10067c20 0x7f9f1005c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:30.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.714+0000 7f53dffff700 1 --2- 172.21.15.111:0/1515485140 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f53e01367a0 0x7f53e0155ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:30.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.714+0000 7f53e4936700 1 --2- 172.21.15.111:0/1515485140 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f53e01363c0 0x7f53e013b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:30.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.714+0000 7f9f0effd700 1 -- 172.21.15.111:0/1442527940 >> v2:172.21.15.111:3300/0 conn(0x7f9f1005c1a0 msgr2=0x7f9f10067040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:30.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.714+0000 7f9f0effd700 1 --2- 172.21.15.111:0/1442527940 >> v2:172.21.15.111:3300/0 conn(0x7f9f1005c1a0 0x7f9f10067040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-25T02:20:30.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.714+0000 7f9f0effd700 1 -- 172.21.15.111:0/1442527940 >> v1:172.21.15.111:6789/0 conn(0x7f9f10066170 legacy=0x7f9f10136350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:30.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.714+0000 7f9f0effd700 1 -- 172.21.15.111:0/1442527940 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f1005ba50 con 0x7f9f10067c20 2024-04-25T02:20:30.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.714+0000 7f53dffff700 1 -- 172.21.15.111:0/1515485140 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f53e013ba00 msgr2=0x7f53e01529c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:30.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.714+0000 7f53dffff700 1 --2- 172.21.15.111:0/1515485140 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f53e013ba00 0x7f53e01529c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:30.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.714+0000 7f53dffff700 1 -- 172.21.15.111:0/1515485140 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f53e01363c0 msgr2=0x7f53e013b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:30.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.714+0000 7f53dffff700 1 --2- 172.21.15.111:0/1515485140 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f53e01363c0 0x7f53e013b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:30.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.714+0000 7f53dffff700 1 -- 172.21.15.111:0/1515485140 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d400b180 con 0x7f53e01367a0 2024-04-25T02:20:30.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.714+0000 7f9f0effd700 1 --2- 172.21.15.111:0/1442527940 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9f10067c20 0x7f9f1005c580 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f9f10066f90 tx=0x7f9f04006df0).ready entity=mon.1 client_cookie=3634b19da21faaed server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:30.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.714+0000 7f53dffff700 1 --2- 172.21.15.111:0/1515485140 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f53e01367a0 0x7f53e0155ec0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f53e0065830 tx=0x7f53cc0079e0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:30.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.714+0000 7f9f0e7fc700 1 -- 172.21.15.111:0/1442527940 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f0400d570 con 0x7f9f10067c20 2024-04-25T02:20:30.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.714+0000 7f9f0e7fc700 1 -- 172.21.15.111:0/1442527940 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f04000e90 con 0x7f9f10067c20 2024-04-25T02:20:30.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.714+0000 7f9f0e7fc700 1 -- 172.21.15.111:0/1442527940 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f0400d8c0 con 0x7f9f10067c20 2024-04-25T02:20:30.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.714+0000 7f53ddffb700 1 -- 172.21.15.111:0/1515485140 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53cc00ce70 con 0x7f53e01367a0 2024-04-25T02:20:30.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.715+0000 7f53e6b9a700 1 -- 172.21.15.111:0/1515485140 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53d8009470 con 0x7f53e01367a0 2024-04-25T02:20:30.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.715+0000 7f53e6b9a700 1 -- 172.21.15.111:0/1515485140 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53e0063520 con 0x7f53e01367a0 2024-04-25T02:20:30.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.715+0000 7f53ddffb700 1 -- 172.21.15.111:0/1515485140 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53cc0070d0 con 0x7f53e01367a0 2024-04-25T02:20:30.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.715+0000 7f53ddffb700 1 -- 172.21.15.111:0/1515485140 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f53cc007240 con 0x7f53e01367a0 2024-04-25T02:20:30.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.715+0000 7f9f15c12700 1 -- 172.21.15.111:0/1442527940 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9f10067c20 msgr2=0x7f9f1005c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:30.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.715+0000 7f9f15c12700 1 --2- 172.21.15.111:0/1442527940 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9f10067c20 0x7f9f1005c580 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f9f10066f90 tx=0x7f9f04006df0).stop 2024-04-25T02:20:30.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.715+0000 7f9f15c12700 1 -- 172.21.15.111:0/1442527940 shutdown_connections 2024-04-25T02:20:30.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.715+0000 7f9f15c12700 1 --2- 172.21.15.111:0/1442527940 >> v2:172.21.15.111:3300/0 conn(0x7f9f1005c1a0 0x7f9f10067040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-04-25T02:20:30.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.715+0000 7f9f15c12700 1 --2- 172.21.15.111:0/1442527940 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9f10067c20 0x7f9f1005c580 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:30.726 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.715+0000 7f9f15c12700 1 -- 172.21.15.111:0/1442527940 >> 172.21.15.111:0/1442527940 conn(0x7f9f100a8a00 msgr2=0x7f9f100a8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:30.726 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.716+0000 7f9f15c12700 1 -- 172.21.15.111:0/1442527940 shutdown_connections 2024-04-25T02:20:30.726 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.716+0000 7f9f15c12700 1 -- 172.21.15.111:0/1442527940 wait complete. 2024-04-25T02:20:30.726 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.716+0000 7f53ddffb700 1 -- 172.21.15.111:0/1515485140 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f53cc010070 con 0x7f53e01367a0 2024-04-25T02:20:30.726 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.716+0000 7f53ddffb700 1 -- 172.21.15.111:0/1515485140 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f53cc049c40 con 0x7f53e01367a0 2024-04-25T02:20:30.726 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.716+0000 7f9f15c12700 1 Processor -- start 2024-04-25T02:20:30.727 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.716+0000 7f53e6b9a700 1 -- 172.21.15.111:0/1515485140 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53e0063360 con 0x7f53e01367a0 2024-04-25T02:20:30.728 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.717+0000 7f9f15c12700 1 -- start start 2024-04-25T02:20:30.728 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.717+0000 7f9f15c12700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9f1005c1a0 0x7f9f1009c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:30.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.717+0000 7f9f15c12700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9f10066170 0x7f9f1009d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:30.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.717+0000 7f9f15c12700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9f10067c20 0x7f9f1014a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:30.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.717+0000 7f9f15c12700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f10061880 con 0x7f9f1005c1a0 2024-04-25T02:20:30.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.717+0000 7f9f15c12700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f1009dac0 con 0x7f9f10066170 2024-04-25T02:20:30.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.717+0000 7f9f15c12700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9f10061ab0 con 0x7f9f10067c20 2024-04-25T02:20:30.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.718+0000 7f9f0ffff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9f10067c20 0x7f9f1014a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:30.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.718+0000 7f9f0ffff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9f10067c20 0x7f9f1014a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:57058/0 (socket says 172.21.15.111:57058) 2024-04-25T02:20:30.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.718+0000 7f9f0ffff700 1 -- 172.21.15.111:0/789902287 learned_addr learned my addr 172.21.15.111:0/789902287 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:30.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.718+0000 7f9f0ffff700 1 -- 172.21.15.111:0/789902287 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9f10066170 msgr2=0x7f9f1009d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:30.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.718+0000 7f9f0ffff700 1 --2- 172.21.15.111:0/789902287 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9f10066170 0x7f9f1009d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-25T02:20:30.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.718+0000 7f9f0ffff700 1 -- 172.21.15.111:0/789902287 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9f1005c1a0 msgr2=0x7f9f1009c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:30.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.718+0000 7f9f0ffff700 1 --2- 172.21.15.111:0/789902287 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9f1005c1a0 0x7f9f1009c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-25T02:20:30.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.718+0000 7f9f0ffff700 1 -- 172.21.15.111:0/789902287 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f0400b180 con 0x7f9f10067c20 2024-04-25T02:20:30.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.718+0000 7f9f0ffff700 1 --2- 172.21.15.111:0/789902287 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9f10067c20 0x7f9f1014a0b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f9f1009dc50 tx=0x7f9f08004a90).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:30.729 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.718+0000 7f9f0cff9700 1 -- 172.21.15.111:0/789902287 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f08005ba0 con 0x7f9f10067c20 2024-04-25T02:20:30.730 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.718+0000 7f9f0cff9700 1 -- 172.21.15.111:0/789902287 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9f08005d00 con 0x7f9f10067c20 2024-04-25T02:20:30.730 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.718+0000 7f9f15c12700 1 -- 172.21.15.111:0/789902287 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f10061d70 con 0x7f9f10067c20 2024-04-25T02:20:30.730 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.718+0000 7f9f0cff9700 1 -- 172.21.15.111:0/789902287 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9f080072c0 con 0x7f9f10067c20 2024-04-25T02:20:30.730 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.718+0000 7f9f15c12700 1 -- 172.21.15.111:0/789902287 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f1009ca20 con 0x7f9f10067c20 2024-04-25T02:20:30.730 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.719+0000 7f9f15c12700 1 -- 172.21.15.111:0/789902287 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f1005e4b0 con 0x7f9f10067c20 2024-04-25T02:20:30.730 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.720+0000 7f9f0cff9700 1 -- 172.21.15.111:0/789902287 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f9f0801a060 con 0x7f9f10067c20 2024-04-25T02:20:30.730 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.720+0000 7f9f0cff9700 1 -- 172.21.15.111:0/789902287 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f9f0804a420 con 0x7f9f10067c20 2024-04-25T02:20:30.730 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.721+0000 7f53ddffb700 1 -- 172.21.15.111:0/1515485140 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f53e0063360 con 0x7f53e01367a0 2024-04-25T02:20:30.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.723+0000 7f9f0cff9700 1 -- 172.21.15.111:0/789902287 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f9f0802f320 con 0x7f9f10067c20 2024-04-25T02:20:30.737 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.733+0000 7fb8f8a47700 1 -- 172.21.15.111:0/543789596 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fb8f406cda0 con 0x7fb8f4136800 2024-04-25T02:20:30.737 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.733+0000 7fb8e37fe700 1 -- 172.21.15.111:0/543789596 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb8ec015020 con 0x7fb8f4136800 2024-04-25T02:20:30.738 INFO:teuthology.orchestra.run.smithi111.stdout:38654705670 2024-04-25T02:20:30.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.735+0000 7fb8f8a47700 1 -- 172.21.15.111:0/543789596 >> v1:172.21.15.111:6816/39585 conn(0x7fb8d0038da0 legacy=0x7fb8d003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:30.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.735+0000 7fb8f8a47700 1 -- 172.21.15.111:0/543789596 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb8f4136800 msgr2=0x7fb8f4149630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:30.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.735+0000 7fb8f8a47700 1 --2- 172.21.15.111:0/543789596 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb8f4136800 0x7fb8f4149630 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fb8ec0032f0 tx=0x7fb8ec016000).stop 2024-04-25T02:20:30.740 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.735+0000 7fb8f8a47700 1 -- 172.21.15.111:0/543789596 shutdown_connections 2024-04-25T02:20:30.740 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.735+0000 7fb8f8a47700 1 --2- 172.21.15.111:0/543789596 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb8f4136800 0x7fb8f4149630 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:30.740 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.735+0000 7fb8f8a47700 1 --2- 172.21.15.111:0/543789596 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb8f4062590 0x7fb8f4066d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:30.740 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.735+0000 7fb8f8a47700 1 --2- 172.21.15.111:0/543789596 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb8f40633b0 0x7fb8f4149140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:30.740 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.735+0000 7fb8f8a47700 1 -- 172.21.15.111:0/543789596 >> 172.21.15.111:0/543789596 conn(0x7fb8f40614e0 msgr2=0x7fb8f406c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:30.740 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.735+0000 7fb8f8a47700 1 -- 172.21.15.111:0/543789596 shutdown_connections 2024-04-25T02:20:30.740 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.735+0000 7fb8f8a47700 1 -- 172.21.15.111:0/543789596 wait complete. 2024-04-25T02:20:30.750 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705670 got 38654705670 for osd.1 2024-04-25T02:20:30.750 DEBUG:teuthology.parallel:result is None 2024-04-25T02:20:30.774 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.770+0000 7f50765cf700 1 -- 172.21.15.111:0/2857620855 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f50700a9fd0 con 0x7f5070136800 2024-04-25T02:20:30.774 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.771+0000 7f506d7fa700 1 -- 172.21.15.111:0/2857620855 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f5068018030 con 0x7f5070136800 2024-04-25T02:20:30.775 INFO:teuthology.orchestra.run.smithi111.stdout:38654705669 2024-04-25T02:20:30.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.772+0000 7f50765cf700 1 -- 172.21.15.111:0/2857620855 >> v1:172.21.15.111:6816/39585 conn(0x7f5050038da0 legacy=0x7f505003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:30.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.772+0000 7f50765cf700 1 -- 172.21.15.111:0/2857620855 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5070136800 msgr2=0x7f5070096f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:30.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.772+0000 7f50765cf700 1 --2- 172.21.15.111:0/2857620855 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5070136800 0x7f5070096f80 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f50700a9320 tx=0x7f5068007f40).stop 2024-04-25T02:20:30.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.772+0000 7f50765cf700 1 -- 172.21.15.111:0/2857620855 shutdown_connections 2024-04-25T02:20:30.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.772+0000 7f50765cf700 1 --2- 172.21.15.111:0/2857620855 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5070136800 0x7f5070096f80 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:30.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.772+0000 7f50765cf700 1 --2- 172.21.15.111:0/2857620855 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5070062590 0x7f50700966e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:30.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.772+0000 7f50765cf700 1 --2- 172.21.15.111:0/2857620855 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f50700633b0 0x7f5070097b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:30.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.772+0000 7f50765cf700 1 -- 172.21.15.111:0/2857620855 >> 172.21.15.111:0/2857620855 conn(0x7f50700614e0 msgr2=0x7f50700a77b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:30.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.772+0000 7f50765cf700 1 -- 172.21.15.111:0/2857620855 shutdown_connections 2024-04-25T02:20:30.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.772+0000 7f50765cf700 1 -- 172.21.15.111:0/2857620855 wait complete. 2024-04-25T02:20:30.787 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.3 2024-04-25T02:20:30.787 DEBUG:teuthology.parallel:result is None 2024-04-25T02:20:30.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.857+0000 7f53e6b9a700 1 -- 172.21.15.111:0/1515485140 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f53e0063360 con 0x7f53e01367a0 2024-04-25T02:20:30.862 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.857+0000 7f53ddffb700 1 -- 172.21.15.111:0/1515485140 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f53e0063360 con 0x7f53e01367a0 2024-04-25T02:20:30.862 INFO:teuthology.orchestra.run.smithi111.stdout:38654705671 2024-04-25T02:20:30.862 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.858+0000 7f9f15c12700 1 -- 172.21.15.111:0/789902287 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f9f10057a60 con 0x7f9f10067c20 2024-04-25T02:20:30.862 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.859+0000 7f9f0cff9700 1 -- 172.21.15.111:0/789902287 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9f08018030 con 0x7f9f10067c20 2024-04-25T02:20:30.863 INFO:teuthology.orchestra.run.smithi111.stdout:38654705669 2024-04-25T02:20:30.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.859+0000 7f53e6b9a700 1 -- 172.21.15.111:0/1515485140 >> v1:172.21.15.111:6816/39585 conn(0x7f53c0038da0 legacy=0x7f53c003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:30.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.859+0000 7f53e6b9a700 1 -- 172.21.15.111:0/1515485140 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f53e01367a0 msgr2=0x7f53e0155ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:30.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.859+0000 7f53e6b9a700 1 --2- 172.21.15.111:0/1515485140 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f53e01367a0 0x7f53e0155ec0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f53e0065830 tx=0x7f53cc0079e0).stop 2024-04-25T02:20:30.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.859+0000 7f53e6b9a700 1 -- 172.21.15.111:0/1515485140 shutdown_connections 2024-04-25T02:20:30.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.859+0000 7f53e6b9a700 1 --2- 172.21.15.111:0/1515485140 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f53e013ba00 0x7f53e01529c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:30.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.859+0000 7f53e6b9a700 1 --2- 172.21.15.111:0/1515485140 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f53e01363c0 0x7f53e013b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:30.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.859+0000 7f53e6b9a700 1 --2- 172.21.15.111:0/1515485140 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f53e01367a0 0x7f53e0155ec0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:30.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.859+0000 7f53e6b9a700 1 -- 172.21.15.111:0/1515485140 >> 172.21.15.111:0/1515485140 conn(0x7f53e00a8a00 msgr2=0x7f53e00a6f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:30.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.859+0000 7f53e6b9a700 1 -- 172.21.15.111:0/1515485140 shutdown_connections 2024-04-25T02:20:30.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.859+0000 7f53e6b9a700 1 -- 172.21.15.111:0/1515485140 wait complete. 2024-04-25T02:20:30.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.860+0000 7f9f15c12700 1 -- 172.21.15.111:0/789902287 >> v1:172.21.15.111:6816/39585 conn(0x7f9ef0038da0 legacy=0x7f9ef003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:30.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.860+0000 7f9f15c12700 1 -- 172.21.15.111:0/789902287 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9f10067c20 msgr2=0x7f9f1014a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:30.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.860+0000 7f9f15c12700 1 --2- 172.21.15.111:0/789902287 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9f10067c20 0x7f9f1014a0b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f9f1009dc50 tx=0x7f9f08004a90).stop 2024-04-25T02:20:30.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.860+0000 7f9f15c12700 1 -- 172.21.15.111:0/789902287 shutdown_connections 2024-04-25T02:20:30.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.860+0000 7f9f15c12700 1 --2- 172.21.15.111:0/789902287 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9f10067c20 0x7f9f1014a0b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:30.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.860+0000 7f9f15c12700 1 --2- 172.21.15.111:0/789902287 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9f1005c1a0 0x7f9f1009c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-25T02:20:30.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.860+0000 7f9f15c12700 1 --2- 172.21.15.111:0/789902287 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9f10066170 0x7f9f1009d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-25T02:20:30.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.860+0000 7f9f15c12700 1 -- 172.21.15.111:0/789902287 >> 172.21.15.111:0/789902287 conn(0x7f9f100a8a00 msgr2=0x7f9f100a4720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:30.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.860+0000 7f9f15c12700 1 -- 172.21.15.111:0/789902287 shutdown_connections 2024-04-25T02:20:30.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.860+0000 7f9f15c12700 1 -- 172.21.15.111:0/789902287 wait complete. 2024-04-25T02:20:30.874 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705671 got 38654705671 for osd.2 2024-04-25T02:20:30.875 DEBUG:teuthology.parallel:result is None 2024-04-25T02:20:30.875 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.0 2024-04-25T02:20:30.875 DEBUG:teuthology.parallel:result is None 2024-04-25T02:20:30.875 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T02:20:30.876 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:20:30.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.973+0000 7ff739121700 1 Processor -- start 2024-04-25T02:20:30.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.973+0000 7ff739121700 1 -- start start 2024-04-25T02:20:30.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.974+0000 7ff739121700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff734139c10 0x7ff734139ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:30.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.974+0000 7ff739121700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7ff734097580 0x7ff73405ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:30.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.974+0000 7ff739121700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff734097960 0x7ff73405bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:30.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.974+0000 7ff739121700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff734099610 con 0x7ff734097580 2024-04-25T02:20:30.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.974+0000 7ff739121700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff73413a4e0 con 0x7ff734097960 2024-04-25T02:20:30.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.974+0000 7ff739121700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff734096f80 con 0x7ff734139c10 2024-04-25T02:20:30.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.974+0000 7ff73359e700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff734097960 0x7ff73405bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:30.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.974+0000 7ff73259c700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7ff734097580 0x7ff73405ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:30.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.974+0000 7ff732d9d700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff734139c10 0x7ff734139ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:30.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.974+0000 7ff73259c700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7ff734097580 0x7ff73405ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48278/0 (socket says 172.21.15.111:48278) 2024-04-25T02:20:30.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.974+0000 7ff73359e700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff734097960 0x7ff73405bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:51390/0 (socket says 172.21.15.111:51390) 2024-04-25T02:20:30.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.974+0000 7ff73259c700 1 -- 172.21.15.111:0/3003486326 learned_addr learned my addr 172.21.15.111:0/3003486326 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:30.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.974+0000 7ff73259c700 1 -- 172.21.15.111:0/3003486326 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff734139c10 msgr2=0x7ff734139ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:30.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.974+0000 7ff73259c700 1 --2- 172.21.15.111:0/3003486326 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff734139c10 0x7ff734139ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:30.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.974+0000 7ff73259c700 1 -- 172.21.15.111:0/3003486326 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff734097960 msgr2=0x7ff73405bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:30.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.974+0000 7ff73259c700 1 --2- 172.21.15.111:0/3003486326 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff734097960 0x7ff73405bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:30.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.974+0000 7ff73259c700 1 -- 172.21.15.111:0/3003486326 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff734139730 con 0x7ff734097580 2024-04-25T02:20:30.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.974+0000 7ff73359e700 1 --2- 172.21.15.111:0/3003486326 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff734097960 0x7ff73405bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:30.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.974+0000 7ff732d9d700 1 --2- 172.21.15.111:0/3003486326 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff734139c10 0x7ff734139ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:30.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.975+0000 7ff73259c700 1 --2- 172.21.15.111:0/3003486326 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff734097580 0x7ff73405ba50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7ff734060f80 tx=0x7ff724006eb0).ready entity=mon.0 client_cookie=4647411846e9679f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:30.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.975+0000 7ff731d9b700 1 -- 172.21.15.111:0/3003486326 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff72400d570 con 0x7ff734097580 2024-04-25T02:20:30.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.975+0000 7ff731d9b700 1 -- 172.21.15.111:0/3003486326 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff724000e90 con 0x7ff734097580 2024-04-25T02:20:30.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.975+0000 7ff731d9b700 1 -- 172.21.15.111:0/3003486326 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff72400d900 con 0x7ff734097580 2024-04-25T02:20:30.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.975+0000 7ff739121700 1 -- 172.21.15.111:0/3003486326 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff734097580 msgr2=0x7ff73405ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:30.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.975+0000 7ff739121700 1 --2- 172.21.15.111:0/3003486326 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff734097580 0x7ff73405ba50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7ff734060f80 tx=0x7ff724006eb0).stop 2024-04-25T02:20:30.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.975+0000 7ff739121700 1 -- 172.21.15.111:0/3003486326 shutdown_connections 2024-04-25T02:20:30.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.975+0000 7ff739121700 1 --2- 172.21.15.111:0/3003486326 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff734097960 0x7ff73405bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:30.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.975+0000 7ff739121700 1 --2- 172.21.15.111:0/3003486326 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff734139c10 0x7ff734139ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:30.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.975+0000 7ff739121700 1 --2- 172.21.15.111:0/3003486326 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff734097580 0x7ff73405ba50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:30.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.975+0000 7ff739121700 1 -- 172.21.15.111:0/3003486326 >> 172.21.15.111:0/3003486326 conn(0x7ff7340614e0 msgr2=0x7ff73406c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:30.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.975+0000 7ff739121700 1 -- 172.21.15.111:0/3003486326 shutdown_connections 2024-04-25T02:20:30.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.975+0000 7ff739121700 1 -- 172.21.15.111:0/3003486326 wait complete. 2024-04-25T02:20:30.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.976+0000 7ff739121700 1 Processor -- start 2024-04-25T02:20:30.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.976+0000 7ff739121700 1 -- start start 2024-04-25T02:20:30.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.977+0000 7ff739121700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff734097580 0x7ff734149630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:30.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.977+0000 7ff739121700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff734097960 0x7ff7340642c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:30.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.977+0000 7ff739121700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff734139c10 0x7ff734135150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:30.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.977+0000 7ff739121700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff734145a60 con 0x7ff734097960 2024-04-25T02:20:30.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.977+0000 7ff739121700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff734145d00 con 0x7ff734139c10 2024-04-25T02:20:30.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.977+0000 7ff739121700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff734063ae0 con 0x7ff734097580 2024-04-25T02:20:30.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.977+0000 7ff732d9d700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff734097580 0x7ff734149630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:30.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.977+0000 7ff732d9d700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff734097580 0x7ff734149630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:57070/0 (socket says 172.21.15.111:57070) 2024-04-25T02:20:30.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.977+0000 7ff732d9d700 1 -- 172.21.15.111:0/89508850 learned_addr learned my addr 172.21.15.111:0/89508850 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:30.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.977+0000 7ff73359e700 1 --2- 172.21.15.111:0/89508850 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff734139c10 0x7ff734135150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:30.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.977+0000 7ff73259c700 1 --2- 172.21.15.111:0/89508850 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff734097960 0x7ff7340642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:30.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.977+0000 7ff732d9d700 1 -- 172.21.15.111:0/89508850 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff734139c10 msgr2=0x7ff734135150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:30.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.977+0000 7ff732d9d700 1 --2- 172.21.15.111:0/89508850 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff734139c10 0x7ff734135150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:30.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.977+0000 7ff732d9d700 1 -- 172.21.15.111:0/89508850 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff734097960 msgr2=0x7ff7340642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:30.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.977+0000 7ff732d9d700 1 --2- 172.21.15.111:0/89508850 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff734097960 0x7ff7340642c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:30.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.977+0000 7ff732d9d700 1 -- 172.21.15.111:0/89508850 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff72c009470 con 0x7ff734097580 2024-04-25T02:20:30.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.977+0000 7ff73259c700 1 --2- 172.21.15.111:0/89508850 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff734097960 0x7ff7340642c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:20:30.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.977+0000 7ff73359e700 1 --2- 172.21.15.111:0/89508850 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff734139c10 0x7ff734135150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:30.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.977+0000 7ff732d9d700 1 --2- 172.21.15.111:0/89508850 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff734097580 0x7ff734149630 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7ff72800c000 tx=0x7ff728006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:30.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.977+0000 7ff723fff700 1 -- 172.21.15.111:0/89508850 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff72800c860 con 0x7ff734097580 2024-04-25T02:20:30.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.977+0000 7ff723fff700 1 -- 172.21.15.111:0/89508850 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff72800c9c0 con 0x7ff734097580 2024-04-25T02:20:30.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.977+0000 7ff739121700 1 -- 172.21.15.111:0/89508850 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff72800b180 con 0x7ff734097580 2024-04-25T02:20:30.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.977+0000 7ff723fff700 1 -- 172.21.15.111:0/89508850 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff72800cd20 con 0x7ff734097580 2024-04-25T02:20:30.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.977+0000 7ff739121700 1 -- 172.21.15.111:0/89508850 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff72400b1e0 con 0x7ff734097580 2024-04-25T02:20:30.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.978+0000 7ff723fff700 1 -- 172.21.15.111:0/89508850 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7ff72801c460 con 0x7ff734097580 2024-04-25T02:20:30.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.978+0000 7ff739121700 1 -- 172.21.15.111:0/89508850 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7341399f0 con 0x7ff734097580 2024-04-25T02:20:30.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.978+0000 7ff723fff700 1 -- 172.21.15.111:0/89508850 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7ff72804ae90 con 0x7ff734097580 2024-04-25T02:20:30.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:30.981+0000 7ff723fff700 1 -- 172.21.15.111:0/89508850 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7ff7280337c0 con 0x7ff734097580 2024-04-25T02:20:31.091 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.087+0000 7ff739121700 1 -- 172.21.15.111:0/89508850 --> v1:172.21.15.111:6816/39585 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff734057a60 con 0x7ff710038da0 2024-04-25T02:20:31.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.094+0000 7ff723fff700 1 -- 172.21.15.111:0/89508850 <== mgr.4099 v1:172.21.15.111:6816/39585 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246926 (unknown 2965378022 0 2125796483) 0x7ff734057a60 con 0x7ff710038da0 2024-04-25T02:20:31.101 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:20:31.103 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.096+0000 7ff739121700 1 -- 172.21.15.111:0/89508850 >> v1:172.21.15.111:6816/39585 conn(0x7ff710038da0 legacy=0x7ff71003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:31.103 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.096+0000 7ff739121700 1 -- 172.21.15.111:0/89508850 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff734097580 msgr2=0x7ff734149630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:31.103 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.096+0000 7ff739121700 1 --2- 172.21.15.111:0/89508850 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff734097580 0x7ff734149630 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7ff72800c000 tx=0x7ff728006df0).stop 2024-04-25T02:20:31.103 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.096+0000 7ff739121700 1 -- 172.21.15.111:0/89508850 shutdown_connections 2024-04-25T02:20:31.103 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.096+0000 7ff739121700 1 --2- 172.21.15.111:0/89508850 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff734139c10 0x7ff734135150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:31.103 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.096+0000 7ff739121700 1 --2- 172.21.15.111:0/89508850 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff734097580 0x7ff734149630 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:31.103 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.096+0000 7ff739121700 1 --2- 172.21.15.111:0/89508850 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff734097960 0x7ff7340642c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:31.103 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.096+0000 7ff739121700 1 -- 172.21.15.111:0/89508850 >> 172.21.15.111:0/89508850 conn(0x7ff7340614e0 msgr2=0x7ff7340a79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:31.103 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.096+0000 7ff739121700 1 -- 172.21.15.111:0/89508850 shutdown_connections 2024-04-25T02:20:31.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.096+0000 7ff739121700 1 -- 172.21.15.111:0/89508850 wait complete. 2024-04-25T02:20:31.104 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2024-04-25T02:20:31.110 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-04-25T02:20:29.437734+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3633,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":4195056,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292304,"statfs":{"total":386547056640,"available":382251319296,"internally_reserved":4294967296,"allocated":737280,"data_stored":210658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3633,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001070"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.197225+0000","last_change":"2024-04-25T02:20:24.195706+0000","last_active":"2024-04-25T02:20:24.197225+0000","last_peered":"2024-04-25T02:20:24.197225+0000","last_clean":"2024-04-25T02:20:24.197225+0000","last_became_active":"2024-04-25T02:20:24.195349+0000","last_became_peered":"2024-04-25T02:20:24.195349+0000","last_unstale":"2024-04-25T02:20:24.197225+0000","last_undegraded":"2024-04-25T02:20:24.197225+0000","last_fullsized":"2024-04-25T02:20:24.197225+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.183813+0000","last_change":"2024-04-25T02:20:24.170636+0000","last_active":"2024-04-25T02:20:24.183813+0000","last_peered":"2024-04-25T02:20:24.183813+0000","last_clean":"2024-04-25T02:20:24.183813+0000","last_became_active":"2024-04-25T02:20:24.170426+0000","last_became_peered":"2024-04-25T02:20:24.170426+0000","last_unstale":"2024-04-25T02:20:24.183813+0000","last_undegraded":"2024-04-25T02:20:24.183813+0000","last_fullsized":"2024-04-25T02:20:24.183813+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.197995+0000","last_change":"2024-04-25T02:20:24.190781+0000","last_active":"2024-04-25T02:20:24.197995+0000","last_peered":"2024-04-25T02:20:24.197995+0000","last_clean":"2024-04-25T02:20:24.197995+0000","last_became_active":"2024-04-25T02:20:24.190114+0000","last_became_peered":"2024-04-25T02:20:24.190114+0000","last_unstale":"2024-04-25T02:20:24.197995+0000","last_undegraded":"2024-04-25T02:20:24.197995+0000","last_fullsized":"2024-04-25T02:20:24.197995+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.197275+0000","last_change":"2024-04-25T02:20:24.192016+0000","last_active":"2024-04-25T02:20:24.197275+0000","last_peered":"2024-04-25T02:20:24.197275+0000","last_clean":"2024-04-25T02:20:24.197275+0000","last_became_active":"2024-04-25T02:20:24.191694+0000","last_became_peered":"2024-04-25T02:20:24.191694+0000","last_unstale":"2024-04-25T02:20:24.197275+0000","last_undegraded":"2024-04-25T02:20:24.197275+0000","last_fullsized":"2024-04-25T02:20:24.197275+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.198818+0000","last_change":"2024-04-25T02:20:24.195316+0000","last_active":"2024-04-25T02:20:24.198818+0000","last_peered":"2024-04-25T02:20:24.198818+0000","last_clean":"2024-04-25T02:20:24.198818+0000","last_became_active":"2024-04-25T02:20:24.194996+0000","last_became_peered":"2024-04-25T02:20:24.194996+0000","last_unstale":"2024-04-25T02:20:24.198818+0000","last_undegraded":"2024-04-25T02:20:24.198818+0000","last_fullsized":"2024-04-25T02:20:24.198818+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.194022+0000","last_change":"2024-04-25T02:20:24.188215+0000","last_active":"2024-04-25T02:20:24.194022+0000","last_peered":"2024-04-25T02:20:24.194022+0000","last_clean":"2024-04-25T02:20:24.194022+0000","last_became_active":"2024-04-25T02:20:24.186345+0000","last_became_peered":"2024-04-25T02:20:24.186345+0000","last_unstale":"2024-04-25T02:20:24.194022+0000","last_undegraded":"2024-04-25T02:20:24.194022+0000","last_fullsized":"2024-04-25T02:20:24.194022+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.193607+0000","last_change":"2024-04-25T02:20:24.186090+0000","last_active":"2024-04-25T02:20:24.193607+0000","last_peered":"2024-04-25T02:20:24.193607+0000","last_clean":"2024-04-25T02:20:24.193607+0000","last_became_active":"2024-04-25T02:20:24.185481+0000","last_became_peered":"2024-04-25T02:20:24.185481+0000","last_unstale":"2024-04-25T02:20:24.193607+0000","last_undegraded":"2024-04-25T02:20:24.193607+0000","last_fullsized":"2024-04-25T02:20:24.193607+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.187860+0000","last_change":"2024-04-25T02:20:24.176292+0000","last_active":"2024-04-25T02:20:24.187860+0000","last_peered":"2024-04-25T02:20:24.187860+0000","last_clean":"2024-04-25T02:20:24.187860+0000","last_became_active":"2024-04-25T02:20:24.175187+0000","last_became_peered":"2024-04-25T02:20:24.175187+0000","last_unstale":"2024-04-25T02:20:24.187860+0000","last_undegraded":"2024-04-25T02:20:24.187860+0000","last_fullsized":"2024-04-25T02:20:24.187860+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.199827+0000","last_change":"2024-04-25T02:20:24.192327+0000","last_active":"2024-04-25T02:20:24.199827+0000","last_peered":"2024-04-25T02:20:24.199827+0000","last_clean":"2024-04-25T02:20:24.199827+0000","last_became_active":"2024-04-25T02:20:24.191616+0000","last_became_peered":"2024-04-25T02:20:24.191616+0000","last_unstale":"2024-04-25T02:20:24.199827+0000","last_undegraded":"2024-04-25T02:20:24.199827+0000","last_fullsized":"2024-04-25T02:20:24.199827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.187908+0000","last_change":"2024-04-25T02:20:24.178072+0000","last_active":"2024-04-25T02:20:24.187908+0000","last_peered":"2024-04-25T02:20:24.187908+0000","last_clean":"2024-04-25T02:20:24.187908+0000","last_became_active":"2024-04-25T02:20:24.177766+0000","last_became_peered":"2024-04-25T02:20:24.177766+0000","last_unstale":"2024-04-25T02:20:24.187908+0000","last_undegraded":"2024-04-25T02:20:24.187908+0000","last_fullsized":"2024-04-25T02:20:24.187908+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.187027+0000","last_change":"2024-04-25T02:20:24.179040+0000","last_active":"2024-04-25T02:20:24.187027+0000","last_peered":"2024-04-25T02:20:24.187027+0000","last_clean":"2024-04-25T02:20:24.187027+0000","last_became_active":"2024-04-25T02:20:24.178732+0000","last_became_peered":"2024-04-25T02:20:24.178732+0000","last_unstale":"2024-04-25T02:20:24.187027+0000","last_undegraded":"2024-04-25T02:20:24.187027+0000","last_fullsized":"2024-04-25T02:20:24.187027+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.197294+0000","last_change":"2024-04-25T02:20:24.195853+0000","last_active":"2024-04-25T02:20:24.197294+0000","last_peered":"2024-04-25T02:20:24.197294+0000","last_clean":"2024-04-25T02:20:24.197294+0000","last_became_active":"2024-04-25T02:20:24.195544+0000","last_became_peered":"2024-04-25T02:20:24.195544+0000","last_unstale":"2024-04-25T02:20:24.197294+0000","last_undegraded":"2024-04-25T02:20:24.197294+0000","last_fullsized":"2024-04-25T02:20:24.197294+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.199249+0000","last_change":"2024-04-25T02:20:24.196840+0000","last_active":"2024-04-25T02:20:24.199249+0000","last_peered":"2024-04-25T02:20:24.199249+0000","last_clean":"2024-04-25T02:20:24.199249+0000","last_became_active":"2024-04-25T02:20:24.196155+0000","last_became_peered":"2024-04-25T02:20:24.196155+0000","last_unstale":"2024-04-25T02:20:24.199249+0000","last_undegraded":"2024-04-25T02:20:24.199249+0000","last_fullsized":"2024-04-25T02:20:24.199249+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.178645+0000","last_change":"2024-04-25T02:20:24.171853+0000","last_active":"2024-04-25T02:20:24.178645+0000","last_peered":"2024-04-25T02:20:24.178645+0000","last_clean":"2024-04-25T02:20:24.178645+0000","last_became_active":"2024-04-25T02:20:24.171522+0000","last_became_peered":"2024-04-25T02:20:24.171522+0000","last_unstale":"2024-04-25T02:20:24.178645+0000","last_undegraded":"2024-04-25T02:20:24.178645+0000","last_fullsized":"2024-04-25T02:20:24.178645+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.193847+0000","last_change":"2024-04-25T02:20:24.185905+0000","last_active":"2024-04-25T02:20:24.193847+0000","last_peered":"2024-04-25T02:20:24.193847+0000","last_clean":"2024-04-25T02:20:24.193847+0000","last_became_active":"2024-04-25T02:20:24.185440+0000","last_became_peered":"2024-04-25T02:20:24.185440+0000","last_unstale":"2024-04-25T02:20:24.193847+0000","last_undegraded":"2024-04-25T02:20:24.193847+0000","last_fullsized":"2024-04-25T02:20:24.193847+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.187908+0000","last_change":"2024-04-25T02:20:24.183619+0000","last_active":"2024-04-25T02:20:24.187908+0000","last_peered":"2024-04-25T02:20:24.187908+0000","last_clean":"2024-04-25T02:20:24.187908+0000","last_became_active":"2024-04-25T02:20:24.183299+0000","last_became_peered":"2024-04-25T02:20:24.183299+0000","last_unstale":"2024-04-25T02:20:24.187908+0000","last_undegraded":"2024-04-25T02:20:24.187908+0000","last_fullsized":"2024-04-25T02:20:24.187908+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.199849+0000","last_change":"2024-04-25T02:20:24.194408+0000","last_active":"2024-04-25T02:20:24.199849+0000","last_peered":"2024-04-25T02:20:24.199849+0000","last_clean":"2024-04-25T02:20:24.199849+0000","last_became_active":"2024-04-25T02:20:24.192031+0000","last_became_peered":"2024-04-25T02:20:24.192031+0000","last_unstale":"2024-04-25T02:20:24.199849+0000","last_undegraded":"2024-04-25T02:20:24.199849+0000","last_fullsized":"2024-04-25T02:20:24.199849+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.179767+0000","last_change":"2024-04-25T02:20:24.175814+0000","last_active":"2024-04-25T02:20:24.179767+0000","last_peered":"2024-04-25T02:20:24.179767+0000","last_clean":"2024-04-25T02:20:24.179767+0000","last_became_active":"2024-04-25T02:20:24.174411+0000","last_became_peered":"2024-04-25T02:20:24.174411+0000","last_unstale":"2024-04-25T02:20:24.179767+0000","last_undegraded":"2024-04-25T02:20:24.179767+0000","last_fullsized":"2024-04-25T02:20:24.179767+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.197264+0000","last_change":"2024-04-25T02:20:24.195764+0000","last_active":"2024-04-25T02:20:24.197264+0000","last_peered":"2024-04-25T02:20:24.197264+0000","last_clean":"2024-04-25T02:20:24.197264+0000","last_became_active":"2024-04-25T02:20:24.195463+0000","last_became_peered":"2024-04-25T02:20:24.195463+0000","last_unstale":"2024-04-25T02:20:24.197264+0000","last_undegraded":"2024-04-25T02:20:24.197264+0000","last_fullsized":"2024-04-25T02:20:24.197264+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.204216+0000","last_change":"2024-04-25T02:20:24.200557+0000","last_active":"2024-04-25T02:20:24.204216+0000","last_peered":"2024-04-25T02:20:24.204216+0000","last_clean":"2024-04-25T02:20:24.204216+0000","last_became_active":"2024-04-25T02:20:24.200289+0000","last_became_peered":"2024-04-25T02:20:24.200289+0000","last_unstale":"2024-04-25T02:20:24.204216+0000","last_undegraded":"2024-04-25T02:20:24.204216+0000","last_fullsized":"2024-04-25T02:20:24.204216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.190365+0000","last_change":"2024-04-25T02:20:24.185144+0000","last_active":"2024-04-25T02:20:24.190365+0000","last_peered":"2024-04-25T02:20:24.190365+0000","last_clean":"2024-04-25T02:20:24.190365+0000","last_became_active":"2024-04-25T02:20:24.184668+0000","last_became_peered":"2024-04-25T02:20:24.184668+0000","last_unstale":"2024-04-25T02:20:24.190365+0000","last_undegraded":"2024-04-25T02:20:24.190365+0000","last_fullsized":"2024-04-25T02:20:24.190365+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.191297+0000","last_change":"2024-04-25T02:20:24.185079+0000","last_active":"2024-04-25T02:20:24.191297+0000","last_peered":"2024-04-25T02:20:24.191297+0000","last_clean":"2024-04-25T02:20:24.191297+0000","last_became_active":"2024-04-25T02:20:24.184748+0000","last_became_peered":"2024-04-25T02:20:24.184748+0000","last_unstale":"2024-04-25T02:20:24.191297+0000","last_undegraded":"2024-04-25T02:20:24.191297+0000","last_fullsized":"2024-04-25T02:20:24.191297+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.193584+0000","last_change":"2024-04-25T02:20:24.185898+0000","last_active":"2024-04-25T02:20:24.193584+0000","last_peered":"2024-04-25T02:20:24.193584+0000","last_clean":"2024-04-25T02:20:24.193584+0000","last_became_active":"2024-04-25T02:20:24.185153+0000","last_became_peered":"2024-04-25T02:20:24.185153+0000","last_unstale":"2024-04-25T02:20:24.193584+0000","last_undegraded":"2024-04-25T02:20:24.193584+0000","last_fullsized":"2024-04-25T02:20:24.193584+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.190967+0000","last_change":"2024-04-25T02:20:24.183879+0000","last_active":"2024-04-25T02:20:24.190967+0000","last_peered":"2024-04-25T02:20:24.190967+0000","last_clean":"2024-04-25T02:20:24.190967+0000","last_became_active":"2024-04-25T02:20:24.183565+0000","last_became_peered":"2024-04-25T02:20:24.183565+0000","last_unstale":"2024-04-25T02:20:24.190967+0000","last_undegraded":"2024-04-25T02:20:24.190967+0000","last_fullsized":"2024-04-25T02:20:24.190967+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.192186+0000","last_change":"2024-04-25T02:20:24.186601+0000","last_active":"2024-04-25T02:20:24.192186+0000","last_peered":"2024-04-25T02:20:24.192186+0000","last_clean":"2024-04-25T02:20:24.192186+0000","last_became_active":"2024-04-25T02:20:24.184553+0000","last_became_peered":"2024-04-25T02:20:24.184553+0000","last_unstale":"2024-04-25T02:20:24.192186+0000","last_undegraded":"2024-04-25T02:20:24.192186+0000","last_fullsized":"2024-04-25T02:20:24.192186+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.177547+0000","last_change":"2024-04-25T02:20:24.167579+0000","last_active":"2024-04-25T02:20:24.177547+0000","last_peered":"2024-04-25T02:20:24.177547+0000","last_clean":"2024-04-25T02:20:24.177547+0000","last_became_active":"2024-04-25T02:20:24.167170+0000","last_became_peered":"2024-04-25T02:20:24.167170+0000","last_unstale":"2024-04-25T02:20:24.177547+0000","last_undegraded":"2024-04-25T02:20:24.177547+0000","last_fullsized":"2024-04-25T02:20:24.177547+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.198565+0000","last_change":"2024-04-25T02:20:24.189023+0000","last_active":"2024-04-25T02:20:24.198565+0000","last_peered":"2024-04-25T02:20:24.198565+0000","last_clean":"2024-04-25T02:20:24.198565+0000","last_became_active":"2024-04-25T02:20:24.188203+0000","last_became_peered":"2024-04-25T02:20:24.188203+0000","last_unstale":"2024-04-25T02:20:24.198565+0000","last_undegraded":"2024-04-25T02:20:24.198565+0000","last_fullsized":"2024-04-25T02:20:24.198565+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.170956+0000","last_change":"2024-04-25T02:20:23.878198+0000","last_active":"2024-04-25T02:20:24.170956+0000","last_peered":"2024-04-25T02:20:24.170956+0000","last_clean":"2024-04-25T02:20:24.170956+0000","last_became_active":"2024-04-25T02:20:23.877819+0000","last_became_peered":"2024-04-25T02:20:23.877819+0000","last_unstale":"2024-04-25T02:20:24.170956+0000","last_undegraded":"2024-04-25T02:20:24.170956+0000","last_fullsized":"2024-04-25T02:20:24.170956+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.198584+0000","last_change":"2024-04-25T02:20:24.191107+0000","last_active":"2024-04-25T02:20:24.198584+0000","last_peered":"2024-04-25T02:20:24.198584+0000","last_clean":"2024-04-25T02:20:24.198584+0000","last_became_active":"2024-04-25T02:20:24.190019+0000","last_became_peered":"2024-04-25T02:20:24.190019+0000","last_unstale":"2024-04-25T02:20:24.198584+0000","last_undegraded":"2024-04-25T02:20:24.198584+0000","last_fullsized":"2024-04-25T02:20:24.198584+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.156633+0000","last_change":"2024-04-25T02:20:23.879347+0000","last_active":"2024-04-25T02:20:24.156633+0000","last_peered":"2024-04-25T02:20:24.156633+0000","last_clean":"2024-04-25T02:20:24.156633+0000","last_became_active":"2024-04-25T02:20:23.879065+0000","last_became_peered":"2024-04-25T02:20:23.879065+0000","last_unstale":"2024-04-25T02:20:24.156633+0000","last_undegraded":"2024-04-25T02:20:24.156633+0000","last_fullsized":"2024-04-25T02:20:24.156633+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.194862+0000","last_change":"2024-04-25T02:20:24.190744+0000","last_active":"2024-04-25T02:20:24.194862+0000","last_peered":"2024-04-25T02:20:24.194862+0000","last_clean":"2024-04-25T02:20:24.194862+0000","last_became_active":"2024-04-25T02:20:24.190410+0000","last_became_peered":"2024-04-25T02:20:24.190410+0000","last_unstale":"2024-04-25T02:20:24.194862+0000","last_undegraded":"2024-04-25T02:20:24.194862+0000","last_fullsized":"2024-04-25T02:20:24.194862+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.281449+0000","last_change":"2024-04-25T02:20:23.890094+0000","last_active":"2024-04-25T02:20:25.281449+0000","last_peered":"2024-04-25T02:20:25.281449+0000","last_clean":"2024-04-25T02:20:25.281449+0000","last_became_active":"2024-04-25T02:20:23.889715+0000","last_became_peered":"2024-04-25T02:20:23.889715+0000","last_unstale":"2024-04-25T02:20:25.281449+0000","last_undegraded":"2024-04-25T02:20:25.281449+0000","last_fullsized":"2024-04-25T02:20:25.281449+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.199764+0000","last_change":"2024-04-25T02:20:24.196642+0000","last_active":"2024-04-25T02:20:24.199764+0000","last_peered":"2024-04-25T02:20:24.199764+0000","last_clean":"2024-04-25T02:20:24.199764+0000","last_became_active":"2024-04-25T02:20:24.196137+0000","last_became_peered":"2024-04-25T02:20:24.196137+0000","last_unstale":"2024-04-25T02:20:24.199764+0000","last_undegraded":"2024-04-25T02:20:24.199764+0000","last_fullsized":"2024-04-25T02:20:24.199764+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"18'3","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.250025+0000","last_change":"2024-04-25T02:20:23.877498+0000","last_active":"2024-04-25T02:20:26.250025+0000","last_peered":"2024-04-25T02:20:26.250025+0000","last_clean":"2024-04-25T02:20:26.250025+0000","last_became_active":"2024-04-25T02:20:23.876803+0000","last_became_peered":"2024-04-25T02:20:23.876803+0000","last_unstale":"2024-04-25T02:20:26.250025+0000","last_undegraded":"2024-04-25T02:20:26.250025+0000","last_fullsized":"2024-04-25T02:20:26.250025+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.196580+0000","last_change":"2024-04-25T02:20:24.192558+0000","last_active":"2024-04-25T02:20:24.196580+0000","last_peered":"2024-04-25T02:20:24.196580+0000","last_clean":"2024-04-25T02:20:24.196580+0000","last_became_active":"2024-04-25T02:20:24.191880+0000","last_became_peered":"2024-04-25T02:20:24.191880+0000","last_unstale":"2024-04-25T02:20:24.196580+0000","last_undegraded":"2024-04-25T02:20:24.196580+0000","last_fullsized":"2024-04-25T02:20:24.196580+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.249543+0000","last_change":"2024-04-25T02:20:23.885888+0000","last_active":"2024-04-25T02:20:26.249543+0000","last_peered":"2024-04-25T02:20:26.249543+0000","last_clean":"2024-04-25T02:20:26.249543+0000","last_became_active":"2024-04-25T02:20:23.885589+0000","last_became_peered":"2024-04-25T02:20:23.885589+0000","last_unstale":"2024-04-25T02:20:26.249543+0000","last_undegraded":"2024-04-25T02:20:26.249543+0000","last_fullsized":"2024-04-25T02:20:26.249543+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.201755+0000","last_change":"2024-04-25T02:20:24.198607+0000","last_active":"2024-04-25T02:20:24.201755+0000","last_peered":"2024-04-25T02:20:24.201755+0000","last_clean":"2024-04-25T02:20:24.201755+0000","last_became_active":"2024-04-25T02:20:24.196892+0000","last_became_peered":"2024-04-25T02:20:24.196892+0000","last_unstale":"2024-04-25T02:20:24.201755+0000","last_undegraded":"2024-04-25T02:20:24.201755+0000","last_fullsized":"2024-04-25T02:20:24.201755+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.167790+0000","last_change":"2024-04-25T02:20:23.883408+0000","last_active":"2024-04-25T02:20:25.167790+0000","last_peered":"2024-04-25T02:20:25.167790+0000","last_clean":"2024-04-25T02:20:25.167790+0000","last_became_active":"2024-04-25T02:20:23.882488+0000","last_became_peered":"2024-04-25T02:20:23.882488+0000","last_unstale":"2024-04-25T02:20:25.167790+0000","last_undegraded":"2024-04-25T02:20:25.167790+0000","last_fullsized":"2024-04-25T02:20:25.167790+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.188614+0000","last_change":"2024-04-25T02:20:24.180953+0000","last_active":"2024-04-25T02:20:24.188614+0000","last_peered":"2024-04-25T02:20:24.188614+0000","last_clean":"2024-04-25T02:20:24.188614+0000","last_became_active":"2024-04-25T02:20:24.180646+0000","last_became_peered":"2024-04-25T02:20:24.180646+0000","last_unstale":"2024-04-25T02:20:24.188614+0000","last_undegraded":"2024-04-25T02:20:24.188614+0000","last_fullsized":"2024-04-25T02:20:24.188614+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"18'8","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.244995+0000","last_change":"2024-04-25T02:20:23.890383+0000","last_active":"2024-04-25T02:20:26.244995+0000","last_peered":"2024-04-25T02:20:26.244995+0000","last_clean":"2024-04-25T02:20:26.244995+0000","last_became_active":"2024-04-25T02:20:23.890015+0000","last_became_peered":"2024-04-25T02:20:23.890015+0000","last_unstale":"2024-04-25T02:20:26.244995+0000","last_undegraded":"2024-04-25T02:20:26.244995+0000","last_fullsized":"2024-04-25T02:20:26.244995+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.193067+0000","last_change":"2024-04-25T02:20:24.186645+0000","last_active":"2024-04-25T02:20:24.193067+0000","last_peered":"2024-04-25T02:20:24.193067+0000","last_clean":"2024-04-25T02:20:24.193067+0000","last_became_active":"2024-04-25T02:20:24.186336+0000","last_became_peered":"2024-04-25T02:20:24.186336+0000","last_unstale":"2024-04-25T02:20:24.193067+0000","last_undegraded":"2024-04-25T02:20:24.193067+0000","last_fullsized":"2024-04-25T02:20:24.193067+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.248214+0000","last_change":"2024-04-25T02:20:23.882583+0000","last_active":"2024-04-25T02:20:26.248214+0000","last_peered":"2024-04-25T02:20:26.248214+0000","last_clean":"2024-04-25T02:20:26.248214+0000","last_became_active":"2024-04-25T02:20:23.882254+0000","last_became_peered":"2024-04-25T02:20:23.882254+0000","last_unstale":"2024-04-25T02:20:26.248214+0000","last_undegraded":"2024-04-25T02:20:26.248214+0000","last_fullsized":"2024-04-25T02:20:26.248214+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.197776+0000","last_change":"2024-04-25T02:20:24.191415+0000","last_active":"2024-04-25T02:20:24.197776+0000","last_peered":"2024-04-25T02:20:24.197776+0000","last_clean":"2024-04-25T02:20:24.197776+0000","last_became_active":"2024-04-25T02:20:24.191024+0000","last_became_peered":"2024-04-25T02:20:24.191024+0000","last_unstale":"2024-04-25T02:20:24.197776+0000","last_undegraded":"2024-04-25T02:20:24.197776+0000","last_fullsized":"2024-04-25T02:20:24.197776+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"18'3","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.248576+0000","last_change":"2024-04-25T02:20:23.881482+0000","last_active":"2024-04-25T02:20:26.248576+0000","last_peered":"2024-04-25T02:20:26.248576+0000","last_clean":"2024-04-25T02:20:26.248576+0000","last_became_active":"2024-04-25T02:20:23.881128+0000","last_became_peered":"2024-04-25T02:20:23.881128+0000","last_unstale":"2024-04-25T02:20:26.248576+0000","last_undegraded":"2024-04-25T02:20:26.248576+0000","last_fullsized":"2024-04-25T02:20:26.248576+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.199346+0000","last_change":"2024-04-25T02:20:24.197800+0000","last_active":"2024-04-25T02:20:24.199346+0000","last_peered":"2024-04-25T02:20:24.199346+0000","last_clean":"2024-04-25T02:20:24.199346+0000","last_became_active":"2024-04-25T02:20:24.188621+0000","last_became_peered":"2024-04-25T02:20:24.188621+0000","last_unstale":"2024-04-25T02:20:24.199346+0000","last_undegraded":"2024-04-25T02:20:24.199346+0000","last_fullsized":"2024-04-25T02:20:24.199346+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.169346+0000","last_change":"2024-04-25T02:20:23.890803+0000","last_active":"2024-04-25T02:20:24.169346+0000","last_peered":"2024-04-25T02:20:24.169346+0000","last_clean":"2024-04-25T02:20:24.169346+0000","last_became_active":"2024-04-25T02:20:23.890114+0000","last_became_peered":"2024-04-25T02:20:23.890114+0000","last_unstale":"2024-04-25T02:20:24.169346+0000","last_undegraded":"2024-04-25T02:20:24.169346+0000","last_fullsized":"2024-04-25T02:20:24.169346+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.192424+0000","last_change":"2024-04-25T02:20:24.186816+0000","last_active":"2024-04-25T02:20:24.192424+0000","last_peered":"2024-04-25T02:20:24.192424+0000","last_clean":"2024-04-25T02:20:24.192424+0000","last_became_active":"2024-04-25T02:20:24.185644+0000","last_became_peered":"2024-04-25T02:20:24.185644+0000","last_unstale":"2024-04-25T02:20:24.192424+0000","last_undegraded":"2024-04-25T02:20:24.192424+0000","last_fullsized":"2024-04-25T02:20:24.192424+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'10","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.250313+0000","last_change":"2024-04-25T02:20:23.873213+0000","last_active":"2024-04-25T02:20:26.250313+0000","last_peered":"2024-04-25T02:20:26.250313+0000","last_clean":"2024-04-25T02:20:26.250313+0000","last_became_active":"2024-04-25T02:20:23.872886+0000","last_became_peered":"2024-04-25T02:20:23.872886+0000","last_unstale":"2024-04-25T02:20:26.250313+0000","last_undegraded":"2024-04-25T02:20:26.250313+0000","last_fullsized":"2024-04-25T02:20:26.250313+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.199743+0000","last_change":"2024-04-25T02:20:24.196436+0000","last_active":"2024-04-25T02:20:24.199743+0000","last_peered":"2024-04-25T02:20:24.199743+0000","last_clean":"2024-04-25T02:20:24.199743+0000","last_became_active":"2024-04-25T02:20:24.195763+0000","last_became_peered":"2024-04-25T02:20:24.195763+0000","last_unstale":"2024-04-25T02:20:24.199743+0000","last_undegraded":"2024-04-25T02:20:24.199743+0000","last_fullsized":"2024-04-25T02:20:24.199743+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.187972+0000","last_change":"2024-04-25T02:20:23.872612+0000","last_active":"2024-04-25T02:20:24.187972+0000","last_peered":"2024-04-25T02:20:24.187972+0000","last_clean":"2024-04-25T02:20:24.187972+0000","last_became_active":"2024-04-25T02:20:23.872266+0000","last_became_peered":"2024-04-25T02:20:23.872266+0000","last_unstale":"2024-04-25T02:20:24.187972+0000","last_undegraded":"2024-04-25T02:20:24.187972+0000","last_fullsized":"2024-04-25T02:20:24.187972+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.197208+0000","last_change":"2024-04-25T02:20:24.194953+0000","last_active":"2024-04-25T02:20:24.197208+0000","last_peered":"2024-04-25T02:20:24.197208+0000","last_clean":"2024-04-25T02:20:24.197208+0000","last_became_active":"2024-04-25T02:20:24.194637+0000","last_became_peered":"2024-04-25T02:20:24.194637+0000","last_unstale":"2024-04-25T02:20:24.197208+0000","last_undegraded":"2024-04-25T02:20:24.197208+0000","last_fullsized":"2024-04-25T02:20:24.197208+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.183925+0000","last_change":"2024-04-25T02:20:23.876382+0000","last_active":"2024-04-25T02:20:24.183925+0000","last_peered":"2024-04-25T02:20:24.183925+0000","last_clean":"2024-04-25T02:20:24.183925+0000","last_became_active":"2024-04-25T02:20:23.875806+0000","last_became_peered":"2024-04-25T02:20:23.875806+0000","last_unstale":"2024-04-25T02:20:24.183925+0000","last_undegraded":"2024-04-25T02:20:24.183925+0000","last_fullsized":"2024-04-25T02:20:24.183925+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.194532+0000","last_change":"2024-04-25T02:20:24.190109+0000","last_active":"2024-04-25T02:20:24.194532+0000","last_peered":"2024-04-25T02:20:24.194532+0000","last_clean":"2024-04-25T02:20:24.194532+0000","last_became_active":"2024-04-25T02:20:24.189801+0000","last_became_peered":"2024-04-25T02:20:24.189801+0000","last_unstale":"2024-04-25T02:20:24.194532+0000","last_undegraded":"2024-04-25T02:20:24.194532+0000","last_fullsized":"2024-04-25T02:20:24.194532+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.199086+0000","last_change":"2024-04-25T02:20:23.885537+0000","last_active":"2024-04-25T02:20:24.199086+0000","last_peered":"2024-04-25T02:20:24.199086+0000","last_clean":"2024-04-25T02:20:24.199086+0000","last_became_active":"2024-04-25T02:20:23.885190+0000","last_became_peered":"2024-04-25T02:20:23.885190+0000","last_unstale":"2024-04-25T02:20:24.199086+0000","last_undegraded":"2024-04-25T02:20:24.199086+0000","last_fullsized":"2024-04-25T02:20:24.199086+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.193670+0000","last_change":"2024-04-25T02:20:24.188326+0000","last_active":"2024-04-25T02:20:24.193670+0000","last_peered":"2024-04-25T02:20:24.193670+0000","last_clean":"2024-04-25T02:20:24.193670+0000","last_became_active":"2024-04-25T02:20:24.187661+0000","last_became_peered":"2024-04-25T02:20:24.187661+0000","last_unstale":"2024-04-25T02:20:24.193670+0000","last_undegraded":"2024-04-25T02:20:24.193670+0000","last_fullsized":"2024-04-25T02:20:24.193670+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.168528+0000","last_change":"2024-04-25T02:20:23.877401+0000","last_active":"2024-04-25T02:20:24.168528+0000","last_peered":"2024-04-25T02:20:24.168528+0000","last_clean":"2024-04-25T02:20:24.168528+0000","last_became_active":"2024-04-25T02:20:23.876871+0000","last_became_peered":"2024-04-25T02:20:23.876871+0000","last_unstale":"2024-04-25T02:20:24.168528+0000","last_undegraded":"2024-04-25T02:20:24.168528+0000","last_fullsized":"2024-04-25T02:20:24.168528+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.193968+0000","last_change":"2024-04-25T02:20:24.185293+0000","last_active":"2024-04-25T02:20:24.193968+0000","last_peered":"2024-04-25T02:20:24.193968+0000","last_clean":"2024-04-25T02:20:24.193968+0000","last_became_active":"2024-04-25T02:20:24.184978+0000","last_became_peered":"2024-04-25T02:20:24.184978+0000","last_unstale":"2024-04-25T02:20:24.193968+0000","last_undegraded":"2024-04-25T02:20:24.193968+0000","last_fullsized":"2024-04-25T02:20:24.193968+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.248087+0000","last_change":"2024-04-25T02:20:23.886478+0000","last_active":"2024-04-25T02:20:26.248087+0000","last_peered":"2024-04-25T02:20:26.248087+0000","last_clean":"2024-04-25T02:20:26.248087+0000","last_became_active":"2024-04-25T02:20:23.886157+0000","last_became_peered":"2024-04-25T02:20:23.886157+0000","last_unstale":"2024-04-25T02:20:26.248087+0000","last_undegraded":"2024-04-25T02:20:26.248087+0000","last_fullsized":"2024-04-25T02:20:26.248087+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.204062+0000","last_change":"2024-04-25T02:20:24.199344+0000","last_active":"2024-04-25T02:20:24.204062+0000","last_peered":"2024-04-25T02:20:24.204062+0000","last_clean":"2024-04-25T02:20:24.204062+0000","last_became_active":"2024-04-25T02:20:24.199010+0000","last_became_peered":"2024-04-25T02:20:24.199010+0000","last_unstale":"2024-04-25T02:20:24.204062+0000","last_undegraded":"2024-04-25T02:20:24.204062+0000","last_fullsized":"2024-04-25T02:20:24.204062+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.161596+0000","last_change":"2024-04-25T02:20:23.884331+0000","last_active":"2024-04-25T02:20:24.161596+0000","last_peered":"2024-04-25T02:20:24.161596+0000","last_clean":"2024-04-25T02:20:24.161596+0000","last_became_active":"2024-04-25T02:20:23.883987+0000","last_became_peered":"2024-04-25T02:20:23.883987+0000","last_unstale":"2024-04-25T02:20:24.161596+0000","last_undegraded":"2024-04-25T02:20:24.161596+0000","last_fullsized":"2024-04-25T02:20:24.161596+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.198604+0000","last_change":"2024-04-25T02:20:24.191297+0000","last_active":"2024-04-25T02:20:24.198604+0000","last_peered":"2024-04-25T02:20:24.198604+0000","last_clean":"2024-04-25T02:20:24.198604+0000","last_became_active":"2024-04-25T02:20:24.190401+0000","last_became_peered":"2024-04-25T02:20:24.190401+0000","last_unstale":"2024-04-25T02:20:24.198604+0000","last_undegraded":"2024-04-25T02:20:24.198604+0000","last_fullsized":"2024-04-25T02:20:24.198604+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"18'3","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.250453+0000","last_change":"2024-04-25T02:20:23.881257+0000","last_active":"2024-04-25T02:20:26.250453+0000","last_peered":"2024-04-25T02:20:26.250453+0000","last_clean":"2024-04-25T02:20:26.250453+0000","last_became_active":"2024-04-25T02:20:23.880935+0000","last_became_peered":"2024-04-25T02:20:23.880935+0000","last_unstale":"2024-04-25T02:20:26.250453+0000","last_undegraded":"2024-04-25T02:20:26.250453+0000","last_fullsized":"2024-04-25T02:20:26.250453+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.193753+0000","last_change":"2024-04-25T02:20:24.189432+0000","last_active":"2024-04-25T02:20:24.193753+0000","last_peered":"2024-04-25T02:20:24.193753+0000","last_clean":"2024-04-25T02:20:24.193753+0000","last_became_active":"2024-04-25T02:20:24.189016+0000","last_became_peered":"2024-04-25T02:20:24.189016+0000","last_unstale":"2024-04-25T02:20:24.193753+0000","last_undegraded":"2024-04-25T02:20:24.193753+0000","last_fullsized":"2024-04-25T02:20:24.193753+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.247109+0000","last_change":"2024-04-25T02:20:23.885274+0000","last_active":"2024-04-25T02:20:26.247109+0000","last_peered":"2024-04-25T02:20:26.247109+0000","last_clean":"2024-04-25T02:20:26.247109+0000","last_became_active":"2024-04-25T02:20:23.884934+0000","last_became_peered":"2024-04-25T02:20:23.884934+0000","last_unstale":"2024-04-25T02:20:26.247109+0000","last_undegraded":"2024-04-25T02:20:26.247109+0000","last_fullsized":"2024-04-25T02:20:26.247109+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.194522+0000","last_change":"2024-04-25T02:20:24.192355+0000","last_active":"2024-04-25T02:20:24.194522+0000","last_peered":"2024-04-25T02:20:24.194522+0000","last_clean":"2024-04-25T02:20:24.194522+0000","last_became_active":"2024-04-25T02:20:24.191909+0000","last_became_peered":"2024-04-25T02:20:24.191909+0000","last_unstale":"2024-04-25T02:20:24.194522+0000","last_undegraded":"2024-04-25T02:20:24.194522+0000","last_fullsized":"2024-04-25T02:20:24.194522+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.161935+0000","last_change":"2024-04-25T02:20:15.491093+0000","last_active":"2024-04-25T02:20:24.161935+0000","last_peered":"2024-04-25T02:20:24.161935+0000","last_clean":"2024-04-25T02:20:24.161935+0000","last_became_active":"2024-04-25T02:20:15.490770+0000","last_became_peered":"2024-04-25T02:20:15.490770+0000","last_unstale":"2024-04-25T02:20:24.161935+0000","last_undegraded":"2024-04-25T02:20:24.161935+0000","last_fullsized":"2024-04-25T02:20:24.161935+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.167026+0000","last_change":"2024-04-25T02:20:23.885604+0000","last_active":"2024-04-25T02:20:25.167026+0000","last_peered":"2024-04-25T02:20:25.167026+0000","last_clean":"2024-04-25T02:20:25.167026+0000","last_became_active":"2024-04-25T02:20:23.885298+0000","last_became_peered":"2024-04-25T02:20:23.885298+0000","last_unstale":"2024-04-25T02:20:25.167026+0000","last_undegraded":"2024-04-25T02:20:25.167026+0000","last_fullsized":"2024-04-25T02:20:25.167026+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.194944+0000","last_change":"2024-04-25T02:20:24.189688+0000","last_active":"2024-04-25T02:20:24.194944+0000","last_peered":"2024-04-25T02:20:24.194944+0000","last_clean":"2024-04-25T02:20:24.194944+0000","last_became_active":"2024-04-25T02:20:24.189417+0000","last_became_peered":"2024-04-25T02:20:24.189417+0000","last_unstale":"2024-04-25T02:20:24.194944+0000","last_undegraded":"2024-04-25T02:20:24.194944+0000","last_fullsized":"2024-04-25T02:20:24.194944+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.162049+0000","last_change":"2024-04-25T02:20:15.489991+0000","last_active":"2024-04-25T02:20:24.162049+0000","last_peered":"2024-04-25T02:20:24.162049+0000","last_clean":"2024-04-25T02:20:24.162049+0000","last_became_active":"2024-04-25T02:20:15.489641+0000","last_became_peered":"2024-04-25T02:20:15.489641+0000","last_unstale":"2024-04-25T02:20:24.162049+0000","last_undegraded":"2024-04-25T02:20:24.162049+0000","last_fullsized":"2024-04-25T02:20:24.162049+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.250313+0000","last_change":"2024-04-25T02:20:23.875583+0000","last_active":"2024-04-25T02:20:26.250313+0000","last_peered":"2024-04-25T02:20:26.250313+0000","last_clean":"2024-04-25T02:20:26.250313+0000","last_became_active":"2024-04-25T02:20:23.875234+0000","last_became_peered":"2024-04-25T02:20:23.875234+0000","last_unstale":"2024-04-25T02:20:26.250313+0000","last_undegraded":"2024-04-25T02:20:26.250313+0000","last_fullsized":"2024-04-25T02:20:26.250313+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.179030+0000","last_change":"2024-04-25T02:20:24.172708+0000","last_active":"2024-04-25T02:20:24.179030+0000","last_peered":"2024-04-25T02:20:24.179030+0000","last_clean":"2024-04-25T02:20:24.179030+0000","last_became_active":"2024-04-25T02:20:24.172138+0000","last_became_peered":"2024-04-25T02:20:24.172138+0000","last_unstale":"2024-04-25T02:20:24.179030+0000","last_undegraded":"2024-04-25T02:20:24.179030+0000","last_fullsized":"2024-04-25T02:20:24.179030+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.159793+0000","last_change":"2024-04-25T02:20:15.488908+0000","last_active":"2024-04-25T02:20:24.159793+0000","last_peered":"2024-04-25T02:20:24.159793+0000","last_clean":"2024-04-25T02:20:24.159793+0000","last_became_active":"2024-04-25T02:20:15.488569+0000","last_became_peered":"2024-04-25T02:20:15.488569+0000","last_unstale":"2024-04-25T02:20:24.159793+0000","last_undegraded":"2024-04-25T02:20:24.159793+0000","last_fullsized":"2024-04-25T02:20:24.159793+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.279870+0000","last_change":"2024-04-25T02:20:23.872080+0000","last_active":"2024-04-25T02:20:25.279870+0000","last_peered":"2024-04-25T02:20:25.279870+0000","last_clean":"2024-04-25T02:20:25.279870+0000","last_became_active":"2024-04-25T02:20:23.871751+0000","last_became_peered":"2024-04-25T02:20:23.871751+0000","last_unstale":"2024-04-25T02:20:25.279870+0000","last_undegraded":"2024-04-25T02:20:25.279870+0000","last_fullsized":"2024-04-25T02:20:25.279870+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.183350+0000","last_change":"2024-04-25T02:20:24.174377+0000","last_active":"2024-04-25T02:20:24.183350+0000","last_peered":"2024-04-25T02:20:24.183350+0000","last_clean":"2024-04-25T02:20:24.183350+0000","last_became_active":"2024-04-25T02:20:24.174100+0000","last_became_peered":"2024-04-25T02:20:24.174100+0000","last_unstale":"2024-04-25T02:20:24.183350+0000","last_undegraded":"2024-04-25T02:20:24.183350+0000","last_fullsized":"2024-04-25T02:20:24.183350+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.159203+0000","last_change":"2024-04-25T02:20:15.487675+0000","last_active":"2024-04-25T02:20:24.159203+0000","last_peered":"2024-04-25T02:20:24.159203+0000","last_clean":"2024-04-25T02:20:24.159203+0000","last_became_active":"2024-04-25T02:20:15.487331+0000","last_became_peered":"2024-04-25T02:20:15.487331+0000","last_unstale":"2024-04-25T02:20:24.159203+0000","last_undegraded":"2024-04-25T02:20:24.159203+0000","last_fullsized":"2024-04-25T02:20:24.159203+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"10'1","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.164063+0000","last_change":"2024-04-25T02:20:11.467819+0000","last_active":"2024-04-25T02:20:24.164063+0000","last_peered":"2024-04-25T02:20:24.164063+0000","last_clean":"2024-04-25T02:20:24.164063+0000","last_became_active":"2024-04-25T02:20:11.467259+0000","last_became_peered":"2024-04-25T02:20:11.467259+0000","last_unstale":"2024-04-25T02:20:24.164063+0000","last_undegraded":"2024-04-25T02:20:24.164063+0000","last_fullsized":"2024-04-25T02:20:24.164063+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:08.432182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:08.432182+0000","last_clean_scrub_stamp":"2024-04-25T02:20:08.432182+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.161484+0000","last_change":"2024-04-25T02:20:23.891327+0000","last_active":"2024-04-25T02:20:24.161484+0000","last_peered":"2024-04-25T02:20:24.161484+0000","last_clean":"2024-04-25T02:20:24.161484+0000","last_became_active":"2024-04-25T02:20:23.891033+0000","last_became_peered":"2024-04-25T02:20:23.891033+0000","last_unstale":"2024-04-25T02:20:24.161484+0000","last_undegraded":"2024-04-25T02:20:24.161484+0000","last_fullsized":"2024-04-25T02:20:24.161484+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.198627+0000","last_change":"2024-04-25T02:20:24.191472+0000","last_active":"2024-04-25T02:20:24.198627+0000","last_peered":"2024-04-25T02:20:24.198627+0000","last_clean":"2024-04-25T02:20:24.198627+0000","last_became_active":"2024-04-25T02:20:24.190777+0000","last_became_peered":"2024-04-25T02:20:24.190777+0000","last_unstale":"2024-04-25T02:20:24.198627+0000","last_undegraded":"2024-04-25T02:20:24.198627+0000","last_fullsized":"2024-04-25T02:20:24.198627+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.160031+0000","last_change":"2024-04-25T02:20:15.490166+0000","last_active":"2024-04-25T02:20:24.160031+0000","last_peered":"2024-04-25T02:20:24.160031+0000","last_clean":"2024-04-25T02:20:24.160031+0000","last_became_active":"2024-04-25T02:20:15.489795+0000","last_became_peered":"2024-04-25T02:20:15.489795+0000","last_unstale":"2024-04-25T02:20:24.160031+0000","last_undegraded":"2024-04-25T02:20:24.160031+0000","last_fullsized":"2024-04-25T02:20:24.160031+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.165306+0000","last_change":"2024-04-25T02:20:23.875637+0000","last_active":"2024-04-25T02:20:25.165306+0000","last_peered":"2024-04-25T02:20:25.165306+0000","last_clean":"2024-04-25T02:20:25.165306+0000","last_became_active":"2024-04-25T02:20:23.875042+0000","last_became_peered":"2024-04-25T02:20:23.875042+0000","last_unstale":"2024-04-25T02:20:25.165306+0000","last_undegraded":"2024-04-25T02:20:25.165306+0000","last_fullsized":"2024-04-25T02:20:25.165306+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.194840+0000","last_change":"2024-04-25T02:20:24.190630+0000","last_active":"2024-04-25T02:20:24.194840+0000","last_peered":"2024-04-25T02:20:24.194840+0000","last_clean":"2024-04-25T02:20:24.194840+0000","last_became_active":"2024-04-25T02:20:24.190288+0000","last_became_peered":"2024-04-25T02:20:24.190288+0000","last_unstale":"2024-04-25T02:20:24.194840+0000","last_undegraded":"2024-04-25T02:20:24.194840+0000","last_fullsized":"2024-04-25T02:20:24.194840+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.163172+0000","last_change":"2024-04-25T02:20:15.485725+0000","last_active":"2024-04-25T02:20:24.163172+0000","last_peered":"2024-04-25T02:20:24.163172+0000","last_clean":"2024-04-25T02:20:24.163172+0000","last_became_active":"2024-04-25T02:20:15.485352+0000","last_became_peered":"2024-04-25T02:20:15.485352+0000","last_unstale":"2024-04-25T02:20:24.163172+0000","last_undegraded":"2024-04-25T02:20:24.163172+0000","last_fullsized":"2024-04-25T02:20:24.163172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.161324+0000","last_change":"2024-04-25T02:20:23.879989+0000","last_active":"2024-04-25T02:20:24.161324+0000","last_peered":"2024-04-25T02:20:24.161324+0000","last_clean":"2024-04-25T02:20:24.161324+0000","last_became_active":"2024-04-25T02:20:23.877442+0000","last_became_peered":"2024-04-25T02:20:23.877442+0000","last_unstale":"2024-04-25T02:20:24.161324+0000","last_undegraded":"2024-04-25T02:20:24.161324+0000","last_fullsized":"2024-04-25T02:20:24.161324+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.180879+0000","last_change":"2024-04-25T02:20:24.176550+0000","last_active":"2024-04-25T02:20:24.180879+0000","last_peered":"2024-04-25T02:20:24.180879+0000","last_clean":"2024-04-25T02:20:24.180879+0000","last_became_active":"2024-04-25T02:20:24.176249+0000","last_became_peered":"2024-04-25T02:20:24.176249+0000","last_unstale":"2024-04-25T02:20:24.180879+0000","last_undegraded":"2024-04-25T02:20:24.180879+0000","last_fullsized":"2024-04-25T02:20:24.180879+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.243563+0000","last_change":"2024-04-25T02:20:23.884258+0000","last_active":"2024-04-25T02:20:26.243563+0000","last_peered":"2024-04-25T02:20:26.243563+0000","last_clean":"2024-04-25T02:20:26.243563+0000","last_became_active":"2024-04-25T02:20:23.883867+0000","last_became_peered":"2024-04-25T02:20:23.883867+0000","last_unstale":"2024-04-25T02:20:26.243563+0000","last_undegraded":"2024-04-25T02:20:26.243563+0000","last_fullsized":"2024-04-25T02:20:26.243563+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.160757+0000","last_change":"2024-04-25T02:20:15.490162+0000","last_active":"2024-04-25T02:20:24.160757+0000","last_peered":"2024-04-25T02:20:24.160757+0000","last_clean":"2024-04-25T02:20:24.160757+0000","last_became_active":"2024-04-25T02:20:15.489760+0000","last_became_peered":"2024-04-25T02:20:15.489760+0000","last_unstale":"2024-04-25T02:20:24.160757+0000","last_undegraded":"2024-04-25T02:20:24.160757+0000","last_fullsized":"2024-04-25T02:20:24.160757+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.197090+0000","last_change":"2024-04-25T02:20:24.192993+0000","last_active":"2024-04-25T02:20:24.197090+0000","last_peered":"2024-04-25T02:20:24.197090+0000","last_clean":"2024-04-25T02:20:24.197090+0000","last_became_active":"2024-04-25T02:20:24.192258+0000","last_became_peered":"2024-04-25T02:20:24.192258+0000","last_unstale":"2024-04-25T02:20:24.197090+0000","last_undegraded":"2024-04-25T02:20:24.197090+0000","last_fullsized":"2024-04-25T02:20:24.197090+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.169672+0000","last_change":"2024-04-25T02:20:15.488540+0000","last_active":"2024-04-25T02:20:24.169672+0000","last_peered":"2024-04-25T02:20:24.169672+0000","last_clean":"2024-04-25T02:20:24.169672+0000","last_became_active":"2024-04-25T02:20:15.488148+0000","last_became_peered":"2024-04-25T02:20:15.488148+0000","last_unstale":"2024-04-25T02:20:24.169672+0000","last_undegraded":"2024-04-25T02:20:24.169672+0000","last_fullsized":"2024-04-25T02:20:24.169672+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.165485+0000","last_change":"2024-04-25T02:20:23.882042+0000","last_active":"2024-04-25T02:20:25.165485+0000","last_peered":"2024-04-25T02:20:25.165485+0000","last_clean":"2024-04-25T02:20:25.165485+0000","last_became_active":"2024-04-25T02:20:23.881660+0000","last_became_peered":"2024-04-25T02:20:23.881660+0000","last_unstale":"2024-04-25T02:20:25.165485+0000","last_undegraded":"2024-04-25T02:20:25.165485+0000","last_fullsized":"2024-04-25T02:20:25.165485+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.193640+0000","last_change":"2024-04-25T02:20:24.188573+0000","last_active":"2024-04-25T02:20:24.193640+0000","last_peered":"2024-04-25T02:20:24.193640+0000","last_clean":"2024-04-25T02:20:24.193640+0000","last_became_active":"2024-04-25T02:20:24.188251+0000","last_became_peered":"2024-04-25T02:20:24.188251+0000","last_unstale":"2024-04-25T02:20:24.193640+0000","last_undegraded":"2024-04-25T02:20:24.193640+0000","last_fullsized":"2024-04-25T02:20:24.193640+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'5","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.248784+0000","last_change":"2024-04-25T02:20:23.883575+0000","last_active":"2024-04-25T02:20:26.248784+0000","last_peered":"2024-04-25T02:20:26.248784+0000","last_clean":"2024-04-25T02:20:26.248784+0000","last_became_active":"2024-04-25T02:20:23.883144+0000","last_became_peered":"2024-04-25T02:20:23.883144+0000","last_unstale":"2024-04-25T02:20:26.248784+0000","last_undegraded":"2024-04-25T02:20:26.248784+0000","last_fullsized":"2024-04-25T02:20:26.248784+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.185264+0000","last_change":"2024-04-25T02:20:24.170678+0000","last_active":"2024-04-25T02:20:24.185264+0000","last_peered":"2024-04-25T02:20:24.185264+0000","last_clean":"2024-04-25T02:20:24.185264+0000","last_became_active":"2024-04-25T02:20:24.170488+0000","last_became_peered":"2024-04-25T02:20:24.170488+0000","last_unstale":"2024-04-25T02:20:24.185264+0000","last_undegraded":"2024-04-25T02:20:24.185264+0000","last_fullsized":"2024-04-25T02:20:24.185264+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.179405+0000","last_change":"2024-04-25T02:20:23.881809+0000","last_active":"2024-04-25T02:20:24.179405+0000","last_peered":"2024-04-25T02:20:24.179405+0000","last_clean":"2024-04-25T02:20:24.179405+0000","last_became_active":"2024-04-25T02:20:23.878991+0000","last_became_peered":"2024-04-25T02:20:23.878991+0000","last_unstale":"2024-04-25T02:20:24.179405+0000","last_undegraded":"2024-04-25T02:20:24.179405+0000","last_fullsized":"2024-04-25T02:20:24.179405+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.201609+0000","last_change":"2024-04-25T02:20:24.197009+0000","last_active":"2024-04-25T02:20:24.201609+0000","last_peered":"2024-04-25T02:20:24.201609+0000","last_clean":"2024-04-25T02:20:24.201609+0000","last_became_active":"2024-04-25T02:20:24.196535+0000","last_became_peered":"2024-04-25T02:20:24.196535+0000","last_unstale":"2024-04-25T02:20:24.201609+0000","last_undegraded":"2024-04-25T02:20:24.201609+0000","last_fullsized":"2024-04-25T02:20:24.201609+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.199642+0000","last_change":"2024-04-25T02:20:23.888031+0000","last_active":"2024-04-25T02:20:24.199642+0000","last_peered":"2024-04-25T02:20:24.199642+0000","last_clean":"2024-04-25T02:20:24.199642+0000","last_became_active":"2024-04-25T02:20:23.887730+0000","last_became_peered":"2024-04-25T02:20:23.887730+0000","last_unstale":"2024-04-25T02:20:24.199642+0000","last_undegraded":"2024-04-25T02:20:24.199642+0000","last_fullsized":"2024-04-25T02:20:24.199642+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.193693+0000","last_change":"2024-04-25T02:20:24.188502+0000","last_active":"2024-04-25T02:20:24.193693+0000","last_peered":"2024-04-25T02:20:24.193693+0000","last_clean":"2024-04-25T02:20:24.193693+0000","last_became_active":"2024-04-25T02:20:24.188102+0000","last_became_peered":"2024-04-25T02:20:24.188102+0000","last_unstale":"2024-04-25T02:20:24.193693+0000","last_undegraded":"2024-04-25T02:20:24.193693+0000","last_fullsized":"2024-04-25T02:20:24.193693+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.190792+0000","last_change":"2024-04-25T02:20:23.890367+0000","last_active":"2024-04-25T02:20:24.190792+0000","last_peered":"2024-04-25T02:20:24.190792+0000","last_clean":"2024-04-25T02:20:24.190792+0000","last_became_active":"2024-04-25T02:20:23.889958+0000","last_became_peered":"2024-04-25T02:20:23.889958+0000","last_unstale":"2024-04-25T02:20:24.190792+0000","last_undegraded":"2024-04-25T02:20:24.190792+0000","last_fullsized":"2024-04-25T02:20:24.190792+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.198626+0000","last_change":"2024-04-25T02:20:24.194271+0000","last_active":"2024-04-25T02:20:24.198626+0000","last_peered":"2024-04-25T02:20:24.198626+0000","last_clean":"2024-04-25T02:20:24.198626+0000","last_became_active":"2024-04-25T02:20:24.193729+0000","last_became_peered":"2024-04-25T02:20:24.193729+0000","last_unstale":"2024-04-25T02:20:24.198626+0000","last_undegraded":"2024-04-25T02:20:24.198626+0000","last_fullsized":"2024-04-25T02:20:24.198626+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.187833+0000","last_change":"2024-04-25T02:20:23.882173+0000","last_active":"2024-04-25T02:20:24.187833+0000","last_peered":"2024-04-25T02:20:24.187833+0000","last_clean":"2024-04-25T02:20:24.187833+0000","last_became_active":"2024-04-25T02:20:23.881840+0000","last_became_peered":"2024-04-25T02:20:23.881840+0000","last_unstale":"2024-04-25T02:20:24.187833+0000","last_undegraded":"2024-04-25T02:20:24.187833+0000","last_fullsized":"2024-04-25T02:20:24.187833+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":553,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.185324+0000","last_change":"2024-04-25T02:20:24.171268+0000","last_active":"2024-04-25T02:20:24.185324+0000","last_peered":"2024-04-25T02:20:24.185324+0000","last_clean":"2024-04-25T02:20:24.185324+0000","last_became_active":"2024-04-25T02:20:24.170957+0000","last_became_peered":"2024-04-25T02:20:24.170957+0000","last_unstale":"2024-04-25T02:20:24.185324+0000","last_undegraded":"2024-04-25T02:20:24.185324+0000","last_fullsized":"2024-04-25T02:20:24.185324+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.178516+0000","last_change":"2024-04-25T02:20:24.167991+0000","last_active":"2024-04-25T02:20:24.178516+0000","last_peered":"2024-04-25T02:20:24.178516+0000","last_clean":"2024-04-25T02:20:24.178516+0000","last_became_active":"2024-04-25T02:20:24.167659+0000","last_became_peered":"2024-04-25T02:20:24.167659+0000","last_unstale":"2024-04-25T02:20:24.178516+0000","last_undegraded":"2024-04-25T02:20:24.178516+0000","last_fullsized":"2024-04-25T02:20:24.178516+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.198601+0000","last_change":"2024-04-25T02:20:24.194043+0000","last_active":"2024-04-25T02:20:24.198601+0000","last_peered":"2024-04-25T02:20:24.198601+0000","last_clean":"2024-04-25T02:20:24.198601+0000","last_became_active":"2024-04-25T02:20:24.193386+0000","last_became_peered":"2024-04-25T02:20:24.193386+0000","last_unstale":"2024-04-25T02:20:24.198601+0000","last_undegraded":"2024-04-25T02:20:24.198601+0000","last_fullsized":"2024-04-25T02:20:24.198601+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.193815+0000","last_change":"2024-04-25T02:20:24.189262+0000","last_active":"2024-04-25T02:20:24.193815+0000","last_peered":"2024-04-25T02:20:24.193815+0000","last_clean":"2024-04-25T02:20:24.193815+0000","last_became_active":"2024-04-25T02:20:24.188938+0000","last_became_peered":"2024-04-25T02:20:24.188938+0000","last_unstale":"2024-04-25T02:20:24.193815+0000","last_undegraded":"2024-04-25T02:20:24.193815+0000","last_fullsized":"2024-04-25T02:20:24.193815+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.194151+0000","last_change":"2024-04-25T02:20:24.189965+0000","last_active":"2024-04-25T02:20:24.194151+0000","last_peered":"2024-04-25T02:20:24.194151+0000","last_clean":"2024-04-25T02:20:24.194151+0000","last_became_active":"2024-04-25T02:20:24.189042+0000","last_became_peered":"2024-04-25T02:20:24.189042+0000","last_unstale":"2024-04-25T02:20:24.194151+0000","last_undegraded":"2024-04-25T02:20:24.194151+0000","last_fullsized":"2024-04-25T02:20:24.194151+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.179008+0000","last_change":"2024-04-25T02:20:24.172462+0000","last_active":"2024-04-25T02:20:24.179008+0000","last_peered":"2024-04-25T02:20:24.179008+0000","last_clean":"2024-04-25T02:20:24.179008+0000","last_became_active":"2024-04-25T02:20:24.171736+0000","last_became_peered":"2024-04-25T02:20:24.171736+0000","last_unstale":"2024-04-25T02:20:24.179008+0000","last_undegraded":"2024-04-25T02:20:24.179008+0000","last_fullsized":"2024-04-25T02:20:24.179008+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3633,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":7266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73,"ondisk_log_size":73,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048784,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323056,"statfs":{"total":96636764160,"available":95562809344,"internally_reserved":1073741824,"allocated":204800,"data_stored":53906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.247}]}]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":52495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.224}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26900000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":52764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]}]},{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048748,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323092,"statfs":{"total":96636764160,"available":95562846208,"internally_reserved":1073741824,"allocated":167936,"data_stored":51493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22600000000000001}]}]}]}} 2024-04-25T02:20:31.114 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:20:31.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.250+0000 7f7b63ff3700 1 Processor -- start 2024-04-25T02:20:31.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.251+0000 7f7b63ff3700 1 -- start start 2024-04-25T02:20:31.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.251+0000 7f7b63ff3700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7b5c138120 0x7f7b5c1349e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:31.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.251+0000 7f7b63ff3700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f7b5c0657d0 0x7f7b5c133ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:31.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.251+0000 7f7b63ff3700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b5c1343c0 con 0x7f7b5c137d40 2024-04-25T02:20:31.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.251+0000 7f7b63ff3700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b5c0684b0 con 0x7f7b5c0657d0 2024-04-25T02:20:31.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.251+0000 7f7b63ff3700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5c137880 con 0x7f7b5c138120 2024-04-25T02:20:31.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.251+0000 7f7b6158e700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7b5c138120 0x7f7b5c1349e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:31.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.251+0000 7f7b6158e700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7b5c138120 0x7f7b5c1349e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:51406/0 (socket says 172.21.15.111:51406) 2024-04-25T02:20:31.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.251+0000 7f7b62590700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f7b5c0657d0 0x7f7b5c133ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:31.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.251+0000 7f7b6158e700 1 -- 172.21.15.111:0/2929754568 learned_addr learned my addr 172.21.15.111:0/2929754568 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:31.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.251+0000 7f7b61d8f700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f7b5c137d40 0x7f7b5c09a9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:55836/0 (socket says 172.21.15.111:55836) 2024-04-25T02:20:31.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.252+0000 7f7b62590700 1 -- 172.21.15.111:0/2929754568 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7b5c138120 msgr2=0x7f7b5c1349e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:31.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.252+0000 7f7b62590700 1 --2- 172.21.15.111:0/2929754568 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7b5c138120 0x7f7b5c1349e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:31.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.252+0000 7f7b62590700 1 -- 172.21.15.111:0/2929754568 >> v1:172.21.15.111:6789/0 conn(0x7f7b5c137d40 legacy=0x7f7b5c09a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:31.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.252+0000 7f7b62590700 1 -- 172.21.15.111:0/2929754568 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b5c137b20 con 0x7f7b5c0657d0 2024-04-25T02:20:31.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.252+0000 7f7b60d8d700 1 -- 172.21.15.111:0/2929754568 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4104922239 0 0) 0x7f7b5c1343c0 con 0x7f7b5c137d40 2024-04-25T02:20:31.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.252+0000 7f7b6158e700 1 --2- 172.21.15.111:0/2929754568 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7b5c138120 0x7f7b5c1349e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:31.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.252+0000 7f7b62590700 1 --2- 172.21.15.111:0/2929754568 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7b5c0657d0 0x7f7b5c133ed0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f7b540032f0 tx=0x7f7b540091d0).ready entity=mon.0 client_cookie=c532582343aabde1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:31.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.252+0000 7f7b60d8d700 1 -- 172.21.15.111:0/2929754568 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b5400b6c0 con 0x7f7b5c0657d0 2024-04-25T02:20:31.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.252+0000 7f7b60d8d700 1 -- 172.21.15.111:0/2929754568 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b5400b820 con 0x7f7b5c0657d0 2024-04-25T02:20:31.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.252+0000 7f7b60d8d700 1 -- 172.21.15.111:0/2929754568 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b5400b990 con 0x7f7b5c0657d0 2024-04-25T02:20:31.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.252+0000 7f7b63ff3700 1 -- 172.21.15.111:0/2929754568 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7b5c0657d0 msgr2=0x7f7b5c133ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:31.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.252+0000 7f7b63ff3700 1 --2- 172.21.15.111:0/2929754568 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7b5c0657d0 0x7f7b5c133ed0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f7b540032f0 tx=0x7f7b540091d0).stop 2024-04-25T02:20:31.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.252+0000 7f7b63ff3700 1 -- 172.21.15.111:0/2929754568 shutdown_connections 2024-04-25T02:20:31.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.252+0000 7f7b63ff3700 1 --2- 172.21.15.111:0/2929754568 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7b5c0657d0 0x7f7b5c133ed0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:31.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.252+0000 7f7b63ff3700 1 --2- 172.21.15.111:0/2929754568 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7b5c138120 0x7f7b5c1349e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:31.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.252+0000 7f7b63ff3700 1 -- 172.21.15.111:0/2929754568 >> 172.21.15.111:0/2929754568 conn(0x7f7b5c05d070 msgr2=0x7f7b5c0625e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:31.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.252+0000 7f7b63ff3700 1 -- 172.21.15.111:0/2929754568 shutdown_connections 2024-04-25T02:20:31.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.253+0000 7f7b63ff3700 1 -- 172.21.15.111:0/2929754568 wait complete. 2024-04-25T02:20:31.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.253+0000 7f7b63ff3700 1 Processor -- start 2024-04-25T02:20:31.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.253+0000 7f7b63ff3700 1 -- start start 2024-04-25T02:20:31.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.254+0000 7f7b63ff3700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7b5c0657d0 0x7f7b5c098400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:31.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.254+0000 7f7b63ff3700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7b5c137d40 0x7f7b5c096d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:31.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.254+0000 7f7b63ff3700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7b5c138120 0x7f7b5c144000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:31.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.254+0000 7f7b63ff3700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5c094b40 con 0x7f7b5c0657d0 2024-04-25T02:20:31.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.254+0000 7f7b63ff3700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5c097b10 con 0x7f7b5c137d40 2024-04-25T02:20:31.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.254+0000 7f7b63ff3700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7b5c097d40 con 0x7f7b5c138120 2024-04-25T02:20:31.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.254+0000 7f7b61d8f700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7b5c0657d0 0x7f7b5c098400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:31.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.254+0000 7f7b6158e700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7b5c137d40 0x7f7b5c096d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:31.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.254+0000 7f7b61d8f700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7b5c0657d0 0x7f7b5c098400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48304/0 (socket says 172.21.15.111:48304) 2024-04-25T02:20:31.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.254+0000 7f7b61d8f700 1 -- 172.21.15.111:0/1562371404 learned_addr learned my addr 172.21.15.111:0/1562371404 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:31.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.254+0000 7f7b62590700 1 --2- 172.21.15.111:0/1562371404 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7b5c138120 0x7f7b5c144000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:31.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.254+0000 7f7b61d8f700 1 -- 172.21.15.111:0/1562371404 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7b5c138120 msgr2=0x7f7b5c144000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:31.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.254+0000 7f7b61d8f700 1 --2- 172.21.15.111:0/1562371404 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7b5c138120 0x7f7b5c144000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:31.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.254+0000 7f7b61d8f700 1 -- 172.21.15.111:0/1562371404 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7b5c137d40 msgr2=0x7f7b5c096d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:31.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.254+0000 7f7b61d8f700 1 --2- 172.21.15.111:0/1562371404 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7b5c137d40 0x7f7b5c096d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:31.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.254+0000 7f7b61d8f700 1 -- 172.21.15.111:0/1562371404 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b5800b1e0 con 0x7f7b5c0657d0 2024-04-25T02:20:31.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.254+0000 7f7b6158e700 1 --2- 172.21.15.111:0/1562371404 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7b5c137d40 0x7f7b5c096d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:31.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.254+0000 7f7b61d8f700 1 --2- 172.21.15.111:0/1562371404 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7b5c0657d0 0x7f7b5c098400 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f7b5c095370 tx=0x7f7b4c007a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:31.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.254+0000 7f7b4affd700 1 -- 172.21.15.111:0/1562371404 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b4c0070d0 con 0x7f7b5c0657d0 2024-04-25T02:20:31.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.254+0000 7f7b4affd700 1 -- 172.21.15.111:0/1562371404 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b4c007230 con 0x7f7b5c0657d0 2024-04-25T02:20:31.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.255+0000 7f7b63ff3700 1 -- 172.21.15.111:0/1562371404 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b54009470 con 0x7f7b5c0657d0 2024-04-25T02:20:31.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.255+0000 7f7b4affd700 1 -- 172.21.15.111:0/1562371404 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7b4c005740 con 0x7f7b5c0657d0 2024-04-25T02:20:31.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.255+0000 7f7b63ff3700 1 -- 172.21.15.111:0/1562371404 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b5c143dd0 con 0x7f7b5c0657d0 2024-04-25T02:20:31.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.255+0000 7f7b4affd700 1 -- 172.21.15.111:0/1562371404 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f7b4c010070 con 0x7f7b5c0657d0 2024-04-25T02:20:31.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.256+0000 7f7b63ff3700 1 -- 172.21.15.111:0/1562371404 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b5c137460 con 0x7f7b5c0657d0 2024-04-25T02:20:31.263 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.256+0000 7f7b4affd700 1 -- 172.21.15.111:0/1562371404 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f7b4c049fe0 con 0x7f7b5c0657d0 2024-04-25T02:20:31.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.259+0000 7f7b4affd700 1 -- 172.21.15.111:0/1562371404 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f7b4c02eee0 con 0x7f7b5c0657d0 2024-04-25T02:20:31.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.364+0000 7f7b63ff3700 1 -- 172.21.15.111:0/1562371404 --> v1:172.21.15.111:6816/39585 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7b5c09c000 con 0x7f7b3c038da0 2024-04-25T02:20:31.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.371+0000 7f7b4affd700 1 -- 172.21.15.111:0/1562371404 <== mgr.4099 v1:172.21.15.111:6816/39585 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+246926 (unknown 2965378022 0 2125796483) 0x7f7b5c09c000 con 0x7f7b3c038da0 2024-04-25T02:20:31.377 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:20:31.379 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.373+0000 7f7b63ff3700 1 -- 172.21.15.111:0/1562371404 >> v1:172.21.15.111:6816/39585 conn(0x7f7b3c038da0 legacy=0x7f7b3c03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:31.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.373+0000 7f7b63ff3700 1 -- 172.21.15.111:0/1562371404 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7b5c0657d0 msgr2=0x7f7b5c098400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:31.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.373+0000 7f7b63ff3700 1 --2- 172.21.15.111:0/1562371404 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7b5c0657d0 0x7f7b5c098400 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f7b5c095370 tx=0x7f7b4c007a60).stop 2024-04-25T02:20:31.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.373+0000 7f7b63ff3700 1 -- 172.21.15.111:0/1562371404 shutdown_connections 2024-04-25T02:20:31.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.373+0000 7f7b63ff3700 1 --2- 172.21.15.111:0/1562371404 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7b5c138120 0x7f7b5c144000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:31.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.373+0000 7f7b63ff3700 1 --2- 172.21.15.111:0/1562371404 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7b5c0657d0 0x7f7b5c098400 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:31.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.373+0000 7f7b63ff3700 1 --2- 172.21.15.111:0/1562371404 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7b5c137d40 0x7f7b5c096d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:31.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.373+0000 7f7b63ff3700 1 -- 172.21.15.111:0/1562371404 >> 172.21.15.111:0/1562371404 conn(0x7f7b5c05d070 msgr2=0x7f7b5c06c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:31.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.373+0000 7f7b63ff3700 1 -- 172.21.15.111:0/1562371404 shutdown_connections 2024-04-25T02:20:31.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.373+0000 7f7b63ff3700 1 -- 172.21.15.111:0/1562371404 wait complete. 2024-04-25T02:20:31.380 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2024-04-25T02:20:31.387 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-04-25T02:20:29.437734+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3633,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":85,"num_write_kb":29,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":4195056,"kb_used_data":720,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292304,"statfs":{"total":386547056640,"available":382251319296,"internally_reserved":4294967296,"allocated":737280,"data_stored":210658,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3633,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001070"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.197225+0000","last_change":"2024-04-25T02:20:24.195706+0000","last_active":"2024-04-25T02:20:24.197225+0000","last_peered":"2024-04-25T02:20:24.197225+0000","last_clean":"2024-04-25T02:20:24.197225+0000","last_became_active":"2024-04-25T02:20:24.195349+0000","last_became_peered":"2024-04-25T02:20:24.195349+0000","last_unstale":"2024-04-25T02:20:24.197225+0000","last_undegraded":"2024-04-25T02:20:24.197225+0000","last_fullsized":"2024-04-25T02:20:24.197225+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.183813+0000","last_change":"2024-04-25T02:20:24.170636+0000","last_active":"2024-04-25T02:20:24.183813+0000","last_peered":"2024-04-25T02:20:24.183813+0000","last_clean":"2024-04-25T02:20:24.183813+0000","last_became_active":"2024-04-25T02:20:24.170426+0000","last_became_peered":"2024-04-25T02:20:24.170426+0000","last_unstale":"2024-04-25T02:20:24.183813+0000","last_undegraded":"2024-04-25T02:20:24.183813+0000","last_fullsized":"2024-04-25T02:20:24.183813+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.197995+0000","last_change":"2024-04-25T02:20:24.190781+0000","last_active":"2024-04-25T02:20:24.197995+0000","last_peered":"2024-04-25T02:20:24.197995+0000","last_clean":"2024-04-25T02:20:24.197995+0000","last_became_active":"2024-04-25T02:20:24.190114+0000","last_became_peered":"2024-04-25T02:20:24.190114+0000","last_unstale":"2024-04-25T02:20:24.197995+0000","last_undegraded":"2024-04-25T02:20:24.197995+0000","last_fullsized":"2024-04-25T02:20:24.197995+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.197275+0000","last_change":"2024-04-25T02:20:24.192016+0000","last_active":"2024-04-25T02:20:24.197275+0000","last_peered":"2024-04-25T02:20:24.197275+0000","last_clean":"2024-04-25T02:20:24.197275+0000","last_became_active":"2024-04-25T02:20:24.191694+0000","last_became_peered":"2024-04-25T02:20:24.191694+0000","last_unstale":"2024-04-25T02:20:24.197275+0000","last_undegraded":"2024-04-25T02:20:24.197275+0000","last_fullsized":"2024-04-25T02:20:24.197275+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.198818+0000","last_change":"2024-04-25T02:20:24.195316+0000","last_active":"2024-04-25T02:20:24.198818+0000","last_peered":"2024-04-25T02:20:24.198818+0000","last_clean":"2024-04-25T02:20:24.198818+0000","last_became_active":"2024-04-25T02:20:24.194996+0000","last_became_peered":"2024-04-25T02:20:24.194996+0000","last_unstale":"2024-04-25T02:20:24.198818+0000","last_undegraded":"2024-04-25T02:20:24.198818+0000","last_fullsized":"2024-04-25T02:20:24.198818+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.194022+0000","last_change":"2024-04-25T02:20:24.188215+0000","last_active":"2024-04-25T02:20:24.194022+0000","last_peered":"2024-04-25T02:20:24.194022+0000","last_clean":"2024-04-25T02:20:24.194022+0000","last_became_active":"2024-04-25T02:20:24.186345+0000","last_became_peered":"2024-04-25T02:20:24.186345+0000","last_unstale":"2024-04-25T02:20:24.194022+0000","last_undegraded":"2024-04-25T02:20:24.194022+0000","last_fullsized":"2024-04-25T02:20:24.194022+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.193607+0000","last_change":"2024-04-25T02:20:24.186090+0000","last_active":"2024-04-25T02:20:24.193607+0000","last_peered":"2024-04-25T02:20:24.193607+0000","last_clean":"2024-04-25T02:20:24.193607+0000","last_became_active":"2024-04-25T02:20:24.185481+0000","last_became_peered":"2024-04-25T02:20:24.185481+0000","last_unstale":"2024-04-25T02:20:24.193607+0000","last_undegraded":"2024-04-25T02:20:24.193607+0000","last_fullsized":"2024-04-25T02:20:24.193607+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.187860+0000","last_change":"2024-04-25T02:20:24.176292+0000","last_active":"2024-04-25T02:20:24.187860+0000","last_peered":"2024-04-25T02:20:24.187860+0000","last_clean":"2024-04-25T02:20:24.187860+0000","last_became_active":"2024-04-25T02:20:24.175187+0000","last_became_peered":"2024-04-25T02:20:24.175187+0000","last_unstale":"2024-04-25T02:20:24.187860+0000","last_undegraded":"2024-04-25T02:20:24.187860+0000","last_fullsized":"2024-04-25T02:20:24.187860+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.199827+0000","last_change":"2024-04-25T02:20:24.192327+0000","last_active":"2024-04-25T02:20:24.199827+0000","last_peered":"2024-04-25T02:20:24.199827+0000","last_clean":"2024-04-25T02:20:24.199827+0000","last_became_active":"2024-04-25T02:20:24.191616+0000","last_became_peered":"2024-04-25T02:20:24.191616+0000","last_unstale":"2024-04-25T02:20:24.199827+0000","last_undegraded":"2024-04-25T02:20:24.199827+0000","last_fullsized":"2024-04-25T02:20:24.199827+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.187908+0000","last_change":"2024-04-25T02:20:24.178072+0000","last_active":"2024-04-25T02:20:24.187908+0000","last_peered":"2024-04-25T02:20:24.187908+0000","last_clean":"2024-04-25T02:20:24.187908+0000","last_became_active":"2024-04-25T02:20:24.177766+0000","last_became_peered":"2024-04-25T02:20:24.177766+0000","last_unstale":"2024-04-25T02:20:24.187908+0000","last_undegraded":"2024-04-25T02:20:24.187908+0000","last_fullsized":"2024-04-25T02:20:24.187908+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.187027+0000","last_change":"2024-04-25T02:20:24.179040+0000","last_active":"2024-04-25T02:20:24.187027+0000","last_peered":"2024-04-25T02:20:24.187027+0000","last_clean":"2024-04-25T02:20:24.187027+0000","last_became_active":"2024-04-25T02:20:24.178732+0000","last_became_peered":"2024-04-25T02:20:24.178732+0000","last_unstale":"2024-04-25T02:20:24.187027+0000","last_undegraded":"2024-04-25T02:20:24.187027+0000","last_fullsized":"2024-04-25T02:20:24.187027+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.197294+0000","last_change":"2024-04-25T02:20:24.195853+0000","last_active":"2024-04-25T02:20:24.197294+0000","last_peered":"2024-04-25T02:20:24.197294+0000","last_clean":"2024-04-25T02:20:24.197294+0000","last_became_active":"2024-04-25T02:20:24.195544+0000","last_became_peered":"2024-04-25T02:20:24.195544+0000","last_unstale":"2024-04-25T02:20:24.197294+0000","last_undegraded":"2024-04-25T02:20:24.197294+0000","last_fullsized":"2024-04-25T02:20:24.197294+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.199249+0000","last_change":"2024-04-25T02:20:24.196840+0000","last_active":"2024-04-25T02:20:24.199249+0000","last_peered":"2024-04-25T02:20:24.199249+0000","last_clean":"2024-04-25T02:20:24.199249+0000","last_became_active":"2024-04-25T02:20:24.196155+0000","last_became_peered":"2024-04-25T02:20:24.196155+0000","last_unstale":"2024-04-25T02:20:24.199249+0000","last_undegraded":"2024-04-25T02:20:24.199249+0000","last_fullsized":"2024-04-25T02:20:24.199249+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.178645+0000","last_change":"2024-04-25T02:20:24.171853+0000","last_active":"2024-04-25T02:20:24.178645+0000","last_peered":"2024-04-25T02:20:24.178645+0000","last_clean":"2024-04-25T02:20:24.178645+0000","last_became_active":"2024-04-25T02:20:24.171522+0000","last_became_peered":"2024-04-25T02:20:24.171522+0000","last_unstale":"2024-04-25T02:20:24.178645+0000","last_undegraded":"2024-04-25T02:20:24.178645+0000","last_fullsized":"2024-04-25T02:20:24.178645+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.193847+0000","last_change":"2024-04-25T02:20:24.185905+0000","last_active":"2024-04-25T02:20:24.193847+0000","last_peered":"2024-04-25T02:20:24.193847+0000","last_clean":"2024-04-25T02:20:24.193847+0000","last_became_active":"2024-04-25T02:20:24.185440+0000","last_became_peered":"2024-04-25T02:20:24.185440+0000","last_unstale":"2024-04-25T02:20:24.193847+0000","last_undegraded":"2024-04-25T02:20:24.193847+0000","last_fullsized":"2024-04-25T02:20:24.193847+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.187908+0000","last_change":"2024-04-25T02:20:24.183619+0000","last_active":"2024-04-25T02:20:24.187908+0000","last_peered":"2024-04-25T02:20:24.187908+0000","last_clean":"2024-04-25T02:20:24.187908+0000","last_became_active":"2024-04-25T02:20:24.183299+0000","last_became_peered":"2024-04-25T02:20:24.183299+0000","last_unstale":"2024-04-25T02:20:24.187908+0000","last_undegraded":"2024-04-25T02:20:24.187908+0000","last_fullsized":"2024-04-25T02:20:24.187908+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.199849+0000","last_change":"2024-04-25T02:20:24.194408+0000","last_active":"2024-04-25T02:20:24.199849+0000","last_peered":"2024-04-25T02:20:24.199849+0000","last_clean":"2024-04-25T02:20:24.199849+0000","last_became_active":"2024-04-25T02:20:24.192031+0000","last_became_peered":"2024-04-25T02:20:24.192031+0000","last_unstale":"2024-04-25T02:20:24.199849+0000","last_undegraded":"2024-04-25T02:20:24.199849+0000","last_fullsized":"2024-04-25T02:20:24.199849+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.179767+0000","last_change":"2024-04-25T02:20:24.175814+0000","last_active":"2024-04-25T02:20:24.179767+0000","last_peered":"2024-04-25T02:20:24.179767+0000","last_clean":"2024-04-25T02:20:24.179767+0000","last_became_active":"2024-04-25T02:20:24.174411+0000","last_became_peered":"2024-04-25T02:20:24.174411+0000","last_unstale":"2024-04-25T02:20:24.179767+0000","last_undegraded":"2024-04-25T02:20:24.179767+0000","last_fullsized":"2024-04-25T02:20:24.179767+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.197264+0000","last_change":"2024-04-25T02:20:24.195764+0000","last_active":"2024-04-25T02:20:24.197264+0000","last_peered":"2024-04-25T02:20:24.197264+0000","last_clean":"2024-04-25T02:20:24.197264+0000","last_became_active":"2024-04-25T02:20:24.195463+0000","last_became_peered":"2024-04-25T02:20:24.195463+0000","last_unstale":"2024-04-25T02:20:24.197264+0000","last_undegraded":"2024-04-25T02:20:24.197264+0000","last_fullsized":"2024-04-25T02:20:24.197264+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.204216+0000","last_change":"2024-04-25T02:20:24.200557+0000","last_active":"2024-04-25T02:20:24.204216+0000","last_peered":"2024-04-25T02:20:24.204216+0000","last_clean":"2024-04-25T02:20:24.204216+0000","last_became_active":"2024-04-25T02:20:24.200289+0000","last_became_peered":"2024-04-25T02:20:24.200289+0000","last_unstale":"2024-04-25T02:20:24.204216+0000","last_undegraded":"2024-04-25T02:20:24.204216+0000","last_fullsized":"2024-04-25T02:20:24.204216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.190365+0000","last_change":"2024-04-25T02:20:24.185144+0000","last_active":"2024-04-25T02:20:24.190365+0000","last_peered":"2024-04-25T02:20:24.190365+0000","last_clean":"2024-04-25T02:20:24.190365+0000","last_became_active":"2024-04-25T02:20:24.184668+0000","last_became_peered":"2024-04-25T02:20:24.184668+0000","last_unstale":"2024-04-25T02:20:24.190365+0000","last_undegraded":"2024-04-25T02:20:24.190365+0000","last_fullsized":"2024-04-25T02:20:24.190365+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.191297+0000","last_change":"2024-04-25T02:20:24.185079+0000","last_active":"2024-04-25T02:20:24.191297+0000","last_peered":"2024-04-25T02:20:24.191297+0000","last_clean":"2024-04-25T02:20:24.191297+0000","last_became_active":"2024-04-25T02:20:24.184748+0000","last_became_peered":"2024-04-25T02:20:24.184748+0000","last_unstale":"2024-04-25T02:20:24.191297+0000","last_undegraded":"2024-04-25T02:20:24.191297+0000","last_fullsized":"2024-04-25T02:20:24.191297+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.193584+0000","last_change":"2024-04-25T02:20:24.185898+0000","last_active":"2024-04-25T02:20:24.193584+0000","last_peered":"2024-04-25T02:20:24.193584+0000","last_clean":"2024-04-25T02:20:24.193584+0000","last_became_active":"2024-04-25T02:20:24.185153+0000","last_became_peered":"2024-04-25T02:20:24.185153+0000","last_unstale":"2024-04-25T02:20:24.193584+0000","last_undegraded":"2024-04-25T02:20:24.193584+0000","last_fullsized":"2024-04-25T02:20:24.193584+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.190967+0000","last_change":"2024-04-25T02:20:24.183879+0000","last_active":"2024-04-25T02:20:24.190967+0000","last_peered":"2024-04-25T02:20:24.190967+0000","last_clean":"2024-04-25T02:20:24.190967+0000","last_became_active":"2024-04-25T02:20:24.183565+0000","last_became_peered":"2024-04-25T02:20:24.183565+0000","last_unstale":"2024-04-25T02:20:24.190967+0000","last_undegraded":"2024-04-25T02:20:24.190967+0000","last_fullsized":"2024-04-25T02:20:24.190967+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.192186+0000","last_change":"2024-04-25T02:20:24.186601+0000","last_active":"2024-04-25T02:20:24.192186+0000","last_peered":"2024-04-25T02:20:24.192186+0000","last_clean":"2024-04-25T02:20:24.192186+0000","last_became_active":"2024-04-25T02:20:24.184553+0000","last_became_peered":"2024-04-25T02:20:24.184553+0000","last_unstale":"2024-04-25T02:20:24.192186+0000","last_undegraded":"2024-04-25T02:20:24.192186+0000","last_fullsized":"2024-04-25T02:20:24.192186+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.177547+0000","last_change":"2024-04-25T02:20:24.167579+0000","last_active":"2024-04-25T02:20:24.177547+0000","last_peered":"2024-04-25T02:20:24.177547+0000","last_clean":"2024-04-25T02:20:24.177547+0000","last_became_active":"2024-04-25T02:20:24.167170+0000","last_became_peered":"2024-04-25T02:20:24.167170+0000","last_unstale":"2024-04-25T02:20:24.177547+0000","last_undegraded":"2024-04-25T02:20:24.177547+0000","last_fullsized":"2024-04-25T02:20:24.177547+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.198565+0000","last_change":"2024-04-25T02:20:24.189023+0000","last_active":"2024-04-25T02:20:24.198565+0000","last_peered":"2024-04-25T02:20:24.198565+0000","last_clean":"2024-04-25T02:20:24.198565+0000","last_became_active":"2024-04-25T02:20:24.188203+0000","last_became_peered":"2024-04-25T02:20:24.188203+0000","last_unstale":"2024-04-25T02:20:24.198565+0000","last_undegraded":"2024-04-25T02:20:24.198565+0000","last_fullsized":"2024-04-25T02:20:24.198565+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.170956+0000","last_change":"2024-04-25T02:20:23.878198+0000","last_active":"2024-04-25T02:20:24.170956+0000","last_peered":"2024-04-25T02:20:24.170956+0000","last_clean":"2024-04-25T02:20:24.170956+0000","last_became_active":"2024-04-25T02:20:23.877819+0000","last_became_peered":"2024-04-25T02:20:23.877819+0000","last_unstale":"2024-04-25T02:20:24.170956+0000","last_undegraded":"2024-04-25T02:20:24.170956+0000","last_fullsized":"2024-04-25T02:20:24.170956+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.198584+0000","last_change":"2024-04-25T02:20:24.191107+0000","last_active":"2024-04-25T02:20:24.198584+0000","last_peered":"2024-04-25T02:20:24.198584+0000","last_clean":"2024-04-25T02:20:24.198584+0000","last_became_active":"2024-04-25T02:20:24.190019+0000","last_became_peered":"2024-04-25T02:20:24.190019+0000","last_unstale":"2024-04-25T02:20:24.198584+0000","last_undegraded":"2024-04-25T02:20:24.198584+0000","last_fullsized":"2024-04-25T02:20:24.198584+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.156633+0000","last_change":"2024-04-25T02:20:23.879347+0000","last_active":"2024-04-25T02:20:24.156633+0000","last_peered":"2024-04-25T02:20:24.156633+0000","last_clean":"2024-04-25T02:20:24.156633+0000","last_became_active":"2024-04-25T02:20:23.879065+0000","last_became_peered":"2024-04-25T02:20:23.879065+0000","last_unstale":"2024-04-25T02:20:24.156633+0000","last_undegraded":"2024-04-25T02:20:24.156633+0000","last_fullsized":"2024-04-25T02:20:24.156633+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.194862+0000","last_change":"2024-04-25T02:20:24.190744+0000","last_active":"2024-04-25T02:20:24.194862+0000","last_peered":"2024-04-25T02:20:24.194862+0000","last_clean":"2024-04-25T02:20:24.194862+0000","last_became_active":"2024-04-25T02:20:24.190410+0000","last_became_peered":"2024-04-25T02:20:24.190410+0000","last_unstale":"2024-04-25T02:20:24.194862+0000","last_undegraded":"2024-04-25T02:20:24.194862+0000","last_fullsized":"2024-04-25T02:20:24.194862+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.281449+0000","last_change":"2024-04-25T02:20:23.890094+0000","last_active":"2024-04-25T02:20:25.281449+0000","last_peered":"2024-04-25T02:20:25.281449+0000","last_clean":"2024-04-25T02:20:25.281449+0000","last_became_active":"2024-04-25T02:20:23.889715+0000","last_became_peered":"2024-04-25T02:20:23.889715+0000","last_unstale":"2024-04-25T02:20:25.281449+0000","last_undegraded":"2024-04-25T02:20:25.281449+0000","last_fullsized":"2024-04-25T02:20:25.281449+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.199764+0000","last_change":"2024-04-25T02:20:24.196642+0000","last_active":"2024-04-25T02:20:24.199764+0000","last_peered":"2024-04-25T02:20:24.199764+0000","last_clean":"2024-04-25T02:20:24.199764+0000","last_became_active":"2024-04-25T02:20:24.196137+0000","last_became_peered":"2024-04-25T02:20:24.196137+0000","last_unstale":"2024-04-25T02:20:24.199764+0000","last_undegraded":"2024-04-25T02:20:24.199764+0000","last_fullsized":"2024-04-25T02:20:24.199764+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"18'3","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.250025+0000","last_change":"2024-04-25T02:20:23.877498+0000","last_active":"2024-04-25T02:20:26.250025+0000","last_peered":"2024-04-25T02:20:26.250025+0000","last_clean":"2024-04-25T02:20:26.250025+0000","last_became_active":"2024-04-25T02:20:23.876803+0000","last_became_peered":"2024-04-25T02:20:23.876803+0000","last_unstale":"2024-04-25T02:20:26.250025+0000","last_undegraded":"2024-04-25T02:20:26.250025+0000","last_fullsized":"2024-04-25T02:20:26.250025+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.196580+0000","last_change":"2024-04-25T02:20:24.192558+0000","last_active":"2024-04-25T02:20:24.196580+0000","last_peered":"2024-04-25T02:20:24.196580+0000","last_clean":"2024-04-25T02:20:24.196580+0000","last_became_active":"2024-04-25T02:20:24.191880+0000","last_became_peered":"2024-04-25T02:20:24.191880+0000","last_unstale":"2024-04-25T02:20:24.196580+0000","last_undegraded":"2024-04-25T02:20:24.196580+0000","last_fullsized":"2024-04-25T02:20:24.196580+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.249543+0000","last_change":"2024-04-25T02:20:23.885888+0000","last_active":"2024-04-25T02:20:26.249543+0000","last_peered":"2024-04-25T02:20:26.249543+0000","last_clean":"2024-04-25T02:20:26.249543+0000","last_became_active":"2024-04-25T02:20:23.885589+0000","last_became_peered":"2024-04-25T02:20:23.885589+0000","last_unstale":"2024-04-25T02:20:26.249543+0000","last_undegraded":"2024-04-25T02:20:26.249543+0000","last_fullsized":"2024-04-25T02:20:26.249543+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.201755+0000","last_change":"2024-04-25T02:20:24.198607+0000","last_active":"2024-04-25T02:20:24.201755+0000","last_peered":"2024-04-25T02:20:24.201755+0000","last_clean":"2024-04-25T02:20:24.201755+0000","last_became_active":"2024-04-25T02:20:24.196892+0000","last_became_peered":"2024-04-25T02:20:24.196892+0000","last_unstale":"2024-04-25T02:20:24.201755+0000","last_undegraded":"2024-04-25T02:20:24.201755+0000","last_fullsized":"2024-04-25T02:20:24.201755+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.167790+0000","last_change":"2024-04-25T02:20:23.883408+0000","last_active":"2024-04-25T02:20:25.167790+0000","last_peered":"2024-04-25T02:20:25.167790+0000","last_clean":"2024-04-25T02:20:25.167790+0000","last_became_active":"2024-04-25T02:20:23.882488+0000","last_became_peered":"2024-04-25T02:20:23.882488+0000","last_unstale":"2024-04-25T02:20:25.167790+0000","last_undegraded":"2024-04-25T02:20:25.167790+0000","last_fullsized":"2024-04-25T02:20:25.167790+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.188614+0000","last_change":"2024-04-25T02:20:24.180953+0000","last_active":"2024-04-25T02:20:24.188614+0000","last_peered":"2024-04-25T02:20:24.188614+0000","last_clean":"2024-04-25T02:20:24.188614+0000","last_became_active":"2024-04-25T02:20:24.180646+0000","last_became_peered":"2024-04-25T02:20:24.180646+0000","last_unstale":"2024-04-25T02:20:24.188614+0000","last_undegraded":"2024-04-25T02:20:24.188614+0000","last_fullsized":"2024-04-25T02:20:24.188614+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"18'8","reported_seq":18,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.244995+0000","last_change":"2024-04-25T02:20:23.890383+0000","last_active":"2024-04-25T02:20:26.244995+0000","last_peered":"2024-04-25T02:20:26.244995+0000","last_clean":"2024-04-25T02:20:26.244995+0000","last_became_active":"2024-04-25T02:20:23.890015+0000","last_became_peered":"2024-04-25T02:20:23.890015+0000","last_unstale":"2024-04-25T02:20:26.244995+0000","last_undegraded":"2024-04-25T02:20:26.244995+0000","last_fullsized":"2024-04-25T02:20:26.244995+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":1535,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.193067+0000","last_change":"2024-04-25T02:20:24.186645+0000","last_active":"2024-04-25T02:20:24.193067+0000","last_peered":"2024-04-25T02:20:24.193067+0000","last_clean":"2024-04-25T02:20:24.193067+0000","last_became_active":"2024-04-25T02:20:24.186336+0000","last_became_peered":"2024-04-25T02:20:24.186336+0000","last_unstale":"2024-04-25T02:20:24.193067+0000","last_undegraded":"2024-04-25T02:20:24.193067+0000","last_fullsized":"2024-04-25T02:20:24.193067+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.248214+0000","last_change":"2024-04-25T02:20:23.882583+0000","last_active":"2024-04-25T02:20:26.248214+0000","last_peered":"2024-04-25T02:20:26.248214+0000","last_clean":"2024-04-25T02:20:26.248214+0000","last_became_active":"2024-04-25T02:20:23.882254+0000","last_became_peered":"2024-04-25T02:20:23.882254+0000","last_unstale":"2024-04-25T02:20:26.248214+0000","last_undegraded":"2024-04-25T02:20:26.248214+0000","last_fullsized":"2024-04-25T02:20:26.248214+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.197776+0000","last_change":"2024-04-25T02:20:24.191415+0000","last_active":"2024-04-25T02:20:24.197776+0000","last_peered":"2024-04-25T02:20:24.197776+0000","last_clean":"2024-04-25T02:20:24.197776+0000","last_became_active":"2024-04-25T02:20:24.191024+0000","last_became_peered":"2024-04-25T02:20:24.191024+0000","last_unstale":"2024-04-25T02:20:24.197776+0000","last_undegraded":"2024-04-25T02:20:24.197776+0000","last_fullsized":"2024-04-25T02:20:24.197776+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"18'3","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.248576+0000","last_change":"2024-04-25T02:20:23.881482+0000","last_active":"2024-04-25T02:20:26.248576+0000","last_peered":"2024-04-25T02:20:26.248576+0000","last_clean":"2024-04-25T02:20:26.248576+0000","last_became_active":"2024-04-25T02:20:23.881128+0000","last_became_peered":"2024-04-25T02:20:23.881128+0000","last_unstale":"2024-04-25T02:20:26.248576+0000","last_undegraded":"2024-04-25T02:20:26.248576+0000","last_fullsized":"2024-04-25T02:20:26.248576+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.199346+0000","last_change":"2024-04-25T02:20:24.197800+0000","last_active":"2024-04-25T02:20:24.199346+0000","last_peered":"2024-04-25T02:20:24.199346+0000","last_clean":"2024-04-25T02:20:24.199346+0000","last_became_active":"2024-04-25T02:20:24.188621+0000","last_became_peered":"2024-04-25T02:20:24.188621+0000","last_unstale":"2024-04-25T02:20:24.199346+0000","last_undegraded":"2024-04-25T02:20:24.199346+0000","last_fullsized":"2024-04-25T02:20:24.199346+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.169346+0000","last_change":"2024-04-25T02:20:23.890803+0000","last_active":"2024-04-25T02:20:24.169346+0000","last_peered":"2024-04-25T02:20:24.169346+0000","last_clean":"2024-04-25T02:20:24.169346+0000","last_became_active":"2024-04-25T02:20:23.890114+0000","last_became_peered":"2024-04-25T02:20:23.890114+0000","last_unstale":"2024-04-25T02:20:24.169346+0000","last_undegraded":"2024-04-25T02:20:24.169346+0000","last_fullsized":"2024-04-25T02:20:24.169346+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.192424+0000","last_change":"2024-04-25T02:20:24.186816+0000","last_active":"2024-04-25T02:20:24.192424+0000","last_peered":"2024-04-25T02:20:24.192424+0000","last_clean":"2024-04-25T02:20:24.192424+0000","last_became_active":"2024-04-25T02:20:24.185644+0000","last_became_peered":"2024-04-25T02:20:24.185644+0000","last_unstale":"2024-04-25T02:20:24.192424+0000","last_undegraded":"2024-04-25T02:20:24.192424+0000","last_fullsized":"2024-04-25T02:20:24.192424+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'10","reported_seq":20,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.250313+0000","last_change":"2024-04-25T02:20:23.873213+0000","last_active":"2024-04-25T02:20:26.250313+0000","last_peered":"2024-04-25T02:20:26.250313+0000","last_clean":"2024-04-25T02:20:26.250313+0000","last_became_active":"2024-04-25T02:20:23.872886+0000","last_became_peered":"2024-04-25T02:20:23.872886+0000","last_unstale":"2024-04-25T02:20:26.250313+0000","last_undegraded":"2024-04-25T02:20:26.250313+0000","last_fullsized":"2024-04-25T02:20:26.250313+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":10,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.199743+0000","last_change":"2024-04-25T02:20:24.196436+0000","last_active":"2024-04-25T02:20:24.199743+0000","last_peered":"2024-04-25T02:20:24.199743+0000","last_clean":"2024-04-25T02:20:24.199743+0000","last_became_active":"2024-04-25T02:20:24.195763+0000","last_became_peered":"2024-04-25T02:20:24.195763+0000","last_unstale":"2024-04-25T02:20:24.199743+0000","last_undegraded":"2024-04-25T02:20:24.199743+0000","last_fullsized":"2024-04-25T02:20:24.199743+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.187972+0000","last_change":"2024-04-25T02:20:23.872612+0000","last_active":"2024-04-25T02:20:24.187972+0000","last_peered":"2024-04-25T02:20:24.187972+0000","last_clean":"2024-04-25T02:20:24.187972+0000","last_became_active":"2024-04-25T02:20:23.872266+0000","last_became_peered":"2024-04-25T02:20:23.872266+0000","last_unstale":"2024-04-25T02:20:24.187972+0000","last_undegraded":"2024-04-25T02:20:24.187972+0000","last_fullsized":"2024-04-25T02:20:24.187972+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.197208+0000","last_change":"2024-04-25T02:20:24.194953+0000","last_active":"2024-04-25T02:20:24.197208+0000","last_peered":"2024-04-25T02:20:24.197208+0000","last_clean":"2024-04-25T02:20:24.197208+0000","last_became_active":"2024-04-25T02:20:24.194637+0000","last_became_peered":"2024-04-25T02:20:24.194637+0000","last_unstale":"2024-04-25T02:20:24.197208+0000","last_undegraded":"2024-04-25T02:20:24.197208+0000","last_fullsized":"2024-04-25T02:20:24.197208+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.183925+0000","last_change":"2024-04-25T02:20:23.876382+0000","last_active":"2024-04-25T02:20:24.183925+0000","last_peered":"2024-04-25T02:20:24.183925+0000","last_clean":"2024-04-25T02:20:24.183925+0000","last_became_active":"2024-04-25T02:20:23.875806+0000","last_became_peered":"2024-04-25T02:20:23.875806+0000","last_unstale":"2024-04-25T02:20:24.183925+0000","last_undegraded":"2024-04-25T02:20:24.183925+0000","last_fullsized":"2024-04-25T02:20:24.183925+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.194532+0000","last_change":"2024-04-25T02:20:24.190109+0000","last_active":"2024-04-25T02:20:24.194532+0000","last_peered":"2024-04-25T02:20:24.194532+0000","last_clean":"2024-04-25T02:20:24.194532+0000","last_became_active":"2024-04-25T02:20:24.189801+0000","last_became_peered":"2024-04-25T02:20:24.189801+0000","last_unstale":"2024-04-25T02:20:24.194532+0000","last_undegraded":"2024-04-25T02:20:24.194532+0000","last_fullsized":"2024-04-25T02:20:24.194532+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.199086+0000","last_change":"2024-04-25T02:20:23.885537+0000","last_active":"2024-04-25T02:20:24.199086+0000","last_peered":"2024-04-25T02:20:24.199086+0000","last_clean":"2024-04-25T02:20:24.199086+0000","last_became_active":"2024-04-25T02:20:23.885190+0000","last_became_peered":"2024-04-25T02:20:23.885190+0000","last_unstale":"2024-04-25T02:20:24.199086+0000","last_undegraded":"2024-04-25T02:20:24.199086+0000","last_fullsized":"2024-04-25T02:20:24.199086+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.193670+0000","last_change":"2024-04-25T02:20:24.188326+0000","last_active":"2024-04-25T02:20:24.193670+0000","last_peered":"2024-04-25T02:20:24.193670+0000","last_clean":"2024-04-25T02:20:24.193670+0000","last_became_active":"2024-04-25T02:20:24.187661+0000","last_became_peered":"2024-04-25T02:20:24.187661+0000","last_unstale":"2024-04-25T02:20:24.193670+0000","last_undegraded":"2024-04-25T02:20:24.193670+0000","last_fullsized":"2024-04-25T02:20:24.193670+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.168528+0000","last_change":"2024-04-25T02:20:23.877401+0000","last_active":"2024-04-25T02:20:24.168528+0000","last_peered":"2024-04-25T02:20:24.168528+0000","last_clean":"2024-04-25T02:20:24.168528+0000","last_became_active":"2024-04-25T02:20:23.876871+0000","last_became_peered":"2024-04-25T02:20:23.876871+0000","last_unstale":"2024-04-25T02:20:24.168528+0000","last_undegraded":"2024-04-25T02:20:24.168528+0000","last_fullsized":"2024-04-25T02:20:24.168528+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.193968+0000","last_change":"2024-04-25T02:20:24.185293+0000","last_active":"2024-04-25T02:20:24.193968+0000","last_peered":"2024-04-25T02:20:24.193968+0000","last_clean":"2024-04-25T02:20:24.193968+0000","last_became_active":"2024-04-25T02:20:24.184978+0000","last_became_peered":"2024-04-25T02:20:24.184978+0000","last_unstale":"2024-04-25T02:20:24.193968+0000","last_undegraded":"2024-04-25T02:20:24.193968+0000","last_fullsized":"2024-04-25T02:20:24.193968+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.248087+0000","last_change":"2024-04-25T02:20:23.886478+0000","last_active":"2024-04-25T02:20:26.248087+0000","last_peered":"2024-04-25T02:20:26.248087+0000","last_clean":"2024-04-25T02:20:26.248087+0000","last_became_active":"2024-04-25T02:20:23.886157+0000","last_became_peered":"2024-04-25T02:20:23.886157+0000","last_unstale":"2024-04-25T02:20:26.248087+0000","last_undegraded":"2024-04-25T02:20:26.248087+0000","last_fullsized":"2024-04-25T02:20:26.248087+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.204062+0000","last_change":"2024-04-25T02:20:24.199344+0000","last_active":"2024-04-25T02:20:24.204062+0000","last_peered":"2024-04-25T02:20:24.204062+0000","last_clean":"2024-04-25T02:20:24.204062+0000","last_became_active":"2024-04-25T02:20:24.199010+0000","last_became_peered":"2024-04-25T02:20:24.199010+0000","last_unstale":"2024-04-25T02:20:24.204062+0000","last_undegraded":"2024-04-25T02:20:24.204062+0000","last_fullsized":"2024-04-25T02:20:24.204062+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.161596+0000","last_change":"2024-04-25T02:20:23.884331+0000","last_active":"2024-04-25T02:20:24.161596+0000","last_peered":"2024-04-25T02:20:24.161596+0000","last_clean":"2024-04-25T02:20:24.161596+0000","last_became_active":"2024-04-25T02:20:23.883987+0000","last_became_peered":"2024-04-25T02:20:23.883987+0000","last_unstale":"2024-04-25T02:20:24.161596+0000","last_undegraded":"2024-04-25T02:20:24.161596+0000","last_fullsized":"2024-04-25T02:20:24.161596+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.198604+0000","last_change":"2024-04-25T02:20:24.191297+0000","last_active":"2024-04-25T02:20:24.198604+0000","last_peered":"2024-04-25T02:20:24.198604+0000","last_clean":"2024-04-25T02:20:24.198604+0000","last_became_active":"2024-04-25T02:20:24.190401+0000","last_became_peered":"2024-04-25T02:20:24.190401+0000","last_unstale":"2024-04-25T02:20:24.198604+0000","last_undegraded":"2024-04-25T02:20:24.198604+0000","last_fullsized":"2024-04-25T02:20:24.198604+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"18'3","reported_seq":13,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.250453+0000","last_change":"2024-04-25T02:20:23.881257+0000","last_active":"2024-04-25T02:20:26.250453+0000","last_peered":"2024-04-25T02:20:26.250453+0000","last_clean":"2024-04-25T02:20:26.250453+0000","last_became_active":"2024-04-25T02:20:23.880935+0000","last_became_peered":"2024-04-25T02:20:23.880935+0000","last_unstale":"2024-04-25T02:20:26.250453+0000","last_undegraded":"2024-04-25T02:20:26.250453+0000","last_fullsized":"2024-04-25T02:20:26.250453+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.193753+0000","last_change":"2024-04-25T02:20:24.189432+0000","last_active":"2024-04-25T02:20:24.193753+0000","last_peered":"2024-04-25T02:20:24.193753+0000","last_clean":"2024-04-25T02:20:24.193753+0000","last_became_active":"2024-04-25T02:20:24.189016+0000","last_became_peered":"2024-04-25T02:20:24.189016+0000","last_unstale":"2024-04-25T02:20:24.193753+0000","last_undegraded":"2024-04-25T02:20:24.193753+0000","last_fullsized":"2024-04-25T02:20:24.193753+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.247109+0000","last_change":"2024-04-25T02:20:23.885274+0000","last_active":"2024-04-25T02:20:26.247109+0000","last_peered":"2024-04-25T02:20:26.247109+0000","last_clean":"2024-04-25T02:20:26.247109+0000","last_became_active":"2024-04-25T02:20:23.884934+0000","last_became_peered":"2024-04-25T02:20:23.884934+0000","last_unstale":"2024-04-25T02:20:26.247109+0000","last_undegraded":"2024-04-25T02:20:26.247109+0000","last_fullsized":"2024-04-25T02:20:26.247109+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.194522+0000","last_change":"2024-04-25T02:20:24.192355+0000","last_active":"2024-04-25T02:20:24.194522+0000","last_peered":"2024-04-25T02:20:24.194522+0000","last_clean":"2024-04-25T02:20:24.194522+0000","last_became_active":"2024-04-25T02:20:24.191909+0000","last_became_peered":"2024-04-25T02:20:24.191909+0000","last_unstale":"2024-04-25T02:20:24.194522+0000","last_undegraded":"2024-04-25T02:20:24.194522+0000","last_fullsized":"2024-04-25T02:20:24.194522+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.161935+0000","last_change":"2024-04-25T02:20:15.491093+0000","last_active":"2024-04-25T02:20:24.161935+0000","last_peered":"2024-04-25T02:20:24.161935+0000","last_clean":"2024-04-25T02:20:24.161935+0000","last_became_active":"2024-04-25T02:20:15.490770+0000","last_became_peered":"2024-04-25T02:20:15.490770+0000","last_unstale":"2024-04-25T02:20:24.161935+0000","last_undegraded":"2024-04-25T02:20:24.161935+0000","last_fullsized":"2024-04-25T02:20:24.161935+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.167026+0000","last_change":"2024-04-25T02:20:23.885604+0000","last_active":"2024-04-25T02:20:25.167026+0000","last_peered":"2024-04-25T02:20:25.167026+0000","last_clean":"2024-04-25T02:20:25.167026+0000","last_became_active":"2024-04-25T02:20:23.885298+0000","last_became_peered":"2024-04-25T02:20:23.885298+0000","last_unstale":"2024-04-25T02:20:25.167026+0000","last_undegraded":"2024-04-25T02:20:25.167026+0000","last_fullsized":"2024-04-25T02:20:25.167026+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.194944+0000","last_change":"2024-04-25T02:20:24.189688+0000","last_active":"2024-04-25T02:20:24.194944+0000","last_peered":"2024-04-25T02:20:24.194944+0000","last_clean":"2024-04-25T02:20:24.194944+0000","last_became_active":"2024-04-25T02:20:24.189417+0000","last_became_peered":"2024-04-25T02:20:24.189417+0000","last_unstale":"2024-04-25T02:20:24.194944+0000","last_undegraded":"2024-04-25T02:20:24.194944+0000","last_fullsized":"2024-04-25T02:20:24.194944+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.162049+0000","last_change":"2024-04-25T02:20:15.489991+0000","last_active":"2024-04-25T02:20:24.162049+0000","last_peered":"2024-04-25T02:20:24.162049+0000","last_clean":"2024-04-25T02:20:24.162049+0000","last_became_active":"2024-04-25T02:20:15.489641+0000","last_became_peered":"2024-04-25T02:20:15.489641+0000","last_unstale":"2024-04-25T02:20:24.162049+0000","last_undegraded":"2024-04-25T02:20:24.162049+0000","last_fullsized":"2024-04-25T02:20:24.162049+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"18'2","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.250313+0000","last_change":"2024-04-25T02:20:23.875583+0000","last_active":"2024-04-25T02:20:26.250313+0000","last_peered":"2024-04-25T02:20:26.250313+0000","last_clean":"2024-04-25T02:20:26.250313+0000","last_became_active":"2024-04-25T02:20:23.875234+0000","last_became_peered":"2024-04-25T02:20:23.875234+0000","last_unstale":"2024-04-25T02:20:26.250313+0000","last_undegraded":"2024-04-25T02:20:26.250313+0000","last_fullsized":"2024-04-25T02:20:26.250313+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.179030+0000","last_change":"2024-04-25T02:20:24.172708+0000","last_active":"2024-04-25T02:20:24.179030+0000","last_peered":"2024-04-25T02:20:24.179030+0000","last_clean":"2024-04-25T02:20:24.179030+0000","last_became_active":"2024-04-25T02:20:24.172138+0000","last_became_peered":"2024-04-25T02:20:24.172138+0000","last_unstale":"2024-04-25T02:20:24.179030+0000","last_undegraded":"2024-04-25T02:20:24.179030+0000","last_fullsized":"2024-04-25T02:20:24.179030+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.159793+0000","last_change":"2024-04-25T02:20:15.488908+0000","last_active":"2024-04-25T02:20:24.159793+0000","last_peered":"2024-04-25T02:20:24.159793+0000","last_clean":"2024-04-25T02:20:24.159793+0000","last_became_active":"2024-04-25T02:20:15.488569+0000","last_became_peered":"2024-04-25T02:20:15.488569+0000","last_unstale":"2024-04-25T02:20:24.159793+0000","last_undegraded":"2024-04-25T02:20:24.159793+0000","last_fullsized":"2024-04-25T02:20:24.159793+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.279870+0000","last_change":"2024-04-25T02:20:23.872080+0000","last_active":"2024-04-25T02:20:25.279870+0000","last_peered":"2024-04-25T02:20:25.279870+0000","last_clean":"2024-04-25T02:20:25.279870+0000","last_became_active":"2024-04-25T02:20:23.871751+0000","last_became_peered":"2024-04-25T02:20:23.871751+0000","last_unstale":"2024-04-25T02:20:25.279870+0000","last_undegraded":"2024-04-25T02:20:25.279870+0000","last_fullsized":"2024-04-25T02:20:25.279870+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.183350+0000","last_change":"2024-04-25T02:20:24.174377+0000","last_active":"2024-04-25T02:20:24.183350+0000","last_peered":"2024-04-25T02:20:24.183350+0000","last_clean":"2024-04-25T02:20:24.183350+0000","last_became_active":"2024-04-25T02:20:24.174100+0000","last_became_peered":"2024-04-25T02:20:24.174100+0000","last_unstale":"2024-04-25T02:20:24.183350+0000","last_undegraded":"2024-04-25T02:20:24.183350+0000","last_fullsized":"2024-04-25T02:20:24.183350+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.159203+0000","last_change":"2024-04-25T02:20:15.487675+0000","last_active":"2024-04-25T02:20:24.159203+0000","last_peered":"2024-04-25T02:20:24.159203+0000","last_clean":"2024-04-25T02:20:24.159203+0000","last_became_active":"2024-04-25T02:20:15.487331+0000","last_became_peered":"2024-04-25T02:20:15.487331+0000","last_unstale":"2024-04-25T02:20:24.159203+0000","last_undegraded":"2024-04-25T02:20:24.159203+0000","last_fullsized":"2024-04-25T02:20:24.159203+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"10'1","reported_seq":17,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.164063+0000","last_change":"2024-04-25T02:20:11.467819+0000","last_active":"2024-04-25T02:20:24.164063+0000","last_peered":"2024-04-25T02:20:24.164063+0000","last_clean":"2024-04-25T02:20:24.164063+0000","last_became_active":"2024-04-25T02:20:11.467259+0000","last_became_peered":"2024-04-25T02:20:11.467259+0000","last_unstale":"2024-04-25T02:20:24.164063+0000","last_undegraded":"2024-04-25T02:20:24.164063+0000","last_fullsized":"2024-04-25T02:20:24.164063+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:08.432182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:08.432182+0000","last_clean_scrub_stamp":"2024-04-25T02:20:08.432182+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.161484+0000","last_change":"2024-04-25T02:20:23.891327+0000","last_active":"2024-04-25T02:20:24.161484+0000","last_peered":"2024-04-25T02:20:24.161484+0000","last_clean":"2024-04-25T02:20:24.161484+0000","last_became_active":"2024-04-25T02:20:23.891033+0000","last_became_peered":"2024-04-25T02:20:23.891033+0000","last_unstale":"2024-04-25T02:20:24.161484+0000","last_undegraded":"2024-04-25T02:20:24.161484+0000","last_fullsized":"2024-04-25T02:20:24.161484+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.198627+0000","last_change":"2024-04-25T02:20:24.191472+0000","last_active":"2024-04-25T02:20:24.198627+0000","last_peered":"2024-04-25T02:20:24.198627+0000","last_clean":"2024-04-25T02:20:24.198627+0000","last_became_active":"2024-04-25T02:20:24.190777+0000","last_became_peered":"2024-04-25T02:20:24.190777+0000","last_unstale":"2024-04-25T02:20:24.198627+0000","last_undegraded":"2024-04-25T02:20:24.198627+0000","last_fullsized":"2024-04-25T02:20:24.198627+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.160031+0000","last_change":"2024-04-25T02:20:15.490166+0000","last_active":"2024-04-25T02:20:24.160031+0000","last_peered":"2024-04-25T02:20:24.160031+0000","last_clean":"2024-04-25T02:20:24.160031+0000","last_became_active":"2024-04-25T02:20:15.489795+0000","last_became_peered":"2024-04-25T02:20:15.489795+0000","last_unstale":"2024-04-25T02:20:24.160031+0000","last_undegraded":"2024-04-25T02:20:24.160031+0000","last_fullsized":"2024-04-25T02:20:24.160031+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.165306+0000","last_change":"2024-04-25T02:20:23.875637+0000","last_active":"2024-04-25T02:20:25.165306+0000","last_peered":"2024-04-25T02:20:25.165306+0000","last_clean":"2024-04-25T02:20:25.165306+0000","last_became_active":"2024-04-25T02:20:23.875042+0000","last_became_peered":"2024-04-25T02:20:23.875042+0000","last_unstale":"2024-04-25T02:20:25.165306+0000","last_undegraded":"2024-04-25T02:20:25.165306+0000","last_fullsized":"2024-04-25T02:20:25.165306+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.194840+0000","last_change":"2024-04-25T02:20:24.190630+0000","last_active":"2024-04-25T02:20:24.194840+0000","last_peered":"2024-04-25T02:20:24.194840+0000","last_clean":"2024-04-25T02:20:24.194840+0000","last_became_active":"2024-04-25T02:20:24.190288+0000","last_became_peered":"2024-04-25T02:20:24.190288+0000","last_unstale":"2024-04-25T02:20:24.194840+0000","last_undegraded":"2024-04-25T02:20:24.194840+0000","last_fullsized":"2024-04-25T02:20:24.194840+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.163172+0000","last_change":"2024-04-25T02:20:15.485725+0000","last_active":"2024-04-25T02:20:24.163172+0000","last_peered":"2024-04-25T02:20:24.163172+0000","last_clean":"2024-04-25T02:20:24.163172+0000","last_became_active":"2024-04-25T02:20:15.485352+0000","last_became_peered":"2024-04-25T02:20:15.485352+0000","last_unstale":"2024-04-25T02:20:24.163172+0000","last_undegraded":"2024-04-25T02:20:24.163172+0000","last_fullsized":"2024-04-25T02:20:24.163172+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.161324+0000","last_change":"2024-04-25T02:20:23.879989+0000","last_active":"2024-04-25T02:20:24.161324+0000","last_peered":"2024-04-25T02:20:24.161324+0000","last_clean":"2024-04-25T02:20:24.161324+0000","last_became_active":"2024-04-25T02:20:23.877442+0000","last_became_peered":"2024-04-25T02:20:23.877442+0000","last_unstale":"2024-04-25T02:20:24.161324+0000","last_undegraded":"2024-04-25T02:20:24.161324+0000","last_fullsized":"2024-04-25T02:20:24.161324+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.180879+0000","last_change":"2024-04-25T02:20:24.176550+0000","last_active":"2024-04-25T02:20:24.180879+0000","last_peered":"2024-04-25T02:20:24.180879+0000","last_clean":"2024-04-25T02:20:24.180879+0000","last_became_active":"2024-04-25T02:20:24.176249+0000","last_became_peered":"2024-04-25T02:20:24.176249+0000","last_unstale":"2024-04-25T02:20:24.180879+0000","last_undegraded":"2024-04-25T02:20:24.180879+0000","last_fullsized":"2024-04-25T02:20:24.180879+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'4","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.243563+0000","last_change":"2024-04-25T02:20:23.884258+0000","last_active":"2024-04-25T02:20:26.243563+0000","last_peered":"2024-04-25T02:20:26.243563+0000","last_clean":"2024-04-25T02:20:26.243563+0000","last_became_active":"2024-04-25T02:20:23.883867+0000","last_became_peered":"2024-04-25T02:20:23.883867+0000","last_unstale":"2024-04-25T02:20:26.243563+0000","last_undegraded":"2024-04-25T02:20:26.243563+0000","last_fullsized":"2024-04-25T02:20:26.243563+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.160757+0000","last_change":"2024-04-25T02:20:15.490162+0000","last_active":"2024-04-25T02:20:24.160757+0000","last_peered":"2024-04-25T02:20:24.160757+0000","last_clean":"2024-04-25T02:20:24.160757+0000","last_became_active":"2024-04-25T02:20:15.489760+0000","last_became_peered":"2024-04-25T02:20:15.489760+0000","last_unstale":"2024-04-25T02:20:24.160757+0000","last_undegraded":"2024-04-25T02:20:24.160757+0000","last_fullsized":"2024-04-25T02:20:24.160757+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.197090+0000","last_change":"2024-04-25T02:20:24.192993+0000","last_active":"2024-04-25T02:20:24.197090+0000","last_peered":"2024-04-25T02:20:24.197090+0000","last_clean":"2024-04-25T02:20:24.197090+0000","last_became_active":"2024-04-25T02:20:24.192258+0000","last_became_peered":"2024-04-25T02:20:24.192258+0000","last_unstale":"2024-04-25T02:20:24.197090+0000","last_undegraded":"2024-04-25T02:20:24.197090+0000","last_fullsized":"2024-04-25T02:20:24.197090+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":13,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.169672+0000","last_change":"2024-04-25T02:20:15.488540+0000","last_active":"2024-04-25T02:20:24.169672+0000","last_peered":"2024-04-25T02:20:24.169672+0000","last_clean":"2024-04-25T02:20:24.169672+0000","last_became_active":"2024-04-25T02:20:15.488148+0000","last_became_peered":"2024-04-25T02:20:15.488148+0000","last_unstale":"2024-04-25T02:20:24.169672+0000","last_undegraded":"2024-04-25T02:20:24.169672+0000","last_fullsized":"2024-04-25T02:20:24.169672+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"18'1","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.165485+0000","last_change":"2024-04-25T02:20:23.882042+0000","last_active":"2024-04-25T02:20:25.165485+0000","last_peered":"2024-04-25T02:20:25.165485+0000","last_clean":"2024-04-25T02:20:25.165485+0000","last_became_active":"2024-04-25T02:20:23.881660+0000","last_became_peered":"2024-04-25T02:20:23.881660+0000","last_unstale":"2024-04-25T02:20:25.165485+0000","last_undegraded":"2024-04-25T02:20:25.165485+0000","last_fullsized":"2024-04-25T02:20:25.165485+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.193640+0000","last_change":"2024-04-25T02:20:24.188573+0000","last_active":"2024-04-25T02:20:24.193640+0000","last_peered":"2024-04-25T02:20:24.193640+0000","last_clean":"2024-04-25T02:20:24.193640+0000","last_became_active":"2024-04-25T02:20:24.188251+0000","last_became_peered":"2024-04-25T02:20:24.188251+0000","last_unstale":"2024-04-25T02:20:24.193640+0000","last_undegraded":"2024-04-25T02:20:24.193640+0000","last_fullsized":"2024-04-25T02:20:24.193640+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"18'5","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.248784+0000","last_change":"2024-04-25T02:20:23.883575+0000","last_active":"2024-04-25T02:20:26.248784+0000","last_peered":"2024-04-25T02:20:26.248784+0000","last_clean":"2024-04-25T02:20:26.248784+0000","last_became_active":"2024-04-25T02:20:23.883144+0000","last_became_peered":"2024-04-25T02:20:23.883144+0000","last_unstale":"2024-04-25T02:20:26.248784+0000","last_undegraded":"2024-04-25T02:20:26.248784+0000","last_fullsized":"2024-04-25T02:20:26.248784+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":574,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.185264+0000","last_change":"2024-04-25T02:20:24.170678+0000","last_active":"2024-04-25T02:20:24.185264+0000","last_peered":"2024-04-25T02:20:24.185264+0000","last_clean":"2024-04-25T02:20:24.185264+0000","last_became_active":"2024-04-25T02:20:24.170488+0000","last_became_peered":"2024-04-25T02:20:24.170488+0000","last_unstale":"2024-04-25T02:20:24.185264+0000","last_undegraded":"2024-04-25T02:20:24.185264+0000","last_fullsized":"2024-04-25T02:20:24.185264+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.179405+0000","last_change":"2024-04-25T02:20:23.881809+0000","last_active":"2024-04-25T02:20:24.179405+0000","last_peered":"2024-04-25T02:20:24.179405+0000","last_clean":"2024-04-25T02:20:24.179405+0000","last_became_active":"2024-04-25T02:20:23.878991+0000","last_became_peered":"2024-04-25T02:20:23.878991+0000","last_unstale":"2024-04-25T02:20:24.179405+0000","last_undegraded":"2024-04-25T02:20:24.179405+0000","last_fullsized":"2024-04-25T02:20:24.179405+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.201609+0000","last_change":"2024-04-25T02:20:24.197009+0000","last_active":"2024-04-25T02:20:24.201609+0000","last_peered":"2024-04-25T02:20:24.201609+0000","last_clean":"2024-04-25T02:20:24.201609+0000","last_became_active":"2024-04-25T02:20:24.196535+0000","last_became_peered":"2024-04-25T02:20:24.196535+0000","last_unstale":"2024-04-25T02:20:24.201609+0000","last_undegraded":"2024-04-25T02:20:24.201609+0000","last_fullsized":"2024-04-25T02:20:24.201609+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":12,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.199642+0000","last_change":"2024-04-25T02:20:23.888031+0000","last_active":"2024-04-25T02:20:24.199642+0000","last_peered":"2024-04-25T02:20:24.199642+0000","last_clean":"2024-04-25T02:20:24.199642+0000","last_became_active":"2024-04-25T02:20:23.887730+0000","last_became_peered":"2024-04-25T02:20:23.887730+0000","last_unstale":"2024-04-25T02:20:24.199642+0000","last_undegraded":"2024-04-25T02:20:24.199642+0000","last_fullsized":"2024-04-25T02:20:24.199642+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.193693+0000","last_change":"2024-04-25T02:20:24.188502+0000","last_active":"2024-04-25T02:20:24.193693+0000","last_peered":"2024-04-25T02:20:24.193693+0000","last_clean":"2024-04-25T02:20:24.193693+0000","last_became_active":"2024-04-25T02:20:24.188102+0000","last_became_peered":"2024-04-25T02:20:24.188102+0000","last_unstale":"2024-04-25T02:20:24.193693+0000","last_undegraded":"2024-04-25T02:20:24.193693+0000","last_fullsized":"2024-04-25T02:20:24.193693+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":11,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.190792+0000","last_change":"2024-04-25T02:20:23.890367+0000","last_active":"2024-04-25T02:20:24.190792+0000","last_peered":"2024-04-25T02:20:24.190792+0000","last_clean":"2024-04-25T02:20:24.190792+0000","last_became_active":"2024-04-25T02:20:23.889958+0000","last_became_peered":"2024-04-25T02:20:23.889958+0000","last_unstale":"2024-04-25T02:20:24.190792+0000","last_undegraded":"2024-04-25T02:20:24.190792+0000","last_fullsized":"2024-04-25T02:20:24.190792+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":1,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.198626+0000","last_change":"2024-04-25T02:20:24.194271+0000","last_active":"2024-04-25T02:20:24.198626+0000","last_peered":"2024-04-25T02:20:24.198626+0000","last_clean":"2024-04-25T02:20:24.198626+0000","last_became_active":"2024-04-25T02:20:24.193729+0000","last_became_peered":"2024-04-25T02:20:24.193729+0000","last_unstale":"2024-04-25T02:20:24.198626+0000","last_undegraded":"2024-04-25T02:20:24.198626+0000","last_fullsized":"2024-04-25T02:20:24.198626+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":14,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.187833+0000","last_change":"2024-04-25T02:20:23.882173+0000","last_active":"2024-04-25T02:20:24.187833+0000","last_peered":"2024-04-25T02:20:24.187833+0000","last_clean":"2024-04-25T02:20:24.187833+0000","last_became_active":"2024-04-25T02:20:23.881840+0000","last_became_peered":"2024-04-25T02:20:23.881840+0000","last_unstale":"2024-04-25T02:20:24.187833+0000","last_undegraded":"2024-04-25T02:20:24.187833+0000","last_fullsized":"2024-04-25T02:20:24.187833+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":553,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.185324+0000","last_change":"2024-04-25T02:20:24.171268+0000","last_active":"2024-04-25T02:20:24.185324+0000","last_peered":"2024-04-25T02:20:24.185324+0000","last_clean":"2024-04-25T02:20:24.185324+0000","last_became_active":"2024-04-25T02:20:24.170957+0000","last_became_peered":"2024-04-25T02:20:24.170957+0000","last_unstale":"2024-04-25T02:20:24.185324+0000","last_undegraded":"2024-04-25T02:20:24.185324+0000","last_fullsized":"2024-04-25T02:20:24.185324+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.178516+0000","last_change":"2024-04-25T02:20:24.167991+0000","last_active":"2024-04-25T02:20:24.178516+0000","last_peered":"2024-04-25T02:20:24.178516+0000","last_clean":"2024-04-25T02:20:24.178516+0000","last_became_active":"2024-04-25T02:20:24.167659+0000","last_became_peered":"2024-04-25T02:20:24.167659+0000","last_unstale":"2024-04-25T02:20:24.178516+0000","last_undegraded":"2024-04-25T02:20:24.178516+0000","last_fullsized":"2024-04-25T02:20:24.178516+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.198601+0000","last_change":"2024-04-25T02:20:24.194043+0000","last_active":"2024-04-25T02:20:24.198601+0000","last_peered":"2024-04-25T02:20:24.198601+0000","last_clean":"2024-04-25T02:20:24.198601+0000","last_became_active":"2024-04-25T02:20:24.193386+0000","last_became_peered":"2024-04-25T02:20:24.193386+0000","last_unstale":"2024-04-25T02:20:24.198601+0000","last_undegraded":"2024-04-25T02:20:24.198601+0000","last_fullsized":"2024-04-25T02:20:24.198601+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.193815+0000","last_change":"2024-04-25T02:20:24.189262+0000","last_active":"2024-04-25T02:20:24.193815+0000","last_peered":"2024-04-25T02:20:24.193815+0000","last_clean":"2024-04-25T02:20:24.193815+0000","last_became_active":"2024-04-25T02:20:24.188938+0000","last_became_peered":"2024-04-25T02:20:24.188938+0000","last_unstale":"2024-04-25T02:20:24.193815+0000","last_undegraded":"2024-04-25T02:20:24.193815+0000","last_fullsized":"2024-04-25T02:20:24.193815+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.194151+0000","last_change":"2024-04-25T02:20:24.189965+0000","last_active":"2024-04-25T02:20:24.194151+0000","last_peered":"2024-04-25T02:20:24.194151+0000","last_clean":"2024-04-25T02:20:24.194151+0000","last_became_active":"2024-04-25T02:20:24.189042+0000","last_became_peered":"2024-04-25T02:20:24.189042+0000","last_unstale":"2024-04-25T02:20:24.194151+0000","last_undegraded":"2024-04-25T02:20:24.194151+0000","last_fullsized":"2024-04-25T02:20:24.194151+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":9,"reported_epoch":17,"state":"active+clean","last_fresh":"2024-04-25T02:20:24.179008+0000","last_change":"2024-04-25T02:20:24.172462+0000","last_active":"2024-04-25T02:20:24.179008+0000","last_peered":"2024-04-25T02:20:24.179008+0000","last_clean":"2024-04-25T02:20:24.179008+0000","last_became_active":"2024-04-25T02:20:24.171736+0000","last_became_peered":"2024-04-25T02:20:24.171736+0000","last_unstale":"2024-04-25T02:20:24.179008+0000","last_undegraded":"2024-04-25T02:20:24.179008+0000","last_fullsized":"2024-04-25T02:20:24.179008+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":3633,"num_objects":40,"num_object_clones":0,"num_object_copies":80,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":84,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":26,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":114688,"data_stored":7266,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":73,"ondisk_log_size":73,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705669,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048784,"kb_used_data":200,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323056,"statfs":{"total":96636764160,"available":95562809344,"internally_reserved":1073741824,"allocated":204800,"data_stored":53906,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23699999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25900000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.247}]}]},{"osd":2,"up_from":9,"seq":38654705671,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048756,"kb_used_data":172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323084,"statfs":{"total":96636764160,"available":95562838016,"internally_reserved":1073741824,"allocated":176128,"data_stored":52495,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.224}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.26900000000000002}]}]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048768,"kb_used_data":184,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323072,"statfs":{"total":96636764160,"available":95562825728,"internally_reserved":1073741824,"allocated":188416,"data_stored":52764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.20699999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34200000000000003}]}]},{"osd":1,"up_from":9,"seq":38654705670,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048748,"kb_used_data":164,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323092,"statfs":{"total":96636764160,"available":95562846208,"internally_reserved":1073741824,"allocated":167936,"data_stored":51493,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23000000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23899999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22600000000000001}]}]}]}} 2024-04-25T02:20:31.391 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T02:20:31.391 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-25T02:20:31.391 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-25T02:20:31.392 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T02:20:31.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.527+0000 7f618cb3e700 1 Processor -- start 2024-04-25T02:20:31.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.527+0000 7f618cb3e700 1 -- start start 2024-04-25T02:20:31.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.528+0000 7f618cb3e700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f618805c020 0x7f6188061c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:31.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.528+0000 7f618cb3e700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f618805c7e0 0x7f618813ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:31.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.528+0000 7f618cb3e700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61880a7280 con 0x7f618805c400 2024-04-25T02:20:31.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.528+0000 7f618cb3e700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61880a7500 con 0x7f618805c020 2024-04-25T02:20:31.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.528+0000 7f618cb3e700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6188067f10 con 0x7f618805c7e0 2024-04-25T02:20:31.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.528+0000 7f6186d9d700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f618805c7e0 0x7f618813ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:31.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.528+0000 7f6185d9b700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f618805c400 0x7f61880a6b70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:55848/0 (socket says 172.21.15.111:55848) 2024-04-25T02:20:31.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.528+0000 7f618659c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f618805c020 0x7f6188061c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:31.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.528+0000 7f6185d9b700 1 -- 172.21.15.111:0/2487885280 learned_addr learned my addr 172.21.15.111:0/2487885280 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:20:31.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.528+0000 7f6186d9d700 1 -- 172.21.15.111:0/2487885280 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f618805c020 msgr2=0x7f6188061c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:31.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.528+0000 7f6186d9d700 1 --2- 172.21.15.111:0/2487885280 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f618805c020 0x7f6188061c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:31.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.528+0000 7f6186d9d700 1 -- 172.21.15.111:0/2487885280 >> v1:172.21.15.111:6789/0 conn(0x7f618805c400 legacy=0x7f61880a6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:31.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.528+0000 7f618559a700 1 -- 172.21.15.111:0/2487885280 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1759768977 0 0) 0x7f61880a7280 con 0x7f618805c400 2024-04-25T02:20:31.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.528+0000 7f6186d9d700 1 -- 172.21.15.111:0/2487885280 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6188062130 con 0x7f618805c7e0 2024-04-25T02:20:31.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.528+0000 7f618659c700 1 --2- 172.21.15.111:0/2487885280 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f618805c020 0x7f6188061c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:31.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.528+0000 7f6186d9d700 1 --2- 172.21.15.111:0/2487885280 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f618805c7e0 0x7f618813ea60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f6188061b90 tx=0x7f61800091d0).ready entity=mon.2 client_cookie=29194203ce17589 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:31.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.528+0000 7f618559a700 1 -- 172.21.15.111:0/2487885280 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f618000b6b0 con 0x7f618805c7e0 2024-04-25T02:20:31.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.528+0000 7f618559a700 1 -- 172.21.15.111:0/2487885280 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f618000b810 con 0x7f618805c7e0 2024-04-25T02:20:31.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.528+0000 7f618559a700 1 -- 172.21.15.111:0/2487885280 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f618000b980 con 0x7f618805c7e0 2024-04-25T02:20:31.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.529+0000 7f618cb3e700 1 -- 172.21.15.111:0/2487885280 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f618805c7e0 msgr2=0x7f618813ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:31.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.529+0000 7f618cb3e700 1 --2- 172.21.15.111:0/2487885280 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f618805c7e0 0x7f618813ea60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f6188061b90 tx=0x7f61800091d0).stop 2024-04-25T02:20:31.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.529+0000 7f618cb3e700 1 -- 172.21.15.111:0/2487885280 shutdown_connections 2024-04-25T02:20:31.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.529+0000 7f618cb3e700 1 --2- 172.21.15.111:0/2487885280 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f618805c7e0 0x7f618813ea60 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:31.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.529+0000 7f618cb3e700 1 --2- 172.21.15.111:0/2487885280 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f618805c020 0x7f6188061c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:31.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.529+0000 7f618cb3e700 1 -- 172.21.15.111:0/2487885280 >> 172.21.15.111:0/2487885280 conn(0x7f61880a8a00 msgr2=0x7f61880a8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:31.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.529+0000 7f618cb3e700 1 -- 172.21.15.111:0/2487885280 shutdown_connections 2024-04-25T02:20:31.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.529+0000 7f618cb3e700 1 -- 172.21.15.111:0/2487885280 wait complete. 2024-04-25T02:20:31.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.530+0000 7f618cb3e700 1 Processor -- start 2024-04-25T02:20:31.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.530+0000 7f618cb3e700 1 -- start start 2024-04-25T02:20:31.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.531+0000 7f618cb3e700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f618805c020 0x7f61880938a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:31.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.531+0000 7f618cb3e700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f618805c400 0x7f6188143ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:31.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.531+0000 7f618cb3e700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f618805c7e0 0x7f6188143fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:31.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.531+0000 7f618cb3e700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6188093f60 con 0x7f618805c7e0 2024-04-25T02:20:31.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.531+0000 7f618cb3e700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6188094220 con 0x7f618805c400 2024-04-25T02:20:31.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.531+0000 7f618cb3e700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f61880958e0 con 0x7f618805c020 2024-04-25T02:20:31.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.531+0000 7f618659c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f618805c020 0x7f61880938a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:31.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.531+0000 7f6186d9d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f618805c7e0 0x7f6188143fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:31.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.531+0000 7f618659c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f618805c020 0x7f61880938a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:57094/0 (socket says 172.21.15.111:57094) 2024-04-25T02:20:31.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.531+0000 7f618659c700 1 -- 172.21.15.111:0/1199297939 learned_addr learned my addr 172.21.15.111:0/1199297939 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:31.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.531+0000 7f6185d9b700 1 --2- 172.21.15.111:0/1199297939 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f618805c400 0x7f6188143ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:31.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.531+0000 7f618659c700 1 -- 172.21.15.111:0/1199297939 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f618805c400 msgr2=0x7f6188143ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:31.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.531+0000 7f618659c700 1 --2- 172.21.15.111:0/1199297939 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f618805c400 0x7f6188143ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:31.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.531+0000 7f618659c700 1 -- 172.21.15.111:0/1199297939 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f618805c7e0 msgr2=0x7f6188143fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:31.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.531+0000 7f618659c700 1 --2- 172.21.15.111:0/1199297939 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f618805c7e0 0x7f6188143fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:31.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.531+0000 7f618659c700 1 -- 172.21.15.111:0/1199297939 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f617c00b180 con 0x7f618805c020 2024-04-25T02:20:31.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.531+0000 7f618659c700 1 --2- 172.21.15.111:0/1199297939 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f618805c020 0x7f61880938a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f617c00c000 tx=0x7f617c006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:31.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.531+0000 7f61777fe700 1 -- 172.21.15.111:0/1199297939 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f617c00c7e0 con 0x7f618805c020 2024-04-25T02:20:31.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.531+0000 7f61777fe700 1 -- 172.21.15.111:0/1199297939 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f617c00c940 con 0x7f618805c020 2024-04-25T02:20:31.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.531+0000 7f618cb3e700 1 -- 172.21.15.111:0/1199297939 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6180009470 con 0x7f618805c020 2024-04-25T02:20:31.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.531+0000 7f61777fe700 1 -- 172.21.15.111:0/1199297939 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f617c00cca0 con 0x7f618805c020 2024-04-25T02:20:31.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.531+0000 7f618cb3e700 1 -- 172.21.15.111:0/1199297939 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6188095e90 con 0x7f618805c020 2024-04-25T02:20:31.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.532+0000 7f61777fe700 1 -- 172.21.15.111:0/1199297939 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f617c01c460 con 0x7f618805c020 2024-04-25T02:20:31.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.532+0000 7f61777fe700 1 -- 172.21.15.111:0/1199297939 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f617c04af10 con 0x7f618805c020 2024-04-25T02:20:31.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.532+0000 7f618cb3e700 1 -- 172.21.15.111:0/1199297939 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6188095b60 con 0x7f618805c020 2024-04-25T02:20:31.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.535+0000 7f61777fe700 1 -- 172.21.15.111:0/1199297939 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f617c033730 con 0x7f618805c020 2024-04-25T02:20:31.684 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.680+0000 7f618cb3e700 1 -- 172.21.15.111:0/1199297939 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f61880a2e60 con 0x7f618805c020 2024-04-25T02:20:31.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.680+0000 7f61777fe700 1 -- 172.21.15.111:0/1199297939 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f617c00ce00 con 0x7f618805c020 2024-04-25T02:20:31.836 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:20:31.837 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.682+0000 7f618cb3e700 1 -- 172.21.15.111:0/1199297939 >> v1:172.21.15.111:6816/39585 conn(0x7f6164038da0 legacy=0x7f616403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:31.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.682+0000 7f618cb3e700 1 -- 172.21.15.111:0/1199297939 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f618805c020 msgr2=0x7f61880938a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:31.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.682+0000 7f618cb3e700 1 --2- 172.21.15.111:0/1199297939 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f618805c020 0x7f61880938a0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f617c00c000 tx=0x7f617c006df0).stop 2024-04-25T02:20:31.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.682+0000 7f618cb3e700 1 -- 172.21.15.111:0/1199297939 shutdown_connections 2024-04-25T02:20:31.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.682+0000 7f618cb3e700 1 --2- 172.21.15.111:0/1199297939 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f618805c7e0 0x7f6188143fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:31.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.682+0000 7f618cb3e700 1 --2- 172.21.15.111:0/1199297939 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f618805c020 0x7f61880938a0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:31.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.682+0000 7f618cb3e700 1 --2- 172.21.15.111:0/1199297939 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f618805c400 0x7f6188143ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:31.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.682+0000 7f618cb3e700 1 -- 172.21.15.111:0/1199297939 >> 172.21.15.111:0/1199297939 conn(0x7f61880a8a00 msgr2=0x7f6188133ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:31.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.682+0000 7f618cb3e700 1 -- 172.21.15.111:0/1199297939 shutdown_connections 2024-04-25T02:20:31.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.682+0000 7f618cb3e700 1 -- 172.21.15.111:0/1199297939 wait complete. 2024-04-25T02:20:31.838 INFO:teuthology.orchestra.run.smithi111.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T02:20:31.839 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-25T02:20:31.839 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:20:31.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.940+0000 7f2d5f550700 1 Processor -- start 2024-04-25T02:20:31.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.940+0000 7f2d5f550700 1 -- start start 2024-04-25T02:20:31.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.940+0000 7f2d5f550700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f2d58136740 0x7f2d58061a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:31.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.940+0000 7f2d5f550700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2d58060e70 0x7f2d58136b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:31.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.940+0000 7f2d5f550700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2d5809bf90 0x7f2d581395a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:31.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.940+0000 7f2d5f550700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d58060770 con 0x7f2d58136740 2024-04-25T02:20:31.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.940+0000 7f2d5f550700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5809c960 con 0x7f2d5809bf90 2024-04-25T02:20:31.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.940+0000 7f2d5f550700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d581360e0 con 0x7f2d58060e70 2024-04-25T02:20:31.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.941+0000 7f2d5d2ec700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f2d58136740 0x7f2d58061a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:31.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.941+0000 7f2d5caeb700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2d58060e70 0x7f2d58136b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:31.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.941+0000 7f2d5daed700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2d5809bf90 0x7f2d581395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:31.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.941+0000 7f2d5d2ec700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f2d58136740 0x7f2d58061a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48328/0 (socket says 172.21.15.111:48328) 2024-04-25T02:20:31.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.941+0000 7f2d5daed700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2d5809bf90 0x7f2d581395a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:51450/0 (socket says 172.21.15.111:51450) 2024-04-25T02:20:31.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.941+0000 7f2d5caeb700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2d58060e70 0x7f2d58136b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:57110/0 (socket says 172.21.15.111:57110) 2024-04-25T02:20:31.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.941+0000 7f2d5d2ec700 1 -- 172.21.15.111:0/4170931151 learned_addr learned my addr 172.21.15.111:0/4170931151 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:31.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.941+0000 7f2d5daed700 1 -- 172.21.15.111:0/4170931151 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2d58060e70 msgr2=0x7f2d58136b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:31.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.941+0000 7f2d5daed700 1 --2- 172.21.15.111:0/4170931151 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2d58060e70 0x7f2d58136b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:31.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.941+0000 7f2d5daed700 1 -- 172.21.15.111:0/4170931151 >> v2:172.21.15.111:3300/0 conn(0x7f2d58136740 msgr2=0x7f2d58061a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:31.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.941+0000 7f2d5daed700 1 --2- 172.21.15.111:0/4170931151 >> v2:172.21.15.111:3300/0 conn(0x7f2d58136740 0x7f2d58061a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:31.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.941+0000 7f2d5daed700 1 -- 172.21.15.111:0/4170931151 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d58067a00 con 0x7f2d5809bf90 2024-04-25T02:20:31.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.941+0000 7f2d5d2ec700 1 --2- 172.21.15.111:0/4170931151 >> v2:172.21.15.111:3300/0 conn(0x7f2d58136740 0x7f2d58061a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:31.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.941+0000 7f2d5caeb700 1 --2- 172.21.15.111:0/4170931151 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2d58060e70 0x7f2d58136b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:31.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.941+0000 7f2d5daed700 1 --2- 172.21.15.111:0/4170931151 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2d5809bf90 0x7f2d581395a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f2d500032f0 tx=0x7f2d500091d0).ready entity=mon.1 client_cookie=b769587e6cbf1964 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:31.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.941+0000 7f2d47fff700 1 -- 172.21.15.111:0/4170931151 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d5000b600 con 0x7f2d5809bf90 2024-04-25T02:20:31.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.941+0000 7f2d47fff700 1 -- 172.21.15.111:0/4170931151 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d5000b760 con 0x7f2d5809bf90 2024-04-25T02:20:31.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.941+0000 7f2d47fff700 1 -- 172.21.15.111:0/4170931151 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d5000b8d0 con 0x7f2d5809bf90 2024-04-25T02:20:31.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.942+0000 7f2d5f550700 1 -- 172.21.15.111:0/4170931151 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2d5809bf90 msgr2=0x7f2d581395a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:31.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.942+0000 7f2d5f550700 1 --2- 172.21.15.111:0/4170931151 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2d5809bf90 0x7f2d581395a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f2d500032f0 tx=0x7f2d500091d0).stop 2024-04-25T02:20:31.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.942+0000 7f2d5f550700 1 -- 172.21.15.111:0/4170931151 shutdown_connections 2024-04-25T02:20:31.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.942+0000 7f2d5f550700 1 --2- 172.21.15.111:0/4170931151 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2d5809bf90 0x7f2d581395a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:31.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.942+0000 7f2d5f550700 1 --2- 172.21.15.111:0/4170931151 >> v2:172.21.15.111:3300/0 conn(0x7f2d58136740 0x7f2d58061a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:31.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.942+0000 7f2d5f550700 1 --2- 172.21.15.111:0/4170931151 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2d58060e70 0x7f2d58136b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:31.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.942+0000 7f2d5f550700 1 -- 172.21.15.111:0/4170931151 >> 172.21.15.111:0/4170931151 conn(0x7f2d5805d070 msgr2=0x7f2d580625e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:31.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.942+0000 7f2d5f550700 1 -- 172.21.15.111:0/4170931151 shutdown_connections 2024-04-25T02:20:31.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.942+0000 7f2d5f550700 1 -- 172.21.15.111:0/4170931151 wait complete. 2024-04-25T02:20:31.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.943+0000 7f2d5f550700 1 Processor -- start 2024-04-25T02:20:31.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.943+0000 7f2d5f550700 1 -- start start 2024-04-25T02:20:31.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.943+0000 7f2d5f550700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2d58060e70 0x7f2d58098060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:31.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.943+0000 7f2d5f550700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2d5809bf90 0x7f2d58149190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:31.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.943+0000 7f2d5f550700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2d58136740 0x7f2d58149680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:31.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.943+0000 7f2d5f550700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d58099600 con 0x7f2d5809bf90 2024-04-25T02:20:31.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.943+0000 7f2d5f550700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d58098680 con 0x7f2d58136740 2024-04-25T02:20:31.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.943+0000 7f2d5f550700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2d58098920 con 0x7f2d58060e70 2024-04-25T02:20:31.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.943+0000 7f2d5d2ec700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2d58060e70 0x7f2d58098060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:31.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.943+0000 7f2d5daed700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2d58136740 0x7f2d58149680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:31.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.943+0000 7f2d5d2ec700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2d58060e70 0x7f2d58098060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:57126/0 (socket says 172.21.15.111:57126) 2024-04-25T02:20:31.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.943+0000 7f2d5d2ec700 1 -- 172.21.15.111:0/2490679898 learned_addr learned my addr 172.21.15.111:0/2490679898 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:31.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.943+0000 7f2d5caeb700 1 --2- 172.21.15.111:0/2490679898 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2d5809bf90 0x7f2d58149190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:31.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.944+0000 7f2d5daed700 1 -- 172.21.15.111:0/2490679898 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2d58060e70 msgr2=0x7f2d58098060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:31.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.944+0000 7f2d5daed700 1 --2- 172.21.15.111:0/2490679898 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2d58060e70 0x7f2d58098060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:31.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.944+0000 7f2d5daed700 1 -- 172.21.15.111:0/2490679898 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2d5809bf90 msgr2=0x7f2d58149190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:31.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.944+0000 7f2d5daed700 1 --2- 172.21.15.111:0/2490679898 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2d5809bf90 0x7f2d58149190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:31.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.944+0000 7f2d5daed700 1 -- 172.21.15.111:0/2490679898 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d4800b180 con 0x7f2d58136740 2024-04-25T02:20:31.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.944+0000 7f2d5daed700 1 --2- 172.21.15.111:0/2490679898 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2d58136740 0x7f2d58149680 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f2d500032f0 tx=0x7f2d50016000).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:31.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.944+0000 7f2d467fc700 1 -- 172.21.15.111:0/2490679898 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d5000b600 con 0x7f2d58136740 2024-04-25T02:20:31.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.944+0000 7f2d467fc700 1 -- 172.21.15.111:0/2490679898 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d50011ae0 con 0x7f2d58136740 2024-04-25T02:20:31.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.944+0000 7f2d5f550700 1 -- 172.21.15.111:0/2490679898 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d5400b1e0 con 0x7f2d58136740 2024-04-25T02:20:31.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.944+0000 7f2d467fc700 1 -- 172.21.15.111:0/2490679898 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f2d50011e40 con 0x7f2d58136740 2024-04-25T02:20:31.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.944+0000 7f2d5f550700 1 -- 172.21.15.111:0/2490679898 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d50009470 con 0x7f2d58136740 2024-04-25T02:20:31.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.945+0000 7f2d467fc700 1 -- 172.21.15.111:0/2490679898 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f2d5000f070 con 0x7f2d58136740 2024-04-25T02:20:31.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.945+0000 7f2d5f550700 1 -- 172.21.15.111:0/2490679898 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d58099d00 con 0x7f2d58136740 2024-04-25T02:20:31.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.945+0000 7f2d467fc700 1 -- 172.21.15.111:0/2490679898 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f2d5004af30 con 0x7f2d58136740 2024-04-25T02:20:31.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:31.948+0000 7f2d467fc700 1 -- 172.21.15.111:0/2490679898 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f2d58099d00 con 0x7f2d58136740 2024-04-25T02:20:32.063 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.059+0000 7f2d5f550700 1 -- 172.21.15.111:0/2490679898 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2d58099d00 con 0x7f2d58136740 2024-04-25T02:20:32.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.060+0000 7f2d467fc700 1 -- 172.21.15.111:0/2490679898 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+10564 (secure 0 0 0) 0x7f2d58099d00 con 0x7f2d58136740 2024-04-25T02:20:32.064 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:20:32.064 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":18,"fsid":"4643f974-f93a-4436-93b8-460ff320e62e","created":"2024-04-25T02:20:05.450475+0000","modified":"2024-04-25T02:20:25.151994+0000","last_up_change":"2024-04-25T02:20:10.439204+0000","last_in_change":"2024-04-25T02:20:10.439204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-25T02:20:07.471248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:20:14.420378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:20:22.251868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T02:20:23.128289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"df3f17ca-3b12-42c8-8cf7-8f1b7189e587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6800","nonce":40214}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6801","nonce":40214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6803","nonce":40214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6802","nonce":40214}]},"public_addr":"172.21.15.111:6800/40214","cluster_addr":"172.21.15.111:6801/40214","heartbeat_back_addr":"172.21.15.111:6803/40214","heartbeat_front_addr":"172.21.15.111:6802/40214","state":["exists","up"]},{"osd":1,"uuid":"93d54815-f215-4285-bba6-32f2d1cabf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6812","nonce":40216}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6813","nonce":40216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6815","nonce":40216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6814","nonce":40216}]},"public_addr":"172.21.15.111:6812/40216","cluster_addr":"172.21.15.111:6813/40216","heartbeat_back_addr":"172.21.15.111:6815/40216","heartbeat_front_addr":"172.21.15.111:6814/40216","state":["exists","up"]},{"osd":2,"uuid":"b26b2104-2a2e-408f-9ce7-3587a32a2ebe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6804","nonce":40215}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6805","nonce":40215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6807","nonce":40215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6806","nonce":40215}]},"public_addr":"172.21.15.111:6804/40215","cluster_addr":"172.21.15.111:6805/40215","heartbeat_back_addr":"172.21.15.111:6807/40215","heartbeat_front_addr":"172.21.15.111:6806/40215","state":["exists","up"]},{"osd":3,"uuid":"43c25820-1edc-4031-badf-72e87dd6bf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6808","nonce":40213}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6809","nonce":40213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6811","nonce":40213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6810","nonce":40213}]},"public_addr":"172.21.15.111:6808/40213","cluster_addr":"172.21.15.111:6809/40213","heartbeat_back_addr":"172.21.15.111:6811/40213","heartbeat_front_addr":"172.21.15.111:6810/40213","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.372427+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.411480+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.361508+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.377212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-25T02:20:32.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.061+0000 7f2d5f550700 1 -- 172.21.15.111:0/2490679898 >> v1:172.21.15.111:6816/39585 conn(0x7f2d38038dd0 legacy=0x7f2d3803b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:32.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.061+0000 7f2d5f550700 1 -- 172.21.15.111:0/2490679898 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2d58136740 msgr2=0x7f2d58149680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:32.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.061+0000 7f2d5f550700 1 --2- 172.21.15.111:0/2490679898 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2d58136740 0x7f2d58149680 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f2d500032f0 tx=0x7f2d50016000).stop 2024-04-25T02:20:32.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.061+0000 7f2d5f550700 1 -- 172.21.15.111:0/2490679898 shutdown_connections 2024-04-25T02:20:32.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.061+0000 7f2d5f550700 1 --2- 172.21.15.111:0/2490679898 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2d58136740 0x7f2d58149680 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:32.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.061+0000 7f2d5f550700 1 --2- 172.21.15.111:0/2490679898 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2d58060e70 0x7f2d58098060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:32.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.061+0000 7f2d5f550700 1 --2- 172.21.15.111:0/2490679898 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2d5809bf90 0x7f2d58149190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:32.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.061+0000 7f2d5f550700 1 -- 172.21.15.111:0/2490679898 >> 172.21.15.111:0/2490679898 conn(0x7f2d5805d070 msgr2=0x7f2d5806c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:32.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.061+0000 7f2d5f550700 1 -- 172.21.15.111:0/2490679898 shutdown_connections 2024-04-25T02:20:32.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.061+0000 7f2d5f550700 1 -- 172.21.15.111:0/2490679898 wait complete. 2024-04-25T02:20:32.076 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-04-25T02:20:07.471248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T02:20:14.420378+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:20:22.251868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:20:23.128289+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T02:20:32.076 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-04-25T02:20:32.183 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.179+0000 7f21c44df700 1 Processor -- start 2024-04-25T02:20:32.183 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.179+0000 7f21c44df700 1 -- start start 2024-04-25T02:20:32.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.180+0000 7f21c44df700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f21bc139ff0 0x7f21bc13e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:32.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.180+0000 7f21c44df700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f21bc13ee30 0x7f21bc141220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:32.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.180+0000 7f21c44df700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f21bc096f80 con 0x7f21bc139c10 2024-04-25T02:20:32.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.180+0000 7f21c44df700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21bc097c90 con 0x7f21bc13ee30 2024-04-25T02:20:32.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.180+0000 7f21c44df700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc099610 con 0x7f21bc139ff0 2024-04-25T02:20:32.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.180+0000 7f21c2a7c700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f21bc13ee30 0x7f21bc141220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:32.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.180+0000 7f21c1a7a700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f21bc139ff0 0x7f21bc13e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:32.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.180+0000 7f21c2a7c700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f21bc13ee30 0x7f21bc141220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48348/0 (socket says 172.21.15.111:48348) 2024-04-25T02:20:32.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.180+0000 7f21c2a7c700 1 -- 172.21.15.111:0/643318218 learned_addr learned my addr 172.21.15.111:0/643318218 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:32.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.180+0000 7f21c1279700 1 -- 172.21.15.111:0/643318218 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 887986855 0 0) 0x7f21bc096f80 con 0x7f21bc139c10 2024-04-25T02:20:32.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.180+0000 7f21c1a7a700 1 -- 172.21.15.111:0/643318218 >> v2:172.21.15.111:3300/0 conn(0x7f21bc13ee30 msgr2=0x7f21bc141220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:32.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.180+0000 7f21c1a7a700 1 --2- 172.21.15.111:0/643318218 >> v2:172.21.15.111:3300/0 conn(0x7f21bc13ee30 0x7f21bc141220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:32.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.180+0000 7f21c1a7a700 1 -- 172.21.15.111:0/643318218 >> v1:172.21.15.111:6789/0 conn(0x7f21bc139c10 legacy=0x7f21bc097580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:32.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.180+0000 7f21c1a7a700 1 -- 172.21.15.111:0/643318218 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21bc139730 con 0x7f21bc139ff0 2024-04-25T02:20:32.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.180+0000 7f21c1a7a700 1 --2- 172.21.15.111:0/643318218 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f21bc139ff0 0x7f21bc13e940 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f21b8002f70 tx=0x7f21b8006df0).ready entity=mon.2 client_cookie=6dfa6a906eec7853 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:32.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.180+0000 7f21c1279700 1 -- 172.21.15.111:0/643318218 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21b800d570 con 0x7f21bc139ff0 2024-04-25T02:20:32.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.180+0000 7f21c1279700 1 -- 172.21.15.111:0/643318218 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b8000e90 con 0x7f21bc139ff0 2024-04-25T02:20:32.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.181+0000 7f21c1279700 1 -- 172.21.15.111:0/643318218 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21b800d8c0 con 0x7f21bc139ff0 2024-04-25T02:20:32.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.181+0000 7f21c44df700 1 -- 172.21.15.111:0/643318218 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f21bc139ff0 msgr2=0x7f21bc13e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:32.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.181+0000 7f21c44df700 1 --2- 172.21.15.111:0/643318218 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f21bc139ff0 0x7f21bc13e940 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f21b8002f70 tx=0x7f21b8006df0).stop 2024-04-25T02:20:32.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.181+0000 7f21c44df700 1 -- 172.21.15.111:0/643318218 shutdown_connections 2024-04-25T02:20:32.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.181+0000 7f21c44df700 1 --2- 172.21.15.111:0/643318218 >> v2:172.21.15.111:3300/0 conn(0x7f21bc13ee30 0x7f21bc141220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:32.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.181+0000 7f21c44df700 1 --2- 172.21.15.111:0/643318218 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f21bc139ff0 0x7f21bc13e940 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:32.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.181+0000 7f21c44df700 1 -- 172.21.15.111:0/643318218 >> 172.21.15.111:0/643318218 conn(0x7f21bc0614e0 msgr2=0x7f21bc06c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:32.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.181+0000 7f21c44df700 1 -- 172.21.15.111:0/643318218 shutdown_connections 2024-04-25T02:20:32.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.181+0000 7f21c44df700 1 -- 172.21.15.111:0/643318218 wait complete. 2024-04-25T02:20:32.189 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.182+0000 7f21c44df700 1 Processor -- start 2024-04-25T02:20:32.189 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.182+0000 7f21c44df700 1 -- start start 2024-04-25T02:20:32.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.183+0000 7f21c44df700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f21bc139c10 0x7f21bc13e870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:32.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.183+0000 7f21c44df700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f21bc139ff0 0x7f21bc0630a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:32.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.183+0000 7f21c44df700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f21bc13ee30 0x7f21bc13bd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:32.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.183+0000 7f21c44df700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc145d30 con 0x7f21bc13ee30 2024-04-25T02:20:32.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.183+0000 7f21c44df700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc13d760 con 0x7f21bc139ff0 2024-04-25T02:20:32.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.183+0000 7f21c44df700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21bc145fd0 con 0x7f21bc139c10 2024-04-25T02:20:32.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.183+0000 7f21c2a7c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f21bc13ee30 0x7f21bc13bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:32.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.183+0000 7f21c227b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f21bc139c10 0x7f21bc13e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:32.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.183+0000 7f21c2a7c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f21bc13ee30 0x7f21bc13bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48362/0 (socket says 172.21.15.111:48362) 2024-04-25T02:20:32.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.183+0000 7f21c2a7c700 1 -- 172.21.15.111:0/159270445 learned_addr learned my addr 172.21.15.111:0/159270445 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:32.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.183+0000 7f21c1a7a700 1 --2- 172.21.15.111:0/159270445 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f21bc139ff0 0x7f21bc0630a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:32.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.183+0000 7f21c2a7c700 1 -- 172.21.15.111:0/159270445 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f21bc139c10 msgr2=0x7f21bc13e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:32.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.183+0000 7f21c2a7c700 1 --2- 172.21.15.111:0/159270445 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f21bc139c10 0x7f21bc13e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:32.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.183+0000 7f21c2a7c700 1 -- 172.21.15.111:0/159270445 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f21bc139ff0 msgr2=0x7f21bc0630a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:32.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.183+0000 7f21c2a7c700 1 --2- 172.21.15.111:0/159270445 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f21bc139ff0 0x7f21bc0630a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:32.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.183+0000 7f21c2a7c700 1 -- 172.21.15.111:0/159270445 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21b800b180 con 0x7f21bc13ee30 2024-04-25T02:20:32.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.183+0000 7f21c227b700 1 --2- 172.21.15.111:0/159270445 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f21bc139c10 0x7f21bc13e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:32.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.183+0000 7f21c2a7c700 1 --2- 172.21.15.111:0/159270445 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f21bc13ee30 0x7f21bc13bd00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f21b400c000 tx=0x7f21b4009290).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:32.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.183+0000 7f21ab7fe700 1 -- 172.21.15.111:0/159270445 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21b4012600 con 0x7f21bc13ee30 2024-04-25T02:20:32.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.183+0000 7f21ab7fe700 1 -- 172.21.15.111:0/159270445 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21b4012760 con 0x7f21bc13ee30 2024-04-25T02:20:32.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.184+0000 7f21ab7fe700 1 -- 172.21.15.111:0/159270445 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f21b4012ac0 con 0x7f21bc13ee30 2024-04-25T02:20:32.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.184+0000 7f21c44df700 1 -- 172.21.15.111:0/159270445 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21bc0628c0 con 0x7f21bc13ee30 2024-04-25T02:20:32.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.184+0000 7f21c44df700 1 -- 172.21.15.111:0/159270445 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21bc062560 con 0x7f21bc13ee30 2024-04-25T02:20:32.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.185+0000 7f21ab7fe700 1 -- 172.21.15.111:0/159270445 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f21b4022070 con 0x7f21bc13ee30 2024-04-25T02:20:32.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.185+0000 7f21c44df700 1 -- 172.21.15.111:0/159270445 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21bc1399f0 con 0x7f21bc13ee30 2024-04-25T02:20:32.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.185+0000 7f21ab7fe700 1 -- 172.21.15.111:0/159270445 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f21b404adb0 con 0x7f21bc13ee30 2024-04-25T02:20:32.192 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.188+0000 7f21ab7fe700 1 -- 172.21.15.111:0/159270445 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f21b40336e0 con 0x7f21bc13ee30 2024-04-25T02:20:32.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.302+0000 7f21c44df700 1 -- 172.21.15.111:0/159270445 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f21bc057a60 con 0x7f21bc13ee30 2024-04-25T02:20:32.307 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.303+0000 7f21ab7fe700 1 -- 172.21.15.111:0/159270445 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v18) v1 ==== 110+0+10 (secure 0 0 0) 0x7f21b4016030 con 0x7f21bc13ee30 2024-04-25T02:20:32.307 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 1 2024-04-25T02:20:32.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.304+0000 7f21c44df700 1 -- 172.21.15.111:0/159270445 >> v1:172.21.15.111:6816/39585 conn(0x7f219c038da0 legacy=0x7f219c03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:32.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.304+0000 7f21c44df700 1 -- 172.21.15.111:0/159270445 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f21bc13ee30 msgr2=0x7f21bc13bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:32.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.304+0000 7f21c44df700 1 --2- 172.21.15.111:0/159270445 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f21bc13ee30 0x7f21bc13bd00 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f21b400c000 tx=0x7f21b4009290).stop 2024-04-25T02:20:32.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.304+0000 7f21c44df700 1 -- 172.21.15.111:0/159270445 shutdown_connections 2024-04-25T02:20:32.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.304+0000 7f21c44df700 1 --2- 172.21.15.111:0/159270445 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f21bc13ee30 0x7f21bc13bd00 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:32.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.304+0000 7f21c44df700 1 --2- 172.21.15.111:0/159270445 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f21bc139c10 0x7f21bc13e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:32.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.304+0000 7f21c44df700 1 --2- 172.21.15.111:0/159270445 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f21bc139ff0 0x7f21bc0630a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:32.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.304+0000 7f21c44df700 1 -- 172.21.15.111:0/159270445 >> 172.21.15.111:0/159270445 conn(0x7f21bc0614e0 msgr2=0x7f21bc098130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:32.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.304+0000 7f21c44df700 1 -- 172.21.15.111:0/159270445 shutdown_connections 2024-04-25T02:20:32.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.304+0000 7f21c44df700 1 -- 172.21.15.111:0/159270445 wait complete. 2024-04-25T02:20:32.319 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T02:20:32.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.419+0000 7f57a0dc0700 1 Processor -- start 2024-04-25T02:20:32.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.419+0000 7f57a0dc0700 1 -- start start 2024-04-25T02:20:32.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.420+0000 7f57a0dc0700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f579c137a10 0x7f579c137df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:32.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.420+0000 7f57a0dc0700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f579c064380 0x7f579c0a98b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:32.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.420+0000 7f57a0dc0700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f579c0a9da0 0x7f579c05ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:32.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.420+0000 7f57a0dc0700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f579c1373c0 con 0x7f579c064380 2024-04-25T02:20:32.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.420+0000 7f57a0dc0700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f579c1382e0 con 0x7f579c0a9da0 2024-04-25T02:20:32.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.420+0000 7f57a0dc0700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f579c064b60 con 0x7f579c137a10 2024-04-25T02:20:32.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.420+0000 7f579a59c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f579c137a10 0x7f579c137df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:32.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.420+0000 7f579ad9d700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f579c0a9da0 0x7f579c05ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:32.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.420+0000 7f5799d9b700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f579c064380 0x7f579c0a98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:32.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.420+0000 7f579ad9d700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f579c0a9da0 0x7f579c05ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:51474/0 (socket says 172.21.15.111:51474) 2024-04-25T02:20:32.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.420+0000 7f579a59c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f579c137a10 0x7f579c137df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:57164/0 (socket says 172.21.15.111:57164) 2024-04-25T02:20:32.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.420+0000 7f5799d9b700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f579c064380 0x7f579c0a98b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48366/0 (socket says 172.21.15.111:48366) 2024-04-25T02:20:32.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.420+0000 7f579ad9d700 1 -- 172.21.15.111:0/1384363958 learned_addr learned my addr 172.21.15.111:0/1384363958 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:32.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.421+0000 7f579ad9d700 1 -- 172.21.15.111:0/1384363958 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f579c137a10 msgr2=0x7f579c137df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:32.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.421+0000 7f579ad9d700 1 --2- 172.21.15.111:0/1384363958 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f579c137a10 0x7f579c137df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:32.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.421+0000 7f579ad9d700 1 -- 172.21.15.111:0/1384363958 >> v2:172.21.15.111:3300/0 conn(0x7f579c064380 msgr2=0x7f579c0a98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:32.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.421+0000 7f579ad9d700 1 --2- 172.21.15.111:0/1384363958 >> v2:172.21.15.111:3300/0 conn(0x7f579c064380 0x7f579c0a98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:32.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.421+0000 7f579ad9d700 1 -- 172.21.15.111:0/1384363958 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f579c1375e0 con 0x7f579c0a9da0 2024-04-25T02:20:32.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.421+0000 7f5799d9b700 1 --2- 172.21.15.111:0/1384363958 >> v2:172.21.15.111:3300/0 conn(0x7f579c064380 0x7f579c0a98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:32.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.421+0000 7f579ad9d700 1 --2- 172.21.15.111:0/1384363958 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f579c0a9da0 0x7f579c05ba50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f579c137500 tx=0x7f578c006eb0).ready entity=mon.1 client_cookie=4488aa64beb3fb72 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:32.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.421+0000 7f579959a700 1 -- 172.21.15.111:0/1384363958 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f578c00d570 con 0x7f579c0a9da0 2024-04-25T02:20:32.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.421+0000 7f579959a700 1 -- 172.21.15.111:0/1384363958 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f578c000e90 con 0x7f579c0a9da0 2024-04-25T02:20:32.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.421+0000 7f579959a700 1 -- 172.21.15.111:0/1384363958 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f578c00d900 con 0x7f579c0a9da0 2024-04-25T02:20:32.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.421+0000 7f57a0dc0700 1 -- 172.21.15.111:0/1384363958 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f579c0a9da0 msgr2=0x7f579c05ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:32.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.421+0000 7f57a0dc0700 1 --2- 172.21.15.111:0/1384363958 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f579c0a9da0 0x7f579c05ba50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f579c137500 tx=0x7f578c006eb0).stop 2024-04-25T02:20:32.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.421+0000 7f57a0dc0700 1 -- 172.21.15.111:0/1384363958 shutdown_connections 2024-04-25T02:20:32.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.421+0000 7f57a0dc0700 1 --2- 172.21.15.111:0/1384363958 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f579c0a9da0 0x7f579c05ba50 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:32.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.421+0000 7f57a0dc0700 1 --2- 172.21.15.111:0/1384363958 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f579c137a10 0x7f579c137df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:32.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.421+0000 7f57a0dc0700 1 --2- 172.21.15.111:0/1384363958 >> v2:172.21.15.111:3300/0 conn(0x7f579c064380 0x7f579c0a98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:32.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.421+0000 7f57a0dc0700 1 -- 172.21.15.111:0/1384363958 >> 172.21.15.111:0/1384363958 conn(0x7f579c0614e0 msgr2=0x7f579c06c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:32.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.421+0000 7f57a0dc0700 1 -- 172.21.15.111:0/1384363958 shutdown_connections 2024-04-25T02:20:32.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.421+0000 7f57a0dc0700 1 -- 172.21.15.111:0/1384363958 wait complete. 2024-04-25T02:20:32.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.422+0000 7f57a0dc0700 1 Processor -- start 2024-04-25T02:20:32.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.422+0000 7f57a0dc0700 1 -- start start 2024-04-25T02:20:32.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.423+0000 7f57a0dc0700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f579c064380 0x7f579c1342c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:32.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.423+0000 7f57a0dc0700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f579c0a9da0 0x7f579c146900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:32.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.423+0000 7f57a0dc0700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f579c137a10 0x7f579c146df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:32.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.423+0000 7f57a0dc0700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579c134c90 con 0x7f579c064380 2024-04-25T02:20:32.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.423+0000 7f57a0dc0700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f579c0990f0 con 0x7f579c137a10 2024-04-25T02:20:32.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.423+0000 7f57a0dc0700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f579c067dd0 con 0x7f579c0a9da0 2024-04-25T02:20:32.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.423+0000 7f579a59c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f579c064380 0x7f579c1342c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:32.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.423+0000 7f579a59c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f579c064380 0x7f579c1342c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48382/0 (socket says 172.21.15.111:48382) 2024-04-25T02:20:32.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.423+0000 7f579a59c700 1 -- 172.21.15.111:0/1666371456 learned_addr learned my addr 172.21.15.111:0/1666371456 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:32.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.423+0000 7f5799d9b700 1 --2- 172.21.15.111:0/1666371456 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f579c0a9da0 0x7f579c146900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:32.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.423+0000 7f579ad9d700 1 --2- 172.21.15.111:0/1666371456 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f579c137a10 0x7f579c146df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:32.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.423+0000 7f579a59c700 1 -- 172.21.15.111:0/1666371456 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f579c0a9da0 msgr2=0x7f579c146900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:32.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.423+0000 7f579a59c700 1 --2- 172.21.15.111:0/1666371456 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f579c0a9da0 0x7f579c146900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:32.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.423+0000 7f579a59c700 1 -- 172.21.15.111:0/1666371456 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f579c137a10 msgr2=0x7f579c146df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:32.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.423+0000 7f579a59c700 1 --2- 172.21.15.111:0/1666371456 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f579c137a10 0x7f579c146df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:32.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.423+0000 7f579a59c700 1 -- 172.21.15.111:0/1666371456 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f579000b180 con 0x7f579c064380 2024-04-25T02:20:32.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.423+0000 7f5799d9b700 1 --2- 172.21.15.111:0/1666371456 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f579c0a9da0 0x7f579c146900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:20:32.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.423+0000 7f579a59c700 1 --2- 172.21.15.111:0/1666371456 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f579c064380 0x7f579c1342c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f579400c000 tx=0x7f57940091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:32.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.423+0000 7f578b7fe700 1 -- 172.21.15.111:0/1666371456 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f579400c6a0 con 0x7f579c064380 2024-04-25T02:20:32.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.423+0000 7f578b7fe700 1 -- 172.21.15.111:0/1666371456 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f579400c800 con 0x7f579c064380 2024-04-25T02:20:32.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.423+0000 7f57a0dc0700 1 -- 172.21.15.111:0/1666371456 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f578c00b1e0 con 0x7f579c064380 2024-04-25T02:20:32.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.423+0000 7f578b7fe700 1 -- 172.21.15.111:0/1666371456 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f579400cb60 con 0x7f579c064380 2024-04-25T02:20:32.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.424+0000 7f57a0dc0700 1 -- 172.21.15.111:0/1666371456 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f579c1336a0 con 0x7f579c064380 2024-04-25T02:20:32.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.424+0000 7f578b7fe700 1 -- 172.21.15.111:0/1666371456 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f5794022070 con 0x7f579c064380 2024-04-25T02:20:32.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.424+0000 7f578b7fe700 1 -- 172.21.15.111:0/1666371456 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f579404adf0 con 0x7f579c064380 2024-04-25T02:20:32.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.425+0000 7f57a0dc0700 1 -- 172.21.15.111:0/1666371456 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f579c065870 con 0x7f579c064380 2024-04-25T02:20:32.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.428+0000 7f578b7fe700 1 -- 172.21.15.111:0/1666371456 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f5794033720 con 0x7f579c064380 2024-04-25T02:20:32.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.538+0000 7f57a0dc0700 1 -- 172.21.15.111:0/1666371456 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f579c057a60 con 0x7f579c064380 2024-04-25T02:20:32.542 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.538+0000 7f578b7fe700 1 -- 172.21.15.111:0/1666371456 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5794033310 con 0x7f579c064380 2024-04-25T02:20:32.543 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 8 2024-04-25T02:20:32.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.539+0000 7f57a0dc0700 1 -- 172.21.15.111:0/1666371456 >> v1:172.21.15.111:6816/39585 conn(0x7f5778038da0 legacy=0x7f577803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:32.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.539+0000 7f57a0dc0700 1 -- 172.21.15.111:0/1666371456 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f579c064380 msgr2=0x7f579c1342c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:32.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.539+0000 7f57a0dc0700 1 --2- 172.21.15.111:0/1666371456 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f579c064380 0x7f579c1342c0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f579400c000 tx=0x7f57940091d0).stop 2024-04-25T02:20:32.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.540+0000 7f57a0dc0700 1 -- 172.21.15.111:0/1666371456 shutdown_connections 2024-04-25T02:20:32.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.540+0000 7f57a0dc0700 1 --2- 172.21.15.111:0/1666371456 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f579c137a10 0x7f579c146df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:32.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.540+0000 7f57a0dc0700 1 --2- 172.21.15.111:0/1666371456 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f579c064380 0x7f579c1342c0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:32.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.540+0000 7f57a0dc0700 1 --2- 172.21.15.111:0/1666371456 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f579c0a9da0 0x7f579c146900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:32.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.540+0000 7f57a0dc0700 1 -- 172.21.15.111:0/1666371456 >> 172.21.15.111:0/1666371456 conn(0x7f579c0614e0 msgr2=0x7f579c0a79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:32.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.540+0000 7f57a0dc0700 1 -- 172.21.15.111:0/1666371456 shutdown_connections 2024-04-25T02:20:32.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.540+0000 7f57a0dc0700 1 -- 172.21.15.111:0/1666371456 wait complete. 2024-04-25T02:20:32.554 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:20:32.659 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.655+0000 7f3bc29a6700 1 Processor -- start 2024-04-25T02:20:32.659 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.655+0000 7f3bc29a6700 1 -- start start 2024-04-25T02:20:32.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.656+0000 7f3bc29a6700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3bbc061c40 0x7f3bbc0a6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:32.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.656+0000 7f3bc29a6700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f3bbc0a7060 0x7f3bbc13ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:32.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.656+0000 7f3bc29a6700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bbc05bbd0 con 0x7f3bbc05c020 2024-04-25T02:20:32.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.656+0000 7f3bc29a6700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bbc0a7500 con 0x7f3bbc0a7060 2024-04-25T02:20:32.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.656+0000 7f3bc29a6700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc067f10 con 0x7f3bbc061c40 2024-04-25T02:20:32.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.656+0000 7f3bbb7fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3bbc061c40 0x7f3bbc0a6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:32.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.656+0000 7f3bbb7fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3bbc061c40 0x7f3bbc0a6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:57186/0 (socket says 172.21.15.111:57186) 2024-04-25T02:20:32.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.656+0000 7f3bbb7fe700 1 -- 172.21.15.111:0/1702896385 learned_addr learned my addr 172.21.15.111:0/1702896385 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:32.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.656+0000 7f3bc0f43700 1 --2- 172.21.15.111:0/1702896385 >> v2:172.21.15.111:3300/0 conn(0x7f3bbc0a7060 0x7f3bbc13ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:32.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.656+0000 7f3bc0f43700 1 -- 172.21.15.111:0/1702896385 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3bbc061c40 msgr2=0x7f3bbc0a6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:32.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.656+0000 7f3bc0f43700 1 --2- 172.21.15.111:0/1702896385 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3bbc061c40 0x7f3bbc0a6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:32.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.656+0000 7f3bc0f43700 1 -- 172.21.15.111:0/1702896385 >> v1:172.21.15.111:6789/0 conn(0x7f3bbc05c020 legacy=0x7f3bbc05c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:32.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.656+0000 7f3bc0f43700 1 -- 172.21.15.111:0/1702896385 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bbc0a2e60 con 0x7f3bbc0a7060 2024-04-25T02:20:32.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.656+0000 7f3bbaffd700 1 -- 172.21.15.111:0/1702896385 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1795619032 0 0) 0x7f3bbc05bbd0 con 0x7f3bbc05c020 2024-04-25T02:20:32.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.656+0000 7f3bbb7fe700 1 --2- 172.21.15.111:0/1702896385 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3bbc061c40 0x7f3bbc0a6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:32.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.656+0000 7f3bc0f43700 1 --2- 172.21.15.111:0/1702896385 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3bbc0a7060 0x7f3bbc13ea60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f3bbc0a2480 tx=0x7f3bb40091d0).ready entity=mon.0 client_cookie=ca7d26c693082912 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:32.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.656+0000 7f3bbaffd700 1 -- 172.21.15.111:0/1702896385 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3bb400b680 con 0x7f3bbc0a7060 2024-04-25T02:20:32.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.656+0000 7f3bbaffd700 1 -- 172.21.15.111:0/1702896385 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb400b7e0 con 0x7f3bbc0a7060 2024-04-25T02:20:32.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.656+0000 7f3bbaffd700 1 -- 172.21.15.111:0/1702896385 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3bb400b950 con 0x7f3bbc0a7060 2024-04-25T02:20:32.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.657+0000 7f3bc29a6700 1 -- 172.21.15.111:0/1702896385 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3bbc0a7060 msgr2=0x7f3bbc13ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:32.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.657+0000 7f3bc29a6700 1 --2- 172.21.15.111:0/1702896385 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3bbc0a7060 0x7f3bbc13ea60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f3bbc0a2480 tx=0x7f3bb40091d0).stop 2024-04-25T02:20:32.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.657+0000 7f3bc29a6700 1 -- 172.21.15.111:0/1702896385 shutdown_connections 2024-04-25T02:20:32.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.657+0000 7f3bc29a6700 1 --2- 172.21.15.111:0/1702896385 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3bbc0a7060 0x7f3bbc13ea60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:32.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.657+0000 7f3bc29a6700 1 --2- 172.21.15.111:0/1702896385 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3bbc061c40 0x7f3bbc0a6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:32.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.657+0000 7f3bc29a6700 1 -- 172.21.15.111:0/1702896385 >> 172.21.15.111:0/1702896385 conn(0x7f3bbc0a8a00 msgr2=0x7f3bbc0a8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:32.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.657+0000 7f3bc29a6700 1 -- 172.21.15.111:0/1702896385 shutdown_connections 2024-04-25T02:20:32.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.657+0000 7f3bc29a6700 1 -- 172.21.15.111:0/1702896385 wait complete. 2024-04-25T02:20:32.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.658+0000 7f3bc29a6700 1 Processor -- start 2024-04-25T02:20:32.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.658+0000 7f3bc29a6700 1 -- start start 2024-04-25T02:20:32.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.658+0000 7f3bc29a6700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3bbc05c020 0x7f3bbc067490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:32.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.658+0000 7f3bc29a6700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3bbc061c40 0x7f3bbc066880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:32.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.658+0000 7f3bc29a6700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3bbc0a7060 0x7f3bbc1331e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:32.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.658+0000 7f3bc29a6700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc066d70 con 0x7f3bbc05c020 2024-04-25T02:20:32.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.658+0000 7f3bc29a6700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc064250 con 0x7f3bbc0a7060 2024-04-25T02:20:32.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.658+0000 7f3bc29a6700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3bbc066f60 con 0x7f3bbc061c40 2024-04-25T02:20:32.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.659+0000 7f3bbb7fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3bbc061c40 0x7f3bbc066880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:32.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.659+0000 7f3bbbfff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3bbc05c020 0x7f3bbc067490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:32.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.659+0000 7f3bbb7fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3bbc061c40 0x7f3bbc066880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:57194/0 (socket says 172.21.15.111:57194) 2024-04-25T02:20:32.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.659+0000 7f3bbb7fe700 1 -- 172.21.15.111:0/780492393 learned_addr learned my addr 172.21.15.111:0/780492393 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:32.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.659+0000 7f3bc0f43700 1 --2- 172.21.15.111:0/780492393 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3bbc0a7060 0x7f3bbc1331e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:32.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.659+0000 7f3bbbfff700 1 -- 172.21.15.111:0/780492393 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3bbc061c40 msgr2=0x7f3bbc066880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:32.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.659+0000 7f3bbbfff700 1 --2- 172.21.15.111:0/780492393 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3bbc061c40 0x7f3bbc066880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:32.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.659+0000 7f3bbbfff700 1 -- 172.21.15.111:0/780492393 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3bbc0a7060 msgr2=0x7f3bbc1331e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:32.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.659+0000 7f3bbbfff700 1 --2- 172.21.15.111:0/780492393 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3bbc0a7060 0x7f3bbc1331e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:32.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.659+0000 7f3bbbfff700 1 -- 172.21.15.111:0/780492393 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bac00b1e0 con 0x7f3bbc05c020 2024-04-25T02:20:32.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.659+0000 7f3bbb7fe700 1 --2- 172.21.15.111:0/780492393 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3bbc061c40 0x7f3bbc066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:32.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.659+0000 7f3bbbfff700 1 --2- 172.21.15.111:0/780492393 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3bbc05c020 0x7f3bbc067490 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f3bbc063f30 tx=0x7f3bb00079b0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:32.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.659+0000 7f3bb97fa700 1 -- 172.21.15.111:0/780492393 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3bb000cdc0 con 0x7f3bbc05c020 2024-04-25T02:20:32.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.659+0000 7f3bb97fa700 1 -- 172.21.15.111:0/780492393 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb0012400 con 0x7f3bbc05c020 2024-04-25T02:20:32.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.659+0000 7f3bc29a6700 1 -- 172.21.15.111:0/780492393 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bb4009470 con 0x7f3bbc05c020 2024-04-25T02:20:32.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.659+0000 7f3bb97fa700 1 -- 172.21.15.111:0/780492393 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f3bb0012760 con 0x7f3bbc05c020 2024-04-25T02:20:32.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.659+0000 7f3bc29a6700 1 -- 172.21.15.111:0/780492393 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bbc0a1430 con 0x7f3bbc05c020 2024-04-25T02:20:32.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.660+0000 7f3bb97fa700 1 -- 172.21.15.111:0/780492393 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f3bb0019030 con 0x7f3bbc05c020 2024-04-25T02:20:32.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.660+0000 7f3bc29a6700 1 -- 172.21.15.111:0/780492393 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bbc0a7f70 con 0x7f3bbc05c020 2024-04-25T02:20:32.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.660+0000 7f3bb97fa700 1 -- 172.21.15.111:0/780492393 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f3bb0049b40 con 0x7f3bbc05c020 2024-04-25T02:20:32.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.663+0000 7f3bb97fa700 1 -- 172.21.15.111:0/780492393 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f3bb002ea80 con 0x7f3bbc05c020 2024-04-25T02:20:32.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.771+0000 7f3bc29a6700 1 -- 172.21.15.111:0/780492393 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3bbc065b00 con 0x7f3bbc05c020 2024-04-25T02:20:32.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.772+0000 7f3bb97fa700 1 -- 172.21.15.111:0/780492393 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v18) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3bb0007af0 con 0x7f3bbc05c020 2024-04-25T02:20:32.776 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 32 2024-04-25T02:20:32.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.773+0000 7f3bc29a6700 1 -- 172.21.15.111:0/780492393 >> v1:172.21.15.111:6816/39585 conn(0x7f3b9c038da0 legacy=0x7f3b9c03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:32.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.773+0000 7f3bc29a6700 1 -- 172.21.15.111:0/780492393 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3bbc05c020 msgr2=0x7f3bbc067490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:32.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.773+0000 7f3bc29a6700 1 --2- 172.21.15.111:0/780492393 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3bbc05c020 0x7f3bbc067490 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f3bbc063f30 tx=0x7f3bb00079b0).stop 2024-04-25T02:20:32.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.773+0000 7f3bc29a6700 1 -- 172.21.15.111:0/780492393 shutdown_connections 2024-04-25T02:20:32.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.773+0000 7f3bc29a6700 1 --2- 172.21.15.111:0/780492393 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3bbc0a7060 0x7f3bbc1331e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:32.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.773+0000 7f3bc29a6700 1 --2- 172.21.15.111:0/780492393 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3bbc05c020 0x7f3bbc067490 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:32.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.773+0000 7f3bc29a6700 1 --2- 172.21.15.111:0/780492393 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3bbc061c40 0x7f3bbc066880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:32.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.773+0000 7f3bc29a6700 1 -- 172.21.15.111:0/780492393 >> 172.21.15.111:0/780492393 conn(0x7f3bbc0a8a00 msgr2=0x7f3bbc136680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:32.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.773+0000 7f3bc29a6700 1 -- 172.21.15.111:0/780492393 shutdown_connections 2024-04-25T02:20:32.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.773+0000 7f3bc29a6700 1 -- 172.21.15.111:0/780492393 wait complete. 2024-04-25T02:20:32.787 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:20:32.893 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.889+0000 7f82edd68700 1 Processor -- start 2024-04-25T02:20:32.893 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.889+0000 7f82edd68700 1 -- start start 2024-04-25T02:20:32.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.890+0000 7f82edd68700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f82e805c1a0 0x7f82e8067040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:32.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.890+0000 7f82edd68700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f82e8067c20 0x7f82e805c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:32.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.890+0000 7f82edd68700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f82e8065c90 con 0x7f82e8066170 2024-04-25T02:20:32.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.890+0000 7f82edd68700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f82e805ca70 con 0x7f82e8067c20 2024-04-25T02:20:32.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.890+0000 7f82edd68700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82e8067680 con 0x7f82e805c1a0 2024-04-25T02:20:32.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.890+0000 7f82e77fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f82e805c1a0 0x7f82e8067040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:32.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.890+0000 7f82e6ffd700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f82e8067c20 0x7f82e805c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:32.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.890+0000 7f82e77fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f82e805c1a0 0x7f82e8067040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:57198/0 (socket says 172.21.15.111:57198) 2024-04-25T02:20:32.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.890+0000 7f82e7fff700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f82e8066170 0x7f82e8136350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:55878/0 (socket says 172.21.15.111:55878) 2024-04-25T02:20:32.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.890+0000 7f82e77fe700 1 -- 172.21.15.111:0/3673399936 learned_addr learned my addr 172.21.15.111:0/3673399936 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:32.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.890+0000 7f82e77fe700 1 -- 172.21.15.111:0/3673399936 >> v2:172.21.15.111:3300/0 conn(0x7f82e8067c20 msgr2=0x7f82e805c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:32.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.890+0000 7f82e77fe700 1 --2- 172.21.15.111:0/3673399936 >> v2:172.21.15.111:3300/0 conn(0x7f82e8067c20 0x7f82e805c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:32.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.890+0000 7f82e77fe700 1 -- 172.21.15.111:0/3673399936 >> v1:172.21.15.111:6789/0 conn(0x7f82e8066170 legacy=0x7f82e8136350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:32.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.890+0000 7f82e77fe700 1 -- 172.21.15.111:0/3673399936 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82e805ba50 con 0x7f82e805c1a0 2024-04-25T02:20:32.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.890+0000 7f82e6ffd700 1 --2- 172.21.15.111:0/3673399936 >> v2:172.21.15.111:3300/0 conn(0x7f82e8067c20 0x7f82e805c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:32.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.890+0000 7f82e77fe700 1 --2- 172.21.15.111:0/3673399936 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f82e805c1a0 0x7f82e8067040 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f82e8060690 tx=0x7f82d0006eb0).ready entity=mon.2 client_cookie=b1e25b94404e3a15 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:32.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.890+0000 7f82e67fc700 1 -- 172.21.15.111:0/3673399936 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82d000d5c0 con 0x7f82e805c1a0 2024-04-25T02:20:32.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.890+0000 7f82e67fc700 1 -- 172.21.15.111:0/3673399936 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d0000e90 con 0x7f82e805c1a0 2024-04-25T02:20:32.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.890+0000 7f82e67fc700 1 -- 172.21.15.111:0/3673399936 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82d000d950 con 0x7f82e805c1a0 2024-04-25T02:20:32.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.891+0000 7f82edd68700 1 -- 172.21.15.111:0/3673399936 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f82e805c1a0 msgr2=0x7f82e8067040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:32.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.891+0000 7f82edd68700 1 --2- 172.21.15.111:0/3673399936 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f82e805c1a0 0x7f82e8067040 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f82e8060690 tx=0x7f82d0006eb0).stop 2024-04-25T02:20:32.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.891+0000 7f82edd68700 1 -- 172.21.15.111:0/3673399936 shutdown_connections 2024-04-25T02:20:32.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.891+0000 7f82edd68700 1 --2- 172.21.15.111:0/3673399936 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f82e805c1a0 0x7f82e8067040 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:32.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.891+0000 7f82edd68700 1 --2- 172.21.15.111:0/3673399936 >> v2:172.21.15.111:3300/0 conn(0x7f82e8067c20 0x7f82e805c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:32.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.891+0000 7f82edd68700 1 -- 172.21.15.111:0/3673399936 >> 172.21.15.111:0/3673399936 conn(0x7f82e80a8a00 msgr2=0x7f82e80a8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:32.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.891+0000 7f82edd68700 1 -- 172.21.15.111:0/3673399936 shutdown_connections 2024-04-25T02:20:32.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.891+0000 7f82edd68700 1 -- 172.21.15.111:0/3673399936 wait complete. 2024-04-25T02:20:32.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.892+0000 7f82edd68700 1 Processor -- start 2024-04-25T02:20:32.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.892+0000 7f82edd68700 1 -- start start 2024-04-25T02:20:32.900 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.892+0000 7f82edd68700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f82e805c1a0 0x7f82e8139e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:32.900 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.892+0000 7f82edd68700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f82e8066170 0x7f82e8130610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:32.900 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.892+0000 7f82edd68700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f82e8067c20 0x7f82e8130b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:32.900 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.892+0000 7f82edd68700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82e8093db0 con 0x7f82e805c1a0 2024-04-25T02:20:32.900 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.892+0000 7f82edd68700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f82e8130ff0 con 0x7f82e8067c20 2024-04-25T02:20:32.900 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.892+0000 7f82edd68700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f82e80927f0 con 0x7f82e8066170 2024-04-25T02:20:32.900 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.892+0000 7f82e77fe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f82e805c1a0 0x7f82e8139e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:32.900 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.892+0000 7f82e6ffd700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f82e8066170 0x7f82e8130610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:32.900 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.892+0000 7f82e7fff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f82e8067c20 0x7f82e8130b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:32.900 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.892+0000 7f82e77fe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f82e805c1a0 0x7f82e8139e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48434/0 (socket says 172.21.15.111:48434) 2024-04-25T02:20:32.900 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.892+0000 7f82e6ffd700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f82e8066170 0x7f82e8130610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:57202/0 (socket says 172.21.15.111:57202) 2024-04-25T02:20:32.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.892+0000 7f82e77fe700 1 -- 172.21.15.111:0/4039064333 learned_addr learned my addr 172.21.15.111:0/4039064333 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:32.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.893+0000 7f82e77fe700 1 -- 172.21.15.111:0/4039064333 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f82e8066170 msgr2=0x7f82e8130610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:32.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.893+0000 7f82e77fe700 1 --2- 172.21.15.111:0/4039064333 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f82e8066170 0x7f82e8130610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:32.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.893+0000 7f82e77fe700 1 -- 172.21.15.111:0/4039064333 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f82e8067c20 msgr2=0x7f82e8130b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:32.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.893+0000 7f82e77fe700 1 --2- 172.21.15.111:0/4039064333 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f82e8067c20 0x7f82e8130b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:32.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.893+0000 7f82e77fe700 1 -- 172.21.15.111:0/4039064333 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f82d800b180 con 0x7f82e805c1a0 2024-04-25T02:20:32.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.893+0000 7f82e7fff700 1 --2- 172.21.15.111:0/4039064333 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f82e8067c20 0x7f82e8130b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:32.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.893+0000 7f82e77fe700 1 --2- 172.21.15.111:0/4039064333 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f82e805c1a0 0x7f82e8139e10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f82e8093f20 tx=0x7f82d0015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:32.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.893+0000 7f82e4ff9700 1 -- 172.21.15.111:0/4039064333 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82d0011860 con 0x7f82e805c1a0 2024-04-25T02:20:32.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.893+0000 7f82e4ff9700 1 -- 172.21.15.111:0/4039064333 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f82d00119c0 con 0x7f82e805c1a0 2024-04-25T02:20:32.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.893+0000 7f82e4ff9700 1 -- 172.21.15.111:0/4039064333 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f82d0011d20 con 0x7f82e805c1a0 2024-04-25T02:20:32.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.893+0000 7f82edd68700 1 -- 172.21.15.111:0/4039064333 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82d000b1e0 con 0x7f82e805c1a0 2024-04-25T02:20:32.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.893+0000 7f82edd68700 1 -- 172.21.15.111:0/4039064333 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82e8094000 con 0x7f82e805c1a0 2024-04-25T02:20:32.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.894+0000 7f82e4ff9700 1 -- 172.21.15.111:0/4039064333 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f82d0025030 con 0x7f82e805c1a0 2024-04-25T02:20:32.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.894+0000 7f82edd68700 1 -- 172.21.15.111:0/4039064333 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f82e805e4b0 con 0x7f82e805c1a0 2024-04-25T02:20:32.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.894+0000 7f82e4ff9700 1 -- 172.21.15.111:0/4039064333 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f82d004ba90 con 0x7f82e805c1a0 2024-04-25T02:20:32.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:32.897+0000 7f82e4ff9700 1 -- 172.21.15.111:0/4039064333 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f82d001eb90 con 0x7f82e805c1a0 2024-04-25T02:20:33.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.007+0000 7f82edd68700 1 -- 172.21.15.111:0/4039064333 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f82e8057a60 con 0x7f82e805c1a0 2024-04-25T02:20:33.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.008+0000 7f82e4ff9700 1 -- 172.21.15.111:0/4039064333 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v18) v1 ==== 100+0+11 (secure 0 0 0) 0x7f82d0023070 con 0x7f82e805c1a0 2024-04-25T02:20:33.012 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 64 2024-04-25T02:20:33.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.009+0000 7f82edd68700 1 -- 172.21.15.111:0/4039064333 >> v1:172.21.15.111:6816/39585 conn(0x7f82cc038dd0 legacy=0x7f82cc03b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:33.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.009+0000 7f82edd68700 1 -- 172.21.15.111:0/4039064333 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f82e805c1a0 msgr2=0x7f82e8139e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:33.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.009+0000 7f82edd68700 1 --2- 172.21.15.111:0/4039064333 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f82e805c1a0 0x7f82e8139e10 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f82e8093f20 tx=0x7f82d0015000).stop 2024-04-25T02:20:33.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.009+0000 7f82edd68700 1 -- 172.21.15.111:0/4039064333 shutdown_connections 2024-04-25T02:20:33.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.009+0000 7f82edd68700 1 --2- 172.21.15.111:0/4039064333 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f82e8067c20 0x7f82e8130b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:33.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.009+0000 7f82edd68700 1 --2- 172.21.15.111:0/4039064333 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f82e805c1a0 0x7f82e8139e10 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:33.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.009+0000 7f82edd68700 1 --2- 172.21.15.111:0/4039064333 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f82e8066170 0x7f82e8130610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:33.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.009+0000 7f82edd68700 1 -- 172.21.15.111:0/4039064333 >> 172.21.15.111:0/4039064333 conn(0x7f82e80a8a00 msgr2=0x7f82e8135af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:33.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.009+0000 7f82edd68700 1 -- 172.21.15.111:0/4039064333 shutdown_connections 2024-04-25T02:20:33.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.009+0000 7f82edd68700 1 -- 172.21.15.111:0/4039064333 wait complete. 2024-04-25T02:20:33.023 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:20:33.124 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.120+0000 7f85fd1a4700 1 Processor -- start 2024-04-25T02:20:33.124 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.120+0000 7f85fd1a4700 1 -- start start 2024-04-25T02:20:33.127 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.121+0000 7f85fd1a4700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f85f805c1a0 0x7f85f8067040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:33.127 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.121+0000 7f85fd1a4700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f85f8067c20 0x7f85f805c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:33.127 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.121+0000 7f85fd1a4700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f85f8066170 0x7f85f80a7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:33.127 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.121+0000 7f85fd1a4700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85f805ca70 con 0x7f85f8066170 2024-04-25T02:20:33.127 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.121+0000 7f85fd1a4700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f8065c90 con 0x7f85f805c1a0 2024-04-25T02:20:33.127 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.121+0000 7f85fd1a4700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f85f80a7fe0 con 0x7f85f8067c20 2024-04-25T02:20:33.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.121+0000 7f85f659c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f85f8067c20 0x7f85f805c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:33.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.121+0000 7f85f759e700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f85f8066170 0x7f85f80a7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:33.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.121+0000 7f85f6d9d700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f85f805c1a0 0x7f85f8067040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:33.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.121+0000 7f85f659c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f85f8067c20 0x7f85f805c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:57218/0 (socket says 172.21.15.111:57218) 2024-04-25T02:20:33.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.121+0000 7f85f759e700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f85f8066170 0x7f85f80a7af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48448/0 (socket says 172.21.15.111:48448) 2024-04-25T02:20:33.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.121+0000 7f85f6d9d700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f85f805c1a0 0x7f85f8067040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:51510/0 (socket says 172.21.15.111:51510) 2024-04-25T02:20:33.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.121+0000 7f85f659c700 1 -- 172.21.15.111:0/698468574 learned_addr learned my addr 172.21.15.111:0/698468574 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:33.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.122+0000 7f85f759e700 1 -- 172.21.15.111:0/698468574 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f85f8067c20 msgr2=0x7f85f805c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:33.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.122+0000 7f85f759e700 1 --2- 172.21.15.111:0/698468574 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f85f8067c20 0x7f85f805c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:33.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.122+0000 7f85f759e700 1 -- 172.21.15.111:0/698468574 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f85f805c1a0 msgr2=0x7f85f8067040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:33.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.122+0000 7f85f759e700 1 --2- 172.21.15.111:0/698468574 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f85f805c1a0 0x7f85f8067040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:33.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.122+0000 7f85f759e700 1 -- 172.21.15.111:0/698468574 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85f8067680 con 0x7f85f8066170 2024-04-25T02:20:33.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.122+0000 7f85f659c700 1 --2- 172.21.15.111:0/698468574 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f85f8067c20 0x7f85f805c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:33.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.122+0000 7f85f6d9d700 1 --2- 172.21.15.111:0/698468574 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f85f805c1a0 0x7f85f8067040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:33.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.122+0000 7f85f759e700 1 --2- 172.21.15.111:0/698468574 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f85f8066170 0x7f85f80a7af0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f85f00032f0 tx=0x7f85f00091d0).ready entity=mon.0 client_cookie=9d9a67b611b6cb76 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:33.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.122+0000 7f85f5d9b700 1 -- 172.21.15.111:0/698468574 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85f000b600 con 0x7f85f8066170 2024-04-25T02:20:33.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.122+0000 7f85f5d9b700 1 -- 172.21.15.111:0/698468574 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85f000b760 con 0x7f85f8066170 2024-04-25T02:20:33.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.122+0000 7f85f5d9b700 1 -- 172.21.15.111:0/698468574 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85f000b8d0 con 0x7f85f8066170 2024-04-25T02:20:33.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.122+0000 7f85fd1a4700 1 -- 172.21.15.111:0/698468574 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f85f8066170 msgr2=0x7f85f80a7af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:33.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.122+0000 7f85fd1a4700 1 --2- 172.21.15.111:0/698468574 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f85f8066170 0x7f85f80a7af0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f85f00032f0 tx=0x7f85f00091d0).stop 2024-04-25T02:20:33.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.122+0000 7f85fd1a4700 1 -- 172.21.15.111:0/698468574 shutdown_connections 2024-04-25T02:20:33.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.123+0000 7f85fd1a4700 1 --2- 172.21.15.111:0/698468574 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f85f8066170 0x7f85f80a7af0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:33.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.123+0000 7f85fd1a4700 1 --2- 172.21.15.111:0/698468574 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f85f805c1a0 0x7f85f8067040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:33.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.123+0000 7f85fd1a4700 1 --2- 172.21.15.111:0/698468574 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f85f8067c20 0x7f85f805c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:33.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.123+0000 7f85fd1a4700 1 -- 172.21.15.111:0/698468574 >> 172.21.15.111:0/698468574 conn(0x7f85f80a8a00 msgr2=0x7f85f80a8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:33.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.123+0000 7f85fd1a4700 1 -- 172.21.15.111:0/698468574 shutdown_connections 2024-04-25T02:20:33.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.123+0000 7f85fd1a4700 1 -- 172.21.15.111:0/698468574 wait complete. 2024-04-25T02:20:33.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.123+0000 7f85fd1a4700 1 Processor -- start 2024-04-25T02:20:33.130 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.123+0000 7f85fd1a4700 1 -- start start 2024-04-25T02:20:33.132 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.124+0000 7f85fd1a4700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f85f805c1a0 0x7f85f8095e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:33.132 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.124+0000 7f85fd1a4700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f85f8066170 0x7f85f8149240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:33.132 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.124+0000 7f85fd1a4700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f85f8067c20 0x7f85f8149730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:33.132 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.124+0000 7f85fd1a4700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85f8095960 con 0x7f85f805c1a0 2024-04-25T02:20:33.132 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.124+0000 7f85fd1a4700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85f80931c0 con 0x7f85f8066170 2024-04-25T02:20:33.132 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.124+0000 7f85fd1a4700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f85f80a2d80 con 0x7f85f8067c20 2024-04-25T02:20:33.132 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.124+0000 7f85f6d9d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f85f805c1a0 0x7f85f8095e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:33.132 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.124+0000 7f85f759e700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f85f8067c20 0x7f85f8149730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:33.132 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.124+0000 7f85f6d9d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f85f805c1a0 0x7f85f8095e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48454/0 (socket says 172.21.15.111:48454) 2024-04-25T02:20:33.132 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.124+0000 7f85f6d9d700 1 -- 172.21.15.111:0/2427635695 learned_addr learned my addr 172.21.15.111:0/2427635695 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:33.132 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.124+0000 7f85f659c700 1 --2- 172.21.15.111:0/2427635695 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f85f8066170 0x7f85f8149240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:33.133 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.124+0000 7f85f6d9d700 1 -- 172.21.15.111:0/2427635695 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f85f8067c20 msgr2=0x7f85f8149730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:33.133 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.124+0000 7f85f6d9d700 1 --2- 172.21.15.111:0/2427635695 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f85f8067c20 0x7f85f8149730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:33.133 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.124+0000 7f85f6d9d700 1 -- 172.21.15.111:0/2427635695 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f85f8066170 msgr2=0x7f85f8149240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:33.133 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.124+0000 7f85f6d9d700 1 --2- 172.21.15.111:0/2427635695 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f85f8066170 0x7f85f8149240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:33.133 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.124+0000 7f85f6d9d700 1 -- 172.21.15.111:0/2427635695 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85ec00b180 con 0x7f85f805c1a0 2024-04-25T02:20:33.133 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.124+0000 7f85f759e700 1 --2- 172.21.15.111:0/2427635695 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f85f8067c20 0x7f85f8149730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:33.133 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.124+0000 7f85f6d9d700 1 --2- 172.21.15.111:0/2427635695 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f85f805c1a0 0x7f85f8095e20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f85ec00c000 tx=0x7f85ec006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:33.133 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.125+0000 7f85e7fff700 1 -- 172.21.15.111:0/2427635695 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85ec00c890 con 0x7f85f805c1a0 2024-04-25T02:20:33.133 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.125+0000 7f85e7fff700 1 -- 172.21.15.111:0/2427635695 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85ec00c9f0 con 0x7f85f805c1a0 2024-04-25T02:20:33.133 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.125+0000 7f85fd1a4700 1 -- 172.21.15.111:0/2427635695 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85e800b1e0 con 0x7f85f805c1a0 2024-04-25T02:20:33.133 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.125+0000 7f85e7fff700 1 -- 172.21.15.111:0/2427635695 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f85ec00cd50 con 0x7f85f805c1a0 2024-04-25T02:20:33.133 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.125+0000 7f85fd1a4700 1 -- 172.21.15.111:0/2427635695 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85f0009470 con 0x7f85f805c1a0 2024-04-25T02:20:33.133 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.125+0000 7f85e7fff700 1 -- 172.21.15.111:0/2427635695 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f85ec01c460 con 0x7f85f805c1a0 2024-04-25T02:20:33.133 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.126+0000 7f85e7fff700 1 -- 172.21.15.111:0/2427635695 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f85ec04aec0 con 0x7f85f805c1a0 2024-04-25T02:20:33.133 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.126+0000 7f85fd1a4700 1 -- 172.21.15.111:0/2427635695 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85f8057a60 con 0x7f85f805c1a0 2024-04-25T02:20:33.134 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.129+0000 7f85e7fff700 1 -- 172.21.15.111:0/2427635695 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f85ec0337f0 con 0x7f85f805c1a0 2024-04-25T02:20:33.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.271+0000 7f85fd1a4700 1 -- 172.21.15.111:0/2427635695 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f85f80a84a0 con 0x7f85f805c1a0 2024-04-25T02:20:33.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.271+0000 7f85e7fff700 1 -- 172.21.15.111:0/2427635695 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+2326 (secure 0 0 0) 0x7f85ec02b090 con 0x7f85f805c1a0 2024-04-25T02:20:33.276 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:20:33.276 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4193,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6817/3699616235","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6817","nonce":3699616235}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:20:24.150791+0000","modified":"2024-04-25T02:20:27.234975+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":4239,"mds_1":4236},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4236":{"gid":4236,"name":"c","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.111:6818/2165982859","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6818","nonce":2165982859}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4239":{"gid":4239,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.111:6819/4003866251","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6819","nonce":4003866251}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-25T02:20:33.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.272+0000 7f85fd1a4700 1 -- 172.21.15.111:0/2427635695 >> v1:172.21.15.111:6816/39585 conn(0x7f85d4038da0 legacy=0x7f85d403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:33.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.272+0000 7f85fd1a4700 1 -- 172.21.15.111:0/2427635695 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f85f805c1a0 msgr2=0x7f85f8095e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:33.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.272+0000 7f85fd1a4700 1 --2- 172.21.15.111:0/2427635695 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f85f805c1a0 0x7f85f8095e20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f85ec00c000 tx=0x7f85ec006df0).stop 2024-04-25T02:20:33.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.273+0000 7f85fd1a4700 1 -- 172.21.15.111:0/2427635695 shutdown_connections 2024-04-25T02:20:33.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.273+0000 7f85fd1a4700 1 --2- 172.21.15.111:0/2427635695 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f85f8067c20 0x7f85f8149730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:33.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.273+0000 7f85fd1a4700 1 --2- 172.21.15.111:0/2427635695 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f85f805c1a0 0x7f85f8095e20 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:33.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.273+0000 7f85fd1a4700 1 --2- 172.21.15.111:0/2427635695 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f85f8066170 0x7f85f8149240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:33.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.273+0000 7f85fd1a4700 1 -- 172.21.15.111:0/2427635695 >> 172.21.15.111:0/2427635695 conn(0x7f85f80a8a00 msgr2=0x7f85f8136b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:33.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.273+0000 7f85fd1a4700 1 -- 172.21.15.111:0/2427635695 shutdown_connections 2024-04-25T02:20:33.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.273+0000 7f85fd1a4700 1 -- 172.21.15.111:0/2427635695 wait complete. 2024-04-25T02:20:33.278 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 8 2024-04-25T02:20:33.287 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:20:33.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.385+0000 7f4d3f1aa700 1 Processor -- start 2024-04-25T02:20:33.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.385+0000 7f4d3f1aa700 1 -- start start 2024-04-25T02:20:33.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.385+0000 7f4d3f1aa700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4d38136800 0x7f4d380642e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:33.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.385+0000 7f4d3f1aa700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f4d38062590 0x7f4d3813d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:33.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.385+0000 7f4d3f1aa700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d381363d0 con 0x7f4d380633b0 2024-04-25T02:20:33.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.385+0000 7f4d3f1aa700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d381372f0 con 0x7f4d38062590 2024-04-25T02:20:33.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.385+0000 7f4d3f1aa700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d380647d0 con 0x7f4d38136800 2024-04-25T02:20:33.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.386+0000 7f4d3d747700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f4d38062590 0x7f4d3813d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:33.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.386+0000 7f4d37fff700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f4d380633b0 0x7f4d38136be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:55884/0 (socket says 172.21.15.111:55884) 2024-04-25T02:20:33.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.386+0000 7f4d37fff700 1 -- 172.21.15.111:0/2766318629 learned_addr learned my addr 172.21.15.111:0/2766318629 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:20:33.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.386+0000 7f4d3cf46700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4d38136800 0x7f4d380642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:33.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.386+0000 7f4d3cf46700 1 -- 172.21.15.111:0/2766318629 >> v2:172.21.15.111:3300/0 conn(0x7f4d38062590 msgr2=0x7f4d3813d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:33.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.386+0000 7f4d3cf46700 1 --2- 172.21.15.111:0/2766318629 >> v2:172.21.15.111:3300/0 conn(0x7f4d38062590 0x7f4d3813d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:33.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.386+0000 7f4d3cf46700 1 -- 172.21.15.111:0/2766318629 >> v1:172.21.15.111:6789/0 conn(0x7f4d380633b0 legacy=0x7f4d38136be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:33.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.386+0000 7f4d377fe700 1 -- 172.21.15.111:0/2766318629 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1973628023 0 0) 0x7f4d381363d0 con 0x7f4d380633b0 2024-04-25T02:20:33.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.386+0000 7f4d3cf46700 1 -- 172.21.15.111:0/2766318629 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d38136600 con 0x7f4d38136800 2024-04-25T02:20:33.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.386+0000 7f4d3d747700 1 --2- 172.21.15.111:0/2766318629 >> v2:172.21.15.111:3300/0 conn(0x7f4d38062590 0x7f4d3813d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:33.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.386+0000 7f4d3cf46700 1 --2- 172.21.15.111:0/2766318629 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4d38136800 0x7f4d380642e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f4d2c002f70 tx=0x7f4d2c006df0).ready entity=mon.1 client_cookie=44aa63e40a5fd8f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:33.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.386+0000 7f4d377fe700 1 -- 172.21.15.111:0/2766318629 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d2c00d570 con 0x7f4d38136800 2024-04-25T02:20:33.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.386+0000 7f4d377fe700 1 -- 172.21.15.111:0/2766318629 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d2c000e90 con 0x7f4d38136800 2024-04-25T02:20:33.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.386+0000 7f4d377fe700 1 -- 172.21.15.111:0/2766318629 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d2c00d8c0 con 0x7f4d38136800 2024-04-25T02:20:33.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.387+0000 7f4d3f1aa700 1 -- 172.21.15.111:0/2766318629 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4d38136800 msgr2=0x7f4d380642e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:33.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.387+0000 7f4d3f1aa700 1 --2- 172.21.15.111:0/2766318629 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4d38136800 0x7f4d380642e0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f4d2c002f70 tx=0x7f4d2c006df0).stop 2024-04-25T02:20:33.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.387+0000 7f4d3f1aa700 1 -- 172.21.15.111:0/2766318629 shutdown_connections 2024-04-25T02:20:33.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.387+0000 7f4d3f1aa700 1 --2- 172.21.15.111:0/2766318629 >> v2:172.21.15.111:3300/0 conn(0x7f4d38062590 0x7f4d3813d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:33.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.387+0000 7f4d3f1aa700 1 --2- 172.21.15.111:0/2766318629 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4d38136800 0x7f4d380642e0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:33.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.387+0000 7f4d3f1aa700 1 -- 172.21.15.111:0/2766318629 >> 172.21.15.111:0/2766318629 conn(0x7f4d380614e0 msgr2=0x7f4d3806c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:33.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.387+0000 7f4d3f1aa700 1 -- 172.21.15.111:0/2766318629 shutdown_connections 2024-04-25T02:20:33.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.387+0000 7f4d3f1aa700 1 -- 172.21.15.111:0/2766318629 wait complete. 2024-04-25T02:20:33.395 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.388+0000 7f4d3f1aa700 1 Processor -- start 2024-04-25T02:20:33.395 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.388+0000 7f4d3f1aa700 1 -- start start 2024-04-25T02:20:33.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.388+0000 7f4d3f1aa700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4d38062590 0x7f4d38148ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:33.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.388+0000 7f4d3f1aa700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4d380633b0 0x7f4d3805ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:33.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.388+0000 7f4d3f1aa700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4d38136800 0x7f4d3805bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:33.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.388+0000 7f4d3f1aa700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3809d6a0 con 0x7f4d38136800 2024-04-25T02:20:33.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.388+0000 7f4d3f1aa700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3809ced0 con 0x7f4d380633b0 2024-04-25T02:20:33.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.388+0000 7f4d3f1aa700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3809db30 con 0x7f4d38062590 2024-04-25T02:20:33.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.388+0000 7f4d3d747700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4d38136800 0x7f4d3805bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:33.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.388+0000 7f4d3cf46700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4d38062590 0x7f4d38148ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:33.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.388+0000 7f4d3d747700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4d38136800 0x7f4d3805bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48464/0 (socket says 172.21.15.111:48464) 2024-04-25T02:20:33.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.388+0000 7f4d3d747700 1 -- 172.21.15.111:0/3490923132 learned_addr learned my addr 172.21.15.111:0/3490923132 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:33.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.388+0000 7f4d37fff700 1 --2- 172.21.15.111:0/3490923132 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4d380633b0 0x7f4d3805ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:33.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.389+0000 7f4d3cf46700 1 -- 172.21.15.111:0/3490923132 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4d380633b0 msgr2=0x7f4d3805ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:33.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.389+0000 7f4d3cf46700 1 --2- 172.21.15.111:0/3490923132 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4d380633b0 0x7f4d3805ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:33.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.389+0000 7f4d3cf46700 1 -- 172.21.15.111:0/3490923132 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4d38136800 msgr2=0x7f4d3805bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:33.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.389+0000 7f4d3cf46700 1 --2- 172.21.15.111:0/3490923132 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4d38136800 0x7f4d3805bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:33.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.389+0000 7f4d3cf46700 1 -- 172.21.15.111:0/3490923132 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d30009470 con 0x7f4d38062590 2024-04-25T02:20:33.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.389+0000 7f4d3d747700 1 --2- 172.21.15.111:0/3490923132 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4d38136800 0x7f4d3805bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:33.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.389+0000 7f4d3cf46700 1 --2- 172.21.15.111:0/3490923132 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4d38062590 0x7f4d38148ae0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f4d3809d320 tx=0x7f4d2c014000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:33.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.389+0000 7f4d35ffb700 1 -- 172.21.15.111:0/3490923132 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d2c016070 con 0x7f4d38062590 2024-04-25T02:20:33.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.389+0000 7f4d35ffb700 1 -- 172.21.15.111:0/3490923132 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d2c0138d0 con 0x7f4d38062590 2024-04-25T02:20:33.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.389+0000 7f4d3f1aa700 1 -- 172.21.15.111:0/3490923132 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d2c00b180 con 0x7f4d38062590 2024-04-25T02:20:33.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.389+0000 7f4d35ffb700 1 -- 172.21.15.111:0/3490923132 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4d2c013c30 con 0x7f4d38062590 2024-04-25T02:20:33.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.389+0000 7f4d3f1aa700 1 -- 172.21.15.111:0/3490923132 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d38149520 con 0x7f4d38062590 2024-04-25T02:20:33.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.390+0000 7f4d35ffb700 1 -- 172.21.15.111:0/3490923132 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f4d2c00f030 con 0x7f4d38062590 2024-04-25T02:20:33.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.390+0000 7f4d3f1aa700 1 -- 172.21.15.111:0/3490923132 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d3806cd40 con 0x7f4d38062590 2024-04-25T02:20:33.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.390+0000 7f4d35ffb700 1 -- 172.21.15.111:0/3490923132 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f4d2c04b430 con 0x7f4d38062590 2024-04-25T02:20:33.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.393+0000 7f4d35ffb700 1 -- 172.21.15.111:0/3490923132 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f4d2c0275c0 con 0x7f4d38062590 2024-04-25T02:20:33.509 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.505+0000 7f4d3f1aa700 1 -- 172.21.15.111:0/3490923132 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d38064cd0 con 0x7f4d38062590 2024-04-25T02:20:33.509 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.506+0000 7f4d35ffb700 1 -- 172.21.15.111:0/3490923132 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+10564 (secure 0 0 0) 0x7f4d2c023020 con 0x7f4d38062590 2024-04-25T02:20:33.510 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:20:33.510 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":18,"fsid":"4643f974-f93a-4436-93b8-460ff320e62e","created":"2024-04-25T02:20:05.450475+0000","modified":"2024-04-25T02:20:25.151994+0000","last_up_change":"2024-04-25T02:20:10.439204+0000","last_in_change":"2024-04-25T02:20:10.439204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-25T02:20:07.471248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:20:14.420378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:20:22.251868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T02:20:23.128289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"df3f17ca-3b12-42c8-8cf7-8f1b7189e587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6800","nonce":40214}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6801","nonce":40214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6803","nonce":40214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6802","nonce":40214}]},"public_addr":"172.21.15.111:6800/40214","cluster_addr":"172.21.15.111:6801/40214","heartbeat_back_addr":"172.21.15.111:6803/40214","heartbeat_front_addr":"172.21.15.111:6802/40214","state":["exists","up"]},{"osd":1,"uuid":"93d54815-f215-4285-bba6-32f2d1cabf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6812","nonce":40216}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6813","nonce":40216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6815","nonce":40216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6814","nonce":40216}]},"public_addr":"172.21.15.111:6812/40216","cluster_addr":"172.21.15.111:6813/40216","heartbeat_back_addr":"172.21.15.111:6815/40216","heartbeat_front_addr":"172.21.15.111:6814/40216","state":["exists","up"]},{"osd":2,"uuid":"b26b2104-2a2e-408f-9ce7-3587a32a2ebe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6804","nonce":40215}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6805","nonce":40215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6807","nonce":40215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6806","nonce":40215}]},"public_addr":"172.21.15.111:6804/40215","cluster_addr":"172.21.15.111:6805/40215","heartbeat_back_addr":"172.21.15.111:6807/40215","heartbeat_front_addr":"172.21.15.111:6806/40215","state":["exists","up"]},{"osd":3,"uuid":"43c25820-1edc-4031-badf-72e87dd6bf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6808","nonce":40213}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6809","nonce":40213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6811","nonce":40213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6810","nonce":40213}]},"public_addr":"172.21.15.111:6808/40213","cluster_addr":"172.21.15.111:6809/40213","heartbeat_back_addr":"172.21.15.111:6811/40213","heartbeat_front_addr":"172.21.15.111:6810/40213","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.372427+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.411480+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.361508+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.377212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-25T02:20:33.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.507+0000 7f4d3f1aa700 1 -- 172.21.15.111:0/3490923132 >> v1:172.21.15.111:6816/39585 conn(0x7f4d18038da0 legacy=0x7f4d1803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:33.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.507+0000 7f4d3f1aa700 1 -- 172.21.15.111:0/3490923132 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4d38062590 msgr2=0x7f4d38148ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:33.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.507+0000 7f4d3f1aa700 1 --2- 172.21.15.111:0/3490923132 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4d38062590 0x7f4d38148ae0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f4d3809d320 tx=0x7f4d2c014000).stop 2024-04-25T02:20:33.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.507+0000 7f4d3f1aa700 1 -- 172.21.15.111:0/3490923132 shutdown_connections 2024-04-25T02:20:33.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.507+0000 7f4d3f1aa700 1 --2- 172.21.15.111:0/3490923132 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4d38136800 0x7f4d3805bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:33.512 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.507+0000 7f4d3f1aa700 1 --2- 172.21.15.111:0/3490923132 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4d38062590 0x7f4d38148ae0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:33.512 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.507+0000 7f4d3f1aa700 1 --2- 172.21.15.111:0/3490923132 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4d380633b0 0x7f4d3805ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:33.512 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.507+0000 7f4d3f1aa700 1 -- 172.21.15.111:0/3490923132 >> 172.21.15.111:0/3490923132 conn(0x7f4d380614e0 msgr2=0x7f4d380999b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:33.512 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.507+0000 7f4d3f1aa700 1 -- 172.21.15.111:0/3490923132 shutdown_connections 2024-04-25T02:20:33.512 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.507+0000 7f4d3f1aa700 1 -- 172.21.15.111:0/3490923132 wait complete. 2024-04-25T02:20:33.521 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-04-25T02:20:07.471248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T02:20:14.420378+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:20:22.251868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:20:23.128289+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T02:20:33.522 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-04-25T02:20:33.626 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.622+0000 7f98e248f700 1 Processor -- start 2024-04-25T02:20:33.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.622+0000 7f98e248f700 1 -- start start 2024-04-25T02:20:33.628 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.623+0000 7f98e248f700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f98dc05c1a0 0x7f98dc067040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:33.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.623+0000 7f98e248f700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f98dc067c20 0x7f98dc05c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:33.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.623+0000 7f98e248f700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f98dc066170 0x7f98dc0a7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:33.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.623+0000 7f98e248f700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98dc05ca70 con 0x7f98dc067c20 2024-04-25T02:20:33.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.623+0000 7f98e248f700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98dc065c90 con 0x7f98dc066170 2024-04-25T02:20:33.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.623+0000 7f98e248f700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98dc0a7fe0 con 0x7f98dc05c1a0 2024-04-25T02:20:33.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.623+0000 7f98e0a2c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f98dc066170 0x7f98dc0a7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:33.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.623+0000 7f98db7fe700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f98dc067c20 0x7f98dc05c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:33.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.623+0000 7f98dbfff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f98dc05c1a0 0x7f98dc067040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:33.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.623+0000 7f98e0a2c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f98dc066170 0x7f98dc0a7af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:51544/0 (socket says 172.21.15.111:51544) 2024-04-25T02:20:33.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.623+0000 7f98db7fe700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f98dc067c20 0x7f98dc05c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48476/0 (socket says 172.21.15.111:48476) 2024-04-25T02:20:33.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.623+0000 7f98e0a2c700 1 -- 172.21.15.111:0/2876429155 learned_addr learned my addr 172.21.15.111:0/2876429155 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:33.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.623+0000 7f98e0a2c700 1 -- 172.21.15.111:0/2876429155 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f98dc05c1a0 msgr2=0x7f98dc067040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:33.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.623+0000 7f98e0a2c700 1 --2- 172.21.15.111:0/2876429155 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f98dc05c1a0 0x7f98dc067040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:33.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.623+0000 7f98e0a2c700 1 -- 172.21.15.111:0/2876429155 >> v2:172.21.15.111:3300/0 conn(0x7f98dc067c20 msgr2=0x7f98dc05c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:33.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.623+0000 7f98e0a2c700 1 --2- 172.21.15.111:0/2876429155 >> v2:172.21.15.111:3300/0 conn(0x7f98dc067c20 0x7f98dc05c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:33.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.623+0000 7f98e0a2c700 1 -- 172.21.15.111:0/2876429155 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98dc067680 con 0x7f98dc066170 2024-04-25T02:20:33.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.624+0000 7f98e0a2c700 1 --2- 172.21.15.111:0/2876429155 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f98dc066170 0x7f98dc0a7af0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f98dc05cbb0 tx=0x7f98d4009290).ready entity=mon.1 client_cookie=feebd6cc5f1da81 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:33.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.624+0000 7f98daffd700 1 -- 172.21.15.111:0/2876429155 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98d400b6b0 con 0x7f98dc066170 2024-04-25T02:20:33.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.624+0000 7f98daffd700 1 -- 172.21.15.111:0/2876429155 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d400b810 con 0x7f98dc066170 2024-04-25T02:20:33.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.624+0000 7f98daffd700 1 -- 172.21.15.111:0/2876429155 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98d400b980 con 0x7f98dc066170 2024-04-25T02:20:33.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.624+0000 7f98e248f700 1 -- 172.21.15.111:0/2876429155 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f98dc066170 msgr2=0x7f98dc0a7af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:33.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.624+0000 7f98e248f700 1 --2- 172.21.15.111:0/2876429155 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f98dc066170 0x7f98dc0a7af0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f98dc05cbb0 tx=0x7f98d4009290).stop 2024-04-25T02:20:33.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.624+0000 7f98e248f700 1 -- 172.21.15.111:0/2876429155 shutdown_connections 2024-04-25T02:20:33.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.624+0000 7f98e248f700 1 --2- 172.21.15.111:0/2876429155 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f98dc066170 0x7f98dc0a7af0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:33.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.624+0000 7f98e248f700 1 --2- 172.21.15.111:0/2876429155 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f98dc05c1a0 0x7f98dc067040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:33.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.624+0000 7f98e248f700 1 --2- 172.21.15.111:0/2876429155 >> v2:172.21.15.111:3300/0 conn(0x7f98dc067c20 0x7f98dc05c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:33.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.624+0000 7f98e248f700 1 -- 172.21.15.111:0/2876429155 >> 172.21.15.111:0/2876429155 conn(0x7f98dc0a8a00 msgr2=0x7f98dc0a8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:33.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.624+0000 7f98e248f700 1 -- 172.21.15.111:0/2876429155 shutdown_connections 2024-04-25T02:20:33.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.624+0000 7f98e248f700 1 -- 172.21.15.111:0/2876429155 wait complete. 2024-04-25T02:20:33.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.625+0000 7f98e248f700 1 Processor -- start 2024-04-25T02:20:33.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.625+0000 7f98e248f700 1 -- start start 2024-04-25T02:20:33.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.626+0000 7f98e248f700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f98dc05c1a0 0x7f98dc0920b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:33.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.626+0000 7f98e248f700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f98dc066170 0x7f98dc149190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:33.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.626+0000 7f98e248f700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f98dc067c20 0x7f98dc149680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:33.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.626+0000 7f98e248f700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98dc092660 con 0x7f98dc05c1a0 2024-04-25T02:20:33.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.626+0000 7f98e248f700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98dc093f70 con 0x7f98dc067c20 2024-04-25T02:20:33.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.626+0000 7f98e248f700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98dc13a740 con 0x7f98dc066170 2024-04-25T02:20:33.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.626+0000 7f98dbfff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f98dc05c1a0 0x7f98dc0920b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:33.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.626+0000 7f98dbfff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f98dc05c1a0 0x7f98dc0920b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48482/0 (socket says 172.21.15.111:48482) 2024-04-25T02:20:33.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.626+0000 7f98e0a2c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f98dc067c20 0x7f98dc149680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:33.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.626+0000 7f98dbfff700 1 -- 172.21.15.111:0/2508574879 learned_addr learned my addr 172.21.15.111:0/2508574879 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:33.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.626+0000 7f98db7fe700 1 --2- 172.21.15.111:0/2508574879 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f98dc066170 0x7f98dc149190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:33.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.626+0000 7f98dbfff700 1 -- 172.21.15.111:0/2508574879 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f98dc066170 msgr2=0x7f98dc149190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:33.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.626+0000 7f98dbfff700 1 --2- 172.21.15.111:0/2508574879 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f98dc066170 0x7f98dc149190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:33.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.626+0000 7f98dbfff700 1 -- 172.21.15.111:0/2508574879 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f98dc067c20 msgr2=0x7f98dc149680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:33.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.626+0000 7f98dbfff700 1 --2- 172.21.15.111:0/2508574879 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f98dc067c20 0x7f98dc149680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:33.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.626+0000 7f98dbfff700 1 -- 172.21.15.111:0/2508574879 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d4009530 con 0x7f98dc05c1a0 2024-04-25T02:20:33.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.626+0000 7f98e0a2c700 1 --2- 172.21.15.111:0/2508574879 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f98dc067c20 0x7f98dc149680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:33.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.626+0000 7f98dbfff700 1 --2- 172.21.15.111:0/2508574879 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f98dc05c1a0 0x7f98dc0920b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f98c400c000 tx=0x7f98c4006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:33.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.626+0000 7f98d97fa700 1 -- 172.21.15.111:0/2508574879 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98c4010780 con 0x7f98dc05c1a0 2024-04-25T02:20:33.634 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.626+0000 7f98d97fa700 1 -- 172.21.15.111:0/2508574879 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98c40108e0 con 0x7f98dc05c1a0 2024-04-25T02:20:33.635 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.626+0000 7f98e248f700 1 -- 172.21.15.111:0/2508574879 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98dc1395d0 con 0x7f98dc05c1a0 2024-04-25T02:20:33.635 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.626+0000 7f98d97fa700 1 -- 172.21.15.111:0/2508574879 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98c4010c40 con 0x7f98dc05c1a0 2024-04-25T02:20:33.635 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.627+0000 7f98e248f700 1 -- 172.21.15.111:0/2508574879 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98dc093150 con 0x7f98dc05c1a0 2024-04-25T02:20:33.635 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.627+0000 7f98d97fa700 1 -- 172.21.15.111:0/2508574879 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f98c401c460 con 0x7f98dc05c1a0 2024-04-25T02:20:33.635 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.628+0000 7f98d97fa700 1 -- 172.21.15.111:0/2508574879 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f98c404ac00 con 0x7f98dc05c1a0 2024-04-25T02:20:33.635 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.628+0000 7f98e248f700 1 -- 172.21.15.111:0/2508574879 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98dc057a60 con 0x7f98dc05c1a0 2024-04-25T02:20:33.635 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.631+0000 7f98d97fa700 1 -- 172.21.15.111:0/2508574879 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f98c4033530 con 0x7f98dc05c1a0 2024-04-25T02:20:33.745 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.741+0000 7f98e248f700 1 -- 172.21.15.111:0/2508574879 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f98dc0a71d0 con 0x7f98dc05c1a0 2024-04-25T02:20:33.745 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.741+0000 7f98d97fa700 1 -- 172.21.15.111:0/2508574879 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v18) v1 ==== 110+0+10 (secure 0 0 0) 0x7f98c4033120 con 0x7f98dc05c1a0 2024-04-25T02:20:33.746 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 1 2024-04-25T02:20:33.749 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.742+0000 7f98e248f700 1 -- 172.21.15.111:0/2508574879 >> v1:172.21.15.111:6816/39585 conn(0x7f98c0038da0 legacy=0x7f98c003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:33.749 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.742+0000 7f98e248f700 1 -- 172.21.15.111:0/2508574879 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f98dc05c1a0 msgr2=0x7f98dc0920b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:33.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.742+0000 7f98e248f700 1 --2- 172.21.15.111:0/2508574879 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f98dc05c1a0 0x7f98dc0920b0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f98c400c000 tx=0x7f98c4006df0).stop 2024-04-25T02:20:33.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.742+0000 7f98e248f700 1 -- 172.21.15.111:0/2508574879 shutdown_connections 2024-04-25T02:20:33.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.742+0000 7f98e248f700 1 --2- 172.21.15.111:0/2508574879 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f98dc067c20 0x7f98dc149680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:33.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.742+0000 7f98e248f700 1 --2- 172.21.15.111:0/2508574879 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f98dc05c1a0 0x7f98dc0920b0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:33.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.742+0000 7f98e248f700 1 --2- 172.21.15.111:0/2508574879 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f98dc066170 0x7f98dc149190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:33.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.743+0000 7f98e248f700 1 -- 172.21.15.111:0/2508574879 >> 172.21.15.111:0/2508574879 conn(0x7f98dc0a8a00 msgr2=0x7f98dc0a4c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:33.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.743+0000 7f98e248f700 1 -- 172.21.15.111:0/2508574879 shutdown_connections 2024-04-25T02:20:33.750 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.743+0000 7f98e248f700 1 -- 172.21.15.111:0/2508574879 wait complete. 2024-04-25T02:20:33.757 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T02:20:33.862 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.858+0000 7f0381ad7700 1 Processor -- start 2024-04-25T02:20:33.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.858+0000 7f0381ad7700 1 -- start start 2024-04-25T02:20:33.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.859+0000 7f0381ad7700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f037c05c1a0 0x7f037c067040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:33.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.859+0000 7f0381ad7700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f037c067c20 0x7f037c05c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:33.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.859+0000 7f0381ad7700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f037c066170 0x7f037c0a7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:33.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.859+0000 7f0381ad7700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f037c05ca70 con 0x7f037c05c1a0 2024-04-25T02:20:33.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.859+0000 7f0381ad7700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f037c065c90 con 0x7f037c067c20 2024-04-25T02:20:33.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.859+0000 7f0381ad7700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f037c0a7fe0 con 0x7f037c066170 2024-04-25T02:20:33.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.859+0000 7f037b7fe700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f037c05c1a0 0x7f037c067040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:33.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.859+0000 7f037affd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f037c067c20 0x7f037c05c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:33.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.859+0000 7f037bfff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f037c066170 0x7f037c0a7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:33.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.859+0000 7f037b7fe700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f037c05c1a0 0x7f037c067040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48484/0 (socket says 172.21.15.111:48484) 2024-04-25T02:20:33.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.859+0000 7f037affd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f037c067c20 0x7f037c05c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:51562/0 (socket says 172.21.15.111:51562) 2024-04-25T02:20:33.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.859+0000 7f037b7fe700 1 -- 172.21.15.111:0/3000139348 learned_addr learned my addr 172.21.15.111:0/3000139348 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:33.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.859+0000 7f037b7fe700 1 -- 172.21.15.111:0/3000139348 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f037c066170 msgr2=0x7f037c0a7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:33.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.859+0000 7f037b7fe700 1 --2- 172.21.15.111:0/3000139348 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f037c066170 0x7f037c0a7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:33.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.859+0000 7f037b7fe700 1 -- 172.21.15.111:0/3000139348 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f037c067c20 msgr2=0x7f037c05c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:33.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.859+0000 7f037b7fe700 1 --2- 172.21.15.111:0/3000139348 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f037c067c20 0x7f037c05c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:33.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.859+0000 7f037b7fe700 1 -- 172.21.15.111:0/3000139348 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f037c067680 con 0x7f037c05c1a0 2024-04-25T02:20:33.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.859+0000 7f037affd700 1 --2- 172.21.15.111:0/3000139348 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f037c067c20 0x7f037c05c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:33.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.859+0000 7f037b7fe700 1 --2- 172.21.15.111:0/3000139348 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f037c05c1a0 0x7f037c067040 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f0370002f70 tx=0x7f0370006eb0).ready entity=mon.0 client_cookie=1c267845d2aaf4c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:33.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.860+0000 7f037a7fc700 1 -- 172.21.15.111:0/3000139348 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f037000d570 con 0x7f037c05c1a0 2024-04-25T02:20:33.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.860+0000 7f037a7fc700 1 -- 172.21.15.111:0/3000139348 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0370000e90 con 0x7f037c05c1a0 2024-04-25T02:20:33.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.860+0000 7f037a7fc700 1 -- 172.21.15.111:0/3000139348 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f037000d8c0 con 0x7f037c05c1a0 2024-04-25T02:20:33.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.860+0000 7f0381ad7700 1 -- 172.21.15.111:0/3000139348 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f037c05c1a0 msgr2=0x7f037c067040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:33.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.860+0000 7f0381ad7700 1 --2- 172.21.15.111:0/3000139348 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f037c05c1a0 0x7f037c067040 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f0370002f70 tx=0x7f0370006eb0).stop 2024-04-25T02:20:33.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.860+0000 7f0381ad7700 1 -- 172.21.15.111:0/3000139348 shutdown_connections 2024-04-25T02:20:33.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.860+0000 7f0381ad7700 1 --2- 172.21.15.111:0/3000139348 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f037c066170 0x7f037c0a7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:33.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.860+0000 7f0381ad7700 1 --2- 172.21.15.111:0/3000139348 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f037c05c1a0 0x7f037c067040 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:33.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.860+0000 7f0381ad7700 1 --2- 172.21.15.111:0/3000139348 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f037c067c20 0x7f037c05c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:33.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.860+0000 7f0381ad7700 1 -- 172.21.15.111:0/3000139348 >> 172.21.15.111:0/3000139348 conn(0x7f037c0a8a00 msgr2=0x7f037c0a8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:33.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.860+0000 7f0381ad7700 1 -- 172.21.15.111:0/3000139348 shutdown_connections 2024-04-25T02:20:33.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.860+0000 7f0381ad7700 1 -- 172.21.15.111:0/3000139348 wait complete. 2024-04-25T02:20:33.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.861+0000 7f0381ad7700 1 Processor -- start 2024-04-25T02:20:33.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.861+0000 7f0381ad7700 1 -- start start 2024-04-25T02:20:33.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.862+0000 7f0381ad7700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f037c05c1a0 0x7f037c094550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:33.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.862+0000 7f0381ad7700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f037c066170 0x7f037c138680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:33.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.862+0000 7f0381ad7700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f037c067c20 0x7f037c138b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:33.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.862+0000 7f0381ad7700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037c093a40 con 0x7f037c066170 2024-04-25T02:20:33.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.862+0000 7f0381ad7700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f037c092670 con 0x7f037c067c20 2024-04-25T02:20:33.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.862+0000 7f0381ad7700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f037c092930 con 0x7f037c05c1a0 2024-04-25T02:20:33.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.862+0000 7f037b7fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f037c05c1a0 0x7f037c094550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:33.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.862+0000 7f037affd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f037c066170 0x7f037c138680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:33.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.862+0000 7f037bfff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f037c067c20 0x7f037c138b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:33.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.862+0000 7f037b7fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f037c05c1a0 0x7f037c094550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:57276/0 (socket says 172.21.15.111:57276) 2024-04-25T02:20:33.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.862+0000 7f037b7fe700 1 -- 172.21.15.111:0/256589279 learned_addr learned my addr 172.21.15.111:0/256589279 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:33.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.862+0000 7f037bfff700 1 -- 172.21.15.111:0/256589279 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f037c05c1a0 msgr2=0x7f037c094550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:33.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.862+0000 7f037bfff700 1 --2- 172.21.15.111:0/256589279 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f037c05c1a0 0x7f037c094550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:33.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.862+0000 7f037bfff700 1 -- 172.21.15.111:0/256589279 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f037c066170 msgr2=0x7f037c138680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:33.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.862+0000 7f037bfff700 1 --2- 172.21.15.111:0/256589279 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f037c066170 0x7f037c138680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:33.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.862+0000 7f037bfff700 1 -- 172.21.15.111:0/256589279 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f036c00b180 con 0x7f037c067c20 2024-04-25T02:20:33.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.862+0000 7f037b7fe700 1 --2- 172.21.15.111:0/256589279 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f037c05c1a0 0x7f037c094550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:33.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.862+0000 7f037bfff700 1 --2- 172.21.15.111:0/256589279 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f037c067c20 0x7f037c138b70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f037400c000 tx=0x7f03740091d0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:33.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.862+0000 7f0378ff9700 1 -- 172.21.15.111:0/256589279 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0374012600 con 0x7f037c067c20 2024-04-25T02:20:33.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.862+0000 7f0378ff9700 1 -- 172.21.15.111:0/256589279 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0374012760 con 0x7f037c067c20 2024-04-25T02:20:33.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.862+0000 7f0381ad7700 1 -- 172.21.15.111:0/256589279 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f037000b1e0 con 0x7f037c067c20 2024-04-25T02:20:33.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.862+0000 7f0378ff9700 1 -- 172.21.15.111:0/256589279 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0374012ac0 con 0x7f037c067c20 2024-04-25T02:20:33.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.862+0000 7f0381ad7700 1 -- 172.21.15.111:0/256589279 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f037c139760 con 0x7f037c067c20 2024-04-25T02:20:33.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.863+0000 7f0378ff9700 1 -- 172.21.15.111:0/256589279 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f0374022070 con 0x7f037c067c20 2024-04-25T02:20:33.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.863+0000 7f0381ad7700 1 -- 172.21.15.111:0/256589279 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f037c093530 con 0x7f037c067c20 2024-04-25T02:20:33.871 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.864+0000 7f0378ff9700 1 -- 172.21.15.111:0/256589279 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f037404adc0 con 0x7f037c067c20 2024-04-25T02:20:33.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.866+0000 7f0378ff9700 1 -- 172.21.15.111:0/256589279 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f03740336f0 con 0x7f037c067c20 2024-04-25T02:20:33.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.977+0000 7f0381ad7700 1 -- 172.21.15.111:0/256589279 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f037c057a60 con 0x7f037c067c20 2024-04-25T02:20:33.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.977+0000 7f0378ff9700 1 -- 172.21.15.111:0/256589279 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v18) v1 ==== 92+0+10 (secure 0 0 0) 0x7f0374016030 con 0x7f037c067c20 2024-04-25T02:20:33.982 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 8 2024-04-25T02:20:33.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.978+0000 7f0381ad7700 1 -- 172.21.15.111:0/256589279 >> v1:172.21.15.111:6816/39585 conn(0x7f035c038dd0 legacy=0x7f035c03b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:33.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.978+0000 7f0381ad7700 1 -- 172.21.15.111:0/256589279 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f037c067c20 msgr2=0x7f037c138b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:33.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.978+0000 7f0381ad7700 1 --2- 172.21.15.111:0/256589279 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f037c067c20 0x7f037c138b70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f037400c000 tx=0x7f03740091d0).stop 2024-04-25T02:20:33.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.979+0000 7f0381ad7700 1 -- 172.21.15.111:0/256589279 shutdown_connections 2024-04-25T02:20:33.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.979+0000 7f0381ad7700 1 --2- 172.21.15.111:0/256589279 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f037c067c20 0x7f037c138b70 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:33.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.979+0000 7f0381ad7700 1 --2- 172.21.15.111:0/256589279 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f037c05c1a0 0x7f037c094550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:33.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.979+0000 7f0381ad7700 1 --2- 172.21.15.111:0/256589279 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f037c066170 0x7f037c138680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:33.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.979+0000 7f0381ad7700 1 -- 172.21.15.111:0/256589279 >> 172.21.15.111:0/256589279 conn(0x7f037c0a8a00 msgr2=0x7f037c136af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:33.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.979+0000 7f0381ad7700 1 -- 172.21.15.111:0/256589279 shutdown_connections 2024-04-25T02:20:33.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:33.979+0000 7f0381ad7700 1 -- 172.21.15.111:0/256589279 wait complete. 2024-04-25T02:20:33.993 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:20:34.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.093+0000 7f5837408700 1 Processor -- start 2024-04-25T02:20:34.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.093+0000 7f5837408700 1 -- start start 2024-04-25T02:20:34.100 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.094+0000 7f5837408700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5830136740 0x7f5830061a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:34.100 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.094+0000 7f5837408700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5830060e70 0x7f5830136b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:34.100 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.094+0000 7f5837408700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f583009c960 con 0x7f583009bf90 2024-04-25T02:20:34.100 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.094+0000 7f5837408700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5830060770 con 0x7f5830060e70 2024-04-25T02:20:34.100 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.094+0000 7f5837408700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f58301360e0 con 0x7f5830136740 2024-04-25T02:20:34.100 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.094+0000 7f58349a3700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5830060e70 0x7f5830136b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:34.100 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.094+0000 7f58359a5700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f583009bf90 0x7f58301395a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:55888/0 (socket says 172.21.15.111:55888) 2024-04-25T02:20:34.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.094+0000 7f58359a5700 1 -- 172.21.15.111:0/2669924938 learned_addr learned my addr 172.21.15.111:0/2669924938 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:20:34.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.094+0000 7f58351a4700 1 --2- 172.21.15.111:0/2669924938 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5830136740 0x7f5830061a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:34.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.094+0000 7f581ffff700 1 -- 172.21.15.111:0/2669924938 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2060993396 0 0) 0x7f583009c960 con 0x7f583009bf90 2024-04-25T02:20:34.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.094+0000 7f58349a3700 1 -- 172.21.15.111:0/2669924938 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5830136740 msgr2=0x7f5830061a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:34.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.094+0000 7f58349a3700 1 --2- 172.21.15.111:0/2669924938 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5830136740 0x7f5830061a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:34.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.094+0000 7f58349a3700 1 -- 172.21.15.111:0/2669924938 >> v1:172.21.15.111:6789/0 conn(0x7f583009bf90 legacy=0x7f58301395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:34.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.094+0000 7f58349a3700 1 -- 172.21.15.111:0/2669924938 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5830067a00 con 0x7f5830060e70 2024-04-25T02:20:34.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.095+0000 7f58349a3700 1 --2- 172.21.15.111:0/2669924938 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5830060e70 0x7f5830136b20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f582c002f70 tx=0x7f582c006df0).ready entity=mon.1 client_cookie=16165c4353ad8e52 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:34.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.095+0000 7f581ffff700 1 -- 172.21.15.111:0/2669924938 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f582c00d570 con 0x7f5830060e70 2024-04-25T02:20:34.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.095+0000 7f581ffff700 1 -- 172.21.15.111:0/2669924938 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f582c000e90 con 0x7f5830060e70 2024-04-25T02:20:34.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.095+0000 7f581ffff700 1 -- 172.21.15.111:0/2669924938 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f582c00d8c0 con 0x7f5830060e70 2024-04-25T02:20:34.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.095+0000 7f5837408700 1 -- 172.21.15.111:0/2669924938 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5830060e70 msgr2=0x7f5830136b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:34.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.095+0000 7f5837408700 1 --2- 172.21.15.111:0/2669924938 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5830060e70 0x7f5830136b20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f582c002f70 tx=0x7f582c006df0).stop 2024-04-25T02:20:34.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.095+0000 7f5837408700 1 -- 172.21.15.111:0/2669924938 shutdown_connections 2024-04-25T02:20:34.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.095+0000 7f5837408700 1 --2- 172.21.15.111:0/2669924938 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5830136740 0x7f5830061a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:34.102 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.095+0000 7f5837408700 1 --2- 172.21.15.111:0/2669924938 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5830060e70 0x7f5830136b20 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:34.102 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.095+0000 7f5837408700 1 -- 172.21.15.111:0/2669924938 >> 172.21.15.111:0/2669924938 conn(0x7f583005d070 msgr2=0x7f58300625e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:34.102 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.095+0000 7f5837408700 1 -- 172.21.15.111:0/2669924938 shutdown_connections 2024-04-25T02:20:34.102 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.095+0000 7f5837408700 1 -- 172.21.15.111:0/2669924938 wait complete. 2024-04-25T02:20:34.102 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.096+0000 7f5837408700 1 Processor -- start 2024-04-25T02:20:34.102 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.096+0000 7f5837408700 1 -- start start 2024-04-25T02:20:34.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.097+0000 7f5837408700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5830060e70 0x7f5830094fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:34.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.097+0000 7f5837408700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f583009bf90 0x7f58301490b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:34.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.097+0000 7f5837408700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5830136740 0x7f58301495a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:34.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.097+0000 7f5837408700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5830096700 con 0x7f5830136740 2024-04-25T02:20:34.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.097+0000 7f5837408700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5830092150 con 0x7f583009bf90 2024-04-25T02:20:34.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.097+0000 7f5837408700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5830092410 con 0x7f5830060e70 2024-04-25T02:20:34.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.097+0000 7f58359a5700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5830136740 0x7f58301495a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:34.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.097+0000 7f58351a4700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5830060e70 0x7f5830094fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:34.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.097+0000 7f58359a5700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5830136740 0x7f58301495a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48502/0 (socket says 172.21.15.111:48502) 2024-04-25T02:20:34.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.097+0000 7f58359a5700 1 -- 172.21.15.111:0/3703994531 learned_addr learned my addr 172.21.15.111:0/3703994531 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:34.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.097+0000 7f58349a3700 1 --2- 172.21.15.111:0/3703994531 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f583009bf90 0x7f58301490b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:34.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.097+0000 7f58351a4700 1 -- 172.21.15.111:0/3703994531 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f583009bf90 msgr2=0x7f58301490b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:34.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.097+0000 7f58351a4700 1 --2- 172.21.15.111:0/3703994531 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f583009bf90 0x7f58301490b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:34.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.097+0000 7f58351a4700 1 -- 172.21.15.111:0/3703994531 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5830136740 msgr2=0x7f58301495a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:34.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.097+0000 7f58351a4700 1 --2- 172.21.15.111:0/3703994531 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5830136740 0x7f58301495a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:34.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.097+0000 7f58351a4700 1 -- 172.21.15.111:0/3703994531 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f582c00b180 con 0x7f5830060e70 2024-04-25T02:20:34.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.097+0000 7f58349a3700 1 --2- 172.21.15.111:0/3703994531 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f583009bf90 0x7f58301490b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:34.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.097+0000 7f58359a5700 1 --2- 172.21.15.111:0/3703994531 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5830136740 0x7f58301495a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:34.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.097+0000 7f58351a4700 1 --2- 172.21.15.111:0/3703994531 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5830060e70 0x7f5830094fc0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f582000c000 tx=0x7f5820006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:34.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.097+0000 7f581e7fc700 1 -- 172.21.15.111:0/3703994531 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5820011750 con 0x7f5830060e70 2024-04-25T02:20:34.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.097+0000 7f581e7fc700 1 -- 172.21.15.111:0/3703994531 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58200118b0 con 0x7f5830060e70 2024-04-25T02:20:34.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.097+0000 7f5837408700 1 -- 172.21.15.111:0/3703994531 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f583009a0f0 con 0x7f5830060e70 2024-04-25T02:20:34.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.097+0000 7f581e7fc700 1 -- 172.21.15.111:0/3703994531 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f5820011c10 con 0x7f5830060e70 2024-04-25T02:20:34.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.098+0000 7f5837408700 1 -- 172.21.15.111:0/3703994531 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5830093af0 con 0x7f5830060e70 2024-04-25T02:20:34.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.098+0000 7f581e7fc700 1 -- 172.21.15.111:0/3703994531 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f5820011d70 con 0x7f5830060e70 2024-04-25T02:20:34.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.099+0000 7f5837408700 1 -- 172.21.15.111:0/3703994531 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f583009c410 con 0x7f5830060e70 2024-04-25T02:20:34.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.099+0000 7f581e7fc700 1 -- 172.21.15.111:0/3703994531 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f582004aae0 con 0x7f5830060e70 2024-04-25T02:20:34.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.102+0000 7f581e7fc700 1 -- 172.21.15.111:0/3703994531 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f5820033410 con 0x7f5830060e70 2024-04-25T02:20:34.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.211+0000 7f5837408700 1 -- 172.21.15.111:0/3703994531 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f58300aa630 con 0x7f5830060e70 2024-04-25T02:20:34.216 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.212+0000 7f581e7fc700 1 -- 172.21.15.111:0/3703994531 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v18) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5820033000 con 0x7f5830060e70 2024-04-25T02:20:34.216 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 32 2024-04-25T02:20:34.217 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.213+0000 7f5837408700 1 -- 172.21.15.111:0/3703994531 >> v1:172.21.15.111:6816/39585 conn(0x7f5810038da0 legacy=0x7f581003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:34.218 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.213+0000 7f5837408700 1 -- 172.21.15.111:0/3703994531 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5830060e70 msgr2=0x7f5830094fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:34.218 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.213+0000 7f5837408700 1 --2- 172.21.15.111:0/3703994531 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5830060e70 0x7f5830094fc0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7f582000c000 tx=0x7f5820006df0).stop 2024-04-25T02:20:34.218 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.213+0000 7f5837408700 1 -- 172.21.15.111:0/3703994531 shutdown_connections 2024-04-25T02:20:34.218 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.213+0000 7f5837408700 1 --2- 172.21.15.111:0/3703994531 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5830136740 0x7f58301495a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:34.218 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.213+0000 7f5837408700 1 --2- 172.21.15.111:0/3703994531 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5830060e70 0x7f5830094fc0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:34.218 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.213+0000 7f5837408700 1 --2- 172.21.15.111:0/3703994531 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f583009bf90 0x7f58301490b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:34.218 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.213+0000 7f5837408700 1 -- 172.21.15.111:0/3703994531 >> 172.21.15.111:0/3703994531 conn(0x7f583005d070 msgr2=0x7f583006c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:34.218 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.213+0000 7f5837408700 1 -- 172.21.15.111:0/3703994531 shutdown_connections 2024-04-25T02:20:34.218 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.213+0000 7f5837408700 1 -- 172.21.15.111:0/3703994531 wait complete. 2024-04-25T02:20:34.228 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:20:34.335 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.329+0000 7f27da540700 1 Processor -- start 2024-04-25T02:20:34.336 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.329+0000 7f27da540700 1 -- start start 2024-04-25T02:20:34.336 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.329+0000 7f27da540700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f27d405c1a0 0x7f27d4067040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:34.336 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.329+0000 7f27da540700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f27d4066170 0x7f27d405c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:34.336 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.329+0000 7f27da540700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27d4065c90 con 0x7f27d4067c20 2024-04-25T02:20:34.336 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.329+0000 7f27da540700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f27d405ca70 con 0x7f27d4066170 2024-04-25T02:20:34.336 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.329+0000 7f27da540700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27d4067680 con 0x7f27d405c1a0 2024-04-25T02:20:34.336 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.330+0000 7f27d3fff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f27d405c1a0 0x7f27d4067040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:34.336 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.330+0000 7f27d8add700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f27d4066170 0x7f27d405c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:34.336 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.330+0000 7f27d3fff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f27d405c1a0 0x7f27d4067040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:57310/0 (socket says 172.21.15.111:57310) 2024-04-25T02:20:34.336 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.330+0000 7f27d3fff700 1 -- 172.21.15.111:0/4049632992 learned_addr learned my addr 172.21.15.111:0/4049632992 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:34.336 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.330+0000 7f27d3fff700 1 -- 172.21.15.111:0/4049632992 >> v2:172.21.15.111:3300/0 conn(0x7f27d4066170 msgr2=0x7f27d405c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:34.336 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.330+0000 7f27d3fff700 1 --2- 172.21.15.111:0/4049632992 >> v2:172.21.15.111:3300/0 conn(0x7f27d4066170 0x7f27d405c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:34.337 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.330+0000 7f27d3fff700 1 -- 172.21.15.111:0/4049632992 >> v1:172.21.15.111:6789/0 conn(0x7f27d4067c20 legacy=0x7f27d4136350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:34.337 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.330+0000 7f27d3fff700 1 -- 172.21.15.111:0/4049632992 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27d405ba50 con 0x7f27d405c1a0 2024-04-25T02:20:34.337 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.330+0000 7f27d3fff700 1 --2- 172.21.15.111:0/4049632992 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f27d405c1a0 0x7f27d4067040 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f27d4060690 tx=0x7f27c4006eb0).ready entity=mon.2 client_cookie=b4b159fdfc53c3f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:34.337 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.330+0000 7f27d2ffd700 1 -- 172.21.15.111:0/4049632992 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27c400d5c0 con 0x7f27d405c1a0 2024-04-25T02:20:34.337 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.330+0000 7f27d2ffd700 1 -- 172.21.15.111:0/4049632992 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c4000e90 con 0x7f27d405c1a0 2024-04-25T02:20:34.337 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.330+0000 7f27d2ffd700 1 -- 172.21.15.111:0/4049632992 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27c400d950 con 0x7f27d405c1a0 2024-04-25T02:20:34.337 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.331+0000 7f27da540700 1 -- 172.21.15.111:0/4049632992 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f27d405c1a0 msgr2=0x7f27d4067040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:34.337 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.331+0000 7f27da540700 1 --2- 172.21.15.111:0/4049632992 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f27d405c1a0 0x7f27d4067040 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f27d4060690 tx=0x7f27c4006eb0).stop 2024-04-25T02:20:34.337 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.331+0000 7f27da540700 1 -- 172.21.15.111:0/4049632992 shutdown_connections 2024-04-25T02:20:34.337 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.331+0000 7f27da540700 1 --2- 172.21.15.111:0/4049632992 >> v2:172.21.15.111:3300/0 conn(0x7f27d4066170 0x7f27d405c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:34.337 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.331+0000 7f27da540700 1 --2- 172.21.15.111:0/4049632992 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f27d405c1a0 0x7f27d4067040 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:34.337 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.331+0000 7f27da540700 1 -- 172.21.15.111:0/4049632992 >> 172.21.15.111:0/4049632992 conn(0x7f27d40a8a00 msgr2=0x7f27d40a8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:34.337 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.331+0000 7f27da540700 1 -- 172.21.15.111:0/4049632992 shutdown_connections 2024-04-25T02:20:34.337 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.331+0000 7f27da540700 1 -- 172.21.15.111:0/4049632992 wait complete. 2024-04-25T02:20:34.337 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.331+0000 7f27da540700 1 Processor -- start 2024-04-25T02:20:34.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.331+0000 7f27da540700 1 -- start start 2024-04-25T02:20:34.340 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.332+0000 7f27da540700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f27d405c1a0 0x7f27d4149bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:34.340 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.332+0000 7f27da540700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f27d4066170 0x7f27d4095770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:34.340 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.332+0000 7f27da540700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f27d4067c20 0x7f27d4095c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:34.340 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.332+0000 7f27da540700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27d4096710 con 0x7f27d4066170 2024-04-25T02:20:34.340 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.332+0000 7f27da540700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27d40950a0 con 0x7f27d4067c20 2024-04-25T02:20:34.340 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.332+0000 7f27da540700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f27d4095340 con 0x7f27d405c1a0 2024-04-25T02:20:34.340 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.332+0000 7f27d3fff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f27d405c1a0 0x7f27d4149bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:34.340 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.332+0000 7f27d8add700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f27d4067c20 0x7f27d4095c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:34.340 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.332+0000 7f27d3fff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f27d405c1a0 0x7f27d4149bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:57320/0 (socket says 172.21.15.111:57320) 2024-04-25T02:20:34.340 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.332+0000 7f27d3fff700 1 -- 172.21.15.111:0/912638574 learned_addr learned my addr 172.21.15.111:0/912638574 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:34.340 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.332+0000 7f27d37fe700 1 --2- 172.21.15.111:0/912638574 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f27d4066170 0x7f27d4095770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:34.340 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.333+0000 7f27d3fff700 1 -- 172.21.15.111:0/912638574 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f27d4067c20 msgr2=0x7f27d4095c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:34.341 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.333+0000 7f27d3fff700 1 --2- 172.21.15.111:0/912638574 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f27d4067c20 0x7f27d4095c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:34.341 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.333+0000 7f27d3fff700 1 -- 172.21.15.111:0/912638574 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f27d4066170 msgr2=0x7f27d4095770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:34.341 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.333+0000 7f27d3fff700 1 --2- 172.21.15.111:0/912638574 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f27d4066170 0x7f27d4095770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:34.341 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.333+0000 7f27d3fff700 1 -- 172.21.15.111:0/912638574 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27c400b1e0 con 0x7f27d405c1a0 2024-04-25T02:20:34.341 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.333+0000 7f27d3fff700 1 --2- 172.21.15.111:0/912638574 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f27d405c1a0 0x7f27d4149bf0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f27d4060690 tx=0x7f27c4015000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:34.341 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.333+0000 7f27d17fa700 1 -- 172.21.15.111:0/912638574 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27c4011760 con 0x7f27d405c1a0 2024-04-25T02:20:34.341 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.333+0000 7f27d17fa700 1 -- 172.21.15.111:0/912638574 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f27c40118c0 con 0x7f27d405c1a0 2024-04-25T02:20:34.341 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.333+0000 7f27da540700 1 -- 172.21.15.111:0/912638574 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27d4094a30 con 0x7f27d405c1a0 2024-04-25T02:20:34.341 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.333+0000 7f27d17fa700 1 -- 172.21.15.111:0/912638574 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f27c4011c20 con 0x7f27d405c1a0 2024-04-25T02:20:34.341 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.333+0000 7f27da540700 1 -- 172.21.15.111:0/912638574 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f27d4096150 con 0x7f27d405c1a0 2024-04-25T02:20:34.341 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.334+0000 7f27d17fa700 1 -- 172.21.15.111:0/912638574 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f27c400f070 con 0x7f27d405c1a0 2024-04-25T02:20:34.341 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.334+0000 7f27da540700 1 -- 172.21.15.111:0/912638574 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27d414a2a0 con 0x7f27d405c1a0 2024-04-25T02:20:34.341 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.334+0000 7f27d17fa700 1 -- 172.21.15.111:0/912638574 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f27c404c0e0 con 0x7f27d405c1a0 2024-04-25T02:20:34.342 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.337+0000 7f27d17fa700 1 -- 172.21.15.111:0/912638574 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f27d414a2a0 con 0x7f27d405c1a0 2024-04-25T02:20:34.451 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.447+0000 7f27da540700 1 -- 172.21.15.111:0/912638574 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f27d414a2a0 con 0x7f27d405c1a0 2024-04-25T02:20:34.451 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.447+0000 7f27d17fa700 1 -- 172.21.15.111:0/912638574 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v18) v1 ==== 100+0+11 (secure 0 0 0) 0x7f27d414a2a0 con 0x7f27d405c1a0 2024-04-25T02:20:34.452 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 64 2024-04-25T02:20:34.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.449+0000 7f27da540700 1 -- 172.21.15.111:0/912638574 >> v1:172.21.15.111:6816/39585 conn(0x7f27b4038da0 legacy=0x7f27b403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:34.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.449+0000 7f27da540700 1 -- 172.21.15.111:0/912638574 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f27d405c1a0 msgr2=0x7f27d4149bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:34.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.449+0000 7f27da540700 1 --2- 172.21.15.111:0/912638574 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f27d405c1a0 0x7f27d4149bf0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f27d4060690 tx=0x7f27c4015000).stop 2024-04-25T02:20:34.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.449+0000 7f27da540700 1 -- 172.21.15.111:0/912638574 shutdown_connections 2024-04-25T02:20:34.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.449+0000 7f27da540700 1 --2- 172.21.15.111:0/912638574 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f27d4067c20 0x7f27d4095c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:34.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.449+0000 7f27da540700 1 --2- 172.21.15.111:0/912638574 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f27d405c1a0 0x7f27d4149bf0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:34.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.449+0000 7f27da540700 1 --2- 172.21.15.111:0/912638574 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f27d4066170 0x7f27d4095770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:34.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.449+0000 7f27da540700 1 -- 172.21.15.111:0/912638574 >> 172.21.15.111:0/912638574 conn(0x7f27d40a8a00 msgr2=0x7f27d4135c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:34.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.449+0000 7f27da540700 1 -- 172.21.15.111:0/912638574 shutdown_connections 2024-04-25T02:20:34.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.449+0000 7f27da540700 1 -- 172.21.15.111:0/912638574 wait complete. 2024-04-25T02:20:34.463 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:20:34.570 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.560+0000 7f7e674e0700 1 Processor -- start 2024-04-25T02:20:34.570 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.561+0000 7f7e674e0700 1 -- start start 2024-04-25T02:20:34.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.561+0000 7f7e674e0700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7e60139c70 0x7f7e60061a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:34.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.561+0000 7f7e674e0700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7e60060e70 0x7f7e6013a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:34.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.561+0000 7f7e674e0700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f7e6009c010 0x7f7e60136040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:34.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.561+0000 7f7e674e0700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e60061610 con 0x7f7e6009c010 2024-04-25T02:20:34.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.561+0000 7f7e674e0700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e601395b0 con 0x7f7e60139c70 2024-04-25T02:20:34.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.561+0000 7f7e674e0700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e6009c860 con 0x7f7e60060e70 2024-04-25T02:20:34.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.561+0000 7f7e6527c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7e60139c70 0x7f7e60061a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:34.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.561+0000 7f7e65a7d700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f7e6009c010 0x7f7e60136040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:34.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.561+0000 7f7e64a7b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7e60060e70 0x7f7e6013a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:34.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.561+0000 7f7e6527c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7e60139c70 0x7f7e60061a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:51596/0 (socket says 172.21.15.111:51596) 2024-04-25T02:20:34.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.561+0000 7f7e65a7d700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f7e6009c010 0x7f7e60136040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48536/0 (socket says 172.21.15.111:48536) 2024-04-25T02:20:34.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.561+0000 7f7e6527c700 1 -- 172.21.15.111:0/1581462300 learned_addr learned my addr 172.21.15.111:0/1581462300 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:34.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.561+0000 7f7e64a7b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7e60060e70 0x7f7e6013a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:57330/0 (socket says 172.21.15.111:57330) 2024-04-25T02:20:34.571 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.562+0000 7f7e6527c700 1 -- 172.21.15.111:0/1581462300 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7e60060e70 msgr2=0x7f7e6013a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:34.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.562+0000 7f7e6527c700 1 --2- 172.21.15.111:0/1581462300 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7e60060e70 0x7f7e6013a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:34.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.562+0000 7f7e6527c700 1 -- 172.21.15.111:0/1581462300 >> v2:172.21.15.111:3300/0 conn(0x7f7e6009c010 msgr2=0x7f7e60136040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:34.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.562+0000 7f7e6527c700 1 --2- 172.21.15.111:0/1581462300 >> v2:172.21.15.111:3300/0 conn(0x7f7e6009c010 0x7f7e60136040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:34.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.562+0000 7f7e6527c700 1 -- 172.21.15.111:0/1581462300 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e60060690 con 0x7f7e60139c70 2024-04-25T02:20:34.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.562+0000 7f7e65a7d700 1 --2- 172.21.15.111:0/1581462300 >> v2:172.21.15.111:3300/0 conn(0x7f7e6009c010 0x7f7e60136040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:34.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.562+0000 7f7e64a7b700 1 --2- 172.21.15.111:0/1581462300 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7e60060e70 0x7f7e6013a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:34.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.562+0000 7f7e6527c700 1 --2- 172.21.15.111:0/1581462300 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7e60139c70 0x7f7e60061a60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f7e60061750 tx=0x7f7e5c006eb0).ready entity=mon.1 client_cookie=68dc0f316b646c9d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:34.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.562+0000 7f7e4ffff700 1 -- 172.21.15.111:0/1581462300 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e5c00d570 con 0x7f7e60139c70 2024-04-25T02:20:34.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.562+0000 7f7e4ffff700 1 -- 172.21.15.111:0/1581462300 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e5c000e90 con 0x7f7e60139c70 2024-04-25T02:20:34.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.562+0000 7f7e4ffff700 1 -- 172.21.15.111:0/1581462300 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e5c00d900 con 0x7f7e60139c70 2024-04-25T02:20:34.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.562+0000 7f7e674e0700 1 -- 172.21.15.111:0/1581462300 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7e60139c70 msgr2=0x7f7e60061a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:34.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.562+0000 7f7e674e0700 1 --2- 172.21.15.111:0/1581462300 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7e60139c70 0x7f7e60061a60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f7e60061750 tx=0x7f7e5c006eb0).stop 2024-04-25T02:20:34.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.562+0000 7f7e674e0700 1 -- 172.21.15.111:0/1581462300 shutdown_connections 2024-04-25T02:20:34.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.562+0000 7f7e674e0700 1 --2- 172.21.15.111:0/1581462300 >> v2:172.21.15.111:3300/0 conn(0x7f7e6009c010 0x7f7e60136040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:34.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.562+0000 7f7e674e0700 1 --2- 172.21.15.111:0/1581462300 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7e60139c70 0x7f7e60061a60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:34.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.562+0000 7f7e674e0700 1 --2- 172.21.15.111:0/1581462300 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7e60060e70 0x7f7e6013a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:34.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.562+0000 7f7e674e0700 1 -- 172.21.15.111:0/1581462300 >> 172.21.15.111:0/1581462300 conn(0x7f7e6005d070 msgr2=0x7f7e600625e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:34.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.562+0000 7f7e674e0700 1 -- 172.21.15.111:0/1581462300 shutdown_connections 2024-04-25T02:20:34.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.562+0000 7f7e674e0700 1 -- 172.21.15.111:0/1581462300 wait complete. 2024-04-25T02:20:34.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.563+0000 7f7e674e0700 1 Processor -- start 2024-04-25T02:20:34.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.563+0000 7f7e674e0700 1 -- start start 2024-04-25T02:20:34.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.564+0000 7f7e674e0700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7e60060e70 0x7f7e6012de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:34.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.564+0000 7f7e674e0700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7e6009c010 0x7f7e6012e2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:34.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.564+0000 7f7e674e0700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7e60139c70 0x7f7e60134e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:34.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.564+0000 7f7e674e0700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e60067480 con 0x7f7e60139c70 2024-04-25T02:20:34.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.564+0000 7f7e674e0700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e60066880 con 0x7f7e60060e70 2024-04-25T02:20:34.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.564+0000 7f7e674e0700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7e60136aa0 con 0x7f7e6009c010 2024-04-25T02:20:34.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.564+0000 7f7e65a7d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7e60139c70 0x7f7e60134e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:34.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.564+0000 7f7e64a7b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7e6009c010 0x7f7e6012e2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:34.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.564+0000 7f7e64a7b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7e6009c010 0x7f7e6012e2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:57344/0 (socket says 172.21.15.111:57344) 2024-04-25T02:20:34.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.564+0000 7f7e64a7b700 1 -- 172.21.15.111:0/2522745842 learned_addr learned my addr 172.21.15.111:0/2522745842 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:34.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.564+0000 7f7e65a7d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7e60139c70 0x7f7e60134e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48542/0 (socket says 172.21.15.111:48542) 2024-04-25T02:20:34.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.564+0000 7f7e6527c700 1 --2- 172.21.15.111:0/2522745842 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7e60060e70 0x7f7e6012de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:34.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.564+0000 7f7e64a7b700 1 -- 172.21.15.111:0/2522745842 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7e60060e70 msgr2=0x7f7e6012de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:34.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.564+0000 7f7e64a7b700 1 --2- 172.21.15.111:0/2522745842 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7e60060e70 0x7f7e6012de00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:34.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.564+0000 7f7e64a7b700 1 -- 172.21.15.111:0/2522745842 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7e60139c70 msgr2=0x7f7e60134e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:34.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.564+0000 7f7e64a7b700 1 --2- 172.21.15.111:0/2522745842 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7e60139c70 0x7f7e60134e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:34.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.564+0000 7f7e64a7b700 1 -- 172.21.15.111:0/2522745842 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e50011990 con 0x7f7e6009c010 2024-04-25T02:20:34.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.564+0000 7f7e64a7b700 1 --2- 172.21.15.111:0/2522745842 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7e6009c010 0x7f7e6012e2f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f7e600633c0 tx=0x7f7e50013040).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:34.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.564+0000 7f7e4e7fc700 1 -- 172.21.15.111:0/2522745842 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e50014e40 con 0x7f7e6009c010 2024-04-25T02:20:34.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.564+0000 7f7e4e7fc700 1 -- 172.21.15.111:0/2522745842 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e50017040 con 0x7f7e6009c010 2024-04-25T02:20:34.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.564+0000 7f7e674e0700 1 -- 172.21.15.111:0/2522745842 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e58009470 con 0x7f7e6009c010 2024-04-25T02:20:34.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.564+0000 7f7e4e7fc700 1 -- 172.21.15.111:0/2522745842 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7e500112c0 con 0x7f7e6009c010 2024-04-25T02:20:34.575 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.565+0000 7f7e674e0700 1 -- 172.21.15.111:0/2522745842 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e5c00b1e0 con 0x7f7e6009c010 2024-04-25T02:20:34.575 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.565+0000 7f7e4e7fc700 1 -- 172.21.15.111:0/2522745842 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f7e50023030 con 0x7f7e6009c010 2024-04-25T02:20:34.575 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.566+0000 7f7e4e7fc700 1 -- 172.21.15.111:0/2522745842 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f7e50052ca0 con 0x7f7e6009c010 2024-04-25T02:20:34.575 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.566+0000 7f7e674e0700 1 -- 172.21.15.111:0/2522745842 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e600672d0 con 0x7f7e6009c010 2024-04-25T02:20:34.575 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.569+0000 7f7e4e7fc700 1 -- 172.21.15.111:0/2522745842 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f7e50038150 con 0x7f7e6009c010 2024-04-25T02:20:34.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.710+0000 7f7e674e0700 1 -- 172.21.15.111:0/2522745842 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7e60136be0 con 0x7f7e6009c010 2024-04-25T02:20:34.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.710+0000 7f7e4e7fc700 1 -- 172.21.15.111:0/2522745842 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+2326 (secure 0 0 0) 0x7f7e5002e070 con 0x7f7e6009c010 2024-04-25T02:20:34.714 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:20:34.715 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4193,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6817/3699616235","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6817","nonce":3699616235}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:20:24.150791+0000","modified":"2024-04-25T02:20:27.234975+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":4239,"mds_1":4236},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4236":{"gid":4236,"name":"c","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.111:6818/2165982859","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6818","nonce":2165982859}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4239":{"gid":4239,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.111:6819/4003866251","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6819","nonce":4003866251}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-25T02:20:34.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.711+0000 7f7e674e0700 1 -- 172.21.15.111:0/2522745842 >> v1:172.21.15.111:6816/39585 conn(0x7f7e40038f50 legacy=0x7f7e4003b410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:34.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.711+0000 7f7e674e0700 1 -- 172.21.15.111:0/2522745842 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7e6009c010 msgr2=0x7f7e6012e2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:34.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.711+0000 7f7e674e0700 1 --2- 172.21.15.111:0/2522745842 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7e6009c010 0x7f7e6012e2f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f7e600633c0 tx=0x7f7e50013040).stop 2024-04-25T02:20:34.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.711+0000 7f7e674e0700 1 -- 172.21.15.111:0/2522745842 shutdown_connections 2024-04-25T02:20:34.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.711+0000 7f7e674e0700 1 --2- 172.21.15.111:0/2522745842 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7e60139c70 0x7f7e60134e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:34.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.711+0000 7f7e674e0700 1 --2- 172.21.15.111:0/2522745842 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7e60060e70 0x7f7e6012de00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:34.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.711+0000 7f7e674e0700 1 --2- 172.21.15.111:0/2522745842 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7e6009c010 0x7f7e6012e2f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:34.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.711+0000 7f7e674e0700 1 -- 172.21.15.111:0/2522745842 >> 172.21.15.111:0/2522745842 conn(0x7f7e6005d070 msgr2=0x7f7e600a82e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:34.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.711+0000 7f7e674e0700 1 -- 172.21.15.111:0/2522745842 shutdown_connections 2024-04-25T02:20:34.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.712+0000 7f7e674e0700 1 -- 172.21.15.111:0/2522745842 wait complete. 2024-04-25T02:20:34.717 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 8 2024-04-25T02:20:34.726 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:20:34.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.824+0000 7f77a2c6c700 1 Processor -- start 2024-04-25T02:20:34.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.824+0000 7f77a2c6c700 1 -- start start 2024-04-25T02:20:34.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.825+0000 7f77a2c6c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f779c136800 0x7f779c0642e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:34.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.825+0000 7f77a2c6c700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f779c062590 0x7f779c13d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:34.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.825+0000 7f77a2c6c700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f779c1363d0 con 0x7f779c0633b0 2024-04-25T02:20:34.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.825+0000 7f77a2c6c700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f779c1372f0 con 0x7f779c062590 2024-04-25T02:20:34.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.825+0000 7f77a2c6c700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f779c0647d0 con 0x7f779c136800 2024-04-25T02:20:34.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.825+0000 7f77a0a08700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f779c136800 0x7f779c0642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:34.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.825+0000 7f779bfff700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f779c0633b0 0x7f779c136be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:55904/0 (socket says 172.21.15.111:55904) 2024-04-25T02:20:34.831 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.825+0000 7f779bfff700 1 -- 172.21.15.111:0/120220696 learned_addr learned my addr 172.21.15.111:0/120220696 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:20:34.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.825+0000 7f77a1209700 1 --2- 172.21.15.111:0/120220696 >> v2:172.21.15.111:3300/0 conn(0x7f779c062590 0x7f779c13d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:34.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.825+0000 7f779b7fe700 1 -- 172.21.15.111:0/120220696 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4148967725 0 0) 0x7f779c1363d0 con 0x7f779c0633b0 2024-04-25T02:20:34.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.825+0000 7f77a0a08700 1 -- 172.21.15.111:0/120220696 >> v2:172.21.15.111:3300/0 conn(0x7f779c062590 msgr2=0x7f779c13d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:34.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.825+0000 7f77a0a08700 1 --2- 172.21.15.111:0/120220696 >> v2:172.21.15.111:3300/0 conn(0x7f779c062590 0x7f779c13d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:34.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.825+0000 7f77a0a08700 1 -- 172.21.15.111:0/120220696 >> v1:172.21.15.111:6789/0 conn(0x7f779c0633b0 legacy=0x7f779c136be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:34.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.825+0000 7f77a0a08700 1 -- 172.21.15.111:0/120220696 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f779c136600 con 0x7f779c136800 2024-04-25T02:20:34.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.825+0000 7f77a1209700 1 --2- 172.21.15.111:0/120220696 >> v2:172.21.15.111:3300/0 conn(0x7f779c062590 0x7f779c13d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:34.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.825+0000 7f77a0a08700 1 --2- 172.21.15.111:0/120220696 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f779c136800 0x7f779c0642e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f7790002f70 tx=0x7f7790006e80).ready entity=mon.1 client_cookie=a0daa9cce41b6ccc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:34.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.825+0000 7f779b7fe700 1 -- 172.21.15.111:0/120220696 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f779000b7d0 con 0x7f779c136800 2024-04-25T02:20:34.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.825+0000 7f779b7fe700 1 -- 172.21.15.111:0/120220696 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f779000b930 con 0x7f779c136800 2024-04-25T02:20:34.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.825+0000 7f779b7fe700 1 -- 172.21.15.111:0/120220696 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f779000bc90 con 0x7f779c136800 2024-04-25T02:20:34.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.826+0000 7f77a2c6c700 1 -- 172.21.15.111:0/120220696 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f779c136800 msgr2=0x7f779c0642e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:34.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.826+0000 7f77a2c6c700 1 --2- 172.21.15.111:0/120220696 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f779c136800 0x7f779c0642e0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f7790002f70 tx=0x7f7790006e80).stop 2024-04-25T02:20:34.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.826+0000 7f77a2c6c700 1 -- 172.21.15.111:0/120220696 shutdown_connections 2024-04-25T02:20:34.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.826+0000 7f77a2c6c700 1 --2- 172.21.15.111:0/120220696 >> v2:172.21.15.111:3300/0 conn(0x7f779c062590 0x7f779c13d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:34.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.826+0000 7f77a2c6c700 1 --2- 172.21.15.111:0/120220696 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f779c136800 0x7f779c0642e0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:34.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.826+0000 7f77a2c6c700 1 -- 172.21.15.111:0/120220696 >> 172.21.15.111:0/120220696 conn(0x7f779c0614e0 msgr2=0x7f779c06c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:34.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.826+0000 7f77a2c6c700 1 -- 172.21.15.111:0/120220696 shutdown_connections 2024-04-25T02:20:34.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.826+0000 7f77a2c6c700 1 -- 172.21.15.111:0/120220696 wait complete. 2024-04-25T02:20:34.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.827+0000 7f77a2c6c700 1 Processor -- start 2024-04-25T02:20:34.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.827+0000 7f77a2c6c700 1 -- start start 2024-04-25T02:20:34.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.828+0000 7f77a2c6c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f779c062590 0x7f779c14d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:34.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.828+0000 7f77a2c6c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f779c0633b0 0x7f779c066b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:34.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.828+0000 7f77a2c6c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f779c136800 0x7f779c067050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:34.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.828+0000 7f77a2c6c700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f779c0a6a40 con 0x7f779c062590 2024-04-25T02:20:34.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.828+0000 7f77a2c6c700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f779c0a64f0 con 0x7f779c136800 2024-04-25T02:20:34.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.828+0000 7f77a2c6c700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f779c14dd70 con 0x7f779c0633b0 2024-04-25T02:20:34.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.828+0000 7f77a0a08700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f779c062590 0x7f779c14d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:34.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.828+0000 7f77a0a08700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f779c062590 0x7f779c14d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48564/0 (socket says 172.21.15.111:48564) 2024-04-25T02:20:34.836 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.828+0000 7f77a0a08700 1 -- 172.21.15.111:0/337405399 learned_addr learned my addr 172.21.15.111:0/337405399 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:34.836 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.828+0000 7f77a1209700 1 --2- 172.21.15.111:0/337405399 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f779c136800 0x7f779c067050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:34.836 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.828+0000 7f779bfff700 1 --2- 172.21.15.111:0/337405399 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f779c0633b0 0x7f779c066b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:34.836 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.828+0000 7f77a0a08700 1 -- 172.21.15.111:0/337405399 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f779c0633b0 msgr2=0x7f779c066b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:34.836 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.828+0000 7f77a0a08700 1 --2- 172.21.15.111:0/337405399 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f779c0633b0 0x7f779c066b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:34.836 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.828+0000 7f77a0a08700 1 -- 172.21.15.111:0/337405399 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f779c136800 msgr2=0x7f779c067050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:34.836 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.828+0000 7f77a0a08700 1 --2- 172.21.15.111:0/337405399 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f779c136800 0x7f779c067050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:34.836 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.828+0000 7f77a0a08700 1 -- 172.21.15.111:0/337405399 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7794009470 con 0x7f779c062590 2024-04-25T02:20:34.836 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.828+0000 7f77a1209700 1 --2- 172.21.15.111:0/337405399 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f779c136800 0x7f779c067050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:34.836 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.828+0000 7f77a0a08700 1 --2- 172.21.15.111:0/337405399 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f779c062590 0x7f779c14d3a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f7790002f70 tx=0x7f779c063f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:34.836 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.828+0000 7f7799ffb700 1 -- 172.21.15.111:0/337405399 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7790010e60 con 0x7f779c062590 2024-04-25T02:20:34.836 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.828+0000 7f7799ffb700 1 -- 172.21.15.111:0/337405399 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7790000e90 con 0x7f779c062590 2024-04-25T02:20:34.836 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.828+0000 7f77a2c6c700 1 -- 172.21.15.111:0/337405399 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f779000d410 con 0x7f779c062590 2024-04-25T02:20:34.836 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.828+0000 7f7799ffb700 1 -- 172.21.15.111:0/337405399 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7790019820 con 0x7f779c062590 2024-04-25T02:20:34.837 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.828+0000 7f77a2c6c700 1 -- 172.21.15.111:0/337405399 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f779c094600 con 0x7f779c062590 2024-04-25T02:20:34.837 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.829+0000 7f7799ffb700 1 -- 172.21.15.111:0/337405399 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f7790019980 con 0x7f779c062590 2024-04-25T02:20:34.837 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.829+0000 7f7799ffb700 1 -- 172.21.15.111:0/337405399 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f779004be30 con 0x7f779c062590 2024-04-25T02:20:34.837 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.829+0000 7f77a2c6c700 1 -- 172.21.15.111:0/337405399 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f779c068010 con 0x7f779c062590 2024-04-25T02:20:34.837 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.832+0000 7f7799ffb700 1 -- 172.21.15.111:0/337405399 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f77900056f0 con 0x7f779c062590 2024-04-25T02:20:34.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.943+0000 7f77a2c6c700 1 -- 172.21.15.111:0/337405399 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f779c14d1f0 con 0x7f779c062590 2024-04-25T02:20:34.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.943+0000 7f7799ffb700 1 -- 172.21.15.111:0/337405399 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v18) v1 ==== 74+0+10564 (secure 0 0 0) 0x7f7790031090 con 0x7f779c062590 2024-04-25T02:20:34.948 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:20:34.948 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":18,"fsid":"4643f974-f93a-4436-93b8-460ff320e62e","created":"2024-04-25T02:20:05.450475+0000","modified":"2024-04-25T02:20:25.151994+0000","last_up_change":"2024-04-25T02:20:10.439204+0000","last_in_change":"2024-04-25T02:20:10.439204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"jewel","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-25T02:20:07.471248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:20:14.420378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:20:22.251868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T02:20:23.128289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"df3f17ca-3b12-42c8-8cf7-8f1b7189e587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6800","nonce":40214}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6801","nonce":40214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6803","nonce":40214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6802","nonce":40214}]},"public_addr":"172.21.15.111:6800/40214","cluster_addr":"172.21.15.111:6801/40214","heartbeat_back_addr":"172.21.15.111:6803/40214","heartbeat_front_addr":"172.21.15.111:6802/40214","state":["exists","up"]},{"osd":1,"uuid":"93d54815-f215-4285-bba6-32f2d1cabf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6812","nonce":40216}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6813","nonce":40216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6815","nonce":40216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6814","nonce":40216}]},"public_addr":"172.21.15.111:6812/40216","cluster_addr":"172.21.15.111:6813/40216","heartbeat_back_addr":"172.21.15.111:6815/40216","heartbeat_front_addr":"172.21.15.111:6814/40216","state":["exists","up"]},{"osd":2,"uuid":"b26b2104-2a2e-408f-9ce7-3587a32a2ebe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6804","nonce":40215}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6805","nonce":40215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6807","nonce":40215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6806","nonce":40215}]},"public_addr":"172.21.15.111:6804/40215","cluster_addr":"172.21.15.111:6805/40215","heartbeat_back_addr":"172.21.15.111:6807/40215","heartbeat_front_addr":"172.21.15.111:6806/40215","state":["exists","up"]},{"osd":3,"uuid":"43c25820-1edc-4031-badf-72e87dd6bf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6808","nonce":40213}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6809","nonce":40213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6811","nonce":40213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6810","nonce":40213}]},"public_addr":"172.21.15.111:6808/40213","cluster_addr":"172.21.15.111:6809/40213","heartbeat_back_addr":"172.21.15.111:6811/40213","heartbeat_front_addr":"172.21.15.111:6810/40213","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.372427+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.411480+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.361508+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.377212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-25T02:20:34.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.945+0000 7f77a2c6c700 1 -- 172.21.15.111:0/337405399 >> v1:172.21.15.111:6816/39585 conn(0x7f777c038dd0 legacy=0x7f777c03b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:34.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.945+0000 7f77a2c6c700 1 -- 172.21.15.111:0/337405399 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f779c062590 msgr2=0x7f779c14d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:34.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.945+0000 7f77a2c6c700 1 --2- 172.21.15.111:0/337405399 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f779c062590 0x7f779c14d3a0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f7790002f70 tx=0x7f779c063f20).stop 2024-04-25T02:20:34.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.945+0000 7f77a2c6c700 1 -- 172.21.15.111:0/337405399 shutdown_connections 2024-04-25T02:20:34.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.945+0000 7f77a2c6c700 1 --2- 172.21.15.111:0/337405399 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f779c136800 0x7f779c067050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:34.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.945+0000 7f77a2c6c700 1 --2- 172.21.15.111:0/337405399 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f779c062590 0x7f779c14d3a0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:34.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.945+0000 7f77a2c6c700 1 --2- 172.21.15.111:0/337405399 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f779c0633b0 0x7f779c066b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:34.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.945+0000 7f77a2c6c700 1 -- 172.21.15.111:0/337405399 >> 172.21.15.111:0/337405399 conn(0x7f779c0614e0 msgr2=0x7f779c09b1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:34.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.945+0000 7f77a2c6c700 1 -- 172.21.15.111:0/337405399 shutdown_connections 2024-04-25T02:20:34.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:34.945+0000 7f77a2c6c700 1 -- 172.21.15.111:0/337405399 wait complete. 2024-04-25T02:20:34.959 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:20:35.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.057+0000 7fa89a980700 1 Processor -- start 2024-04-25T02:20:35.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.057+0000 7fa89a980700 1 -- start start 2024-04-25T02:20:35.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.058+0000 7fa89a980700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa894139c10 0x7fa894139ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:35.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.058+0000 7fa89a980700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa894097580 0x7fa89405ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:35.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.058+0000 7fa89a980700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa89413a4e0 con 0x7fa894097960 2024-04-25T02:20:35.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.058+0000 7fa89a980700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa894099610 con 0x7fa894139c10 2024-04-25T02:20:35.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.058+0000 7fa89a980700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa894096f80 con 0x7fa894097580 2024-04-25T02:20:35.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.058+0000 7fa893fff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa894139c10 0x7fa894139ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:35.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.058+0000 7fa8937fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa894097580 0x7fa89405ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:35.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.058+0000 7fa893fff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa894139c10 0x7fa894139ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:51636/0 (socket says 172.21.15.111:51636) 2024-04-25T02:20:35.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.058+0000 7fa898f1d700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7fa894097960 0x7fa89405bf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:55906/0 (socket says 172.21.15.111:55906) 2024-04-25T02:20:35.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.058+0000 7fa8937fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa894097580 0x7fa89405ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:57360/0 (socket says 172.21.15.111:57360) 2024-04-25T02:20:35.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.058+0000 7fa893fff700 1 -- 172.21.15.111:0/2258142359 learned_addr learned my addr 172.21.15.111:0/2258142359 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:35.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.058+0000 7fa8937fe700 1 -- 172.21.15.111:0/2258142359 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa894139c10 msgr2=0x7fa894139ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:35.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.058+0000 7fa892ffd700 1 -- 172.21.15.111:0/2258142359 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3505670203 0 0) 0x7fa89413a4e0 con 0x7fa894097960 2024-04-25T02:20:35.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.058+0000 7fa8937fe700 1 --2- 172.21.15.111:0/2258142359 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa894139c10 0x7fa894139ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.058+0000 7fa8937fe700 1 -- 172.21.15.111:0/2258142359 >> v1:172.21.15.111:6789/0 conn(0x7fa894097960 legacy=0x7fa89405bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:35.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.058+0000 7fa8937fe700 1 -- 172.21.15.111:0/2258142359 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa894139730 con 0x7fa894097580 2024-04-25T02:20:35.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.058+0000 7fa893fff700 1 --2- 172.21.15.111:0/2258142359 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa894139c10 0x7fa894139ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:35.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.058+0000 7fa8937fe700 1 --2- 172.21.15.111:0/2258142359 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa894097580 0x7fa89405ba50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fa884002f70 tx=0x7fa884006df0).ready entity=mon.2 client_cookie=4f6c531b63d87084 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:35.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.058+0000 7fa892ffd700 1 -- 172.21.15.111:0/2258142359 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa88400d570 con 0x7fa894097580 2024-04-25T02:20:35.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.058+0000 7fa892ffd700 1 -- 172.21.15.111:0/2258142359 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa884000e90 con 0x7fa894097580 2024-04-25T02:20:35.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.058+0000 7fa892ffd700 1 -- 172.21.15.111:0/2258142359 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa88400d8c0 con 0x7fa894097580 2024-04-25T02:20:35.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.059+0000 7fa89a980700 1 -- 172.21.15.111:0/2258142359 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa894097580 msgr2=0x7fa89405ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:35.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.059+0000 7fa89a980700 1 --2- 172.21.15.111:0/2258142359 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa894097580 0x7fa89405ba50 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fa884002f70 tx=0x7fa884006df0).stop 2024-04-25T02:20:35.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.059+0000 7fa89a980700 1 -- 172.21.15.111:0/2258142359 shutdown_connections 2024-04-25T02:20:35.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.059+0000 7fa89a980700 1 --2- 172.21.15.111:0/2258142359 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa894139c10 0x7fa894139ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.059+0000 7fa89a980700 1 --2- 172.21.15.111:0/2258142359 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa894097580 0x7fa89405ba50 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.059+0000 7fa89a980700 1 -- 172.21.15.111:0/2258142359 >> 172.21.15.111:0/2258142359 conn(0x7fa8940614e0 msgr2=0x7fa89406c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:35.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.059+0000 7fa89a980700 1 -- 172.21.15.111:0/2258142359 shutdown_connections 2024-04-25T02:20:35.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.059+0000 7fa89a980700 1 -- 172.21.15.111:0/2258142359 wait complete. 2024-04-25T02:20:35.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.060+0000 7fa89a980700 1 Processor -- start 2024-04-25T02:20:35.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.060+0000 7fa89a980700 1 -- start start 2024-04-25T02:20:35.069 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.060+0000 7fa89a980700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa894097580 0x7fa894064670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:35.069 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.060+0000 7fa89a980700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa894097960 0x7fa894148dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:35.069 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.060+0000 7fa89a980700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa894139c10 0x7fa8941492b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:35.069 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.060+0000 7fa89a980700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8940672e0 con 0x7fa894097960 2024-04-25T02:20:35.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.060+0000 7fa89a980700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa894065b80 con 0x7fa894139c10 2024-04-25T02:20:35.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.060+0000 7fa89a980700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa894064c90 con 0x7fa894097580 2024-04-25T02:20:35.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.061+0000 7fa898f1d700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa894139c10 0x7fa8941492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:35.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.061+0000 7fa893fff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa894097580 0x7fa894064670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:35.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.061+0000 7fa898f1d700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa894139c10 0x7fa8941492b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:51640/0 (socket says 172.21.15.111:51640) 2024-04-25T02:20:35.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.061+0000 7fa898f1d700 1 -- 172.21.15.111:0/2578731559 learned_addr learned my addr 172.21.15.111:0/2578731559 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:35.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.061+0000 7fa893fff700 1 -- 172.21.15.111:0/2578731559 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa894139c10 msgr2=0x7fa8941492b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:35.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.061+0000 7fa893fff700 1 --2- 172.21.15.111:0/2578731559 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa894139c10 0x7fa8941492b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.061+0000 7fa893fff700 1 -- 172.21.15.111:0/2578731559 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa894097960 msgr2=0x7fa894148dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:35.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.061+0000 7fa893fff700 1 --2- 172.21.15.111:0/2578731559 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa894097960 0x7fa894148dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-25T02:20:35.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.061+0000 7fa893fff700 1 -- 172.21.15.111:0/2578731559 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa87c00b1e0 con 0x7fa894097580 2024-04-25T02:20:35.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.061+0000 7fa898f1d700 1 --2- 172.21.15.111:0/2578731559 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa894139c10 0x7fa8941492b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:35.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.061+0000 7fa893fff700 1 --2- 172.21.15.111:0/2578731559 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa894097580 0x7fa894064670 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fa87c00c000 tx=0x7fa87c006eb0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:35.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.061+0000 7fa8917fa700 1 -- 172.21.15.111:0/2578731559 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa87c012600 con 0x7fa894097580 2024-04-25T02:20:35.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.061+0000 7fa8917fa700 1 -- 172.21.15.111:0/2578731559 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa87c012760 con 0x7fa894097580 2024-04-25T02:20:35.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.061+0000 7fa89a980700 1 -- 172.21.15.111:0/2578731559 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa88400b180 con 0x7fa894097580 2024-04-25T02:20:35.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.061+0000 7fa8917fa700 1 -- 172.21.15.111:0/2578731559 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fa87c012ac0 con 0x7fa894097580 2024-04-25T02:20:35.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.061+0000 7fa89a980700 1 -- 172.21.15.111:0/2578731559 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa894066110 con 0x7fa894097580 2024-04-25T02:20:35.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.062+0000 7fa8917fa700 1 -- 172.21.15.111:0/2578731559 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fa87c012c20 con 0x7fa894097580 2024-04-25T02:20:35.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.062+0000 7fa89a980700 1 -- 172.21.15.111:0/2578731559 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8941399f0 con 0x7fa894097580 2024-04-25T02:20:35.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.062+0000 7fa8917fa700 1 -- 172.21.15.111:0/2578731559 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fa87c04ad10 con 0x7fa894097580 2024-04-25T02:20:35.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.065+0000 7fa8917fa700 1 -- 172.21.15.111:0/2578731559 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fa87c0334b0 con 0x7fa894097580 2024-04-25T02:20:35.209 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.204+0000 7fa89a980700 1 -- 172.21.15.111:0/2578731559 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa89413a450 con 0x7fa894097580 2024-04-25T02:20:35.209 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.205+0000 7fa8917fa700 1 -- 172.21.15.111:0/2578731559 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+2326 (secure 0 0 0) 0x7fa87c0330a0 con 0x7fa894097580 2024-04-25T02:20:35.209 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:20:35.209 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4193,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6817/3699616235","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6817","nonce":3699616235}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:20:24.150791+0000","modified":"2024-04-25T02:20:27.234975+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":4239,"mds_1":4236},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4236":{"gid":4236,"name":"c","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.111:6818/2165982859","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6818","nonce":2165982859}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4239":{"gid":4239,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.111:6819/4003866251","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6819","nonce":4003866251}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-25T02:20:35.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.206+0000 7fa89a980700 1 -- 172.21.15.111:0/2578731559 >> v1:172.21.15.111:6816/39585 conn(0x7fa878038dd0 legacy=0x7fa87803b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:35.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.206+0000 7fa89a980700 1 -- 172.21.15.111:0/2578731559 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa894097580 msgr2=0x7fa894064670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:35.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.206+0000 7fa89a980700 1 --2- 172.21.15.111:0/2578731559 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa894097580 0x7fa894064670 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fa87c00c000 tx=0x7fa87c006eb0).stop 2024-04-25T02:20:35.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.206+0000 7fa89a980700 1 -- 172.21.15.111:0/2578731559 shutdown_connections 2024-04-25T02:20:35.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.206+0000 7fa89a980700 1 --2- 172.21.15.111:0/2578731559 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa894139c10 0x7fa8941492b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.206+0000 7fa89a980700 1 --2- 172.21.15.111:0/2578731559 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa894097580 0x7fa894064670 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.206+0000 7fa89a980700 1 --2- 172.21.15.111:0/2578731559 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa894097960 0x7fa894148dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-04-25T02:20:35.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.206+0000 7fa89a980700 1 -- 172.21.15.111:0/2578731559 >> 172.21.15.111:0/2578731559 conn(0x7fa8940614e0 msgr2=0x7fa8941322a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:35.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.206+0000 7fa89a980700 1 -- 172.21.15.111:0/2578731559 shutdown_connections 2024-04-25T02:20:35.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.206+0000 7fa89a980700 1 -- 172.21.15.111:0/2578731559 wait complete. 2024-04-25T02:20:35.211 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 8 2024-04-25T02:20:35.523 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 8, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T02:20:24.150791+0000', 'modified': '2024-04-25T02:20:27.234975+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 2, 'in': [0, 1], 'up': {'mds_0': 4239, 'mds_1': 4236}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4236': {'gid': 4236, 'name': 'c', 'rank': 1, 'incarnation': 7, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.111:6818/2165982859', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.111:6818', 'nonce': 2165982859}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4239': {'gid': 4239, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.111:6819/4003866251', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.111:6819', 'nonce': 4003866251}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-25T02:20:35.523 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 2/2 2024-04-25T02:20:35.523 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-25T02:20:35.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.625+0000 7f980b2dd700 1 Processor -- start 2024-04-25T02:20:35.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.625+0000 7f980b2dd700 1 -- start start 2024-04-25T02:20:35.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.625+0000 7f980b2dd700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f9804136eb0 0x7f98040a1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:35.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.625+0000 7f980b2dd700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f980413ba00 0x7f980413ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:35.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.625+0000 7f980b2dd700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98040a1c60 con 0x7f98041363c0 2024-04-25T02:20:35.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.625+0000 7f980b2dd700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98040a1540 con 0x7f9804136eb0 2024-04-25T02:20:35.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.625+0000 7f980b2dd700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98040a25a0 con 0x7f980413ba00 2024-04-25T02:20:35.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.625+0000 7f9808878700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f9804136eb0 0x7f98040a1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:35.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.625+0000 7f980987a700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f980413ba00 0x7f980413ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:35.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.626+0000 7f9809079700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f98041363c0 0x7f98041367a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:55914/0 (socket says 172.21.15.111:55914) 2024-04-25T02:20:35.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.626+0000 7f9808878700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f9804136eb0 0x7f98040a1050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48584/0 (socket says 172.21.15.111:48584) 2024-04-25T02:20:35.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.626+0000 7f9809079700 1 -- 172.21.15.111:0/1512606003 learned_addr learned my addr 172.21.15.111:0/1512606003 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:20:35.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.626+0000 7f980987a700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f980413ba00 0x7f980413ddf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:57382/0 (socket says 172.21.15.111:57382) 2024-04-25T02:20:35.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.626+0000 7f980987a700 1 -- 172.21.15.111:0/1512606003 >> v2:172.21.15.111:3300/0 conn(0x7f9804136eb0 msgr2=0x7f98040a1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:35.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.626+0000 7f980987a700 1 --2- 172.21.15.111:0/1512606003 >> v2:172.21.15.111:3300/0 conn(0x7f9804136eb0 0x7f98040a1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.626+0000 7f980987a700 1 -- 172.21.15.111:0/1512606003 >> v1:172.21.15.111:6789/0 conn(0x7f98041363c0 legacy=0x7f98041367a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:35.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.626+0000 7f97f3fff700 1 -- 172.21.15.111:0/1512606003 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1697118917 0 0) 0x7f98040a1c60 con 0x7f98041363c0 2024-04-25T02:20:35.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.626+0000 7f980987a700 1 -- 172.21.15.111:0/1512606003 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98040a2860 con 0x7f980413ba00 2024-04-25T02:20:35.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.626+0000 7f9808878700 1 --2- 172.21.15.111:0/1512606003 >> v2:172.21.15.111:3300/0 conn(0x7f9804136eb0 0x7f98040a1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:35.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.626+0000 7f980987a700 1 --2- 172.21.15.111:0/1512606003 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f980413ba00 0x7f980413ddf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f98040a7bc0 tx=0x7f97fc0091d0).ready entity=mon.2 client_cookie=a63be0d0b15c6579 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:35.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.626+0000 7f97f3fff700 1 -- 172.21.15.111:0/1512606003 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97fc00b680 con 0x7f980413ba00 2024-04-25T02:20:35.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.626+0000 7f97f3fff700 1 -- 172.21.15.111:0/1512606003 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97fc00b7e0 con 0x7f980413ba00 2024-04-25T02:20:35.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.626+0000 7f97f3fff700 1 -- 172.21.15.111:0/1512606003 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f97fc00b950 con 0x7f980413ba00 2024-04-25T02:20:35.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.627+0000 7f980b2dd700 1 -- 172.21.15.111:0/1512606003 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f980413ba00 msgr2=0x7f980413ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:35.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.627+0000 7f980b2dd700 1 --2- 172.21.15.111:0/1512606003 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f980413ba00 0x7f980413ddf0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f98040a7bc0 tx=0x7f97fc0091d0).stop 2024-04-25T02:20:35.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.627+0000 7f980b2dd700 1 -- 172.21.15.111:0/1512606003 shutdown_connections 2024-04-25T02:20:35.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.627+0000 7f980b2dd700 1 --2- 172.21.15.111:0/1512606003 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f980413ba00 0x7f980413ddf0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.627+0000 7f980b2dd700 1 --2- 172.21.15.111:0/1512606003 >> v2:172.21.15.111:3300/0 conn(0x7f9804136eb0 0x7f98040a1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.627+0000 7f980b2dd700 1 -- 172.21.15.111:0/1512606003 >> 172.21.15.111:0/1512606003 conn(0x7f98040a8a00 msgr2=0x7f98040a8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:35.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.627+0000 7f980b2dd700 1 -- 172.21.15.111:0/1512606003 shutdown_connections 2024-04-25T02:20:35.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.627+0000 7f980b2dd700 1 -- 172.21.15.111:0/1512606003 wait complete. 2024-04-25T02:20:35.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.628+0000 7f980b2dd700 1 Processor -- start 2024-04-25T02:20:35.633 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.628+0000 7f980b2dd700 1 -- start start 2024-04-25T02:20:35.635 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.628+0000 7f980b2dd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f98041363c0 0x7f9804092350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:35.635 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.628+0000 7f980b2dd700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9804136eb0 0x7f9804066570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:35.635 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.628+0000 7f980b2dd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f980413ba00 0x7f9804064c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:35.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.628+0000 7f980b2dd700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9804092ca0 con 0x7f98041363c0 2024-04-25T02:20:35.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.628+0000 7f980b2dd700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9804093880 con 0x7f980413ba00 2024-04-25T02:20:35.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.628+0000 7f980b2dd700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9804093b40 con 0x7f9804136eb0 2024-04-25T02:20:35.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.629+0000 7f9809079700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f98041363c0 0x7f9804092350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:35.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.629+0000 7f9808878700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9804136eb0 0x7f9804066570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:35.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.629+0000 7f9809079700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f98041363c0 0x7f9804092350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48590/0 (socket says 172.21.15.111:48590) 2024-04-25T02:20:35.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.629+0000 7f9808878700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9804136eb0 0x7f9804066570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:57392/0 (socket says 172.21.15.111:57392) 2024-04-25T02:20:35.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.629+0000 7f9809079700 1 -- 172.21.15.111:0/4164610432 learned_addr learned my addr 172.21.15.111:0/4164610432 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:35.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.629+0000 7f980987a700 1 --2- 172.21.15.111:0/4164610432 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f980413ba00 0x7f9804064c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:35.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.629+0000 7f9809079700 1 -- 172.21.15.111:0/4164610432 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9804136eb0 msgr2=0x7f9804066570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:35.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.629+0000 7f9809079700 1 --2- 172.21.15.111:0/4164610432 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9804136eb0 0x7f9804066570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.629+0000 7f9809079700 1 -- 172.21.15.111:0/4164610432 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f980413ba00 msgr2=0x7f9804064c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:35.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.629+0000 7f9809079700 1 --2- 172.21.15.111:0/4164610432 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f980413ba00 0x7f9804064c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.636 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.629+0000 7f9809079700 1 -- 172.21.15.111:0/4164610432 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f400b180 con 0x7f98041363c0 2024-04-25T02:20:35.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.629+0000 7f9809079700 1 --2- 172.21.15.111:0/4164610432 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f98041363c0 0x7f9804092350 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f9800000bc0 tx=0x7f9800007a60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:35.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.629+0000 7f97f27fc700 1 -- 172.21.15.111:0/4164610432 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f98000070d0 con 0x7f98041363c0 2024-04-25T02:20:35.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.629+0000 7f97f27fc700 1 -- 172.21.15.111:0/4164610432 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9800007230 con 0x7f98041363c0 2024-04-25T02:20:35.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.629+0000 7f97f27fc700 1 -- 172.21.15.111:0/4164610432 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9800005610 con 0x7f98041363c0 2024-04-25T02:20:35.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.629+0000 7f980b2dd700 1 -- 172.21.15.111:0/4164610432 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97fc009470 con 0x7f98041363c0 2024-04-25T02:20:35.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.629+0000 7f980b2dd700 1 -- 172.21.15.111:0/4164610432 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f980405c850 con 0x7f98041363c0 2024-04-25T02:20:35.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.630+0000 7f97f27fc700 1 -- 172.21.15.111:0/4164610432 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f9800010070 con 0x7f98041363c0 2024-04-25T02:20:35.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.630+0000 7f97f27fc700 1 -- 172.21.15.111:0/4164610432 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f9800049de0 con 0x7f98041363c0 2024-04-25T02:20:35.643 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.633+0000 7f981cd64b80 1 Processor -- start 2024-04-25T02:20:35.643 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.633+0000 7f981cd64b80 1 -- start start 2024-04-25T02:20:35.643 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.634+0000 7f981cd64b80 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x5642170641d0 0x564217057a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:35.643 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.634+0000 7f981cd64b80 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x5642170645b0 0x5642170649b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:35.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.634+0000 7f981cd64b80 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564217069590 0x564217069a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:35.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.634+0000 7f981cd64b80 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x564217005a10 con 0x564217069590 2024-04-25T02:20:35.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.634+0000 7f981cd64b80 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x564216faae10 con 0x5642170641d0 2024-04-25T02:20:35.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.634+0000 7f981cd64b80 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x564216f7b8b0 con 0x5642170645b0 2024-04-25T02:20:35.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.634+0000 7f9808878700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x5642170645b0 0x5642170649b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:35.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.634+0000 7f9809079700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x5642170641d0 0x564217057a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:35.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.634+0000 7f9808878700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x5642170645b0 0x5642170649b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:57402/0 (socket says 172.21.15.111:57402) 2024-04-25T02:20:35.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.634+0000 7f9809079700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x5642170641d0 0x564217057a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:51672/0 (socket says 172.21.15.111:51672) 2024-04-25T02:20:35.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.634+0000 7f9808878700 1 -- 172.21.15.111:0/1461548153 learned_addr learned my addr 172.21.15.111:0/1461548153 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:35.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.634+0000 7f980987a700 1 --2- 172.21.15.111:0/1461548153 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564217069590 0x564217069a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:35.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.634+0000 7f9809079700 1 -- 172.21.15.111:0/1461548153 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x5642170645b0 msgr2=0x5642170649b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:35.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.634+0000 7f9809079700 1 --2- 172.21.15.111:0/1461548153 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x5642170645b0 0x5642170649b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.634+0000 7f9809079700 1 -- 172.21.15.111:0/1461548153 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564217069590 msgr2=0x564217069a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:35.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.634+0000 7f9809079700 1 --2- 172.21.15.111:0/1461548153 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564217069590 0x564217069a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.634+0000 7f9809079700 1 -- 172.21.15.111:0/1461548153 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564217011e20 con 0x5642170641d0 2024-04-25T02:20:35.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.634+0000 7f9808878700 1 --2- 172.21.15.111:0/1461548153 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x5642170645b0 0x5642170649b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:35.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.634+0000 7f9809079700 1 --2- 172.21.15.111:0/1461548153 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x5642170641d0 0x564217057a60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f9800000fa0 tx=0x7f9800015000).ready entity=mon.1 client_cookie=c57999bfced6cae7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:35.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.634+0000 7f980b2dd700 1 -- 172.21.15.111:0/1461548153 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9800022070 con 0x5642170641d0 2024-04-25T02:20:35.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.634+0000 7f980b2dd700 1 -- 172.21.15.111:0/1461548153 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98000324e0 con 0x5642170641d0 2024-04-25T02:20:35.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.634+0000 7f980b2dd700 1 -- 172.21.15.111:0/1461548153 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9800032300 con 0x5642170641d0 2024-04-25T02:20:35.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.635+0000 7f981cd64b80 1 -- 172.21.15.111:0/1461548153 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x5642170641d0 msgr2=0x564217057a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:35.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.635+0000 7f981cd64b80 1 --2- 172.21.15.111:0/1461548153 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x5642170641d0 0x564217057a60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f9800000fa0 tx=0x7f9800015000).stop 2024-04-25T02:20:35.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.635+0000 7f981cd64b80 1 -- 172.21.15.111:0/1461548153 shutdown_connections 2024-04-25T02:20:35.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.635+0000 7f981cd64b80 1 --2- 172.21.15.111:0/1461548153 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564217069590 0x564217069a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.635+0000 7f981cd64b80 1 --2- 172.21.15.111:0/1461548153 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x5642170641d0 0x564217057a60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.635+0000 7f981cd64b80 1 --2- 172.21.15.111:0/1461548153 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x5642170645b0 0x5642170649b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.635+0000 7f981cd64b80 1 -- 172.21.15.111:0/1461548153 >> 172.21.15.111:0/1461548153 conn(0x564217003970 msgr2=0x564216f5d690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:35.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.635+0000 7f981cd64b80 1 -- 172.21.15.111:0/1461548153 shutdown_connections 2024-04-25T02:20:35.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.635+0000 7f981cd64b80 1 -- 172.21.15.111:0/1461548153 wait complete. 2024-04-25T02:20:35.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.635+0000 7f981cd64b80 1 -- start start 2024-04-25T02:20:35.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.636+0000 7f981cd64b80 1 Processor -- start 2024-04-25T02:20:35.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.636+0000 7f981cd64b80 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x5642170641d0 0x56421705aed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:35.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.636+0000 7f981cd64b80 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x5642170645b0 0x564217067b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:35.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.636+0000 7f981cd64b80 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564217069590 0x564217068030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:35.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.636+0000 7f981cd64b80 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x564216f8f180 con 0x564217069590 2024-04-25T02:20:35.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.636+0000 7f981cd64b80 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x564216f6f7f0 con 0x5642170645b0 2024-04-25T02:20:35.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.636+0000 7f981cd64b80 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x564216f5f710 con 0x5642170641d0 2024-04-25T02:20:35.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.636+0000 7f981cd64b80 10 client.0 ll_register_callbacks cb 0x564216f84570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:20:35.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.636+0000 7f9809079700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x5642170641d0 0x56421705aed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:35.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.636+0000 7f9808878700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x5642170645b0 0x564217067b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:35.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.636+0000 7f980987a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564217069590 0x564217068030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:35.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.636+0000 7f9809079700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x5642170641d0 0x56421705aed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:57412/0 (socket says 172.21.15.111:57412) 2024-04-25T02:20:35.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.636+0000 7f9809079700 1 -- 172.21.15.111:0/2637650082 learned_addr learned my addr 172.21.15.111:0/2637650082 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:35.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.636+0000 7f9808878700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x5642170645b0 0x564217067b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:51682/0 (socket says 172.21.15.111:51682) 2024-04-25T02:20:35.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.637+0000 7f9809079700 1 -- 172.21.15.111:0/2637650082 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x5642170645b0 msgr2=0x564217067b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:35.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.637+0000 7f9809079700 1 --2- 172.21.15.111:0/2637650082 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x5642170645b0 0x564217067b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.637+0000 7f9809079700 1 -- 172.21.15.111:0/2637650082 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564217069590 msgr2=0x564217068030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:35.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.637+0000 7f9809079700 1 --2- 172.21.15.111:0/2637650082 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564217069590 0x564217068030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.637+0000 7f9809079700 1 -- 172.21.15.111:0/2637650082 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97f400bc80 con 0x5642170641d0 2024-04-25T02:20:35.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.637+0000 7f9808878700 1 --2- 172.21.15.111:0/2637650082 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x5642170645b0 0x564217067b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:35.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.637+0000 7f9809079700 1 --2- 172.21.15.111:0/2637650082 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x5642170641d0 0x56421705aed0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x56421705b750 tx=0x7f9800027000).ready entity=mon.2 client_cookie=1df0697f2d7b1db8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:35.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.637+0000 7f97e07f8700 10 client.0 ms_handle_connect on v2:172.21.15.111:3302/0 2024-04-25T02:20:35.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.637+0000 7f97e07f8700 1 -- 172.21.15.111:0/2637650082 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9800022070 con 0x5642170641d0 2024-04-25T02:20:35.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.637+0000 7f97e07f8700 1 -- 172.21.15.111:0/2637650082 <== mon.2 v2:172.21.15.111:3302/0 2 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f9800031900 con 0x5642170641d0 2024-04-25T02:20:35.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.637+0000 7f981cd64b80 1 -- 172.21.15.111:0/2637650082 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x564216f060c0 con 0x5642170641d0 2024-04-25T02:20:35.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.637+0000 7f97e07f8700 1 -- 172.21.15.111:0/2637650082 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9800031ac0 con 0x5642170641d0 2024-04-25T02:20:35.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.637+0000 7f981cd64b80 10 client.4484 fetch_fsmap learned FSMap version 8 2024-04-25T02:20:35.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.637+0000 7f981cd64b80 1 -- 172.21.15.111:0/2637650082 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x7f980405c850 con 0x5642170641d0 2024-04-25T02:20:35.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.637+0000 7f97e07f8700 1 -- 172.21.15.111:0/2637650082 <== mon.2 v2:172.21.15.111:3302/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x564216f060c0 con 0x5642170641d0 2024-04-25T02:20:35.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.637+0000 7f97e07f8700 1 -- 172.21.15.111:0/2637650082 <== mon.2 v2:172.21.15.111:3302/0 5 ==== fsmap(e 8) v1 ==== 1341+0+0 (secure 0 0 0) 0x7f9800039030 con 0x5642170641d0 2024-04-25T02:20:35.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.637+0000 7f981cd64b80 10 client.4484 fetch_fsmap finished waiting for FSMap version 8 2024-04-25T02:20:35.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.637+0000 7f981cd64b80 10 client.4484 resolve_mds: resolved ID 'c' to GID 4236 2024-04-25T02:20:35.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.637+0000 7f981cd64b80 20 client.4484 populate_metadata read hostname 'smithi111' 2024-04-25T02:20:35.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.637+0000 7f981cd64b80 4 client.4484 mds_command: new command op to 4236 tid=0[{"prefix": "get_command_descriptions"}] 2024-04-25T02:20:35.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.637+0000 7f981cd64b80 1 -- 172.21.15.111:0/2637650082 --> v1:172.21.15.111:6818/2165982859 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x564216f85230 con 0x564217072a80 2024-04-25T02:20:35.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.637+0000 7f97e07f8700 10 client.4484 ms_handle_connect on v1:172.21.15.111:6818/2165982859 2024-04-25T02:20:35.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.638+0000 7f97e07f8700 1 -- 172.21.15.111:0/2637650082 <== mds.1 v1:172.21.15.111:6818/2165982859 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (unknown 0 0 4003121674) 0x564216f85230 con 0x564217072a80 2024-04-25T02:20:35.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.638+0000 7f97e07f8700 10 client.4484 handle_command_reply: tid=0 2024-04-25T02:20:35.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.638+0000 7f981cd64b80 1 client.4484 shutdown 2024-04-25T02:20:35.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.638+0000 7f981cd64b80 1 -- 172.21.15.111:0/2637650082 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x5642170641d0 msgr2=0x56421705aed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:35.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.638+0000 7f981cd64b80 1 --2- 172.21.15.111:0/2637650082 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x5642170641d0 0x56421705aed0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x56421705b750 tx=0x7f9800027000).stop 2024-04-25T02:20:35.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.638+0000 7f981cd64b80 1 -- 172.21.15.111:0/2637650082 shutdown_connections 2024-04-25T02:20:35.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.638+0000 7f981cd64b80 1 --2- 172.21.15.111:0/2637650082 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x564217069590 0x564217068030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.638+0000 7f97e07f8700 0 client.4484 ms_handle_reset on v1:172.21.15.111:6818/2165982859 2024-04-25T02:20:35.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.638+0000 7f981cd64b80 1 --2- 172.21.15.111:0/2637650082 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x5642170641d0 0x56421705aed0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.638+0000 7f981cd64b80 1 --2- 172.21.15.111:0/2637650082 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x5642170645b0 0x564217067b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.638+0000 7f981cd64b80 1 -- 172.21.15.111:0/2637650082 >> 172.21.15.111:0/2637650082 conn(0x564217003970 msgr2=0x564216f58cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:35.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.638+0000 7f981cd64b80 1 -- 172.21.15.111:0/2637650082 shutdown_connections 2024-04-25T02:20:35.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.638+0000 7f981cd64b80 1 -- 172.21.15.111:0/2637650082 wait complete. 2024-04-25T02:20:35.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.638+0000 7f981cd64b80 20 client.4484 trim_cache size 0 max 16384 2024-04-25T02:20:35.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.654+0000 7f981cd64b80 1 Processor -- start 2024-04-25T02:20:35.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.654+0000 7f981cd64b80 1 -- start start 2024-04-25T02:20:35.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.655+0000 7f981cd64b80 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x5642170641d0 0x564217058f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:35.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.655+0000 7f981cd64b80 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5642170645b0 0x564217064990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:35.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.655+0000 7f981cd64b80 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x564217069590 0x564216f58cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:35.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.655+0000 7f981cd64b80 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x564216f54600 con 0x5642170645b0 2024-04-25T02:20:35.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.655+0000 7f981cd64b80 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x56421705bdc0 con 0x5642170641d0 2024-04-25T02:20:35.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.655+0000 7f981cd64b80 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x564217036d90 con 0x564217069590 2024-04-25T02:20:35.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.655+0000 7f9809079700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x5642170641d0 0x564217058f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:35.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.655+0000 7f9808878700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5642170645b0 0x564217064990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:35.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.655+0000 7f9809079700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x5642170641d0 0x564217058f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:51684/0 (socket says 172.21.15.111:51684) 2024-04-25T02:20:35.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.655+0000 7f9809079700 1 -- 172.21.15.111:0/1103235104 learned_addr learned my addr 172.21.15.111:0/1103235104 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:35.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.655+0000 7f980987a700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x564217069590 0x564216f58cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:35.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.655+0000 7f9809079700 1 -- 172.21.15.111:0/1103235104 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x564217069590 msgr2=0x564216f58cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:35.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.655+0000 7f9809079700 1 --2- 172.21.15.111:0/1103235104 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x564217069590 0x564216f58cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.655+0000 7f9809079700 1 -- 172.21.15.111:0/1103235104 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5642170645b0 msgr2=0x564217064990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:35.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.655+0000 7f9809079700 1 --2- 172.21.15.111:0/1103235104 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5642170645b0 0x564217064990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.655+0000 7f9809079700 1 -- 172.21.15.111:0/1103235104 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x564216f7eae0 con 0x5642170641d0 2024-04-25T02:20:35.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.655+0000 7f9808878700 1 --2- 172.21.15.111:0/1103235104 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5642170645b0 0x564217064990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:35.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.655+0000 7f980987a700 1 --2- 172.21.15.111:0/1103235104 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x564217069590 0x564216f58cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:35.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.655+0000 7f9809079700 1 --2- 172.21.15.111:0/1103235104 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x5642170641d0 0x564217058f80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x56421705bfc0 tx=0x7f9800034040).ready entity=mon.1 client_cookie=5d379d8267aeb570 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:35.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.655+0000 7f97e27fc700 1 -- 172.21.15.111:0/1103235104 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9800022040 con 0x5642170641d0 2024-04-25T02:20:35.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.655+0000 7f97e27fc700 1 -- 172.21.15.111:0/1103235104 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9800005420 con 0x5642170641d0 2024-04-25T02:20:35.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.655+0000 7f97e27fc700 1 -- 172.21.15.111:0/1103235104 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9800031af0 con 0x5642170641d0 2024-04-25T02:20:35.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.656+0000 7f981cd64b80 1 -- 172.21.15.111:0/1103235104 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x5642170641d0 msgr2=0x564217058f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:35.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.656+0000 7f981cd64b80 1 --2- 172.21.15.111:0/1103235104 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x5642170641d0 0x564217058f80 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x56421705bfc0 tx=0x7f9800034040).stop 2024-04-25T02:20:35.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.656+0000 7f981cd64b80 1 -- 172.21.15.111:0/1103235104 shutdown_connections 2024-04-25T02:20:35.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.656+0000 7f981cd64b80 1 --2- 172.21.15.111:0/1103235104 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x564217069590 0x564216f58cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.656+0000 7f981cd64b80 1 --2- 172.21.15.111:0/1103235104 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x5642170641d0 0x564217058f80 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.656+0000 7f981cd64b80 1 --2- 172.21.15.111:0/1103235104 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5642170645b0 0x564217064990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.656+0000 7f981cd64b80 1 -- 172.21.15.111:0/1103235104 >> 172.21.15.111:0/1103235104 conn(0x564217003970 msgr2=0x564217063aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:35.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.656+0000 7f981cd64b80 1 -- 172.21.15.111:0/1103235104 shutdown_connections 2024-04-25T02:20:35.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.656+0000 7f981cd64b80 1 -- 172.21.15.111:0/1103235104 wait complete. 2024-04-25T02:20:35.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.656+0000 7f981cd64b80 1 -- start start 2024-04-25T02:20:35.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.656+0000 7f981cd64b80 1 Processor -- start 2024-04-25T02:20:35.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.657+0000 7f981cd64b80 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x5642170641d0 0x564217072ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:35.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.657+0000 7f981cd64b80 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5642170645b0 0x564217056fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:35.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.657+0000 7f981cd64b80 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x564217069590 0x5642170574d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:35.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.657+0000 7f981cd64b80 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x564216f59270 con 0x5642170645b0 2024-04-25T02:20:35.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.657+0000 7f981cd64b80 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x564217072270 con 0x564217069590 2024-04-25T02:20:35.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.657+0000 7f981cd64b80 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x56421705b3b0 con 0x5642170641d0 2024-04-25T02:20:35.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.657+0000 7f981cd64b80 10 client.0 ll_register_callbacks cb 0x56421705d250 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:20:35.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.657+0000 7f9809079700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x5642170641d0 0x564217072ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:35.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.657+0000 7f9809079700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x5642170641d0 0x564217072ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:57440/0 (socket says 172.21.15.111:57440) 2024-04-25T02:20:35.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.657+0000 7f9809079700 1 -- 172.21.15.111:0/986093719 learned_addr learned my addr 172.21.15.111:0/986093719 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:35.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.657+0000 7f980987a700 1 --2- 172.21.15.111:0/986093719 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x564217069590 0x5642170574d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:35.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.657+0000 7f9808878700 1 --2- 172.21.15.111:0/986093719 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5642170645b0 0x564217056fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:35.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.657+0000 7f9809079700 1 -- 172.21.15.111:0/986093719 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x564217069590 msgr2=0x5642170574d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:35.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.657+0000 7f9809079700 1 --2- 172.21.15.111:0/986093719 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x564217069590 0x5642170574d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.657+0000 7f9809079700 1 -- 172.21.15.111:0/986093719 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5642170645b0 msgr2=0x564217056fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:35.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.657+0000 7f9809079700 1 --2- 172.21.15.111:0/986093719 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5642170645b0 0x564217056fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.657+0000 7f9809079700 1 -- 172.21.15.111:0/986093719 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97f4017680 con 0x5642170641d0 2024-04-25T02:20:35.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.657+0000 7f9809079700 1 --2- 172.21.15.111:0/986093719 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x5642170641d0 0x564217072ed0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x56421705bfc0 tx=0x7f980003d070).ready entity=mon.2 client_cookie=b31a0ce39a22e92a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:35.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.657+0000 7f97e17fa700 10 client.0 ms_handle_connect on v2:172.21.15.111:3302/0 2024-04-25T02:20:35.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.658+0000 7f97e17fa700 1 -- 172.21.15.111:0/986093719 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9800032710 con 0x5642170641d0 2024-04-25T02:20:35.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.658+0000 7f97e17fa700 1 -- 172.21.15.111:0/986093719 <== mon.2 v2:172.21.15.111:3302/0 2 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f980002e2e0 con 0x5642170641d0 2024-04-25T02:20:35.667 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.658+0000 7f981cd64b80 1 -- 172.21.15.111:0/986093719 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f98000324e0 con 0x5642170641d0 2024-04-25T02:20:35.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.658+0000 7f97e17fa700 1 -- 172.21.15.111:0/986093719 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7f980002e4a0 con 0x5642170641d0 2024-04-25T02:20:35.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.658+0000 7f981cd64b80 10 client.4490 fetch_fsmap learned FSMap version 8 2024-04-25T02:20:35.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.658+0000 7f981cd64b80 1 -- 172.21.15.111:0/986093719 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x7f98040a2860 con 0x5642170641d0 2024-04-25T02:20:35.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.658+0000 7f97e17fa700 1 -- 172.21.15.111:0/986093719 <== mon.2 v2:172.21.15.111:3302/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9800048070 con 0x5642170641d0 2024-04-25T02:20:35.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.658+0000 7f97e17fa700 1 -- 172.21.15.111:0/986093719 <== mon.2 v2:172.21.15.111:3302/0 5 ==== fsmap(e 8) v1 ==== 1341+0+0 (secure 0 0 0) 0x7f9800039070 con 0x5642170641d0 2024-04-25T02:20:35.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.658+0000 7f981cd64b80 10 client.4490 fetch_fsmap finished waiting for FSMap version 8 2024-04-25T02:20:35.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.658+0000 7f981cd64b80 10 client.4490 resolve_mds: resolved ID 'c' to GID 4236 2024-04-25T02:20:35.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.658+0000 7f981cd64b80 20 client.4490 populate_metadata read hostname 'smithi111' 2024-04-25T02:20:35.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.658+0000 7f981cd64b80 4 client.4490 mds_command: new command op to 4236 tid=0[{"prefix": "status"}] 2024-04-25T02:20:35.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.658+0000 7f981cd64b80 1 -- 172.21.15.111:0/986093719 --> v1:172.21.15.111:6818/2165982859 -- command(tid 0: {"prefix": "status"}) v1 -- 0x564216f7d570 con 0x5642170733c0 2024-04-25T02:20:35.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.658+0000 7f97e17fa700 10 client.4490 ms_handle_connect on v1:172.21.15.111:6818/2165982859 2024-04-25T02:20:35.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.658+0000 7f97e17fa700 1 -- 172.21.15.111:0/986093719 <== mds.1 v1:172.21.15.111:6818/2165982859 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+305 (unknown 0 0 3314478129) 0x564216f7d570 con 0x5642170733c0 2024-04-25T02:20:35.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.658+0000 7f97e17fa700 10 client.4490 handle_command_reply: tid=0 2024-04-25T02:20:35.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.658+0000 7f981cd64b80 1 client.4490 shutdown 2024-04-25T02:20:35.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.658+0000 7f981cd64b80 1 -- 172.21.15.111:0/986093719 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x5642170641d0 msgr2=0x564217072ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:35.668 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.658+0000 7f981cd64b80 1 --2- 172.21.15.111:0/986093719 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x5642170641d0 0x564217072ed0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x56421705bfc0 tx=0x7f980003d070).stop 2024-04-25T02:20:35.669 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.659+0000 7f981cd64b80 1 -- 172.21.15.111:0/986093719 shutdown_connections 2024-04-25T02:20:35.669 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.659+0000 7f981cd64b80 1 --2- 172.21.15.111:0/986093719 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x564217069590 0x5642170574d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.669 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.659+0000 7f981cd64b80 1 --2- 172.21.15.111:0/986093719 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x5642170641d0 0x564217072ed0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.669 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.659+0000 7f981cd64b80 1 --2- 172.21.15.111:0/986093719 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x5642170645b0 0x564217056fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.669 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.659+0000 7f97e17fa700 0 client.4490 ms_handle_reset on v1:172.21.15.111:6818/2165982859 2024-04-25T02:20:35.669 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.659+0000 7f981cd64b80 1 -- 172.21.15.111:0/986093719 >> 172.21.15.111:0/986093719 conn(0x564217003970 msgr2=0x564217064990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:35.669 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.659+0000 7f981cd64b80 1 -- 172.21.15.111:0/986093719 shutdown_connections 2024-04-25T02:20:35.669 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.659+0000 7f981cd64b80 1 -- 172.21.15.111:0/986093719 wait complete. 2024-04-25T02:20:35.669 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.659+0000 7f981cd64b80 20 client.4490 trim_cache size 0 max 16384 2024-04-25T02:20:35.669 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-25T02:20:35.669 INFO:teuthology.orchestra.run.smithi111.stdout: "cluster_fsid": "4643f974-f93a-4436-93b8-460ff320e62e", 2024-04-25T02:20:35.669 INFO:teuthology.orchestra.run.smithi111.stdout: "whoami": 1, 2024-04-25T02:20:35.670 INFO:teuthology.orchestra.run.smithi111.stdout: "id": 4236, 2024-04-25T02:20:35.670 INFO:teuthology.orchestra.run.smithi111.stdout: "want_state": "up:active", 2024-04-25T02:20:35.670 INFO:teuthology.orchestra.run.smithi111.stdout: "state": "up:active", 2024-04-25T02:20:35.670 INFO:teuthology.orchestra.run.smithi111.stdout: "rank_uptime": 9.4247113710000008, 2024-04-25T02:20:35.670 INFO:teuthology.orchestra.run.smithi111.stdout: "mdsmap_epoch": 8, 2024-04-25T02:20:35.670 INFO:teuthology.orchestra.run.smithi111.stdout: "osdmap_epoch": 18, 2024-04-25T02:20:35.670 INFO:teuthology.orchestra.run.smithi111.stdout: "osdmap_epoch_barrier": 18, 2024-04-25T02:20:35.670 INFO:teuthology.orchestra.run.smithi111.stdout: "uptime": 20.068108157000001 2024-04-25T02:20:35.670 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-25T02:20:35.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.659+0000 7f980b2dd700 1 -- 172.21.15.111:0/4164610432 >> v1:172.21.15.111:6816/39585 conn(0x7f97e4038da0 legacy=0x7f97e403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:35.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.659+0000 7f980b2dd700 1 -- 172.21.15.111:0/4164610432 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f98041363c0 msgr2=0x7f9804092350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:35.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.659+0000 7f980b2dd700 1 --2- 172.21.15.111:0/4164610432 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f98041363c0 0x7f9804092350 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f9800000bc0 tx=0x7f9800007a60).stop 2024-04-25T02:20:35.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.659+0000 7f980b2dd700 1 -- 172.21.15.111:0/4164610432 shutdown_connections 2024-04-25T02:20:35.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.659+0000 7f980b2dd700 1 --2- 172.21.15.111:0/4164610432 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f980413ba00 0x7f9804064c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.659+0000 7f980b2dd700 1 --2- 172.21.15.111:0/4164610432 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f98041363c0 0x7f9804092350 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.659+0000 7f980b2dd700 1 --2- 172.21.15.111:0/4164610432 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9804136eb0 0x7f9804066570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.659+0000 7f980b2dd700 1 -- 172.21.15.111:0/4164610432 >> 172.21.15.111:0/4164610432 conn(0x7f98040a8a00 msgr2=0x7f9804135c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:35.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.659+0000 7f980b2dd700 1 -- 172.21.15.111:0/4164610432 shutdown_connections 2024-04-25T02:20:35.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.659+0000 7f980b2dd700 1 -- 172.21.15.111:0/4164610432 wait complete. 2024-04-25T02:20:35.673 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-25T02:20:35.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.773+0000 7ff2987ba700 1 Processor -- start 2024-04-25T02:20:35.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.773+0000 7ff2987ba700 1 -- start start 2024-04-25T02:20:35.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.774+0000 7ff2987ba700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff290061a60 0x7ff290060e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:35.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.774+0000 7ff2987ba700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7ff29013a050 0x7ff290140950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:35.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.774+0000 7ff2987ba700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2901395b0 con 0x7ff290139c70 2024-04-25T02:20:35.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.774+0000 7ff2987ba700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff290061610 con 0x7ff29013a050 2024-04-25T02:20:35.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.774+0000 7ff2987ba700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff29009c860 con 0x7ff290061a60 2024-04-25T02:20:35.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.774+0000 7ff295d55700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff290061a60 0x7ff290060e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:35.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.774+0000 7ff296d57700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7ff29013a050 0x7ff290140950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:35.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.774+0000 7ff295d55700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff290061a60 0x7ff290060e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:57442/0 (socket says 172.21.15.111:57442) 2024-04-25T02:20:35.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.774+0000 7ff296556700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7ff290139c70 0x7ff29009c010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:55930/0 (socket says 172.21.15.111:55930) 2024-04-25T02:20:35.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.774+0000 7ff296d57700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7ff29013a050 0x7ff290140950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48624/0 (socket says 172.21.15.111:48624) 2024-04-25T02:20:35.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.774+0000 7ff295d55700 1 -- 172.21.15.111:0/1989487817 learned_addr learned my addr 172.21.15.111:0/1989487817 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:35.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.774+0000 7ff295554700 1 -- 172.21.15.111:0/1989487817 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2514913022 0 0) 0x7ff2901395b0 con 0x7ff290139c70 2024-04-25T02:20:35.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.774+0000 7ff295d55700 1 -- 172.21.15.111:0/1989487817 >> v2:172.21.15.111:3300/0 conn(0x7ff29013a050 msgr2=0x7ff290140950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:35.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.774+0000 7ff295d55700 1 --2- 172.21.15.111:0/1989487817 >> v2:172.21.15.111:3300/0 conn(0x7ff29013a050 0x7ff290140950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.774+0000 7ff295d55700 1 -- 172.21.15.111:0/1989487817 >> v1:172.21.15.111:6789/0 conn(0x7ff290139c70 legacy=0x7ff29009c010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:35.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.774+0000 7ff295d55700 1 -- 172.21.15.111:0/1989487817 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff29013a4e0 con 0x7ff290061a60 2024-04-25T02:20:35.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.774+0000 7ff296d57700 1 --2- 172.21.15.111:0/1989487817 >> v2:172.21.15.111:3300/0 conn(0x7ff29013a050 0x7ff290140950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:35.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.774+0000 7ff295d55700 1 --2- 172.21.15.111:0/1989487817 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff290061a60 0x7ff290060e70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7ff290061750 tx=0x7ff28c006eb0).ready entity=mon.2 client_cookie=e6a6709757bd8f5f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:35.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.774+0000 7ff295554700 1 -- 172.21.15.111:0/1989487817 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff28c00d5c0 con 0x7ff290061a60 2024-04-25T02:20:35.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.774+0000 7ff295554700 1 -- 172.21.15.111:0/1989487817 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff28c000e90 con 0x7ff290061a60 2024-04-25T02:20:35.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.774+0000 7ff295554700 1 -- 172.21.15.111:0/1989487817 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff28c00d910 con 0x7ff290061a60 2024-04-25T02:20:35.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.775+0000 7ff2987ba700 1 -- 172.21.15.111:0/1989487817 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff290061a60 msgr2=0x7ff290060e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:35.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.775+0000 7ff2987ba700 1 --2- 172.21.15.111:0/1989487817 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff290061a60 0x7ff290060e70 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7ff290061750 tx=0x7ff28c006eb0).stop 2024-04-25T02:20:35.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.775+0000 7ff2987ba700 1 -- 172.21.15.111:0/1989487817 shutdown_connections 2024-04-25T02:20:35.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.775+0000 7ff2987ba700 1 --2- 172.21.15.111:0/1989487817 >> v2:172.21.15.111:3300/0 conn(0x7ff29013a050 0x7ff290140950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.775+0000 7ff2987ba700 1 --2- 172.21.15.111:0/1989487817 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff290061a60 0x7ff290060e70 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.775+0000 7ff2987ba700 1 -- 172.21.15.111:0/1989487817 >> 172.21.15.111:0/1989487817 conn(0x7ff29005d070 msgr2=0x7ff2900625e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:35.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.775+0000 7ff2987ba700 1 -- 172.21.15.111:0/1989487817 shutdown_connections 2024-04-25T02:20:35.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.775+0000 7ff2987ba700 1 -- 172.21.15.111:0/1989487817 wait complete. 2024-04-25T02:20:35.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.776+0000 7ff2987ba700 1 Processor -- start 2024-04-25T02:20:35.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.776+0000 7ff2987ba700 1 -- start start 2024-04-25T02:20:35.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.776+0000 7ff2987ba700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff290061a60 0x7ff2900948b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:35.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.776+0000 7ff2987ba700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff290139c70 0x7ff290148dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:35.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.776+0000 7ff2987ba700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff29013a050 0x7ff2901492b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:35.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.776+0000 7ff2987ba700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff290094da0 con 0x7ff290139c70 2024-04-25T02:20:35.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.776+0000 7ff2987ba700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff290096a80 con 0x7ff290061a60 2024-04-25T02:20:35.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.776+0000 7ff2987ba700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff290092150 con 0x7ff29013a050 2024-04-25T02:20:35.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.776+0000 7ff295d55700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff290139c70 0x7ff290148dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:35.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.776+0000 7ff295d55700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff290139c70 0x7ff290148dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48630/0 (socket says 172.21.15.111:48630) 2024-04-25T02:20:35.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.776+0000 7ff296d57700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff29013a050 0x7ff2901492b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:35.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.776+0000 7ff295d55700 1 -- 172.21.15.111:0/1504446167 learned_addr learned my addr 172.21.15.111:0/1504446167 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:35.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.776+0000 7ff296556700 1 --2- 172.21.15.111:0/1504446167 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff290061a60 0x7ff2900948b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:35.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.777+0000 7ff296d57700 1 -- 172.21.15.111:0/1504446167 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff290061a60 msgr2=0x7ff2900948b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:35.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.777+0000 7ff296d57700 1 --2- 172.21.15.111:0/1504446167 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff290061a60 0x7ff2900948b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.777+0000 7ff296d57700 1 -- 172.21.15.111:0/1504446167 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff290139c70 msgr2=0x7ff290148dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:35.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.777+0000 7ff296d57700 1 --2- 172.21.15.111:0/1504446167 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff290139c70 0x7ff290148dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.777+0000 7ff296d57700 1 -- 172.21.15.111:0/1504446167 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff288009470 con 0x7ff29013a050 2024-04-25T02:20:35.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.777+0000 7ff295d55700 1 --2- 172.21.15.111:0/1504446167 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff290139c70 0x7ff290148dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:35.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.777+0000 7ff296d57700 1 --2- 172.21.15.111:0/1504446167 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff29013a050 0x7ff2901492b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7ff28800c000 tx=0x7ff2880091d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:35.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.777+0000 7ff27f7fe700 1 -- 172.21.15.111:0/1504446167 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff28800c610 con 0x7ff29013a050 2024-04-25T02:20:35.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.777+0000 7ff27f7fe700 1 -- 172.21.15.111:0/1504446167 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff28800c770 con 0x7ff29013a050 2024-04-25T02:20:35.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.777+0000 7ff2987ba700 1 -- 172.21.15.111:0/1504446167 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff28c00b1e0 con 0x7ff29013a050 2024-04-25T02:20:35.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.777+0000 7ff27f7fe700 1 -- 172.21.15.111:0/1504446167 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff28800cad0 con 0x7ff29013a050 2024-04-25T02:20:35.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.777+0000 7ff2987ba700 1 -- 172.21.15.111:0/1504446167 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff290094fe0 con 0x7ff29013a050 2024-04-25T02:20:35.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.778+0000 7ff27f7fe700 1 -- 172.21.15.111:0/1504446167 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7ff288022070 con 0x7ff29013a050 2024-04-25T02:20:35.792 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.778+0000 7ff27f7fe700 1 -- 172.21.15.111:0/1504446167 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7ff28804aed0 con 0x7ff29013a050 2024-04-25T02:20:35.792 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.781+0000 7ff2aa241b80 1 Processor -- start 2024-04-25T02:20:35.792 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.781+0000 7ff2aa241b80 1 -- start start 2024-04-25T02:20:35.792 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.782+0000 7ff2aa241b80 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55921f97b1d0 0x55921f96ea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:35.792 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.782+0000 7ff2aa241b80 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x55921f97b5b0 0x55921f97b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:35.792 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.782+0000 7ff2aa241b80 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55921f980590 0x55921f980a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:35.792 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.782+0000 7ff2aa241b80 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55921f91ca10 con 0x55921f97b1d0 2024-04-25T02:20:35.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.782+0000 7ff2aa241b80 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x55921f8c1e10 con 0x55921f980590 2024-04-25T02:20:35.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.782+0000 7ff2aa241b80 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x55921f8928b0 con 0x55921f97b5b0 2024-04-25T02:20:35.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.782+0000 7ff295d55700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x55921f97b5b0 0x55921f97b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:35.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.782+0000 7ff296556700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55921f97b1d0 0x55921f96ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:35.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.782+0000 7ff295d55700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x55921f97b5b0 0x55921f97b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:57462/0 (socket says 172.21.15.111:57462) 2024-04-25T02:20:35.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.782+0000 7ff296d57700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55921f980590 0x55921f980a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:35.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.782+0000 7ff295d55700 1 -- 172.21.15.111:0/3480438524 learned_addr learned my addr 172.21.15.111:0/3480438524 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:35.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.782+0000 7ff296556700 1 -- 172.21.15.111:0/3480438524 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x55921f97b5b0 msgr2=0x55921f97b9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:35.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.782+0000 7ff296556700 1 --2- 172.21.15.111:0/3480438524 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x55921f97b5b0 0x55921f97b9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.782+0000 7ff296556700 1 -- 172.21.15.111:0/3480438524 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55921f980590 msgr2=0x55921f980a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:35.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.782+0000 7ff296556700 1 --2- 172.21.15.111:0/3480438524 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55921f980590 0x55921f980a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.782+0000 7ff296556700 1 -- 172.21.15.111:0/3480438524 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55921f928e20 con 0x55921f97b1d0 2024-04-25T02:20:35.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.782+0000 7ff295d55700 1 --2- 172.21.15.111:0/3480438524 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x55921f97b5b0 0x55921f97b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:35.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.782+0000 7ff296d57700 1 --2- 172.21.15.111:0/3480438524 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55921f980590 0x55921f980a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:35.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.782+0000 7ff296556700 1 --2- 172.21.15.111:0/3480438524 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55921f97b1d0 0x55921f96ea60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7ff280000bc0 tx=0x7ff2800079e0).ready entity=mon.0 client_cookie=c454da42ac3a7899 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:35.794 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.782+0000 7ff2987ba700 1 -- 172.21.15.111:0/3480438524 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff2800071b0 con 0x55921f97b1d0 2024-04-25T02:20:35.794 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.782+0000 7ff2987ba700 1 -- 172.21.15.111:0/3480438524 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff280007310 con 0x55921f97b1d0 2024-04-25T02:20:35.794 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.782+0000 7ff2987ba700 1 -- 172.21.15.111:0/3480438524 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff280011ca0 con 0x55921f97b1d0 2024-04-25T02:20:35.794 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.783+0000 7ff2aa241b80 1 -- 172.21.15.111:0/3480438524 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55921f97b1d0 msgr2=0x55921f96ea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:35.794 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.783+0000 7ff2aa241b80 1 --2- 172.21.15.111:0/3480438524 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55921f97b1d0 0x55921f96ea60 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7ff280000bc0 tx=0x7ff2800079e0).stop 2024-04-25T02:20:35.794 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.783+0000 7ff2aa241b80 1 -- 172.21.15.111:0/3480438524 shutdown_connections 2024-04-25T02:20:35.794 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.783+0000 7ff2aa241b80 1 --2- 172.21.15.111:0/3480438524 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55921f980590 0x55921f980a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.794 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.783+0000 7ff2aa241b80 1 --2- 172.21.15.111:0/3480438524 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55921f97b1d0 0x55921f96ea60 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.794 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.783+0000 7ff2aa241b80 1 --2- 172.21.15.111:0/3480438524 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x55921f97b5b0 0x55921f97b9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.794 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.783+0000 7ff2aa241b80 1 -- 172.21.15.111:0/3480438524 >> 172.21.15.111:0/3480438524 conn(0x55921f91a970 msgr2=0x55921f874690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:35.794 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.783+0000 7ff2aa241b80 1 -- 172.21.15.111:0/3480438524 shutdown_connections 2024-04-25T02:20:35.794 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.783+0000 7ff2aa241b80 1 -- 172.21.15.111:0/3480438524 wait complete. 2024-04-25T02:20:35.795 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.783+0000 7ff2aa241b80 1 -- start start 2024-04-25T02:20:35.795 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.784+0000 7ff2aa241b80 1 Processor -- start 2024-04-25T02:20:35.795 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.784+0000 7ff2aa241b80 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55921f97b1d0 0x55921f986190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:35.795 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.784+0000 7ff2aa241b80 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55921f97b5b0 0x55921f97f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:35.795 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.784+0000 7ff2aa241b80 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x55921f980590 0x55921f989720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:35.795 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.784+0000 7ff2aa241b80 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55921f8a6180 con 0x55921f97b5b0 2024-04-25T02:20:35.795 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.784+0000 7ff2aa241b80 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x55921f8867f0 con 0x55921f97b1d0 2024-04-25T02:20:35.795 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.784+0000 7ff2aa241b80 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x55921f876710 con 0x55921f980590 2024-04-25T02:20:35.795 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.784+0000 7ff2aa241b80 10 client.0 ll_register_callbacks cb 0x55921f89b570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:20:35.795 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.784+0000 7ff296556700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55921f97b1d0 0x55921f986190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:35.795 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.784+0000 7ff295d55700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55921f97b5b0 0x55921f97f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:35.795 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.784+0000 7ff296556700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55921f97b1d0 0x55921f986190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:51706/0 (socket says 172.21.15.111:51706) 2024-04-25T02:20:35.795 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.784+0000 7ff296556700 1 -- 172.21.15.111:0/1564552166 learned_addr learned my addr 172.21.15.111:0/1564552166 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:35.795 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.784+0000 7ff296d57700 1 --2- 172.21.15.111:0/1564552166 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x55921f980590 0x55921f989720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:35.795 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.784+0000 7ff295d55700 1 -- 172.21.15.111:0/1564552166 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x55921f980590 msgr2=0x55921f989720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:35.796 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.784+0000 7ff295d55700 1 --2- 172.21.15.111:0/1564552166 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x55921f980590 0x55921f989720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.796 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.785+0000 7ff295d55700 1 -- 172.21.15.111:0/1564552166 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55921f97b1d0 msgr2=0x55921f986190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:35.796 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.785+0000 7ff295d55700 1 --2- 172.21.15.111:0/1564552166 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55921f97b1d0 0x55921f986190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.796 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.785+0000 7ff295d55700 1 -- 172.21.15.111:0/1564552166 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff29013a4e0 con 0x55921f97b5b0 2024-04-25T02:20:35.796 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.785+0000 7ff296556700 1 --2- 172.21.15.111:0/1564552166 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55921f97b1d0 0x55921f986190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:35.796 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.785+0000 7ff296d57700 1 --2- 172.21.15.111:0/1564552166 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x55921f980590 0x55921f989720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:35.796 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.785+0000 7ff295d55700 1 --2- 172.21.15.111:0/1564552166 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55921f97b5b0 0x55921f97f660 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7ff28c016000 tx=0x7ff28c015000).ready entity=mon.0 client_cookie=8ef35fa65c4e37ce server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:35.796 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.785+0000 7ff26d7fa700 10 client.0 ms_handle_connect on v2:172.21.15.111:3300/0 2024-04-25T02:20:35.796 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.785+0000 7ff26d7fa700 1 -- 172.21.15.111:0/1564552166 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff28c024070 con 0x55921f97b5b0 2024-04-25T02:20:35.796 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.785+0000 7ff26d7fa700 1 -- 172.21.15.111:0/1564552166 <== mon.0 v2:172.21.15.111:3300/0 2 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7ff28c00d970 con 0x55921f97b5b0 2024-04-25T02:20:35.796 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.785+0000 7ff2aa241b80 1 -- 172.21.15.111:0/1564552166 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55921f81d0c0 con 0x55921f97b5b0 2024-04-25T02:20:35.796 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.785+0000 7ff26d7fa700 1 -- 172.21.15.111:0/1564552166 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff28c01f650 con 0x55921f97b5b0 2024-04-25T02:20:35.796 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.785+0000 7ff2aa241b80 10 client.4644 fetch_fsmap learned FSMap version 8 2024-04-25T02:20:35.796 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.785+0000 7ff2aa241b80 1 -- 172.21.15.111:0/1564552166 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x7ff290094fe0 con 0x55921f97b5b0 2024-04-25T02:20:35.796 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.785+0000 7ff26d7fa700 1 -- 172.21.15.111:0/1564552166 <== mon.0 v2:172.21.15.111:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff28c02d070 con 0x55921f97b5b0 2024-04-25T02:20:35.796 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.785+0000 7ff26d7fa700 1 -- 172.21.15.111:0/1564552166 <== mon.0 v2:172.21.15.111:3300/0 5 ==== fsmap(e 8) v1 ==== 1341+0+0 (secure 0 0 0) 0x7ff28c027020 con 0x55921f97b5b0 2024-04-25T02:20:35.797 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.785+0000 7ff2aa241b80 10 client.4644 fetch_fsmap finished waiting for FSMap version 8 2024-04-25T02:20:35.797 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.785+0000 7ff2aa241b80 10 client.4644 resolve_mds: resolved ID 'b' to GID 4239 2024-04-25T02:20:35.797 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.785+0000 7ff2aa241b80 20 client.4644 populate_metadata read hostname 'smithi111' 2024-04-25T02:20:35.797 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.785+0000 7ff2aa241b80 4 client.4644 mds_command: new command op to 4239 tid=0[{"prefix": "get_command_descriptions"}] 2024-04-25T02:20:35.797 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.785+0000 7ff2aa241b80 1 -- 172.21.15.111:0/1564552166 --> v1:172.21.15.111:6819/4003866251 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55921f89c230 con 0x55921f9721d0 2024-04-25T02:20:35.797 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.785+0000 7ff26d7fa700 10 client.4644 ms_handle_connect on v1:172.21.15.111:6819/4003866251 2024-04-25T02:20:35.797 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.786+0000 7ff26d7fa700 1 -- 172.21.15.111:0/1564552166 <== mds.0 v1:172.21.15.111:6819/4003866251 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (unknown 0 0 4003121674) 0x55921f89c230 con 0x55921f9721d0 2024-04-25T02:20:35.797 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.786+0000 7ff26d7fa700 10 client.4644 handle_command_reply: tid=0 2024-04-25T02:20:35.797 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.786+0000 7ff2aa241b80 1 client.4644 shutdown 2024-04-25T02:20:35.797 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.786+0000 7ff2aa241b80 1 -- 172.21.15.111:0/1564552166 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55921f97b5b0 msgr2=0x55921f97f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:35.797 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.786+0000 7ff2aa241b80 1 --2- 172.21.15.111:0/1564552166 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55921f97b5b0 0x55921f97f660 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7ff28c016000 tx=0x7ff28c015000).stop 2024-04-25T02:20:35.797 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.786+0000 7ff2aa241b80 1 -- 172.21.15.111:0/1564552166 shutdown_connections 2024-04-25T02:20:35.797 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.786+0000 7ff2aa241b80 1 --2- 172.21.15.111:0/1564552166 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x55921f980590 0x55921f989720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.797 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.786+0000 7ff2aa241b80 1 --2- 172.21.15.111:0/1564552166 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55921f97b1d0 0x55921f986190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.797 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.786+0000 7ff26d7fa700 0 client.4644 ms_handle_reset on v1:172.21.15.111:6819/4003866251 2024-04-25T02:20:35.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.786+0000 7ff2aa241b80 1 --2- 172.21.15.111:0/1564552166 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55921f97b5b0 0x55921f97f660 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.786+0000 7ff2aa241b80 1 -- 172.21.15.111:0/1564552166 >> 172.21.15.111:0/1564552166 conn(0x55921f91a970 msgr2=0x55921f96e710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:35.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.786+0000 7ff2aa241b80 1 -- 172.21.15.111:0/1564552166 shutdown_connections 2024-04-25T02:20:35.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.786+0000 7ff2aa241b80 1 -- 172.21.15.111:0/1564552166 wait complete. 2024-04-25T02:20:35.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.786+0000 7ff2aa241b80 20 client.4644 trim_cache size 0 max 16384 2024-04-25T02:20:35.806 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.802+0000 7ff2aa241b80 1 Processor -- start 2024-04-25T02:20:35.806 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.802+0000 7ff2aa241b80 1 -- start start 2024-04-25T02:20:35.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.803+0000 7ff2aa241b80 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x55921f97b1d0 0x55921f98a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:35.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.803+0000 7ff2aa241b80 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55921f97b5b0 0x55921f96e6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:35.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.803+0000 7ff2aa241b80 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55921f980590 0x55921f97f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:35.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.803+0000 7ff2aa241b80 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55921f94e790 con 0x55921f980590 2024-04-25T02:20:35.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.803+0000 7ff2aa241b80 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x55921f96f710 con 0x55921f97b5b0 2024-04-25T02:20:35.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.803+0000 7ff2aa241b80 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x55921f96f930 con 0x55921f97b1d0 2024-04-25T02:20:35.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.803+0000 7ff296556700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x55921f97b1d0 0x55921f98a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:35.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.803+0000 7ff296d57700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55921f980590 0x55921f97f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:35.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.803+0000 7ff295d55700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55921f97b5b0 0x55921f96e6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:35.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.803+0000 7ff296556700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x55921f97b1d0 0x55921f98a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:57484/0 (socket says 172.21.15.111:57484) 2024-04-25T02:20:35.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.803+0000 7ff296d57700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55921f980590 0x55921f97f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48658/0 (socket says 172.21.15.111:48658) 2024-04-25T02:20:35.813 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.803+0000 7ff296556700 1 -- 172.21.15.111:0/2608228721 learned_addr learned my addr 172.21.15.111:0/2608228721 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:35.813 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.803+0000 7ff295d55700 1 -- 172.21.15.111:0/2608228721 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x55921f97b1d0 msgr2=0x55921f98a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:35.813 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.803+0000 7ff295d55700 1 --2- 172.21.15.111:0/2608228721 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x55921f97b1d0 0x55921f98a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.813 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.803+0000 7ff295d55700 1 -- 172.21.15.111:0/2608228721 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55921f980590 msgr2=0x55921f97f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:35.813 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.803+0000 7ff295d55700 1 --2- 172.21.15.111:0/2608228721 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55921f980590 0x55921f97f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.813 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.803+0000 7ff295d55700 1 -- 172.21.15.111:0/2608228721 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55921f86b600 con 0x55921f97b5b0 2024-04-25T02:20:35.813 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.803+0000 7ff296d57700 1 --2- 172.21.15.111:0/2608228721 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55921f980590 0x55921f97f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:35.813 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.803+0000 7ff296556700 1 --2- 172.21.15.111:0/2608228721 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x55921f97b1d0 0x55921f98a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:35.813 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.803+0000 7ff295d55700 1 --2- 172.21.15.111:0/2608228721 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55921f97b5b0 0x55921f96e6f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x55921f875080 tx=0x7ff28c024000).ready entity=mon.1 client_cookie=62e26578ef5fac01 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:35.813 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.803+0000 7ff26f7fe700 1 -- 172.21.15.111:0/2608228721 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff28c01e470 con 0x55921f97b5b0 2024-04-25T02:20:35.813 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.803+0000 7ff26f7fe700 1 -- 172.21.15.111:0/2608228721 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff28c02d040 con 0x55921f97b5b0 2024-04-25T02:20:35.813 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.803+0000 7ff26f7fe700 1 -- 172.21.15.111:0/2608228721 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff28c01e7c0 con 0x55921f97b5b0 2024-04-25T02:20:35.813 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.804+0000 7ff2aa241b80 1 -- 172.21.15.111:0/2608228721 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55921f97b5b0 msgr2=0x55921f96e6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:35.814 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.804+0000 7ff2aa241b80 1 --2- 172.21.15.111:0/2608228721 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55921f97b5b0 0x55921f96e6f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x55921f875080 tx=0x7ff28c024000).stop 2024-04-25T02:20:35.814 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.804+0000 7ff2aa241b80 1 -- 172.21.15.111:0/2608228721 shutdown_connections 2024-04-25T02:20:35.814 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.804+0000 7ff2aa241b80 1 --2- 172.21.15.111:0/2608228721 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55921f980590 0x55921f97f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.814 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.804+0000 7ff2aa241b80 1 --2- 172.21.15.111:0/2608228721 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x55921f97b1d0 0x55921f98a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.814 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.804+0000 7ff2aa241b80 1 --2- 172.21.15.111:0/2608228721 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55921f97b5b0 0x55921f96e6f0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.814 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.804+0000 7ff2aa241b80 1 -- 172.21.15.111:0/2608228721 >> 172.21.15.111:0/2608228721 conn(0x55921f91a970 msgr2=0x55921f97aaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:35.814 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.804+0000 7ff2aa241b80 1 -- 172.21.15.111:0/2608228721 shutdown_connections 2024-04-25T02:20:35.814 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.804+0000 7ff2aa241b80 1 -- 172.21.15.111:0/2608228721 wait complete. 2024-04-25T02:20:35.814 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.804+0000 7ff2aa241b80 1 -- start start 2024-04-25T02:20:35.814 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.804+0000 7ff2aa241b80 1 Processor -- start 2024-04-25T02:20:35.814 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.805+0000 7ff2aa241b80 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55921f97b1d0 0x55921f86fcc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:35.814 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.805+0000 7ff2aa241b80 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55921f97b5b0 0x55921f9dbd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:35.814 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.805+0000 7ff2aa241b80 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x55921f980590 0x55921f9dc280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:35.814 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.805+0000 7ff2aa241b80 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55921f997b20 con 0x55921f97b5b0 2024-04-25T02:20:35.815 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.805+0000 7ff2aa241b80 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x55921f9970d0 con 0x55921f97b1d0 2024-04-25T02:20:35.815 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.805+0000 7ff2aa241b80 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x55921f998080 con 0x55921f980590 2024-04-25T02:20:35.815 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.805+0000 7ff2aa241b80 10 client.0 ll_register_callbacks cb 0x55921f986ac0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:20:35.815 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.805+0000 7ff296556700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55921f97b1d0 0x55921f86fcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:35.815 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.805+0000 7ff296d57700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x55921f980590 0x55921f9dc280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:35.815 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.805+0000 7ff296556700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55921f97b1d0 0x55921f86fcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:51724/0 (socket says 172.21.15.111:51724) 2024-04-25T02:20:35.815 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.805+0000 7ff296556700 1 -- 172.21.15.111:0/1241962350 learned_addr learned my addr 172.21.15.111:0/1241962350 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:35.815 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.805+0000 7ff295d55700 1 --2- 172.21.15.111:0/1241962350 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55921f97b5b0 0x55921f9dbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:35.815 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.805+0000 7ff296556700 1 -- 172.21.15.111:0/1241962350 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x55921f980590 msgr2=0x55921f9dc280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:35.815 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.805+0000 7ff296556700 1 --2- 172.21.15.111:0/1241962350 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x55921f980590 0x55921f9dc280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.815 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.805+0000 7ff296556700 1 -- 172.21.15.111:0/1241962350 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55921f97b5b0 msgr2=0x55921f9dbd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:35.815 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.805+0000 7ff296556700 1 --2- 172.21.15.111:0/1241962350 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55921f97b5b0 0x55921f9dbd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.815 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.805+0000 7ff296556700 1 -- 172.21.15.111:0/1241962350 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff28c00b1e0 con 0x55921f97b1d0 2024-04-25T02:20:35.815 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.805+0000 7ff296556700 1 --2- 172.21.15.111:0/1241962350 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55921f97b1d0 0x55921f86fcc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x55921f8705d0 tx=0x7ff280019000).ready entity=mon.1 client_cookie=e2f18b01b3f7addb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:35.816 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.805+0000 7ff26e7fc700 10 client.0 ms_handle_connect on v2:172.21.15.111:3301/0 2024-04-25T02:20:35.816 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.806+0000 7ff26e7fc700 1 -- 172.21.15.111:0/1241962350 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7ff280011e90 con 0x55921f97b1d0 2024-04-25T02:20:35.816 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.806+0000 7ff26e7fc700 1 -- 172.21.15.111:0/1241962350 <== mon.1 v2:172.21.15.111:3301/0 2 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7ff2800240b0 con 0x55921f97b1d0 2024-04-25T02:20:35.816 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.806+0000 7ff2aa241b80 1 -- 172.21.15.111:0/1241962350 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff280007310 con 0x55921f97b1d0 2024-04-25T02:20:35.816 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.806+0000 7ff26e7fc700 1 -- 172.21.15.111:0/1241962350 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_get_version_reply(handle=1 version=8) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff280024800 con 0x55921f97b1d0 2024-04-25T02:20:35.816 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.806+0000 7ff2aa241b80 10 client.4498 fetch_fsmap learned FSMap version 8 2024-04-25T02:20:35.816 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.806+0000 7ff2aa241b80 1 -- 172.21.15.111:0/1241962350 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,fsmap=8,monmap=2+}) v3 -- 0x7ff290094fe0 con 0x55921f97b1d0 2024-04-25T02:20:35.816 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.806+0000 7ff26e7fc700 1 -- 172.21.15.111:0/1241962350 <== mon.1 v2:172.21.15.111:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff280007310 con 0x55921f97b1d0 2024-04-25T02:20:35.816 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.806+0000 7ff26e7fc700 1 -- 172.21.15.111:0/1241962350 <== mon.1 v2:172.21.15.111:3301/0 5 ==== fsmap(e 8) v1 ==== 1341+0+0 (secure 0 0 0) 0x7ff28001f040 con 0x55921f97b1d0 2024-04-25T02:20:35.816 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.806+0000 7ff2aa241b80 10 client.4498 fetch_fsmap finished waiting for FSMap version 8 2024-04-25T02:20:35.816 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.806+0000 7ff2aa241b80 10 client.4498 resolve_mds: resolved ID 'b' to GID 4239 2024-04-25T02:20:35.816 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.806+0000 7ff2aa241b80 20 client.4498 populate_metadata read hostname 'smithi111' 2024-04-25T02:20:35.816 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.806+0000 7ff2aa241b80 4 client.4498 mds_command: new command op to 4239 tid=0[{"prefix": "status"}] 2024-04-25T02:20:35.816 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.806+0000 7ff2aa241b80 1 -- 172.21.15.111:0/1241962350 --> v1:172.21.15.111:6819/4003866251 -- command(tid 0: {"prefix": "status"}) v1 -- 0x55921f894570 con 0x55921f9dc770 2024-04-25T02:20:35.816 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.806+0000 7ff26e7fc700 10 client.4498 ms_handle_connect on v1:172.21.15.111:6819/4003866251 2024-04-25T02:20:35.817 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.806+0000 7ff26e7fc700 1 -- 172.21.15.111:0/1241962350 <== mds.0 v1:172.21.15.111:6819/4003866251 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+293 (unknown 0 0 3152451668) 0x55921f894570 con 0x55921f9dc770 2024-04-25T02:20:35.817 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.806+0000 7ff26e7fc700 10 client.4498 handle_command_reply: tid=0 2024-04-25T02:20:35.817 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.806+0000 7ff2aa241b80 1 client.4498 shutdown 2024-04-25T02:20:35.817 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.807+0000 7ff2aa241b80 1 -- 172.21.15.111:0/1241962350 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55921f97b1d0 msgr2=0x55921f86fcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:35.817 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.807+0000 7ff2aa241b80 1 --2- 172.21.15.111:0/1241962350 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55921f97b1d0 0x55921f86fcc0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x55921f8705d0 tx=0x7ff280019000).stop 2024-04-25T02:20:35.817 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.807+0000 7ff2aa241b80 1 -- 172.21.15.111:0/1241962350 shutdown_connections 2024-04-25T02:20:35.817 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.807+0000 7ff2aa241b80 1 --2- 172.21.15.111:0/1241962350 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x55921f980590 0x55921f9dc280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.817 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.807+0000 7ff26e7fc700 0 client.4498 ms_handle_reset on v1:172.21.15.111:6819/4003866251 2024-04-25T02:20:35.817 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.807+0000 7ff2aa241b80 1 --2- 172.21.15.111:0/1241962350 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55921f97b1d0 0x55921f86fcc0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.817 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.807+0000 7ff2aa241b80 1 --2- 172.21.15.111:0/1241962350 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55921f97b5b0 0x55921f9dbd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.817 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.807+0000 7ff2aa241b80 1 -- 172.21.15.111:0/1241962350 >> 172.21.15.111:0/1241962350 conn(0x55921f91a970 msgr2=0x55921f98a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:35.817 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.807+0000 7ff2aa241b80 1 -- 172.21.15.111:0/1241962350 shutdown_connections 2024-04-25T02:20:35.817 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.807+0000 7ff2aa241b80 1 -- 172.21.15.111:0/1241962350 wait complete. 2024-04-25T02:20:35.817 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.807+0000 7ff2aa241b80 20 client.4498 trim_cache size 0 max 16384 2024-04-25T02:20:35.818 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-25T02:20:35.818 INFO:teuthology.orchestra.run.smithi111.stdout: "cluster_fsid": "4643f974-f93a-4436-93b8-460ff320e62e", 2024-04-25T02:20:35.818 INFO:teuthology.orchestra.run.smithi111.stdout: "whoami": 0, 2024-04-25T02:20:35.818 INFO:teuthology.orchestra.run.smithi111.stdout: "id": 4239, 2024-04-25T02:20:35.818 INFO:teuthology.orchestra.run.smithi111.stdout: "want_state": "up:active", 2024-04-25T02:20:35.818 INFO:teuthology.orchestra.run.smithi111.stdout: "state": "up:active", 2024-04-25T02:20:35.818 INFO:teuthology.orchestra.run.smithi111.stdout: "rank_uptime": 11.656013341, 2024-04-25T02:20:35.818 INFO:teuthology.orchestra.run.smithi111.stdout: "mdsmap_epoch": 8, 2024-04-25T02:20:35.818 INFO:teuthology.orchestra.run.smithi111.stdout: "osdmap_epoch": 18, 2024-04-25T02:20:35.818 INFO:teuthology.orchestra.run.smithi111.stdout: "osdmap_epoch_barrier": 18, 2024-04-25T02:20:35.819 INFO:teuthology.orchestra.run.smithi111.stdout: "uptime": 20.215622731 2024-04-25T02:20:35.819 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-25T02:20:35.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.807+0000 7ff2987ba700 1 -- 172.21.15.111:0/1504446167 >> v1:172.21.15.111:6816/39585 conn(0x7ff270038da0 legacy=0x7ff27003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:35.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.807+0000 7ff2987ba700 1 -- 172.21.15.111:0/1504446167 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff29013a050 msgr2=0x7ff2901492b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:35.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.807+0000 7ff2987ba700 1 --2- 172.21.15.111:0/1504446167 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff29013a050 0x7ff2901492b0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7ff28800c000 tx=0x7ff2880091d0).stop 2024-04-25T02:20:35.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.807+0000 7ff2987ba700 1 -- 172.21.15.111:0/1504446167 shutdown_connections 2024-04-25T02:20:35.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.807+0000 7ff2987ba700 1 --2- 172.21.15.111:0/1504446167 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff29013a050 0x7ff2901492b0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.807+0000 7ff2987ba700 1 --2- 172.21.15.111:0/1504446167 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff290061a60 0x7ff2900948b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.807+0000 7ff2987ba700 1 --2- 172.21.15.111:0/1504446167 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff290139c70 0x7ff290148dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.807+0000 7ff2987ba700 1 -- 172.21.15.111:0/1504446167 >> 172.21.15.111:0/1504446167 conn(0x7ff29005d070 msgr2=0x7ff29006c8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:35.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.807+0000 7ff2987ba700 1 -- 172.21.15.111:0/1504446167 shutdown_connections 2024-04-25T02:20:35.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.807+0000 7ff2987ba700 1 -- 172.21.15.111:0/1504446167 wait complete. 2024-04-25T02:20:35.822 INFO:teuthology.run_tasks:Running task exec... 2024-04-25T02:20:35.831 INFO:teuthology.task.exec:Executing custom commands... 2024-04-25T02:20:35.831 INFO:teuthology.task.exec:Running commands on role osd.0 host ubuntu@smithi111.front.sepia.ceph.com 2024-04-25T02:20:35.831 DEBUG:teuthology.orchestra.run.smithi111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd set-require-min-compat-client octopus' 2024-04-25T02:20:35.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.928+0000 7f79e1feb700 1 Processor -- start 2024-04-25T02:20:35.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.928+0000 7f79e1feb700 1 -- start start 2024-04-25T02:20:35.935 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.929+0000 7f79e1feb700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f79dc135650 0x7f79dc0a4750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:35.935 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.929+0000 7f79e1feb700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f79dc135a30 0x7f79dc067090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:35.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.929+0000 7f79e1feb700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f79dc135e90 0x7f79dc0a3370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:35.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.929+0000 7f79e1feb700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79dc065a80 con 0x7f79dc135a30 2024-04-25T02:20:35.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.929+0000 7f79e1feb700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc065d40 con 0x7f79dc135650 2024-04-25T02:20:35.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.929+0000 7f79e1feb700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc060550 con 0x7f79dc135e90 2024-04-25T02:20:35.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.929+0000 7f79daffd700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f79dc135a30 0x7f79dc067090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:35.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.929+0000 7f79dbfff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f79dc135e90 0x7f79dc0a3370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:35.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.929+0000 7f79db7fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f79dc135650 0x7f79dc0a4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:35.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.929+0000 7f79daffd700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f79dc135a30 0x7f79dc067090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48668/0 (socket says 172.21.15.111:48668) 2024-04-25T02:20:35.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.929+0000 7f79dbfff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f79dc135e90 0x7f79dc0a3370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:57514/0 (socket says 172.21.15.111:57514) 2024-04-25T02:20:35.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.929+0000 7f79daffd700 1 -- 172.21.15.111:0/3300580307 learned_addr learned my addr 172.21.15.111:0/3300580307 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:35.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.930+0000 7f79db7fe700 1 -- 172.21.15.111:0/3300580307 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f79dc135e90 msgr2=0x7f79dc0a3370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:35.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.930+0000 7f79db7fe700 1 --2- 172.21.15.111:0/3300580307 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f79dc135e90 0x7f79dc0a3370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.930+0000 7f79db7fe700 1 -- 172.21.15.111:0/3300580307 >> v2:172.21.15.111:3300/0 conn(0x7f79dc135a30 msgr2=0x7f79dc067090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:35.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.930+0000 7f79db7fe700 1 --2- 172.21.15.111:0/3300580307 >> v2:172.21.15.111:3300/0 conn(0x7f79dc135a30 0x7f79dc067090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.930+0000 7f79db7fe700 1 -- 172.21.15.111:0/3300580307 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79dc09faa0 con 0x7f79dc135650 2024-04-25T02:20:35.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.930+0000 7f79daffd700 1 --2- 172.21.15.111:0/3300580307 >> v2:172.21.15.111:3300/0 conn(0x7f79dc135a30 0x7f79dc067090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:35.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.930+0000 7f79db7fe700 1 --2- 172.21.15.111:0/3300580307 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f79dc135650 0x7f79dc0a4750 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f79d0002f70 tx=0x7f79d0006df0).ready entity=mon.1 client_cookie=eba5adc8e5d5daf4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:35.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.930+0000 7f79da7fc700 1 -- 172.21.15.111:0/3300580307 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79d000d4a0 con 0x7f79dc135650 2024-04-25T02:20:35.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.930+0000 7f79da7fc700 1 -- 172.21.15.111:0/3300580307 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d0000e90 con 0x7f79dc135650 2024-04-25T02:20:35.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.930+0000 7f79da7fc700 1 -- 172.21.15.111:0/3300580307 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79d000d7f0 con 0x7f79dc135650 2024-04-25T02:20:35.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.930+0000 7f79e1feb700 1 -- 172.21.15.111:0/3300580307 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f79dc135650 msgr2=0x7f79dc0a4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:35.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.930+0000 7f79e1feb700 1 --2- 172.21.15.111:0/3300580307 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f79dc135650 0x7f79dc0a4750 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f79d0002f70 tx=0x7f79d0006df0).stop 2024-04-25T02:20:35.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.930+0000 7f79e1feb700 1 -- 172.21.15.111:0/3300580307 shutdown_connections 2024-04-25T02:20:35.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.930+0000 7f79e1feb700 1 --2- 172.21.15.111:0/3300580307 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f79dc135e90 0x7f79dc0a3370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.930+0000 7f79e1feb700 1 --2- 172.21.15.111:0/3300580307 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f79dc135650 0x7f79dc0a4750 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.930+0000 7f79e1feb700 1 --2- 172.21.15.111:0/3300580307 >> v2:172.21.15.111:3300/0 conn(0x7f79dc135a30 0x7f79dc067090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.930+0000 7f79e1feb700 1 -- 172.21.15.111:0/3300580307 >> 172.21.15.111:0/3300580307 conn(0x7f79dc05c5a0 msgr2=0x7f79dc0a89d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:35.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.930+0000 7f79e1feb700 1 -- 172.21.15.111:0/3300580307 shutdown_connections 2024-04-25T02:20:35.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.930+0000 7f79e1feb700 1 -- 172.21.15.111:0/3300580307 wait complete. 2024-04-25T02:20:35.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.931+0000 7f79e1feb700 1 Processor -- start 2024-04-25T02:20:35.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.931+0000 7f79e1feb700 1 -- start start 2024-04-25T02:20:35.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.932+0000 7f79e1feb700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f79dc135650 0x7f79dc0a2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:35.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.932+0000 7f79e1feb700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f79dc135a30 0x7f79dc149250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:35.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.932+0000 7f79e1feb700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79dc135e90 0x7f79dc149740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:35.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.932+0000 7f79e1feb700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc0a1a30 con 0x7f79dc135e90 2024-04-25T02:20:35.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.932+0000 7f79e1feb700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc148ed0 con 0x7f79dc135a30 2024-04-25T02:20:35.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.932+0000 7f79e1feb700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79dc0a2b10 con 0x7f79dc135650 2024-04-25T02:20:35.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.932+0000 7f79dbfff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79dc135e90 0x7f79dc149740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:35.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.932+0000 7f79db7fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f79dc135650 0x7f79dc0a2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:35.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.932+0000 7f79daffd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f79dc135a30 0x7f79dc149250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:35.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.932+0000 7f79dbfff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79dc135e90 0x7f79dc149740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48676/0 (socket says 172.21.15.111:48676) 2024-04-25T02:20:35.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.932+0000 7f79dbfff700 1 -- 172.21.15.111:0/2698257601 learned_addr learned my addr 172.21.15.111:0/2698257601 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:35.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.932+0000 7f79db7fe700 1 -- 172.21.15.111:0/2698257601 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f79dc135a30 msgr2=0x7f79dc149250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:35.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.932+0000 7f79db7fe700 1 --2- 172.21.15.111:0/2698257601 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f79dc135a30 0x7f79dc149250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.932+0000 7f79db7fe700 1 -- 172.21.15.111:0/2698257601 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79dc135e90 msgr2=0x7f79dc149740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:35.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.932+0000 7f79db7fe700 1 --2- 172.21.15.111:0/2698257601 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79dc135e90 0x7f79dc149740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:35.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.932+0000 7f79db7fe700 1 -- 172.21.15.111:0/2698257601 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79cc00b1e0 con 0x7f79dc135650 2024-04-25T02:20:35.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.932+0000 7f79daffd700 1 --2- 172.21.15.111:0/2698257601 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f79dc135a30 0x7f79dc149250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:35.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.932+0000 7f79dbfff700 1 --2- 172.21.15.111:0/2698257601 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79dc135e90 0x7f79dc149740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:35.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.933+0000 7f79db7fe700 1 --2- 172.21.15.111:0/2698257601 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f79dc135650 0x7f79dc0a2290 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f79dc0a18f0 tx=0x7f79d0014000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:35.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.933+0000 7f79d8ff9700 1 -- 172.21.15.111:0/2698257601 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79d0012930 con 0x7f79dc135650 2024-04-25T02:20:35.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.933+0000 7f79d8ff9700 1 -- 172.21.15.111:0/2698257601 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79d0012a90 con 0x7f79dc135650 2024-04-25T02:20:35.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.933+0000 7f79e1feb700 1 -- 172.21.15.111:0/2698257601 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79d000b180 con 0x7f79dc135650 2024-04-25T02:20:35.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.933+0000 7f79d8ff9700 1 -- 172.21.15.111:0/2698257601 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f79d0012df0 con 0x7f79dc135650 2024-04-25T02:20:35.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.933+0000 7f79e1feb700 1 -- 172.21.15.111:0/2698257601 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79dc0a81c0 con 0x7f79dc135650 2024-04-25T02:20:35.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.934+0000 7f79d8ff9700 1 -- 172.21.15.111:0/2698257601 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f79d001c070 con 0x7f79dc135650 2024-04-25T02:20:35.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.934+0000 7f79d8ff9700 1 -- 172.21.15.111:0/2698257601 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f79d004b3c0 con 0x7f79dc135650 2024-04-25T02:20:35.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.934+0000 7f79e1feb700 1 -- 172.21.15.111:0/2698257601 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79dc149df0 con 0x7f79dc135650 2024-04-25T02:20:35.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:35.937+0000 7f79d8ff9700 1 -- 172.21.15.111:0/2698257601 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f79dc149df0 con 0x7f79dc135650 2024-04-25T02:20:36.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.056+0000 7f79e1feb700 1 -- 172.21.15.111:0/2698257601 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "osd set-require-min-compat-client", "version": "octopus"} v 0) v1 -- 0x7f79dc149df0 con 0x7f79dc135650 2024-04-25T02:20:36.266 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.262+0000 7f79d8ff9700 1 -- 172.21.15.111:0/2698257601 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "osd set-require-min-compat-client", "version": "octopus"}]=0 set require_min_compat_client to octopus v19) v1 ==== 143+0+0 (secure 0 0 0) 0x7f79dc149df0 con 0x7f79dc135650 2024-04-25T02:20:36.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.264+0000 7f79e1feb700 1 -- 172.21.15.111:0/2698257601 >> v1:172.21.15.111:6816/39585 conn(0x7f79bc038da0 legacy=0x7f79bc03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:36.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.264+0000 7f79e1feb700 1 -- 172.21.15.111:0/2698257601 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f79dc135650 msgr2=0x7f79dc0a2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:36.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.264+0000 7f79e1feb700 1 --2- 172.21.15.111:0/2698257601 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f79dc135650 0x7f79dc0a2290 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f79dc0a18f0 tx=0x7f79d0014000).stop 2024-04-25T02:20:36.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.264+0000 7f79e1feb700 1 -- 172.21.15.111:0/2698257601 shutdown_connections 2024-04-25T02:20:36.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.264+0000 7f79e1feb700 1 --2- 172.21.15.111:0/2698257601 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79dc135e90 0x7f79dc149740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:36.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.264+0000 7f79e1feb700 1 --2- 172.21.15.111:0/2698257601 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f79dc135650 0x7f79dc0a2290 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:36.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.264+0000 7f79e1feb700 1 --2- 172.21.15.111:0/2698257601 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f79dc135a30 0x7f79dc149250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:36.269 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.264+0000 7f79e1feb700 1 -- 172.21.15.111:0/2698257601 >> 172.21.15.111:0/2698257601 conn(0x7f79dc05c5a0 msgr2=0x7f79dc134b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:36.269 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.264+0000 7f79e1feb700 1 -- 172.21.15.111:0/2698257601 shutdown_connections 2024-04-25T02:20:36.269 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.264+0000 7f79e1feb700 1 -- 172.21.15.111:0/2698257601 wait complete. 2024-04-25T02:20:36.269 INFO:teuthology.orchestra.run.smithi111.stderr:set require_min_compat_client to octopus 2024-04-25T02:20:36.279 INFO:teuthology.run_tasks:Running task print... 2024-04-25T02:20:36.288 INFO:teuthology.task.print:**** done ceph 2024-04-25T02:20:36.288 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-25T02:20:36.312 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-25T02:20:36.312 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-04-25T02:20:36.313 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-25T02:20:36.313 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T02:20:36.313 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T02:20:36.313 INFO:tasks.ceph_fuse:client.1 config is {} 2024-04-25T02:20:36.313 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-25T02:20:36.313 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-25T02:20:36.313 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:20:36.313 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-04-25T02:20:36.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:20:36.338 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link delete ceph-brx 2024-04-25T02:20:36.413 INFO:teuthology.orchestra.run.smithi114.stderr:Cannot find device "ceph-brx" 2024-04-25T02:20:36.414 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:20:36.414 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:20:36.414 DEBUG:teuthology.orchestra.run.smithi186:> ip netns list 2024-04-25T02:20:36.438 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:20:36.439 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip link delete ceph-brx 2024-04-25T02:20:36.515 INFO:teuthology.orchestra.run.smithi186.stderr:Cannot find device "ceph-brx" 2024-04-25T02:20:36.516 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:20:36.516 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-25T02:20:36.517 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T02:20:36.620 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.616+0000 7f4600779700 1 Processor -- start 2024-04-25T02:20:36.620 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.616+0000 7f4600779700 1 -- start start 2024-04-25T02:20:36.626 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.617+0000 7f4600779700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f45f8137a10 0x7f45f8137df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:36.626 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.617+0000 7f4600779700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f45f8064380 0x7f45f80a98b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:36.626 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.617+0000 7f4600779700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45f81382e0 con 0x7f45f80a9da0 2024-04-25T02:20:36.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.617+0000 7f4600779700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f81373c0 con 0x7f45f8137a10 2024-04-25T02:20:36.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.617+0000 7f4600779700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45f8064b60 con 0x7f45f8064380 2024-04-25T02:20:36.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.617+0000 7f45fe515700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f45f8137a10 0x7f45f8137df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:36.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.617+0000 7f45fdd14700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f45f8064380 0x7f45f80a98b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:36.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.617+0000 7f45fe515700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f45f8137a10 0x7f45f8137df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:51744/0 (socket says 172.21.15.111:51744) 2024-04-25T02:20:36.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.617+0000 7f45fdd14700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f45f8064380 0x7f45f80a98b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:57532/0 (socket says 172.21.15.111:57532) 2024-04-25T02:20:36.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.617+0000 7f45fe515700 1 -- 172.21.15.111:0/1007192367 learned_addr learned my addr 172.21.15.111:0/1007192367 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:36.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.617+0000 7f45fe515700 1 -- 172.21.15.111:0/1007192367 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f45f8064380 msgr2=0x7f45f80a98b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:36.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.617+0000 7f45fe515700 1 --2- 172.21.15.111:0/1007192367 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f45f8064380 0x7f45f80a98b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:36.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.617+0000 7f45fe515700 1 -- 172.21.15.111:0/1007192367 >> v1:172.21.15.111:6789/0 conn(0x7f45f80a9da0 legacy=0x7f45f805ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:36.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.617+0000 7f45fd513700 1 -- 172.21.15.111:0/1007192367 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1902033711 0 0) 0x7f45f81382e0 con 0x7f45f80a9da0 2024-04-25T02:20:36.628 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.617+0000 7f45fe515700 1 -- 172.21.15.111:0/1007192367 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f81375e0 con 0x7f45f8137a10 2024-04-25T02:20:36.628 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.617+0000 7f45fdd14700 1 --2- 172.21.15.111:0/1007192367 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f45f8064380 0x7f45f80a98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:36.628 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.618+0000 7f45fe515700 1 --2- 172.21.15.111:0/1007192367 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f45f8137a10 0x7f45f8137df0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f45f8133e50 tx=0x7f45e8006eb0).ready entity=mon.1 client_cookie=b81186f72d24740b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:36.628 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.618+0000 7f45fd513700 1 -- 172.21.15.111:0/1007192367 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45e800d570 con 0x7f45f8137a10 2024-04-25T02:20:36.628 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.618+0000 7f45fd513700 1 -- 172.21.15.111:0/1007192367 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45e8000e90 con 0x7f45f8137a10 2024-04-25T02:20:36.628 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.618+0000 7f45fd513700 1 -- 172.21.15.111:0/1007192367 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45e800d8c0 con 0x7f45f8137a10 2024-04-25T02:20:36.628 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.618+0000 7f4600779700 1 -- 172.21.15.111:0/1007192367 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f45f8137a10 msgr2=0x7f45f8137df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:36.628 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.618+0000 7f4600779700 1 --2- 172.21.15.111:0/1007192367 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f45f8137a10 0x7f45f8137df0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f45f8133e50 tx=0x7f45e8006eb0).stop 2024-04-25T02:20:36.628 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.618+0000 7f4600779700 1 -- 172.21.15.111:0/1007192367 shutdown_connections 2024-04-25T02:20:36.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.618+0000 7f4600779700 1 --2- 172.21.15.111:0/1007192367 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f45f8137a10 0x7f45f8137df0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:36.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.618+0000 7f4600779700 1 --2- 172.21.15.111:0/1007192367 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f45f8064380 0x7f45f80a98b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:36.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.618+0000 7f4600779700 1 -- 172.21.15.111:0/1007192367 >> 172.21.15.111:0/1007192367 conn(0x7f45f80614e0 msgr2=0x7f45f806c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:36.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.618+0000 7f4600779700 1 -- 172.21.15.111:0/1007192367 shutdown_connections 2024-04-25T02:20:36.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.618+0000 7f4600779700 1 -- 172.21.15.111:0/1007192367 wait complete. 2024-04-25T02:20:36.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.619+0000 7f4600779700 1 Processor -- start 2024-04-25T02:20:36.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.619+0000 7f4600779700 1 -- start start 2024-04-25T02:20:36.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.620+0000 7f4600779700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f45f8064380 0x7f45f8135830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:36.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.620+0000 7f4600779700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f45f80a9da0 0x7f45f8148f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:36.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.620+0000 7f4600779700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f45f8137a10 0x7f45f81493f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:36.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.620+0000 7f4600779700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45f8132e50 con 0x7f45f8137a10 2024-04-25T02:20:36.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.620+0000 7f4600779700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45f8133110 con 0x7f45f8064380 2024-04-25T02:20:36.629 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.620+0000 7f4600779700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f45f8063cb0 con 0x7f45f80a9da0 2024-04-25T02:20:36.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.620+0000 7f45fe515700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f45f8064380 0x7f45f8135830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:36.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.620+0000 7f45fdd14700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f45f80a9da0 0x7f45f8148f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:36.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.620+0000 7f45fdd14700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f45f80a9da0 0x7f45f8148f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:57546/0 (socket says 172.21.15.111:57546) 2024-04-25T02:20:36.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.620+0000 7f45fed16700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f45f8137a10 0x7f45f81493f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:36.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.620+0000 7f45fdd14700 1 -- 172.21.15.111:0/1005457229 learned_addr learned my addr 172.21.15.111:0/1005457229 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:36.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.620+0000 7f45fe515700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f45f8064380 0x7f45f8135830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:51754/0 (socket says 172.21.15.111:51754) 2024-04-25T02:20:36.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.620+0000 7f45fdd14700 1 -- 172.21.15.111:0/1005457229 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f45f8064380 msgr2=0x7f45f8135830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:36.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.620+0000 7f45fdd14700 1 --2- 172.21.15.111:0/1005457229 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f45f8064380 0x7f45f8135830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:36.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.620+0000 7f45fdd14700 1 -- 172.21.15.111:0/1005457229 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f45f8137a10 msgr2=0x7f45f81493f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:36.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.620+0000 7f45fdd14700 1 --2- 172.21.15.111:0/1005457229 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f45f8137a10 0x7f45f81493f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:36.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.620+0000 7f45fdd14700 1 -- 172.21.15.111:0/1005457229 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45f400b180 con 0x7f45f80a9da0 2024-04-25T02:20:36.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.620+0000 7f45fe515700 1 --2- 172.21.15.111:0/1005457229 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f45f8064380 0x7f45f8135830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:36.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.620+0000 7f45fdd14700 1 --2- 172.21.15.111:0/1005457229 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f45f80a9da0 0x7f45f8148f00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f45f400c000 tx=0x7f45f4006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:36.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.620+0000 7f45e77fe700 1 -- 172.21.15.111:0/1005457229 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45f400c7e0 con 0x7f45f80a9da0 2024-04-25T02:20:36.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.620+0000 7f45e77fe700 1 -- 172.21.15.111:0/1005457229 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45f400c940 con 0x7f45f80a9da0 2024-04-25T02:20:36.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.620+0000 7f4600779700 1 -- 172.21.15.111:0/1005457229 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45e800b1e0 con 0x7f45f80a9da0 2024-04-25T02:20:36.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.620+0000 7f45e77fe700 1 -- 172.21.15.111:0/1005457229 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f45f400cca0 con 0x7f45f80a9da0 2024-04-25T02:20:36.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.620+0000 7f4600779700 1 -- 172.21.15.111:0/1005457229 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45f8136e40 con 0x7f45f80a9da0 2024-04-25T02:20:36.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.621+0000 7f45e77fe700 1 -- 172.21.15.111:0/1005457229 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f45f401c460 con 0x7f45f80a9da0 2024-04-25T02:20:36.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.621+0000 7f45e77fe700 1 -- 172.21.15.111:0/1005457229 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f45f404ae00 con 0x7f45f80a9da0 2024-04-25T02:20:36.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.621+0000 7f4600779700 1 -- 172.21.15.111:0/1005457229 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45f8062940 con 0x7f45f80a9da0 2024-04-25T02:20:36.632 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.624+0000 7f45e77fe700 1 -- 172.21.15.111:0/1005457229 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f45f4033730 con 0x7f45f80a9da0 2024-04-25T02:20:36.768 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.764+0000 7f4600779700 1 -- 172.21.15.111:0/1005457229 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f45f8065870 con 0x7f45f80a9da0 2024-04-25T02:20:36.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.764+0000 7f45e77fe700 1 -- 172.21.15.111:0/1005457229 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7f45f400ce00 con 0x7f45f80a9da0 2024-04-25T02:20:36.769 INFO:teuthology.orchestra.run.smithi111.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T02:20:36.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.766+0000 7f4600779700 1 -- 172.21.15.111:0/1005457229 >> v1:172.21.15.111:6816/39585 conn(0x7f45d8038da0 legacy=0x7f45d803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:36.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.766+0000 7f4600779700 1 -- 172.21.15.111:0/1005457229 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f45f80a9da0 msgr2=0x7f45f8148f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:36.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.766+0000 7f4600779700 1 --2- 172.21.15.111:0/1005457229 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f45f80a9da0 0x7f45f8148f00 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f45f400c000 tx=0x7f45f4006df0).stop 2024-04-25T02:20:36.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.766+0000 7f4600779700 1 -- 172.21.15.111:0/1005457229 shutdown_connections 2024-04-25T02:20:36.771 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.766+0000 7f4600779700 1 --2- 172.21.15.111:0/1005457229 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f45f8137a10 0x7f45f81493f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:36.771 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.766+0000 7f4600779700 1 --2- 172.21.15.111:0/1005457229 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f45f8064380 0x7f45f8135830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:36.771 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.766+0000 7f4600779700 1 --2- 172.21.15.111:0/1005457229 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f45f80a9da0 0x7f45f8148f00 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:36.771 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.766+0000 7f4600779700 1 -- 172.21.15.111:0/1005457229 >> 172.21.15.111:0/1005457229 conn(0x7f45f80614e0 msgr2=0x7f45f80a79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:36.771 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.766+0000 7f4600779700 1 -- 172.21.15.111:0/1005457229 shutdown_connections 2024-04-25T02:20:36.771 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:36.766+0000 7f4600779700 1 -- 172.21.15.111:0/1005457229 wait complete. 2024-04-25T02:20:36.780 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T02:20:36.781 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T02:20:36.781 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2024-04-25T02:20:36.781 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T02:20:36.781 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T02:20:36.781 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T02:20:36.781 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T02:20:36.781 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T02:20:36.782 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:20:36.782 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:20:36.782 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2024-04-25T02:20:36.806 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T02:20:36.806 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T02:20:36.806 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T02:20:36.806 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:20:36.806 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2024-04-25T02:20:36.807 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:20:36.807 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:20:36.807 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:20:36.807 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2024-04-25T02:20:36.807 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:20:36.807 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:20:36.807 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2024-04-25T02:20:36.808 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:20:36.808 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:20:36.808 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T02:20:36.808 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:20:36.808 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T02:20:36.808 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 42605sec preferred_lft 42605sec 2024-04-25T02:20:36.809 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2024-04-25T02:20:36.809 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:20:36.809 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T02:20:36.809 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:20:36.809 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-04-25T02:20:36.810 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link add name ceph-brx type bridge 2024-04-25T02:20:36.810 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip addr flush dev ceph-brx 2024-04-25T02:20:36.810 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set ceph-brx up 2024-04-25T02:20:36.810 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T02:20:36.810 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-04-25T02:20:36.904 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-25T02:20:36 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:20:37.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-25T02:20:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:20:37.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:20:37.014 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T02:20:37.041 INFO:teuthology.orchestra.run.smithi114.stdout:1 2024-04-25T02:20:37.043 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:20:37.043 DEBUG:teuthology.orchestra.run.smithi114:> route 2024-04-25T02:20:37.118 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2024-04-25T02:20:37.118 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T02:20:37.118 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T02:20:37.118 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T02:20:37.118 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T02:20:37.119 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:20:37.119 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-04-25T02:20:37.119 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T02:20:37.119 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T02:20:37.119 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T02:20:37.119 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-04-25T02:20:37.208 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-25T02:20:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:20:37.417 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-25T02:20:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:20:37.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:20:37.423 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-04-25T02:20:37.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:20:37.441 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list-id 2024-04-25T02:20:37.498 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:20:37.499 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-04-25T02:20:37.499 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T02:20:37.499 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-25T02:20:37.499 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-04-25T02:20:37.588 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-25T02:20:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:20:37.626 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-25T02:20:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:20:37.630 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-25T02:20:37.630 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:20:37.630 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-04-25T02:20:37.630 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-25T02:20:37.630 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T02:20:37.631 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-25T02:20:37.631 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-25T02:20:37.631 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-25T02:20:37.631 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-04-25T02:20:37.681 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-25T02:20:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:20:37.872 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-25T02:20:37 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:20:37.878 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:20:37.878 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-04-25T02:20:37.878 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2024-04-25T02:20:37.879 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T02:20:37.879 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-04-25T02:20:37.929 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-25T02:20:37 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:20:38.008 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-25T02:20:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:20:38.013 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-25T02:20:38.013 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:20:38.013 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T02:20:38.031 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:20:38.031 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:20:38.031 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T02:20:38.087 DEBUG:teuthology.orchestra.run.smithi114:> sudo modprobe fuse 2024-04-25T02:20:38.155 DEBUG:teuthology.orchestra.run.smithi114:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T02:20:38.212 INFO:teuthology.orchestra.run.smithi114.stdout:/sys 2024-04-25T02:20:38.213 INFO:teuthology.orchestra.run.smithi114.stdout:/proc 2024-04-25T02:20:38.213 INFO:teuthology.orchestra.run.smithi114.stdout:/dev 2024-04-25T02:20:38.213 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/security 2024-04-25T02:20:38.213 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/shm 2024-04-25T02:20:38.213 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/pts 2024-04-25T02:20:38.213 INFO:teuthology.orchestra.run.smithi114.stdout:/run 2024-04-25T02:20:38.213 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup 2024-04-25T02:20:38.213 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup/systemd 2024-04-25T02:20:38.213 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/pstore 2024-04-25T02:20:38.213 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/bpf 2024-04-25T02:20:38.213 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup/freezer 2024-04-25T02:20:38.213 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup/memory 2024-04-25T02:20:38.214 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup/hugetlb 2024-04-25T02:20:38.214 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup/devices 2024-04-25T02:20:38.214 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup/cpu,cpuacct 2024-04-25T02:20:38.214 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup/pids 2024-04-25T02:20:38.214 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup/rdma 2024-04-25T02:20:38.214 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup/net_cls,net_prio 2024-04-25T02:20:38.214 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup/cpuset 2024-04-25T02:20:38.214 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup/blkio 2024-04-25T02:20:38.214 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup/perf_event 2024-04-25T02:20:38.214 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/tracing 2024-04-25T02:20:38.214 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/config 2024-04-25T02:20:38.214 INFO:teuthology.orchestra.run.smithi114.stdout:/ 2024-04-25T02:20:38.214 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/selinux 2024-04-25T02:20:38.214 INFO:teuthology.orchestra.run.smithi114.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T02:20:38.215 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/hugepages 2024-04-25T02:20:38.215 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/mqueue 2024-04-25T02:20:38.215 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/debug 2024-04-25T02:20:38.215 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/fuse/connections 2024-04-25T02:20:38.215 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T02:20:38.215 INFO:teuthology.orchestra.run.smithi114.stdout:/run/user/1000 2024-04-25T02:20:38.215 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph 2024-04-25T02:20:38.215 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns 2024-04-25T02:20:38.215 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T02:20:38.215 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T02:20:38.216 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:20:38.216 DEBUG:teuthology.orchestra.run.smithi114:> ls /sys/fs/fuse/connections 2024-04-25T02:20:38.273 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-25T02:20:38.273 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-25T02:20:38.315 DEBUG:teuthology.orchestra.run.smithi114:> sudo modprobe fuse 2024-04-25T02:20:38.341 DEBUG:teuthology.orchestra.run.smithi114:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T02:20:38.398 INFO:teuthology.orchestra.run.smithi114.stdout:/sys 2024-04-25T02:20:38.398 INFO:teuthology.orchestra.run.smithi114.stdout:/proc 2024-04-25T02:20:38.398 INFO:teuthology.orchestra.run.smithi114.stdout:/dev 2024-04-25T02:20:38.398 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/security 2024-04-25T02:20:38.398 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/shm 2024-04-25T02:20:38.398 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/pts 2024-04-25T02:20:38.398 INFO:teuthology.orchestra.run.smithi114.stdout:/run 2024-04-25T02:20:38.399 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup 2024-04-25T02:20:38.399 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup/systemd 2024-04-25T02:20:38.399 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/pstore 2024-04-25T02:20:38.399 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/bpf 2024-04-25T02:20:38.399 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup/freezer 2024-04-25T02:20:38.399 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup/memory 2024-04-25T02:20:38.399 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup/hugetlb 2024-04-25T02:20:38.399 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup/devices 2024-04-25T02:20:38.399 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup/cpu,cpuacct 2024-04-25T02:20:38.399 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup/pids 2024-04-25T02:20:38.399 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup/rdma 2024-04-25T02:20:38.399 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup/net_cls,net_prio 2024-04-25T02:20:38.399 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup/cpuset 2024-04-25T02:20:38.400 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup/blkio 2024-04-25T02:20:38.400 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup/perf_event 2024-04-25T02:20:38.400 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/tracing 2024-04-25T02:20:38.400 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/config 2024-04-25T02:20:38.400 INFO:teuthology.orchestra.run.smithi114.stdout:/ 2024-04-25T02:20:38.400 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/selinux 2024-04-25T02:20:38.400 INFO:teuthology.orchestra.run.smithi114.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T02:20:38.400 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/hugepages 2024-04-25T02:20:38.400 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/mqueue 2024-04-25T02:20:38.400 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/debug 2024-04-25T02:20:38.400 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/fuse/connections 2024-04-25T02:20:38.400 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T02:20:38.400 INFO:teuthology.orchestra.run.smithi114.stdout:/run/user/1000 2024-04-25T02:20:38.400 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph 2024-04-25T02:20:38.401 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns 2024-04-25T02:20:38.401 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T02:20:38.401 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T02:20:38.401 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:20:38.401 DEBUG:teuthology.orchestra.run.smithi114:> ls /sys/fs/fuse/connections 2024-04-25T02:20:38.437 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:2024-04-25T02:20:38.433+0000 7f01e498e200 -1 init, newargv = 0x5570b13f4030 newargc=9 2024-04-25T02:20:38.437 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:ceph-fuse[37442]: starting ceph client 2024-04-25T02:20:38.444 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:ceph-fuse[37442]: starting fuse 2024-04-25T02:20:38.454 INFO:teuthology.orchestra.run.smithi114.stdout:46 2024-04-25T02:20:38.455 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2024-04-25T02:20:38.455 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer -- python3 -c ' 2024-04-25T02:20:38.455 DEBUG:teuthology.orchestra.run.smithi114:> import glob 2024-04-25T02:20:38.455 DEBUG:teuthology.orchestra.run.smithi114:> import re 2024-04-25T02:20:38.455 DEBUG:teuthology.orchestra.run.smithi114:> import os 2024-04-25T02:20:38.455 DEBUG:teuthology.orchestra.run.smithi114:> import subprocess 2024-04-25T02:20:38.455 DEBUG:teuthology.orchestra.run.smithi114:> 2024-04-25T02:20:38.455 DEBUG:teuthology.orchestra.run.smithi114:> def _find_admin_socket(client_name): 2024-04-25T02:20:38.455 DEBUG:teuthology.orchestra.run.smithi114:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-25T02:20:38.455 DEBUG:teuthology.orchestra.run.smithi114:> files = glob.glob(asok_path) 2024-04-25T02:20:38.455 DEBUG:teuthology.orchestra.run.smithi114:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-25T02:20:38.456 DEBUG:teuthology.orchestra.run.smithi114:> 2024-04-25T02:20:38.456 DEBUG:teuthology.orchestra.run.smithi114:> # Given a non-glob path, it better be there 2024-04-25T02:20:38.456 DEBUG:teuthology.orchestra.run.smithi114:> if "*" not in asok_path: 2024-04-25T02:20:38.456 DEBUG:teuthology.orchestra.run.smithi114:> assert(len(files) == 1) 2024-04-25T02:20:38.456 DEBUG:teuthology.orchestra.run.smithi114:> return files[0] 2024-04-25T02:20:38.456 DEBUG:teuthology.orchestra.run.smithi114:> 2024-04-25T02:20:38.456 DEBUG:teuthology.orchestra.run.smithi114:> for f in files: 2024-04-25T02:20:38.456 DEBUG:teuthology.orchestra.run.smithi114:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-25T02:20:38.456 DEBUG:teuthology.orchestra.run.smithi114:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-25T02:20:38.456 DEBUG:teuthology.orchestra.run.smithi114:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-25T02:20:38.456 DEBUG:teuthology.orchestra.run.smithi114:> contents = proc_f.read() 2024-04-25T02:20:38.456 DEBUG:teuthology.orchestra.run.smithi114:> if mountpoint in contents: 2024-04-25T02:20:38.456 DEBUG:teuthology.orchestra.run.smithi114:> return f 2024-04-25T02:20:38.456 DEBUG:teuthology.orchestra.run.smithi114:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-25T02:20:38.456 DEBUG:teuthology.orchestra.run.smithi114:> 2024-04-25T02:20:38.456 DEBUG:teuthology.orchestra.run.smithi114:> print(_find_admin_socket("client.0")) 2024-04-25T02:20:38.457 DEBUG:teuthology.orchestra.run.smithi114:> ' 2024-04-25T02:20:38.577 INFO:teuthology.orchestra.run.smithi114.stdout:/var/run/ceph/ceph-client.0.37442.asok 2024-04-25T02:20:38.580 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-25T02:20:38 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:20:38.586 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.37442.asok 2024-04-25T02:20:38.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:20:38.587 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.37442.asok status 2024-04-25T02:20:38.725 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-04-25T02:20:38.725 INFO:teuthology.orchestra.run.smithi114.stdout: "metadata": { 2024-04-25T02:20:38.725 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_sha1": "8a82819d84cf884bd39c17e3236e0632ac146dc4", 2024-04-25T02:20:38.725 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_version": "ceph version 15.2.17 (8a82819d84cf884bd39c17e3236e0632ac146dc4) octopus (stable)", 2024-04-25T02:20:38.725 INFO:teuthology.orchestra.run.smithi114.stdout: "entity_id": "0", 2024-04-25T02:20:38.726 INFO:teuthology.orchestra.run.smithi114.stdout: "hostname": "smithi114", 2024-04-25T02:20:38.726 INFO:teuthology.orchestra.run.smithi114.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-25T02:20:38.726 INFO:teuthology.orchestra.run.smithi114.stdout: "pid": "37442", 2024-04-25T02:20:38.726 INFO:teuthology.orchestra.run.smithi114.stdout: "root": "/" 2024-04-25T02:20:38.726 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-25T02:20:38.726 INFO:teuthology.orchestra.run.smithi114.stdout: "dentry_count": 0, 2024-04-25T02:20:38.726 INFO:teuthology.orchestra.run.smithi114.stdout: "dentry_pinned_count": 0, 2024-04-25T02:20:38.726 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 4516, 2024-04-25T02:20:38.726 INFO:teuthology.orchestra.run.smithi114.stdout: "inst": { 2024-04-25T02:20:38.726 INFO:teuthology.orchestra.run.smithi114.stdout: "name": { 2024-04-25T02:20:38.726 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "client", 2024-04-25T02:20:38.726 INFO:teuthology.orchestra.run.smithi114.stdout: "num": 4516 2024-04-25T02:20:38.726 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-25T02:20:38.726 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": { 2024-04-25T02:20:38.727 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v1", 2024-04-25T02:20:38.727 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "172.21.15.114:0", 2024-04-25T02:20:38.727 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 1252797170 2024-04-25T02:20:38.727 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-25T02:20:38.727 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-25T02:20:38.727 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": { 2024-04-25T02:20:38.727 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v1", 2024-04-25T02:20:38.727 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "172.21.15.114:0", 2024-04-25T02:20:38.727 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 1252797170 2024-04-25T02:20:38.727 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-25T02:20:38.727 INFO:teuthology.orchestra.run.smithi114.stdout: "inst_str": "client.4516 172.21.15.114:0/1252797170", 2024-04-25T02:20:38.727 INFO:teuthology.orchestra.run.smithi114.stdout: "addr_str": "172.21.15.114:0/1252797170", 2024-04-25T02:20:38.727 INFO:teuthology.orchestra.run.smithi114.stdout: "inode_count": 1, 2024-04-25T02:20:38.727 INFO:teuthology.orchestra.run.smithi114.stdout: "mds_epoch": 8, 2024-04-25T02:20:38.728 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_epoch": 19, 2024-04-25T02:20:38.728 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_epoch_barrier": 0, 2024-04-25T02:20:38.728 INFO:teuthology.orchestra.run.smithi114.stdout: "blacklisted": false, 2024-04-25T02:20:38.728 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs" 2024-04-25T02:20:38.728 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-04-25T02:20:38.734 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T02:20:38.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.844+0000 7fdaffff8700 1 Processor -- start 2024-04-25T02:20:38.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.845+0000 7fdaffff8700 1 -- start start 2024-04-25T02:20:38.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.845+0000 7fdaffff8700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fdaf8136eb0 0x7fdaf80a1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:38.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.845+0000 7fdaffff8700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdaf813ba00 0x7fdaf813ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:38.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.845+0000 7fdaffff8700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdaf80a1c60 con 0x7fdaf81363c0 2024-04-25T02:20:38.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.845+0000 7fdaffff8700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf80a1a60 con 0x7fdaf813ba00 2024-04-25T02:20:38.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.845+0000 7fdaffff8700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf80a1540 con 0x7fdaf8136eb0 2024-04-25T02:20:38.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.845+0000 7fdafe595700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdaf813ba00 0x7fdaf813ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:38.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.845+0000 7fdafdd94700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7fdaf81363c0 0x7fdaf81367a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:55952/0 (socket says 172.21.15.111:55952) 2024-04-25T02:20:38.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.845+0000 7fdafd593700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fdaf8136eb0 0x7fdaf80a1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:38.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.845+0000 7fdafdd94700 1 -- 172.21.15.111:0/231215762 learned_addr learned my addr 172.21.15.111:0/231215762 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:20:38.856 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.846+0000 7fdafe595700 1 -- 172.21.15.111:0/231215762 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fdaf8136eb0 msgr2=0x7fdaf80a1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:38.856 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.846+0000 7fdafe595700 1 --2- 172.21.15.111:0/231215762 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fdaf8136eb0 0x7fdaf80a1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:38.856 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.846+0000 7fdafe595700 1 -- 172.21.15.111:0/231215762 >> v1:172.21.15.111:6789/0 conn(0x7fdaf81363c0 legacy=0x7fdaf81367a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:38.856 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.846+0000 7fdafcd92700 1 -- 172.21.15.111:0/231215762 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1679746765 0 0) 0x7fdaf80a1c60 con 0x7fdaf81363c0 2024-04-25T02:20:38.856 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.846+0000 7fdafe595700 1 -- 172.21.15.111:0/231215762 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf80a25a0 con 0x7fdaf813ba00 2024-04-25T02:20:38.856 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.846+0000 7fdafd593700 1 --2- 172.21.15.111:0/231215762 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fdaf8136eb0 0x7fdaf80a1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:38.856 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.846+0000 7fdafe595700 1 --2- 172.21.15.111:0/231215762 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdaf813ba00 0x7fdaf813ddf0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fdaf80a1680 tx=0x7fdaf00091d0).ready entity=mon.1 client_cookie=d9ddae42ea441855 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:38.856 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.846+0000 7fdafcd92700 1 -- 172.21.15.111:0/231215762 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdaf000b650 con 0x7fdaf813ba00 2024-04-25T02:20:38.856 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.846+0000 7fdafcd92700 1 -- 172.21.15.111:0/231215762 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf000b7b0 con 0x7fdaf813ba00 2024-04-25T02:20:38.856 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.846+0000 7fdafcd92700 1 -- 172.21.15.111:0/231215762 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdaf000b920 con 0x7fdaf813ba00 2024-04-25T02:20:38.856 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.846+0000 7fdaffff8700 1 -- 172.21.15.111:0/231215762 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdaf813ba00 msgr2=0x7fdaf813ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:38.856 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.846+0000 7fdaffff8700 1 --2- 172.21.15.111:0/231215762 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdaf813ba00 0x7fdaf813ddf0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7fdaf80a1680 tx=0x7fdaf00091d0).stop 2024-04-25T02:20:38.856 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.846+0000 7fdaffff8700 1 -- 172.21.15.111:0/231215762 shutdown_connections 2024-04-25T02:20:38.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.846+0000 7fdaffff8700 1 --2- 172.21.15.111:0/231215762 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdaf813ba00 0x7fdaf813ddf0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:38.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.846+0000 7fdaffff8700 1 --2- 172.21.15.111:0/231215762 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fdaf8136eb0 0x7fdaf80a1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:38.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.846+0000 7fdaffff8700 1 -- 172.21.15.111:0/231215762 >> 172.21.15.111:0/231215762 conn(0x7fdaf80a8a00 msgr2=0x7fdaf80a8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:38.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.847+0000 7fdaffff8700 1 -- 172.21.15.111:0/231215762 shutdown_connections 2024-04-25T02:20:38.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.847+0000 7fdaffff8700 1 -- 172.21.15.111:0/231215762 wait complete. 2024-04-25T02:20:38.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.847+0000 7fdaffff8700 1 Processor -- start 2024-04-25T02:20:38.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.847+0000 7fdaffff8700 1 -- start start 2024-04-25T02:20:38.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.848+0000 7fdaffff8700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdaf81363c0 0x7fdaf8064490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:38.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.848+0000 7fdaffff8700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fdaf8136eb0 0x7fdaf8065920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:38.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.848+0000 7fdaffff8700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdaf813ba00 0x7fdaf81321d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:38.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.848+0000 7fdaffff8700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf8064980 con 0x7fdaf81363c0 2024-04-25T02:20:38.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.848+0000 7fdaffff8700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf80630a0 con 0x7fdaf813ba00 2024-04-25T02:20:38.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.848+0000 7fdaffff8700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdaf8064f90 con 0x7fdaf8136eb0 2024-04-25T02:20:38.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.848+0000 7fdafdd94700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdaf81363c0 0x7fdaf8064490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:38.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.848+0000 7fdafd593700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fdaf8136eb0 0x7fdaf8065920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:38.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.848+0000 7fdafdd94700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdaf81363c0 0x7fdaf8064490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48688/0 (socket says 172.21.15.111:48688) 2024-04-25T02:20:38.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.848+0000 7fdafdd94700 1 -- 172.21.15.111:0/1116070734 learned_addr learned my addr 172.21.15.111:0/1116070734 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:38.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.848+0000 7fdafd593700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fdaf8136eb0 0x7fdaf8065920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:57562/0 (socket says 172.21.15.111:57562) 2024-04-25T02:20:38.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.848+0000 7fdafe595700 1 --2- 172.21.15.111:0/1116070734 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdaf813ba00 0x7fdaf81321d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:38.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.848+0000 7fdafd593700 1 -- 172.21.15.111:0/1116070734 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdaf813ba00 msgr2=0x7fdaf81321d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:38.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.848+0000 7fdafd593700 1 --2- 172.21.15.111:0/1116070734 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdaf813ba00 0x7fdaf81321d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:38.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.848+0000 7fdafd593700 1 -- 172.21.15.111:0/1116070734 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdaf81363c0 msgr2=0x7fdaf8064490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:38.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.848+0000 7fdafd593700 1 --2- 172.21.15.111:0/1116070734 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdaf81363c0 0x7fdaf8064490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:38.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.848+0000 7fdafd593700 1 -- 172.21.15.111:0/1116070734 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaf400b180 con 0x7fdaf8136eb0 2024-04-25T02:20:38.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.848+0000 7fdafdd94700 1 --2- 172.21.15.111:0/1116070734 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdaf81363c0 0x7fdaf8064490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:38.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.849+0000 7fdafd593700 1 --2- 172.21.15.111:0/1116070734 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fdaf8136eb0 0x7fdaf8065920 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fdaf8064ac0 tx=0x7fdaf4006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:38.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.849+0000 7fdae6ffd700 1 -- 172.21.15.111:0/1116070734 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdaf4010780 con 0x7fdaf8136eb0 2024-04-25T02:20:38.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.849+0000 7fdae6ffd700 1 -- 172.21.15.111:0/1116070734 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf40108e0 con 0x7fdaf8136eb0 2024-04-25T02:20:38.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.849+0000 7fdaffff8700 1 -- 172.21.15.111:0/1116070734 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdaf0009470 con 0x7fdaf8136eb0 2024-04-25T02:20:38.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.849+0000 7fdae6ffd700 1 -- 172.21.15.111:0/1116070734 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdaf4010c40 con 0x7fdaf8136eb0 2024-04-25T02:20:38.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.849+0000 7fdaffff8700 1 -- 172.21.15.111:0/1116070734 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdaf8063570 con 0x7fdaf8136eb0 2024-04-25T02:20:38.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.850+0000 7fdae6ffd700 1 -- 172.21.15.111:0/1116070734 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fdaf401c460 con 0x7fdaf8136eb0 2024-04-25T02:20:38.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.850+0000 7fdaffff8700 1 -- 172.21.15.111:0/1116070734 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdaf8065790 con 0x7fdaf8136eb0 2024-04-25T02:20:38.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.850+0000 7fdae6ffd700 1 -- 172.21.15.111:0/1116070734 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fdaf404ada0 con 0x7fdaf8136eb0 2024-04-25T02:20:38.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.853+0000 7fdae6ffd700 1 -- 172.21.15.111:0/1116070734 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fdaf4033630 con 0x7fdaf8136eb0 2024-04-25T02:20:38.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.994+0000 7fdaffff8700 1 -- 172.21.15.111:0/1116070734 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fdaf809fa30 con 0x7fdaf8136eb0 2024-04-25T02:20:38.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.994+0000 7fdae6ffd700 1 -- 172.21.15.111:0/1116070734 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v8) v1 ==== 53+0+73 (secure 0 0 0) 0x7fdaf4033220 con 0x7fdaf8136eb0 2024-04-25T02:20:38.998 INFO:teuthology.orchestra.run.smithi111.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T02:20:38.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.995+0000 7fdaffff8700 1 -- 172.21.15.111:0/1116070734 >> v1:172.21.15.111:6816/39585 conn(0x7fdad8038da0 legacy=0x7fdad803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:39.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.995+0000 7fdaffff8700 1 -- 172.21.15.111:0/1116070734 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fdaf8136eb0 msgr2=0x7fdaf8065920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:39.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.995+0000 7fdaffff8700 1 --2- 172.21.15.111:0/1116070734 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fdaf8136eb0 0x7fdaf8065920 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fdaf8064ac0 tx=0x7fdaf4006df0).stop 2024-04-25T02:20:39.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.995+0000 7fdaffff8700 1 -- 172.21.15.111:0/1116070734 shutdown_connections 2024-04-25T02:20:39.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.995+0000 7fdaffff8700 1 --2- 172.21.15.111:0/1116070734 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdaf813ba00 0x7fdaf81321d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:39.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.995+0000 7fdaffff8700 1 --2- 172.21.15.111:0/1116070734 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdaf81363c0 0x7fdaf8064490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:39.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.995+0000 7fdaffff8700 1 --2- 172.21.15.111:0/1116070734 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fdaf8136eb0 0x7fdaf8065920 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:39.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.995+0000 7fdaffff8700 1 -- 172.21.15.111:0/1116070734 >> 172.21.15.111:0/1116070734 conn(0x7fdaf80a8a00 msgr2=0x7fdaf80a8de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:39.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.995+0000 7fdaffff8700 1 -- 172.21.15.111:0/1116070734 shutdown_connections 2024-04-25T02:20:39.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:38.995+0000 7fdaffff8700 1 -- 172.21.15.111:0/1116070734 wait complete. 2024-04-25T02:20:39.009 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T02:20:39.010 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T02:20:39.010 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi186.front.sepia.ceph.com 2024-04-25T02:20:39.010 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-04-25T02:20:39.010 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-04-25T02:20:39.010 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T02:20:39.010 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T02:20:39.010 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T02:20:39.010 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-04-25T02:20:39.010 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:20:39.010 DEBUG:teuthology.orchestra.run.smithi186:> ip addr 2024-04-25T02:20:39.033 INFO:teuthology.orchestra.run.smithi186.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T02:20:39.033 INFO:teuthology.orchestra.run.smithi186.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T02:20:39.033 INFO:teuthology.orchestra.run.smithi186.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T02:20:39.033 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:20:39.033 INFO:teuthology.orchestra.run.smithi186.stdout: inet6 ::1/128 scope host 2024-04-25T02:20:39.033 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:20:39.033 INFO:teuthology.orchestra.run.smithi186.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:20:39.033 INFO:teuthology.orchestra.run.smithi186.stdout: link/ether 0c:c4:7a:d9:38:2c brd ff:ff:ff:ff:ff:ff 2024-04-25T02:20:39.033 INFO:teuthology.orchestra.run.smithi186.stdout: altname enp7s0f0 2024-04-25T02:20:39.033 INFO:teuthology.orchestra.run.smithi186.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:20:39.033 INFO:teuthology.orchestra.run.smithi186.stdout: link/ether 0c:c4:7a:d9:38:2d brd ff:ff:ff:ff:ff:ff 2024-04-25T02:20:39.033 INFO:teuthology.orchestra.run.smithi186.stdout: altname enp7s0f1 2024-04-25T02:20:39.034 INFO:teuthology.orchestra.run.smithi186.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:20:39.034 INFO:teuthology.orchestra.run.smithi186.stdout: link/ether 0c:c4:7a:88:6d:f4 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:20:39.034 INFO:teuthology.orchestra.run.smithi186.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T02:20:39.034 INFO:teuthology.orchestra.run.smithi186.stdout: link/ether 0c:c4:7a:88:6d:f5 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:20:39.034 INFO:teuthology.orchestra.run.smithi186.stdout: inet 172.21.15.186/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T02:20:39.034 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft 42617sec preferred_lft 42617sec 2024-04-25T02:20:39.034 INFO:teuthology.orchestra.run.smithi186.stdout: inet6 fe80::ec4:7aff:fe88:6df5/64 scope link 2024-04-25T02:20:39.034 INFO:teuthology.orchestra.run.smithi186.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:20:39.034 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T02:20:39.034 DEBUG:teuthology.orchestra.run.smithi186:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:20:39.035 DEBUG:teuthology.orchestra.run.smithi186:> set -e 2024-04-25T02:20:39.035 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip link add name ceph-brx type bridge 2024-04-25T02:20:39.035 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip addr flush dev ceph-brx 2024-04-25T02:20:39.035 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip link set ceph-brx up 2024-04-25T02:20:39.035 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T02:20:39.035 DEBUG:teuthology.orchestra.run.smithi186:> ') 2024-04-25T02:20:39.130 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T02:20:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:20:39.237 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T02:20:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:20:39.242 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:20:39.243 DEBUG:teuthology.orchestra.run.smithi186:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T02:20:39.270 INFO:teuthology.orchestra.run.smithi186.stdout:1 2024-04-25T02:20:39.271 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:20:39.271 DEBUG:teuthology.orchestra.run.smithi186:> route 2024-04-25T02:20:39.346 INFO:teuthology.orchestra.run.smithi186.stdout:Kernel IP routing table 2024-04-25T02:20:39.346 INFO:teuthology.orchestra.run.smithi186.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T02:20:39.346 INFO:teuthology.orchestra.run.smithi186.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T02:20:39.346 INFO:teuthology.orchestra.run.smithi186.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T02:20:39.346 INFO:teuthology.orchestra.run.smithi186.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T02:20:39.347 DEBUG:teuthology.orchestra.run.smithi186:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:20:39.347 DEBUG:teuthology.orchestra.run.smithi186:> set -e 2024-04-25T02:20:39.347 DEBUG:teuthology.orchestra.run.smithi186:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T02:20:39.347 DEBUG:teuthology.orchestra.run.smithi186:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T02:20:39.347 DEBUG:teuthology.orchestra.run.smithi186:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T02:20:39.347 DEBUG:teuthology.orchestra.run.smithi186:> ') 2024-04-25T02:20:39.436 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T02:20:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:20:39.619 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T02:20:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:20:39.624 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:20:39.624 DEBUG:teuthology.orchestra.run.smithi186:> ip netns list 2024-04-25T02:20:39.642 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:20:39.642 DEBUG:teuthology.orchestra.run.smithi186:> ip netns list-id 2024-04-25T02:20:39.700 DEBUG:teuthology.orchestra.run.smithi186:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:20:39.700 DEBUG:teuthology.orchestra.run.smithi186:> set -e 2024-04-25T02:20:39.700 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T02:20:39.701 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-04-25T02:20:39.701 DEBUG:teuthology.orchestra.run.smithi186:> ') 2024-04-25T02:20:39.789 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T02:20:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:20:39.827 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T02:20:39 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:20:39.833 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-04-25T02:20:39.833 DEBUG:teuthology.orchestra.run.smithi186:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:20:39.833 DEBUG:teuthology.orchestra.run.smithi186:> set -e 2024-04-25T02:20:39.833 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-04-25T02:20:39.833 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T02:20:39.833 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-04-25T02:20:39.833 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-04-25T02:20:39.833 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-04-25T02:20:39.833 DEBUG:teuthology.orchestra.run.smithi186:> ') 2024-04-25T02:20:39.883 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T02:20:39 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:20:40.076 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T02:20:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:20:40.082 DEBUG:teuthology.orchestra.run.smithi186:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:20:40.082 DEBUG:teuthology.orchestra.run.smithi186:> set -e 2024-04-25T02:20:40.082 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip link set brx.0 up 2024-04-25T02:20:40.082 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T02:20:40.082 DEBUG:teuthology.orchestra.run.smithi186:> ') 2024-04-25T02:20:40.132 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T02:20:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:20:40.212 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T02:20:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:20:40.217 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-04-25T02:20:40.217 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:20:40.217 DEBUG:teuthology.orchestra.run.smithi186:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-04-25T02:20:40.235 INFO:teuthology.orchestra.run.smithi186.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-04-25T02:20:40.235 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:20:40.235 DEBUG:teuthology.orchestra.run.smithi186:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-04-25T02:20:40.292 DEBUG:teuthology.orchestra.run.smithi186:> sudo modprobe fuse 2024-04-25T02:20:40.360 DEBUG:teuthology.orchestra.run.smithi186:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T02:20:40.418 INFO:teuthology.orchestra.run.smithi186.stdout:/sys 2024-04-25T02:20:40.418 INFO:teuthology.orchestra.run.smithi186.stdout:/proc 2024-04-25T02:20:40.418 INFO:teuthology.orchestra.run.smithi186.stdout:/dev 2024-04-25T02:20:40.419 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/kernel/security 2024-04-25T02:20:40.419 INFO:teuthology.orchestra.run.smithi186.stdout:/dev/shm 2024-04-25T02:20:40.419 INFO:teuthology.orchestra.run.smithi186.stdout:/dev/pts 2024-04-25T02:20:40.419 INFO:teuthology.orchestra.run.smithi186.stdout:/run 2024-04-25T02:20:40.419 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/cgroup 2024-04-25T02:20:40.419 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/cgroup/systemd 2024-04-25T02:20:40.419 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/pstore 2024-04-25T02:20:40.419 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/bpf 2024-04-25T02:20:40.419 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/cgroup/net_cls,net_prio 2024-04-25T02:20:40.419 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/cgroup/freezer 2024-04-25T02:20:40.419 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/cgroup/devices 2024-04-25T02:20:40.419 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/cgroup/hugetlb 2024-04-25T02:20:40.419 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/cgroup/perf_event 2024-04-25T02:20:40.419 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/cgroup/pids 2024-04-25T02:20:40.419 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/cgroup/rdma 2024-04-25T02:20:40.420 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/cgroup/memory 2024-04-25T02:20:40.420 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/cgroup/cpu,cpuacct 2024-04-25T02:20:40.420 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/cgroup/blkio 2024-04-25T02:20:40.420 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/cgroup/cpuset 2024-04-25T02:20:40.420 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/kernel/tracing 2024-04-25T02:20:40.420 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/kernel/config 2024-04-25T02:20:40.420 INFO:teuthology.orchestra.run.smithi186.stdout:/ 2024-04-25T02:20:40.420 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/selinux 2024-04-25T02:20:40.420 INFO:teuthology.orchestra.run.smithi186.stdout:/dev/hugepages 2024-04-25T02:20:40.420 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/kernel/debug 2024-04-25T02:20:40.420 INFO:teuthology.orchestra.run.smithi186.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T02:20:40.420 INFO:teuthology.orchestra.run.smithi186.stdout:/dev/mqueue 2024-04-25T02:20:40.420 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/fuse/connections 2024-04-25T02:20:40.420 INFO:teuthology.orchestra.run.smithi186.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T02:20:40.420 INFO:teuthology.orchestra.run.smithi186.stdout:/run/user/1000 2024-04-25T02:20:40.420 INFO:teuthology.orchestra.run.smithi186.stdout:/var/lib/ceph 2024-04-25T02:20:40.421 INFO:teuthology.orchestra.run.smithi186.stdout:/run/netns 2024-04-25T02:20:40.421 INFO:teuthology.orchestra.run.smithi186.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T02:20:40.421 INFO:teuthology.orchestra.run.smithi186.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T02:20:40.421 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:20:40.421 DEBUG:teuthology.orchestra.run.smithi186:> ls /sys/fs/fuse/connections 2024-04-25T02:20:40.476 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-25T02:20:40.476 DEBUG:teuthology.orchestra.run.smithi186:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-04-25T02:20:40.518 DEBUG:teuthology.orchestra.run.smithi186:> sudo modprobe fuse 2024-04-25T02:20:40.544 DEBUG:teuthology.orchestra.run.smithi186:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T02:20:40.606 INFO:teuthology.orchestra.run.smithi186.stdout:/sys 2024-04-25T02:20:40.606 INFO:teuthology.orchestra.run.smithi186.stdout:/proc 2024-04-25T02:20:40.606 INFO:teuthology.orchestra.run.smithi186.stdout:/dev 2024-04-25T02:20:40.606 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/kernel/security 2024-04-25T02:20:40.607 INFO:teuthology.orchestra.run.smithi186.stdout:/dev/shm 2024-04-25T02:20:40.607 INFO:teuthology.orchestra.run.smithi186.stdout:/dev/pts 2024-04-25T02:20:40.607 INFO:teuthology.orchestra.run.smithi186.stdout:/run 2024-04-25T02:20:40.607 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/cgroup 2024-04-25T02:20:40.607 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/cgroup/systemd 2024-04-25T02:20:40.607 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/pstore 2024-04-25T02:20:40.607 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/bpf 2024-04-25T02:20:40.607 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/cgroup/net_cls,net_prio 2024-04-25T02:20:40.607 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/cgroup/freezer 2024-04-25T02:20:40.607 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/cgroup/devices 2024-04-25T02:20:40.607 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/cgroup/hugetlb 2024-04-25T02:20:40.607 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/cgroup/perf_event 2024-04-25T02:20:40.607 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/cgroup/pids 2024-04-25T02:20:40.607 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/cgroup/rdma 2024-04-25T02:20:40.607 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/cgroup/memory 2024-04-25T02:20:40.608 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/cgroup/cpu,cpuacct 2024-04-25T02:20:40.608 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/cgroup/blkio 2024-04-25T02:20:40.608 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/cgroup/cpuset 2024-04-25T02:20:40.608 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/kernel/tracing 2024-04-25T02:20:40.608 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/kernel/config 2024-04-25T02:20:40.608 INFO:teuthology.orchestra.run.smithi186.stdout:/ 2024-04-25T02:20:40.608 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/selinux 2024-04-25T02:20:40.608 INFO:teuthology.orchestra.run.smithi186.stdout:/dev/hugepages 2024-04-25T02:20:40.608 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/kernel/debug 2024-04-25T02:20:40.608 INFO:teuthology.orchestra.run.smithi186.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T02:20:40.608 INFO:teuthology.orchestra.run.smithi186.stdout:/dev/mqueue 2024-04-25T02:20:40.608 INFO:teuthology.orchestra.run.smithi186.stdout:/sys/fs/fuse/connections 2024-04-25T02:20:40.608 INFO:teuthology.orchestra.run.smithi186.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T02:20:40.608 INFO:teuthology.orchestra.run.smithi186.stdout:/run/user/1000 2024-04-25T02:20:40.608 INFO:teuthology.orchestra.run.smithi186.stdout:/var/lib/ceph 2024-04-25T02:20:40.609 INFO:teuthology.orchestra.run.smithi186.stdout:/run/netns 2024-04-25T02:20:40.609 INFO:teuthology.orchestra.run.smithi186.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T02:20:40.609 INFO:teuthology.orchestra.run.smithi186.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T02:20:40.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:20:40.609 DEBUG:teuthology.orchestra.run.smithi186:> ls /sys/fs/fuse/connections 2024-04-25T02:20:40.621 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi186.stderr:2024-04-25T02:20:40.617+0000 7f5af19f5200 -1 init, newargv = 0x55e03e4e5fe0 newargc=9 2024-04-25T02:20:40.621 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi186.stderr:ceph-fuse[37471]: starting ceph client 2024-04-25T02:20:40.628 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi186.stderr:ceph-fuse[37471]: starting fuse 2024-04-25T02:20:40.639 INFO:teuthology.orchestra.run.smithi186.stdout:46 2024-04-25T02:20:40.639 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2024-04-25T02:20:40.639 DEBUG:teuthology.orchestra.run.smithi186:> sudo stdin-killer -- python3 -c ' 2024-04-25T02:20:40.639 DEBUG:teuthology.orchestra.run.smithi186:> import glob 2024-04-25T02:20:40.639 DEBUG:teuthology.orchestra.run.smithi186:> import re 2024-04-25T02:20:40.640 DEBUG:teuthology.orchestra.run.smithi186:> import os 2024-04-25T02:20:40.640 DEBUG:teuthology.orchestra.run.smithi186:> import subprocess 2024-04-25T02:20:40.640 DEBUG:teuthology.orchestra.run.smithi186:> 2024-04-25T02:20:40.640 DEBUG:teuthology.orchestra.run.smithi186:> def _find_admin_socket(client_name): 2024-04-25T02:20:40.640 DEBUG:teuthology.orchestra.run.smithi186:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-04-25T02:20:40.640 DEBUG:teuthology.orchestra.run.smithi186:> files = glob.glob(asok_path) 2024-04-25T02:20:40.640 DEBUG:teuthology.orchestra.run.smithi186:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-04-25T02:20:40.640 DEBUG:teuthology.orchestra.run.smithi186:> 2024-04-25T02:20:40.640 DEBUG:teuthology.orchestra.run.smithi186:> # Given a non-glob path, it better be there 2024-04-25T02:20:40.640 DEBUG:teuthology.orchestra.run.smithi186:> if "*" not in asok_path: 2024-04-25T02:20:40.640 DEBUG:teuthology.orchestra.run.smithi186:> assert(len(files) == 1) 2024-04-25T02:20:40.640 DEBUG:teuthology.orchestra.run.smithi186:> return files[0] 2024-04-25T02:20:40.640 DEBUG:teuthology.orchestra.run.smithi186:> 2024-04-25T02:20:40.640 DEBUG:teuthology.orchestra.run.smithi186:> for f in files: 2024-04-25T02:20:40.640 DEBUG:teuthology.orchestra.run.smithi186:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-25T02:20:40.640 DEBUG:teuthology.orchestra.run.smithi186:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-25T02:20:40.640 DEBUG:teuthology.orchestra.run.smithi186:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-25T02:20:40.640 DEBUG:teuthology.orchestra.run.smithi186:> contents = proc_f.read() 2024-04-25T02:20:40.641 DEBUG:teuthology.orchestra.run.smithi186:> if mountpoint in contents: 2024-04-25T02:20:40.641 DEBUG:teuthology.orchestra.run.smithi186:> return f 2024-04-25T02:20:40.641 DEBUG:teuthology.orchestra.run.smithi186:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-25T02:20:40.641 DEBUG:teuthology.orchestra.run.smithi186:> 2024-04-25T02:20:40.641 DEBUG:teuthology.orchestra.run.smithi186:> print(_find_admin_socket("client.1")) 2024-04-25T02:20:40.641 DEBUG:teuthology.orchestra.run.smithi186:> ' 2024-04-25T02:20:40.761 INFO:teuthology.orchestra.run.smithi186.stdout:/var/run/ceph/ceph-client.1.37471.asok 2024-04-25T02:20:40.764 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T02:20:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:20:40.770 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.37471.asok 2024-04-25T02:20:40.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:20:40.771 DEBUG:teuthology.orchestra.run.smithi186:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.37471.asok status 2024-04-25T02:20:40.910 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-25T02:20:40.910 INFO:teuthology.orchestra.run.smithi186.stdout: "metadata": { 2024-04-25T02:20:40.910 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_sha1": "8a82819d84cf884bd39c17e3236e0632ac146dc4", 2024-04-25T02:20:40.910 INFO:teuthology.orchestra.run.smithi186.stdout: "ceph_version": "ceph version 15.2.17 (8a82819d84cf884bd39c17e3236e0632ac146dc4) octopus (stable)", 2024-04-25T02:20:40.910 INFO:teuthology.orchestra.run.smithi186.stdout: "entity_id": "1", 2024-04-25T02:20:40.910 INFO:teuthology.orchestra.run.smithi186.stdout: "hostname": "smithi186", 2024-04-25T02:20:40.910 INFO:teuthology.orchestra.run.smithi186.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-04-25T02:20:40.910 INFO:teuthology.orchestra.run.smithi186.stdout: "pid": "37471", 2024-04-25T02:20:40.910 INFO:teuthology.orchestra.run.smithi186.stdout: "root": "/" 2024-04-25T02:20:40.910 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-25T02:20:40.910 INFO:teuthology.orchestra.run.smithi186.stdout: "dentry_count": 0, 2024-04-25T02:20:40.911 INFO:teuthology.orchestra.run.smithi186.stdout: "dentry_pinned_count": 0, 2024-04-25T02:20:40.911 INFO:teuthology.orchestra.run.smithi186.stdout: "id": 4538, 2024-04-25T02:20:40.911 INFO:teuthology.orchestra.run.smithi186.stdout: "inst": { 2024-04-25T02:20:40.911 INFO:teuthology.orchestra.run.smithi186.stdout: "name": { 2024-04-25T02:20:40.911 INFO:teuthology.orchestra.run.smithi186.stdout: "type": "client", 2024-04-25T02:20:40.911 INFO:teuthology.orchestra.run.smithi186.stdout: "num": 4538 2024-04-25T02:20:40.911 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-25T02:20:40.911 INFO:teuthology.orchestra.run.smithi186.stdout: "addr": { 2024-04-25T02:20:40.911 INFO:teuthology.orchestra.run.smithi186.stdout: "type": "v1", 2024-04-25T02:20:40.911 INFO:teuthology.orchestra.run.smithi186.stdout: "addr": "172.21.15.186:0", 2024-04-25T02:20:40.911 INFO:teuthology.orchestra.run.smithi186.stdout: "nonce": 1473940677 2024-04-25T02:20:40.911 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-25T02:20:40.911 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-25T02:20:40.911 INFO:teuthology.orchestra.run.smithi186.stdout: "addr": { 2024-04-25T02:20:40.912 INFO:teuthology.orchestra.run.smithi186.stdout: "type": "v1", 2024-04-25T02:20:40.912 INFO:teuthology.orchestra.run.smithi186.stdout: "addr": "172.21.15.186:0", 2024-04-25T02:20:40.912 INFO:teuthology.orchestra.run.smithi186.stdout: "nonce": 1473940677 2024-04-25T02:20:40.912 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-25T02:20:40.912 INFO:teuthology.orchestra.run.smithi186.stdout: "inst_str": "client.4538 172.21.15.186:0/1473940677", 2024-04-25T02:20:40.912 INFO:teuthology.orchestra.run.smithi186.stdout: "addr_str": "172.21.15.186:0/1473940677", 2024-04-25T02:20:40.912 INFO:teuthology.orchestra.run.smithi186.stdout: "inode_count": 1, 2024-04-25T02:20:40.912 INFO:teuthology.orchestra.run.smithi186.stdout: "mds_epoch": 8, 2024-04-25T02:20:40.912 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_epoch": 19, 2024-04-25T02:20:40.912 INFO:teuthology.orchestra.run.smithi186.stdout: "osd_epoch_barrier": 0, 2024-04-25T02:20:40.912 INFO:teuthology.orchestra.run.smithi186.stdout: "blacklisted": false, 2024-04-25T02:20:40.912 INFO:teuthology.orchestra.run.smithi186.stdout: "fs_name": "cephfs" 2024-04-25T02:20:40.912 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-25T02:20:40.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:20:40.919 DEBUG:teuthology.orchestra.run.smithi114:> stat --file-system '--printf=%T 2024-04-25T02:20:40.919 DEBUG:teuthology.orchestra.run.smithi114:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-25T02:20:40.941 INFO:teuthology.orchestra.run.smithi114.stdout:fuseblk 2024-04-25T02:20:40.941 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-25T02:20:40.941 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:20:40.941 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T02:20:41.015 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:20:41.015 DEBUG:teuthology.orchestra.run.smithi186:> stat --file-system '--printf=%T 2024-04-25T02:20:41.015 DEBUG:teuthology.orchestra.run.smithi186:> ' -- /home/ubuntu/cephtest/mnt.1 2024-04-25T02:20:41.034 INFO:teuthology.orchestra.run.smithi186.stdout:fuseblk 2024-04-25T02:20:41.034 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-04-25T02:20:41.034 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:20:41.035 DEBUG:teuthology.orchestra.run.smithi186:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-04-25T02:20:45.606 INFO:teuthology.run_tasks:Running task print... 2024-04-25T02:20:45.616 INFO:teuthology.task.print:**** done octopus client 2024-04-25T02:20:45.616 INFO:teuthology.run_tasks:Running task print... 2024-04-25T02:20:45.628 INFO:teuthology.task.print:**** done fsstress 2024-04-25T02:20:45.628 INFO:teuthology.run_tasks:Running task mds_pre_upgrade... 2024-04-25T02:20:45.637 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:20:45.752 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.748+0000 7f683c842700 1 Processor -- start 2024-04-25T02:20:45.752 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.748+0000 7f683c842700 1 -- start start 2024-04-25T02:20:45.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.748+0000 7f683c842700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6838136740 0x7f6838061a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:45.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.748+0000 7f683c842700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6838136b20 0x7f6838140940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:45.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.748+0000 7f683c842700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f683809c960 con 0x7f6838060e70 2024-04-25T02:20:45.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.748+0000 7f683c842700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6838060770 con 0x7f6838136740 2024-04-25T02:20:45.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.748+0000 7f683c842700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6838136fa0 con 0x7f6838136b20 2024-04-25T02:20:45.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.749+0000 7f683659c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6838136740 0x7f6838061a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:45.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.749+0000 7f6836d9d700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6838136b20 0x7f6838140940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:45.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.749+0000 7f6835d9b700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f6838060e70 0x7f683809bf90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:57100/0 (socket says 172.21.15.111:57100) 2024-04-25T02:20:45.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.749+0000 7f6835d9b700 1 -- 172.21.15.111:0/70142017 learned_addr learned my addr 172.21.15.111:0/70142017 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:20:45.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.749+0000 7f683659c700 1 -- 172.21.15.111:0/70142017 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6838136b20 msgr2=0x7f6838140940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:45.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.749+0000 7f683659c700 1 --2- 172.21.15.111:0/70142017 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6838136b20 0x7f6838140940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:45.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.749+0000 7f683559a700 1 -- 172.21.15.111:0/70142017 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 578534721 0 0) 0x7f683809c960 con 0x7f6838060e70 2024-04-25T02:20:45.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.749+0000 7f683659c700 1 -- 172.21.15.111:0/70142017 >> v1:172.21.15.111:6789/0 conn(0x7f6838060e70 legacy=0x7f683809bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:45.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.749+0000 7f683659c700 1 -- 172.21.15.111:0/70142017 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f68381360e0 con 0x7f6838136740 2024-04-25T02:20:45.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.749+0000 7f6836d9d700 1 --2- 172.21.15.111:0/70142017 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6838136b20 0x7f6838140940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:45.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.749+0000 7f683659c700 1 --2- 172.21.15.111:0/70142017 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6838136740 0x7f6838061a60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f6838060dc0 tx=0x7f68280091d0).ready entity=mon.1 client_cookie=c7905c768f0ebaf2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:45.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.749+0000 7f683559a700 1 -- 172.21.15.111:0/70142017 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f682800b6b0 con 0x7f6838136740 2024-04-25T02:20:45.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.749+0000 7f683559a700 1 -- 172.21.15.111:0/70142017 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f682800b810 con 0x7f6838136740 2024-04-25T02:20:45.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.749+0000 7f683559a700 1 -- 172.21.15.111:0/70142017 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f682800b980 con 0x7f6838136740 2024-04-25T02:20:45.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.750+0000 7f683c842700 1 -- 172.21.15.111:0/70142017 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6838136740 msgr2=0x7f6838061a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:45.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.750+0000 7f683c842700 1 --2- 172.21.15.111:0/70142017 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6838136740 0x7f6838061a60 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f6838060dc0 tx=0x7f68280091d0).stop 2024-04-25T02:20:45.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.750+0000 7f683c842700 1 -- 172.21.15.111:0/70142017 shutdown_connections 2024-04-25T02:20:45.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.750+0000 7f683c842700 1 --2- 172.21.15.111:0/70142017 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6838136b20 0x7f6838140940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:45.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.750+0000 7f683c842700 1 --2- 172.21.15.111:0/70142017 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6838136740 0x7f6838061a60 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:45.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.750+0000 7f683c842700 1 -- 172.21.15.111:0/70142017 >> 172.21.15.111:0/70142017 conn(0x7f683805d070 msgr2=0x7f68380625e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:45.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.750+0000 7f683c842700 1 -- 172.21.15.111:0/70142017 shutdown_connections 2024-04-25T02:20:45.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.750+0000 7f683c842700 1 -- 172.21.15.111:0/70142017 wait complete. 2024-04-25T02:20:45.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.751+0000 7f683c842700 1 Processor -- start 2024-04-25T02:20:45.757 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.751+0000 7f683c842700 1 -- start start 2024-04-25T02:20:45.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.751+0000 7f683c842700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6838060e70 0x7f6838145b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:45.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.751+0000 7f683c842700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6838136740 0x7f6838148f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:45.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.751+0000 7f683c842700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6838136b20 0x7f6838149400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:45.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.751+0000 7f683c842700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6838095a40 con 0x7f6838136b20 2024-04-25T02:20:45.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.751+0000 7f683c842700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6838098820 con 0x7f6838060e70 2024-04-25T02:20:45.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.751+0000 7f683c842700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6838146500 con 0x7f6838136740 2024-04-25T02:20:45.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.751+0000 7f683659c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6838060e70 0x7f6838145b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:45.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.751+0000 7f6835d9b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6838136740 0x7f6838148f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:45.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.751+0000 7f683659c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6838060e70 0x7f6838145b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:36382/0 (socket says 172.21.15.111:36382) 2024-04-25T02:20:45.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.751+0000 7f683659c700 1 -- 172.21.15.111:0/354047234 learned_addr learned my addr 172.21.15.111:0/354047234 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:45.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.751+0000 7f6836d9d700 1 --2- 172.21.15.111:0/354047234 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6838136b20 0x7f6838149400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:45.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.752+0000 7f6835d9b700 1 -- 172.21.15.111:0/354047234 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6838060e70 msgr2=0x7f6838145b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:45.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.752+0000 7f6835d9b700 1 --2- 172.21.15.111:0/354047234 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6838060e70 0x7f6838145b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:45.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.752+0000 7f6835d9b700 1 -- 172.21.15.111:0/354047234 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6838136b20 msgr2=0x7f6838149400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:45.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.752+0000 7f6835d9b700 1 --2- 172.21.15.111:0/354047234 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6838136b20 0x7f6838149400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:45.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.752+0000 7f6835d9b700 1 -- 172.21.15.111:0/354047234 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f683000b180 con 0x7f6838136740 2024-04-25T02:20:45.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.752+0000 7f6835d9b700 1 --2- 172.21.15.111:0/354047234 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6838136740 0x7f6838148f10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f6820000bc0 tx=0x7f68200079e0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:45.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.752+0000 7f682f7fe700 1 -- 172.21.15.111:0/354047234 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f682000cdd0 con 0x7f6838136740 2024-04-25T02:20:45.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.752+0000 7f682f7fe700 1 -- 172.21.15.111:0/354047234 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f68200070d0 con 0x7f6838136740 2024-04-25T02:20:45.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.752+0000 7f683c842700 1 -- 172.21.15.111:0/354047234 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6828009470 con 0x7f6838136740 2024-04-25T02:20:45.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.752+0000 7f682f7fe700 1 -- 172.21.15.111:0/354047234 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f6820007430 con 0x7f6838136740 2024-04-25T02:20:45.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.752+0000 7f683c842700 1 -- 172.21.15.111:0/354047234 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f68380998f0 con 0x7f6838136740 2024-04-25T02:20:45.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.753+0000 7f682f7fe700 1 -- 172.21.15.111:0/354047234 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f6820010070 con 0x7f6838136740 2024-04-25T02:20:45.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.753+0000 7f682f7fe700 1 -- 172.21.15.111:0/354047234 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f6820049d00 con 0x7f6838136740 2024-04-25T02:20:45.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.753+0000 7f683c842700 1 -- 172.21.15.111:0/354047234 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f683809c6a0 con 0x7f6838136740 2024-04-25T02:20:45.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.756+0000 7f682f7fe700 1 -- 172.21.15.111:0/354047234 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f682002ec00 con 0x7f6838136740 2024-04-25T02:20:45.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.868+0000 7f683c842700 1 -- 172.21.15.111:0/354047234 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6838062cf0 con 0x7f6838136740 2024-04-25T02:20:45.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.869+0000 7f682f7fe700 1 -- 172.21.15.111:0/354047234 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+10566 (secure 0 0 0) 0x7f6820032220 con 0x7f6838136740 2024-04-25T02:20:45.873 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:20:45.873 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":19,"fsid":"4643f974-f93a-4436-93b8-460ff320e62e","created":"2024-04-25T02:20:05.450475+0000","modified":"2024-04-25T02:20:36.255829+0000","last_up_change":"2024-04-25T02:20:10.439204+0000","last_in_change":"2024-04-25T02:20:10.439204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-25T02:20:07.471248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:20:14.420378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:20:22.251868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T02:20:23.128289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"df3f17ca-3b12-42c8-8cf7-8f1b7189e587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6800","nonce":40214}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6801","nonce":40214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6803","nonce":40214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6802","nonce":40214}]},"public_addr":"172.21.15.111:6800/40214","cluster_addr":"172.21.15.111:6801/40214","heartbeat_back_addr":"172.21.15.111:6803/40214","heartbeat_front_addr":"172.21.15.111:6802/40214","state":["exists","up"]},{"osd":1,"uuid":"93d54815-f215-4285-bba6-32f2d1cabf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6812","nonce":40216}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6813","nonce":40216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6815","nonce":40216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6814","nonce":40216}]},"public_addr":"172.21.15.111:6812/40216","cluster_addr":"172.21.15.111:6813/40216","heartbeat_back_addr":"172.21.15.111:6815/40216","heartbeat_front_addr":"172.21.15.111:6814/40216","state":["exists","up"]},{"osd":2,"uuid":"b26b2104-2a2e-408f-9ce7-3587a32a2ebe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6804","nonce":40215}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6805","nonce":40215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6807","nonce":40215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6806","nonce":40215}]},"public_addr":"172.21.15.111:6804/40215","cluster_addr":"172.21.15.111:6805/40215","heartbeat_back_addr":"172.21.15.111:6807/40215","heartbeat_front_addr":"172.21.15.111:6806/40215","state":["exists","up"]},{"osd":3,"uuid":"43c25820-1edc-4031-badf-72e87dd6bf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6808","nonce":40213}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6809","nonce":40213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6811","nonce":40213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6810","nonce":40213}]},"public_addr":"172.21.15.111:6808/40213","cluster_addr":"172.21.15.111:6809/40213","heartbeat_back_addr":"172.21.15.111:6811/40213","heartbeat_front_addr":"172.21.15.111:6810/40213","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.372427+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.411480+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.361508+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.377212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-25T02:20:45.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.870+0000 7f683c842700 1 -- 172.21.15.111:0/354047234 >> v1:172.21.15.111:6816/39585 conn(0x7f681c038dd0 legacy=0x7f681c03b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:45.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.870+0000 7f683c842700 1 -- 172.21.15.111:0/354047234 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6838136740 msgr2=0x7f6838148f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:45.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.870+0000 7f683c842700 1 --2- 172.21.15.111:0/354047234 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6838136740 0x7f6838148f10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f6820000bc0 tx=0x7f68200079e0).stop 2024-04-25T02:20:45.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.870+0000 7f683c842700 1 -- 172.21.15.111:0/354047234 shutdown_connections 2024-04-25T02:20:45.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.870+0000 7f683c842700 1 --2- 172.21.15.111:0/354047234 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6838136b20 0x7f6838149400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:45.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.870+0000 7f683c842700 1 --2- 172.21.15.111:0/354047234 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6838060e70 0x7f6838145b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:45.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.870+0000 7f683c842700 1 --2- 172.21.15.111:0/354047234 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6838136740 0x7f6838148f10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:45.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.870+0000 7f683c842700 1 -- 172.21.15.111:0/354047234 >> 172.21.15.111:0/354047234 conn(0x7f683805d070 msgr2=0x7f68380a9c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:45.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.870+0000 7f683c842700 1 -- 172.21.15.111:0/354047234 shutdown_connections 2024-04-25T02:20:45.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.870+0000 7f683c842700 1 -- 172.21.15.111:0/354047234 wait complete. 2024-04-25T02:20:45.884 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-04-25T02:20:07.471248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T02:20:14.420378+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:20:22.251868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:20:23.128289+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T02:20:45.885 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-04-25T02:20:45.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.985+0000 7f340fcb9700 1 Processor -- start 2024-04-25T02:20:45.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.985+0000 7f340fcb9700 1 -- start start 2024-04-25T02:20:45.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.986+0000 7f340fcb9700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f340805c1a0 0x7f3408067040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:45.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.986+0000 7f340fcb9700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3408067c20 0x7f340805c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:45.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.986+0000 7f340fcb9700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3408065c90 con 0x7f3408066170 2024-04-25T02:20:45.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.986+0000 7f340fcb9700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f340805ca70 con 0x7f340805c1a0 2024-04-25T02:20:45.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.986+0000 7f340fcb9700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3408067680 con 0x7f3408067c20 2024-04-25T02:20:45.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.986+0000 7f340d254700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3408067c20 0x7f340805c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:45.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.986+0000 7f340da55700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f340805c1a0 0x7f3408067040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:45.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.986+0000 7f340e256700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f3408066170 0x7f3408136350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:57110/0 (socket says 172.21.15.111:57110) 2024-04-25T02:20:45.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.986+0000 7f340e256700 1 -- 172.21.15.111:0/1560917239 learned_addr learned my addr 172.21.15.111:0/1560917239 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:20:45.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.986+0000 7f340da55700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f340805c1a0 0x7f3408067040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:40706/0 (socket says 172.21.15.111:40706) 2024-04-25T02:20:45.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.986+0000 7f340d254700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3408067c20 0x7f340805c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:36392/0 (socket says 172.21.15.111:36392) 2024-04-25T02:20:45.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.986+0000 7f340d254700 1 -- 172.21.15.111:0/1560917239 >> v2:172.21.15.111:3300/0 conn(0x7f340805c1a0 msgr2=0x7f3408067040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:45.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.986+0000 7f340d254700 1 --2- 172.21.15.111:0/1560917239 >> v2:172.21.15.111:3300/0 conn(0x7f340805c1a0 0x7f3408067040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:45.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.986+0000 7f340d254700 1 -- 172.21.15.111:0/1560917239 >> v1:172.21.15.111:6789/0 conn(0x7f3408066170 legacy=0x7f3408136350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:45.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.986+0000 7f340d254700 1 -- 172.21.15.111:0/1560917239 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f340805ba50 con 0x7f3408067c20 2024-04-25T02:20:45.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.986+0000 7f340da55700 1 --2- 172.21.15.111:0/1560917239 >> v2:172.21.15.111:3300/0 conn(0x7f340805c1a0 0x7f3408067040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:45.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.987+0000 7f340d254700 1 --2- 172.21.15.111:0/1560917239 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3408067c20 0x7f340805c580 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f3408060690 tx=0x7f3404006df0).ready entity=mon.1 client_cookie=da5b9cb57faf9d6f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:45.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.987+0000 7f340ca53700 1 -- 172.21.15.111:0/1560917239 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f340400d570 con 0x7f3408067c20 2024-04-25T02:20:45.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.987+0000 7f340ca53700 1 -- 172.21.15.111:0/1560917239 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3404000e90 con 0x7f3408067c20 2024-04-25T02:20:45.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.987+0000 7f340ca53700 1 -- 172.21.15.111:0/1560917239 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f340400d8c0 con 0x7f3408067c20 2024-04-25T02:20:45.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.987+0000 7f340fcb9700 1 -- 172.21.15.111:0/1560917239 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3408067c20 msgr2=0x7f340805c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:45.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.987+0000 7f340fcb9700 1 --2- 172.21.15.111:0/1560917239 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3408067c20 0x7f340805c580 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f3408060690 tx=0x7f3404006df0).stop 2024-04-25T02:20:45.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.987+0000 7f340fcb9700 1 -- 172.21.15.111:0/1560917239 shutdown_connections 2024-04-25T02:20:45.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.987+0000 7f340fcb9700 1 --2- 172.21.15.111:0/1560917239 >> v2:172.21.15.111:3300/0 conn(0x7f340805c1a0 0x7f3408067040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:45.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.987+0000 7f340fcb9700 1 --2- 172.21.15.111:0/1560917239 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3408067c20 0x7f340805c580 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:45.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.987+0000 7f340fcb9700 1 -- 172.21.15.111:0/1560917239 >> 172.21.15.111:0/1560917239 conn(0x7f34080a8a00 msgr2=0x7f34080a8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:45.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.987+0000 7f340fcb9700 1 -- 172.21.15.111:0/1560917239 shutdown_connections 2024-04-25T02:20:45.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.987+0000 7f340fcb9700 1 -- 172.21.15.111:0/1560917239 wait complete. 2024-04-25T02:20:45.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.988+0000 7f340fcb9700 1 Processor -- start 2024-04-25T02:20:45.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.988+0000 7f340fcb9700 1 -- start start 2024-04-25T02:20:45.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.989+0000 7f340fcb9700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f340805c1a0 0x7f3408145e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:45.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.989+0000 7f340fcb9700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3408066170 0x7f34080926e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:45.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.989+0000 7f340fcb9700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3408067c20 0x7f340809e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:45.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.989+0000 7f340fcb9700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3408093330 con 0x7f3408067c20 2024-04-25T02:20:45.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.989+0000 7f340fcb9700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3408146480 con 0x7f340805c1a0 2024-04-25T02:20:45.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.989+0000 7f340fcb9700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3408146740 con 0x7f3408066170 2024-04-25T02:20:45.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.989+0000 7f340da55700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f340805c1a0 0x7f3408145e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:45.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.989+0000 7f340da55700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f340805c1a0 0x7f3408145e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:36406/0 (socket says 172.21.15.111:36406) 2024-04-25T02:20:45.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.989+0000 7f340da55700 1 -- 172.21.15.111:0/3748778609 learned_addr learned my addr 172.21.15.111:0/3748778609 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:45.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.989+0000 7f340e256700 1 --2- 172.21.15.111:0/3748778609 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3408067c20 0x7f340809e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:45.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.989+0000 7f340d254700 1 --2- 172.21.15.111:0/3748778609 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3408066170 0x7f34080926e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:45.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.989+0000 7f340da55700 1 -- 172.21.15.111:0/3748778609 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3408066170 msgr2=0x7f34080926e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:45.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.989+0000 7f340da55700 1 --2- 172.21.15.111:0/3748778609 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3408066170 0x7f34080926e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:45.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.989+0000 7f340da55700 1 -- 172.21.15.111:0/3748778609 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3408067c20 msgr2=0x7f340809e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:45.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.989+0000 7f340da55700 1 --2- 172.21.15.111:0/3748778609 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3408067c20 0x7f340809e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:45.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.989+0000 7f340da55700 1 -- 172.21.15.111:0/3748778609 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f800b180 con 0x7f340805c1a0 2024-04-25T02:20:45.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.989+0000 7f340da55700 1 --2- 172.21.15.111:0/3748778609 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f340805c1a0 0x7f3408145e60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f33f800c000 tx=0x7f33f8006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:45.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.989+0000 7f33f6ffd700 1 -- 172.21.15.111:0/3748778609 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33f800c5f0 con 0x7f340805c1a0 2024-04-25T02:20:45.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.989+0000 7f33f6ffd700 1 -- 172.21.15.111:0/3748778609 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33f800c750 con 0x7f340805c1a0 2024-04-25T02:20:45.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.989+0000 7f33f6ffd700 1 -- 172.21.15.111:0/3748778609 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f33f800cab0 con 0x7f340805c1a0 2024-04-25T02:20:45.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.989+0000 7f340fcb9700 1 -- 172.21.15.111:0/3748778609 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f340400b180 con 0x7f340805c1a0 2024-04-25T02:20:45.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.989+0000 7f340fcb9700 1 -- 172.21.15.111:0/3748778609 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3408092c50 con 0x7f340805c1a0 2024-04-25T02:20:45.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.990+0000 7f33f6ffd700 1 -- 172.21.15.111:0/3748778609 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f33f800cc10 con 0x7f340805c1a0 2024-04-25T02:20:45.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.991+0000 7f340fcb9700 1 -- 172.21.15.111:0/3748778609 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f340805e4b0 con 0x7f340805c1a0 2024-04-25T02:20:45.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.991+0000 7f33f6ffd700 1 -- 172.21.15.111:0/3748778609 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f33f804ad90 con 0x7f340805c1a0 2024-04-25T02:20:45.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:45.994+0000 7f33f6ffd700 1 -- 172.21.15.111:0/3748778609 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f33f80336c0 con 0x7f340805c1a0 2024-04-25T02:20:46.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.103+0000 7f340fcb9700 1 -- 172.21.15.111:0/3748778609 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f3408057a60 con 0x7f340805c1a0 2024-04-25T02:20:46.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.104+0000 7f33f6ffd700 1 -- 172.21.15.111:0/3748778609 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v19) v1 ==== 110+0+10 (secure 0 0 0) 0x7f33f80332b0 con 0x7f340805c1a0 2024-04-25T02:20:46.109 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 1 2024-04-25T02:20:46.111 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.105+0000 7f340fcb9700 1 -- 172.21.15.111:0/3748778609 >> v1:172.21.15.111:6816/39585 conn(0x7f33e8038e30 legacy=0x7f33e803b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:46.111 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.105+0000 7f340fcb9700 1 -- 172.21.15.111:0/3748778609 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f340805c1a0 msgr2=0x7f3408145e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:46.111 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.105+0000 7f340fcb9700 1 --2- 172.21.15.111:0/3748778609 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f340805c1a0 0x7f3408145e60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f33f800c000 tx=0x7f33f8006df0).stop 2024-04-25T02:20:46.111 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.105+0000 7f340fcb9700 1 -- 172.21.15.111:0/3748778609 shutdown_connections 2024-04-25T02:20:46.111 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.105+0000 7f340fcb9700 1 --2- 172.21.15.111:0/3748778609 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3408067c20 0x7f340809e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:46.112 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.105+0000 7f340fcb9700 1 --2- 172.21.15.111:0/3748778609 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f340805c1a0 0x7f3408145e60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:46.112 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.105+0000 7f340fcb9700 1 --2- 172.21.15.111:0/3748778609 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3408066170 0x7f34080926e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:46.112 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.105+0000 7f340fcb9700 1 -- 172.21.15.111:0/3748778609 >> 172.21.15.111:0/3748778609 conn(0x7f34080a8a00 msgr2=0x7f3408135c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:46.112 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.105+0000 7f340fcb9700 1 -- 172.21.15.111:0/3748778609 shutdown_connections 2024-04-25T02:20:46.112 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.105+0000 7f340fcb9700 1 -- 172.21.15.111:0/3748778609 wait complete. 2024-04-25T02:20:46.119 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T02:20:46.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.220+0000 7f59bae42700 1 Processor -- start 2024-04-25T02:20:46.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.220+0000 7f59bae42700 1 -- start start 2024-04-25T02:20:46.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.221+0000 7f59bae42700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f59b4136800 0x7f59b40642e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:46.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.221+0000 7f59bae42700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f59b40633b0 0x7f59b4136be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:46.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.221+0000 7f59bae42700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59b41363d0 con 0x7f59b4062590 2024-04-25T02:20:46.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.221+0000 7f59bae42700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59b40647d0 con 0x7f59b4136800 2024-04-25T02:20:46.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.221+0000 7f59bae42700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59b4136600 con 0x7f59b40633b0 2024-04-25T02:20:46.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.221+0000 7f59b8bde700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f59b4136800 0x7f59b40642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:46.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.221+0000 7f59b3fff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f59b40633b0 0x7f59b4136be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:46.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.221+0000 7f59b8bde700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f59b4136800 0x7f59b40642e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:36408/0 (socket says 172.21.15.111:36408) 2024-04-25T02:20:46.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.221+0000 7f59b8bde700 1 -- 172.21.15.111:0/1874005391 learned_addr learned my addr 172.21.15.111:0/1874005391 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:46.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.221+0000 7f59b93df700 1 --1- 172.21.15.111:0/1874005391 >> v1:172.21.15.111:6789/0 conn(0x7f59b4062590 0x7f59b40a82a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:57124/0 (socket says 172.21.15.111:57124) 2024-04-25T02:20:46.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.221+0000 7f59b3fff700 1 -- 172.21.15.111:0/1874005391 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f59b4136800 msgr2=0x7f59b40642e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:46.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.221+0000 7f59b3fff700 1 --2- 172.21.15.111:0/1874005391 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f59b4136800 0x7f59b40642e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:46.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.221+0000 7f59b3fff700 1 -- 172.21.15.111:0/1874005391 >> v1:172.21.15.111:6789/0 conn(0x7f59b4062590 legacy=0x7f59b40a82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:46.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.221+0000 7f59b37fe700 1 -- 172.21.15.111:0/1874005391 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3474129709 0 0) 0x7f59b41363d0 con 0x7f59b4062590 2024-04-25T02:20:46.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.221+0000 7f59b3fff700 1 -- 172.21.15.111:0/1874005391 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59b40a9d70 con 0x7f59b40633b0 2024-04-25T02:20:46.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.221+0000 7f59b8bde700 1 --2- 172.21.15.111:0/1874005391 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f59b4136800 0x7f59b40642e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:46.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.221+0000 7f59b3fff700 1 --2- 172.21.15.111:0/1874005391 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f59b40633b0 0x7f59b4136be0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f59a0002f70 tx=0x7f59a0006df0).ready entity=mon.2 client_cookie=65117ad728eb3710 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:46.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.221+0000 7f59b37fe700 1 -- 172.21.15.111:0/1874005391 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59a000d570 con 0x7f59b40633b0 2024-04-25T02:20:46.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.221+0000 7f59b37fe700 1 -- 172.21.15.111:0/1874005391 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a0000e90 con 0x7f59b40633b0 2024-04-25T02:20:46.231 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.221+0000 7f59b37fe700 1 -- 172.21.15.111:0/1874005391 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59a000d8c0 con 0x7f59b40633b0 2024-04-25T02:20:46.231 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.222+0000 7f59bae42700 1 -- 172.21.15.111:0/1874005391 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f59b40633b0 msgr2=0x7f59b4136be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:46.231 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.222+0000 7f59bae42700 1 --2- 172.21.15.111:0/1874005391 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f59b40633b0 0x7f59b4136be0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f59a0002f70 tx=0x7f59a0006df0).stop 2024-04-25T02:20:46.231 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.222+0000 7f59bae42700 1 -- 172.21.15.111:0/1874005391 shutdown_connections 2024-04-25T02:20:46.231 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.222+0000 7f59bae42700 1 --2- 172.21.15.111:0/1874005391 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f59b4136800 0x7f59b40642e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:46.231 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.222+0000 7f59bae42700 1 --2- 172.21.15.111:0/1874005391 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f59b40633b0 0x7f59b4136be0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:46.231 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.222+0000 7f59bae42700 1 -- 172.21.15.111:0/1874005391 >> 172.21.15.111:0/1874005391 conn(0x7f59b40614e0 msgr2=0x7f59b406c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:46.231 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.222+0000 7f59bae42700 1 -- 172.21.15.111:0/1874005391 shutdown_connections 2024-04-25T02:20:46.231 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.222+0000 7f59bae42700 1 -- 172.21.15.111:0/1874005391 wait complete. 2024-04-25T02:20:46.231 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.223+0000 7f59bae42700 1 Processor -- start 2024-04-25T02:20:46.231 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.223+0000 7f59bae42700 1 -- start start 2024-04-25T02:20:46.231 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.224+0000 7f59bae42700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f59b4062590 0x7f59b413d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:46.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.224+0000 7f59bae42700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f59b40633b0 0x7f59b412fe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:46.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.224+0000 7f59bae42700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f59b4136800 0x7f59b4130360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:46.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.224+0000 7f59bae42700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59b413bd30 con 0x7f59b4136800 2024-04-25T02:20:46.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.224+0000 7f59bae42700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59b4099060 con 0x7f59b4062590 2024-04-25T02:20:46.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.224+0000 7f59bae42700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f59b413c6b0 con 0x7f59b40633b0 2024-04-25T02:20:46.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.224+0000 7f59b3fff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f59b40633b0 0x7f59b412fe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:46.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.224+0000 7f59b3fff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f59b40633b0 0x7f59b412fe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:45066/0 (socket says 172.21.15.111:45066) 2024-04-25T02:20:46.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.224+0000 7f59b3fff700 1 -- 172.21.15.111:0/1515545793 learned_addr learned my addr 172.21.15.111:0/1515545793 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:46.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.224+0000 7f59b8bde700 1 --2- 172.21.15.111:0/1515545793 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f59b4062590 0x7f59b413d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:46.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.224+0000 7f59b93df700 1 --2- 172.21.15.111:0/1515545793 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f59b4136800 0x7f59b4130360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:46.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.224+0000 7f59b8bde700 1 -- 172.21.15.111:0/1515545793 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f59b40633b0 msgr2=0x7f59b412fe70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:46.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.224+0000 7f59b8bde700 1 --2- 172.21.15.111:0/1515545793 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f59b40633b0 0x7f59b412fe70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:46.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.224+0000 7f59b8bde700 1 -- 172.21.15.111:0/1515545793 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f59b4136800 msgr2=0x7f59b4130360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:46.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.224+0000 7f59b8bde700 1 --2- 172.21.15.111:0/1515545793 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f59b4136800 0x7f59b4130360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:46.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.224+0000 7f59b8bde700 1 -- 172.21.15.111:0/1515545793 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59a800b1e0 con 0x7f59b4062590 2024-04-25T02:20:46.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.224+0000 7f59b3fff700 1 --2- 172.21.15.111:0/1515545793 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f59b40633b0 0x7f59b412fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:46.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.224+0000 7f59b8bde700 1 --2- 172.21.15.111:0/1515545793 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f59b4062590 0x7f59b413d170 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f59a800c000 tx=0x7f59a8006eb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:46.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.224+0000 7f59b1ffb700 1 -- 172.21.15.111:0/1515545793 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59a8012600 con 0x7f59b4062590 2024-04-25T02:20:46.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.224+0000 7f59b1ffb700 1 -- 172.21.15.111:0/1515545793 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59a8012760 con 0x7f59b4062590 2024-04-25T02:20:46.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.224+0000 7f59bae42700 1 -- 172.21.15.111:0/1515545793 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59a000b180 con 0x7f59b4062590 2024-04-25T02:20:46.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.224+0000 7f59b1ffb700 1 -- 172.21.15.111:0/1515545793 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f59a8012ac0 con 0x7f59b4062590 2024-04-25T02:20:46.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.225+0000 7f59bae42700 1 -- 172.21.15.111:0/1515545793 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59b413baf0 con 0x7f59b4062590 2024-04-25T02:20:46.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.225+0000 7f59b1ffb700 1 -- 172.21.15.111:0/1515545793 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f59a8022070 con 0x7f59b4062590 2024-04-25T02:20:46.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.226+0000 7f59bae42700 1 -- 172.21.15.111:0/1515545793 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59b413cfc0 con 0x7f59b4062590 2024-04-25T02:20:46.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.231+0000 7f59b1ffb700 1 -- 172.21.15.111:0/1515545793 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f59a8031a50 con 0x7f59b4062590 2024-04-25T02:20:46.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.234+0000 7f59b1ffb700 1 -- 172.21.15.111:0/1515545793 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f59a8033420 con 0x7f59b4062590 2024-04-25T02:20:46.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.344+0000 7f59bae42700 1 -- 172.21.15.111:0/1515545793 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f59b406cda0 con 0x7f59b4062590 2024-04-25T02:20:46.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.344+0000 7f59b1ffb700 1 -- 172.21.15.111:0/1515545793 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v19) v1 ==== 92+0+10 (secure 0 0 0) 0x7f59a8033010 con 0x7f59b4062590 2024-04-25T02:20:46.349 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 8 2024-04-25T02:20:46.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.346+0000 7f59bae42700 1 -- 172.21.15.111:0/1515545793 >> v1:172.21.15.111:6816/39585 conn(0x7f5994038da0 legacy=0x7f599403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:46.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.346+0000 7f59bae42700 1 -- 172.21.15.111:0/1515545793 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f59b4062590 msgr2=0x7f59b413d170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:46.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.346+0000 7f59bae42700 1 --2- 172.21.15.111:0/1515545793 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f59b4062590 0x7f59b413d170 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f59a800c000 tx=0x7f59a8006eb0).stop 2024-04-25T02:20:46.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.346+0000 7f59bae42700 1 -- 172.21.15.111:0/1515545793 shutdown_connections 2024-04-25T02:20:46.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.346+0000 7f59bae42700 1 --2- 172.21.15.111:0/1515545793 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f59b4136800 0x7f59b4130360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:46.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.346+0000 7f59bae42700 1 --2- 172.21.15.111:0/1515545793 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f59b4062590 0x7f59b413d170 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:46.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.346+0000 7f59bae42700 1 --2- 172.21.15.111:0/1515545793 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f59b40633b0 0x7f59b412fe70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:46.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.346+0000 7f59bae42700 1 -- 172.21.15.111:0/1515545793 >> 172.21.15.111:0/1515545793 conn(0x7f59b40614e0 msgr2=0x7f59b413ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:46.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.346+0000 7f59bae42700 1 -- 172.21.15.111:0/1515545793 shutdown_connections 2024-04-25T02:20:46.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.346+0000 7f59bae42700 1 -- 172.21.15.111:0/1515545793 wait complete. 2024-04-25T02:20:46.360 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:20:46.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.461+0000 7f42695f9700 1 Processor -- start 2024-04-25T02:20:46.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.461+0000 7f42695f9700 1 -- start start 2024-04-25T02:20:46.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.462+0000 7f42695f9700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f426412c310 0x7f426405cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:46.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.462+0000 7f42695f9700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f426412c6f0 0x7f42640a95f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:46.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.462+0000 7f42695f9700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42641377e0 con 0x7f426405da60 2024-04-25T02:20:46.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.462+0000 7f42695f9700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f426413a760 con 0x7f426412c310 2024-04-25T02:20:46.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.462+0000 7f42695f9700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42640a7770 con 0x7f426412c6f0 2024-04-25T02:20:46.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.462+0000 7f42637fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f426412c6f0 0x7f42640a95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:46.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.462+0000 7f4262ffd700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f426412c310 0x7f426405cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:46.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.462+0000 7f42627fc700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f426405da60 0x7f42640a8ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:57132/0 (socket says 172.21.15.111:57132) 2024-04-25T02:20:46.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.462+0000 7f42627fc700 1 -- 172.21.15.111:0/3242437353 learned_addr learned my addr 172.21.15.111:0/3242437353 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:20:46.471 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.462+0000 7f42637fe700 1 -- 172.21.15.111:0/3242437353 >> v2:172.21.15.111:3300/0 conn(0x7f426412c310 msgr2=0x7f426405cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:46.471 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.462+0000 7f42637fe700 1 --2- 172.21.15.111:0/3242437353 >> v2:172.21.15.111:3300/0 conn(0x7f426412c310 0x7f426405cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:46.471 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.462+0000 7f42637fe700 1 -- 172.21.15.111:0/3242437353 >> v1:172.21.15.111:6789/0 conn(0x7f426405da60 legacy=0x7f42640a8ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:46.471 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.462+0000 7f42637fe700 1 -- 172.21.15.111:0/3242437353 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f426405c420 con 0x7f426412c6f0 2024-04-25T02:20:46.471 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.462+0000 7f4262ffd700 1 --2- 172.21.15.111:0/3242437353 >> v2:172.21.15.111:3300/0 conn(0x7f426412c310 0x7f426405cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:46.471 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.462+0000 7f42637fe700 1 --2- 172.21.15.111:0/3242437353 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f426412c6f0 0x7f42640a95f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f425c0032f0 tx=0x7f425c0091d0).ready entity=mon.1 client_cookie=6d286506b9613f97 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:46.471 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.463+0000 7f4261ffb700 1 -- 172.21.15.111:0/3242437353 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f425c00b6c0 con 0x7f426412c6f0 2024-04-25T02:20:46.471 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.463+0000 7f4261ffb700 1 -- 172.21.15.111:0/3242437353 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f425c00b820 con 0x7f426412c6f0 2024-04-25T02:20:46.471 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.463+0000 7f4261ffb700 1 -- 172.21.15.111:0/3242437353 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f425c00b990 con 0x7f426412c6f0 2024-04-25T02:20:46.471 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.463+0000 7f42695f9700 1 -- 172.21.15.111:0/3242437353 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f426412c6f0 msgr2=0x7f42640a95f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:46.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.463+0000 7f42695f9700 1 --2- 172.21.15.111:0/3242437353 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f426412c6f0 0x7f42640a95f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f425c0032f0 tx=0x7f425c0091d0).stop 2024-04-25T02:20:46.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.463+0000 7f42695f9700 1 -- 172.21.15.111:0/3242437353 shutdown_connections 2024-04-25T02:20:46.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.463+0000 7f42695f9700 1 --2- 172.21.15.111:0/3242437353 >> v2:172.21.15.111:3300/0 conn(0x7f426412c310 0x7f426405cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:46.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.463+0000 7f42695f9700 1 --2- 172.21.15.111:0/3242437353 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f426412c6f0 0x7f42640a95f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:46.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.463+0000 7f42695f9700 1 -- 172.21.15.111:0/3242437353 >> 172.21.15.111:0/3242437353 conn(0x7f4264066b10 msgr2=0x7f426406c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:46.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.463+0000 7f42695f9700 1 -- 172.21.15.111:0/3242437353 shutdown_connections 2024-04-25T02:20:46.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.463+0000 7f42695f9700 1 -- 172.21.15.111:0/3242437353 wait complete. 2024-04-25T02:20:46.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.464+0000 7f42695f9700 1 Processor -- start 2024-04-25T02:20:46.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.464+0000 7f42695f9700 1 -- start start 2024-04-25T02:20:46.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.465+0000 7f42695f9700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f426412c310 0x7f42640a47a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:46.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.465+0000 7f42695f9700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f426412c6f0 0x7f42640a5620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:46.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.465+0000 7f42695f9700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4264149660 0x7f4264149ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:46.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.465+0000 7f42695f9700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42640a40a0 con 0x7f426412c310 2024-04-25T02:20:46.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.465+0000 7f42695f9700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42641493c0 con 0x7f426412c6f0 2024-04-25T02:20:46.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.465+0000 7f42695f9700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f42640a4320 con 0x7f4264149660 2024-04-25T02:20:46.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.465+0000 7f42627fc700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f426412c6f0 0x7f42640a5620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:46.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.465+0000 7f4262ffd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f426412c310 0x7f42640a47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:46.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.465+0000 7f42637fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4264149660 0x7f4264149ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:46.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.465+0000 7f42627fc700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f426412c6f0 0x7f42640a5620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:36426/0 (socket says 172.21.15.111:36426) 2024-04-25T02:20:46.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.465+0000 7f42627fc700 1 -- 172.21.15.111:0/2742645341 learned_addr learned my addr 172.21.15.111:0/2742645341 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:46.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.465+0000 7f42627fc700 1 -- 172.21.15.111:0/2742645341 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4264149660 msgr2=0x7f4264149ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:46.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.465+0000 7f42627fc700 1 --2- 172.21.15.111:0/2742645341 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4264149660 0x7f4264149ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:46.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.465+0000 7f42627fc700 1 -- 172.21.15.111:0/2742645341 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f426412c310 msgr2=0x7f42640a47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:46.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.465+0000 7f42627fc700 1 --2- 172.21.15.111:0/2742645341 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f426412c310 0x7f42640a47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:46.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.465+0000 7f42627fc700 1 -- 172.21.15.111:0/2742645341 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f425800b180 con 0x7f426412c6f0 2024-04-25T02:20:46.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.465+0000 7f4262ffd700 1 --2- 172.21.15.111:0/2742645341 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f426412c310 0x7f42640a47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:46.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.465+0000 7f42627fc700 1 --2- 172.21.15.111:0/2742645341 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f426412c6f0 0x7f42640a5620 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f4264067400 tx=0x7f4254007c40).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:46.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.465+0000 7f4253fff700 1 -- 172.21.15.111:0/2742645341 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f42540070d0 con 0x7f426412c6f0 2024-04-25T02:20:46.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.465+0000 7f4253fff700 1 -- 172.21.15.111:0/2742645341 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4254007230 con 0x7f426412c6f0 2024-04-25T02:20:46.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.465+0000 7f42695f9700 1 -- 172.21.15.111:0/2742645341 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f425c009470 con 0x7f426412c6f0 2024-04-25T02:20:46.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.465+0000 7f4253fff700 1 -- 172.21.15.111:0/2742645341 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4254005610 con 0x7f426412c6f0 2024-04-25T02:20:46.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.465+0000 7f42695f9700 1 -- 172.21.15.111:0/2742645341 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42640a6770 con 0x7f426412c6f0 2024-04-25T02:20:46.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.466+0000 7f4253fff700 1 -- 172.21.15.111:0/2742645341 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f4254010070 con 0x7f426412c6f0 2024-04-25T02:20:46.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.466+0000 7f42695f9700 1 -- 172.21.15.111:0/2742645341 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f426412d2a0 con 0x7f426412c6f0 2024-04-25T02:20:46.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.466+0000 7f4253fff700 1 -- 172.21.15.111:0/2742645341 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f4254049d70 con 0x7f426412c6f0 2024-04-25T02:20:46.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.469+0000 7f4253fff700 1 -- 172.21.15.111:0/2742645341 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f425402ec70 con 0x7f426412c6f0 2024-04-25T02:20:46.584 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.580+0000 7f42695f9700 1 -- 172.21.15.111:0/2742645341 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4264137cb0 con 0x7f426412c6f0 2024-04-25T02:20:46.584 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.580+0000 7f4253fff700 1 -- 172.21.15.111:0/2742645341 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v19) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4254032290 con 0x7f426412c6f0 2024-04-25T02:20:46.584 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 32 2024-04-25T02:20:46.585 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.581+0000 7f42695f9700 1 -- 172.21.15.111:0/2742645341 >> v1:172.21.15.111:6816/39585 conn(0x7f4240038ef0 legacy=0x7f424003b3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:46.585 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.581+0000 7f42695f9700 1 -- 172.21.15.111:0/2742645341 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f426412c6f0 msgr2=0x7f42640a5620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:46.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.581+0000 7f42695f9700 1 --2- 172.21.15.111:0/2742645341 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f426412c6f0 0x7f42640a5620 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f4264067400 tx=0x7f4254007c40).stop 2024-04-25T02:20:46.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.581+0000 7f42695f9700 1 -- 172.21.15.111:0/2742645341 shutdown_connections 2024-04-25T02:20:46.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.581+0000 7f42695f9700 1 --2- 172.21.15.111:0/2742645341 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4264149660 0x7f4264149ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:46.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.581+0000 7f42695f9700 1 --2- 172.21.15.111:0/2742645341 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f426412c310 0x7f42640a47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:46.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.581+0000 7f42695f9700 1 --2- 172.21.15.111:0/2742645341 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f426412c6f0 0x7f42640a5620 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:46.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.581+0000 7f42695f9700 1 -- 172.21.15.111:0/2742645341 >> 172.21.15.111:0/2742645341 conn(0x7f4264066b10 msgr2=0x7f426405ba50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:46.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.581+0000 7f42695f9700 1 -- 172.21.15.111:0/2742645341 shutdown_connections 2024-04-25T02:20:46.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.581+0000 7f42695f9700 1 -- 172.21.15.111:0/2742645341 wait complete. 2024-04-25T02:20:46.595 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:20:46.701 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.698+0000 7fcd42870700 1 Processor -- start 2024-04-25T02:20:46.702 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.698+0000 7fcd42870700 1 -- start start 2024-04-25T02:20:46.704 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.698+0000 7fcd42870700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fcd3c139c10 0x7fcd3c139ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:46.704 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.698+0000 7fcd42870700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcd3c097990 0x7fcd3c05c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:46.704 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.698+0000 7fcd42870700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd3c13a4e0 con 0x7fcd3c097580 2024-04-25T02:20:46.704 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.698+0000 7fcd42870700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd3c099610 con 0x7fcd3c139c10 2024-04-25T02:20:46.704 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.698+0000 7fcd42870700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3c096f80 con 0x7fcd3c097990 2024-04-25T02:20:46.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.698+0000 7fcd3bfff700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fcd3c139c10 0x7fcd3c139ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:46.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.698+0000 7fcd40e0d700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcd3c097990 0x7fcd3c05c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:46.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.698+0000 7fcd3b7fe700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7fcd3c097580 0x7fcd3c05ba50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:57140/0 (socket says 172.21.15.111:57140) 2024-04-25T02:20:46.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.698+0000 7fcd3b7fe700 1 -- 172.21.15.111:0/3675110427 learned_addr learned my addr 172.21.15.111:0/3675110427 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:20:46.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.699+0000 7fcd3bfff700 1 -- 172.21.15.111:0/3675110427 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcd3c097990 msgr2=0x7fcd3c05c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:46.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.699+0000 7fcd3bfff700 1 --2- 172.21.15.111:0/3675110427 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcd3c097990 0x7fcd3c05c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:46.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.699+0000 7fcd3bfff700 1 -- 172.21.15.111:0/3675110427 >> v1:172.21.15.111:6789/0 conn(0x7fcd3c097580 legacy=0x7fcd3c05ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:46.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.699+0000 7fcd3affd700 1 -- 172.21.15.111:0/3675110427 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2429256685 0 0) 0x7fcd3c13a4e0 con 0x7fcd3c097580 2024-04-25T02:20:46.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.699+0000 7fcd3bfff700 1 -- 172.21.15.111:0/3675110427 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd3c139730 con 0x7fcd3c139c10 2024-04-25T02:20:46.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.699+0000 7fcd3bfff700 1 --2- 172.21.15.111:0/3675110427 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcd3c139c10 0x7fcd3c139ff0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fcd24002f70 tx=0x7fcd24006df0).ready entity=mon.0 client_cookie=23243acfb291d5d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:46.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.699+0000 7fcd3affd700 1 -- 172.21.15.111:0/3675110427 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd2400d570 con 0x7fcd3c139c10 2024-04-25T02:20:46.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.699+0000 7fcd3affd700 1 -- 172.21.15.111:0/3675110427 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd24000e90 con 0x7fcd3c139c10 2024-04-25T02:20:46.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.699+0000 7fcd3affd700 1 -- 172.21.15.111:0/3675110427 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd2400d8c0 con 0x7fcd3c139c10 2024-04-25T02:20:46.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.699+0000 7fcd42870700 1 -- 172.21.15.111:0/3675110427 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcd3c139c10 msgr2=0x7fcd3c139ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:46.706 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.699+0000 7fcd42870700 1 --2- 172.21.15.111:0/3675110427 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcd3c139c10 0x7fcd3c139ff0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7fcd24002f70 tx=0x7fcd24006df0).stop 2024-04-25T02:20:46.706 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.699+0000 7fcd42870700 1 -- 172.21.15.111:0/3675110427 shutdown_connections 2024-04-25T02:20:46.706 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.699+0000 7fcd42870700 1 --2- 172.21.15.111:0/3675110427 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcd3c139c10 0x7fcd3c139ff0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:46.706 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.699+0000 7fcd42870700 1 --2- 172.21.15.111:0/3675110427 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcd3c097990 0x7fcd3c05c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:46.706 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.699+0000 7fcd42870700 1 -- 172.21.15.111:0/3675110427 >> 172.21.15.111:0/3675110427 conn(0x7fcd3c0614e0 msgr2=0x7fcd3c06c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:46.706 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.699+0000 7fcd42870700 1 -- 172.21.15.111:0/3675110427 shutdown_connections 2024-04-25T02:20:46.706 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.699+0000 7fcd42870700 1 -- 172.21.15.111:0/3675110427 wait complete. 2024-04-25T02:20:46.706 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.700+0000 7fcd42870700 1 Processor -- start 2024-04-25T02:20:46.706 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.700+0000 7fcd42870700 1 -- start start 2024-04-25T02:20:46.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.701+0000 7fcd42870700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcd3c097580 0x7fcd3c0642c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:46.709 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.701+0000 7fcd42870700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcd3c097990 0x7fcd3c130df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:46.709 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.701+0000 7fcd42870700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fcd3c139c10 0x7fcd3c1312e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:46.709 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.701+0000 7fcd42870700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3c09b4c0 con 0x7fcd3c097990 2024-04-25T02:20:46.709 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.701+0000 7fcd42870700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3c0675f0 con 0x7fcd3c097580 2024-04-25T02:20:46.709 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.701+0000 7fcd42870700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3c064bf0 con 0x7fcd3c139c10 2024-04-25T02:20:46.709 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.701+0000 7fcd3bfff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcd3c097580 0x7fcd3c0642c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:46.709 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.701+0000 7fcd3bfff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcd3c097580 0x7fcd3c0642c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:36450/0 (socket says 172.21.15.111:36450) 2024-04-25T02:20:46.709 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.701+0000 7fcd3bfff700 1 -- 172.21.15.111:0/538628765 learned_addr learned my addr 172.21.15.111:0/538628765 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:46.709 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.701+0000 7fcd3b7fe700 1 --2- 172.21.15.111:0/538628765 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcd3c097990 0x7fcd3c130df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:46.709 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.701+0000 7fcd40e0d700 1 --2- 172.21.15.111:0/538628765 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fcd3c139c10 0x7fcd3c1312e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:46.709 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.701+0000 7fcd3b7fe700 1 -- 172.21.15.111:0/538628765 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fcd3c139c10 msgr2=0x7fcd3c1312e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:46.709 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.701+0000 7fcd3b7fe700 1 --2- 172.21.15.111:0/538628765 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fcd3c139c10 0x7fcd3c1312e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:46.709 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.701+0000 7fcd3b7fe700 1 -- 172.21.15.111:0/538628765 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcd3c097580 msgr2=0x7fcd3c0642c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:46.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.701+0000 7fcd3b7fe700 1 --2- 172.21.15.111:0/538628765 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcd3c097580 0x7fcd3c0642c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:46.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.701+0000 7fcd3b7fe700 1 -- 172.21.15.111:0/538628765 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd2400b180 con 0x7fcd3c097990 2024-04-25T02:20:46.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.701+0000 7fcd3bfff700 1 --2- 172.21.15.111:0/538628765 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcd3c097580 0x7fcd3c0642c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:46.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.701+0000 7fcd3b7fe700 1 --2- 172.21.15.111:0/538628765 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcd3c097990 0x7fcd3c130df0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fcd2c000bc0 tx=0x7fcd2c0079e0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:46.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.702+0000 7fcd397fa700 1 -- 172.21.15.111:0/538628765 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd2c00ce00 con 0x7fcd3c097990 2024-04-25T02:20:46.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.702+0000 7fcd397fa700 1 -- 172.21.15.111:0/538628765 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd2c0070d0 con 0x7fcd3c097990 2024-04-25T02:20:46.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.702+0000 7fcd397fa700 1 -- 172.21.15.111:0/538628765 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fcd2c007430 con 0x7fcd3c097990 2024-04-25T02:20:46.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.702+0000 7fcd42870700 1 -- 172.21.15.111:0/538628765 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd3c064eb0 con 0x7fcd3c097990 2024-04-25T02:20:46.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.702+0000 7fcd42870700 1 -- 172.21.15.111:0/538628765 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd3c1317d0 con 0x7fcd3c097990 2024-04-25T02:20:46.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.703+0000 7fcd397fa700 1 -- 172.21.15.111:0/538628765 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fcd2c010070 con 0x7fcd3c097990 2024-04-25T02:20:46.711 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.702+0000 7fcd42870700 1 -- 172.21.15.111:0/538628765 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd3c067790 con 0x7fcd3c097990 2024-04-25T02:20:46.711 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.703+0000 7fcd397fa700 1 -- 172.21.15.111:0/538628765 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fcd2c049d50 con 0x7fcd3c097990 2024-04-25T02:20:46.711 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.706+0000 7fcd397fa700 1 -- 172.21.15.111:0/538628765 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fcd3c067790 con 0x7fcd3c097990 2024-04-25T02:20:46.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.816+0000 7fcd42870700 1 -- 172.21.15.111:0/538628765 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcd3c067790 con 0x7fcd3c097990 2024-04-25T02:20:46.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.816+0000 7fcd397fa700 1 -- 172.21.15.111:0/538628765 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v19) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcd3c067790 con 0x7fcd3c097990 2024-04-25T02:20:46.820 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 64 2024-04-25T02:20:46.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.817+0000 7fcd42870700 1 -- 172.21.15.111:0/538628765 >> v1:172.21.15.111:6816/39585 conn(0x7fcd20038ec0 legacy=0x7fcd2003b380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:46.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.817+0000 7fcd42870700 1 -- 172.21.15.111:0/538628765 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcd3c097990 msgr2=0x7fcd3c130df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:46.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.817+0000 7fcd42870700 1 --2- 172.21.15.111:0/538628765 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcd3c097990 0x7fcd3c130df0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fcd2c000bc0 tx=0x7fcd2c0079e0).stop 2024-04-25T02:20:46.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.817+0000 7fcd42870700 1 -- 172.21.15.111:0/538628765 shutdown_connections 2024-04-25T02:20:46.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.817+0000 7fcd42870700 1 --2- 172.21.15.111:0/538628765 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fcd3c139c10 0x7fcd3c1312e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:46.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.817+0000 7fcd42870700 1 --2- 172.21.15.111:0/538628765 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcd3c097580 0x7fcd3c0642c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:46.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.817+0000 7fcd42870700 1 --2- 172.21.15.111:0/538628765 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcd3c097990 0x7fcd3c130df0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:46.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.817+0000 7fcd42870700 1 -- 172.21.15.111:0/538628765 >> 172.21.15.111:0/538628765 conn(0x7fcd3c0614e0 msgr2=0x7fcd3c098340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:46.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.818+0000 7fcd42870700 1 -- 172.21.15.111:0/538628765 shutdown_connections 2024-04-25T02:20:46.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.818+0000 7fcd42870700 1 -- 172.21.15.111:0/538628765 wait complete. 2024-04-25T02:20:46.832 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:20:46.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.929+0000 7f952350b700 1 Processor -- start 2024-04-25T02:20:46.934 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.929+0000 7f952350b700 1 -- start start 2024-04-25T02:20:46.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.930+0000 7f952350b700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f951c139c10 0x7f951c139ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:46.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.930+0000 7f952350b700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f951c097580 0x7f951c05ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:46.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.930+0000 7f952350b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f951c097960 0x7f951c05bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:46.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.930+0000 7f952350b700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f951c099610 con 0x7f951c097580 2024-04-25T02:20:46.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.930+0000 7f952350b700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f951c13a4e0 con 0x7f951c139c10 2024-04-25T02:20:46.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.930+0000 7f952350b700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f951c096f80 con 0x7f951c097960 2024-04-25T02:20:46.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.930+0000 7f9520aa6700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f951c097580 0x7f951c05ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:46.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.930+0000 7f9521aa8700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f951c097960 0x7f951c05bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:46.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.930+0000 7f95212a7700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f951c139c10 0x7f951c139ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:46.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.930+0000 7f9520aa6700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f951c097580 0x7f951c05ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:40780/0 (socket says 172.21.15.111:40780) 2024-04-25T02:20:46.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.930+0000 7f9521aa8700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f951c097960 0x7f951c05bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:45100/0 (socket says 172.21.15.111:45100) 2024-04-25T02:20:46.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.930+0000 7f9520aa6700 1 -- 172.21.15.111:0/439453846 learned_addr learned my addr 172.21.15.111:0/439453846 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:46.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.930+0000 7f9520aa6700 1 -- 172.21.15.111:0/439453846 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f951c097960 msgr2=0x7f951c05bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:46.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.931+0000 7f9520aa6700 1 --2- 172.21.15.111:0/439453846 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f951c097960 0x7f951c05bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:46.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.931+0000 7f9520aa6700 1 -- 172.21.15.111:0/439453846 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f951c139c10 msgr2=0x7f951c139ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:46.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.931+0000 7f9520aa6700 1 --2- 172.21.15.111:0/439453846 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f951c139c10 0x7f951c139ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:46.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.931+0000 7f9520aa6700 1 -- 172.21.15.111:0/439453846 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f951c139730 con 0x7f951c097580 2024-04-25T02:20:46.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.931+0000 7f95212a7700 1 --2- 172.21.15.111:0/439453846 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f951c139c10 0x7f951c139ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:46.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.931+0000 7f9521aa8700 1 --2- 172.21.15.111:0/439453846 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f951c097960 0x7f951c05bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:46.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.931+0000 7f9520aa6700 1 --2- 172.21.15.111:0/439453846 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f951c097580 0x7f951c05ba50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f951c060f80 tx=0x7f950c006eb0).ready entity=mon.0 client_cookie=bcb8ddeaa70235b4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:46.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.931+0000 7f950bfff700 1 -- 172.21.15.111:0/439453846 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f950c00d570 con 0x7f951c097580 2024-04-25T02:20:46.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.931+0000 7f950bfff700 1 -- 172.21.15.111:0/439453846 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f950c000e90 con 0x7f951c097580 2024-04-25T02:20:46.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.931+0000 7f950bfff700 1 -- 172.21.15.111:0/439453846 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f950c00d900 con 0x7f951c097580 2024-04-25T02:20:46.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.931+0000 7f952350b700 1 -- 172.21.15.111:0/439453846 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f951c097580 msgr2=0x7f951c05ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:46.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.931+0000 7f952350b700 1 --2- 172.21.15.111:0/439453846 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f951c097580 0x7f951c05ba50 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f951c060f80 tx=0x7f950c006eb0).stop 2024-04-25T02:20:46.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.931+0000 7f952350b700 1 -- 172.21.15.111:0/439453846 shutdown_connections 2024-04-25T02:20:46.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.931+0000 7f952350b700 1 --2- 172.21.15.111:0/439453846 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f951c097960 0x7f951c05bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:46.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.931+0000 7f952350b700 1 --2- 172.21.15.111:0/439453846 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f951c139c10 0x7f951c139ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:46.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.931+0000 7f952350b700 1 --2- 172.21.15.111:0/439453846 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f951c097580 0x7f951c05ba50 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:46.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.931+0000 7f952350b700 1 -- 172.21.15.111:0/439453846 >> 172.21.15.111:0/439453846 conn(0x7f951c0614e0 msgr2=0x7f951c06c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:46.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.931+0000 7f952350b700 1 -- 172.21.15.111:0/439453846 shutdown_connections 2024-04-25T02:20:46.939 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.931+0000 7f952350b700 1 -- 172.21.15.111:0/439453846 wait complete. 2024-04-25T02:20:46.939 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.932+0000 7f952350b700 1 Processor -- start 2024-04-25T02:20:46.939 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.932+0000 7f952350b700 1 -- start start 2024-04-25T02:20:46.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.933+0000 7f952350b700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f951c097580 0x7f951c062a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:46.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.933+0000 7f952350b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f951c097960 0x7f951c148bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:46.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.933+0000 7f952350b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f951c139c10 0x7f951c1490c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:46.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.933+0000 7f952350b700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f951c0636f0 con 0x7f951c097960 2024-04-25T02:20:46.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.933+0000 7f952350b700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f951c063f00 con 0x7f951c097580 2024-04-25T02:20:46.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.933+0000 7f952350b700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f951c063430 con 0x7f951c139c10 2024-04-25T02:20:46.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.933+0000 7f9520aa6700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f951c097960 0x7f951c148bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:46.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.933+0000 7f9521aa8700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f951c139c10 0x7f951c1490c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:46.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.933+0000 7f9520aa6700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f951c097960 0x7f951c148bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:40784/0 (socket says 172.21.15.111:40784) 2024-04-25T02:20:46.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.933+0000 7f9520aa6700 1 -- 172.21.15.111:0/2830817252 learned_addr learned my addr 172.21.15.111:0/2830817252 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:46.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.933+0000 7f95212a7700 1 --2- 172.21.15.111:0/2830817252 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f951c097580 0x7f951c062a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:46.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.933+0000 7f9520aa6700 1 -- 172.21.15.111:0/2830817252 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f951c139c10 msgr2=0x7f951c1490c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:46.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.933+0000 7f9520aa6700 1 --2- 172.21.15.111:0/2830817252 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f951c139c10 0x7f951c1490c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:46.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.933+0000 7f9520aa6700 1 -- 172.21.15.111:0/2830817252 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f951c097580 msgr2=0x7f951c062a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:46.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.933+0000 7f9520aa6700 1 --2- 172.21.15.111:0/2830817252 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f951c097580 0x7f951c062a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:46.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.933+0000 7f9520aa6700 1 -- 172.21.15.111:0/2830817252 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9514009470 con 0x7f951c097960 2024-04-25T02:20:46.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.933+0000 7f9520aa6700 1 --2- 172.21.15.111:0/2830817252 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f951c097960 0x7f951c148bd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f951c060f80 tx=0x7f950c015000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:46.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.933+0000 7f950a7fc700 1 -- 172.21.15.111:0/2830817252 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f950c0068b0 con 0x7f951c097960 2024-04-25T02:20:46.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.933+0000 7f950a7fc700 1 -- 172.21.15.111:0/2830817252 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f950c002f50 con 0x7f951c097960 2024-04-25T02:20:46.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.933+0000 7f950a7fc700 1 -- 172.21.15.111:0/2830817252 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f950c011e20 con 0x7f951c097960 2024-04-25T02:20:46.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.933+0000 7f952350b700 1 -- 172.21.15.111:0/2830817252 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f951800b180 con 0x7f951c097960 2024-04-25T02:20:46.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.934+0000 7f952350b700 1 -- 172.21.15.111:0/2830817252 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f950c00b1e0 con 0x7f951c097960 2024-04-25T02:20:46.943 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.934+0000 7f950a7fc700 1 -- 172.21.15.111:0/2830817252 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f950c025030 con 0x7f951c097960 2024-04-25T02:20:46.943 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.934+0000 7f952350b700 1 -- 172.21.15.111:0/2830817252 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f951c1399f0 con 0x7f951c097960 2024-04-25T02:20:46.943 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.935+0000 7f950a7fc700 1 -- 172.21.15.111:0/2830817252 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f950c04ba20 con 0x7f951c097960 2024-04-25T02:20:46.943 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:46.938+0000 7f950a7fc700 1 -- 172.21.15.111:0/2830817252 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f950c01e460 con 0x7f951c097960 2024-04-25T02:20:47.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.077+0000 7f952350b700 1 -- 172.21.15.111:0/2830817252 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f951c134740 con 0x7f951c097960 2024-04-25T02:20:47.081 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.077+0000 7f950a7fc700 1 -- 172.21.15.111:0/2830817252 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) v1 ==== 93+0+2326 (secure 0 0 0) 0x7f950c023930 con 0x7f951c097960 2024-04-25T02:20:47.082 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:20:47.082 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":8,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4193,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6817/3699616235","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6817","nonce":3699616235}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":8,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:20:24.150791+0000","modified":"2024-04-25T02:20:27.234975+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":4239,"mds_1":4236},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4236":{"gid":4236,"name":"c","rank":1,"incarnation":7,"state":"up:active","state_seq":4,"addr":"172.21.15.111:6818/2165982859","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6818","nonce":2165982859}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4239":{"gid":4239,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.111:6819/4003866251","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6819","nonce":4003866251}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-25T02:20:47.083 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.079+0000 7f952350b700 1 -- 172.21.15.111:0/2830817252 >> v1:172.21.15.111:6816/39585 conn(0x7f94fc038dd0 legacy=0x7f94fc03b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:47.084 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.079+0000 7f952350b700 1 -- 172.21.15.111:0/2830817252 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f951c097960 msgr2=0x7f951c148bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:47.084 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.079+0000 7f952350b700 1 --2- 172.21.15.111:0/2830817252 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f951c097960 0x7f951c148bd0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f951c060f80 tx=0x7f950c015000).stop 2024-04-25T02:20:47.084 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.079+0000 7f952350b700 1 -- 172.21.15.111:0/2830817252 shutdown_connections 2024-04-25T02:20:47.084 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.079+0000 7f952350b700 1 --2- 172.21.15.111:0/2830817252 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f951c139c10 0x7f951c1490c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:47.084 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.079+0000 7f952350b700 1 --2- 172.21.15.111:0/2830817252 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f951c097580 0x7f951c062a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:47.084 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.079+0000 7f952350b700 1 --2- 172.21.15.111:0/2830817252 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f951c097960 0x7f951c148bd0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:47.084 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.079+0000 7f952350b700 1 -- 172.21.15.111:0/2830817252 >> 172.21.15.111:0/2830817252 conn(0x7f951c0614e0 msgr2=0x7f951c0a79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:47.084 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.079+0000 7f952350b700 1 -- 172.21.15.111:0/2830817252 shutdown_connections 2024-04-25T02:20:47.084 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.079+0000 7f952350b700 1 -- 172.21.15.111:0/2830817252 wait complete. 2024-04-25T02:20:47.084 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 8 2024-04-25T02:20:47.093 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:20:47.195 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.192+0000 7f7a3585f700 1 Processor -- start 2024-04-25T02:20:47.195 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.192+0000 7f7a3585f700 1 -- start start 2024-04-25T02:20:47.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.193+0000 7f7a3585f700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f7a30139e30 0x7f7a3009c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:47.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.193+0000 7f7a3585f700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7a300aa970 0x7f7a3009ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:47.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.193+0000 7f7a3585f700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7a3013a210 0x7f7a30061390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:47.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.193+0000 7f7a3585f700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a3009b2f0 con 0x7f7a30139e30 2024-04-25T02:20:47.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.193+0000 7f7a3585f700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a30061cc0 con 0x7f7a3013a210 2024-04-25T02:20:47.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.193+0000 7f7a3585f700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a301395d0 con 0x7f7a300aa970 2024-04-25T02:20:47.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.193+0000 7f7a2f7fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7a3013a210 0x7f7a30061390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:47.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.193+0000 7f7a2effd700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f7a30139e30 0x7f7a3009c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:47.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.193+0000 7f7a2e7fc700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7a300aa970 0x7f7a3009ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:47.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.193+0000 7f7a2f7fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7a3013a210 0x7f7a30061390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:36484/0 (socket says 172.21.15.111:36484) 2024-04-25T02:20:47.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.193+0000 7f7a2effd700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f7a30139e30 0x7f7a3009c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:40798/0 (socket says 172.21.15.111:40798) 2024-04-25T02:20:47.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.193+0000 7f7a2f7fe700 1 -- 172.21.15.111:0/3774012239 learned_addr learned my addr 172.21.15.111:0/3774012239 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:47.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.193+0000 7f7a2f7fe700 1 -- 172.21.15.111:0/3774012239 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7a300aa970 msgr2=0x7f7a3009ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:47.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.193+0000 7f7a2f7fe700 1 --2- 172.21.15.111:0/3774012239 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7a300aa970 0x7f7a3009ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:47.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.193+0000 7f7a2f7fe700 1 -- 172.21.15.111:0/3774012239 >> v2:172.21.15.111:3300/0 conn(0x7f7a30139e30 msgr2=0x7f7a3009c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:47.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.193+0000 7f7a2f7fe700 1 --2- 172.21.15.111:0/3774012239 >> v2:172.21.15.111:3300/0 conn(0x7f7a30139e30 0x7f7a3009c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:47.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.193+0000 7f7a2f7fe700 1 -- 172.21.15.111:0/3774012239 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a30061880 con 0x7f7a3013a210 2024-04-25T02:20:47.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.193+0000 7f7a2effd700 1 --2- 172.21.15.111:0/3774012239 >> v2:172.21.15.111:3300/0 conn(0x7f7a30139e30 0x7f7a3009c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:47.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.193+0000 7f7a2e7fc700 1 --2- 172.21.15.111:0/3774012239 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7a300aa970 0x7f7a3009ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:47.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.193+0000 7f7a2f7fe700 1 --2- 172.21.15.111:0/3774012239 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7a3013a210 0x7f7a30061390 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f7a280032f0 tx=0x7f7a28009290).ready entity=mon.1 client_cookie=abb2b04191db34be server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:47.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.193+0000 7f7a2dffb700 1 -- 172.21.15.111:0/3774012239 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a2800b6c0 con 0x7f7a3013a210 2024-04-25T02:20:47.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.193+0000 7f7a2dffb700 1 -- 172.21.15.111:0/3774012239 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2800b820 con 0x7f7a3013a210 2024-04-25T02:20:47.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.193+0000 7f7a2dffb700 1 -- 172.21.15.111:0/3774012239 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a2800b990 con 0x7f7a3013a210 2024-04-25T02:20:47.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.193+0000 7f7a3585f700 1 -- 172.21.15.111:0/3774012239 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7a3013a210 msgr2=0x7f7a30061390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:47.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.193+0000 7f7a3585f700 1 --2- 172.21.15.111:0/3774012239 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7a3013a210 0x7f7a30061390 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7f7a280032f0 tx=0x7f7a28009290).stop 2024-04-25T02:20:47.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.193+0000 7f7a3585f700 1 -- 172.21.15.111:0/3774012239 shutdown_connections 2024-04-25T02:20:47.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.193+0000 7f7a3585f700 1 --2- 172.21.15.111:0/3774012239 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7a3013a210 0x7f7a30061390 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:47.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.193+0000 7f7a3585f700 1 --2- 172.21.15.111:0/3774012239 >> v2:172.21.15.111:3300/0 conn(0x7f7a30139e30 0x7f7a3009c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:47.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.193+0000 7f7a3585f700 1 --2- 172.21.15.111:0/3774012239 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7a300aa970 0x7f7a3009ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:47.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.193+0000 7f7a3585f700 1 -- 172.21.15.111:0/3774012239 >> 172.21.15.111:0/3774012239 conn(0x7f7a3005c060 msgr2=0x7f7a3005c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:47.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.193+0000 7f7a3585f700 1 -- 172.21.15.111:0/3774012239 shutdown_connections 2024-04-25T02:20:47.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.193+0000 7f7a3585f700 1 -- 172.21.15.111:0/3774012239 wait complete. 2024-04-25T02:20:47.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.194+0000 7f7a3585f700 1 Processor -- start 2024-04-25T02:20:47.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.194+0000 7f7a3585f700 1 -- start start 2024-04-25T02:20:47.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.194+0000 7f7a3585f700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7a300aa970 0x7f7a30146270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:47.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.194+0000 7f7a3585f700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7a30139e30 0x7f7a30094f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:47.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.194+0000 7f7a3585f700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7a3013a210 0x7f7a30135ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:47.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.194+0000 7f7a3585f700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a30149bd0 con 0x7f7a30139e30 2024-04-25T02:20:47.203 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.195+0000 7f7a3585f700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a30094a70 con 0x7f7a300aa970 2024-04-25T02:20:47.203 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.195+0000 7f7a3585f700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7a301490a0 con 0x7f7a3013a210 2024-04-25T02:20:47.203 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.195+0000 7f7a2e7fc700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7a30139e30 0x7f7a30094f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:47.203 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.195+0000 7f7a2f7fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7a3013a210 0x7f7a30135ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:47.203 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.195+0000 7f7a2f7fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7a3013a210 0x7f7a30135ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:45134/0 (socket says 172.21.15.111:45134) 2024-04-25T02:20:47.203 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.195+0000 7f7a2e7fc700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7a30139e30 0x7f7a30094f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:40806/0 (socket says 172.21.15.111:40806) 2024-04-25T02:20:47.203 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.195+0000 7f7a2f7fe700 1 -- 172.21.15.111:0/657952708 learned_addr learned my addr 172.21.15.111:0/657952708 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:47.203 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.195+0000 7f7a2effd700 1 --2- 172.21.15.111:0/657952708 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7a300aa970 0x7f7a30146270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:47.203 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.195+0000 7f7a2f7fe700 1 -- 172.21.15.111:0/657952708 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7a300aa970 msgr2=0x7f7a30146270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:47.203 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.195+0000 7f7a2f7fe700 1 --2- 172.21.15.111:0/657952708 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7a300aa970 0x7f7a30146270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:47.203 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.195+0000 7f7a2f7fe700 1 -- 172.21.15.111:0/657952708 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7a30139e30 msgr2=0x7f7a30094f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:47.203 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.195+0000 7f7a2f7fe700 1 --2- 172.21.15.111:0/657952708 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7a30139e30 0x7f7a30094f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:47.203 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.195+0000 7f7a2f7fe700 1 -- 172.21.15.111:0/657952708 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a2000b180 con 0x7f7a3013a210 2024-04-25T02:20:47.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.195+0000 7f7a2e7fc700 1 --2- 172.21.15.111:0/657952708 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7a30139e30 0x7f7a30094f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:47.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.195+0000 7f7a2f7fe700 1 --2- 172.21.15.111:0/657952708 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7a3013a210 0x7f7a30135ec0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f7a280032f0 tx=0x7f7a28016000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:47.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.195+0000 7f7a1ffff700 1 -- 172.21.15.111:0/657952708 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a2800b6c0 con 0x7f7a3013a210 2024-04-25T02:20:47.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.195+0000 7f7a1ffff700 1 -- 172.21.15.111:0/657952708 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a28021670 con 0x7f7a3013a210 2024-04-25T02:20:47.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.195+0000 7f7a3585f700 1 -- 172.21.15.111:0/657952708 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a2400b180 con 0x7f7a3013a210 2024-04-25T02:20:47.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.195+0000 7f7a1ffff700 1 -- 172.21.15.111:0/657952708 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f7a2800bee0 con 0x7f7a3013a210 2024-04-25T02:20:47.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.195+0000 7f7a3585f700 1 -- 172.21.15.111:0/657952708 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a28009530 con 0x7f7a3013a210 2024-04-25T02:20:47.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.196+0000 7f7a1ffff700 1 -- 172.21.15.111:0/657952708 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f7a2800f070 con 0x7f7a3013a210 2024-04-25T02:20:47.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.196+0000 7f7a3585f700 1 -- 172.21.15.111:0/657952708 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a301490a0 con 0x7f7a3013a210 2024-04-25T02:20:47.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.196+0000 7f7a1ffff700 1 -- 172.21.15.111:0/657952708 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f7a2804b500 con 0x7f7a3013a210 2024-04-25T02:20:47.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.200+0000 7f7a1ffff700 1 -- 172.21.15.111:0/657952708 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f7a280066a0 con 0x7f7a3013a210 2024-04-25T02:20:47.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.312+0000 7f7a3585f700 1 -- 172.21.15.111:0/657952708 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7a30057a60 con 0x7f7a3013a210 2024-04-25T02:20:47.317 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.313+0000 7f7a1ffff700 1 -- 172.21.15.111:0/657952708 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+10566 (secure 0 0 0) 0x7f7a28024e00 con 0x7f7a3013a210 2024-04-25T02:20:47.317 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:20:47.317 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":19,"fsid":"4643f974-f93a-4436-93b8-460ff320e62e","created":"2024-04-25T02:20:05.450475+0000","modified":"2024-04-25T02:20:36.255829+0000","last_up_change":"2024-04-25T02:20:10.439204+0000","last_in_change":"2024-04-25T02:20:10.439204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-25T02:20:07.471248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:20:14.420378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:20:22.251868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T02:20:23.128289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"df3f17ca-3b12-42c8-8cf7-8f1b7189e587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6800","nonce":40214}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6801","nonce":40214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6803","nonce":40214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6802","nonce":40214}]},"public_addr":"172.21.15.111:6800/40214","cluster_addr":"172.21.15.111:6801/40214","heartbeat_back_addr":"172.21.15.111:6803/40214","heartbeat_front_addr":"172.21.15.111:6802/40214","state":["exists","up"]},{"osd":1,"uuid":"93d54815-f215-4285-bba6-32f2d1cabf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6812","nonce":40216}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6813","nonce":40216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6815","nonce":40216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6814","nonce":40216}]},"public_addr":"172.21.15.111:6812/40216","cluster_addr":"172.21.15.111:6813/40216","heartbeat_back_addr":"172.21.15.111:6815/40216","heartbeat_front_addr":"172.21.15.111:6814/40216","state":["exists","up"]},{"osd":2,"uuid":"b26b2104-2a2e-408f-9ce7-3587a32a2ebe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6804","nonce":40215}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6805","nonce":40215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6807","nonce":40215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6806","nonce":40215}]},"public_addr":"172.21.15.111:6804/40215","cluster_addr":"172.21.15.111:6805/40215","heartbeat_back_addr":"172.21.15.111:6807/40215","heartbeat_front_addr":"172.21.15.111:6806/40215","state":["exists","up"]},{"osd":3,"uuid":"43c25820-1edc-4031-badf-72e87dd6bf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6808","nonce":40213}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6809","nonce":40213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6811","nonce":40213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6810","nonce":40213}]},"public_addr":"172.21.15.111:6808/40213","cluster_addr":"172.21.15.111:6809/40213","heartbeat_back_addr":"172.21.15.111:6811/40213","heartbeat_front_addr":"172.21.15.111:6810/40213","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.372427+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.411480+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.361508+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.377212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blacklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{}} 2024-04-25T02:20:47.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.314+0000 7f7a3585f700 1 -- 172.21.15.111:0/657952708 >> v1:172.21.15.111:6816/39585 conn(0x7f7a0c038da0 legacy=0x7f7a0c03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:47.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.314+0000 7f7a3585f700 1 -- 172.21.15.111:0/657952708 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7a3013a210 msgr2=0x7f7a30135ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:47.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.314+0000 7f7a3585f700 1 --2- 172.21.15.111:0/657952708 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7a3013a210 0x7f7a30135ec0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f7a280032f0 tx=0x7f7a28016000).stop 2024-04-25T02:20:47.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.314+0000 7f7a3585f700 1 -- 172.21.15.111:0/657952708 shutdown_connections 2024-04-25T02:20:47.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.314+0000 7f7a3585f700 1 --2- 172.21.15.111:0/657952708 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7a3013a210 0x7f7a30135ec0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:47.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.314+0000 7f7a3585f700 1 --2- 172.21.15.111:0/657952708 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7a300aa970 0x7f7a30146270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:47.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.314+0000 7f7a3585f700 1 --2- 172.21.15.111:0/657952708 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7a30139e30 0x7f7a30094f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:47.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.314+0000 7f7a3585f700 1 -- 172.21.15.111:0/657952708 >> 172.21.15.111:0/657952708 conn(0x7f7a3005c060 msgr2=0x7f7a300679c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:47.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.314+0000 7f7a3585f700 1 -- 172.21.15.111:0/657952708 shutdown_connections 2024-04-25T02:20:47.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.315+0000 7f7a3585f700 1 -- 172.21.15.111:0/657952708 wait complete. 2024-04-25T02:20:47.329 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-25T02:20:47.433 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.429+0000 7f8b66835700 1 Processor -- start 2024-04-25T02:20:47.434 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.429+0000 7f8b66835700 1 -- start start 2024-04-25T02:20:47.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.430+0000 7f8b66835700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8b6005c020 0x7f8b60061c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:47.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.430+0000 7f8b66835700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8b6005c400 0x7f8b600a6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:47.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.430+0000 7f8b66835700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b60062130 con 0x7f8b600a7060 2024-04-25T02:20:47.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.430+0000 7f8b66835700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b600a7500 con 0x7f8b6005c020 2024-04-25T02:20:47.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.430+0000 7f8b66835700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b60067f10 con 0x7f8b6005c400 2024-04-25T02:20:47.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.430+0000 7f8b5ffff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8b6005c020 0x7f8b60061c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:47.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.430+0000 7f8b64dd2700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f8b600a7060 0x7f8b601376c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:57150/0 (socket says 172.21.15.111:57150) 2024-04-25T02:20:47.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.430+0000 7f8b64dd2700 1 -- 172.21.15.111:0/3939504506 learned_addr learned my addr 172.21.15.111:0/3939504506 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:20:47.436 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.430+0000 7f8b5f7fe700 1 --2- 172.21.15.111:0/3939504506 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8b6005c400 0x7f8b600a6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:47.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.430+0000 7f8b5effd700 1 -- 172.21.15.111:0/3939504506 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2771563885 0 0) 0x7f8b60062130 con 0x7f8b600a7060 2024-04-25T02:20:47.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.430+0000 7f8b5ffff700 1 -- 172.21.15.111:0/3939504506 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8b6005c400 msgr2=0x7f8b600a6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:47.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.430+0000 7f8b5ffff700 1 --2- 172.21.15.111:0/3939504506 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8b6005c400 0x7f8b600a6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:47.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.430+0000 7f8b5ffff700 1 -- 172.21.15.111:0/3939504506 >> v1:172.21.15.111:6789/0 conn(0x7f8b600a7060 legacy=0x7f8b601376c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:47.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.430+0000 7f8b5ffff700 1 -- 172.21.15.111:0/3939504506 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b6005bbd0 con 0x7f8b6005c020 2024-04-25T02:20:47.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.430+0000 7f8b5f7fe700 1 --2- 172.21.15.111:0/3939504506 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8b6005c400 0x7f8b600a6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:47.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.431+0000 7f8b5ffff700 1 --2- 172.21.15.111:0/3939504506 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8b6005c020 0x7f8b60061c40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f8b60061b90 tx=0x7f8b54006df0).ready entity=mon.1 client_cookie=c19e50a2fb0a0f36 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:47.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.431+0000 7f8b5effd700 1 -- 172.21.15.111:0/3939504506 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b5400d570 con 0x7f8b6005c020 2024-04-25T02:20:47.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.431+0000 7f8b5effd700 1 -- 172.21.15.111:0/3939504506 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b54000e90 con 0x7f8b6005c020 2024-04-25T02:20:47.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.431+0000 7f8b5effd700 1 -- 172.21.15.111:0/3939504506 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b5400d8c0 con 0x7f8b6005c020 2024-04-25T02:20:47.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.431+0000 7f8b66835700 1 -- 172.21.15.111:0/3939504506 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8b6005c020 msgr2=0x7f8b60061c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:47.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.431+0000 7f8b66835700 1 --2- 172.21.15.111:0/3939504506 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8b6005c020 0x7f8b60061c40 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f8b60061b90 tx=0x7f8b54006df0).stop 2024-04-25T02:20:47.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.431+0000 7f8b66835700 1 -- 172.21.15.111:0/3939504506 shutdown_connections 2024-04-25T02:20:47.437 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.431+0000 7f8b66835700 1 --2- 172.21.15.111:0/3939504506 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8b6005c020 0x7f8b60061c40 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:47.438 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.431+0000 7f8b66835700 1 --2- 172.21.15.111:0/3939504506 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8b6005c400 0x7f8b600a6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:47.438 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.431+0000 7f8b66835700 1 -- 172.21.15.111:0/3939504506 >> 172.21.15.111:0/3939504506 conn(0x7f8b600a8a00 msgr2=0x7f8b600a8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:47.438 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.431+0000 7f8b66835700 1 -- 172.21.15.111:0/3939504506 shutdown_connections 2024-04-25T02:20:47.438 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.431+0000 7f8b66835700 1 -- 172.21.15.111:0/3939504506 wait complete. 2024-04-25T02:20:47.438 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.432+0000 7f8b66835700 1 Processor -- start 2024-04-25T02:20:47.438 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.432+0000 7f8b66835700 1 -- start start 2024-04-25T02:20:47.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.433+0000 7f8b66835700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8b6005c020 0x7f8b60065940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:47.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.433+0000 7f8b66835700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8b6005c400 0x7f8b600643c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:47.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.433+0000 7f8b66835700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8b600a7060 0x7f8b6014a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:47.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.433+0000 7f8b66835700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6014a1f0 con 0x7f8b6005c020 2024-04-25T02:20:47.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.433+0000 7f8b66835700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b60064f80 con 0x7f8b600a7060 2024-04-25T02:20:47.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.433+0000 7f8b66835700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8b60065260 con 0x7f8b6005c400 2024-04-25T02:20:47.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.433+0000 7f8b64dd2700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8b600a7060 0x7f8b6014a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:47.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.433+0000 7f8b5ffff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8b6005c020 0x7f8b60065940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:47.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.433+0000 7f8b64dd2700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8b600a7060 0x7f8b6014a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:36494/0 (socket says 172.21.15.111:36494) 2024-04-25T02:20:47.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.433+0000 7f8b64dd2700 1 -- 172.21.15.111:0/3269530811 learned_addr learned my addr 172.21.15.111:0/3269530811 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:47.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.433+0000 7f8b5f7fe700 1 --2- 172.21.15.111:0/3269530811 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8b6005c400 0x7f8b600643c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:47.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.433+0000 7f8b5ffff700 1 -- 172.21.15.111:0/3269530811 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8b6005c400 msgr2=0x7f8b600643c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:47.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.433+0000 7f8b5ffff700 1 --2- 172.21.15.111:0/3269530811 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8b6005c400 0x7f8b600643c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:47.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.433+0000 7f8b5ffff700 1 -- 172.21.15.111:0/3269530811 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8b600a7060 msgr2=0x7f8b6014a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:47.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.433+0000 7f8b5ffff700 1 --2- 172.21.15.111:0/3269530811 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8b600a7060 0x7f8b6014a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:47.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.433+0000 7f8b5ffff700 1 -- 172.21.15.111:0/3269530811 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b5000b180 con 0x7f8b6005c020 2024-04-25T02:20:47.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.433+0000 7f8b64dd2700 1 --2- 172.21.15.111:0/3269530811 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8b600a7060 0x7f8b6014a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:47.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.433+0000 7f8b5f7fe700 1 --2- 172.21.15.111:0/3269530811 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8b6005c400 0x7f8b600643c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:47.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.433+0000 7f8b5ffff700 1 --2- 172.21.15.111:0/3269530811 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8b6005c020 0x7f8b60065940 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f8b60061b90 tx=0x7f8b54014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:47.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.434+0000 7f8b5d7fa700 1 -- 172.21.15.111:0/3269530811 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b54016070 con 0x7f8b6005c020 2024-04-25T02:20:47.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.434+0000 7f8b5d7fa700 1 -- 172.21.15.111:0/3269530811 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b54002f70 con 0x7f8b6005c020 2024-04-25T02:20:47.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.434+0000 7f8b66835700 1 -- 172.21.15.111:0/3269530811 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b5400b180 con 0x7f8b6005c020 2024-04-25T02:20:47.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.434+0000 7f8b5d7fa700 1 -- 172.21.15.111:0/3269530811 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f8b5400dea0 con 0x7f8b6005c020 2024-04-25T02:20:47.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.434+0000 7f8b66835700 1 -- 172.21.15.111:0/3269530811 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b6009e440 con 0x7f8b6005c020 2024-04-25T02:20:47.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.435+0000 7f8b5d7fa700 1 -- 172.21.15.111:0/3269530811 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f8b54025030 con 0x7f8b6005c020 2024-04-25T02:20:47.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.435+0000 7f8b66835700 1 -- 172.21.15.111:0/3269530811 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b600a7f70 con 0x7f8b6005c020 2024-04-25T02:20:47.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.435+0000 7f8b5d7fa700 1 -- 172.21.15.111:0/3269530811 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f8b5404b850 con 0x7f8b6005c020 2024-04-25T02:20:47.443 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.439+0000 7f8b5d7fa700 1 -- 172.21.15.111:0/3269530811 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f8b54028b70 con 0x7f8b6005c020 2024-04-25T02:20:47.584 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:47.580+0000 7f8b66835700 1 -- 172.21.15.111:0/3269530811 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f8b600653a0 con 0x7f8b6005c020 2024-04-25T02:20:48.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.241+0000 7f8b5d7fa700 1 -- 172.21.15.111:0/3269530811 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v9) v1 ==== 122+0+0 (secure 0 0 0) 0x7f8b600653a0 con 0x7f8b6005c020 2024-04-25T02:20:48.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.242+0000 7f8b66835700 1 -- 172.21.15.111:0/3269530811 >> v1:172.21.15.111:6816/39585 conn(0x7f8b40038e30 legacy=0x7f8b4003b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:48.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.242+0000 7f8b66835700 1 -- 172.21.15.111:0/3269530811 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8b6005c020 msgr2=0x7f8b60065940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:48.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.242+0000 7f8b66835700 1 --2- 172.21.15.111:0/3269530811 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8b6005c020 0x7f8b60065940 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f8b60061b90 tx=0x7f8b54014000).stop 2024-04-25T02:20:48.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.243+0000 7f8b66835700 1 -- 172.21.15.111:0/3269530811 shutdown_connections 2024-04-25T02:20:48.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.243+0000 7f8b66835700 1 --2- 172.21.15.111:0/3269530811 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8b600a7060 0x7f8b6014a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:48.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.243+0000 7f8b66835700 1 --2- 172.21.15.111:0/3269530811 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8b6005c020 0x7f8b60065940 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:48.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.243+0000 7f8b66835700 1 --2- 172.21.15.111:0/3269530811 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8b6005c400 0x7f8b600643c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:48.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.243+0000 7f8b66835700 1 -- 172.21.15.111:0/3269530811 >> 172.21.15.111:0/3269530811 conn(0x7f8b600a8a00 msgr2=0x7f8b601366f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:48.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.243+0000 7f8b66835700 1 -- 172.21.15.111:0/3269530811 shutdown_connections 2024-04-25T02:20:48.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.243+0000 7f8b66835700 1 -- 172.21.15.111:0/3269530811 wait complete. 2024-04-25T02:20:48.256 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 1 2024-04-25T02:20:48.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.357+0000 7f0711a3f700 1 Processor -- start 2024-04-25T02:20:48.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.357+0000 7f0711a3f700 1 -- start start 2024-04-25T02:20:48.362 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.358+0000 7f0711a3f700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f070c094f90 0x7f070c096760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:48.363 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.358+0000 7f0711a3f700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f070c095370 0x7f070c137e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:48.363 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.358+0000 7f0711a3f700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f070c131b90 con 0x7f070c137430 2024-04-25T02:20:48.363 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.358+0000 7f0711a3f700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f070c095750 con 0x7f070c095370 2024-04-25T02:20:48.363 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.358+0000 7f0711a3f700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f070c094ab0 con 0x7f070c094f90 2024-04-25T02:20:48.363 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.358+0000 7f070affd700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f070c094f90 0x7f070c096760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:48.363 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.358+0000 7f070b7fe700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f070c137430 0x7f070c133ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:57154/0 (socket says 172.21.15.111:57154) 2024-04-25T02:20:48.363 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.358+0000 7f070b7fe700 1 -- 172.21.15.111:0/2311072862 learned_addr learned my addr 172.21.15.111:0/2311072862 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:20:48.363 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.358+0000 7f070a7fc700 1 --2- 172.21.15.111:0/2311072862 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f070c095370 0x7f070c137e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:48.363 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.359+0000 7f070affd700 1 -- 172.21.15.111:0/2311072862 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f070c095370 msgr2=0x7f070c137e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:48.363 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.359+0000 7f0709ffb700 1 -- 172.21.15.111:0/2311072862 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4168717 0 0) 0x7f070c131b90 con 0x7f070c137430 2024-04-25T02:20:48.363 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.359+0000 7f070affd700 1 --2- 172.21.15.111:0/2311072862 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f070c095370 0x7f070c137e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:48.363 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.359+0000 7f070affd700 1 -- 172.21.15.111:0/2311072862 >> v1:172.21.15.111:6789/0 conn(0x7f070c137430 legacy=0x7f070c133ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:48.363 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.359+0000 7f070affd700 1 -- 172.21.15.111:0/2311072862 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f070c094d70 con 0x7f070c094f90 2024-04-25T02:20:48.363 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.359+0000 7f070a7fc700 1 --2- 172.21.15.111:0/2311072862 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f070c095370 0x7f070c137e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:48.364 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.359+0000 7f070affd700 1 --2- 172.21.15.111:0/2311072862 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f070c094f90 0x7f070c096760 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f0700002f70 tx=0x7f0700006df0).ready entity=mon.2 client_cookie=4424240330e13e5c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:48.364 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.359+0000 7f0709ffb700 1 -- 172.21.15.111:0/2311072862 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f070000d570 con 0x7f070c094f90 2024-04-25T02:20:48.364 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.359+0000 7f0709ffb700 1 -- 172.21.15.111:0/2311072862 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0700000e90 con 0x7f070c094f90 2024-04-25T02:20:48.364 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.359+0000 7f0709ffb700 1 -- 172.21.15.111:0/2311072862 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f070000d8c0 con 0x7f070c094f90 2024-04-25T02:20:48.364 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.359+0000 7f0711a3f700 1 -- 172.21.15.111:0/2311072862 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f070c094f90 msgr2=0x7f070c096760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:48.364 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.359+0000 7f0711a3f700 1 --2- 172.21.15.111:0/2311072862 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f070c094f90 0x7f070c096760 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f0700002f70 tx=0x7f0700006df0).stop 2024-04-25T02:20:48.364 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.359+0000 7f0711a3f700 1 -- 172.21.15.111:0/2311072862 shutdown_connections 2024-04-25T02:20:48.364 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.359+0000 7f0711a3f700 1 --2- 172.21.15.111:0/2311072862 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f070c094f90 0x7f070c096760 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:48.364 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.359+0000 7f0711a3f700 1 --2- 172.21.15.111:0/2311072862 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f070c095370 0x7f070c137e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:48.364 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.359+0000 7f0711a3f700 1 -- 172.21.15.111:0/2311072862 >> 172.21.15.111:0/2311072862 conn(0x7f070c060340 msgr2=0x7f070c06c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:48.364 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.360+0000 7f0711a3f700 1 -- 172.21.15.111:0/2311072862 shutdown_connections 2024-04-25T02:20:48.364 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.360+0000 7f0711a3f700 1 -- 172.21.15.111:0/2311072862 wait complete. 2024-04-25T02:20:48.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.360+0000 7f0711a3f700 1 Processor -- start 2024-04-25T02:20:48.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.360+0000 7f0711a3f700 1 -- start start 2024-04-25T02:20:48.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.361+0000 7f0711a3f700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f070c094f90 0x7f070c0673b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:48.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.361+0000 7f0711a3f700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f070c095370 0x7f070c1349d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:48.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.361+0000 7f0711a3f700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f070c137430 0x7f070c0626d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:48.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.361+0000 7f0711a3f700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f070c146f20 con 0x7f070c095370 2024-04-25T02:20:48.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.361+0000 7f0711a3f700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f070c1471e0 con 0x7f070c137430 2024-04-25T02:20:48.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.361+0000 7f0711a3f700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f070c062380 con 0x7f070c094f90 2024-04-25T02:20:48.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.361+0000 7f070affd700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f070c094f90 0x7f070c0673b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:48.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.361+0000 7f070a7fc700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f070c095370 0x7f070c1349d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:48.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.361+0000 7f070affd700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f070c094f90 0x7f070c0673b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:45186/0 (socket says 172.21.15.111:45186) 2024-04-25T02:20:48.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.361+0000 7f070a7fc700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f070c095370 0x7f070c1349d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:40818/0 (socket says 172.21.15.111:40818) 2024-04-25T02:20:48.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.361+0000 7f070affd700 1 -- 172.21.15.111:0/372862724 learned_addr learned my addr 172.21.15.111:0/372862724 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:48.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.361+0000 7f070b7fe700 1 --2- 172.21.15.111:0/372862724 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f070c137430 0x7f070c0626d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:48.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.361+0000 7f070affd700 1 -- 172.21.15.111:0/372862724 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f070c137430 msgr2=0x7f070c0626d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:48.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.361+0000 7f070affd700 1 --2- 172.21.15.111:0/372862724 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f070c137430 0x7f070c0626d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:48.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.361+0000 7f070affd700 1 -- 172.21.15.111:0/372862724 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f070c095370 msgr2=0x7f070c1349d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:48.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.361+0000 7f070affd700 1 --2- 172.21.15.111:0/372862724 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f070c095370 0x7f070c1349d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:48.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.361+0000 7f070affd700 1 -- 172.21.15.111:0/372862724 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06fc00b180 con 0x7f070c094f90 2024-04-25T02:20:48.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.361+0000 7f070a7fc700 1 --2- 172.21.15.111:0/372862724 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f070c095370 0x7f070c1349d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:48.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.361+0000 7f070affd700 1 --2- 172.21.15.111:0/372862724 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f070c094f90 0x7f070c0673b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f0700002f70 tx=0x7f0700014000).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:48.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.362+0000 7f06fbfff700 1 -- 172.21.15.111:0/372862724 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0700016070 con 0x7f070c094f90 2024-04-25T02:20:48.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.362+0000 7f06fbfff700 1 -- 172.21.15.111:0/372862724 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0700013bf0 con 0x7f070c094f90 2024-04-25T02:20:48.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.362+0000 7f06fbfff700 1 -- 172.21.15.111:0/372862724 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f070001e450 con 0x7f070c094f90 2024-04-25T02:20:48.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.362+0000 7f0711a3f700 1 -- 172.21.15.111:0/372862724 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f070000b180 con 0x7f070c094f90 2024-04-25T02:20:48.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.362+0000 7f0711a3f700 1 -- 172.21.15.111:0/372862724 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f070c067e30 con 0x7f070c094f90 2024-04-25T02:20:48.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.362+0000 7f06fbfff700 1 -- 172.21.15.111:0/372862724 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f070000f030 con 0x7f070c094f90 2024-04-25T02:20:48.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.362+0000 7f0711a3f700 1 -- 172.21.15.111:0/372862724 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f070c068050 con 0x7f070c094f90 2024-04-25T02:20:48.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.363+0000 7f06fbfff700 1 -- 172.21.15.111:0/372862724 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f070004b520 con 0x7f070c094f90 2024-04-25T02:20:48.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.365+0000 7f06fbfff700 1 -- 172.21.15.111:0/372862724 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f070c068050 con 0x7f070c094f90 2024-04-25T02:20:48.512 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:48.509+0000 7f0711a3f700 1 -- 172.21.15.111:0/372862724 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"} v 0) v1 -- 0x7f070c068050 con 0x7f070c094f90 2024-04-25T02:20:49.245 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.242+0000 7f06fbfff700 1 -- 172.21.15.111:0/372862724 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "1"}]=0 v10) v1 ==== 105+0+0 (secure 0 0 0) 0x7f070c068050 con 0x7f070c094f90 2024-04-25T02:20:49.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.244+0000 7f0711a3f700 1 -- 172.21.15.111:0/372862724 >> v1:172.21.15.111:6816/39585 conn(0x7f06e8038da0 legacy=0x7f06e803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:49.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.244+0000 7f0711a3f700 1 -- 172.21.15.111:0/372862724 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f070c094f90 msgr2=0x7f070c0673b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:49.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.244+0000 7f0711a3f700 1 --2- 172.21.15.111:0/372862724 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f070c094f90 0x7f070c0673b0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f0700002f70 tx=0x7f0700014000).stop 2024-04-25T02:20:49.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.244+0000 7f0711a3f700 1 -- 172.21.15.111:0/372862724 shutdown_connections 2024-04-25T02:20:49.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.244+0000 7f0711a3f700 1 --2- 172.21.15.111:0/372862724 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f070c137430 0x7f070c0626d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:49.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.244+0000 7f0711a3f700 1 --2- 172.21.15.111:0/372862724 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f070c094f90 0x7f070c0673b0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:49.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.244+0000 7f0711a3f700 1 --2- 172.21.15.111:0/372862724 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f070c095370 0x7f070c1349d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:49.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.244+0000 7f0711a3f700 1 -- 172.21.15.111:0/372862724 >> 172.21.15.111:0/372862724 conn(0x7f070c060340 msgr2=0x7f070c0a8900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:49.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.245+0000 7f0711a3f700 1 -- 172.21.15.111:0/372862724 shutdown_connections 2024-04-25T02:20:49.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.245+0000 7f0711a3f700 1 -- 172.21.15.111:0/372862724 wait complete. 2024-04-25T02:20:49.261 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:20:49.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.367+0000 7f9cfd50e700 1 Processor -- start 2024-04-25T02:20:49.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.367+0000 7f9cfd50e700 1 -- start start 2024-04-25T02:20:49.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.368+0000 7f9cfd50e700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9cf8133120 0x7f9cf809c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:49.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.368+0000 7f9cfd50e700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9cf8061460 0x7f9cf8133500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:49.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.368+0000 7f9cfd50e700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f9cf80675f0 0x7f9cf8067aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:49.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.368+0000 7f9cfd50e700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cf809b5d0 con 0x7f9cf80675f0 2024-04-25T02:20:49.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.368+0000 7f9cfd50e700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf80618a0 con 0x7f9cf8133120 2024-04-25T02:20:49.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.368+0000 7f9cfd50e700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf8060a60 con 0x7f9cf8061460 2024-04-25T02:20:49.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.368+0000 7f9cf67fc700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9cf8061460 0x7f9cf8133500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:49.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.368+0000 7f9cf6ffd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9cf8133120 0x7f9cf809c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:49.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.368+0000 7f9cf77fe700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f9cf80675f0 0x7f9cf8067aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:49.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.368+0000 7f9cf67fc700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9cf8061460 0x7f9cf8133500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:45196/0 (socket says 172.21.15.111:45196) 2024-04-25T02:20:49.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.368+0000 7f9cf6ffd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9cf8133120 0x7f9cf809c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:36520/0 (socket says 172.21.15.111:36520) 2024-04-25T02:20:49.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.368+0000 7f9cf67fc700 1 -- 172.21.15.111:0/454882689 learned_addr learned my addr 172.21.15.111:0/454882689 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:49.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.368+0000 7f9cf77fe700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f9cf80675f0 0x7f9cf8067aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:40834/0 (socket says 172.21.15.111:40834) 2024-04-25T02:20:49.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.368+0000 7f9cf77fe700 1 -- 172.21.15.111:0/454882689 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9cf8061460 msgr2=0x7f9cf8133500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:49.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.368+0000 7f9cf77fe700 1 --2- 172.21.15.111:0/454882689 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9cf8061460 0x7f9cf8133500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:49.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.368+0000 7f9cf77fe700 1 -- 172.21.15.111:0/454882689 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9cf8133120 msgr2=0x7f9cf809c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:49.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.368+0000 7f9cf77fe700 1 --2- 172.21.15.111:0/454882689 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9cf8133120 0x7f9cf809c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:49.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.368+0000 7f9cf77fe700 1 -- 172.21.15.111:0/454882689 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf8061b20 con 0x7f9cf80675f0 2024-04-25T02:20:49.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.368+0000 7f9cf6ffd700 1 --2- 172.21.15.111:0/454882689 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9cf8133120 0x7f9cf809c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:49.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.368+0000 7f9cf77fe700 1 --2- 172.21.15.111:0/454882689 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9cf80675f0 0x7f9cf8067aa0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f9cf00032f0 tx=0x7f9cf00091d0).ready entity=mon.0 client_cookie=1186419b4461dd14 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:49.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.368+0000 7f9cf5ffb700 1 -- 172.21.15.111:0/454882689 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9cf000b600 con 0x7f9cf80675f0 2024-04-25T02:20:49.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.368+0000 7f9cf5ffb700 1 -- 172.21.15.111:0/454882689 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf000b760 con 0x7f9cf80675f0 2024-04-25T02:20:49.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.369+0000 7f9cf5ffb700 1 -- 172.21.15.111:0/454882689 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9cf000b8d0 con 0x7f9cf80675f0 2024-04-25T02:20:49.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.369+0000 7f9cfd50e700 1 -- 172.21.15.111:0/454882689 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9cf80675f0 msgr2=0x7f9cf8067aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:49.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.369+0000 7f9cfd50e700 1 --2- 172.21.15.111:0/454882689 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9cf80675f0 0x7f9cf8067aa0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f9cf00032f0 tx=0x7f9cf00091d0).stop 2024-04-25T02:20:49.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.369+0000 7f9cfd50e700 1 -- 172.21.15.111:0/454882689 shutdown_connections 2024-04-25T02:20:49.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.369+0000 7f9cfd50e700 1 --2- 172.21.15.111:0/454882689 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9cf80675f0 0x7f9cf8067aa0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:49.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.369+0000 7f9cfd50e700 1 --2- 172.21.15.111:0/454882689 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9cf8133120 0x7f9cf809c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:49.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.369+0000 7f9cfd50e700 1 --2- 172.21.15.111:0/454882689 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9cf8061460 0x7f9cf8133500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:49.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.369+0000 7f9cfd50e700 1 -- 172.21.15.111:0/454882689 >> 172.21.15.111:0/454882689 conn(0x7f9cf805c060 msgr2=0x7f9cf805c440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:49.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.369+0000 7f9cfd50e700 1 -- 172.21.15.111:0/454882689 shutdown_connections 2024-04-25T02:20:49.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.369+0000 7f9cfd50e700 1 -- 172.21.15.111:0/454882689 wait complete. 2024-04-25T02:20:49.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.370+0000 7f9cfd50e700 1 Processor -- start 2024-04-25T02:20:49.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.370+0000 7f9cfd50e700 1 -- start start 2024-04-25T02:20:49.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.371+0000 7f9cfd50e700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9cf8061460 0x7f9cf8138ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:49.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.371+0000 7f9cfd50e700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9cf80675f0 0x7f9cf8092ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:49.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.371+0000 7f9cfd50e700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9cf8133120 0x7f9cf8145d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:49.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.371+0000 7f9cfd50e700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf81457c0 con 0x7f9cf8133120 2024-04-25T02:20:49.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.371+0000 7f9cfd50e700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf8145a60 con 0x7f9cf8061460 2024-04-25T02:20:49.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.371+0000 7f9cfd50e700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf80933b0 con 0x7f9cf80675f0 2024-04-25T02:20:49.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.371+0000 7f9cf6ffd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9cf8061460 0x7f9cf8138ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:49.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.371+0000 7f9cf77fe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9cf8133120 0x7f9cf8145d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:49.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.371+0000 7f9cf6ffd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9cf8061460 0x7f9cf8138ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:36528/0 (socket says 172.21.15.111:36528) 2024-04-25T02:20:49.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.371+0000 7f9cf6ffd700 1 -- 172.21.15.111:0/2109559512 learned_addr learned my addr 172.21.15.111:0/2109559512 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:49.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.371+0000 7f9cf67fc700 1 --2- 172.21.15.111:0/2109559512 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9cf80675f0 0x7f9cf8092ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:49.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.371+0000 7f9cf6ffd700 1 -- 172.21.15.111:0/2109559512 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9cf80675f0 msgr2=0x7f9cf8092ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:49.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.371+0000 7f9cf6ffd700 1 --2- 172.21.15.111:0/2109559512 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9cf80675f0 0x7f9cf8092ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:49.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.371+0000 7f9cf6ffd700 1 -- 172.21.15.111:0/2109559512 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9cf8133120 msgr2=0x7f9cf8145d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:49.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.371+0000 7f9cf6ffd700 1 --2- 172.21.15.111:0/2109559512 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9cf8133120 0x7f9cf8145d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:49.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.371+0000 7f9cf6ffd700 1 -- 172.21.15.111:0/2109559512 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cec00b180 con 0x7f9cf8061460 2024-04-25T02:20:49.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.371+0000 7f9cf67fc700 1 --2- 172.21.15.111:0/2109559512 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9cf80675f0 0x7f9cf8092ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:20:49.379 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.371+0000 7f9cf77fe700 1 --2- 172.21.15.111:0/2109559512 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9cf8133120 0x7f9cf8145d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:49.379 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.371+0000 7f9cf6ffd700 1 --2- 172.21.15.111:0/2109559512 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9cf8061460 0x7f9cf8138ca0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f9cec00c000 tx=0x7f9cec006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:49.379 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.371+0000 7f9ce7fff700 1 -- 172.21.15.111:0/2109559512 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9cec010780 con 0x7f9cf8061460 2024-04-25T02:20:49.379 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.371+0000 7f9ce7fff700 1 -- 172.21.15.111:0/2109559512 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cec0108e0 con 0x7f9cf8061460 2024-04-25T02:20:49.379 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.371+0000 7f9cfd50e700 1 -- 172.21.15.111:0/2109559512 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cf0009470 con 0x7f9cf8061460 2024-04-25T02:20:49.379 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.371+0000 7f9ce7fff700 1 -- 172.21.15.111:0/2109559512 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f9cec010c40 con 0x7f9cf8061460 2024-04-25T02:20:49.379 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.371+0000 7f9cfd50e700 1 -- 172.21.15.111:0/2109559512 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cf80946e0 con 0x7f9cf8061460 2024-04-25T02:20:49.379 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.372+0000 7f9ce7fff700 1 -- 172.21.15.111:0/2109559512 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f9cec01c460 con 0x7f9cf8061460 2024-04-25T02:20:49.379 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.372+0000 7f9ce7fff700 1 -- 172.21.15.111:0/2109559512 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f9cec04af20 con 0x7f9cf8061460 2024-04-25T02:20:49.379 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.372+0000 7f9cfd50e700 1 -- 172.21.15.111:0/2109559512 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cf8061e10 con 0x7f9cf8061460 2024-04-25T02:20:49.379 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.375+0000 7f9ce7fff700 1 -- 172.21.15.111:0/2109559512 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f9cec0336c0 con 0x7f9cf8061460 2024-04-25T02:20:49.519 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.516+0000 7f9cfd50e700 1 -- 172.21.15.111:0/2109559512 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9cf8057a60 con 0x7f9cf8061460 2024-04-25T02:20:49.519 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.516+0000 7f9ce7fff700 1 -- 172.21.15.111:0/2109559512 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+2330 (secure 0 0 0) 0x7f9cec02b090 con 0x7f9cf8061460 2024-04-25T02:20:49.520 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:20:49.520 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4193,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6817/3699616235","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6817","nonce":3699616235}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:20:24.150791+0000","modified":"2024-04-25T02:20:49.242915+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4239,"mds_1":4236},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4236":{"gid":4236,"name":"c","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.111:6818/2165982859","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6818","nonce":2165982859}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4239":{"gid":4239,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.111:6819/4003866251","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6819","nonce":4003866251}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-25T02:20:49.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.517+0000 7f9cfd50e700 1 -- 172.21.15.111:0/2109559512 >> v1:172.21.15.111:6816/39585 conn(0x7f9cd4038dd0 legacy=0x7f9cd403b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:49.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.517+0000 7f9cfd50e700 1 -- 172.21.15.111:0/2109559512 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9cf8061460 msgr2=0x7f9cf8138ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:49.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.517+0000 7f9cfd50e700 1 --2- 172.21.15.111:0/2109559512 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9cf8061460 0x7f9cf8138ca0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f9cec00c000 tx=0x7f9cec006df0).stop 2024-04-25T02:20:49.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.518+0000 7f9cfd50e700 1 -- 172.21.15.111:0/2109559512 shutdown_connections 2024-04-25T02:20:49.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.518+0000 7f9cfd50e700 1 --2- 172.21.15.111:0/2109559512 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9cf8133120 0x7f9cf8145d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:49.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.518+0000 7f9cfd50e700 1 --2- 172.21.15.111:0/2109559512 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9cf8061460 0x7f9cf8138ca0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:49.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.518+0000 7f9cfd50e700 1 --2- 172.21.15.111:0/2109559512 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9cf80675f0 0x7f9cf8092ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:49.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.518+0000 7f9cfd50e700 1 -- 172.21.15.111:0/2109559512 >> 172.21.15.111:0/2109559512 conn(0x7f9cf805c060 msgr2=0x7f9cf8067a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:49.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.518+0000 7f9cfd50e700 1 -- 172.21.15.111:0/2109559512 shutdown_connections 2024-04-25T02:20:49.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:49.518+0000 7f9cfd50e700 1 -- 172.21.15.111:0/2109559512 wait complete. 2024-04-25T02:20:49.522 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 11 2024-04-25T02:20:49.833 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 11, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T02:20:24.150791+0000', 'modified': '2024-04-25T02:20:49.242915+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4239, 'mds_1': 4236}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4236': {'gid': 4236, 'name': 'c', 'rank': 1, 'incarnation': 7, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.111:6818/2165982859', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.111:6818', 'nonce': 2165982859}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4239': {'gid': 4239, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.111:6819/4003866251', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.111:6819', 'nonce': 4003866251}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-25T02:20:49.833 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4236:up:stopping 2024-04-25T02:20:50.834 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:20:50.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.945+0000 7f0a2588a700 1 Processor -- start 2024-04-25T02:20:50.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.945+0000 7f0a2588a700 1 -- start start 2024-04-25T02:20:50.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.946+0000 7f0a2588a700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0a20136800 0x7f0a200642e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:50.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.946+0000 7f0a2588a700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f0a200633b0 0x7f0a20136be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:50.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.946+0000 7f0a2588a700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a201363d0 con 0x7f0a20062590 2024-04-25T02:20:50.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.946+0000 7f0a2588a700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a200647d0 con 0x7f0a200633b0 2024-04-25T02:20:50.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.946+0000 7f0a2588a700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a20136600 con 0x7f0a20136800 2024-04-25T02:20:50.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.946+0000 7f0a1effd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0a20136800 0x7f0a200642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:50.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.946+0000 7f0a1e7fc700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f0a200633b0 0x7f0a20136be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:50.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.946+0000 7f0a1effd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0a20136800 0x7f0a200642e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:35888/0 (socket says 172.21.15.111:35888) 2024-04-25T02:20:50.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.946+0000 7f0a1e7fc700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f0a200633b0 0x7f0a20136be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:47132/0 (socket says 172.21.15.111:47132) 2024-04-25T02:20:50.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.946+0000 7f0a1f7fe700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f0a20062590 0x7f0a200a82a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:40318/0 (socket says 172.21.15.111:40318) 2024-04-25T02:20:50.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.946+0000 7f0a1effd700 1 -- 172.21.15.111:0/2197096367 learned_addr learned my addr 172.21.15.111:0/2197096367 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:50.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.947+0000 7f0a1effd700 1 -- 172.21.15.111:0/2197096367 >> v2:172.21.15.111:3300/0 conn(0x7f0a200633b0 msgr2=0x7f0a20136be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:50.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.947+0000 7f0a1effd700 1 --2- 172.21.15.111:0/2197096367 >> v2:172.21.15.111:3300/0 conn(0x7f0a200633b0 0x7f0a20136be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:50.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.947+0000 7f0a1effd700 1 -- 172.21.15.111:0/2197096367 >> v1:172.21.15.111:6789/0 conn(0x7f0a20062590 legacy=0x7f0a200a82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:50.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.947+0000 7f0a1effd700 1 -- 172.21.15.111:0/2197096367 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a200a9d70 con 0x7f0a20136800 2024-04-25T02:20:50.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.947+0000 7f0a1e7fc700 1 --2- 172.21.15.111:0/2197096367 >> v2:172.21.15.111:3300/0 conn(0x7f0a200633b0 0x7f0a20136be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:50.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.947+0000 7f0a1effd700 1 --2- 172.21.15.111:0/2197096367 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0a20136800 0x7f0a200642e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f0a14002f70 tx=0x7f0a14006eb0).ready entity=mon.1 client_cookie=a7ca648691f49bae server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:50.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.947+0000 7f0a1dffb700 1 -- 172.21.15.111:0/2197096367 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a1400d570 con 0x7f0a20136800 2024-04-25T02:20:50.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.947+0000 7f0a1dffb700 1 -- 172.21.15.111:0/2197096367 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a14000e90 con 0x7f0a20136800 2024-04-25T02:20:50.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.947+0000 7f0a1dffb700 1 -- 172.21.15.111:0/2197096367 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a1400d900 con 0x7f0a20136800 2024-04-25T02:20:50.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.947+0000 7f0a2588a700 1 -- 172.21.15.111:0/2197096367 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0a20136800 msgr2=0x7f0a200642e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:50.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.947+0000 7f0a2588a700 1 --2- 172.21.15.111:0/2197096367 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0a20136800 0x7f0a200642e0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f0a14002f70 tx=0x7f0a14006eb0).stop 2024-04-25T02:20:50.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.947+0000 7f0a2588a700 1 -- 172.21.15.111:0/2197096367 shutdown_connections 2024-04-25T02:20:50.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.947+0000 7f0a2588a700 1 --2- 172.21.15.111:0/2197096367 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0a20136800 0x7f0a200642e0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:50.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.947+0000 7f0a2588a700 1 --2- 172.21.15.111:0/2197096367 >> v2:172.21.15.111:3300/0 conn(0x7f0a200633b0 0x7f0a20136be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:50.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.947+0000 7f0a2588a700 1 -- 172.21.15.111:0/2197096367 >> 172.21.15.111:0/2197096367 conn(0x7f0a200614e0 msgr2=0x7f0a2006c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:50.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.947+0000 7f0a2588a700 1 -- 172.21.15.111:0/2197096367 shutdown_connections 2024-04-25T02:20:50.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.948+0000 7f0a2588a700 1 -- 172.21.15.111:0/2197096367 wait complete. 2024-04-25T02:20:50.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.949+0000 7f0a2588a700 1 Processor -- start 2024-04-25T02:20:50.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.949+0000 7f0a2588a700 1 -- start start 2024-04-25T02:20:50.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.949+0000 7f0a2588a700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0a20062590 0x7f0a20094530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:50.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.949+0000 7f0a2588a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0a200633b0 0x7f0a20065f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:50.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.949+0000 7f0a2588a700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0a20136800 0x7f0a20066410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:50.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.949+0000 7f0a2588a700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a200920b0 con 0x7f0a200633b0 2024-04-25T02:20:50.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.949+0000 7f0a2588a700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a200938e0 con 0x7f0a20062590 2024-04-25T02:20:50.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.949+0000 7f0a2588a700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0a20067fa0 con 0x7f0a20136800 2024-04-25T02:20:50.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.949+0000 7f0a1effd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0a20062590 0x7f0a20094530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:50.957 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.949+0000 7f0a1e7fc700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0a200633b0 0x7f0a20065f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:50.957 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.949+0000 7f0a1effd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0a20062590 0x7f0a20094530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:35892/0 (socket says 172.21.15.111:35892) 2024-04-25T02:20:50.957 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.949+0000 7f0a1effd700 1 -- 172.21.15.111:0/3751525163 learned_addr learned my addr 172.21.15.111:0/3751525163 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:50.957 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.949+0000 7f0a1f7fe700 1 --2- 172.21.15.111:0/3751525163 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0a20136800 0x7f0a20066410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:50.957 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.950+0000 7f0a1e7fc700 1 -- 172.21.15.111:0/3751525163 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0a20136800 msgr2=0x7f0a20066410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:50.957 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.950+0000 7f0a1e7fc700 1 --2- 172.21.15.111:0/3751525163 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0a20136800 0x7f0a20066410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:50.957 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.950+0000 7f0a1e7fc700 1 -- 172.21.15.111:0/3751525163 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0a20062590 msgr2=0x7f0a20094530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:50.957 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.950+0000 7f0a1e7fc700 1 --2- 172.21.15.111:0/3751525163 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0a20062590 0x7f0a20094530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:50.957 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.950+0000 7f0a1e7fc700 1 -- 172.21.15.111:0/3751525163 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a1000b180 con 0x7f0a200633b0 2024-04-25T02:20:50.957 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.950+0000 7f0a1effd700 1 --2- 172.21.15.111:0/3751525163 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0a20062590 0x7f0a20094530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:50.957 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.950+0000 7f0a1f7fe700 1 --2- 172.21.15.111:0/3751525163 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0a20136800 0x7f0a20066410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:50.957 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.950+0000 7f0a1e7fc700 1 --2- 172.21.15.111:0/3751525163 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0a200633b0 0x7f0a20065f20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f0a1000c000 tx=0x7f0a10006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:50.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.950+0000 7f0a0ffff700 1 -- 172.21.15.111:0/3751525163 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a10010780 con 0x7f0a200633b0 2024-04-25T02:20:50.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.950+0000 7f0a0ffff700 1 -- 172.21.15.111:0/3751525163 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a100108e0 con 0x7f0a200633b0 2024-04-25T02:20:50.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.950+0000 7f0a0ffff700 1 -- 172.21.15.111:0/3751525163 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f0a10010c40 con 0x7f0a200633b0 2024-04-25T02:20:50.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.950+0000 7f0a2588a700 1 -- 172.21.15.111:0/3751525163 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a1400b1e0 con 0x7f0a200633b0 2024-04-25T02:20:50.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.950+0000 7f0a2588a700 1 -- 172.21.15.111:0/3751525163 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a20067360 con 0x7f0a200633b0 2024-04-25T02:20:50.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.951+0000 7f0a0ffff700 1 -- 172.21.15.111:0/3751525163 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f0a1001c460 con 0x7f0a200633b0 2024-04-25T02:20:50.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.951+0000 7f0a2588a700 1 -- 172.21.15.111:0/3751525163 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a20094be0 con 0x7f0a200633b0 2024-04-25T02:20:50.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.951+0000 7f0a0ffff700 1 -- 172.21.15.111:0/3751525163 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f0a1004acc0 con 0x7f0a200633b0 2024-04-25T02:20:50.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:50.954+0000 7f0a0ffff700 1 -- 172.21.15.111:0/3751525163 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f0a100335f0 con 0x7f0a200633b0 2024-04-25T02:20:51.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:51.094+0000 7f0a2588a700 1 -- 172.21.15.111:0/3751525163 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0a20057a60 con 0x7f0a200633b0 2024-04-25T02:20:51.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:51.094+0000 7f0a0ffff700 1 -- 172.21.15.111:0/3751525163 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+2330 (secure 0 0 0) 0x7f0a100331e0 con 0x7f0a200633b0 2024-04-25T02:20:51.098 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:20:51.098 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4193,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6817/3699616235","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6817","nonce":3699616235}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:20:24.150791+0000","modified":"2024-04-25T02:20:49.242915+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4239,"mds_1":4236},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4236":{"gid":4236,"name":"c","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.111:6818/2165982859","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6818","nonce":2165982859}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4239":{"gid":4239,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.111:6819/4003866251","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6819","nonce":4003866251}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-25T02:20:51.099 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:51.096+0000 7f0a2588a700 1 -- 172.21.15.111:0/3751525163 >> v1:172.21.15.111:6816/39585 conn(0x7f09fc038da0 legacy=0x7f09fc03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:51.099 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:51.096+0000 7f0a2588a700 1 -- 172.21.15.111:0/3751525163 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0a200633b0 msgr2=0x7f0a20065f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:51.099 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:51.096+0000 7f0a2588a700 1 --2- 172.21.15.111:0/3751525163 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0a200633b0 0x7f0a20065f20 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f0a1000c000 tx=0x7f0a10006df0).stop 2024-04-25T02:20:51.099 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:51.096+0000 7f0a2588a700 1 -- 172.21.15.111:0/3751525163 shutdown_connections 2024-04-25T02:20:51.099 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:51.096+0000 7f0a2588a700 1 --2- 172.21.15.111:0/3751525163 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0a20136800 0x7f0a20066410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:51.099 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:51.096+0000 7f0a2588a700 1 --2- 172.21.15.111:0/3751525163 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0a20062590 0x7f0a20094530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:51.099 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:51.096+0000 7f0a2588a700 1 --2- 172.21.15.111:0/3751525163 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0a200633b0 0x7f0a20065f20 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:51.099 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:51.096+0000 7f0a2588a700 1 -- 172.21.15.111:0/3751525163 >> 172.21.15.111:0/3751525163 conn(0x7f0a200614e0 msgr2=0x7f0a200a7a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:51.099 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:51.096+0000 7f0a2588a700 1 -- 172.21.15.111:0/3751525163 shutdown_connections 2024-04-25T02:20:51.099 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:51.096+0000 7f0a2588a700 1 -- 172.21.15.111:0/3751525163 wait complete. 2024-04-25T02:20:51.100 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 11 2024-04-25T02:20:51.411 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 11, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T02:20:24.150791+0000', 'modified': '2024-04-25T02:20:49.242915+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4239, 'mds_1': 4236}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4236': {'gid': 4236, 'name': 'c', 'rank': 1, 'incarnation': 7, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.111:6818/2165982859', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.111:6818', 'nonce': 2165982859}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4239': {'gid': 4239, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.111:6819/4003866251', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.111:6819', 'nonce': 4003866251}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-25T02:20:51.411 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4236:up:stopping 2024-04-25T02:20:52.413 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:20:52.528 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.525+0000 7f6308462700 1 Processor -- start 2024-04-25T02:20:52.528 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.525+0000 7f6308462700 1 -- start start 2024-04-25T02:20:52.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.525+0000 7f6308462700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f630012c310 0x7f630005cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:52.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.525+0000 7f6308462700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f630005da60 0x7f63000a8ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:52.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.525+0000 7f6308462700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f63001377e0 con 0x7f630012c6f0 2024-04-25T02:20:52.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.525+0000 7f6308462700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f630013a760 con 0x7f630005da60 2024-04-25T02:20:52.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.525+0000 7f6308462700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f63000a7770 con 0x7f630012c310 2024-04-25T02:20:52.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.526+0000 7f63059fd700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f630005da60 0x7f63000a8ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:52.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.526+0000 7f63061fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f630012c310 0x7f630005cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:52.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.526+0000 7f63069ff700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f630012c6f0 0x7f63000a93d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:40334/0 (socket says 172.21.15.111:40334) 2024-04-25T02:20:52.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.526+0000 7f63059fd700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f630005da60 0x7f63000a8ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:47156/0 (socket says 172.21.15.111:47156) 2024-04-25T02:20:52.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.526+0000 7f63061fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f630012c310 0x7f630005cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:33632/0 (socket says 172.21.15.111:33632) 2024-04-25T02:20:52.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.526+0000 7f63069ff700 1 -- 172.21.15.111:0/243542193 learned_addr learned my addr 172.21.15.111:0/243542193 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:20:52.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.526+0000 7f63059fd700 1 -- 172.21.15.111:0/243542193 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f630012c310 msgr2=0x7f630005cfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:52.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.526+0000 7f63059fd700 1 --2- 172.21.15.111:0/243542193 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f630012c310 0x7f630005cfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:52.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.526+0000 7f63059fd700 1 -- 172.21.15.111:0/243542193 >> v1:172.21.15.111:6789/0 conn(0x7f630012c6f0 legacy=0x7f63000a93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:52.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.526+0000 7f63059fd700 1 -- 172.21.15.111:0/243542193 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f630005c420 con 0x7f630005da60 2024-04-25T02:20:52.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.526+0000 7f63051fc700 1 -- 172.21.15.111:0/243542193 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1701634006 0 0) 0x7f63001377e0 con 0x7f630012c6f0 2024-04-25T02:20:52.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.526+0000 7f63059fd700 1 --2- 172.21.15.111:0/243542193 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f630005da60 0x7f63000a8ee0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f62f0002f70 tx=0x7f62f0006df0).ready entity=mon.0 client_cookie=db3107977312299e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:52.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.526+0000 7f63051fc700 1 -- 172.21.15.111:0/243542193 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62f000d570 con 0x7f630005da60 2024-04-25T02:20:52.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.526+0000 7f63051fc700 1 -- 172.21.15.111:0/243542193 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f0000e90 con 0x7f630005da60 2024-04-25T02:20:52.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.526+0000 7f63051fc700 1 -- 172.21.15.111:0/243542193 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62f000d8c0 con 0x7f630005da60 2024-04-25T02:20:52.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.527+0000 7f6308462700 1 -- 172.21.15.111:0/243542193 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f630005da60 msgr2=0x7f63000a8ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:52.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.527+0000 7f6308462700 1 --2- 172.21.15.111:0/243542193 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f630005da60 0x7f63000a8ee0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f62f0002f70 tx=0x7f62f0006df0).stop 2024-04-25T02:20:52.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.527+0000 7f6308462700 1 -- 172.21.15.111:0/243542193 shutdown_connections 2024-04-25T02:20:52.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.527+0000 7f6308462700 1 --2- 172.21.15.111:0/243542193 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f630012c310 0x7f630005cfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:52.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.527+0000 7f6308462700 1 --2- 172.21.15.111:0/243542193 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f630005da60 0x7f63000a8ee0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:52.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.527+0000 7f6308462700 1 -- 172.21.15.111:0/243542193 >> 172.21.15.111:0/243542193 conn(0x7f6300066b10 msgr2=0x7f630006c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:52.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.527+0000 7f6308462700 1 -- 172.21.15.111:0/243542193 shutdown_connections 2024-04-25T02:20:52.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.527+0000 7f6308462700 1 -- 172.21.15.111:0/243542193 wait complete. 2024-04-25T02:20:52.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.528+0000 7f6308462700 1 Processor -- start 2024-04-25T02:20:52.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.528+0000 7f6308462700 1 -- start start 2024-04-25T02:20:52.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.528+0000 7f6308462700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f630012c310 0x7f630012d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:52.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.528+0000 7f6308462700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f630012c6f0 0x7f63001296b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:52.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.528+0000 7f6308462700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6300129ba0 0x7f6300145c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:52.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.528+0000 7f6308462700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63001303f0 con 0x7f630012c6f0 2024-04-25T02:20:52.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.528+0000 7f6308462700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f630012ff60 con 0x7f630012c310 2024-04-25T02:20:52.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.528+0000 7f6308462700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f630012f4d0 con 0x7f6300129ba0 2024-04-25T02:20:52.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.529+0000 7f63059fd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f630012c6f0 0x7f63001296b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:52.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.529+0000 7f63069ff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6300129ba0 0x7f6300145c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:52.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.529+0000 7f63061fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f630012c310 0x7f630012d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:52.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.529+0000 7f63059fd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f630012c6f0 0x7f63001296b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:47164/0 (socket says 172.21.15.111:47164) 2024-04-25T02:20:52.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.529+0000 7f63059fd700 1 -- 172.21.15.111:0/1209046619 learned_addr learned my addr 172.21.15.111:0/1209046619 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:52.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.529+0000 7f63069ff700 1 -- 172.21.15.111:0/1209046619 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f630012c310 msgr2=0x7f630012d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:52.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.529+0000 7f63069ff700 1 --2- 172.21.15.111:0/1209046619 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f630012c310 0x7f630012d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:52.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.529+0000 7f63069ff700 1 -- 172.21.15.111:0/1209046619 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f630012c6f0 msgr2=0x7f63001296b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:52.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.529+0000 7f63069ff700 1 --2- 172.21.15.111:0/1209046619 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f630012c6f0 0x7f63001296b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:52.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.529+0000 7f63069ff700 1 -- 172.21.15.111:0/1209046619 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f000b180 con 0x7f6300129ba0 2024-04-25T02:20:52.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.529+0000 7f63059fd700 1 --2- 172.21.15.111:0/1209046619 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f630012c6f0 0x7f63001296b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:52.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.529+0000 7f63061fe700 1 --2- 172.21.15.111:0/1209046619 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f630012c310 0x7f630012d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:52.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.529+0000 7f63069ff700 1 --2- 172.21.15.111:0/1209046619 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6300129ba0 0x7f6300145c70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f62f8001250 tx=0x7f62f8007f20).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:52.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.529+0000 7f62ef7fe700 1 -- 172.21.15.111:0/1209046619 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62f8005ba0 con 0x7f6300129ba0 2024-04-25T02:20:52.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.529+0000 7f62ef7fe700 1 -- 172.21.15.111:0/1209046619 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f8005d00 con 0x7f6300129ba0 2024-04-25T02:20:52.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.529+0000 7f6308462700 1 -- 172.21.15.111:0/1209046619 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f630012e0b0 con 0x7f6300129ba0 2024-04-25T02:20:52.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.529+0000 7f62ef7fe700 1 -- 172.21.15.111:0/1209046619 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f62f8004a90 con 0x7f6300129ba0 2024-04-25T02:20:52.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.529+0000 7f6308462700 1 -- 172.21.15.111:0/1209046619 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f630012d570 con 0x7f6300129ba0 2024-04-25T02:20:52.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.530+0000 7f62ef7fe700 1 -- 172.21.15.111:0/1209046619 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f62f8004bf0 con 0x7f6300129ba0 2024-04-25T02:20:52.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.531+0000 7f62ef7fe700 1 -- 172.21.15.111:0/1209046619 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f62f804a340 con 0x7f6300129ba0 2024-04-25T02:20:52.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.531+0000 7f6308462700 1 -- 172.21.15.111:0/1209046619 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6300137cb0 con 0x7f6300129ba0 2024-04-25T02:20:52.537 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.534+0000 7f62ef7fe700 1 -- 172.21.15.111:0/1209046619 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f62f802f240 con 0x7f6300129ba0 2024-04-25T02:20:52.675 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.673+0000 7f6308462700 1 -- 172.21.15.111:0/1209046619 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6300057a60 con 0x7f6300129ba0 2024-04-25T02:20:52.676 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.673+0000 7f62ef7fe700 1 -- 172.21.15.111:0/1209046619 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+2330 (secure 0 0 0) 0x7f62f8032860 con 0x7f6300129ba0 2024-04-25T02:20:52.676 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:20:52.676 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4193,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6817/3699616235","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6817","nonce":3699616235}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:20:24.150791+0000","modified":"2024-04-25T02:20:49.242915+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4239,"mds_1":4236},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4236":{"gid":4236,"name":"c","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.111:6818/2165982859","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6818","nonce":2165982859}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4239":{"gid":4239,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.111:6819/4003866251","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6819","nonce":4003866251}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-25T02:20:52.678 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.674+0000 7f6308462700 1 -- 172.21.15.111:0/1209046619 >> v1:172.21.15.111:6816/39585 conn(0x7f62e0038da0 legacy=0x7f62e003b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:52.678 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.674+0000 7f6308462700 1 -- 172.21.15.111:0/1209046619 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6300129ba0 msgr2=0x7f6300145c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:52.678 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.674+0000 7f6308462700 1 --2- 172.21.15.111:0/1209046619 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6300129ba0 0x7f6300145c70 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f62f8001250 tx=0x7f62f8007f20).stop 2024-04-25T02:20:52.678 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.674+0000 7f6308462700 1 -- 172.21.15.111:0/1209046619 shutdown_connections 2024-04-25T02:20:52.678 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.674+0000 7f6308462700 1 --2- 172.21.15.111:0/1209046619 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6300129ba0 0x7f6300145c70 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:52.678 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.674+0000 7f6308462700 1 --2- 172.21.15.111:0/1209046619 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f630012c310 0x7f630012d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:52.678 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.674+0000 7f6308462700 1 --2- 172.21.15.111:0/1209046619 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f630012c6f0 0x7f63001296b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:52.678 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.674+0000 7f6308462700 1 -- 172.21.15.111:0/1209046619 >> 172.21.15.111:0/1209046619 conn(0x7f6300066b10 msgr2=0x7f630012abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:52.678 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.674+0000 7f6308462700 1 -- 172.21.15.111:0/1209046619 shutdown_connections 2024-04-25T02:20:52.679 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:52.674+0000 7f6308462700 1 -- 172.21.15.111:0/1209046619 wait complete. 2024-04-25T02:20:52.679 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 11 2024-04-25T02:20:52.990 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 11, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T02:20:24.150791+0000', 'modified': '2024-04-25T02:20:49.242915+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4239, 'mds_1': 4236}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4236': {'gid': 4236, 'name': 'c', 'rank': 1, 'incarnation': 7, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.111:6818/2165982859', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.111:6818', 'nonce': 2165982859}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4239': {'gid': 4239, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.111:6819/4003866251', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.111:6819', 'nonce': 4003866251}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-25T02:20:52.990 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4236:up:stopping 2024-04-25T02:20:53.991 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:20:54.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.103+0000 7fbbdb05d700 1 Processor -- start 2024-04-25T02:20:54.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.103+0000 7fbbdb05d700 1 -- start start 2024-04-25T02:20:54.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.104+0000 7fbbdb05d700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fbbd40acd00 0x7fbbd41397b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:54.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.104+0000 7fbbdb05d700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbbd405d8a0 0x7fbbd4139ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:54.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.104+0000 7fbbdb05d700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbd412c4c0 con 0x7fbbd40a8140 2024-04-25T02:20:54.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.104+0000 7fbbdb05d700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbd405c790 con 0x7fbbd40acd00 2024-04-25T02:20:54.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.104+0000 7fbbdb05d700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd405c520 con 0x7fbbd405d8a0 2024-04-25T02:20:54.108 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.104+0000 7fbbd3fff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbbd405d8a0 0x7fbbd4139ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:54.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.104+0000 7fbbd8df9700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fbbd40acd00 0x7fbbd41397b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:54.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.104+0000 7fbbd95fa700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7fbbd40a8140 0x7fbbd4140b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:40348/0 (socket says 172.21.15.111:40348) 2024-04-25T02:20:54.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.104+0000 7fbbd95fa700 1 -- 172.21.15.111:0/3185231137 learned_addr learned my addr 172.21.15.111:0/3185231137 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:20:54.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.104+0000 7fbbd8df9700 1 -- 172.21.15.111:0/3185231137 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbbd405d8a0 msgr2=0x7fbbd4139ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:54.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.104+0000 7fbbd8df9700 1 --2- 172.21.15.111:0/3185231137 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbbd405d8a0 0x7fbbd4139ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:54.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.104+0000 7fbbd8df9700 1 -- 172.21.15.111:0/3185231137 >> v1:172.21.15.111:6789/0 conn(0x7fbbd40a8140 legacy=0x7fbbd4140b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:54.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.104+0000 7fbbd8df9700 1 -- 172.21.15.111:0/3185231137 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbd405d1d0 con 0x7fbbd40acd00 2024-04-25T02:20:54.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.104+0000 7fbbd37fe700 1 -- 172.21.15.111:0/3185231137 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1083497420 0 0) 0x7fbbd412c4c0 con 0x7fbbd40a8140 2024-04-25T02:20:54.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.104+0000 7fbbd3fff700 1 --2- 172.21.15.111:0/3185231137 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbbd405d8a0 0x7fbbd4139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:54.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.104+0000 7fbbd8df9700 1 --2- 172.21.15.111:0/3185231137 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbbd40acd00 0x7fbbd41397b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fbbc8002f70 tx=0x7fbbc8006df0).ready entity=mon.0 client_cookie=a74066154cdcf9d1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:54.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.105+0000 7fbbd37fe700 1 -- 172.21.15.111:0/3185231137 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbc800d570 con 0x7fbbd40acd00 2024-04-25T02:20:54.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.105+0000 7fbbd37fe700 1 -- 172.21.15.111:0/3185231137 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc8000e90 con 0x7fbbd40acd00 2024-04-25T02:20:54.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.105+0000 7fbbd37fe700 1 -- 172.21.15.111:0/3185231137 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbc800d8c0 con 0x7fbbd40acd00 2024-04-25T02:20:54.109 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.105+0000 7fbbdb05d700 1 -- 172.21.15.111:0/3185231137 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbbd40acd00 msgr2=0x7fbbd41397b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:54.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.105+0000 7fbbdb05d700 1 --2- 172.21.15.111:0/3185231137 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbbd40acd00 0x7fbbd41397b0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7fbbc8002f70 tx=0x7fbbc8006df0).stop 2024-04-25T02:20:54.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.105+0000 7fbbdb05d700 1 -- 172.21.15.111:0/3185231137 shutdown_connections 2024-04-25T02:20:54.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.105+0000 7fbbdb05d700 1 --2- 172.21.15.111:0/3185231137 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbbd40acd00 0x7fbbd41397b0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:54.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.105+0000 7fbbdb05d700 1 --2- 172.21.15.111:0/3185231137 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbbd405d8a0 0x7fbbd4139ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:54.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.105+0000 7fbbdb05d700 1 -- 172.21.15.111:0/3185231137 >> 172.21.15.111:0/3185231137 conn(0x7fbbd405dfb0 msgr2=0x7fbbd4066ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:54.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.105+0000 7fbbdb05d700 1 -- 172.21.15.111:0/3185231137 shutdown_connections 2024-04-25T02:20:54.110 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.105+0000 7fbbdb05d700 1 -- 172.21.15.111:0/3185231137 wait complete. 2024-04-25T02:20:54.112 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.106+0000 7fbbdb05d700 1 Processor -- start 2024-04-25T02:20:54.112 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.106+0000 7fbbdb05d700 1 -- start start 2024-04-25T02:20:54.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.107+0000 7fbbdb05d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbbd405d8a0 0x7fbbd4145f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:54.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.107+0000 7fbbdb05d700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbbd40a8140 0x7fbbd4146860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:54.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.107+0000 7fbbdb05d700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fbbd40acd00 0x7fbbd412dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:54.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.107+0000 7fbbdb05d700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd412e7b0 con 0x7fbbd405d8a0 2024-04-25T02:20:54.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.107+0000 7fbbdb05d700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd40a5700 con 0x7fbbd40a8140 2024-04-25T02:20:54.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.107+0000 7fbbdb05d700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbbd40a59a0 con 0x7fbbd40acd00 2024-04-25T02:20:54.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.107+0000 7fbbd8df9700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbbd405d8a0 0x7fbbd4145f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:54.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.107+0000 7fbbd3fff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbbd40a8140 0x7fbbd4146860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:54.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.107+0000 7fbbd8df9700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbbd405d8a0 0x7fbbd4145f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:47184/0 (socket says 172.21.15.111:47184) 2024-04-25T02:20:54.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.107+0000 7fbbd8df9700 1 -- 172.21.15.111:0/439068472 learned_addr learned my addr 172.21.15.111:0/439068472 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:54.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.107+0000 7fbbd95fa700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fbbd40acd00 0x7fbbd412dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:54.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.107+0000 7fbbd8df9700 1 -- 172.21.15.111:0/439068472 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fbbd40acd00 msgr2=0x7fbbd412dc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:54.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.107+0000 7fbbd8df9700 1 --2- 172.21.15.111:0/439068472 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fbbd40acd00 0x7fbbd412dc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:54.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.107+0000 7fbbd8df9700 1 -- 172.21.15.111:0/439068472 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbbd40a8140 msgr2=0x7fbbd4146860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:54.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.107+0000 7fbbd8df9700 1 --2- 172.21.15.111:0/439068472 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbbd40a8140 0x7fbbd4146860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:54.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.107+0000 7fbbd8df9700 1 -- 172.21.15.111:0/439068472 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbc000b180 con 0x7fbbd405d8a0 2024-04-25T02:20:54.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.107+0000 7fbbd95fa700 1 --2- 172.21.15.111:0/439068472 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fbbd40acd00 0x7fbbd412dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:54.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.107+0000 7fbbd3fff700 1 --2- 172.21.15.111:0/439068472 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbbd40a8140 0x7fbbd4146860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:54.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.107+0000 7fbbd8df9700 1 --2- 172.21.15.111:0/439068472 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbbd405d8a0 0x7fbbd4145f00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7fbbc8002f70 tx=0x7fbbc8014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:54.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.107+0000 7fbbd1ffb700 1 -- 172.21.15.111:0/439068472 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbc8013de0 con 0x7fbbd405d8a0 2024-04-25T02:20:54.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.108+0000 7fbbd1ffb700 1 -- 172.21.15.111:0/439068472 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbc801e400 con 0x7fbbd405d8a0 2024-04-25T02:20:54.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.108+0000 7fbbd1ffb700 1 -- 172.21.15.111:0/439068472 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbbc801e760 con 0x7fbbd405d8a0 2024-04-25T02:20:54.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.108+0000 7fbbdb05d700 1 -- 172.21.15.111:0/439068472 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbc800b180 con 0x7fbbd405d8a0 2024-04-25T02:20:54.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.108+0000 7fbbdb05d700 1 -- 172.21.15.111:0/439068472 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbd412e130 con 0x7fbbd405d8a0 2024-04-25T02:20:54.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.108+0000 7fbbd1ffb700 1 -- 172.21.15.111:0/439068472 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fbbc8025030 con 0x7fbbd405d8a0 2024-04-25T02:20:54.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.109+0000 7fbbdb05d700 1 -- 172.21.15.111:0/439068472 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbd412d5c0 con 0x7fbbd405d8a0 2024-04-25T02:20:54.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.109+0000 7fbbd1ffb700 1 -- 172.21.15.111:0/439068472 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fbbc804b5e0 con 0x7fbbd405d8a0 2024-04-25T02:20:54.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.112+0000 7fbbd1ffb700 1 -- 172.21.15.111:0/439068472 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fbbc80058c0 con 0x7fbbd405d8a0 2024-04-25T02:20:54.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.250+0000 7fbbdb05d700 1 -- 172.21.15.111:0/439068472 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbbd40a96e0 con 0x7fbbd405d8a0 2024-04-25T02:20:54.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.251+0000 7fbbd1ffb700 1 -- 172.21.15.111:0/439068472 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+2330 (secure 0 0 0) 0x7fbbc8023030 con 0x7fbbd405d8a0 2024-04-25T02:20:54.254 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:20:54.254 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4193,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6817/3699616235","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6817","nonce":3699616235}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:20:24.150791+0000","modified":"2024-04-25T02:20:49.242915+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4239,"mds_1":4236},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4236":{"gid":4236,"name":"c","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.111:6818/2165982859","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6818","nonce":2165982859}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4239":{"gid":4239,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.111:6819/4003866251","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6819","nonce":4003866251}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-25T02:20:54.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.252+0000 7fbbdb05d700 1 -- 172.21.15.111:0/439068472 >> v1:172.21.15.111:6816/39585 conn(0x7fbbb4038da0 legacy=0x7fbbb403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:54.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.252+0000 7fbbdb05d700 1 -- 172.21.15.111:0/439068472 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbbd405d8a0 msgr2=0x7fbbd4145f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:54.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.252+0000 7fbbdb05d700 1 --2- 172.21.15.111:0/439068472 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbbd405d8a0 0x7fbbd4145f00 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7fbbc8002f70 tx=0x7fbbc8014000).stop 2024-04-25T02:20:54.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.252+0000 7fbbdb05d700 1 -- 172.21.15.111:0/439068472 shutdown_connections 2024-04-25T02:20:54.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.252+0000 7fbbdb05d700 1 --2- 172.21.15.111:0/439068472 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fbbd40acd00 0x7fbbd412dc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:54.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.252+0000 7fbbdb05d700 1 --2- 172.21.15.111:0/439068472 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbbd405d8a0 0x7fbbd4145f00 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:54.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.252+0000 7fbbdb05d700 1 --2- 172.21.15.111:0/439068472 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbbd40a8140 0x7fbbd4146860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:54.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.252+0000 7fbbdb05d700 1 -- 172.21.15.111:0/439068472 >> 172.21.15.111:0/439068472 conn(0x7fbbd405dfb0 msgr2=0x7fbbd4066aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:54.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.252+0000 7fbbdb05d700 1 -- 172.21.15.111:0/439068472 shutdown_connections 2024-04-25T02:20:54.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:54.252+0000 7fbbdb05d700 1 -- 172.21.15.111:0/439068472 wait complete. 2024-04-25T02:20:54.257 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 11 2024-04-25T02:20:54.569 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 11, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T02:20:24.150791+0000', 'modified': '2024-04-25T02:20:49.242915+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4239, 'mds_1': 4236}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4236': {'gid': 4236, 'name': 'c', 'rank': 1, 'incarnation': 7, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.111:6818/2165982859', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.111:6818', 'nonce': 2165982859}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4239': {'gid': 4239, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.111:6819/4003866251', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.111:6819', 'nonce': 4003866251}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-25T02:20:54.569 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4236:up:stopping 2024-04-25T02:20:55.570 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:20:55.685 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.682+0000 7f99eb2ad700 1 Processor -- start 2024-04-25T02:20:55.685 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.682+0000 7f99eb2ad700 1 -- start start 2024-04-25T02:20:55.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.683+0000 7f99eb2ad700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f99e4136800 0x7f99e40642e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:55.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.683+0000 7f99eb2ad700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f99e40633b0 0x7f99e4136be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:55.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.683+0000 7f99eb2ad700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f99e4062590 0x7f99e40a82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:55.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.683+0000 7f99eb2ad700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99e41363d0 con 0x7f99e4136800 2024-04-25T02:20:55.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.683+0000 7f99eb2ad700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e40647d0 con 0x7f99e4062590 2024-04-25T02:20:55.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.683+0000 7f99eb2ad700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f99e4136600 con 0x7f99e40633b0 2024-04-25T02:20:55.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.683+0000 7f99e8848700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f99e40633b0 0x7f99e4136be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:55.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.683+0000 7f99e984a700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f99e4062590 0x7f99e40a82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:55.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.683+0000 7f99e9049700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f99e4136800 0x7f99e40642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:55.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.683+0000 7f99e9049700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f99e4136800 0x7f99e40642e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:47200/0 (socket says 172.21.15.111:47200) 2024-04-25T02:20:55.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.683+0000 7f99e8848700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f99e40633b0 0x7f99e4136be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:33654/0 (socket says 172.21.15.111:33654) 2024-04-25T02:20:55.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.683+0000 7f99e984a700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f99e4062590 0x7f99e40a82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:35926/0 (socket says 172.21.15.111:35926) 2024-04-25T02:20:55.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.683+0000 7f99e9049700 1 -- 172.21.15.111:0/3022706571 learned_addr learned my addr 172.21.15.111:0/3022706571 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:55.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.684+0000 7f99e8848700 1 -- 172.21.15.111:0/3022706571 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f99e4062590 msgr2=0x7f99e40a82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:55.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.684+0000 7f99e8848700 1 --2- 172.21.15.111:0/3022706571 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f99e4062590 0x7f99e40a82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:55.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.684+0000 7f99e8848700 1 -- 172.21.15.111:0/3022706571 >> v2:172.21.15.111:3300/0 conn(0x7f99e4136800 msgr2=0x7f99e40642e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:55.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.684+0000 7f99e8848700 1 --2- 172.21.15.111:0/3022706571 >> v2:172.21.15.111:3300/0 conn(0x7f99e4136800 0x7f99e40642e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:55.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.684+0000 7f99e8848700 1 -- 172.21.15.111:0/3022706571 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99e40a9d70 con 0x7f99e40633b0 2024-04-25T02:20:55.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.684+0000 7f99e984a700 1 --2- 172.21.15.111:0/3022706571 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f99e4062590 0x7f99e40a82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:55.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.684+0000 7f99e9049700 1 --2- 172.21.15.111:0/3022706571 >> v2:172.21.15.111:3300/0 conn(0x7f99e4136800 0x7f99e40642e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:55.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.684+0000 7f99e8848700 1 --2- 172.21.15.111:0/3022706571 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f99e40633b0 0x7f99e4136be0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f99e0002f70 tx=0x7f99e0006e80).ready entity=mon.2 client_cookie=aa9d068fabc2102d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:55.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.684+0000 7f99d3fff700 1 -- 172.21.15.111:0/3022706571 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99e0012070 con 0x7f99e40633b0 2024-04-25T02:20:55.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.684+0000 7f99d3fff700 1 -- 172.21.15.111:0/3022706571 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99e0000e90 con 0x7f99e40633b0 2024-04-25T02:20:55.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.684+0000 7f99d3fff700 1 -- 172.21.15.111:0/3022706571 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99e0017850 con 0x7f99e40633b0 2024-04-25T02:20:55.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.684+0000 7f99eb2ad700 1 -- 172.21.15.111:0/3022706571 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f99e40633b0 msgr2=0x7f99e4136be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:55.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.684+0000 7f99eb2ad700 1 --2- 172.21.15.111:0/3022706571 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f99e40633b0 0x7f99e4136be0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f99e0002f70 tx=0x7f99e0006e80).stop 2024-04-25T02:20:55.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.684+0000 7f99eb2ad700 1 -- 172.21.15.111:0/3022706571 shutdown_connections 2024-04-25T02:20:55.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.684+0000 7f99eb2ad700 1 --2- 172.21.15.111:0/3022706571 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f99e4062590 0x7f99e40a82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:55.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.684+0000 7f99eb2ad700 1 --2- 172.21.15.111:0/3022706571 >> v2:172.21.15.111:3300/0 conn(0x7f99e4136800 0x7f99e40642e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:55.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.684+0000 7f99eb2ad700 1 --2- 172.21.15.111:0/3022706571 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f99e40633b0 0x7f99e4136be0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:55.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.684+0000 7f99eb2ad700 1 -- 172.21.15.111:0/3022706571 >> 172.21.15.111:0/3022706571 conn(0x7f99e40614e0 msgr2=0x7f99e406c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:55.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.684+0000 7f99eb2ad700 1 -- 172.21.15.111:0/3022706571 shutdown_connections 2024-04-25T02:20:55.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.684+0000 7f99eb2ad700 1 -- 172.21.15.111:0/3022706571 wait complete. 2024-04-25T02:20:55.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.685+0000 7f99eb2ad700 1 Processor -- start 2024-04-25T02:20:55.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.685+0000 7f99eb2ad700 1 -- start start 2024-04-25T02:20:55.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.686+0000 7f99eb2ad700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f99e4062590 0x7f99e4065740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:55.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.686+0000 7f99eb2ad700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f99e40633b0 0x7f99e41448f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:55.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.686+0000 7f99eb2ad700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f99e4136800 0x7f99e4144de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:55.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.686+0000 7f99eb2ad700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99e4131e30 con 0x7f99e40633b0 2024-04-25T02:20:55.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.686+0000 7f99eb2ad700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99e40672b0 con 0x7f99e4062590 2024-04-25T02:20:55.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.686+0000 7f99eb2ad700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f99e4098f10 con 0x7f99e4136800 2024-04-25T02:20:55.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.686+0000 7f99e9049700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f99e4062590 0x7f99e4065740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:55.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.686+0000 7f99e9049700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f99e4062590 0x7f99e4065740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:35936/0 (socket says 172.21.15.111:35936) 2024-04-25T02:20:55.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.686+0000 7f99e8848700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f99e40633b0 0x7f99e41448f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:55.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.686+0000 7f99e984a700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f99e4136800 0x7f99e4144de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:55.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.686+0000 7f99e9049700 1 -- 172.21.15.111:0/2560362773 learned_addr learned my addr 172.21.15.111:0/2560362773 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:55.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.686+0000 7f99e984a700 1 -- 172.21.15.111:0/2560362773 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f99e4062590 msgr2=0x7f99e4065740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:55.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.686+0000 7f99e984a700 1 --2- 172.21.15.111:0/2560362773 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f99e4062590 0x7f99e4065740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:55.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.686+0000 7f99e984a700 1 -- 172.21.15.111:0/2560362773 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f99e40633b0 msgr2=0x7f99e41448f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:55.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.686+0000 7f99e984a700 1 --2- 172.21.15.111:0/2560362773 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f99e40633b0 0x7f99e41448f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:55.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.686+0000 7f99e984a700 1 -- 172.21.15.111:0/2560362773 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99dc009470 con 0x7f99e4136800 2024-04-25T02:20:55.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.686+0000 7f99e9049700 1 --2- 172.21.15.111:0/2560362773 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f99e4062590 0x7f99e4065740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:55.694 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.686+0000 7f99e8848700 1 --2- 172.21.15.111:0/2560362773 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f99e40633b0 0x7f99e41448f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:55.694 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.686+0000 7f99e984a700 1 --2- 172.21.15.111:0/2560362773 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f99e4136800 0x7f99e4144de0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f99dc00c000 tx=0x7f99dc0091d0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:55.694 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.687+0000 7f99d27fc700 1 -- 172.21.15.111:0/2560362773 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99dc0096a0 con 0x7f99e4136800 2024-04-25T02:20:55.694 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.687+0000 7f99d27fc700 1 -- 172.21.15.111:0/2560362773 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99dc00c850 con 0x7f99e4136800 2024-04-25T02:20:55.694 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.687+0000 7f99eb2ad700 1 -- 172.21.15.111:0/2560362773 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99d400b1e0 con 0x7f99e4136800 2024-04-25T02:20:55.694 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.687+0000 7f99d27fc700 1 -- 172.21.15.111:0/2560362773 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f99dc00cbb0 con 0x7f99e4136800 2024-04-25T02:20:55.694 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.687+0000 7f99eb2ad700 1 -- 172.21.15.111:0/2560362773 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99e000d590 con 0x7f99e4136800 2024-04-25T02:20:55.694 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.688+0000 7f99d27fc700 1 -- 172.21.15.111:0/2560362773 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f99dc022070 con 0x7f99e4136800 2024-04-25T02:20:55.694 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.688+0000 7f99d27fc700 1 -- 172.21.15.111:0/2560362773 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f99dc04aeb0 con 0x7f99e4136800 2024-04-25T02:20:55.694 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.688+0000 7f99eb2ad700 1 -- 172.21.15.111:0/2560362773 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99e4099130 con 0x7f99e4136800 2024-04-25T02:20:55.695 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.691+0000 7f99d27fc700 1 -- 172.21.15.111:0/2560362773 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f99dc0337e0 con 0x7f99e4136800 2024-04-25T02:20:55.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.832+0000 7f99eb2ad700 1 -- 172.21.15.111:0/2560362773 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f99e406cdd0 con 0x7f99e4136800 2024-04-25T02:20:55.836 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.833+0000 7f99d27fc700 1 -- 172.21.15.111:0/2560362773 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+2330 (secure 0 0 0) 0x7f99dc016020 con 0x7f99e4136800 2024-04-25T02:20:55.836 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:20:55.836 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4193,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6817/3699616235","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6817","nonce":3699616235}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:20:24.150791+0000","modified":"2024-04-25T02:20:49.242915+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4239,"mds_1":4236},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4236":{"gid":4236,"name":"c","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.111:6818/2165982859","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6818","nonce":2165982859}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4239":{"gid":4239,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.111:6819/4003866251","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6819","nonce":4003866251}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-25T02:20:55.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.834+0000 7f99eb2ad700 1 -- 172.21.15.111:0/2560362773 >> v1:172.21.15.111:6816/39585 conn(0x7f99c4038dd0 legacy=0x7f99c403b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:55.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.834+0000 7f99eb2ad700 1 -- 172.21.15.111:0/2560362773 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f99e4136800 msgr2=0x7f99e4144de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:55.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.834+0000 7f99eb2ad700 1 --2- 172.21.15.111:0/2560362773 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f99e4136800 0x7f99e4144de0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f99dc00c000 tx=0x7f99dc0091d0).stop 2024-04-25T02:20:55.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.834+0000 7f99eb2ad700 1 -- 172.21.15.111:0/2560362773 shutdown_connections 2024-04-25T02:20:55.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.834+0000 7f99eb2ad700 1 --2- 172.21.15.111:0/2560362773 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f99e4136800 0x7f99e4144de0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:55.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.834+0000 7f99eb2ad700 1 --2- 172.21.15.111:0/2560362773 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f99e4062590 0x7f99e4065740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:55.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.834+0000 7f99eb2ad700 1 --2- 172.21.15.111:0/2560362773 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f99e40633b0 0x7f99e41448f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:55.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.834+0000 7f99eb2ad700 1 -- 172.21.15.111:0/2560362773 >> 172.21.15.111:0/2560362773 conn(0x7f99e40614e0 msgr2=0x7f99e4135940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:55.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.834+0000 7f99eb2ad700 1 -- 172.21.15.111:0/2560362773 shutdown_connections 2024-04-25T02:20:55.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:55.834+0000 7f99eb2ad700 1 -- 172.21.15.111:0/2560362773 wait complete. 2024-04-25T02:20:55.839 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 11 2024-04-25T02:20:56.150 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 11, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T02:20:24.150791+0000', 'modified': '2024-04-25T02:20:49.242915+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4239, 'mds_1': 4236}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4236': {'gid': 4236, 'name': 'c', 'rank': 1, 'incarnation': 7, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.111:6818/2165982859', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.111:6818', 'nonce': 2165982859}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4239': {'gid': 4239, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.111:6819/4003866251', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.111:6819', 'nonce': 4003866251}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-25T02:20:56.150 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4236:up:stopping 2024-04-25T02:20:57.151 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:20:57.266 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.263+0000 7fec243c2700 1 Processor -- start 2024-04-25T02:20:57.266 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.263+0000 7fec243c2700 1 -- start start 2024-04-25T02:20:57.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.264+0000 7fec243c2700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fec1c136800 0x7fec1c0642e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:57.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.264+0000 7fec243c2700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fec1c062590 0x7fec1c13d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:57.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.264+0000 7fec243c2700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec1c1363d0 con 0x7fec1c0633b0 2024-04-25T02:20:57.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.264+0000 7fec243c2700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec1c1372f0 con 0x7fec1c062590 2024-04-25T02:20:57.269 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.264+0000 7fec243c2700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c0647d0 con 0x7fec1c136800 2024-04-25T02:20:57.269 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.264+0000 7fec2215e700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fec1c136800 0x7fec1c0642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:57.269 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.264+0000 7fec2295f700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fec1c062590 0x7fec1c13d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:57.269 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.264+0000 7fec2215e700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fec1c136800 0x7fec1c0642e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:35944/0 (socket says 172.21.15.111:35944) 2024-04-25T02:20:57.269 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.264+0000 7fec2195d700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7fec1c0633b0 0x7fec1c136be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:40362/0 (socket says 172.21.15.111:40362) 2024-04-25T02:20:57.269 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.264+0000 7fec2215e700 1 -- 172.21.15.111:0/675354078 learned_addr learned my addr 172.21.15.111:0/675354078 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:57.269 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.264+0000 7fec2295f700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fec1c062590 0x7fec1c13d710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:47212/0 (socket says 172.21.15.111:47212) 2024-04-25T02:20:57.269 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.264+0000 7fec2215e700 1 -- 172.21.15.111:0/675354078 >> v2:172.21.15.111:3300/0 conn(0x7fec1c062590 msgr2=0x7fec1c13d710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:57.269 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.264+0000 7fec2215e700 1 --2- 172.21.15.111:0/675354078 >> v2:172.21.15.111:3300/0 conn(0x7fec1c062590 0x7fec1c13d710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:57.269 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.264+0000 7fec2215e700 1 -- 172.21.15.111:0/675354078 >> v1:172.21.15.111:6789/0 conn(0x7fec1c0633b0 legacy=0x7fec1c136be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:57.269 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.264+0000 7fec2215e700 1 -- 172.21.15.111:0/675354078 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec1c136600 con 0x7fec1c136800 2024-04-25T02:20:57.269 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.264+0000 7fec2115c700 1 -- 172.21.15.111:0/675354078 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3495654956 0 0) 0x7fec1c1363d0 con 0x7fec1c0633b0 2024-04-25T02:20:57.269 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.264+0000 7fec2295f700 1 --2- 172.21.15.111:0/675354078 >> v2:172.21.15.111:3300/0 conn(0x7fec1c062590 0x7fec1c13d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:57.269 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.264+0000 7fec2215e700 1 --2- 172.21.15.111:0/675354078 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fec1c136800 0x7fec1c0642e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fec18002f70 tx=0x7fec18006f40).ready entity=mon.1 client_cookie=a4f996b16844d893 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:57.270 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.264+0000 7fec2115c700 1 -- 172.21.15.111:0/675354078 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec1800da80 con 0x7fec1c136800 2024-04-25T02:20:57.270 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.264+0000 7fec2115c700 1 -- 172.21.15.111:0/675354078 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec18000e90 con 0x7fec1c136800 2024-04-25T02:20:57.270 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.264+0000 7fec2115c700 1 -- 172.21.15.111:0/675354078 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec1800ddd0 con 0x7fec1c136800 2024-04-25T02:20:57.270 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.265+0000 7fec243c2700 1 -- 172.21.15.111:0/675354078 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fec1c136800 msgr2=0x7fec1c0642e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:57.270 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.265+0000 7fec243c2700 1 --2- 172.21.15.111:0/675354078 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fec1c136800 0x7fec1c0642e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7fec18002f70 tx=0x7fec18006f40).stop 2024-04-25T02:20:57.270 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.265+0000 7fec243c2700 1 -- 172.21.15.111:0/675354078 shutdown_connections 2024-04-25T02:20:57.270 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.265+0000 7fec243c2700 1 --2- 172.21.15.111:0/675354078 >> v2:172.21.15.111:3300/0 conn(0x7fec1c062590 0x7fec1c13d710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:57.270 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.265+0000 7fec243c2700 1 --2- 172.21.15.111:0/675354078 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fec1c136800 0x7fec1c0642e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:57.270 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.265+0000 7fec243c2700 1 -- 172.21.15.111:0/675354078 >> 172.21.15.111:0/675354078 conn(0x7fec1c0614e0 msgr2=0x7fec1c06c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:57.270 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.265+0000 7fec243c2700 1 -- 172.21.15.111:0/675354078 shutdown_connections 2024-04-25T02:20:57.270 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.265+0000 7fec243c2700 1 -- 172.21.15.111:0/675354078 wait complete. 2024-04-25T02:20:57.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.266+0000 7fec243c2700 1 Processor -- start 2024-04-25T02:20:57.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.266+0000 7fec243c2700 1 -- start start 2024-04-25T02:20:57.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.266+0000 7fec243c2700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fec1c062590 0x7fec1c066c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:57.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.266+0000 7fec243c2700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fec1c0633b0 0x7fec1c144a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:57.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.266+0000 7fec243c2700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fec1c136800 0x7fec1c144f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:57.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.266+0000 7fec243c2700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c068190 con 0x7fec1c062590 2024-04-25T02:20:57.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.266+0000 7fec243c2700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c095a10 con 0x7fec1c136800 2024-04-25T02:20:57.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.266+0000 7fec243c2700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec1c095510 con 0x7fec1c0633b0 2024-04-25T02:20:57.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.267+0000 7fec2215e700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fec1c062590 0x7fec1c066c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:57.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.267+0000 7fec2195d700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fec1c0633b0 0x7fec1c144a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:57.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.267+0000 7fec2215e700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fec1c062590 0x7fec1c066c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:47222/0 (socket says 172.21.15.111:47222) 2024-04-25T02:20:57.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.267+0000 7fec2215e700 1 -- 172.21.15.111:0/363542510 learned_addr learned my addr 172.21.15.111:0/363542510 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:57.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.267+0000 7fec2295f700 1 --2- 172.21.15.111:0/363542510 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fec1c136800 0x7fec1c144f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:57.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.267+0000 7fec2215e700 1 -- 172.21.15.111:0/363542510 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fec1c0633b0 msgr2=0x7fec1c144a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:57.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.267+0000 7fec2215e700 1 --2- 172.21.15.111:0/363542510 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fec1c0633b0 0x7fec1c144a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:57.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.267+0000 7fec2215e700 1 -- 172.21.15.111:0/363542510 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fec1c136800 msgr2=0x7fec1c144f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:57.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.267+0000 7fec2215e700 1 --2- 172.21.15.111:0/363542510 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fec1c136800 0x7fec1c144f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:57.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.267+0000 7fec2215e700 1 -- 172.21.15.111:0/363542510 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec14009470 con 0x7fec1c062590 2024-04-25T02:20:57.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.267+0000 7fec2215e700 1 --2- 172.21.15.111:0/363542510 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fec1c062590 0x7fec1c066c90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fec18002f70 tx=0x7fec1c063f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:57.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.267+0000 7fec0b7fe700 1 -- 172.21.15.111:0/363542510 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec1800de40 con 0x7fec1c062590 2024-04-25T02:20:57.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.267+0000 7fec0b7fe700 1 -- 172.21.15.111:0/363542510 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec18010e10 con 0x7fec1c062590 2024-04-25T02:20:57.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.267+0000 7fec243c2700 1 -- 172.21.15.111:0/363542510 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec1800b460 con 0x7fec1c062590 2024-04-25T02:20:57.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.267+0000 7fec0b7fe700 1 -- 172.21.15.111:0/363542510 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fec18018800 con 0x7fec1c062590 2024-04-25T02:20:57.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.267+0000 7fec243c2700 1 -- 172.21.15.111:0/363542510 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec1c067180 con 0x7fec1c062590 2024-04-25T02:20:57.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.268+0000 7fec0b7fe700 1 -- 172.21.15.111:0/363542510 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fec18021020 con 0x7fec1c062590 2024-04-25T02:20:57.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.268+0000 7fec0b7fe700 1 -- 172.21.15.111:0/363542510 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fec1804e4d0 con 0x7fec1c062590 2024-04-25T02:20:57.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.268+0000 7fec243c2700 1 -- 172.21.15.111:0/363542510 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec1c094b00 con 0x7fec1c062590 2024-04-25T02:20:57.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.271+0000 7fec0b7fe700 1 -- 172.21.15.111:0/363542510 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fec18026640 con 0x7fec1c062590 2024-04-25T02:20:57.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.411+0000 7fec243c2700 1 -- 172.21.15.111:0/363542510 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec1c132740 con 0x7fec1c062590 2024-04-25T02:20:57.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.411+0000 7fec0b7fe700 1 -- 172.21.15.111:0/363542510 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+2330 (secure 0 0 0) 0x7fec18026230 con 0x7fec1c062590 2024-04-25T02:20:57.415 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:20:57.415 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4193,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6817/3699616235","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6817","nonce":3699616235}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:20:24.150791+0000","modified":"2024-04-25T02:20:49.242915+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4239,"mds_1":4236},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4236":{"gid":4236,"name":"c","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.111:6818/2165982859","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6818","nonce":2165982859}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4239":{"gid":4239,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.111:6819/4003866251","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6819","nonce":4003866251}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-25T02:20:57.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.413+0000 7fec243c2700 1 -- 172.21.15.111:0/363542510 >> v1:172.21.15.111:6816/39585 conn(0x7febfc038dd0 legacy=0x7febfc03b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:57.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.413+0000 7fec243c2700 1 -- 172.21.15.111:0/363542510 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fec1c062590 msgr2=0x7fec1c066c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:57.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.413+0000 7fec243c2700 1 --2- 172.21.15.111:0/363542510 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fec1c062590 0x7fec1c066c90 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7fec18002f70 tx=0x7fec1c063f20).stop 2024-04-25T02:20:57.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.413+0000 7fec243c2700 1 -- 172.21.15.111:0/363542510 shutdown_connections 2024-04-25T02:20:57.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.413+0000 7fec243c2700 1 --2- 172.21.15.111:0/363542510 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fec1c136800 0x7fec1c144f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:57.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.413+0000 7fec243c2700 1 --2- 172.21.15.111:0/363542510 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fec1c062590 0x7fec1c066c90 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:57.417 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.413+0000 7fec243c2700 1 --2- 172.21.15.111:0/363542510 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fec1c0633b0 0x7fec1c144a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:57.417 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.413+0000 7fec243c2700 1 -- 172.21.15.111:0/363542510 >> 172.21.15.111:0/363542510 conn(0x7fec1c0614e0 msgr2=0x7fec1c135a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:57.417 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.413+0000 7fec243c2700 1 -- 172.21.15.111:0/363542510 shutdown_connections 2024-04-25T02:20:57.417 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:57.413+0000 7fec243c2700 1 -- 172.21.15.111:0/363542510 wait complete. 2024-04-25T02:20:57.417 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 11 2024-04-25T02:20:57.729 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 11, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T02:20:24.150791+0000', 'modified': '2024-04-25T02:20:49.242915+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4239, 'mds_1': 4236}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4236': {'gid': 4236, 'name': 'c', 'rank': 1, 'incarnation': 7, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.111:6818/2165982859', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.111:6818', 'nonce': 2165982859}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4239': {'gid': 4239, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.111:6819/4003866251', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.111:6819', 'nonce': 4003866251}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-25T02:20:57.730 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4236:up:stopping 2024-04-25T02:20:58.730 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:20:58.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.841+0000 7fe99f735700 1 Processor -- start 2024-04-25T02:20:58.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.842+0000 7fe99f735700 1 -- start start 2024-04-25T02:20:58.847 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.842+0000 7fe99f735700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fe99805c1a0 0x7fe998067040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:58.847 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.842+0000 7fe99f735700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe998066170 0x7fe99805c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:58.847 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.842+0000 7fe99f735700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe998065c90 con 0x7fe998067c20 2024-04-25T02:20:58.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.842+0000 7fe99f735700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe99805ca70 con 0x7fe99805c1a0 2024-04-25T02:20:58.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.842+0000 7fe99f735700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe998067680 con 0x7fe998066170 2024-04-25T02:20:58.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.842+0000 7fe99dcd2700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe998066170 0x7fe99805c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:58.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.842+0000 7fe99d4d1700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fe99805c1a0 0x7fe998067040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:58.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.842+0000 7fe99ccd0700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7fe998067c20 0x7fe998136350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:40374/0 (socket says 172.21.15.111:40374) 2024-04-25T02:20:58.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.842+0000 7fe99ccd0700 1 -- 172.21.15.111:0/2431439362 learned_addr learned my addr 172.21.15.111:0/2431439362 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:20:58.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.843+0000 7fe99d4d1700 1 -- 172.21.15.111:0/2431439362 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe998066170 msgr2=0x7fe99805c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:20:58.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.843+0000 7fe99d4d1700 1 --2- 172.21.15.111:0/2431439362 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe998066170 0x7fe99805c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:58.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.843+0000 7fe99d4d1700 1 -- 172.21.15.111:0/2431439362 >> v1:172.21.15.111:6789/0 conn(0x7fe998067c20 legacy=0x7fe998136350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:58.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.843+0000 7fe99d4d1700 1 -- 172.21.15.111:0/2431439362 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe99805ba50 con 0x7fe99805c1a0 2024-04-25T02:20:58.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.843+0000 7fe987fff700 1 -- 172.21.15.111:0/2431439362 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1029324092 0 0) 0x7fe998065c90 con 0x7fe998067c20 2024-04-25T02:20:58.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.843+0000 7fe99dcd2700 1 --2- 172.21.15.111:0/2431439362 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe998066170 0x7fe99805c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:58.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.843+0000 7fe99d4d1700 1 --2- 172.21.15.111:0/2431439362 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe99805c1a0 0x7fe998067040 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fe9980a6e90 tx=0x7fe988006df0).ready entity=mon.0 client_cookie=7a02b2f4a65cdf38 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:58.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.843+0000 7fe987fff700 1 -- 172.21.15.111:0/2431439362 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe98800d570 con 0x7fe99805c1a0 2024-04-25T02:20:58.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.843+0000 7fe987fff700 1 -- 172.21.15.111:0/2431439362 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe988000e90 con 0x7fe99805c1a0 2024-04-25T02:20:58.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.843+0000 7fe987fff700 1 -- 172.21.15.111:0/2431439362 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe98800d8c0 con 0x7fe99805c1a0 2024-04-25T02:20:58.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.843+0000 7fe99f735700 1 -- 172.21.15.111:0/2431439362 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe99805c1a0 msgr2=0x7fe998067040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:58.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.843+0000 7fe99f735700 1 --2- 172.21.15.111:0/2431439362 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe99805c1a0 0x7fe998067040 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fe9980a6e90 tx=0x7fe988006df0).stop 2024-04-25T02:20:58.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.844+0000 7fe99f735700 1 -- 172.21.15.111:0/2431439362 shutdown_connections 2024-04-25T02:20:58.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.844+0000 7fe99f735700 1 --2- 172.21.15.111:0/2431439362 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe998066170 0x7fe99805c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:58.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.844+0000 7fe99f735700 1 --2- 172.21.15.111:0/2431439362 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe99805c1a0 0x7fe998067040 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:58.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.844+0000 7fe99f735700 1 -- 172.21.15.111:0/2431439362 >> 172.21.15.111:0/2431439362 conn(0x7fe9980a8a00 msgr2=0x7fe9980a8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:58.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.844+0000 7fe99f735700 1 -- 172.21.15.111:0/2431439362 shutdown_connections 2024-04-25T02:20:58.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.844+0000 7fe99f735700 1 -- 172.21.15.111:0/2431439362 wait complete. 2024-04-25T02:20:58.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.844+0000 7fe99f735700 1 Processor -- start 2024-04-25T02:20:58.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.844+0000 7fe99f735700 1 -- start start 2024-04-25T02:20:58.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.845+0000 7fe99f735700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe99805c1a0 0x7fe99813a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:58.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.845+0000 7fe99f735700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe998066170 0x7fe998092960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:58.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.845+0000 7fe99f735700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe998067c20 0x7fe9981465f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:20:58.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.845+0000 7fe99f735700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe998139050 con 0x7fe998067c20 2024-04-25T02:20:58.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.845+0000 7fe99f735700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe998093940 con 0x7fe998066170 2024-04-25T02:20:58.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.845+0000 7fe99f735700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe998093b90 con 0x7fe99805c1a0 2024-04-25T02:20:58.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.845+0000 7fe99d4d1700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe99805c1a0 0x7fe99813a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:58.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.845+0000 7fe99dcd2700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe998067c20 0x7fe9981465f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:58.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.845+0000 7fe99d4d1700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe99805c1a0 0x7fe99813a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:33692/0 (socket says 172.21.15.111:33692) 2024-04-25T02:20:58.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.845+0000 7fe99d4d1700 1 -- 172.21.15.111:0/547350772 learned_addr learned my addr 172.21.15.111:0/547350772 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:20:58.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.845+0000 7fe99ccd0700 1 --2- 172.21.15.111:0/547350772 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe998066170 0x7fe998092960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:20:58.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.845+0000 7fe99dcd2700 1 -- 172.21.15.111:0/547350772 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe99805c1a0 msgr2=0x7fe99813a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:58.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.845+0000 7fe99dcd2700 1 --2- 172.21.15.111:0/547350772 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe99805c1a0 0x7fe99813a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:58.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.845+0000 7fe99dcd2700 1 -- 172.21.15.111:0/547350772 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe998066170 msgr2=0x7fe998092960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:58.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.845+0000 7fe99dcd2700 1 --2- 172.21.15.111:0/547350772 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe998066170 0x7fe998092960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:58.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.845+0000 7fe99dcd2700 1 -- 172.21.15.111:0/547350772 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe990009470 con 0x7fe998067c20 2024-04-25T02:20:58.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.845+0000 7fe99d4d1700 1 --2- 172.21.15.111:0/547350772 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe99805c1a0 0x7fe99813a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:20:58.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.846+0000 7fe99dcd2700 1 --2- 172.21.15.111:0/547350772 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe998067c20 0x7fe9981465f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fe99000c000 tx=0x7fe9900091d0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:20:58.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.846+0000 7fe9867fc700 1 -- 172.21.15.111:0/547350772 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe99000c6a0 con 0x7fe998067c20 2024-04-25T02:20:58.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.846+0000 7fe9867fc700 1 -- 172.21.15.111:0/547350772 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe99000c800 con 0x7fe998067c20 2024-04-25T02:20:58.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.846+0000 7fe99f735700 1 -- 172.21.15.111:0/547350772 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe98800b180 con 0x7fe998067c20 2024-04-25T02:20:58.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.846+0000 7fe9867fc700 1 -- 172.21.15.111:0/547350772 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fe99000cb60 con 0x7fe998067c20 2024-04-25T02:20:58.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.846+0000 7fe99f735700 1 -- 172.21.15.111:0/547350772 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9980932d0 con 0x7fe998067c20 2024-04-25T02:20:58.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.847+0000 7fe9867fc700 1 -- 172.21.15.111:0/547350772 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fe99000ccc0 con 0x7fe998067c20 2024-04-25T02:20:58.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.847+0000 7fe99f735700 1 -- 172.21.15.111:0/547350772 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe998093010 con 0x7fe998067c20 2024-04-25T02:20:58.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.847+0000 7fe9867fc700 1 -- 172.21.15.111:0/547350772 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fe99004b120 con 0x7fe998067c20 2024-04-25T02:20:58.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.850+0000 7fe9867fc700 1 -- 172.21.15.111:0/547350772 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fe990030020 con 0x7fe998067c20 2024-04-25T02:20:58.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.990+0000 7fe99f735700 1 -- 172.21.15.111:0/547350772 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe998057a60 con 0x7fe998067c20 2024-04-25T02:20:58.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.991+0000 7fe9867fc700 1 -- 172.21.15.111:0/547350772 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+2330 (secure 0 0 0) 0x7fe990016070 con 0x7fe998067c20 2024-04-25T02:20:58.994 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:20:58.994 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4193,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6817/3699616235","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6817","nonce":3699616235}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:20:24.150791+0000","modified":"2024-04-25T02:20:49.242915+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4239,"mds_1":4236},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4236":{"gid":4236,"name":"c","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.111:6818/2165982859","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6818","nonce":2165982859}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4239":{"gid":4239,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.111:6819/4003866251","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6819","nonce":4003866251}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-25T02:20:58.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.992+0000 7fe99f735700 1 -- 172.21.15.111:0/547350772 >> v1:172.21.15.111:6816/39585 conn(0x7fe978038dd0 legacy=0x7fe97803b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:58.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.992+0000 7fe99f735700 1 -- 172.21.15.111:0/547350772 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe998067c20 msgr2=0x7fe9981465f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:20:58.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.992+0000 7fe99f735700 1 --2- 172.21.15.111:0/547350772 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe998067c20 0x7fe9981465f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7fe99000c000 tx=0x7fe9900091d0).stop 2024-04-25T02:20:58.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.992+0000 7fe99f735700 1 -- 172.21.15.111:0/547350772 shutdown_connections 2024-04-25T02:20:58.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.992+0000 7fe99f735700 1 --2- 172.21.15.111:0/547350772 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe998067c20 0x7fe9981465f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:58.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.992+0000 7fe99f735700 1 --2- 172.21.15.111:0/547350772 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe99805c1a0 0x7fe99813a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:58.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.992+0000 7fe99f735700 1 --2- 172.21.15.111:0/547350772 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe998066170 0x7fe998092960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:20:58.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.992+0000 7fe99f735700 1 -- 172.21.15.111:0/547350772 >> 172.21.15.111:0/547350772 conn(0x7fe9980a8a00 msgr2=0x7fe9980a4450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:20:58.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.992+0000 7fe99f735700 1 -- 172.21.15.111:0/547350772 shutdown_connections 2024-04-25T02:20:58.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:20:58.992+0000 7fe99f735700 1 -- 172.21.15.111:0/547350772 wait complete. 2024-04-25T02:20:58.996 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 11 2024-04-25T02:20:59.307 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 11, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T02:20:24.150791+0000', 'modified': '2024-04-25T02:20:49.242915+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4239, 'mds_1': 4236}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4236': {'gid': 4236, 'name': 'c', 'rank': 1, 'incarnation': 7, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.111:6818/2165982859', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.111:6818', 'nonce': 2165982859}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4239': {'gid': 4239, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.111:6819/4003866251', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.111:6819', 'nonce': 4003866251}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-25T02:20:59.307 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4236:up:stopping 2024-04-25T02:21:00.308 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:21:00.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.420+0000 7fbc7c62e700 1 Processor -- start 2024-04-25T02:21:00.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.420+0000 7fbc7c62e700 1 -- start start 2024-04-25T02:21:00.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.421+0000 7fbc7c62e700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fbc74136800 0x7fbc740642e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:00.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.421+0000 7fbc7c62e700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbc740633b0 0x7fbc74136be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:00.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.421+0000 7fbc7c62e700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fbc74062590 0x7fbc740a82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:00.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.421+0000 7fbc7c62e700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc741363d0 con 0x7fbc74136800 2024-04-25T02:21:00.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.421+0000 7fbc7c62e700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc740647d0 con 0x7fbc740633b0 2024-04-25T02:21:00.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.421+0000 7fbc7c62e700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbc74136600 con 0x7fbc74062590 2024-04-25T02:21:00.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.421+0000 7fbc7a3ca700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fbc74136800 0x7fbc740642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:00.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.421+0000 7fbc7abcb700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fbc74062590 0x7fbc740a82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:00.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.421+0000 7fbc79bc9700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbc740633b0 0x7fbc74136be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:00.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.421+0000 7fbc7abcb700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fbc74062590 0x7fbc740a82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:37264/0 (socket says 172.21.15.111:37264) 2024-04-25T02:21:00.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.421+0000 7fbc7a3ca700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fbc74136800 0x7fbc740642e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:50642/0 (socket says 172.21.15.111:50642) 2024-04-25T02:21:00.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.421+0000 7fbc79bc9700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbc740633b0 0x7fbc74136be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:48986/0 (socket says 172.21.15.111:48986) 2024-04-25T02:21:00.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.421+0000 7fbc7abcb700 1 -- 172.21.15.111:0/4069354961 learned_addr learned my addr 172.21.15.111:0/4069354961 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:21:00.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.421+0000 7fbc7a3ca700 1 -- 172.21.15.111:0/4069354961 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fbc74062590 msgr2=0x7fbc740a82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:21:00.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.421+0000 7fbc7a3ca700 1 --2- 172.21.15.111:0/4069354961 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fbc74062590 0x7fbc740a82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:00.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.421+0000 7fbc7a3ca700 1 -- 172.21.15.111:0/4069354961 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbc740633b0 msgr2=0x7fbc74136be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:21:00.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.421+0000 7fbc7a3ca700 1 --2- 172.21.15.111:0/4069354961 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbc740633b0 0x7fbc74136be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:00.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.421+0000 7fbc7a3ca700 1 -- 172.21.15.111:0/4069354961 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc740a9d70 con 0x7fbc74136800 2024-04-25T02:21:00.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.421+0000 7fbc7abcb700 1 --2- 172.21.15.111:0/4069354961 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fbc74062590 0x7fbc740a82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:21:00.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.421+0000 7fbc79bc9700 1 --2- 172.21.15.111:0/4069354961 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbc740633b0 0x7fbc74136be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:21:00.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.422+0000 7fbc7a3ca700 1 --2- 172.21.15.111:0/4069354961 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc74136800 0x7fbc740642e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fbc64002f70 tx=0x7fbc64006e80).ready entity=mon.0 client_cookie=d23a7d50b30d1b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:00.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.422+0000 7fbc793c8700 1 -- 172.21.15.111:0/4069354961 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc64012070 con 0x7fbc74136800 2024-04-25T02:21:00.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.422+0000 7fbc793c8700 1 -- 172.21.15.111:0/4069354961 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc64000e90 con 0x7fbc74136800 2024-04-25T02:21:00.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.422+0000 7fbc793c8700 1 -- 172.21.15.111:0/4069354961 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc64017850 con 0x7fbc74136800 2024-04-25T02:21:00.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.422+0000 7fbc7c62e700 1 -- 172.21.15.111:0/4069354961 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc74136800 msgr2=0x7fbc740642e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:00.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.422+0000 7fbc7c62e700 1 --2- 172.21.15.111:0/4069354961 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc74136800 0x7fbc740642e0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7fbc64002f70 tx=0x7fbc64006e80).stop 2024-04-25T02:21:00.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.422+0000 7fbc7c62e700 1 -- 172.21.15.111:0/4069354961 shutdown_connections 2024-04-25T02:21:00.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.422+0000 7fbc7c62e700 1 --2- 172.21.15.111:0/4069354961 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fbc74062590 0x7fbc740a82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:00.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.422+0000 7fbc7c62e700 1 --2- 172.21.15.111:0/4069354961 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc74136800 0x7fbc740642e0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:00.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.422+0000 7fbc7c62e700 1 --2- 172.21.15.111:0/4069354961 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbc740633b0 0x7fbc74136be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:00.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.422+0000 7fbc7c62e700 1 -- 172.21.15.111:0/4069354961 >> 172.21.15.111:0/4069354961 conn(0x7fbc740614e0 msgr2=0x7fbc7406c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:00.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.422+0000 7fbc7c62e700 1 -- 172.21.15.111:0/4069354961 shutdown_connections 2024-04-25T02:21:00.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.422+0000 7fbc7c62e700 1 -- 172.21.15.111:0/4069354961 wait complete. 2024-04-25T02:21:00.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.423+0000 7fbc7c62e700 1 Processor -- start 2024-04-25T02:21:00.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.423+0000 7fbc7c62e700 1 -- start start 2024-04-25T02:21:00.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.424+0000 7fbc7c62e700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc74062590 0x7fbc74065c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:00.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.424+0000 7fbc7c62e700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbc740633b0 0x7fbc7412bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:00.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.424+0000 7fbc7c62e700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fbc74136800 0x7fbc7412c290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:00.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.424+0000 7fbc7c62e700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc74131f40 con 0x7fbc74062590 2024-04-25T02:21:00.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.424+0000 7fbc7c62e700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc74067730 con 0x7fbc740633b0 2024-04-25T02:21:00.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.424+0000 7fbc7c62e700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fbc7412c780 con 0x7fbc74136800 2024-04-25T02:21:00.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.424+0000 7fbc79bc9700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbc740633b0 0x7fbc7412bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:00.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.424+0000 7fbc7a3ca700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc74062590 0x7fbc74065c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:00.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.424+0000 7fbc79bc9700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbc740633b0 0x7fbc7412bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:48992/0 (socket says 172.21.15.111:48992) 2024-04-25T02:21:00.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.424+0000 7fbc79bc9700 1 -- 172.21.15.111:0/2358542731 learned_addr learned my addr 172.21.15.111:0/2358542731 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:21:00.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.424+0000 7fbc7abcb700 1 --2- 172.21.15.111:0/2358542731 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fbc74136800 0x7fbc7412c290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:00.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.424+0000 7fbc7a3ca700 1 -- 172.21.15.111:0/2358542731 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fbc74136800 msgr2=0x7fbc7412c290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:00.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.424+0000 7fbc7a3ca700 1 --2- 172.21.15.111:0/2358542731 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fbc74136800 0x7fbc7412c290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:00.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.424+0000 7fbc7a3ca700 1 -- 172.21.15.111:0/2358542731 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbc740633b0 msgr2=0x7fbc7412bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:00.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.424+0000 7fbc7a3ca700 1 --2- 172.21.15.111:0/2358542731 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbc740633b0 0x7fbc7412bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:00.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.424+0000 7fbc7a3ca700 1 -- 172.21.15.111:0/2358542731 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc6c00b5e0 con 0x7fbc74062590 2024-04-25T02:21:00.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.424+0000 7fbc79bc9700 1 --2- 172.21.15.111:0/2358542731 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbc740633b0 0x7fbc7412bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:21:00.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.424+0000 7fbc7a3ca700 1 --2- 172.21.15.111:0/2358542731 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc74062590 0x7fbc74065c20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fbc64002f70 tx=0x7fbc740a9ac0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:00.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.424+0000 7fbc637fe700 1 -- 172.21.15.111:0/2358542731 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc6400b640 con 0x7fbc74062590 2024-04-25T02:21:00.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.425+0000 7fbc637fe700 1 -- 172.21.15.111:0/2358542731 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc6400b7a0 con 0x7fbc74062590 2024-04-25T02:21:00.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.425+0000 7fbc7c62e700 1 -- 172.21.15.111:0/2358542731 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc7000b180 con 0x7fbc74062590 2024-04-25T02:21:00.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.425+0000 7fbc637fe700 1 -- 172.21.15.111:0/2358542731 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fbc6400bb00 con 0x7fbc74062590 2024-04-25T02:21:00.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.425+0000 7fbc7c62e700 1 -- 172.21.15.111:0/2358542731 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc6400d590 con 0x7fbc74062590 2024-04-25T02:21:00.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.426+0000 7fbc637fe700 1 -- 172.21.15.111:0/2358542731 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fbc640163d0 con 0x7fbc74062590 2024-04-25T02:21:00.433 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.426+0000 7fbc637fe700 1 -- 172.21.15.111:0/2358542731 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fbc6404f280 con 0x7fbc74062590 2024-04-25T02:21:00.433 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.426+0000 7fbc7c62e700 1 -- 172.21.15.111:0/2358542731 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc7406cdd0 con 0x7fbc74062590 2024-04-25T02:21:00.433 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.429+0000 7fbc637fe700 1 -- 172.21.15.111:0/2358542731 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fbc64024b40 con 0x7fbc74062590 2024-04-25T02:21:00.575 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.572+0000 7fbc7c62e700 1 -- 172.21.15.111:0/2358542731 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbc74057a60 con 0x7fbc74062590 2024-04-25T02:21:00.575 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.572+0000 7fbc637fe700 1 -- 172.21.15.111:0/2358542731 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+2330 (secure 0 0 0) 0x7fbc640377a0 con 0x7fbc74062590 2024-04-25T02:21:00.576 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:21:00.576 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4193,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6817/3699616235","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6817","nonce":3699616235}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:20:24.150791+0000","modified":"2024-04-25T02:20:49.242915+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4239,"mds_1":4236},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4236":{"gid":4236,"name":"c","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.111:6818/2165982859","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6818","nonce":2165982859}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4239":{"gid":4239,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.111:6819/4003866251","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6819","nonce":4003866251}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-25T02:21:00.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.573+0000 7fbc7c62e700 1 -- 172.21.15.111:0/2358542731 >> v1:172.21.15.111:6816/39585 conn(0x7fbc54038da0 legacy=0x7fbc5403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:00.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.574+0000 7fbc7c62e700 1 -- 172.21.15.111:0/2358542731 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc74062590 msgr2=0x7fbc74065c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:00.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.574+0000 7fbc7c62e700 1 --2- 172.21.15.111:0/2358542731 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc74062590 0x7fbc74065c20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fbc64002f70 tx=0x7fbc740a9ac0).stop 2024-04-25T02:21:00.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.574+0000 7fbc7c62e700 1 -- 172.21.15.111:0/2358542731 shutdown_connections 2024-04-25T02:21:00.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.574+0000 7fbc7c62e700 1 --2- 172.21.15.111:0/2358542731 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fbc74136800 0x7fbc7412c290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:00.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.574+0000 7fbc7c62e700 1 --2- 172.21.15.111:0/2358542731 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fbc74062590 0x7fbc74065c20 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:00.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.574+0000 7fbc7c62e700 1 --2- 172.21.15.111:0/2358542731 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fbc740633b0 0x7fbc7412bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:00.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.574+0000 7fbc7c62e700 1 -- 172.21.15.111:0/2358542731 >> 172.21.15.111:0/2358542731 conn(0x7fbc740614e0 msgr2=0x7fbc740a7990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:00.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.574+0000 7fbc7c62e700 1 -- 172.21.15.111:0/2358542731 shutdown_connections 2024-04-25T02:21:00.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:00.574+0000 7fbc7c62e700 1 -- 172.21.15.111:0/2358542731 wait complete. 2024-04-25T02:21:00.578 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 11 2024-04-25T02:21:00.889 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 11, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T02:20:24.150791+0000', 'modified': '2024-04-25T02:20:49.242915+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4239, 'mds_1': 4236}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4236': {'gid': 4236, 'name': 'c', 'rank': 1, 'incarnation': 7, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.111:6818/2165982859', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.111:6818', 'nonce': 2165982859}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4239': {'gid': 4239, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.111:6819/4003866251', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.111:6819', 'nonce': 4003866251}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-25T02:21:00.889 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4236:up:stopping 2024-04-25T02:21:01.890 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:21:02.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.001+0000 7fc22f470700 1 Processor -- start 2024-04-25T02:21:02.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.001+0000 7fc22f470700 1 -- start start 2024-04-25T02:21:02.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.002+0000 7fc22f470700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fc2280633b0 0x7fc2280642e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:02.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.002+0000 7fc22f470700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc228062590 0x7fc22813d710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:02.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.002+0000 7fc22f470700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2281363d0 con 0x7fc228136800 2024-04-25T02:21:02.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.002+0000 7fc22f470700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2281372f0 con 0x7fc2280633b0 2024-04-25T02:21:02.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.002+0000 7fc22f470700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2280647d0 con 0x7fc228062590 2024-04-25T02:21:02.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.002+0000 7fc22ca0b700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fc2280633b0 0x7fc2280642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:02.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.002+0000 7fc22da0d700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc228062590 0x7fc22813d710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:02.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.002+0000 7fc22d20c700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7fc228136800 0x7fc228136be0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:33224/0 (socket says 172.21.15.111:33224) 2024-04-25T02:21:02.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.002+0000 7fc22d20c700 1 -- 172.21.15.111:0/1812890192 learned_addr learned my addr 172.21.15.111:0/1812890192 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:21:02.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.002+0000 7fc217fff700 1 -- 172.21.15.111:0/1812890192 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4221737799 0 0) 0x7fc2281363d0 con 0x7fc228136800 2024-04-25T02:21:02.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.002+0000 7fc217fff700 1 -- 172.21.15.111:0/1812890192 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc210003260 con 0x7fc228136800 2024-04-25T02:21:02.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.003+0000 7fc22da0d700 1 -- 172.21.15.111:0/1812890192 >> v2:172.21.15.111:3300/0 conn(0x7fc2280633b0 msgr2=0x7fc2280642e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:21:02.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.003+0000 7fc22da0d700 1 --2- 172.21.15.111:0/1812890192 >> v2:172.21.15.111:3300/0 conn(0x7fc2280633b0 0x7fc2280642e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:02.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.003+0000 7fc22da0d700 1 -- 172.21.15.111:0/1812890192 >> v1:172.21.15.111:6789/0 conn(0x7fc228136800 legacy=0x7fc228136be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:02.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.003+0000 7fc22da0d700 1 -- 172.21.15.111:0/1812890192 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc228136600 con 0x7fc228062590 2024-04-25T02:21:02.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.003+0000 7fc22ca0b700 1 --2- 172.21.15.111:0/1812890192 >> v2:172.21.15.111:3300/0 conn(0x7fc2280633b0 0x7fc2280642e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:21:02.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.003+0000 7fc22da0d700 1 --2- 172.21.15.111:0/1812890192 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc228062590 0x7fc22813d710 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fc228132eb0 tx=0x7fc2200091d0).ready entity=mon.1 client_cookie=86abadd5c796d5e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:02.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.003+0000 7fc217fff700 1 -- 172.21.15.111:0/1812890192 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc22000b600 con 0x7fc228062590 2024-04-25T02:21:02.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.003+0000 7fc217fff700 1 -- 172.21.15.111:0/1812890192 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc22000b760 con 0x7fc228062590 2024-04-25T02:21:02.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.003+0000 7fc217fff700 1 -- 172.21.15.111:0/1812890192 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc22000b8d0 con 0x7fc228062590 2024-04-25T02:21:02.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.003+0000 7fc22f470700 1 -- 172.21.15.111:0/1812890192 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc228062590 msgr2=0x7fc22813d710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:02.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.003+0000 7fc22f470700 1 --2- 172.21.15.111:0/1812890192 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc228062590 0x7fc22813d710 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fc228132eb0 tx=0x7fc2200091d0).stop 2024-04-25T02:21:02.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.003+0000 7fc22f470700 1 -- 172.21.15.111:0/1812890192 shutdown_connections 2024-04-25T02:21:02.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.003+0000 7fc22f470700 1 --2- 172.21.15.111:0/1812890192 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc228062590 0x7fc22813d710 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:02.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.003+0000 7fc22f470700 1 --2- 172.21.15.111:0/1812890192 >> v2:172.21.15.111:3300/0 conn(0x7fc2280633b0 0x7fc2280642e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:02.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.003+0000 7fc22f470700 1 -- 172.21.15.111:0/1812890192 >> 172.21.15.111:0/1812890192 conn(0x7fc2280614e0 msgr2=0x7fc22806c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:02.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.003+0000 7fc22f470700 1 -- 172.21.15.111:0/1812890192 shutdown_connections 2024-04-25T02:21:02.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.003+0000 7fc22f470700 1 -- 172.21.15.111:0/1812890192 wait complete. 2024-04-25T02:21:02.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.004+0000 7fc22f470700 1 Processor -- start 2024-04-25T02:21:02.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.004+0000 7fc22f470700 1 -- start start 2024-04-25T02:21:02.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.005+0000 7fc22f470700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc228062590 0x7fc228098cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:02.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.005+0000 7fc22f470700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc2280633b0 0x7fc2280964c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:02.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.005+0000 7fc22f470700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc228136800 0x7fc2280969b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:02.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.005+0000 7fc22f470700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc228065030 con 0x7fc228136800 2024-04-25T02:21:02.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.005+0000 7fc22f470700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc228065310 con 0x7fc228062590 2024-04-25T02:21:02.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.005+0000 7fc22f470700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc2280659b0 con 0x7fc2280633b0 2024-04-25T02:21:02.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.005+0000 7fc22da0d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc228136800 0x7fc2280969b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:02.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.005+0000 7fc22ca0b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc2280633b0 0x7fc2280964c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:02.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.005+0000 7fc22da0d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc228136800 0x7fc2280969b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:50670/0 (socket says 172.21.15.111:50670) 2024-04-25T02:21:02.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.005+0000 7fc22da0d700 1 -- 172.21.15.111:0/2355239208 learned_addr learned my addr 172.21.15.111:0/2355239208 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:21:02.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.005+0000 7fc22d20c700 1 --2- 172.21.15.111:0/2355239208 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc228062590 0x7fc228098cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:02.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.005+0000 7fc22da0d700 1 -- 172.21.15.111:0/2355239208 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc2280633b0 msgr2=0x7fc2280964c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:02.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.005+0000 7fc22da0d700 1 --2- 172.21.15.111:0/2355239208 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc2280633b0 0x7fc2280964c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:02.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.005+0000 7fc22da0d700 1 -- 172.21.15.111:0/2355239208 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc228062590 msgr2=0x7fc228098cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:02.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.005+0000 7fc22da0d700 1 --2- 172.21.15.111:0/2355239208 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc228062590 0x7fc228098cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:02.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.005+0000 7fc22da0d700 1 -- 172.21.15.111:0/2355239208 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc22400b180 con 0x7fc228136800 2024-04-25T02:21:02.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.005+0000 7fc22ca0b700 1 --2- 172.21.15.111:0/2355239208 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc2280633b0 0x7fc2280964c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:21:02.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.005+0000 7fc22da0d700 1 --2- 172.21.15.111:0/2355239208 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc228136800 0x7fc2280969b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fc228132eb0 tx=0x7fc220016000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:02.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.006+0000 7fc2167fc700 1 -- 172.21.15.111:0/2355239208 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc220011b60 con 0x7fc228136800 2024-04-25T02:21:02.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.006+0000 7fc2167fc700 1 -- 172.21.15.111:0/2355239208 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc220011cc0 con 0x7fc228136800 2024-04-25T02:21:02.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.006+0000 7fc22f470700 1 -- 172.21.15.111:0/2355239208 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc220009470 con 0x7fc228136800 2024-04-25T02:21:02.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.006+0000 7fc2167fc700 1 -- 172.21.15.111:0/2355239208 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fc22001f5e0 con 0x7fc228136800 2024-04-25T02:21:02.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.006+0000 7fc22f470700 1 -- 172.21.15.111:0/2355239208 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc22805c310 con 0x7fc228136800 2024-04-25T02:21:02.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.007+0000 7fc2167fc700 1 -- 172.21.15.111:0/2355239208 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fc22000f070 con 0x7fc228136800 2024-04-25T02:21:02.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.007+0000 7fc22f470700 1 -- 172.21.15.111:0/2355239208 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc228068350 con 0x7fc228136800 2024-04-25T02:21:02.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.007+0000 7fc2167fc700 1 -- 172.21.15.111:0/2355239208 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fc22004b1f0 con 0x7fc228136800 2024-04-25T02:21:02.015 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.010+0000 7fc2167fc700 1 -- 172.21.15.111:0/2355239208 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fc220008cd0 con 0x7fc228136800 2024-04-25T02:21:02.153 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.149+0000 7fc22f470700 1 -- 172.21.15.111:0/2355239208 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc22806cd40 con 0x7fc228136800 2024-04-25T02:21:02.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.150+0000 7fc2167fc700 1 -- 172.21.15.111:0/2355239208 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+2330 (secure 0 0 0) 0x7fc22001f740 con 0x7fc228136800 2024-04-25T02:21:02.154 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:21:02.154 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4193,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6817/3699616235","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6817","nonce":3699616235}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:20:24.150791+0000","modified":"2024-04-25T02:20:49.242915+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4239,"mds_1":4236},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4236":{"gid":4236,"name":"c","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.111:6818/2165982859","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6818","nonce":2165982859}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4239":{"gid":4239,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.111:6819/4003866251","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6819","nonce":4003866251}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-25T02:21:02.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.151+0000 7fc22f470700 1 -- 172.21.15.111:0/2355239208 >> v1:172.21.15.111:6816/39585 conn(0x7fc208038da0 legacy=0x7fc20803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:02.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.151+0000 7fc22f470700 1 -- 172.21.15.111:0/2355239208 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc228136800 msgr2=0x7fc2280969b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:02.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.151+0000 7fc22f470700 1 --2- 172.21.15.111:0/2355239208 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc228136800 0x7fc2280969b0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fc228132eb0 tx=0x7fc220016000).stop 2024-04-25T02:21:02.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.151+0000 7fc22f470700 1 -- 172.21.15.111:0/2355239208 shutdown_connections 2024-04-25T02:21:02.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.151+0000 7fc22f470700 1 --2- 172.21.15.111:0/2355239208 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc228136800 0x7fc2280969b0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:02.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.151+0000 7fc22f470700 1 --2- 172.21.15.111:0/2355239208 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc228062590 0x7fc228098cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:02.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.151+0000 7fc22f470700 1 --2- 172.21.15.111:0/2355239208 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc2280633b0 0x7fc2280964c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:02.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.151+0000 7fc22f470700 1 -- 172.21.15.111:0/2355239208 >> 172.21.15.111:0/2355239208 conn(0x7fc2280614e0 msgr2=0x7fc228131890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:02.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.151+0000 7fc22f470700 1 -- 172.21.15.111:0/2355239208 shutdown_connections 2024-04-25T02:21:02.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:02.151+0000 7fc22f470700 1 -- 172.21.15.111:0/2355239208 wait complete. 2024-04-25T02:21:02.158 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 11 2024-04-25T02:21:02.468 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 11, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T02:20:24.150791+0000', 'modified': '2024-04-25T02:20:49.242915+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4239, 'mds_1': 4236}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4236': {'gid': 4236, 'name': 'c', 'rank': 1, 'incarnation': 7, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.111:6818/2165982859', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.111:6818', 'nonce': 2165982859}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4239': {'gid': 4239, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.111:6819/4003866251', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.111:6819', 'nonce': 4003866251}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-25T02:21:02.490 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4236:up:stopping 2024-04-25T02:21:03.490 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:21:03.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.600+0000 7fb100dbf700 1 Processor -- start 2024-04-25T02:21:03.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.600+0000 7fb100dbf700 1 -- start start 2024-04-25T02:21:03.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.601+0000 7fb100dbf700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb0fc05c1a0 0x7fb0fc067040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:03.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.601+0000 7fb100dbf700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb0fc067c20 0x7fb0fc05c580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:03.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.601+0000 7fb100dbf700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fb0fc066170 0x7fb0fc0a7af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:03.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.601+0000 7fb100dbf700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb0fc05ca70 con 0x7fb0fc066170 2024-04-25T02:21:03.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.601+0000 7fb100dbf700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc065c90 con 0x7fb0fc05c1a0 2024-04-25T02:21:03.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.601+0000 7fb100dbf700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc0a7fe0 con 0x7fb0fc067c20 2024-04-25T02:21:03.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.601+0000 7fb0f9d9b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb0fc067c20 0x7fb0fc05c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:03.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.601+0000 7fb0fad9d700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fb0fc066170 0x7fb0fc0a7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:03.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.601+0000 7fb0f9d9b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb0fc067c20 0x7fb0fc05c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:37274/0 (socket says 172.21.15.111:37274) 2024-04-25T02:21:03.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.601+0000 7fb0f9d9b700 1 -- 172.21.15.111:0/53317735 learned_addr learned my addr 172.21.15.111:0/53317735 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:21:03.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.601+0000 7fb0fa59c700 1 --2- 172.21.15.111:0/53317735 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb0fc05c1a0 0x7fb0fc067040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:03.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.601+0000 7fb0fad9d700 1 -- 172.21.15.111:0/53317735 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb0fc067c20 msgr2=0x7fb0fc05c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:21:03.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.601+0000 7fb0fad9d700 1 --2- 172.21.15.111:0/53317735 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb0fc067c20 0x7fb0fc05c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:03.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.601+0000 7fb0fad9d700 1 -- 172.21.15.111:0/53317735 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb0fc05c1a0 msgr2=0x7fb0fc067040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:21:03.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.601+0000 7fb0fad9d700 1 --2- 172.21.15.111:0/53317735 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb0fc05c1a0 0x7fb0fc067040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:03.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.601+0000 7fb0fad9d700 1 -- 172.21.15.111:0/53317735 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0fc067680 con 0x7fb0fc066170 2024-04-25T02:21:03.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.601+0000 7fb0fa59c700 1 --2- 172.21.15.111:0/53317735 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb0fc05c1a0 0x7fb0fc067040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:21:03.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.601+0000 7fb0f9d9b700 1 --2- 172.21.15.111:0/53317735 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb0fc067c20 0x7fb0fc05c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:21:03.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.601+0000 7fb0fad9d700 1 --2- 172.21.15.111:0/53317735 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb0fc066170 0x7fb0fc0a7af0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fb0f40032f0 tx=0x7fb0f40091d0).ready entity=mon.0 client_cookie=b4e304ddf51fc8e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:03.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.601+0000 7fb0f959a700 1 -- 172.21.15.111:0/53317735 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0f400b600 con 0x7fb0fc066170 2024-04-25T02:21:03.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.601+0000 7fb0f959a700 1 -- 172.21.15.111:0/53317735 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f400b760 con 0x7fb0fc066170 2024-04-25T02:21:03.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.601+0000 7fb0f959a700 1 -- 172.21.15.111:0/53317735 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0f400b8d0 con 0x7fb0fc066170 2024-04-25T02:21:03.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.602+0000 7fb100dbf700 1 -- 172.21.15.111:0/53317735 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb0fc066170 msgr2=0x7fb0fc0a7af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:03.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.602+0000 7fb100dbf700 1 --2- 172.21.15.111:0/53317735 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb0fc066170 0x7fb0fc0a7af0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fb0f40032f0 tx=0x7fb0f40091d0).stop 2024-04-25T02:21:03.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.602+0000 7fb100dbf700 1 -- 172.21.15.111:0/53317735 shutdown_connections 2024-04-25T02:21:03.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.602+0000 7fb100dbf700 1 --2- 172.21.15.111:0/53317735 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb0fc066170 0x7fb0fc0a7af0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:03.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.602+0000 7fb100dbf700 1 --2- 172.21.15.111:0/53317735 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb0fc05c1a0 0x7fb0fc067040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:03.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.602+0000 7fb100dbf700 1 --2- 172.21.15.111:0/53317735 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb0fc067c20 0x7fb0fc05c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:03.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.602+0000 7fb100dbf700 1 -- 172.21.15.111:0/53317735 >> 172.21.15.111:0/53317735 conn(0x7fb0fc0a8a00 msgr2=0x7fb0fc0a8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:03.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.602+0000 7fb100dbf700 1 -- 172.21.15.111:0/53317735 shutdown_connections 2024-04-25T02:21:03.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.602+0000 7fb100dbf700 1 -- 172.21.15.111:0/53317735 wait complete. 2024-04-25T02:21:03.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.603+0000 7fb100dbf700 1 Processor -- start 2024-04-25T02:21:03.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.603+0000 7fb100dbf700 1 -- start start 2024-04-25T02:21:03.611 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.603+0000 7fb100dbf700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb0fc05c1a0 0x7fb0fc095e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:03.611 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.603+0000 7fb100dbf700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb0fc066170 0x7fb0fc149240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:03.611 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.603+0000 7fb100dbf700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb0fc067c20 0x7fb0fc149730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:03.611 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.603+0000 7fb100dbf700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc095960 con 0x7fb0fc067c20 2024-04-25T02:21:03.611 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.603+0000 7fb100dbf700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc0931c0 con 0x7fb0fc066170 2024-04-25T02:21:03.611 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.603+0000 7fb100dbf700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc0a2d80 con 0x7fb0fc05c1a0 2024-04-25T02:21:03.611 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.604+0000 7fb0fa59c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb0fc05c1a0 0x7fb0fc095e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:03.611 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.604+0000 7fb0fad9d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb0fc067c20 0x7fb0fc149730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:03.612 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.604+0000 7fb0f9d9b700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb0fc066170 0x7fb0fc149240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:03.612 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.604+0000 7fb0fa59c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb0fc05c1a0 0x7fb0fc095e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:37278/0 (socket says 172.21.15.111:37278) 2024-04-25T02:21:03.612 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.604+0000 7fb0fad9d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb0fc067c20 0x7fb0fc149730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:50684/0 (socket says 172.21.15.111:50684) 2024-04-25T02:21:03.612 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.604+0000 7fb0fa59c700 1 -- 172.21.15.111:0/1192621779 learned_addr learned my addr 172.21.15.111:0/1192621779 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:21:03.612 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.604+0000 7fb0fa59c700 1 -- 172.21.15.111:0/1192621779 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb0fc066170 msgr2=0x7fb0fc149240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:03.612 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.604+0000 7fb0fa59c700 1 --2- 172.21.15.111:0/1192621779 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb0fc066170 0x7fb0fc149240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:03.612 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.604+0000 7fb0fa59c700 1 -- 172.21.15.111:0/1192621779 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb0fc067c20 msgr2=0x7fb0fc149730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:03.612 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.604+0000 7fb0fa59c700 1 --2- 172.21.15.111:0/1192621779 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb0fc067c20 0x7fb0fc149730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:03.612 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.604+0000 7fb0fa59c700 1 -- 172.21.15.111:0/1192621779 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0ec00b180 con 0x7fb0fc05c1a0 2024-04-25T02:21:03.612 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.604+0000 7fb0fa59c700 1 --2- 172.21.15.111:0/1192621779 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb0fc05c1a0 0x7fb0fc095e20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fb0ec00c000 tx=0x7fb0ec006df0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:03.612 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.604+0000 7fb0eb7fe700 1 -- 172.21.15.111:0/1192621779 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0ec00c890 con 0x7fb0fc05c1a0 2024-04-25T02:21:03.612 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.604+0000 7fb0eb7fe700 1 -- 172.21.15.111:0/1192621779 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0ec00c9f0 con 0x7fb0fc05c1a0 2024-04-25T02:21:03.612 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.604+0000 7fb100dbf700 1 -- 172.21.15.111:0/1192621779 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0f000b1e0 con 0x7fb0fc05c1a0 2024-04-25T02:21:03.612 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.604+0000 7fb0eb7fe700 1 -- 172.21.15.111:0/1192621779 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fb0ec00cd50 con 0x7fb0fc05c1a0 2024-04-25T02:21:03.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.604+0000 7fb100dbf700 1 -- 172.21.15.111:0/1192621779 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0f4009470 con 0x7fb0fc05c1a0 2024-04-25T02:21:03.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.605+0000 7fb0eb7fe700 1 -- 172.21.15.111:0/1192621779 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fb0ec01c460 con 0x7fb0fc05c1a0 2024-04-25T02:21:03.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.605+0000 7fb0eb7fe700 1 -- 172.21.15.111:0/1192621779 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fb0ec04aea0 con 0x7fb0fc05c1a0 2024-04-25T02:21:03.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.605+0000 7fb100dbf700 1 -- 172.21.15.111:0/1192621779 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0fc057a60 con 0x7fb0fc05c1a0 2024-04-25T02:21:03.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.608+0000 7fb0eb7fe700 1 -- 172.21.15.111:0/1192621779 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fb0ec0337d0 con 0x7fb0fc05c1a0 2024-04-25T02:21:03.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.749+0000 7fb100dbf700 1 -- 172.21.15.111:0/1192621779 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb0fc0a84a0 con 0x7fb0fc05c1a0 2024-04-25T02:21:03.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.750+0000 7fb0eb7fe700 1 -- 172.21.15.111:0/1192621779 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+2330 (secure 0 0 0) 0x7fb0ec02b090 con 0x7fb0fc05c1a0 2024-04-25T02:21:03.754 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:21:03.754 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4193,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6817/3699616235","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6817","nonce":3699616235}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:20:24.150791+0000","modified":"2024-04-25T02:20:49.242915+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4239,"mds_1":4236},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4236":{"gid":4236,"name":"c","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.111:6818/2165982859","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6818","nonce":2165982859}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4239":{"gid":4239,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.111:6819/4003866251","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6819","nonce":4003866251}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-25T02:21:03.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.751+0000 7fb100dbf700 1 -- 172.21.15.111:0/1192621779 >> v1:172.21.15.111:6816/39585 conn(0x7fb0d8038da0 legacy=0x7fb0d803b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:03.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.751+0000 7fb100dbf700 1 -- 172.21.15.111:0/1192621779 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb0fc05c1a0 msgr2=0x7fb0fc095e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:03.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.751+0000 7fb100dbf700 1 --2- 172.21.15.111:0/1192621779 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb0fc05c1a0 0x7fb0fc095e20 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fb0ec00c000 tx=0x7fb0ec006df0).stop 2024-04-25T02:21:03.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.751+0000 7fb100dbf700 1 -- 172.21.15.111:0/1192621779 shutdown_connections 2024-04-25T02:21:03.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.751+0000 7fb100dbf700 1 --2- 172.21.15.111:0/1192621779 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb0fc067c20 0x7fb0fc149730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:03.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.751+0000 7fb100dbf700 1 --2- 172.21.15.111:0/1192621779 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb0fc05c1a0 0x7fb0fc095e20 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:03.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.751+0000 7fb100dbf700 1 --2- 172.21.15.111:0/1192621779 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb0fc066170 0x7fb0fc149240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:03.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.751+0000 7fb100dbf700 1 -- 172.21.15.111:0/1192621779 >> 172.21.15.111:0/1192621779 conn(0x7fb0fc0a8a00 msgr2=0x7fb0fc136b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:03.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.751+0000 7fb100dbf700 1 -- 172.21.15.111:0/1192621779 shutdown_connections 2024-04-25T02:21:03.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:03.751+0000 7fb100dbf700 1 -- 172.21.15.111:0/1192621779 wait complete. 2024-04-25T02:21:03.756 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 11 2024-04-25T02:21:04.068 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 11, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T02:20:24.150791+0000', 'modified': '2024-04-25T02:20:49.242915+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4239, 'mds_1': 4236}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4236': {'gid': 4236, 'name': 'c', 'rank': 1, 'incarnation': 7, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.111:6818/2165982859', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.111:6818', 'nonce': 2165982859}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4239': {'gid': 4239, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.111:6819/4003866251', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.111:6819', 'nonce': 4003866251}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-25T02:21:04.068 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4236:up:stopping 2024-04-25T02:21:05.068 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:21:05.182 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.178+0000 7fd979253700 1 Processor -- start 2024-04-25T02:21:05.182 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.178+0000 7fd979253700 1 -- start start 2024-04-25T02:21:05.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.179+0000 7fd979253700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fd974136800 0x7fd9740642e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:05.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.179+0000 7fd979253700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd9740633b0 0x7fd974136be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:05.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.179+0000 7fd979253700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9741363d0 con 0x7fd974062590 2024-04-25T02:21:05.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.179+0000 7fd979253700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9740647d0 con 0x7fd974136800 2024-04-25T02:21:05.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.179+0000 7fd979253700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd974136600 con 0x7fd9740633b0 2024-04-25T02:21:05.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.179+0000 7fd97259c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd9740633b0 0x7fd974136be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:05.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.179+0000 7fd972d9d700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fd974136800 0x7fd9740642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:05.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.179+0000 7fd97359e700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7fd974062590 0x7fd9740a82a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:33234/0 (socket says 172.21.15.111:33234) 2024-04-25T02:21:05.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.179+0000 7fd97259c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd9740633b0 0x7fd974136be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:37284/0 (socket says 172.21.15.111:37284) 2024-04-25T02:21:05.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.179+0000 7fd972d9d700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fd974136800 0x7fd9740642e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:50698/0 (socket says 172.21.15.111:50698) 2024-04-25T02:21:05.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.179+0000 7fd97359e700 1 -- 172.21.15.111:0/2482126900 learned_addr learned my addr 172.21.15.111:0/2482126900 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:21:05.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.179+0000 7fd97259c700 1 -- 172.21.15.111:0/2482126900 >> v2:172.21.15.111:3300/0 conn(0x7fd974136800 msgr2=0x7fd9740642e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:21:05.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.179+0000 7fd97259c700 1 --2- 172.21.15.111:0/2482126900 >> v2:172.21.15.111:3300/0 conn(0x7fd974136800 0x7fd9740642e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:05.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.179+0000 7fd97259c700 1 -- 172.21.15.111:0/2482126900 >> v1:172.21.15.111:6789/0 conn(0x7fd974062590 legacy=0x7fd9740a82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:05.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.179+0000 7fd97259c700 1 -- 172.21.15.111:0/2482126900 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9740a9d70 con 0x7fd9740633b0 2024-04-25T02:21:05.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.179+0000 7fd972d9d700 1 --2- 172.21.15.111:0/2482126900 >> v2:172.21.15.111:3300/0 conn(0x7fd974136800 0x7fd9740642e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:21:05.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.179+0000 7fd97259c700 1 --2- 172.21.15.111:0/2482126900 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd9740633b0 0x7fd974136be0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fd964002f70 tx=0x7fd964006df0).ready entity=mon.2 client_cookie=28e1ea4c6c338cd9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:05.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.180+0000 7fd971d9b700 1 -- 172.21.15.111:0/2482126900 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd96400d570 con 0x7fd9740633b0 2024-04-25T02:21:05.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.180+0000 7fd971d9b700 1 -- 172.21.15.111:0/2482126900 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd964000e90 con 0x7fd9740633b0 2024-04-25T02:21:05.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.180+0000 7fd971d9b700 1 -- 172.21.15.111:0/2482126900 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd96400d8c0 con 0x7fd9740633b0 2024-04-25T02:21:05.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.180+0000 7fd979253700 1 -- 172.21.15.111:0/2482126900 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd9740633b0 msgr2=0x7fd974136be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:05.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.180+0000 7fd979253700 1 --2- 172.21.15.111:0/2482126900 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd9740633b0 0x7fd974136be0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fd964002f70 tx=0x7fd964006df0).stop 2024-04-25T02:21:05.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.180+0000 7fd979253700 1 -- 172.21.15.111:0/2482126900 shutdown_connections 2024-04-25T02:21:05.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.180+0000 7fd979253700 1 --2- 172.21.15.111:0/2482126900 >> v2:172.21.15.111:3300/0 conn(0x7fd974136800 0x7fd9740642e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:05.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.180+0000 7fd979253700 1 --2- 172.21.15.111:0/2482126900 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd9740633b0 0x7fd974136be0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:05.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.180+0000 7fd979253700 1 -- 172.21.15.111:0/2482126900 >> 172.21.15.111:0/2482126900 conn(0x7fd9740614e0 msgr2=0x7fd97406c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:05.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.180+0000 7fd979253700 1 -- 172.21.15.111:0/2482126900 shutdown_connections 2024-04-25T02:21:05.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.180+0000 7fd979253700 1 -- 172.21.15.111:0/2482126900 wait complete. 2024-04-25T02:21:05.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.181+0000 7fd979253700 1 Processor -- start 2024-04-25T02:21:05.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.181+0000 7fd979253700 1 -- start start 2024-04-25T02:21:05.189 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.182+0000 7fd979253700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd974062590 0x7fd97413ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:05.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.182+0000 7fd979253700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd9740633b0 0x7fd974094780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:05.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.182+0000 7fd979253700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd974136800 0x7fd9740920b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:05.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.182+0000 7fd979253700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd97413f240 con 0x7fd974062590 2024-04-25T02:21:05.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.182+0000 7fd979253700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd974093130 con 0x7fd9740633b0 2024-04-25T02:21:05.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.182+0000 7fd979253700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd97413f4b0 con 0x7fd974136800 2024-04-25T02:21:05.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.182+0000 7fd972d9d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd974062590 0x7fd97413ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:05.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.182+0000 7fd972d9d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd974062590 0x7fd97413ed50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:50704/0 (socket says 172.21.15.111:50704) 2024-04-25T02:21:05.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.182+0000 7fd97359e700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd974136800 0x7fd9740920b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:05.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.182+0000 7fd972d9d700 1 -- 172.21.15.111:0/1008945995 learned_addr learned my addr 172.21.15.111:0/1008945995 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:21:05.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.182+0000 7fd97259c700 1 --2- 172.21.15.111:0/1008945995 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd9740633b0 0x7fd974094780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:05.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.182+0000 7fd972d9d700 1 -- 172.21.15.111:0/1008945995 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd974136800 msgr2=0x7fd9740920b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:05.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.182+0000 7fd972d9d700 1 --2- 172.21.15.111:0/1008945995 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd974136800 0x7fd9740920b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:05.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.182+0000 7fd972d9d700 1 -- 172.21.15.111:0/1008945995 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd9740633b0 msgr2=0x7fd974094780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:05.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.182+0000 7fd972d9d700 1 --2- 172.21.15.111:0/1008945995 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd9740633b0 0x7fd974094780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:05.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.182+0000 7fd972d9d700 1 -- 172.21.15.111:0/1008945995 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd96800b180 con 0x7fd974062590 2024-04-25T02:21:05.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.182+0000 7fd97259c700 1 --2- 172.21.15.111:0/1008945995 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd9740633b0 0x7fd974094780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:21:05.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.182+0000 7fd972d9d700 1 --2- 172.21.15.111:0/1008945995 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd974062590 0x7fd97413ed50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fd96800c000 tx=0x7fd968006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:05.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.182+0000 7fd963fff700 1 -- 172.21.15.111:0/1008945995 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd968010780 con 0x7fd974062590 2024-04-25T02:21:05.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.182+0000 7fd963fff700 1 -- 172.21.15.111:0/1008945995 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd9680108e0 con 0x7fd974062590 2024-04-25T02:21:05.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.182+0000 7fd979253700 1 -- 172.21.15.111:0/1008945995 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd96400b180 con 0x7fd974062590 2024-04-25T02:21:05.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.182+0000 7fd963fff700 1 -- 172.21.15.111:0/1008945995 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fd968010c40 con 0x7fd974062590 2024-04-25T02:21:05.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.182+0000 7fd979253700 1 -- 172.21.15.111:0/1008945995 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd974094c70 con 0x7fd974062590 2024-04-25T02:21:05.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.183+0000 7fd963fff700 1 -- 172.21.15.111:0/1008945995 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fd96801c460 con 0x7fd974062590 2024-04-25T02:21:05.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.183+0000 7fd963fff700 1 -- 172.21.15.111:0/1008945995 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fd96804ad70 con 0x7fd974062590 2024-04-25T02:21:05.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.183+0000 7fd979253700 1 -- 172.21.15.111:0/1008945995 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd974057a60 con 0x7fd974062590 2024-04-25T02:21:05.192 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.186+0000 7fd963fff700 1 -- 172.21.15.111:0/1008945995 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fd968033600 con 0x7fd974062590 2024-04-25T02:21:05.333 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.329+0000 7fd979253700 1 -- 172.21.15.111:0/1008945995 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd9740a9fd0 con 0x7fd974062590 2024-04-25T02:21:05.333 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.329+0000 7fd963fff700 1 -- 172.21.15.111:0/1008945995 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+2330 (secure 0 0 0) 0x7fd96802b090 con 0x7fd974062590 2024-04-25T02:21:05.333 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:21:05.333 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4193,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6817/3699616235","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6817","nonce":3699616235}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:20:24.150791+0000","modified":"2024-04-25T02:20:49.242915+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4239,"mds_1":4236},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4236":{"gid":4236,"name":"c","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.111:6818/2165982859","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6818","nonce":2165982859}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4239":{"gid":4239,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.111:6819/4003866251","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6819","nonce":4003866251}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-25T02:21:05.335 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.330+0000 7fd979253700 1 -- 172.21.15.111:0/1008945995 >> v1:172.21.15.111:6816/39585 conn(0x7fd950038dd0 legacy=0x7fd95003b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:05.335 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.330+0000 7fd979253700 1 -- 172.21.15.111:0/1008945995 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd974062590 msgr2=0x7fd97413ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:05.335 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.330+0000 7fd979253700 1 --2- 172.21.15.111:0/1008945995 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd974062590 0x7fd97413ed50 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fd96800c000 tx=0x7fd968006df0).stop 2024-04-25T02:21:05.335 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.330+0000 7fd979253700 1 -- 172.21.15.111:0/1008945995 shutdown_connections 2024-04-25T02:21:05.335 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.330+0000 7fd979253700 1 --2- 172.21.15.111:0/1008945995 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd974136800 0x7fd9740920b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:05.335 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.330+0000 7fd979253700 1 --2- 172.21.15.111:0/1008945995 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd974062590 0x7fd97413ed50 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:05.335 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.330+0000 7fd979253700 1 --2- 172.21.15.111:0/1008945995 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd9740633b0 0x7fd974094780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:05.335 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.330+0000 7fd979253700 1 -- 172.21.15.111:0/1008945995 >> 172.21.15.111:0/1008945995 conn(0x7fd9740614e0 msgr2=0x7fd9740a9360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:05.335 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.331+0000 7fd979253700 1 -- 172.21.15.111:0/1008945995 shutdown_connections 2024-04-25T02:21:05.335 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:05.331+0000 7fd979253700 1 -- 172.21.15.111:0/1008945995 wait complete. 2024-04-25T02:21:05.336 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 11 2024-04-25T02:21:05.646 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 11, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T02:20:24.150791+0000', 'modified': '2024-04-25T02:20:49.242915+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4239, 'mds_1': 4236}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4236': {'gid': 4236, 'name': 'c', 'rank': 1, 'incarnation': 7, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.111:6818/2165982859', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.111:6818', 'nonce': 2165982859}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4239': {'gid': 4239, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.111:6819/4003866251', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.111:6819', 'nonce': 4003866251}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-25T02:21:05.647 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4236:up:stopping 2024-04-25T02:21:06.647 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:21:06.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.758+0000 7f18bbad9700 1 Processor -- start 2024-04-25T02:21:06.763 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.759+0000 7f18bbad9700 1 -- start start 2024-04-25T02:21:06.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.759+0000 7f18bbad9700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f18b4139c10 0x7f18b4139ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:06.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.759+0000 7f18bbad9700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f18b4097990 0x7f18b405c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:06.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.759+0000 7f18bbad9700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18b413a4e0 con 0x7f18b4097580 2024-04-25T02:21:06.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.759+0000 7f18bbad9700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18b4099610 con 0x7f18b4139c10 2024-04-25T02:21:06.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.759+0000 7f18bbad9700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b4096f80 con 0x7f18b4097990 2024-04-25T02:21:06.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.759+0000 7f18ba076700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f18b4097990 0x7f18b405c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:06.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.759+0000 7f18b9875700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f18b4139c10 0x7f18b4139ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:06.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.759+0000 7f18b9074700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f18b4097580 0x7f18b405ba50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:33240/0 (socket says 172.21.15.111:33240) 2024-04-25T02:21:06.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.759+0000 7f18b9074700 1 -- 172.21.15.111:0/1711567010 learned_addr learned my addr 172.21.15.111:0/1711567010 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:21:06.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.760+0000 7f18b9875700 1 -- 172.21.15.111:0/1711567010 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f18b4097990 msgr2=0x7f18b405c160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:21:06.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.760+0000 7f18b9875700 1 --2- 172.21.15.111:0/1711567010 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f18b4097990 0x7f18b405c160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:06.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.760+0000 7f18b9875700 1 -- 172.21.15.111:0/1711567010 >> v1:172.21.15.111:6789/0 conn(0x7f18b4097580 legacy=0x7f18b405ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:06.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.760+0000 7f18b9875700 1 -- 172.21.15.111:0/1711567010 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b4139730 con 0x7f18b4139c10 2024-04-25T02:21:06.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.760+0000 7f18b8873700 1 -- 172.21.15.111:0/1711567010 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3400964811 0 0) 0x7f18b413a4e0 con 0x7f18b4097580 2024-04-25T02:21:06.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.760+0000 7f18ba076700 1 --2- 172.21.15.111:0/1711567010 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f18b4097990 0x7f18b405c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:21:06.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.760+0000 7f18b9875700 1 --2- 172.21.15.111:0/1711567010 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18b4139c10 0x7f18b4139ff0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f18a4002f70 tx=0x7f18a4006df0).ready entity=mon.0 client_cookie=16e8955b23a91674 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:06.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.760+0000 7f18b8873700 1 -- 172.21.15.111:0/1711567010 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18a400d570 con 0x7f18b4139c10 2024-04-25T02:21:06.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.760+0000 7f18b8873700 1 -- 172.21.15.111:0/1711567010 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a4000e90 con 0x7f18b4139c10 2024-04-25T02:21:06.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.760+0000 7f18b8873700 1 -- 172.21.15.111:0/1711567010 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18a400d8c0 con 0x7f18b4139c10 2024-04-25T02:21:06.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.760+0000 7f18bbad9700 1 -- 172.21.15.111:0/1711567010 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18b4139c10 msgr2=0x7f18b4139ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:06.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.760+0000 7f18bbad9700 1 --2- 172.21.15.111:0/1711567010 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18b4139c10 0x7f18b4139ff0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f18a4002f70 tx=0x7f18a4006df0).stop 2024-04-25T02:21:06.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.760+0000 7f18bbad9700 1 -- 172.21.15.111:0/1711567010 shutdown_connections 2024-04-25T02:21:06.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.760+0000 7f18bbad9700 1 --2- 172.21.15.111:0/1711567010 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18b4139c10 0x7f18b4139ff0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:06.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.760+0000 7f18bbad9700 1 --2- 172.21.15.111:0/1711567010 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f18b4097990 0x7f18b405c160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:06.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.760+0000 7f18bbad9700 1 -- 172.21.15.111:0/1711567010 >> 172.21.15.111:0/1711567010 conn(0x7f18b40614e0 msgr2=0x7f18b406c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:06.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.760+0000 7f18bbad9700 1 -- 172.21.15.111:0/1711567010 shutdown_connections 2024-04-25T02:21:06.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.760+0000 7f18bbad9700 1 -- 172.21.15.111:0/1711567010 wait complete. 2024-04-25T02:21:06.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.761+0000 7f18bbad9700 1 Processor -- start 2024-04-25T02:21:06.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.761+0000 7f18bbad9700 1 -- start start 2024-04-25T02:21:06.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.762+0000 7f18bbad9700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18b4097580 0x7f18b41455a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:06.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.762+0000 7f18bbad9700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f18b4097990 0x7f18b4148af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:06.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.762+0000 7f18bbad9700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f18b4139c10 0x7f18b4148fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:06.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.762+0000 7f18bbad9700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b4063c30 con 0x7f18b4097580 2024-04-25T02:21:06.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.762+0000 7f18bbad9700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b41431a0 con 0x7f18b4097990 2024-04-25T02:21:06.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.762+0000 7f18bbad9700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18b4145ed0 con 0x7f18b4139c10 2024-04-25T02:21:06.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.762+0000 7f18b9875700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18b4097580 0x7f18b41455a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:06.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.762+0000 7f18b9875700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18b4097580 0x7f18b41455a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:50716/0 (socket says 172.21.15.111:50716) 2024-04-25T02:21:06.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.762+0000 7f18b9875700 1 -- 172.21.15.111:0/3207022952 learned_addr learned my addr 172.21.15.111:0/3207022952 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:21:06.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.762+0000 7f18b9074700 1 --2- 172.21.15.111:0/3207022952 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f18b4097990 0x7f18b4148af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:06.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.762+0000 7f18ba076700 1 --2- 172.21.15.111:0/3207022952 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f18b4139c10 0x7f18b4148fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:06.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.762+0000 7f18b9875700 1 -- 172.21.15.111:0/3207022952 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f18b4139c10 msgr2=0x7f18b4148fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:06.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.762+0000 7f18b9875700 1 --2- 172.21.15.111:0/3207022952 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f18b4139c10 0x7f18b4148fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:06.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.762+0000 7f18b9875700 1 -- 172.21.15.111:0/3207022952 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f18b4097990 msgr2=0x7f18b4148af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:06.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.762+0000 7f18b9875700 1 --2- 172.21.15.111:0/3207022952 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f18b4097990 0x7f18b4148af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:06.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.762+0000 7f18b9875700 1 -- 172.21.15.111:0/3207022952 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18ac009470 con 0x7f18b4097580 2024-04-25T02:21:06.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.762+0000 7f18b9875700 1 --2- 172.21.15.111:0/3207022952 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18b4097580 0x7f18b41455a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f18a4002f70 tx=0x7f18a4014000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:06.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.763+0000 7f18a2ffd700 1 -- 172.21.15.111:0/3207022952 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18a4016070 con 0x7f18b4097580 2024-04-25T02:21:06.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.763+0000 7f18a2ffd700 1 -- 172.21.15.111:0/3207022952 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a40139c0 con 0x7f18b4097580 2024-04-25T02:21:06.771 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.763+0000 7f18bbad9700 1 -- 172.21.15.111:0/3207022952 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18a400b180 con 0x7f18b4097580 2024-04-25T02:21:06.771 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.763+0000 7f18a2ffd700 1 -- 172.21.15.111:0/3207022952 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f18a4013d20 con 0x7f18b4097580 2024-04-25T02:21:06.771 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.763+0000 7f18bbad9700 1 -- 172.21.15.111:0/3207022952 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18b4063950 con 0x7f18b4097580 2024-04-25T02:21:06.771 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.763+0000 7f18a2ffd700 1 -- 172.21.15.111:0/3207022952 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f18a4025030 con 0x7f18b4097580 2024-04-25T02:21:06.771 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.764+0000 7f18a2ffd700 1 -- 172.21.15.111:0/3207022952 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f18a404b840 con 0x7f18b4097580 2024-04-25T02:21:06.771 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.764+0000 7f18bbad9700 1 -- 172.21.15.111:0/3207022952 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18b4135d60 con 0x7f18b4097580 2024-04-25T02:21:06.771 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.767+0000 7f18a2ffd700 1 -- 172.21.15.111:0/3207022952 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f18a4023030 con 0x7f18b4097580 2024-04-25T02:21:06.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.906+0000 7f18bbad9700 1 -- 172.21.15.111:0/3207022952 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f18b41399f0 con 0x7f18b4097580 2024-04-25T02:21:06.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.906+0000 7f18a2ffd700 1 -- 172.21.15.111:0/3207022952 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+2330 (secure 0 0 0) 0x7f18a4028610 con 0x7f18b4097580 2024-04-25T02:21:06.910 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:21:06.911 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4193,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6817/3699616235","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6817","nonce":3699616235}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:20:24.150791+0000","modified":"2024-04-25T02:20:49.242915+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4239,"mds_1":4236},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4236":{"gid":4236,"name":"c","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.111:6818/2165982859","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6818","nonce":2165982859}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4239":{"gid":4239,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.111:6819/4003866251","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6819","nonce":4003866251}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-25T02:21:06.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.908+0000 7f18bbad9700 1 -- 172.21.15.111:0/3207022952 >> v1:172.21.15.111:6816/39585 conn(0x7f1894038da0 legacy=0x7f189403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:06.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.908+0000 7f18bbad9700 1 -- 172.21.15.111:0/3207022952 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18b4097580 msgr2=0x7f18b41455a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:06.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.908+0000 7f18bbad9700 1 --2- 172.21.15.111:0/3207022952 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18b4097580 0x7f18b41455a0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f18a4002f70 tx=0x7f18a4014000).stop 2024-04-25T02:21:06.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.908+0000 7f18bbad9700 1 -- 172.21.15.111:0/3207022952 shutdown_connections 2024-04-25T02:21:06.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.908+0000 7f18bbad9700 1 --2- 172.21.15.111:0/3207022952 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f18b4139c10 0x7f18b4148fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:06.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.908+0000 7f18bbad9700 1 --2- 172.21.15.111:0/3207022952 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18b4097580 0x7f18b41455a0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:06.913 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.908+0000 7f18bbad9700 1 --2- 172.21.15.111:0/3207022952 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f18b4097990 0x7f18b4148af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:06.913 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.908+0000 7f18bbad9700 1 -- 172.21.15.111:0/3207022952 >> 172.21.15.111:0/3207022952 conn(0x7f18b40614e0 msgr2=0x7f18b4098090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:06.913 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.908+0000 7f18bbad9700 1 -- 172.21.15.111:0/3207022952 shutdown_connections 2024-04-25T02:21:06.913 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:06.908+0000 7f18bbad9700 1 -- 172.21.15.111:0/3207022952 wait complete. 2024-04-25T02:21:06.913 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 11 2024-04-25T02:21:07.224 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 11, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T02:20:24.150791+0000', 'modified': '2024-04-25T02:20:49.242915+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4239, 'mds_1': 4236}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4236': {'gid': 4236, 'name': 'c', 'rank': 1, 'incarnation': 7, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.111:6818/2165982859', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.111:6818', 'nonce': 2165982859}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4239': {'gid': 4239, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.111:6819/4003866251', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.111:6819', 'nonce': 4003866251}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-25T02:21:07.225 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4236:up:stopping 2024-04-25T02:21:08.225 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:21:08.341 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.337+0000 7f5725482700 1 Processor -- start 2024-04-25T02:21:08.342 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.337+0000 7f5725482700 1 -- start start 2024-04-25T02:21:08.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.338+0000 7f5725482700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5720136800 0x7f57200642e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:08.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.338+0000 7f5725482700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f57200633b0 0x7f5720136be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:08.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.338+0000 7f5725482700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f5720062590 0x7f57200a82a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:08.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.338+0000 7f5725482700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57201363d0 con 0x7f5720062590 2024-04-25T02:21:08.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.338+0000 7f5725482700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57200647d0 con 0x7f5720136800 2024-04-25T02:21:08.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.338+0000 7f5725482700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5720136600 con 0x7f57200633b0 2024-04-25T02:21:08.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.338+0000 7f571e7fc700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f57200633b0 0x7f5720136be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:08.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.338+0000 7f571effd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5720136800 0x7f57200642e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:08.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.338+0000 7f571f7fe700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f5720062590 0x7f57200a82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:08.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.338+0000 7f571e7fc700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f57200633b0 0x7f5720136be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:37308/0 (socket says 172.21.15.111:37308) 2024-04-25T02:21:08.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.338+0000 7f571effd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5720136800 0x7f57200642e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:49048/0 (socket says 172.21.15.111:49048) 2024-04-25T02:21:08.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.338+0000 7f571f7fe700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f5720062590 0x7f57200a82a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:50726/0 (socket says 172.21.15.111:50726) 2024-04-25T02:21:08.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.338+0000 7f571e7fc700 1 -- 172.21.15.111:0/353699261 learned_addr learned my addr 172.21.15.111:0/353699261 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:21:08.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.339+0000 7f571e7fc700 1 -- 172.21.15.111:0/353699261 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5720136800 msgr2=0x7f57200642e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:21:08.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.339+0000 7f571e7fc700 1 --2- 172.21.15.111:0/353699261 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5720136800 0x7f57200642e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:08.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.339+0000 7f571e7fc700 1 -- 172.21.15.111:0/353699261 >> v2:172.21.15.111:3300/0 conn(0x7f5720062590 msgr2=0x7f57200a82a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:21:08.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.339+0000 7f571e7fc700 1 --2- 172.21.15.111:0/353699261 >> v2:172.21.15.111:3300/0 conn(0x7f5720062590 0x7f57200a82a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:08.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.339+0000 7f571e7fc700 1 -- 172.21.15.111:0/353699261 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57200a9d70 con 0x7f57200633b0 2024-04-25T02:21:08.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.339+0000 7f571f7fe700 1 --2- 172.21.15.111:0/353699261 >> v2:172.21.15.111:3300/0 conn(0x7f5720062590 0x7f57200a82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:21:08.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.339+0000 7f571effd700 1 --2- 172.21.15.111:0/353699261 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5720136800 0x7f57200642e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:21:08.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.339+0000 7f571e7fc700 1 --2- 172.21.15.111:0/353699261 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f57200633b0 0x7f5720136be0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f5708002f70 tx=0x7f5708006f40).ready entity=mon.2 client_cookie=6b546b9c3979a56e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:08.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.339+0000 7f571dffb700 1 -- 172.21.15.111:0/353699261 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f570800d940 con 0x7f57200633b0 2024-04-25T02:21:08.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.339+0000 7f571dffb700 1 -- 172.21.15.111:0/353699261 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5708000e90 con 0x7f57200633b0 2024-04-25T02:21:08.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.339+0000 7f571dffb700 1 -- 172.21.15.111:0/353699261 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f570800dcd0 con 0x7f57200633b0 2024-04-25T02:21:08.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.339+0000 7f5725482700 1 -- 172.21.15.111:0/353699261 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f57200633b0 msgr2=0x7f5720136be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:08.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.339+0000 7f5725482700 1 --2- 172.21.15.111:0/353699261 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f57200633b0 0x7f5720136be0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f5708002f70 tx=0x7f5708006f40).stop 2024-04-25T02:21:08.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.340+0000 7f5725482700 1 -- 172.21.15.111:0/353699261 shutdown_connections 2024-04-25T02:21:08.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.340+0000 7f5725482700 1 --2- 172.21.15.111:0/353699261 >> v2:172.21.15.111:3300/0 conn(0x7f5720062590 0x7f57200a82a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:08.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.340+0000 7f5725482700 1 --2- 172.21.15.111:0/353699261 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5720136800 0x7f57200642e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:08.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.340+0000 7f5725482700 1 --2- 172.21.15.111:0/353699261 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f57200633b0 0x7f5720136be0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:08.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.340+0000 7f5725482700 1 -- 172.21.15.111:0/353699261 >> 172.21.15.111:0/353699261 conn(0x7f57200614e0 msgr2=0x7f572006c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:08.347 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.340+0000 7f5725482700 1 -- 172.21.15.111:0/353699261 shutdown_connections 2024-04-25T02:21:08.347 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.340+0000 7f5725482700 1 -- 172.21.15.111:0/353699261 wait complete. 2024-04-25T02:21:08.347 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.340+0000 7f5725482700 1 Processor -- start 2024-04-25T02:21:08.347 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.341+0000 7f5725482700 1 -- start start 2024-04-25T02:21:08.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.341+0000 7f5725482700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5720062590 0x7f5720094520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:08.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.341+0000 7f5725482700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f57200633b0 0x7f5720065f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:08.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.341+0000 7f5725482700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5720136800 0x7f5720066410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:08.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.341+0000 7f5725482700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5720092c20 con 0x7f57200633b0 2024-04-25T02:21:08.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.341+0000 7f5725482700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5720093cb0 con 0x7f5720062590 2024-04-25T02:21:08.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.341+0000 7f5725482700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5720092250 con 0x7f5720136800 2024-04-25T02:21:08.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.341+0000 7f571e7fc700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f57200633b0 0x7f5720065f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:08.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.341+0000 7f571f7fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5720136800 0x7f5720066410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:08.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.341+0000 7f571e7fc700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f57200633b0 0x7f5720065f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:50732/0 (socket says 172.21.15.111:50732) 2024-04-25T02:21:08.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.341+0000 7f571e7fc700 1 -- 172.21.15.111:0/3295138036 learned_addr learned my addr 172.21.15.111:0/3295138036 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:21:08.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.341+0000 7f571f7fe700 1 --2- 172.21.15.111:0/3295138036 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5720136800 0x7f5720066410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:37318/0 (socket says 172.21.15.111:37318) 2024-04-25T02:21:08.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.341+0000 7f571effd700 1 --2- 172.21.15.111:0/3295138036 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5720062590 0x7f5720094520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:08.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.342+0000 7f571e7fc700 1 -- 172.21.15.111:0/3295138036 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5720136800 msgr2=0x7f5720066410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:08.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.342+0000 7f571e7fc700 1 --2- 172.21.15.111:0/3295138036 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5720136800 0x7f5720066410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:08.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.342+0000 7f571e7fc700 1 -- 172.21.15.111:0/3295138036 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5720062590 msgr2=0x7f5720094520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:08.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.342+0000 7f571e7fc700 1 --2- 172.21.15.111:0/3295138036 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5720062590 0x7f5720094520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:08.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.342+0000 7f571e7fc700 1 -- 172.21.15.111:0/3295138036 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f571000b180 con 0x7f57200633b0 2024-04-25T02:21:08.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.342+0000 7f571f7fe700 1 --2- 172.21.15.111:0/3295138036 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5720136800 0x7f5720066410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:21:08.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.342+0000 7f571effd700 1 --2- 172.21.15.111:0/3295138036 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5720062590 0x7f5720094520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:21:08.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.342+0000 7f571e7fc700 1 --2- 172.21.15.111:0/3295138036 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f57200633b0 0x7f5720065f20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f5708002f70 tx=0x7f5720132e80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:08.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.342+0000 7f5717fff700 1 -- 172.21.15.111:0/3295138036 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f570800dd00 con 0x7f57200633b0 2024-04-25T02:21:08.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.342+0000 7f5717fff700 1 -- 172.21.15.111:0/3295138036 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5708024450 con 0x7f57200633b0 2024-04-25T02:21:08.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.342+0000 7f5725482700 1 -- 172.21.15.111:0/3295138036 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5718009470 con 0x7f57200633b0 2024-04-25T02:21:08.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.342+0000 7f5717fff700 1 -- 172.21.15.111:0/3295138036 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f57080247b0 con 0x7f57200633b0 2024-04-25T02:21:08.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.342+0000 7f5725482700 1 -- 172.21.15.111:0/3295138036 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f570800b460 con 0x7f57200633b0 2024-04-25T02:21:08.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.343+0000 7f5717fff700 1 -- 172.21.15.111:0/3295138036 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f5708021070 con 0x7f57200633b0 2024-04-25T02:21:08.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.343+0000 7f5725482700 1 -- 172.21.15.111:0/3295138036 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f572006cdd0 con 0x7f57200633b0 2024-04-25T02:21:08.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.343+0000 7f5717fff700 1 -- 172.21.15.111:0/3295138036 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f570804e100 con 0x7f57200633b0 2024-04-25T02:21:08.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.346+0000 7f5717fff700 1 -- 172.21.15.111:0/3295138036 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f570800c2e0 con 0x7f57200633b0 2024-04-25T02:21:08.491 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.487+0000 7f5725482700 1 -- 172.21.15.111:0/3295138036 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5720064cd0 con 0x7f57200633b0 2024-04-25T02:21:08.491 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.487+0000 7f5717fff700 1 -- 172.21.15.111:0/3295138036 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+2330 (secure 0 0 0) 0x7f5708025810 con 0x7f57200633b0 2024-04-25T02:21:08.491 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:21:08.491 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4193,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6817/3699616235","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6817","nonce":3699616235}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:20:24.150791+0000","modified":"2024-04-25T02:20:49.242915+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4239,"mds_1":4236},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4236":{"gid":4236,"name":"c","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.111:6818/2165982859","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6818","nonce":2165982859}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4239":{"gid":4239,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.111:6819/4003866251","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6819","nonce":4003866251}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-25T02:21:08.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.489+0000 7f5725482700 1 -- 172.21.15.111:0/3295138036 >> v1:172.21.15.111:6816/39585 conn(0x7f5704038da0 legacy=0x7f570403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:08.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.489+0000 7f5725482700 1 -- 172.21.15.111:0/3295138036 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f57200633b0 msgr2=0x7f5720065f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:08.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.489+0000 7f5725482700 1 --2- 172.21.15.111:0/3295138036 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f57200633b0 0x7f5720065f20 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f5708002f70 tx=0x7f5720132e80).stop 2024-04-25T02:21:08.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.489+0000 7f5725482700 1 -- 172.21.15.111:0/3295138036 shutdown_connections 2024-04-25T02:21:08.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.489+0000 7f5725482700 1 --2- 172.21.15.111:0/3295138036 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5720136800 0x7f5720066410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:08.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.489+0000 7f5725482700 1 --2- 172.21.15.111:0/3295138036 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5720062590 0x7f5720094520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:08.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.489+0000 7f5725482700 1 --2- 172.21.15.111:0/3295138036 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f57200633b0 0x7f5720065f20 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:08.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.489+0000 7f5725482700 1 -- 172.21.15.111:0/3295138036 >> 172.21.15.111:0/3295138036 conn(0x7f57200614e0 msgr2=0x7f572006c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:08.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.489+0000 7f5725482700 1 -- 172.21.15.111:0/3295138036 shutdown_connections 2024-04-25T02:21:08.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:08.489+0000 7f5725482700 1 -- 172.21.15.111:0/3295138036 wait complete. 2024-04-25T02:21:08.494 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 11 2024-04-25T02:21:08.805 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 11, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T02:20:24.150791+0000', 'modified': '2024-04-25T02:20:49.242915+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4239, 'mds_1': 4236}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4236': {'gid': 4236, 'name': 'c', 'rank': 1, 'incarnation': 7, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.111:6818/2165982859', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.111:6818', 'nonce': 2165982859}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4239': {'gid': 4239, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.111:6819/4003866251', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.111:6819', 'nonce': 4003866251}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-25T02:21:08.805 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4236:up:stopping 2024-04-25T02:21:09.806 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:21:09.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.916+0000 7fdcb36dc700 1 Processor -- start 2024-04-25T02:21:09.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.917+0000 7fdcb36dc700 1 -- start start 2024-04-25T02:21:09.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.917+0000 7fdcb36dc700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdcac139c10 0x7fdcac139ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:09.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.917+0000 7fdcb36dc700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fdcac097960 0x7fdcac05c160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:09.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.917+0000 7fdcb36dc700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcac13a4e0 con 0x7fdcac097580 2024-04-25T02:21:09.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.917+0000 7fdcb36dc700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac099610 con 0x7fdcac139c10 2024-04-25T02:21:09.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.917+0000 7fdcb36dc700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac096f80 con 0x7fdcac097960 2024-04-25T02:21:09.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.917+0000 7fdcb1478700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdcac139c10 0x7fdcac139ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:09.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.917+0000 7fdcb1c79700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fdcac097960 0x7fdcac05c160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:09.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.917+0000 7fdcb0c77700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7fdcac097580 0x7fdcac05ba50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:33256/0 (socket says 172.21.15.111:33256) 2024-04-25T02:21:09.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.917+0000 7fdcb0c77700 1 -- 172.21.15.111:0/2230955453 learned_addr learned my addr 172.21.15.111:0/2230955453 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:21:09.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.918+0000 7fdcb1c79700 1 -- 172.21.15.111:0/2230955453 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdcac139c10 msgr2=0x7fdcac139ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:21:09.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.918+0000 7fdcb1c79700 1 --2- 172.21.15.111:0/2230955453 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdcac139c10 0x7fdcac139ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:09.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.918+0000 7fdc9bfff700 1 -- 172.21.15.111:0/2230955453 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3285124273 0 0) 0x7fdcac13a4e0 con 0x7fdcac097580 2024-04-25T02:21:09.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.918+0000 7fdcb1c79700 1 -- 172.21.15.111:0/2230955453 >> v1:172.21.15.111:6789/0 conn(0x7fdcac097580 legacy=0x7fdcac05ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:09.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.918+0000 7fdcb1c79700 1 -- 172.21.15.111:0/2230955453 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcac139730 con 0x7fdcac097960 2024-04-25T02:21:09.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.918+0000 7fdcb1478700 1 --2- 172.21.15.111:0/2230955453 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdcac139c10 0x7fdcac139ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:21:09.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.918+0000 7fdcb1c79700 1 --2- 172.21.15.111:0/2230955453 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fdcac097960 0x7fdcac05c160 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fdca40032f0 tx=0x7fdca40091d0).ready entity=mon.2 client_cookie=fe6f2cf9f02ac563 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:09.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.918+0000 7fdc9bfff700 1 -- 172.21.15.111:0/2230955453 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdca400b6c0 con 0x7fdcac097960 2024-04-25T02:21:09.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.918+0000 7fdc9bfff700 1 -- 172.21.15.111:0/2230955453 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca400b820 con 0x7fdcac097960 2024-04-25T02:21:09.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.918+0000 7fdc9bfff700 1 -- 172.21.15.111:0/2230955453 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdca400b990 con 0x7fdcac097960 2024-04-25T02:21:09.925 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.918+0000 7fdcb36dc700 1 -- 172.21.15.111:0/2230955453 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fdcac097960 msgr2=0x7fdcac05c160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:09.925 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.918+0000 7fdcb36dc700 1 --2- 172.21.15.111:0/2230955453 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fdcac097960 0x7fdcac05c160 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fdca40032f0 tx=0x7fdca40091d0).stop 2024-04-25T02:21:09.925 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.918+0000 7fdcb36dc700 1 -- 172.21.15.111:0/2230955453 shutdown_connections 2024-04-25T02:21:09.925 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.918+0000 7fdcb36dc700 1 --2- 172.21.15.111:0/2230955453 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fdcac097960 0x7fdcac05c160 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:09.925 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.918+0000 7fdcb36dc700 1 --2- 172.21.15.111:0/2230955453 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdcac139c10 0x7fdcac139ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:09.925 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.918+0000 7fdcb36dc700 1 -- 172.21.15.111:0/2230955453 >> 172.21.15.111:0/2230955453 conn(0x7fdcac0614e0 msgr2=0x7fdcac06c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:09.925 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.918+0000 7fdcb36dc700 1 -- 172.21.15.111:0/2230955453 shutdown_connections 2024-04-25T02:21:09.925 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.919+0000 7fdcb36dc700 1 -- 172.21.15.111:0/2230955453 wait complete. 2024-04-25T02:21:09.925 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.920+0000 7fdcb36dc700 1 Processor -- start 2024-04-25T02:21:09.925 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.920+0000 7fdcb36dc700 1 -- start start 2024-04-25T02:21:09.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.920+0000 7fdcb36dc700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdcac097580 0x7fdcac067040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:09.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.920+0000 7fdcb36dc700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fdcac097960 0x7fdcac145da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:09.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.920+0000 7fdcb36dc700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdcac139c10 0x7fdcac146660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:09.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.920+0000 7fdcb36dc700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac0651e0 con 0x7fdcac097580 2024-04-25T02:21:09.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.920+0000 7fdcb36dc700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac064a10 con 0x7fdcac139c10 2024-04-25T02:21:09.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.920+0000 7fdcb36dc700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac063b30 con 0x7fdcac097960 2024-04-25T02:21:09.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.920+0000 7fdcb1478700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdcac097580 0x7fdcac067040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:09.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.920+0000 7fdcb0c77700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fdcac097960 0x7fdcac145da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:09.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.920+0000 7fdcb1478700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdcac097580 0x7fdcac067040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:50746/0 (socket says 172.21.15.111:50746) 2024-04-25T02:21:09.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.920+0000 7fdcb1478700 1 -- 172.21.15.111:0/667390864 learned_addr learned my addr 172.21.15.111:0/667390864 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:21:09.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.920+0000 7fdcb1c79700 1 --2- 172.21.15.111:0/667390864 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdcac139c10 0x7fdcac146660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:09.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.921+0000 7fdcb1478700 1 -- 172.21.15.111:0/667390864 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fdcac097960 msgr2=0x7fdcac145da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:09.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.921+0000 7fdcb1478700 1 --2- 172.21.15.111:0/667390864 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fdcac097960 0x7fdcac145da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:09.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.921+0000 7fdcb1478700 1 -- 172.21.15.111:0/667390864 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdcac139c10 msgr2=0x7fdcac146660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:09.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.921+0000 7fdcb1478700 1 --2- 172.21.15.111:0/667390864 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdcac139c10 0x7fdcac146660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:09.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.921+0000 7fdcb1478700 1 -- 172.21.15.111:0/667390864 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc9c00b180 con 0x7fdcac097580 2024-04-25T02:21:09.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.921+0000 7fdcb0c77700 1 --2- 172.21.15.111:0/667390864 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fdcac097960 0x7fdcac145da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:21:09.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.921+0000 7fdcb1c79700 1 --2- 172.21.15.111:0/667390864 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdcac139c10 0x7fdcac146660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:21:09.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.921+0000 7fdcb1478700 1 --2- 172.21.15.111:0/667390864 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdcac097580 0x7fdcac067040 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fdc9c00c000 tx=0x7fdc9c006df0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:09.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.921+0000 7fdc9a7fc700 1 -- 172.21.15.111:0/667390864 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc9c010780 con 0x7fdcac097580 2024-04-25T02:21:09.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.921+0000 7fdc9a7fc700 1 -- 172.21.15.111:0/667390864 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc9c0108e0 con 0x7fdcac097580 2024-04-25T02:21:09.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.921+0000 7fdcb36dc700 1 -- 172.21.15.111:0/667390864 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdca4009470 con 0x7fdcac097580 2024-04-25T02:21:09.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.921+0000 7fdc9a7fc700 1 -- 172.21.15.111:0/667390864 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7fdc9c010c40 con 0x7fdcac097580 2024-04-25T02:21:09.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.921+0000 7fdcb36dc700 1 -- 172.21.15.111:0/667390864 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcac0654a0 con 0x7fdcac097580 2024-04-25T02:21:09.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.922+0000 7fdc9a7fc700 1 -- 172.21.15.111:0/667390864 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7fdc9c01c460 con 0x7fdcac097580 2024-04-25T02:21:09.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.922+0000 7fdc9a7fc700 1 -- 172.21.15.111:0/667390864 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fdc9c04ad50 con 0x7fdcac097580 2024-04-25T02:21:09.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.922+0000 7fdcb36dc700 1 -- 172.21.15.111:0/667390864 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcac0667d0 con 0x7fdcac097580 2024-04-25T02:21:09.930 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:09.925+0000 7fdc9a7fc700 1 -- 172.21.15.111:0/667390864 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7fdc9c033680 con 0x7fdcac097580 2024-04-25T02:21:10.069 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:10.065+0000 7fdcb36dc700 1 -- 172.21.15.111:0/667390864 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdcac1399f0 con 0x7fdcac097580 2024-04-25T02:21:10.069 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:10.065+0000 7fdc9a7fc700 1 -- 172.21.15.111:0/667390864 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) v1 ==== 94+0+2330 (secure 0 0 0) 0x7fdc9c02b090 con 0x7fdcac097580 2024-04-25T02:21:10.070 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:21:10.070 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":11,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4193,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6817/3699616235","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6817","nonce":3699616235}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":11,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:20:24.150791+0000","modified":"2024-04-25T02:20:49.242915+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0,1],"up":{"mds_0":4239,"mds_1":4236},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4236":{"gid":4236,"name":"c","rank":1,"incarnation":7,"state":"up:stopping","state_seq":4,"addr":"172.21.15.111:6818/2165982859","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6818","nonce":2165982859}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0},"gid_4239":{"gid":4239,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.111:6819/4003866251","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6819","nonce":4003866251}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-25T02:21:10.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:10.067+0000 7fdcb36dc700 1 -- 172.21.15.111:0/667390864 >> v1:172.21.15.111:6816/39585 conn(0x7fdc8c038da0 legacy=0x7fdc8c03b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:10.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:10.067+0000 7fdcb36dc700 1 -- 172.21.15.111:0/667390864 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdcac097580 msgr2=0x7fdcac067040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:10.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:10.067+0000 7fdcb36dc700 1 --2- 172.21.15.111:0/667390864 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdcac097580 0x7fdcac067040 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fdc9c00c000 tx=0x7fdc9c006df0).stop 2024-04-25T02:21:10.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:10.067+0000 7fdcb36dc700 1 -- 172.21.15.111:0/667390864 shutdown_connections 2024-04-25T02:21:10.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:10.067+0000 7fdcb36dc700 1 --2- 172.21.15.111:0/667390864 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdcac139c10 0x7fdcac146660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:10.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:10.067+0000 7fdcb36dc700 1 --2- 172.21.15.111:0/667390864 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdcac097580 0x7fdcac067040 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:10.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:10.067+0000 7fdcb36dc700 1 --2- 172.21.15.111:0/667390864 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fdcac097960 0x7fdcac145da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:10.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:10.067+0000 7fdcb36dc700 1 -- 172.21.15.111:0/667390864 >> 172.21.15.111:0/667390864 conn(0x7fdcac0614e0 msgr2=0x7fdcac0a79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:10.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:10.067+0000 7fdcb36dc700 1 -- 172.21.15.111:0/667390864 shutdown_connections 2024-04-25T02:21:10.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:10.067+0000 7fdcb36dc700 1 -- 172.21.15.111:0/667390864 wait complete. 2024-04-25T02:21:10.072 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 11 2024-04-25T02:21:10.383 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 11, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T02:20:24.150791+0000', 'modified': '2024-04-25T02:20:49.242915+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0, 1], 'up': {'mds_0': 4239, 'mds_1': 4236}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4236': {'gid': 4236, 'name': 'c', 'rank': 1, 'incarnation': 7, 'state': 'up:stopping', 'state_seq': 4, 'addr': '172.21.15.111:6818/2165982859', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.111:6818', 'nonce': 2165982859}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}, 'gid_4239': {'gid': 4239, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.111:6819/4003866251', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.111:6819', 'nonce': 4003866251}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-25T02:21:10.384 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4236:up:stopping 2024-04-25T02:21:11.277 INFO:tasks.ceph.mds.c.smithi111.stdout:starting mds.c at 2024-04-25T02:21:11.384 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:21:11.492 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.486+0000 7f4a1c408700 1 Processor -- start 2024-04-25T02:21:11.492 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.486+0000 7f4a1c408700 1 -- start start 2024-04-25T02:21:11.492 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.487+0000 7f4a1c408700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4a14136eb0 0x7f4a140a1050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:11.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.487+0000 7f4a1c408700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4a1413ba00 0x7f4a1413ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:11.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.487+0000 7f4a1c408700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a140a1c60 con 0x7f4a141363c0 2024-04-25T02:21:11.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.487+0000 7f4a1c408700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a140a1a60 con 0x7f4a1413ba00 2024-04-25T02:21:11.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.487+0000 7f4a1c408700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a140a1540 con 0x7f4a14136eb0 2024-04-25T02:21:11.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.487+0000 7f4a1a1a4700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f4a141363c0 0x7f4a141367a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:53914/0 (socket says 172.21.15.111:53914) 2024-04-25T02:21:11.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.487+0000 7f4a1a1a4700 1 -- 172.21.15.111:0/2313148945 learned_addr learned my addr 172.21.15.111:0/2313148945 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:21:11.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.487+0000 7f4a1a9a5700 1 --2- 172.21.15.111:0/2313148945 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4a1413ba00 0x7f4a1413ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:11.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.487+0000 7f4a199a3700 1 --2- 172.21.15.111:0/2313148945 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4a14136eb0 0x7f4a140a1050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:11.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.487+0000 7f4a191a2700 1 -- 172.21.15.111:0/2313148945 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3522234959 0 0) 0x7f4a140a1c60 con 0x7f4a141363c0 2024-04-25T02:21:11.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.487+0000 7f4a191a2700 1 -- 172.21.15.111:0/2313148945 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f49fc003260 con 0x7f4a141363c0 2024-04-25T02:21:11.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.487+0000 7f4a1a9a5700 1 -- 172.21.15.111:0/2313148945 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4a14136eb0 msgr2=0x7f4a140a1050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:21:11.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.487+0000 7f4a1a9a5700 1 --2- 172.21.15.111:0/2313148945 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4a14136eb0 0x7f4a140a1050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:11.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.487+0000 7f4a1a9a5700 1 -- 172.21.15.111:0/2313148945 >> v1:172.21.15.111:6789/0 conn(0x7f4a141363c0 legacy=0x7f4a141367a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:11.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.487+0000 7f4a1a9a5700 1 -- 172.21.15.111:0/2313148945 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a140a25a0 con 0x7f4a1413ba00 2024-04-25T02:21:11.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.487+0000 7f4a199a3700 1 --2- 172.21.15.111:0/2313148945 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4a14136eb0 0x7f4a140a1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:21:11.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.487+0000 7f4a1a9a5700 1 --2- 172.21.15.111:0/2313148945 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4a1413ba00 0x7f4a1413ddf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f4a140a1680 tx=0x7f4a0c0091d0).ready entity=mon.1 client_cookie=a7827aff30aac3b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:11.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.487+0000 7f4a191a2700 1 -- 172.21.15.111:0/2313148945 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a0c00b5a0 con 0x7f4a1413ba00 2024-04-25T02:21:11.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.488+0000 7f4a191a2700 1 -- 172.21.15.111:0/2313148945 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a0c00b700 con 0x7f4a1413ba00 2024-04-25T02:21:11.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.488+0000 7f4a191a2700 1 -- 172.21.15.111:0/2313148945 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a0c00b870 con 0x7f4a1413ba00 2024-04-25T02:21:11.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.488+0000 7f4a1c408700 1 -- 172.21.15.111:0/2313148945 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4a1413ba00 msgr2=0x7f4a1413ddf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:11.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.488+0000 7f4a1c408700 1 --2- 172.21.15.111:0/2313148945 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4a1413ba00 0x7f4a1413ddf0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f4a140a1680 tx=0x7f4a0c0091d0).stop 2024-04-25T02:21:11.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.488+0000 7f4a1c408700 1 -- 172.21.15.111:0/2313148945 shutdown_connections 2024-04-25T02:21:11.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.488+0000 7f4a1c408700 1 --2- 172.21.15.111:0/2313148945 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4a1413ba00 0x7f4a1413ddf0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:11.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.488+0000 7f4a1c408700 1 --2- 172.21.15.111:0/2313148945 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4a14136eb0 0x7f4a140a1050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:11.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.488+0000 7f4a1c408700 1 -- 172.21.15.111:0/2313148945 >> 172.21.15.111:0/2313148945 conn(0x7f4a140a8a00 msgr2=0x7f4a140a8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:11.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.488+0000 7f4a1c408700 1 -- 172.21.15.111:0/2313148945 shutdown_connections 2024-04-25T02:21:11.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.488+0000 7f4a1c408700 1 -- 172.21.15.111:0/2313148945 wait complete. 2024-04-25T02:21:11.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.489+0000 7f4a1c408700 1 Processor -- start 2024-04-25T02:21:11.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.489+0000 7f4a1c408700 1 -- start start 2024-04-25T02:21:11.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.490+0000 7f4a1c408700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4a141363c0 0x7f4a14065940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:11.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.490+0000 7f4a1c408700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4a14136eb0 0x7f4a14146ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:11.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.490+0000 7f4a1c408700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4a1413ba00 0x7f4a14146fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:11.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.490+0000 7f4a1c408700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a14066350 con 0x7f4a141363c0 2024-04-25T02:21:11.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.490+0000 7f4a1c408700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a14065e30 con 0x7f4a14136eb0 2024-04-25T02:21:11.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.490+0000 7f4a1c408700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4a14066550 con 0x7f4a1413ba00 2024-04-25T02:21:11.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.490+0000 7f4a199a3700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4a14136eb0 0x7f4a14146ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:11.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.490+0000 7f4a1a9a5700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4a1413ba00 0x7f4a14146fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:11.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.490+0000 7f4a199a3700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4a14136eb0 0x7f4a14146ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:52862/0 (socket says 172.21.15.111:52862) 2024-04-25T02:21:11.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.490+0000 7f4a199a3700 1 -- 172.21.15.111:0/3350434518 learned_addr learned my addr 172.21.15.111:0/3350434518 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:21:11.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.490+0000 7f4a1a1a4700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4a141363c0 0x7f4a14065940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:11.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.490+0000 7f4a199a3700 1 -- 172.21.15.111:0/3350434518 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4a1413ba00 msgr2=0x7f4a14146fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:11.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.490+0000 7f4a199a3700 1 --2- 172.21.15.111:0/3350434518 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4a1413ba00 0x7f4a14146fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:11.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.490+0000 7f4a199a3700 1 -- 172.21.15.111:0/3350434518 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4a141363c0 msgr2=0x7f4a14065940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:11.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.490+0000 7f4a199a3700 1 --2- 172.21.15.111:0/3350434518 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4a141363c0 0x7f4a14065940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:11.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.490+0000 7f4a199a3700 1 -- 172.21.15.111:0/3350434518 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a1000b180 con 0x7f4a14136eb0 2024-04-25T02:21:11.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.490+0000 7f4a1a9a5700 1 --2- 172.21.15.111:0/3350434518 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4a1413ba00 0x7f4a14146fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:21:11.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.490+0000 7f4a199a3700 1 --2- 172.21.15.111:0/3350434518 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4a14136eb0 0x7f4a14146ae0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f4a14133be0 tx=0x7f4a10006df0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:11.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.490+0000 7f4a037fe700 1 -- 172.21.15.111:0/3350434518 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a1000c5f0 con 0x7f4a14136eb0 2024-04-25T02:21:11.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.490+0000 7f4a037fe700 1 -- 172.21.15.111:0/3350434518 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a1000c750 con 0x7f4a14136eb0 2024-04-25T02:21:11.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.490+0000 7f4a1c408700 1 -- 172.21.15.111:0/3350434518 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a0c009470 con 0x7f4a14136eb0 2024-04-25T02:21:11.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.490+0000 7f4a037fe700 1 -- 172.21.15.111:0/3350434518 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7f4a1000cab0 con 0x7f4a14136eb0 2024-04-25T02:21:11.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.490+0000 7f4a1c408700 1 -- 172.21.15.111:0/3350434518 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a14066a50 con 0x7f4a14136eb0 2024-04-25T02:21:11.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.491+0000 7f4a037fe700 1 -- 172.21.15.111:0/3350434518 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7f4a1000cc10 con 0x7f4a14136eb0 2024-04-25T02:21:11.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.491+0000 7f4a037fe700 1 -- 172.21.15.111:0/3350434518 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f4a1004ade0 con 0x7f4a14136eb0 2024-04-25T02:21:11.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.491+0000 7f4a1c408700 1 -- 172.21.15.111:0/3350434518 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a1409fa30 con 0x7f4a14136eb0 2024-04-25T02:21:11.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.494+0000 7f4a037fe700 1 -- 172.21.15.111:0/3350434518 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+108456 (secure 0 0 0) 0x7f4a10033670 con 0x7f4a14136eb0 2024-04-25T02:21:11.639 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.635+0000 7f4a1c408700 1 -- 172.21.15.111:0/3350434518 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4a14057a60 con 0x7f4a14136eb0 2024-04-25T02:21:11.639 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.635+0000 7f4a037fe700 1 -- 172.21.15.111:0/3350434518 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+2021 (secure 0 0 0) 0x7f4a10033260 con 0x7f4a14136eb0 2024-04-25T02:21:11.640 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:21:11.640 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4193,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6817/3699616235","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6817","nonce":3699616235}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"epoch":2}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:20:24.150791+0000","modified":"2024-04-25T02:21:11.248656+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"min_compat_client":"0 (unknown)","max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4239},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_4239":{"gid":4239,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.111:6819/4003866251","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6819","nonce":4003866251}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-25T02:21:11.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.637+0000 7f4a1c408700 1 -- 172.21.15.111:0/3350434518 >> v1:172.21.15.111:6816/39585 conn(0x7f49f4038da0 legacy=0x7f49f403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:11.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.637+0000 7f4a1c408700 1 -- 172.21.15.111:0/3350434518 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4a14136eb0 msgr2=0x7f4a14146ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:11.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.637+0000 7f4a1c408700 1 --2- 172.21.15.111:0/3350434518 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4a14136eb0 0x7f4a14146ae0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f4a14133be0 tx=0x7f4a10006df0).stop 2024-04-25T02:21:11.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.637+0000 7f4a1c408700 1 -- 172.21.15.111:0/3350434518 shutdown_connections 2024-04-25T02:21:11.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.637+0000 7f4a1c408700 1 --2- 172.21.15.111:0/3350434518 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4a1413ba00 0x7f4a14146fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:11.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.637+0000 7f4a1c408700 1 --2- 172.21.15.111:0/3350434518 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4a141363c0 0x7f4a14065940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:11.642 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.637+0000 7f4a1c408700 1 --2- 172.21.15.111:0/3350434518 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4a14136eb0 0x7f4a14146ae0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:11.642 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.637+0000 7f4a1c408700 1 -- 172.21.15.111:0/3350434518 >> 172.21.15.111:0/3350434518 conn(0x7f4a140a8a00 msgr2=0x7f4a141333f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:11.642 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.637+0000 7f4a1c408700 1 -- 172.21.15.111:0/3350434518 shutdown_connections 2024-04-25T02:21:11.642 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:11.637+0000 7f4a1c408700 1 -- 172.21.15.111:0/3350434518 wait complete. 2024-04-25T02:21:11.642 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 12 2024-04-25T02:21:11.953 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 12, 'flags': 18, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T02:20:24.150791+0000', 'modified': '2024-04-25T02:21:11.248656+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'min_compat_client': '0 (unknown)', 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4239}, 'failed': [], 'damaged': [], 'stopped': [1], 'info': {'gid_4239': {'gid': 4239, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.111:6819/4003866251', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.111:6819', 'nonce': 4003866251}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-25T02:21:11.953 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T02:21:11.953 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-25T02:21:12.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.053+0000 7efc3a852700 1 Processor -- start 2024-04-25T02:21:12.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.053+0000 7efc3a852700 1 -- start start 2024-04-25T02:21:12.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.053+0000 7efc3a852700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efc34139c10 0x7efc34139ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:12.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.053+0000 7efc3a852700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7efc34097580 0x7efc3405ba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:12.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.053+0000 7efc3a852700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efc3413a4e0 con 0x7efc34097960 2024-04-25T02:21:12.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.053+0000 7efc3a852700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc34099610 con 0x7efc34097580 2024-04-25T02:21:12.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.053+0000 7efc3a852700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc34096f80 con 0x7efc34139c10 2024-04-25T02:21:12.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.053+0000 7efc337fe700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7efc34097580 0x7efc3405ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:12.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.053+0000 7efc33fff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efc34139c10 0x7efc34139ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:12.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.053+0000 7efc38def700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7efc34097960 0x7efc3405bf40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:53916/0 (socket says 172.21.15.111:53916) 2024-04-25T02:21:12.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.053+0000 7efc38def700 1 -- 172.21.15.111:0/1806001312 learned_addr learned my addr 172.21.15.111:0/1806001312 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:21:12.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.054+0000 7efc33fff700 1 -- 172.21.15.111:0/1806001312 >> v2:172.21.15.111:3300/0 conn(0x7efc34097580 msgr2=0x7efc3405ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:21:12.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.054+0000 7efc33fff700 1 --2- 172.21.15.111:0/1806001312 >> v2:172.21.15.111:3300/0 conn(0x7efc34097580 0x7efc3405ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:12.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.054+0000 7efc33fff700 1 -- 172.21.15.111:0/1806001312 >> v1:172.21.15.111:6789/0 conn(0x7efc34097960 legacy=0x7efc3405bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:12.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.054+0000 7efc33fff700 1 -- 172.21.15.111:0/1806001312 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc34139730 con 0x7efc34139c10 2024-04-25T02:21:12.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.054+0000 7efc32ffd700 1 -- 172.21.15.111:0/1806001312 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 302125843 0 0) 0x7efc3413a4e0 con 0x7efc34097960 2024-04-25T02:21:12.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.054+0000 7efc337fe700 1 --2- 172.21.15.111:0/1806001312 >> v2:172.21.15.111:3300/0 conn(0x7efc34097580 0x7efc3405ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:21:12.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.054+0000 7efc33fff700 1 --2- 172.21.15.111:0/1806001312 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efc34139c10 0x7efc34139ff0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7efc24002f70 tx=0x7efc24006df0).ready entity=mon.1 client_cookie=b79b3634ff9d93d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:12.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.054+0000 7efc32ffd700 1 -- 172.21.15.111:0/1806001312 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc2400d570 con 0x7efc34139c10 2024-04-25T02:21:12.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.054+0000 7efc32ffd700 1 -- 172.21.15.111:0/1806001312 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc24000e90 con 0x7efc34139c10 2024-04-25T02:21:12.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.054+0000 7efc32ffd700 1 -- 172.21.15.111:0/1806001312 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc2400d8c0 con 0x7efc34139c10 2024-04-25T02:21:12.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.054+0000 7efc3a852700 1 -- 172.21.15.111:0/1806001312 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efc34139c10 msgr2=0x7efc34139ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:12.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.054+0000 7efc3a852700 1 --2- 172.21.15.111:0/1806001312 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efc34139c10 0x7efc34139ff0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7efc24002f70 tx=0x7efc24006df0).stop 2024-04-25T02:21:12.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.055+0000 7efc3a852700 1 -- 172.21.15.111:0/1806001312 shutdown_connections 2024-04-25T02:21:12.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.055+0000 7efc3a852700 1 --2- 172.21.15.111:0/1806001312 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efc34139c10 0x7efc34139ff0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:12.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.055+0000 7efc3a852700 1 --2- 172.21.15.111:0/1806001312 >> v2:172.21.15.111:3300/0 conn(0x7efc34097580 0x7efc3405ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:12.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.055+0000 7efc3a852700 1 -- 172.21.15.111:0/1806001312 >> 172.21.15.111:0/1806001312 conn(0x7efc340614e0 msgr2=0x7efc3406c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:12.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.055+0000 7efc3a852700 1 -- 172.21.15.111:0/1806001312 shutdown_connections 2024-04-25T02:21:12.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.055+0000 7efc3a852700 1 -- 172.21.15.111:0/1806001312 wait complete. 2024-04-25T02:21:12.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.055+0000 7efc3a852700 1 Processor -- start 2024-04-25T02:21:12.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.055+0000 7efc3a852700 1 -- start start 2024-04-25T02:21:12.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.056+0000 7efc3a852700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efc34097580 0x7efc34063fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:12.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.056+0000 7efc3a852700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7efc34097960 0x7efc34148ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:12.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.056+0000 7efc3a852700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efc34139c10 0x7efc340623f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:12.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.056+0000 7efc3a852700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc34063850 con 0x7efc34139c10 2024-04-25T02:21:12.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.056+0000 7efc3a852700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc34149670 con 0x7efc34097580 2024-04-25T02:21:12.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.056+0000 7efc3a852700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efc340644b0 con 0x7efc34097960 2024-04-25T02:21:12.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.056+0000 7efc33fff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efc34097580 0x7efc34063fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:12.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.056+0000 7efc38def700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efc34139c10 0x7efc340623f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:12.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.056+0000 7efc33fff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efc34097580 0x7efc34063fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:52866/0 (socket says 172.21.15.111:52866) 2024-04-25T02:21:12.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.056+0000 7efc33fff700 1 -- 172.21.15.111:0/3612839532 learned_addr learned my addr 172.21.15.111:0/3612839532 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:21:12.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.056+0000 7efc38def700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efc34139c10 0x7efc340623f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:58130/0 (socket says 172.21.15.111:58130) 2024-04-25T02:21:12.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.056+0000 7efc337fe700 1 --2- 172.21.15.111:0/3612839532 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7efc34097960 0x7efc34148ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:12.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.056+0000 7efc38def700 1 -- 172.21.15.111:0/3612839532 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7efc34097960 msgr2=0x7efc34148ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:12.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.057+0000 7efc38def700 1 --2- 172.21.15.111:0/3612839532 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7efc34097960 0x7efc34148ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:12.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.057+0000 7efc38def700 1 -- 172.21.15.111:0/3612839532 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efc34097580 msgr2=0x7efc34063fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:12.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.057+0000 7efc38def700 1 --2- 172.21.15.111:0/3612839532 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efc34097580 0x7efc34063fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:12.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.057+0000 7efc38def700 1 -- 172.21.15.111:0/3612839532 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc2800b180 con 0x7efc34139c10 2024-04-25T02:21:12.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.057+0000 7efc33fff700 1 --2- 172.21.15.111:0/3612839532 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efc34097580 0x7efc34063fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:21:12.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.057+0000 7efc38def700 1 --2- 172.21.15.111:0/3612839532 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efc34139c10 0x7efc340623f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7efc2c001250 tx=0x7efc2c007d00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:12.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.057+0000 7efc317fa700 1 -- 172.21.15.111:0/3612839532 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc2c005ba0 con 0x7efc34139c10 2024-04-25T02:21:12.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.057+0000 7efc317fa700 1 -- 172.21.15.111:0/3612839532 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc2c005d00 con 0x7efc34139c10 2024-04-25T02:21:12.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.057+0000 7efc3a852700 1 -- 172.21.15.111:0/3612839532 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc2400b180 con 0x7efc34139c10 2024-04-25T02:21:12.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.057+0000 7efc317fa700 1 -- 172.21.15.111:0/3612839532 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc2c004a90 con 0x7efc34139c10 2024-04-25T02:21:12.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.057+0000 7efc3a852700 1 -- 172.21.15.111:0/3612839532 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc3409b0b0 con 0x7efc34139c10 2024-04-25T02:21:12.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.058+0000 7efc317fa700 1 -- 172.21.15.111:0/3612839532 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 5) v1 ==== 42017+0+0 (secure 0 0 0) 0x7efc2c004bf0 con 0x7efc34139c10 2024-04-25T02:21:12.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.058+0000 7efc317fa700 1 -- 172.21.15.111:0/3612839532 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7efc2c04a2f0 con 0x7efc34139c10 2024-04-25T02:21:12.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.061+0000 7efc4c2d9b80 1 Processor -- start 2024-04-25T02:21:12.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.061+0000 7efc4c2d9b80 1 -- start start 2024-04-25T02:21:12.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.061+0000 7efc4c2d9b80 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55e9663db1d0 0x55e9663cea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:12.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.061+0000 7efc4c2d9b80 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x55e9663db5b0 0x55e9663db9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:12.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.061+0000 7efc4c2d9b80 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9663e0590 0x55e9663e0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:12.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.061+0000 7efc4c2d9b80 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e96637ca10 con 0x55e9663e0590 2024-04-25T02:21:12.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.061+0000 7efc4c2d9b80 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e966321e10 con 0x55e9663db1d0 2024-04-25T02:21:12.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.061+0000 7efc4c2d9b80 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x55e9662f28b0 con 0x55e9663db5b0 2024-04-25T02:21:12.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.061+0000 7efc33fff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55e9663db1d0 0x55e9663cea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:12.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.061+0000 7efc38def700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9663e0590 0x55e9663e0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:12.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.062+0000 7efc337fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x55e9663db5b0 0x55e9663db9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:12.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.062+0000 7efc33fff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55e9663db1d0 0x55e9663cea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:52872/0 (socket says 172.21.15.111:52872) 2024-04-25T02:21:12.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.062+0000 7efc33fff700 1 -- 172.21.15.111:0/3928179951 learned_addr learned my addr 172.21.15.111:0/3928179951 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:21:12.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.062+0000 7efc337fe700 1 -- 172.21.15.111:0/3928179951 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55e9663db1d0 msgr2=0x55e9663cea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:21:12.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.062+0000 7efc337fe700 1 --2- 172.21.15.111:0/3928179951 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55e9663db1d0 0x55e9663cea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:12.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.062+0000 7efc337fe700 1 -- 172.21.15.111:0/3928179951 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9663e0590 msgr2=0x55e9663e0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:21:12.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.062+0000 7efc337fe700 1 --2- 172.21.15.111:0/3928179951 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9663e0590 0x55e9663e0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:12.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.062+0000 7efc337fe700 1 -- 172.21.15.111:0/3928179951 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55e966388e20 con 0x55e9663db5b0 2024-04-25T02:21:12.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.062+0000 7efc38def700 1 --2- 172.21.15.111:0/3928179951 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9663e0590 0x55e9663e0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:21:12.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.062+0000 7efc33fff700 1 --2- 172.21.15.111:0/3928179951 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55e9663db1d0 0x55e9663cea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:21:12.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.062+0000 7efc337fe700 1 --2- 172.21.15.111:0/3928179951 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x55e9663db5b0 0x55e9663db9b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7efc2800b000 tx=0x7efc28006df0).ready entity=mon.2 client_cookie=f28e740f02950446 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:12.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.062+0000 7efc3a852700 1 -- 172.21.15.111:0/3928179951 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc28011a60 con 0x55e9663db5b0 2024-04-25T02:21:12.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.062+0000 7efc3a852700 1 -- 172.21.15.111:0/3928179951 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc28011bc0 con 0x55e9663db5b0 2024-04-25T02:21:12.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.062+0000 7efc3a852700 1 -- 172.21.15.111:0/3928179951 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc28014440 con 0x55e9663db5b0 2024-04-25T02:21:12.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.063+0000 7efc4c2d9b80 1 -- 172.21.15.111:0/3928179951 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x55e9663db5b0 msgr2=0x55e9663db9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:12.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.063+0000 7efc4c2d9b80 1 --2- 172.21.15.111:0/3928179951 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x55e9663db5b0 0x55e9663db9b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7efc2800b000 tx=0x7efc28006df0).stop 2024-04-25T02:21:12.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.063+0000 7efc4c2d9b80 1 -- 172.21.15.111:0/3928179951 shutdown_connections 2024-04-25T02:21:12.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.063+0000 7efc4c2d9b80 1 --2- 172.21.15.111:0/3928179951 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9663e0590 0x55e9663e0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:12.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.063+0000 7efc4c2d9b80 1 --2- 172.21.15.111:0/3928179951 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55e9663db1d0 0x55e9663cea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:12.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.063+0000 7efc4c2d9b80 1 --2- 172.21.15.111:0/3928179951 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x55e9663db5b0 0x55e9663db9b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:12.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.063+0000 7efc4c2d9b80 1 -- 172.21.15.111:0/3928179951 >> 172.21.15.111:0/3928179951 conn(0x55e96637a970 msgr2=0x55e9662d4690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:12.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.063+0000 7efc4c2d9b80 1 -- 172.21.15.111:0/3928179951 shutdown_connections 2024-04-25T02:21:12.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.063+0000 7efc4c2d9b80 1 -- 172.21.15.111:0/3928179951 wait complete. 2024-04-25T02:21:12.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.063+0000 7efc4c2d9b80 1 -- start start 2024-04-25T02:21:12.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.063+0000 7efc4c2d9b80 1 Processor -- start 2024-04-25T02:21:12.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.064+0000 7efc4c2d9b80 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x55e9663db1d0 0x55e9663d8230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:12.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.064+0000 7efc4c2d9b80 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9663db5b0 0x55e9663ccb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:12.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.064+0000 7efc4c2d9b80 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55e9663e0590 0x55e9663ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:12.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.064+0000 7efc4c2d9b80 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e966306180 con 0x55e9663db5b0 2024-04-25T02:21:12.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.064+0000 7efc4c2d9b80 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e9662e67f0 con 0x55e9663e0590 2024-04-25T02:21:12.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.064+0000 7efc4c2d9b80 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x55e9662d6710 con 0x55e9663db1d0 2024-04-25T02:21:12.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.064+0000 7efc337fe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9663db5b0 0x55e9663ccb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:12.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.064+0000 7efc33fff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x55e9663db1d0 0x55e9663d8230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:12.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.064+0000 7efc337fe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9663db5b0 0x55e9663ccb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:58142/0 (socket says 172.21.15.111:58142) 2024-04-25T02:21:12.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.064+0000 7efc33fff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x55e9663db1d0 0x55e9663d8230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:40770/0 (socket says 172.21.15.111:40770) 2024-04-25T02:21:12.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.064+0000 7efc337fe700 1 -- 172.21.15.111:0/1010567711 learned_addr learned my addr 172.21.15.111:0/1010567711 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:21:12.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.064+0000 7efc38def700 1 --2- 172.21.15.111:0/1010567711 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55e9663e0590 0x55e9663ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:12.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.064+0000 7efc4c2d9b80 10 client.0 ll_register_callbacks cb 0x55e9662fb570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:21:12.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.065+0000 7efc337fe700 1 -- 172.21.15.111:0/1010567711 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x55e9663db1d0 msgr2=0x55e9663d8230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:21:12.074 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.065+0000 7efc337fe700 1 --2- 172.21.15.111:0/1010567711 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x55e9663db1d0 0x55e9663d8230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:12.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.065+0000 7efc337fe700 1 -- 172.21.15.111:0/1010567711 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55e9663e0590 msgr2=0x55e9663ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:21:12.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.065+0000 7efc337fe700 1 --2- 172.21.15.111:0/1010567711 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55e9663e0590 0x55e9663ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:12.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.065+0000 7efc337fe700 1 -- 172.21.15.111:0/1010567711 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc34139730 con 0x55e9663db5b0 2024-04-25T02:21:12.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.065+0000 7efc38def700 1 --2- 172.21.15.111:0/1010567711 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55e9663e0590 0x55e9663ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:21:12.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.065+0000 7efc337fe700 1 --2- 172.21.15.111:0/1010567711 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9663db5b0 0x55e9663ccb00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x55e9663d2230 tx=0x7efc2801b000).ready entity=mon.0 client_cookie=f9bb4ba487dcdd59 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:12.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.065+0000 7efc12ffd700 10 client.0 ms_handle_connect on v2:172.21.15.111:3300/0 2024-04-25T02:21:12.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.065+0000 7efc12ffd700 1 -- 172.21.15.111:0/1010567711 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc28011a60 con 0x55e9663db5b0 2024-04-25T02:21:12.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.065+0000 7efc12ffd700 1 -- 172.21.15.111:0/1010567711 <== mon.0 v2:172.21.15.111:3300/0 2 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7efc2801fe20 con 0x55e9663db5b0 2024-04-25T02:21:12.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.065+0000 7efc4c2d9b80 1 -- 172.21.15.111:0/1010567711 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55e96627d0c0 con 0x55e9663db5b0 2024-04-25T02:21:12.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.065+0000 7efc12ffd700 1 -- 172.21.15.111:0/1010567711 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_get_version_reply(handle=1 version=12) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc28028440 con 0x55e9663db5b0 2024-04-25T02:21:12.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.065+0000 7efc4c2d9b80 10 client.4884 fetch_fsmap learned FSMap version 12 2024-04-25T02:21:12.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.065+0000 7efc4c2d9b80 1 -- 172.21.15.111:0/1010567711 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) v3 -- 0x7efc3409b0b0 con 0x55e9663db5b0 2024-04-25T02:21:12.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.065+0000 7efc12ffd700 1 -- 172.21.15.111:0/1010567711 <== mon.0 v2:172.21.15.111:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55e96627d0c0 con 0x55e9663db5b0 2024-04-25T02:21:12.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.065+0000 7efc12ffd700 1 -- 172.21.15.111:0/1010567711 <== mon.0 v2:172.21.15.111:3300/0 5 ==== fsmap(e 12) v1 ==== 1181+0+0 (secure 0 0 0) 0x7efc28014950 con 0x55e9663db5b0 2024-04-25T02:21:12.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.065+0000 7efc4c2d9b80 10 client.4884 fetch_fsmap finished waiting for FSMap version 12 2024-04-25T02:21:12.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.065+0000 7efc4c2d9b80 10 client.4884 resolve_mds: resolved ID 'b' to GID 4239 2024-04-25T02:21:12.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.065+0000 7efc4c2d9b80 20 client.4884 populate_metadata read hostname 'smithi111' 2024-04-25T02:21:12.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.065+0000 7efc4c2d9b80 4 client.4884 mds_command: new command op to 4239 tid=0[{"prefix": "get_command_descriptions"}] 2024-04-25T02:21:12.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.065+0000 7efc4c2d9b80 1 -- 172.21.15.111:0/1010567711 --> v1:172.21.15.111:6819/4003866251 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55e9662fc230 con 0x55e9663df290 2024-04-25T02:21:12.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.066+0000 7efc12ffd700 10 client.4884 ms_handle_connect on v1:172.21.15.111:6819/4003866251 2024-04-25T02:21:12.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.066+0000 7efc12ffd700 1 -- 172.21.15.111:0/1010567711 <== mds.0 v1:172.21.15.111:6819/4003866251 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (unknown 0 0 4003121674) 0x55e9662fc230 con 0x55e9663df290 2024-04-25T02:21:12.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.066+0000 7efc12ffd700 10 client.4884 handle_command_reply: tid=0 2024-04-25T02:21:12.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.066+0000 7efc4c2d9b80 1 client.4884 shutdown 2024-04-25T02:21:12.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.066+0000 7efc4c2d9b80 1 -- 172.21.15.111:0/1010567711 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9663db5b0 msgr2=0x55e9663ccb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:12.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.066+0000 7efc4c2d9b80 1 --2- 172.21.15.111:0/1010567711 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9663db5b0 0x55e9663ccb00 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x55e9663d2230 tx=0x7efc2801b000).stop 2024-04-25T02:21:12.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.066+0000 7efc4c2d9b80 1 -- 172.21.15.111:0/1010567711 shutdown_connections 2024-04-25T02:21:12.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.066+0000 7efc4c2d9b80 1 --2- 172.21.15.111:0/1010567711 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55e9663e0590 0x55e9663ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:12.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.066+0000 7efc12ffd700 0 client.4884 ms_handle_reset on v1:172.21.15.111:6819/4003866251 2024-04-25T02:21:12.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.066+0000 7efc4c2d9b80 1 --2- 172.21.15.111:0/1010567711 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x55e9663db1d0 0x55e9663d8230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:12.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.066+0000 7efc4c2d9b80 1 --2- 172.21.15.111:0/1010567711 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9663db5b0 0x55e9663ccb00 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:12.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.066+0000 7efc4c2d9b80 1 -- 172.21.15.111:0/1010567711 >> 172.21.15.111:0/1010567711 conn(0x55e96637a970 msgr2=0x55e9662cfcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:12.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.066+0000 7efc4c2d9b80 1 -- 172.21.15.111:0/1010567711 shutdown_connections 2024-04-25T02:21:12.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.066+0000 7efc4c2d9b80 1 -- 172.21.15.111:0/1010567711 wait complete. 2024-04-25T02:21:12.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.067+0000 7efc4c2d9b80 20 client.4884 trim_cache size 0 max 16384 2024-04-25T02:21:12.086 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.082+0000 7efc4c2d9b80 1 Processor -- start 2024-04-25T02:21:12.086 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.082+0000 7efc4c2d9b80 1 -- start start 2024-04-25T02:21:12.092 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.083+0000 7efc4c2d9b80 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55e9663db1d0 0x55e9663d0bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:12.092 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.083+0000 7efc4c2d9b80 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x55e9663db5b0 0x55e9663de560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:12.092 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.083+0000 7efc4c2d9b80 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9663e0590 0x55e9663df670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:12.092 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.083+0000 7efc4c2d9b80 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9663d03a0 con 0x55e9663e0590 2024-04-25T02:21:12.092 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.083+0000 7efc4c2d9b80 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e96627d2f0 con 0x55e9663db1d0 2024-04-25T02:21:12.092 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.083+0000 7efc4c2d9b80 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x55e96638ccb0 con 0x55e9663db5b0 2024-04-25T02:21:12.092 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.083+0000 7efc33fff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55e9663db1d0 0x55e9663d0bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:12.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.083+0000 7efc337fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x55e9663db5b0 0x55e9663de560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:12.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.083+0000 7efc33fff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55e9663db1d0 0x55e9663d0bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:52888/0 (socket says 172.21.15.111:52888) 2024-04-25T02:21:12.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.083+0000 7efc33fff700 1 -- 172.21.15.111:0/2296957810 learned_addr learned my addr 172.21.15.111:0/2296957810 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:21:12.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.083+0000 7efc38def700 1 --2- 172.21.15.111:0/2296957810 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9663e0590 0x55e9663df670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:12.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.083+0000 7efc33fff700 1 -- 172.21.15.111:0/2296957810 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x55e9663db5b0 msgr2=0x55e9663de560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:21:12.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.083+0000 7efc33fff700 1 --2- 172.21.15.111:0/2296957810 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x55e9663db5b0 0x55e9663de560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:12.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.083+0000 7efc33fff700 1 -- 172.21.15.111:0/2296957810 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9663e0590 msgr2=0x55e9663df670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:21:12.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.083+0000 7efc33fff700 1 --2- 172.21.15.111:0/2296957810 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9663e0590 0x55e9663df670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:12.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.083+0000 7efc33fff700 1 -- 172.21.15.111:0/2296957810 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc2800b970 con 0x55e9663db1d0 2024-04-25T02:21:12.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.083+0000 7efc38def700 1 --2- 172.21.15.111:0/2296957810 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9663e0590 0x55e9663df670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:21:12.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.083+0000 7efc337fe700 1 --2- 172.21.15.111:0/2296957810 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x55e9663db5b0 0x55e9663de560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:21:12.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.083+0000 7efc33fff700 1 --2- 172.21.15.111:0/2296957810 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55e9663db1d0 0x55e9663d0bb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7efc2401d000 tx=0x7efc24012000).ready entity=mon.1 client_cookie=ebd460f25903e1a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:12.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.083+0000 7efc197fa700 1 -- 172.21.15.111:0/2296957810 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc24026820 con 0x55e9663db1d0 2024-04-25T02:21:12.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.083+0000 7efc197fa700 1 -- 172.21.15.111:0/2296957810 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc24026980 con 0x55e9663db1d0 2024-04-25T02:21:12.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.083+0000 7efc197fa700 1 -- 172.21.15.111:0/2296957810 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc24026ce0 con 0x55e9663db1d0 2024-04-25T02:21:12.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.084+0000 7efc4c2d9b80 1 -- 172.21.15.111:0/2296957810 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55e9663db1d0 msgr2=0x55e9663d0bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:12.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.084+0000 7efc4c2d9b80 1 --2- 172.21.15.111:0/2296957810 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55e9663db1d0 0x55e9663d0bb0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7efc2401d000 tx=0x7efc24012000).stop 2024-04-25T02:21:12.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.084+0000 7efc4c2d9b80 1 -- 172.21.15.111:0/2296957810 shutdown_connections 2024-04-25T02:21:12.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.084+0000 7efc4c2d9b80 1 --2- 172.21.15.111:0/2296957810 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9663e0590 0x55e9663df670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:12.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.084+0000 7efc4c2d9b80 1 --2- 172.21.15.111:0/2296957810 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55e9663db1d0 0x55e9663d0bb0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:12.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.084+0000 7efc4c2d9b80 1 --2- 172.21.15.111:0/2296957810 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x55e9663db5b0 0x55e9663de560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:12.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.084+0000 7efc4c2d9b80 1 -- 172.21.15.111:0/2296957810 >> 172.21.15.111:0/2296957810 conn(0x55e96637a970 msgr2=0x55e9663d7fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:12.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.084+0000 7efc4c2d9b80 1 -- 172.21.15.111:0/2296957810 shutdown_connections 2024-04-25T02:21:12.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.084+0000 7efc4c2d9b80 1 -- 172.21.15.111:0/2296957810 wait complete. 2024-04-25T02:21:12.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.084+0000 7efc4c2d9b80 1 -- start start 2024-04-25T02:21:12.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.084+0000 7efc4c2d9b80 1 Processor -- start 2024-04-25T02:21:12.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.085+0000 7efc4c2d9b80 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55e9663db1d0 0x55e9663d6ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:12.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.085+0000 7efc4c2d9b80 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9663db5b0 0x55e9663e92e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:12.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.085+0000 7efc4c2d9b80 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x55e9663e0590 0x55e9663acd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-04-25T02:21:12.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.085+0000 7efc4c2d9b80 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x55e9663d73e0 con 0x55e9663db5b0 2024-04-25T02:21:12.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.085+0000 7efc4c2d9b80 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x55e9663f7650 con 0x55e9663db1d0 2024-04-25T02:21:12.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.085+0000 7efc4c2d9b80 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x55e9663f7320 con 0x55e9663e0590 2024-04-25T02:21:12.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.085+0000 7efc4c2d9b80 10 client.0 ll_register_callbacks cb 0x55e9663e03a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:21:12.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.085+0000 7efc33fff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55e9663db1d0 0x55e9663d6ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:12.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.085+0000 7efc38def700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x55e9663e0590 0x55e9663acd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:12.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.085+0000 7efc33fff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55e9663db1d0 0x55e9663d6ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:52896/0 (socket says 172.21.15.111:52896) 2024-04-25T02:21:12.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.085+0000 7efc33fff700 1 -- 172.21.15.111:0/1630730538 learned_addr learned my addr 172.21.15.111:0/1630730538 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:21:12.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.085+0000 7efc337fe700 1 --2- 172.21.15.111:0/1630730538 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9663db5b0 0x55e9663e92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-04-25T02:21:12.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.086+0000 7efc33fff700 1 -- 172.21.15.111:0/1630730538 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x55e9663e0590 msgr2=0x55e9663acd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:21:12.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.086+0000 7efc33fff700 1 --2- 172.21.15.111:0/1630730538 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x55e9663e0590 0x55e9663acd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:12.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.086+0000 7efc33fff700 1 -- 172.21.15.111:0/1630730538 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9663db5b0 msgr2=0x55e9663e92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:21:12.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.086+0000 7efc33fff700 1 --2- 172.21.15.111:0/1630730538 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9663db5b0 0x55e9663e92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:12.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.086+0000 7efc33fff700 1 -- 172.21.15.111:0/1630730538 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc3409b0b0 con 0x55e9663db1d0 2024-04-25T02:21:12.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.086+0000 7efc337fe700 1 --2- 172.21.15.111:0/1630730538 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9663db5b0 0x55e9663e92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:21:12.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.086+0000 7efc33fff700 1 --2- 172.21.15.111:0/1630730538 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55e9663db1d0 0x55e9663d6ef0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x55e9663cd9a0 tx=0x7efc24025000).ready entity=mon.1 client_cookie=31f207ffca0f0688 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:21:12.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.086+0000 7efc13fff700 10 client.0 ms_handle_connect on v2:172.21.15.111:3301/0 2024-04-25T02:21:12.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.086+0000 7efc13fff700 1 -- 172.21.15.111:0/1630730538 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 383+0+0 (secure 0 0 0) 0x7efc24026d00 con 0x55e9663db1d0 2024-04-25T02:21:12.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.086+0000 7efc13fff700 1 -- 172.21.15.111:0/1630730538 <== mon.1 v2:172.21.15.111:3301/0 2 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7efc24013470 con 0x55e9663db1d0 2024-04-25T02:21:12.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.086+0000 7efc4c2d9b80 1 -- 172.21.15.111:0/1630730538 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7efc28011bc0 con 0x55e9663db1d0 2024-04-25T02:21:12.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.086+0000 7efc13fff700 1 -- 172.21.15.111:0/1630730538 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_get_version_reply(handle=1 version=12) v2 ==== 24+0+0 (secure 0 0 0) 0x7efc24026e60 con 0x55e9663db1d0 2024-04-25T02:21:12.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.086+0000 7efc4c2d9b80 10 client.4681 fetch_fsmap learned FSMap version 12 2024-04-25T02:21:12.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.086+0000 7efc4c2d9b80 1 -- 172.21.15.111:0/1630730538 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,fsmap=12,monmap=2+}) v3 -- 0x7efc2400b180 con 0x55e9663db1d0 2024-04-25T02:21:12.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.086+0000 7efc13fff700 1 -- 172.21.15.111:0/1630730538 <== mon.1 v2:172.21.15.111:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc28011bc0 con 0x55e9663db1d0 2024-04-25T02:21:12.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.086+0000 7efc13fff700 1 -- 172.21.15.111:0/1630730538 <== mon.1 v2:172.21.15.111:3301/0 5 ==== fsmap(e 12) v1 ==== 1181+0+0 (secure 0 0 0) 0x7efc24013b40 con 0x55e9663db1d0 2024-04-25T02:21:12.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.086+0000 7efc4c2d9b80 10 client.4681 fetch_fsmap finished waiting for FSMap version 12 2024-04-25T02:21:12.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.086+0000 7efc4c2d9b80 10 client.4681 resolve_mds: resolved ID 'b' to GID 4239 2024-04-25T02:21:12.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.086+0000 7efc4c2d9b80 20 client.4681 populate_metadata read hostname 'smithi111' 2024-04-25T02:21:12.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.086+0000 7efc4c2d9b80 4 client.4681 mds_command: new command op to 4239 tid=0[{"prefix": "status"}] 2024-04-25T02:21:12.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.086+0000 7efc4c2d9b80 1 -- 172.21.15.111:0/1630730538 --> v1:172.21.15.111:6819/4003866251 -- command(tid 0: {"prefix": "status"}) v1 -- 0x55e9662f4570 con 0x55e9663ad220 2024-04-25T02:21:12.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.086+0000 7efc13fff700 10 client.4681 ms_handle_connect on v1:172.21.15.111:6819/4003866251 2024-04-25T02:21:12.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.087+0000 7efc13fff700 1 -- 172.21.15.111:0/1630730538 <== mds.0 v1:172.21.15.111:6819/4003866251 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+306 (unknown 0 0 3148593941) 0x55e9662f4570 con 0x55e9663ad220 2024-04-25T02:21:12.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.087+0000 7efc13fff700 10 client.4681 handle_command_reply: tid=0 2024-04-25T02:21:12.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.087+0000 7efc4c2d9b80 1 client.4681 shutdown 2024-04-25T02:21:12.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.087+0000 7efc4c2d9b80 1 -- 172.21.15.111:0/1630730538 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55e9663db1d0 msgr2=0x55e9663d6ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:12.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.087+0000 7efc4c2d9b80 1 --2- 172.21.15.111:0/1630730538 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55e9663db1d0 0x55e9663d6ef0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x55e9663cd9a0 tx=0x7efc24025000).stop 2024-04-25T02:21:12.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.087+0000 7efc4c2d9b80 1 -- 172.21.15.111:0/1630730538 shutdown_connections 2024-04-25T02:21:12.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.087+0000 7efc4c2d9b80 1 --2- 172.21.15.111:0/1630730538 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x55e9663e0590 0x55e9663acd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:12.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.087+0000 7efc4c2d9b80 1 --2- 172.21.15.111:0/1630730538 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x55e9663db1d0 0x55e9663d6ef0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:12.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.087+0000 7efc13fff700 0 client.4681 ms_handle_reset on v1:172.21.15.111:6819/4003866251 2024-04-25T02:21:12.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.087+0000 7efc4c2d9b80 1 --2- 172.21.15.111:0/1630730538 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x55e9663db5b0 0x55e9663e92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:12.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.087+0000 7efc4c2d9b80 1 -- 172.21.15.111:0/1630730538 >> 172.21.15.111:0/1630730538 conn(0x55e96637a970 msgr2=0x55e9663dbbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:12.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.087+0000 7efc4c2d9b80 1 -- 172.21.15.111:0/1630730538 shutdown_connections 2024-04-25T02:21:12.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.087+0000 7efc4c2d9b80 1 -- 172.21.15.111:0/1630730538 wait complete. 2024-04-25T02:21:12.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.087+0000 7efc4c2d9b80 20 client.4681 trim_cache size 0 max 16384 2024-04-25T02:21:12.098 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-25T02:21:12.098 INFO:teuthology.orchestra.run.smithi111.stdout: "cluster_fsid": "4643f974-f93a-4436-93b8-460ff320e62e", 2024-04-25T02:21:12.098 INFO:teuthology.orchestra.run.smithi111.stdout: "whoami": 0, 2024-04-25T02:21:12.098 INFO:teuthology.orchestra.run.smithi111.stdout: "id": 4239, 2024-04-25T02:21:12.098 INFO:teuthology.orchestra.run.smithi111.stdout: "want_state": "up:active", 2024-04-25T02:21:12.098 INFO:teuthology.orchestra.run.smithi111.stdout: "state": "up:active", 2024-04-25T02:21:12.099 INFO:teuthology.orchestra.run.smithi111.stdout: "rank_uptime": 47.936304528000001, 2024-04-25T02:21:12.099 INFO:teuthology.orchestra.run.smithi111.stdout: "mdsmap_epoch": 12, 2024-04-25T02:21:12.099 INFO:teuthology.orchestra.run.smithi111.stdout: "osdmap_epoch": 19, 2024-04-25T02:21:12.099 INFO:teuthology.orchestra.run.smithi111.stdout: "osdmap_epoch_barrier": 19, 2024-04-25T02:21:12.099 INFO:teuthology.orchestra.run.smithi111.stdout: "uptime": 56.495914519000003 2024-04-25T02:21:12.099 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-25T02:21:12.100 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.087+0000 7efc3a852700 1 -- 172.21.15.111:0/3612839532 >> v1:172.21.15.111:6816/39585 conn(0x7efc14038da0 legacy=0x7efc1403b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:12.100 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.088+0000 7efc3a852700 1 -- 172.21.15.111:0/3612839532 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efc34139c10 msgr2=0x7efc340623f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:21:12.100 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.088+0000 7efc3a852700 1 --2- 172.21.15.111:0/3612839532 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efc34139c10 0x7efc340623f0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7efc2c001250 tx=0x7efc2c007d00).stop 2024-04-25T02:21:12.100 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.088+0000 7efc3a852700 1 -- 172.21.15.111:0/3612839532 shutdown_connections 2024-04-25T02:21:12.100 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.088+0000 7efc3a852700 1 --2- 172.21.15.111:0/3612839532 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efc34139c10 0x7efc340623f0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:12.100 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.088+0000 7efc3a852700 1 --2- 172.21.15.111:0/3612839532 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efc34097580 0x7efc34063fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:12.100 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.088+0000 7efc3a852700 1 --2- 172.21.15.111:0/3612839532 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7efc34097960 0x7efc34148ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-04-25T02:21:12.100 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.088+0000 7efc3a852700 1 -- 172.21.15.111:0/3612839532 >> 172.21.15.111:0/3612839532 conn(0x7efc340614e0 msgr2=0x7efc34098090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:21:12.100 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.088+0000 7efc3a852700 1 -- 172.21.15.111:0/3612839532 shutdown_connections 2024-04-25T02:21:12.100 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:21:12.088+0000 7efc3a852700 1 -- 172.21.15.111:0/3612839532 wait complete. 2024-04-25T02:21:12.102 INFO:teuthology.run_tasks:Running task print... 2024-04-25T02:21:12.111 INFO:teuthology.task.print:**** done mds pre-upgrade sequence 2024-04-25T02:21:12.111 INFO:teuthology.run_tasks:Running task install.upgrade... 2024-04-25T02:21:12.143 INFO:teuthology.task.install:project ceph config {'mon.a': {'branch': 'quincy'}} overrides {'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'} 2024-04-25T02:21:12.143 INFO:teuthology.task.install:config contains sha1|tag|branch, removing those keys from override 2024-04-25T02:21:12.143 INFO:teuthology.task.install:remote ubuntu@smithi111.front.sepia.ceph.com config {'branch': 'quincy', 'flavor': 'default'} 2024-04-25T02:21:12.143 INFO:teuthology.task.install:extra packages: [] 2024-04-25T02:21:12.149 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-25T02:21:12.149 INFO:teuthology.task.install:Upgrading ceph rpm packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd 2024-04-25T02:21:12.149 DEBUG:teuthology.orchestra.run.smithi111:> rpm -q ceph-common --qf '%{VERSION}-%{RELEASE}' 2024-04-25T02:21:12.171 INFO:teuthology.orchestra.run.smithi111.stdout:15.2.17-0.el8 2024-04-25T02:21:12.171 INFO:teuthology.packaging:The installed version of ceph-common is 15.2.17-0.el8 2024-04-25T02:21:12.172 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2024-04-25T02:21:12.424 INFO:teuthology.task.install:Ceph rpm upgrade from 15.2.17-0.el8 to 17.2.7-902.gc61472c8 2024-04-25T02:21:12.424 INFO:teuthology.task.install.rpm:Host smithi111 is: centos 8 x86_64 2024-04-25T02:21:12.424 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2024-04-25T02:21:12.775 INFO:teuthology.task.install.rpm:Repo base URL: https://3.chacra.ceph.com/r/ceph/quincy/c61472c83ce76869b0fe076c19ed2f4bcc3fb4af/centos/8/flavors/default/ 2024-04-25T02:21:12.775 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f /etc/yum.repos.d/ceph.repo 2024-04-25T02:21:12.975 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/quincy/c61472c83ce76869b0fe076c19ed2f4bcc3fb4af/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy/c61472c83ce76869b0fe076c19ed2f4bcc3fb4af/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy/c61472c83ce76869b0fe076c19ed2f4bcc3fb4af/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T02:21:12.975 DEBUG:teuthology.orchestra.run.smithi111:> set -ex 2024-04-25T02:21:12.975 DEBUG:teuthology.orchestra.run.smithi111:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T02:21:13.004 DEBUG:teuthology.orchestra.run.smithi111:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T02:21:13.072 DEBUG:teuthology.orchestra.run.smithi111:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T02:21:13.139 DEBUG:teuthology.orchestra.run.smithi111:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T02:21:13.197 INFO:teuthology.orchestra.run.smithi111.stdout:check_obsoletes = 1 2024-04-25T02:21:13.208 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum clean all 2024-04-25T02:21:13.468 INFO:teuthology.orchestra.run.smithi111.stdout:71 files removed 2024-04-25T02:21:13.497 DEBUG:teuthology.orchestra.run.smithi111:> sudo yum -y upgrade ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd 2024-04-25T02:21:14.270 INFO:teuthology.orchestra.run.smithi111.stdout:ceph packages for x86_64 215 kB/s | 79 kB 00:00 2024-04-25T02:21:14.603 INFO:teuthology.orchestra.run.smithi111.stdout:ceph noarch packages 36 kB/s | 11 kB 00:00 2024-04-25T02:21:14.904 INFO:teuthology.orchestra.run.smithi111.stdout:ceph source packages 5.4 kB/s | 1.5 kB 00:00 2024-04-25T02:21:15.612 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 8 - AppStream 41 MB/s | 28 MB 00:00 2024-04-25T02:21:21.255 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 8 - BaseOS 16 MB/s | 10 MB 00:00 2024-04-25T02:21:23.282 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 8 - Extras 43 kB/s | 18 kB 00:00 2024-04-25T02:21:23.707 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 8 - Extras common packages 24 kB/s | 7.7 kB 00:00 2024-04-25T02:21:24.308 INFO:teuthology.orchestra.run.smithi111.stdout:CentOS Stream 8 - PowerTools 9.7 MB/s | 5.0 MB 00:00 2024-04-25T02:21:25.392 INFO:teuthology.orchestra.run.smithi111.stdout:Copr repo for python3-asyncssh owned by ceph 25 kB/s | 3.5 kB 00:00 2024-04-25T02:21:37.693 INFO:teuthology.orchestra.run.smithi111.stdout:Extra Packages for Enterprise Linux 1.3 MB/s | 16 MB 00:12 2024-04-25T02:21:41.493 INFO:teuthology.orchestra.run.smithi111.stdout:lab-extras 415 kB/s | 24 kB 00:00 2024-04-25T02:21:45.088 INFO:teuthology.orchestra.run.smithi111.stderr:Package cephadm available, but not installed. 2024-04-25T02:21:45.088 INFO:teuthology.orchestra.run.smithi111.stdout:No match for argument: cephadm 2024-04-25T02:21:45.093 INFO:teuthology.orchestra.run.smithi111.stderr:Package ceph-mgr-dashboard available, but not installed. 2024-04-25T02:21:45.094 INFO:teuthology.orchestra.run.smithi111.stdout:No match for argument: ceph-mgr-dashboard 2024-04-25T02:21:45.094 INFO:teuthology.orchestra.run.smithi111.stderr:Package ceph-mgr-diskprediction-local available, but not installed. 2024-04-25T02:21:45.094 INFO:teuthology.orchestra.run.smithi111.stdout:No match for argument: ceph-mgr-diskprediction-local 2024-04-25T02:21:45.094 INFO:teuthology.orchestra.run.smithi111.stderr:Package ceph-mgr-rook available, but not installed. 2024-04-25T02:21:45.095 INFO:teuthology.orchestra.run.smithi111.stdout:No match for argument: ceph-mgr-rook 2024-04-25T02:21:45.095 INFO:teuthology.orchestra.run.smithi111.stderr:Package ceph-mgr-cephadm available, but not installed. 2024-04-25T02:21:45.095 INFO:teuthology.orchestra.run.smithi111.stdout:No match for argument: ceph-mgr-cephadm 2024-04-25T02:21:45.097 INFO:teuthology.orchestra.run.smithi111.stderr:Package ceph-volume available, but not installed. 2024-04-25T02:21:45.098 INFO:teuthology.orchestra.run.smithi111.stdout:No match for argument: ceph-volume 2024-04-25T02:21:45.200 INFO:teuthology.orchestra.run.smithi111.stdout:Dependencies resolved. 2024-04-25T02:21:45.205 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-04-25T02:21:45.205 INFO:teuthology.orchestra.run.smithi111.stdout: Package Arch Version Repository Size 2024-04-25T02:21:45.205 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-04-25T02:21:45.205 INFO:teuthology.orchestra.run.smithi111.stdout:Upgrading: 2024-04-25T02:21:45.205 INFO:teuthology.orchestra.run.smithi111.stdout: ceph x86_64 2:17.2.7-902.gc61472c8.el8 ceph 6.4 k 2024-04-25T02:21:45.205 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-base x86_64 2:17.2.7-902.gc61472c8.el8 ceph 5.3 M 2024-04-25T02:21:45.205 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-common x86_64 2:17.2.7-902.gc61472c8.el8 ceph 24 M 2024-04-25T02:21:45.205 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-fuse x86_64 2:17.2.7-902.gc61472c8.el8 ceph 876 k 2024-04-25T02:21:45.205 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-immutable-object-cache 2024-04-25T02:21:45.205 INFO:teuthology.orchestra.run.smithi111.stdout: x86_64 2:17.2.7-902.gc61472c8.el8 ceph 162 k 2024-04-25T02:21:45.205 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mds x86_64 2:17.2.7-902.gc61472c8.el8 ceph 2.3 M 2024-04-25T02:21:45.205 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr x86_64 2:17.2.7-902.gc61472c8.el8 ceph 1.6 M 2024-04-25T02:21:45.205 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-modules-core noarch 2:17.2.7-902.gc61472c8.el8 ceph-noarch 240 k 2024-04-25T02:21:45.206 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mon x86_64 2:17.2.7-902.gc61472c8.el8 ceph 4.0 M 2024-04-25T02:21:45.206 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-osd x86_64 2:17.2.7-902.gc61472c8.el8 ceph 17 M 2024-04-25T02:21:45.206 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-radosgw x86_64 2:17.2.7-902.gc61472c8.el8 ceph 17 M 2024-04-25T02:21:45.206 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-selinux x86_64 2:17.2.7-902.gc61472c8.el8 ceph 24 k 2024-04-25T02:21:45.206 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-test x86_64 2:17.2.7-902.gc61472c8.el8 ceph 53 M 2024-04-25T02:21:45.206 INFO:teuthology.orchestra.run.smithi111.stdout: libcephfs-devel x86_64 2:17.2.7-902.gc61472c8.el8 ceph 25 k 2024-04-25T02:21:45.206 INFO:teuthology.orchestra.run.smithi111.stdout: libcephfs2 x86_64 2:17.2.7-902.gc61472c8.el8 ceph 798 k 2024-04-25T02:21:45.206 INFO:teuthology.orchestra.run.smithi111.stdout: librados-devel x86_64 2:17.2.7-902.gc61472c8.el8 ceph 130 k 2024-04-25T02:21:45.206 INFO:teuthology.orchestra.run.smithi111.stdout: librados2 x86_64 2:17.2.7-902.gc61472c8.el8 ceph 3.5 M 2024-04-25T02:21:45.206 INFO:teuthology.orchestra.run.smithi111.stdout: libradosstriper1 x86_64 2:17.2.7-902.gc61472c8.el8 ceph 505 k 2024-04-25T02:21:45.206 INFO:teuthology.orchestra.run.smithi111.stdout: librbd1 x86_64 2:17.2.7-902.gc61472c8.el8 ceph 3.6 M 2024-04-25T02:21:45.206 INFO:teuthology.orchestra.run.smithi111.stdout: librgw2 x86_64 2:17.2.7-902.gc61472c8.el8 ceph 5.6 M 2024-04-25T02:21:45.206 INFO:teuthology.orchestra.run.smithi111.stdout: python3-ceph-argparse x86_64 2:17.2.7-902.gc61472c8.el8 ceph 45 k 2024-04-25T02:21:45.207 INFO:teuthology.orchestra.run.smithi111.stdout: python3-ceph-common x86_64 2:17.2.7-902.gc61472c8.el8 ceph 117 k 2024-04-25T02:21:45.207 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cephfs x86_64 2:17.2.7-902.gc61472c8.el8 ceph 190 k 2024-04-25T02:21:45.207 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rados x86_64 2:17.2.7-902.gc61472c8.el8 ceph 371 k 2024-04-25T02:21:45.207 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rbd x86_64 2:17.2.7-902.gc61472c8.el8 ceph 359 k 2024-04-25T02:21:45.207 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rgw x86_64 2:17.2.7-902.gc61472c8.el8 ceph 106 k 2024-04-25T02:21:45.207 INFO:teuthology.orchestra.run.smithi111.stdout: rbd-fuse x86_64 2:17.2.7-902.gc61472c8.el8 ceph 91 k 2024-04-25T02:21:45.207 INFO:teuthology.orchestra.run.smithi111.stdout: rbd-mirror x86_64 2:17.2.7-902.gc61472c8.el8 ceph 3.5 M 2024-04-25T02:21:45.207 INFO:teuthology.orchestra.run.smithi111.stdout: rbd-nbd x86_64 2:17.2.7-902.gc61472c8.el8 ceph 175 k 2024-04-25T02:21:45.207 INFO:teuthology.orchestra.run.smithi111.stdout:Installing dependencies: 2024-04-25T02:21:45.207 INFO:teuthology.orchestra.run.smithi111.stdout: libcephsqlite x86_64 2:17.2.7-902.gc61472c8.el8 ceph 179 k 2024-04-25T02:21:45.207 INFO:teuthology.orchestra.run.smithi111.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-04-25T02:21:45.207 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:21:45.207 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction Summary 2024-04-25T02:21:45.208 INFO:teuthology.orchestra.run.smithi111.stdout:================================================================================ 2024-04-25T02:21:45.208 INFO:teuthology.orchestra.run.smithi111.stdout:Install 2 Packages 2024-04-25T02:21:45.208 INFO:teuthology.orchestra.run.smithi111.stdout:Upgrade 29 Packages 2024-04-25T02:21:45.208 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:21:45.208 INFO:teuthology.orchestra.run.smithi111.stdout:Total download size: 145 M 2024-04-25T02:21:45.208 INFO:teuthology.orchestra.run.smithi111.stdout:Downloading Packages: 2024-04-25T02:21:45.553 INFO:teuthology.orchestra.run.smithi111.stdout:(1/31): ceph-17.2.7-902.gc61472c8.el8.x86_64.rp 29 kB/s | 6.4 kB 00:00 2024-04-25T02:21:45.637 INFO:teuthology.orchestra.run.smithi111.stdout:(2/31): libcephsqlite-17.2.7-902.gc61472c8.el8. 593 kB/s | 179 kB 00:00 2024-04-25T02:21:46.212 INFO:teuthology.orchestra.run.smithi111.stdout:(3/31): ceph-base-17.2.7-902.gc61472c8.el8.x86_ 8.0 MB/s | 5.3 MB 00:00 2024-04-25T02:21:46.246 INFO:teuthology.orchestra.run.smithi111.stdout:(4/31): thrift-0.13.0-2.el8.x86_64.rpm 1.9 MB/s | 1.7 MB 00:00 2024-04-25T02:21:46.329 INFO:teuthology.orchestra.run.smithi111.stdout:(5/31): ceph-fuse-17.2.7-902.gc61472c8.el8.x86_ 7.3 MB/s | 876 kB 00:00 2024-04-25T02:21:46.654 INFO:teuthology.orchestra.run.smithi111.stdout:(6/31): ceph-mds-17.2.7-902.gc61472c8.el8.x86_6 7.2 MB/s | 2.3 MB 00:00 2024-04-25T02:21:46.697 INFO:teuthology.orchestra.run.smithi111.stdout:(7/31): ceph-immutable-object-cache-17.2.7-902. 360 kB/s | 162 kB 00:00 2024-04-25T02:21:46.878 INFO:teuthology.orchestra.run.smithi111.stdout:(8/31): ceph-mgr-17.2.7-902.gc61472c8.el8.x86_6 7.0 MB/s | 1.6 MB 00:00 2024-04-25T02:21:47.131 INFO:teuthology.orchestra.run.smithi111.stdout:(9/31): ceph-common-17.2.7-902.gc61472c8.el8.x8 16 MB/s | 24 MB 00:01 2024-04-25T02:21:48.214 INFO:teuthology.orchestra.run.smithi111.stdout:(10/31): ceph-osd-17.2.7-902.gc61472c8.el8.x86_ 13 MB/s | 17 MB 00:01 2024-04-25T02:21:48.298 INFO:teuthology.orchestra.run.smithi111.stdout:(11/31): ceph-selinux-17.2.7-902.gc61472c8.el8. 294 kB/s | 24 kB 00:00 2024-04-25T02:21:48.356 INFO:teuthology.orchestra.run.smithi111.stdout:(12/31): ceph-mon-17.2.7-902.gc61472c8.el8.x86_ 2.4 MB/s | 4.0 MB 00:01 2024-04-25T02:21:48.407 INFO:teuthology.orchestra.run.smithi111.stdout:(13/31): libcephfs-devel-17.2.7-902.gc61472c8.e 496 kB/s | 25 kB 00:00 2024-04-25T02:21:48.699 INFO:teuthology.orchestra.run.smithi111.stdout:(14/31): ceph-radosgw-17.2.7-902.gc61472c8.el8. 11 MB/s | 17 MB 00:01 2024-04-25T02:21:48.766 INFO:teuthology.orchestra.run.smithi111.stdout:(15/31): libcephfs2-17.2.7-902.gc61472c8.el8.x8 2.2 MB/s | 798 kB 00:00 2024-04-25T02:21:48.791 INFO:teuthology.orchestra.run.smithi111.stdout:(16/31): librados-devel-17.2.7-902.gc61472c8.el 1.4 MB/s | 130 kB 00:00 2024-04-25T02:21:48.891 INFO:teuthology.orchestra.run.smithi111.stdout:(17/31): libradosstriper1-17.2.7-902.gc61472c8. 4.9 MB/s | 505 kB 00:00 2024-04-25T02:21:49.266 INFO:teuthology.orchestra.run.smithi111.stdout:(18/31): librbd1-17.2.7-902.gc61472c8.el8.x86_6 9.6 MB/s | 3.6 MB 00:00 2024-04-25T02:21:49.775 INFO:teuthology.orchestra.run.smithi111.stdout:(19/31): librgw2-17.2.7-902.gc61472c8.el8.x86_6 11 MB/s | 5.6 MB 00:00 2024-04-25T02:21:49.892 INFO:teuthology.orchestra.run.smithi111.stdout:(20/31): python3-ceph-argparse-17.2.7-902.gc614 382 kB/s | 45 kB 00:00 2024-04-25T02:21:49.959 INFO:teuthology.orchestra.run.smithi111.stdout:(21/31): librados2-17.2.7-902.gc61472c8.el8.x86 2.9 MB/s | 3.5 MB 00:01 2024-04-25T02:21:49.984 INFO:teuthology.orchestra.run.smithi111.stdout:(22/31): python3-ceph-common-17.2.7-902.gc61472 1.2 MB/s | 117 kB 00:00 2024-04-25T02:21:50.043 INFO:teuthology.orchestra.run.smithi111.stdout:(23/31): python3-cephfs-17.2.7-902.gc61472c8.el 2.2 MB/s | 190 kB 00:00 2024-04-25T02:21:50.076 INFO:teuthology.orchestra.run.smithi111.stdout:(24/31): python3-rados-17.2.7-902.gc61472c8.el8 3.9 MB/s | 371 kB 00:00 2024-04-25T02:21:50.143 INFO:teuthology.orchestra.run.smithi111.stdout:(25/31): python3-rgw-17.2.7-902.gc61472c8.el8.x 1.6 MB/s | 106 kB 00:00 2024-04-25T02:21:50.202 INFO:teuthology.orchestra.run.smithi111.stdout:(26/31): python3-rbd-17.2.7-902.gc61472c8.el8.x 2.2 MB/s | 359 kB 00:00 2024-04-25T02:21:50.244 INFO:teuthology.orchestra.run.smithi111.stdout:(27/31): rbd-fuse-17.2.7-902.gc61472c8.el8.x86_ 899 kB/s | 91 kB 00:00 2024-04-25T02:21:50.311 INFO:teuthology.orchestra.run.smithi111.stdout:(28/31): rbd-nbd-17.2.7-902.gc61472c8.el8.x86_6 2.6 MB/s | 175 kB 00:00 2024-04-25T02:21:50.420 INFO:teuthology.orchestra.run.smithi111.stdout:(29/31): ceph-mgr-modules-core-17.2.7-902.gc614 2.2 MB/s | 240 kB 00:00 2024-04-25T02:21:50.812 INFO:teuthology.orchestra.run.smithi111.stdout:(30/31): rbd-mirror-17.2.7-902.gc61472c8.el8.x8 5.7 MB/s | 3.5 MB 00:00 2024-04-25T02:21:52.170 INFO:teuthology.orchestra.run.smithi111.stdout:(31/31): ceph-test-17.2.7-902.gc61472c8.el8.x86 14 MB/s | 53 MB 00:03 2024-04-25T02:21:52.174 INFO:teuthology.orchestra.run.smithi111.stdout:-------------------------------------------------------------------------------- 2024-04-25T02:21:52.174 INFO:teuthology.orchestra.run.smithi111.stdout:Total 21 MB/s | 145 MB 00:06 2024-04-25T02:21:52.175 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction check 2024-04-25T02:21:52.238 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction check succeeded. 2024-04-25T02:21:52.238 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction test 2024-04-25T02:21:52.909 INFO:teuthology.orchestra.run.smithi111.stdout:Transaction test succeeded. 2024-04-25T02:21:52.912 INFO:teuthology.orchestra.run.smithi111.stdout:Running transaction 2024-04-25T02:21:55.220 INFO:teuthology.orchestra.run.smithi111.stdout: Preparing : 1/1 2024-04-25T02:21:55.616 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: librados2-2:17.2.7-902.gc61472c8.el8.x86_64 1/1 2024-04-25T02:21:55.850 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : librados2-2:17.2.7-902.gc61472c8.el8.x86_64 1/60 2024-04-25T02:21:56.236 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: librados2-2:17.2.7-902.gc61472c8.el8.x86_64 1/60 2024-04-25T02:21:56.450 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : librbd1-2:17.2.7-902.gc61472c8.el8.x86_64 2/60 2024-04-25T02:21:56.575 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: librbd1-2:17.2.7-902.gc61472c8.el8.x86_64 2/60 2024-04-25T02:21:56.817 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : libcephfs2-2:17.2.7-902.gc61472c8.el8.x86_64 3/60 2024-04-25T02:21:56.914 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: libcephfs2-2:17.2.7-902.gc61472c8.el8.x86_64 3/60 2024-04-25T02:21:57.286 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : python3-rados-2:17.2.7-902.gc61472c8.el8.x86_64 4/60 2024-04-25T02:21:58.149 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : thrift-0.13.0-2.el8.x86_64 5/60 2024-04-25T02:21:58.383 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : librgw2-2:17.2.7-902.gc61472c8.el8.x86_64 6/60 2024-04-25T02:21:58.454 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: librgw2-2:17.2.7-902.gc61472c8.el8.x86_64 6/60 2024-04-25T02:21:58.808 INFO:teuthology.orchestra.run.smithi111.stdout: Installing : libcephsqlite-2:17.2.7-902.gc61472c8.el8.x86_64 7/60 2024-04-25T02:21:58.904 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: libcephsqlite-2:17.2.7-902.gc61472c8.el8.x86_64 7/60 2024-04-25T02:21:59.091 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : libradosstriper1-2:17.2.7-902.gc61472c8.el8.x86_64 8/60 2024-04-25T02:21:59.156 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: libradosstriper1-2:17.2.7-902.gc61472c8.el8.x86_64 8/60 2024-04-25T02:21:59.362 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : python3-ceph-argparse-2:17.2.7-902.gc61472c8.el8.x 9/60 2024-04-25T02:21:59.606 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : python3-cephfs-2:17.2.7-902.gc61472c8.el8.x86_64 10/60 2024-04-25T02:21:59.844 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : python3-rgw-2:17.2.7-902.gc61472c8.el8.x86_64 11/60 2024-04-25T02:22:00.106 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : python3-rbd-2:17.2.7-902.gc61472c8.el8.x86_64 12/60 2024-04-25T02:22:00.415 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : librados-devel-2:17.2.7-902.gc61472c8.el8.x86_64 13/60 2024-04-25T02:22:00.700 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : ceph-mgr-modules-core-2:17.2.7-902.gc61472c8.el8.n 14/60 2024-04-25T02:22:00.908 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : python3-ceph-common-2:17.2.7-902.gc61472c8.el8.x86 15/60 2024-04-25T02:22:03.223 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-common-2:17.2.7-902.gc61472c8.el8.x86_64 16/60 2024-04-25T02:22:03.499 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : ceph-common-2:17.2.7-902.gc61472c8.el8.x86_64 16/60 2024-04-25T02:22:04.131 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-common-2:17.2.7-902.gc61472c8.el8.x86_64 16/60 2024-04-25T02:22:04.421 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : ceph-base-2:17.2.7-902.gc61472c8.el8.x86_64 17/60 2024-04-25T02:22:04.516 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-base-2:17.2.7-902.gc61472c8.el8.x86_64 17/60 2024-04-25T02:22:04.690 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : ceph-selinux-2:17.2.7-902.gc61472c8.el8.x86_64 18/60 2024-04-25T02:22:23.245 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-selinux-2:17.2.7-902.gc61472c8.el8.x86_64 18/60 2024-04-25T02:22:23.504 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : ceph-mds-2:17.2.7-902.gc61472c8.el8.x86_64 19/60 2024-04-25T02:22:23.655 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-mds-2:17.2.7-902.gc61472c8.el8.x86_64 19/60 2024-04-25T02:22:23.926 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : ceph-mgr-2:17.2.7-902.gc61472c8.el8.x86_64 20/60 2024-04-25T02:22:24.324 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-mgr-2:17.2.7-902.gc61472c8.el8.x86_64 20/60 2024-04-25T02:22:24.587 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : ceph-mon-2:17.2.7-902.gc61472c8.el8.x86_64 21/60 2024-04-25T02:22:26.365 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-mon-2:17.2.7-902.gc61472c8.el8.x86_64 21/60 2024-04-25T02:22:26.618 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : ceph-osd-2:17.2.7-902.gc61472c8.el8.x86_64 22/60 2024-04-25T02:22:26.628 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-osd-2:17.2.7-902.gc61472c8.el8.x86_64 22/60 2024-04-25T02:22:28.549 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : ceph-2:17.2.7-902.gc61472c8.el8.x86_64 23/60 2024-04-25T02:22:28.835 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : ceph-radosgw-2:17.2.7-902.gc61472c8.el8.x86_64 24/60 2024-04-25T02:22:28.898 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-902.gc61472c8.el8.x86_64 24/60 2024-04-25T02:22:29.162 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : ceph-immutable-object-cache-2:17.2.7-902.gc61472c8 25/60 2024-04-25T02:22:29.565 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-902.gc61472c8 25/60 2024-04-25T02:22:29.820 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : rbd-mirror-2:17.2.7-902.gc61472c8.el8.x86_64 26/60 2024-04-25T02:22:35.485 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: rbd-mirror-2:17.2.7-902.gc61472c8.el8.x86_64 26/60 2024-04-25T02:22:35.789 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : ceph-test-2:17.2.7-902.gc61472c8.el8.x86_64 27/60 2024-04-25T02:22:35.985 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : libcephfs-devel-2:17.2.7-902.gc61472c8.el8.x86_64 28/60 2024-04-25T02:22:36.230 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : rbd-fuse-2:17.2.7-902.gc61472c8.el8.x86_64 29/60 2024-04-25T02:22:36.522 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : rbd-nbd-2:17.2.7-902.gc61472c8.el8.x86_64 30/60 2024-04-25T02:22:36.765 INFO:teuthology.orchestra.run.smithi111.stdout: Upgrading : ceph-fuse-2:17.2.7-902.gc61472c8.el8.x86_64 31/60 2024-04-25T02:22:36.869 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : ceph-2:15.2.17-0.el8.x86_64 32/60 2024-04-25T02:22:37.070 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : ceph-test-2:15.2.17-0.el8.x86_64 33/60 2024-04-25T02:22:37.077 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-radosgw-2:15.2.17-0.el8.x86_64 34/60 2024-04-25T02:22:37.077 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : ceph-radosgw-2:15.2.17-0.el8.x86_64 34/60 2024-04-25T02:22:37.317 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-radosgw-2:15.2.17-0.el8.x86_64 34/60 2024-04-25T02:22:37.503 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : rbd-nbd-2:15.2.17-0.el8.x86_64 35/60 2024-04-25T02:22:37.509 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: rbd-mirror-2:15.2.17-0.el8.x86_64 36/60 2024-04-25T02:22:37.510 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : rbd-mirror-2:15.2.17-0.el8.x86_64 36/60 2024-04-25T02:22:37.687 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: rbd-mirror-2:15.2.17-0.el8.x86_64 36/60 2024-04-25T02:22:37.853 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : rbd-fuse-2:15.2.17-0.el8.x86_64 37/60 2024-04-25T02:22:37.859 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 38/60 2024-04-25T02:22:37.860 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 38/60 2024-04-25T02:22:38.045 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 38/60 2024-04-25T02:22:38.186 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : libcephfs-devel-2:15.2.17-0.el8.x86_64 39/60 2024-04-25T02:22:38.336 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : librados-devel-2:15.2.17-0.el8.x86_64 40/60 2024-04-25T02:22:38.343 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-mgr-2:15.2.17-0.el8.x86_64 41/60 2024-04-25T02:22:38.343 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : ceph-mgr-2:15.2.17-0.el8.x86_64 41/60 2024-04-25T02:22:38.509 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-mgr-2:15.2.17-0.el8.x86_64 41/60 2024-04-25T02:22:38.516 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-osd-2:15.2.17-0.el8.x86_64 42/60 2024-04-25T02:22:38.517 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : ceph-osd-2:15.2.17-0.el8.x86_64 42/60 2024-04-25T02:22:38.837 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-osd-2:15.2.17-0.el8.x86_64 42/60 2024-04-25T02:22:38.842 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-mds-2:15.2.17-0.el8.x86_64 43/60 2024-04-25T02:22:38.842 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : ceph-mds-2:15.2.17-0.el8.x86_64 43/60 2024-04-25T02:22:39.028 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-mds-2:15.2.17-0.el8.x86_64 43/60 2024-04-25T02:22:39.034 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-mon-2:15.2.17-0.el8.x86_64 44/60 2024-04-25T02:22:39.034 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : ceph-mon-2:15.2.17-0.el8.x86_64 44/60 2024-04-25T02:22:39.253 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-mon-2:15.2.17-0.el8.x86_64 44/60 2024-04-25T02:22:39.253 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : ceph-selinux-2:15.2.17-0.el8.x86_64 45/60 2024-04-25T02:22:39.404 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-selinux-2:15.2.17-0.el8.x86_64 45/60 2024-04-25T02:22:39.429 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-base-2:15.2.17-0.el8.x86_64 46/60 2024-04-25T02:22:39.430 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : ceph-base-2:15.2.17-0.el8.x86_64 46/60 2024-04-25T02:22:39.720 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-base-2:15.2.17-0.el8.x86_64 46/60 2024-04-25T02:22:39.720 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : ceph-common-2:15.2.17-0.el8.x86_64 47/60 2024-04-25T02:22:39.945 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: ceph-common-2:15.2.17-0.el8.x86_64 47/60 2024-04-25T02:22:39.945 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : libradosstriper1-2:15.2.17-0.el8.x86_64 48/60 2024-04-25T02:22:40.161 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: libradosstriper1-2:15.2.17-0.el8.x86_64 48/60 2024-04-25T02:22:40.336 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : python3-cephfs-2:15.2.17-0.el8.x86_64 49/60 2024-04-25T02:22:40.544 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : python3-rbd-2:15.2.17-0.el8.x86_64 50/60 2024-04-25T02:22:40.544 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : librbd1-2:15.2.17-0.el8.x86_64 51/60 2024-04-25T02:22:40.770 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: librbd1-2:15.2.17-0.el8.x86_64 51/60 2024-04-25T02:22:40.928 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : python3-rgw-2:15.2.17-0.el8.x86_64 52/60 2024-04-25T02:22:40.928 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : librgw2-2:15.2.17-0.el8.x86_64 53/60 2024-04-25T02:22:41.178 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: librgw2-2:15.2.17-0.el8.x86_64 53/60 2024-04-25T02:22:41.377 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : python3-rados-2:15.2.17-0.el8.x86_64 54/60 2024-04-25T02:22:41.378 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : libcephfs2-2:15.2.17-0.el8.x86_64 55/60 2024-04-25T02:22:41.587 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: libcephfs2-2:15.2.17-0.el8.x86_64 55/60 2024-04-25T02:22:41.752 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : ceph-fuse-2:15.2.17-0.el8.x86_64 56/60 2024-04-25T02:22:41.895 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : python3-ceph-argparse-2:15.2.17-0.el8.x86_64 57/60 2024-04-25T02:22:42.080 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : python3-ceph-common-2:15.2.17-0.el8.x86_64 58/60 2024-04-25T02:22:42.266 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 59/60 2024-04-25T02:22:42.266 INFO:teuthology.orchestra.run.smithi111.stdout: Cleanup : librados2-2:15.2.17-0.el8.x86_64 60/60 2024-04-25T02:22:43.046 INFO:teuthology.orchestra.run.smithi111.stdout: Running scriptlet: librados2-2:15.2.17-0.el8.x86_64 60/60 2024-04-25T02:22:43.047 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libcephsqlite-2:17.2.7-902.gc61472c8.el8.x86_64 1/60 2024-04-25T02:22:43.047 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 2/60 2024-04-25T02:22:43.047 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-2:17.2.7-902.gc61472c8.el8.x86_64 3/60 2024-04-25T02:22:43.047 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-2:15.2.17-0.el8.x86_64 4/60 2024-04-25T02:22:43.047 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-base-2:17.2.7-902.gc61472c8.el8.x86_64 5/60 2024-04-25T02:22:43.047 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-base-2:15.2.17-0.el8.x86_64 6/60 2024-04-25T02:22:43.047 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-common-2:17.2.7-902.gc61472c8.el8.x86_64 7/60 2024-04-25T02:22:43.047 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-common-2:15.2.17-0.el8.x86_64 8/60 2024-04-25T02:22:43.047 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-fuse-2:17.2.7-902.gc61472c8.el8.x86_64 9/60 2024-04-25T02:22:43.047 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-fuse-2:15.2.17-0.el8.x86_64 10/60 2024-04-25T02:22:43.047 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-902.gc61472c8 11/60 2024-04-25T02:22:43.047 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 12/60 2024-04-25T02:22:43.047 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mds-2:17.2.7-902.gc61472c8.el8.x86_64 13/60 2024-04-25T02:22:43.048 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mds-2:15.2.17-0.el8.x86_64 14/60 2024-04-25T02:22:43.048 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mgr-2:17.2.7-902.gc61472c8.el8.x86_64 15/60 2024-04-25T02:22:43.048 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mgr-2:15.2.17-0.el8.x86_64 16/60 2024-04-25T02:22:43.048 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mon-2:17.2.7-902.gc61472c8.el8.x86_64 17/60 2024-04-25T02:22:43.048 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mon-2:15.2.17-0.el8.x86_64 18/60 2024-04-25T02:22:43.048 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-osd-2:17.2.7-902.gc61472c8.el8.x86_64 19/60 2024-04-25T02:22:43.048 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-osd-2:15.2.17-0.el8.x86_64 20/60 2024-04-25T02:22:43.048 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-radosgw-2:17.2.7-902.gc61472c8.el8.x86_64 21/60 2024-04-25T02:22:43.048 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-radosgw-2:15.2.17-0.el8.x86_64 22/60 2024-04-25T02:22:43.048 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-selinux-2:17.2.7-902.gc61472c8.el8.x86_64 23/60 2024-04-25T02:22:43.048 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-selinux-2:15.2.17-0.el8.x86_64 24/60 2024-04-25T02:22:43.048 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-test-2:17.2.7-902.gc61472c8.el8.x86_64 25/60 2024-04-25T02:22:43.048 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-test-2:15.2.17-0.el8.x86_64 26/60 2024-04-25T02:22:43.049 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libcephfs-devel-2:17.2.7-902.gc61472c8.el8.x86_64 27/60 2024-04-25T02:22:43.049 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libcephfs-devel-2:15.2.17-0.el8.x86_64 28/60 2024-04-25T02:22:43.049 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libcephfs2-2:17.2.7-902.gc61472c8.el8.x86_64 29/60 2024-04-25T02:22:43.049 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libcephfs2-2:15.2.17-0.el8.x86_64 30/60 2024-04-25T02:22:43.049 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librados-devel-2:17.2.7-902.gc61472c8.el8.x86_64 31/60 2024-04-25T02:22:43.049 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librados-devel-2:15.2.17-0.el8.x86_64 32/60 2024-04-25T02:22:43.049 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librados2-2:17.2.7-902.gc61472c8.el8.x86_64 33/60 2024-04-25T02:22:43.049 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librados2-2:15.2.17-0.el8.x86_64 34/60 2024-04-25T02:22:43.049 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libradosstriper1-2:17.2.7-902.gc61472c8.el8.x86_64 35/60 2024-04-25T02:22:43.049 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : libradosstriper1-2:15.2.17-0.el8.x86_64 36/60 2024-04-25T02:22:43.049 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librbd1-2:17.2.7-902.gc61472c8.el8.x86_64 37/60 2024-04-25T02:22:43.049 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librbd1-2:15.2.17-0.el8.x86_64 38/60 2024-04-25T02:22:43.050 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librgw2-2:17.2.7-902.gc61472c8.el8.x86_64 39/60 2024-04-25T02:22:43.050 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : librgw2-2:15.2.17-0.el8.x86_64 40/60 2024-04-25T02:22:43.050 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-ceph-argparse-2:17.2.7-902.gc61472c8.el8.x 41/60 2024-04-25T02:22:43.050 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-ceph-argparse-2:15.2.17-0.el8.x86_64 42/60 2024-04-25T02:22:43.050 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-ceph-common-2:17.2.7-902.gc61472c8.el8.x86 43/60 2024-04-25T02:22:43.050 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-ceph-common-2:15.2.17-0.el8.x86_64 44/60 2024-04-25T02:22:43.050 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-cephfs-2:17.2.7-902.gc61472c8.el8.x86_64 45/60 2024-04-25T02:22:43.050 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-cephfs-2:15.2.17-0.el8.x86_64 46/60 2024-04-25T02:22:43.050 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-rados-2:17.2.7-902.gc61472c8.el8.x86_64 47/60 2024-04-25T02:22:43.050 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-rados-2:15.2.17-0.el8.x86_64 48/60 2024-04-25T02:22:43.050 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-rbd-2:17.2.7-902.gc61472c8.el8.x86_64 49/60 2024-04-25T02:22:43.050 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-rbd-2:15.2.17-0.el8.x86_64 50/60 2024-04-25T02:22:43.050 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-rgw-2:17.2.7-902.gc61472c8.el8.x86_64 51/60 2024-04-25T02:22:43.050 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : python3-rgw-2:15.2.17-0.el8.x86_64 52/60 2024-04-25T02:22:43.051 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : rbd-fuse-2:17.2.7-902.gc61472c8.el8.x86_64 53/60 2024-04-25T02:22:43.051 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : rbd-fuse-2:15.2.17-0.el8.x86_64 54/60 2024-04-25T02:22:43.051 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : rbd-mirror-2:17.2.7-902.gc61472c8.el8.x86_64 55/60 2024-04-25T02:22:43.051 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : rbd-mirror-2:15.2.17-0.el8.x86_64 56/60 2024-04-25T02:22:43.051 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : rbd-nbd-2:17.2.7-902.gc61472c8.el8.x86_64 57/60 2024-04-25T02:22:43.051 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : rbd-nbd-2:15.2.17-0.el8.x86_64 58/60 2024-04-25T02:22:43.051 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-902.gc61472c8.el8.n 59/60 2024-04-25T02:22:44.332 INFO:teuthology.orchestra.run.smithi111.stdout: Verifying : ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 60/60 2024-04-25T02:22:44.333 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:22:44.333 INFO:teuthology.orchestra.run.smithi111.stdout:Upgraded: 2024-04-25T02:22:44.333 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:22:44.333 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-base-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:22:44.333 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-common-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:22:44.333 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-fuse-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:22:44.333 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-immutable-object-cache-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:22:44.333 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mds-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:22:44.333 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:22:44.333 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mgr-modules-core-2:17.2.7-902.gc61472c8.el8.noarch 2024-04-25T02:22:44.333 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-mon-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:22:44.334 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-osd-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:22:44.334 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-radosgw-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:22:44.334 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-selinux-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:22:44.334 INFO:teuthology.orchestra.run.smithi111.stdout: ceph-test-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:22:44.334 INFO:teuthology.orchestra.run.smithi111.stdout: libcephfs-devel-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:22:44.334 INFO:teuthology.orchestra.run.smithi111.stdout: libcephfs2-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:22:44.334 INFO:teuthology.orchestra.run.smithi111.stdout: librados-devel-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:22:44.334 INFO:teuthology.orchestra.run.smithi111.stdout: librados2-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:22:44.335 INFO:teuthology.orchestra.run.smithi111.stdout: libradosstriper1-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:22:44.335 INFO:teuthology.orchestra.run.smithi111.stdout: librbd1-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:22:44.335 INFO:teuthology.orchestra.run.smithi111.stdout: librgw2-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:22:44.335 INFO:teuthology.orchestra.run.smithi111.stdout: python3-ceph-argparse-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:22:44.335 INFO:teuthology.orchestra.run.smithi111.stdout: python3-ceph-common-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:22:44.335 INFO:teuthology.orchestra.run.smithi111.stdout: python3-cephfs-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:22:44.335 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rados-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:22:44.335 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rbd-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:22:44.335 INFO:teuthology.orchestra.run.smithi111.stdout: python3-rgw-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:22:44.335 INFO:teuthology.orchestra.run.smithi111.stdout: rbd-fuse-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:22:44.335 INFO:teuthology.orchestra.run.smithi111.stdout: rbd-mirror-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:22:44.335 INFO:teuthology.orchestra.run.smithi111.stdout: rbd-nbd-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:22:44.335 INFO:teuthology.orchestra.run.smithi111.stdout:Installed: 2024-04-25T02:22:44.335 INFO:teuthology.orchestra.run.smithi111.stdout: libcephsqlite-2:17.2.7-902.gc61472c8.el8.x86_64 thrift-0.13.0-2.el8.x86_64 2024-04-25T02:22:44.336 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:22:44.336 INFO:teuthology.orchestra.run.smithi111.stdout:Complete! 2024-04-25T02:22:44.487 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2024-04-25T02:22:44.710 DEBUG:teuthology.orchestra.run.smithi111:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T02:22:44.734 INFO:teuthology.orchestra.run.smithi111.stdout:17.2.7-902.gc61472c8.el8 2024-04-25T02:22:44.734 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-902.gc61472c8.el8 2024-04-25T02:22:44.734 INFO:teuthology.task.install:The correct ceph version 17.2.7-902.gc61472c8 is installed. 2024-04-25T02:22:44.737 INFO:teuthology.run_tasks:Running task print... 2024-04-25T02:22:44.748 INFO:teuthology.task.print:**** done install.upgrade the host 2024-04-25T02:22:44.749 INFO:teuthology.run_tasks:Running task ceph.restart... 2024-04-25T02:22:44.762 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-25T02:22:44.762 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:22:44.785 INFO:tasks.ceph.mon.a:Stopped 2024-04-25T02:22:44.786 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-25T02:22:44.786 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-25T02:22:44.828 INFO:tasks.ceph.mon.a:Started 2024-04-25T02:22:44.829 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-25T02:22:44.829 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:22:44.840 INFO:tasks.ceph.mon.b:Stopped 2024-04-25T02:22:44.840 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-25T02:22:44.841 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-25T02:22:44.884 INFO:tasks.ceph.mon.b:Started 2024-04-25T02:22:44.884 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-25T02:22:44.884 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:22:44.897 INFO:tasks.ceph.mon.c:Stopped 2024-04-25T02:22:44.897 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-25T02:22:44.897 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-25T02:22:44.940 INFO:tasks.ceph.mon.c:Started 2024-04-25T02:22:44.941 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-25T02:22:44.941 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:22:44.956 INFO:tasks.ceph.mgr.x:Stopped 2024-04-25T02:22:44.956 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-25T02:22:44.957 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-25T02:22:45.000 INFO:tasks.ceph.mgr.x:Started 2024-04-25T02:22:45.000 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-25T02:22:45.000 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:22:45.018 INFO:tasks.ceph.mgr.y:Stopped 2024-04-25T02:22:45.019 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-25T02:22:45.019 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-25T02:22:45.062 INFO:tasks.ceph.mgr.y:Started 2024-04-25T02:22:45.062 INFO:teuthology.run_tasks:Running task ceph.healthy... 2024-04-25T02:22:45.355 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-25T02:22:45.355 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-25T02:22:45.355 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-25T02:22:45.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:45.469+0000 7f661040e700 1 Processor -- start 2024-04-25T02:22:45.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:45.469+0000 7f661040e700 1 -- start start 2024-04-25T02:22:45.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:45.470+0000 7f661040e700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f66080b4fd0 0x7f66080a2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:45.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:45.470+0000 7f661040e700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f660813f110 0x7f66080a3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:45.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:45.470+0000 7f661040e700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66080a46d0 con 0x7f66080a3980 2024-04-25T02:22:45.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:45.470+0000 7f661040e700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66080a6710 con 0x7f66080b4fd0 2024-04-25T02:22:45.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:45.470+0000 7f661040e700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66080a4930 con 0x7f660813f110 2024-04-25T02:22:45.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:45.470+0000 7f660e1aa700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f66080b4fd0 0x7f66080a2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:45.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:45.470+0000 7f660e9ab700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f660813f110 0x7f66080a3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:45.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:45.470+0000 7f660e1aa700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f66080b4fd0 0x7f66080a2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:58710/0 (socket says 172.21.15.111:58710) 2024-04-25T02:22:45.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:45.470+0000 7f660d9a9700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f66080a3980 0x7f660813ea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:55110/0 (socket says 172.21.15.111:55110) 2024-04-25T02:22:45.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:45.470+0000 7f660e9ab700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f660813f110 0x7f66080a3d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:42696/0 (socket says 172.21.15.111:42696) 2024-04-25T02:22:45.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:45.470+0000 7f660e1aa700 1 -- 172.21.15.111:0/2155507391 learned_addr learned my addr 172.21.15.111:0/2155507391 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:22:45.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:45.470+0000 7f660e1aa700 1 -- 172.21.15.111:0/2155507391 >> v2:172.21.15.111:3300/0 conn(0x7f66080b4fd0 msgr2=0x7f66080a2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T02:22:45.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:45.470+0000 7f660e9ab700 1 -- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f660813f110 msgr2=0x7f66080a3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T02:22:45.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:45.470+0000 7f660e1aa700 1 -- 172.21.15.111:0/2155507391 >> v2:172.21.15.111:3300/0 conn(0x7f66080b4fd0 msgr2=0x7f66080a2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T02:22:45.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:45.470+0000 7f660e9ab700 1 -- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f660813f110 msgr2=0x7f66080a3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T02:22:45.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:45.470+0000 7f660e9ab700 1 --2- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f660813f110 0x7f66080a3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-25T02:22:45.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:45.470+0000 7f660e1aa700 1 --2- 172.21.15.111:0/2155507391 >> v2:172.21.15.111:3300/0 conn(0x7f66080b4fd0 0x7f66080a2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-25T02:22:45.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:45.470+0000 7f660e1aa700 1 --2- 172.21.15.111:0/2155507391 >> v2:172.21.15.111:3300/0 conn(0x7f66080b4fd0 0x7f66080a2560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T02:22:45.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:45.470+0000 7f660e9ab700 1 --2- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f660813f110 0x7f66080a3d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T02:22:45.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:45.671+0000 7f660e9ab700 1 --2- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f660813f110 0x7f66080a3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:45.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:45.671+0000 7f660e1aa700 1 --2- 172.21.15.111:0/2155507391 >> v2:172.21.15.111:3300/0 conn(0x7f66080b4fd0 0x7f66080a2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:45.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:45.671+0000 7f660e9ab700 1 -- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f660813f110 msgr2=0x7f66080a3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T02:22:45.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:45.671+0000 7f660e9ab700 1 -- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f660813f110 msgr2=0x7f66080a3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T02:22:45.675 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:45.671+0000 7f660e9ab700 1 --2- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f660813f110 0x7f66080a3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-25T02:22:45.675 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:45.671+0000 7f660e1aa700 1 -- 172.21.15.111:0/2155507391 >> v2:172.21.15.111:3300/0 conn(0x7f66080b4fd0 msgr2=0x7f66080a2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T02:22:45.675 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:45.671+0000 7f660e9ab700 1 --2- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f660813f110 0x7f66080a3d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T02:22:45.675 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:45.671+0000 7f660e1aa700 1 -- 172.21.15.111:0/2155507391 >> v2:172.21.15.111:3300/0 conn(0x7f66080b4fd0 msgr2=0x7f66080a2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T02:22:45.675 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:45.671+0000 7f660e1aa700 1 --2- 172.21.15.111:0/2155507391 >> v2:172.21.15.111:3300/0 conn(0x7f66080b4fd0 0x7f66080a2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-25T02:22:45.675 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:45.671+0000 7f660e1aa700 1 --2- 172.21.15.111:0/2155507391 >> v2:172.21.15.111:3300/0 conn(0x7f66080b4fd0 0x7f66080a2560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T02:22:46.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:46.072+0000 7f660e1aa700 1 --2- 172.21.15.111:0/2155507391 >> v2:172.21.15.111:3300/0 conn(0x7f66080b4fd0 0x7f66080a2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:46.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:46.072+0000 7f660e9ab700 1 --2- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f660813f110 0x7f66080a3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:46.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:46.072+0000 7f660e1aa700 1 -- 172.21.15.111:0/2155507391 >> v2:172.21.15.111:3300/0 conn(0x7f66080b4fd0 msgr2=0x7f66080a2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T02:22:46.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:46.072+0000 7f660e1aa700 1 -- 172.21.15.111:0/2155507391 >> v2:172.21.15.111:3300/0 conn(0x7f66080b4fd0 msgr2=0x7f66080a2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T02:22:46.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:46.072+0000 7f660e9ab700 1 -- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f660813f110 msgr2=0x7f66080a3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T02:22:46.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:46.072+0000 7f660e9ab700 1 -- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f660813f110 msgr2=0x7f66080a3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T02:22:46.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:46.072+0000 7f660e1aa700 1 --2- 172.21.15.111:0/2155507391 >> v2:172.21.15.111:3300/0 conn(0x7f66080b4fd0 0x7f66080a2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-25T02:22:46.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:46.072+0000 7f660e9ab700 1 --2- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f660813f110 0x7f66080a3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-25T02:22:46.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:46.072+0000 7f660e9ab700 1 --2- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f660813f110 0x7f66080a3d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T02:22:46.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:46.072+0000 7f660e1aa700 1 --2- 172.21.15.111:0/2155507391 >> v2:172.21.15.111:3300/0 conn(0x7f66080b4fd0 0x7f66080a2560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T02:22:46.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:46.873+0000 7f660e1aa700 1 --2- 172.21.15.111:0/2155507391 >> v2:172.21.15.111:3300/0 conn(0x7f66080b4fd0 0x7f66080a2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:46.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:46.873+0000 7f660e9ab700 1 --2- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f660813f110 0x7f66080a3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:46.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:46.873+0000 7f660e9ab700 1 -- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f660813f110 msgr2=0x7f66080a3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-25T02:22:46.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:46.873+0000 7f660e9ab700 1 -- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f660813f110 msgr2=0x7f66080a3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T02:22:46.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:46.873+0000 7f660e1aa700 1 -- 172.21.15.111:0/2155507391 >> v2:172.21.15.111:3300/0 conn(0x7f66080b4fd0 msgr2=0x7f66080a2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T02:22:46.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:46.873+0000 7f660e1aa700 1 -- 172.21.15.111:0/2155507391 >> v2:172.21.15.111:3300/0 conn(0x7f66080b4fd0 msgr2=0x7f66080a2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T02:22:46.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:46.873+0000 7f660e9ab700 1 --2- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f660813f110 0x7f66080a3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-25T02:22:46.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:46.873+0000 7f660e1aa700 1 --2- 172.21.15.111:0/2155507391 >> v2:172.21.15.111:3300/0 conn(0x7f66080b4fd0 0x7f66080a2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-25T02:22:46.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:46.873+0000 7f660e1aa700 1 --2- 172.21.15.111:0/2155507391 >> v2:172.21.15.111:3300/0 conn(0x7f66080b4fd0 0x7f66080a2560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T02:22:46.877 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:46.873+0000 7f660e9ab700 1 --2- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f660813f110 0x7f66080a3d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T02:22:48.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:48.470+0000 7f65fffff700 1 -- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f660813f110 msgr2=0x7f66080a3d80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T02:22:48.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:48.470+0000 7f65fffff700 1 --2- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f660813f110 0x7f66080a3d80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:48.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:48.470+0000 7f65fffff700 1 -- 172.21.15.111:0/2155507391 >> v2:172.21.15.111:3300/0 conn(0x7f66080b4fd0 msgr2=0x7f66080a2560 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T02:22:48.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:48.470+0000 7f65fffff700 1 --2- 172.21.15.111:0/2155507391 >> v2:172.21.15.111:3300/0 conn(0x7f66080b4fd0 0x7f66080a2560 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:48.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:48.470+0000 7f65fffff700 1 -- 172.21.15.111:0/2155507391 >> v1:172.21.15.111:6789/0 conn(0x7f66080a3980 legacy=0x7f660813ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:48.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:48.470+0000 7f65fffff700 1 --2- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f65ec0036c0 0x7f65ec005b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:48.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:48.470+0000 7f65fffff700 1 -- 172.21.15.111:0/2155507391 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66080a6710 con 0x7f65ec0036c0 2024-04-25T02:22:48.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:48.470+0000 7f660e1aa700 1 --2- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f65ec0036c0 0x7f65ec005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:48.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:48.470+0000 7f660e1aa700 1 -- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f65ec0036c0 msgr2=0x7f65ec005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T02:22:48.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:48.470+0000 7f660e1aa700 1 -- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f65ec0036c0 msgr2=0x7f65ec005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T02:22:48.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:48.470+0000 7f660e1aa700 1 --2- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f65ec0036c0 0x7f65ec005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-25T02:22:48.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:48.470+0000 7f660e1aa700 1 --2- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f65ec0036c0 0x7f65ec005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-25T02:22:48.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:48.671+0000 7f660e1aa700 1 --2- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f65ec0036c0 0x7f65ec005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:48.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:48.671+0000 7f660e1aa700 1 -- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f65ec0036c0 msgr2=0x7f65ec005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T02:22:48.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:48.671+0000 7f660e1aa700 1 -- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f65ec0036c0 msgr2=0x7f65ec005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T02:22:48.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:48.671+0000 7f660e1aa700 1 --2- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f65ec0036c0 0x7f65ec005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-25T02:22:48.675 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:48.671+0000 7f660e1aa700 1 --2- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f65ec0036c0 0x7f65ec005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-25T02:22:49.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:49.072+0000 7f660e1aa700 1 --2- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f65ec0036c0 0x7f65ec005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:49.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:49.072+0000 7f660e1aa700 1 -- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f65ec0036c0 msgr2=0x7f65ec005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T02:22:49.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:49.072+0000 7f660e1aa700 1 -- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f65ec0036c0 msgr2=0x7f65ec005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T02:22:49.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:49.072+0000 7f660e1aa700 1 --2- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f65ec0036c0 0x7f65ec005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-25T02:22:49.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:49.072+0000 7f660e1aa700 1 --2- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f65ec0036c0 0x7f65ec005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-04-25T02:22:49.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:49.873+0000 7f660e1aa700 1 --2- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f65ec0036c0 0x7f65ec005b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:49.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:49.873+0000 7f660e1aa700 1 -- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f65ec0036c0 msgr2=0x7f65ec005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-25T02:22:49.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:49.873+0000 7f660e1aa700 1 -- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f65ec0036c0 msgr2=0x7f65ec005b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-25T02:22:49.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:49.873+0000 7f660e1aa700 1 --2- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f65ec0036c0 0x7f65ec005b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-04-25T02:22:49.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:49.873+0000 7f660e1aa700 1 --2- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f65ec0036c0 0x7f65ec005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-04-25T02:22:51.206 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-04-25T02:22:51.204+0000 7f5e56aad1c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T02:22:51.242 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-25T02:22:51.239+0000 7f1f561191c0 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-25T02:22:51.462 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-04-25T02:22:51.459+0000 7f5e56aad1c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T02:22:51.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.470+0000 7f65fffff700 1 -- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f65ec0036c0 msgr2=0x7f65ec005b40 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T02:22:51.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.470+0000 7f65fffff700 1 --2- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f65ec0036c0 0x7f65ec005b40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:51.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.470+0000 7f65fffff700 1 --2- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f660813f110 0x7f65ec00bac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:51.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.470+0000 7f65fffff700 1 --2- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f65ec0036c0 0x7f65ec00c070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:51.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.470+0000 7f65fffff700 1 -- 172.21.15.111:0/2155507391 --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66080a31a0 con 0x7f66080a3980 2024-04-25T02:22:51.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.470+0000 7f65fffff700 1 -- 172.21.15.111:0/2155507391 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66080a6710 con 0x7f660813f110 2024-04-25T02:22:51.476 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.470+0000 7f65fffff700 1 -- 172.21.15.111:0/2155507391 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f66080a4930 con 0x7f65ec0036c0 2024-04-25T02:22:51.476 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.470+0000 7f660e9ab700 1 --2- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f65ec0036c0 0x7f65ec00c070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:51.476 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.470+0000 7f660d9a9700 1 --2- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f660813f110 0x7f65ec00bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:51.476 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.471+0000 7f660d1a8700 1 -- 172.21.15.111:0/2155507391 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3568705989 0 0) 0x7f66080a31a0 con 0x7f66080a3980 2024-04-25T02:22:51.476 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.471+0000 7f660d1a8700 1 -- 172.21.15.111:0/2155507391 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f65f4003570 con 0x7f66080a3980 2024-04-25T02:22:51.476 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.471+0000 7f660e9ab700 1 -- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f660813f110 msgr2=0x7f65ec00bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:22:51.476 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.471+0000 7f660e9ab700 1 --2- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f660813f110 0x7f65ec00bac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:51.476 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.471+0000 7f660e9ab700 1 -- 172.21.15.111:0/2155507391 >> v1:172.21.15.111:6789/0 conn(0x7f66080a3980 legacy=0x7f65ec008370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:51.476 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.471+0000 7f660e9ab700 1 -- 172.21.15.111:0/2155507391 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65ec005c90 con 0x7f65ec0036c0 2024-04-25T02:22:51.476 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.471+0000 7f660d9a9700 1 --2- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f660813f110 0x7f65ec00bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:22:51.476 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.471+0000 7f660e9ab700 1 --2- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f65ec0036c0 0x7f65ec00c070 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6600009f00 tx=0x7f660000b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8cac2045be47406d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:51.476 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.471+0000 7f660d1a8700 1 -- 172.21.15.111:0/2155507391 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6600007df0 con 0x7f65ec0036c0 2024-04-25T02:22:51.476 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.471+0000 7f660d1a8700 1 -- 172.21.15.111:0/2155507391 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6600017470 con 0x7f65ec0036c0 2024-04-25T02:22:51.477 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.471+0000 7f660d1a8700 1 -- 172.21.15.111:0/2155507391 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6600017830 con 0x7f65ec0036c0 2024-04-25T02:22:51.477 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.472+0000 7f661040e700 1 -- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f65ec0036c0 msgr2=0x7f65ec00c070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:51.477 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.472+0000 7f661040e700 1 --2- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f65ec0036c0 0x7f65ec00c070 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6600009f00 tx=0x7f660000b040 comp rx=0 tx=0).stop 2024-04-25T02:22:51.477 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.472+0000 7f661040e700 1 -- 172.21.15.111:0/2155507391 shutdown_connections 2024-04-25T02:22:51.477 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.472+0000 7f661040e700 1 --2- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f65ec0036c0 0x7f65ec00c070 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:51.477 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.472+0000 7f661040e700 1 --2- 172.21.15.111:0/2155507391 >> v2:172.21.15.111:3300/0 conn(0x7f66080b4fd0 0x7f66080a2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:51.477 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.472+0000 7f661040e700 1 --2- 172.21.15.111:0/2155507391 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f660813f110 0x7f65ec00bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:51.477 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.472+0000 7f661040e700 1 -- 172.21.15.111:0/2155507391 >> 172.21.15.111:0/2155507391 conn(0x7f66080883e0 msgr2=0x7f6608068b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:51.477 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.472+0000 7f661040e700 1 -- 172.21.15.111:0/2155507391 shutdown_connections 2024-04-25T02:22:51.477 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.472+0000 7f661040e700 1 -- 172.21.15.111:0/2155507391 wait complete. 2024-04-25T02:22:51.480 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.473+0000 7f661040e700 1 Processor -- start 2024-04-25T02:22:51.480 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.473+0000 7f661040e700 1 -- start start 2024-04-25T02:22:51.480 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.474+0000 7f661040e700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f65ec0036c0 0x7f660809c6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:51.480 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.474+0000 7f661040e700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f66080a3980 0x7f660809d5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:51.480 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.474+0000 7f661040e700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f66080b4fd0 0x7f66081513a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:51.480 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.474+0000 7f661040e700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f660809d0b0 con 0x7f66080a3980 2024-04-25T02:22:51.480 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.474+0000 7f661040e700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f660809f680 con 0x7f65ec0036c0 2024-04-25T02:22:51.480 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.474+0000 7f661040e700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f660809b7a0 con 0x7f66080b4fd0 2024-04-25T02:22:51.480 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.474+0000 7f660d9a9700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f66080a3980 0x7f660809d5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:51.480 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.474+0000 7f660d9a9700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f66080a3980 0x7f660809d5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:53024/0 (socket says 172.21.15.111:53024) 2024-04-25T02:22:51.480 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.474+0000 7f660e1aa700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f65ec0036c0 0x7f660809c6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:51.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.474+0000 7f660d9a9700 1 -- 172.21.15.111:0/866540788 learned_addr learned my addr 172.21.15.111:0/866540788 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:22:51.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.474+0000 7f660e9ab700 1 --2- 172.21.15.111:0/866540788 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f66080b4fd0 0x7f66081513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:51.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.474+0000 7f660e1aa700 1 -- 172.21.15.111:0/866540788 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f66080b4fd0 msgr2=0x7f66081513a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:51.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.474+0000 7f660e1aa700 1 --2- 172.21.15.111:0/866540788 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f66080b4fd0 0x7f66081513a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:51.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.474+0000 7f660e1aa700 1 -- 172.21.15.111:0/866540788 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f66080a3980 msgr2=0x7f660809d5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:51.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.474+0000 7f660e1aa700 1 --2- 172.21.15.111:0/866540788 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f66080a3980 0x7f660809d5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:51.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.474+0000 7f660e1aa700 1 -- 172.21.15.111:0/866540788 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66080a46d0 con 0x7f65ec0036c0 2024-04-25T02:22:51.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.474+0000 7f660d9a9700 1 --2- 172.21.15.111:0/866540788 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f66080a3980 0x7f660809d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:22:51.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.474+0000 7f660e1aa700 1 --2- 172.21.15.111:0/866540788 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f65ec0036c0 0x7f660809c6e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f65f8009060 tx=0x7f65f8008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:51.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.475+0000 7f65fe7fc700 1 -- 172.21.15.111:0/866540788 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f801e070 con 0x7f65ec0036c0 2024-04-25T02:22:51.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.475+0000 7f65fe7fc700 1 -- 172.21.15.111:0/866540788 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f65f800c040 con 0x7f65ec0036c0 2024-04-25T02:22:51.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.475+0000 7f65fe7fc700 1 -- 172.21.15.111:0/866540788 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65f8016940 con 0x7f65ec0036c0 2024-04-25T02:22:51.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.475+0000 7f661040e700 1 -- 172.21.15.111:0/866540788 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6600009ae0 con 0x7f65ec0036c0 2024-04-25T02:22:51.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.475+0000 7f661040e700 1 -- 172.21.15.111:0/866540788 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f660809ce60 con 0x7f65ec0036c0 2024-04-25T02:22:51.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.476+0000 7f65fe7fc700 1 -- 172.21.15.111:0/866540788 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 6) v1 ==== 42206+0+0 (secure 0 0 0) 0x7f65f8016cf0 con 0x7f65ec0036c0 2024-04-25T02:22:51.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.476+0000 7f65fe7fc700 1 -- 172.21.15.111:0/866540788 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f65f804c760 con 0x7f65ec0036c0 2024-04-25T02:22:51.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.476+0000 7f660d9a9700 1 -- 172.21.15.111:0/866540788 >> v1:172.21.15.111:6816/39585 conn(0x7f65ec039d10 legacy=0x7f65ec03c1c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.111:6816/39585 2024-04-25T02:22:51.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.476+0000 7f661040e700 1 -- 172.21.15.111:0/866540788 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6608065190 con 0x7f65ec0036c0 2024-04-25T02:22:51.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.479+0000 7f65fe7fc700 1 -- 172.21.15.111:0/866540788 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+112002 (secure 0 0 0) 0x7f65f801a040 con 0x7f65ec0036c0 2024-04-25T02:22:51.494 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-25T02:22:51.491+0000 7f1f561191c0 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-25T02:22:51.596 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-04-25T02:22:51.593+0000 7f5e56aad1c0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T02:22:51.608 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-25T02:22:51.605+0000 7f1f561191c0 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-04-25T02:22:51.626 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.623+0000 7f661040e700 1 -- 172.21.15.111:0/866540788 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f6608142710 con 0x7f65ec0036c0 2024-04-25T02:22:51.628 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.625+0000 7f65fe7fc700 1 -- 172.21.15.111:0/866540788 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v6) v1 ==== 74+0+85079 (secure 0 0 0) 0x7f65f80016c0 con 0x7f65ec0036c0 2024-04-25T02:22:51.629 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:22:51.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.626+0000 7f661040e700 1 -- 172.21.15.111:0/866540788 >> v1:172.21.15.111:6816/39585 conn(0x7f65ec039d10 legacy=0x7f65ec03c1c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T02:22:51.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.626+0000 7f661040e700 1 -- 172.21.15.111:0/866540788 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f65ec0036c0 msgr2=0x7f660809c6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:51.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.626+0000 7f661040e700 1 --2- 172.21.15.111:0/866540788 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f65ec0036c0 0x7f660809c6e0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f65f8009060 tx=0x7f65f8008040 comp rx=0 tx=0).stop 2024-04-25T02:22:51.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.626+0000 7f661040e700 1 -- 172.21.15.111:0/866540788 shutdown_connections 2024-04-25T02:22:51.630 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.626+0000 7f661040e700 1 --2- 172.21.15.111:0/866540788 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f66080b4fd0 0x7f66081513a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:51.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.626+0000 7f661040e700 1 --2- 172.21.15.111:0/866540788 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f65ec0036c0 0x7f660809c6e0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:51.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.626+0000 7f661040e700 1 --2- 172.21.15.111:0/866540788 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f66080a3980 0x7f660809d5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:51.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.626+0000 7f661040e700 1 -- 172.21.15.111:0/866540788 >> 172.21.15.111:0/866540788 conn(0x7f66080883e0 msgr2=0x7f66080a2640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:51.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.626+0000 7f661040e700 1 -- 172.21.15.111:0/866540788 shutdown_connections 2024-04-25T02:22:51.631 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.626+0000 7f661040e700 1 -- 172.21.15.111:0/866540788 wait complete. 2024-04-25T02:22:51.641 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":6,"flags":0,"active_gid":4099,"active_name":"y","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6816","nonce":39585}]},"active_addr":"172.21.15.111:6816/39585","active_change":"2024-04-25T02:20:07.430202+0000","active_mgr_features":4540138292840890367,"available":true,"standbys":[{"gid":4113,"name":"x","mgr_features":4540138292840890367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"none","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"None","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"persist_interval":{"name":"persist_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how frequently to persist completed events","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"","addrvec":[{"type":"v2","addr":"172.21.15.111:0","nonce":1276843622}]},{"name":"","addrvec":[{"type":"v2","addr":"172.21.15.111:0","nonce":2148931273}]},{"name":"","addrvec":[{"type":"v2","addr":"172.21.15.111:0","nonce":3911588907}]}]} 2024-04-25T02:22:51.643 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-25T02:22:51.643 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-25T02:22:51.644 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:22:51.763 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.760+0000 7f9aa4378700 1 Processor -- start 2024-04-25T02:22:51.763 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.761+0000 7f9aa4378700 1 -- start start 2024-04-25T02:22:51.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.762+0000 7f9aa4378700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9a9c063a80 0x7f9a9c0a5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:51.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.762+0000 7f9aa4378700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f9a9c0ad100 0x7f9a9c0ad4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:51.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.762+0000 7f9aa4378700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a9c0a60c0 con 0x7f9a9c139300 2024-04-25T02:22:51.766 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.762+0000 7f9aa4378700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a9c13f690 con 0x7f9a9c0ad100 2024-04-25T02:22:51.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.762+0000 7f9aa4378700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9c13f930 con 0x7f9a9c063a80 2024-04-25T02:22:51.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.762+0000 7f9aa1913700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f9a9c0ad100 0x7f9a9c0ad4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:51.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.762+0000 7f9aa2114700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9a9c063a80 0x7f9a9c0a5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:51.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.762+0000 7f9aa1913700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f9a9c0ad100 0x7f9a9c0ad4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:53034/0 (socket says 172.21.15.111:53034) 2024-04-25T02:22:51.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.762+0000 7f9aa2114700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9a9c063a80 0x7f9a9c0a5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:57736/0 (socket says 172.21.15.111:57736) 2024-04-25T02:22:51.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.762+0000 7f9aa1913700 1 -- 172.21.15.111:0/1972081899 learned_addr learned my addr 172.21.15.111:0/1972081899 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:22:51.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.762+0000 7f9aa2114700 1 -- 172.21.15.111:0/1972081899 >> v2:172.21.15.111:3300/0 conn(0x7f9a9c0ad100 msgr2=0x7f9a9c0ad4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:22:51.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.762+0000 7f9aa2114700 1 --2- 172.21.15.111:0/1972081899 >> v2:172.21.15.111:3300/0 conn(0x7f9a9c0ad100 0x7f9a9c0ad4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:51.768 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.762+0000 7f9aa2114700 1 -- 172.21.15.111:0/1972081899 >> v1:172.21.15.111:6789/0 conn(0x7f9a9c139300 legacy=0x7f9a9c067940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:51.768 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.762+0000 7f9aa2114700 1 -- 172.21.15.111:0/1972081899 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a9c069010 con 0x7f9a9c063a80 2024-04-25T02:22:51.768 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.762+0000 7f9aa1913700 1 --2- 172.21.15.111:0/1972081899 >> v2:172.21.15.111:3300/0 conn(0x7f9a9c0ad100 0x7f9a9c0ad4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:22:51.768 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.762+0000 7f9aa2114700 1 --2- 172.21.15.111:0/1972081899 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9a9c063a80 0x7f9a9c0a5b80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9a980098e0 tx=0x7f9a980091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3602a03df4c2c69f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:51.768 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.762+0000 7f9aa1112700 1 -- 172.21.15.111:0/1972081899 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9800b640 con 0x7f9a9c063a80 2024-04-25T02:22:51.768 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.763+0000 7f9aa1112700 1 -- 172.21.15.111:0/1972081899 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a9800b7a0 con 0x7f9a9c063a80 2024-04-25T02:22:51.768 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.763+0000 7f9aa1112700 1 -- 172.21.15.111:0/1972081899 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9800bb40 con 0x7f9a9c063a80 2024-04-25T02:22:51.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.763+0000 7f9aa4378700 1 -- 172.21.15.111:0/1972081899 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9a9c063a80 msgr2=0x7f9a9c0a5b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:51.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.763+0000 7f9aa4378700 1 --2- 172.21.15.111:0/1972081899 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9a9c063a80 0x7f9a9c0a5b80 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f9a980098e0 tx=0x7f9a980091a0 comp rx=0 tx=0).stop 2024-04-25T02:22:51.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.763+0000 7f9aa4378700 1 -- 172.21.15.111:0/1972081899 shutdown_connections 2024-04-25T02:22:51.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.763+0000 7f9aa4378700 1 --2- 172.21.15.111:0/1972081899 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9a9c063a80 0x7f9a9c0a5b80 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:51.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.763+0000 7f9aa4378700 1 --2- 172.21.15.111:0/1972081899 >> v2:172.21.15.111:3300/0 conn(0x7f9a9c0ad100 0x7f9a9c0ad4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:51.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.763+0000 7f9aa4378700 1 -- 172.21.15.111:0/1972081899 >> 172.21.15.111:0/1972081899 conn(0x7f9a9c0b1510 msgr2=0x7f9a9c0b1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:51.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.763+0000 7f9aa4378700 1 -- 172.21.15.111:0/1972081899 shutdown_connections 2024-04-25T02:22:51.770 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.763+0000 7f9aa4378700 1 -- 172.21.15.111:0/1972081899 wait complete. 2024-04-25T02:22:51.774 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.765+0000 7f9aa4378700 1 Processor -- start 2024-04-25T02:22:51.774 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.765+0000 7f9aa4378700 1 -- start start 2024-04-25T02:22:51.774 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.765+0000 7f9aa4378700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9a9c063a80 0x7f9a9c11b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:51.774 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.765+0000 7f9aa4378700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9a9c0ad100 0x7f9a9c06d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:51.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.765+0000 7f9aa4378700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9a9c139300 0x7f9a9c06d780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:51.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.765+0000 7f9aa4378700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9c119d40 con 0x7f9a9c139300 2024-04-25T02:22:51.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.765+0000 7f9aa4378700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9c11ad70 con 0x7f9a9c0ad100 2024-04-25T02:22:51.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.765+0000 7f9aa4378700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9c11b050 con 0x7f9a9c063a80 2024-04-25T02:22:51.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.766+0000 7f9aa2114700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9a9c063a80 0x7f9a9c11b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:51.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.766+0000 7f9aa2915700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9a9c139300 0x7f9a9c06d780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:51.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.766+0000 7f9aa1913700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9a9c0ad100 0x7f9a9c06d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:51.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.766+0000 7f9aa2114700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9a9c063a80 0x7f9a9c11b550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:57738/0 (socket says 172.21.15.111:57738) 2024-04-25T02:22:51.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.766+0000 7f9aa2915700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9a9c139300 0x7f9a9c06d780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:53050/0 (socket says 172.21.15.111:53050) 2024-04-25T02:22:51.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.766+0000 7f9aa2114700 1 -- 172.21.15.111:0/2909428340 learned_addr learned my addr 172.21.15.111:0/2909428340 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:22:51.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.766+0000 7f9aa1913700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9a9c0ad100 0x7f9a9c06d240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:60976/0 (socket says 172.21.15.111:60976) 2024-04-25T02:22:51.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.766+0000 7f9aa2114700 1 -- 172.21.15.111:0/2909428340 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9a9c0ad100 msgr2=0x7f9a9c06d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:51.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.766+0000 7f9aa2114700 1 --2- 172.21.15.111:0/2909428340 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9a9c0ad100 0x7f9a9c06d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:51.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.766+0000 7f9aa2114700 1 -- 172.21.15.111:0/2909428340 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9a9c139300 msgr2=0x7f9a9c06d780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:51.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.766+0000 7f9aa2114700 1 --2- 172.21.15.111:0/2909428340 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9a9c139300 0x7f9a9c06d780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:51.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.766+0000 7f9aa2114700 1 -- 172.21.15.111:0/2909428340 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a8c0094f0 con 0x7f9a9c063a80 2024-04-25T02:22:51.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.766+0000 7f9aa2915700 1 --2- 172.21.15.111:0/2909428340 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9a9c139300 0x7f9a9c06d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:22:51.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.766+0000 7f9aa1913700 1 --2- 172.21.15.111:0/2909428340 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9a9c0ad100 0x7f9a9c06d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:22:51.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.766+0000 7f9aa2114700 1 --2- 172.21.15.111:0/2909428340 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9a9c063a80 0x7f9a9c11b550 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c0a6250 tx=0x7f9a98017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:51.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.766+0000 7f9a927fc700 1 -- 172.21.15.111:0/2909428340 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a9801bc40 con 0x7f9a9c063a80 2024-04-25T02:22:51.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.766+0000 7f9a927fc700 1 -- 172.21.15.111:0/2909428340 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a9801bde0 con 0x7f9a9c063a80 2024-04-25T02:22:51.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.766+0000 7f9aa4378700 1 -- 172.21.15.111:0/2909428340 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a98009420 con 0x7f9a9c063a80 2024-04-25T02:22:51.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.766+0000 7f9a927fc700 1 -- 172.21.15.111:0/2909428340 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a98011670 con 0x7f9a9c063a80 2024-04-25T02:22:51.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.766+0000 7f9aa4378700 1 -- 172.21.15.111:0/2909428340 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a9c06e4d0 con 0x7f9a9c063a80 2024-04-25T02:22:51.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.767+0000 7f9aa4378700 1 -- 172.21.15.111:0/2909428340 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a9c11b210 con 0x7f9a9c063a80 2024-04-25T02:22:51.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.767+0000 7f9a927fc700 1 -- 172.21.15.111:0/2909428340 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 6) v1 ==== 42206+0+0 (secure 0 0 0) 0x7f9a980119e0 con 0x7f9a9c063a80 2024-04-25T02:22:51.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.768+0000 7f9a927fc700 1 -- 172.21.15.111:0/2909428340 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f9a9804cc20 con 0x7f9a9c063a80 2024-04-25T02:22:51.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.768+0000 7f9aa1913700 1 -- 172.21.15.111:0/2909428340 >> v1:172.21.15.111:6816/39585 conn(0x7f9a800394d0 legacy=0x7f9a8003b980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.111:6816/39585 2024-04-25T02:22:51.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.773+0000 7f9a927fc700 1 -- 172.21.15.111:0/2909428340 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+112002 (secure 0 0 0) 0x7f9a980010a0 con 0x7f9a9c063a80 2024-04-25T02:22:51.891 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-04-25T02:22:51.889+0000 7f5e56aad1c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T02:22:51.900 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.897+0000 7f9aa4378700 1 -- 172.21.15.111:0/2909428340 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9a9c071790 con 0x7f9a9c063a80 2024-04-25T02:22:51.900 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-25T02:22:51.898+0000 7f1f561191c0 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-25T02:22:51.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.898+0000 7f9a927fc700 1 -- 172.21.15.111:0/2909428340 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+11324 (secure 0 0 0) 0x7f9a98006830 con 0x7f9a9c063a80 2024-04-25T02:22:51.901 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:22:51.901 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":19,"fsid":"4643f974-f93a-4436-93b8-460ff320e62e","created":"2024-04-25T02:20:05.450475+0000","modified":"2024-04-25T02:20:36.255829+0000","last_up_change":"2024-04-25T02:20:10.439204+0000","last_in_change":"2024-04-25T02:20:10.439204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-25T02:20:07.471248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:20:14.420378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:20:22.251868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T02:20:23.128289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"df3f17ca-3b12-42c8-8cf7-8f1b7189e587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6800","nonce":40214}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6801","nonce":40214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6803","nonce":40214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6802","nonce":40214}]},"public_addr":"172.21.15.111:6800/40214","cluster_addr":"172.21.15.111:6801/40214","heartbeat_back_addr":"172.21.15.111:6803/40214","heartbeat_front_addr":"172.21.15.111:6802/40214","state":["exists","up"]},{"osd":1,"uuid":"93d54815-f215-4285-bba6-32f2d1cabf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6812","nonce":40216}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6813","nonce":40216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6815","nonce":40216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6814","nonce":40216}]},"public_addr":"172.21.15.111:6812/40216","cluster_addr":"172.21.15.111:6813/40216","heartbeat_back_addr":"172.21.15.111:6815/40216","heartbeat_front_addr":"172.21.15.111:6814/40216","state":["exists","up"]},{"osd":2,"uuid":"b26b2104-2a2e-408f-9ce7-3587a32a2ebe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6804","nonce":40215}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6805","nonce":40215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6807","nonce":40215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6806","nonce":40215}]},"public_addr":"172.21.15.111:6804/40215","cluster_addr":"172.21.15.111:6805/40215","heartbeat_back_addr":"172.21.15.111:6807/40215","heartbeat_front_addr":"172.21.15.111:6806/40215","state":["exists","up"]},{"osd":3,"uuid":"43c25820-1edc-4031-badf-72e87dd6bf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6808","nonce":40213}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6809","nonce":40213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6811","nonce":40213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6810","nonce":40213}]},"public_addr":"172.21.15.111:6808/40213","cluster_addr":"172.21.15.111:6809/40213","heartbeat_back_addr":"172.21.15.111:6811/40213","heartbeat_front_addr":"172.21.15.111:6810/40213","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.372427+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.411480+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.361508+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.377212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:22:51.903 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.900+0000 7f9aa4378700 1 -- 172.21.15.111:0/2909428340 >> v1:172.21.15.111:6816/39585 conn(0x7f9a800394d0 legacy=0x7f9a8003b980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T02:22:51.903 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.900+0000 7f9aa4378700 1 -- 172.21.15.111:0/2909428340 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9a9c063a80 msgr2=0x7f9a9c11b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:51.903 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.900+0000 7f9aa4378700 1 --2- 172.21.15.111:0/2909428340 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9a9c063a80 0x7f9a9c11b550 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f9a9c0a6250 tx=0x7f9a98017000 comp rx=0 tx=0).stop 2024-04-25T02:22:51.903 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.900+0000 7f9aa4378700 1 -- 172.21.15.111:0/2909428340 shutdown_connections 2024-04-25T02:22:51.904 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.900+0000 7f9aa4378700 1 --2- 172.21.15.111:0/2909428340 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9a9c139300 0x7f9a9c06d780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:51.904 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.900+0000 7f9aa4378700 1 --2- 172.21.15.111:0/2909428340 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9a9c063a80 0x7f9a9c11b550 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:51.904 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.900+0000 7f9aa4378700 1 --2- 172.21.15.111:0/2909428340 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9a9c0ad100 0x7f9a9c06d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:51.904 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.900+0000 7f9aa4378700 1 -- 172.21.15.111:0/2909428340 >> 172.21.15.111:0/2909428340 conn(0x7f9a9c0b1510 msgr2=0x7f9a9c0ae750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:51.904 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.900+0000 7f9aa4378700 1 -- 172.21.15.111:0/2909428340 shutdown_connections 2024-04-25T02:22:51.904 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:51.900+0000 7f9aa4378700 1 -- 172.21.15.111:0/2909428340 wait complete. 2024-04-25T02:22:51.921 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-25T02:22:51.921 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:22:51.964 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-04-25T02:22:51.962+0000 7f5e56aad1c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T02:22:51.978 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-25T02:22:51.976+0000 7f1f561191c0 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-25T02:22:52.042 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.039+0000 7f4c20c41700 1 Processor -- start 2024-04-25T02:22:52.042 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.039+0000 7f4c20c41700 1 -- start start 2024-04-25T02:22:52.045 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.040+0000 7f4c20c41700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4c1c0b4fd0 0x7f4c1c0a2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:52.045 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.040+0000 7f4c20c41700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f4c1c0a3980 0x7f4c1c0a3d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:52.045 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.040+0000 7f4c20c41700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c1c0a46d0 con 0x7f4c1c13ea00 2024-04-25T02:22:52.045 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.040+0000 7f4c20c41700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c1c0a6710 con 0x7f4c1c0a3980 2024-04-25T02:22:52.046 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.040+0000 7f4c20c41700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c0a4930 con 0x7f4c1c0b4fd0 2024-04-25T02:22:52.046 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.040+0000 7f4c1a59c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4c1c0b4fd0 0x7f4c1c0a2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:52.046 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.040+0000 7f4c19d9b700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f4c1c0a3980 0x7f4c1c0a3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:52.046 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.040+0000 7f4c1a59c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4c1c0b4fd0 0x7f4c1c0a2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:57746/0 (socket says 172.21.15.111:57746) 2024-04-25T02:22:52.046 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.040+0000 7f4c19d9b700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f4c1c0a3980 0x7f4c1c0a3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:53064/0 (socket says 172.21.15.111:53064) 2024-04-25T02:22:52.046 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.040+0000 7f4c1a59c700 1 -- 172.21.15.111:0/618692901 learned_addr learned my addr 172.21.15.111:0/618692901 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:22:52.046 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.041+0000 7f4c19d9b700 1 -- 172.21.15.111:0/618692901 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4c1c0b4fd0 msgr2=0x7f4c1c0a2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:22:52.046 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.041+0000 7f4c19d9b700 1 --2- 172.21.15.111:0/618692901 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4c1c0b4fd0 0x7f4c1c0a2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.046 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.041+0000 7f4c19d9b700 1 -- 172.21.15.111:0/618692901 >> v1:172.21.15.111:6789/0 conn(0x7f4c1c13ea00 legacy=0x7f4c1c13eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:52.046 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.041+0000 7f4c19d9b700 1 -- 172.21.15.111:0/618692901 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c1c0a31a0 con 0x7f4c1c0a3980 2024-04-25T02:22:52.046 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.041+0000 7f4c1a59c700 1 --2- 172.21.15.111:0/618692901 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4c1c0b4fd0 0x7f4c1c0a2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:22:52.046 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.041+0000 7f4c19d9b700 1 --2- 172.21.15.111:0/618692901 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4c1c0a3980 0x7f4c1c0a3d50 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4c100098e0 tx=0x7f4c100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f645703cb888499 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:52.047 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.041+0000 7f4c1959a700 1 -- 172.21.15.111:0/618692901 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1000b640 con 0x7f4c1c0a3980 2024-04-25T02:22:52.047 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.041+0000 7f4c1959a700 1 -- 172.21.15.111:0/618692901 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1000b7a0 con 0x7f4c1c0a3980 2024-04-25T02:22:52.047 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.041+0000 7f4c1959a700 1 -- 172.21.15.111:0/618692901 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1000bb40 con 0x7f4c1c0a3980 2024-04-25T02:22:52.047 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.042+0000 7f4c20c41700 1 -- 172.21.15.111:0/618692901 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4c1c0a3980 msgr2=0x7f4c1c0a3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:52.047 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.042+0000 7f4c20c41700 1 --2- 172.21.15.111:0/618692901 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4c1c0a3980 0x7f4c1c0a3d50 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f4c100098e0 tx=0x7f4c100091a0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.047 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.042+0000 7f4c20c41700 1 -- 172.21.15.111:0/618692901 shutdown_connections 2024-04-25T02:22:52.047 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.042+0000 7f4c20c41700 1 --2- 172.21.15.111:0/618692901 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4c1c0b4fd0 0x7f4c1c0a2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.047 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.042+0000 7f4c20c41700 1 --2- 172.21.15.111:0/618692901 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4c1c0a3980 0x7f4c1c0a3d50 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.048 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.042+0000 7f4c20c41700 1 -- 172.21.15.111:0/618692901 >> 172.21.15.111:0/618692901 conn(0x7f4c1c0883e0 msgr2=0x7f4c1c068b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:52.048 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.042+0000 7f4c20c41700 1 -- 172.21.15.111:0/618692901 shutdown_connections 2024-04-25T02:22:52.048 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.042+0000 7f4c20c41700 1 -- 172.21.15.111:0/618692901 wait complete. 2024-04-25T02:22:52.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.043+0000 7f4c20c41700 1 Processor -- start 2024-04-25T02:22:52.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.043+0000 7f4c20c41700 1 -- start start 2024-04-25T02:22:52.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.043+0000 7f4c20c41700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4c1c0a3980 0x7f4c1c141bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:52.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.043+0000 7f4c20c41700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4c1c0b4fd0 0x7f4c1c151e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:52.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.043+0000 7f4c20c41700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4c1c13ea00 0x7f4c1c1431e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:52.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.043+0000 7f4c20c41700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c147a50 con 0x7f4c1c0a3980 2024-04-25T02:22:52.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.043+0000 7f4c20c41700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c1519c0 con 0x7f4c1c0b4fd0 2024-04-25T02:22:52.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.043+0000 7f4c20c41700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c142e00 con 0x7f4c1c13ea00 2024-04-25T02:22:52.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.043+0000 7f4c1ad9d700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4c1c13ea00 0x7f4c1c1431e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:52.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.043+0000 7f4c1ad9d700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4c1c13ea00 0x7f4c1c1431e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:57748/0 (socket says 172.21.15.111:57748) 2024-04-25T02:22:52.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.043+0000 7f4c1ad9d700 1 -- 172.21.15.111:0/619923023 learned_addr learned my addr 172.21.15.111:0/619923023 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:22:52.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.044+0000 7f4c19d9b700 1 --2- 172.21.15.111:0/619923023 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4c1c0b4fd0 0x7f4c1c151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:52.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.044+0000 7f4c1a59c700 1 --2- 172.21.15.111:0/619923023 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4c1c0a3980 0x7f4c1c141bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:52.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.044+0000 7f4c1ad9d700 1 -- 172.21.15.111:0/619923023 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4c1c0b4fd0 msgr2=0x7f4c1c151e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:52.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.044+0000 7f4c1ad9d700 1 --2- 172.21.15.111:0/619923023 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4c1c0b4fd0 0x7f4c1c151e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.044+0000 7f4c1ad9d700 1 -- 172.21.15.111:0/619923023 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4c1c0a3980 msgr2=0x7f4c1c141bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:52.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.044+0000 7f4c1ad9d700 1 --2- 172.21.15.111:0/619923023 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4c1c0a3980 0x7f4c1c141bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.044+0000 7f4c1ad9d700 1 -- 172.21.15.111:0/619923023 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c0c0094f0 con 0x7f4c1c13ea00 2024-04-25T02:22:52.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.044+0000 7f4c1ad9d700 1 --2- 172.21.15.111:0/619923023 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4c1c13ea00 0x7f4c1c1431e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4c1400c840 tx=0x7f4c14001670 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:52.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.044+0000 7f4c0a7fc700 1 -- 172.21.15.111:0/619923023 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c14012630 con 0x7f4c1c13ea00 2024-04-25T02:22:52.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.044+0000 7f4c0a7fc700 1 -- 172.21.15.111:0/619923023 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c140127b0 con 0x7f4c1c13ea00 2024-04-25T02:22:52.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.044+0000 7f4c0a7fc700 1 -- 172.21.15.111:0/619923023 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c14012b70 con 0x7f4c1c13ea00 2024-04-25T02:22:52.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.044+0000 7f4c20c41700 1 -- 172.21.15.111:0/619923023 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c10009420 con 0x7f4c1c13ea00 2024-04-25T02:22:52.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.044+0000 7f4c20c41700 1 -- 172.21.15.111:0/619923023 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c1c152530 con 0x7f4c1c13ea00 2024-04-25T02:22:52.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.045+0000 7f4c0a7fc700 1 -- 172.21.15.111:0/619923023 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 6) v1 ==== 42206+0+0 (secure 0 0 0) 0x7f4c1401a3a0 con 0x7f4c1c13ea00 2024-04-25T02:22:52.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.045+0000 7f4c20c41700 1 -- 172.21.15.111:0/619923023 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c1c065190 con 0x7f4c1c13ea00 2024-04-25T02:22:52.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.045+0000 7f4c1a59c700 1 -- 172.21.15.111:0/619923023 >> v1:172.21.15.111:6816/39585 conn(0x7f4bfc0394d0 legacy=0x7f4bfc03b980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.111:6816/39585 2024-04-25T02:22:52.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.045+0000 7f4c0a7fc700 1 -- 172.21.15.111:0/619923023 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f4c1404b7f0 con 0x7f4c1c13ea00 2024-04-25T02:22:52.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.051+0000 7f4c0a7fc700 1 -- 172.21.15.111:0/619923023 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+112002 (secure 0 0 0) 0x7f4c14030200 con 0x7f4c1c13ea00 2024-04-25T02:22:52.084 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-04-25T02:22:52.082+0000 7f5e56aad1c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T02:22:52.098 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-25T02:22:52.095+0000 7f1f561191c0 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-25T02:22:52.179 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.177+0000 7f4c20c41700 1 -- 172.21.15.111:0/619923023 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c1c0b5cd0 con 0x7f4c1c13ea00 2024-04-25T02:22:52.180 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.178+0000 7f4c0a7fc700 1 -- 172.21.15.111:0/619923023 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+11324 (secure 0 0 0) 0x7f4c14033820 con 0x7f4c1c13ea00 2024-04-25T02:22:52.180 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:22:52.181 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":19,"fsid":"4643f974-f93a-4436-93b8-460ff320e62e","created":"2024-04-25T02:20:05.450475+0000","modified":"2024-04-25T02:20:36.255829+0000","last_up_change":"2024-04-25T02:20:10.439204+0000","last_in_change":"2024-04-25T02:20:10.439204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-04-25T02:20:07.471248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:20:14.420378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:20:22.251868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T02:20:23.128289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"df3f17ca-3b12-42c8-8cf7-8f1b7189e587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6800","nonce":40214}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6801","nonce":40214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6803","nonce":40214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6802","nonce":40214}]},"public_addr":"172.21.15.111:6800/40214","cluster_addr":"172.21.15.111:6801/40214","heartbeat_back_addr":"172.21.15.111:6803/40214","heartbeat_front_addr":"172.21.15.111:6802/40214","state":["exists","up"]},{"osd":1,"uuid":"93d54815-f215-4285-bba6-32f2d1cabf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6812","nonce":40216}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6813","nonce":40216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6815","nonce":40216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6814","nonce":40216}]},"public_addr":"172.21.15.111:6812/40216","cluster_addr":"172.21.15.111:6813/40216","heartbeat_back_addr":"172.21.15.111:6815/40216","heartbeat_front_addr":"172.21.15.111:6814/40216","state":["exists","up"]},{"osd":2,"uuid":"b26b2104-2a2e-408f-9ce7-3587a32a2ebe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6804","nonce":40215}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6805","nonce":40215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6807","nonce":40215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6806","nonce":40215}]},"public_addr":"172.21.15.111:6804/40215","cluster_addr":"172.21.15.111:6805/40215","heartbeat_back_addr":"172.21.15.111:6807/40215","heartbeat_front_addr":"172.21.15.111:6806/40215","state":["exists","up"]},{"osd":3,"uuid":"43c25820-1edc-4031-badf-72e87dd6bf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6808","nonce":40213}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6809","nonce":40213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6811","nonce":40213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6810","nonce":40213}]},"public_addr":"172.21.15.111:6808/40213","cluster_addr":"172.21.15.111:6809/40213","heartbeat_back_addr":"172.21.15.111:6811/40213","heartbeat_front_addr":"172.21.15.111:6810/40213","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.372427+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.411480+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.361508+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.377212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:22:52.183 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.180+0000 7f4c20c41700 1 -- 172.21.15.111:0/619923023 >> v1:172.21.15.111:6816/39585 conn(0x7f4bfc0394d0 legacy=0x7f4bfc03b980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T02:22:52.183 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.180+0000 7f4c20c41700 1 -- 172.21.15.111:0/619923023 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4c1c13ea00 msgr2=0x7f4c1c1431e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:52.183 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.180+0000 7f4c20c41700 1 --2- 172.21.15.111:0/619923023 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4c1c13ea00 0x7f4c1c1431e0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4c1400c840 tx=0x7f4c14001670 comp rx=0 tx=0).stop 2024-04-25T02:22:52.183 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.180+0000 7f4c20c41700 1 -- 172.21.15.111:0/619923023 shutdown_connections 2024-04-25T02:22:52.183 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.180+0000 7f4c20c41700 1 --2- 172.21.15.111:0/619923023 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4c1c13ea00 0x7f4c1c1431e0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.183 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.180+0000 7f4c20c41700 1 --2- 172.21.15.111:0/619923023 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f4c1c0a3980 0x7f4c1c141bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.183 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.180+0000 7f4c20c41700 1 --2- 172.21.15.111:0/619923023 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4c1c0b4fd0 0x7f4c1c151e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.183 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.180+0000 7f4c20c41700 1 -- 172.21.15.111:0/619923023 >> 172.21.15.111:0/619923023 conn(0x7f4c1c0883e0 msgr2=0x7f4c1c063d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:52.183 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.180+0000 7f4c20c41700 1 -- 172.21.15.111:0/619923023 shutdown_connections 2024-04-25T02:22:52.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.180+0000 7f4c20c41700 1 -- 172.21.15.111:0/619923023 wait complete. 2024-04-25T02:22:52.200 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-25T02:22:52.200 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-25T02:22:52.201 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-25T02:22:52.201 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-25T02:22:52.237 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-04-25T02:22:52.234+0000 7f5e56aad1c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T02:22:52.240 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-25T02:22:52.237+0000 7f1f561191c0 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-25T02:22:52.341 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.338+0000 7f5755e52700 1 Processor -- start 2024-04-25T02:22:52.341 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.338+0000 7f5755e52700 1 -- start start 2024-04-25T02:22:52.342 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.339+0000 7f5755e52700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5750063c90 0x7f57500ad110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:52.342 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.339+0000 7f5755e52700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f575006dad0 0x7f5750142d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:52.342 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.339+0000 7f5755e52700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57500ac2b0 con 0x7f575006dea0 2024-04-25T02:22:52.342 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.339+0000 7f5755e52700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57500ac4e0 con 0x7f575006dad0 2024-04-25T02:22:52.342 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.339+0000 7f5755e52700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f57500ac780 con 0x7f5750063c90 2024-04-25T02:22:52.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.340+0000 7f574effd700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f575006dad0 0x7f5750142d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:52.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.340+0000 7f574ffff700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f575006dea0 0x7f57501432d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:55388/0 (socket says 172.21.15.111:55388) 2024-04-25T02:22:52.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.340+0000 7f574effd700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f575006dad0 0x7f5750142d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:53082/0 (socket says 172.21.15.111:53082) 2024-04-25T02:22:52.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.340+0000 7f574ffff700 1 -- 172.21.15.111:0/3027641690 learned_addr learned my addr 172.21.15.111:0/3027641690 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:22:52.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.340+0000 7f574f7fe700 1 --2- 172.21.15.111:0/3027641690 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5750063c90 0x7f57500ad110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:52.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.340+0000 7f574e7fc700 1 -- 172.21.15.111:0/3027641690 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1821669265 0 0) 0x7f57500ac2b0 con 0x7f575006dea0 2024-04-25T02:22:52.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.340+0000 7f574e7fc700 1 -- 172.21.15.111:0/3027641690 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f573c003570 con 0x7f575006dea0 2024-04-25T02:22:52.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.340+0000 7f574effd700 1 -- 172.21.15.111:0/3027641690 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5750063c90 msgr2=0x7f57500ad110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:22:52.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.340+0000 7f574effd700 1 --2- 172.21.15.111:0/3027641690 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5750063c90 0x7f57500ad110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.340+0000 7f574effd700 1 -- 172.21.15.111:0/3027641690 >> v1:172.21.15.111:6789/0 conn(0x7f575006dea0 legacy=0x7f57501432d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:52.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.340+0000 7f574effd700 1 -- 172.21.15.111:0/3027641690 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57500abe30 con 0x7f575006dad0 2024-04-25T02:22:52.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.340+0000 7f574f7fe700 1 --2- 172.21.15.111:0/3027641690 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5750063c90 0x7f57500ad110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:22:52.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.341+0000 7f574effd700 1 --2- 172.21.15.111:0/3027641690 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f575006dad0 0x7f5750142d90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f57400098e0 tx=0x7f57400091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69a5a89e4f2d0ab server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:52.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.341+0000 7f574e7fc700 1 -- 172.21.15.111:0/3027641690 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f574000b6d0 con 0x7f575006dad0 2024-04-25T02:22:52.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.341+0000 7f574e7fc700 1 -- 172.21.15.111:0/3027641690 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f574000b830 con 0x7f575006dad0 2024-04-25T02:22:52.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.341+0000 7f574e7fc700 1 -- 172.21.15.111:0/3027641690 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f574000bbd0 con 0x7f575006dad0 2024-04-25T02:22:52.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.341+0000 7f496f2ad700 1 Processor -- start 2024-04-25T02:22:52.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.342+0000 7f5755e52700 1 -- 172.21.15.111:0/3027641690 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f575006dad0 msgr2=0x7f5750142d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:52.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.342+0000 7f5755e52700 1 --2- 172.21.15.111:0/3027641690 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f575006dad0 0x7f5750142d90 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f57400098e0 tx=0x7f57400091a0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.342+0000 7f496f2ad700 1 -- start start 2024-04-25T02:22:52.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.342+0000 7f5755e52700 1 -- 172.21.15.111:0/3027641690 shutdown_connections 2024-04-25T02:22:52.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.342+0000 7f5755e52700 1 --2- 172.21.15.111:0/3027641690 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5750063c90 0x7f57500ad110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.342+0000 7f5755e52700 1 --2- 172.21.15.111:0/3027641690 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f575006dad0 0x7f5750142d90 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.342+0000 7f5755e52700 1 -- 172.21.15.111:0/3027641690 >> 172.21.15.111:0/3027641690 conn(0x7f57500b1390 msgr2=0x7f57500b1760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:52.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.342+0000 7f496f2ad700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f49680a05e0 0x7f49681428d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:52.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.342+0000 7f496f2ad700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f496806f2d0 0x7f496814d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:52.347 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.342+0000 7f496f2ad700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f496809fb90 con 0x7f496806ef00 2024-04-25T02:22:52.347 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.342+0000 7f496f2ad700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f496806f6f0 con 0x7f49680a05e0 2024-04-25T02:22:52.347 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.342+0000 7f496f2ad700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4968143270 con 0x7f496806f2d0 2024-04-25T02:22:52.347 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.342+0000 7f5755e52700 1 -- 172.21.15.111:0/3027641690 shutdown_connections 2024-04-25T02:22:52.347 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.343+0000 7f5755e52700 1 -- 172.21.15.111:0/3027641690 wait complete. 2024-04-25T02:22:52.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.343+0000 7f496d049700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f49680a05e0 0x7f49681428d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:52.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.343+0000 7f496d049700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f49680a05e0 0x7f49681428d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:53090/0 (socket says 172.21.15.111:53090) 2024-04-25T02:22:52.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.343+0000 7f496d049700 1 -- 172.21.15.111:0/955164605 learned_addr learned my addr 172.21.15.111:0/955164605 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:22:52.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.343+0000 7f496d84a700 1 --2- 172.21.15.111:0/955164605 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f496806f2d0 0x7f496814d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:52.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.343+0000 7f495ffff700 1 -- 172.21.15.111:0/955164605 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 984284 0 0) 0x7f496809fb90 con 0x7f496806ef00 2024-04-25T02:22:52.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.343+0000 7f495ffff700 1 -- 172.21.15.111:0/955164605 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4954003570 con 0x7f496806ef00 2024-04-25T02:22:52.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.343+0000 7f496d84a700 1 -- 172.21.15.111:0/955164605 >> v2:172.21.15.111:3300/0 conn(0x7f49680a05e0 msgr2=0x7f49681428d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:22:52.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.343+0000 7f496d84a700 1 --2- 172.21.15.111:0/955164605 >> v2:172.21.15.111:3300/0 conn(0x7f49680a05e0 0x7f49681428d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.343+0000 7f496d84a700 1 -- 172.21.15.111:0/955164605 >> v1:172.21.15.111:6789/0 conn(0x7f496806ef00 legacy=0x7f49680a3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:52.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.343+0000 7f496d84a700 1 -- 172.21.15.111:0/955164605 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4968143510 con 0x7f496806f2d0 2024-04-25T02:22:52.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.344+0000 7f496d84a700 1 --2- 172.21.15.111:0/955164605 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f496806f2d0 0x7f496814d190 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f49640098e0 tx=0x7f49640091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5b8918f09d65ed28 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:52.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.344+0000 7f5755e52700 1 Processor -- start 2024-04-25T02:22:52.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.344+0000 7f495ffff700 1 -- 172.21.15.111:0/955164605 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4964011630 con 0x7f496806f2d0 2024-04-25T02:22:52.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.344+0000 7f495ffff700 1 -- 172.21.15.111:0/955164605 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f49640117b0 con 0x7f496806f2d0 2024-04-25T02:22:52.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.344+0000 7f495ffff700 1 -- 172.21.15.111:0/955164605 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4964011b70 con 0x7f496806f2d0 2024-04-25T02:22:52.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.344+0000 7f5755e52700 1 -- start start 2024-04-25T02:22:52.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.345+0000 7f496f2ad700 1 -- 172.21.15.111:0/955164605 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f496806f2d0 msgr2=0x7f496814d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:52.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.345+0000 7f496f2ad700 1 --2- 172.21.15.111:0/955164605 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f496806f2d0 0x7f496814d190 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f49640098e0 tx=0x7f49640091a0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.355 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.345+0000 7f5755e52700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5750063c90 0x7f575014a860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:52.355 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.345+0000 7f5755e52700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f575006dad0 0x7f5750149df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:52.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.345+0000 7f5755e52700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f575006dea0 0x7f5750152670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:52.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.345+0000 7f5755e52700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5750148e00 con 0x7f575006dad0 2024-04-25T02:22:52.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.345+0000 7f5755e52700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57501523f0 con 0x7f5750063c90 2024-04-25T02:22:52.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.345+0000 7f5755e52700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f575014ada0 con 0x7f575006dea0 2024-04-25T02:22:52.357 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.345+0000 7f574effd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f575006dad0 0x7f5750149df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:52.357 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.345+0000 7f574f7fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5750063c90 0x7f575014a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:52.357 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.345+0000 7f574effd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f575006dad0 0x7f5750149df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:53106/0 (socket says 172.21.15.111:53106) 2024-04-25T02:22:52.357 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.345+0000 7f574effd700 1 -- 172.21.15.111:0/279028947 learned_addr learned my addr 172.21.15.111:0/279028947 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:22:52.357 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.346+0000 7f574ffff700 1 --2- 172.21.15.111:0/279028947 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f575006dea0 0x7f5750152670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:52.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.346+0000 7f574f7fe700 1 -- 172.21.15.111:0/279028947 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f575006dea0 msgr2=0x7f5750152670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:52.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.346+0000 7f574f7fe700 1 --2- 172.21.15.111:0/279028947 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f575006dea0 0x7f5750152670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.346+0000 7f574f7fe700 1 -- 172.21.15.111:0/279028947 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f575006dad0 msgr2=0x7f5750149df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:52.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.346+0000 7f574f7fe700 1 --2- 172.21.15.111:0/279028947 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f575006dad0 0x7f5750149df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.346+0000 7f574f7fe700 1 -- 172.21.15.111:0/279028947 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5740009420 con 0x7f5750063c90 2024-04-25T02:22:52.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.346+0000 7f574f7fe700 1 --2- 172.21.15.111:0/279028947 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5750063c90 0x7f575014a860 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5738006fd0 tx=0x7f5738008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:52.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.346+0000 7f57477fe700 1 -- 172.21.15.111:0/279028947 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5738013410 con 0x7f5750063c90 2024-04-25T02:22:52.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.346+0000 7f57477fe700 1 -- 172.21.15.111:0/279028947 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5738013570 con 0x7f5750063c90 2024-04-25T02:22:52.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.346+0000 7f57477fe700 1 -- 172.21.15.111:0/279028947 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57380138f0 con 0x7f5750063c90 2024-04-25T02:22:52.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.347+0000 7f5755e52700 1 -- 172.21.15.111:0/279028947 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f575014b370 con 0x7f5750063c90 2024-04-25T02:22:52.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.347+0000 7f5755e52700 1 -- 172.21.15.111:0/279028947 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57500ab6e0 con 0x7f5750063c90 2024-04-25T02:22:52.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.347+0000 7f57477fe700 1 -- 172.21.15.111:0/279028947 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 6) v1 ==== 42206+0+0 (secure 0 0 0) 0x7f5738013ce0 con 0x7f5750063c90 2024-04-25T02:22:52.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.348+0000 7f57477fe700 1 -- 172.21.15.111:0/279028947 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f573804b570 con 0x7f5750063c90 2024-04-25T02:22:52.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.348+0000 7f574effd700 1 -- 172.21.15.111:0/279028947 >> v1:172.21.15.111:6816/39585 conn(0x7f5730039520 legacy=0x7f573003b9d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.111:6816/39585 2024-04-25T02:22:52.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.348+0000 7f5755e52700 1 -- 172.21.15.111:0/279028947 --> v1:172.21.15.111:6804/40215 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f57501532c0 con 0x7f575014a330 2024-04-25T02:22:52.361 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-04-25T02:22:52.348+0000 7f5e56aad1c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T02:22:52.361 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-25T02:22:52.347+0000 7f1f561191c0 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-25T02:22:52.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.350+0000 7f496f2ad700 1 -- 172.21.15.111:0/955164605 shutdown_connections 2024-04-25T02:22:52.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.350+0000 7f496f2ad700 1 --2- 172.21.15.111:0/955164605 >> v2:172.21.15.111:3300/0 conn(0x7f49680a05e0 0x7f49681428d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.350+0000 7f496f2ad700 1 --2- 172.21.15.111:0/955164605 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f496806f2d0 0x7f496814d190 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.350+0000 7f496f2ad700 1 -- 172.21.15.111:0/955164605 >> 172.21.15.111:0/955164605 conn(0x7f4968069bf0 msgr2=0x7f4968067940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:52.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.350+0000 7f496f2ad700 1 -- 172.21.15.111:0/955164605 shutdown_connections 2024-04-25T02:22:52.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.350+0000 7f496f2ad700 1 -- 172.21.15.111:0/955164605 wait complete. 2024-04-25T02:22:52.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.351+0000 7f496f2ad700 1 Processor -- start 2024-04-25T02:22:52.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.351+0000 7f496f2ad700 1 -- start start 2024-04-25T02:22:52.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.352+0000 7f496f2ad700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f496806ef00 0x7f49680a66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:52.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.352+0000 7f496f2ad700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f496806f2d0 0x7f49680a4f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:52.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.352+0000 7f496f2ad700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f49680a05e0 0x7f4968155a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:52.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.352+0000 7f496f2ad700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49680a4680 con 0x7f49680a05e0 2024-04-25T02:22:52.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.352+0000 7f496f2ad700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49680a5870 con 0x7f496806f2d0 2024-04-25T02:22:52.367 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.352+0000 7f496f2ad700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4968155600 con 0x7f496806ef00 2024-04-25T02:22:52.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.352+0000 7f496d049700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f496806ef00 0x7f49680a66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:52.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.352+0000 7f496d049700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f496806ef00 0x7f49680a66a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:57766/0 (socket says 172.21.15.111:57766) 2024-04-25T02:22:52.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.352+0000 7f496d049700 1 -- 172.21.15.111:0/3289605941 learned_addr learned my addr 172.21.15.111:0/3289605941 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:22:52.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.352+0000 7f496d84a700 1 --2- 172.21.15.111:0/3289605941 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f49680a05e0 0x7f4968155a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:52.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.353+0000 7f496c848700 1 --2- 172.21.15.111:0/3289605941 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f496806f2d0 0x7f49680a4f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:52.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.353+0000 7f496d049700 1 -- 172.21.15.111:0/3289605941 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f496806f2d0 msgr2=0x7f49680a4f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:52.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.353+0000 7f496d049700 1 --2- 172.21.15.111:0/3289605941 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f496806f2d0 0x7f49680a4f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.353+0000 7f496d049700 1 -- 172.21.15.111:0/3289605941 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f49680a05e0 msgr2=0x7f4968155a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:52.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.353+0000 7f496d049700 1 --2- 172.21.15.111:0/3289605941 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f49680a05e0 0x7f4968155a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.353+0000 7f496d049700 1 -- 172.21.15.111:0/3289605941 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4964009420 con 0x7f496806ef00 2024-04-25T02:22:52.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.353+0000 7f496d049700 1 --2- 172.21.15.111:0/3289605941 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f496806ef00 0x7f49680a66a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4960007e80 tx=0x7f4960009330 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:52.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.353+0000 7f495d7fa700 1 -- 172.21.15.111:0/3289605941 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f496000db60 con 0x7f496806ef00 2024-04-25T02:22:52.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.353+0000 7f495d7fa700 1 -- 172.21.15.111:0/3289605941 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f496000f040 con 0x7f496806ef00 2024-04-25T02:22:52.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.353+0000 7f495d7fa700 1 -- 172.21.15.111:0/3289605941 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4960015400 con 0x7f496806ef00 2024-04-25T02:22:52.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.353+0000 7f496f2ad700 1 -- 172.21.15.111:0/3289605941 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49680a5ec0 con 0x7f496806ef00 2024-04-25T02:22:52.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.353+0000 7f496f2ad700 1 -- 172.21.15.111:0/3289605941 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49680a5480 con 0x7f496806ef00 2024-04-25T02:22:52.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.354+0000 7f496f2ad700 1 -- 172.21.15.111:0/3289605941 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f4968065190 con 0x7f496806ef00 2024-04-25T02:22:52.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.355+0000 7f495d7fa700 1 -- 172.21.15.111:0/3289605941 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 6) v1 ==== 42206+0+0 (secure 0 0 0) 0x7f4960015770 con 0x7f496806ef00 2024-04-25T02:22:52.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.355+0000 7f495d7fa700 1 -- 172.21.15.111:0/3289605941 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f496004c6c0 con 0x7f496806ef00 2024-04-25T02:22:52.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.355+0000 7f496c848700 1 -- 172.21.15.111:0/3289605941 >> v1:172.21.15.111:6816/39585 conn(0x7f494c0394d0 legacy=0x7f494c03b980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.111:6816/39585 2024-04-25T02:22:52.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.355+0000 7f495d7fa700 1 -- 172.21.15.111:0/3289605941 --> v1:172.21.15.111:6808/40213 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f494c045dd0 con 0x7f494c0420f0 2024-04-25T02:22:52.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.355+0000 7f495d7fa700 1 -- 172.21.15.111:0/3289605941 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f496004ca90 con 0x7f496806ef00 2024-04-25T02:22:52.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.356+0000 7f57477fe700 1 -- 172.21.15.111:0/279028947 <== osd.2 v1:172.21.15.111:6804/40215 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (unknown 0 0 2423311318) 0x7f57501532c0 con 0x7f575014a330 2024-04-25T02:22:52.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.362+0000 7f495d7fa700 1 -- 172.21.15.111:0/3289605941 <== osd.3 v1:172.21.15.111:6808/40213 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (unknown 0 0 2423311318) 0x7f494c045dd0 con 0x7f494c0420f0 2024-04-25T02:22:52.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.376+0000 7f1956816700 1 Processor -- start 2024-04-25T02:22:52.379 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.376+0000 7f1956816700 1 -- start start 2024-04-25T02:22:52.379 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.376+0000 7f1956816700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f19500a5a90 0x7f19501376a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:52.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.376+0000 7f1956816700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f1950137be0 0x7f1950144e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:52.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.376+0000 7f1956816700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19500a4d20 con 0x7f19500b15d0 2024-04-25T02:22:52.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.376+0000 7f1956816700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19500a52b0 con 0x7f1950137be0 2024-04-25T02:22:52.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.376+0000 7f1956816700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19500adc80 con 0x7f19500a5a90 2024-04-25T02:22:52.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.377+0000 7f1947fff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f19500a5a90 0x7f19501376a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:52.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.377+0000 7f1947fff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f19500a5a90 0x7f19501376a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:32804/0 (socket says 172.21.15.111:32804) 2024-04-25T02:22:52.380 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.377+0000 7f1947fff700 1 -- 172.21.15.111:0/2069210923 learned_addr learned my addr 172.21.15.111:0/2069210923 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:22:52.383 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.377+0000 7f1947fff700 1 -- 172.21.15.111:0/2069210923 >> v2:172.21.15.111:3300/0 conn(0x7f1950137be0 msgr2=0x7f1950144e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:22:52.383 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.377+0000 7f1947fff700 1 --2- 172.21.15.111:0/2069210923 >> v2:172.21.15.111:3300/0 conn(0x7f1950137be0 0x7f1950144e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.384 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.377+0000 7f1947fff700 1 -- 172.21.15.111:0/2069210923 >> v1:172.21.15.111:6789/0 conn(0x7f19500b15d0 legacy=0x7f19500a4610 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T02:22:52.384 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.377+0000 7f1947fff700 1 -- 172.21.15.111:0/2069210923 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19500adf20 con 0x7f19500a5a90 2024-04-25T02:22:52.384 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.377+0000 7f1947fff700 1 --2- 172.21.15.111:0/2069210923 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f19500a5a90 0x7f19501376a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f194000d050 tx=0x7f19400082d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea75fdee270ff36e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:52.384 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.378+0000 7f194f7fe700 1 -- 172.21.15.111:0/2069210923 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1940010070 con 0x7f19500a5a90 2024-04-25T02:22:52.384 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.378+0000 7f194f7fe700 1 -- 172.21.15.111:0/2069210923 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f194000dae0 con 0x7f19500a5a90 2024-04-25T02:22:52.385 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.378+0000 7f194f7fe700 1 -- 172.21.15.111:0/2069210923 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f194000de80 con 0x7f19500a5a90 2024-04-25T02:22:52.385 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.378+0000 7f1956816700 1 -- 172.21.15.111:0/2069210923 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f19500a5a90 msgr2=0x7f19501376a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:52.385 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.378+0000 7f1956816700 1 --2- 172.21.15.111:0/2069210923 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f19500a5a90 0x7f19501376a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f194000d050 tx=0x7f19400082d0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.385 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.378+0000 7f1956816700 1 -- 172.21.15.111:0/2069210923 shutdown_connections 2024-04-25T02:22:52.385 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.378+0000 7f1956816700 1 --2- 172.21.15.111:0/2069210923 >> v2:172.21.15.111:3300/0 conn(0x7f1950137be0 0x7f1950144e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.386 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.379+0000 7f1956816700 1 --2- 172.21.15.111:0/2069210923 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f19500a5a90 0x7f19501376a0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.386 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.379+0000 7f1956816700 1 -- 172.21.15.111:0/2069210923 >> 172.21.15.111:0/2069210923 conn(0x7f195006c040 msgr2=0x7f1950069a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:52.386 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.379+0000 7f1956816700 1 -- 172.21.15.111:0/2069210923 shutdown_connections 2024-04-25T02:22:52.386 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.379+0000 7f1956816700 1 -- 172.21.15.111:0/2069210923 wait complete. 2024-04-25T02:22:52.387 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.380+0000 7f1956816700 1 Processor -- start 2024-04-25T02:22:52.387 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.380+0000 7f1956816700 1 -- start start 2024-04-25T02:22:52.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.381+0000 7f1956816700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f19500a5a90 0x7f19500a0550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:52.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.381+0000 7f1956816700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f19500b15d0 0x7f1950152c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:52.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.381+0000 7f1956816700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1950137be0 0x7f1950153140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:52.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.381+0000 7f1956816700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19500a1cd0 con 0x7f1950137be0 2024-04-25T02:22:52.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.381+0000 7f1956816700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19500a1a60 con 0x7f19500a5a90 2024-04-25T02:22:52.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.381+0000 7f1956816700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f19500a0c10 con 0x7f19500b15d0 2024-04-25T02:22:52.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.381+0000 7f1947fff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f19500b15d0 0x7f1950152c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:52.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.381+0000 7f1947fff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f19500b15d0 0x7f1950152c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:57774/0 (socket says 172.21.15.111:57774) 2024-04-25T02:22:52.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.381+0000 7f1947fff700 1 -- 172.21.15.111:0/3741179441 learned_addr learned my addr 172.21.15.111:0/3741179441 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:22:52.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.381+0000 7f1954db3700 1 --2- 172.21.15.111:0/3741179441 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1950137be0 0x7f1950153140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:52.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.381+0000 7f194ffff700 1 --2- 172.21.15.111:0/3741179441 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f19500a5a90 0x7f19500a0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:52.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.382+0000 7f194ffff700 1 -- 172.21.15.111:0/3741179441 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f19500b15d0 msgr2=0x7f1950152c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:52.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.382+0000 7f194ffff700 1 --2- 172.21.15.111:0/3741179441 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f19500b15d0 0x7f1950152c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.382+0000 7f194ffff700 1 -- 172.21.15.111:0/3741179441 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1950137be0 msgr2=0x7f1950153140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:52.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.382+0000 7f194ffff700 1 --2- 172.21.15.111:0/3741179441 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1950137be0 0x7f1950153140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.382+0000 7f194ffff700 1 -- 172.21.15.111:0/3741179441 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1940008570 con 0x7f19500a5a90 2024-04-25T02:22:52.392 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.382+0000 7f1954db3700 1 --2- 172.21.15.111:0/3741179441 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1950137be0 0x7f1950153140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:22:52.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.382+0000 7f194ffff700 1 --2- 172.21.15.111:0/3741179441 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f19500a5a90 0x7f19500a0550 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f193800b5b0 tx=0x7f19380090f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:52.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.382+0000 7f194cff9700 1 -- 172.21.15.111:0/3741179441 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193800f510 con 0x7f19500a5a90 2024-04-25T02:22:52.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.382+0000 7f194cff9700 1 -- 172.21.15.111:0/3741179441 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f193800f670 con 0x7f19500a5a90 2024-04-25T02:22:52.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.382+0000 7f194cff9700 1 -- 172.21.15.111:0/3741179441 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f193800fa10 con 0x7f19500a5a90 2024-04-25T02:22:52.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.382+0000 7f1956816700 1 -- 172.21.15.111:0/3741179441 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1950152870 con 0x7f19500a5a90 2024-04-25T02:22:52.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.382+0000 7f1956816700 1 -- 172.21.15.111:0/3741179441 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f195013e790 con 0x7f19500a5a90 2024-04-25T02:22:52.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.383+0000 7f1956816700 1 -- 172.21.15.111:0/3741179441 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f1950065190 con 0x7f19500a5a90 2024-04-25T02:22:52.394 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.384+0000 7f194cff9700 1 -- 172.21.15.111:0/3741179441 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 6) v1 ==== 42206+0+0 (secure 0 0 0) 0x7f193801a3b0 con 0x7f19500a5a90 2024-04-25T02:22:52.394 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.384+0000 7f2cdbd39700 1 Processor -- start 2024-04-25T02:22:52.395 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.384+0000 7f2cdbd39700 1 -- start start 2024-04-25T02:22:52.395 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.384+0000 7f194cff9700 1 -- 172.21.15.111:0/3741179441 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f193804abc0 con 0x7f19500a5a90 2024-04-25T02:22:52.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.384+0000 7f194cff9700 1 -- 172.21.15.111:0/3741179441 --> v1:172.21.15.111:6812/40216 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f1930045e50 con 0x7f1930042170 2024-04-25T02:22:52.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.384+0000 7f194cff9700 1 -- 172.21.15.111:0/3741179441 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f193804f220 con 0x7f19500a5a90 2024-04-25T02:22:52.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.384+0000 7f1947fff700 1 -- 172.21.15.111:0/3741179441 >> v1:172.21.15.111:6816/39585 conn(0x7f19300394d0 legacy=0x7f193003b980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.111:6816/39585 2024-04-25T02:22:52.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.385+0000 7f2cdbd39700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2cd40b2650 0x7f2cd40a4300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:52.398 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.385+0000 7f2cdbd39700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2cd40a3c60 0x7f2cd413fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:52.399 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.385+0000 7f2cdbd39700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2cd413f940 con 0x7f2cd40a6140 2024-04-25T02:22:52.399 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.385+0000 7f2cdbd39700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd40a4840 con 0x7f2cd40b2650 2024-04-25T02:22:52.399 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.385+0000 7f2cdbd39700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd413f630 con 0x7f2cd40a3c60 2024-04-25T02:22:52.399 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.385+0000 7f2cd92d4700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2cd40a3c60 0x7f2cd413fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:52.399 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.385+0000 7f2cd92d4700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2cd40a3c60 0x7f2cd413fbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:57782/0 (socket says 172.21.15.111:57782) 2024-04-25T02:22:52.400 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.385+0000 7f2cd92d4700 1 -- 172.21.15.111:0/4011182497 learned_addr learned my addr 172.21.15.111:0/4011182497 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:22:52.400 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.385+0000 7f2cd9ad5700 1 --2- 172.21.15.111:0/4011182497 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2cd40b2650 0x7f2cd40a4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:52.400 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.385+0000 7f2cd92d4700 1 -- 172.21.15.111:0/4011182497 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2cd40b2650 msgr2=0x7f2cd40a4300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:22:52.400 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.385+0000 7f2cd92d4700 1 --2- 172.21.15.111:0/4011182497 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2cd40b2650 0x7f2cd40a4300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.400 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.385+0000 7f2cd92d4700 1 -- 172.21.15.111:0/4011182497 >> v1:172.21.15.111:6789/0 conn(0x7f2cd40a6140 legacy=0x7f2cd4067940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:52.401 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.385+0000 7f2cd92d4700 1 -- 172.21.15.111:0/4011182497 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd40a4d40 con 0x7f2cd40a3c60 2024-04-25T02:22:52.401 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.385+0000 7f2cd92d4700 1 --2- 172.21.15.111:0/4011182497 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2cd40a3c60 0x7f2cd413fbe0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc009f50 tx=0x7f2ccc009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=70bf6dd18c89aef4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:52.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.386+0000 7f5755e52700 1 -- 172.21.15.111:0/279028947 --> v1:172.21.15.111:6804/40215 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f575006e310 con 0x7f575014a330 2024-04-25T02:22:52.402 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.386+0000 7f57477fe700 1 -- 172.21.15.111:0/279028947 <== osd.2 v1:172.21.15.111:6804/40215 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 3476117139) 0x7f575006e310 con 0x7f575014a330 2024-04-25T02:22:52.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.386+0000 7f194cff9700 1 -- 172.21.15.111:0/3741179441 <== osd.1 v1:172.21.15.111:6812/40216 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (unknown 0 0 2423311318) 0x7f1930045e50 con 0x7f1930042170 2024-04-25T02:22:52.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.386+0000 7f5755e52700 1 -- 172.21.15.111:0/279028947 >> v1:172.21.15.111:6804/40215 conn(0x7f575014a330 legacy=0x7f5750152bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:52.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.386+0000 7f5755e52700 1 -- 172.21.15.111:0/279028947 >> v1:172.21.15.111:6816/39585 conn(0x7f5730039520 legacy=0x7f573003b9d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T02:22:52.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.387+0000 7f5755e52700 1 -- 172.21.15.111:0/279028947 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5750063c90 msgr2=0x7f575014a860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:52.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.387+0000 7f5755e52700 1 --2- 172.21.15.111:0/279028947 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5750063c90 0x7f575014a860 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f5738006fd0 tx=0x7f5738008040 comp rx=0 tx=0).stop 2024-04-25T02:22:52.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.387+0000 7f574ffff700 1 -- 172.21.15.111:0/279028947 reap_dead start 2024-04-25T02:22:52.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.387+0000 7f5755e52700 1 -- 172.21.15.111:0/279028947 shutdown_connections 2024-04-25T02:22:52.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.387+0000 7f5755e52700 1 -- 172.21.15.111:0/279028947 >> 172.21.15.111:0/279028947 conn(0x7f57500b1390 msgr2=0x7f5750142b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:52.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.387+0000 7f5755e52700 1 -- 172.21.15.111:0/279028947 shutdown_connections 2024-04-25T02:22:52.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.387+0000 7f5755e52700 1 -- 172.21.15.111:0/279028947 wait complete. 2024-04-25T02:22:52.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.390+0000 7f2cd8ad3700 1 -- 172.21.15.111:0/4011182497 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc00e070 con 0x7f2cd40a3c60 2024-04-25T02:22:52.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.390+0000 7f2cd8ad3700 1 -- 172.21.15.111:0/4011182497 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ccc00bab0 con 0x7f2cd40a3c60 2024-04-25T02:22:52.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.390+0000 7f2cd8ad3700 1 -- 172.21.15.111:0/4011182497 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc0092e0 con 0x7f2cd40a3c60 2024-04-25T02:22:52.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.391+0000 7f2cdbd39700 1 -- 172.21.15.111:0/4011182497 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2cd40a3c60 msgr2=0x7f2cd413fbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:52.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.391+0000 7f2cdbd39700 1 --2- 172.21.15.111:0/4011182497 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2cd40a3c60 0x7f2cd413fbe0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc009f50 tx=0x7f2ccc009840 comp rx=0 tx=0).stop 2024-04-25T02:22:52.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.391+0000 7f496f2ad700 1 -- 172.21.15.111:0/3289605941 --> v1:172.21.15.111:6808/40213 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f4968068930 con 0x7f494c0420f0 2024-04-25T02:22:52.409 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.394+0000 7f2cdbd39700 1 -- 172.21.15.111:0/4011182497 shutdown_connections 2024-04-25T02:22:52.409 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.394+0000 7f2cdbd39700 1 --2- 172.21.15.111:0/4011182497 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2cd40b2650 0x7f2cd40a4300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.409 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.394+0000 7f2cdbd39700 1 --2- 172.21.15.111:0/4011182497 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2cd40a3c60 0x7f2cd413fbe0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.409 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.394+0000 7f2cdbd39700 1 -- 172.21.15.111:0/4011182497 >> 172.21.15.111:0/4011182497 conn(0x7f2cd406ac90 msgr2=0x7f2cd40b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:52.409 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.394+0000 7f2cdbd39700 1 -- 172.21.15.111:0/4011182497 shutdown_connections 2024-04-25T02:22:52.410 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.394+0000 7f495d7fa700 1 -- 172.21.15.111:0/3289605941 <== osd.3 v1:172.21.15.111:6808/40213 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 1665788340) 0x7f4968068930 con 0x7f494c0420f0 2024-04-25T02:22:52.411 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.394+0000 7f2cdbd39700 1 -- 172.21.15.111:0/4011182497 wait complete. 2024-04-25T02:22:52.411 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.395+0000 7f496f2ad700 1 -- 172.21.15.111:0/3289605941 >> v1:172.21.15.111:6808/40213 conn(0x7f494c0420f0 legacy=0x7f494c044560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:52.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.395+0000 7f496f2ad700 1 -- 172.21.15.111:0/3289605941 >> v1:172.21.15.111:6816/39585 conn(0x7f494c0394d0 legacy=0x7f494c03b980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T02:22:52.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.395+0000 7f496f2ad700 1 -- 172.21.15.111:0/3289605941 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f496806ef00 msgr2=0x7f49680a66a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:52.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.395+0000 7f496f2ad700 1 --2- 172.21.15.111:0/3289605941 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f496806ef00 0x7f49680a66a0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f4960007e80 tx=0x7f4960009330 comp rx=0 tx=0).stop 2024-04-25T02:22:52.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.395+0000 7f496d84a700 1 -- 172.21.15.111:0/3289605941 reap_dead start 2024-04-25T02:22:52.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.395+0000 7f2cdbd39700 1 Processor -- start 2024-04-25T02:22:52.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.395+0000 7f496f2ad700 1 -- 172.21.15.111:0/3289605941 shutdown_connections 2024-04-25T02:22:52.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.395+0000 7f496f2ad700 1 -- 172.21.15.111:0/3289605941 >> 172.21.15.111:0/3289605941 conn(0x7f4968069bf0 msgr2=0x7f4968071320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:52.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.396+0000 7f2cdbd39700 1 -- start start 2024-04-25T02:22:52.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.397+0000 7f2cdbd39700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2cd40a3c60 0x7f2cd40a9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:52.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.397+0000 7f2cdbd39700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2cd40a6140 0x7f2cd413d900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:52.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.397+0000 7f2cdbd39700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2cd40b2650 0x7f2cd413de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:52.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.397+0000 7f2cdbd39700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd40a76f0 con 0x7f2cd40a6140 2024-04-25T02:22:52.417 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.397+0000 7f2cdbd39700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd40a96c0 con 0x7f2cd40a3c60 2024-04-25T02:22:52.417 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.397+0000 7f2cdbd39700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2cd40a7920 con 0x7f2cd40b2650 2024-04-25T02:22:52.417 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.397+0000 7f2cda2d6700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2cd40b2650 0x7f2cd413de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:52.417 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.397+0000 7f2cda2d6700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2cd40b2650 0x7f2cd413de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:57790/0 (socket says 172.21.15.111:57790) 2024-04-25T02:22:52.417 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.397+0000 7f2cd92d4700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2cd40a6140 0x7f2cd413d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:52.417 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.397+0000 7f2cda2d6700 1 -- 172.21.15.111:0/4194821747 learned_addr learned my addr 172.21.15.111:0/4194821747 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:22:52.417 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.398+0000 7f2cd92d4700 1 -- 172.21.15.111:0/4194821747 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2cd40b2650 msgr2=0x7f2cd413de40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:52.417 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.398+0000 7f2cd92d4700 1 --2- 172.21.15.111:0/4194821747 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2cd40b2650 0x7f2cd413de40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.398+0000 7f2cd92d4700 1 -- 172.21.15.111:0/4194821747 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2cd40a3c60 msgr2=0x7f2cd40a9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:52.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.398+0000 7f2cd92d4700 1 --2- 172.21.15.111:0/4194821747 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2cd40a3c60 0x7f2cd40a9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.398+0000 7f2cd92d4700 1 -- 172.21.15.111:0/4194821747 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ccc009ae0 con 0x7f2cd40a6140 2024-04-25T02:22:52.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.398+0000 7f2cda2d6700 1 --2- 172.21.15.111:0/4194821747 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2cd40b2650 0x7f2cd413de40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:22:52.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.398+0000 7f2cd92d4700 1 --2- 172.21.15.111:0/4194821747 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2cd40a6140 0x7f2cd413d900 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc015000 tx=0x7f2ccc018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:52.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.398+0000 7f2cc9ffb700 1 -- 172.21.15.111:0/4194821747 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc008a80 con 0x7f2cd40a6140 2024-04-25T02:22:52.419 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.398+0000 7f2cc9ffb700 1 -- 172.21.15.111:0/4194821747 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ccc008be0 con 0x7f2cd40a6140 2024-04-25T02:22:52.419 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.398+0000 7f2cc9ffb700 1 -- 172.21.15.111:0/4194821747 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ccc026460 con 0x7f2cd40a6140 2024-04-25T02:22:52.419 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.398+0000 7f2cdbd39700 1 -- 172.21.15.111:0/4194821747 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cd40a7bc0 con 0x7f2cd40a6140 2024-04-25T02:22:52.419 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.398+0000 7f2cdbd39700 1 -- 172.21.15.111:0/4194821747 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cd413e380 con 0x7f2cd40a6140 2024-04-25T02:22:52.419 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.399+0000 7f2cdbd39700 1 -- 172.21.15.111:0/4194821747 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f2cd4146470 con 0x7f2cd40a6140 2024-04-25T02:22:52.419 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.400+0000 7f2cc9ffb700 1 -- 172.21.15.111:0/4194821747 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 6) v1 ==== 42206+0+0 (secure 0 0 0) 0x7f2ccc003040 con 0x7f2cd40a6140 2024-04-25T02:22:52.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.399+0000 7f496f2ad700 1 -- 172.21.15.111:0/3289605941 shutdown_connections 2024-04-25T02:22:52.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.400+0000 7f2cc9ffb700 1 -- 172.21.15.111:0/4194821747 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f2ccc04ce30 con 0x7f2cd40a6140 2024-04-25T02:22:52.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.400+0000 7f2cc9ffb700 1 -- 172.21.15.111:0/4194821747 --> v1:172.21.15.111:6800/40214 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2cb8045d50 con 0x7f2cb8042070 2024-04-25T02:22:52.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.400+0000 7f2cd9ad5700 1 -- 172.21.15.111:0/4194821747 >> v1:172.21.15.111:6816/39585 conn(0x7f2cb80394d0 legacy=0x7f2cb803b980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.111:6816/39585 2024-04-25T02:22:52.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.400+0000 7f2cc9ffb700 1 -- 172.21.15.111:0/4194821747 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2ccc008250 con 0x7f2cd40a6140 2024-04-25T02:22:52.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.401+0000 7f496f2ad700 1 -- 172.21.15.111:0/3289605941 wait complete. 2024-04-25T02:22:52.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.404+0000 7f1956816700 1 -- 172.21.15.111:0/3741179441 --> v1:172.21.15.111:6812/40216 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f19500ad7b0 con 0x7f1930042170 2024-04-25T02:22:52.422 INFO:teuthology.orchestra.run.smithi111.stdout:38654705699 2024-04-25T02:22:52.422 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T02:22:52.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.407+0000 7f194cff9700 1 -- 172.21.15.111:0/3741179441 <== osd.1 v1:172.21.15.111:6812/40216 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 1029363088) 0x7f19500ad7b0 con 0x7f1930042170 2024-04-25T02:22:52.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.408+0000 7f1956816700 1 -- 172.21.15.111:0/3741179441 >> v1:172.21.15.111:6812/40216 conn(0x7f1930042170 legacy=0x7f19300445e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:52.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.408+0000 7f1956816700 1 -- 172.21.15.111:0/3741179441 >> v1:172.21.15.111:6816/39585 conn(0x7f19300394d0 legacy=0x7f193003b980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T02:22:52.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.408+0000 7f1956816700 1 -- 172.21.15.111:0/3741179441 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f19500a5a90 msgr2=0x7f19500a0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:52.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.408+0000 7f1956816700 1 --2- 172.21.15.111:0/3741179441 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f19500a5a90 0x7f19500a0550 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f193800b5b0 tx=0x7f19380090f0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.408+0000 7f1954db3700 1 -- 172.21.15.111:0/3741179441 reap_dead start 2024-04-25T02:22:52.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.408+0000 7f1956816700 1 -- 172.21.15.111:0/3741179441 shutdown_connections 2024-04-25T02:22:52.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.408+0000 7f1956816700 1 -- 172.21.15.111:0/3741179441 >> 172.21.15.111:0/3741179441 conn(0x7f195006c040 msgr2=0x7f1950064900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:52.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.408+0000 7f2cc9ffb700 1 -- 172.21.15.111:0/4194821747 <== osd.0 v1:172.21.15.111:6800/40214 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23441 (unknown 0 0 2423311318) 0x7f2cb8045d50 con 0x7f2cb8042070 2024-04-25T02:22:52.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.409+0000 7f1956816700 1 -- 172.21.15.111:0/3741179441 shutdown_connections 2024-04-25T02:22:52.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.409+0000 7f1956816700 1 -- 172.21.15.111:0/3741179441 wait complete. 2024-04-25T02:22:52.425 INFO:teuthology.orchestra.run.smithi111.stdout:38654705697 2024-04-25T02:22:52.426 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T02:22:52.426 INFO:teuthology.orchestra.run.smithi111.stdout:38654705698 2024-04-25T02:22:52.427 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T02:22:52.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.424+0000 7f2cdbd39700 1 -- 172.21.15.111:0/4194821747 --> v1:172.21.15.111:6800/40214 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f2cd406ecd0 con 0x7f2cb8042070 2024-04-25T02:22:52.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.424+0000 7f2cc9ffb700 1 -- 172.21.15.111:0/4194821747 <== osd.0 v1:172.21.15.111:6800/40214 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (unknown 0 0 1665788340) 0x7f2cd406ecd0 con 0x7f2cb8042070 2024-04-25T02:22:52.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.425+0000 7f2cdbd39700 1 -- 172.21.15.111:0/4194821747 >> v1:172.21.15.111:6800/40214 conn(0x7f2cb8042070 legacy=0x7f2cb80444e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:52.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.425+0000 7f2cdbd39700 1 -- 172.21.15.111:0/4194821747 >> v1:172.21.15.111:6816/39585 conn(0x7f2cb80394d0 legacy=0x7f2cb803b980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T02:22:52.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.425+0000 7f2cdbd39700 1 -- 172.21.15.111:0/4194821747 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2cd40a6140 msgr2=0x7f2cd413d900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:52.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.425+0000 7f2cdbd39700 1 --2- 172.21.15.111:0/4194821747 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2cd40a6140 0x7f2cd413d900 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f2ccc015000 tx=0x7f2ccc018000 comp rx=0 tx=0).stop 2024-04-25T02:22:52.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.425+0000 7f2cda2d6700 1 -- 172.21.15.111:0/4194821747 reap_dead start 2024-04-25T02:22:52.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.425+0000 7f2cdbd39700 1 -- 172.21.15.111:0/4194821747 shutdown_connections 2024-04-25T02:22:52.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.425+0000 7f2cdbd39700 1 -- 172.21.15.111:0/4194821747 >> 172.21.15.111:0/4194821747 conn(0x7f2cd406ac90 msgr2=0x7f2cd4068090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:52.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.425+0000 7f2cdbd39700 1 -- 172.21.15.111:0/4194821747 shutdown_connections 2024-04-25T02:22:52.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.425+0000 7f2cdbd39700 1 -- 172.21.15.111:0/4194821747 wait complete. 2024-04-25T02:22:52.444 INFO:teuthology.orchestra.run.smithi111.stdout:38654705697 2024-04-25T02:22:52.444 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T02:22:52.517 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-25T02:22:52.515+0000 7f1f561191c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T02:22:52.543 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-04-25T02:22:52.541+0000 7f5e56aad1c0 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-25T02:22:52.585 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.583+0000 7fb1259b3700 1 Processor -- start 2024-04-25T02:22:52.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.583+0000 7fb1259b3700 1 -- start start 2024-04-25T02:22:52.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.584+0000 7fb1259b3700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fb1200ad610 0x7fb12006e230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:52.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.584+0000 7fb1259b3700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb12013ae70 0x7fb12013b240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:52.587 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.584+0000 7fb1259b3700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb12006da50 con 0x7fb120063a30 2024-04-25T02:22:52.587 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.584+0000 7fb1259b3700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb12006e770 con 0x7fb1200ad610 2024-04-25T02:22:52.587 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.584+0000 7fb1259b3700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb12006ee40 con 0x7fb12013ae70 2024-04-25T02:22:52.588 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.586+0000 7fb11effd700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fb1200ad610 0x7fb12006e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:52.588 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.586+0000 7fb11effd700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fb1200ad610 0x7fb12006e230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:53166/0 (socket says 172.21.15.111:53166) 2024-04-25T02:22:52.588 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.586+0000 7fb11effd700 1 -- 172.21.15.111:0/1978561077 learned_addr learned my addr 172.21.15.111:0/1978561077 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:22:52.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.586+0000 7fb11effd700 1 -- 172.21.15.111:0/1978561077 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb12013ae70 msgr2=0x7fb12013b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:22:52.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.586+0000 7fb11effd700 1 --2- 172.21.15.111:0/1978561077 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb12013ae70 0x7fb12013b240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.586+0000 7fb11effd700 1 -- 172.21.15.111:0/1978561077 >> v1:172.21.15.111:6789/0 conn(0x7fb120063a30 legacy=0x7fb12013dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:52.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.586+0000 7fb11effd700 1 -- 172.21.15.111:0/1978561077 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb12006dd30 con 0x7fb1200ad610 2024-04-25T02:22:52.589 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.587+0000 7fb11effd700 1 --2- 172.21.15.111:0/1978561077 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb1200ad610 0x7fb12006e230 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb1080099b0 tx=0x7fb108009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f97cb16cecee24d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:52.590 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.587+0000 7fb11dffb700 1 -- 172.21.15.111:0/1978561077 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10800b860 con 0x7fb1200ad610 2024-04-25T02:22:52.590 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.588+0000 7fb11dffb700 1 -- 172.21.15.111:0/1978561077 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb10800b9c0 con 0x7fb1200ad610 2024-04-25T02:22:52.590 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.588+0000 7fb11dffb700 1 -- 172.21.15.111:0/1978561077 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb10800bd60 con 0x7fb1200ad610 2024-04-25T02:22:52.590 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.588+0000 7f8be24b4700 1 Processor -- start 2024-04-25T02:22:52.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.589+0000 7fb1259b3700 1 -- 172.21.15.111:0/1978561077 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb1200ad610 msgr2=0x7fb12006e230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:52.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.589+0000 7fb1259b3700 1 --2- 172.21.15.111:0/1978561077 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb1200ad610 0x7fb12006e230 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fb1080099b0 tx=0x7fb108009250 comp rx=0 tx=0).stop 2024-04-25T02:22:52.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.589+0000 7fb1259b3700 1 -- 172.21.15.111:0/1978561077 shutdown_connections 2024-04-25T02:22:52.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.589+0000 7fb1259b3700 1 --2- 172.21.15.111:0/1978561077 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb1200ad610 0x7fb12006e230 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.589+0000 7fb1259b3700 1 --2- 172.21.15.111:0/1978561077 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb12013ae70 0x7fb12013b240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.589+0000 7fb1259b3700 1 -- 172.21.15.111:0/1978561077 >> 172.21.15.111:0/1978561077 conn(0x7fb1200b1400 msgr2=0x7fb1200b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:52.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.589+0000 7fb1259b3700 1 -- 172.21.15.111:0/1978561077 shutdown_connections 2024-04-25T02:22:52.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.588+0000 7f8be24b4700 1 -- start start 2024-04-25T02:22:52.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.589+0000 7f8be24b4700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f8bdc063d30 0x7f8bdc06e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:52.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.589+0000 7f8be24b4700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8bdc06d960 0x7f8bdc142fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:52.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.589+0000 7f8be24b4700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8bdc1434e0 0x7f8bdc145dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:52.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.589+0000 7f8be24b4700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bdc064100 con 0x7f8bdc063d30 2024-04-25T02:22:52.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.589+0000 7f8be24b4700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bdc0abe90 con 0x7f8bdc06d960 2024-04-25T02:22:52.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.589+0000 7f8be24b4700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8bdc0ac130 con 0x7f8bdc1434e0 2024-04-25T02:22:52.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.589+0000 7f8bdbfff700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f8bdc063d30 0x7f8bdc06e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:52.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.589+0000 7f8bdbfff700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f8bdc063d30 0x7f8bdc06e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:53180/0 (socket says 172.21.15.111:53180) 2024-04-25T02:22:52.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.589+0000 7f8bdbfff700 1 -- 172.21.15.111:0/3041247604 learned_addr learned my addr 172.21.15.111:0/3041247604 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:22:52.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.589+0000 7f8bdbfff700 1 -- 172.21.15.111:0/3041247604 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8bdc1434e0 msgr2=0x7f8bdc145dc0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T02:22:52.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.589+0000 7f8bdbfff700 1 --2- 172.21.15.111:0/3041247604 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8bdc1434e0 0x7f8bdc145dc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.589+0000 7f8bdbfff700 1 -- 172.21.15.111:0/3041247604 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8bdc06d960 msgr2=0x7f8bdc142fa0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T02:22:52.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.589+0000 7f8bdbfff700 1 --2- 172.21.15.111:0/3041247604 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8bdc06d960 0x7f8bdc142fa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.589+0000 7f8bdbfff700 1 -- 172.21.15.111:0/3041247604 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bdc068950 con 0x7f8bdc063d30 2024-04-25T02:22:52.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.589+0000 7f8bdbfff700 1 --2- 172.21.15.111:0/3041247604 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8bdc063d30 0x7f8bdc06e4e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4009f20 tx=0x7f8bd4009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fb84cb6ba88968f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:52.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.589+0000 7f8bdaffd700 1 -- 172.21.15.111:0/3041247604 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd400e070 con 0x7f8bdc063d30 2024-04-25T02:22:52.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.590+0000 7f8bdaffd700 1 -- 172.21.15.111:0/3041247604 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bd400ba80 con 0x7f8bdc063d30 2024-04-25T02:22:52.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.590+0000 7f8bdaffd700 1 -- 172.21.15.111:0/3041247604 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd40092e0 con 0x7f8bdc063d30 2024-04-25T02:22:52.596 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.589+0000 7fb1259b3700 1 -- 172.21.15.111:0/1978561077 wait complete. 2024-04-25T02:22:52.596 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.590+0000 7fb1259b3700 1 Processor -- start 2024-04-25T02:22:52.596 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.591+0000 7fb1259b3700 1 -- start start 2024-04-25T02:22:52.596 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.591+0000 7fb1259b3700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb120063a30 0x7fb1200a6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:52.596 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.591+0000 7fb1259b3700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb1200ad610 0x7fb1200a9360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:52.596 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.591+0000 7fb1259b3700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb12013ae70 0x7fb1200a54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:52.597 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.591+0000 7fb1259b3700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb1200a86e0 con 0x7fb12013ae70 2024-04-25T02:22:52.597 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.591+0000 7fb1259b3700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb1200a98a0 con 0x7fb120063a30 2024-04-25T02:22:52.597 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.591+0000 7fb1259b3700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb1200a7f60 con 0x7fb1200ad610 2024-04-25T02:22:52.597 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.591+0000 7fb11effd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb120063a30 0x7fb1200a6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:52.597 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.591+0000 7fb11effd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb120063a30 0x7fb1200a6e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:32848/0 (socket says 172.21.15.111:32848) 2024-04-25T02:22:52.597 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.592+0000 7fb11effd700 1 -- 172.21.15.111:0/2102390253 learned_addr learned my addr 172.21.15.111:0/2102390253 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:22:52.597 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.592+0000 7fb11f7fe700 1 --2- 172.21.15.111:0/2102390253 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb12013ae70 0x7fb1200a54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:52.597 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.592+0000 7fb11effd700 1 -- 172.21.15.111:0/2102390253 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb1200ad610 msgr2=0x7fb1200a9360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:52.597 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.592+0000 7fb11effd700 1 --2- 172.21.15.111:0/2102390253 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb1200ad610 0x7fb1200a9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.597 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.592+0000 7fb11effd700 1 -- 172.21.15.111:0/2102390253 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb12013ae70 msgr2=0x7fb1200a54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:52.597 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.592+0000 7fb11effd700 1 --2- 172.21.15.111:0/2102390253 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb12013ae70 0x7fb1200a54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.597 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.592+0000 7fb11effd700 1 -- 172.21.15.111:0/2102390253 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb1080094f0 con 0x7fb120063a30 2024-04-25T02:22:52.597 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.592+0000 7fb11f7fe700 1 --2- 172.21.15.111:0/2102390253 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb12013ae70 0x7fb1200a54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:22:52.597 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.592+0000 7fb11effd700 1 --2- 172.21.15.111:0/2102390253 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb120063a30 0x7fb1200a6e80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb108009290 tx=0x7fb108017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:52.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.591+0000 7f8be24b4700 1 -- 172.21.15.111:0/3041247604 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8bdc063d30 msgr2=0x7f8bdc06e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:52.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.591+0000 7f8be24b4700 1 --2- 172.21.15.111:0/3041247604 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8bdc063d30 0x7f8bdc06e4e0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4009f20 tx=0x7f8bd4009840 comp rx=0 tx=0).stop 2024-04-25T02:22:52.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.592+0000 7fb116ffd700 1 -- 172.21.15.111:0/2102390253 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb108026480 con 0x7fb120063a30 2024-04-25T02:22:52.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.592+0000 7fb116ffd700 1 -- 172.21.15.111:0/2102390253 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb10801f070 con 0x7fb120063a30 2024-04-25T02:22:52.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.592+0000 7fb116ffd700 1 -- 172.21.15.111:0/2102390253 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb108026850 con 0x7fb120063a30 2024-04-25T02:22:52.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.592+0000 7fb1259b3700 1 -- 172.21.15.111:0/2102390253 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1200a8200 con 0x7fb120063a30 2024-04-25T02:22:52.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.592+0000 7fb1259b3700 1 -- 172.21.15.111:0/2102390253 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb120141140 con 0x7fb120063a30 2024-04-25T02:22:52.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.593+0000 7f8be24b4700 1 -- 172.21.15.111:0/3041247604 shutdown_connections 2024-04-25T02:22:52.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.593+0000 7f8be24b4700 1 --2- 172.21.15.111:0/3041247604 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8bdc1434e0 0x7f8bdc145dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.593+0000 7f8be24b4700 1 --2- 172.21.15.111:0/3041247604 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8bdc063d30 0x7f8bdc06e4e0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.593+0000 7f8be24b4700 1 --2- 172.21.15.111:0/3041247604 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8bdc06d960 0x7f8bdc142fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.593+0000 7f8be24b4700 1 -- 172.21.15.111:0/3041247604 >> 172.21.15.111:0/3041247604 conn(0x7f8bdc0b1e10 msgr2=0x7f8bdc0ade80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:52.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.593+0000 7fb1259b3700 1 -- 172.21.15.111:0/2102390253 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb120065190 con 0x7fb120063a30 2024-04-25T02:22:52.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.593+0000 7fb116ffd700 1 -- 172.21.15.111:0/2102390253 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 6) v1 ==== 42206+0+0 (secure 0 0 0) 0x7fb10801a430 con 0x7fb120063a30 2024-04-25T02:22:52.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.594+0000 7f8be24b4700 1 -- 172.21.15.111:0/3041247604 shutdown_connections 2024-04-25T02:22:52.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.594+0000 7fb116ffd700 1 -- 172.21.15.111:0/2102390253 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fb108021070 con 0x7fb120063a30 2024-04-25T02:22:52.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.595+0000 7fb11e7fc700 1 -- 172.21.15.111:0/2102390253 >> v1:172.21.15.111:6816/39585 conn(0x7fb1000394d0 legacy=0x7fb10003b980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.111:6816/39585 2024-04-25T02:22:52.602 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.594+0000 7f8be24b4700 1 -- 172.21.15.111:0/3041247604 wait complete. 2024-04-25T02:22:52.602 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.595+0000 7f8be24b4700 1 Processor -- start 2024-04-25T02:22:52.602 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.595+0000 7f8be24b4700 1 -- start start 2024-04-25T02:22:52.602 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.596+0000 7f8be24b4700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8bdc063d30 0x7f8bdc14a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:52.602 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.596+0000 7f8be24b4700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8bdc06d960 0x7f8bdc0a9ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:52.602 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.596+0000 7f8be24b4700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8bdc1434e0 0x7f8bdc0aa010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:52.602 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.596+0000 7f8be24b4700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bdc0ab1d0 con 0x7f8bdc06d960 2024-04-25T02:22:52.602 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.596+0000 7f8be24b4700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bdc14afe0 con 0x7f8bdc1434e0 2024-04-25T02:22:52.602 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.596+0000 7f8be24b4700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8bdc0aa550 con 0x7f8bdc063d30 2024-04-25T02:22:52.602 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.597+0000 7f8bdbfff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8bdc063d30 0x7f8bdc14a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:52.602 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.597+0000 7f8bdbfff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8bdc063d30 0x7f8bdc14a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:57826/0 (socket says 172.21.15.111:57826) 2024-04-25T02:22:52.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.597+0000 7f8bdbfff700 1 -- 172.21.15.111:0/2542797126 learned_addr learned my addr 172.21.15.111:0/2542797126 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:22:52.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.597+0000 7f8be0a51700 1 --2- 172.21.15.111:0/2542797126 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8bdc1434e0 0x7f8bdc0aa010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:52.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.597+0000 7f8bdbfff700 1 -- 172.21.15.111:0/2542797126 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8bdc1434e0 msgr2=0x7f8bdc0aa010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:52.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.597+0000 7f8bdbfff700 1 --2- 172.21.15.111:0/2542797126 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8bdc1434e0 0x7f8bdc0aa010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.597+0000 7f8bdbfff700 1 -- 172.21.15.111:0/2542797126 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8bdc06d960 msgr2=0x7f8bdc0a9ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:52.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.597+0000 7f8bdbfff700 1 --2- 172.21.15.111:0/2542797126 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8bdc06d960 0x7f8bdc0a9ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.597+0000 7f8bdbfff700 1 -- 172.21.15.111:0/2542797126 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bd4009ae0 con 0x7f8bdc063d30 2024-04-25T02:22:52.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.598+0000 7f8bdbfff700 1 --2- 172.21.15.111:0/2542797126 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8bdc063d30 0x7f8bdc14a610 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8bd400bfa0 tx=0x7f8bd4018000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:52.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.598+0000 7f8bcbfff700 1 -- 172.21.15.111:0/2542797126 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd4008b40 con 0x7f8bdc063d30 2024-04-25T02:22:52.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.598+0000 7f8be24b4700 1 -- 172.21.15.111:0/2542797126 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bdc0a8e20 con 0x7f8bdc063d30 2024-04-25T02:22:52.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.598+0000 7f8be24b4700 1 -- 172.21.15.111:0/2542797126 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bdc0a8860 con 0x7f8bdc063d30 2024-04-25T02:22:52.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.599+0000 7fb116ffd700 1 -- 172.21.15.111:0/2102390253 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+112002 (secure 0 0 0) 0x7fb10801cc40 con 0x7fb120063a30 2024-04-25T02:22:52.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.599+0000 7f8bcbfff700 1 -- 172.21.15.111:0/2542797126 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bd4009940 con 0x7f8bdc063d30 2024-04-25T02:22:52.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.599+0000 7f8bcbfff700 1 -- 172.21.15.111:0/2542797126 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bd4026460 con 0x7f8bdc063d30 2024-04-25T02:22:52.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.601+0000 7f8be24b4700 1 -- 172.21.15.111:0/2542797126 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bb80052a0 con 0x7f8bdc063d30 2024-04-25T02:22:52.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.601+0000 7f8bcbfff700 1 -- 172.21.15.111:0/2542797126 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 6) v1 ==== 42206+0+0 (secure 0 0 0) 0x7f8bd4003040 con 0x7f8bdc063d30 2024-04-25T02:22:52.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.601+0000 7f8bcbfff700 1 -- 172.21.15.111:0/2542797126 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f8bd404d660 con 0x7f8bdc063d30 2024-04-25T02:22:52.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.601+0000 7f8bdb7fe700 1 -- 172.21.15.111:0/2542797126 >> v1:172.21.15.111:6816/39585 conn(0x7f8bc00394d0 legacy=0x7f8bc003b980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.111:6816/39585 2024-04-25T02:22:52.610 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.608+0000 7f8bcbfff700 1 -- 172.21.15.111:0/2542797126 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+112002 (secure 0 0 0) 0x7f8bd400e3f0 con 0x7f8bdc063d30 2024-04-25T02:22:52.611 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.609+0000 7f0f79227700 1 Processor -- start 2024-04-25T02:22:52.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.609+0000 7f0f79227700 1 -- start start 2024-04-25T02:22:52.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.610+0000 7f0f79227700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f0f74063d30 0x7f0f7406e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:52.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.610+0000 7f0f79227700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0f7406d960 0x7f0f74142fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:52.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.610+0000 7f0f79227700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f74064100 con 0x7f0f741434e0 2024-04-25T02:22:52.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.610+0000 7f0f79227700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f740abe90 con 0x7f0f74063d30 2024-04-25T02:22:52.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.610+0000 7f0f79227700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f740ac130 con 0x7f0f7406d960 2024-04-25T02:22:52.615 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.610+0000 7f0f72d9d700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f0f74063d30 0x7f0f7406e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:52.616 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.610+0000 7f0f72d9d700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f0f74063d30 0x7f0f7406e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:53210/0 (socket says 172.21.15.111:53210) 2024-04-25T02:22:52.616 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.610+0000 7f0f72d9d700 1 -- 172.21.15.111:0/3918783850 learned_addr learned my addr 172.21.15.111:0/3918783850 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:22:52.616 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.610+0000 7f0f7259c700 1 --2- 172.21.15.111:0/3918783850 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0f7406d960 0x7f0f74142fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:52.616 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.611+0000 7f0f7259c700 1 -- 172.21.15.111:0/3918783850 >> v2:172.21.15.111:3300/0 conn(0x7f0f74063d30 msgr2=0x7f0f7406e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:22:52.616 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.611+0000 7f0f7259c700 1 --2- 172.21.15.111:0/3918783850 >> v2:172.21.15.111:3300/0 conn(0x7f0f74063d30 0x7f0f7406e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.616 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.611+0000 7f0f7259c700 1 -- 172.21.15.111:0/3918783850 >> v1:172.21.15.111:6789/0 conn(0x7f0f741434e0 legacy=0x7f0f74145dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:52.616 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.611+0000 7f0f7259c700 1 -- 172.21.15.111:0/3918783850 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f74068950 con 0x7f0f7406d960 2024-04-25T02:22:52.616 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.611+0000 7f0f7259c700 1 --2- 172.21.15.111:0/3918783850 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0f7406d960 0x7f0f74142fa0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0f680098e0 tx=0x7f0f680091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=defadac35278bc39 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:52.617 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.611+0000 7f0f71d9b700 1 -- 172.21.15.111:0/3918783850 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6800b640 con 0x7f0f7406d960 2024-04-25T02:22:52.617 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.611+0000 7f0f71d9b700 1 -- 172.21.15.111:0/3918783850 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f6800b7a0 con 0x7f0f7406d960 2024-04-25T02:22:52.617 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.611+0000 7f0f71d9b700 1 -- 172.21.15.111:0/3918783850 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6800bb60 con 0x7f0f7406d960 2024-04-25T02:22:52.617 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.612+0000 7f0f79227700 1 -- 172.21.15.111:0/3918783850 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0f7406d960 msgr2=0x7f0f74142fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:52.617 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.612+0000 7f0f79227700 1 --2- 172.21.15.111:0/3918783850 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0f7406d960 0x7f0f74142fa0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0f680098e0 tx=0x7f0f680091a0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.617 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.612+0000 7f0f79227700 1 -- 172.21.15.111:0/3918783850 shutdown_connections 2024-04-25T02:22:52.617 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.612+0000 7f0f79227700 1 --2- 172.21.15.111:0/3918783850 >> v2:172.21.15.111:3300/0 conn(0x7f0f74063d30 0x7f0f7406e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.617 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.612+0000 7f0f79227700 1 --2- 172.21.15.111:0/3918783850 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0f7406d960 0x7f0f74142fa0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.617 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.612+0000 7f0f79227700 1 -- 172.21.15.111:0/3918783850 >> 172.21.15.111:0/3918783850 conn(0x7f0f740b1e10 msgr2=0x7f0f740ade80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:52.617 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.612+0000 7f0f79227700 1 -- 172.21.15.111:0/3918783850 shutdown_connections 2024-04-25T02:22:52.617 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.613+0000 7f0f79227700 1 -- 172.21.15.111:0/3918783850 wait complete. 2024-04-25T02:22:52.618 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.614+0000 7f0f79227700 1 Processor -- start 2024-04-25T02:22:52.618 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.614+0000 7f0f79227700 1 -- start start 2024-04-25T02:22:52.619 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.615+0000 7f0f79227700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0f74063d30 0x7f0f740a9990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:52.619 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.615+0000 7f0f79227700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0f7406d960 0x7f0f74131640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:52.619 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.615+0000 7f0f79227700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0f741434e0 0x7f0f740a8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:52.619 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.615+0000 7f0f79227700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f74132010 con 0x7f0f7406d960 2024-04-25T02:22:52.619 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.615+0000 7f0f79227700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f74131b80 con 0x7f0f74063d30 2024-04-25T02:22:52.619 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.615+0000 7f0f79227700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f740a7c90 con 0x7f0f741434e0 2024-04-25T02:22:52.619 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.615+0000 7f0f7359e700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0f741434e0 0x7f0f740a8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:52.619 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.615+0000 7f0f7359e700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0f741434e0 0x7f0f740a8950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:57846/0 (socket says 172.21.15.111:57846) 2024-04-25T02:22:52.619 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.615+0000 7f0f7359e700 1 -- 172.21.15.111:0/2845688136 learned_addr learned my addr 172.21.15.111:0/2845688136 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:22:52.619 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.616+0000 7f0f72d9d700 1 --2- 172.21.15.111:0/2845688136 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0f74063d30 0x7f0f740a9990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:52.619 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.616+0000 7f0f7259c700 1 --2- 172.21.15.111:0/2845688136 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0f7406d960 0x7f0f74131640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:52.620 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.616+0000 7f0f72d9d700 1 -- 172.21.15.111:0/2845688136 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0f741434e0 msgr2=0x7f0f740a8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:52.620 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.616+0000 7f0f72d9d700 1 --2- 172.21.15.111:0/2845688136 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0f741434e0 0x7f0f740a8950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.620 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.616+0000 7f0f72d9d700 1 -- 172.21.15.111:0/2845688136 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0f7406d960 msgr2=0x7f0f74131640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:52.620 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.616+0000 7f0f72d9d700 1 --2- 172.21.15.111:0/2845688136 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0f7406d960 0x7f0f74131640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.616+0000 7f0f72d9d700 1 -- 172.21.15.111:0/2845688136 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f68009420 con 0x7f0f74063d30 2024-04-25T02:22:52.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.616+0000 7f0f72d9d700 1 --2- 172.21.15.111:0/2845688136 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0f74063d30 0x7f0f740a9990 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0f64006d40 tx=0x7f0f64009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:52.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.617+0000 7f0f5affd700 1 -- 172.21.15.111:0/2845688136 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f64013680 con 0x7f0f74063d30 2024-04-25T02:22:52.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.617+0000 7f0f5affd700 1 -- 172.21.15.111:0/2845688136 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f640137e0 con 0x7f0f74063d30 2024-04-25T02:22:52.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.617+0000 7f0f79227700 1 -- 172.21.15.111:0/2845688136 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f740a83e0 con 0x7f0f74063d30 2024-04-25T02:22:52.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.617+0000 7f0f5affd700 1 -- 172.21.15.111:0/2845688136 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f64013b60 con 0x7f0f74063d30 2024-04-25T02:22:52.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.617+0000 7f0f79227700 1 -- 172.21.15.111:0/2845688136 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f7414de80 con 0x7f0f74063d30 2024-04-25T02:22:52.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.618+0000 7f0f79227700 1 -- 172.21.15.111:0/2845688136 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f740b0550 con 0x7f0f74063d30 2024-04-25T02:22:52.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.619+0000 7f0f5affd700 1 -- 172.21.15.111:0/2845688136 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 6) v1 ==== 42206+0+0 (secure 0 0 0) 0x7f0f6400c3e0 con 0x7f0f74063d30 2024-04-25T02:22:52.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.620+0000 7f0f5affd700 1 -- 172.21.15.111:0/2845688136 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f0f6404c030 con 0x7f0f74063d30 2024-04-25T02:22:52.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.621+0000 7f0f7259c700 1 -- 172.21.15.111:0/2845688136 >> v1:172.21.15.111:6816/39585 conn(0x7f0f60039500 legacy=0x7f0f6003b9b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.111:6816/39585 2024-04-25T02:22:52.628 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.625+0000 7f0f5affd700 1 -- 172.21.15.111:0/2845688136 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+112002 (secure 0 0 0) 0x7f0f64034470 con 0x7f0f74063d30 2024-04-25T02:22:52.647 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-25T02:22:52.644+0000 7f1f561191c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T02:22:52.652 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-04-25T02:22:52.646+0000 7f5e56aad1c0 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-25T02:22:52.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.679+0000 7f8ed541a700 1 Processor -- start 2024-04-25T02:22:52.682 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.679+0000 7f8ed541a700 1 -- start start 2024-04-25T02:22:52.683 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.680+0000 7f8ed541a700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8ed00a3390 0x7f8ed00a4430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:52.683 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.680+0000 7f8ed541a700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8ed006fb70 0x7f8ed006e170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:52.683 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.680+0000 7f8ed541a700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ed006fff0 con 0x7f8ed0067b90 2024-04-25T02:22:52.684 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.680+0000 7f8ed541a700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed00a2c20 con 0x7f8ed00a3390 2024-04-25T02:22:52.684 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.680+0000 7f8ed541a700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed00a38b0 con 0x7f8ed006fb70 2024-04-25T02:22:52.684 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.680+0000 7f8ecf7fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8ed006fb70 0x7f8ed006e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:52.685 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.681+0000 7f8ecf7fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8ed006fb70 0x7f8ed006e170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:57848/0 (socket says 172.21.15.111:57848) 2024-04-25T02:22:52.685 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.681+0000 7f8ecf7fe700 1 -- 172.21.15.111:0/2088201877 learned_addr learned my addr 172.21.15.111:0/2088201877 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:22:52.685 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.681+0000 7f8ece7fc700 1 --2- 172.21.15.111:0/2088201877 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8ed00a3390 0x7f8ed00a4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:52.685 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.681+0000 7f8ece7fc700 1 -- 172.21.15.111:0/2088201877 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8ed006fb70 msgr2=0x7f8ed006e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:22:52.685 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.681+0000 7f8ece7fc700 1 --2- 172.21.15.111:0/2088201877 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8ed006fb70 0x7f8ed006e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.681+0000 7f8ece7fc700 1 -- 172.21.15.111:0/2088201877 >> v1:172.21.15.111:6789/0 conn(0x7f8ed0067b90 legacy=0x7f8ed006da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:52.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.681+0000 7f8ece7fc700 1 -- 172.21.15.111:0/2088201877 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ed00a3b50 con 0x7f8ed00a3390 2024-04-25T02:22:52.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.681+0000 7f8ece7fc700 1 --2- 172.21.15.111:0/2088201877 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8ed00a3390 0x7f8ed00a4430 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8ec0009910 tx=0x7f8ec00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=99eeaf9ea2df8a67 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:52.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.681+0000 7f8ecdffb700 1 -- 172.21.15.111:0/2088201877 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec000b860 con 0x7f8ed00a3390 2024-04-25T02:22:52.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.682+0000 7f8ecdffb700 1 -- 172.21.15.111:0/2088201877 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec000b9c0 con 0x7f8ed00a3390 2024-04-25T02:22:52.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.682+0000 7f8ecdffb700 1 -- 172.21.15.111:0/2088201877 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec000bd60 con 0x7f8ed00a3390 2024-04-25T02:22:52.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.682+0000 7f8ed541a700 1 -- 172.21.15.111:0/2088201877 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8ed00a3390 msgr2=0x7f8ed00a4430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:52.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.682+0000 7f8ed541a700 1 --2- 172.21.15.111:0/2088201877 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8ed00a3390 0x7f8ed00a4430 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f8ec0009910 tx=0x7f8ec00091a0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.683+0000 7f8ed541a700 1 -- 172.21.15.111:0/2088201877 shutdown_connections 2024-04-25T02:22:52.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.683+0000 7f8ed541a700 1 --2- 172.21.15.111:0/2088201877 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8ed006fb70 0x7f8ed006e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.683+0000 7f8ed541a700 1 --2- 172.21.15.111:0/2088201877 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8ed00a3390 0x7f8ed00a4430 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.683+0000 7f8ed541a700 1 -- 172.21.15.111:0/2088201877 >> 172.21.15.111:0/2088201877 conn(0x7f8ed00b1cf0 msgr2=0x7f8ed00b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:52.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.683+0000 7f8ed541a700 1 -- 172.21.15.111:0/2088201877 shutdown_connections 2024-04-25T02:22:52.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.683+0000 7f8ed541a700 1 -- 172.21.15.111:0/2088201877 wait complete. 2024-04-25T02:22:52.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.684+0000 7f8ed541a700 1 Processor -- start 2024-04-25T02:22:52.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.684+0000 7f8ed541a700 1 -- start start 2024-04-25T02:22:52.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.685+0000 7f8ed541a700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8ed0067b90 0x7f8ed00a8170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:52.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.685+0000 7f8ed541a700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8ed006fb70 0x7f8ed01424f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:52.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.685+0000 7f8ed541a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8ed00a3390 0x7f8ed0142a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:52.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.685+0000 7f8ed541a700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed00a8c20 con 0x7f8ed00a3390 2024-04-25T02:22:52.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.685+0000 7f8ed541a700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed01438c0 con 0x7f8ed006fb70 2024-04-25T02:22:52.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.685+0000 7f8ed541a700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed00a9d50 con 0x7f8ed0067b90 2024-04-25T02:22:52.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.686+0000 7f8eceffd700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8ed0067b90 0x7f8ed00a8170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:52.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.686+0000 7f8eceffd700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8ed0067b90 0x7f8ed00a8170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:57864/0 (socket says 172.21.15.111:57864) 2024-04-25T02:22:52.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.686+0000 7f8ecf7fe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8ed00a3390 0x7f8ed0142a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:52.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.686+0000 7f8eceffd700 1 -- 172.21.15.111:0/1743847305 learned_addr learned my addr 172.21.15.111:0/1743847305 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:22:52.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.686+0000 7f8ecf7fe700 1 -- 172.21.15.111:0/1743847305 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8ed0067b90 msgr2=0x7f8ed00a8170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:52.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.686+0000 7f8ecf7fe700 1 --2- 172.21.15.111:0/1743847305 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8ed0067b90 0x7f8ed00a8170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.686+0000 7f8ecf7fe700 1 -- 172.21.15.111:0/1743847305 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8ed006fb70 msgr2=0x7f8ed01424f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:52.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.686+0000 7f8ecf7fe700 1 --2- 172.21.15.111:0/1743847305 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8ed006fb70 0x7f8ed01424f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.686+0000 7f8ecf7fe700 1 -- 172.21.15.111:0/1743847305 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ec0009420 con 0x7f8ed00a3390 2024-04-25T02:22:52.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.686+0000 7f8ecf7fe700 1 --2- 172.21.15.111:0/1743847305 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8ed00a3390 0x7f8ed0142a30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8007ba0 tx=0x7f8ec8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:52.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.687+0000 7f8eb6ffd700 1 -- 172.21.15.111:0/1743847305 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec800d8a0 con 0x7f8ed00a3390 2024-04-25T02:22:52.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.687+0000 7f8ed541a700 1 -- 172.21.15.111:0/1743847305 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ed00a8980 con 0x7f8ed00a3390 2024-04-25T02:22:52.691 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.687+0000 7f8ed541a700 1 -- 172.21.15.111:0/1743847305 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ed00a6f90 con 0x7f8ed00a3390 2024-04-25T02:22:52.691 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.688+0000 7f8ed541a700 1 -- 172.21.15.111:0/1743847305 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ed00b08a0 con 0x7f8ed00a3390 2024-04-25T02:22:52.691 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.688+0000 7f8eb6ffd700 1 -- 172.21.15.111:0/1743847305 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ec800f040 con 0x7f8ed00a3390 2024-04-25T02:22:52.691 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.688+0000 7f8eb6ffd700 1 -- 172.21.15.111:0/1743847305 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ec800dc50 con 0x7f8ed00a3390 2024-04-25T02:22:52.699 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.696+0000 7f8eb6ffd700 1 -- 172.21.15.111:0/1743847305 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 6) v1 ==== 42206+0+0 (secure 0 0 0) 0x7f8ec801f440 con 0x7f8ed00a3390 2024-04-25T02:22:52.699 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.696+0000 7f8eb6ffd700 1 -- 172.21.15.111:0/1743847305 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f8ec804be00 con 0x7f8ed00a3390 2024-04-25T02:22:52.699 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.696+0000 7f8eceffd700 1 -- 172.21.15.111:0/1743847305 >> v1:172.21.15.111:6816/39585 conn(0x7f8ebc0394d0 legacy=0x7f8ebc03b980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.111:6816/39585 2024-04-25T02:22:52.699 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.696+0000 7f8eb6ffd700 1 -- 172.21.15.111:0/1743847305 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+112002 (secure 0 0 0) 0x7f8ec804c180 con 0x7f8ed00a3390 2024-04-25T02:22:52.738 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-25T02:22:52.736+0000 7f1f561191c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T02:22:52.746 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-04-25T02:22:52.743+0000 7f5e56aad1c0 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-25T02:22:52.752 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.749+0000 7f8be24b4700 1 -- 172.21.15.111:0/2542797126 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f8bb8005550 con 0x7f8bdc063d30 2024-04-25T02:22:52.752 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.749+0000 7f8bcbfff700 1 -- 172.21.15.111:0/2542797126 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8bd400ad70 con 0x7f8bdc063d30 2024-04-25T02:22:52.752 INFO:teuthology.orchestra.run.smithi111.stdout:38654705697 2024-04-25T02:22:52.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.751+0000 7f8be24b4700 1 -- 172.21.15.111:0/2542797126 >> v1:172.21.15.111:6816/39585 conn(0x7f8bc00394d0 legacy=0x7f8bc003b980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T02:22:52.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.751+0000 7f8be24b4700 1 -- 172.21.15.111:0/2542797126 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8bdc063d30 msgr2=0x7f8bdc14a610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:52.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.751+0000 7f8be24b4700 1 --2- 172.21.15.111:0/2542797126 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8bdc063d30 0x7f8bdc14a610 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8bd400bfa0 tx=0x7f8bd4018000 comp rx=0 tx=0).stop 2024-04-25T02:22:52.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.751+0000 7f8be24b4700 1 -- 172.21.15.111:0/2542797126 shutdown_connections 2024-04-25T02:22:52.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.751+0000 7f8be24b4700 1 --2- 172.21.15.111:0/2542797126 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8bdc1434e0 0x7f8bdc0aa010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.751+0000 7f8be24b4700 1 --2- 172.21.15.111:0/2542797126 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8bdc063d30 0x7f8bdc14a610 secure :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8bd400bfa0 tx=0x7f8bd4018000 comp rx=0 tx=0).stop 2024-04-25T02:22:52.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.751+0000 7f8be24b4700 1 --2- 172.21.15.111:0/2542797126 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8bdc06d960 0x7f8bdc0a9ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.751+0000 7f8be24b4700 1 -- 172.21.15.111:0/2542797126 >> 172.21.15.111:0/2542797126 conn(0x7f8bdc0b1e10 msgr2=0x7f8bdc143920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:52.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.752+0000 7f8be24b4700 1 -- 172.21.15.111:0/2542797126 shutdown_connections 2024-04-25T02:22:52.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.752+0000 7f8be24b4700 1 -- 172.21.15.111:0/2542797126 wait complete. 2024-04-25T02:22:52.768 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705698 got 38654705697 for osd.1 2024-04-25T02:22:52.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.796+0000 7fb11e7fc700 1 -- 172.21.15.111:0/2102390253 >> v1:172.21.15.111:6816/39585 conn(0x7fb1000394d0 legacy=0x7fb10003b980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.111:6816/39585 2024-04-25T02:22:52.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.822+0000 7f0f7259c700 1 -- 172.21.15.111:0/2845688136 >> v1:172.21.15.111:6816/39585 conn(0x7f0f60039500 legacy=0x7f0f6003b9b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.111:6816/39585 2024-04-25T02:22:52.826 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-25T02:22:52.824+0000 7f1f561191c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T02:22:52.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.845+0000 7fb1259b3700 1 -- 172.21.15.111:0/2102390253 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fb12006ec20 con 0x7fb120063a30 2024-04-25T02:22:52.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.845+0000 7fb116ffd700 1 -- 172.21.15.111:0/2102390253 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fb10802b030 con 0x7fb120063a30 2024-04-25T02:22:52.848 INFO:teuthology.orchestra.run.smithi111.stdout:38654705696 2024-04-25T02:22:52.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.847+0000 7fb1259b3700 1 -- 172.21.15.111:0/2102390253 >> v1:172.21.15.111:6816/39585 conn(0x7fb1000394d0 legacy=0x7fb10003b980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T02:22:52.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.847+0000 7fb1259b3700 1 -- 172.21.15.111:0/2102390253 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb120063a30 msgr2=0x7fb1200a6e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:52.851 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.847+0000 7fb1259b3700 1 --2- 172.21.15.111:0/2102390253 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb120063a30 0x7fb1200a6e80 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb108009290 tx=0x7fb108017000 comp rx=0 tx=0).stop 2024-04-25T02:22:52.851 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.848+0000 7fb1259b3700 1 -- 172.21.15.111:0/2102390253 shutdown_connections 2024-04-25T02:22:52.851 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.848+0000 7fb1259b3700 1 --2- 172.21.15.111:0/2102390253 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb12013ae70 0x7fb1200a54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.851 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.848+0000 7fb1259b3700 1 --2- 172.21.15.111:0/2102390253 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb120063a30 0x7fb1200a6e80 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.851 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.848+0000 7fb1259b3700 1 --2- 172.21.15.111:0/2102390253 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb1200ad610 0x7fb1200a9360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.851 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.848+0000 7fb1259b3700 1 -- 172.21.15.111:0/2102390253 >> 172.21.15.111:0/2102390253 conn(0x7fb1200b1400 msgr2=0x7fb1200ae640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:52.851 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.848+0000 7fb1259b3700 1 -- 172.21.15.111:0/2102390253 shutdown_connections 2024-04-25T02:22:52.851 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.848+0000 7fb1259b3700 1 -- 172.21.15.111:0/2102390253 wait complete. 2024-04-25T02:22:52.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.864+0000 7f0f79227700 1 -- 172.21.15.111:0/2845688136 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f0f74071790 con 0x7f0f74063d30 2024-04-25T02:22:52.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.864+0000 7f0f5affd700 1 -- 172.21.15.111:0/2845688136 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0f64034060 con 0x7f0f74063d30 2024-04-25T02:22:52.867 INFO:teuthology.orchestra.run.smithi111.stdout:38654705698 2024-04-25T02:22:52.868 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705697 got 38654705696 for osd.3 2024-04-25T02:22:52.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.866+0000 7f0f79227700 1 -- 172.21.15.111:0/2845688136 >> v1:172.21.15.111:6816/39585 conn(0x7f0f60039500 legacy=0x7f0f6003b9b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T02:22:52.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.866+0000 7f0f79227700 1 -- 172.21.15.111:0/2845688136 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0f74063d30 msgr2=0x7f0f740a9990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:52.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.866+0000 7f0f79227700 1 --2- 172.21.15.111:0/2845688136 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0f74063d30 0x7f0f740a9990 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f0f64006d40 tx=0x7f0f64009250 comp rx=0 tx=0).stop 2024-04-25T02:22:52.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.866+0000 7f0f79227700 1 -- 172.21.15.111:0/2845688136 shutdown_connections 2024-04-25T02:22:52.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.866+0000 7f0f79227700 1 --2- 172.21.15.111:0/2845688136 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0f741434e0 0x7f0f740a8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.866+0000 7f0f79227700 1 --2- 172.21.15.111:0/2845688136 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0f74063d30 0x7f0f740a9990 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.866+0000 7f0f79227700 1 --2- 172.21.15.111:0/2845688136 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0f7406d960 0x7f0f74131640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.866+0000 7f0f79227700 1 -- 172.21.15.111:0/2845688136 >> 172.21.15.111:0/2845688136 conn(0x7f0f740b1e10 msgr2=0x7f0f740adce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:52.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.866+0000 7f0f79227700 1 -- 172.21.15.111:0/2845688136 shutdown_connections 2024-04-25T02:22:52.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.866+0000 7f0f79227700 1 -- 172.21.15.111:0/2845688136 wait complete. 2024-04-25T02:22:52.882 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705699 got 38654705698 for osd.2 2024-04-25T02:22:52.899 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.897+0000 7f8eceffd700 1 -- 172.21.15.111:0/1743847305 >> v1:172.21.15.111:6816/39585 conn(0x7f8ebc0394d0 legacy=0x7f8ebc03b980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.111:6816/39585 2024-04-25T02:22:52.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.919+0000 7f8ed541a700 1 -- 172.21.15.111:0/1743847305 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f8ed006eb40 con 0x7f8ed00a3390 2024-04-25T02:22:52.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.920+0000 7f8eb6ffd700 1 -- 172.21.15.111:0/1743847305 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f8ec801a070 con 0x7f8ed00a3390 2024-04-25T02:22:52.923 INFO:teuthology.orchestra.run.smithi111.stdout:38654705696 2024-04-25T02:22:52.925 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.922+0000 7f8ed541a700 1 -- 172.21.15.111:0/1743847305 >> v1:172.21.15.111:6816/39585 conn(0x7f8ebc0394d0 legacy=0x7f8ebc03b980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T02:22:52.925 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.922+0000 7f8ed541a700 1 -- 172.21.15.111:0/1743847305 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8ed00a3390 msgr2=0x7f8ed0142a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:52.925 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.922+0000 7f8ed541a700 1 --2- 172.21.15.111:0/1743847305 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8ed00a3390 0x7f8ed0142a30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f8ec8007ba0 tx=0x7f8ec8009250 comp rx=0 tx=0).stop 2024-04-25T02:22:52.925 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.922+0000 7f8ed541a700 1 -- 172.21.15.111:0/1743847305 shutdown_connections 2024-04-25T02:22:52.926 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.922+0000 7f8ed541a700 1 --2- 172.21.15.111:0/1743847305 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8ed00a3390 0x7f8ed0142a30 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.926 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.922+0000 7f8ed541a700 1 --2- 172.21.15.111:0/1743847305 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8ed0067b90 0x7f8ed00a8170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.926 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.922+0000 7f8ed541a700 1 --2- 172.21.15.111:0/1743847305 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8ed006fb70 0x7f8ed01424f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:52.926 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.922+0000 7f8ed541a700 1 -- 172.21.15.111:0/1743847305 >> 172.21.15.111:0/1743847305 conn(0x7f8ed00b1cf0 msgr2=0x7f8ed00b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:52.926 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.922+0000 7f8ed541a700 1 -- 172.21.15.111:0/1743847305 shutdown_connections 2024-04-25T02:22:52.926 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:52.922+0000 7f8ed541a700 1 -- 172.21.15.111:0/1743847305 wait complete. 2024-04-25T02:22:52.944 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705697 got 38654705696 for osd.0 2024-04-25T02:22:52.954 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-04-25T02:22:52.951+0000 7f5e56aad1c0 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-25T02:22:53.077 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-25T02:22:53.074+0000 7f1f561191c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T02:22:53.078 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-04-25T02:22:53.075+0000 7f5e56aad1c0 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-25T02:22:53.157 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-04-25T02:22:53.154+0000 7f5e56aad1c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T02:22:53.157 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-25T02:22:53.155+0000 7f1f561191c0 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-25T02:22:53.313 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-04-25T02:22:53.310+0000 7f5e56aad1c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T02:22:53.313 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-25T02:22:53.310+0000 7f1f561191c0 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-25T02:22:53.483 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-25T02:22:53.480+0000 7f1f561191c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T02:22:53.483 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-04-25T02:22:53.480+0000 7f5e56aad1c0 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-25T02:22:53.557 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-04-25T02:22:53.555+0000 7f5e56aad1c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T02:22:53.559 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-25T02:22:53.557+0000 7f1f561191c0 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-25T02:22:53.687 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-04-25T02:22:53.685+0000 7f5e56aad1c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T02:22:53.688 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-25T02:22:53.685+0000 7f1f561191c0 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-25T02:22:53.769 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T02:22:53.804 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-25T02:22:53.801+0000 7f1f561191c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T02:22:53.805 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-04-25T02:22:53.802+0000 7f5e56aad1c0 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-25T02:22:53.869 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T02:22:53.883 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T02:22:53.891 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.888+0000 7fd0e0475700 1 Processor -- start 2024-04-25T02:22:53.891 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.888+0000 7fd0e0475700 1 -- start start 2024-04-25T02:22:53.892 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.889+0000 7fd0e0475700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fd0d8063d50 0x7fd0d80ad330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:53.892 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.889+0000 7fd0e0475700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd0d806efd0 0x7fd0d8131100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:53.895 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.889+0000 7fd0e0475700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0d8068ae0 con 0x7fd0d8131640 2024-04-25T02:22:53.895 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.889+0000 7fd0e0475700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0d8064120 con 0x7fd0d8063d50 2024-04-25T02:22:53.895 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.889+0000 7fd0e0475700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d806d340 con 0x7fd0d806efd0 2024-04-25T02:22:53.895 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.890+0000 7fd0de211700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fd0d8063d50 0x7fd0d80ad330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:53.895 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.890+0000 7fd0dda10700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd0d806efd0 0x7fd0d8131100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:53.895 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.890+0000 7fd0de211700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fd0d8063d50 0x7fd0d80ad330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:53242/0 (socket says 172.21.15.111:53242) 2024-04-25T02:22:53.895 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.890+0000 7fd0dda10700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd0d806efd0 0x7fd0d8131100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:32876/0 (socket says 172.21.15.111:32876) 2024-04-25T02:22:53.895 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.890+0000 7fd0de211700 1 -- 172.21.15.111:0/4175791823 learned_addr learned my addr 172.21.15.111:0/4175791823 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:22:53.895 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.890+0000 7fd0de211700 1 -- 172.21.15.111:0/4175791823 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd0d806efd0 msgr2=0x7fd0d8131100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:22:53.895 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.890+0000 7fd0de211700 1 --2- 172.21.15.111:0/4175791823 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd0d806efd0 0x7fd0d8131100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:53.895 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.890+0000 7fd0de211700 1 -- 172.21.15.111:0/4175791823 >> v1:172.21.15.111:6789/0 conn(0x7fd0d8131640 legacy=0x7fd0d813e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:22:53.895 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.890+0000 7fd0de211700 1 -- 172.21.15.111:0/4175791823 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d806d600 con 0x7fd0d8063d50 2024-04-25T02:22:53.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.890+0000 7fd0de211700 1 --2- 172.21.15.111:0/4175791823 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd0d8063d50 0x7fd0d80ad330 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd0d40099b0 tx=0x7fd0d4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c6be3f94cd9a5f6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:53.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.891+0000 7fd0dd20f700 1 -- 172.21.15.111:0/4175791823 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d4009ea0 con 0x7fd0d8063d50 2024-04-25T02:22:53.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.891+0000 7fd0dd20f700 1 -- 172.21.15.111:0/4175791823 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0d400b820 con 0x7fd0d8063d50 2024-04-25T02:22:53.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.891+0000 7fd0dd20f700 1 -- 172.21.15.111:0/4175791823 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0d400bba0 con 0x7fd0d8063d50 2024-04-25T02:22:53.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.892+0000 7fd0e0475700 1 -- 172.21.15.111:0/4175791823 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd0d8063d50 msgr2=0x7fd0d80ad330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:53.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.892+0000 7fd0e0475700 1 --2- 172.21.15.111:0/4175791823 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd0d8063d50 0x7fd0d80ad330 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fd0d40099b0 tx=0x7fd0d4009250 comp rx=0 tx=0).stop 2024-04-25T02:22:53.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.892+0000 7fd0e0475700 1 -- 172.21.15.111:0/4175791823 shutdown_connections 2024-04-25T02:22:53.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.892+0000 7fd0e0475700 1 --2- 172.21.15.111:0/4175791823 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd0d8063d50 0x7fd0d80ad330 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:53.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.892+0000 7fd0e0475700 1 --2- 172.21.15.111:0/4175791823 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd0d806efd0 0x7fd0d8131100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:53.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.892+0000 7fd0e0475700 1 -- 172.21.15.111:0/4175791823 >> 172.21.15.111:0/4175791823 conn(0x7fd0d80b1e10 msgr2=0x7fd0d80ade80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:53.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.892+0000 7fd0e0475700 1 -- 172.21.15.111:0/4175791823 shutdown_connections 2024-04-25T02:22:53.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.892+0000 7fd0e0475700 1 -- 172.21.15.111:0/4175791823 wait complete. 2024-04-25T02:22:53.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.893+0000 7fd0e0475700 1 Processor -- start 2024-04-25T02:22:53.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.894+0000 7fd0e0475700 1 -- start start 2024-04-25T02:22:53.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.894+0000 7fd0e0475700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd0d8063d50 0x7fd0d812eb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:53.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.894+0000 7fd0e0475700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd0d806efd0 0x7fd0d8155b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:53.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.894+0000 7fd0e0475700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd0d8131640 0x7fd0d8156050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:53.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.894+0000 7fd0e0475700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d812d730 con 0x7fd0d8063d50 2024-04-25T02:22:53.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.894+0000 7fd0e0475700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d812d960 con 0x7fd0d806efd0 2024-04-25T02:22:53.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.894+0000 7fd0e0475700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd0d812e330 con 0x7fd0d8131640 2024-04-25T02:22:53.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.895+0000 7fd0dda10700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd0d806efd0 0x7fd0d8155b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:53.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.895+0000 7fd0dda10700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd0d806efd0 0x7fd0d8155b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:32886/0 (socket says 172.21.15.111:32886) 2024-04-25T02:22:53.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.895+0000 7fd0dda10700 1 -- 172.21.15.111:0/3897422704 learned_addr learned my addr 172.21.15.111:0/3897422704 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:22:53.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.895+0000 7fd0de211700 1 --2- 172.21.15.111:0/3897422704 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd0d8063d50 0x7fd0d812eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:53.899 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.895+0000 7fd0dea12700 1 --2- 172.21.15.111:0/3897422704 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd0d8131640 0x7fd0d8156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:53.899 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.895+0000 7fd0dda10700 1 -- 172.21.15.111:0/3897422704 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd0d8131640 msgr2=0x7fd0d8156050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:53.899 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.895+0000 7fd0dda10700 1 --2- 172.21.15.111:0/3897422704 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd0d8131640 0x7fd0d8156050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:53.899 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.895+0000 7fd0dda10700 1 -- 172.21.15.111:0/3897422704 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd0d8063d50 msgr2=0x7fd0d812eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:53.899 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.895+0000 7fd0dda10700 1 --2- 172.21.15.111:0/3897422704 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd0d8063d50 0x7fd0d812eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:53.899 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.895+0000 7fd0dda10700 1 -- 172.21.15.111:0/3897422704 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0d40094f0 con 0x7fd0d806efd0 2024-04-25T02:22:53.899 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.895+0000 7fd0de211700 1 --2- 172.21.15.111:0/3897422704 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd0d8063d50 0x7fd0d812eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:22:53.899 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.897+0000 7fd0dda10700 1 --2- 172.21.15.111:0/3897422704 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd0d806efd0 0x7fd0d8155b10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd0c800ec80 tx=0x7fd0c80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:53.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.899+0000 7fd0ce7fc700 1 -- 172.21.15.111:0/3897422704 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c800c9d0 con 0x7fd0d806efd0 2024-04-25T02:22:53.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.899+0000 7fd0ce7fc700 1 -- 172.21.15.111:0/3897422704 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd0c800cb30 con 0x7fd0d806efd0 2024-04-25T02:22:53.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.899+0000 7fd0e0475700 1 -- 172.21.15.111:0/3897422704 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0d812c3d0 con 0x7fd0d806efd0 2024-04-25T02:22:53.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.899+0000 7fd0ce7fc700 1 -- 172.21.15.111:0/3897422704 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd0c8013470 con 0x7fd0d806efd0 2024-04-25T02:22:53.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.899+0000 7fd0e0475700 1 -- 172.21.15.111:0/3897422704 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0d812c910 con 0x7fd0d806efd0 2024-04-25T02:22:53.903 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.900+0000 7fd0e0475700 1 -- 172.21.15.111:0/3897422704 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd0d812cb10 con 0x7fd0d806efd0 2024-04-25T02:22:53.903 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.900+0000 7fd0ce7fc700 1 -- 172.21.15.111:0/3897422704 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 6) v1 ==== 42206+0+0 (secure 0 0 0) 0x7fd0c8013820 con 0x7fd0d806efd0 2024-04-25T02:22:53.903 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.900+0000 7fd0ce7fc700 1 -- 172.21.15.111:0/3897422704 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7fd0c804bbc0 con 0x7fd0d806efd0 2024-04-25T02:22:53.903 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.900+0000 7fd0de211700 1 -- 172.21.15.111:0/3897422704 >> v1:172.21.15.111:6816/39585 conn(0x7fd0bc039520 legacy=0x7fd0bc03b9d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.111:6816/39585 2024-04-25T02:22:53.908 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:53.906+0000 7fd0ce7fc700 1 -- 172.21.15.111:0/3897422704 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+112002 (secure 0 0 0) 0x7fd0d812cb10 con 0x7fd0d806efd0 2024-04-25T02:22:53.945 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T02:22:54.019 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.016+0000 7f7027b72700 1 Processor -- start 2024-04-25T02:22:54.019 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.016+0000 7f7027b72700 1 -- start start 2024-04-25T02:22:54.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.017+0000 7f7027b72700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7020063d10 0x7f70200ad430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:54.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.017+0000 7f7027b72700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f702006eca0 0x7f7020131100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:54.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.017+0000 7f7027b72700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f702006e580 con 0x7f7020131640 2024-04-25T02:22:54.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.017+0000 7f7027b72700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f702006e3a0 con 0x7f7020063d10 2024-04-25T02:22:54.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.017+0000 7f7027b72700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f702013e660 con 0x7f702006eca0 2024-04-25T02:22:54.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.018+0000 7f702590e700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7020063d10 0x7f70200ad430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:54.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.018+0000 7f702590e700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7020063d10 0x7f70200ad430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:32900/0 (socket says 172.21.15.111:32900) 2024-04-25T02:22:54.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.018+0000 7f702590e700 1 -- 172.21.15.111:0/2432585222 learned_addr learned my addr 172.21.15.111:0/2432585222 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:22:54.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.018+0000 7f702590e700 1 -- 172.21.15.111:0/2432585222 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f702006eca0 msgr2=0x7f7020131100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:22:54.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.018+0000 7f702590e700 1 --2- 172.21.15.111:0/2432585222 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f702006eca0 0x7f7020131100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:54.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.018+0000 7f702590e700 1 -- 172.21.15.111:0/2432585222 >> v1:172.21.15.111:6789/0 conn(0x7f7020131640 legacy=0x7f702006d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:54.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.018+0000 7f702590e700 1 -- 172.21.15.111:0/2432585222 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f702013e900 con 0x7f7020063d10 2024-04-25T02:22:54.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.018+0000 7f702590e700 1 --2- 172.21.15.111:0/2432585222 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7020063d10 0x7f70200ad430 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f70140099e0 tx=0x7f7014009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=de957cd15618bddd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:54.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.019+0000 7f702490c700 1 -- 172.21.15.111:0/2432585222 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701400b760 con 0x7f7020063d10 2024-04-25T02:22:54.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.019+0000 7f702490c700 1 -- 172.21.15.111:0/2432585222 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f701400b8c0 con 0x7f7020063d10 2024-04-25T02:22:54.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.019+0000 7f702490c700 1 -- 172.21.15.111:0/2432585222 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701400bc60 con 0x7f7020063d10 2024-04-25T02:22:54.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.020+0000 7f7027b72700 1 -- 172.21.15.111:0/2432585222 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7020063d10 msgr2=0x7f70200ad430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:54.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.020+0000 7f7027b72700 1 --2- 172.21.15.111:0/2432585222 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7020063d10 0x7f70200ad430 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f70140099e0 tx=0x7f7014009250 comp rx=0 tx=0).stop 2024-04-25T02:22:54.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.020+0000 7f7027b72700 1 -- 172.21.15.111:0/2432585222 shutdown_connections 2024-04-25T02:22:54.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.020+0000 7f7027b72700 1 --2- 172.21.15.111:0/2432585222 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7020063d10 0x7f70200ad430 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:54.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.020+0000 7f7027b72700 1 --2- 172.21.15.111:0/2432585222 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f702006eca0 0x7f7020131100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:54.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.020+0000 7f7027b72700 1 -- 172.21.15.111:0/2432585222 >> 172.21.15.111:0/2432585222 conn(0x7f70200b1e10 msgr2=0x7f70200ade80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:54.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.020+0000 7f7027b72700 1 -- 172.21.15.111:0/2432585222 shutdown_connections 2024-04-25T02:22:54.023 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.020+0000 7f7027b72700 1 -- 172.21.15.111:0/2432585222 wait complete. 2024-04-25T02:22:54.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.021+0000 7f7027b72700 1 Processor -- start 2024-04-25T02:22:54.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.021+0000 7f7027b72700 1 -- start start 2024-04-25T02:22:54.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.022+0000 7f7027b72700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7020063d10 0x7f70200aaa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:54.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.022+0000 7f7027b72700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f702006eca0 0x7f70200a9560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:54.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.022+0000 7f7027b72700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f70200a9aa0 0x7f7020152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:54.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.022+0000 7f7027b72700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70200a7c20 con 0x7f702006eca0 2024-04-25T02:22:54.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.022+0000 7f7027b72700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7020152900 con 0x7f7020063d10 2024-04-25T02:22:54.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.022+0000 7f7027b72700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f70200aaf40 con 0x7f70200a9aa0 2024-04-25T02:22:54.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.023+0000 7f702510d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f702006eca0 0x7f70200a9560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:54.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.023+0000 7f702510d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f702006eca0 0x7f70200a9560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:53252/0 (socket says 172.21.15.111:53252) 2024-04-25T02:22:54.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.023+0000 7f702510d700 1 -- 172.21.15.111:0/1938221034 learned_addr learned my addr 172.21.15.111:0/1938221034 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:22:54.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.023+0000 7f702590e700 1 --2- 172.21.15.111:0/1938221034 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7020063d10 0x7f70200aaa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:54.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.023+0000 7f702510d700 1 -- 172.21.15.111:0/1938221034 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f70200a9aa0 msgr2=0x7f7020152ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:54.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.023+0000 7f702510d700 1 --2- 172.21.15.111:0/1938221034 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f70200a9aa0 0x7f7020152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:54.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.023+0000 7f702510d700 1 -- 172.21.15.111:0/1938221034 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7020063d10 msgr2=0x7f70200aaa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:54.027 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.023+0000 7f702510d700 1 --2- 172.21.15.111:0/1938221034 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7020063d10 0x7f70200aaa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:54.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.023+0000 7f702510d700 1 -- 172.21.15.111:0/1938221034 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70140094f0 con 0x7f702006eca0 2024-04-25T02:22:54.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.024+0000 7f702510d700 1 --2- 172.21.15.111:0/1938221034 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f702006eca0 0x7f70200a9560 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f701c00b810 tx=0x7f701c009220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:54.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.024+0000 7f7011ffb700 1 -- 172.21.15.111:0/1938221034 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701c00f510 con 0x7f702006eca0 2024-04-25T02:22:54.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.024+0000 7f7011ffb700 1 -- 172.21.15.111:0/1938221034 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f701c00f690 con 0x7f702006eca0 2024-04-25T02:22:54.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.024+0000 7f7011ffb700 1 -- 172.21.15.111:0/1938221034 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f701c00fa50 con 0x7f702006eca0 2024-04-25T02:22:54.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.024+0000 7f7027b72700 1 -- 172.21.15.111:0/1938221034 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70200aa220 con 0x7f702006eca0 2024-04-25T02:22:54.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.024+0000 7f7027b72700 1 -- 172.21.15.111:0/1938221034 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70200a9ec0 con 0x7f702006eca0 2024-04-25T02:22:54.029 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.027+0000 7f7011ffb700 1 -- 172.21.15.111:0/1938221034 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 6) v1 ==== 42206+0+0 (secure 0 0 0) 0x7f701c01a400 con 0x7f702006eca0 2024-04-25T02:22:54.030 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.027+0000 7f7011ffb700 1 -- 172.21.15.111:0/1938221034 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f701c04b3c0 con 0x7f702006eca0 2024-04-25T02:22:54.030 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.027+0000 7f702590e700 1 -- 172.21.15.111:0/1938221034 >> v1:172.21.15.111:6816/39585 conn(0x7f7004039500 legacy=0x7f700403b9b0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.111:6816/39585 2024-04-25T02:22:54.030 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.028+0000 7f7027b72700 1 -- 172.21.15.111:0/1938221034 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7020071790 con 0x7f702006eca0 2024-04-25T02:22:54.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.035+0000 7f7011ffb700 1 -- 172.21.15.111:0/1938221034 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+112002 (secure 0 0 0) 0x7f701c02fb00 con 0x7f702006eca0 2024-04-25T02:22:54.091 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.088+0000 7f2a50d4e700 1 Processor -- start 2024-04-25T02:22:54.091 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.088+0000 7f2a50d4e700 1 -- start start 2024-04-25T02:22:54.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.090+0000 7f2a50d4e700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2a4c0ad550 0x7f2a4c063bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:54.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.090+0000 7f2a50d4e700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f2a4c06e4d0 0x7f2a4c143150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:54.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.090+0000 7f2a50d4e700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a4c06dd60 con 0x7f2a4c0ad920 2024-04-25T02:22:54.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.090+0000 7f2a50d4e700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a4c06e020 con 0x7f2a4c06e4d0 2024-04-25T02:22:54.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.090+0000 7f2a50d4e700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c143690 con 0x7f2a4c0ad550 2024-04-25T02:22:54.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.090+0000 7f2a4ad9d700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f2a4c0ad920 0x7f2a4c145d50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:55444/0 (socket says 172.21.15.111:55444) 2024-04-25T02:22:54.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.090+0000 7f2a4ad9d700 1 -- 172.21.15.111:0/4169496404 learned_addr learned my addr 172.21.15.111:0/4169496404 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:22:54.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.090+0000 7f2a49d9b700 1 --2- 172.21.15.111:0/4169496404 >> v2:172.21.15.111:3300/0 conn(0x7f2a4c06e4d0 0x7f2a4c143150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:54.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.091+0000 7f2a49d9b700 1 -- 172.21.15.111:0/4169496404 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2a4c0ad550 msgr2=0x7f2a4c063bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:22:54.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.091+0000 7f2a49d9b700 1 --2- 172.21.15.111:0/4169496404 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2a4c0ad550 0x7f2a4c063bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:54.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.091+0000 7f2a49d9b700 1 -- 172.21.15.111:0/4169496404 >> v1:172.21.15.111:6789/0 conn(0x7f2a4c0ad920 legacy=0x7f2a4c145d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:54.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.091+0000 7f2a49d9b700 1 -- 172.21.15.111:0/4169496404 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a4c143800 con 0x7f2a4c06e4d0 2024-04-25T02:22:54.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.091+0000 7f2a49d9b700 1 --2- 172.21.15.111:0/4169496404 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2a4c06e4d0 0x7f2a4c143150 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c0098e0 tx=0x7f2a3c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b511a1a95cd53e6b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:54.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.091+0000 7f2a4959a700 1 -- 172.21.15.111:0/4169496404 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c009e80 con 0x7f2a4c06e4d0 2024-04-25T02:22:54.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.091+0000 7f2a4959a700 1 -- 172.21.15.111:0/4169496404 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a3c00b860 con 0x7f2a4c06e4d0 2024-04-25T02:22:54.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.091+0000 7f2a4959a700 1 -- 172.21.15.111:0/4169496404 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c00bbe0 con 0x7f2a4c06e4d0 2024-04-25T02:22:54.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.092+0000 7f2a50d4e700 1 -- 172.21.15.111:0/4169496404 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2a4c06e4d0 msgr2=0x7f2a4c143150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:54.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.092+0000 7f2a50d4e700 1 --2- 172.21.15.111:0/4169496404 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2a4c06e4d0 0x7f2a4c143150 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c0098e0 tx=0x7f2a3c0091a0 comp rx=0 tx=0).stop 2024-04-25T02:22:54.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.092+0000 7f2a50d4e700 1 -- 172.21.15.111:0/4169496404 shutdown_connections 2024-04-25T02:22:54.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.092+0000 7f2a50d4e700 1 --2- 172.21.15.111:0/4169496404 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2a4c0ad550 0x7f2a4c063bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:54.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.092+0000 7f2a50d4e700 1 --2- 172.21.15.111:0/4169496404 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2a4c06e4d0 0x7f2a4c143150 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:54.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.092+0000 7f2a50d4e700 1 -- 172.21.15.111:0/4169496404 >> 172.21.15.111:0/4169496404 conn(0x7f2a4c0b1e10 msgr2=0x7f2a4c0ade80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:54.096 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.092+0000 7f2a50d4e700 1 -- 172.21.15.111:0/4169496404 shutdown_connections 2024-04-25T02:22:54.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.092+0000 7f2a50d4e700 1 -- 172.21.15.111:0/4169496404 wait complete. 2024-04-25T02:22:54.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.094+0000 7f2a50d4e700 1 Processor -- start 2024-04-25T02:22:54.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.094+0000 7f2a50d4e700 1 -- start start 2024-04-25T02:22:54.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.095+0000 7f2a50d4e700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2a4c0ad550 0x7f2a4c0a5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:54.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.095+0000 7f2a50d4e700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2a4c0ad920 0x7f2a4c155840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:54.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.095+0000 7f2a49d9b700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2a4c0ad920 0x7f2a4c155840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:54.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.095+0000 7f2a49d9b700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2a4c0ad920 0x7f2a4c155840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:32928/0 (socket says 172.21.15.111:32928) 2024-04-25T02:22:54.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.095+0000 7f2a50d4e700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2a4c0a7440 0x7f2a4c155d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:54.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.095+0000 7f2a50d4e700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c0a7ae0 con 0x7f2a4c0a7440 2024-04-25T02:22:54.099 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.095+0000 7f2a50d4e700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c0a7d00 con 0x7f2a4c0ad920 2024-04-25T02:22:54.099 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.095+0000 7f2a50d4e700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2a4c0a81c0 con 0x7f2a4c0ad550 2024-04-25T02:22:54.100 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.095+0000 7f2a49d9b700 1 -- 172.21.15.111:0/861941093 learned_addr learned my addr 172.21.15.111:0/861941093 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:22:54.100 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.095+0000 7f2a4ad9d700 1 --2- 172.21.15.111:0/861941093 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2a4c0a7440 0x7f2a4c155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:54.100 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.096+0000 7f2a4a59c700 1 --2- 172.21.15.111:0/861941093 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2a4c0ad550 0x7f2a4c0a5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:54.100 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.096+0000 7f2a49d9b700 1 -- 172.21.15.111:0/861941093 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2a4c0ad550 msgr2=0x7f2a4c0a5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:54.100 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.096+0000 7f2a49d9b700 1 --2- 172.21.15.111:0/861941093 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2a4c0ad550 0x7f2a4c0a5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:54.100 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.096+0000 7f2a49d9b700 1 -- 172.21.15.111:0/861941093 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2a4c0a7440 msgr2=0x7f2a4c155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:54.100 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.096+0000 7f2a49d9b700 1 --2- 172.21.15.111:0/861941093 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2a4c0a7440 0x7f2a4c155d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:54.100 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.096+0000 7f2a49d9b700 1 -- 172.21.15.111:0/861941093 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a3c009420 con 0x7f2a4c0ad920 2024-04-25T02:22:54.100 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.096+0000 7f2a4a59c700 1 --2- 172.21.15.111:0/861941093 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2a4c0ad550 0x7f2a4c0a5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:22:54.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.096+0000 7f2a49d9b700 1 --2- 172.21.15.111:0/861941093 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2a4c0ad920 0x7f2a4c155840 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c013000 tx=0x7f2a3c017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:54.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.096+0000 7f2a427fc700 1 -- 172.21.15.111:0/861941093 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c011420 con 0x7f2a4c0ad920 2024-04-25T02:22:54.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.096+0000 7f2a50d4e700 1 -- 172.21.15.111:0/861941093 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a4c0a6b50 con 0x7f2a4c0ad920 2024-04-25T02:22:54.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.096+0000 7f2a427fc700 1 -- 172.21.15.111:0/861941093 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a3c0115a0 con 0x7f2a4c0ad920 2024-04-25T02:22:54.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.096+0000 7f2a427fc700 1 -- 172.21.15.111:0/861941093 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a3c011960 con 0x7f2a4c0ad920 2024-04-25T02:22:54.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.096+0000 7f2a50d4e700 1 -- 172.21.15.111:0/861941093 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a4c142ce0 con 0x7f2a4c0ad920 2024-04-25T02:22:54.102 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.098+0000 7f2a50d4e700 1 -- 172.21.15.111:0/861941093 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a4c071790 con 0x7f2a4c0ad920 2024-04-25T02:22:54.102 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.099+0000 7f2a427fc700 1 -- 172.21.15.111:0/861941093 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 6) v1 ==== 42206+0+0 (secure 0 0 0) 0x7f2a3c02c3b0 con 0x7f2a4c0ad920 2024-04-25T02:22:54.102 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.099+0000 7f2a427fc700 1 -- 172.21.15.111:0/861941093 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f2a3c04d3f0 con 0x7f2a4c0ad920 2024-04-25T02:22:54.102 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.099+0000 7f2a4a59c700 1 -- 172.21.15.111:0/861941093 >> v1:172.21.15.111:6816/39585 conn(0x7f2a2c0394d0 legacy=0x7f2a2c03b980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.111:6816/39585 2024-04-25T02:22:54.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.103+0000 7f2a427fc700 1 -- 172.21.15.111:0/861941093 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+112002 (secure 0 0 0) 0x7f2a3c01a420 con 0x7f2a4c0ad920 2024-04-25T02:22:54.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.103+0000 7fd0de211700 1 -- 172.21.15.111:0/3897422704 >> v1:172.21.15.111:6816/39585 conn(0x7fd0bc039520 legacy=0x7fd0bc03b9d0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.111:6816/39585 2024-04-25T02:22:54.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.119+0000 7fd0e0475700 1 -- 172.21.15.111:0/3897422704 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fd0d812cb10 con 0x7fd0d806efd0 2024-04-25T02:22:54.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.119+0000 7fd0ce7fc700 1 -- 172.21.15.111:0/3897422704 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd0d812cb10 con 0x7fd0d806efd0 2024-04-25T02:22:54.124 INFO:teuthology.orchestra.run.smithi111.stdout:38654705697 2024-04-25T02:22:54.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.122+0000 7fd0e0475700 1 -- 172.21.15.111:0/3897422704 >> v1:172.21.15.111:6816/39585 conn(0x7fd0bc039520 legacy=0x7fd0bc03b9d0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T02:22:54.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.122+0000 7fd0e0475700 1 -- 172.21.15.111:0/3897422704 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd0d806efd0 msgr2=0x7fd0d8155b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:54.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.122+0000 7fd0e0475700 1 --2- 172.21.15.111:0/3897422704 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd0d806efd0 0x7fd0d8155b10 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd0c800ec80 tx=0x7fd0c80091a0 comp rx=0 tx=0).stop 2024-04-25T02:22:54.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.122+0000 7fd0e0475700 1 -- 172.21.15.111:0/3897422704 shutdown_connections 2024-04-25T02:22:54.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.122+0000 7fd0e0475700 1 --2- 172.21.15.111:0/3897422704 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd0d8131640 0x7fd0d8156050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:54.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.122+0000 7fd0e0475700 1 --2- 172.21.15.111:0/3897422704 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd0d8063d50 0x7fd0d812eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:54.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.122+0000 7fd0e0475700 1 --2- 172.21.15.111:0/3897422704 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd0d806efd0 0x7fd0d8155b10 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:54.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.122+0000 7fd0e0475700 1 -- 172.21.15.111:0/3897422704 >> 172.21.15.111:0/3897422704 conn(0x7fd0d80b1e10 msgr2=0x7fd0d813c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:54.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.122+0000 7fd0e0475700 1 -- 172.21.15.111:0/3897422704 shutdown_connections 2024-04-25T02:22:54.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.122+0000 7fd0e0475700 1 -- 172.21.15.111:0/3897422704 wait complete. 2024-04-25T02:22:54.127 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.125+0000 7f6bfb799700 1 Processor -- start 2024-04-25T02:22:54.128 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.125+0000 7f6bfb799700 1 -- start start 2024-04-25T02:22:54.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.126+0000 7f6bfb799700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6bf4063d10 0x7f6bf40ad430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:54.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.126+0000 7f6bfb799700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f6bf406eca0 0x7f6bf4131100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:54.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.126+0000 7f6bfb799700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bf406e580 con 0x7f6bf4131640 2024-04-25T02:22:54.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.126+0000 7f6bfb799700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bf406e3a0 con 0x7f6bf406eca0 2024-04-25T02:22:54.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.126+0000 7f6bfb799700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf413e660 con 0x7f6bf4063d10 2024-04-25T02:22:54.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.127+0000 7f6bf8d34700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f6bf406eca0 0x7f6bf4131100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:54.129 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.127+0000 7f6bf8d34700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f6bf406eca0 0x7f6bf4131100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:53284/0 (socket says 172.21.15.111:53284) 2024-04-25T02:22:54.130 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.127+0000 7f6bf8d34700 1 -- 172.21.15.111:0/2137052457 learned_addr learned my addr 172.21.15.111:0/2137052457 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:22:54.130 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.127+0000 7f6bf8d34700 1 -- 172.21.15.111:0/2137052457 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6bf4063d10 msgr2=0x7f6bf40ad430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:22:54.130 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.127+0000 7f6bf8d34700 1 --2- 172.21.15.111:0/2137052457 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6bf4063d10 0x7f6bf40ad430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:54.131 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.127+0000 7f6bf8d34700 1 -- 172.21.15.111:0/2137052457 >> v1:172.21.15.111:6789/0 conn(0x7f6bf4131640 legacy=0x7f6bf406d1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:22:54.131 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.127+0000 7f6bf8d34700 1 -- 172.21.15.111:0/2137052457 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf413e900 con 0x7f6bf406eca0 2024-04-25T02:22:54.131 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.127+0000 7f6bf8d34700 1 --2- 172.21.15.111:0/2137052457 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6bf406eca0 0x7f6bf4131100 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6bf000bc50 tx=0x7f6bf000b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c2decc56570429e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:54.131 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.128+0000 7f6bebfff700 1 -- 172.21.15.111:0/2137052457 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf000be60 con 0x7f6bf406eca0 2024-04-25T02:22:54.131 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.128+0000 7f6bebfff700 1 -- 172.21.15.111:0/2137052457 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf000de00 con 0x7f6bf406eca0 2024-04-25T02:22:54.131 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.128+0000 7f6bebfff700 1 -- 172.21.15.111:0/2137052457 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf00196b0 con 0x7f6bf406eca0 2024-04-25T02:22:54.131 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.129+0000 7f6bfb799700 1 -- 172.21.15.111:0/2137052457 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6bf406eca0 msgr2=0x7f6bf4131100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:54.131 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.129+0000 7f6bfb799700 1 --2- 172.21.15.111:0/2137052457 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6bf406eca0 0x7f6bf4131100 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f6bf000bc50 tx=0x7f6bf000b4f0 comp rx=0 tx=0).stop 2024-04-25T02:22:54.131 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.129+0000 7f6bfb799700 1 -- 172.21.15.111:0/2137052457 shutdown_connections 2024-04-25T02:22:54.132 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.129+0000 7f6bfb799700 1 --2- 172.21.15.111:0/2137052457 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6bf4063d10 0x7f6bf40ad430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:54.132 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.129+0000 7f6bfb799700 1 --2- 172.21.15.111:0/2137052457 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6bf406eca0 0x7f6bf4131100 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:54.132 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.129+0000 7f6bfb799700 1 -- 172.21.15.111:0/2137052457 >> 172.21.15.111:0/2137052457 conn(0x7f6bf40b1e10 msgr2=0x7f6bf40ade80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:54.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.134+0000 7f6bfb799700 1 -- 172.21.15.111:0/2137052457 shutdown_connections 2024-04-25T02:22:54.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.134+0000 7f6bfb799700 1 -- 172.21.15.111:0/2137052457 wait complete. 2024-04-25T02:22:54.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.135+0000 7f6bfb799700 1 Processor -- start 2024-04-25T02:22:54.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.135+0000 7f6bfb799700 1 -- start start 2024-04-25T02:22:54.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.136+0000 7f6bfb799700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6bf4063d10 0x7f6bf4119ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:54.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.136+0000 7f6bfb799700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6bf406eca0 0x7f6bf411b040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:54.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.136+0000 7f6bfb799700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6bf41196f0 0x7f6bf4152a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:54.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.136+0000 7f6bfb799700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf4152790 con 0x7f6bf406eca0 2024-04-25T02:22:54.140 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.136+0000 7f6bfb799700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf40aad60 con 0x7f6bf4063d10 2024-04-25T02:22:54.140 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.136+0000 7f6bfb799700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6bf411b580 con 0x7f6bf41196f0 2024-04-25T02:22:54.141 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.137+0000 7f6bf8d34700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6bf406eca0 0x7f6bf411b040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:54.141 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.137+0000 7f6bf8d34700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6bf406eca0 0x7f6bf411b040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:53286/0 (socket says 172.21.15.111:53286) 2024-04-25T02:22:54.141 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.137+0000 7f6bf8d34700 1 -- 172.21.15.111:0/1590636601 learned_addr learned my addr 172.21.15.111:0/1590636601 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:22:54.141 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.137+0000 7f6bf8d34700 1 -- 172.21.15.111:0/1590636601 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6bf41196f0 msgr2=0x7f6bf4152a30 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T02:22:54.141 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.137+0000 7f6bf8d34700 1 --2- 172.21.15.111:0/1590636601 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6bf41196f0 0x7f6bf4152a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:54.141 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.137+0000 7f6bf8d34700 1 -- 172.21.15.111:0/1590636601 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6bf4063d10 msgr2=0x7f6bf4119ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:54.141 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.137+0000 7f6bf8d34700 1 --2- 172.21.15.111:0/1590636601 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6bf4063d10 0x7f6bf4119ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:54.141 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.138+0000 7f6bf8d34700 1 -- 172.21.15.111:0/1590636601 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bf000b790 con 0x7f6bf406eca0 2024-04-25T02:22:54.141 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.138+0000 7f6bf8d34700 1 --2- 172.21.15.111:0/1590636601 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6bf406eca0 0x7f6bf411b040 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6bf406e710 tx=0x7f6bf001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:54.141 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.138+0000 7f6be97fa700 1 -- 172.21.15.111:0/1590636601 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf001d070 con 0x7f6bf406eca0 2024-04-25T02:22:54.142 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.138+0000 7f6be97fa700 1 -- 172.21.15.111:0/1590636601 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bf00106c0 con 0x7f6bf406eca0 2024-04-25T02:22:54.142 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.138+0000 7f6be97fa700 1 -- 172.21.15.111:0/1590636601 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bf0010a40 con 0x7f6bf406eca0 2024-04-25T02:22:54.142 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.138+0000 7f6bfb799700 1 -- 172.21.15.111:0/1590636601 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bf411a860 con 0x7f6bf406eca0 2024-04-25T02:22:54.142 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.138+0000 7f6bfb799700 1 -- 172.21.15.111:0/1590636601 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bf41523b0 con 0x7f6bf406eca0 2024-04-25T02:22:54.142 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.139+0000 7f6be97fa700 1 -- 172.21.15.111:0/1590636601 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 6) v1 ==== 42206+0+0 (secure 0 0 0) 0x7f6bf0021070 con 0x7f6bf406eca0 2024-04-25T02:22:54.142 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.140+0000 7f6be97fa700 1 -- 172.21.15.111:0/1590636601 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 3674+0+0 (secure 0 0 0) 0x7f6bf0014070 con 0x7f6bf406eca0 2024-04-25T02:22:54.142 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.140+0000 7f6bf9535700 1 -- 172.21.15.111:0/1590636601 >> v1:172.21.15.111:6816/39585 conn(0x7f6bd80394d0 legacy=0x7f6bd803b980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.111:6816/39585 2024-04-25T02:22:54.149 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705698 got 38654705697 for osd.1 2024-04-25T02:22:54.149 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.145+0000 7f6bfb799700 1 -- 172.21.15.111:0/1590636601 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bf4119b60 con 0x7f6bf406eca0 2024-04-25T02:22:54.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.152+0000 7f6be97fa700 1 -- 172.21.15.111:0/1590636601 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+112002 (secure 0 0 0) 0x7f6bf004b5a0 con 0x7f6bf406eca0 2024-04-25T02:22:54.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.194+0000 7f7027b72700 1 -- 172.21.15.111:0/1938221034 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f70200b0390 con 0x7f702006eca0 2024-04-25T02:22:54.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.195+0000 7f7011ffb700 1 -- 172.21.15.111:0/1938221034 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f701c0332f0 con 0x7f702006eca0 2024-04-25T02:22:54.198 INFO:teuthology.orchestra.run.smithi111.stdout:38654705696 2024-04-25T02:22:54.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.196+0000 7f7027b72700 1 -- 172.21.15.111:0/1938221034 >> v1:172.21.15.111:6816/39585 conn(0x7f7004039500 legacy=0x7f700403b9b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T02:22:54.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.196+0000 7f7027b72700 1 -- 172.21.15.111:0/1938221034 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f702006eca0 msgr2=0x7f70200a9560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:54.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.196+0000 7f7027b72700 1 --2- 172.21.15.111:0/1938221034 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f702006eca0 0x7f70200a9560 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f701c00b810 tx=0x7f701c009220 comp rx=0 tx=0).stop 2024-04-25T02:22:54.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.196+0000 7f7027b72700 1 -- 172.21.15.111:0/1938221034 shutdown_connections 2024-04-25T02:22:54.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.196+0000 7f7027b72700 1 --2- 172.21.15.111:0/1938221034 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f70200a9aa0 0x7f7020152ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:54.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.196+0000 7f7027b72700 1 --2- 172.21.15.111:0/1938221034 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7020063d10 0x7f70200aaa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:54.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.196+0000 7f7027b72700 1 --2- 172.21.15.111:0/1938221034 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f702006eca0 0x7f70200a9560 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:54.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.196+0000 7f7027b72700 1 -- 172.21.15.111:0/1938221034 >> 172.21.15.111:0/1938221034 conn(0x7f70200b1e10 msgr2=0x7f7020067940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:54.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.196+0000 7f7027b72700 1 -- 172.21.15.111:0/1938221034 shutdown_connections 2024-04-25T02:22:54.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.196+0000 7f7027b72700 1 -- 172.21.15.111:0/1938221034 wait complete. 2024-04-25T02:22:54.212 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705697 got 38654705696 for osd.3 2024-04-25T02:22:54.318 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-04-25T02:22:54.315+0000 7f5e56aad1c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T02:22:54.319 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-25T02:22:54.316+0000 7f1f561191c0 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-25T02:22:54.324 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.321+0000 7f2a50d4e700 1 -- 172.21.15.111:0/861941093 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f2a4c0ae980 con 0x7f2a4c0ad920 2024-04-25T02:22:54.324 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.321+0000 7f2a427fc700 1 -- 172.21.15.111:0/861941093 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f2a3c015070 con 0x7f2a4c0ad920 2024-04-25T02:22:54.324 INFO:teuthology.orchestra.run.smithi111.stdout:38654705698 2024-04-25T02:22:54.326 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.322+0000 7f2a50d4e700 1 -- 172.21.15.111:0/861941093 >> v1:172.21.15.111:6816/39585 conn(0x7f2a2c0394d0 legacy=0x7f2a2c03b980 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-25T02:22:54.326 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.322+0000 7f2a50d4e700 1 -- 172.21.15.111:0/861941093 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2a4c0ad920 msgr2=0x7f2a4c155840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:54.326 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.322+0000 7f2a50d4e700 1 --2- 172.21.15.111:0/861941093 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2a4c0ad920 0x7f2a4c155840 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f2a3c013000 tx=0x7f2a3c017000 comp rx=0 tx=0).stop 2024-04-25T02:22:54.327 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.323+0000 7f2a50d4e700 1 -- 172.21.15.111:0/861941093 shutdown_connections 2024-04-25T02:22:54.327 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.323+0000 7f2a50d4e700 1 --2- 172.21.15.111:0/861941093 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2a4c0a7440 0x7f2a4c155d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:54.327 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.323+0000 7f2a50d4e700 1 --2- 172.21.15.111:0/861941093 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2a4c0ad550 0x7f2a4c0a5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:54.327 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.323+0000 7f2a50d4e700 1 --2- 172.21.15.111:0/861941093 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2a4c0ad920 0x7f2a4c155840 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:54.327 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.323+0000 7f2a50d4e700 1 -- 172.21.15.111:0/861941093 >> 172.21.15.111:0/861941093 conn(0x7f2a4c0b1e10 msgr2=0x7f2a4c145390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:54.327 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.323+0000 7f2a50d4e700 1 -- 172.21.15.111:0/861941093 shutdown_connections 2024-04-25T02:22:54.328 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.323+0000 7f2a50d4e700 1 -- 172.21.15.111:0/861941093 wait complete. 2024-04-25T02:22:54.339 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705699 got 38654705698 for osd.2 2024-04-25T02:22:54.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.341+0000 7f6bf9535700 1 -- 172.21.15.111:0/1590636601 >> v1:172.21.15.111:6816/39585 conn(0x7f6bd80394d0 legacy=0x7f6bd803b980 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v1:172.21.15.111:6816/39585 2024-04-25T02:22:54.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.353+0000 7f6bfb799700 1 -- 172.21.15.111:0/1590636601 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f6bf4071790 con 0x7f6bf406eca0 2024-04-25T02:22:54.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.353+0000 7f6be97fa700 1 -- 172.21.15.111:0/1590636601 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6bf0030030 con 0x7f6bf406eca0 2024-04-25T02:22:54.356 INFO:teuthology.orchestra.run.smithi111.stdout:38654705696 2024-04-25T02:22:54.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.354+0000 7f6bfb799700 1 -- 172.21.15.111:0/1590636601 >> v1:172.21.15.111:6816/39585 conn(0x7f6bd80394d0 legacy=0x7f6bd803b980 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T02:22:54.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.354+0000 7f6bfb799700 1 -- 172.21.15.111:0/1590636601 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6bf406eca0 msgr2=0x7f6bf411b040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:54.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.354+0000 7f6bfb799700 1 --2- 172.21.15.111:0/1590636601 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6bf406eca0 0x7f6bf411b040 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6bf406e710 tx=0x7f6bf001b000 comp rx=0 tx=0).stop 2024-04-25T02:22:54.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.355+0000 7f6bfb799700 1 -- 172.21.15.111:0/1590636601 shutdown_connections 2024-04-25T02:22:54.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.355+0000 7f6bfb799700 1 --2- 172.21.15.111:0/1590636601 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6bf41196f0 0x7f6bf4152a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:54.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.355+0000 7f6bfb799700 1 --2- 172.21.15.111:0/1590636601 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6bf4063d10 0x7f6bf4119ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:54.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.355+0000 7f6bfb799700 1 --2- 172.21.15.111:0/1590636601 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6bf406eca0 0x7f6bf411b040 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:54.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.355+0000 7f6bfb799700 1 -- 172.21.15.111:0/1590636601 >> 172.21.15.111:0/1590636601 conn(0x7f6bf40b1e10 msgr2=0x7f6bf40b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:54.359 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.355+0000 7f6bfb799700 1 -- 172.21.15.111:0/1590636601 shutdown_connections 2024-04-25T02:22:54.360 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:54.355+0000 7f6bfb799700 1 -- 172.21.15.111:0/1590636601 wait complete. 2024-04-25T02:22:54.372 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705697 got 38654705696 for osd.0 2024-04-25T02:22:54.449 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-04-25T02:22:54.446+0000 7f5e56aad1c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T02:22:54.449 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-25T02:22:54.447+0000 7f1f561191c0 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-25T02:22:54.600 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-25T02:22:54.597+0000 7f1f561191c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T02:22:54.600 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-04-25T02:22:54.598+0000 7f5e56aad1c0 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-25T02:22:54.702 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-25T02:22:54.700+0000 7f1f561191c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T02:22:54.703 INFO:tasks.ceph.mgr.x.smithi111.stderr:2024-04-25T02:22:54.701+0000 7f5e56aad1c0 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-25T02:22:54.781 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-25T02:22:54.778+0000 7f1f1701c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T02:22:54.781 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-25T02:22:54.778+0000 7f1f1701c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T02:22:54.781 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-25T02:22:54.778+0000 7f1f1701c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T02:22:54.782 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-25T02:22:54.778+0000 7f1f1701c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T02:22:54.782 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-25T02:22:54.778+0000 7f1f1701c700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T02:22:54.782 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-25T02:22:54.778+0000 7f1f1a823700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T02:22:54.782 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-25T02:22:54.778+0000 7f1f1a823700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T02:22:54.782 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-25T02:22:54.778+0000 7f1f1a823700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T02:22:54.782 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-25T02:22:54.778+0000 7f1f1a823700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T02:22:54.782 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-25T02:22:54.778+0000 7f1f1a823700 -1 client.0 error registering admin socket command: (17) File exists 2024-04-25T02:22:55.149 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T02:22:55.213 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T02:22:55.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.270+0000 7f474c3c9700 1 Processor -- start 2024-04-25T02:22:55.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.270+0000 7f474c3c9700 1 -- start start 2024-04-25T02:22:55.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.271+0000 7f474c3c9700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f47440a2560 0x7f474413ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:55.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.271+0000 7f474c3c9700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f474413ef40 0x7f4744148d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:55.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.271+0000 7f474c3c9700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47440a46d0 con 0x7f47440b4fd0 2024-04-25T02:22:55.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.271+0000 7f474c3c9700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47440a6710 con 0x7f474413ef40 2024-04-25T02:22:55.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.271+0000 7f474c3c9700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f474413f3e0 con 0x7f47440a2560 2024-04-25T02:22:55.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.271+0000 7f474a966700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f474413ef40 0x7f4744148d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:55.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.271+0000 7f474a165700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f47440b4fd0 0x7f47440a3980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:55456/0 (socket says 172.21.15.111:55456) 2024-04-25T02:22:55.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.271+0000 7f4749964700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f47440a2560 0x7f474413ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:55.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.271+0000 7f474a165700 1 -- 172.21.15.111:0/3085934340 learned_addr learned my addr 172.21.15.111:0/3085934340 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:22:55.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.272+0000 7f4749163700 1 -- 172.21.15.111:0/3085934340 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3851547926 0 0) 0x7f47440a46d0 con 0x7f47440b4fd0 2024-04-25T02:22:55.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.272+0000 7f474a966700 1 -- 172.21.15.111:0/3085934340 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f47440a2560 msgr2=0x7f474413ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:22:55.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.272+0000 7f474a966700 1 --2- 172.21.15.111:0/3085934340 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f47440a2560 0x7f474413ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:55.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.272+0000 7f474a966700 1 -- 172.21.15.111:0/3085934340 >> v1:172.21.15.111:6789/0 conn(0x7f47440b4fd0 legacy=0x7f47440a3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:55.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.272+0000 7f474a966700 1 -- 172.21.15.111:0/3085934340 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47440a4930 con 0x7f474413ef40 2024-04-25T02:22:55.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.272+0000 7f4749964700 1 --2- 172.21.15.111:0/3085934340 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f47440a2560 0x7f474413ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:22:55.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.272+0000 7f474a966700 1 --2- 172.21.15.111:0/3085934340 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f474413ef40 0x7f4744148d60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f473c009e90 tx=0x7f473c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fdd87470a42b522f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:55.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.272+0000 7f4749163700 1 -- 172.21.15.111:0/3085934340 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473c00e070 con 0x7f474413ef40 2024-04-25T02:22:55.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.272+0000 7f4749163700 1 -- 172.21.15.111:0/3085934340 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f473c00bc30 con 0x7f474413ef40 2024-04-25T02:22:55.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.272+0000 7f4749163700 1 -- 172.21.15.111:0/3085934340 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473c012430 con 0x7f474413ef40 2024-04-25T02:22:55.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.272+0000 7f474c3c9700 1 -- 172.21.15.111:0/3085934340 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f474413ef40 msgr2=0x7f4744148d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:55.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.272+0000 7f474c3c9700 1 --2- 172.21.15.111:0/3085934340 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f474413ef40 0x7f4744148d60 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f473c009e90 tx=0x7f473c009780 comp rx=0 tx=0).stop 2024-04-25T02:22:55.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.273+0000 7f474c3c9700 1 -- 172.21.15.111:0/3085934340 shutdown_connections 2024-04-25T02:22:55.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.273+0000 7f474c3c9700 1 --2- 172.21.15.111:0/3085934340 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f474413ef40 0x7f4744148d60 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:55.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.273+0000 7f474c3c9700 1 --2- 172.21.15.111:0/3085934340 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f47440a2560 0x7f474413ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:55.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.273+0000 7f474c3c9700 1 -- 172.21.15.111:0/3085934340 >> 172.21.15.111:0/3085934340 conn(0x7f47440883e0 msgr2=0x7f4744068b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:55.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.273+0000 7f474c3c9700 1 -- 172.21.15.111:0/3085934340 shutdown_connections 2024-04-25T02:22:55.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.273+0000 7f474c3c9700 1 -- 172.21.15.111:0/3085934340 wait complete. 2024-04-25T02:22:55.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.274+0000 7f474c3c9700 1 Processor -- start 2024-04-25T02:22:55.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.274+0000 7f474c3c9700 1 -- start start 2024-04-25T02:22:55.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.275+0000 7f474c3c9700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f47440a2560 0x7f474409c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:55.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.275+0000 7f474c3c9700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f47440b4fd0 0x7f474409b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:55.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.275+0000 7f474c3c9700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f474413ef40 0x7f4744151490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:55.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.275+0000 7f474c3c9700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f474409d270 con 0x7f474413ef40 2024-04-25T02:22:55.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.275+0000 7f474c3c9700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f474409be00 con 0x7f47440a2560 2024-04-25T02:22:55.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.275+0000 7f474c3c9700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f474409a640 con 0x7f47440b4fd0 2024-04-25T02:22:55.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.275+0000 7f474a966700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f474413ef40 0x7f4744151490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:55.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.275+0000 7f474a165700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f47440a2560 0x7f474409c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:55.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.275+0000 7f4749964700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f47440b4fd0 0x7f474409b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:55.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.275+0000 7f474a966700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f474413ef40 0x7f4744151490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:53396/0 (socket says 172.21.15.111:53396) 2024-04-25T02:22:55.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.275+0000 7f474a966700 1 -- 172.21.15.111:0/4207306933 learned_addr learned my addr 172.21.15.111:0/4207306933 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:22:55.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.275+0000 7f474a966700 1 -- 172.21.15.111:0/4207306933 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f47440b4fd0 msgr2=0x7f474409b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:55.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.275+0000 7f474a966700 1 --2- 172.21.15.111:0/4207306933 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f47440b4fd0 0x7f474409b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:55.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.275+0000 7f474a966700 1 -- 172.21.15.111:0/4207306933 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f47440a2560 msgr2=0x7f474409c990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:55.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.275+0000 7f474a966700 1 --2- 172.21.15.111:0/4207306933 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f47440a2560 0x7f474409c990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:55.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.275+0000 7f474a966700 1 -- 172.21.15.111:0/4207306933 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4734009420 con 0x7f474413ef40 2024-04-25T02:22:55.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.275+0000 7f474a165700 1 --2- 172.21.15.111:0/4207306933 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f47440a2560 0x7f474409c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:22:55.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.275+0000 7f4749964700 1 --2- 172.21.15.111:0/4207306933 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f47440b4fd0 0x7f474409b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:22:55.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.275+0000 7f474a966700 1 --2- 172.21.15.111:0/4207306933 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f474413ef40 0x7f4744151490 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f473c0097c0 tx=0x7f473c019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:55.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.275+0000 7f473a7fc700 1 -- 172.21.15.111:0/4207306933 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473c009420 con 0x7f474413ef40 2024-04-25T02:22:55.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.275+0000 7f474c3c9700 1 -- 172.21.15.111:0/4207306933 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f473c009a20 con 0x7f474413ef40 2024-04-25T02:22:55.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.275+0000 7f473a7fc700 1 -- 172.21.15.111:0/4207306933 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f473c027470 con 0x7f474413ef40 2024-04-25T02:22:55.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.275+0000 7f473a7fc700 1 -- 172.21.15.111:0/4207306933 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f473c027810 con 0x7f474413ef40 2024-04-25T02:22:55.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.275+0000 7f474c3c9700 1 -- 172.21.15.111:0/4207306933 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47440a1200 con 0x7f474413ef40 2024-04-25T02:22:55.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.276+0000 7f474c3c9700 1 -- 172.21.15.111:0/4207306933 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47440a13f0 con 0x7f474413ef40 2024-04-25T02:22:55.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.277+0000 7f473a7fc700 1 -- 172.21.15.111:0/4207306933 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 7) v1 ==== 53244+0+0 (secure 0 0 0) 0x7f473c024070 con 0x7f474413ef40 2024-04-25T02:22:55.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.277+0000 7f473a7fc700 1 -- 172.21.15.111:0/4207306933 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3846+0+0 (secure 0 0 0) 0x7f473c05d7c0 con 0x7f474413ef40 2024-04-25T02:22:55.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.280+0000 7f473a7fc700 1 -- 172.21.15.111:0/4207306933 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+112002 (secure 0 0 0) 0x7f473c00ae90 con 0x7f474413ef40 2024-04-25T02:22:55.335 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.332+0000 7f9d2855d700 1 Processor -- start 2024-04-25T02:22:55.335 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.332+0000 7f9d2855d700 1 -- start start 2024-04-25T02:22:55.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.333+0000 7f9d2855d700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9d200b4fd0 0x7f9d200a2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:55.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.333+0000 7f9d2855d700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f9d2013f110 0x7f9d200a3d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:55.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.333+0000 7f9d2855d700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d200a46d0 con 0x7f9d200a3980 2024-04-25T02:22:55.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.333+0000 7f9d2855d700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d200a6710 con 0x7f9d2013f110 2024-04-25T02:22:55.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.333+0000 7f9d2855d700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d200a4930 con 0x7f9d200b4fd0 2024-04-25T02:22:55.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.333+0000 7f9d262f9700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9d200b4fd0 0x7f9d200a2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:55.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.333+0000 7f9d26afa700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f9d2013f110 0x7f9d200a3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:55.339 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.333+0000 7f9d262f9700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9d200b4fd0 0x7f9d200a2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:58008/0 (socket says 172.21.15.111:58008) 2024-04-25T02:22:55.339 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.333+0000 7f9d262f9700 1 -- 172.21.15.111:0/1175153809 learned_addr learned my addr 172.21.15.111:0/1175153809 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:22:55.339 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.333+0000 7f9d262f9700 1 -- 172.21.15.111:0/1175153809 >> v2:172.21.15.111:3300/0 conn(0x7f9d2013f110 msgr2=0x7f9d200a3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:22:55.339 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.333+0000 7f9d262f9700 1 --2- 172.21.15.111:0/1175153809 >> v2:172.21.15.111:3300/0 conn(0x7f9d2013f110 0x7f9d200a3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:55.339 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.333+0000 7f9d262f9700 1 -- 172.21.15.111:0/1175153809 >> v1:172.21.15.111:6789/0 conn(0x7f9d200a3980 legacy=0x7f9d2013ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:55.339 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.333+0000 7f9d262f9700 1 -- 172.21.15.111:0/1175153809 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d200a31a0 con 0x7f9d200b4fd0 2024-04-25T02:22:55.339 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.333+0000 7f9d26afa700 1 --2- 172.21.15.111:0/1175153809 >> v2:172.21.15.111:3300/0 conn(0x7f9d2013f110 0x7f9d200a3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:22:55.339 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.333+0000 7f9d262f9700 1 --2- 172.21.15.111:0/1175153809 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9d200b4fd0 0x7f9d200a2560 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c0099b0 tx=0x7f9d1c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f5cc51e81afd3353 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:55.339 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.334+0000 7f9d252f7700 1 -- 172.21.15.111:0/1175153809 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c009ea0 con 0x7f9d200b4fd0 2024-04-25T02:22:55.339 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.334+0000 7f9d252f7700 1 -- 172.21.15.111:0/1175153809 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1c00b860 con 0x7f9d200b4fd0 2024-04-25T02:22:55.339 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.334+0000 7f9d252f7700 1 -- 172.21.15.111:0/1175153809 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c00bc00 con 0x7f9d200b4fd0 2024-04-25T02:22:55.339 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.334+0000 7f9d2855d700 1 -- 172.21.15.111:0/1175153809 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9d200b4fd0 msgr2=0x7f9d200a2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:55.339 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.334+0000 7f9d2855d700 1 --2- 172.21.15.111:0/1175153809 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9d200b4fd0 0x7f9d200a2560 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c0099b0 tx=0x7f9d1c009250 comp rx=0 tx=0).stop 2024-04-25T02:22:55.339 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.334+0000 7f9d2855d700 1 -- 172.21.15.111:0/1175153809 shutdown_connections 2024-04-25T02:22:55.340 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.334+0000 7f9d2855d700 1 --2- 172.21.15.111:0/1175153809 >> v2:172.21.15.111:3300/0 conn(0x7f9d2013f110 0x7f9d200a3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:55.340 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.334+0000 7f9d2855d700 1 --2- 172.21.15.111:0/1175153809 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9d200b4fd0 0x7f9d200a2560 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:55.340 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.334+0000 7f9d2855d700 1 -- 172.21.15.111:0/1175153809 >> 172.21.15.111:0/1175153809 conn(0x7f9d200883e0 msgr2=0x7f9d20068b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:55.340 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.334+0000 7f9d2855d700 1 -- 172.21.15.111:0/1175153809 shutdown_connections 2024-04-25T02:22:55.340 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.334+0000 7f9d2855d700 1 -- 172.21.15.111:0/1175153809 wait complete. 2024-04-25T02:22:55.340 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.335+0000 7f9d2855d700 1 Processor -- start 2024-04-25T02:22:55.340 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.335+0000 7f9d2855d700 1 -- start start 2024-04-25T02:22:55.340 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T02:22:55.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.336+0000 7f9d2855d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d200a3980 0x7f9d20144dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:55.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.336+0000 7f9d2855d700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9d200b4fd0 0x7f9d20143960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:55.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.336+0000 7f9d2855d700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9d2013f110 0x7f9d2014ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:55.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.336+0000 7f9d2855d700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2013e270 con 0x7f9d200a3980 2024-04-25T02:22:55.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.336+0000 7f9d2855d700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d201445e0 con 0x7f9d200b4fd0 2024-04-25T02:22:55.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.336+0000 7f9d2855d700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d201448c0 con 0x7f9d2013f110 2024-04-25T02:22:55.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.336+0000 7f9d262f9700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d200a3980 0x7f9d20144dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:55.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.336+0000 7f9d25af8700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9d200b4fd0 0x7f9d20143960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:55.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.336+0000 7f9d262f9700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d200a3980 0x7f9d20144dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:53418/0 (socket says 172.21.15.111:53418) 2024-04-25T02:22:55.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.336+0000 7f9d262f9700 1 -- 172.21.15.111:0/4127704777 learned_addr learned my addr 172.21.15.111:0/4127704777 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:22:55.343 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.336+0000 7f9d26afa700 1 --2- 172.21.15.111:0/4127704777 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9d2013f110 0x7f9d2014ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:55.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.336+0000 7f9d262f9700 1 -- 172.21.15.111:0/4127704777 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9d2013f110 msgr2=0x7f9d2014ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:55.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.336+0000 7f9d262f9700 1 --2- 172.21.15.111:0/4127704777 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9d2013f110 0x7f9d2014ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:55.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.336+0000 7f9d262f9700 1 -- 172.21.15.111:0/4127704777 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9d200b4fd0 msgr2=0x7f9d20143960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:55.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.336+0000 7f9d262f9700 1 --2- 172.21.15.111:0/4127704777 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9d200b4fd0 0x7f9d20143960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:55.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.336+0000 7f9d262f9700 1 -- 172.21.15.111:0/4127704777 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d18009a20 con 0x7f9d200a3980 2024-04-25T02:22:55.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.336+0000 7f9d262f9700 1 --2- 172.21.15.111:0/4127704777 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d200a3980 0x7f9d20144dc0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9d200a6850 tx=0x7f9d1c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:55.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.336+0000 7f9d167fc700 1 -- 172.21.15.111:0/4127704777 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c00bbe0 con 0x7f9d200a3980 2024-04-25T02:22:55.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.336+0000 7f9d167fc700 1 -- 172.21.15.111:0/4127704777 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1c011420 con 0x7f9d200a3980 2024-04-25T02:22:55.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.336+0000 7f9d2855d700 1 -- 172.21.15.111:0/4127704777 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d1c0094f0 con 0x7f9d200a3980 2024-04-25T02:22:55.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.336+0000 7f9d167fc700 1 -- 172.21.15.111:0/4127704777 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c0117c0 con 0x7f9d200a3980 2024-04-25T02:22:55.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.336+0000 7f9d2855d700 1 -- 172.21.15.111:0/4127704777 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d2013dfe0 con 0x7f9d200a3980 2024-04-25T02:22:55.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.337+0000 7f9d167fc700 1 -- 172.21.15.111:0/4127704777 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 7) v1 ==== 53244+0+0 (secure 0 0 0) 0x7f9d1c011bf0 con 0x7f9d200a3980 2024-04-25T02:22:55.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.337+0000 7f9d2855d700 1 -- 172.21.15.111:0/4127704777 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d20068d50 con 0x7f9d200a3980 2024-04-25T02:22:55.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.338+0000 7f9d167fc700 1 -- 172.21.15.111:0/4127704777 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3846+0+0 (secure 0 0 0) 0x7f9d1c05bff0 con 0x7f9d200a3980 2024-04-25T02:22:55.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.341+0000 7f9d167fc700 1 -- 172.21.15.111:0/4127704777 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+112002 (secure 0 0 0) 0x7f9d1c07e5a0 con 0x7f9d200a3980 2024-04-25T02:22:55.372 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T02:22:55.409 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.407+0000 7f474c3c9700 1 -- 172.21.15.111:0/4207306933 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f474409e110 con 0x7f474413ef40 2024-04-25T02:22:55.410 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.407+0000 7f473a7fc700 1 -- 172.21.15.111:0/4207306933 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f473c02c030 con 0x7f474413ef40 2024-04-25T02:22:55.410 INFO:teuthology.orchestra.run.smithi111.stdout:38654705697 2024-04-25T02:22:55.411 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.409+0000 7f474c3c9700 1 -- 172.21.15.111:0/4207306933 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f474413ef40 msgr2=0x7f4744151490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:55.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.409+0000 7f474c3c9700 1 --2- 172.21.15.111:0/4207306933 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f474413ef40 0x7f4744151490 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f473c0097c0 tx=0x7f473c019000 comp rx=0 tx=0).stop 2024-04-25T02:22:55.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.409+0000 7f474c3c9700 1 -- 172.21.15.111:0/4207306933 shutdown_connections 2024-04-25T02:22:55.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.409+0000 7f474c3c9700 1 --2- 172.21.15.111:0/4207306933 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f474413ef40 0x7f4744151490 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:55.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.409+0000 7f474c3c9700 1 --2- 172.21.15.111:0/4207306933 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f47440a2560 0x7f474409c990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:55.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.409+0000 7f474c3c9700 1 --2- 172.21.15.111:0/4207306933 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f47440b4fd0 0x7f474409b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:55.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.409+0000 7f474c3c9700 1 -- 172.21.15.111:0/4207306933 >> 172.21.15.111:0/4207306933 conn(0x7f47440883e0 msgr2=0x7f474413f7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:55.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.410+0000 7f474c3c9700 1 -- 172.21.15.111:0/4207306933 shutdown_connections 2024-04-25T02:22:55.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.410+0000 7f474c3c9700 1 -- 172.21.15.111:0/4207306933 wait complete. 2024-04-25T02:22:55.427 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705698 got 38654705697 for osd.1 2024-04-25T02:22:55.465 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.462+0000 7f97f7d7f700 1 Processor -- start 2024-04-25T02:22:55.466 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.463+0000 7f97f7d7f700 1 -- start start 2024-04-25T02:22:55.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.463+0000 7f97f7d7f700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f97f00ad3f0 0x7f97f00aa260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:55.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.463+0000 7f97f7d7f700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f97f00aac50 0x7f97f013b830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:55.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.463+0000 7f97f7d7f700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f97f013bd70 0x7f97f0067940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:55.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.463+0000 7f97f7d7f700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97f00abea0 con 0x7f97f013bd70 2024-04-25T02:22:55.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.463+0000 7f97f7d7f700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f00ad7c0 con 0x7f97f00ad3f0 2024-04-25T02:22:55.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.463+0000 7f97f7d7f700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97f00aa7a0 con 0x7f97f00aac50 2024-04-25T02:22:55.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.463+0000 7f97f5b1b700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f97f00ad3f0 0x7f97f00aa260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:55.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.463+0000 7f97f531a700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f97f00aac50 0x7f97f013b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:55.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.464+0000 7f97f5b1b700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f97f00ad3f0 0x7f97f00aa260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:33092/0 (socket says 172.21.15.111:33092) 2024-04-25T02:22:55.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.464+0000 7f97f5b1b700 1 -- 172.21.15.111:0/3950657319 learned_addr learned my addr 172.21.15.111:0/3950657319 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:22:55.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.464+0000 7f97f531a700 1 --2- 172.21.15.111:0/3950657319 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f97f00aac50 0x7f97f013b830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:58014/0 (socket says 172.21.15.111:58014) 2024-04-25T02:22:55.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.464+0000 7f97f631c700 1 --2- 172.21.15.111:0/3950657319 >> v2:172.21.15.111:3300/0 conn(0x7f97f013bd70 0x7f97f0067940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:55.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.464+0000 7f97f5b1b700 1 -- 172.21.15.111:0/3950657319 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f97f00aac50 msgr2=0x7f97f013b830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:22:55.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.464+0000 7f97f5b1b700 1 --2- 172.21.15.111:0/3950657319 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f97f00aac50 0x7f97f013b830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:55.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.464+0000 7f97f5b1b700 1 -- 172.21.15.111:0/3950657319 >> v2:172.21.15.111:3300/0 conn(0x7f97f013bd70 msgr2=0x7f97f0067940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:22:55.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.464+0000 7f97f5b1b700 1 --2- 172.21.15.111:0/3950657319 >> v2:172.21.15.111:3300/0 conn(0x7f97f013bd70 0x7f97f0067940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:55.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.464+0000 7f97f5b1b700 1 -- 172.21.15.111:0/3950657319 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f00ac530 con 0x7f97f00ad3f0 2024-04-25T02:22:55.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.464+0000 7f97f531a700 1 --2- 172.21.15.111:0/3950657319 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f97f00aac50 0x7f97f013b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:22:55.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.464+0000 7f97f631c700 1 --2- 172.21.15.111:0/3950657319 >> v2:172.21.15.111:3300/0 conn(0x7f97f013bd70 0x7f97f0067940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:22:55.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.464+0000 7f97f5b1b700 1 --2- 172.21.15.111:0/3950657319 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f97f00ad3f0 0x7f97f00aa260 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f97ec0099b0 tx=0x7f97ec009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a95763b12b491f0e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:55.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.464+0000 7f97f4b19700 1 -- 172.21.15.111:0/3950657319 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ec00b710 con 0x7f97f00ad3f0 2024-04-25T02:22:55.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.464+0000 7f97f4b19700 1 -- 172.21.15.111:0/3950657319 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97ec00b870 con 0x7f97f00ad3f0 2024-04-25T02:22:55.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.464+0000 7f97f4b19700 1 -- 172.21.15.111:0/3950657319 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ec00bc10 con 0x7f97f00ad3f0 2024-04-25T02:22:55.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.465+0000 7f97f7d7f700 1 -- 172.21.15.111:0/3950657319 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f97f00ad3f0 msgr2=0x7f97f00aa260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:55.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.465+0000 7f97f7d7f700 1 --2- 172.21.15.111:0/3950657319 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f97f00ad3f0 0x7f97f00aa260 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f97ec0099b0 tx=0x7f97ec009250 comp rx=0 tx=0).stop 2024-04-25T02:22:55.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.465+0000 7f97f7d7f700 1 -- 172.21.15.111:0/3950657319 shutdown_connections 2024-04-25T02:22:55.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.465+0000 7f97f7d7f700 1 --2- 172.21.15.111:0/3950657319 >> v2:172.21.15.111:3300/0 conn(0x7f97f013bd70 0x7f97f0067940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:55.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.465+0000 7f97f7d7f700 1 --2- 172.21.15.111:0/3950657319 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f97f00ad3f0 0x7f97f00aa260 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:55.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.465+0000 7f97f7d7f700 1 --2- 172.21.15.111:0/3950657319 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f97f00aac50 0x7f97f013b830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:55.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.465+0000 7f97f7d7f700 1 -- 172.21.15.111:0/3950657319 >> 172.21.15.111:0/3950657319 conn(0x7f97f00b1390 msgr2=0x7f97f00b1760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:55.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.465+0000 7f97f7d7f700 1 -- 172.21.15.111:0/3950657319 shutdown_connections 2024-04-25T02:22:55.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.465+0000 7f97f7d7f700 1 -- 172.21.15.111:0/3950657319 wait complete. 2024-04-25T02:22:55.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.466+0000 7f97f7d7f700 1 Processor -- start 2024-04-25T02:22:55.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.466+0000 7f97f7d7f700 1 -- start start 2024-04-25T02:22:55.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.466+0000 7f97f7d7f700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f97f00aac50 0x7f97f0141640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:55.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.466+0000 7f97f7d7f700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f97f00ad3f0 0x7f97f0151650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:55.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.466+0000 7f97f7d7f700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f97f013bd70 0x7f97f0151b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:55.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.466+0000 7f97f7d7f700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97f0119f30 con 0x7f97f00ad3f0 2024-04-25T02:22:55.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.466+0000 7f97f7d7f700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97f0141da0 con 0x7f97f00aac50 2024-04-25T02:22:55.473 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.466+0000 7f97f7d7f700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f97f0142060 con 0x7f97f013bd70 2024-04-25T02:22:55.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.467+0000 7f97f531a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f97f00ad3f0 0x7f97f0151650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:55.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.467+0000 7f97f531a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f97f00ad3f0 0x7f97f0151650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:53436/0 (socket says 172.21.15.111:53436) 2024-04-25T02:22:55.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.467+0000 7f97f531a700 1 -- 172.21.15.111:0/677479580 learned_addr learned my addr 172.21.15.111:0/677479580 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:22:55.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.467+0000 7f97f5b1b700 1 --2- 172.21.15.111:0/677479580 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f97f00aac50 0x7f97f0141640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:55.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.467+0000 7f97f631c700 1 --2- 172.21.15.111:0/677479580 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f97f013bd70 0x7f97f0151b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:55.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.467+0000 7f97f5b1b700 1 -- 172.21.15.111:0/677479580 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f97f013bd70 msgr2=0x7f97f0151b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:55.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.467+0000 7f97f5b1b700 1 --2- 172.21.15.111:0/677479580 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f97f013bd70 0x7f97f0151b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:55.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.467+0000 7f97f5b1b700 1 -- 172.21.15.111:0/677479580 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f97f00ad3f0 msgr2=0x7f97f0151650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:55.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.467+0000 7f97f5b1b700 1 --2- 172.21.15.111:0/677479580 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f97f00ad3f0 0x7f97f0151650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:55.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.467+0000 7f97f5b1b700 1 -- 172.21.15.111:0/677479580 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e0009420 con 0x7f97f00aac50 2024-04-25T02:22:55.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.467+0000 7f97f631c700 1 --2- 172.21.15.111:0/677479580 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f97f013bd70 0x7f97f0151b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:22:55.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.467+0000 7f97f531a700 1 --2- 172.21.15.111:0/677479580 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f97f00ad3f0 0x7f97f0151650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:22:55.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.467+0000 7f97f5b1b700 1 --2- 172.21.15.111:0/677479580 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f97f00aac50 0x7f97f0141640 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f97f00ad0d0 tx=0x7f97ec017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:55.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.467+0000 7f97e5ffb700 1 -- 172.21.15.111:0/677479580 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ec00bbf0 con 0x7f97f00aac50 2024-04-25T02:22:55.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.467+0000 7f97e5ffb700 1 -- 172.21.15.111:0/677479580 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97ec025440 con 0x7f97f00aac50 2024-04-25T02:22:55.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.467+0000 7f97f7d7f700 1 -- 172.21.15.111:0/677479580 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97e8009a20 con 0x7f97f00aac50 2024-04-25T02:22:55.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.467+0000 7f97e5ffb700 1 -- 172.21.15.111:0/677479580 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97ec025800 con 0x7f97f00aac50 2024-04-25T02:22:55.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.467+0000 7f97f7d7f700 1 -- 172.21.15.111:0/677479580 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97ec0094f0 con 0x7f97f00aac50 2024-04-25T02:22:55.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.468+0000 7f97e5ffb700 1 -- 172.21.15.111:0/677479580 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 7) v1 ==== 53244+0+0 (secure 0 0 0) 0x7f97ec011420 con 0x7f97f00aac50 2024-04-25T02:22:55.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.469+0000 7f97f7d7f700 1 -- 172.21.15.111:0/677479580 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97f0071790 con 0x7f97f00aac50 2024-04-25T02:22:55.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.469+0000 7f97e5ffb700 1 -- 172.21.15.111:0/677479580 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3846+0+0 (secure 0 0 0) 0x7f97ec05bd80 con 0x7f97f00aac50 2024-04-25T02:22:55.476 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.472+0000 7f97e5ffb700 1 -- 172.21.15.111:0/677479580 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+112002 (secure 0 0 0) 0x7f97ec03e080 con 0x7f97f00aac50 2024-04-25T02:22:55.479 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.476+0000 7f9d2855d700 1 -- 172.21.15.111:0/4127704777 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f9d20065190 con 0x7f9d200a3980 2024-04-25T02:22:55.479 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.476+0000 7f9d167fc700 1 -- 172.21.15.111:0/4127704777 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f9d1c015070 con 0x7f9d200a3980 2024-04-25T02:22:55.479 INFO:teuthology.orchestra.run.smithi111.stdout:38654705696 2024-04-25T02:22:55.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.478+0000 7f9d2855d700 1 -- 172.21.15.111:0/4127704777 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d200a3980 msgr2=0x7f9d20144dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:55.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.478+0000 7f9d2855d700 1 --2- 172.21.15.111:0/4127704777 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d200a3980 0x7f9d20144dc0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f9d200a6850 tx=0x7f9d1c017000 comp rx=0 tx=0).stop 2024-04-25T02:22:55.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.478+0000 7f9d2855d700 1 -- 172.21.15.111:0/4127704777 shutdown_connections 2024-04-25T02:22:55.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.478+0000 7f9d2855d700 1 --2- 172.21.15.111:0/4127704777 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9d2013f110 0x7f9d2014ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:55.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.478+0000 7f9d2855d700 1 --2- 172.21.15.111:0/4127704777 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d200a3980 0x7f9d20144dc0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:55.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.478+0000 7f9d2855d700 1 --2- 172.21.15.111:0/4127704777 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9d200b4fd0 0x7f9d20143960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:55.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.478+0000 7f9d2855d700 1 -- 172.21.15.111:0/4127704777 >> 172.21.15.111:0/4127704777 conn(0x7f9d200883e0 msgr2=0x7f9d20148360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:55.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.478+0000 7f9d2855d700 1 -- 172.21.15.111:0/4127704777 shutdown_connections 2024-04-25T02:22:55.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.478+0000 7f9d2855d700 1 -- 172.21.15.111:0/4127704777 wait complete. 2024-04-25T02:22:55.492 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705697 got 38654705696 for osd.3 2024-04-25T02:22:55.510 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.508+0000 7f86cf360700 1 Processor -- start 2024-04-25T02:22:55.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.508+0000 7f86cf360700 1 -- start start 2024-04-25T02:22:55.513 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.509+0000 7f86cf360700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f86c80b4d80 0x7f86c80b0fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:55.513 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.509+0000 7f86cf360700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f86c80a20e0 0x7f86c80b1960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:55.513 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.509+0000 7f86cf360700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f86c8142e60 0x7f86c81432d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:55.513 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.509+0000 7f86cf360700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86c80b1520 con 0x7f86c8142e60 2024-04-25T02:22:55.514 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.509+0000 7f86cf360700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c8142bc0 con 0x7f86c80b4d80 2024-04-25T02:22:55.514 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.509+0000 7f86cf360700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86c81428f0 con 0x7f86c80a20e0 2024-04-25T02:22:55.514 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.509+0000 7f86cc8fb700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f86c80a20e0 0x7f86c80b1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:55.514 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.509+0000 7f86cc8fb700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f86c80a20e0 0x7f86c80b1960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:58034/0 (socket says 172.21.15.111:58034) 2024-04-25T02:22:55.514 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.509+0000 7f86cd0fc700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f86c80b4d80 0x7f86c80b0fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:55.514 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.509+0000 7f86cc8fb700 1 -- 172.21.15.111:0/248356477 learned_addr learned my addr 172.21.15.111:0/248356477 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:22:55.514 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.509+0000 7f86cd8fd700 1 --2- 172.21.15.111:0/248356477 >> v2:172.21.15.111:3300/0 conn(0x7f86c8142e60 0x7f86c81432d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:55.514 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.509+0000 7f86cd0fc700 1 -- 172.21.15.111:0/248356477 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f86c80a20e0 msgr2=0x7f86c80b1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:22:55.514 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.509+0000 7f86cd0fc700 1 --2- 172.21.15.111:0/248356477 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f86c80a20e0 0x7f86c80b1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:55.514 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.509+0000 7f86cd0fc700 1 -- 172.21.15.111:0/248356477 >> v2:172.21.15.111:3300/0 conn(0x7f86c8142e60 msgr2=0x7f86c81432d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:22:55.514 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.509+0000 7f86cd0fc700 1 --2- 172.21.15.111:0/248356477 >> v2:172.21.15.111:3300/0 conn(0x7f86c8142e60 0x7f86c81432d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:55.514 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.509+0000 7f86cd0fc700 1 -- 172.21.15.111:0/248356477 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86c8143810 con 0x7f86c80b4d80 2024-04-25T02:22:55.514 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.509+0000 7f86cd8fd700 1 --2- 172.21.15.111:0/248356477 >> v2:172.21.15.111:3300/0 conn(0x7f86c8142e60 0x7f86c81432d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:22:55.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.509+0000 7f86cc8fb700 1 --2- 172.21.15.111:0/248356477 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f86c80a20e0 0x7f86c80b1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:22:55.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.510+0000 7f86cd0fc700 1 --2- 172.21.15.111:0/248356477 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f86c80b4d80 0x7f86c80b0fe0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f86c40098e0 tx=0x7f86c40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7941b2d7ab86d14 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:55.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.510+0000 7f86bffff700 1 -- 172.21.15.111:0/248356477 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c4011630 con 0x7f86c80b4d80 2024-04-25T02:22:55.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.510+0000 7f86bffff700 1 -- 172.21.15.111:0/248356477 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c4011790 con 0x7f86c80b4d80 2024-04-25T02:22:55.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.510+0000 7f86bffff700 1 -- 172.21.15.111:0/248356477 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c4011b30 con 0x7f86c80b4d80 2024-04-25T02:22:55.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.510+0000 7f86cf360700 1 -- 172.21.15.111:0/248356477 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f86c80b4d80 msgr2=0x7f86c80b0fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:55.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.510+0000 7f86cf360700 1 --2- 172.21.15.111:0/248356477 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f86c80b4d80 0x7f86c80b0fe0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f86c40098e0 tx=0x7f86c40091a0 comp rx=0 tx=0).stop 2024-04-25T02:22:55.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.510+0000 7f86cf360700 1 -- 172.21.15.111:0/248356477 shutdown_connections 2024-04-25T02:22:55.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.510+0000 7f86cf360700 1 --2- 172.21.15.111:0/248356477 >> v2:172.21.15.111:3300/0 conn(0x7f86c8142e60 0x7f86c81432d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:55.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.510+0000 7f86cf360700 1 --2- 172.21.15.111:0/248356477 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f86c80b4d80 0x7f86c80b0fe0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:55.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.510+0000 7f86cf360700 1 --2- 172.21.15.111:0/248356477 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f86c80a20e0 0x7f86c80b1960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:55.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.511+0000 7f86cf360700 1 -- 172.21.15.111:0/248356477 >> 172.21.15.111:0/248356477 conn(0x7f86c80883e0 msgr2=0x7f86c8068b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:55.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.511+0000 7f86cf360700 1 -- 172.21.15.111:0/248356477 shutdown_connections 2024-04-25T02:22:55.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.511+0000 7f86cf360700 1 -- 172.21.15.111:0/248356477 wait complete. 2024-04-25T02:22:55.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.511+0000 7f86cf360700 1 Processor -- start 2024-04-25T02:22:55.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.512+0000 7f86cf360700 1 -- start start 2024-04-25T02:22:55.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.512+0000 7f86cf360700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f86c80a20e0 0x7f86c806ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:55.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.512+0000 7f86cf360700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f86c80b4d80 0x7f86c8155800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:55.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.512+0000 7f86cf360700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f86c8142e60 0x7f86c8155d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:55.519 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.512+0000 7f86cf360700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86c806e460 con 0x7f86c80b4d80 2024-04-25T02:22:55.519 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.512+0000 7f86cf360700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86c806cd30 con 0x7f86c8142e60 2024-04-25T02:22:55.519 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.512+0000 7f86cf360700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86c806b5d0 con 0x7f86c80a20e0 2024-04-25T02:22:55.519 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.512+0000 7f86cc8fb700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f86c80b4d80 0x7f86c8155800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:55.519 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.512+0000 7f86cd0fc700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f86c80a20e0 0x7f86c806ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:55.519 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.512+0000 7f86cc8fb700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f86c80b4d80 0x7f86c8155800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:53446/0 (socket says 172.21.15.111:53446) 2024-04-25T02:22:55.519 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.512+0000 7f86cc8fb700 1 -- 172.21.15.111:0/2720335948 learned_addr learned my addr 172.21.15.111:0/2720335948 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:22:55.519 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.512+0000 7f86cd8fd700 1 --2- 172.21.15.111:0/2720335948 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f86c8142e60 0x7f86c8155d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:55.519 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.513+0000 7f86cd0fc700 1 -- 172.21.15.111:0/2720335948 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f86c8142e60 msgr2=0x7f86c8155d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:55.519 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.513+0000 7f86cd0fc700 1 --2- 172.21.15.111:0/2720335948 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f86c8142e60 0x7f86c8155d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:55.519 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.513+0000 7f86cd0fc700 1 -- 172.21.15.111:0/2720335948 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f86c80b4d80 msgr2=0x7f86c8155800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:55.519 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.513+0000 7f86cd0fc700 1 --2- 172.21.15.111:0/2720335948 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f86c80b4d80 0x7f86c8155800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:55.519 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.513+0000 7f86cd0fc700 1 -- 172.21.15.111:0/2720335948 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86b80094f0 con 0x7f86c80a20e0 2024-04-25T02:22:55.519 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.513+0000 7f86cc8fb700 1 --2- 172.21.15.111:0/2720335948 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f86c80b4d80 0x7f86c8155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:22:55.520 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.513+0000 7f86cd0fc700 1 --2- 172.21.15.111:0/2720335948 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f86c80a20e0 0x7f86c806ad80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f86c80a7310 tx=0x7f86c4017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:55.520 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.513+0000 7f86bd7fa700 1 -- 172.21.15.111:0/2720335948 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c4011b10 con 0x7f86c80a20e0 2024-04-25T02:22:55.520 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.513+0000 7f86bd7fa700 1 -- 172.21.15.111:0/2720335948 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86c40253f0 con 0x7f86c80a20e0 2024-04-25T02:22:55.520 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.513+0000 7f86cf360700 1 -- 172.21.15.111:0/2720335948 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86c0009a20 con 0x7f86c80a20e0 2024-04-25T02:22:55.520 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.513+0000 7f86bd7fa700 1 -- 172.21.15.111:0/2720335948 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86c4025790 con 0x7f86c80a20e0 2024-04-25T02:22:55.520 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.513+0000 7f86cf360700 1 -- 172.21.15.111:0/2720335948 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86c4009420 con 0x7f86c80a20e0 2024-04-25T02:22:55.520 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.514+0000 7f86bd7fa700 1 -- 172.21.15.111:0/2720335948 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 7) v1 ==== 53244+0+0 (secure 0 0 0) 0x7f86c400b400 con 0x7f86c80a20e0 2024-04-25T02:22:55.520 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.514+0000 7f86cf360700 1 -- 172.21.15.111:0/2720335948 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86c8065190 con 0x7f86c80a20e0 2024-04-25T02:22:55.520 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.514+0000 7f86bd7fa700 1 -- 172.21.15.111:0/2720335948 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3846+0+0 (secure 0 0 0) 0x7f86c405c250 con 0x7f86c80a20e0 2024-04-25T02:22:55.520 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.517+0000 7f86bd7fa700 1 -- 172.21.15.111:0/2720335948 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+112002 (secure 0 0 0) 0x7f86c4026af0 con 0x7f86c80a20e0 2024-04-25T02:22:55.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.599+0000 7f97f7d7f700 1 -- 172.21.15.111:0/677479580 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f97f006e840 con 0x7f97f00aac50 2024-04-25T02:22:55.888 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.599+0000 7f97e5ffb700 1 -- 172.21.15.111:0/677479580 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f97ec015020 con 0x7f97f00aac50 2024-04-25T02:22:55.889 INFO:teuthology.orchestra.run.smithi111.stdout:38654705698 2024-04-25T02:22:55.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.600+0000 7f97f7d7f700 1 -- 172.21.15.111:0/677479580 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f97f00aac50 msgr2=0x7f97f0141640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:55.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.600+0000 7f97f7d7f700 1 --2- 172.21.15.111:0/677479580 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f97f00aac50 0x7f97f0141640 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f97f00ad0d0 tx=0x7f97ec017000 comp rx=0 tx=0).stop 2024-04-25T02:22:55.891 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.600+0000 7f97f7d7f700 1 -- 172.21.15.111:0/677479580 shutdown_connections 2024-04-25T02:22:55.891 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.600+0000 7f97f7d7f700 1 --2- 172.21.15.111:0/677479580 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f97f013bd70 0x7f97f0151b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:55.891 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.600+0000 7f97f7d7f700 1 --2- 172.21.15.111:0/677479580 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f97f00aac50 0x7f97f0141640 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:55.891 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.600+0000 7f97f7d7f700 1 --2- 172.21.15.111:0/677479580 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f97f00ad3f0 0x7f97f0151650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:55.891 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.600+0000 7f97f7d7f700 1 -- 172.21.15.111:0/677479580 >> 172.21.15.111:0/677479580 conn(0x7f97f00b1390 msgr2=0x7f97f00b1760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:55.891 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.600+0000 7f97f7d7f700 1 -- 172.21.15.111:0/677479580 shutdown_connections 2024-04-25T02:22:55.891 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.600+0000 7f97f7d7f700 1 -- 172.21.15.111:0/677479580 wait complete. 2024-04-25T02:22:55.892 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705699 got 38654705698 for osd.2 2024-04-25T02:22:55.892 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.642+0000 7f86cf360700 1 -- 172.21.15.111:0/2720335948 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f86c80b38e0 con 0x7f86c80a20e0 2024-04-25T02:22:55.892 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.642+0000 7f86bd7fa700 1 -- 172.21.15.111:0/2720335948 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f86c4015030 con 0x7f86c80a20e0 2024-04-25T02:22:55.892 INFO:teuthology.orchestra.run.smithi111.stdout:38654705696 2024-04-25T02:22:55.894 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.643+0000 7f86cf360700 1 -- 172.21.15.111:0/2720335948 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f86c80a20e0 msgr2=0x7f86c806ad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:55.894 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.643+0000 7f86cf360700 1 --2- 172.21.15.111:0/2720335948 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f86c80a20e0 0x7f86c806ad80 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f86c80a7310 tx=0x7f86c4017000 comp rx=0 tx=0).stop 2024-04-25T02:22:55.894 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.643+0000 7f86cf360700 1 -- 172.21.15.111:0/2720335948 shutdown_connections 2024-04-25T02:22:55.894 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.643+0000 7f86cf360700 1 --2- 172.21.15.111:0/2720335948 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f86c8142e60 0x7f86c8155d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:55.894 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.643+0000 7f86cf360700 1 --2- 172.21.15.111:0/2720335948 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f86c80a20e0 0x7f86c806ad80 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:55.894 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.643+0000 7f86cf360700 1 --2- 172.21.15.111:0/2720335948 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f86c80b4d80 0x7f86c8155800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:55.894 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.643+0000 7f86cf360700 1 -- 172.21.15.111:0/2720335948 >> 172.21.15.111:0/2720335948 conn(0x7f86c80883e0 msgr2=0x7f86c8063d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:55.895 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.643+0000 7f86cf360700 1 -- 172.21.15.111:0/2720335948 shutdown_connections 2024-04-25T02:22:55.895 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:55.643+0000 7f86cf360700 1 -- 172.21.15.111:0/2720335948 wait complete. 2024-04-25T02:22:55.895 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705697 got 38654705696 for osd.0 2024-04-25T02:22:55.895 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-25T02:22:55.723+0000 7f1f35058700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-25T02:22:55.895 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-25T02:22:55.725+0000 7f1f35058700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-25T02:22:55.895 INFO:tasks.ceph.mgr.y.smithi111.stderr:2024-04-25T02:22:55.726+0000 7f1f35058700 -1 mgr.server handle_report got status from non-daemon mon.a 2024-04-25T02:22:56.428 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T02:22:56.493 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T02:22:56.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.545+0000 7f1d170eb700 1 Processor -- start 2024-04-25T02:22:56.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.545+0000 7f1d170eb700 1 -- start start 2024-04-25T02:22:56.550 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.546+0000 7f1d170eb700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f1d100b06c0 0x7f1d101402a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:56.550 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.546+0000 7f1d170eb700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1d100a4720 0x7f1d10146b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:56.550 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.546+0000 7f1d170eb700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d100a42c0 con 0x7f1d100a5470 2024-04-25T02:22:56.551 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.546+0000 7f1d170eb700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d100a3860 con 0x7f1d100b06c0 2024-04-25T02:22:56.551 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.546+0000 7f1d170eb700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d100a71a0 con 0x7f1d100a4720 2024-04-25T02:22:56.551 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.546+0000 7f1d15688700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1d100a4720 0x7f1d10146b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:56.551 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.546+0000 7f1d0ffff700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f1d100b06c0 0x7f1d101402a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:56.551 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.546+0000 7f1d14e87700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f1d100a5470 0x7f1d1013fb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:55472/0 (socket says 172.21.15.111:55472) 2024-04-25T02:22:56.551 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.546+0000 7f1d15688700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1d100a4720 0x7f1d10146b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:58038/0 (socket says 172.21.15.111:58038) 2024-04-25T02:22:56.551 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.546+0000 7f1d0ffff700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f1d100b06c0 0x7f1d101402a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:53462/0 (socket says 172.21.15.111:53462) 2024-04-25T02:22:56.551 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.546+0000 7f1d14e87700 1 -- 172.21.15.111:0/307179268 learned_addr learned my addr 172.21.15.111:0/307179268 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:22:56.551 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.546+0000 7f1d0f7fe700 1 -- 172.21.15.111:0/307179268 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3584922381 0 0) 0x7f1d100a42c0 con 0x7f1d100a5470 2024-04-25T02:22:56.551 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.546+0000 7f1d0f7fe700 1 -- 172.21.15.111:0/307179268 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d00003570 con 0x7f1d100a5470 2024-04-25T02:22:56.551 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.546+0000 7f1d0ffff700 1 -- 172.21.15.111:0/307179268 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1d100a4720 msgr2=0x7f1d10146b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:22:56.551 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.546+0000 7f1d0ffff700 1 --2- 172.21.15.111:0/307179268 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1d100a4720 0x7f1d10146b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:56.552 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.546+0000 7f1d0ffff700 1 -- 172.21.15.111:0/307179268 >> v1:172.21.15.111:6789/0 conn(0x7f1d100a5470 legacy=0x7f1d1013fb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:56.552 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.546+0000 7f1d0ffff700 1 -- 172.21.15.111:0/307179268 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d100a5da0 con 0x7f1d100b06c0 2024-04-25T02:22:56.552 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.546+0000 7f1d15688700 1 --2- 172.21.15.111:0/307179268 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1d100a4720 0x7f1d10146b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:22:56.552 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.546+0000 7f1d0ffff700 1 --2- 172.21.15.111:0/307179268 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1d100b06c0 0x7f1d101402a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc0098e0 tx=0x7f1cfc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=439d23eff4d17f54 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:56.552 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.547+0000 7f1d0f7fe700 1 -- 172.21.15.111:0/307179268 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc011630 con 0x7f1d100b06c0 2024-04-25T02:22:56.552 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.547+0000 7f1d0f7fe700 1 -- 172.21.15.111:0/307179268 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cfc011790 con 0x7f1d100b06c0 2024-04-25T02:22:56.552 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.547+0000 7f1d0f7fe700 1 -- 172.21.15.111:0/307179268 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cfc011b30 con 0x7f1d100b06c0 2024-04-25T02:22:56.552 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.547+0000 7f1d170eb700 1 -- 172.21.15.111:0/307179268 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1d100b06c0 msgr2=0x7f1d101402a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:56.552 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.547+0000 7f1d170eb700 1 --2- 172.21.15.111:0/307179268 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1d100b06c0 0x7f1d101402a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f1cfc0098e0 tx=0x7f1cfc0091a0 comp rx=0 tx=0).stop 2024-04-25T02:22:56.552 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.548+0000 7f1d170eb700 1 -- 172.21.15.111:0/307179268 shutdown_connections 2024-04-25T02:22:56.552 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.548+0000 7f1d170eb700 1 --2- 172.21.15.111:0/307179268 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1d100a4720 0x7f1d10146b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:56.552 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.548+0000 7f1d170eb700 1 --2- 172.21.15.111:0/307179268 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1d100b06c0 0x7f1d101402a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:56.552 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.548+0000 7f1d170eb700 1 -- 172.21.15.111:0/307179268 >> 172.21.15.111:0/307179268 conn(0x7f1d1006bd70 msgr2=0x7f1d1006c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:56.552 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.548+0000 7f1d170eb700 1 -- 172.21.15.111:0/307179268 shutdown_connections 2024-04-25T02:22:56.552 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.548+0000 7f1d170eb700 1 -- 172.21.15.111:0/307179268 wait complete. 2024-04-25T02:22:56.555 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.549+0000 7f1d170eb700 1 Processor -- start 2024-04-25T02:22:56.555 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.549+0000 7f1d170eb700 1 -- start start 2024-04-25T02:22:56.555 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.550+0000 7f1d170eb700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1d100a4720 0x7f1d10097e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:56.555 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.550+0000 7f1d170eb700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1d100a5470 0x7f1d1013e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:56.555 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.550+0000 7f1d170eb700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1d100b06c0 0x7f1d1013edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:56.555 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.550+0000 7f1d170eb700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d10097970 con 0x7f1d100a4720 2024-04-25T02:22:56.555 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.550+0000 7f1d170eb700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d100aeaa0 con 0x7f1d100b06c0 2024-04-25T02:22:56.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.550+0000 7f1d170eb700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1d100ab090 con 0x7f1d100a5470 2024-04-25T02:22:56.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.550+0000 7f1d14e87700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1d100a4720 0x7f1d10097e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:56.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.550+0000 7f1d15688700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1d100b06c0 0x7f1d1013edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:56.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.550+0000 7f1d14e87700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1d100a4720 0x7f1d10097e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:53466/0 (socket says 172.21.15.111:53466) 2024-04-25T02:22:56.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.550+0000 7f1d14e87700 1 -- 172.21.15.111:0/2604299029 learned_addr learned my addr 172.21.15.111:0/2604299029 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:22:56.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.550+0000 7f1d0ffff700 1 --2- 172.21.15.111:0/2604299029 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1d100a5470 0x7f1d1013e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:56.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.550+0000 7f1d14e87700 1 -- 172.21.15.111:0/2604299029 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1d100a5470 msgr2=0x7f1d1013e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:56.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.550+0000 7f1d14e87700 1 --2- 172.21.15.111:0/2604299029 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1d100a5470 0x7f1d1013e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:56.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.550+0000 7f1d14e87700 1 -- 172.21.15.111:0/2604299029 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1d100b06c0 msgr2=0x7f1d1013edf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:56.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.550+0000 7f1d14e87700 1 --2- 172.21.15.111:0/2604299029 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1d100b06c0 0x7f1d1013edf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:56.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.550+0000 7f1d14e87700 1 -- 172.21.15.111:0/2604299029 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d08009a20 con 0x7f1d100a4720 2024-04-25T02:22:56.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.550+0000 7f1d15688700 1 --2- 172.21.15.111:0/2604299029 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1d100b06c0 0x7f1d1013edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:22:56.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.550+0000 7f1d0ffff700 1 --2- 172.21.15.111:0/2604299029 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1d100a5470 0x7f1d1013e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:22:56.556 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.550+0000 7f1d14e87700 1 --2- 172.21.15.111:0/2604299029 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1d100a4720 0x7f1d10097e00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1d0400c7e0 tx=0x7f1d04007df0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:56.557 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.551+0000 7f1d0cff9700 1 -- 172.21.15.111:0/2604299029 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d04005b30 con 0x7f1d100a4720 2024-04-25T02:22:56.557 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.551+0000 7f1d0cff9700 1 -- 172.21.15.111:0/2604299029 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d04005c90 con 0x7f1d100a4720 2024-04-25T02:22:56.557 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.551+0000 7f1d0cff9700 1 -- 172.21.15.111:0/2604299029 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d04007300 con 0x7f1d100a4720 2024-04-25T02:22:56.557 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.551+0000 7f1d170eb700 1 -- 172.21.15.111:0/2604299029 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cfc009420 con 0x7f1d100a4720 2024-04-25T02:22:56.557 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.551+0000 7f1d170eb700 1 -- 172.21.15.111:0/2604299029 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d10098340 con 0x7f1d100a4720 2024-04-25T02:22:56.557 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.552+0000 7f1d0cff9700 1 -- 172.21.15.111:0/2604299029 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 8) v1 ==== 53336+0+0 (secure 0 0 0) 0x7f1d040076b0 con 0x7f1d100a4720 2024-04-25T02:22:56.557 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.552+0000 7f1d170eb700 1 -- 172.21.15.111:0/2604299029 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d10071790 con 0x7f1d100a4720 2024-04-25T02:22:56.557 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.552+0000 7f1d0cff9700 1 -- 172.21.15.111:0/2604299029 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3846+0+0 (secure 0 0 0) 0x7f1d0405a1f0 con 0x7f1d100a4720 2024-04-25T02:22:56.558 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.555+0000 7f1d0cff9700 1 -- 172.21.15.111:0/2604299029 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f1d040388b0 con 0x7f1d100a4720 2024-04-25T02:22:56.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.611+0000 7fec186a4700 1 Processor -- start 2024-04-25T02:22:56.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.611+0000 7fec186a4700 1 -- start start 2024-04-25T02:22:56.617 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.612+0000 7fec186a4700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fec100a2560 0x7fec1013ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:56.617 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.612+0000 7fec186a4700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fec1013ef40 0x7fec10148d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:56.617 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.612+0000 7fec186a4700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec100a46d0 con 0x7fec100b4fd0 2024-04-25T02:22:56.617 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.612+0000 7fec186a4700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec100a6710 con 0x7fec100a2560 2024-04-25T02:22:56.617 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.612+0000 7fec186a4700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec1013f3c0 con 0x7fec1013ef40 2024-04-25T02:22:56.617 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.612+0000 7fec15c3f700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fec100a2560 0x7fec1013ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:56.617 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.612+0000 7fec16c41700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fec1013ef40 0x7fec10148d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:56.617 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.612+0000 7fec16440700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7fec100b4fd0 0x7fec100a3980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:55474/0 (socket says 172.21.15.111:55474) 2024-04-25T02:22:56.617 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.612+0000 7fec16440700 1 -- 172.21.15.111:0/867636532 learned_addr learned my addr 172.21.15.111:0/867636532 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:22:56.617 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.612+0000 7fec15c3f700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fec100a2560 0x7fec1013ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:53470/0 (socket says 172.21.15.111:53470) 2024-04-25T02:22:56.617 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.613+0000 7fec1543e700 1 -- 172.21.15.111:0/867636532 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2446702405 0 0) 0x7fec100a46d0 con 0x7fec100b4fd0 2024-04-25T02:22:56.617 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.613+0000 7fec15c3f700 1 -- 172.21.15.111:0/867636532 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fec1013ef40 msgr2=0x7fec10148d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:22:56.618 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.613+0000 7fec15c3f700 1 --2- 172.21.15.111:0/867636532 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fec1013ef40 0x7fec10148d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:56.618 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.613+0000 7fec15c3f700 1 -- 172.21.15.111:0/867636532 >> v1:172.21.15.111:6789/0 conn(0x7fec100b4fd0 legacy=0x7fec100a3980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:56.618 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.613+0000 7fec15c3f700 1 -- 172.21.15.111:0/867636532 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec100a4930 con 0x7fec100a2560 2024-04-25T02:22:56.618 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.613+0000 7fec16c41700 1 --2- 172.21.15.111:0/867636532 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fec1013ef40 0x7fec10148d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:22:56.618 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.613+0000 7fec15c3f700 1 --2- 172.21.15.111:0/867636532 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fec100a2560 0x7fec1013ea00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fec000098e0 tx=0x7fec000091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8934603c76651f45 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:56.618 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.613+0000 7fec1543e700 1 -- 172.21.15.111:0/867636532 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0000b640 con 0x7fec100a2560 2024-04-25T02:22:56.618 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.613+0000 7fec1543e700 1 -- 172.21.15.111:0/867636532 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec0000b7a0 con 0x7fec100a2560 2024-04-25T02:22:56.618 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.613+0000 7fec1543e700 1 -- 172.21.15.111:0/867636532 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0000bb40 con 0x7fec100a2560 2024-04-25T02:22:56.618 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.613+0000 7fec186a4700 1 -- 172.21.15.111:0/867636532 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fec100a2560 msgr2=0x7fec1013ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:56.618 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.613+0000 7fec186a4700 1 --2- 172.21.15.111:0/867636532 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fec100a2560 0x7fec1013ea00 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fec000098e0 tx=0x7fec000091a0 comp rx=0 tx=0).stop 2024-04-25T02:22:56.618 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.614+0000 7fec186a4700 1 -- 172.21.15.111:0/867636532 shutdown_connections 2024-04-25T02:22:56.618 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.614+0000 7fec186a4700 1 --2- 172.21.15.111:0/867636532 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fec1013ef40 0x7fec10148d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:56.618 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.614+0000 7fec186a4700 1 --2- 172.21.15.111:0/867636532 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fec100a2560 0x7fec1013ea00 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:56.619 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.614+0000 7fec186a4700 1 -- 172.21.15.111:0/867636532 >> 172.21.15.111:0/867636532 conn(0x7fec100883e0 msgr2=0x7fec10068b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:56.619 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.614+0000 7fec186a4700 1 -- 172.21.15.111:0/867636532 shutdown_connections 2024-04-25T02:22:56.619 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.614+0000 7fec186a4700 1 -- 172.21.15.111:0/867636532 wait complete. 2024-04-25T02:22:56.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.615+0000 7fec186a4700 1 Processor -- start 2024-04-25T02:22:56.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.615+0000 7fec186a4700 1 -- start start 2024-04-25T02:22:56.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.615+0000 7fec186a4700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fec100a2560 0x7fec100abd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:56.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.615+0000 7fec186a4700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fec100b4fd0 0x7fec1013c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:56.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.615+0000 7fec186a4700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fec1013ef40 0x7fec1013cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:56.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.615+0000 7fec186a4700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec100ac890 con 0x7fec100a2560 2024-04-25T02:22:56.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.615+0000 7fec186a4700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec100ad870 con 0x7fec1013ef40 2024-04-25T02:22:56.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.615+0000 7fec186a4700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fec100ac5f0 con 0x7fec100b4fd0 2024-04-25T02:22:56.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.615+0000 7fec16c41700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fec1013ef40 0x7fec1013cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:56.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.615+0000 7fec16c41700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fec1013ef40 0x7fec1013cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:33144/0 (socket says 172.21.15.111:33144) 2024-04-25T02:22:56.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.615+0000 7fec16c41700 1 -- 172.21.15.111:0/1046194053 learned_addr learned my addr 172.21.15.111:0/1046194053 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:22:56.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.615+0000 7fec16440700 1 --2- 172.21.15.111:0/1046194053 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fec100a2560 0x7fec100abd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:56.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.615+0000 7fec15c3f700 1 --2- 172.21.15.111:0/1046194053 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fec100b4fd0 0x7fec1013c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:56.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.615+0000 7fec16c41700 1 -- 172.21.15.111:0/1046194053 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fec100b4fd0 msgr2=0x7fec1013c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:56.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.615+0000 7fec16c41700 1 --2- 172.21.15.111:0/1046194053 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fec100b4fd0 0x7fec1013c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:56.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.615+0000 7fec16c41700 1 -- 172.21.15.111:0/1046194053 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fec100a2560 msgr2=0x7fec100abd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:56.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.615+0000 7fec16c41700 1 --2- 172.21.15.111:0/1046194053 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fec100a2560 0x7fec100abd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:56.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.616+0000 7fec16c41700 1 -- 172.21.15.111:0/1046194053 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec08009a20 con 0x7fec1013ef40 2024-04-25T02:22:56.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.616+0000 7fec16c41700 1 --2- 172.21.15.111:0/1046194053 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fec1013ef40 0x7fec1013cf20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fec08009f50 tx=0x7fec0800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:56.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.616+0000 7fec067fc700 1 -- 172.21.15.111:0/1046194053 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec0800cbe0 con 0x7fec1013ef40 2024-04-25T02:22:56.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.616+0000 7fec067fc700 1 -- 172.21.15.111:0/1046194053 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec0800f040 con 0x7fec1013ef40 2024-04-25T02:22:56.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.616+0000 7fec067fc700 1 -- 172.21.15.111:0/1046194053 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec08014480 con 0x7fec1013ef40 2024-04-25T02:22:56.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.616+0000 7fec186a4700 1 -- 172.21.15.111:0/1046194053 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec00009420 con 0x7fec1013ef40 2024-04-25T02:22:56.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.616+0000 7fec186a4700 1 -- 172.21.15.111:0/1046194053 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec100aad20 con 0x7fec1013ef40 2024-04-25T02:22:56.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.617+0000 7fec186a4700 1 -- 172.21.15.111:0/1046194053 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec10065190 con 0x7fec1013ef40 2024-04-25T02:22:56.623 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.617+0000 7fec067fc700 1 -- 172.21.15.111:0/1046194053 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 8) v1 ==== 53336+0+0 (secure 0 0 0) 0x7fec08003020 con 0x7fec1013ef40 2024-04-25T02:22:56.623 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.618+0000 7fec067fc700 1 -- 172.21.15.111:0/1046194053 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3846+0+0 (secure 0 0 0) 0x7fec0805b620 con 0x7fec1013ef40 2024-04-25T02:22:56.627 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.625+0000 7fec067fc700 1 -- 172.21.15.111:0/1046194053 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fec08039c20 con 0x7fec1013ef40 2024-04-25T02:22:56.728 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.725+0000 7f1d170eb700 1 -- 172.21.15.111:0/2604299029 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1d100a4080 con 0x7f1d100a4720 2024-04-25T02:22:56.728 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.726+0000 7f1d0cff9700 1 -- 172.21.15.111:0/2604299029 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f1d04017030 con 0x7f1d100a4720 2024-04-25T02:22:56.729 INFO:teuthology.orchestra.run.smithi111.stdout:38654705699 2024-04-25T02:22:56.730 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.727+0000 7f1d170eb700 1 -- 172.21.15.111:0/2604299029 >> v1:172.21.15.111:6816/46482 conn(0x7f1cf4045d40 legacy=0x7f1cf40481f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:56.730 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.727+0000 7f1d170eb700 1 -- 172.21.15.111:0/2604299029 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1d100a4720 msgr2=0x7f1d10097e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:56.730 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.727+0000 7f1d170eb700 1 --2- 172.21.15.111:0/2604299029 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1d100a4720 0x7f1d10097e00 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f1d0400c7e0 tx=0x7f1d04007df0 comp rx=0 tx=0).stop 2024-04-25T02:22:56.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.727+0000 7f1d170eb700 1 -- 172.21.15.111:0/2604299029 shutdown_connections 2024-04-25T02:22:56.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.727+0000 7f1d170eb700 1 --2- 172.21.15.111:0/2604299029 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1d100b06c0 0x7f1d1013edf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:56.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.727+0000 7f1d170eb700 1 --2- 172.21.15.111:0/2604299029 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1d100a4720 0x7f1d10097e00 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:56.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.727+0000 7f1d170eb700 1 --2- 172.21.15.111:0/2604299029 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1d100a5470 0x7f1d1013e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:56.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.727+0000 7f1d170eb700 1 -- 172.21.15.111:0/2604299029 >> 172.21.15.111:0/2604299029 conn(0x7f1d1006bd70 msgr2=0x7f1d1006eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:56.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.728+0000 7f1d170eb700 1 -- 172.21.15.111:0/2604299029 shutdown_connections 2024-04-25T02:22:56.731 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.728+0000 7f1d170eb700 1 -- 172.21.15.111:0/2604299029 wait complete. 2024-04-25T02:22:56.742 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705698 got 38654705699 for osd.1 2024-04-25T02:22:56.742 DEBUG:teuthology.parallel:result is None 2024-04-25T02:22:56.790 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.787+0000 7fec186a4700 1 -- 172.21.15.111:0/1046194053 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fec100a2ee0 con 0x7fec1013ef40 2024-04-25T02:22:56.790 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.787+0000 7fec067fc700 1 -- 172.21.15.111:0/1046194053 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fec08018030 con 0x7fec1013ef40 2024-04-25T02:22:56.791 INFO:teuthology.orchestra.run.smithi111.stdout:38654705698 2024-04-25T02:22:56.792 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.789+0000 7fec186a4700 1 -- 172.21.15.111:0/1046194053 >> v1:172.21.15.111:6816/46482 conn(0x7febf4045d40 legacy=0x7febf40481f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:56.792 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.789+0000 7fec186a4700 1 -- 172.21.15.111:0/1046194053 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fec1013ef40 msgr2=0x7fec1013cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:56.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.789+0000 7fec186a4700 1 --2- 172.21.15.111:0/1046194053 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fec1013ef40 0x7fec1013cf20 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fec08009f50 tx=0x7fec0800b040 comp rx=0 tx=0).stop 2024-04-25T02:22:56.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.789+0000 7fec186a4700 1 -- 172.21.15.111:0/1046194053 shutdown_connections 2024-04-25T02:22:56.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.789+0000 7fec186a4700 1 --2- 172.21.15.111:0/1046194053 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fec1013ef40 0x7fec1013cf20 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:56.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.789+0000 7fec186a4700 1 --2- 172.21.15.111:0/1046194053 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fec100a2560 0x7fec100abd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:56.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.789+0000 7fec186a4700 1 --2- 172.21.15.111:0/1046194053 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fec100b4fd0 0x7fec1013c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:56.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.789+0000 7fec186a4700 1 -- 172.21.15.111:0/1046194053 >> 172.21.15.111:0/1046194053 conn(0x7fec100883e0 msgr2=0x7fec100a38a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:56.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.789+0000 7fec186a4700 1 -- 172.21.15.111:0/1046194053 shutdown_connections 2024-04-25T02:22:56.793 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:56.789+0000 7fec186a4700 1 -- 172.21.15.111:0/1046194053 wait complete. 2024-04-25T02:22:56.803 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705697 got 38654705698 for osd.3 2024-04-25T02:22:56.803 DEBUG:teuthology.parallel:result is None 2024-04-25T02:22:56.893 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T02:22:56.895 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T02:22:57.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.010+0000 7f3dbeea5700 1 Processor -- start 2024-04-25T02:22:57.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.010+0000 7f3dbeea5700 1 -- start start 2024-04-25T02:22:57.015 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.011+0000 7f3dbeea5700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f3db80b4fd0 0x7f3db80a2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:57.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.011+0000 7f3dbeea5700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3db80a3980 0x7f3db80a3d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:57.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.011+0000 7f3dbeea5700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3db80a46d0 con 0x7f3db813ea00 2024-04-25T02:22:57.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.011+0000 7f3dbeea5700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3db80a6710 con 0x7f3db80b4fd0 2024-04-25T02:22:57.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.011+0000 7f3dbeea5700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3db80a4930 con 0x7f3db80a3980 2024-04-25T02:22:57.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.011+0000 7f3db7fff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3db80a3980 0x7f3db80a3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:57.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.011+0000 7f3dbcc41700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f3db80b4fd0 0x7f3db80a2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:57.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.011+0000 7f3dbd442700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f3db813ea00 0x7f3db813eea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:55490/0 (socket says 172.21.15.111:55490) 2024-04-25T02:22:57.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.011+0000 7f3dbcc41700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f3db80b4fd0 0x7f3db80a2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:53482/0 (socket says 172.21.15.111:53482) 2024-04-25T02:22:57.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.011+0000 7f3dbd442700 1 -- 172.21.15.111:0/1189683109 learned_addr learned my addr 172.21.15.111:0/1189683109 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:22:57.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.011+0000 7f3db7fff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3db80a3980 0x7f3db80a3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:58072/0 (socket says 172.21.15.111:58072) 2024-04-25T02:22:57.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.012+0000 7f3db7fff700 1 -- 172.21.15.111:0/1189683109 >> v2:172.21.15.111:3300/0 conn(0x7f3db80b4fd0 msgr2=0x7f3db80a2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:22:57.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.012+0000 7f3db7fff700 1 --2- 172.21.15.111:0/1189683109 >> v2:172.21.15.111:3300/0 conn(0x7f3db80b4fd0 0x7f3db80a2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:57.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.012+0000 7f3db7fff700 1 -- 172.21.15.111:0/1189683109 >> v1:172.21.15.111:6789/0 conn(0x7f3db813ea00 legacy=0x7f3db813eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:57.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.012+0000 7f3db7fff700 1 -- 172.21.15.111:0/1189683109 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db80a31a0 con 0x7f3db80a3980 2024-04-25T02:22:57.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.012+0000 7f3dbcc41700 1 --2- 172.21.15.111:0/1189683109 >> v2:172.21.15.111:3300/0 conn(0x7f3db80b4fd0 0x7f3db80a2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:22:57.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.012+0000 7f3db7fff700 1 --2- 172.21.15.111:0/1189683109 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3db80a3980 0x7f3db80a3d50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3da40098e0 tx=0x7f3da40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2db1fa624893387f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:57.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.012+0000 7f3db77fe700 1 -- 172.21.15.111:0/1189683109 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da400b640 con 0x7f3db80a3980 2024-04-25T02:22:57.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.012+0000 7f3db77fe700 1 -- 172.21.15.111:0/1189683109 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3da400b7a0 con 0x7f3db80a3980 2024-04-25T02:22:57.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.012+0000 7f3db77fe700 1 -- 172.21.15.111:0/1189683109 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3da400bb40 con 0x7f3db80a3980 2024-04-25T02:22:57.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.013+0000 7f3dbeea5700 1 -- 172.21.15.111:0/1189683109 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3db80a3980 msgr2=0x7f3db80a3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:57.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.013+0000 7f3dbeea5700 1 --2- 172.21.15.111:0/1189683109 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3db80a3980 0x7f3db80a3d50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f3da40098e0 tx=0x7f3da40091a0 comp rx=0 tx=0).stop 2024-04-25T02:22:57.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.013+0000 7f3dbeea5700 1 -- 172.21.15.111:0/1189683109 shutdown_connections 2024-04-25T02:22:57.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.013+0000 7f3dbeea5700 1 --2- 172.21.15.111:0/1189683109 >> v2:172.21.15.111:3300/0 conn(0x7f3db80b4fd0 0x7f3db80a2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:57.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.013+0000 7f3dbeea5700 1 --2- 172.21.15.111:0/1189683109 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3db80a3980 0x7f3db80a3d50 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:57.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.013+0000 7f3dbeea5700 1 -- 172.21.15.111:0/1189683109 >> 172.21.15.111:0/1189683109 conn(0x7f3db80883e0 msgr2=0x7f3db8068b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:57.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.013+0000 7f3dbeea5700 1 -- 172.21.15.111:0/1189683109 shutdown_connections 2024-04-25T02:22:57.018 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.013+0000 7f3dbeea5700 1 -- 172.21.15.111:0/1189683109 wait complete. 2024-04-25T02:22:57.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.014+0000 7f3dbeea5700 1 Processor -- start 2024-04-25T02:22:57.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.014+0000 7f3dbeea5700 1 -- start start 2024-04-25T02:22:57.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.015+0000 7f3dbeea5700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3db80a3980 0x7f3db8143860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:57.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.015+0000 7f3dbeea5700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3db80b4fd0 0x7f3db8142f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:57.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.015+0000 7f3dbeea5700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3db813ea00 0x7f3db8151b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:57.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.015+0000 7f3dbeea5700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db8145090 con 0x7f3db813ea00 2024-04-25T02:22:57.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.015+0000 7f3dbeea5700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3db8145260 con 0x7f3db80b4fd0 2024-04-25T02:22:57.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.015+0000 7f3dbeea5700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3db813d770 con 0x7f3db80a3980 2024-04-25T02:22:57.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.015+0000 7f3db7fff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3db80b4fd0 0x7f3db8142f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:57.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.015+0000 7f3dbcc41700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3db80a3980 0x7f3db8143860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:57.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.015+0000 7f3db7fff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3db80b4fd0 0x7f3db8142f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:33152/0 (socket says 172.21.15.111:33152) 2024-04-25T02:22:57.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.015+0000 7f3db7fff700 1 -- 172.21.15.111:0/2977146857 learned_addr learned my addr 172.21.15.111:0/2977146857 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:22:57.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.015+0000 7f3dbd442700 1 --2- 172.21.15.111:0/2977146857 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3db813ea00 0x7f3db8151b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:57.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.016+0000 7f3dbcc41700 1 -- 172.21.15.111:0/2977146857 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3db80b4fd0 msgr2=0x7f3db8142f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:57.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.016+0000 7f3dbcc41700 1 --2- 172.21.15.111:0/2977146857 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3db80b4fd0 0x7f3db8142f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:57.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.016+0000 7f3dbcc41700 1 -- 172.21.15.111:0/2977146857 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3db813ea00 msgr2=0x7f3db8151b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:57.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.016+0000 7f3dbcc41700 1 --2- 172.21.15.111:0/2977146857 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3db813ea00 0x7f3db8151b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:57.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.016+0000 7f3dbcc41700 1 -- 172.21.15.111:0/2977146857 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3dac009420 con 0x7f3db80a3980 2024-04-25T02:22:57.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.016+0000 7f3db7fff700 1 --2- 172.21.15.111:0/2977146857 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3db80b4fd0 0x7f3db8142f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:22:57.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.016+0000 7f3dbd442700 1 --2- 172.21.15.111:0/2977146857 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3db813ea00 0x7f3db8151b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:22:57.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.016+0000 7f3dbcc41700 1 --2- 172.21.15.111:0/2977146857 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3db80a3980 0x7f3db8143860 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3dac00ecb0 tx=0x7f3dac0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:57.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.016+0000 7f3db4ff9700 1 -- 172.21.15.111:0/2977146857 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dac00c8e0 con 0x7f3db80a3980 2024-04-25T02:22:57.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.016+0000 7f3db4ff9700 1 -- 172.21.15.111:0/2977146857 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3dac00ca40 con 0x7f3db80a3980 2024-04-25T02:22:57.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.016+0000 7f3db4ff9700 1 -- 172.21.15.111:0/2977146857 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3dac00cde0 con 0x7f3db80a3980 2024-04-25T02:22:57.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.016+0000 7f3dbeea5700 1 -- 172.21.15.111:0/2977146857 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3da4009420 con 0x7f3db80a3980 2024-04-25T02:22:57.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.016+0000 7f3dbeea5700 1 -- 172.21.15.111:0/2977146857 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3db8143470 con 0x7f3db80a3980 2024-04-25T02:22:57.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.017+0000 7f3db4ff9700 1 -- 172.21.15.111:0/2977146857 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 8) v1 ==== 53336+0+0 (secure 0 0 0) 0x7f3dac013680 con 0x7f3db80a3980 2024-04-25T02:22:57.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.017+0000 7f3db4ff9700 1 -- 172.21.15.111:0/2977146857 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3846+0+0 (secure 0 0 0) 0x7f3dac05b000 con 0x7f3db80a3980 2024-04-25T02:22:57.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.017+0000 7f3dbeea5700 1 -- 172.21.15.111:0/2977146857 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3db8065190 con 0x7f3db80a3980 2024-04-25T02:22:57.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.021+0000 7f3db4ff9700 1 -- 172.21.15.111:0/2977146857 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f3dac0397d0 con 0x7f3db80a3980 2024-04-25T02:22:57.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.054+0000 7fd02b82b700 1 Processor -- start 2024-04-25T02:22:57.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.055+0000 7fd02b82b700 1 -- start start 2024-04-25T02:22:57.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.055+0000 7fd02b82b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd02406a820 0x7fd0240b3410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:57.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.055+0000 7fd02b82b700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fd0240a4e80 0x7fd02406eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:57.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.055+0000 7fd02b82b700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd02406f050 0x7fd02406f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:57.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.055+0000 7fd02b82b700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0240a3930 con 0x7fd0240a4e80 2024-04-25T02:22:57.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.055+0000 7fd02b82b700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd024068de0 con 0x7fd02406f050 2024-04-25T02:22:57.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.055+0000 7fd02b82b700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd0240b3950 con 0x7fd02406a820 2024-04-25T02:22:57.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.055+0000 7fd028dc6700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fd0240a4e80 0x7fd02406eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:57.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.055+0000 7fd028dc6700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fd0240a4e80 0x7fd02406eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:53500/0 (socket says 172.21.15.111:53500) 2024-04-25T02:22:57.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.055+0000 7fd028dc6700 1 -- 172.21.15.111:0/3746848079 learned_addr learned my addr 172.21.15.111:0/3746848079 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:22:57.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.055+0000 7fd029dc8700 1 --2- 172.21.15.111:0/3746848079 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd02406f050 0x7fd02406f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:57.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.055+0000 7fd0295c7700 1 --2- 172.21.15.111:0/3746848079 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd02406a820 0x7fd0240b3410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:57.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.056+0000 7fd029dc8700 1 -- 172.21.15.111:0/3746848079 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd02406a820 msgr2=0x7fd0240b3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:22:57.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.056+0000 7fd029dc8700 1 --2- 172.21.15.111:0/3746848079 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd02406a820 0x7fd0240b3410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:57.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.056+0000 7fd029dc8700 1 -- 172.21.15.111:0/3746848079 >> v2:172.21.15.111:3300/0 conn(0x7fd0240a4e80 msgr2=0x7fd02406eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:22:57.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.056+0000 7fd029dc8700 1 --2- 172.21.15.111:0/3746848079 >> v2:172.21.15.111:3300/0 conn(0x7fd0240a4e80 0x7fd02406eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:57.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.056+0000 7fd029dc8700 1 -- 172.21.15.111:0/3746848079 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0240a56d0 con 0x7fd02406f050 2024-04-25T02:22:57.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.056+0000 7fd028dc6700 1 --2- 172.21.15.111:0/3746848079 >> v2:172.21.15.111:3300/0 conn(0x7fd0240a4e80 0x7fd02406eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:22:57.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.056+0000 7fd029dc8700 1 --2- 172.21.15.111:0/3746848079 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd02406f050 0x7fd02406f4d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd014009e90 tx=0x7fd014009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a16f16fb82e209fb server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:57.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.056+0000 7fd023fff700 1 -- 172.21.15.111:0/3746848079 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01400e070 con 0x7fd02406f050 2024-04-25T02:22:57.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.056+0000 7fd023fff700 1 -- 172.21.15.111:0/3746848079 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd01400bb40 con 0x7fd02406f050 2024-04-25T02:22:57.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.056+0000 7fd023fff700 1 -- 172.21.15.111:0/3746848079 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd014012430 con 0x7fd02406f050 2024-04-25T02:22:57.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.057+0000 7fd02b82b700 1 -- 172.21.15.111:0/3746848079 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd02406f050 msgr2=0x7fd02406f4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:57.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.057+0000 7fd02b82b700 1 --2- 172.21.15.111:0/3746848079 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd02406f050 0x7fd02406f4d0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd014009e90 tx=0x7fd014009780 comp rx=0 tx=0).stop 2024-04-25T02:22:57.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.057+0000 7fd02b82b700 1 -- 172.21.15.111:0/3746848079 shutdown_connections 2024-04-25T02:22:57.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.057+0000 7fd02b82b700 1 --2- 172.21.15.111:0/3746848079 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd02406f050 0x7fd02406f4d0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:57.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.057+0000 7fd02b82b700 1 --2- 172.21.15.111:0/3746848079 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd02406a820 0x7fd0240b3410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:57.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.057+0000 7fd02b82b700 1 --2- 172.21.15.111:0/3746848079 >> v2:172.21.15.111:3300/0 conn(0x7fd0240a4e80 0x7fd02406eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:57.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.057+0000 7fd02b82b700 1 -- 172.21.15.111:0/3746848079 >> 172.21.15.111:0/3746848079 conn(0x7fd02406bd70 msgr2=0x7fd02406c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:57.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.057+0000 7fd02b82b700 1 -- 172.21.15.111:0/3746848079 shutdown_connections 2024-04-25T02:22:57.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.057+0000 7fd02b82b700 1 -- 172.21.15.111:0/3746848079 wait complete. 2024-04-25T02:22:57.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.058+0000 7fd02b82b700 1 Processor -- start 2024-04-25T02:22:57.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.058+0000 7fd02b82b700 1 -- start start 2024-04-25T02:22:57.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.058+0000 7fd02b82b700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd02406a820 0x7fd02409a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:57.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.058+0000 7fd02b82b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd02406f050 0x7fd024096a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:57.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.058+0000 7fd02b82b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd0240a4e80 0x7fd024096fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:57.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.058+0000 7fd02b82b700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd024099b70 con 0x7fd02406f050 2024-04-25T02:22:57.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.058+0000 7fd02b82b700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd024099d70 con 0x7fd02406a820 2024-04-25T02:22:57.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.058+0000 7fd02b82b700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd024097f30 con 0x7fd0240a4e80 2024-04-25T02:22:57.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.059+0000 7fd028dc6700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd02406f050 0x7fd024096a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:57.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.059+0000 7fd028dc6700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd02406f050 0x7fd024096a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:53516/0 (socket says 172.21.15.111:53516) 2024-04-25T02:22:57.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.059+0000 7fd028dc6700 1 -- 172.21.15.111:0/3515382990 learned_addr learned my addr 172.21.15.111:0/3515382990 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:22:57.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.059+0000 7fd0295c7700 1 --2- 172.21.15.111:0/3515382990 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd02406a820 0x7fd02409a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:57.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.059+0000 7fd029dc8700 1 --2- 172.21.15.111:0/3515382990 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd0240a4e80 0x7fd024096fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:57.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.059+0000 7fd028dc6700 1 -- 172.21.15.111:0/3515382990 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd0240a4e80 msgr2=0x7fd024096fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:57.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.059+0000 7fd028dc6700 1 --2- 172.21.15.111:0/3515382990 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd0240a4e80 0x7fd024096fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:57.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.059+0000 7fd028dc6700 1 -- 172.21.15.111:0/3515382990 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd02406a820 msgr2=0x7fd02409a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:57.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.059+0000 7fd028dc6700 1 --2- 172.21.15.111:0/3515382990 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd02406a820 0x7fd02409a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:57.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.059+0000 7fd028dc6700 1 -- 172.21.15.111:0/3515382990 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0180094f0 con 0x7fd02406f050 2024-04-25T02:22:57.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.059+0000 7fd028dc6700 1 --2- 172.21.15.111:0/3515382990 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd02406f050 0x7fd024096a70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd01800ec50 tx=0x7fd018009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:57.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.059+0000 7fd0217fa700 1 -- 172.21.15.111:0/3515382990 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01800c850 con 0x7fd02406f050 2024-04-25T02:22:57.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.059+0000 7fd0217fa700 1 -- 172.21.15.111:0/3515382990 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd01800c9b0 con 0x7fd02406f050 2024-04-25T02:22:57.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.059+0000 7fd0217fa700 1 -- 172.21.15.111:0/3515382990 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd01800cd50 con 0x7fd02406f050 2024-04-25T02:22:57.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.059+0000 7fd02b82b700 1 -- 172.21.15.111:0/3515382990 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd014009a20 con 0x7fd02406f050 2024-04-25T02:22:57.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.059+0000 7fd02b82b700 1 -- 172.21.15.111:0/3515382990 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0240ae960 con 0x7fd02406f050 2024-04-25T02:22:57.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.060+0000 7fd0217fa700 1 -- 172.21.15.111:0/3515382990 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 8) v1 ==== 53336+0+0 (secure 0 0 0) 0x7fd018013680 con 0x7fd02406f050 2024-04-25T02:22:57.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.060+0000 7fd02b82b700 1 -- 172.21.15.111:0/3515382990 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd024071790 con 0x7fd02406f050 2024-04-25T02:22:57.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.060+0000 7fd0217fa700 1 -- 172.21.15.111:0/3515382990 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3846+0+0 (secure 0 0 0) 0x7fd01805af30 con 0x7fd02406f050 2024-04-25T02:22:57.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.067+0000 7fd0217fa700 1 -- 172.21.15.111:0/3515382990 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fd0180394d0 con 0x7fd02406f050 2024-04-25T02:22:57.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.188+0000 7f3dbeea5700 1 -- 172.21.15.111:0/2977146857 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f3db80a2ee0 con 0x7f3db80a3980 2024-04-25T02:22:57.191 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.189+0000 7f3db4ff9700 1 -- 172.21.15.111:0/2977146857 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3dac03cdf0 con 0x7f3db80a3980 2024-04-25T02:22:57.192 INFO:teuthology.orchestra.run.smithi111.stdout:38654705700 2024-04-25T02:22:57.193 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.190+0000 7f3dbeea5700 1 -- 172.21.15.111:0/2977146857 >> v1:172.21.15.111:6816/46482 conn(0x7f3d9c045d40 legacy=0x7f3d9c0481f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:57.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.190+0000 7f3dbeea5700 1 -- 172.21.15.111:0/2977146857 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3db80a3980 msgr2=0x7f3db8143860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:57.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.190+0000 7f3dbeea5700 1 --2- 172.21.15.111:0/2977146857 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3db80a3980 0x7f3db8143860 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f3dac00ecb0 tx=0x7f3dac0091a0 comp rx=0 tx=0).stop 2024-04-25T02:22:57.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.190+0000 7f3dbeea5700 1 -- 172.21.15.111:0/2977146857 shutdown_connections 2024-04-25T02:22:57.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.190+0000 7f3dbeea5700 1 --2- 172.21.15.111:0/2977146857 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3db813ea00 0x7f3db8151b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:57.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.190+0000 7f3dbeea5700 1 --2- 172.21.15.111:0/2977146857 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3db80a3980 0x7f3db8143860 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:57.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.190+0000 7f3dbeea5700 1 --2- 172.21.15.111:0/2977146857 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3db80b4fd0 0x7f3db8142f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:57.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.190+0000 7f3dbeea5700 1 -- 172.21.15.111:0/2977146857 >> 172.21.15.111:0/2977146857 conn(0x7f3db80883e0 msgr2=0x7f3db8063d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:57.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.190+0000 7f3dbeea5700 1 -- 172.21.15.111:0/2977146857 shutdown_connections 2024-04-25T02:22:57.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.191+0000 7f3dbeea5700 1 -- 172.21.15.111:0/2977146857 wait complete. 2024-04-25T02:22:57.209 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705699 got 38654705700 for osd.2 2024-04-25T02:22:57.209 DEBUG:teuthology.parallel:result is None 2024-04-25T02:22:57.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.240+0000 7fd02b82b700 1 -- 172.21.15.111:0/3515382990 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fd0240b25a0 con 0x7fd02406f050 2024-04-25T02:22:57.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.240+0000 7fd0217fa700 1 -- 172.21.15.111:0/3515382990 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fd01803ccc0 con 0x7fd02406f050 2024-04-25T02:22:57.243 INFO:teuthology.orchestra.run.smithi111.stdout:38654705698 2024-04-25T02:22:57.245 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.242+0000 7fd02b82b700 1 -- 172.21.15.111:0/3515382990 >> v1:172.21.15.111:6816/46482 conn(0x7fd010045d70 legacy=0x7fd010048220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:57.245 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.242+0000 7fd02b82b700 1 -- 172.21.15.111:0/3515382990 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd02406f050 msgr2=0x7fd024096a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:57.245 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.242+0000 7fd02b82b700 1 --2- 172.21.15.111:0/3515382990 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd02406f050 0x7fd024096a70 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fd01800ec50 tx=0x7fd018009250 comp rx=0 tx=0).stop 2024-04-25T02:22:57.245 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.242+0000 7fd02b82b700 1 -- 172.21.15.111:0/3515382990 shutdown_connections 2024-04-25T02:22:57.245 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.242+0000 7fd02b82b700 1 --2- 172.21.15.111:0/3515382990 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd0240a4e80 0x7fd024096fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:57.245 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.242+0000 7fd02b82b700 1 --2- 172.21.15.111:0/3515382990 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd02406a820 0x7fd02409a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:57.245 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.242+0000 7fd02b82b700 1 --2- 172.21.15.111:0/3515382990 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd02406f050 0x7fd024096a70 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:57.245 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.242+0000 7fd02b82b700 1 -- 172.21.15.111:0/3515382990 >> 172.21.15.111:0/3515382990 conn(0x7fd02406bd70 msgr2=0x7fd024143920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:57.245 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.242+0000 7fd02b82b700 1 -- 172.21.15.111:0/3515382990 shutdown_connections 2024-04-25T02:22:57.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.242+0000 7fd02b82b700 1 -- 172.21.15.111:0/3515382990 wait complete. 2024-04-25T02:22:57.256 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705697 got 38654705698 for osd.0 2024-04-25T02:22:57.256 DEBUG:teuthology.parallel:result is None 2024-04-25T02:22:57.256 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T02:22:57.256 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:22:57.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.409+0000 7fd32bdf3700 1 Processor -- start 2024-04-25T02:22:57.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.409+0000 7fd32bdf3700 1 -- start start 2024-04-25T02:22:57.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.410+0000 7fd32bdf3700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fd3240a3410 0x7fd3240a4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:57.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.410+0000 7fd32bdf3700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd3240a22a0 0x7fd32413e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:57.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.410+0000 7fd32bdf3700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd32406da60 con 0x7fd32413eb60 2024-04-25T02:22:57.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.410+0000 7fd32bdf3700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3240a2a20 con 0x7fd3240a3410 2024-04-25T02:22:57.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.410+0000 7fd32bdf3700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3240a3c80 con 0x7fd3240a22a0 2024-04-25T02:22:57.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.410+0000 7fd32938e700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd3240a22a0 0x7fd32413e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:57.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.410+0000 7fd329b8f700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fd3240a3410 0x7fd3240a4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:57.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.410+0000 7fd32a390700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7fd32413eb60 0x7fd32413b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:55500/0 (socket says 172.21.15.111:55500) 2024-04-25T02:22:57.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.410+0000 7fd32a390700 1 -- 172.21.15.111:0/579231014 learned_addr learned my addr 172.21.15.111:0/579231014 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:22:57.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.410+0000 7fd329b8f700 1 -- 172.21.15.111:0/579231014 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd3240a22a0 msgr2=0x7fd32413e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:22:57.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.410+0000 7fd329b8f700 1 --2- 172.21.15.111:0/579231014 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd3240a22a0 0x7fd32413e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:57.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.410+0000 7fd329b8f700 1 -- 172.21.15.111:0/579231014 >> v1:172.21.15.111:6789/0 conn(0x7fd32413eb60 legacy=0x7fd32413b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:57.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.410+0000 7fd328b8d700 1 -- 172.21.15.111:0/579231014 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 639657108 0 0) 0x7fd32406da60 con 0x7fd32413eb60 2024-04-25T02:22:57.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.410+0000 7fd329b8f700 1 -- 172.21.15.111:0/579231014 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3240a37e0 con 0x7fd3240a3410 2024-04-25T02:22:57.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.410+0000 7fd32938e700 1 --2- 172.21.15.111:0/579231014 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd3240a22a0 0x7fd32413e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:22:57.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.411+0000 7fd329b8f700 1 --2- 172.21.15.111:0/579231014 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd3240a3410 0x7fd3240a4460 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd3140098e0 tx=0x7fd3140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc067eb9ccbcefe3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:57.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.411+0000 7fd328b8d700 1 -- 172.21.15.111:0/579231014 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31400b640 con 0x7fd3240a3410 2024-04-25T02:22:57.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.411+0000 7fd328b8d700 1 -- 172.21.15.111:0/579231014 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd31400b7a0 con 0x7fd3240a3410 2024-04-25T02:22:57.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.411+0000 7fd328b8d700 1 -- 172.21.15.111:0/579231014 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31400bb40 con 0x7fd3240a3410 2024-04-25T02:22:57.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.411+0000 7fd32bdf3700 1 -- 172.21.15.111:0/579231014 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd3240a3410 msgr2=0x7fd3240a4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:57.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.411+0000 7fd32bdf3700 1 --2- 172.21.15.111:0/579231014 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd3240a3410 0x7fd3240a4460 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd3140098e0 tx=0x7fd3140091a0 comp rx=0 tx=0).stop 2024-04-25T02:22:57.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.411+0000 7fd32bdf3700 1 -- 172.21.15.111:0/579231014 shutdown_connections 2024-04-25T02:22:57.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.411+0000 7fd32bdf3700 1 --2- 172.21.15.111:0/579231014 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd3240a3410 0x7fd3240a4460 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:57.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.411+0000 7fd32bdf3700 1 --2- 172.21.15.111:0/579231014 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd3240a22a0 0x7fd32413e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:57.417 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.411+0000 7fd32bdf3700 1 -- 172.21.15.111:0/579231014 >> 172.21.15.111:0/579231014 conn(0x7fd3240b1cf0 msgr2=0x7fd3240b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:57.417 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.411+0000 7fd32bdf3700 1 -- 172.21.15.111:0/579231014 shutdown_connections 2024-04-25T02:22:57.417 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.411+0000 7fd32bdf3700 1 -- 172.21.15.111:0/579231014 wait complete. 2024-04-25T02:22:57.417 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.412+0000 7fd32bdf3700 1 Processor -- start 2024-04-25T02:22:57.417 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.412+0000 7fd32bdf3700 1 -- start start 2024-04-25T02:22:57.419 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.413+0000 7fd32bdf3700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd3240a22a0 0x7fd3240a8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:57.419 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.413+0000 7fd32bdf3700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd3240a3410 0x7fd3240a57f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:57.419 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.413+0000 7fd32bdf3700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd32413eb60 0x7fd3240a5d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:57.419 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.413+0000 7fd32bdf3700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3240a8f70 con 0x7fd32413eb60 2024-04-25T02:22:57.419 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.413+0000 7fd32bdf3700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3240a9cb0 con 0x7fd3240a3410 2024-04-25T02:22:57.419 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.413+0000 7fd32bdf3700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3240a7a00 con 0x7fd3240a22a0 2024-04-25T02:22:57.419 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.413+0000 7fd329b8f700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd3240a22a0 0x7fd3240a8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:57.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.413+0000 7fd32938e700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd3240a3410 0x7fd3240a57f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:57.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.413+0000 7fd32a390700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd32413eb60 0x7fd3240a5d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:57.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.413+0000 7fd329b8f700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd3240a22a0 0x7fd3240a8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:58128/0 (socket says 172.21.15.111:58128) 2024-04-25T02:22:57.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.413+0000 7fd329b8f700 1 -- 172.21.15.111:0/3108729893 learned_addr learned my addr 172.21.15.111:0/3108729893 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:22:57.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.413+0000 7fd329b8f700 1 -- 172.21.15.111:0/3108729893 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd3240a3410 msgr2=0x7fd3240a57f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:57.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.413+0000 7fd329b8f700 1 --2- 172.21.15.111:0/3108729893 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd3240a3410 0x7fd3240a57f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:57.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.413+0000 7fd329b8f700 1 -- 172.21.15.111:0/3108729893 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd32413eb60 msgr2=0x7fd3240a5d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:57.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.413+0000 7fd329b8f700 1 --2- 172.21.15.111:0/3108729893 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd32413eb60 0x7fd3240a5d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:57.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.413+0000 7fd329b8f700 1 -- 172.21.15.111:0/3108729893 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd32000b6d0 con 0x7fd3240a22a0 2024-04-25T02:22:57.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.413+0000 7fd32938e700 1 --2- 172.21.15.111:0/3108729893 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd3240a3410 0x7fd3240a57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:22:57.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.413+0000 7fd32a390700 1 --2- 172.21.15.111:0/3108729893 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd32413eb60 0x7fd3240a5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:22:57.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.413+0000 7fd329b8f700 1 --2- 172.21.15.111:0/3108729893 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd3240a22a0 0x7fd3240a8a30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd314009f80 tx=0x7fd314017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:57.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.413+0000 7fd319ffb700 1 -- 172.21.15.111:0/3108729893 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31400b910 con 0x7fd3240a22a0 2024-04-25T02:22:57.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.414+0000 7fd319ffb700 1 -- 172.21.15.111:0/3108729893 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd31400ba70 con 0x7fd3240a22a0 2024-04-25T02:22:57.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.414+0000 7fd32bdf3700 1 -- 172.21.15.111:0/3108729893 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd314009420 con 0x7fd3240a22a0 2024-04-25T02:22:57.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.414+0000 7fd319ffb700 1 -- 172.21.15.111:0/3108729893 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd314011650 con 0x7fd3240a22a0 2024-04-25T02:22:57.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.414+0000 7fd32bdf3700 1 -- 172.21.15.111:0/3108729893 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3240a7570 con 0x7fd3240a22a0 2024-04-25T02:22:57.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.415+0000 7fd32bdf3700 1 -- 172.21.15.111:0/3108729893 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3240a9df0 con 0x7fd3240a22a0 2024-04-25T02:22:57.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.415+0000 7fd319ffb700 1 -- 172.21.15.111:0/3108729893 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 8) v1 ==== 53336+0+0 (secure 0 0 0) 0x7fd314011a00 con 0x7fd3240a22a0 2024-04-25T02:22:57.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.416+0000 7fd319ffb700 1 -- 172.21.15.111:0/3108729893 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 3846+0+0 (secure 0 0 0) 0x7fd31405c8e0 con 0x7fd3240a22a0 2024-04-25T02:22:57.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.419+0000 7fd319ffb700 1 -- 172.21.15.111:0/3108729893 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fd31401db10 con 0x7fd3240a22a0 2024-04-25T02:22:57.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.569+0000 7fd32bdf3700 1 -- 172.21.15.111:0/3108729893 --> v1:172.21.15.111:6816/46482 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd32406a150 con 0x7fd308045d40 2024-04-25T02:22:57.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.577+0000 7fd319ffb700 1 -- 172.21.15.111:0/3108729893 <== mgr.14107 v1:172.21.15.111:6816/46482 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+270500 (unknown 2965378022 0 709195467) 0x7fd32406a150 con 0x7fd308045d40 2024-04-25T02:22:57.583 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:22:57.585 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.579+0000 7fd32bdf3700 1 -- 172.21.15.111:0/3108729893 >> v1:172.21.15.111:6816/46482 conn(0x7fd308045d40 legacy=0x7fd3080481f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:57.585 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.579+0000 7fd32bdf3700 1 -- 172.21.15.111:0/3108729893 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd3240a22a0 msgr2=0x7fd3240a8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:57.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.580+0000 7fd32bdf3700 1 --2- 172.21.15.111:0/3108729893 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd3240a22a0 0x7fd3240a8a30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7fd314009f80 tx=0x7fd314017000 comp rx=0 tx=0).stop 2024-04-25T02:22:57.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.580+0000 7fd32bdf3700 1 -- 172.21.15.111:0/3108729893 shutdown_connections 2024-04-25T02:22:57.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.580+0000 7fd32bdf3700 1 --2- 172.21.15.111:0/3108729893 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd32413eb60 0x7fd3240a5d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:57.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.580+0000 7fd32bdf3700 1 --2- 172.21.15.111:0/3108729893 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd3240a22a0 0x7fd3240a8a30 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:57.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.580+0000 7fd32bdf3700 1 --2- 172.21.15.111:0/3108729893 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd3240a3410 0x7fd3240a57f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:57.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.580+0000 7fd32bdf3700 1 -- 172.21.15.111:0/3108729893 >> 172.21.15.111:0/3108729893 conn(0x7fd3240b1cf0 msgr2=0x7fd3240b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:57.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.580+0000 7fd32bdf3700 1 -- 172.21.15.111:0/3108729893 shutdown_connections 2024-04-25T02:22:57.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.580+0000 7fd32bdf3700 1 -- 172.21.15.111:0/3108729893 wait complete. 2024-04-25T02:22:57.586 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2024-04-25T02:22:57.594 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":4,"stamp":"2024-04-25T02:22:56.727312+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":8511,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":4195120,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292240,"statfs":{"total":386547056640,"available":382251253760,"internally_reserved":4294967296,"allocated":802816,"data_stored":248508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"1.001224"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.803299+0000","last_change":"2024-04-25T02:20:24.195706+0000","last_active":"2024-04-25T02:20:36.803299+0000","last_peered":"2024-04-25T02:20:36.803299+0000","last_clean":"2024-04-25T02:20:36.803299+0000","last_became_active":"2024-04-25T02:20:24.195349+0000","last_became_peered":"2024-04-25T02:20:24.195349+0000","last_unstale":"2024-04-25T02:20:36.803299+0000","last_undegraded":"2024-04-25T02:20:36.803299+0000","last_fullsized":"2024-04-25T02:20:36.803299+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.803415+0000","last_change":"2024-04-25T02:20:24.170636+0000","last_active":"2024-04-25T02:20:36.803415+0000","last_peered":"2024-04-25T02:20:36.803415+0000","last_clean":"2024-04-25T02:20:36.803415+0000","last_became_active":"2024-04-25T02:20:24.170426+0000","last_became_peered":"2024-04-25T02:20:24.170426+0000","last_unstale":"2024-04-25T02:20:36.803415+0000","last_undegraded":"2024-04-25T02:20:36.803415+0000","last_fullsized":"2024-04-25T02:20:36.803415+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.167886+0000","last_change":"2024-04-25T02:20:24.190781+0000","last_active":"2024-04-25T02:20:25.167886+0000","last_peered":"2024-04-25T02:20:25.167886+0000","last_clean":"2024-04-25T02:20:25.167886+0000","last_became_active":"2024-04-25T02:20:24.190114+0000","last_became_peered":"2024-04-25T02:20:24.190114+0000","last_unstale":"2024-04-25T02:20:25.167886+0000","last_undegraded":"2024-04-25T02:20:25.167886+0000","last_fullsized":"2024-04-25T02:20:25.167886+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.167257+0000","last_change":"2024-04-25T02:20:24.192016+0000","last_active":"2024-04-25T02:20:25.167257+0000","last_peered":"2024-04-25T02:20:25.167257+0000","last_clean":"2024-04-25T02:20:25.167257+0000","last_became_active":"2024-04-25T02:20:24.191694+0000","last_became_peered":"2024-04-25T02:20:24.191694+0000","last_unstale":"2024-04-25T02:20:25.167257+0000","last_undegraded":"2024-04-25T02:20:25.167257+0000","last_fullsized":"2024-04-25T02:20:25.167257+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.166678+0000","last_change":"2024-04-25T02:20:24.195316+0000","last_active":"2024-04-25T02:20:25.166678+0000","last_peered":"2024-04-25T02:20:25.166678+0000","last_clean":"2024-04-25T02:20:25.166678+0000","last_became_active":"2024-04-25T02:20:24.194996+0000","last_became_peered":"2024-04-25T02:20:24.194996+0000","last_unstale":"2024-04-25T02:20:25.166678+0000","last_undegraded":"2024-04-25T02:20:25.166678+0000","last_fullsized":"2024-04-25T02:20:25.166678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.263478+0000","last_change":"2024-04-25T02:20:24.188215+0000","last_active":"2024-04-25T02:20:36.263478+0000","last_peered":"2024-04-25T02:20:36.263478+0000","last_clean":"2024-04-25T02:20:36.263478+0000","last_became_active":"2024-04-25T02:20:24.186345+0000","last_became_peered":"2024-04-25T02:20:24.186345+0000","last_unstale":"2024-04-25T02:20:36.263478+0000","last_undegraded":"2024-04-25T02:20:36.263478+0000","last_fullsized":"2024-04-25T02:20:36.263478+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.262015+0000","last_change":"2024-04-25T02:20:24.186090+0000","last_active":"2024-04-25T02:20:36.262015+0000","last_peered":"2024-04-25T02:20:36.262015+0000","last_clean":"2024-04-25T02:20:36.262015+0000","last_became_active":"2024-04-25T02:20:24.185481+0000","last_became_peered":"2024-04-25T02:20:24.185481+0000","last_unstale":"2024-04-25T02:20:36.262015+0000","last_undegraded":"2024-04-25T02:20:36.262015+0000","last_fullsized":"2024-04-25T02:20:36.262015+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.801290+0000","last_change":"2024-04-25T02:20:24.176292+0000","last_active":"2024-04-25T02:20:36.801290+0000","last_peered":"2024-04-25T02:20:36.801290+0000","last_clean":"2024-04-25T02:20:36.801290+0000","last_became_active":"2024-04-25T02:20:24.175187+0000","last_became_peered":"2024-04-25T02:20:24.175187+0000","last_unstale":"2024-04-25T02:20:36.801290+0000","last_undegraded":"2024-04-25T02:20:36.801290+0000","last_fullsized":"2024-04-25T02:20:36.801290+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.165933+0000","last_change":"2024-04-25T02:20:24.192327+0000","last_active":"2024-04-25T02:20:25.165933+0000","last_peered":"2024-04-25T02:20:25.165933+0000","last_clean":"2024-04-25T02:20:25.165933+0000","last_became_active":"2024-04-25T02:20:24.191616+0000","last_became_peered":"2024-04-25T02:20:24.191616+0000","last_unstale":"2024-04-25T02:20:25.165933+0000","last_undegraded":"2024-04-25T02:20:25.165933+0000","last_fullsized":"2024-04-25T02:20:25.165933+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.801993+0000","last_change":"2024-04-25T02:20:24.178072+0000","last_active":"2024-04-25T02:20:36.801993+0000","last_peered":"2024-04-25T02:20:36.801993+0000","last_clean":"2024-04-25T02:20:36.801993+0000","last_became_active":"2024-04-25T02:20:24.177766+0000","last_became_peered":"2024-04-25T02:20:24.177766+0000","last_unstale":"2024-04-25T02:20:36.801993+0000","last_undegraded":"2024-04-25T02:20:36.801993+0000","last_fullsized":"2024-04-25T02:20:36.801993+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.802552+0000","last_change":"2024-04-25T02:20:24.179040+0000","last_active":"2024-04-25T02:20:36.802552+0000","last_peered":"2024-04-25T02:20:36.802552+0000","last_clean":"2024-04-25T02:20:36.802552+0000","last_became_active":"2024-04-25T02:20:24.178732+0000","last_became_peered":"2024-04-25T02:20:24.178732+0000","last_unstale":"2024-04-25T02:20:36.802552+0000","last_undegraded":"2024-04-25T02:20:36.802552+0000","last_fullsized":"2024-04-25T02:20:36.802552+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.803008+0000","last_change":"2024-04-25T02:20:24.195853+0000","last_active":"2024-04-25T02:20:36.803008+0000","last_peered":"2024-04-25T02:20:36.803008+0000","last_clean":"2024-04-25T02:20:36.803008+0000","last_became_active":"2024-04-25T02:20:24.195544+0000","last_became_peered":"2024-04-25T02:20:24.195544+0000","last_unstale":"2024-04-25T02:20:36.803008+0000","last_undegraded":"2024-04-25T02:20:36.803008+0000","last_fullsized":"2024-04-25T02:20:36.803008+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.802385+0000","last_change":"2024-04-25T02:20:24.196840+0000","last_active":"2024-04-25T02:20:36.802385+0000","last_peered":"2024-04-25T02:20:36.802385+0000","last_clean":"2024-04-25T02:20:36.802385+0000","last_became_active":"2024-04-25T02:20:24.196155+0000","last_became_peered":"2024-04-25T02:20:24.196155+0000","last_unstale":"2024-04-25T02:20:36.802385+0000","last_undegraded":"2024-04-25T02:20:36.802385+0000","last_fullsized":"2024-04-25T02:20:36.802385+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.801766+0000","last_change":"2024-04-25T02:20:24.171853+0000","last_active":"2024-04-25T02:20:36.801766+0000","last_peered":"2024-04-25T02:20:36.801766+0000","last_clean":"2024-04-25T02:20:36.801766+0000","last_became_active":"2024-04-25T02:20:24.171522+0000","last_became_peered":"2024-04-25T02:20:24.171522+0000","last_unstale":"2024-04-25T02:20:36.801766+0000","last_undegraded":"2024-04-25T02:20:36.801766+0000","last_fullsized":"2024-04-25T02:20:36.801766+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.165430+0000","last_change":"2024-04-25T02:20:24.185905+0000","last_active":"2024-04-25T02:20:25.165430+0000","last_peered":"2024-04-25T02:20:25.165430+0000","last_clean":"2024-04-25T02:20:25.165430+0000","last_became_active":"2024-04-25T02:20:24.185440+0000","last_became_peered":"2024-04-25T02:20:24.185440+0000","last_unstale":"2024-04-25T02:20:25.165430+0000","last_undegraded":"2024-04-25T02:20:25.165430+0000","last_fullsized":"2024-04-25T02:20:25.165430+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.261428+0000","last_change":"2024-04-25T02:20:24.183619+0000","last_active":"2024-04-25T02:20:36.261428+0000","last_peered":"2024-04-25T02:20:36.261428+0000","last_clean":"2024-04-25T02:20:36.261428+0000","last_became_active":"2024-04-25T02:20:24.183299+0000","last_became_peered":"2024-04-25T02:20:24.183299+0000","last_unstale":"2024-04-25T02:20:36.261428+0000","last_undegraded":"2024-04-25T02:20:36.261428+0000","last_fullsized":"2024-04-25T02:20:36.261428+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.165837+0000","last_change":"2024-04-25T02:20:24.194408+0000","last_active":"2024-04-25T02:20:25.165837+0000","last_peered":"2024-04-25T02:20:25.165837+0000","last_clean":"2024-04-25T02:20:25.165837+0000","last_became_active":"2024-04-25T02:20:24.192031+0000","last_became_peered":"2024-04-25T02:20:24.192031+0000","last_unstale":"2024-04-25T02:20:25.165837+0000","last_undegraded":"2024-04-25T02:20:25.165837+0000","last_fullsized":"2024-04-25T02:20:25.165837+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.165398+0000","last_change":"2024-04-25T02:20:24.175814+0000","last_active":"2024-04-25T02:20:25.165398+0000","last_peered":"2024-04-25T02:20:25.165398+0000","last_clean":"2024-04-25T02:20:25.165398+0000","last_became_active":"2024-04-25T02:20:24.174411+0000","last_became_peered":"2024-04-25T02:20:24.174411+0000","last_unstale":"2024-04-25T02:20:25.165398+0000","last_undegraded":"2024-04-25T02:20:25.165398+0000","last_fullsized":"2024-04-25T02:20:25.165398+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.801260+0000","last_change":"2024-04-25T02:20:24.195764+0000","last_active":"2024-04-25T02:20:36.801260+0000","last_peered":"2024-04-25T02:20:36.801260+0000","last_clean":"2024-04-25T02:20:36.801260+0000","last_became_active":"2024-04-25T02:20:24.195463+0000","last_became_peered":"2024-04-25T02:20:24.195463+0000","last_unstale":"2024-04-25T02:20:36.801260+0000","last_undegraded":"2024-04-25T02:20:36.801260+0000","last_fullsized":"2024-04-25T02:20:36.801260+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.802443+0000","last_change":"2024-04-25T02:20:24.200557+0000","last_active":"2024-04-25T02:20:36.802443+0000","last_peered":"2024-04-25T02:20:36.802443+0000","last_clean":"2024-04-25T02:20:36.802443+0000","last_became_active":"2024-04-25T02:20:24.200289+0000","last_became_peered":"2024-04-25T02:20:24.200289+0000","last_unstale":"2024-04-25T02:20:36.802443+0000","last_undegraded":"2024-04-25T02:20:36.802443+0000","last_fullsized":"2024-04-25T02:20:36.802443+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.801739+0000","last_change":"2024-04-25T02:20:24.185144+0000","last_active":"2024-04-25T02:20:36.801739+0000","last_peered":"2024-04-25T02:20:36.801739+0000","last_clean":"2024-04-25T02:20:36.801739+0000","last_became_active":"2024-04-25T02:20:24.184668+0000","last_became_peered":"2024-04-25T02:20:24.184668+0000","last_unstale":"2024-04-25T02:20:36.801739+0000","last_undegraded":"2024-04-25T02:20:36.801739+0000","last_fullsized":"2024-04-25T02:20:36.801739+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.166200+0000","last_change":"2024-04-25T02:20:24.185079+0000","last_active":"2024-04-25T02:20:25.166200+0000","last_peered":"2024-04-25T02:20:25.166200+0000","last_clean":"2024-04-25T02:20:25.166200+0000","last_became_active":"2024-04-25T02:20:24.184748+0000","last_became_peered":"2024-04-25T02:20:24.184748+0000","last_unstale":"2024-04-25T02:20:25.166200+0000","last_undegraded":"2024-04-25T02:20:25.166200+0000","last_fullsized":"2024-04-25T02:20:25.166200+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.261970+0000","last_change":"2024-04-25T02:20:24.185898+0000","last_active":"2024-04-25T02:20:36.261970+0000","last_peered":"2024-04-25T02:20:36.261970+0000","last_clean":"2024-04-25T02:20:36.261970+0000","last_became_active":"2024-04-25T02:20:24.185153+0000","last_became_peered":"2024-04-25T02:20:24.185153+0000","last_unstale":"2024-04-25T02:20:36.261970+0000","last_undegraded":"2024-04-25T02:20:36.261970+0000","last_fullsized":"2024-04-25T02:20:36.261970+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.801331+0000","last_change":"2024-04-25T02:20:24.183879+0000","last_active":"2024-04-25T02:20:36.801331+0000","last_peered":"2024-04-25T02:20:36.801331+0000","last_clean":"2024-04-25T02:20:36.801331+0000","last_became_active":"2024-04-25T02:20:24.183565+0000","last_became_peered":"2024-04-25T02:20:24.183565+0000","last_unstale":"2024-04-25T02:20:36.801331+0000","last_undegraded":"2024-04-25T02:20:36.801331+0000","last_fullsized":"2024-04-25T02:20:36.801331+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.802042+0000","last_change":"2024-04-25T02:20:24.186601+0000","last_active":"2024-04-25T02:20:36.802042+0000","last_peered":"2024-04-25T02:20:36.802042+0000","last_clean":"2024-04-25T02:20:36.802042+0000","last_became_active":"2024-04-25T02:20:24.184553+0000","last_became_peered":"2024-04-25T02:20:24.184553+0000","last_unstale":"2024-04-25T02:20:36.802042+0000","last_undegraded":"2024-04-25T02:20:36.802042+0000","last_fullsized":"2024-04-25T02:20:36.802042+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.801932+0000","last_change":"2024-04-25T02:20:24.167579+0000","last_active":"2024-04-25T02:20:36.801932+0000","last_peered":"2024-04-25T02:20:36.801932+0000","last_clean":"2024-04-25T02:20:36.801932+0000","last_became_active":"2024-04-25T02:20:24.167170+0000","last_became_peered":"2024-04-25T02:20:24.167170+0000","last_unstale":"2024-04-25T02:20:36.801932+0000","last_undegraded":"2024-04-25T02:20:36.801932+0000","last_fullsized":"2024-04-25T02:20:36.801932+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.262888+0000","last_change":"2024-04-25T02:20:24.189023+0000","last_active":"2024-04-25T02:20:36.262888+0000","last_peered":"2024-04-25T02:20:36.262888+0000","last_clean":"2024-04-25T02:20:36.262888+0000","last_became_active":"2024-04-25T02:20:24.188203+0000","last_became_peered":"2024-04-25T02:20:24.188203+0000","last_unstale":"2024-04-25T02:20:36.262888+0000","last_undegraded":"2024-04-25T02:20:36.262888+0000","last_fullsized":"2024-04-25T02:20:36.262888+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.801329+0000","last_change":"2024-04-25T02:20:23.878198+0000","last_active":"2024-04-25T02:20:36.801329+0000","last_peered":"2024-04-25T02:20:36.801329+0000","last_clean":"2024-04-25T02:20:36.801329+0000","last_became_active":"2024-04-25T02:20:23.877819+0000","last_became_peered":"2024-04-25T02:20:23.877819+0000","last_unstale":"2024-04-25T02:20:36.801329+0000","last_undegraded":"2024-04-25T02:20:36.801329+0000","last_fullsized":"2024-04-25T02:20:36.801329+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.262973+0000","last_change":"2024-04-25T02:20:24.191107+0000","last_active":"2024-04-25T02:20:36.262973+0000","last_peered":"2024-04-25T02:20:36.262973+0000","last_clean":"2024-04-25T02:20:36.262973+0000","last_became_active":"2024-04-25T02:20:24.190019+0000","last_became_peered":"2024-04-25T02:20:24.190019+0000","last_unstale":"2024-04-25T02:20:36.262973+0000","last_undegraded":"2024-04-25T02:20:36.262973+0000","last_fullsized":"2024-04-25T02:20:36.262973+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.801338+0000","last_change":"2024-04-25T02:20:23.879347+0000","last_active":"2024-04-25T02:20:36.801338+0000","last_peered":"2024-04-25T02:20:36.801338+0000","last_clean":"2024-04-25T02:20:36.801338+0000","last_became_active":"2024-04-25T02:20:23.879065+0000","last_became_peered":"2024-04-25T02:20:23.879065+0000","last_unstale":"2024-04-25T02:20:36.801338+0000","last_undegraded":"2024-04-25T02:20:36.801338+0000","last_fullsized":"2024-04-25T02:20:36.801338+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.165577+0000","last_change":"2024-04-25T02:20:24.190744+0000","last_active":"2024-04-25T02:20:25.165577+0000","last_peered":"2024-04-25T02:20:25.165577+0000","last_clean":"2024-04-25T02:20:25.165577+0000","last_became_active":"2024-04-25T02:20:24.190410+0000","last_became_peered":"2024-04-25T02:20:24.190410+0000","last_unstale":"2024-04-25T02:20:25.165577+0000","last_undegraded":"2024-04-25T02:20:25.165577+0000","last_fullsized":"2024-04-25T02:20:25.165577+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.261726+0000","last_change":"2024-04-25T02:20:23.890094+0000","last_active":"2024-04-25T02:20:36.261726+0000","last_peered":"2024-04-25T02:20:36.261726+0000","last_clean":"2024-04-25T02:20:36.261726+0000","last_became_active":"2024-04-25T02:20:23.889715+0000","last_became_peered":"2024-04-25T02:20:23.889715+0000","last_unstale":"2024-04-25T02:20:36.261726+0000","last_undegraded":"2024-04-25T02:20:36.261726+0000","last_fullsized":"2024-04-25T02:20:36.261726+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.263969+0000","last_change":"2024-04-25T02:20:24.196642+0000","last_active":"2024-04-25T02:20:36.263969+0000","last_peered":"2024-04-25T02:20:36.263969+0000","last_clean":"2024-04-25T02:20:36.263969+0000","last_became_active":"2024-04-25T02:20:24.196137+0000","last_became_peered":"2024-04-25T02:20:24.196137+0000","last_unstale":"2024-04-25T02:20:36.263969+0000","last_undegraded":"2024-04-25T02:20:36.263969+0000","last_fullsized":"2024-04-25T02:20:36.263969+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"19'7","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:21:05.598766+0000","last_change":"2024-04-25T02:20:23.877498+0000","last_active":"2024-04-25T02:21:05.598766+0000","last_peered":"2024-04-25T02:21:05.598766+0000","last_clean":"2024-04-25T02:21:05.598766+0000","last_became_active":"2024-04-25T02:20:23.876803+0000","last_became_peered":"2024-04-25T02:20:23.876803+0000","last_unstale":"2024-04-25T02:21:05.598766+0000","last_undegraded":"2024-04-25T02:21:05.598766+0000","last_fullsized":"2024-04-25T02:21:05.598766+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.261760+0000","last_change":"2024-04-25T02:20:24.192558+0000","last_active":"2024-04-25T02:20:36.261760+0000","last_peered":"2024-04-25T02:20:36.261760+0000","last_clean":"2024-04-25T02:20:36.261760+0000","last_became_active":"2024-04-25T02:20:24.191880+0000","last_became_peered":"2024-04-25T02:20:24.191880+0000","last_unstale":"2024-04-25T02:20:36.261760+0000","last_undegraded":"2024-04-25T02:20:36.261760+0000","last_fullsized":"2024-04-25T02:20:36.261760+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.803310+0000","last_change":"2024-04-25T02:20:23.885888+0000","last_active":"2024-04-25T02:20:36.803310+0000","last_peered":"2024-04-25T02:20:36.803310+0000","last_clean":"2024-04-25T02:20:36.803310+0000","last_became_active":"2024-04-25T02:20:23.885589+0000","last_became_peered":"2024-04-25T02:20:23.885589+0000","last_unstale":"2024-04-25T02:20:36.803310+0000","last_undegraded":"2024-04-25T02:20:36.803310+0000","last_fullsized":"2024-04-25T02:20:36.803310+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.262231+0000","last_change":"2024-04-25T02:20:24.198607+0000","last_active":"2024-04-25T02:20:36.262231+0000","last_peered":"2024-04-25T02:20:36.262231+0000","last_clean":"2024-04-25T02:20:36.262231+0000","last_became_active":"2024-04-25T02:20:24.196892+0000","last_became_peered":"2024-04-25T02:20:24.196892+0000","last_unstale":"2024-04-25T02:20:36.262231+0000","last_undegraded":"2024-04-25T02:20:36.262231+0000","last_fullsized":"2024-04-25T02:20:36.262231+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"18'4","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.248322+0000","last_change":"2024-04-25T02:20:23.883408+0000","last_active":"2024-04-25T02:20:26.248322+0000","last_peered":"2024-04-25T02:20:26.248322+0000","last_clean":"2024-04-25T02:20:26.248322+0000","last_became_active":"2024-04-25T02:20:23.882488+0000","last_became_peered":"2024-04-25T02:20:23.882488+0000","last_unstale":"2024-04-25T02:20:26.248322+0000","last_undegraded":"2024-04-25T02:20:26.248322+0000","last_fullsized":"2024-04-25T02:20:26.248322+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.801657+0000","last_change":"2024-04-25T02:20:24.180953+0000","last_active":"2024-04-25T02:20:36.801657+0000","last_peered":"2024-04-25T02:20:36.801657+0000","last_clean":"2024-04-25T02:20:36.801657+0000","last_became_active":"2024-04-25T02:20:24.180646+0000","last_became_peered":"2024-04-25T02:20:24.180646+0000","last_unstale":"2024-04-25T02:20:36.801657+0000","last_undegraded":"2024-04-25T02:20:36.801657+0000","last_fullsized":"2024-04-25T02:20:36.801657+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'16","reported_seq":28,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:22:54.785519+0000","last_change":"2024-04-25T02:20:23.890383+0000","last_active":"2024-04-25T02:22:54.785519+0000","last_peered":"2024-04-25T02:22:54.785519+0000","last_clean":"2024-04-25T02:22:54.785519+0000","last_became_active":"2024-04-25T02:20:23.890015+0000","last_became_peered":"2024-04-25T02:20:23.890015+0000","last_unstale":"2024-04-25T02:22:54.785519+0000","last_undegraded":"2024-04-25T02:22:54.785519+0000","last_fullsized":"2024-04-25T02:22:54.785519+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4743,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.802572+0000","last_change":"2024-04-25T02:20:24.186645+0000","last_active":"2024-04-25T02:20:36.802572+0000","last_peered":"2024-04-25T02:20:36.802572+0000","last_clean":"2024-04-25T02:20:36.802572+0000","last_became_active":"2024-04-25T02:20:24.186336+0000","last_became_peered":"2024-04-25T02:20:24.186336+0000","last_unstale":"2024-04-25T02:20:36.802572+0000","last_undegraded":"2024-04-25T02:20:36.802572+0000","last_fullsized":"2024-04-25T02:20:36.802572+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.262732+0000","last_change":"2024-04-25T02:20:23.882583+0000","last_active":"2024-04-25T02:20:36.262732+0000","last_peered":"2024-04-25T02:20:36.262732+0000","last_clean":"2024-04-25T02:20:36.262732+0000","last_became_active":"2024-04-25T02:20:23.882254+0000","last_became_peered":"2024-04-25T02:20:23.882254+0000","last_unstale":"2024-04-25T02:20:36.262732+0000","last_undegraded":"2024-04-25T02:20:36.262732+0000","last_fullsized":"2024-04-25T02:20:36.262732+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.262519+0000","last_change":"2024-04-25T02:20:24.191415+0000","last_active":"2024-04-25T02:20:36.262519+0000","last_peered":"2024-04-25T02:20:36.262519+0000","last_clean":"2024-04-25T02:20:36.262519+0000","last_became_active":"2024-04-25T02:20:24.191024+0000","last_became_peered":"2024-04-25T02:20:24.191024+0000","last_unstale":"2024-04-25T02:20:36.262519+0000","last_undegraded":"2024-04-25T02:20:36.262519+0000","last_fullsized":"2024-04-25T02:20:36.262519+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"18'3","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.248691+0000","last_change":"2024-04-25T02:20:23.881482+0000","last_active":"2024-04-25T02:20:26.248691+0000","last_peered":"2024-04-25T02:20:26.248691+0000","last_clean":"2024-04-25T02:20:26.248691+0000","last_became_active":"2024-04-25T02:20:23.881128+0000","last_became_peered":"2024-04-25T02:20:23.881128+0000","last_unstale":"2024-04-25T02:20:26.248691+0000","last_undegraded":"2024-04-25T02:20:26.248691+0000","last_fullsized":"2024-04-25T02:20:26.248691+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.263056+0000","last_change":"2024-04-25T02:20:24.197800+0000","last_active":"2024-04-25T02:20:36.263056+0000","last_peered":"2024-04-25T02:20:36.263056+0000","last_clean":"2024-04-25T02:20:36.263056+0000","last_became_active":"2024-04-25T02:20:24.188621+0000","last_became_peered":"2024-04-25T02:20:24.188621+0000","last_unstale":"2024-04-25T02:20:36.263056+0000","last_undegraded":"2024-04-25T02:20:36.263056+0000","last_fullsized":"2024-04-25T02:20:36.263056+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.262184+0000","last_change":"2024-04-25T02:20:23.890803+0000","last_active":"2024-04-25T02:20:36.262184+0000","last_peered":"2024-04-25T02:20:36.262184+0000","last_clean":"2024-04-25T02:20:36.262184+0000","last_became_active":"2024-04-25T02:20:23.890114+0000","last_became_peered":"2024-04-25T02:20:23.890114+0000","last_unstale":"2024-04-25T02:20:36.262184+0000","last_undegraded":"2024-04-25T02:20:36.262184+0000","last_fullsized":"2024-04-25T02:20:36.262184+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.165684+0000","last_change":"2024-04-25T02:20:24.186816+0000","last_active":"2024-04-25T02:20:25.165684+0000","last_peered":"2024-04-25T02:20:25.165684+0000","last_clean":"2024-04-25T02:20:25.165684+0000","last_became_active":"2024-04-25T02:20:24.185644+0000","last_became_peered":"2024-04-25T02:20:24.185644+0000","last_unstale":"2024-04-25T02:20:25.165684+0000","last_undegraded":"2024-04-25T02:20:25.165684+0000","last_fullsized":"2024-04-25T02:20:25.165684+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'10","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.801534+0000","last_change":"2024-04-25T02:20:23.873213+0000","last_active":"2024-04-25T02:20:36.801534+0000","last_peered":"2024-04-25T02:20:36.801534+0000","last_clean":"2024-04-25T02:20:36.801534+0000","last_became_active":"2024-04-25T02:20:23.872886+0000","last_became_peered":"2024-04-25T02:20:23.872886+0000","last_unstale":"2024-04-25T02:20:36.801534+0000","last_undegraded":"2024-04-25T02:20:36.801534+0000","last_fullsized":"2024-04-25T02:20:36.801534+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.263920+0000","last_change":"2024-04-25T02:20:24.196436+0000","last_active":"2024-04-25T02:20:36.263920+0000","last_peered":"2024-04-25T02:20:36.263920+0000","last_clean":"2024-04-25T02:20:36.263920+0000","last_became_active":"2024-04-25T02:20:24.195763+0000","last_became_peered":"2024-04-25T02:20:24.195763+0000","last_unstale":"2024-04-25T02:20:36.263920+0000","last_undegraded":"2024-04-25T02:20:36.263920+0000","last_fullsized":"2024-04-25T02:20:36.263920+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.165519+0000","last_change":"2024-04-25T02:20:23.872612+0000","last_active":"2024-04-25T02:20:25.165519+0000","last_peered":"2024-04-25T02:20:25.165519+0000","last_clean":"2024-04-25T02:20:25.165519+0000","last_became_active":"2024-04-25T02:20:23.872266+0000","last_became_peered":"2024-04-25T02:20:23.872266+0000","last_unstale":"2024-04-25T02:20:25.165519+0000","last_undegraded":"2024-04-25T02:20:25.165519+0000","last_fullsized":"2024-04-25T02:20:25.165519+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.261826+0000","last_change":"2024-04-25T02:20:24.194953+0000","last_active":"2024-04-25T02:20:36.261826+0000","last_peered":"2024-04-25T02:20:36.261826+0000","last_clean":"2024-04-25T02:20:36.261826+0000","last_became_active":"2024-04-25T02:20:24.194637+0000","last_became_peered":"2024-04-25T02:20:24.194637+0000","last_unstale":"2024-04-25T02:20:36.261826+0000","last_undegraded":"2024-04-25T02:20:36.261826+0000","last_fullsized":"2024-04-25T02:20:36.261826+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.803311+0000","last_change":"2024-04-25T02:20:23.876382+0000","last_active":"2024-04-25T02:20:36.803311+0000","last_peered":"2024-04-25T02:20:36.803311+0000","last_clean":"2024-04-25T02:20:36.803311+0000","last_became_active":"2024-04-25T02:20:23.875806+0000","last_became_peered":"2024-04-25T02:20:23.875806+0000","last_unstale":"2024-04-25T02:20:36.803311+0000","last_undegraded":"2024-04-25T02:20:36.803311+0000","last_fullsized":"2024-04-25T02:20:36.803311+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.801439+0000","last_change":"2024-04-25T02:20:24.190109+0000","last_active":"2024-04-25T02:20:36.801439+0000","last_peered":"2024-04-25T02:20:36.801439+0000","last_clean":"2024-04-25T02:20:36.801439+0000","last_became_active":"2024-04-25T02:20:24.189801+0000","last_became_peered":"2024-04-25T02:20:24.189801+0000","last_unstale":"2024-04-25T02:20:36.801439+0000","last_undegraded":"2024-04-25T02:20:36.801439+0000","last_fullsized":"2024-04-25T02:20:36.801439+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.263231+0000","last_change":"2024-04-25T02:20:23.885537+0000","last_active":"2024-04-25T02:20:36.263231+0000","last_peered":"2024-04-25T02:20:36.263231+0000","last_clean":"2024-04-25T02:20:36.263231+0000","last_became_active":"2024-04-25T02:20:23.885190+0000","last_became_peered":"2024-04-25T02:20:23.885190+0000","last_unstale":"2024-04-25T02:20:36.263231+0000","last_undegraded":"2024-04-25T02:20:36.263231+0000","last_fullsized":"2024-04-25T02:20:36.263231+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.802124+0000","last_change":"2024-04-25T02:20:24.188326+0000","last_active":"2024-04-25T02:20:36.802124+0000","last_peered":"2024-04-25T02:20:36.802124+0000","last_clean":"2024-04-25T02:20:36.802124+0000","last_became_active":"2024-04-25T02:20:24.187661+0000","last_became_peered":"2024-04-25T02:20:24.187661+0000","last_unstale":"2024-04-25T02:20:36.802124+0000","last_undegraded":"2024-04-25T02:20:36.802124+0000","last_fullsized":"2024-04-25T02:20:36.802124+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.167493+0000","last_change":"2024-04-25T02:20:23.877401+0000","last_active":"2024-04-25T02:20:25.167493+0000","last_peered":"2024-04-25T02:20:25.167493+0000","last_clean":"2024-04-25T02:20:25.167493+0000","last_became_active":"2024-04-25T02:20:23.876871+0000","last_became_peered":"2024-04-25T02:20:23.876871+0000","last_unstale":"2024-04-25T02:20:25.167493+0000","last_undegraded":"2024-04-25T02:20:25.167493+0000","last_fullsized":"2024-04-25T02:20:25.167493+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.167058+0000","last_change":"2024-04-25T02:20:24.185293+0000","last_active":"2024-04-25T02:20:25.167058+0000","last_peered":"2024-04-25T02:20:25.167058+0000","last_clean":"2024-04-25T02:20:25.167058+0000","last_became_active":"2024-04-25T02:20:24.184978+0000","last_became_peered":"2024-04-25T02:20:24.184978+0000","last_unstale":"2024-04-25T02:20:25.167058+0000","last_undegraded":"2024-04-25T02:20:25.167058+0000","last_fullsized":"2024-04-25T02:20:25.167058+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.262556+0000","last_change":"2024-04-25T02:20:23.886478+0000","last_active":"2024-04-25T02:20:36.262556+0000","last_peered":"2024-04-25T02:20:36.262556+0000","last_clean":"2024-04-25T02:20:36.262556+0000","last_became_active":"2024-04-25T02:20:23.886157+0000","last_became_peered":"2024-04-25T02:20:23.886157+0000","last_unstale":"2024-04-25T02:20:36.262556+0000","last_undegraded":"2024-04-25T02:20:36.262556+0000","last_fullsized":"2024-04-25T02:20:36.262556+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.167412+0000","last_change":"2024-04-25T02:20:24.199344+0000","last_active":"2024-04-25T02:20:25.167412+0000","last_peered":"2024-04-25T02:20:25.167412+0000","last_clean":"2024-04-25T02:20:25.167412+0000","last_became_active":"2024-04-25T02:20:24.199010+0000","last_became_peered":"2024-04-25T02:20:24.199010+0000","last_unstale":"2024-04-25T02:20:25.167412+0000","last_undegraded":"2024-04-25T02:20:25.167412+0000","last_fullsized":"2024-04-25T02:20:25.167412+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"19'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:55.598457+0000","last_change":"2024-04-25T02:20:23.884331+0000","last_active":"2024-04-25T02:20:55.598457+0000","last_peered":"2024-04-25T02:20:55.598457+0000","last_clean":"2024-04-25T02:20:55.598457+0000","last_became_active":"2024-04-25T02:20:23.883987+0000","last_became_peered":"2024-04-25T02:20:23.883987+0000","last_unstale":"2024-04-25T02:20:55.598457+0000","last_undegraded":"2024-04-25T02:20:55.598457+0000","last_fullsized":"2024-04-25T02:20:55.598457+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.263141+0000","last_change":"2024-04-25T02:20:24.191297+0000","last_active":"2024-04-25T02:20:36.263141+0000","last_peered":"2024-04-25T02:20:36.263141+0000","last_clean":"2024-04-25T02:20:36.263141+0000","last_became_active":"2024-04-25T02:20:24.190401+0000","last_became_peered":"2024-04-25T02:20:24.190401+0000","last_unstale":"2024-04-25T02:20:36.263141+0000","last_undegraded":"2024-04-25T02:20:36.263141+0000","last_fullsized":"2024-04-25T02:20:36.263141+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"18'3","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.262064+0000","last_change":"2024-04-25T02:20:23.881257+0000","last_active":"2024-04-25T02:20:36.262064+0000","last_peered":"2024-04-25T02:20:36.262064+0000","last_clean":"2024-04-25T02:20:36.262064+0000","last_became_active":"2024-04-25T02:20:23.880935+0000","last_became_peered":"2024-04-25T02:20:23.880935+0000","last_unstale":"2024-04-25T02:20:36.262064+0000","last_undegraded":"2024-04-25T02:20:36.262064+0000","last_fullsized":"2024-04-25T02:20:36.262064+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.803386+0000","last_change":"2024-04-25T02:20:24.189432+0000","last_active":"2024-04-25T02:20:36.803386+0000","last_peered":"2024-04-25T02:20:36.803386+0000","last_clean":"2024-04-25T02:20:36.803386+0000","last_became_active":"2024-04-25T02:20:24.189016+0000","last_became_peered":"2024-04-25T02:20:24.189016+0000","last_unstale":"2024-04-25T02:20:36.803386+0000","last_undegraded":"2024-04-25T02:20:36.803386+0000","last_fullsized":"2024-04-25T02:20:36.803386+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.261472+0000","last_change":"2024-04-25T02:20:23.885274+0000","last_active":"2024-04-25T02:20:36.261472+0000","last_peered":"2024-04-25T02:20:36.261472+0000","last_clean":"2024-04-25T02:20:36.261472+0000","last_became_active":"2024-04-25T02:20:23.884934+0000","last_became_peered":"2024-04-25T02:20:23.884934+0000","last_unstale":"2024-04-25T02:20:36.261472+0000","last_undegraded":"2024-04-25T02:20:36.261472+0000","last_fullsized":"2024-04-25T02:20:36.261472+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.802132+0000","last_change":"2024-04-25T02:20:24.192355+0000","last_active":"2024-04-25T02:20:36.802132+0000","last_peered":"2024-04-25T02:20:36.802132+0000","last_clean":"2024-04-25T02:20:36.802132+0000","last_became_active":"2024-04-25T02:20:24.191909+0000","last_became_peered":"2024-04-25T02:20:24.191909+0000","last_unstale":"2024-04-25T02:20:36.802132+0000","last_undegraded":"2024-04-25T02:20:36.802132+0000","last_fullsized":"2024-04-25T02:20:36.802132+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.802359+0000","last_change":"2024-04-25T02:20:15.491093+0000","last_active":"2024-04-25T02:20:36.802359+0000","last_peered":"2024-04-25T02:20:36.802359+0000","last_clean":"2024-04-25T02:20:36.802359+0000","last_became_active":"2024-04-25T02:20:15.490770+0000","last_became_peered":"2024-04-25T02:20:15.490770+0000","last_unstale":"2024-04-25T02:20:36.802359+0000","last_undegraded":"2024-04-25T02:20:36.802359+0000","last_fullsized":"2024-04-25T02:20:36.802359+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.803235+0000","last_change":"2024-04-25T02:20:23.885604+0000","last_active":"2024-04-25T02:20:36.803235+0000","last_peered":"2024-04-25T02:20:36.803235+0000","last_clean":"2024-04-25T02:20:36.803235+0000","last_became_active":"2024-04-25T02:20:23.885298+0000","last_became_peered":"2024-04-25T02:20:23.885298+0000","last_unstale":"2024-04-25T02:20:36.803235+0000","last_undegraded":"2024-04-25T02:20:36.803235+0000","last_fullsized":"2024-04-25T02:20:36.803235+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.801646+0000","last_change":"2024-04-25T02:20:24.189688+0000","last_active":"2024-04-25T02:20:36.801646+0000","last_peered":"2024-04-25T02:20:36.801646+0000","last_clean":"2024-04-25T02:20:36.801646+0000","last_became_active":"2024-04-25T02:20:24.189417+0000","last_became_peered":"2024-04-25T02:20:24.189417+0000","last_unstale":"2024-04-25T02:20:36.801646+0000","last_undegraded":"2024-04-25T02:20:36.801646+0000","last_fullsized":"2024-04-25T02:20:36.801646+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.263576+0000","last_change":"2024-04-25T02:20:15.489991+0000","last_active":"2024-04-25T02:20:36.263576+0000","last_peered":"2024-04-25T02:20:36.263576+0000","last_clean":"2024-04-25T02:20:36.263576+0000","last_became_active":"2024-04-25T02:20:15.489641+0000","last_became_peered":"2024-04-25T02:20:15.489641+0000","last_unstale":"2024-04-25T02:20:36.263576+0000","last_undegraded":"2024-04-25T02:20:36.263576+0000","last_fullsized":"2024-04-25T02:20:36.263576+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"19'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.261952+0000","last_change":"2024-04-25T02:20:23.875583+0000","last_active":"2024-04-25T02:20:36.261952+0000","last_peered":"2024-04-25T02:20:36.261952+0000","last_clean":"2024-04-25T02:20:36.261952+0000","last_became_active":"2024-04-25T02:20:23.875234+0000","last_became_peered":"2024-04-25T02:20:23.875234+0000","last_unstale":"2024-04-25T02:20:36.261952+0000","last_undegraded":"2024-04-25T02:20:36.261952+0000","last_fullsized":"2024-04-25T02:20:36.261952+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.802085+0000","last_change":"2024-04-25T02:20:24.172708+0000","last_active":"2024-04-25T02:20:36.802085+0000","last_peered":"2024-04-25T02:20:36.802085+0000","last_clean":"2024-04-25T02:20:36.802085+0000","last_became_active":"2024-04-25T02:20:24.172138+0000","last_became_peered":"2024-04-25T02:20:24.172138+0000","last_unstale":"2024-04-25T02:20:36.802085+0000","last_undegraded":"2024-04-25T02:20:36.802085+0000","last_fullsized":"2024-04-25T02:20:36.802085+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.801575+0000","last_change":"2024-04-25T02:20:15.488908+0000","last_active":"2024-04-25T02:20:36.801575+0000","last_peered":"2024-04-25T02:20:36.801575+0000","last_clean":"2024-04-25T02:20:36.801575+0000","last_became_active":"2024-04-25T02:20:15.488569+0000","last_became_peered":"2024-04-25T02:20:15.488569+0000","last_unstale":"2024-04-25T02:20:36.801575+0000","last_undegraded":"2024-04-25T02:20:36.801575+0000","last_fullsized":"2024-04-25T02:20:36.801575+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.801466+0000","last_change":"2024-04-25T02:20:23.872080+0000","last_active":"2024-04-25T02:20:36.801466+0000","last_peered":"2024-04-25T02:20:36.801466+0000","last_clean":"2024-04-25T02:20:36.801466+0000","last_became_active":"2024-04-25T02:20:23.871751+0000","last_became_peered":"2024-04-25T02:20:23.871751+0000","last_unstale":"2024-04-25T02:20:36.801466+0000","last_undegraded":"2024-04-25T02:20:36.801466+0000","last_fullsized":"2024-04-25T02:20:36.801466+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.802162+0000","last_change":"2024-04-25T02:20:24.174377+0000","last_active":"2024-04-25T02:20:36.802162+0000","last_peered":"2024-04-25T02:20:36.802162+0000","last_clean":"2024-04-25T02:20:36.802162+0000","last_became_active":"2024-04-25T02:20:24.174100+0000","last_became_peered":"2024-04-25T02:20:24.174100+0000","last_unstale":"2024-04-25T02:20:36.802162+0000","last_undegraded":"2024-04-25T02:20:36.802162+0000","last_fullsized":"2024-04-25T02:20:36.802162+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.262639+0000","last_change":"2024-04-25T02:20:15.487675+0000","last_active":"2024-04-25T02:20:36.262639+0000","last_peered":"2024-04-25T02:20:36.262639+0000","last_clean":"2024-04-25T02:20:36.262639+0000","last_became_active":"2024-04-25T02:20:15.487331+0000","last_became_peered":"2024-04-25T02:20:15.487331+0000","last_unstale":"2024-04-25T02:20:36.262639+0000","last_undegraded":"2024-04-25T02:20:36.262639+0000","last_fullsized":"2024-04-25T02:20:36.262639+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"10'1","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.801400+0000","last_change":"2024-04-25T02:20:11.467819+0000","last_active":"2024-04-25T02:20:36.801400+0000","last_peered":"2024-04-25T02:20:36.801400+0000","last_clean":"2024-04-25T02:20:36.801400+0000","last_became_active":"2024-04-25T02:20:11.467259+0000","last_became_peered":"2024-04-25T02:20:11.467259+0000","last_unstale":"2024-04-25T02:20:36.801400+0000","last_undegraded":"2024-04-25T02:20:36.801400+0000","last_fullsized":"2024-04-25T02:20:36.801400+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:08.432182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:08.432182+0000","last_clean_scrub_stamp":"2024-04-25T02:20:08.432182+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.263326+0000","last_change":"2024-04-25T02:20:23.891327+0000","last_active":"2024-04-25T02:20:36.263326+0000","last_peered":"2024-04-25T02:20:36.263326+0000","last_clean":"2024-04-25T02:20:36.263326+0000","last_became_active":"2024-04-25T02:20:23.891033+0000","last_became_peered":"2024-04-25T02:20:23.891033+0000","last_unstale":"2024-04-25T02:20:36.263326+0000","last_undegraded":"2024-04-25T02:20:36.263326+0000","last_fullsized":"2024-04-25T02:20:36.263326+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.263578+0000","last_change":"2024-04-25T02:20:24.191472+0000","last_active":"2024-04-25T02:20:36.263578+0000","last_peered":"2024-04-25T02:20:36.263578+0000","last_clean":"2024-04-25T02:20:36.263578+0000","last_became_active":"2024-04-25T02:20:24.190777+0000","last_became_peered":"2024-04-25T02:20:24.190777+0000","last_unstale":"2024-04-25T02:20:36.263578+0000","last_undegraded":"2024-04-25T02:20:36.263578+0000","last_fullsized":"2024-04-25T02:20:36.263578+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.261615+0000","last_change":"2024-04-25T02:20:15.490166+0000","last_active":"2024-04-25T02:20:36.261615+0000","last_peered":"2024-04-25T02:20:36.261615+0000","last_clean":"2024-04-25T02:20:36.261615+0000","last_became_active":"2024-04-25T02:20:15.489795+0000","last_became_peered":"2024-04-25T02:20:15.489795+0000","last_unstale":"2024-04-25T02:20:36.261615+0000","last_undegraded":"2024-04-25T02:20:36.261615+0000","last_fullsized":"2024-04-25T02:20:36.261615+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.250242+0000","last_change":"2024-04-25T02:20:23.875637+0000","last_active":"2024-04-25T02:20:26.250242+0000","last_peered":"2024-04-25T02:20:26.250242+0000","last_clean":"2024-04-25T02:20:26.250242+0000","last_became_active":"2024-04-25T02:20:23.875042+0000","last_became_peered":"2024-04-25T02:20:23.875042+0000","last_unstale":"2024-04-25T02:20:26.250242+0000","last_undegraded":"2024-04-25T02:20:26.250242+0000","last_fullsized":"2024-04-25T02:20:26.250242+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.165754+0000","last_change":"2024-04-25T02:20:24.190630+0000","last_active":"2024-04-25T02:20:25.165754+0000","last_peered":"2024-04-25T02:20:25.165754+0000","last_clean":"2024-04-25T02:20:25.165754+0000","last_became_active":"2024-04-25T02:20:24.190288+0000","last_became_peered":"2024-04-25T02:20:24.190288+0000","last_unstale":"2024-04-25T02:20:25.165754+0000","last_undegraded":"2024-04-25T02:20:25.165754+0000","last_fullsized":"2024-04-25T02:20:25.165754+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.263383+0000","last_change":"2024-04-25T02:20:15.485725+0000","last_active":"2024-04-25T02:20:36.263383+0000","last_peered":"2024-04-25T02:20:36.263383+0000","last_clean":"2024-04-25T02:20:36.263383+0000","last_became_active":"2024-04-25T02:20:15.485352+0000","last_became_peered":"2024-04-25T02:20:15.485352+0000","last_unstale":"2024-04-25T02:20:36.263383+0000","last_undegraded":"2024-04-25T02:20:36.263383+0000","last_fullsized":"2024-04-25T02:20:36.263383+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.801986+0000","last_change":"2024-04-25T02:20:23.879989+0000","last_active":"2024-04-25T02:20:36.801986+0000","last_peered":"2024-04-25T02:20:36.801986+0000","last_clean":"2024-04-25T02:20:36.801986+0000","last_became_active":"2024-04-25T02:20:23.877442+0000","last_became_peered":"2024-04-25T02:20:23.877442+0000","last_unstale":"2024-04-25T02:20:36.801986+0000","last_undegraded":"2024-04-25T02:20:36.801986+0000","last_fullsized":"2024-04-25T02:20:36.801986+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.166953+0000","last_change":"2024-04-25T02:20:24.176550+0000","last_active":"2024-04-25T02:20:25.166953+0000","last_peered":"2024-04-25T02:20:25.166953+0000","last_clean":"2024-04-25T02:20:25.166953+0000","last_became_active":"2024-04-25T02:20:24.176249+0000","last_became_peered":"2024-04-25T02:20:24.176249+0000","last_unstale":"2024-04-25T02:20:25.166953+0000","last_undegraded":"2024-04-25T02:20:25.166953+0000","last_fullsized":"2024-04-25T02:20:25.166953+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.263810+0000","last_change":"2024-04-25T02:20:23.884258+0000","last_active":"2024-04-25T02:20:36.263810+0000","last_peered":"2024-04-25T02:20:36.263810+0000","last_clean":"2024-04-25T02:20:36.263810+0000","last_became_active":"2024-04-25T02:20:23.883867+0000","last_became_peered":"2024-04-25T02:20:23.883867+0000","last_unstale":"2024-04-25T02:20:36.263810+0000","last_undegraded":"2024-04-25T02:20:36.263810+0000","last_fullsized":"2024-04-25T02:20:36.263810+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.801887+0000","last_change":"2024-04-25T02:20:15.490162+0000","last_active":"2024-04-25T02:20:36.801887+0000","last_peered":"2024-04-25T02:20:36.801887+0000","last_clean":"2024-04-25T02:20:36.801887+0000","last_became_active":"2024-04-25T02:20:15.489760+0000","last_became_peered":"2024-04-25T02:20:15.489760+0000","last_unstale":"2024-04-25T02:20:36.801887+0000","last_undegraded":"2024-04-25T02:20:36.801887+0000","last_fullsized":"2024-04-25T02:20:36.801887+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.261582+0000","last_change":"2024-04-25T02:20:24.192993+0000","last_active":"2024-04-25T02:20:36.261582+0000","last_peered":"2024-04-25T02:20:36.261582+0000","last_clean":"2024-04-25T02:20:36.261582+0000","last_became_active":"2024-04-25T02:20:24.192258+0000","last_became_peered":"2024-04-25T02:20:24.192258+0000","last_unstale":"2024-04-25T02:20:36.261582+0000","last_undegraded":"2024-04-25T02:20:36.261582+0000","last_fullsized":"2024-04-25T02:20:36.261582+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.263870+0000","last_change":"2024-04-25T02:20:15.488540+0000","last_active":"2024-04-25T02:20:36.263870+0000","last_peered":"2024-04-25T02:20:36.263870+0000","last_clean":"2024-04-25T02:20:36.263870+0000","last_became_active":"2024-04-25T02:20:15.488148+0000","last_became_peered":"2024-04-25T02:20:15.488148+0000","last_unstale":"2024-04-25T02:20:36.263870+0000","last_undegraded":"2024-04-25T02:20:36.263870+0000","last_fullsized":"2024-04-25T02:20:36.263870+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"19'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:45.598792+0000","last_change":"2024-04-25T02:20:23.882042+0000","last_active":"2024-04-25T02:20:45.598792+0000","last_peered":"2024-04-25T02:20:45.598792+0000","last_clean":"2024-04-25T02:20:45.598792+0000","last_became_active":"2024-04-25T02:20:23.881660+0000","last_became_peered":"2024-04-25T02:20:23.881660+0000","last_unstale":"2024-04-25T02:20:45.598792+0000","last_undegraded":"2024-04-25T02:20:45.598792+0000","last_fullsized":"2024-04-25T02:20:45.598792+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.801407+0000","last_change":"2024-04-25T02:20:24.188573+0000","last_active":"2024-04-25T02:20:36.801407+0000","last_peered":"2024-04-25T02:20:36.801407+0000","last_clean":"2024-04-25T02:20:36.801407+0000","last_became_active":"2024-04-25T02:20:24.188251+0000","last_became_peered":"2024-04-25T02:20:24.188251+0000","last_unstale":"2024-04-25T02:20:36.801407+0000","last_undegraded":"2024-04-25T02:20:36.801407+0000","last_fullsized":"2024-04-25T02:20:36.801407+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'10","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:50.602372+0000","last_change":"2024-04-25T02:20:23.883575+0000","last_active":"2024-04-25T02:20:50.602372+0000","last_peered":"2024-04-25T02:20:50.602372+0000","last_clean":"2024-04-25T02:20:50.602372+0000","last_became_active":"2024-04-25T02:20:23.883144+0000","last_became_peered":"2024-04-25T02:20:23.883144+0000","last_unstale":"2024-04-25T02:20:50.602372+0000","last_undegraded":"2024-04-25T02:20:50.602372+0000","last_fullsized":"2024-04-25T02:20:50.602372+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2244,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.803107+0000","last_change":"2024-04-25T02:20:24.170678+0000","last_active":"2024-04-25T02:20:36.803107+0000","last_peered":"2024-04-25T02:20:36.803107+0000","last_clean":"2024-04-25T02:20:36.803107+0000","last_became_active":"2024-04-25T02:20:24.170488+0000","last_became_peered":"2024-04-25T02:20:24.170488+0000","last_unstale":"2024-04-25T02:20:36.803107+0000","last_undegraded":"2024-04-25T02:20:36.803107+0000","last_fullsized":"2024-04-25T02:20:36.803107+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.802182+0000","last_change":"2024-04-25T02:20:23.881809+0000","last_active":"2024-04-25T02:20:36.802182+0000","last_peered":"2024-04-25T02:20:36.802182+0000","last_clean":"2024-04-25T02:20:36.802182+0000","last_became_active":"2024-04-25T02:20:23.878991+0000","last_became_peered":"2024-04-25T02:20:23.878991+0000","last_unstale":"2024-04-25T02:20:36.802182+0000","last_undegraded":"2024-04-25T02:20:36.802182+0000","last_fullsized":"2024-04-25T02:20:36.802182+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.802479+0000","last_change":"2024-04-25T02:20:24.197009+0000","last_active":"2024-04-25T02:20:36.802479+0000","last_peered":"2024-04-25T02:20:36.802479+0000","last_clean":"2024-04-25T02:20:36.802479+0000","last_became_active":"2024-04-25T02:20:24.196535+0000","last_became_peered":"2024-04-25T02:20:24.196535+0000","last_unstale":"2024-04-25T02:20:36.802479+0000","last_undegraded":"2024-04-25T02:20:36.802479+0000","last_fullsized":"2024-04-25T02:20:36.802479+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.263510+0000","last_change":"2024-04-25T02:20:23.888031+0000","last_active":"2024-04-25T02:20:36.263510+0000","last_peered":"2024-04-25T02:20:36.263510+0000","last_clean":"2024-04-25T02:20:36.263510+0000","last_became_active":"2024-04-25T02:20:23.887730+0000","last_became_peered":"2024-04-25T02:20:23.887730+0000","last_unstale":"2024-04-25T02:20:36.263510+0000","last_undegraded":"2024-04-25T02:20:36.263510+0000","last_fullsized":"2024-04-25T02:20:36.263510+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.802029+0000","last_change":"2024-04-25T02:20:24.188502+0000","last_active":"2024-04-25T02:20:36.802029+0000","last_peered":"2024-04-25T02:20:36.802029+0000","last_clean":"2024-04-25T02:20:36.802029+0000","last_became_active":"2024-04-25T02:20:24.188102+0000","last_became_peered":"2024-04-25T02:20:24.188102+0000","last_unstale":"2024-04-25T02:20:36.802029+0000","last_undegraded":"2024-04-25T02:20:36.802029+0000","last_fullsized":"2024-04-25T02:20:36.802029+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.263549+0000","last_change":"2024-04-25T02:20:23.890367+0000","last_active":"2024-04-25T02:20:36.263549+0000","last_peered":"2024-04-25T02:20:36.263549+0000","last_clean":"2024-04-25T02:20:36.263549+0000","last_became_active":"2024-04-25T02:20:23.889958+0000","last_became_peered":"2024-04-25T02:20:23.889958+0000","last_unstale":"2024-04-25T02:20:36.263549+0000","last_undegraded":"2024-04-25T02:20:36.263549+0000","last_fullsized":"2024-04-25T02:20:36.263549+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.262315+0000","last_change":"2024-04-25T02:20:24.194271+0000","last_active":"2024-04-25T02:20:36.262315+0000","last_peered":"2024-04-25T02:20:36.262315+0000","last_clean":"2024-04-25T02:20:36.262315+0000","last_became_active":"2024-04-25T02:20:24.193729+0000","last_became_peered":"2024-04-25T02:20:24.193729+0000","last_unstale":"2024-04-25T02:20:36.262315+0000","last_undegraded":"2024-04-25T02:20:36.262315+0000","last_fullsized":"2024-04-25T02:20:36.262315+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.165762+0000","last_change":"2024-04-25T02:20:23.882173+0000","last_active":"2024-04-25T02:20:25.165762+0000","last_peered":"2024-04-25T02:20:25.165762+0000","last_clean":"2024-04-25T02:20:25.165762+0000","last_became_active":"2024-04-25T02:20:23.881840+0000","last_became_peered":"2024-04-25T02:20:23.881840+0000","last_unstale":"2024-04-25T02:20:25.165762+0000","last_undegraded":"2024-04-25T02:20:25.165762+0000","last_fullsized":"2024-04-25T02:20:25.165762+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":553,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.801120+0000","last_change":"2024-04-25T02:20:24.171268+0000","last_active":"2024-04-25T02:20:36.801120+0000","last_peered":"2024-04-25T02:20:36.801120+0000","last_clean":"2024-04-25T02:20:36.801120+0000","last_became_active":"2024-04-25T02:20:24.170957+0000","last_became_peered":"2024-04-25T02:20:24.170957+0000","last_unstale":"2024-04-25T02:20:36.801120+0000","last_undegraded":"2024-04-25T02:20:36.801120+0000","last_fullsized":"2024-04-25T02:20:36.801120+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.801542+0000","last_change":"2024-04-25T02:20:24.167991+0000","last_active":"2024-04-25T02:20:36.801542+0000","last_peered":"2024-04-25T02:20:36.801542+0000","last_clean":"2024-04-25T02:20:36.801542+0000","last_became_active":"2024-04-25T02:20:24.167659+0000","last_became_peered":"2024-04-25T02:20:24.167659+0000","last_unstale":"2024-04-25T02:20:36.801542+0000","last_undegraded":"2024-04-25T02:20:36.801542+0000","last_fullsized":"2024-04-25T02:20:36.801542+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.262110+0000","last_change":"2024-04-25T02:20:24.194043+0000","last_active":"2024-04-25T02:20:36.262110+0000","last_peered":"2024-04-25T02:20:36.262110+0000","last_clean":"2024-04-25T02:20:36.262110+0000","last_became_active":"2024-04-25T02:20:24.193386+0000","last_became_peered":"2024-04-25T02:20:24.193386+0000","last_unstale":"2024-04-25T02:20:36.262110+0000","last_undegraded":"2024-04-25T02:20:36.262110+0000","last_fullsized":"2024-04-25T02:20:36.262110+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.166421+0000","last_change":"2024-04-25T02:20:24.189262+0000","last_active":"2024-04-25T02:20:25.166421+0000","last_peered":"2024-04-25T02:20:25.166421+0000","last_clean":"2024-04-25T02:20:25.166421+0000","last_became_active":"2024-04-25T02:20:24.188938+0000","last_became_peered":"2024-04-25T02:20:24.188938+0000","last_unstale":"2024-04-25T02:20:25.166421+0000","last_undegraded":"2024-04-25T02:20:25.166421+0000","last_fullsized":"2024-04-25T02:20:25.166421+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.262819+0000","last_change":"2024-04-25T02:20:24.189965+0000","last_active":"2024-04-25T02:20:36.262819+0000","last_peered":"2024-04-25T02:20:36.262819+0000","last_clean":"2024-04-25T02:20:36.262819+0000","last_became_active":"2024-04-25T02:20:24.189042+0000","last_became_peered":"2024-04-25T02:20:24.189042+0000","last_unstale":"2024-04-25T02:20:36.262819+0000","last_undegraded":"2024-04-25T02:20:36.262819+0000","last_fullsized":"2024-04-25T02:20:36.262819+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.802274+0000","last_change":"2024-04-25T02:20:24.172462+0000","last_active":"2024-04-25T02:20:36.802274+0000","last_peered":"2024-04-25T02:20:36.802274+0000","last_clean":"2024-04-25T02:20:36.802274+0000","last_became_active":"2024-04-25T02:20:24.171736+0000","last_became_peered":"2024-04-25T02:20:24.171736+0000","last_unstale":"2024-04-25T02:20:36.802274+0000","last_undegraded":"2024-04-25T02:20:36.802274+0000","last_fullsized":"2024-04-25T02:20:36.802274+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":8511,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":17022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705698,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048804,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323036,"statfs":{"total":96636764160,"available":95562788864,"internally_reserved":1073741824,"allocated":225280,"data_stored":66860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:22:15 2024","interfaces":[{"interface":"back","average":{"1min":0.27300000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"min":{"1min":0.21299999999999999,"5min":0.192,"15min":0.192},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.27600000000000002,"5min":0.28100000000000003,"15min":0.28199999999999997},"min":{"1min":0.222,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.26500000000000001}]},{"osd":1,"last update":"Thu Apr 25 02:22:15 2024","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.29599999999999999,"15min":0.29699999999999999},"min":{"1min":0.222,"5min":0.221,"15min":0.221},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.23000000000000001},{"interface":"front","average":{"1min":0.28499999999999998,"5min":0.29499999999999998,"15min":0.29699999999999999},"min":{"1min":0.218,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.27800000000000002}]},{"osd":2,"last update":"Thu Apr 25 02:22:15 2024","interfaces":[{"interface":"back","average":{"1min":0.30099999999999999,"5min":0.309,"15min":0.31},"min":{"1min":0.23400000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.28999999999999998,"5min":0.29699999999999999,"15min":0.29799999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.28899999999999998}]}]},{"osd":2,"up_from":9,"seq":38654705700,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":63779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:22:14 2024","interfaces":[{"interface":"back","average":{"1min":0.26000000000000001,"5min":0.28100000000000003,"15min":0.28499999999999998},"min":{"1min":0.183,"5min":0.16,"15min":0.16},"max":{"1min":0.37,"5min":0.41799999999999998,"15min":0.41799999999999998},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.25900000000000001,"5min":0.29599999999999999,"15min":0.30199999999999999},"min":{"1min":0.21299999999999999,"5min":0.184,"15min":0.184},"max":{"1min":0.40300000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":1.2070000000000001}]},{"osd":1,"last update":"Thu Apr 25 02:22:14 2024","interfaces":[{"interface":"back","average":{"1min":0.27300000000000002,"5min":0.29699999999999999,"15min":0.30099999999999999},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.38400000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"last":1.1479999999999999},{"interface":"front","average":{"1min":0.27300000000000002,"5min":0.309,"15min":0.315},"min":{"1min":0.23499999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.42399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.23899999999999999}]},{"osd":3,"last update":"Thu Apr 25 02:22:14 2024","interfaces":[{"interface":"back","average":{"1min":0.28599999999999998,"5min":0.318,"15min":0.32400000000000001},"min":{"1min":0.23599999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.45600000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"last":5.5490000000000004},{"interface":"front","average":{"1min":0.28799999999999998,"5min":0.32800000000000001,"15min":0.33400000000000002},"min":{"1min":0.216,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.442,"5min":0.48299999999999998,"15min":0.48299999999999998},"last":1.1759999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705698,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":58300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 25 02:22:16 2024","interfaces":[{"interface":"back","average":{"1min":0.28599999999999998,"5min":0.29699999999999999,"15min":0.29899999999999999},"min":{"1min":0.20300000000000001,"5min":0.157,"15min":0.157},"max":{"1min":0.5,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.28499999999999998,"5min":0.32500000000000001,"15min":0.33200000000000002},"min":{"1min":0.14199999999999999,"5min":0.14199999999999999,"15min":0.14199999999999999},"max":{"1min":0.45700000000000002,"5min":1.123,"15min":1.123},"last":0.38600000000000001}]},{"osd":2,"last update":"Thu Apr 25 02:22:16 2024","interfaces":[{"interface":"back","average":{"1min":0.28799999999999998,"5min":0.30399999999999999,"15min":0.307},"min":{"1min":0.20799999999999999,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.441,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.309,"5min":0.56599999999999995,"15min":0.60899999999999999},"min":{"1min":0.157,"5min":0.157,"15min":0.157},"max":{"1min":0.48699999999999999,"5min":6.54,"15min":6.54},"last":0.40600000000000003}]},{"osd":3,"last update":"Thu Apr 25 02:22:16 2024","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.48699999999999999,"15min":0.51500000000000001},"min":{"1min":0.187,"5min":0.186,"15min":0.186},"max":{"1min":0.52500000000000002,"5min":4.2709999999999999,"15min":4.2709999999999999},"last":0.443},{"interface":"front","average":{"1min":0.312,"5min":0.34000000000000002,"15min":0.34399999999999997},"min":{"1min":0.23200000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.49099999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.42899999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705699,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048764,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323076,"statfs":{"total":96636764160,"available":95562829824,"internally_reserved":1073741824,"allocated":184320,"data_stored":59569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:22:13 2024","interfaces":[{"interface":"back","average":{"1min":0.254,"5min":0.27400000000000002,"15min":0.27700000000000002},"min":{"1min":0.151,"5min":0.14599999999999999,"15min":0.14599999999999999},"max":{"1min":0.47499999999999998,"5min":0.48399999999999999,"15min":0.48399999999999999},"last":0.22700000000000001},{"interface":"front","average":{"1min":0.25700000000000001,"5min":0.29199999999999998,"15min":0.29799999999999999},"min":{"1min":0.16900000000000001,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.42899999999999999,"5min":0.501,"15min":0.501},"last":0.23499999999999999}]},{"osd":2,"last update":"Thu Apr 25 02:22:13 2024","interfaces":[{"interface":"back","average":{"1min":0.26400000000000001,"5min":0.28199999999999997,"15min":0.28499999999999998},"min":{"1min":0.16800000000000001,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"last":0.251},{"interface":"front","average":{"1min":0.27200000000000002,"5min":0.29699999999999999,"15min":0.30099999999999999},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.245}]},{"osd":3,"last update":"Thu Apr 25 02:22:13 2024","interfaces":[{"interface":"back","average":{"1min":0.27900000000000003,"5min":0.29899999999999999,"15min":0.30199999999999999},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"last":0.21099999999999999},{"interface":"front","average":{"1min":0.28199999999999997,"5min":0.315,"15min":0.32100000000000001},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":0.495,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.29399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":7936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:22:57.598 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:22:57.752 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.749+0000 7f3868c03700 1 Processor -- start 2024-04-25T02:22:57.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.750+0000 7f3868c03700 1 -- start start 2024-04-25T02:22:57.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.750+0000 7f3868c03700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f38640a3410 0x7f38640a4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:57.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.750+0000 7f3868c03700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f386413ed30 0x7f3864145b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:57.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.750+0000 7f3868c03700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f386406da60 con 0x7f38640a22a0 2024-04-25T02:22:57.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.750+0000 7f3868c03700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38640a2a20 con 0x7f38640a3410 2024-04-25T02:22:57.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.750+0000 7f3868c03700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38640a3c80 con 0x7f386413ed30 2024-04-25T02:22:57.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.750+0000 7f386259c700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f38640a3410 0x7f38640a4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:57.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.750+0000 7f3862d9d700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f386413ed30 0x7f3864145b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:57.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.750+0000 7f3861d9b700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f38640a22a0 0x7f386413e620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:55512/0 (socket says 172.21.15.111:55512) 2024-04-25T02:22:57.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.750+0000 7f3861d9b700 1 -- 172.21.15.111:0/1267772476 learned_addr learned my addr 172.21.15.111:0/1267772476 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:22:57.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.751+0000 7f3862d9d700 1 -- 172.21.15.111:0/1267772476 >> v2:172.21.15.111:3300/0 conn(0x7f38640a3410 msgr2=0x7f38640a4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:22:57.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.751+0000 7f3862d9d700 1 --2- 172.21.15.111:0/1267772476 >> v2:172.21.15.111:3300/0 conn(0x7f38640a3410 0x7f38640a4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:57.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.751+0000 7f3862d9d700 1 -- 172.21.15.111:0/1267772476 >> v1:172.21.15.111:6789/0 conn(0x7f38640a22a0 legacy=0x7f386413e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:57.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.751+0000 7f3862d9d700 1 -- 172.21.15.111:0/1267772476 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38640a37e0 con 0x7f386413ed30 2024-04-25T02:22:57.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.751+0000 7f386159a700 1 -- 172.21.15.111:0/1267772476 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 592258161 0 0) 0x7f386406da60 con 0x7f38640a22a0 2024-04-25T02:22:57.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.751+0000 7f386259c700 1 --2- 172.21.15.111:0/1267772476 >> v2:172.21.15.111:3300/0 conn(0x7f38640a3410 0x7f38640a4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:22:57.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.751+0000 7f3862d9d700 1 --2- 172.21.15.111:0/1267772476 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f386413ed30 0x7f3864145b70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f385c009e90 tx=0x7f385c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=57af63bc18bd68e2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:57.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.751+0000 7f386159a700 1 -- 172.21.15.111:0/1267772476 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385c00e070 con 0x7f386413ed30 2024-04-25T02:22:57.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.751+0000 7f386159a700 1 -- 172.21.15.111:0/1267772476 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f385c00bbf0 con 0x7f386413ed30 2024-04-25T02:22:57.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.751+0000 7f386159a700 1 -- 172.21.15.111:0/1267772476 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f385c012430 con 0x7f386413ed30 2024-04-25T02:22:57.757 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.751+0000 7f3868c03700 1 -- 172.21.15.111:0/1267772476 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f386413ed30 msgr2=0x7f3864145b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:57.757 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.751+0000 7f3868c03700 1 --2- 172.21.15.111:0/1267772476 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f386413ed30 0x7f3864145b70 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f385c009e90 tx=0x7f385c009780 comp rx=0 tx=0).stop 2024-04-25T02:22:57.757 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.752+0000 7f3868c03700 1 -- 172.21.15.111:0/1267772476 shutdown_connections 2024-04-25T02:22:57.757 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.752+0000 7f3868c03700 1 --2- 172.21.15.111:0/1267772476 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f386413ed30 0x7f3864145b70 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:57.757 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.752+0000 7f3868c03700 1 --2- 172.21.15.111:0/1267772476 >> v2:172.21.15.111:3300/0 conn(0x7f38640a3410 0x7f38640a4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:57.757 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.752+0000 7f3868c03700 1 -- 172.21.15.111:0/1267772476 >> 172.21.15.111:0/1267772476 conn(0x7f38640b1cf0 msgr2=0x7f38640b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:57.757 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.752+0000 7f3868c03700 1 -- 172.21.15.111:0/1267772476 shutdown_connections 2024-04-25T02:22:57.757 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.752+0000 7f3868c03700 1 -- 172.21.15.111:0/1267772476 wait complete. 2024-04-25T02:22:57.757 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.752+0000 7f3868c03700 1 Processor -- start 2024-04-25T02:22:57.757 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.752+0000 7f3868c03700 1 -- start start 2024-04-25T02:22:57.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.753+0000 7f3868c03700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f38640a22a0 0x7f38640aaab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:57.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.753+0000 7f3868c03700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f38640a3410 0x7f386414dd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:57.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.753+0000 7f3868c03700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f386413ed30 0x7f386414e260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:57.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.753+0000 7f3868c03700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38640aca70 con 0x7f38640a22a0 2024-04-25T02:22:57.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.753+0000 7f3868c03700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38640ab170 con 0x7f38640a3410 2024-04-25T02:22:57.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.753+0000 7f3868c03700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f38640ab430 con 0x7f386413ed30 2024-04-25T02:22:57.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.753+0000 7f386259c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f38640a22a0 0x7f38640aaab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:57.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.753+0000 7f3861d9b700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f38640a3410 0x7f386414dd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:57.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.753+0000 7f386259c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f38640a22a0 0x7f38640aaab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:53556/0 (socket says 172.21.15.111:53556) 2024-04-25T02:22:57.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.753+0000 7f3862d9d700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f386413ed30 0x7f386414e260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:57.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.753+0000 7f386259c700 1 -- 172.21.15.111:0/2518865971 learned_addr learned my addr 172.21.15.111:0/2518865971 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:22:57.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.753+0000 7f3861d9b700 1 -- 172.21.15.111:0/2518865971 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f386413ed30 msgr2=0x7f386414e260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:57.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.753+0000 7f3861d9b700 1 --2- 172.21.15.111:0/2518865971 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f386413ed30 0x7f386414e260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:57.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.753+0000 7f3861d9b700 1 -- 172.21.15.111:0/2518865971 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f38640a22a0 msgr2=0x7f38640aaab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:57.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.753+0000 7f3861d9b700 1 --2- 172.21.15.111:0/2518865971 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f38640a22a0 0x7f38640aaab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:57.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.753+0000 7f3861d9b700 1 -- 172.21.15.111:0/2518865971 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3858009420 con 0x7f38640a3410 2024-04-25T02:22:57.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.753+0000 7f386259c700 1 --2- 172.21.15.111:0/2518865971 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f38640a22a0 0x7f38640aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:22:57.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.754+0000 7f3861d9b700 1 --2- 172.21.15.111:0/2518865971 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f38640a3410 0x7f386414dd20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f38540011e0 tx=0x7f3854007d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:57.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.754+0000 7f38527fc700 1 -- 172.21.15.111:0/2518865971 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3854005b30 con 0x7f38640a3410 2024-04-25T02:22:57.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.754+0000 7f38527fc700 1 -- 172.21.15.111:0/2518865971 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3854005cb0 con 0x7f38640a3410 2024-04-25T02:22:57.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.754+0000 7f3868c03700 1 -- 172.21.15.111:0/2518865971 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f385c009a20 con 0x7f38640a3410 2024-04-25T02:22:57.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.754+0000 7f38527fc700 1 -- 172.21.15.111:0/2518865971 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3854007320 con 0x7f38640a3410 2024-04-25T02:22:57.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.754+0000 7f3868c03700 1 -- 172.21.15.111:0/2518865971 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f38640ae860 con 0x7f38640a3410 2024-04-25T02:22:57.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.755+0000 7f3868c03700 1 -- 172.21.15.111:0/2518865971 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f386413c940 con 0x7f38640a3410 2024-04-25T02:22:57.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.755+0000 7f38527fc700 1 -- 172.21.15.111:0/2518865971 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 9) v1 ==== 53544+0+0 (secure 0 0 0) 0x7f3854012400 con 0x7f38640a3410 2024-04-25T02:22:57.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.755+0000 7f38527fc700 1 -- 172.21.15.111:0/2518865971 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3829+0+0 (secure 0 0 0) 0x7f385405a4e0 con 0x7f38640a3410 2024-04-25T02:22:57.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.758+0000 7f38527fc700 1 -- 172.21.15.111:0/2518865971 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f38540387f0 con 0x7f38640a3410 2024-04-25T02:22:57.914 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.911+0000 7f3868c03700 1 -- 172.21.15.111:0/2518865971 --> v1:172.21.15.111:6816/46482 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f38640b11a0 con 0x7f3844045f80 2024-04-25T02:22:57.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.918+0000 7f38527fc700 1 -- 172.21.15.111:0/2518865971 <== mgr.14107 v1:172.21.15.111:6816/46482 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+270500 (unknown 2965378022 0 1823893466) 0x7f38640b11a0 con 0x7f3844045f80 2024-04-25T02:22:57.925 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:22:57.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.921+0000 7f3868c03700 1 -- 172.21.15.111:0/2518865971 >> v1:172.21.15.111:6816/46482 conn(0x7f3844045f80 legacy=0x7f3844048430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:57.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.921+0000 7f3868c03700 1 -- 172.21.15.111:0/2518865971 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f38640a3410 msgr2=0x7f386414dd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:57.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.921+0000 7f3868c03700 1 --2- 172.21.15.111:0/2518865971 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f38640a3410 0x7f386414dd20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f38540011e0 tx=0x7f3854007d10 comp rx=0 tx=0).stop 2024-04-25T02:22:57.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.921+0000 7f3868c03700 1 -- 172.21.15.111:0/2518865971 shutdown_connections 2024-04-25T02:22:57.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.921+0000 7f3868c03700 1 --2- 172.21.15.111:0/2518865971 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f386413ed30 0x7f386414e260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:57.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.921+0000 7f3868c03700 1 --2- 172.21.15.111:0/2518865971 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f38640a22a0 0x7f38640aaab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:57.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.921+0000 7f3868c03700 1 --2- 172.21.15.111:0/2518865971 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f38640a3410 0x7f386414dd20 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:57.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.921+0000 7f3868c03700 1 -- 172.21.15.111:0/2518865971 >> 172.21.15.111:0/2518865971 conn(0x7f38640b1cf0 msgr2=0x7f386406deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:57.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.921+0000 7f3868c03700 1 -- 172.21.15.111:0/2518865971 shutdown_connections 2024-04-25T02:22:57.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:57.921+0000 7f3868c03700 1 -- 172.21.15.111:0/2518865971 wait complete. 2024-04-25T02:22:57.929 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2024-04-25T02:22:57.935 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-04-25T02:22:57.730212+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":8511,"num_objects":42,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":114,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":28,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":98,"ondisk_log_size":98,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":4195120,"kb_used_data":784,"kb_used_omap":0,"kb_used_meta":4194304,"kb_avail":373292240,"statfs":{"total":386547056640,"available":382251253760,"internally_reserved":4294967296,"allocated":802816,"data_stored":248508,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":4294967296},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"2.004124"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.803299+0000","last_change":"2024-04-25T02:20:24.195706+0000","last_active":"2024-04-25T02:20:36.803299+0000","last_peered":"2024-04-25T02:20:36.803299+0000","last_clean":"2024-04-25T02:20:36.803299+0000","last_became_active":"2024-04-25T02:20:24.195349+0000","last_became_peered":"2024-04-25T02:20:24.195349+0000","last_unstale":"2024-04-25T02:20:36.803299+0000","last_undegraded":"2024-04-25T02:20:36.803299+0000","last_fullsized":"2024-04-25T02:20:36.803299+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.803415+0000","last_change":"2024-04-25T02:20:24.170636+0000","last_active":"2024-04-25T02:20:36.803415+0000","last_peered":"2024-04-25T02:20:36.803415+0000","last_clean":"2024-04-25T02:20:36.803415+0000","last_became_active":"2024-04-25T02:20:24.170426+0000","last_became_peered":"2024-04-25T02:20:24.170426+0000","last_unstale":"2024-04-25T02:20:36.803415+0000","last_undegraded":"2024-04-25T02:20:36.803415+0000","last_fullsized":"2024-04-25T02:20:36.803415+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.167886+0000","last_change":"2024-04-25T02:20:24.190781+0000","last_active":"2024-04-25T02:20:25.167886+0000","last_peered":"2024-04-25T02:20:25.167886+0000","last_clean":"2024-04-25T02:20:25.167886+0000","last_became_active":"2024-04-25T02:20:24.190114+0000","last_became_peered":"2024-04-25T02:20:24.190114+0000","last_unstale":"2024-04-25T02:20:25.167886+0000","last_undegraded":"2024-04-25T02:20:25.167886+0000","last_fullsized":"2024-04-25T02:20:25.167886+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.167257+0000","last_change":"2024-04-25T02:20:24.192016+0000","last_active":"2024-04-25T02:20:25.167257+0000","last_peered":"2024-04-25T02:20:25.167257+0000","last_clean":"2024-04-25T02:20:25.167257+0000","last_became_active":"2024-04-25T02:20:24.191694+0000","last_became_peered":"2024-04-25T02:20:24.191694+0000","last_unstale":"2024-04-25T02:20:25.167257+0000","last_undegraded":"2024-04-25T02:20:25.167257+0000","last_fullsized":"2024-04-25T02:20:25.167257+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.166678+0000","last_change":"2024-04-25T02:20:24.195316+0000","last_active":"2024-04-25T02:20:25.166678+0000","last_peered":"2024-04-25T02:20:25.166678+0000","last_clean":"2024-04-25T02:20:25.166678+0000","last_became_active":"2024-04-25T02:20:24.194996+0000","last_became_peered":"2024-04-25T02:20:24.194996+0000","last_unstale":"2024-04-25T02:20:25.166678+0000","last_undegraded":"2024-04-25T02:20:25.166678+0000","last_fullsized":"2024-04-25T02:20:25.166678+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.263478+0000","last_change":"2024-04-25T02:20:24.188215+0000","last_active":"2024-04-25T02:20:36.263478+0000","last_peered":"2024-04-25T02:20:36.263478+0000","last_clean":"2024-04-25T02:20:36.263478+0000","last_became_active":"2024-04-25T02:20:24.186345+0000","last_became_peered":"2024-04-25T02:20:24.186345+0000","last_unstale":"2024-04-25T02:20:36.263478+0000","last_undegraded":"2024-04-25T02:20:36.263478+0000","last_fullsized":"2024-04-25T02:20:36.263478+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.262015+0000","last_change":"2024-04-25T02:20:24.186090+0000","last_active":"2024-04-25T02:20:36.262015+0000","last_peered":"2024-04-25T02:20:36.262015+0000","last_clean":"2024-04-25T02:20:36.262015+0000","last_became_active":"2024-04-25T02:20:24.185481+0000","last_became_peered":"2024-04-25T02:20:24.185481+0000","last_unstale":"2024-04-25T02:20:36.262015+0000","last_undegraded":"2024-04-25T02:20:36.262015+0000","last_fullsized":"2024-04-25T02:20:36.262015+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.801290+0000","last_change":"2024-04-25T02:20:24.176292+0000","last_active":"2024-04-25T02:20:36.801290+0000","last_peered":"2024-04-25T02:20:36.801290+0000","last_clean":"2024-04-25T02:20:36.801290+0000","last_became_active":"2024-04-25T02:20:24.175187+0000","last_became_peered":"2024-04-25T02:20:24.175187+0000","last_unstale":"2024-04-25T02:20:36.801290+0000","last_undegraded":"2024-04-25T02:20:36.801290+0000","last_fullsized":"2024-04-25T02:20:36.801290+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.165933+0000","last_change":"2024-04-25T02:20:24.192327+0000","last_active":"2024-04-25T02:20:25.165933+0000","last_peered":"2024-04-25T02:20:25.165933+0000","last_clean":"2024-04-25T02:20:25.165933+0000","last_became_active":"2024-04-25T02:20:24.191616+0000","last_became_peered":"2024-04-25T02:20:24.191616+0000","last_unstale":"2024-04-25T02:20:25.165933+0000","last_undegraded":"2024-04-25T02:20:25.165933+0000","last_fullsized":"2024-04-25T02:20:25.165933+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.801993+0000","last_change":"2024-04-25T02:20:24.178072+0000","last_active":"2024-04-25T02:20:36.801993+0000","last_peered":"2024-04-25T02:20:36.801993+0000","last_clean":"2024-04-25T02:20:36.801993+0000","last_became_active":"2024-04-25T02:20:24.177766+0000","last_became_peered":"2024-04-25T02:20:24.177766+0000","last_unstale":"2024-04-25T02:20:36.801993+0000","last_undegraded":"2024-04-25T02:20:36.801993+0000","last_fullsized":"2024-04-25T02:20:36.801993+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.802552+0000","last_change":"2024-04-25T02:20:24.179040+0000","last_active":"2024-04-25T02:20:36.802552+0000","last_peered":"2024-04-25T02:20:36.802552+0000","last_clean":"2024-04-25T02:20:36.802552+0000","last_became_active":"2024-04-25T02:20:24.178732+0000","last_became_peered":"2024-04-25T02:20:24.178732+0000","last_unstale":"2024-04-25T02:20:36.802552+0000","last_undegraded":"2024-04-25T02:20:36.802552+0000","last_fullsized":"2024-04-25T02:20:36.802552+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.803008+0000","last_change":"2024-04-25T02:20:24.195853+0000","last_active":"2024-04-25T02:20:36.803008+0000","last_peered":"2024-04-25T02:20:36.803008+0000","last_clean":"2024-04-25T02:20:36.803008+0000","last_became_active":"2024-04-25T02:20:24.195544+0000","last_became_peered":"2024-04-25T02:20:24.195544+0000","last_unstale":"2024-04-25T02:20:36.803008+0000","last_undegraded":"2024-04-25T02:20:36.803008+0000","last_fullsized":"2024-04-25T02:20:36.803008+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.802385+0000","last_change":"2024-04-25T02:20:24.196840+0000","last_active":"2024-04-25T02:20:36.802385+0000","last_peered":"2024-04-25T02:20:36.802385+0000","last_clean":"2024-04-25T02:20:36.802385+0000","last_became_active":"2024-04-25T02:20:24.196155+0000","last_became_peered":"2024-04-25T02:20:24.196155+0000","last_unstale":"2024-04-25T02:20:36.802385+0000","last_undegraded":"2024-04-25T02:20:36.802385+0000","last_fullsized":"2024-04-25T02:20:36.802385+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.801766+0000","last_change":"2024-04-25T02:20:24.171853+0000","last_active":"2024-04-25T02:20:36.801766+0000","last_peered":"2024-04-25T02:20:36.801766+0000","last_clean":"2024-04-25T02:20:36.801766+0000","last_became_active":"2024-04-25T02:20:24.171522+0000","last_became_peered":"2024-04-25T02:20:24.171522+0000","last_unstale":"2024-04-25T02:20:36.801766+0000","last_undegraded":"2024-04-25T02:20:36.801766+0000","last_fullsized":"2024-04-25T02:20:36.801766+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.165430+0000","last_change":"2024-04-25T02:20:24.185905+0000","last_active":"2024-04-25T02:20:25.165430+0000","last_peered":"2024-04-25T02:20:25.165430+0000","last_clean":"2024-04-25T02:20:25.165430+0000","last_became_active":"2024-04-25T02:20:24.185440+0000","last_became_peered":"2024-04-25T02:20:24.185440+0000","last_unstale":"2024-04-25T02:20:25.165430+0000","last_undegraded":"2024-04-25T02:20:25.165430+0000","last_fullsized":"2024-04-25T02:20:25.165430+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.261428+0000","last_change":"2024-04-25T02:20:24.183619+0000","last_active":"2024-04-25T02:20:36.261428+0000","last_peered":"2024-04-25T02:20:36.261428+0000","last_clean":"2024-04-25T02:20:36.261428+0000","last_became_active":"2024-04-25T02:20:24.183299+0000","last_became_peered":"2024-04-25T02:20:24.183299+0000","last_unstale":"2024-04-25T02:20:36.261428+0000","last_undegraded":"2024-04-25T02:20:36.261428+0000","last_fullsized":"2024-04-25T02:20:36.261428+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.165837+0000","last_change":"2024-04-25T02:20:24.194408+0000","last_active":"2024-04-25T02:20:25.165837+0000","last_peered":"2024-04-25T02:20:25.165837+0000","last_clean":"2024-04-25T02:20:25.165837+0000","last_became_active":"2024-04-25T02:20:24.192031+0000","last_became_peered":"2024-04-25T02:20:24.192031+0000","last_unstale":"2024-04-25T02:20:25.165837+0000","last_undegraded":"2024-04-25T02:20:25.165837+0000","last_fullsized":"2024-04-25T02:20:25.165837+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.165398+0000","last_change":"2024-04-25T02:20:24.175814+0000","last_active":"2024-04-25T02:20:25.165398+0000","last_peered":"2024-04-25T02:20:25.165398+0000","last_clean":"2024-04-25T02:20:25.165398+0000","last_became_active":"2024-04-25T02:20:24.174411+0000","last_became_peered":"2024-04-25T02:20:24.174411+0000","last_unstale":"2024-04-25T02:20:25.165398+0000","last_undegraded":"2024-04-25T02:20:25.165398+0000","last_fullsized":"2024-04-25T02:20:25.165398+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.801260+0000","last_change":"2024-04-25T02:20:24.195764+0000","last_active":"2024-04-25T02:20:36.801260+0000","last_peered":"2024-04-25T02:20:36.801260+0000","last_clean":"2024-04-25T02:20:36.801260+0000","last_became_active":"2024-04-25T02:20:24.195463+0000","last_became_peered":"2024-04-25T02:20:24.195463+0000","last_unstale":"2024-04-25T02:20:36.801260+0000","last_undegraded":"2024-04-25T02:20:36.801260+0000","last_fullsized":"2024-04-25T02:20:36.801260+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.802443+0000","last_change":"2024-04-25T02:20:24.200557+0000","last_active":"2024-04-25T02:20:36.802443+0000","last_peered":"2024-04-25T02:20:36.802443+0000","last_clean":"2024-04-25T02:20:36.802443+0000","last_became_active":"2024-04-25T02:20:24.200289+0000","last_became_peered":"2024-04-25T02:20:24.200289+0000","last_unstale":"2024-04-25T02:20:36.802443+0000","last_undegraded":"2024-04-25T02:20:36.802443+0000","last_fullsized":"2024-04-25T02:20:36.802443+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.801739+0000","last_change":"2024-04-25T02:20:24.185144+0000","last_active":"2024-04-25T02:20:36.801739+0000","last_peered":"2024-04-25T02:20:36.801739+0000","last_clean":"2024-04-25T02:20:36.801739+0000","last_became_active":"2024-04-25T02:20:24.184668+0000","last_became_peered":"2024-04-25T02:20:24.184668+0000","last_unstale":"2024-04-25T02:20:36.801739+0000","last_undegraded":"2024-04-25T02:20:36.801739+0000","last_fullsized":"2024-04-25T02:20:36.801739+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.166200+0000","last_change":"2024-04-25T02:20:24.185079+0000","last_active":"2024-04-25T02:20:25.166200+0000","last_peered":"2024-04-25T02:20:25.166200+0000","last_clean":"2024-04-25T02:20:25.166200+0000","last_became_active":"2024-04-25T02:20:24.184748+0000","last_became_peered":"2024-04-25T02:20:24.184748+0000","last_unstale":"2024-04-25T02:20:25.166200+0000","last_undegraded":"2024-04-25T02:20:25.166200+0000","last_fullsized":"2024-04-25T02:20:25.166200+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.261970+0000","last_change":"2024-04-25T02:20:24.185898+0000","last_active":"2024-04-25T02:20:36.261970+0000","last_peered":"2024-04-25T02:20:36.261970+0000","last_clean":"2024-04-25T02:20:36.261970+0000","last_became_active":"2024-04-25T02:20:24.185153+0000","last_became_peered":"2024-04-25T02:20:24.185153+0000","last_unstale":"2024-04-25T02:20:36.261970+0000","last_undegraded":"2024-04-25T02:20:36.261970+0000","last_fullsized":"2024-04-25T02:20:36.261970+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.801331+0000","last_change":"2024-04-25T02:20:24.183879+0000","last_active":"2024-04-25T02:20:36.801331+0000","last_peered":"2024-04-25T02:20:36.801331+0000","last_clean":"2024-04-25T02:20:36.801331+0000","last_became_active":"2024-04-25T02:20:24.183565+0000","last_became_peered":"2024-04-25T02:20:24.183565+0000","last_unstale":"2024-04-25T02:20:36.801331+0000","last_undegraded":"2024-04-25T02:20:36.801331+0000","last_fullsized":"2024-04-25T02:20:36.801331+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.802042+0000","last_change":"2024-04-25T02:20:24.186601+0000","last_active":"2024-04-25T02:20:36.802042+0000","last_peered":"2024-04-25T02:20:36.802042+0000","last_clean":"2024-04-25T02:20:36.802042+0000","last_became_active":"2024-04-25T02:20:24.184553+0000","last_became_peered":"2024-04-25T02:20:24.184553+0000","last_unstale":"2024-04-25T02:20:36.802042+0000","last_undegraded":"2024-04-25T02:20:36.802042+0000","last_fullsized":"2024-04-25T02:20:36.802042+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.801932+0000","last_change":"2024-04-25T02:20:24.167579+0000","last_active":"2024-04-25T02:20:36.801932+0000","last_peered":"2024-04-25T02:20:36.801932+0000","last_clean":"2024-04-25T02:20:36.801932+0000","last_became_active":"2024-04-25T02:20:24.167170+0000","last_became_peered":"2024-04-25T02:20:24.167170+0000","last_unstale":"2024-04-25T02:20:36.801932+0000","last_undegraded":"2024-04-25T02:20:36.801932+0000","last_fullsized":"2024-04-25T02:20:36.801932+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.262888+0000","last_change":"2024-04-25T02:20:24.189023+0000","last_active":"2024-04-25T02:20:36.262888+0000","last_peered":"2024-04-25T02:20:36.262888+0000","last_clean":"2024-04-25T02:20:36.262888+0000","last_became_active":"2024-04-25T02:20:24.188203+0000","last_became_peered":"2024-04-25T02:20:24.188203+0000","last_unstale":"2024-04-25T02:20:36.262888+0000","last_undegraded":"2024-04-25T02:20:36.262888+0000","last_fullsized":"2024-04-25T02:20:36.262888+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"17'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.801329+0000","last_change":"2024-04-25T02:20:23.878198+0000","last_active":"2024-04-25T02:20:36.801329+0000","last_peered":"2024-04-25T02:20:36.801329+0000","last_clean":"2024-04-25T02:20:36.801329+0000","last_became_active":"2024-04-25T02:20:23.877819+0000","last_became_peered":"2024-04-25T02:20:23.877819+0000","last_unstale":"2024-04-25T02:20:36.801329+0000","last_undegraded":"2024-04-25T02:20:36.801329+0000","last_fullsized":"2024-04-25T02:20:36.801329+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.262973+0000","last_change":"2024-04-25T02:20:24.191107+0000","last_active":"2024-04-25T02:20:36.262973+0000","last_peered":"2024-04-25T02:20:36.262973+0000","last_clean":"2024-04-25T02:20:36.262973+0000","last_became_active":"2024-04-25T02:20:24.190019+0000","last_became_peered":"2024-04-25T02:20:24.190019+0000","last_unstale":"2024-04-25T02:20:36.262973+0000","last_undegraded":"2024-04-25T02:20:36.262973+0000","last_fullsized":"2024-04-25T02:20:36.262973+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.801338+0000","last_change":"2024-04-25T02:20:23.879347+0000","last_active":"2024-04-25T02:20:36.801338+0000","last_peered":"2024-04-25T02:20:36.801338+0000","last_clean":"2024-04-25T02:20:36.801338+0000","last_became_active":"2024-04-25T02:20:23.879065+0000","last_became_peered":"2024-04-25T02:20:23.879065+0000","last_unstale":"2024-04-25T02:20:36.801338+0000","last_undegraded":"2024-04-25T02:20:36.801338+0000","last_fullsized":"2024-04-25T02:20:36.801338+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.165577+0000","last_change":"2024-04-25T02:20:24.190744+0000","last_active":"2024-04-25T02:20:25.165577+0000","last_peered":"2024-04-25T02:20:25.165577+0000","last_clean":"2024-04-25T02:20:25.165577+0000","last_became_active":"2024-04-25T02:20:24.190410+0000","last_became_peered":"2024-04-25T02:20:24.190410+0000","last_unstale":"2024-04-25T02:20:25.165577+0000","last_undegraded":"2024-04-25T02:20:25.165577+0000","last_fullsized":"2024-04-25T02:20:25.165577+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.261726+0000","last_change":"2024-04-25T02:20:23.890094+0000","last_active":"2024-04-25T02:20:36.261726+0000","last_peered":"2024-04-25T02:20:36.261726+0000","last_clean":"2024-04-25T02:20:36.261726+0000","last_became_active":"2024-04-25T02:20:23.889715+0000","last_became_peered":"2024-04-25T02:20:23.889715+0000","last_unstale":"2024-04-25T02:20:36.261726+0000","last_undegraded":"2024-04-25T02:20:36.261726+0000","last_fullsized":"2024-04-25T02:20:36.261726+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.263969+0000","last_change":"2024-04-25T02:20:24.196642+0000","last_active":"2024-04-25T02:20:36.263969+0000","last_peered":"2024-04-25T02:20:36.263969+0000","last_clean":"2024-04-25T02:20:36.263969+0000","last_became_active":"2024-04-25T02:20:24.196137+0000","last_became_peered":"2024-04-25T02:20:24.196137+0000","last_unstale":"2024-04-25T02:20:36.263969+0000","last_undegraded":"2024-04-25T02:20:36.263969+0000","last_fullsized":"2024-04-25T02:20:36.263969+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"19'7","reported_seq":18,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:21:05.598766+0000","last_change":"2024-04-25T02:20:23.877498+0000","last_active":"2024-04-25T02:21:05.598766+0000","last_peered":"2024-04-25T02:21:05.598766+0000","last_clean":"2024-04-25T02:21:05.598766+0000","last_became_active":"2024-04-25T02:20:23.876803+0000","last_became_peered":"2024-04-25T02:20:23.876803+0000","last_unstale":"2024-04-25T02:21:05.598766+0000","last_undegraded":"2024-04-25T02:21:05.598766+0000","last_fullsized":"2024-04-25T02:21:05.598766+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.261760+0000","last_change":"2024-04-25T02:20:24.192558+0000","last_active":"2024-04-25T02:20:36.261760+0000","last_peered":"2024-04-25T02:20:36.261760+0000","last_clean":"2024-04-25T02:20:36.261760+0000","last_became_active":"2024-04-25T02:20:24.191880+0000","last_became_peered":"2024-04-25T02:20:24.191880+0000","last_unstale":"2024-04-25T02:20:36.261760+0000","last_undegraded":"2024-04-25T02:20:36.261760+0000","last_fullsized":"2024-04-25T02:20:36.261760+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.803310+0000","last_change":"2024-04-25T02:20:23.885888+0000","last_active":"2024-04-25T02:20:36.803310+0000","last_peered":"2024-04-25T02:20:36.803310+0000","last_clean":"2024-04-25T02:20:36.803310+0000","last_became_active":"2024-04-25T02:20:23.885589+0000","last_became_peered":"2024-04-25T02:20:23.885589+0000","last_unstale":"2024-04-25T02:20:36.803310+0000","last_undegraded":"2024-04-25T02:20:36.803310+0000","last_fullsized":"2024-04-25T02:20:36.803310+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.262231+0000","last_change":"2024-04-25T02:20:24.198607+0000","last_active":"2024-04-25T02:20:36.262231+0000","last_peered":"2024-04-25T02:20:36.262231+0000","last_clean":"2024-04-25T02:20:36.262231+0000","last_became_active":"2024-04-25T02:20:24.196892+0000","last_became_peered":"2024-04-25T02:20:24.196892+0000","last_unstale":"2024-04-25T02:20:36.262231+0000","last_undegraded":"2024-04-25T02:20:36.262231+0000","last_fullsized":"2024-04-25T02:20:36.262231+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"18'4","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.248322+0000","last_change":"2024-04-25T02:20:23.883408+0000","last_active":"2024-04-25T02:20:26.248322+0000","last_peered":"2024-04-25T02:20:26.248322+0000","last_clean":"2024-04-25T02:20:26.248322+0000","last_became_active":"2024-04-25T02:20:23.882488+0000","last_became_peered":"2024-04-25T02:20:23.882488+0000","last_unstale":"2024-04-25T02:20:26.248322+0000","last_undegraded":"2024-04-25T02:20:26.248322+0000","last_fullsized":"2024-04-25T02:20:26.248322+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.801657+0000","last_change":"2024-04-25T02:20:24.180953+0000","last_active":"2024-04-25T02:20:36.801657+0000","last_peered":"2024-04-25T02:20:36.801657+0000","last_clean":"2024-04-25T02:20:36.801657+0000","last_became_active":"2024-04-25T02:20:24.180646+0000","last_became_peered":"2024-04-25T02:20:24.180646+0000","last_unstale":"2024-04-25T02:20:36.801657+0000","last_undegraded":"2024-04-25T02:20:36.801657+0000","last_fullsized":"2024-04-25T02:20:36.801657+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"20'16","reported_seq":28,"reported_epoch":20,"state":"active+clean","last_fresh":"2024-04-25T02:22:54.785519+0000","last_change":"2024-04-25T02:20:23.890383+0000","last_active":"2024-04-25T02:22:54.785519+0000","last_peered":"2024-04-25T02:22:54.785519+0000","last_clean":"2024-04-25T02:22:54.785519+0000","last_became_active":"2024-04-25T02:20:23.890015+0000","last_became_peered":"2024-04-25T02:20:23.890015+0000","last_unstale":"2024-04-25T02:22:54.785519+0000","last_undegraded":"2024-04-25T02:22:54.785519+0000","last_fullsized":"2024-04-25T02:22:54.785519+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4743,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":11,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.802572+0000","last_change":"2024-04-25T02:20:24.186645+0000","last_active":"2024-04-25T02:20:36.802572+0000","last_peered":"2024-04-25T02:20:36.802572+0000","last_clean":"2024-04-25T02:20:36.802572+0000","last_became_active":"2024-04-25T02:20:24.186336+0000","last_became_peered":"2024-04-25T02:20:24.186336+0000","last_unstale":"2024-04-25T02:20:36.802572+0000","last_undegraded":"2024-04-25T02:20:36.802572+0000","last_fullsized":"2024-04-25T02:20:36.802572+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.262732+0000","last_change":"2024-04-25T02:20:23.882583+0000","last_active":"2024-04-25T02:20:36.262732+0000","last_peered":"2024-04-25T02:20:36.262732+0000","last_clean":"2024-04-25T02:20:36.262732+0000","last_became_active":"2024-04-25T02:20:23.882254+0000","last_became_peered":"2024-04-25T02:20:23.882254+0000","last_unstale":"2024-04-25T02:20:36.262732+0000","last_undegraded":"2024-04-25T02:20:36.262732+0000","last_fullsized":"2024-04-25T02:20:36.262732+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.262519+0000","last_change":"2024-04-25T02:20:24.191415+0000","last_active":"2024-04-25T02:20:36.262519+0000","last_peered":"2024-04-25T02:20:36.262519+0000","last_clean":"2024-04-25T02:20:36.262519+0000","last_became_active":"2024-04-25T02:20:24.191024+0000","last_became_peered":"2024-04-25T02:20:24.191024+0000","last_unstale":"2024-04-25T02:20:36.262519+0000","last_undegraded":"2024-04-25T02:20:36.262519+0000","last_fullsized":"2024-04-25T02:20:36.262519+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"18'3","reported_seq":14,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.248691+0000","last_change":"2024-04-25T02:20:23.881482+0000","last_active":"2024-04-25T02:20:26.248691+0000","last_peered":"2024-04-25T02:20:26.248691+0000","last_clean":"2024-04-25T02:20:26.248691+0000","last_became_active":"2024-04-25T02:20:23.881128+0000","last_became_peered":"2024-04-25T02:20:23.881128+0000","last_unstale":"2024-04-25T02:20:26.248691+0000","last_undegraded":"2024-04-25T02:20:26.248691+0000","last_fullsized":"2024-04-25T02:20:26.248691+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.263056+0000","last_change":"2024-04-25T02:20:24.197800+0000","last_active":"2024-04-25T02:20:36.263056+0000","last_peered":"2024-04-25T02:20:36.263056+0000","last_clean":"2024-04-25T02:20:36.263056+0000","last_became_active":"2024-04-25T02:20:24.188621+0000","last_became_peered":"2024-04-25T02:20:24.188621+0000","last_unstale":"2024-04-25T02:20:36.263056+0000","last_undegraded":"2024-04-25T02:20:36.263056+0000","last_fullsized":"2024-04-25T02:20:36.263056+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.262184+0000","last_change":"2024-04-25T02:20:23.890803+0000","last_active":"2024-04-25T02:20:36.262184+0000","last_peered":"2024-04-25T02:20:36.262184+0000","last_clean":"2024-04-25T02:20:36.262184+0000","last_became_active":"2024-04-25T02:20:23.890114+0000","last_became_peered":"2024-04-25T02:20:23.890114+0000","last_unstale":"2024-04-25T02:20:36.262184+0000","last_undegraded":"2024-04-25T02:20:36.262184+0000","last_fullsized":"2024-04-25T02:20:36.262184+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.165684+0000","last_change":"2024-04-25T02:20:24.186816+0000","last_active":"2024-04-25T02:20:25.165684+0000","last_peered":"2024-04-25T02:20:25.165684+0000","last_clean":"2024-04-25T02:20:25.165684+0000","last_became_active":"2024-04-25T02:20:24.185644+0000","last_became_peered":"2024-04-25T02:20:24.185644+0000","last_unstale":"2024-04-25T02:20:25.165684+0000","last_undegraded":"2024-04-25T02:20:25.165684+0000","last_fullsized":"2024-04-25T02:20:25.165684+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'10","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.801534+0000","last_change":"2024-04-25T02:20:23.873213+0000","last_active":"2024-04-25T02:20:36.801534+0000","last_peered":"2024-04-25T02:20:36.801534+0000","last_clean":"2024-04-25T02:20:36.801534+0000","last_became_active":"2024-04-25T02:20:23.872886+0000","last_became_peered":"2024-04-25T02:20:23.872886+0000","last_unstale":"2024-04-25T02:20:36.801534+0000","last_undegraded":"2024-04-25T02:20:36.801534+0000","last_fullsized":"2024-04-25T02:20:36.801534+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.263920+0000","last_change":"2024-04-25T02:20:24.196436+0000","last_active":"2024-04-25T02:20:36.263920+0000","last_peered":"2024-04-25T02:20:36.263920+0000","last_clean":"2024-04-25T02:20:36.263920+0000","last_became_active":"2024-04-25T02:20:24.195763+0000","last_became_peered":"2024-04-25T02:20:24.195763+0000","last_unstale":"2024-04-25T02:20:36.263920+0000","last_undegraded":"2024-04-25T02:20:36.263920+0000","last_fullsized":"2024-04-25T02:20:36.263920+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.165519+0000","last_change":"2024-04-25T02:20:23.872612+0000","last_active":"2024-04-25T02:20:25.165519+0000","last_peered":"2024-04-25T02:20:25.165519+0000","last_clean":"2024-04-25T02:20:25.165519+0000","last_became_active":"2024-04-25T02:20:23.872266+0000","last_became_peered":"2024-04-25T02:20:23.872266+0000","last_unstale":"2024-04-25T02:20:25.165519+0000","last_undegraded":"2024-04-25T02:20:25.165519+0000","last_fullsized":"2024-04-25T02:20:25.165519+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.261826+0000","last_change":"2024-04-25T02:20:24.194953+0000","last_active":"2024-04-25T02:20:36.261826+0000","last_peered":"2024-04-25T02:20:36.261826+0000","last_clean":"2024-04-25T02:20:36.261826+0000","last_became_active":"2024-04-25T02:20:24.194637+0000","last_became_peered":"2024-04-25T02:20:24.194637+0000","last_unstale":"2024-04-25T02:20:36.261826+0000","last_undegraded":"2024-04-25T02:20:36.261826+0000","last_fullsized":"2024-04-25T02:20:36.261826+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.803311+0000","last_change":"2024-04-25T02:20:23.876382+0000","last_active":"2024-04-25T02:20:36.803311+0000","last_peered":"2024-04-25T02:20:36.803311+0000","last_clean":"2024-04-25T02:20:36.803311+0000","last_became_active":"2024-04-25T02:20:23.875806+0000","last_became_peered":"2024-04-25T02:20:23.875806+0000","last_unstale":"2024-04-25T02:20:36.803311+0000","last_undegraded":"2024-04-25T02:20:36.803311+0000","last_fullsized":"2024-04-25T02:20:36.803311+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.801439+0000","last_change":"2024-04-25T02:20:24.190109+0000","last_active":"2024-04-25T02:20:36.801439+0000","last_peered":"2024-04-25T02:20:36.801439+0000","last_clean":"2024-04-25T02:20:36.801439+0000","last_became_active":"2024-04-25T02:20:24.189801+0000","last_became_peered":"2024-04-25T02:20:24.189801+0000","last_unstale":"2024-04-25T02:20:36.801439+0000","last_undegraded":"2024-04-25T02:20:36.801439+0000","last_fullsized":"2024-04-25T02:20:36.801439+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.263231+0000","last_change":"2024-04-25T02:20:23.885537+0000","last_active":"2024-04-25T02:20:36.263231+0000","last_peered":"2024-04-25T02:20:36.263231+0000","last_clean":"2024-04-25T02:20:36.263231+0000","last_became_active":"2024-04-25T02:20:23.885190+0000","last_became_peered":"2024-04-25T02:20:23.885190+0000","last_unstale":"2024-04-25T02:20:36.263231+0000","last_undegraded":"2024-04-25T02:20:36.263231+0000","last_fullsized":"2024-04-25T02:20:36.263231+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.802124+0000","last_change":"2024-04-25T02:20:24.188326+0000","last_active":"2024-04-25T02:20:36.802124+0000","last_peered":"2024-04-25T02:20:36.802124+0000","last_clean":"2024-04-25T02:20:36.802124+0000","last_became_active":"2024-04-25T02:20:24.187661+0000","last_became_peered":"2024-04-25T02:20:24.187661+0000","last_unstale":"2024-04-25T02:20:36.802124+0000","last_undegraded":"2024-04-25T02:20:36.802124+0000","last_fullsized":"2024-04-25T02:20:36.802124+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":11,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.167493+0000","last_change":"2024-04-25T02:20:23.877401+0000","last_active":"2024-04-25T02:20:25.167493+0000","last_peered":"2024-04-25T02:20:25.167493+0000","last_clean":"2024-04-25T02:20:25.167493+0000","last_became_active":"2024-04-25T02:20:23.876871+0000","last_became_peered":"2024-04-25T02:20:23.876871+0000","last_unstale":"2024-04-25T02:20:25.167493+0000","last_undegraded":"2024-04-25T02:20:25.167493+0000","last_fullsized":"2024-04-25T02:20:25.167493+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.167058+0000","last_change":"2024-04-25T02:20:24.185293+0000","last_active":"2024-04-25T02:20:25.167058+0000","last_peered":"2024-04-25T02:20:25.167058+0000","last_clean":"2024-04-25T02:20:25.167058+0000","last_became_active":"2024-04-25T02:20:24.184978+0000","last_became_peered":"2024-04-25T02:20:24.184978+0000","last_unstale":"2024-04-25T02:20:25.167058+0000","last_undegraded":"2024-04-25T02:20:25.167058+0000","last_fullsized":"2024-04-25T02:20:25.167058+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"18'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.262556+0000","last_change":"2024-04-25T02:20:23.886478+0000","last_active":"2024-04-25T02:20:36.262556+0000","last_peered":"2024-04-25T02:20:36.262556+0000","last_clean":"2024-04-25T02:20:36.262556+0000","last_became_active":"2024-04-25T02:20:23.886157+0000","last_became_peered":"2024-04-25T02:20:23.886157+0000","last_unstale":"2024-04-25T02:20:36.262556+0000","last_undegraded":"2024-04-25T02:20:36.262556+0000","last_fullsized":"2024-04-25T02:20:36.262556+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.167412+0000","last_change":"2024-04-25T02:20:24.199344+0000","last_active":"2024-04-25T02:20:25.167412+0000","last_peered":"2024-04-25T02:20:25.167412+0000","last_clean":"2024-04-25T02:20:25.167412+0000","last_became_active":"2024-04-25T02:20:24.199010+0000","last_became_peered":"2024-04-25T02:20:24.199010+0000","last_unstale":"2024-04-25T02:20:25.167412+0000","last_undegraded":"2024-04-25T02:20:25.167412+0000","last_fullsized":"2024-04-25T02:20:25.167412+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"19'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:55.598457+0000","last_change":"2024-04-25T02:20:23.884331+0000","last_active":"2024-04-25T02:20:55.598457+0000","last_peered":"2024-04-25T02:20:55.598457+0000","last_clean":"2024-04-25T02:20:55.598457+0000","last_became_active":"2024-04-25T02:20:23.883987+0000","last_became_peered":"2024-04-25T02:20:23.883987+0000","last_unstale":"2024-04-25T02:20:55.598457+0000","last_undegraded":"2024-04-25T02:20:55.598457+0000","last_fullsized":"2024-04-25T02:20:55.598457+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.263141+0000","last_change":"2024-04-25T02:20:24.191297+0000","last_active":"2024-04-25T02:20:36.263141+0000","last_peered":"2024-04-25T02:20:36.263141+0000","last_clean":"2024-04-25T02:20:36.263141+0000","last_became_active":"2024-04-25T02:20:24.190401+0000","last_became_peered":"2024-04-25T02:20:24.190401+0000","last_unstale":"2024-04-25T02:20:36.263141+0000","last_undegraded":"2024-04-25T02:20:36.263141+0000","last_fullsized":"2024-04-25T02:20:36.263141+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"18'3","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.262064+0000","last_change":"2024-04-25T02:20:23.881257+0000","last_active":"2024-04-25T02:20:36.262064+0000","last_peered":"2024-04-25T02:20:36.262064+0000","last_clean":"2024-04-25T02:20:36.262064+0000","last_became_active":"2024-04-25T02:20:23.880935+0000","last_became_peered":"2024-04-25T02:20:23.880935+0000","last_unstale":"2024-04-25T02:20:36.262064+0000","last_undegraded":"2024-04-25T02:20:36.262064+0000","last_fullsized":"2024-04-25T02:20:36.262064+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.803386+0000","last_change":"2024-04-25T02:20:24.189432+0000","last_active":"2024-04-25T02:20:36.803386+0000","last_peered":"2024-04-25T02:20:36.803386+0000","last_clean":"2024-04-25T02:20:36.803386+0000","last_became_active":"2024-04-25T02:20:24.189016+0000","last_became_peered":"2024-04-25T02:20:24.189016+0000","last_unstale":"2024-04-25T02:20:36.803386+0000","last_undegraded":"2024-04-25T02:20:36.803386+0000","last_fullsized":"2024-04-25T02:20:36.803386+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"18'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.261472+0000","last_change":"2024-04-25T02:20:23.885274+0000","last_active":"2024-04-25T02:20:36.261472+0000","last_peered":"2024-04-25T02:20:36.261472+0000","last_clean":"2024-04-25T02:20:36.261472+0000","last_became_active":"2024-04-25T02:20:23.884934+0000","last_became_peered":"2024-04-25T02:20:23.884934+0000","last_unstale":"2024-04-25T02:20:36.261472+0000","last_undegraded":"2024-04-25T02:20:36.261472+0000","last_fullsized":"2024-04-25T02:20:36.261472+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.802132+0000","last_change":"2024-04-25T02:20:24.192355+0000","last_active":"2024-04-25T02:20:36.802132+0000","last_peered":"2024-04-25T02:20:36.802132+0000","last_clean":"2024-04-25T02:20:36.802132+0000","last_became_active":"2024-04-25T02:20:24.191909+0000","last_became_peered":"2024-04-25T02:20:24.191909+0000","last_unstale":"2024-04-25T02:20:36.802132+0000","last_undegraded":"2024-04-25T02:20:36.802132+0000","last_fullsized":"2024-04-25T02:20:36.802132+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.802359+0000","last_change":"2024-04-25T02:20:15.491093+0000","last_active":"2024-04-25T02:20:36.802359+0000","last_peered":"2024-04-25T02:20:36.802359+0000","last_clean":"2024-04-25T02:20:36.802359+0000","last_became_active":"2024-04-25T02:20:15.490770+0000","last_became_peered":"2024-04-25T02:20:15.490770+0000","last_unstale":"2024-04-25T02:20:36.802359+0000","last_undegraded":"2024-04-25T02:20:36.802359+0000","last_fullsized":"2024-04-25T02:20:36.802359+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.803235+0000","last_change":"2024-04-25T02:20:23.885604+0000","last_active":"2024-04-25T02:20:36.803235+0000","last_peered":"2024-04-25T02:20:36.803235+0000","last_clean":"2024-04-25T02:20:36.803235+0000","last_became_active":"2024-04-25T02:20:23.885298+0000","last_became_peered":"2024-04-25T02:20:23.885298+0000","last_unstale":"2024-04-25T02:20:36.803235+0000","last_undegraded":"2024-04-25T02:20:36.803235+0000","last_fullsized":"2024-04-25T02:20:36.803235+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.801646+0000","last_change":"2024-04-25T02:20:24.189688+0000","last_active":"2024-04-25T02:20:36.801646+0000","last_peered":"2024-04-25T02:20:36.801646+0000","last_clean":"2024-04-25T02:20:36.801646+0000","last_became_active":"2024-04-25T02:20:24.189417+0000","last_became_peered":"2024-04-25T02:20:24.189417+0000","last_unstale":"2024-04-25T02:20:36.801646+0000","last_undegraded":"2024-04-25T02:20:36.801646+0000","last_fullsized":"2024-04-25T02:20:36.801646+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.263576+0000","last_change":"2024-04-25T02:20:15.489991+0000","last_active":"2024-04-25T02:20:36.263576+0000","last_peered":"2024-04-25T02:20:36.263576+0000","last_clean":"2024-04-25T02:20:36.263576+0000","last_became_active":"2024-04-25T02:20:15.489641+0000","last_became_peered":"2024-04-25T02:20:15.489641+0000","last_unstale":"2024-04-25T02:20:36.263576+0000","last_undegraded":"2024-04-25T02:20:36.263576+0000","last_fullsized":"2024-04-25T02:20:36.263576+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"19'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.261952+0000","last_change":"2024-04-25T02:20:23.875583+0000","last_active":"2024-04-25T02:20:36.261952+0000","last_peered":"2024-04-25T02:20:36.261952+0000","last_clean":"2024-04-25T02:20:36.261952+0000","last_became_active":"2024-04-25T02:20:23.875234+0000","last_became_peered":"2024-04-25T02:20:23.875234+0000","last_unstale":"2024-04-25T02:20:36.261952+0000","last_undegraded":"2024-04-25T02:20:36.261952+0000","last_fullsized":"2024-04-25T02:20:36.261952+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.802085+0000","last_change":"2024-04-25T02:20:24.172708+0000","last_active":"2024-04-25T02:20:36.802085+0000","last_peered":"2024-04-25T02:20:36.802085+0000","last_clean":"2024-04-25T02:20:36.802085+0000","last_became_active":"2024-04-25T02:20:24.172138+0000","last_became_peered":"2024-04-25T02:20:24.172138+0000","last_unstale":"2024-04-25T02:20:36.802085+0000","last_undegraded":"2024-04-25T02:20:36.802085+0000","last_fullsized":"2024-04-25T02:20:36.802085+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.801575+0000","last_change":"2024-04-25T02:20:15.488908+0000","last_active":"2024-04-25T02:20:36.801575+0000","last_peered":"2024-04-25T02:20:36.801575+0000","last_clean":"2024-04-25T02:20:36.801575+0000","last_became_active":"2024-04-25T02:20:15.488569+0000","last_became_peered":"2024-04-25T02:20:15.488569+0000","last_unstale":"2024-04-25T02:20:36.801575+0000","last_undegraded":"2024-04-25T02:20:36.801575+0000","last_fullsized":"2024-04-25T02:20:36.801575+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"18'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.801466+0000","last_change":"2024-04-25T02:20:23.872080+0000","last_active":"2024-04-25T02:20:36.801466+0000","last_peered":"2024-04-25T02:20:36.801466+0000","last_clean":"2024-04-25T02:20:36.801466+0000","last_became_active":"2024-04-25T02:20:23.871751+0000","last_became_peered":"2024-04-25T02:20:23.871751+0000","last_unstale":"2024-04-25T02:20:36.801466+0000","last_undegraded":"2024-04-25T02:20:36.801466+0000","last_fullsized":"2024-04-25T02:20:36.801466+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.802162+0000","last_change":"2024-04-25T02:20:24.174377+0000","last_active":"2024-04-25T02:20:36.802162+0000","last_peered":"2024-04-25T02:20:36.802162+0000","last_clean":"2024-04-25T02:20:36.802162+0000","last_became_active":"2024-04-25T02:20:24.174100+0000","last_became_peered":"2024-04-25T02:20:24.174100+0000","last_unstale":"2024-04-25T02:20:36.802162+0000","last_undegraded":"2024-04-25T02:20:36.802162+0000","last_fullsized":"2024-04-25T02:20:36.802162+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.262639+0000","last_change":"2024-04-25T02:20:15.487675+0000","last_active":"2024-04-25T02:20:36.262639+0000","last_peered":"2024-04-25T02:20:36.262639+0000","last_clean":"2024-04-25T02:20:36.262639+0000","last_became_active":"2024-04-25T02:20:15.487331+0000","last_became_peered":"2024-04-25T02:20:15.487331+0000","last_unstale":"2024-04-25T02:20:36.262639+0000","last_undegraded":"2024-04-25T02:20:36.262639+0000","last_fullsized":"2024-04-25T02:20:36.262639+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"10'1","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.801400+0000","last_change":"2024-04-25T02:20:11.467819+0000","last_active":"2024-04-25T02:20:36.801400+0000","last_peered":"2024-04-25T02:20:36.801400+0000","last_clean":"2024-04-25T02:20:36.801400+0000","last_became_active":"2024-04-25T02:20:11.467259+0000","last_became_peered":"2024-04-25T02:20:11.467259+0000","last_unstale":"2024-04-25T02:20:36.801400+0000","last_undegraded":"2024-04-25T02:20:36.801400+0000","last_fullsized":"2024-04-25T02:20:36.801400+0000","mapping_epoch":9,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":10,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:08.432182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:08.432182+0000","last_clean_scrub_stamp":"2024-04-25T02:20:08.432182+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.263326+0000","last_change":"2024-04-25T02:20:23.891327+0000","last_active":"2024-04-25T02:20:36.263326+0000","last_peered":"2024-04-25T02:20:36.263326+0000","last_clean":"2024-04-25T02:20:36.263326+0000","last_became_active":"2024-04-25T02:20:23.891033+0000","last_became_peered":"2024-04-25T02:20:23.891033+0000","last_unstale":"2024-04-25T02:20:36.263326+0000","last_undegraded":"2024-04-25T02:20:36.263326+0000","last_fullsized":"2024-04-25T02:20:36.263326+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.263578+0000","last_change":"2024-04-25T02:20:24.191472+0000","last_active":"2024-04-25T02:20:36.263578+0000","last_peered":"2024-04-25T02:20:36.263578+0000","last_clean":"2024-04-25T02:20:36.263578+0000","last_became_active":"2024-04-25T02:20:24.190777+0000","last_became_peered":"2024-04-25T02:20:24.190777+0000","last_unstale":"2024-04-25T02:20:36.263578+0000","last_undegraded":"2024-04-25T02:20:36.263578+0000","last_fullsized":"2024-04-25T02:20:36.263578+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.261615+0000","last_change":"2024-04-25T02:20:15.490166+0000","last_active":"2024-04-25T02:20:36.261615+0000","last_peered":"2024-04-25T02:20:36.261615+0000","last_clean":"2024-04-25T02:20:36.261615+0000","last_became_active":"2024-04-25T02:20:15.489795+0000","last_became_peered":"2024-04-25T02:20:15.489795+0000","last_unstale":"2024-04-25T02:20:36.261615+0000","last_undegraded":"2024-04-25T02:20:36.261615+0000","last_fullsized":"2024-04-25T02:20:36.261615+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"18'1","reported_seq":12,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:26.250242+0000","last_change":"2024-04-25T02:20:23.875637+0000","last_active":"2024-04-25T02:20:26.250242+0000","last_peered":"2024-04-25T02:20:26.250242+0000","last_clean":"2024-04-25T02:20:26.250242+0000","last_became_active":"2024-04-25T02:20:23.875042+0000","last_became_peered":"2024-04-25T02:20:23.875042+0000","last_unstale":"2024-04-25T02:20:26.250242+0000","last_undegraded":"2024-04-25T02:20:26.250242+0000","last_fullsized":"2024-04-25T02:20:26.250242+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.165754+0000","last_change":"2024-04-25T02:20:24.190630+0000","last_active":"2024-04-25T02:20:25.165754+0000","last_peered":"2024-04-25T02:20:25.165754+0000","last_clean":"2024-04-25T02:20:25.165754+0000","last_became_active":"2024-04-25T02:20:24.190288+0000","last_became_peered":"2024-04-25T02:20:24.190288+0000","last_unstale":"2024-04-25T02:20:25.165754+0000","last_undegraded":"2024-04-25T02:20:25.165754+0000","last_fullsized":"2024-04-25T02:20:25.165754+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.263383+0000","last_change":"2024-04-25T02:20:15.485725+0000","last_active":"2024-04-25T02:20:36.263383+0000","last_peered":"2024-04-25T02:20:36.263383+0000","last_clean":"2024-04-25T02:20:36.263383+0000","last_became_active":"2024-04-25T02:20:15.485352+0000","last_became_peered":"2024-04-25T02:20:15.485352+0000","last_unstale":"2024-04-25T02:20:36.263383+0000","last_undegraded":"2024-04-25T02:20:36.263383+0000","last_fullsized":"2024-04-25T02:20:36.263383+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.801986+0000","last_change":"2024-04-25T02:20:23.879989+0000","last_active":"2024-04-25T02:20:36.801986+0000","last_peered":"2024-04-25T02:20:36.801986+0000","last_clean":"2024-04-25T02:20:36.801986+0000","last_became_active":"2024-04-25T02:20:23.877442+0000","last_became_peered":"2024-04-25T02:20:23.877442+0000","last_unstale":"2024-04-25T02:20:36.801986+0000","last_undegraded":"2024-04-25T02:20:36.801986+0000","last_fullsized":"2024-04-25T02:20:36.801986+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.166953+0000","last_change":"2024-04-25T02:20:24.176550+0000","last_active":"2024-04-25T02:20:25.166953+0000","last_peered":"2024-04-25T02:20:25.166953+0000","last_clean":"2024-04-25T02:20:25.166953+0000","last_became_active":"2024-04-25T02:20:24.176249+0000","last_became_peered":"2024-04-25T02:20:24.176249+0000","last_unstale":"2024-04-25T02:20:25.166953+0000","last_undegraded":"2024-04-25T02:20:25.166953+0000","last_fullsized":"2024-04-25T02:20:25.166953+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'4","reported_seq":16,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.263810+0000","last_change":"2024-04-25T02:20:23.884258+0000","last_active":"2024-04-25T02:20:36.263810+0000","last_peered":"2024-04-25T02:20:36.263810+0000","last_clean":"2024-04-25T02:20:36.263810+0000","last_became_active":"2024-04-25T02:20:23.883867+0000","last_became_peered":"2024-04-25T02:20:23.883867+0000","last_unstale":"2024-04-25T02:20:36.263810+0000","last_undegraded":"2024-04-25T02:20:36.263810+0000","last_fullsized":"2024-04-25T02:20:36.263810+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.801887+0000","last_change":"2024-04-25T02:20:15.490162+0000","last_active":"2024-04-25T02:20:36.801887+0000","last_peered":"2024-04-25T02:20:36.801887+0000","last_clean":"2024-04-25T02:20:36.801887+0000","last_became_active":"2024-04-25T02:20:15.489760+0000","last_became_peered":"2024-04-25T02:20:15.489760+0000","last_unstale":"2024-04-25T02:20:36.801887+0000","last_undegraded":"2024-04-25T02:20:36.801887+0000","last_fullsized":"2024-04-25T02:20:36.801887+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.261582+0000","last_change":"2024-04-25T02:20:24.192993+0000","last_active":"2024-04-25T02:20:36.261582+0000","last_peered":"2024-04-25T02:20:36.261582+0000","last_clean":"2024-04-25T02:20:36.261582+0000","last_became_active":"2024-04-25T02:20:24.192258+0000","last_became_peered":"2024-04-25T02:20:24.192258+0000","last_unstale":"2024-04-25T02:20:36.261582+0000","last_undegraded":"2024-04-25T02:20:36.261582+0000","last_fullsized":"2024-04-25T02:20:36.261582+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.263870+0000","last_change":"2024-04-25T02:20:15.488540+0000","last_active":"2024-04-25T02:20:36.263870+0000","last_peered":"2024-04-25T02:20:36.263870+0000","last_clean":"2024-04-25T02:20:36.263870+0000","last_became_active":"2024-04-25T02:20:15.488148+0000","last_became_peered":"2024-04-25T02:20:15.488148+0000","last_unstale":"2024-04-25T02:20:36.263870+0000","last_undegraded":"2024-04-25T02:20:36.263870+0000","last_fullsized":"2024-04-25T02:20:36.263870+0000","mapping_epoch":12,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":13,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"19'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:45.598792+0000","last_change":"2024-04-25T02:20:23.882042+0000","last_active":"2024-04-25T02:20:45.598792+0000","last_peered":"2024-04-25T02:20:45.598792+0000","last_clean":"2024-04-25T02:20:45.598792+0000","last_became_active":"2024-04-25T02:20:23.881660+0000","last_became_peered":"2024-04-25T02:20:23.881660+0000","last_unstale":"2024-04-25T02:20:45.598792+0000","last_undegraded":"2024-04-25T02:20:45.598792+0000","last_fullsized":"2024-04-25T02:20:45.598792+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.801407+0000","last_change":"2024-04-25T02:20:24.188573+0000","last_active":"2024-04-25T02:20:36.801407+0000","last_peered":"2024-04-25T02:20:36.801407+0000","last_clean":"2024-04-25T02:20:36.801407+0000","last_became_active":"2024-04-25T02:20:24.188251+0000","last_became_peered":"2024-04-25T02:20:24.188251+0000","last_unstale":"2024-04-25T02:20:36.801407+0000","last_undegraded":"2024-04-25T02:20:36.801407+0000","last_fullsized":"2024-04-25T02:20:36.801407+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"19'10","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:50.602372+0000","last_change":"2024-04-25T02:20:23.883575+0000","last_active":"2024-04-25T02:20:50.602372+0000","last_peered":"2024-04-25T02:20:50.602372+0000","last_clean":"2024-04-25T02:20:50.602372+0000","last_became_active":"2024-04-25T02:20:23.883144+0000","last_became_peered":"2024-04-25T02:20:23.883144+0000","last_unstale":"2024-04-25T02:20:50.602372+0000","last_undegraded":"2024-04-25T02:20:50.602372+0000","last_fullsized":"2024-04-25T02:20:50.602372+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2244,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.803107+0000","last_change":"2024-04-25T02:20:24.170678+0000","last_active":"2024-04-25T02:20:36.803107+0000","last_peered":"2024-04-25T02:20:36.803107+0000","last_clean":"2024-04-25T02:20:36.803107+0000","last_became_active":"2024-04-25T02:20:24.170488+0000","last_became_peered":"2024-04-25T02:20:24.170488+0000","last_unstale":"2024-04-25T02:20:36.803107+0000","last_undegraded":"2024-04-25T02:20:36.803107+0000","last_fullsized":"2024-04-25T02:20:36.803107+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.802182+0000","last_change":"2024-04-25T02:20:23.881809+0000","last_active":"2024-04-25T02:20:36.802182+0000","last_peered":"2024-04-25T02:20:36.802182+0000","last_clean":"2024-04-25T02:20:36.802182+0000","last_became_active":"2024-04-25T02:20:23.878991+0000","last_became_peered":"2024-04-25T02:20:23.878991+0000","last_unstale":"2024-04-25T02:20:36.802182+0000","last_undegraded":"2024-04-25T02:20:36.802182+0000","last_fullsized":"2024-04-25T02:20:36.802182+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.802479+0000","last_change":"2024-04-25T02:20:24.197009+0000","last_active":"2024-04-25T02:20:36.802479+0000","last_peered":"2024-04-25T02:20:36.802479+0000","last_clean":"2024-04-25T02:20:36.802479+0000","last_became_active":"2024-04-25T02:20:24.196535+0000","last_became_peered":"2024-04-25T02:20:24.196535+0000","last_unstale":"2024-04-25T02:20:36.802479+0000","last_undegraded":"2024-04-25T02:20:36.802479+0000","last_fullsized":"2024-04-25T02:20:36.802479+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.263510+0000","last_change":"2024-04-25T02:20:23.888031+0000","last_active":"2024-04-25T02:20:36.263510+0000","last_peered":"2024-04-25T02:20:36.263510+0000","last_clean":"2024-04-25T02:20:36.263510+0000","last_became_active":"2024-04-25T02:20:23.887730+0000","last_became_peered":"2024-04-25T02:20:23.887730+0000","last_unstale":"2024-04-25T02:20:36.263510+0000","last_undegraded":"2024-04-25T02:20:36.263510+0000","last_fullsized":"2024-04-25T02:20:36.263510+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.802029+0000","last_change":"2024-04-25T02:20:24.188502+0000","last_active":"2024-04-25T02:20:36.802029+0000","last_peered":"2024-04-25T02:20:36.802029+0000","last_clean":"2024-04-25T02:20:36.802029+0000","last_became_active":"2024-04-25T02:20:24.188102+0000","last_became_peered":"2024-04-25T02:20:24.188102+0000","last_unstale":"2024-04-25T02:20:36.802029+0000","last_undegraded":"2024-04-25T02:20:36.802029+0000","last_fullsized":"2024-04-25T02:20:36.802029+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"17'1","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.263549+0000","last_change":"2024-04-25T02:20:23.890367+0000","last_active":"2024-04-25T02:20:36.263549+0000","last_peered":"2024-04-25T02:20:36.263549+0000","last_clean":"2024-04-25T02:20:36.263549+0000","last_became_active":"2024-04-25T02:20:23.889958+0000","last_became_peered":"2024-04-25T02:20:23.889958+0000","last_unstale":"2024-04-25T02:20:36.263549+0000","last_undegraded":"2024-04-25T02:20:36.263549+0000","last_fullsized":"2024-04-25T02:20:36.263549+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.262315+0000","last_change":"2024-04-25T02:20:24.194271+0000","last_active":"2024-04-25T02:20:36.262315+0000","last_peered":"2024-04-25T02:20:36.262315+0000","last_clean":"2024-04-25T02:20:36.262315+0000","last_became_active":"2024-04-25T02:20:24.193729+0000","last_became_peered":"2024-04-25T02:20:24.193729+0000","last_unstale":"2024-04-25T02:20:36.262315+0000","last_undegraded":"2024-04-25T02:20:36.262315+0000","last_fullsized":"2024-04-25T02:20:36.262315+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"17'4","reported_seq":15,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.165762+0000","last_change":"2024-04-25T02:20:23.882173+0000","last_active":"2024-04-25T02:20:25.165762+0000","last_peered":"2024-04-25T02:20:25.165762+0000","last_clean":"2024-04-25T02:20:25.165762+0000","last_became_active":"2024-04-25T02:20:23.881840+0000","last_became_peered":"2024-04-25T02:20:23.881840+0000","last_unstale":"2024-04-25T02:20:25.165762+0000","last_undegraded":"2024-04-25T02:20:25.165762+0000","last_fullsized":"2024-04-25T02:20:25.165762+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":553,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.801120+0000","last_change":"2024-04-25T02:20:24.171268+0000","last_active":"2024-04-25T02:20:36.801120+0000","last_peered":"2024-04-25T02:20:36.801120+0000","last_clean":"2024-04-25T02:20:36.801120+0000","last_became_active":"2024-04-25T02:20:24.170957+0000","last_became_peered":"2024-04-25T02:20:24.170957+0000","last_unstale":"2024-04-25T02:20:36.801120+0000","last_undegraded":"2024-04-25T02:20:36.801120+0000","last_fullsized":"2024-04-25T02:20:36.801120+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.801542+0000","last_change":"2024-04-25T02:20:24.167991+0000","last_active":"2024-04-25T02:20:36.801542+0000","last_peered":"2024-04-25T02:20:36.801542+0000","last_clean":"2024-04-25T02:20:36.801542+0000","last_became_active":"2024-04-25T02:20:24.167659+0000","last_became_peered":"2024-04-25T02:20:24.167659+0000","last_unstale":"2024-04-25T02:20:36.801542+0000","last_undegraded":"2024-04-25T02:20:36.801542+0000","last_fullsized":"2024-04-25T02:20:36.801542+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.262110+0000","last_change":"2024-04-25T02:20:24.194043+0000","last_active":"2024-04-25T02:20:36.262110+0000","last_peered":"2024-04-25T02:20:36.262110+0000","last_clean":"2024-04-25T02:20:36.262110+0000","last_became_active":"2024-04-25T02:20:24.193386+0000","last_became_peered":"2024-04-25T02:20:24.193386+0000","last_unstale":"2024-04-25T02:20:36.262110+0000","last_undegraded":"2024-04-25T02:20:36.262110+0000","last_fullsized":"2024-04-25T02:20:36.262110+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":10,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-25T02:20:25.166421+0000","last_change":"2024-04-25T02:20:24.189262+0000","last_active":"2024-04-25T02:20:25.166421+0000","last_peered":"2024-04-25T02:20:25.166421+0000","last_clean":"2024-04-25T02:20:25.166421+0000","last_became_active":"2024-04-25T02:20:24.188938+0000","last_became_peered":"2024-04-25T02:20:24.188938+0000","last_unstale":"2024-04-25T02:20:25.166421+0000","last_undegraded":"2024-04-25T02:20:25.166421+0000","last_fullsized":"2024-04-25T02:20:25.166421+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.262819+0000","last_change":"2024-04-25T02:20:24.189965+0000","last_active":"2024-04-25T02:20:36.262819+0000","last_peered":"2024-04-25T02:20:36.262819+0000","last_clean":"2024-04-25T02:20:36.262819+0000","last_became_active":"2024-04-25T02:20:24.189042+0000","last_became_peered":"2024-04-25T02:20:24.189042+0000","last_unstale":"2024-04-25T02:20:36.262819+0000","last_undegraded":"2024-04-25T02:20:36.262819+0000","last_fullsized":"2024-04-25T02:20:36.262819+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-25T02:20:36.802274+0000","last_change":"2024-04-25T02:20:24.172462+0000","last_active":"2024-04-25T02:20:36.802274+0000","last_peered":"2024-04-25T02:20:36.802274+0000","last_clean":"2024-04-25T02:20:36.802274+0000","last_became_active":"2024-04-25T02:20:24.171736+0000","last_became_peered":"2024-04-25T02:20:24.171736+0000","last_unstale":"2024-04-25T02:20:36.802274+0000","last_undegraded":"2024-04-25T02:20:36.802274+0000","last_fullsized":"2024-04-25T02:20:36.802274+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":8511,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":113,"num_write_kb":43,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":17022,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":97,"ondisk_log_size":97,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1,"ondisk_log_size":1,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":9,"seq":38654705698,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048804,"kb_used_data":220,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323036,"statfs":{"total":96636764160,"available":95562788864,"internally_reserved":1073741824,"allocated":225280,"data_stored":66860,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:22:15 2024","interfaces":[{"interface":"back","average":{"1min":0.27300000000000002,"5min":0.27100000000000002,"15min":0.27100000000000002},"min":{"1min":0.21299999999999999,"5min":0.192,"15min":0.192},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.27600000000000002,"5min":0.28100000000000003,"15min":0.28199999999999997},"min":{"1min":0.222,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.26500000000000001}]},{"osd":1,"last update":"Thu Apr 25 02:22:15 2024","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.29599999999999999,"15min":0.29699999999999999},"min":{"1min":0.222,"5min":0.221,"15min":0.221},"max":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"last":0.23000000000000001},{"interface":"front","average":{"1min":0.28499999999999998,"5min":0.29499999999999998,"15min":0.29699999999999999},"min":{"1min":0.218,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.27800000000000002}]},{"osd":2,"last update":"Thu Apr 25 02:22:15 2024","interfaces":[{"interface":"back","average":{"1min":0.30099999999999999,"5min":0.309,"15min":0.31},"min":{"1min":0.23400000000000001,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.28999999999999998,"5min":0.29699999999999999,"15min":0.29799999999999999},"min":{"1min":0.215,"5min":0.215,"15min":0.215},"max":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"last":0.28899999999999998}]}]},{"osd":2,"up_from":9,"seq":38654705700,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":63779,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:22:14 2024","interfaces":[{"interface":"back","average":{"1min":0.26000000000000001,"5min":0.28100000000000003,"15min":0.28499999999999998},"min":{"1min":0.183,"5min":0.16,"15min":0.16},"max":{"1min":0.37,"5min":0.41799999999999998,"15min":0.41799999999999998},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.25900000000000001,"5min":0.29599999999999999,"15min":0.30199999999999999},"min":{"1min":0.21299999999999999,"5min":0.184,"15min":0.184},"max":{"1min":0.40300000000000002,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":1.2070000000000001}]},{"osd":1,"last update":"Thu Apr 25 02:22:14 2024","interfaces":[{"interface":"back","average":{"1min":0.27300000000000002,"5min":0.29699999999999999,"15min":0.30099999999999999},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.38400000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"last":1.1479999999999999},{"interface":"front","average":{"1min":0.27300000000000002,"5min":0.309,"15min":0.315},"min":{"1min":0.23499999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.42399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.23899999999999999}]},{"osd":3,"last update":"Thu Apr 25 02:22:14 2024","interfaces":[{"interface":"back","average":{"1min":0.28599999999999998,"5min":0.318,"15min":0.32400000000000001},"min":{"1min":0.23599999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.45600000000000002,"5min":0.46600000000000003,"15min":0.46600000000000003},"last":5.5490000000000004},{"interface":"front","average":{"1min":0.28799999999999998,"5min":0.32800000000000001,"15min":0.33400000000000002},"min":{"1min":0.216,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.442,"5min":0.48299999999999998,"15min":0.48299999999999998},"last":1.1759999999999999}]}]},{"osd":0,"up_from":9,"seq":38654705698,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048776,"kb_used_data":192,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323064,"statfs":{"total":96636764160,"available":95562817536,"internally_reserved":1073741824,"allocated":196608,"data_stored":58300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 25 02:22:16 2024","interfaces":[{"interface":"back","average":{"1min":0.28599999999999998,"5min":0.29699999999999999,"15min":0.29899999999999999},"min":{"1min":0.20300000000000001,"5min":0.157,"15min":0.157},"max":{"1min":0.5,"5min":1.3260000000000001,"15min":1.3260000000000001},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.28499999999999998,"5min":0.32500000000000001,"15min":0.33200000000000002},"min":{"1min":0.14199999999999999,"5min":0.14199999999999999,"15min":0.14199999999999999},"max":{"1min":0.45700000000000002,"5min":1.123,"15min":1.123},"last":0.38600000000000001}]},{"osd":2,"last update":"Thu Apr 25 02:22:16 2024","interfaces":[{"interface":"back","average":{"1min":0.28799999999999998,"5min":0.30399999999999999,"15min":0.307},"min":{"1min":0.20799999999999999,"5min":0.16500000000000001,"15min":0.16500000000000001},"max":{"1min":0.441,"5min":0.59299999999999997,"15min":0.59299999999999997},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.309,"5min":0.56599999999999995,"15min":0.60899999999999999},"min":{"1min":0.157,"5min":0.157,"15min":0.157},"max":{"1min":0.48699999999999999,"5min":6.54,"15min":6.54},"last":0.40600000000000003}]},{"osd":3,"last update":"Thu Apr 25 02:22:16 2024","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.48699999999999999,"15min":0.51500000000000001},"min":{"1min":0.187,"5min":0.186,"15min":0.186},"max":{"1min":0.52500000000000002,"5min":4.2709999999999999,"15min":4.2709999999999999},"last":0.443},{"interface":"front","average":{"1min":0.312,"5min":0.34000000000000002,"15min":0.34399999999999997},"min":{"1min":0.23200000000000001,"5min":0.20699999999999999,"15min":0.20699999999999999},"max":{"1min":0.49099999999999999,"5min":1.1699999999999999,"15min":1.1699999999999999},"last":0.42899999999999999}]}]},{"osd":1,"up_from":9,"seq":38654705699,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1048764,"kb_used_data":180,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93323076,"statfs":{"total":96636764160,"available":95562829824,"internally_reserved":1073741824,"allocated":184320,"data_stored":59569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:22:13 2024","interfaces":[{"interface":"back","average":{"1min":0.254,"5min":0.27400000000000002,"15min":0.27700000000000002},"min":{"1min":0.151,"5min":0.14599999999999999,"15min":0.14599999999999999},"max":{"1min":0.47499999999999998,"5min":0.48399999999999999,"15min":0.48399999999999999},"last":0.22700000000000001},{"interface":"front","average":{"1min":0.25700000000000001,"5min":0.29199999999999998,"15min":0.29799999999999999},"min":{"1min":0.16900000000000001,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":0.42899999999999999,"5min":0.501,"15min":0.501},"last":0.23499999999999999}]},{"osd":2,"last update":"Thu Apr 25 02:22:13 2024","interfaces":[{"interface":"back","average":{"1min":0.26400000000000001,"5min":0.28199999999999997,"15min":0.28499999999999998},"min":{"1min":0.16800000000000001,"5min":0.16800000000000001,"15min":0.16800000000000001},"max":{"1min":0.45300000000000001,"5min":0.45300000000000001,"15min":0.45300000000000001},"last":0.251},{"interface":"front","average":{"1min":0.27200000000000002,"5min":0.29699999999999999,"15min":0.30099999999999999},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.245}]},{"osd":3,"last update":"Thu Apr 25 02:22:13 2024","interfaces":[{"interface":"back","average":{"1min":0.27900000000000003,"5min":0.29899999999999999,"15min":0.30199999999999999},"min":{"1min":0.185,"5min":0.185,"15min":0.185},"max":{"1min":0.46500000000000002,"5min":0.46500000000000002,"15min":0.46500000000000002},"last":0.21099999999999999},{"interface":"front","average":{"1min":0.28199999999999997,"5min":0.315,"15min":0.32100000000000001},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":0.495,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.29399999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":4855,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":7936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:22:57.940 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T02:22:57.940 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-25T02:22:57.940 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-25T02:22:57.940 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T02:22:58.090 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.087+0000 7efe9bfad700 1 Processor -- start 2024-04-25T02:22:58.090 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.087+0000 7efe9bfad700 1 -- start start 2024-04-25T02:22:58.092 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.088+0000 7efe9bfad700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7efe940a4c60 0x7efe9413fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:58.092 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.088+0000 7efe9bfad700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efe940b05e0 0x7efe941401c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:58.092 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.088+0000 7efe9bfad700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe940a7130 con 0x7efe940b3050 2024-04-25T02:22:58.092 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.088+0000 7efe9bfad700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe940a5560 con 0x7efe940b05e0 2024-04-25T02:22:58.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.088+0000 7efe9bfad700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe940a3f60 con 0x7efe940a4c60 2024-04-25T02:22:58.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.088+0000 7efe99d49700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7efe940a4c60 0x7efe9413fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:58.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.088+0000 7efe9a54a700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efe940b05e0 0x7efe941401c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:58.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.088+0000 7efe9a54a700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efe940b05e0 0x7efe941401c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:33210/0 (socket says 172.21.15.111:33210) 2024-04-25T02:22:58.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.088+0000 7efe99548700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7efe940b3050 0x7efe9406eb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:55524/0 (socket says 172.21.15.111:55524) 2024-04-25T02:22:58.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.088+0000 7efe99d49700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7efe940a4c60 0x7efe9413fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:58150/0 (socket says 172.21.15.111:58150) 2024-04-25T02:22:58.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.088+0000 7efe9a54a700 1 -- 172.21.15.111:0/2042336803 learned_addr learned my addr 172.21.15.111:0/2042336803 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:22:58.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.088+0000 7efe98d47700 1 -- 172.21.15.111:0/2042336803 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 811830652 0 0) 0x7efe940a7130 con 0x7efe940b3050 2024-04-25T02:22:58.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.088+0000 7efe99d49700 1 -- 172.21.15.111:0/2042336803 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efe940b05e0 msgr2=0x7efe941401c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:22:58.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.088+0000 7efe99d49700 1 --2- 172.21.15.111:0/2042336803 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efe940b05e0 0x7efe941401c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:58.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.088+0000 7efe99d49700 1 -- 172.21.15.111:0/2042336803 >> v1:172.21.15.111:6789/0 conn(0x7efe940b3050 legacy=0x7efe9406eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:58.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.088+0000 7efe99d49700 1 -- 172.21.15.111:0/2042336803 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe940a40d0 con 0x7efe940a4c60 2024-04-25T02:22:58.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.088+0000 7efe9a54a700 1 --2- 172.21.15.111:0/2042336803 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efe940b05e0 0x7efe941401c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:22:58.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.089+0000 7efe99d49700 1 --2- 172.21.15.111:0/2042336803 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7efe940a4c60 0x7efe9413fc80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7efe84009910 tx=0x7efe840091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=311ea3b7e0a330df server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:58.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.089+0000 7efe98d47700 1 -- 172.21.15.111:0/2042336803 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe8400b710 con 0x7efe940a4c60 2024-04-25T02:22:58.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.089+0000 7efe98d47700 1 -- 172.21.15.111:0/2042336803 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe8400b870 con 0x7efe940a4c60 2024-04-25T02:22:58.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.089+0000 7efe98d47700 1 -- 172.21.15.111:0/2042336803 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe8400bc30 con 0x7efe940a4c60 2024-04-25T02:22:58.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.089+0000 7efe9bfad700 1 -- 172.21.15.111:0/2042336803 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7efe940a4c60 msgr2=0x7efe9413fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:58.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.089+0000 7efe9bfad700 1 --2- 172.21.15.111:0/2042336803 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7efe940a4c60 0x7efe9413fc80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7efe84009910 tx=0x7efe840091a0 comp rx=0 tx=0).stop 2024-04-25T02:22:58.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.089+0000 7efe9bfad700 1 -- 172.21.15.111:0/2042336803 shutdown_connections 2024-04-25T02:22:58.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.089+0000 7efe9bfad700 1 --2- 172.21.15.111:0/2042336803 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7efe940a4c60 0x7efe9413fc80 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:58.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.089+0000 7efe9bfad700 1 --2- 172.21.15.111:0/2042336803 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efe940b05e0 0x7efe941401c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:58.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.089+0000 7efe9bfad700 1 -- 172.21.15.111:0/2042336803 >> 172.21.15.111:0/2042336803 conn(0x7efe9406bcc0 msgr2=0x7efe9406c090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:58.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.089+0000 7efe9bfad700 1 -- 172.21.15.111:0/2042336803 shutdown_connections 2024-04-25T02:22:58.094 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.089+0000 7efe9bfad700 1 -- 172.21.15.111:0/2042336803 wait complete. 2024-04-25T02:22:58.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.090+0000 7efe9bfad700 1 Processor -- start 2024-04-25T02:22:58.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.090+0000 7efe9bfad700 1 -- start start 2024-04-25T02:22:58.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.091+0000 7efe9bfad700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efe940a4c60 0x7efe94068a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:58.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.091+0000 7efe9bfad700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efe940b05e0 0x7efe94068f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:58.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.091+0000 7efe9bfad700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7efe940b3050 0x7efe940694d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:58.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.091+0000 7efe9bfad700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe940af4c0 con 0x7efe940b05e0 2024-04-25T02:22:58.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.091+0000 7efe9bfad700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe940ad880 con 0x7efe940a4c60 2024-04-25T02:22:58.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.091+0000 7efe9bfad700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efe940adb40 con 0x7efe940b3050 2024-04-25T02:22:58.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.091+0000 7efe99d49700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efe940a4c60 0x7efe94068a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:58.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.091+0000 7efe99548700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efe940b05e0 0x7efe94068f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:58.097 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.091+0000 7efe99d49700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efe940a4c60 0x7efe94068a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:33226/0 (socket says 172.21.15.111:33226) 2024-04-25T02:22:58.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.091+0000 7efe99d49700 1 -- 172.21.15.111:0/1085630046 learned_addr learned my addr 172.21.15.111:0/1085630046 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:22:58.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.091+0000 7efe9a54a700 1 --2- 172.21.15.111:0/1085630046 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7efe940b3050 0x7efe940694d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:58.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.091+0000 7efe9a54a700 1 -- 172.21.15.111:0/1085630046 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efe940a4c60 msgr2=0x7efe94068a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:58.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.091+0000 7efe9a54a700 1 --2- 172.21.15.111:0/1085630046 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efe940a4c60 0x7efe94068a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:58.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.091+0000 7efe9a54a700 1 -- 172.21.15.111:0/1085630046 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efe940b05e0 msgr2=0x7efe94068f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:58.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.091+0000 7efe9a54a700 1 --2- 172.21.15.111:0/1085630046 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efe940b05e0 0x7efe94068f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:58.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.091+0000 7efe9a54a700 1 -- 172.21.15.111:0/1085630046 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe8c009ae0 con 0x7efe940b3050 2024-04-25T02:22:58.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.091+0000 7efe99548700 1 --2- 172.21.15.111:0/1085630046 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efe940b05e0 0x7efe94068f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:22:58.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.091+0000 7efe99d49700 1 --2- 172.21.15.111:0/1085630046 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efe940a4c60 0x7efe94068a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:22:58.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.091+0000 7efe9a54a700 1 --2- 172.21.15.111:0/1085630046 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7efe940b3050 0x7efe940694d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7efe8c009ee0 tx=0x7efe8c00b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:58.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.091+0000 7efe89ffb700 1 -- 172.21.15.111:0/1085630046 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe8c018070 con 0x7efe940b3050 2024-04-25T02:22:58.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.092+0000 7efe89ffb700 1 -- 172.21.15.111:0/1085630046 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe8c00f040 con 0x7efe940b3050 2024-04-25T02:22:58.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.092+0000 7efe9bfad700 1 -- 172.21.15.111:0/1085630046 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe84009420 con 0x7efe940b3050 2024-04-25T02:22:58.098 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.092+0000 7efe89ffb700 1 -- 172.21.15.111:0/1085630046 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe8c00cb90 con 0x7efe940b3050 2024-04-25T02:22:58.099 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.092+0000 7efe9bfad700 1 -- 172.21.15.111:0/1085630046 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe940aead0 con 0x7efe940b3050 2024-04-25T02:22:58.099 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.092+0000 7efe89ffb700 1 -- 172.21.15.111:0/1085630046 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 9) v1 ==== 53544+0+0 (secure 0 0 0) 0x7efe8c003020 con 0x7efe940b3050 2024-04-25T02:22:58.099 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.093+0000 7efe89ffb700 1 -- 172.21.15.111:0/1085630046 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3829+0+0 (secure 0 0 0) 0x7efe8c05b480 con 0x7efe940b3050 2024-04-25T02:22:58.099 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.093+0000 7efe9bfad700 1 -- 172.21.15.111:0/1085630046 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe94071790 con 0x7efe940b3050 2024-04-25T02:22:58.099 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.096+0000 7efe89ffb700 1 -- 172.21.15.111:0/1085630046 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7efe8c0398b0 con 0x7efe940b3050 2024-04-25T02:22:58.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.278+0000 7efe9bfad700 1 -- 172.21.15.111:0/1085630046 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7efe940aecf0 con 0x7efe940b3050 2024-04-25T02:22:58.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.279+0000 7efe89ffb700 1 -- 172.21.15.111:0/1085630046 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7efe8c03ced0 con 0x7efe940b3050 2024-04-25T02:22:58.282 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:22:58.282 INFO:teuthology.orchestra.run.smithi111.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T02:22:58.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.280+0000 7efe9bfad700 1 -- 172.21.15.111:0/1085630046 >> v1:172.21.15.111:6816/46482 conn(0x7efe78045f80 legacy=0x7efe78048430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:58.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.280+0000 7efe9bfad700 1 -- 172.21.15.111:0/1085630046 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7efe940b3050 msgr2=0x7efe940694d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:58.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.280+0000 7efe9bfad700 1 --2- 172.21.15.111:0/1085630046 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7efe940b3050 0x7efe940694d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7efe8c009ee0 tx=0x7efe8c00b040 comp rx=0 tx=0).stop 2024-04-25T02:22:58.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.280+0000 7efe9bfad700 1 -- 172.21.15.111:0/1085630046 shutdown_connections 2024-04-25T02:22:58.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.280+0000 7efe9bfad700 1 --2- 172.21.15.111:0/1085630046 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7efe940b3050 0x7efe940694d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:58.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.280+0000 7efe9bfad700 1 --2- 172.21.15.111:0/1085630046 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efe940a4c60 0x7efe94068a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:58.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.280+0000 7efe9bfad700 1 --2- 172.21.15.111:0/1085630046 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efe940b05e0 0x7efe94068f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:58.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.280+0000 7efe9bfad700 1 -- 172.21.15.111:0/1085630046 >> 172.21.15.111:0/1085630046 conn(0x7efe9406bcc0 msgr2=0x7efe940b15a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:58.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.280+0000 7efe9bfad700 1 -- 172.21.15.111:0/1085630046 shutdown_connections 2024-04-25T02:22:58.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.280+0000 7efe9bfad700 1 -- 172.21.15.111:0/1085630046 wait complete. 2024-04-25T02:22:58.295 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-25T02:22:58.295 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:22:58.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.407+0000 7fe669a7f700 1 Processor -- start 2024-04-25T02:22:58.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.407+0000 7fe669a7f700 1 -- start start 2024-04-25T02:22:58.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.408+0000 7fe669a7f700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe6640a5470 0x7fe66413fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:58.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.408+0000 7fe669a7f700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fe6640b06c0 0x7fe6641400d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:58.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.408+0000 7fe669a7f700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6640a42c0 con 0x7fe6640a4720 2024-04-25T02:22:58.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.408+0000 7fe669a7f700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6640a3860 con 0x7fe6640b06c0 2024-04-25T02:22:58.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.408+0000 7fe669a7f700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6640a71a0 con 0x7fe6640a5470 2024-04-25T02:22:58.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.408+0000 7fe6637fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe6640a5470 0x7fe66413fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:58.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.408+0000 7fe662ffd700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fe6640b06c0 0x7fe6641400d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:58.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.408+0000 7fe663fff700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7fe6640a4720 0x7fe66406eb10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:55538/0 (socket says 172.21.15.111:55538) 2024-04-25T02:22:58.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.408+0000 7fe663fff700 1 -- 172.21.15.111:0/3998744429 learned_addr learned my addr 172.21.15.111:0/3998744429 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:22:58.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.408+0000 7fe662ffd700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fe6640b06c0 0x7fe6641400d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:53564/0 (socket says 172.21.15.111:53564) 2024-04-25T02:22:58.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.408+0000 7fe6637fe700 1 -- 172.21.15.111:0/3998744429 >> v2:172.21.15.111:3300/0 conn(0x7fe6640b06c0 msgr2=0x7fe6641400d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:22:58.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.408+0000 7fe6637fe700 1 --2- 172.21.15.111:0/3998744429 >> v2:172.21.15.111:3300/0 conn(0x7fe6640b06c0 0x7fe6641400d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:58.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.408+0000 7fe6637fe700 1 -- 172.21.15.111:0/3998744429 >> v1:172.21.15.111:6789/0 conn(0x7fe6640a4720 legacy=0x7fe66406eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:58.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.408+0000 7fe6637fe700 1 -- 172.21.15.111:0/3998744429 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6640a5da0 con 0x7fe6640a5470 2024-04-25T02:22:58.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.408+0000 7fe6627fc700 1 -- 172.21.15.111:0/3998744429 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2760599767 0 0) 0x7fe6640a42c0 con 0x7fe6640a4720 2024-04-25T02:22:58.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.408+0000 7fe662ffd700 1 --2- 172.21.15.111:0/3998744429 >> v2:172.21.15.111:3300/0 conn(0x7fe6640b06c0 0x7fe6641400d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:22:58.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.408+0000 7fe6637fe700 1 --2- 172.21.15.111:0/3998744429 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe6640a5470 0x7fe66413fb90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe6540098e0 tx=0x7fe6540091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bc373dec2caaba1e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:58.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.409+0000 7fe6627fc700 1 -- 172.21.15.111:0/3998744429 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65400b640 con 0x7fe6640a5470 2024-04-25T02:22:58.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.409+0000 7fe6627fc700 1 -- 172.21.15.111:0/3998744429 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe65400b7a0 con 0x7fe6640a5470 2024-04-25T02:22:58.414 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.409+0000 7fe6627fc700 1 -- 172.21.15.111:0/3998744429 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65400bb40 con 0x7fe6640a5470 2024-04-25T02:22:58.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.409+0000 7fe669a7f700 1 -- 172.21.15.111:0/3998744429 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe6640a5470 msgr2=0x7fe66413fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:58.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.409+0000 7fe669a7f700 1 --2- 172.21.15.111:0/3998744429 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe6640a5470 0x7fe66413fb90 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fe6540098e0 tx=0x7fe6540091a0 comp rx=0 tx=0).stop 2024-04-25T02:22:58.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.409+0000 7fe669a7f700 1 -- 172.21.15.111:0/3998744429 shutdown_connections 2024-04-25T02:22:58.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.409+0000 7fe669a7f700 1 --2- 172.21.15.111:0/3998744429 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe6640a5470 0x7fe66413fb90 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:58.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.409+0000 7fe669a7f700 1 --2- 172.21.15.111:0/3998744429 >> v2:172.21.15.111:3300/0 conn(0x7fe6640b06c0 0x7fe6641400d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:58.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.409+0000 7fe669a7f700 1 -- 172.21.15.111:0/3998744429 >> 172.21.15.111:0/3998744429 conn(0x7fe66406bd70 msgr2=0x7fe66406c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:58.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.409+0000 7fe669a7f700 1 -- 172.21.15.111:0/3998744429 shutdown_connections 2024-04-25T02:22:58.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.409+0000 7fe669a7f700 1 -- 172.21.15.111:0/3998744429 wait complete. 2024-04-25T02:22:58.418 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.410+0000 7fe669a7f700 1 Processor -- start 2024-04-25T02:22:58.419 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.410+0000 7fe669a7f700 1 -- start start 2024-04-25T02:22:58.419 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.411+0000 7fe669a7f700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe6640a4720 0x7fe66414f060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:58.419 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.411+0000 7fe669a7f700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe6640a5470 0x7fe66414f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:58.419 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.411+0000 7fe669a7f700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe6640b06c0 0x7fe66414fae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:58.419 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.411+0000 7fe669a7f700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe664098ab0 con 0x7fe6640b06c0 2024-04-25T02:22:58.419 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.411+0000 7fe669a7f700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe664099510 con 0x7fe6640a4720 2024-04-25T02:22:58.419 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.411+0000 7fe669a7f700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe6640aedc0 con 0x7fe6640a5470 2024-04-25T02:22:58.419 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.411+0000 7fe6637fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe6640a4720 0x7fe66414f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:58.419 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.411+0000 7fe663fff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe6640b06c0 0x7fe66414fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:58.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.411+0000 7fe6637fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe6640a4720 0x7fe66414f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:33232/0 (socket says 172.21.15.111:33232) 2024-04-25T02:22:58.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.411+0000 7fe6637fe700 1 -- 172.21.15.111:0/2922514608 learned_addr learned my addr 172.21.15.111:0/2922514608 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:22:58.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.411+0000 7fe662ffd700 1 --2- 172.21.15.111:0/2922514608 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe6640a5470 0x7fe66414f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:58.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.411+0000 7fe6637fe700 1 -- 172.21.15.111:0/2922514608 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe6640a5470 msgr2=0x7fe66414f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:58.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.411+0000 7fe6637fe700 1 --2- 172.21.15.111:0/2922514608 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe6640a5470 0x7fe66414f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:58.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.411+0000 7fe6637fe700 1 -- 172.21.15.111:0/2922514608 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe6640b06c0 msgr2=0x7fe66414fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:58.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.411+0000 7fe6637fe700 1 --2- 172.21.15.111:0/2922514608 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe6640b06c0 0x7fe66414fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:58.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.411+0000 7fe6637fe700 1 -- 172.21.15.111:0/2922514608 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe64c009a20 con 0x7fe6640a4720 2024-04-25T02:22:58.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.411+0000 7fe662ffd700 1 --2- 172.21.15.111:0/2922514608 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe6640a5470 0x7fe66414f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:22:58.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.411+0000 7fe663fff700 1 --2- 172.21.15.111:0/2922514608 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe6640b06c0 0x7fe66414fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:22:58.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.411+0000 7fe6637fe700 1 --2- 172.21.15.111:0/2922514608 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe6640a4720 0x7fe66414f060 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe6640a72e0 tx=0x7fe654017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:58.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.411+0000 7fe65b7fe700 1 -- 172.21.15.111:0/2922514608 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65401f070 con 0x7fe6640a4720 2024-04-25T02:22:58.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.411+0000 7fe65b7fe700 1 -- 172.21.15.111:0/2922514608 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe654002f30 con 0x7fe6640a4720 2024-04-25T02:22:58.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.412+0000 7fe669a7f700 1 -- 172.21.15.111:0/2922514608 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe654009420 con 0x7fe6640a4720 2024-04-25T02:22:58.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.412+0000 7fe65b7fe700 1 -- 172.21.15.111:0/2922514608 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65400b910 con 0x7fe6640a4720 2024-04-25T02:22:58.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.412+0000 7fe669a7f700 1 -- 172.21.15.111:0/2922514608 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6640987d0 con 0x7fe6640a4720 2024-04-25T02:22:58.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.412+0000 7fe65b7fe700 1 -- 172.21.15.111:0/2922514608 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 9) v1 ==== 53544+0+0 (secure 0 0 0) 0x7fe654023070 con 0x7fe6640a4720 2024-04-25T02:22:58.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.413+0000 7fe669a7f700 1 -- 172.21.15.111:0/2922514608 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe664071790 con 0x7fe6640a4720 2024-04-25T02:22:58.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.413+0000 7fe65b7fe700 1 -- 172.21.15.111:0/2922514608 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3829+0+0 (secure 0 0 0) 0x7fe65405c3f0 con 0x7fe6640a4720 2024-04-25T02:22:58.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.416+0000 7fe65b7fe700 1 -- 172.21.15.111:0/2922514608 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fe654007900 con 0x7fe6640a4720 2024-04-25T02:22:58.576 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.572+0000 7fe669a7f700 1 -- 172.21.15.111:0/2922514608 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe6640a40a0 con 0x7fe6640a4720 2024-04-25T02:22:58.576 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.573+0000 7fe65b7fe700 1 -- 172.21.15.111:0/2922514608 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v21) v1 ==== 74+0+11556 (secure 0 0 0) 0x7fe65402a070 con 0x7fe6640a4720 2024-04-25T02:22:58.576 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:22:58.577 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":21,"fsid":"4643f974-f93a-4436-93b8-460ff320e62e","created":"2024-04-25T02:20:05.450475+0000","modified":"2024-04-25T02:22:57.720872+0000","last_up_change":"2024-04-25T02:20:10.439204+0000","last_in_change":"2024-04-25T02:20:10.439204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:20:07.471248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"11","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:20:14.420378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:20:22.251868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T02:20:23.128289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"df3f17ca-3b12-42c8-8cf7-8f1b7189e587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6800","nonce":40214}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6801","nonce":40214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6803","nonce":40214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6802","nonce":40214}]},"public_addr":"172.21.15.111:6800/40214","cluster_addr":"172.21.15.111:6801/40214","heartbeat_back_addr":"172.21.15.111:6803/40214","heartbeat_front_addr":"172.21.15.111:6802/40214","state":["exists","up"]},{"osd":1,"uuid":"93d54815-f215-4285-bba6-32f2d1cabf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6812","nonce":40216}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6813","nonce":40216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6815","nonce":40216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6814","nonce":40216}]},"public_addr":"172.21.15.111:6812/40216","cluster_addr":"172.21.15.111:6813/40216","heartbeat_back_addr":"172.21.15.111:6815/40216","heartbeat_front_addr":"172.21.15.111:6814/40216","state":["exists","up"]},{"osd":2,"uuid":"b26b2104-2a2e-408f-9ce7-3587a32a2ebe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6804","nonce":40215}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6805","nonce":40215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6807","nonce":40215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6806","nonce":40215}]},"public_addr":"172.21.15.111:6804/40215","cluster_addr":"172.21.15.111:6805/40215","heartbeat_back_addr":"172.21.15.111:6807/40215","heartbeat_front_addr":"172.21.15.111:6806/40215","state":["exists","up"]},{"osd":3,"uuid":"43c25820-1edc-4031-badf-72e87dd6bf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6808","nonce":40213}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6809","nonce":40213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6811","nonce":40213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6810","nonce":40213}]},"public_addr":"172.21.15.111:6808/40213","cluster_addr":"172.21.15.111:6809/40213","heartbeat_back_addr":"172.21.15.111:6811/40213","heartbeat_front_addr":"172.21.15.111:6810/40213","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.372427+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.411480+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.361508+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.377212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.111:0/2148931273":"2024-04-26T02:22:54.713254+0000","172.21.15.111:6816/39585":"2024-04-26T02:22:54.713254+0000","172.21.15.111:0/3911588907":"2024-04-26T02:22:54.713254+0000","172.21.15.111:0/1276843622":"2024-04-26T02:22:54.713254+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:22:58.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.574+0000 7fe669a7f700 1 -- 172.21.15.111:0/2922514608 >> v1:172.21.15.111:6816/46482 conn(0x7fe644045f80 legacy=0x7fe644048430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:58.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.574+0000 7fe669a7f700 1 -- 172.21.15.111:0/2922514608 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe6640a4720 msgr2=0x7fe66414f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:58.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.574+0000 7fe669a7f700 1 --2- 172.21.15.111:0/2922514608 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe6640a4720 0x7fe66414f060 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe6640a72e0 tx=0x7fe654017000 comp rx=0 tx=0).stop 2024-04-25T02:22:58.580 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.574+0000 7fe669a7f700 1 -- 172.21.15.111:0/2922514608 shutdown_connections 2024-04-25T02:22:58.580 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.574+0000 7fe669a7f700 1 --2- 172.21.15.111:0/2922514608 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe6640b06c0 0x7fe66414fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:58.580 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.574+0000 7fe669a7f700 1 --2- 172.21.15.111:0/2922514608 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe6640a4720 0x7fe66414f060 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:58.580 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.574+0000 7fe669a7f700 1 --2- 172.21.15.111:0/2922514608 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe6640a5470 0x7fe66414f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:58.580 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.574+0000 7fe669a7f700 1 -- 172.21.15.111:0/2922514608 >> 172.21.15.111:0/2922514608 conn(0x7fe66406bd70 msgr2=0x7fe66406c140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:58.580 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.574+0000 7fe669a7f700 1 -- 172.21.15.111:0/2922514608 shutdown_connections 2024-04-25T02:22:58.580 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.574+0000 7fe669a7f700 1 -- 172.21.15.111:0/2922514608 wait complete. 2024-04-25T02:22:58.589 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:20:07.471248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '11', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T02:20:14.420378+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:20:22.251868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:20:23.128289+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T02:22:58.590 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:22:58.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.704+0000 7fca79ebf700 1 Processor -- start 2024-04-25T02:22:58.708 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.704+0000 7fca79ebf700 1 -- start start 2024-04-25T02:22:58.713 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.705+0000 7fca79ebf700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fca740b2860 0x7fca740a31d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:58.713 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.705+0000 7fca79ebf700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fca7413ebe0 0x7fca7413efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:58.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.705+0000 7fca79ebf700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fca7406dad0 0x7fca7406df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:58.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.705+0000 7fca79ebf700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca740a3e40 con 0x7fca7413ebe0 2024-04-25T02:22:58.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.705+0000 7fca79ebf700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca7413e940 con 0x7fca740b2860 2024-04-25T02:22:58.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.705+0000 7fca79ebf700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca7406f9d0 con 0x7fca7406dad0 2024-04-25T02:22:58.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.705+0000 7fca72ffd700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fca7413ebe0 0x7fca7413efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:58.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.705+0000 7fca737fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fca740b2860 0x7fca740a31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:58.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.705+0000 7fca73fff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fca7406dad0 0x7fca7406df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:58.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.705+0000 7fca72ffd700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fca7413ebe0 0x7fca7413efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:53578/0 (socket says 172.21.15.111:53578) 2024-04-25T02:22:58.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.705+0000 7fca737fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fca740b2860 0x7fca740a31d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:33236/0 (socket says 172.21.15.111:33236) 2024-04-25T02:22:58.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.705+0000 7fca72ffd700 1 -- 172.21.15.111:0/1309697538 learned_addr learned my addr 172.21.15.111:0/1309697538 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:22:58.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.705+0000 7fca73fff700 1 -- 172.21.15.111:0/1309697538 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fca740b2860 msgr2=0x7fca740a31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:22:58.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.705+0000 7fca73fff700 1 --2- 172.21.15.111:0/1309697538 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fca740b2860 0x7fca740a31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:58.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.705+0000 7fca73fff700 1 -- 172.21.15.111:0/1309697538 >> v2:172.21.15.111:3300/0 conn(0x7fca7413ebe0 msgr2=0x7fca7413efd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:22:58.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.705+0000 7fca73fff700 1 --2- 172.21.15.111:0/1309697538 >> v2:172.21.15.111:3300/0 conn(0x7fca7413ebe0 0x7fca7413efd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:58.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.705+0000 7fca73fff700 1 -- 172.21.15.111:0/1309697538 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca740a24b0 con 0x7fca7406dad0 2024-04-25T02:22:58.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.705+0000 7fca72ffd700 1 --2- 172.21.15.111:0/1309697538 >> v2:172.21.15.111:3300/0 conn(0x7fca7413ebe0 0x7fca7413efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:22:58.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.705+0000 7fca737fe700 1 --2- 172.21.15.111:0/1309697538 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fca740b2860 0x7fca740a31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:22:58.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.706+0000 7fca73fff700 1 --2- 172.21.15.111:0/1309697538 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fca7406dad0 0x7fca7406df70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fca6c00d0d0 tx=0x7fca6c00b990 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8642289829e7d932 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:58.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.706+0000 7fca727fc700 1 -- 172.21.15.111:0/1309697538 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c010070 con 0x7fca7406dad0 2024-04-25T02:22:58.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.706+0000 7fca727fc700 1 -- 172.21.15.111:0/1309697538 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6c00b2e0 con 0x7fca7406dad0 2024-04-25T02:22:58.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.706+0000 7fca727fc700 1 -- 172.21.15.111:0/1309697538 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c00dcd0 con 0x7fca7406dad0 2024-04-25T02:22:58.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.706+0000 7fca79ebf700 1 -- 172.21.15.111:0/1309697538 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fca7406dad0 msgr2=0x7fca7406df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:58.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.706+0000 7fca79ebf700 1 --2- 172.21.15.111:0/1309697538 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fca7406dad0 0x7fca7406df70 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fca6c00d0d0 tx=0x7fca6c00b990 comp rx=0 tx=0).stop 2024-04-25T02:22:58.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.706+0000 7fca79ebf700 1 -- 172.21.15.111:0/1309697538 shutdown_connections 2024-04-25T02:22:58.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.706+0000 7fca79ebf700 1 --2- 172.21.15.111:0/1309697538 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fca7406dad0 0x7fca7406df70 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:58.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.706+0000 7fca79ebf700 1 --2- 172.21.15.111:0/1309697538 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fca740b2860 0x7fca740a31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:58.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.706+0000 7fca79ebf700 1 --2- 172.21.15.111:0/1309697538 >> v2:172.21.15.111:3300/0 conn(0x7fca7413ebe0 0x7fca7413efd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:58.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.706+0000 7fca79ebf700 1 -- 172.21.15.111:0/1309697538 >> 172.21.15.111:0/1309697538 conn(0x7fca7406b0d0 msgr2=0x7fca740b1f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:58.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.706+0000 7fca79ebf700 1 -- 172.21.15.111:0/1309697538 shutdown_connections 2024-04-25T02:22:58.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.706+0000 7fca79ebf700 1 -- 172.21.15.111:0/1309697538 wait complete. 2024-04-25T02:22:58.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.707+0000 7fca79ebf700 1 Processor -- start 2024-04-25T02:22:58.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.707+0000 7fca79ebf700 1 -- start start 2024-04-25T02:22:58.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.708+0000 7fca79ebf700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fca7406dad0 0x7fca7414d320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:58.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.708+0000 7fca79ebf700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fca740b2860 0x7fca7414d860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:58.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.708+0000 7fca79ebf700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fca7413ebe0 0x7fca7414dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:58.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.708+0000 7fca79ebf700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca740acde0 con 0x7fca7406dad0 2024-04-25T02:22:58.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.708+0000 7fca79ebf700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca740aaf20 con 0x7fca740b2860 2024-04-25T02:22:58.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.708+0000 7fca79ebf700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fca740ab1c0 con 0x7fca7413ebe0 2024-04-25T02:22:58.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.708+0000 7fca73fff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fca7413ebe0 0x7fca7414dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:58.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.708+0000 7fca737fe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fca7406dad0 0x7fca7414d320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:58.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.708+0000 7fca73fff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fca7413ebe0 0x7fca7414dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:58182/0 (socket says 172.21.15.111:58182) 2024-04-25T02:22:58.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.708+0000 7fca73fff700 1 -- 172.21.15.111:0/4009079738 learned_addr learned my addr 172.21.15.111:0/4009079738 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:22:58.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.708+0000 7fca72ffd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fca740b2860 0x7fca7414d860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:58.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.708+0000 7fca737fe700 1 --2- 172.21.15.111:0/4009079738 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fca7406dad0 0x7fca7414d320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:53594/0 (socket says 172.21.15.111:53594) 2024-04-25T02:22:58.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.708+0000 7fca73fff700 1 -- 172.21.15.111:0/4009079738 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fca740b2860 msgr2=0x7fca7414d860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:58.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.708+0000 7fca73fff700 1 --2- 172.21.15.111:0/4009079738 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fca740b2860 0x7fca7414d860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:58.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.708+0000 7fca73fff700 1 -- 172.21.15.111:0/4009079738 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fca7406dad0 msgr2=0x7fca7414d320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:58.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.708+0000 7fca73fff700 1 --2- 172.21.15.111:0/4009079738 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fca7406dad0 0x7fca7414d320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:58.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.708+0000 7fca73fff700 1 -- 172.21.15.111:0/4009079738 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca68009420 con 0x7fca7413ebe0 2024-04-25T02:22:58.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.708+0000 7fca72ffd700 1 --2- 172.21.15.111:0/4009079738 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fca740b2860 0x7fca7414d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:22:58.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.708+0000 7fca73fff700 1 --2- 172.21.15.111:0/4009079738 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fca7413ebe0 0x7fca7414dda0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fca7406fb60 tx=0x7fca6c01a000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:58.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.709+0000 7fca5b7fe700 1 -- 172.21.15.111:0/4009079738 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c00abd0 con 0x7fca7413ebe0 2024-04-25T02:22:58.717 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.709+0000 7fca5b7fe700 1 -- 172.21.15.111:0/4009079738 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca6c00ad30 con 0x7fca7413ebe0 2024-04-25T02:22:58.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.709+0000 7fca79ebf700 1 -- 172.21.15.111:0/4009079738 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca640094f0 con 0x7fca7413ebe0 2024-04-25T02:22:58.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.709+0000 7fca5b7fe700 1 -- 172.21.15.111:0/4009079738 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca6c00aea0 con 0x7fca7413ebe0 2024-04-25T02:22:58.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.709+0000 7fca79ebf700 1 -- 172.21.15.111:0/4009079738 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca6c00bc30 con 0x7fca7413ebe0 2024-04-25T02:22:58.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.709+0000 7fca5b7fe700 1 -- 172.21.15.111:0/4009079738 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 9) v1 ==== 53544+0+0 (secure 0 0 0) 0x7fca6c003040 con 0x7fca7413ebe0 2024-04-25T02:22:58.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.710+0000 7fca79ebf700 1 -- 172.21.15.111:0/4009079738 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca7413c8c0 con 0x7fca7413ebe0 2024-04-25T02:22:58.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.710+0000 7fca5b7fe700 1 -- 172.21.15.111:0/4009079738 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 3829+0+0 (secure 0 0 0) 0x7fca6c05e6e0 con 0x7fca7413ebe0 2024-04-25T02:22:58.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.713+0000 7fca5b7fe700 1 -- 172.21.15.111:0/4009079738 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fca6c02abe0 con 0x7fca7413ebe0 2024-04-25T02:22:58.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.908+0000 7fca79ebf700 1 -- 172.21.15.111:0/4009079738 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fca740acf50 con 0x7fca7413ebe0 2024-04-25T02:22:58.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.908+0000 7fca5b7fe700 1 -- 172.21.15.111:0/4009079738 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7fca6c022030 con 0x7fca7413ebe0 2024-04-25T02:22:58.912 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 1 2024-04-25T02:22:58.914 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.910+0000 7fca79ebf700 1 -- 172.21.15.111:0/4009079738 >> v1:172.21.15.111:6816/46482 conn(0x7fca60045f80 legacy=0x7fca60048430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:58.914 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.910+0000 7fca79ebf700 1 -- 172.21.15.111:0/4009079738 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fca7413ebe0 msgr2=0x7fca7414dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:58.914 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.910+0000 7fca79ebf700 1 --2- 172.21.15.111:0/4009079738 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fca7413ebe0 0x7fca7414dda0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fca7406fb60 tx=0x7fca6c01a000 comp rx=0 tx=0).stop 2024-04-25T02:22:58.914 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.910+0000 7fca79ebf700 1 -- 172.21.15.111:0/4009079738 shutdown_connections 2024-04-25T02:22:58.914 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.910+0000 7fca79ebf700 1 --2- 172.21.15.111:0/4009079738 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fca7413ebe0 0x7fca7414dda0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:58.914 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.910+0000 7fca79ebf700 1 --2- 172.21.15.111:0/4009079738 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fca7406dad0 0x7fca7414d320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:58.914 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.910+0000 7fca79ebf700 1 --2- 172.21.15.111:0/4009079738 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fca740b2860 0x7fca7414d860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:58.914 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.910+0000 7fca79ebf700 1 -- 172.21.15.111:0/4009079738 >> 172.21.15.111:0/4009079738 conn(0x7fca7406b0d0 msgr2=0x7fca7413efd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:58.915 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.910+0000 7fca79ebf700 1 -- 172.21.15.111:0/4009079738 shutdown_connections 2024-04-25T02:22:58.915 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:58.910+0000 7fca79ebf700 1 -- 172.21.15.111:0/4009079738 wait complete. 2024-04-25T02:22:58.926 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T02:22:59.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.048+0000 7f6f87f9c700 1 Processor -- start 2024-04-25T02:22:59.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.049+0000 7f6f87f9c700 1 -- start start 2024-04-25T02:22:59.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.049+0000 7f6f87f9c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6f800682a0 0x7f6f800a3d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:59.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.049+0000 7f6f87f9c700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f6f80140160 0x7f6f80147020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:59.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.049+0000 7f6f87f9c700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6f800a4370 con 0x7f6f800a50d0 2024-04-25T02:22:59.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.049+0000 7f6f87f9c700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6f800a4610 con 0x7f6f80140160 2024-04-25T02:22:59.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.049+0000 7f6f87f9c700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f800a38d0 con 0x7f6f800682a0 2024-04-25T02:22:59.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.049+0000 7f6f85d38700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6f800682a0 0x7f6f800a3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:59.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.049+0000 7f6f86539700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f6f80140160 0x7f6f80147020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:59.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.049+0000 7f6f86539700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f6f80140160 0x7f6f80147020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:53624/0 (socket says 172.21.15.111:53624) 2024-04-25T02:22:59.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.049+0000 7f6f85d38700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6f800682a0 0x7f6f800a3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:58212/0 (socket says 172.21.15.111:58212) 2024-04-25T02:22:59.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.049+0000 7f6f85537700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f6f800a50d0 0x7f6f8013fa50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:55542/0 (socket says 172.21.15.111:55542) 2024-04-25T02:22:59.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.049+0000 7f6f85d38700 1 -- 172.21.15.111:0/258889698 learned_addr learned my addr 172.21.15.111:0/258889698 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:22:59.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.050+0000 7f6f86539700 1 -- 172.21.15.111:0/258889698 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6f800682a0 msgr2=0x7f6f800a3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:22:59.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.050+0000 7f6f86539700 1 --2- 172.21.15.111:0/258889698 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6f800682a0 0x7f6f800a3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:59.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.050+0000 7f6f86539700 1 -- 172.21.15.111:0/258889698 >> v1:172.21.15.111:6789/0 conn(0x7f6f800a50d0 legacy=0x7f6f8013fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:59.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.050+0000 7f6f86539700 1 -- 172.21.15.111:0/258889698 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f800b0910 con 0x7f6f80140160 2024-04-25T02:22:59.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.050+0000 7f6f84d36700 1 -- 172.21.15.111:0/258889698 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 169882395 0 0) 0x7f6f800a4370 con 0x7f6f800a50d0 2024-04-25T02:22:59.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.050+0000 7f6f85d38700 1 --2- 172.21.15.111:0/258889698 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6f800682a0 0x7f6f800a3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:22:59.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.050+0000 7f6f86539700 1 --2- 172.21.15.111:0/258889698 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6f80140160 0x7f6f80147020 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6f78009e60 tx=0x7f6f78009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29b574f7694f2420 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:59.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.050+0000 7f6f84d36700 1 -- 172.21.15.111:0/258889698 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7800e070 con 0x7f6f80140160 2024-04-25T02:22:59.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.050+0000 7f6f84d36700 1 -- 172.21.15.111:0/258889698 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f7800bb60 con 0x7f6f80140160 2024-04-25T02:22:59.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.050+0000 7f6f84d36700 1 -- 172.21.15.111:0/258889698 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f78012430 con 0x7f6f80140160 2024-04-25T02:22:59.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.051+0000 7f6f87f9c700 1 -- 172.21.15.111:0/258889698 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6f80140160 msgr2=0x7f6f80147020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:59.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.051+0000 7f6f87f9c700 1 --2- 172.21.15.111:0/258889698 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6f80140160 0x7f6f80147020 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f6f78009e60 tx=0x7f6f78009780 comp rx=0 tx=0).stop 2024-04-25T02:22:59.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.051+0000 7f6f87f9c700 1 -- 172.21.15.111:0/258889698 shutdown_connections 2024-04-25T02:22:59.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.051+0000 7f6f87f9c700 1 --2- 172.21.15.111:0/258889698 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6f80140160 0x7f6f80147020 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:59.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.051+0000 7f6f87f9c700 1 --2- 172.21.15.111:0/258889698 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6f800682a0 0x7f6f800a3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:59.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.051+0000 7f6f87f9c700 1 -- 172.21.15.111:0/258889698 >> 172.21.15.111:0/258889698 conn(0x7f6f8006c080 msgr2=0x7f6f80067940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:59.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.051+0000 7f6f87f9c700 1 -- 172.21.15.111:0/258889698 shutdown_connections 2024-04-25T02:22:59.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.051+0000 7f6f87f9c700 1 -- 172.21.15.111:0/258889698 wait complete. 2024-04-25T02:22:59.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.052+0000 7f6f87f9c700 1 Processor -- start 2024-04-25T02:22:59.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.052+0000 7f6f87f9c700 1 -- start start 2024-04-25T02:22:59.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.052+0000 7f6f87f9c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6f800682a0 0x7f6f80069c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:59.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.052+0000 7f6f87f9c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6f800a50d0 0x7f6f801518c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:59.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.052+0000 7f6f87f9c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6f80140160 0x7f6f80151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:59.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.052+0000 7f6f87f9c700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8006a600 con 0x7f6f800a50d0 2024-04-25T02:22:59.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.052+0000 7f6f87f9c700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6f8006a8a0 con 0x7f6f80140160 2024-04-25T02:22:59.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.052+0000 7f6f87f9c700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6f80068f60 con 0x7f6f800682a0 2024-04-25T02:22:59.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.052+0000 7f6f85d38700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6f800682a0 0x7f6f80069c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:59.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.052+0000 7f6f85d38700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6f800682a0 0x7f6f80069c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:58228/0 (socket says 172.21.15.111:58228) 2024-04-25T02:22:59.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.052+0000 7f6f85d38700 1 -- 172.21.15.111:0/2850512 learned_addr learned my addr 172.21.15.111:0/2850512 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:22:59.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.052+0000 7f6f86539700 1 --2- 172.21.15.111:0/2850512 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6f80140160 0x7f6f80151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:59.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.052+0000 7f6f85537700 1 --2- 172.21.15.111:0/2850512 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6f800a50d0 0x7f6f801518c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:59.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.053+0000 7f6f85d38700 1 -- 172.21.15.111:0/2850512 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6f80140160 msgr2=0x7f6f80151e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:59.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.053+0000 7f6f85d38700 1 --2- 172.21.15.111:0/2850512 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6f80140160 0x7f6f80151e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:59.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.053+0000 7f6f85d38700 1 -- 172.21.15.111:0/2850512 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6f800a50d0 msgr2=0x7f6f801518c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:59.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.053+0000 7f6f85d38700 1 --2- 172.21.15.111:0/2850512 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6f800a50d0 0x7f6f801518c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:59.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.053+0000 7f6f85d38700 1 -- 172.21.15.111:0/2850512 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6f700094f0 con 0x7f6f800682a0 2024-04-25T02:22:59.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.053+0000 7f6f85537700 1 --2- 172.21.15.111:0/2850512 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6f800a50d0 0x7f6f801518c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:22:59.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.053+0000 7f6f85d38700 1 --2- 172.21.15.111:0/2850512 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6f800682a0 0x7f6f80069c30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6f7000ec50 tx=0x7f6f70009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:59.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.053+0000 7f6f75ffb700 1 -- 172.21.15.111:0/2850512 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f70009730 con 0x7f6f800682a0 2024-04-25T02:22:59.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.053+0000 7f6f75ffb700 1 -- 172.21.15.111:0/2850512 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6f7000c850 con 0x7f6f800682a0 2024-04-25T02:22:59.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.053+0000 7f6f87f9c700 1 -- 172.21.15.111:0/2850512 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f78009a20 con 0x7f6f800682a0 2024-04-25T02:22:59.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.053+0000 7f6f75ffb700 1 -- 172.21.15.111:0/2850512 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6f7000cbd0 con 0x7f6f800682a0 2024-04-25T02:22:59.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.053+0000 7f6f87f9c700 1 -- 172.21.15.111:0/2850512 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f8006a330 con 0x7f6f800682a0 2024-04-25T02:22:59.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.054+0000 7f6f87f9c700 1 -- 172.21.15.111:0/2850512 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f800b0ff0 con 0x7f6f800682a0 2024-04-25T02:22:59.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.055+0000 7f6f75ffb700 1 -- 172.21.15.111:0/2850512 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 9) v1 ==== 53544+0+0 (secure 0 0 0) 0x7f6f70013470 con 0x7f6f800682a0 2024-04-25T02:22:59.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.055+0000 7f6f75ffb700 1 -- 172.21.15.111:0/2850512 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f6f7005b920 con 0x7f6f800682a0 2024-04-25T02:22:59.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.058+0000 7f6f75ffb700 1 -- 172.21.15.111:0/2850512 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f6f70039cd0 con 0x7f6f800682a0 2024-04-25T02:22:59.228 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.224+0000 7f6f87f9c700 1 -- 172.21.15.111:0/2850512 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f6f80065190 con 0x7f6f800682a0 2024-04-25T02:22:59.228 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.224+0000 7f6f75ffb700 1 -- 172.21.15.111:0/2850512 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f6f70021030 con 0x7f6f800682a0 2024-04-25T02:22:59.228 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 8 2024-04-25T02:22:59.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.226+0000 7f6f87f9c700 1 -- 172.21.15.111:0/2850512 >> v1:172.21.15.111:6816/46482 conn(0x7f6f64045f80 legacy=0x7f6f64048430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:59.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.226+0000 7f6f87f9c700 1 -- 172.21.15.111:0/2850512 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6f800682a0 msgr2=0x7f6f80069c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:59.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.226+0000 7f6f87f9c700 1 --2- 172.21.15.111:0/2850512 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6f800682a0 0x7f6f80069c30 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f6f7000ec50 tx=0x7f6f70009250 comp rx=0 tx=0).stop 2024-04-25T02:22:59.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.226+0000 7f6f87f9c700 1 -- 172.21.15.111:0/2850512 shutdown_connections 2024-04-25T02:22:59.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.226+0000 7f6f87f9c700 1 --2- 172.21.15.111:0/2850512 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6f80140160 0x7f6f80151e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:59.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.226+0000 7f6f87f9c700 1 --2- 172.21.15.111:0/2850512 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6f800682a0 0x7f6f80069c30 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:59.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.226+0000 7f6f87f9c700 1 --2- 172.21.15.111:0/2850512 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6f800a50d0 0x7f6f801518c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:59.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.226+0000 7f6f87f9c700 1 -- 172.21.15.111:0/2850512 >> 172.21.15.111:0/2850512 conn(0x7f6f8006c080 msgr2=0x7f6f8013f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:59.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.226+0000 7f6f87f9c700 1 -- 172.21.15.111:0/2850512 shutdown_connections 2024-04-25T02:22:59.231 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.226+0000 7f6f87f9c700 1 -- 172.21.15.111:0/2850512 wait complete. 2024-04-25T02:22:59.242 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:22:59.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.361+0000 7feaf4433700 1 Processor -- start 2024-04-25T02:22:59.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.361+0000 7feaf4433700 1 -- start start 2024-04-25T02:22:59.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.362+0000 7feaf4433700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7feaec0a5320 0x7feaec0a6e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:59.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.362+0000 7feaf4433700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7feaec144a70 0x7feaec146e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:59.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.362+0000 7feaf4433700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feaec0685e0 con 0x7feaec068210 2024-04-25T02:22:59.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.362+0000 7feaf4433700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaec0a5730 con 0x7feaec144a70 2024-04-25T02:22:59.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.362+0000 7feaf4433700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feaec13f900 con 0x7feaec0a5320 2024-04-25T02:22:59.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.362+0000 7feaf21cf700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7feaec068210 0x7feaec13ffd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:55546/0 (socket says 172.21.15.111:55546) 2024-04-25T02:22:59.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.362+0000 7feaf21cf700 1 -- 172.21.15.111:0/2520690341 learned_addr learned my addr 172.21.15.111:0/2520690341 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:22:59.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.362+0000 7feaf29d0700 1 --2- 172.21.15.111:0/2520690341 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7feaec144a70 0x7feaec146e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:59.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.362+0000 7feaf19ce700 1 --2- 172.21.15.111:0/2520690341 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7feaec0a5320 0x7feaec0a6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:59.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.362+0000 7feaf11cd700 1 -- 172.21.15.111:0/2520690341 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 134174841 0 0) 0x7feaec0685e0 con 0x7feaec068210 2024-04-25T02:22:59.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.362+0000 7feaf11cd700 1 -- 172.21.15.111:0/2520690341 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fead8003570 con 0x7feaec068210 2024-04-25T02:22:59.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.363+0000 7feaf29d0700 1 -- 172.21.15.111:0/2520690341 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7feaec0a5320 msgr2=0x7feaec0a6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:22:59.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.363+0000 7feaf29d0700 1 --2- 172.21.15.111:0/2520690341 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7feaec0a5320 0x7feaec0a6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:59.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.363+0000 7feaf29d0700 1 -- 172.21.15.111:0/2520690341 >> v1:172.21.15.111:6789/0 conn(0x7feaec068210 legacy=0x7feaec13ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:59.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.363+0000 7feaf29d0700 1 -- 172.21.15.111:0/2520690341 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feaec13fba0 con 0x7feaec144a70 2024-04-25T02:22:59.373 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.363+0000 7feaf29d0700 1 --2- 172.21.15.111:0/2520690341 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7feaec144a70 0x7feaec146e50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7feae4009e90 tx=0x7feae4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4f6eb7949df36680 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:59.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.363+0000 7feaf11cd700 1 -- 172.21.15.111:0/2520690341 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae400e070 con 0x7feaec144a70 2024-04-25T02:22:59.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.363+0000 7feaf11cd700 1 -- 172.21.15.111:0/2520690341 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feae400bb80 con 0x7feaec144a70 2024-04-25T02:22:59.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.363+0000 7feaf11cd700 1 -- 172.21.15.111:0/2520690341 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feae4012430 con 0x7feaec144a70 2024-04-25T02:22:59.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.363+0000 7feaf4433700 1 -- 172.21.15.111:0/2520690341 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7feaec144a70 msgr2=0x7feaec146e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:59.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.363+0000 7feaf4433700 1 --2- 172.21.15.111:0/2520690341 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7feaec144a70 0x7feaec146e50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7feae4009e90 tx=0x7feae4009780 comp rx=0 tx=0).stop 2024-04-25T02:22:59.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.364+0000 7feaf4433700 1 -- 172.21.15.111:0/2520690341 shutdown_connections 2024-04-25T02:22:59.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.364+0000 7feaf4433700 1 --2- 172.21.15.111:0/2520690341 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7feaec144a70 0x7feaec146e50 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:59.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.364+0000 7feaf4433700 1 --2- 172.21.15.111:0/2520690341 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7feaec0a5320 0x7feaec0a6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:59.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.364+0000 7feaf4433700 1 -- 172.21.15.111:0/2520690341 >> 172.21.15.111:0/2520690341 conn(0x7feaec06bfb0 msgr2=0x7feaec067940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:59.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.364+0000 7feaf4433700 1 -- 172.21.15.111:0/2520690341 shutdown_connections 2024-04-25T02:22:59.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.364+0000 7feaf4433700 1 -- 172.21.15.111:0/2520690341 wait complete. 2024-04-25T02:22:59.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.364+0000 7feaf4433700 1 Processor -- start 2024-04-25T02:22:59.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.365+0000 7feaf4433700 1 -- start start 2024-04-25T02:22:59.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.365+0000 7feaf4433700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feaec068210 0x7feaec144220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:59.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.365+0000 7feaf4433700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7feaec0a5320 0x7feaec0a8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:59.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.365+0000 7feaf4433700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7feaec144a70 0x7feaec1553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:59.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.365+0000 7feaf4433700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feaec142c80 con 0x7feaec068210 2024-04-25T02:22:59.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.365+0000 7feaf4433700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feaec142900 con 0x7feaec144a70 2024-04-25T02:22:59.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.365+0000 7feaf4433700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7feaec142eb0 con 0x7feaec0a5320 2024-04-25T02:22:59.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.365+0000 7feaf19ce700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7feaec0a5320 0x7feaec0a8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:59.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.365+0000 7feaf21cf700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feaec068210 0x7feaec144220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:59.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.365+0000 7feaf19ce700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7feaec0a5320 0x7feaec0a8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:58256/0 (socket says 172.21.15.111:58256) 2024-04-25T02:22:59.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.365+0000 7feaf19ce700 1 -- 172.21.15.111:0/3718542409 learned_addr learned my addr 172.21.15.111:0/3718542409 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:22:59.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.365+0000 7feaf29d0700 1 --2- 172.21.15.111:0/3718542409 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7feaec144a70 0x7feaec1553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:59.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.366+0000 7feaf19ce700 1 -- 172.21.15.111:0/3718542409 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7feaec144a70 msgr2=0x7feaec1553b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:59.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.366+0000 7feaf19ce700 1 --2- 172.21.15.111:0/3718542409 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7feaec144a70 0x7feaec1553b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:59.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.366+0000 7feaf19ce700 1 -- 172.21.15.111:0/3718542409 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feaec068210 msgr2=0x7feaec144220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:59.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.366+0000 7feaf19ce700 1 --2- 172.21.15.111:0/3718542409 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feaec068210 0x7feaec144220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:59.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.366+0000 7feaf19ce700 1 -- 172.21.15.111:0/3718542409 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feae4009a20 con 0x7feaec0a5320 2024-04-25T02:22:59.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.366+0000 7feaf29d0700 1 --2- 172.21.15.111:0/3718542409 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7feaec144a70 0x7feaec1553b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:22:59.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.366+0000 7feaf21cf700 1 --2- 172.21.15.111:0/3718542409 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feaec068210 0x7feaec144220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:22:59.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.366+0000 7feaf19ce700 1 --2- 172.21.15.111:0/3718542409 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7feaec0a5320 0x7feaec0a8190 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7feadc00ec80 tx=0x7feadc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:59.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.386+0000 7feae27fc700 1 -- 172.21.15.111:0/3718542409 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feadc00c8e0 con 0x7feaec0a5320 2024-04-25T02:22:59.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.386+0000 7feaf4433700 1 -- 172.21.15.111:0/3718542409 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feaec143170 con 0x7feaec0a5320 2024-04-25T02:22:59.390 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.386+0000 7feaf4433700 1 -- 172.21.15.111:0/3718542409 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feaec141ca0 con 0x7feaec0a5320 2024-04-25T02:22:59.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.387+0000 7feae27fc700 1 -- 172.21.15.111:0/3718542409 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feadc00ca40 con 0x7feaec0a5320 2024-04-25T02:22:59.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.387+0000 7feae27fc700 1 -- 172.21.15.111:0/3718542409 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feadc00cde0 con 0x7feaec0a5320 2024-04-25T02:22:59.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.387+0000 7feae27fc700 1 -- 172.21.15.111:0/3718542409 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 9) v1 ==== 53544+0+0 (secure 0 0 0) 0x7feadc013680 con 0x7feaec0a5320 2024-04-25T02:22:59.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.387+0000 7feae27fc700 1 -- 172.21.15.111:0/3718542409 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3840+0+0 (secure 0 0 0) 0x7feadc05b670 con 0x7feaec0a5320 2024-04-25T02:22:59.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.387+0000 7feaf4433700 1 -- 172.21.15.111:0/3718542409 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fead40052a0 con 0x7feaec0a5320 2024-04-25T02:22:59.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.392+0000 7feae27fc700 1 -- 172.21.15.111:0/3718542409 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7feadc039bd0 con 0x7feaec0a5320 2024-04-25T02:22:59.552 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.548+0000 7feaf4433700 1 -- 172.21.15.111:0/3718542409 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fead4005ad0 con 0x7feaec0a5320 2024-04-25T02:22:59.552 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.549+0000 7feae27fc700 1 -- 172.21.15.111:0/3718542409 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7feadc03d1f0 con 0x7feaec0a5320 2024-04-25T02:22:59.552 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 32 2024-04-25T02:22:59.554 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.550+0000 7feaf4433700 1 -- 172.21.15.111:0/3718542409 >> v1:172.21.15.111:6816/46482 conn(0x7fead0045f80 legacy=0x7fead0048430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:59.554 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.550+0000 7feaf4433700 1 -- 172.21.15.111:0/3718542409 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7feaec0a5320 msgr2=0x7feaec0a8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:59.554 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.550+0000 7feaf4433700 1 --2- 172.21.15.111:0/3718542409 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7feaec0a5320 0x7feaec0a8190 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7feadc00ec80 tx=0x7feadc0091a0 comp rx=0 tx=0).stop 2024-04-25T02:22:59.554 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.550+0000 7feaf4433700 1 -- 172.21.15.111:0/3718542409 shutdown_connections 2024-04-25T02:22:59.555 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.550+0000 7feaf4433700 1 --2- 172.21.15.111:0/3718542409 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7feaec144a70 0x7feaec1553b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:59.555 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.550+0000 7feaf4433700 1 --2- 172.21.15.111:0/3718542409 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7feaec068210 0x7feaec144220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:59.555 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.550+0000 7feaf4433700 1 --2- 172.21.15.111:0/3718542409 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7feaec0a5320 0x7feaec0a8190 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:59.555 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.550+0000 7feaf4433700 1 -- 172.21.15.111:0/3718542409 >> 172.21.15.111:0/3718542409 conn(0x7feaec06bfb0 msgr2=0x7feaec0b24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:59.555 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.550+0000 7feaf4433700 1 -- 172.21.15.111:0/3718542409 shutdown_connections 2024-04-25T02:22:59.555 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.550+0000 7feaf4433700 1 -- 172.21.15.111:0/3718542409 wait complete. 2024-04-25T02:22:59.566 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:22:59.684 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.680+0000 7f78a7843700 1 Processor -- start 2024-04-25T02:22:59.684 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.680+0000 7f78a7843700 1 -- start start 2024-04-25T02:22:59.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.681+0000 7f78a7843700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f78a0068c70 0x7f78a0067940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:59.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.681+0000 7f78a7843700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f78a006e6f0 0x7f78a00a3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:59.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.681+0000 7f78a7843700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78a00a47a0 con 0x7f78a006e2e0 2024-04-25T02:22:59.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.681+0000 7f78a7843700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a0067e80 con 0x7f78a0068c70 2024-04-25T02:22:59.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.681+0000 7f78a7843700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78a00a23f0 con 0x7f78a006e6f0 2024-04-25T02:22:59.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.681+0000 7f78a55df700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f78a0068c70 0x7f78a0067940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:59.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.681+0000 7f78a5de0700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f78a006e6f0 0x7f78a00a3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:59.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.681+0000 7f78a4dde700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f78a006e2e0 0x7f78a00a35f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:55550/0 (socket says 172.21.15.111:55550) 2024-04-25T02:22:59.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.681+0000 7f78a4dde700 1 -- 172.21.15.111:0/2266763034 learned_addr learned my addr 172.21.15.111:0/2266763034 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:22:59.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.681+0000 7f7897fff700 1 -- 172.21.15.111:0/2266763034 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3437068406 0 0) 0x7f78a00a47a0 con 0x7f78a006e2e0 2024-04-25T02:22:59.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.681+0000 7f78a55df700 1 -- 172.21.15.111:0/2266763034 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f78a006e6f0 msgr2=0x7f78a00a3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:22:59.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.681+0000 7f78a55df700 1 --2- 172.21.15.111:0/2266763034 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f78a006e6f0 0x7f78a00a3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:59.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.681+0000 7f78a55df700 1 -- 172.21.15.111:0/2266763034 >> v1:172.21.15.111:6789/0 conn(0x7f78a006e2e0 legacy=0x7f78a00a35f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:59.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.681+0000 7f78a55df700 1 -- 172.21.15.111:0/2266763034 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78a0068070 con 0x7f78a0068c70 2024-04-25T02:22:59.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.681+0000 7f78a5de0700 1 --2- 172.21.15.111:0/2266763034 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f78a006e6f0 0x7f78a00a3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:22:59.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.681+0000 7f78a55df700 1 --2- 172.21.15.111:0/2266763034 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f78a0068c70 0x7f78a0067940 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7890009910 tx=0x7f78900091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65878cf9b6541d02 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:59.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.681+0000 7f7897fff700 1 -- 172.21.15.111:0/2266763034 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789000b680 con 0x7f78a0068c70 2024-04-25T02:22:59.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.682+0000 7f7897fff700 1 -- 172.21.15.111:0/2266763034 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f789000b7e0 con 0x7f78a0068c70 2024-04-25T02:22:59.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.682+0000 7f7897fff700 1 -- 172.21.15.111:0/2266763034 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789000bba0 con 0x7f78a0068c70 2024-04-25T02:22:59.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.682+0000 7f78a7843700 1 -- 172.21.15.111:0/2266763034 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f78a0068c70 msgr2=0x7f78a0067940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:59.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.682+0000 7f78a7843700 1 --2- 172.21.15.111:0/2266763034 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f78a0068c70 0x7f78a0067940 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f7890009910 tx=0x7f78900091a0 comp rx=0 tx=0).stop 2024-04-25T02:22:59.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.682+0000 7f78a7843700 1 -- 172.21.15.111:0/2266763034 shutdown_connections 2024-04-25T02:22:59.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.682+0000 7f78a7843700 1 --2- 172.21.15.111:0/2266763034 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f78a006e6f0 0x7f78a00a3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:59.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.682+0000 7f78a7843700 1 --2- 172.21.15.111:0/2266763034 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f78a0068c70 0x7f78a0067940 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:59.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.682+0000 7f78a7843700 1 -- 172.21.15.111:0/2266763034 >> 172.21.15.111:0/2266763034 conn(0x7f78a006ce40 msgr2=0x7f78a006af80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:59.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.682+0000 7f78a7843700 1 -- 172.21.15.111:0/2266763034 shutdown_connections 2024-04-25T02:22:59.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.682+0000 7f78a7843700 1 -- 172.21.15.111:0/2266763034 wait complete. 2024-04-25T02:22:59.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.683+0000 7f78a7843700 1 Processor -- start 2024-04-25T02:22:59.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.683+0000 7f78a7843700 1 -- start start 2024-04-25T02:22:59.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.684+0000 7f78a7843700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78a0068c70 0x7f78a0099440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:59.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.684+0000 7f78a7843700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f78a006e2e0 0x7f78a0096e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:59.691 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.684+0000 7f78a7843700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f78a006e6f0 0x7f78a01517a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:59.691 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.684+0000 7f78a7843700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78a00977e0 con 0x7f78a0068c70 2024-04-25T02:22:59.691 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.684+0000 7f78a7843700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78a0097350 con 0x7f78a006e2e0 2024-04-25T02:22:59.691 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.684+0000 7f78a7843700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78a0098870 con 0x7f78a006e6f0 2024-04-25T02:22:59.691 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.684+0000 7f78a55df700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78a0068c70 0x7f78a0099440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:59.691 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.684+0000 7f78a5de0700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f78a006e6f0 0x7f78a01517a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:59.691 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.684+0000 7f78a55df700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78a0068c70 0x7f78a0099440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:53656/0 (socket says 172.21.15.111:53656) 2024-04-25T02:22:59.691 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.684+0000 7f78a4dde700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f78a006e2e0 0x7f78a0096e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:59.691 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.684+0000 7f78a55df700 1 -- 172.21.15.111:0/71867022 learned_addr learned my addr 172.21.15.111:0/71867022 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:22:59.691 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.684+0000 7f78a4dde700 1 -- 172.21.15.111:0/71867022 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f78a006e6f0 msgr2=0x7f78a01517a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:59.691 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.684+0000 7f78a4dde700 1 --2- 172.21.15.111:0/71867022 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f78a006e6f0 0x7f78a01517a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:59.691 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.684+0000 7f78a4dde700 1 -- 172.21.15.111:0/71867022 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78a0068c70 msgr2=0x7f78a0099440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:59.691 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.684+0000 7f78a4dde700 1 --2- 172.21.15.111:0/71867022 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78a0068c70 0x7f78a0099440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:59.691 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.684+0000 7f78a4dde700 1 -- 172.21.15.111:0/71867022 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7898009a20 con 0x7f78a006e2e0 2024-04-25T02:22:59.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.684+0000 7f78a55df700 1 --2- 172.21.15.111:0/71867022 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78a0068c70 0x7f78a0099440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:22:59.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.684+0000 7f78a4dde700 1 --2- 172.21.15.111:0/71867022 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f78a006e2e0 0x7f78a0096e10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f78a00b1d60 tx=0x7f789c007f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:59.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.684+0000 7f78957fa700 1 -- 172.21.15.111:0/71867022 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c00ce20 con 0x7f78a006e2e0 2024-04-25T02:22:59.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.685+0000 7f78957fa700 1 -- 172.21.15.111:0/71867022 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f789c005b30 con 0x7f78a006e2e0 2024-04-25T02:22:59.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.685+0000 7f78957fa700 1 -- 172.21.15.111:0/71867022 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f789c0070d0 con 0x7f78a006e2e0 2024-04-25T02:22:59.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.685+0000 7f78a7843700 1 -- 172.21.15.111:0/71867022 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7890009420 con 0x7f78a006e2e0 2024-04-25T02:22:59.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.685+0000 7f78a7843700 1 -- 172.21.15.111:0/71867022 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78a0096bb0 con 0x7f78a006e2e0 2024-04-25T02:22:59.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.685+0000 7f78957fa700 1 -- 172.21.15.111:0/71867022 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 9) v1 ==== 53544+0+0 (secure 0 0 0) 0x7f789c0074c0 con 0x7f78a006e2e0 2024-04-25T02:22:59.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.686+0000 7f78a7843700 1 -- 172.21.15.111:0/71867022 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78a0098c40 con 0x7f78a006e2e0 2024-04-25T02:22:59.692 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.686+0000 7f78957fa700 1 -- 172.21.15.111:0/71867022 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f789c05a310 con 0x7f78a006e2e0 2024-04-25T02:22:59.693 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.690+0000 7f78957fa700 1 -- 172.21.15.111:0/71867022 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f789c0386a0 con 0x7f78a006e2e0 2024-04-25T02:22:59.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.848+0000 7f78a7843700 1 -- 172.21.15.111:0/71867022 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f78a0065190 con 0x7f78a006e2e0 2024-04-25T02:22:59.852 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.849+0000 7f78957fa700 1 -- 172.21.15.111:0/71867022 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f789c017020 con 0x7f78a006e2e0 2024-04-25T02:22:59.853 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 64 2024-04-25T02:22:59.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.850+0000 7f78a7843700 1 -- 172.21.15.111:0/71867022 >> v1:172.21.15.111:6816/46482 conn(0x7f7884045fb0 legacy=0x7f7884048460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:59.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.850+0000 7f78a7843700 1 -- 172.21.15.111:0/71867022 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f78a006e2e0 msgr2=0x7f78a0096e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:59.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.850+0000 7f78a7843700 1 --2- 172.21.15.111:0/71867022 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f78a006e2e0 0x7f78a0096e10 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f78a00b1d60 tx=0x7f789c007f30 comp rx=0 tx=0).stop 2024-04-25T02:22:59.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.850+0000 7f78a7843700 1 -- 172.21.15.111:0/71867022 shutdown_connections 2024-04-25T02:22:59.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.850+0000 7f78a7843700 1 --2- 172.21.15.111:0/71867022 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f78a006e6f0 0x7f78a01517a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:59.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.850+0000 7f78a7843700 1 --2- 172.21.15.111:0/71867022 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78a0068c70 0x7f78a0099440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:59.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.850+0000 7f78a7843700 1 --2- 172.21.15.111:0/71867022 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f78a006e2e0 0x7f78a0096e10 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:59.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.850+0000 7f78a7843700 1 -- 172.21.15.111:0/71867022 >> 172.21.15.111:0/71867022 conn(0x7f78a006ce40 msgr2=0x7f78a00b24e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:59.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.851+0000 7f78a7843700 1 -- 172.21.15.111:0/71867022 shutdown_connections 2024-04-25T02:22:59.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.851+0000 7f78a7843700 1 -- 172.21.15.111:0/71867022 wait complete. 2024-04-25T02:22:59.866 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:22:59.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.977+0000 7f88a8eb6700 1 Processor -- start 2024-04-25T02:22:59.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.977+0000 7f88a8eb6700 1 -- start start 2024-04-25T02:22:59.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.978+0000 7f88a8eb6700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f88a40a3ef0 0x7f88a4068050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:59.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.978+0000 7f88a8eb6700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f88a41475c0 0x7f88a41499a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:59.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.978+0000 7f88a8eb6700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88a406e4f0 con 0x7f88a40b2170 2024-04-25T02:22:59.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.978+0000 7f88a8eb6700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88a406df00 con 0x7f88a40a3ef0 2024-04-25T02:22:59.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.978+0000 7f88a8eb6700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88a40a3ab0 con 0x7f88a41475c0 2024-04-25T02:22:59.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.978+0000 7f88a1d9b700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f88a40a3ef0 0x7f88a4068050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:59.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.978+0000 7f88a2d9d700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f88a41475c0 0x7f88a41499a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:59.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.978+0000 7f88a1d9b700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f88a40a3ef0 0x7f88a4068050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:53668/0 (socket says 172.21.15.111:53668) 2024-04-25T02:22:59.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.978+0000 7f88a259c700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f88a40b2170 0x7f88a4067940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:55560/0 (socket says 172.21.15.111:55560) 2024-04-25T02:22:59.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.978+0000 7f88a1d9b700 1 -- 172.21.15.111:0/3154898449 learned_addr learned my addr 172.21.15.111:0/3154898449 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:22:59.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.978+0000 7f88a2d9d700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f88a41475c0 0x7f88a41499a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:58282/0 (socket says 172.21.15.111:58282) 2024-04-25T02:22:59.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.978+0000 7f88a1d9b700 1 -- 172.21.15.111:0/3154898449 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f88a41475c0 msgr2=0x7f88a41499a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:22:59.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.978+0000 7f88a1d9b700 1 --2- 172.21.15.111:0/3154898449 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f88a41475c0 0x7f88a41499a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:59.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.978+0000 7f88a1d9b700 1 -- 172.21.15.111:0/3154898449 >> v1:172.21.15.111:6789/0 conn(0x7f88a40b2170 legacy=0x7f88a4067940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:59.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.978+0000 7f88a1d9b700 1 -- 172.21.15.111:0/3154898449 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88a40af360 con 0x7f88a40a3ef0 2024-04-25T02:22:59.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.978+0000 7f88a2d9d700 1 --2- 172.21.15.111:0/3154898449 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f88a41475c0 0x7f88a41499a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:22:59.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.978+0000 7f88a1d9b700 1 --2- 172.21.15.111:0/3154898449 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f88a40a3ef0 0x7f88a4068050 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f88940099b0 tx=0x7f8894009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7c2ad39bcee910b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:59.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.978+0000 7f88a159a700 1 -- 172.21.15.111:0/3154898449 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8894009ea0 con 0x7f88a40a3ef0 2024-04-25T02:22:59.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.978+0000 7f88a159a700 1 -- 172.21.15.111:0/3154898449 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f889400b860 con 0x7f88a40a3ef0 2024-04-25T02:22:59.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.978+0000 7f88a159a700 1 -- 172.21.15.111:0/3154898449 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f889400bc00 con 0x7f88a40a3ef0 2024-04-25T02:22:59.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.979+0000 7f88a8eb6700 1 -- 172.21.15.111:0/3154898449 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f88a40a3ef0 msgr2=0x7f88a4068050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:59.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.979+0000 7f88a8eb6700 1 --2- 172.21.15.111:0/3154898449 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f88a40a3ef0 0x7f88a4068050 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f88940099b0 tx=0x7f8894009250 comp rx=0 tx=0).stop 2024-04-25T02:22:59.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.979+0000 7f88a8eb6700 1 -- 172.21.15.111:0/3154898449 shutdown_connections 2024-04-25T02:22:59.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.979+0000 7f88a8eb6700 1 --2- 172.21.15.111:0/3154898449 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f88a41475c0 0x7f88a41499a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:59.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.979+0000 7f88a8eb6700 1 --2- 172.21.15.111:0/3154898449 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f88a40a3ef0 0x7f88a4068050 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:59.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.979+0000 7f88a8eb6700 1 -- 172.21.15.111:0/3154898449 >> 172.21.15.111:0/3154898449 conn(0x7f88a406d200 msgr2=0x7f88a406aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:22:59.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.979+0000 7f88a8eb6700 1 -- 172.21.15.111:0/3154898449 shutdown_connections 2024-04-25T02:22:59.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.979+0000 7f88a8eb6700 1 -- 172.21.15.111:0/3154898449 wait complete. 2024-04-25T02:22:59.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.980+0000 7f88a8eb6700 1 Processor -- start 2024-04-25T02:22:59.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.980+0000 7f88a8eb6700 1 -- start start 2024-04-25T02:22:59.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.980+0000 7f88a8eb6700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f88a40a3ef0 0x7f88a40addd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:59.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.980+0000 7f88a8eb6700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f88a40b2170 0x7f88a414e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:59.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.980+0000 7f88a8eb6700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f88a41475c0 0x7f88a414ea90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:22:59.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.980+0000 7f88a8eb6700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88a40ad8d0 con 0x7f88a40b2170 2024-04-25T02:22:59.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.980+0000 7f88a8eb6700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88a40ad5f0 con 0x7f88a41475c0 2024-04-25T02:22:59.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.980+0000 7f88a8eb6700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f88a414e240 con 0x7f88a40a3ef0 2024-04-25T02:22:59.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.981+0000 7f88a259c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f88a40a3ef0 0x7f88a40addd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:59.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.981+0000 7f88a1d9b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f88a40b2170 0x7f88a414e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:59.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.981+0000 7f88a259c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f88a40a3ef0 0x7f88a40addd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:58288/0 (socket says 172.21.15.111:58288) 2024-04-25T02:22:59.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.981+0000 7f88a259c700 1 -- 172.21.15.111:0/2424998326 learned_addr learned my addr 172.21.15.111:0/2424998326 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:22:59.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.981+0000 7f88a1d9b700 1 --2- 172.21.15.111:0/2424998326 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f88a40b2170 0x7f88a414e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:53680/0 (socket says 172.21.15.111:53680) 2024-04-25T02:22:59.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.981+0000 7f88a2d9d700 1 --2- 172.21.15.111:0/2424998326 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f88a41475c0 0x7f88a414ea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:22:59.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.981+0000 7f88a259c700 1 -- 172.21.15.111:0/2424998326 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f88a41475c0 msgr2=0x7f88a414ea90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:59.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.981+0000 7f88a259c700 1 --2- 172.21.15.111:0/2424998326 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f88a41475c0 0x7f88a414ea90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:59.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.981+0000 7f88a259c700 1 -- 172.21.15.111:0/2424998326 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f88a40b2170 msgr2=0x7f88a414e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:22:59.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.981+0000 7f88a259c700 1 --2- 172.21.15.111:0/2424998326 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f88a40b2170 0x7f88a414e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:22:59.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.981+0000 7f88a259c700 1 -- 172.21.15.111:0/2424998326 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f889c009a20 con 0x7f88a40a3ef0 2024-04-25T02:22:59.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.981+0000 7f88a1d9b700 1 --2- 172.21.15.111:0/2424998326 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f88a40b2170 0x7f88a414e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:22:59.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.981+0000 7f88a259c700 1 --2- 172.21.15.111:0/2424998326 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f88a40a3ef0 0x7f88a40addd0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f889800c7c0 tx=0x7f8898007f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:22:59.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.981+0000 7f88927fc700 1 -- 172.21.15.111:0/2424998326 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8898005a70 con 0x7f88a40a3ef0 2024-04-25T02:22:59.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.981+0000 7f88927fc700 1 -- 172.21.15.111:0/2424998326 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8898005bd0 con 0x7f88a40a3ef0 2024-04-25T02:22:59.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.981+0000 7f88927fc700 1 -- 172.21.15.111:0/2424998326 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88980070d0 con 0x7f88a40a3ef0 2024-04-25T02:22:59.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.981+0000 7f88a8eb6700 1 -- 172.21.15.111:0/2424998326 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88940094f0 con 0x7f88a40a3ef0 2024-04-25T02:22:59.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.981+0000 7f88a8eb6700 1 -- 172.21.15.111:0/2424998326 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88a40ae310 con 0x7f88a40a3ef0 2024-04-25T02:22:59.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.982+0000 7f88a8eb6700 1 -- 172.21.15.111:0/2424998326 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88a4071790 con 0x7f88a40a3ef0 2024-04-25T02:22:59.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.982+0000 7f88927fc700 1 -- 172.21.15.111:0/2424998326 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 9) v1 ==== 53544+0+0 (secure 0 0 0) 0x7f8898007480 con 0x7f88a40a3ef0 2024-04-25T02:22:59.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.983+0000 7f88927fc700 1 -- 172.21.15.111:0/2424998326 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f889805a4b0 con 0x7f88a40a3ef0 2024-04-25T02:22:59.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:22:59.986+0000 7f88927fc700 1 -- 172.21.15.111:0/2424998326 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f8898038900 con 0x7f88a40a3ef0 2024-04-25T02:23:00.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.167+0000 7f88a8eb6700 1 -- 172.21.15.111:0/2424998326 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88a40aa490 con 0x7f88a40a3ef0 2024-04-25T02:23:00.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.168+0000 7f88927fc700 1 -- 172.21.15.111:0/2424998326 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+3667 (secure 0 0 0) 0x7f8898017020 con 0x7f88a40a3ef0 2024-04-25T02:23:00.172 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:23:00.172 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4193,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6817/3699616235","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6817","nonce":3699616235}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4655,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6818/3127437614","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6818","nonce":3127437614}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:20:24.150791+0000","modified":"2024-04-25T02:21:11.248656+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4239},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_4239":{"gid":4239,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.111:6819/4003866251","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6819","nonce":4003866251}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-25T02:23:00.173 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.169+0000 7f88a8eb6700 1 -- 172.21.15.111:0/2424998326 >> v1:172.21.15.111:6816/46482 conn(0x7f8884045f80 legacy=0x7f8884048430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:00.173 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.169+0000 7f88a8eb6700 1 -- 172.21.15.111:0/2424998326 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f88a40a3ef0 msgr2=0x7f88a40addd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:00.173 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.169+0000 7f88a8eb6700 1 --2- 172.21.15.111:0/2424998326 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f88a40a3ef0 0x7f88a40addd0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f889800c7c0 tx=0x7f8898007f70 comp rx=0 tx=0).stop 2024-04-25T02:23:00.174 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.169+0000 7f88a8eb6700 1 -- 172.21.15.111:0/2424998326 shutdown_connections 2024-04-25T02:23:00.174 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.169+0000 7f88a8eb6700 1 --2- 172.21.15.111:0/2424998326 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f88a41475c0 0x7f88a414ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:00.174 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.169+0000 7f88a8eb6700 1 --2- 172.21.15.111:0/2424998326 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f88a40a3ef0 0x7f88a40addd0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:00.174 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.169+0000 7f88a8eb6700 1 --2- 172.21.15.111:0/2424998326 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f88a40b2170 0x7f88a414e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:00.174 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.169+0000 7f88a8eb6700 1 -- 172.21.15.111:0/2424998326 >> 172.21.15.111:0/2424998326 conn(0x7f88a406d200 msgr2=0x7f88a4068090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:00.174 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.170+0000 7f88a8eb6700 1 -- 172.21.15.111:0/2424998326 shutdown_connections 2024-04-25T02:23:00.174 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.170+0000 7f88a8eb6700 1 -- 172.21.15.111:0/2424998326 wait complete. 2024-04-25T02:23:00.174 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 13 2024-04-25T02:23:00.185 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:23:00.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.297+0000 7fcf8b9d4700 1 Processor -- start 2024-04-25T02:23:00.301 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.298+0000 7fcf8b9d4700 1 -- start start 2024-04-25T02:23:00.303 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.298+0000 7fcf8b9d4700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcf84068a50 0x7fcf8406f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:00.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.298+0000 7fcf8b9d4700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fcf8406db40 0x7fcf8406df10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:00.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.298+0000 7fcf8b9d4700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fcf8413b510 0x7fcf8413b990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:00.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.298+0000 7fcf8b9d4700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf8413aed0 con 0x7fcf8413b510 2024-04-25T02:23:00.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.298+0000 7fcf8b9d4700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8406f990 con 0x7fcf84068a50 2024-04-25T02:23:00.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.298+0000 7fcf8b9d4700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf8406ec70 con 0x7fcf8406db40 2024-04-25T02:23:00.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.298+0000 7fcf89770700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcf84068a50 0x7fcf8406f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:00.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.298+0000 7fcf89f71700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fcf8413b510 0x7fcf8413b990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:00.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.298+0000 7fcf88f6f700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fcf8406db40 0x7fcf8406df10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:00.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.298+0000 7fcf89f71700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fcf8413b510 0x7fcf8413b990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44456/0 (socket says 172.21.15.111:44456) 2024-04-25T02:23:00.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.298+0000 7fcf89770700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcf84068a50 0x7fcf8406f450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:50108/0 (socket says 172.21.15.111:50108) 2024-04-25T02:23:00.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.298+0000 7fcf89f71700 1 -- 172.21.15.111:0/1455660595 learned_addr learned my addr 172.21.15.111:0/1455660595 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:00.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.298+0000 7fcf88f6f700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fcf8406db40 0x7fcf8406df10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:35240/0 (socket says 172.21.15.111:35240) 2024-04-25T02:23:00.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.298+0000 7fcf89770700 1 -- 172.21.15.111:0/1455660595 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fcf8406db40 msgr2=0x7fcf8406df10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:00.304 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.298+0000 7fcf89770700 1 --2- 172.21.15.111:0/1455660595 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fcf8406db40 0x7fcf8406df10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:00.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.298+0000 7fcf89770700 1 -- 172.21.15.111:0/1455660595 >> v2:172.21.15.111:3300/0 conn(0x7fcf8413b510 msgr2=0x7fcf8413b990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:00.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.298+0000 7fcf89770700 1 --2- 172.21.15.111:0/1455660595 >> v2:172.21.15.111:3300/0 conn(0x7fcf8413b510 0x7fcf8413b990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:00.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.298+0000 7fcf89770700 1 -- 172.21.15.111:0/1455660595 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf8406e510 con 0x7fcf84068a50 2024-04-25T02:23:00.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.299+0000 7fcf88f6f700 1 --2- 172.21.15.111:0/1455660595 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fcf8406db40 0x7fcf8406df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:00.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.299+0000 7fcf89f71700 1 --2- 172.21.15.111:0/1455660595 >> v2:172.21.15.111:3300/0 conn(0x7fcf8413b510 0x7fcf8413b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:00.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.299+0000 7fcf89770700 1 --2- 172.21.15.111:0/1455660595 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcf84068a50 0x7fcf8406f450 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcf74009910 tx=0x7fcf740091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58990ecf6ed3d7f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:00.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.299+0000 7fcf7bfff700 1 -- 172.21.15.111:0/1455660595 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf74011630 con 0x7fcf84068a50 2024-04-25T02:23:00.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.299+0000 7fcf7bfff700 1 -- 172.21.15.111:0/1455660595 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf74011790 con 0x7fcf84068a50 2024-04-25T02:23:00.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.299+0000 7fcf7bfff700 1 -- 172.21.15.111:0/1455660595 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf74011b30 con 0x7fcf84068a50 2024-04-25T02:23:00.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.299+0000 7fcf8b9d4700 1 -- 172.21.15.111:0/1455660595 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcf84068a50 msgr2=0x7fcf8406f450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:00.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.299+0000 7fcf8b9d4700 1 --2- 172.21.15.111:0/1455660595 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcf84068a50 0x7fcf8406f450 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fcf74009910 tx=0x7fcf740091a0 comp rx=0 tx=0).stop 2024-04-25T02:23:00.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.299+0000 7fcf8b9d4700 1 -- 172.21.15.111:0/1455660595 shutdown_connections 2024-04-25T02:23:00.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.299+0000 7fcf8b9d4700 1 --2- 172.21.15.111:0/1455660595 >> v2:172.21.15.111:3300/0 conn(0x7fcf8413b510 0x7fcf8413b990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:00.305 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.299+0000 7fcf8b9d4700 1 --2- 172.21.15.111:0/1455660595 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcf84068a50 0x7fcf8406f450 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:00.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.299+0000 7fcf8b9d4700 1 --2- 172.21.15.111:0/1455660595 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fcf8406db40 0x7fcf8406df10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:00.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.299+0000 7fcf8b9d4700 1 -- 172.21.15.111:0/1455660595 >> 172.21.15.111:0/1455660595 conn(0x7fcf8406ce40 msgr2=0x7fcf8406af80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:00.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.299+0000 7fcf8b9d4700 1 -- 172.21.15.111:0/1455660595 shutdown_connections 2024-04-25T02:23:00.306 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.299+0000 7fcf8b9d4700 1 -- 172.21.15.111:0/1455660595 wait complete. 2024-04-25T02:23:00.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.300+0000 7fcf8b9d4700 1 Processor -- start 2024-04-25T02:23:00.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.300+0000 7fcf8b9d4700 1 -- start start 2024-04-25T02:23:00.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.301+0000 7fcf8b9d4700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fcf84068a50 0x7fcf840a8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:00.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.301+0000 7fcf8b9d4700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcf8406db40 0x7fcf84137940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:00.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.301+0000 7fcf8b9d4700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcf8413b510 0x7fcf84137e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:00.308 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.301+0000 7fcf8b9d4700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf840a8ba0 con 0x7fcf8413b510 2024-04-25T02:23:00.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.301+0000 7fcf8b9d4700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf840a6790 con 0x7fcf8406db40 2024-04-25T02:23:00.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.301+0000 7fcf8b9d4700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcf840aa520 con 0x7fcf84068a50 2024-04-25T02:23:00.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.301+0000 7fcf89770700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fcf84068a50 0x7fcf840a8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:00.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.301+0000 7fcf88f6f700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcf8406db40 0x7fcf84137940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:00.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.301+0000 7fcf89f71700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcf8413b510 0x7fcf84137e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:00.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.301+0000 7fcf89770700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fcf84068a50 0x7fcf840a8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:35250/0 (socket says 172.21.15.111:35250) 2024-04-25T02:23:00.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.301+0000 7fcf89f71700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcf8413b510 0x7fcf84137e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44468/0 (socket says 172.21.15.111:44468) 2024-04-25T02:23:00.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.301+0000 7fcf89770700 1 -- 172.21.15.111:0/672407772 learned_addr learned my addr 172.21.15.111:0/672407772 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:00.309 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.301+0000 7fcf89770700 1 -- 172.21.15.111:0/672407772 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcf8406db40 msgr2=0x7fcf84137940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:00.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.301+0000 7fcf89770700 1 --2- 172.21.15.111:0/672407772 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcf8406db40 0x7fcf84137940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:00.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.301+0000 7fcf89770700 1 -- 172.21.15.111:0/672407772 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcf8413b510 msgr2=0x7fcf84137e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:00.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.301+0000 7fcf89770700 1 --2- 172.21.15.111:0/672407772 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcf8413b510 0x7fcf84137e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:00.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.301+0000 7fcf89770700 1 -- 172.21.15.111:0/672407772 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf8000b6d0 con 0x7fcf84068a50 2024-04-25T02:23:00.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.302+0000 7fcf89f71700 1 --2- 172.21.15.111:0/672407772 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcf8413b510 0x7fcf84137e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:00.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.302+0000 7fcf88f6f700 1 --2- 172.21.15.111:0/672407772 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcf8406db40 0x7fcf84137940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:00.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.302+0000 7fcf89770700 1 --2- 172.21.15.111:0/672407772 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fcf84068a50 0x7fcf840a8660 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fcf74009f00 tx=0x7fcf74017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:00.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.302+0000 7fcf797fa700 1 -- 172.21.15.111:0/672407772 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf74000d10 con 0x7fcf84068a50 2024-04-25T02:23:00.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.302+0000 7fcf797fa700 1 -- 172.21.15.111:0/672407772 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf74011b10 con 0x7fcf84068a50 2024-04-25T02:23:00.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.302+0000 7fcf797fa700 1 -- 172.21.15.111:0/672407772 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf74025660 con 0x7fcf84068a50 2024-04-25T02:23:00.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.302+0000 7fcf8b9d4700 1 -- 172.21.15.111:0/672407772 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf7c009ae0 con 0x7fcf84068a50 2024-04-25T02:23:00.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.302+0000 7fcf8b9d4700 1 -- 172.21.15.111:0/672407772 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf74009420 con 0x7fcf84068a50 2024-04-25T02:23:00.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.303+0000 7fcf8b9d4700 1 -- 172.21.15.111:0/672407772 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf841383c0 con 0x7fcf84068a50 2024-04-25T02:23:00.310 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.303+0000 7fcf797fa700 1 -- 172.21.15.111:0/672407772 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 9) v1 ==== 53544+0+0 (secure 0 0 0) 0x7fcf74025a50 con 0x7fcf84068a50 2024-04-25T02:23:00.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.303+0000 7fcf797fa700 1 -- 172.21.15.111:0/672407772 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3840+0+0 (secure 0 0 0) 0x7fcf7405c6d0 con 0x7fcf84068a50 2024-04-25T02:23:00.311 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.307+0000 7fcf797fa700 1 -- 172.21.15.111:0/672407772 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fcf7401deb0 con 0x7fcf84068a50 2024-04-25T02:23:00.467 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.463+0000 7fcf8b9d4700 1 -- 172.21.15.111:0/672407772 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcf840a3dd0 con 0x7fcf84068a50 2024-04-25T02:23:00.467 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.464+0000 7fcf797fa700 1 -- 172.21.15.111:0/672407772 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+11565 (secure 0 0 0) 0x7fcf74015070 con 0x7fcf84068a50 2024-04-25T02:23:00.467 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:23:00.468 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":22,"fsid":"4643f974-f93a-4436-93b8-460ff320e62e","created":"2024-04-25T02:20:05.450475+0000","modified":"2024-04-25T02:22:58.724563+0000","last_up_change":"2024-04-25T02:20:10.439204+0000","last_in_change":"2024-04-25T02:20:10.439204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:20:07.471248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:20:14.420378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:20:22.251868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T02:20:23.128289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"df3f17ca-3b12-42c8-8cf7-8f1b7189e587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6800","nonce":40214}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6801","nonce":40214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6803","nonce":40214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6802","nonce":40214}]},"public_addr":"172.21.15.111:6800/40214","cluster_addr":"172.21.15.111:6801/40214","heartbeat_back_addr":"172.21.15.111:6803/40214","heartbeat_front_addr":"172.21.15.111:6802/40214","state":["exists","up"]},{"osd":1,"uuid":"93d54815-f215-4285-bba6-32f2d1cabf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6812","nonce":40216}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6813","nonce":40216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6815","nonce":40216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6814","nonce":40216}]},"public_addr":"172.21.15.111:6812/40216","cluster_addr":"172.21.15.111:6813/40216","heartbeat_back_addr":"172.21.15.111:6815/40216","heartbeat_front_addr":"172.21.15.111:6814/40216","state":["exists","up"]},{"osd":2,"uuid":"b26b2104-2a2e-408f-9ce7-3587a32a2ebe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6804","nonce":40215}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6805","nonce":40215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6807","nonce":40215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6806","nonce":40215}]},"public_addr":"172.21.15.111:6804/40215","cluster_addr":"172.21.15.111:6805/40215","heartbeat_back_addr":"172.21.15.111:6807/40215","heartbeat_front_addr":"172.21.15.111:6806/40215","state":["exists","up"]},{"osd":3,"uuid":"43c25820-1edc-4031-badf-72e87dd6bf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6808","nonce":40213}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6809","nonce":40213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6811","nonce":40213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6810","nonce":40213}]},"public_addr":"172.21.15.111:6808/40213","cluster_addr":"172.21.15.111:6809/40213","heartbeat_back_addr":"172.21.15.111:6811/40213","heartbeat_front_addr":"172.21.15.111:6810/40213","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.372427+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.411480+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.361508+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.377212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.111:0/2148931273":"2024-04-26T02:22:54.713254+0000","172.21.15.111:6816/39585":"2024-04-26T02:22:54.713254+0000","172.21.15.111:0/3911588907":"2024-04-26T02:22:54.713254+0000","172.21.15.111:0/1276843622":"2024-04-26T02:22:54.713254+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:23:00.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.465+0000 7fcf8b9d4700 1 -- 172.21.15.111:0/672407772 >> v1:172.21.15.111:6816/46482 conn(0x7fcf68045fb0 legacy=0x7fcf68048460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:00.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.465+0000 7fcf8b9d4700 1 -- 172.21.15.111:0/672407772 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fcf84068a50 msgr2=0x7fcf840a8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:00.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.465+0000 7fcf8b9d4700 1 --2- 172.21.15.111:0/672407772 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fcf84068a50 0x7fcf840a8660 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fcf74009f00 tx=0x7fcf74017000 comp rx=0 tx=0).stop 2024-04-25T02:23:00.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.466+0000 7fcf8b9d4700 1 -- 172.21.15.111:0/672407772 shutdown_connections 2024-04-25T02:23:00.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.466+0000 7fcf8b9d4700 1 --2- 172.21.15.111:0/672407772 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcf8413b510 0x7fcf84137e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:00.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.466+0000 7fcf8b9d4700 1 --2- 172.21.15.111:0/672407772 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fcf84068a50 0x7fcf840a8660 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:00.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.466+0000 7fcf8b9d4700 1 --2- 172.21.15.111:0/672407772 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcf8406db40 0x7fcf84137940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:00.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.466+0000 7fcf8b9d4700 1 -- 172.21.15.111:0/672407772 >> 172.21.15.111:0/672407772 conn(0x7fcf8406ce40 msgr2=0x7fcf84140050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:00.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.466+0000 7fcf8b9d4700 1 -- 172.21.15.111:0/672407772 shutdown_connections 2024-04-25T02:23:00.470 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.466+0000 7fcf8b9d4700 1 -- 172.21.15.111:0/672407772 wait complete. 2024-04-25T02:23:00.481 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:20:07.471248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T02:20:14.420378+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '14', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:20:22.251868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '17', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:20:23.128289+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '18', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T02:23:00.481 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:23:00.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.596+0000 7f93eed19700 1 Processor -- start 2024-04-25T02:23:00.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.596+0000 7f93eed19700 1 -- start start 2024-04-25T02:23:00.602 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.597+0000 7f93eed19700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f93e8063c90 0x7f93e813aec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:00.602 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.597+0000 7f93eed19700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f93e806fb90 0x7f93e8145860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:00.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.597+0000 7f93eed19700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93e806f1a0 con 0x7f93e813b400 2024-04-25T02:23:00.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.597+0000 7f93eed19700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93e80acf00 con 0x7f93e806fb90 2024-04-25T02:23:00.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.597+0000 7f93eed19700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e813b8c0 con 0x7f93e8063c90 2024-04-25T02:23:00.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.597+0000 7f93ed2b6700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f93e806fb90 0x7f93e8145860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:00.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.597+0000 7f93ecab5700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f93e8063c90 0x7f93e813aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:00.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.597+0000 7f93e7fff700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f93e813b400 0x7f93e806e1d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:35660/0 (socket says 172.21.15.111:35660) 2024-04-25T02:23:00.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.597+0000 7f93ecab5700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f93e8063c90 0x7f93e813aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:50132/0 (socket says 172.21.15.111:50132) 2024-04-25T02:23:00.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.597+0000 7f93e7fff700 1 -- 172.21.15.111:0/1607139738 learned_addr learned my addr 172.21.15.111:0/1607139738 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:23:00.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.597+0000 7f93ed2b6700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f93e806fb90 0x7f93e8145860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44472/0 (socket says 172.21.15.111:44472) 2024-04-25T02:23:00.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.597+0000 7f93ed2b6700 1 -- 172.21.15.111:0/1607139738 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f93e8063c90 msgr2=0x7f93e813aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:00.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.597+0000 7f93ed2b6700 1 --2- 172.21.15.111:0/1607139738 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f93e8063c90 0x7f93e813aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:00.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.597+0000 7f93ed2b6700 1 -- 172.21.15.111:0/1607139738 >> v1:172.21.15.111:6789/0 conn(0x7f93e813b400 legacy=0x7f93e806e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:00.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.597+0000 7f93e77fe700 1 -- 172.21.15.111:0/1607139738 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 178179237 0 0) 0x7f93e806f1a0 con 0x7f93e813b400 2024-04-25T02:23:00.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.597+0000 7f93ed2b6700 1 -- 172.21.15.111:0/1607139738 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93e813bb80 con 0x7f93e806fb90 2024-04-25T02:23:00.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.597+0000 7f93ecab5700 1 --2- 172.21.15.111:0/1607139738 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f93e8063c90 0x7f93e813aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:00.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.598+0000 7f93ed2b6700 1 --2- 172.21.15.111:0/1607139738 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f93e806fb90 0x7f93e8145860 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f93e000d0d0 tx=0x7f93e000b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=933cd0932e51e610 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:00.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.598+0000 7f93e77fe700 1 -- 172.21.15.111:0/1607139738 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e0010070 con 0x7f93e806fb90 2024-04-25T02:23:00.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.598+0000 7f93e77fe700 1 -- 172.21.15.111:0/1607139738 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e000b2e0 con 0x7f93e806fb90 2024-04-25T02:23:00.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.598+0000 7f93e77fe700 1 -- 172.21.15.111:0/1607139738 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e000dd80 con 0x7f93e806fb90 2024-04-25T02:23:00.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.598+0000 7f93eed19700 1 -- 172.21.15.111:0/1607139738 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f93e806fb90 msgr2=0x7f93e8145860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:00.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.598+0000 7f93eed19700 1 --2- 172.21.15.111:0/1607139738 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f93e806fb90 0x7f93e8145860 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f93e000d0d0 tx=0x7f93e000b990 comp rx=0 tx=0).stop 2024-04-25T02:23:00.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.598+0000 7f93eed19700 1 -- 172.21.15.111:0/1607139738 shutdown_connections 2024-04-25T02:23:00.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.598+0000 7f93eed19700 1 --2- 172.21.15.111:0/1607139738 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f93e806fb90 0x7f93e8145860 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:00.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.598+0000 7f93eed19700 1 --2- 172.21.15.111:0/1607139738 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f93e8063c90 0x7f93e813aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:00.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.598+0000 7f93eed19700 1 -- 172.21.15.111:0/1607139738 >> 172.21.15.111:0/1607139738 conn(0x7f93e80b1e80 msgr2=0x7f93e80adef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:00.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.598+0000 7f93eed19700 1 -- 172.21.15.111:0/1607139738 shutdown_connections 2024-04-25T02:23:00.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.598+0000 7f93eed19700 1 -- 172.21.15.111:0/1607139738 wait complete. 2024-04-25T02:23:00.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.600+0000 7f93eed19700 1 Processor -- start 2024-04-25T02:23:00.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.600+0000 7f93eed19700 1 -- start start 2024-04-25T02:23:00.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.600+0000 7f93eed19700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f93e8063c90 0x7f93e80a76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:00.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.601+0000 7f93eed19700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f93e806fb90 0x7f93e80a63e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:00.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.601+0000 7f93eed19700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f93e813b400 0x7f93e81499d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:00.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.601+0000 7f93eed19700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93e813f3e0 con 0x7f93e806fb90 2024-04-25T02:23:00.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.601+0000 7f93eed19700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93e8149470 con 0x7f93e813b400 2024-04-25T02:23:00.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.601+0000 7f93eed19700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f93e813e830 con 0x7f93e8063c90 2024-04-25T02:23:00.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.601+0000 7f93e7fff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f93e806fb90 0x7f93e80a63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:00.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.601+0000 7f93e7fff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f93e806fb90 0x7f93e80a63e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44482/0 (socket says 172.21.15.111:44482) 2024-04-25T02:23:00.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.601+0000 7f93ed2b6700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f93e813b400 0x7f93e81499d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:00.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.601+0000 7f93e7fff700 1 -- 172.21.15.111:0/2646285563 learned_addr learned my addr 172.21.15.111:0/2646285563 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:00.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.601+0000 7f93ecab5700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f93e8063c90 0x7f93e80a76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:00.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.601+0000 7f93ed2b6700 1 -- 172.21.15.111:0/2646285563 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f93e8063c90 msgr2=0x7f93e80a76f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:00.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.601+0000 7f93ed2b6700 1 --2- 172.21.15.111:0/2646285563 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f93e8063c90 0x7f93e80a76f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:00.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.601+0000 7f93ed2b6700 1 -- 172.21.15.111:0/2646285563 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f93e806fb90 msgr2=0x7f93e80a63e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:00.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.601+0000 7f93ed2b6700 1 --2- 172.21.15.111:0/2646285563 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f93e806fb90 0x7f93e80a63e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:00.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.601+0000 7f93ed2b6700 1 -- 172.21.15.111:0/2646285563 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93dc009420 con 0x7f93e813b400 2024-04-25T02:23:00.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.601+0000 7f93e7fff700 1 --2- 172.21.15.111:0/2646285563 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f93e806fb90 0x7f93e80a63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:00.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.601+0000 7f93ed2b6700 1 --2- 172.21.15.111:0/2646285563 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f93e813b400 0x7f93e81499d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f93e0017000 tx=0x7f93e001a000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:00.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.601+0000 7f93e4ff9700 1 -- 172.21.15.111:0/2646285563 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e000deb0 con 0x7f93e813b400 2024-04-25T02:23:00.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.601+0000 7f93e4ff9700 1 -- 172.21.15.111:0/2646285563 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93e0028460 con 0x7f93e813b400 2024-04-25T02:23:00.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.601+0000 7f93eed19700 1 -- 172.21.15.111:0/2646285563 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93e000bc30 con 0x7f93e813b400 2024-04-25T02:23:00.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.601+0000 7f93e4ff9700 1 -- 172.21.15.111:0/2646285563 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93e0028840 con 0x7f93e813b400 2024-04-25T02:23:00.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.601+0000 7f93eed19700 1 -- 172.21.15.111:0/2646285563 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93e80a6f10 con 0x7f93e813b400 2024-04-25T02:23:00.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.602+0000 7f93e4ff9700 1 -- 172.21.15.111:0/2646285563 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 9) v1 ==== 53544+0+0 (secure 0 0 0) 0x7f93e0003040 con 0x7f93e813b400 2024-04-25T02:23:00.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.602+0000 7f93eed19700 1 -- 172.21.15.111:0/2646285563 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93e8065190 con 0x7f93e813b400 2024-04-25T02:23:00.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.602+0000 7f93e4ff9700 1 -- 172.21.15.111:0/2646285563 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f93e005eb40 con 0x7f93e813b400 2024-04-25T02:23:00.610 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.606+0000 7f93e4ff9700 1 -- 172.21.15.111:0/2646285563 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f93e002be00 con 0x7f93e813b400 2024-04-25T02:23:00.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.763+0000 7f93eed19700 1 -- 172.21.15.111:0/2646285563 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f93e80aeca0 con 0x7f93e813b400 2024-04-25T02:23:00.769 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.764+0000 7f93e4ff9700 1 -- 172.21.15.111:0/2646285563 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v22) v1 ==== 93+0+10 (secure 0 0 0) 0x7f93e0023030 con 0x7f93e813b400 2024-04-25T02:23:00.770 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 1 2024-04-25T02:23:00.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.765+0000 7f93eed19700 1 -- 172.21.15.111:0/2646285563 >> v1:172.21.15.111:6816/46482 conn(0x7f93cc045f80 legacy=0x7f93cc048430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:00.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.765+0000 7f93eed19700 1 -- 172.21.15.111:0/2646285563 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f93e813b400 msgr2=0x7f93e81499d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:00.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.765+0000 7f93eed19700 1 --2- 172.21.15.111:0/2646285563 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f93e813b400 0x7f93e81499d0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f93e0017000 tx=0x7f93e001a000 comp rx=0 tx=0).stop 2024-04-25T02:23:00.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.766+0000 7f93eed19700 1 -- 172.21.15.111:0/2646285563 shutdown_connections 2024-04-25T02:23:00.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.766+0000 7f93eed19700 1 --2- 172.21.15.111:0/2646285563 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f93e813b400 0x7f93e81499d0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:00.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.766+0000 7f93eed19700 1 --2- 172.21.15.111:0/2646285563 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f93e8063c90 0x7f93e80a76f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:00.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.766+0000 7f93eed19700 1 --2- 172.21.15.111:0/2646285563 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f93e806fb90 0x7f93e80a63e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:00.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.766+0000 7f93eed19700 1 -- 172.21.15.111:0/2646285563 >> 172.21.15.111:0/2646285563 conn(0x7f93e80b1e80 msgr2=0x7f93e80abc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:00.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.766+0000 7f93eed19700 1 -- 172.21.15.111:0/2646285563 shutdown_connections 2024-04-25T02:23:00.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.766+0000 7f93eed19700 1 -- 172.21.15.111:0/2646285563 wait complete. 2024-04-25T02:23:00.781 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T02:23:00.905 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.901+0000 7f533320f700 1 Processor -- start 2024-04-25T02:23:00.905 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.901+0000 7f533320f700 1 -- start start 2024-04-25T02:23:00.907 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.901+0000 7f533320f700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f532c0b2650 0x7f532c13b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:00.907 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.901+0000 7f533320f700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f532c0a4bb0 0x7f532c13be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:00.907 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.901+0000 7f533320f700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f532c0a2b10 con 0x7f532c0a22a0 2024-04-25T02:23:00.907 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.901+0000 7f533320f700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f532c0a3ef0 con 0x7f532c0b2650 2024-04-25T02:23:00.907 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.901+0000 7f533320f700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f532c0a2850 con 0x7f532c0a4bb0 2024-04-25T02:23:00.907 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.901+0000 7f5330fab700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f532c0b2650 0x7f532c13b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:00.908 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.901+0000 7f5330fab700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f532c0b2650 0x7f532c13b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44486/0 (socket says 172.21.15.111:44486) 2024-04-25T02:23:00.908 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.901+0000 7f532bfff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f532c0a4bb0 0x7f532c13be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:00.908 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.901+0000 7f53317ac700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f532c0a22a0 0x7f532c06da40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:35666/0 (socket says 172.21.15.111:35666) 2024-04-25T02:23:00.908 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.901+0000 7f5330fab700 1 -- 172.21.15.111:0/2522794965 learned_addr learned my addr 172.21.15.111:0/2522794965 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:00.908 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.902+0000 7f5330fab700 1 -- 172.21.15.111:0/2522794965 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f532c0a4bb0 msgr2=0x7f532c13be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:00.908 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.902+0000 7f5330fab700 1 --2- 172.21.15.111:0/2522794965 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f532c0a4bb0 0x7f532c13be20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:00.908 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.902+0000 7f5330fab700 1 -- 172.21.15.111:0/2522794965 >> v1:172.21.15.111:6789/0 conn(0x7f532c0a22a0 legacy=0x7f532c06da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:00.908 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.902+0000 7f5330fab700 1 -- 172.21.15.111:0/2522794965 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f532c0a3810 con 0x7f532c0b2650 2024-04-25T02:23:00.908 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.902+0000 7f532bfff700 1 --2- 172.21.15.111:0/2522794965 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f532c0a4bb0 0x7f532c13be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:00.908 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.902+0000 7f5330fab700 1 --2- 172.21.15.111:0/2522794965 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f532c0b2650 0x7f532c13b8e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5324009f20 tx=0x7f5324009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c4c1dbb4137f9ca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:00.908 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.902+0000 7f532b7fe700 1 -- 172.21.15.111:0/2522794965 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f532400e070 con 0x7f532c0b2650 2024-04-25T02:23:00.908 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.902+0000 7f532b7fe700 1 -- 172.21.15.111:0/2522794965 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f532400b9d0 con 0x7f532c0b2650 2024-04-25T02:23:00.908 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.902+0000 7f532b7fe700 1 -- 172.21.15.111:0/2522794965 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53240092e0 con 0x7f532c0b2650 2024-04-25T02:23:00.908 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.902+0000 7f533320f700 1 -- 172.21.15.111:0/2522794965 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f532c0b2650 msgr2=0x7f532c13b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:00.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.902+0000 7f533320f700 1 --2- 172.21.15.111:0/2522794965 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f532c0b2650 0x7f532c13b8e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f5324009f20 tx=0x7f5324009840 comp rx=0 tx=0).stop 2024-04-25T02:23:00.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.902+0000 7f533320f700 1 -- 172.21.15.111:0/2522794965 shutdown_connections 2024-04-25T02:23:00.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.902+0000 7f533320f700 1 --2- 172.21.15.111:0/2522794965 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f532c0b2650 0x7f532c13b8e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:00.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.902+0000 7f533320f700 1 --2- 172.21.15.111:0/2522794965 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f532c0a4bb0 0x7f532c13be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:00.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.902+0000 7f533320f700 1 -- 172.21.15.111:0/2522794965 >> 172.21.15.111:0/2522794965 conn(0x7f532c06ada0 msgr2=0x7f532c0b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:00.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.902+0000 7f533320f700 1 -- 172.21.15.111:0/2522794965 shutdown_connections 2024-04-25T02:23:00.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.903+0000 7f533320f700 1 -- 172.21.15.111:0/2522794965 wait complete. 2024-04-25T02:23:00.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.903+0000 7f533320f700 1 Processor -- start 2024-04-25T02:23:00.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.904+0000 7f533320f700 1 -- start start 2024-04-25T02:23:00.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.904+0000 7f533320f700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f532c0a22a0 0x7f532c14c770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:00.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.904+0000 7f533320f700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f532c0a4bb0 0x7f532c1402c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:00.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.904+0000 7f533320f700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f532c0b2650 0x7f532c14f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:00.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.904+0000 7f533320f700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f532c139dc0 con 0x7f532c0a4bb0 2024-04-25T02:23:00.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.904+0000 7f533320f700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f532c14ccb0 con 0x7f532c0a22a0 2024-04-25T02:23:00.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.904+0000 7f533320f700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f532c139ff0 con 0x7f532c0b2650 2024-04-25T02:23:00.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.904+0000 7f5330fab700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f532c0a22a0 0x7f532c14c770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:00.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.904+0000 7f53317ac700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f532c0b2650 0x7f532c14f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:00.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.904+0000 7f532bfff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f532c0a4bb0 0x7f532c1402c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:00.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.904+0000 7f532bfff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f532c0a4bb0 0x7f532c1402c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44488/0 (socket says 172.21.15.111:44488) 2024-04-25T02:23:00.913 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.904+0000 7f5330fab700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f532c0a22a0 0x7f532c14c770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:50156/0 (socket says 172.21.15.111:50156) 2024-04-25T02:23:00.913 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.904+0000 7f53317ac700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f532c0b2650 0x7f532c14f3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:35290/0 (socket says 172.21.15.111:35290) 2024-04-25T02:23:00.913 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.904+0000 7f532bfff700 1 -- 172.21.15.111:0/429369019 learned_addr learned my addr 172.21.15.111:0/429369019 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:00.913 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.904+0000 7f532bfff700 1 -- 172.21.15.111:0/429369019 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f532c0b2650 msgr2=0x7f532c14f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:00.913 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.904+0000 7f532bfff700 1 --2- 172.21.15.111:0/429369019 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f532c0b2650 0x7f532c14f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:00.913 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.904+0000 7f532bfff700 1 -- 172.21.15.111:0/429369019 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f532c0a22a0 msgr2=0x7f532c14c770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:00.913 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.904+0000 7f532bfff700 1 --2- 172.21.15.111:0/429369019 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f532c0a22a0 0x7f532c14c770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:00.913 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.904+0000 7f532bfff700 1 -- 172.21.15.111:0/429369019 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5314009420 con 0x7f532c0a4bb0 2024-04-25T02:23:00.913 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.904+0000 7f53317ac700 1 --2- 172.21.15.111:0/429369019 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f532c0b2650 0x7f532c14f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:00.913 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.904+0000 7f5330fab700 1 --2- 172.21.15.111:0/429369019 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f532c0a22a0 0x7f532c14c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:00.913 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.905+0000 7f532bfff700 1 --2- 172.21.15.111:0/429369019 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f532c0a4bb0 0x7f532c1402c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f531400ec80 tx=0x7f53140091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:00.913 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.905+0000 7f5328ff9700 1 -- 172.21.15.111:0/429369019 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531400c850 con 0x7f532c0a4bb0 2024-04-25T02:23:00.913 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.905+0000 7f5328ff9700 1 -- 172.21.15.111:0/429369019 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f531400c9b0 con 0x7f532c0a4bb0 2024-04-25T02:23:00.913 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.905+0000 7f533320f700 1 -- 172.21.15.111:0/429369019 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5324009ae0 con 0x7f532c0a4bb0 2024-04-25T02:23:00.914 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.905+0000 7f5328ff9700 1 -- 172.21.15.111:0/429369019 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f531400cd50 con 0x7f532c0a4bb0 2024-04-25T02:23:00.914 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.905+0000 7f533320f700 1 -- 172.21.15.111:0/429369019 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f532c138ae0 con 0x7f532c0a4bb0 2024-04-25T02:23:00.914 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.906+0000 7f533320f700 1 -- 172.21.15.111:0/429369019 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f532c065190 con 0x7f532c0a4bb0 2024-04-25T02:23:00.914 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.906+0000 7f5328ff9700 1 -- 172.21.15.111:0/429369019 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 9) v1 ==== 53544+0+0 (secure 0 0 0) 0x7f5314013680 con 0x7f532c0a4bb0 2024-04-25T02:23:00.914 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.906+0000 7f5328ff9700 1 -- 172.21.15.111:0/429369019 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f531405b6e0 con 0x7f532c0a4bb0 2024-04-25T02:23:00.914 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:00.910+0000 7f5328ff9700 1 -- 172.21.15.111:0/429369019 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f5314039a90 con 0x7f532c0a4bb0 2024-04-25T02:23:01.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.063+0000 7f533320f700 1 -- 172.21.15.111:0/429369019 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f532c14c450 con 0x7f532c0a4bb0 2024-04-25T02:23:01.067 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.063+0000 7f5328ff9700 1 -- 172.21.15.111:0/429369019 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v22) v1 ==== 92+0+10 (secure 0 0 0) 0x7f531403d280 con 0x7f532c0a4bb0 2024-04-25T02:23:01.067 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 8 2024-04-25T02:23:01.069 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.065+0000 7f533320f700 1 -- 172.21.15.111:0/429369019 >> v1:172.21.15.111:6816/46482 conn(0x7f530c045f80 legacy=0x7f530c048430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:01.069 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.065+0000 7f533320f700 1 -- 172.21.15.111:0/429369019 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f532c0a4bb0 msgr2=0x7f532c1402c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:01.069 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.065+0000 7f533320f700 1 --2- 172.21.15.111:0/429369019 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f532c0a4bb0 0x7f532c1402c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f531400ec80 tx=0x7f53140091a0 comp rx=0 tx=0).stop 2024-04-25T02:23:01.069 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.065+0000 7f533320f700 1 -- 172.21.15.111:0/429369019 shutdown_connections 2024-04-25T02:23:01.069 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.065+0000 7f533320f700 1 --2- 172.21.15.111:0/429369019 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f532c0b2650 0x7f532c14f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:01.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.065+0000 7f533320f700 1 --2- 172.21.15.111:0/429369019 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f532c0a22a0 0x7f532c14c770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:01.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.065+0000 7f533320f700 1 --2- 172.21.15.111:0/429369019 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f532c0a4bb0 0x7f532c1402c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:01.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.065+0000 7f533320f700 1 -- 172.21.15.111:0/429369019 >> 172.21.15.111:0/429369019 conn(0x7f532c06ada0 msgr2=0x7f532c146e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:01.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.065+0000 7f533320f700 1 -- 172.21.15.111:0/429369019 shutdown_connections 2024-04-25T02:23:01.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.065+0000 7f533320f700 1 -- 172.21.15.111:0/429369019 wait complete. 2024-04-25T02:23:01.080 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:23:01.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.200+0000 7f2b812c0700 1 Processor -- start 2024-04-25T02:23:01.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.200+0000 7f2b812c0700 1 -- start start 2024-04-25T02:23:01.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.200+0000 7f2b812c0700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2b7c063cf0 0x7f2b7c069a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:01.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.200+0000 7f2b812c0700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2b7c0a3d40 0x7f2b7c06eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:01.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.200+0000 7f2b812c0700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b7c069fd0 con 0x7f2b7c06f070 2024-04-25T02:23:01.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.200+0000 7f2b812c0700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c0b0470 con 0x7f2b7c063cf0 2024-04-25T02:23:01.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.200+0000 7f2b812c0700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c06a230 con 0x7f2b7c0a3d40 2024-04-25T02:23:01.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.200+0000 7f2b7affd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2b7c063cf0 0x7f2b7c069a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:01.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.200+0000 7f2b7a7fc700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2b7c0a3d40 0x7f2b7c06eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:01.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.200+0000 7f2b7b7fe700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f2b7c06f070 0x7f2b7c1486c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:35680/0 (socket says 172.21.15.111:35680) 2024-04-25T02:23:01.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.200+0000 7f2b7affd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2b7c063cf0 0x7f2b7c069a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:50168/0 (socket says 172.21.15.111:50168) 2024-04-25T02:23:01.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.200+0000 7f2b7a7fc700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2b7c0a3d40 0x7f2b7c06eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:35296/0 (socket says 172.21.15.111:35296) 2024-04-25T02:23:01.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.200+0000 7f2b7b7fe700 1 -- 172.21.15.111:0/2387609266 learned_addr learned my addr 172.21.15.111:0/2387609266 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:23:01.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.201+0000 7f2b79ffb700 1 -- 172.21.15.111:0/2387609266 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1838056280 0 0) 0x7f2b7c069fd0 con 0x7f2b7c06f070 2024-04-25T02:23:01.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.201+0000 7f2b7a7fc700 1 -- 172.21.15.111:0/2387609266 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2b7c063cf0 msgr2=0x7f2b7c069a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:01.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.201+0000 7f2b7a7fc700 1 --2- 172.21.15.111:0/2387609266 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2b7c063cf0 0x7f2b7c069a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:01.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.201+0000 7f2b7a7fc700 1 -- 172.21.15.111:0/2387609266 >> v1:172.21.15.111:6789/0 conn(0x7f2b7c06f070 legacy=0x7f2b7c1486c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:01.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.201+0000 7f2b7a7fc700 1 -- 172.21.15.111:0/2387609266 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b7c06a4d0 con 0x7f2b7c0a3d40 2024-04-25T02:23:01.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.201+0000 7f2b7affd700 1 --2- 172.21.15.111:0/2387609266 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2b7c063cf0 0x7f2b7c069a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:01.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.201+0000 7f2b7a7fc700 1 --2- 172.21.15.111:0/2387609266 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2b7c0a3d40 0x7f2b7c06eb30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c009910 tx=0x7f2b6c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cf4a9f201b02c45e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:01.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.201+0000 7f2b79ffb700 1 -- 172.21.15.111:0/2387609266 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c00b680 con 0x7f2b7c0a3d40 2024-04-25T02:23:01.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.201+0000 7f2b79ffb700 1 -- 172.21.15.111:0/2387609266 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b6c00b7e0 con 0x7f2b7c0a3d40 2024-04-25T02:23:01.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.201+0000 7f2b79ffb700 1 -- 172.21.15.111:0/2387609266 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c00bba0 con 0x7f2b7c0a3d40 2024-04-25T02:23:01.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.202+0000 7f2b812c0700 1 -- 172.21.15.111:0/2387609266 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2b7c0a3d40 msgr2=0x7f2b7c06eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:01.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.202+0000 7f2b812c0700 1 --2- 172.21.15.111:0/2387609266 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2b7c0a3d40 0x7f2b7c06eb30 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c009910 tx=0x7f2b6c0091a0 comp rx=0 tx=0).stop 2024-04-25T02:23:01.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.202+0000 7f2b812c0700 1 -- 172.21.15.111:0/2387609266 shutdown_connections 2024-04-25T02:23:01.207 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.202+0000 7f2b812c0700 1 --2- 172.21.15.111:0/2387609266 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2b7c063cf0 0x7f2b7c069a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:01.208 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.202+0000 7f2b812c0700 1 --2- 172.21.15.111:0/2387609266 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2b7c0a3d40 0x7f2b7c06eb30 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:01.208 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.202+0000 7f2b812c0700 1 -- 172.21.15.111:0/2387609266 >> 172.21.15.111:0/2387609266 conn(0x7f2b7c06c090 msgr2=0x7f2b7c0635e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:01.208 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.202+0000 7f2b812c0700 1 -- 172.21.15.111:0/2387609266 shutdown_connections 2024-04-25T02:23:01.208 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.202+0000 7f2b812c0700 1 -- 172.21.15.111:0/2387609266 wait complete. 2024-04-25T02:23:01.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.203+0000 7f2b812c0700 1 Processor -- start 2024-04-25T02:23:01.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.203+0000 7f2b812c0700 1 -- start start 2024-04-25T02:23:01.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.204+0000 7f2b812c0700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2b7c063cf0 0x7f2b7c098820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:01.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.204+0000 7f2b812c0700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b7c06f070 0x7f2b7c14eb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:01.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.204+0000 7f2b812c0700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2b7c0a3d40 0x7f2b7c097040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:01.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.204+0000 7f2b812c0700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c097df0 con 0x7f2b7c06f070 2024-04-25T02:23:01.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.204+0000 7f2b812c0700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c0ae0e0 con 0x7f2b7c0a3d40 2024-04-25T02:23:01.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.204+0000 7f2b812c0700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7c096bf0 con 0x7f2b7c063cf0 2024-04-25T02:23:01.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.204+0000 7f2b7b7fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2b7c0a3d40 0x7f2b7c097040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:01.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.204+0000 7f2b7affd700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2b7c063cf0 0x7f2b7c098820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:01.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.204+0000 7f2b7affd700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2b7c063cf0 0x7f2b7c098820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:35308/0 (socket says 172.21.15.111:35308) 2024-04-25T02:23:01.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.204+0000 7f2b7b7fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2b7c0a3d40 0x7f2b7c097040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:50170/0 (socket says 172.21.15.111:50170) 2024-04-25T02:23:01.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.204+0000 7f2b7a7fc700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b7c06f070 0x7f2b7c14eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:01.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.204+0000 7f2b7affd700 1 -- 172.21.15.111:0/3103029759 learned_addr learned my addr 172.21.15.111:0/3103029759 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:01.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.204+0000 7f2b7b7fe700 1 -- 172.21.15.111:0/3103029759 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2b7c063cf0 msgr2=0x7f2b7c098820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:01.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.204+0000 7f2b7b7fe700 1 --2- 172.21.15.111:0/3103029759 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2b7c063cf0 0x7f2b7c098820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:01.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.204+0000 7f2b7b7fe700 1 -- 172.21.15.111:0/3103029759 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b7c06f070 msgr2=0x7f2b7c14eb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:01.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.204+0000 7f2b7b7fe700 1 --2- 172.21.15.111:0/3103029759 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b7c06f070 0x7f2b7c14eb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:01.212 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.204+0000 7f2b7b7fe700 1 -- 172.21.15.111:0/3103029759 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b70009420 con 0x7f2b7c0a3d40 2024-04-25T02:23:01.212 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.204+0000 7f2b7b7fe700 1 --2- 172.21.15.111:0/3103029759 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2b7c0a3d40 0x7f2b7c097040 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2b7400cbe0 tx=0x7f2b740019a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:01.212 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.204+0000 7f2b62ffd700 1 -- 172.21.15.111:0/3103029759 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7400a8b0 con 0x7f2b7c0a3d40 2024-04-25T02:23:01.212 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.205+0000 7f2b62ffd700 1 -- 172.21.15.111:0/3103029759 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b7400aa10 con 0x7f2b7c0a3d40 2024-04-25T02:23:01.212 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.205+0000 7f2b812c0700 1 -- 172.21.15.111:0/3103029759 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b6c009420 con 0x7f2b7c0a3d40 2024-04-25T02:23:01.212 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.205+0000 7f2b62ffd700 1 -- 172.21.15.111:0/3103029759 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b7400add0 con 0x7f2b7c0a3d40 2024-04-25T02:23:01.212 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.205+0000 7f2b812c0700 1 -- 172.21.15.111:0/3103029759 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b7c0adb20 con 0x7f2b7c0a3d40 2024-04-25T02:23:01.212 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.205+0000 7f2b812c0700 1 -- 172.21.15.111:0/3103029759 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b7c065190 con 0x7f2b7c0a3d40 2024-04-25T02:23:01.212 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.206+0000 7f2b62ffd700 1 -- 172.21.15.111:0/3103029759 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 9) v1 ==== 53544+0+0 (secure 0 0 0) 0x7f2b74007300 con 0x7f2b7c0a3d40 2024-04-25T02:23:01.212 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.206+0000 7f2b62ffd700 1 -- 172.21.15.111:0/3103029759 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f2b7405bd40 con 0x7f2b7c0a3d40 2024-04-25T02:23:01.213 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.209+0000 7f2b62ffd700 1 -- 172.21.15.111:0/3103029759 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f2b7403a070 con 0x7f2b7c0a3d40 2024-04-25T02:23:01.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.362+0000 7f2b812c0700 1 -- 172.21.15.111:0/3103029759 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f2b7c0ab920 con 0x7f2b7c0a3d40 2024-04-25T02:23:01.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.362+0000 7f2b62ffd700 1 -- 172.21.15.111:0/3103029759 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v22) v1 ==== 104+0+11 (secure 0 0 0) 0x7f2b7403d860 con 0x7f2b7c0a3d40 2024-04-25T02:23:01.366 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 32 2024-04-25T02:23:01.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.364+0000 7f2b812c0700 1 -- 172.21.15.111:0/3103029759 >> v1:172.21.15.111:6816/46482 conn(0x7f2b68046000 legacy=0x7f2b680484b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:01.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.364+0000 7f2b812c0700 1 -- 172.21.15.111:0/3103029759 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2b7c0a3d40 msgr2=0x7f2b7c097040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:01.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.364+0000 7f2b812c0700 1 --2- 172.21.15.111:0/3103029759 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2b7c0a3d40 0x7f2b7c097040 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f2b7400cbe0 tx=0x7f2b740019a0 comp rx=0 tx=0).stop 2024-04-25T02:23:01.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.364+0000 7f2b812c0700 1 -- 172.21.15.111:0/3103029759 shutdown_connections 2024-04-25T02:23:01.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.364+0000 7f2b812c0700 1 --2- 172.21.15.111:0/3103029759 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2b7c0a3d40 0x7f2b7c097040 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:01.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.364+0000 7f2b812c0700 1 --2- 172.21.15.111:0/3103029759 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2b7c063cf0 0x7f2b7c098820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:01.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.364+0000 7f2b812c0700 1 --2- 172.21.15.111:0/3103029759 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b7c06f070 0x7f2b7c14eb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:01.368 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.364+0000 7f2b812c0700 1 -- 172.21.15.111:0/3103029759 >> 172.21.15.111:0/3103029759 conn(0x7f2b7c06c090 msgr2=0x7f2b7c0712b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:01.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.364+0000 7f2b812c0700 1 -- 172.21.15.111:0/3103029759 shutdown_connections 2024-04-25T02:23:01.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.364+0000 7f2b812c0700 1 -- 172.21.15.111:0/3103029759 wait complete. 2024-04-25T02:23:01.379 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:23:01.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.496+0000 7f48fca37700 1 Processor -- start 2024-04-25T02:23:01.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.496+0000 7f48fca37700 1 -- start start 2024-04-25T02:23:01.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.497+0000 7f48fca37700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f48f8132180 0x7f48f8144a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:01.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.497+0000 7f48fca37700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f48f81325d0 0x7f48f8146f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:01.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.497+0000 7f48fca37700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48f80ada70 con 0x7f48f8063a40 2024-04-25T02:23:01.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.497+0000 7f48fca37700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48f80ac500 con 0x7f48f81325d0 2024-04-25T02:23:01.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.497+0000 7f48fca37700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48f80abac0 con 0x7f48f8132180 2024-04-25T02:23:01.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.497+0000 7f48f6d9d700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f48f81325d0 0x7f48f8146f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:01.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.497+0000 7f48f659c700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f48f8063a40 0x7f48f80abdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:35694/0 (socket says 172.21.15.111:35694) 2024-04-25T02:23:01.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.497+0000 7f48f659c700 1 -- 172.21.15.111:0/3537617832 learned_addr learned my addr 172.21.15.111:0/3537617832 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:23:01.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.497+0000 7f48f5d9b700 1 --2- 172.21.15.111:0/3537617832 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f48f8132180 0x7f48f8144a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:01.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.497+0000 7f48f559a700 1 -- 172.21.15.111:0/3537617832 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3373951198 0 0) 0x7f48f80ada70 con 0x7f48f8063a40 2024-04-25T02:23:01.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.497+0000 7f48f559a700 1 -- 172.21.15.111:0/3537617832 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48e0003570 con 0x7f48f8063a40 2024-04-25T02:23:01.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.497+0000 7f48f5d9b700 1 -- 172.21.15.111:0/3537617832 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f48f81325d0 msgr2=0x7f48f8146f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:01.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.497+0000 7f48f5d9b700 1 --2- 172.21.15.111:0/3537617832 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f48f81325d0 0x7f48f8146f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:01.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.497+0000 7f48f5d9b700 1 -- 172.21.15.111:0/3537617832 >> v1:172.21.15.111:6789/0 conn(0x7f48f8063a40 legacy=0x7f48f80abdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:01.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.497+0000 7f48f5d9b700 1 -- 172.21.15.111:0/3537617832 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f80ae600 con 0x7f48f8132180 2024-04-25T02:23:01.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.497+0000 7f48f6d9d700 1 --2- 172.21.15.111:0/3537617832 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f48f81325d0 0x7f48f8146f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:01.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.497+0000 7f48f5d9b700 1 --2- 172.21.15.111:0/3537617832 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f48f8132180 0x7f48f8144a10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f48ec009910 tx=0x7f48ec0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=acc2091d3ac337c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:01.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.497+0000 7f48f559a700 1 -- 172.21.15.111:0/3537617832 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ec011630 con 0x7f48f8132180 2024-04-25T02:23:01.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.497+0000 7f48f559a700 1 -- 172.21.15.111:0/3537617832 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48ec011790 con 0x7f48f8132180 2024-04-25T02:23:01.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.497+0000 7f48f559a700 1 -- 172.21.15.111:0/3537617832 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48ec011b30 con 0x7f48f8132180 2024-04-25T02:23:01.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.498+0000 7f48fca37700 1 -- 172.21.15.111:0/3537617832 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f48f8132180 msgr2=0x7f48f8144a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:01.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.498+0000 7f48fca37700 1 --2- 172.21.15.111:0/3537617832 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f48f8132180 0x7f48f8144a10 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f48ec009910 tx=0x7f48ec0091a0 comp rx=0 tx=0).stop 2024-04-25T02:23:01.504 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.498+0000 7f48fca37700 1 -- 172.21.15.111:0/3537617832 shutdown_connections 2024-04-25T02:23:01.504 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.498+0000 7f48fca37700 1 --2- 172.21.15.111:0/3537617832 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f48f81325d0 0x7f48f8146f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:01.504 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.498+0000 7f48fca37700 1 --2- 172.21.15.111:0/3537617832 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f48f8132180 0x7f48f8144a10 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:01.504 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.498+0000 7f48fca37700 1 -- 172.21.15.111:0/3537617832 >> 172.21.15.111:0/3537617832 conn(0x7f48f80b1e80 msgr2=0x7f48f80adef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:01.504 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.498+0000 7f48fca37700 1 -- 172.21.15.111:0/3537617832 shutdown_connections 2024-04-25T02:23:01.504 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.498+0000 7f48fca37700 1 -- 172.21.15.111:0/3537617832 wait complete. 2024-04-25T02:23:01.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.499+0000 7f48fca37700 1 Processor -- start 2024-04-25T02:23:01.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.499+0000 7f48fca37700 1 -- start start 2024-04-25T02:23:01.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.499+0000 7f48fca37700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f48f8063a40 0x7f48f8137770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:01.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.499+0000 7f48fca37700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f48f8132180 0x7f48f814f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:01.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.499+0000 7f48fca37700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f48f81325d0 0x7f48f814f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:01.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.499+0000 7f48fca37700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48f8139120 con 0x7f48f8132180 2024-04-25T02:23:01.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.499+0000 7f48fca37700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48f81367b0 con 0x7f48f81325d0 2024-04-25T02:23:01.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.499+0000 7f48fca37700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f48f8136d70 con 0x7f48f8063a40 2024-04-25T02:23:01.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.500+0000 7f48f659c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f48f8063a40 0x7f48f8137770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:01.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.500+0000 7f48f5d9b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f48f8132180 0x7f48f814f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:01.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.500+0000 7f48f659c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f48f8063a40 0x7f48f8137770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:35334/0 (socket says 172.21.15.111:35334) 2024-04-25T02:23:01.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.500+0000 7f48f659c700 1 -- 172.21.15.111:0/992175404 learned_addr learned my addr 172.21.15.111:0/992175404 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:01.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.500+0000 7f48f6d9d700 1 --2- 172.21.15.111:0/992175404 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f48f81325d0 0x7f48f814f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:01.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.500+0000 7f48f659c700 1 -- 172.21.15.111:0/992175404 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f48f81325d0 msgr2=0x7f48f814f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:01.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.500+0000 7f48f659c700 1 --2- 172.21.15.111:0/992175404 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f48f81325d0 0x7f48f814f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:01.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.500+0000 7f48f659c700 1 -- 172.21.15.111:0/992175404 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f48f8132180 msgr2=0x7f48f814f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:01.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.500+0000 7f48f659c700 1 --2- 172.21.15.111:0/992175404 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f48f8132180 0x7f48f814f230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:01.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.500+0000 7f48f659c700 1 -- 172.21.15.111:0/992175404 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48f0009a20 con 0x7f48f8063a40 2024-04-25T02:23:01.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.500+0000 7f48f5d9b700 1 --2- 172.21.15.111:0/992175404 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f48f8132180 0x7f48f814f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:01.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.500+0000 7f48f6d9d700 1 --2- 172.21.15.111:0/992175404 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f48f81325d0 0x7f48f814f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:01.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.500+0000 7f48f659c700 1 --2- 172.21.15.111:0/992175404 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f48f8063a40 0x7f48f8137770 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f48e800c7c0 tx=0x7f48e8007e00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:01.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.500+0000 7f48e67fc700 1 -- 172.21.15.111:0/992175404 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e8005b30 con 0x7f48f8063a40 2024-04-25T02:23:01.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.500+0000 7f48e67fc700 1 -- 172.21.15.111:0/992175404 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48e8005cb0 con 0x7f48f8063a40 2024-04-25T02:23:01.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.500+0000 7f48e67fc700 1 -- 172.21.15.111:0/992175404 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48e8007320 con 0x7f48f8063a40 2024-04-25T02:23:01.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.500+0000 7f48fca37700 1 -- 172.21.15.111:0/992175404 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48ec009420 con 0x7f48f8063a40 2024-04-25T02:23:01.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.500+0000 7f48fca37700 1 -- 172.21.15.111:0/992175404 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48f8140490 con 0x7f48f8063a40 2024-04-25T02:23:01.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.501+0000 7f48fca37700 1 -- 172.21.15.111:0/992175404 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48f81368f0 con 0x7f48f8063a40 2024-04-25T02:23:01.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.501+0000 7f48e67fc700 1 -- 172.21.15.111:0/992175404 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 9) v1 ==== 53544+0+0 (secure 0 0 0) 0x7f48e801b3b0 con 0x7f48f8063a40 2024-04-25T02:23:01.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.501+0000 7f48e67fc700 1 -- 172.21.15.111:0/992175404 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f48e805a4f0 con 0x7f48f8063a40 2024-04-25T02:23:01.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.505+0000 7f48e67fc700 1 -- 172.21.15.111:0/992175404 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f48e80388e0 con 0x7f48f8063a40 2024-04-25T02:23:01.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.660+0000 7f48fca37700 1 -- 172.21.15.111:0/992175404 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f48f8065190 con 0x7f48f8063a40 2024-04-25T02:23:01.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.660+0000 7f48e67fc700 1 -- 172.21.15.111:0/992175404 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v22) v1 ==== 100+0+11 (secure 0 0 0) 0x7f48e8017020 con 0x7f48f8063a40 2024-04-25T02:23:01.664 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 64 2024-04-25T02:23:01.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.662+0000 7f48fca37700 1 -- 172.21.15.111:0/992175404 >> v1:172.21.15.111:6816/46482 conn(0x7f48d8045f80 legacy=0x7f48d8048430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:01.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.662+0000 7f48fca37700 1 -- 172.21.15.111:0/992175404 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f48f8063a40 msgr2=0x7f48f8137770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:01.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.662+0000 7f48fca37700 1 --2- 172.21.15.111:0/992175404 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f48f8063a40 0x7f48f8137770 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f48e800c7c0 tx=0x7f48e8007e00 comp rx=0 tx=0).stop 2024-04-25T02:23:01.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.662+0000 7f48fca37700 1 -- 172.21.15.111:0/992175404 shutdown_connections 2024-04-25T02:23:01.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.662+0000 7f48fca37700 1 --2- 172.21.15.111:0/992175404 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f48f81325d0 0x7f48f814f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:01.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.662+0000 7f48fca37700 1 --2- 172.21.15.111:0/992175404 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f48f8063a40 0x7f48f8137770 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:01.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.662+0000 7f48fca37700 1 --2- 172.21.15.111:0/992175404 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f48f8132180 0x7f48f814f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:01.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.662+0000 7f48fca37700 1 -- 172.21.15.111:0/992175404 >> 172.21.15.111:0/992175404 conn(0x7f48f80b1e80 msgr2=0x7f48f8141280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:01.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.662+0000 7f48fca37700 1 -- 172.21.15.111:0/992175404 shutdown_connections 2024-04-25T02:23:01.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.662+0000 7f48fca37700 1 -- 172.21.15.111:0/992175404 wait complete. 2024-04-25T02:23:01.677 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:23:01.796 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.792+0000 7fdb674fe700 1 Processor -- start 2024-04-25T02:23:01.796 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.792+0000 7fdb674fe700 1 -- start start 2024-04-25T02:23:01.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.793+0000 7fdb674fe700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fdb600b3140 0x7fdb60069ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:01.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.793+0000 7fdb674fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdb6006f260 0x7fdb601496d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:01.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.793+0000 7fdb674fe700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb6006a020 con 0x7fdb600a3d40 2024-04-25T02:23:01.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.793+0000 7fdb674fe700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb600b0470 con 0x7fdb600b3140 2024-04-25T02:23:01.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.793+0000 7fdb674fe700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb6006a280 con 0x7fdb6006f260 2024-04-25T02:23:01.798 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.793+0000 7fdb65a9b700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdb6006f260 0x7fdb601496d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:01.799 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.793+0000 7fdb6529a700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fdb600b3140 0x7fdb60069ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:01.799 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.793+0000 7fdb65a9b700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdb6006f260 0x7fdb601496d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:50192/0 (socket says 172.21.15.111:50192) 2024-04-25T02:23:01.799 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.793+0000 7fdb6529a700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fdb600b3140 0x7fdb60069ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44512/0 (socket says 172.21.15.111:44512) 2024-04-25T02:23:01.799 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.793+0000 7fdb65a9b700 1 -- 172.21.15.111:0/3683254184 learned_addr learned my addr 172.21.15.111:0/3683254184 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:01.799 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.793+0000 7fdb64a99700 1 --1- 172.21.15.111:0/3683254184 >> v1:172.21.15.111:6789/0 conn(0x7fdb600a3d40 0x7fdb6006eb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:35700/0 (socket says 172.21.15.111:35700) 2024-04-25T02:23:01.799 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.793+0000 7fdb65a9b700 1 -- 172.21.15.111:0/3683254184 >> v2:172.21.15.111:3300/0 conn(0x7fdb600b3140 msgr2=0x7fdb60069ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:01.799 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.793+0000 7fdb65a9b700 1 --2- 172.21.15.111:0/3683254184 >> v2:172.21.15.111:3300/0 conn(0x7fdb600b3140 0x7fdb60069ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:01.799 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.793+0000 7fdb65a9b700 1 -- 172.21.15.111:0/3683254184 >> v1:172.21.15.111:6789/0 conn(0x7fdb600a3d40 legacy=0x7fdb6006eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:01.799 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.793+0000 7fdb65a9b700 1 -- 172.21.15.111:0/3683254184 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb6006a520 con 0x7fdb6006f260 2024-04-25T02:23:01.799 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.793+0000 7fdb6529a700 1 --2- 172.21.15.111:0/3683254184 >> v2:172.21.15.111:3300/0 conn(0x7fdb600b3140 0x7fdb60069ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:01.799 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.793+0000 7fdb57fff700 1 -- 172.21.15.111:0/3683254184 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3359111807 0 0) 0x7fdb6006a020 con 0x7fdb600a3d40 2024-04-25T02:23:01.799 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.793+0000 7fdb65a9b700 1 --2- 172.21.15.111:0/3683254184 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdb6006f260 0x7fdb601496d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdb58009f20 tx=0x7fdb58009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=977e0bbb4a72bda3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:01.799 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.793+0000 7fdb57fff700 1 -- 172.21.15.111:0/3683254184 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5800e070 con 0x7fdb6006f260 2024-04-25T02:23:01.799 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.794+0000 7fdb57fff700 1 -- 172.21.15.111:0/3683254184 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5800b9d0 con 0x7fdb6006f260 2024-04-25T02:23:01.800 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.794+0000 7fdb57fff700 1 -- 172.21.15.111:0/3683254184 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb580092e0 con 0x7fdb6006f260 2024-04-25T02:23:01.800 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.794+0000 7fdb674fe700 1 -- 172.21.15.111:0/3683254184 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdb6006f260 msgr2=0x7fdb601496d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:01.800 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.794+0000 7fdb674fe700 1 --2- 172.21.15.111:0/3683254184 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdb6006f260 0x7fdb601496d0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fdb58009f20 tx=0x7fdb58009840 comp rx=0 tx=0).stop 2024-04-25T02:23:01.800 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.794+0000 7fdb674fe700 1 -- 172.21.15.111:0/3683254184 shutdown_connections 2024-04-25T02:23:01.800 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.794+0000 7fdb674fe700 1 --2- 172.21.15.111:0/3683254184 >> v2:172.21.15.111:3300/0 conn(0x7fdb600b3140 0x7fdb60069ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:01.800 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.794+0000 7fdb674fe700 1 --2- 172.21.15.111:0/3683254184 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdb6006f260 0x7fdb601496d0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:01.800 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.794+0000 7fdb674fe700 1 -- 172.21.15.111:0/3683254184 >> 172.21.15.111:0/3683254184 conn(0x7fdb6006e080 msgr2=0x7fdb6006bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:01.800 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.794+0000 7fdb674fe700 1 -- 172.21.15.111:0/3683254184 shutdown_connections 2024-04-25T02:23:01.800 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.794+0000 7fdb674fe700 1 -- 172.21.15.111:0/3683254184 wait complete. 2024-04-25T02:23:01.803 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.795+0000 7fdb674fe700 1 Processor -- start 2024-04-25T02:23:01.803 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.795+0000 7fdb674fe700 1 -- start start 2024-04-25T02:23:01.803 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.796+0000 7fdb674fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fdb6006f260 0x7fdb60097ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:01.803 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.796+0000 7fdb674fe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdb600a3d40 0x7fdb60140a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:01.803 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.796+0000 7fdb674fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdb600b3140 0x7fdb60140f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:01.803 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.796+0000 7fdb674fe700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb600adc10 con 0x7fdb600a3d40 2024-04-25T02:23:01.803 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.796+0000 7fdb674fe700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb60099b40 con 0x7fdb600b3140 2024-04-25T02:23:01.803 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.796+0000 7fdb674fe700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdb601414c0 con 0x7fdb6006f260 2024-04-25T02:23:01.803 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.796+0000 7fdb65a9b700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdb600b3140 0x7fdb60140f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:01.803 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.796+0000 7fdb64a99700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdb600a3d40 0x7fdb60140a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:01.803 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.796+0000 7fdb6529a700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fdb6006f260 0x7fdb60097ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:01.803 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.796+0000 7fdb65a9b700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdb600b3140 0x7fdb60140f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:50202/0 (socket says 172.21.15.111:50202) 2024-04-25T02:23:01.803 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.796+0000 7fdb65a9b700 1 -- 172.21.15.111:0/2348153896 learned_addr learned my addr 172.21.15.111:0/2348153896 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:01.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.796+0000 7fdb64a99700 1 -- 172.21.15.111:0/2348153896 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fdb6006f260 msgr2=0x7fdb60097ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:01.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.796+0000 7fdb64a99700 1 --2- 172.21.15.111:0/2348153896 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fdb6006f260 0x7fdb60097ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:01.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.796+0000 7fdb64a99700 1 -- 172.21.15.111:0/2348153896 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdb600b3140 msgr2=0x7fdb60140f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:01.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.796+0000 7fdb64a99700 1 --2- 172.21.15.111:0/2348153896 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdb600b3140 0x7fdb60140f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:01.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.796+0000 7fdb64a99700 1 -- 172.21.15.111:0/2348153896 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb50009420 con 0x7fdb600a3d40 2024-04-25T02:23:01.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.796+0000 7fdb65a9b700 1 --2- 172.21.15.111:0/2348153896 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdb600b3140 0x7fdb60140f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:01.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.796+0000 7fdb6529a700 1 --2- 172.21.15.111:0/2348153896 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fdb6006f260 0x7fdb60097ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:01.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.796+0000 7fdb64a99700 1 --2- 172.21.15.111:0/2348153896 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdb600a3d40 0x7fdb60140a40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c0011e0 tx=0x7fdb5c007d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:01.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.796+0000 7fdb557fa700 1 -- 172.21.15.111:0/2348153896 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c005a70 con 0x7fdb600a3d40 2024-04-25T02:23:01.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.796+0000 7fdb557fa700 1 -- 172.21.15.111:0/2348153896 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdb5c005bf0 con 0x7fdb600a3d40 2024-04-25T02:23:01.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.796+0000 7fdb557fa700 1 -- 172.21.15.111:0/2348153896 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdb5c0070d0 con 0x7fdb600a3d40 2024-04-25T02:23:01.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.796+0000 7fdb674fe700 1 -- 172.21.15.111:0/2348153896 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb58009ae0 con 0x7fdb600a3d40 2024-04-25T02:23:01.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.797+0000 7fdb674fe700 1 -- 172.21.15.111:0/2348153896 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb60098480 con 0x7fdb600a3d40 2024-04-25T02:23:01.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.797+0000 7fdb557fa700 1 -- 172.21.15.111:0/2348153896 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7fdb5c007440 con 0x7fdb600a3d40 2024-04-25T02:23:01.805 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.798+0000 7fdb674fe700 1 -- 172.21.15.111:0/2348153896 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb60097900 con 0x7fdb600a3d40 2024-04-25T02:23:01.805 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.798+0000 7fdb557fa700 1 -- 172.21.15.111:0/2348153896 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3840+0+0 (secure 0 0 0) 0x7fdb5c05a550 con 0x7fdb600a3d40 2024-04-25T02:23:01.805 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.801+0000 7fdb557fa700 1 -- 172.21.15.111:0/2348153896 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fdb5c0387a0 con 0x7fdb600a3d40 2024-04-25T02:23:01.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.981+0000 7fdb674fe700 1 -- 172.21.15.111:0/2348153896 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdb600afa80 con 0x7fdb600a3d40 2024-04-25T02:23:01.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.982+0000 7fdb557fa700 1 -- 172.21.15.111:0/2348153896 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+3667 (secure 0 0 0) 0x7fdb5c017070 con 0x7fdb600a3d40 2024-04-25T02:23:01.986 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:23:01.986 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4193,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6817/3699616235","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6817","nonce":3699616235}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4655,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6818/3127437614","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6818","nonce":3127437614}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:20:24.150791+0000","modified":"2024-04-25T02:21:11.248656+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4239},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_4239":{"gid":4239,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.111:6819/4003866251","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6819","nonce":4003866251}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-25T02:23:01.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.983+0000 7fdb674fe700 1 -- 172.21.15.111:0/2348153896 >> v1:172.21.15.111:6816/46482 conn(0x7fdb44046010 legacy=0x7fdb440484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:01.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.983+0000 7fdb674fe700 1 -- 172.21.15.111:0/2348153896 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdb600a3d40 msgr2=0x7fdb60140a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:01.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.983+0000 7fdb674fe700 1 --2- 172.21.15.111:0/2348153896 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdb600a3d40 0x7fdb60140a40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fdb5c0011e0 tx=0x7fdb5c007d30 comp rx=0 tx=0).stop 2024-04-25T02:23:01.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.984+0000 7fdb674fe700 1 -- 172.21.15.111:0/2348153896 shutdown_connections 2024-04-25T02:23:01.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.984+0000 7fdb674fe700 1 --2- 172.21.15.111:0/2348153896 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdb600b3140 0x7fdb60140f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:01.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.984+0000 7fdb674fe700 1 --2- 172.21.15.111:0/2348153896 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fdb6006f260 0x7fdb60097ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:01.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.984+0000 7fdb674fe700 1 --2- 172.21.15.111:0/2348153896 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdb600a3d40 0x7fdb60140a40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:01.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.984+0000 7fdb674fe700 1 -- 172.21.15.111:0/2348153896 >> 172.21.15.111:0/2348153896 conn(0x7fdb6006e080 msgr2=0x7fdb60144220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:01.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.984+0000 7fdb674fe700 1 -- 172.21.15.111:0/2348153896 shutdown_connections 2024-04-25T02:23:01.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:01.984+0000 7fdb674fe700 1 -- 172.21.15.111:0/2348153896 wait complete. 2024-04-25T02:23:01.988 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 13 2024-04-25T02:23:01.999 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:23:02.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.110+0000 7f9e2548c700 1 Processor -- start 2024-04-25T02:23:02.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.110+0000 7f9e2548c700 1 -- start start 2024-04-25T02:23:02.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.111+0000 7f9e2548c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9e200a2600 0x7f9e200a4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:02.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.111+0000 7f9e2548c700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f9e200a31c0 0x7f9e2013f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:02.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.111+0000 7f9e2548c700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e200a3f40 con 0x7f9e2006dab0 2024-04-25T02:23:02.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.111+0000 7f9e2548c700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e200a4980 con 0x7f9e200a31c0 2024-04-25T02:23:02.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.111+0000 7f9e2548c700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e200a4b90 con 0x7f9e200a2600 2024-04-25T02:23:02.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.111+0000 7f9e1e7fc700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f9e200a31c0 0x7f9e2013f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:02.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.111+0000 7f9e1effd700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9e200a2600 0x7f9e200a4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:02.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.111+0000 7f9e1effd700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9e200a2600 0x7f9e200a4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:35360/0 (socket says 172.21.15.111:35360) 2024-04-25T02:23:02.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.111+0000 7f9e1e7fc700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f9e200a31c0 0x7f9e2013f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44536/0 (socket says 172.21.15.111:44536) 2024-04-25T02:23:02.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.111+0000 7f9e1effd700 1 -- 172.21.15.111:0/2734255309 learned_addr learned my addr 172.21.15.111:0/2734255309 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:02.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.111+0000 7f9e1f7fe700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f9e2006dab0 0x7f9e2006def0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:35702/0 (socket says 172.21.15.111:35702) 2024-04-25T02:23:02.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.111+0000 7f9e1e7fc700 1 -- 172.21.15.111:0/2734255309 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9e200a2600 msgr2=0x7f9e200a4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:02.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.111+0000 7f9e1e7fc700 1 --2- 172.21.15.111:0/2734255309 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9e200a2600 0x7f9e200a4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:02.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.111+0000 7f9e1e7fc700 1 -- 172.21.15.111:0/2734255309 >> v1:172.21.15.111:6789/0 conn(0x7f9e2006dab0 legacy=0x7f9e2006def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:02.117 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.111+0000 7f9e1e7fc700 1 -- 172.21.15.111:0/2734255309 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e2013e8e0 con 0x7f9e200a31c0 2024-04-25T02:23:02.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.111+0000 7f9e1dffb700 1 -- 172.21.15.111:0/2734255309 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 891942143 0 0) 0x7f9e200a3f40 con 0x7f9e2006dab0 2024-04-25T02:23:02.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.111+0000 7f9e1effd700 1 --2- 172.21.15.111:0/2734255309 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9e200a2600 0x7f9e200a4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:02.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.111+0000 7f9e1e7fc700 1 --2- 172.21.15.111:0/2734255309 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9e200a31c0 0x7f9e2013f040 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9e100098e0 tx=0x7f9e100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3506ccadceb4edfd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:02.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.112+0000 7f9e1dffb700 1 -- 172.21.15.111:0/2734255309 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1000b640 con 0x7f9e200a31c0 2024-04-25T02:23:02.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.112+0000 7f9e1dffb700 1 -- 172.21.15.111:0/2734255309 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e1000b7a0 con 0x7f9e200a31c0 2024-04-25T02:23:02.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.112+0000 7f9e1dffb700 1 -- 172.21.15.111:0/2734255309 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1000bb40 con 0x7f9e200a31c0 2024-04-25T02:23:02.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.112+0000 7f9e2548c700 1 -- 172.21.15.111:0/2734255309 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9e200a31c0 msgr2=0x7f9e2013f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:02.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.112+0000 7f9e2548c700 1 --2- 172.21.15.111:0/2734255309 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9e200a31c0 0x7f9e2013f040 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9e100098e0 tx=0x7f9e100091a0 comp rx=0 tx=0).stop 2024-04-25T02:23:02.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.112+0000 7f9e2548c700 1 -- 172.21.15.111:0/2734255309 shutdown_connections 2024-04-25T02:23:02.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.112+0000 7f9e2548c700 1 --2- 172.21.15.111:0/2734255309 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9e200a2600 0x7f9e200a4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:02.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.112+0000 7f9e2548c700 1 --2- 172.21.15.111:0/2734255309 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9e200a31c0 0x7f9e2013f040 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:02.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.112+0000 7f9e2548c700 1 -- 172.21.15.111:0/2734255309 >> 172.21.15.111:0/2734255309 conn(0x7f9e2006d200 msgr2=0x7f9e2006aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:02.119 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.112+0000 7f9e2548c700 1 -- 172.21.15.111:0/2734255309 shutdown_connections 2024-04-25T02:23:02.119 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.112+0000 7f9e2548c700 1 -- 172.21.15.111:0/2734255309 wait complete. 2024-04-25T02:23:02.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.113+0000 7f9e2548c700 1 Processor -- start 2024-04-25T02:23:02.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.113+0000 7f9e2548c700 1 -- start start 2024-04-25T02:23:02.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.114+0000 7f9e2548c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9e2006dab0 0x7f9e200690e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:02.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.114+0000 7f9e2548c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9e200a2600 0x7f9e200a0ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:02.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.114+0000 7f9e2548c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9e200a31c0 0x7f9e200a1420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:02.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.114+0000 7f9e2548c700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2013a150 con 0x7f9e200a2600 2024-04-25T02:23:02.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.114+0000 7f9e2548c700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2013b820 con 0x7f9e200a31c0 2024-04-25T02:23:02.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.114+0000 7f9e2548c700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9e201399e0 con 0x7f9e2006dab0 2024-04-25T02:23:02.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.114+0000 7f9e1effd700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9e2006dab0 0x7f9e200690e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:02.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.114+0000 7f9e1e7fc700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9e200a2600 0x7f9e200a0ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:02.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.114+0000 7f9e1effd700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9e2006dab0 0x7f9e200690e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:35376/0 (socket says 172.21.15.111:35376) 2024-04-25T02:23:02.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.114+0000 7f9e1effd700 1 -- 172.21.15.111:0/3501987450 learned_addr learned my addr 172.21.15.111:0/3501987450 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:02.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.114+0000 7f9e1f7fe700 1 --2- 172.21.15.111:0/3501987450 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9e200a31c0 0x7f9e200a1420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:02.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.114+0000 7f9e1e7fc700 1 -- 172.21.15.111:0/3501987450 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9e2006dab0 msgr2=0x7f9e200690e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:02.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.114+0000 7f9e1e7fc700 1 --2- 172.21.15.111:0/3501987450 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9e2006dab0 0x7f9e200690e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:02.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.114+0000 7f9e1e7fc700 1 -- 172.21.15.111:0/3501987450 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9e200a31c0 msgr2=0x7f9e200a1420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:02.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.114+0000 7f9e1e7fc700 1 --2- 172.21.15.111:0/3501987450 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9e200a31c0 0x7f9e200a1420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:02.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.114+0000 7f9e1e7fc700 1 -- 172.21.15.111:0/3501987450 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e140094f0 con 0x7f9e200a2600 2024-04-25T02:23:02.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.114+0000 7f9e1e7fc700 1 --2- 172.21.15.111:0/3501987450 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9e200a2600 0x7f9e200a0ee0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9e10016000 tx=0x7f9e10017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:02.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.114+0000 7f9e06ffd700 1 -- 172.21.15.111:0/3501987450 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e1000bb20 con 0x7f9e200a2600 2024-04-25T02:23:02.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.114+0000 7f9e06ffd700 1 -- 172.21.15.111:0/3501987450 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e10000c90 con 0x7f9e200a2600 2024-04-25T02:23:02.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.114+0000 7f9e2548c700 1 -- 172.21.15.111:0/3501987450 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e10009420 con 0x7f9e200a2600 2024-04-25T02:23:02.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.115+0000 7f9e06ffd700 1 -- 172.21.15.111:0/3501987450 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e10011690 con 0x7f9e200a2600 2024-04-25T02:23:02.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.115+0000 7f9e2548c700 1 -- 172.21.15.111:0/3501987450 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e2013fb50 con 0x7f9e200a2600 2024-04-25T02:23:02.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.115+0000 7f9e06ffd700 1 -- 172.21.15.111:0/3501987450 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f9e10011a80 con 0x7f9e200a2600 2024-04-25T02:23:02.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.115+0000 7f9e2548c700 1 -- 172.21.15.111:0/3501987450 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e2013a3e0 con 0x7f9e200a2600 2024-04-25T02:23:02.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.116+0000 7f9e06ffd700 1 -- 172.21.15.111:0/3501987450 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f9e1005c900 con 0x7f9e200a2600 2024-04-25T02:23:02.124 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.119+0000 7f9e06ffd700 1 -- 172.21.15.111:0/3501987450 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f9e10005fa0 con 0x7f9e200a2600 2024-04-25T02:23:02.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.275+0000 7f9e2548c700 1 -- 172.21.15.111:0/3501987450 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9e20071790 con 0x7f9e200a2600 2024-04-25T02:23:02.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.276+0000 7f9e06ffd700 1 -- 172.21.15.111:0/3501987450 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v22) v1 ==== 74+0+11565 (secure 0 0 0) 0x7f9e10015020 con 0x7f9e200a2600 2024-04-25T02:23:02.280 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:23:02.280 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":22,"fsid":"4643f974-f93a-4436-93b8-460ff320e62e","created":"2024-04-25T02:20:05.450475+0000","modified":"2024-04-25T02:22:58.724563+0000","last_up_change":"2024-04-25T02:20:10.439204+0000","last_in_change":"2024-04-25T02:20:10.439204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:20:07.471248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:20:14.420378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:20:22.251868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T02:20:23.128289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"df3f17ca-3b12-42c8-8cf7-8f1b7189e587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6800","nonce":40214}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6801","nonce":40214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6803","nonce":40214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6802","nonce":40214}]},"public_addr":"172.21.15.111:6800/40214","cluster_addr":"172.21.15.111:6801/40214","heartbeat_back_addr":"172.21.15.111:6803/40214","heartbeat_front_addr":"172.21.15.111:6802/40214","state":["exists","up"]},{"osd":1,"uuid":"93d54815-f215-4285-bba6-32f2d1cabf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6812","nonce":40216}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6813","nonce":40216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6815","nonce":40216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6814","nonce":40216}]},"public_addr":"172.21.15.111:6812/40216","cluster_addr":"172.21.15.111:6813/40216","heartbeat_back_addr":"172.21.15.111:6815/40216","heartbeat_front_addr":"172.21.15.111:6814/40216","state":["exists","up"]},{"osd":2,"uuid":"b26b2104-2a2e-408f-9ce7-3587a32a2ebe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6804","nonce":40215}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6805","nonce":40215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6807","nonce":40215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6806","nonce":40215}]},"public_addr":"172.21.15.111:6804/40215","cluster_addr":"172.21.15.111:6805/40215","heartbeat_back_addr":"172.21.15.111:6807/40215","heartbeat_front_addr":"172.21.15.111:6806/40215","state":["exists","up"]},{"osd":3,"uuid":"43c25820-1edc-4031-badf-72e87dd6bf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6808","nonce":40213}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6809","nonce":40213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6811","nonce":40213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6810","nonce":40213}]},"public_addr":"172.21.15.111:6808/40213","cluster_addr":"172.21.15.111:6809/40213","heartbeat_back_addr":"172.21.15.111:6811/40213","heartbeat_front_addr":"172.21.15.111:6810/40213","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.372427+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.411480+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.361508+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.377212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.111:0/2148931273":"2024-04-26T02:22:54.713254+0000","172.21.15.111:6816/39585":"2024-04-26T02:22:54.713254+0000","172.21.15.111:0/3911588907":"2024-04-26T02:22:54.713254+0000","172.21.15.111:0/1276843622":"2024-04-26T02:22:54.713254+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:23:02.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.277+0000 7f9e2548c700 1 -- 172.21.15.111:0/3501987450 >> v1:172.21.15.111:6816/46482 conn(0x7f9e0c046010 legacy=0x7f9e0c0484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:02.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.277+0000 7f9e2548c700 1 -- 172.21.15.111:0/3501987450 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9e200a2600 msgr2=0x7f9e200a0ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:02.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.277+0000 7f9e2548c700 1 --2- 172.21.15.111:0/3501987450 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9e200a2600 0x7f9e200a0ee0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9e10016000 tx=0x7f9e10017000 comp rx=0 tx=0).stop 2024-04-25T02:23:02.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.278+0000 7f9e2548c700 1 -- 172.21.15.111:0/3501987450 shutdown_connections 2024-04-25T02:23:02.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.278+0000 7f9e2548c700 1 --2- 172.21.15.111:0/3501987450 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9e200a31c0 0x7f9e200a1420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:02.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.278+0000 7f9e2548c700 1 --2- 172.21.15.111:0/3501987450 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9e2006dab0 0x7f9e200690e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:02.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.278+0000 7f9e2548c700 1 --2- 172.21.15.111:0/3501987450 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9e200a2600 0x7f9e200a0ee0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:02.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.278+0000 7f9e2548c700 1 -- 172.21.15.111:0/3501987450 >> 172.21.15.111:0/3501987450 conn(0x7f9e2006d200 msgr2=0x7f9e201471c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:02.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.278+0000 7f9e2548c700 1 -- 172.21.15.111:0/3501987450 shutdown_connections 2024-04-25T02:23:02.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.278+0000 7f9e2548c700 1 -- 172.21.15.111:0/3501987450 wait complete. 2024-04-25T02:23:02.293 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:23:02.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.404+0000 7fb7ec324700 1 Processor -- start 2024-04-25T02:23:02.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.404+0000 7fb7ec324700 1 -- start start 2024-04-25T02:23:02.411 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.405+0000 7fb7ec324700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb7e406eb20 0x7fb7e40a43f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:02.411 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.405+0000 7fb7ec324700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fb7e40a33c0 0x7fb7e4068a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:02.411 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.405+0000 7fb7ec324700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb7e4068f90 0x7fb7e4069410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:02.411 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.405+0000 7fb7ec324700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7e406f4f0 con 0x7fb7e40a33c0 2024-04-25T02:23:02.411 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.405+0000 7fb7ec324700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e40a3df0 con 0x7fb7e406eb20 2024-04-25T02:23:02.411 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.405+0000 7fb7ec324700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e406a120 con 0x7fb7e4068f90 2024-04-25T02:23:02.411 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.405+0000 7fb7ea0c0700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb7e406eb20 0x7fb7e40a43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:02.411 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.405+0000 7fb7e98bf700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fb7e40a33c0 0x7fb7e4068a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:02.411 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.405+0000 7fb7ea8c1700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb7e4068f90 0x7fb7e4069410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:02.411 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.405+0000 7fb7ea8c1700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb7e4068f90 0x7fb7e4069410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:35386/0 (socket says 172.21.15.111:35386) 2024-04-25T02:23:02.411 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.405+0000 7fb7e98bf700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fb7e40a33c0 0x7fb7e4068a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44544/0 (socket says 172.21.15.111:44544) 2024-04-25T02:23:02.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.405+0000 7fb7ea0c0700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb7e406eb20 0x7fb7e40a43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:50216/0 (socket says 172.21.15.111:50216) 2024-04-25T02:23:02.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.405+0000 7fb7ea8c1700 1 -- 172.21.15.111:0/3183476768 learned_addr learned my addr 172.21.15.111:0/3183476768 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:02.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.405+0000 7fb7ea0c0700 1 -- 172.21.15.111:0/3183476768 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb7e4068f90 msgr2=0x7fb7e4069410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:02.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.405+0000 7fb7ea0c0700 1 --2- 172.21.15.111:0/3183476768 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb7e4068f90 0x7fb7e4069410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:02.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.405+0000 7fb7ea0c0700 1 -- 172.21.15.111:0/3183476768 >> v2:172.21.15.111:3300/0 conn(0x7fb7e40a33c0 msgr2=0x7fb7e4068a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:02.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.405+0000 7fb7ea0c0700 1 --2- 172.21.15.111:0/3183476768 >> v2:172.21.15.111:3300/0 conn(0x7fb7e40a33c0 0x7fb7e4068a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:02.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.405+0000 7fb7ea0c0700 1 -- 172.21.15.111:0/3183476768 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e406a380 con 0x7fb7e406eb20 2024-04-25T02:23:02.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.405+0000 7fb7ea8c1700 1 --2- 172.21.15.111:0/3183476768 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb7e4068f90 0x7fb7e4069410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:02.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.405+0000 7fb7e98bf700 1 --2- 172.21.15.111:0/3183476768 >> v2:172.21.15.111:3300/0 conn(0x7fb7e40a33c0 0x7fb7e4068a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:02.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.406+0000 7fb7ea0c0700 1 --2- 172.21.15.111:0/3183476768 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb7e406eb20 0x7fb7e40a43f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4009910 tx=0x7fb7d40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6d8a87d48d8eb988 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:02.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.406+0000 7fb7e90be700 1 -- 172.21.15.111:0/3183476768 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d4011630 con 0x7fb7e406eb20 2024-04-25T02:23:02.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.406+0000 7fb7e90be700 1 -- 172.21.15.111:0/3183476768 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d4011790 con 0x7fb7e406eb20 2024-04-25T02:23:02.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.406+0000 7fb7e90be700 1 -- 172.21.15.111:0/3183476768 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d4011b30 con 0x7fb7e406eb20 2024-04-25T02:23:02.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.406+0000 7fb7ec324700 1 -- 172.21.15.111:0/3183476768 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb7e406eb20 msgr2=0x7fb7e40a43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:02.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.406+0000 7fb7ec324700 1 --2- 172.21.15.111:0/3183476768 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb7e406eb20 0x7fb7e40a43f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fb7d4009910 tx=0x7fb7d40091a0 comp rx=0 tx=0).stop 2024-04-25T02:23:02.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.406+0000 7fb7ec324700 1 -- 172.21.15.111:0/3183476768 shutdown_connections 2024-04-25T02:23:02.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.406+0000 7fb7ec324700 1 --2- 172.21.15.111:0/3183476768 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb7e4068f90 0x7fb7e4069410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:02.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.406+0000 7fb7ec324700 1 --2- 172.21.15.111:0/3183476768 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb7e406eb20 0x7fb7e40a43f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:02.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.406+0000 7fb7ec324700 1 --2- 172.21.15.111:0/3183476768 >> v2:172.21.15.111:3300/0 conn(0x7fb7e40a33c0 0x7fb7e4068a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:02.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.406+0000 7fb7ec324700 1 -- 172.21.15.111:0/3183476768 >> 172.21.15.111:0/3183476768 conn(0x7fb7e4067940 msgr2=0x7fb7e4067d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:02.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.406+0000 7fb7ec324700 1 -- 172.21.15.111:0/3183476768 shutdown_connections 2024-04-25T02:23:02.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.406+0000 7fb7ec324700 1 -- 172.21.15.111:0/3183476768 wait complete. 2024-04-25T02:23:02.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.407+0000 7fb7ec324700 1 Processor -- start 2024-04-25T02:23:02.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.407+0000 7fb7ec324700 1 -- start start 2024-04-25T02:23:02.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.408+0000 7fb7ec324700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb7e4068f90 0x7fb7e4098580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:02.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.408+0000 7fb7ec324700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb7e406eb20 0x7fb7e413e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:02.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.408+0000 7fb7ec324700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb7e40a33c0 0x7fb7e413ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:02.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.408+0000 7fb7ec324700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e4097b50 con 0x7fb7e406eb20 2024-04-25T02:23:02.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.408+0000 7fb7ec324700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e413f3a0 con 0x7fb7e40a33c0 2024-04-25T02:23:02.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.408+0000 7fb7ec324700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e40a2940 con 0x7fb7e4068f90 2024-04-25T02:23:02.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.408+0000 7fb7ea0c0700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb7e4068f90 0x7fb7e4098580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:02.415 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.408+0000 7fb7ea8c1700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb7e40a33c0 0x7fb7e413ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:02.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.408+0000 7fb7e98bf700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb7e406eb20 0x7fb7e413e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:02.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.408+0000 7fb7ea0c0700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb7e4068f90 0x7fb7e4098580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:35390/0 (socket says 172.21.15.111:35390) 2024-04-25T02:23:02.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.408+0000 7fb7ea0c0700 1 -- 172.21.15.111:0/873099277 learned_addr learned my addr 172.21.15.111:0/873099277 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:02.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.408+0000 7fb7ea0c0700 1 -- 172.21.15.111:0/873099277 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb7e40a33c0 msgr2=0x7fb7e413ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:02.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.408+0000 7fb7ea0c0700 1 --2- 172.21.15.111:0/873099277 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb7e40a33c0 0x7fb7e413ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:02.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.408+0000 7fb7ea0c0700 1 -- 172.21.15.111:0/873099277 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb7e406eb20 msgr2=0x7fb7e413e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:02.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.408+0000 7fb7ea0c0700 1 --2- 172.21.15.111:0/873099277 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb7e406eb20 0x7fb7e413e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:02.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.408+0000 7fb7ea0c0700 1 -- 172.21.15.111:0/873099277 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7dc009ae0 con 0x7fb7e4068f90 2024-04-25T02:23:02.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.408+0000 7fb7e98bf700 1 --2- 172.21.15.111:0/873099277 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb7e406eb20 0x7fb7e413e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:02.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.408+0000 7fb7ea0c0700 1 --2- 172.21.15.111:0/873099277 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb7e4068f90 0x7fb7e4098580 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb7e40a3f80 tx=0x7fb7d4017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:02.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.408+0000 7fb7da7fc700 1 -- 172.21.15.111:0/873099277 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d4000d10 con 0x7fb7e4068f90 2024-04-25T02:23:02.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.408+0000 7fb7da7fc700 1 -- 172.21.15.111:0/873099277 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb7d4011b10 con 0x7fb7e4068f90 2024-04-25T02:23:02.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.409+0000 7fb7ec324700 1 -- 172.21.15.111:0/873099277 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7e0009420 con 0x7fb7e4068f90 2024-04-25T02:23:02.416 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.409+0000 7fb7da7fc700 1 -- 172.21.15.111:0/873099277 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7d4025640 con 0x7fb7e4068f90 2024-04-25T02:23:02.417 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.409+0000 7fb7ec324700 1 -- 172.21.15.111:0/873099277 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7d4009420 con 0x7fb7e4068f90 2024-04-25T02:23:02.417 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.409+0000 7fb7da7fc700 1 -- 172.21.15.111:0/873099277 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7fb7d4025a70 con 0x7fb7e4068f90 2024-04-25T02:23:02.417 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.410+0000 7fb7ec324700 1 -- 172.21.15.111:0/873099277 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7e4096b30 con 0x7fb7e4068f90 2024-04-25T02:23:02.417 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.410+0000 7fb7da7fc700 1 -- 172.21.15.111:0/873099277 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3840+0+0 (secure 0 0 0) 0x7fb7d405c990 con 0x7fb7e4068f90 2024-04-25T02:23:02.417 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.413+0000 7fb7da7fc700 1 -- 172.21.15.111:0/873099277 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fb7e4096b30 con 0x7fb7e4068f90 2024-04-25T02:23:02.597 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.593+0000 7fb7ec324700 1 -- 172.21.15.111:0/873099277 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb7e4096b30 con 0x7fb7e4068f90 2024-04-25T02:23:02.597 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.593+0000 7fb7da7fc700 1 -- 172.21.15.111:0/873099277 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+3667 (secure 0 0 0) 0x7fb7e4096b30 con 0x7fb7e4068f90 2024-04-25T02:23:02.597 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:23:02.597 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":false},"standbys":[{"gid":4193,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6817/3699616235","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6817","nonce":3699616235}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4655,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6818/3127437614","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6818","nonce":3127437614}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":13}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:20:24.150791+0000","modified":"2024-04-25T02:21:11.248656+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4239},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_4239":{"gid":4239,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":4,"addr":"172.21.15.111:6819/4003866251","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6819","nonce":4003866251}]},"join_fscid":-1,"export_targets":[],"features":4540138292840890367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-25T02:23:02.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.595+0000 7fb7ec324700 1 -- 172.21.15.111:0/873099277 >> v1:172.21.15.111:6816/46482 conn(0x7fb7c8046010 legacy=0x7fb7c80484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:02.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.595+0000 7fb7ec324700 1 -- 172.21.15.111:0/873099277 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb7e4068f90 msgr2=0x7fb7e4098580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:02.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.595+0000 7fb7ec324700 1 --2- 172.21.15.111:0/873099277 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb7e4068f90 0x7fb7e4098580 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fb7e40a3f80 tx=0x7fb7d4017000 comp rx=0 tx=0).stop 2024-04-25T02:23:02.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.595+0000 7fb7ec324700 1 -- 172.21.15.111:0/873099277 shutdown_connections 2024-04-25T02:23:02.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.595+0000 7fb7ec324700 1 --2- 172.21.15.111:0/873099277 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb7e40a33c0 0x7fb7e413ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:02.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.595+0000 7fb7ec324700 1 --2- 172.21.15.111:0/873099277 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb7e4068f90 0x7fb7e4098580 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:02.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.595+0000 7fb7ec324700 1 --2- 172.21.15.111:0/873099277 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb7e406eb20 0x7fb7e413e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:02.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.595+0000 7fb7ec324700 1 -- 172.21.15.111:0/873099277 >> 172.21.15.111:0/873099277 conn(0x7fb7e4067940 msgr2=0x7fb7e4144f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:02.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.595+0000 7fb7ec324700 1 -- 172.21.15.111:0/873099277 shutdown_connections 2024-04-25T02:23:02.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:02.595+0000 7fb7ec324700 1 -- 172.21.15.111:0/873099277 wait complete. 2024-04-25T02:23:02.600 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 13 2024-04-25T02:23:02.913 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 12, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T02:20:24.150791+0000', 'modified': '2024-04-25T02:21:11.248656+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4239}, 'failed': [], 'damaged': [], 'stopped': [1], 'info': {'gid_4239': {'gid': 4239, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.111:6819/4003866251', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.111:6819', 'nonce': 4003866251}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138292840890367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-25T02:23:02.913 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T02:23:02.913 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-25T02:23:03.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.027+0000 7f7c832ef700 1 Processor -- start 2024-04-25T02:23:03.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.028+0000 7f7c832ef700 1 -- start start 2024-04-25T02:23:03.034 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.028+0000 7f7c832ef700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7c7c0b2400 0x7f7c7c0a49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:03.034 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.028+0000 7f7c832ef700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f7c7c067940 0x7f7c7c067d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:03.034 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.028+0000 7f7c832ef700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c7c0a3320 con 0x7f7c7c068290 2024-04-25T02:23:03.034 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.028+0000 7f7c832ef700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c7c0a2e20 con 0x7f7c7c067940 2024-04-25T02:23:03.034 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.028+0000 7f7c832ef700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c06f090 con 0x7f7c7c0b2400 2024-04-25T02:23:03.034 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.028+0000 7f7c8108b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7c7c0b2400 0x7f7c7c0a49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:03.034 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.028+0000 7f7c8088a700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f7c7c067940 0x7f7c7c067d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:03.034 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.028+0000 7f7c8088a700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f7c7c067940 0x7f7c7c067d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44572/0 (socket says 172.21.15.111:44572) 2024-04-25T02:23:03.034 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.028+0000 7f7c8188c700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f7c7c068290 0x7f7c7c148520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:35708/0 (socket says 172.21.15.111:35708) 2024-04-25T02:23:03.034 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.028+0000 7f7c8108b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7c7c0b2400 0x7f7c7c0a49f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:35402/0 (socket says 172.21.15.111:35402) 2024-04-25T02:23:03.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.028+0000 7f7c8088a700 1 -- 172.21.15.111:0/1181504084 learned_addr learned my addr 172.21.15.111:0/1181504084 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:03.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.028+0000 7f7c8108b700 1 -- 172.21.15.111:0/1181504084 >> v2:172.21.15.111:3300/0 conn(0x7f7c7c067940 msgr2=0x7f7c7c067d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:03.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.028+0000 7f7c8108b700 1 --2- 172.21.15.111:0/1181504084 >> v2:172.21.15.111:3300/0 conn(0x7f7c7c067940 0x7f7c7c067d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:03.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.029+0000 7f7c8108b700 1 -- 172.21.15.111:0/1181504084 >> v1:172.21.15.111:6789/0 conn(0x7f7c7c068290 legacy=0x7f7c7c148520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:03.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.029+0000 7f7c8108b700 1 -- 172.21.15.111:0/1181504084 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c7c0a3550 con 0x7f7c7c0b2400 2024-04-25T02:23:03.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.029+0000 7f7c73fff700 1 -- 172.21.15.111:0/1181504084 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1306008636 0 0) 0x7f7c7c0a3320 con 0x7f7c7c068290 2024-04-25T02:23:03.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.029+0000 7f7c8088a700 1 --2- 172.21.15.111:0/1181504084 >> v2:172.21.15.111:3300/0 conn(0x7f7c7c067940 0x7f7c7c067d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:03.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.029+0000 7f7c8108b700 1 --2- 172.21.15.111:0/1181504084 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7c7c0b2400 0x7f7c7c0a49f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c0098e0 tx=0x7f7c6c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f9d5fef3b95660f0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:03.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.029+0000 7f7c73fff700 1 -- 172.21.15.111:0/1181504084 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c00b6d0 con 0x7f7c7c0b2400 2024-04-25T02:23:03.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.029+0000 7f7c73fff700 1 -- 172.21.15.111:0/1181504084 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c6c00b830 con 0x7f7c7c0b2400 2024-04-25T02:23:03.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.029+0000 7f7c73fff700 1 -- 172.21.15.111:0/1181504084 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c00bbd0 con 0x7f7c7c0b2400 2024-04-25T02:23:03.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.029+0000 7f7c832ef700 1 -- 172.21.15.111:0/1181504084 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7c7c0b2400 msgr2=0x7f7c7c0a49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:03.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.029+0000 7f7c832ef700 1 --2- 172.21.15.111:0/1181504084 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7c7c0b2400 0x7f7c7c0a49f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7c6c0098e0 tx=0x7f7c6c0091a0 comp rx=0 tx=0).stop 2024-04-25T02:23:03.035 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.029+0000 7f7c832ef700 1 -- 172.21.15.111:0/1181504084 shutdown_connections 2024-04-25T02:23:03.036 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.029+0000 7f7c832ef700 1 --2- 172.21.15.111:0/1181504084 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7c7c0b2400 0x7f7c7c0a49f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:03.036 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.029+0000 7f7c832ef700 1 --2- 172.21.15.111:0/1181504084 >> v2:172.21.15.111:3300/0 conn(0x7f7c7c067940 0x7f7c7c067d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:03.036 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.029+0000 7f7c832ef700 1 -- 172.21.15.111:0/1181504084 >> 172.21.15.111:0/1181504084 conn(0x7f7c7c06ac90 msgr2=0x7f7c7c0b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:03.036 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.029+0000 7f7c832ef700 1 -- 172.21.15.111:0/1181504084 shutdown_connections 2024-04-25T02:23:03.036 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.030+0000 7f7c832ef700 1 -- 172.21.15.111:0/1181504084 wait complete. 2024-04-25T02:23:03.036 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.030+0000 7f7c832ef700 1 Processor -- start 2024-04-25T02:23:03.036 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.030+0000 7f7c832ef700 1 -- start start 2024-04-25T02:23:03.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.031+0000 7f7c832ef700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7c7c067940 0x7f7c7c096bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:03.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.031+0000 7f7c832ef700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7c7c068290 0x7f7c7c1514c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:03.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.031+0000 7f7c832ef700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7c7c0b2400 0x7f7c7c151a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:03.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.031+0000 7f7c832ef700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c0999a0 con 0x7f7c7c0b2400 2024-04-25T02:23:03.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.031+0000 7f7c832ef700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c0ae180 con 0x7f7c7c067940 2024-04-25T02:23:03.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.031+0000 7f7c832ef700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c7c0975a0 con 0x7f7c7c068290 2024-04-25T02:23:03.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.031+0000 7f7c8188c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7c7c0b2400 0x7f7c7c151a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:03.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.031+0000 7f7c8108b700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7c7c067940 0x7f7c7c096bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:03.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.031+0000 7f7c8188c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7c7c0b2400 0x7f7c7c151a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44574/0 (socket says 172.21.15.111:44574) 2024-04-25T02:23:03.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.031+0000 7f7c8188c700 1 -- 172.21.15.111:0/3862789734 learned_addr learned my addr 172.21.15.111:0/3862789734 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:03.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.031+0000 7f7c8088a700 1 --2- 172.21.15.111:0/3862789734 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7c7c068290 0x7f7c7c1514c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:03.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.031+0000 7f7c8188c700 1 -- 172.21.15.111:0/3862789734 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7c7c068290 msgr2=0x7f7c7c1514c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:03.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.031+0000 7f7c8188c700 1 --2- 172.21.15.111:0/3862789734 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7c7c068290 0x7f7c7c1514c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:03.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.031+0000 7f7c8188c700 1 -- 172.21.15.111:0/3862789734 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7c7c067940 msgr2=0x7f7c7c096bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:03.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.031+0000 7f7c8188c700 1 --2- 172.21.15.111:0/3862789734 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7c7c067940 0x7f7c7c096bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:03.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.031+0000 7f7c8188c700 1 -- 172.21.15.111:0/3862789734 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c780094f0 con 0x7f7c7c0b2400 2024-04-25T02:23:03.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.031+0000 7f7c8108b700 1 --2- 172.21.15.111:0/3862789734 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7c7c067940 0x7f7c7c096bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:03.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.032+0000 7f7c8188c700 1 --2- 172.21.15.111:0/3862789734 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7c7c0b2400 0x7f7c7c151a00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7c7400cd50 tx=0x7f7c74001b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:03.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.032+0000 7f7c717fa700 1 -- 172.21.15.111:0/3862789734 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c74005df0 con 0x7f7c7c0b2400 2024-04-25T02:23:03.040 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.032+0000 7f7c717fa700 1 -- 172.21.15.111:0/3862789734 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c7400a8b0 con 0x7f7c7c0b2400 2024-04-25T02:23:03.040 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.032+0000 7f7c717fa700 1 -- 172.21.15.111:0/3862789734 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7400ac70 con 0x7f7c7c0b2400 2024-04-25T02:23:03.040 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.032+0000 7f7c832ef700 1 -- 172.21.15.111:0/3862789734 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c6c009420 con 0x7f7c7c0b2400 2024-04-25T02:23:03.040 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.032+0000 7f7c832ef700 1 -- 172.21.15.111:0/3862789734 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c7c098470 con 0x7f7c7c0b2400 2024-04-25T02:23:03.040 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.033+0000 7f7c717fa700 1 -- 172.21.15.111:0/3862789734 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f7c74007300 con 0x7f7c7c0b2400 2024-04-25T02:23:03.040 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.033+0000 7f7c717fa700 1 -- 172.21.15.111:0/3862789734 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f7c7405b1f0 con 0x7f7c7c0b2400 2024-04-25T02:23:03.045 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.035+0000 7f7c8c608b80 1 Processor -- start 2024-04-25T02:23:03.046 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.035+0000 7f7c8c608b80 1 -- start start 2024-04-25T02:23:03.046 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.036+0000 7f7c8c608b80 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x557f49a36990 0x557f49a56440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:03.046 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.036+0000 7f7c8c608b80 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x557f49a53b60 0x557f49a53f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:03.046 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.036+0000 7f7c8c608b80 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557f49a69a90 0x557f49a69f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:03.046 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.036+0000 7f7c8c608b80 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f4998c7a0 con 0x557f49a69a90 2024-04-25T02:23:03.046 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.036+0000 7f7c8c608b80 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x557f4998a160 con 0x557f49a36990 2024-04-25T02:23:03.046 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.036+0000 7f7c8c608b80 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x557f49985f50 con 0x557f49a53b60 2024-04-25T02:23:03.046 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.036+0000 7f7c8108b700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x557f49a36990 0x557f49a56440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:03.046 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.036+0000 7f7c8088a700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x557f49a53b60 0x557f49a53f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:03.046 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.036+0000 7f7c8188c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557f49a69a90 0x557f49a69f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:03.046 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.036+0000 7f7c8108b700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x557f49a36990 0x557f49a56440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:50240/0 (socket says 172.21.15.111:50240) 2024-04-25T02:23:03.046 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.036+0000 7f7c8108b700 1 -- 172.21.15.111:0/2989858349 learned_addr learned my addr 172.21.15.111:0/2989858349 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:03.046 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.036+0000 7f7c8088a700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x557f49a53b60 0x557f49a53f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:35418/0 (socket says 172.21.15.111:35418) 2024-04-25T02:23:03.047 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.036+0000 7f7c8188c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557f49a69a90 0x557f49a69f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44576/0 (socket says 172.21.15.111:44576) 2024-04-25T02:23:03.047 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.036+0000 7f7c8108b700 1 -- 172.21.15.111:0/2989858349 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x557f49a53b60 msgr2=0x557f49a53f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:03.047 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.036+0000 7f7c8108b700 1 --2- 172.21.15.111:0/2989858349 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x557f49a53b60 0x557f49a53f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:03.047 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.036+0000 7f7c8108b700 1 -- 172.21.15.111:0/2989858349 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557f49a69a90 msgr2=0x557f49a69f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:03.047 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.036+0000 7f7c8108b700 1 --2- 172.21.15.111:0/2989858349 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557f49a69a90 0x557f49a69f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:03.047 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.036+0000 7f7c8108b700 1 -- 172.21.15.111:0/2989858349 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f497c4230 con 0x557f49a36990 2024-04-25T02:23:03.047 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.036+0000 7f7c8188c700 1 --2- 172.21.15.111:0/2989858349 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557f49a69a90 0x557f49a69f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:03.047 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.036+0000 7f7c8108b700 1 --2- 172.21.15.111:0/2989858349 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x557f49a36990 0x557f49a56440 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c06f1d0 tx=0x7f7c6c017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec335c418f11f3da server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:03.047 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.036+0000 7f7c667fc700 1 -- 172.21.15.111:0/2989858349 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c00bb20 con 0x557f49a36990 2024-04-25T02:23:03.047 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.037+0000 7f7c667fc700 1 -- 172.21.15.111:0/2989858349 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c6c01b7f0 con 0x557f49a36990 2024-04-25T02:23:03.047 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.037+0000 7f7c667fc700 1 -- 172.21.15.111:0/2989858349 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c6c01bb90 con 0x557f49a36990 2024-04-25T02:23:03.047 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.037+0000 7f7c8c608b80 1 -- 172.21.15.111:0/2989858349 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x557f49a36990 msgr2=0x557f49a56440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:03.047 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.037+0000 7f7c8c608b80 1 --2- 172.21.15.111:0/2989858349 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x557f49a36990 0x557f49a56440 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c06f1d0 tx=0x7f7c6c017000 comp rx=0 tx=0).stop 2024-04-25T02:23:03.047 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.037+0000 7f7c8c608b80 1 -- 172.21.15.111:0/2989858349 shutdown_connections 2024-04-25T02:23:03.048 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.037+0000 7f7c8c608b80 1 --2- 172.21.15.111:0/2989858349 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557f49a69a90 0x557f49a69f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:03.048 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.037+0000 7f7c8c608b80 1 --2- 172.21.15.111:0/2989858349 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x557f49a36990 0x557f49a56440 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:03.048 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.037+0000 7f7c8c608b80 1 --2- 172.21.15.111:0/2989858349 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x557f49a53b60 0x557f49a53f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:03.048 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.037+0000 7f7c8c608b80 1 -- 172.21.15.111:0/2989858349 >> 172.21.15.111:0/2989858349 conn(0x557f49a34350 msgr2=0x557f49a37830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:03.048 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.037+0000 7f7c8c608b80 1 -- 172.21.15.111:0/2989858349 shutdown_connections 2024-04-25T02:23:03.048 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.037+0000 7f7c8c608b80 1 -- 172.21.15.111:0/2989858349 wait complete. 2024-04-25T02:23:03.048 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.038+0000 7f7c8c608b80 1 -- start start 2024-04-25T02:23:03.048 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.038+0000 7f7c8c608b80 1 Processor -- start 2024-04-25T02:23:03.048 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.038+0000 7f7c8c608b80 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x557f49a36990 0x557f49a67b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:03.048 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.038+0000 7f7c8c608b80 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557f49a53b60 0x557f49a73f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:03.048 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.038+0000 7f7c8c608b80 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x557f49a69a90 0x557f49a744b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:03.048 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.038+0000 7f7c8c608b80 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f49930d70 con 0x557f49a53b60 2024-04-25T02:23:03.048 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.038+0000 7f7c8c608b80 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x557f49930a10 con 0x557f49a36990 2024-04-25T02:23:03.048 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.038+0000 7f7c8c608b80 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x557f4987e290 con 0x557f49a69a90 2024-04-25T02:23:03.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.038+0000 7f7c8c608b80 10 client.0 _ll_register_callbacks cb 0x557f49880c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:23:03.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.039+0000 7f7c8088a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557f49a53b60 0x557f49a73f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:03.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.039+0000 7f7c8088a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557f49a53b60 0x557f49a73f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44582/0 (socket says 172.21.15.111:44582) 2024-04-25T02:23:03.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.039+0000 7f7c8088a700 1 -- 172.21.15.111:0/1263367649 learned_addr learned my addr 172.21.15.111:0/1263367649 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:03.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.039+0000 7f7c8108b700 1 --2- 172.21.15.111:0/1263367649 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x557f49a36990 0x557f49a67b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:03.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.039+0000 7f7c8188c700 1 --2- 172.21.15.111:0/1263367649 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x557f49a69a90 0x557f49a744b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:03.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.039+0000 7f7c8188c700 1 -- 172.21.15.111:0/1263367649 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x557f49a36990 msgr2=0x557f49a67b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:03.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.039+0000 7f7c8188c700 1 --2- 172.21.15.111:0/1263367649 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x557f49a36990 0x557f49a67b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:03.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.039+0000 7f7c8188c700 1 -- 172.21.15.111:0/1263367649 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557f49a53b60 msgr2=0x557f49a73f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:03.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.039+0000 7f7c8188c700 1 --2- 172.21.15.111:0/1263367649 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557f49a53b60 0x557f49a73f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:03.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.039+0000 7f7c8188c700 1 -- 172.21.15.111:0/1263367649 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c7c098470 con 0x557f49a69a90 2024-04-25T02:23:03.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.039+0000 7f7c8088a700 1 --2- 172.21.15.111:0/1263367649 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557f49a53b60 0x557f49a73f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:03.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.039+0000 7f7c8188c700 1 --2- 172.21.15.111:0/1263367649 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x557f49a69a90 0x557f49a744b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7c74059d70 tx=0x7f7c7400cf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a9190180ad03b6e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:03.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.039+0000 7f7c5b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.111:3302/0 2024-04-25T02:23:03.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.039+0000 7f7c5b7fe700 1 -- 172.21.15.111:0/1263367649 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c74037190 con 0x557f49a69a90 2024-04-25T02:23:03.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.039+0000 7f7c5b7fe700 1 -- 172.21.15.111:0/1263367649 <== mon.2 v2:172.21.15.111:3302/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f7c74037530 con 0x557f49a69a90 2024-04-25T02:23:03.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.039+0000 7f7c8c608b80 1 -- 172.21.15.111:0/1263367649 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x557f4998a3d0 con 0x557f49a69a90 2024-04-25T02:23:03.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.039+0000 7f7c5b7fe700 1 -- 172.21.15.111:0/1263367649 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c7403ca50 con 0x557f49a69a90 2024-04-25T02:23:03.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.039+0000 7f7c8c608b80 10 client.14342 fetch_fsmap learned FSMap version 13 2024-04-25T02:23:03.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.039+0000 7f7c8c608b80 1 -- 172.21.15.111:0/1263367649 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,fsmap=13,monmap=3+}) v3 -- 0x7f7c7c0a3550 con 0x557f49a69a90 2024-04-25T02:23:03.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.039+0000 7f7c5b7fe700 1 -- 172.21.15.111:0/1263367649 <== mon.2 v2:172.21.15.111:3302/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x557f4998a3d0 con 0x557f49a69a90 2024-04-25T02:23:03.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.039+0000 7f7c5b7fe700 1 -- 172.21.15.111:0/1263367649 <== mon.2 v2:172.21.15.111:3302/0 5 ==== fsmap(e 13) v1 ==== 2454+0+0 (secure 0 0 0) 0x7f7c7403c2b0 con 0x557f49a69a90 2024-04-25T02:23:03.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.039+0000 7f7c8c608b80 10 client.14342 fetch_fsmap finished waiting for FSMap version 13 2024-04-25T02:23:03.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.039+0000 7f7c8c608b80 10 client.14342 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T02:23:03.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.039+0000 7f7c8c608b80 20 client.14342 populate_metadata read hostname 'smithi111' 2024-04-25T02:23:03.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.040+0000 7f7c8c608b80 4 client.14342 mds_command: new command op to 4239 tid=0[{"prefix": "get_command_descriptions"}] 2024-04-25T02:23:03.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.040+0000 7f7c8c608b80 1 -- 172.21.15.111:0/1263367649 --> v1:172.21.15.111:6819/4003866251 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x557f499280e0 con 0x557f49a50ad0 2024-04-25T02:23:03.050 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.040+0000 7f7c5b7fe700 10 client.14342 ms_handle_connect on v1:172.21.15.111:6819/4003866251 2024-04-25T02:23:03.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.040+0000 7f7c5b7fe700 1 -- 172.21.15.111:0/1263367649 <== mds.0 v1:172.21.15.111:6819/4003866251 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17002 (unknown 0 0 4003121674) 0x557f499280e0 con 0x557f49a50ad0 2024-04-25T02:23:03.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.040+0000 7f7c5b7fe700 10 client.14342 handle_command_reply: tid=0 2024-04-25T02:23:03.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.040+0000 7f7c8c608b80 1 client.14342 shutdown 2024-04-25T02:23:03.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.041+0000 7f7c8c608b80 1 -- 172.21.15.111:0/1263367649 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x557f49a69a90 msgr2=0x557f49a744b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:03.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.041+0000 7f7c8c608b80 1 --2- 172.21.15.111:0/1263367649 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x557f49a69a90 0x557f49a744b0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f7c74059d70 tx=0x7f7c7400cf50 comp rx=0 tx=0).stop 2024-04-25T02:23:03.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.041+0000 7f7c8c608b80 1 -- 172.21.15.111:0/1263367649 shutdown_connections 2024-04-25T02:23:03.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.041+0000 7f7c8c608b80 1 --2- 172.21.15.111:0/1263367649 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x557f49a69a90 0x557f49a744b0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:03.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.041+0000 7f7c8c608b80 1 --2- 172.21.15.111:0/1263367649 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x557f49a36990 0x557f49a67b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:03.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.041+0000 7f7c5b7fe700 0 client.14342 ms_handle_reset on v1:172.21.15.111:6819/4003866251 2024-04-25T02:23:03.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.041+0000 7f7c8c608b80 1 --2- 172.21.15.111:0/1263367649 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557f49a53b60 0x557f49a73f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:03.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.041+0000 7f7c8c608b80 1 -- 172.21.15.111:0/1263367649 >> 172.21.15.111:0/1263367649 conn(0x557f49a34350 msgr2=0x557f49a56440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:03.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.041+0000 7f7c8c608b80 1 -- 172.21.15.111:0/1263367649 shutdown_connections 2024-04-25T02:23:03.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.041+0000 7f7c8c608b80 1 -- 172.21.15.111:0/1263367649 wait complete. 2024-04-25T02:23:03.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.041+0000 7f7c8c608b80 20 client.14342 trim_cache size 0 max 16384 2024-04-25T02:23:03.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.057+0000 7f7c8c608b80 1 Processor -- start 2024-04-25T02:23:03.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.057+0000 7f7c8c608b80 1 -- start start 2024-04-25T02:23:03.063 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.058+0000 7f7c8c608b80 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557f49a36990 0x557f49a61aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:03.063 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.058+0000 7f7c8c608b80 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x557f49a50ad0 0x557f49a66640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:03.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.058+0000 7f7c8c608b80 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x557f49a53b60 0x557f49a73e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:03.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.058+0000 7f7c8c608b80 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f49a57970 con 0x557f49a36990 2024-04-25T02:23:03.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.058+0000 7f7c8c608b80 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x557f49a670f0 con 0x557f49a50ad0 2024-04-25T02:23:03.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.058+0000 7f7c8c608b80 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x557f49a7b330 con 0x557f49a53b60 2024-04-25T02:23:03.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.058+0000 7f7c8108b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557f49a36990 0x557f49a61aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:03.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.058+0000 7f7c8088a700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x557f49a50ad0 0x557f49a66640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:03.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.058+0000 7f7c8188c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x557f49a53b60 0x557f49a73e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:03.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.058+0000 7f7c8108b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557f49a36990 0x557f49a61aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44596/0 (socket says 172.21.15.111:44596) 2024-04-25T02:23:03.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.058+0000 7f7c8108b700 1 -- 172.21.15.111:0/299245015 learned_addr learned my addr 172.21.15.111:0/299245015 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:03.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.058+0000 7f7c8088a700 1 -- 172.21.15.111:0/299245015 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x557f49a53b60 msgr2=0x557f49a73e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:03.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.058+0000 7f7c8088a700 1 --2- 172.21.15.111:0/299245015 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x557f49a53b60 0x557f49a73e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:03.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.058+0000 7f7c8088a700 1 -- 172.21.15.111:0/299245015 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557f49a36990 msgr2=0x557f49a61aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:03.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.058+0000 7f7c8088a700 1 --2- 172.21.15.111:0/299245015 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557f49a36990 0x557f49a61aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:03.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.058+0000 7f7c8088a700 1 -- 172.21.15.111:0/299245015 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x557f49953970 con 0x557f49a50ad0 2024-04-25T02:23:03.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.058+0000 7f7c8188c700 1 --2- 172.21.15.111:0/299245015 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x557f49a53b60 0x557f49a73e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:03.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.058+0000 7f7c8108b700 1 --2- 172.21.15.111:0/299245015 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557f49a36990 0x557f49a61aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:03.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.058+0000 7f7c8088a700 1 --2- 172.21.15.111:0/299245015 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x557f49a50ad0 0x557f49a66640 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c065ba0 tx=0x7f7c78009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=43aac683f2f540d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:03.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.058+0000 7f7c66ffd700 1 -- 172.21.15.111:0/299245015 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7801a070 con 0x557f49a50ad0 2024-04-25T02:23:03.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.058+0000 7f7c66ffd700 1 -- 172.21.15.111:0/299245015 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c78014620 con 0x557f49a50ad0 2024-04-25T02:23:03.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.058+0000 7f7c66ffd700 1 -- 172.21.15.111:0/299245015 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c780149e0 con 0x557f49a50ad0 2024-04-25T02:23:03.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.059+0000 7f7c8c608b80 1 -- 172.21.15.111:0/299245015 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x557f49a50ad0 msgr2=0x557f49a66640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:03.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.059+0000 7f7c8c608b80 1 --2- 172.21.15.111:0/299245015 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x557f49a50ad0 0x557f49a66640 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7c7c065ba0 tx=0x7f7c78009250 comp rx=0 tx=0).stop 2024-04-25T02:23:03.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.059+0000 7f7c8c608b80 1 -- 172.21.15.111:0/299245015 shutdown_connections 2024-04-25T02:23:03.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.059+0000 7f7c8c608b80 1 --2- 172.21.15.111:0/299245015 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x557f49a53b60 0x557f49a73e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:03.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.059+0000 7f7c8c608b80 1 --2- 172.21.15.111:0/299245015 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557f49a36990 0x557f49a61aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:03.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.059+0000 7f7c8c608b80 1 --2- 172.21.15.111:0/299245015 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x557f49a50ad0 0x557f49a66640 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:03.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.059+0000 7f7c8c608b80 1 -- 172.21.15.111:0/299245015 >> 172.21.15.111:0/299245015 conn(0x557f49a34350 msgr2=0x557f49a55a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:03.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.059+0000 7f7c8c608b80 1 -- 172.21.15.111:0/299245015 shutdown_connections 2024-04-25T02:23:03.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.059+0000 7f7c8c608b80 1 -- 172.21.15.111:0/299245015 wait complete. 2024-04-25T02:23:03.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.060+0000 7f7c8c608b80 1 -- start start 2024-04-25T02:23:03.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.060+0000 7f7c8c608b80 1 Processor -- start 2024-04-25T02:23:03.069 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.061+0000 7f7c8c608b80 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557f49a36990 0x557f49a76ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:03.069 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.061+0000 7f7c8c608b80 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x557f49a50ad0 0x557f49ac58b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:03.069 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.061+0000 7f7c8c608b80 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x557f49a53b60 0x557f49ac5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:03.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.061+0000 7f7c8c608b80 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x557f49a6a710 con 0x557f49a36990 2024-04-25T02:23:03.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.061+0000 7f7c8c608b80 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x557f49ac5580 con 0x557f49a50ad0 2024-04-25T02:23:03.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.061+0000 7f7c8c608b80 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x557f49a6a430 con 0x557f49a53b60 2024-04-25T02:23:03.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.061+0000 7f7c8c608b80 10 client.0 _ll_register_callbacks cb 0x7f7c7403cf60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:23:03.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.061+0000 7f7c8188c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x557f49a53b60 0x557f49ac5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:03.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.061+0000 7f7c8088a700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x557f49a50ad0 0x557f49ac58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:03.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.061+0000 7f7c8088a700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x557f49a50ad0 0x557f49ac58b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:50266/0 (socket says 172.21.15.111:50266) 2024-04-25T02:23:03.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.061+0000 7f7c8188c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x557f49a53b60 0x557f49ac5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:35456/0 (socket says 172.21.15.111:35456) 2024-04-25T02:23:03.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.061+0000 7f7c8088a700 1 -- 172.21.15.111:0/2520898094 learned_addr learned my addr 172.21.15.111:0/2520898094 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:03.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.061+0000 7f7c8108b700 1 --2- 172.21.15.111:0/2520898094 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557f49a36990 0x557f49a76ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:03.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.061+0000 7f7c8088a700 1 -- 172.21.15.111:0/2520898094 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x557f49a53b60 msgr2=0x557f49ac5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:03.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.061+0000 7f7c8088a700 1 --2- 172.21.15.111:0/2520898094 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x557f49a53b60 0x557f49ac5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:03.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.061+0000 7f7c8088a700 1 -- 172.21.15.111:0/2520898094 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557f49a36990 msgr2=0x557f49a76ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:03.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.061+0000 7f7c8088a700 1 --2- 172.21.15.111:0/2520898094 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557f49a36990 0x557f49a76ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:03.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.061+0000 7f7c8088a700 1 -- 172.21.15.111:0/2520898094 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x557f497c4230 con 0x557f49a50ad0 2024-04-25T02:23:03.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.061+0000 7f7c8188c700 1 --2- 172.21.15.111:0/2520898094 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x557f49a53b60 0x557f49ac5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:03.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.061+0000 7f7c8108b700 1 --2- 172.21.15.111:0/2520898094 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557f49a36990 0x557f49a76ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:03.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.061+0000 7f7c8088a700 1 --2- 172.21.15.111:0/2520898094 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x557f49a50ad0 0x557f49ac58b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7c78006d40 tx=0x7f7c78021000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=be07be4fe4a2c33d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:03.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.061+0000 7f7c5b7fe700 10 client.0 ms_handle_connect on v2:172.21.15.111:3301/0 2024-04-25T02:23:03.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.061+0000 7f7c5b7fe700 1 -- 172.21.15.111:0/2520898094 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c7801e410 con 0x557f49a50ad0 2024-04-25T02:23:03.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.061+0000 7f7c5b7fe700 1 -- 172.21.15.111:0/2520898094 <== mon.1 v2:172.21.15.111:3301/0 2 ==== osd_map(22..22 src has 1..22) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f7c7801e570 con 0x557f49a50ad0 2024-04-25T02:23:03.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.061+0000 7f7c8c608b80 1 -- 172.21.15.111:0/2520898094 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f7c6c01b7f0 con 0x557f49a50ad0 2024-04-25T02:23:03.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.062+0000 7f7c5b7fe700 1 -- 172.21.15.111:0/2520898094 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7f7c7801e940 con 0x557f49a50ad0 2024-04-25T02:23:03.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.062+0000 7f7c8c608b80 10 client.14335 fetch_fsmap learned FSMap version 13 2024-04-25T02:23:03.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.062+0000 7f7c8c608b80 1 -- 172.21.15.111:0/2520898094 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,fsmap=13,monmap=3+}) v3 -- 0x7f7c7c0a3550 con 0x557f49a50ad0 2024-04-25T02:23:03.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.062+0000 7f7c5b7fe700 1 -- 172.21.15.111:0/2520898094 <== mon.1 v2:172.21.15.111:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c6c01b7f0 con 0x557f49a50ad0 2024-04-25T02:23:03.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.062+0000 7f7c5b7fe700 1 -- 172.21.15.111:0/2520898094 <== mon.1 v2:172.21.15.111:3301/0 5 ==== fsmap(e 13) v1 ==== 2454+0+0 (secure 0 0 0) 0x7f7c7802f020 con 0x557f49a50ad0 2024-04-25T02:23:03.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.062+0000 7f7c8c608b80 10 client.14335 fetch_fsmap finished waiting for FSMap version 13 2024-04-25T02:23:03.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.062+0000 7f7c8c608b80 10 client.14335 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T02:23:03.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.062+0000 7f7c8c608b80 20 client.14335 populate_metadata read hostname 'smithi111' 2024-04-25T02:23:03.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.062+0000 7f7c8c608b80 4 client.14335 mds_command: new command op to 4239 tid=0[{"prefix": "status"}] 2024-04-25T02:23:03.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.062+0000 7f7c8c608b80 1 -- 172.21.15.111:0/2520898094 --> v1:172.21.15.111:6819/4003866251 -- command(tid 0: {"prefix": "status"}) v1 -- 0x557f497e7100 con 0x557f49a69a90 2024-04-25T02:23:03.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.062+0000 7f7c5b7fe700 10 client.14335 ms_handle_connect on v1:172.21.15.111:6819/4003866251 2024-04-25T02:23:03.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.062+0000 7f7c5b7fe700 1 -- 172.21.15.111:0/2520898094 <== mds.0 v1:172.21.15.111:6819/4003866251 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+301 (unknown 0 0 4047128248) 0x557f497e7100 con 0x557f49a69a90 2024-04-25T02:23:03.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.062+0000 7f7c5b7fe700 10 client.14335 handle_command_reply: tid=0 2024-04-25T02:23:03.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.062+0000 7f7c8c608b80 1 client.14335 shutdown 2024-04-25T02:23:03.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.063+0000 7f7c8c608b80 1 -- 172.21.15.111:0/2520898094 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x557f49a50ad0 msgr2=0x557f49ac58b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:03.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.063+0000 7f7c8c608b80 1 --2- 172.21.15.111:0/2520898094 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x557f49a50ad0 0x557f49ac58b0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7c78006d40 tx=0x7f7c78021000 comp rx=0 tx=0).stop 2024-04-25T02:23:03.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.063+0000 7f7c8c608b80 1 -- 172.21.15.111:0/2520898094 shutdown_connections 2024-04-25T02:23:03.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.063+0000 7f7c8c608b80 1 --2- 172.21.15.111:0/2520898094 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x557f49a53b60 0x557f49ac5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:03.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.063+0000 7f7c5b7fe700 0 client.14335 ms_handle_reset on v1:172.21.15.111:6819/4003866251 2024-04-25T02:23:03.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.063+0000 7f7c8c608b80 1 --2- 172.21.15.111:0/2520898094 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x557f49a36990 0x557f49a76ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:03.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.063+0000 7f7c8c608b80 1 --2- 172.21.15.111:0/2520898094 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x557f49a50ad0 0x557f49ac58b0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:03.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.063+0000 7f7c8c608b80 1 -- 172.21.15.111:0/2520898094 >> 172.21.15.111:0/2520898094 conn(0x557f49a34350 msgr2=0x557f49a619f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:03.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.063+0000 7f7c8c608b80 1 -- 172.21.15.111:0/2520898094 shutdown_connections 2024-04-25T02:23:03.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.063+0000 7f7c8c608b80 1 -- 172.21.15.111:0/2520898094 wait complete. 2024-04-25T02:23:03.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.064+0000 7f7c8c608b80 20 client.14335 trim_cache size 0 max 16384 2024-04-25T02:23:03.073 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-25T02:23:03.073 INFO:teuthology.orchestra.run.smithi111.stdout: "cluster_fsid": "4643f974-f93a-4436-93b8-460ff320e62e", 2024-04-25T02:23:03.073 INFO:teuthology.orchestra.run.smithi111.stdout: "whoami": 0, 2024-04-25T02:23:03.074 INFO:teuthology.orchestra.run.smithi111.stdout: "id": 4239, 2024-04-25T02:23:03.074 INFO:teuthology.orchestra.run.smithi111.stdout: "want_state": "up:active", 2024-04-25T02:23:03.074 INFO:teuthology.orchestra.run.smithi111.stdout: "state": "up:active", 2024-04-25T02:23:03.074 INFO:teuthology.orchestra.run.smithi111.stdout: "rank_uptime": 158.912085314, 2024-04-25T02:23:03.074 INFO:teuthology.orchestra.run.smithi111.stdout: "mdsmap_epoch": 12, 2024-04-25T02:23:03.074 INFO:teuthology.orchestra.run.smithi111.stdout: "osdmap_epoch": 22, 2024-04-25T02:23:03.074 INFO:teuthology.orchestra.run.smithi111.stdout: "osdmap_epoch_barrier": 19, 2024-04-25T02:23:03.074 INFO:teuthology.orchestra.run.smithi111.stdout: "uptime": 167.47169306500001 2024-04-25T02:23:03.074 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-25T02:23:03.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.064+0000 7f7c832ef700 1 -- 172.21.15.111:0/3862789734 >> v1:172.21.15.111:6816/46482 conn(0x7f7c60046010 legacy=0x7f7c600484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:03.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.064+0000 7f7c832ef700 1 -- 172.21.15.111:0/3862789734 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7c7c0b2400 msgr2=0x7f7c7c151a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:03.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.064+0000 7f7c832ef700 1 --2- 172.21.15.111:0/3862789734 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7c7c0b2400 0x7f7c7c151a00 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f7c7400cd50 tx=0x7f7c74001b10 comp rx=0 tx=0).stop 2024-04-25T02:23:03.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.064+0000 7f7c832ef700 1 -- 172.21.15.111:0/3862789734 shutdown_connections 2024-04-25T02:23:03.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.064+0000 7f7c832ef700 1 --2- 172.21.15.111:0/3862789734 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7c7c0b2400 0x7f7c7c151a00 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:03.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.064+0000 7f7c832ef700 1 --2- 172.21.15.111:0/3862789734 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7c7c067940 0x7f7c7c096bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:03.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.064+0000 7f7c832ef700 1 --2- 172.21.15.111:0/3862789734 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7c7c068290 0x7f7c7c1514c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:03.075 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.064+0000 7f7c832ef700 1 -- 172.21.15.111:0/3862789734 >> 172.21.15.111:0/3862789734 conn(0x7f7c7c06ac90 msgr2=0x7f7c7c069170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:03.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.064+0000 7f7c832ef700 1 -- 172.21.15.111:0/3862789734 shutdown_connections 2024-04-25T02:23:03.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.064+0000 7f7c832ef700 1 -- 172.21.15.111:0/3862789734 wait complete. 2024-04-25T02:23:03.079 INFO:teuthology.run_tasks:Running task ceph.restart... 2024-04-25T02:23:03.091 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-25T02:23:03.091 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:23:03.117 INFO:tasks.ceph.osd.0:Stopped 2024-04-25T02:23:03.117 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 0 2024-04-25T02:23:03.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.270+0000 7fa407dc6700 1 Processor -- start 2024-04-25T02:23:03.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.270+0000 7fa407dc6700 1 -- start start 2024-04-25T02:23:03.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.271+0000 7fa407dc6700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fa4000a2600 0x7fa4000a4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:03.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.271+0000 7fa407dc6700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa4000a31c0 0x7fa40013f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:03.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.271+0000 7fa407dc6700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa40006dab0 0x7fa40006df30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:03.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.271+0000 7fa407dc6700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4000a4980 con 0x7fa4000a2600 2024-04-25T02:23:03.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.271+0000 7fa407dc6700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4000a3f40 con 0x7fa4000a31c0 2024-04-25T02:23:03.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.271+0000 7fa407dc6700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4000a4b90 con 0x7fa40006dab0 2024-04-25T02:23:03.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.271+0000 7fa405b62700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fa4000a2600 0x7fa4000a4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:03.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.271+0000 7fa405361700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa4000a31c0 0x7fa40013f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:03.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.271+0000 7fa406363700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa40006dab0 0x7fa40006df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:03.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.271+0000 7fa405361700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa4000a31c0 0x7fa40013f040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:50268/0 (socket says 172.21.15.111:50268) 2024-04-25T02:23:03.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.271+0000 7fa406363700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa40006dab0 0x7fa40006df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:35460/0 (socket says 172.21.15.111:35460) 2024-04-25T02:23:03.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.271+0000 7fa405361700 1 -- 172.21.15.111:0/906428543 learned_addr learned my addr 172.21.15.111:0/906428543 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:03.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.271+0000 7fa405b62700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fa4000a2600 0x7fa4000a4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44608/0 (socket says 172.21.15.111:44608) 2024-04-25T02:23:03.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.271+0000 7fa405361700 1 -- 172.21.15.111:0/906428543 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa40006dab0 msgr2=0x7fa40006df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:03.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.271+0000 7fa405361700 1 --2- 172.21.15.111:0/906428543 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa40006dab0 0x7fa40006df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:03.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.271+0000 7fa405361700 1 -- 172.21.15.111:0/906428543 >> v2:172.21.15.111:3300/0 conn(0x7fa4000a2600 msgr2=0x7fa4000a4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:03.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.271+0000 7fa405361700 1 --2- 172.21.15.111:0/906428543 >> v2:172.21.15.111:3300/0 conn(0x7fa4000a2600 0x7fa4000a4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:03.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.271+0000 7fa405361700 1 -- 172.21.15.111:0/906428543 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa40013e8e0 con 0x7fa4000a31c0 2024-04-25T02:23:03.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.271+0000 7fa406363700 1 --2- 172.21.15.111:0/906428543 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa40006dab0 0x7fa40006df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:03.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.271+0000 7fa405b62700 1 --2- 172.21.15.111:0/906428543 >> v2:172.21.15.111:3300/0 conn(0x7fa4000a2600 0x7fa4000a4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:03.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.271+0000 7fa405361700 1 --2- 172.21.15.111:0/906428543 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa4000a31c0 0x7fa40013f040 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc0099b0 tx=0x7fa3fc009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=65d8ee4872a5ab2c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:03.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.272+0000 7fa404b60700 1 -- 172.21.15.111:0/906428543 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc00b680 con 0x7fa4000a31c0 2024-04-25T02:23:03.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.272+0000 7fa404b60700 1 -- 172.21.15.111:0/906428543 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3fc00b7e0 con 0x7fa4000a31c0 2024-04-25T02:23:03.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.272+0000 7fa404b60700 1 -- 172.21.15.111:0/906428543 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc00bb80 con 0x7fa4000a31c0 2024-04-25T02:23:03.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.272+0000 7fa407dc6700 1 -- 172.21.15.111:0/906428543 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa4000a31c0 msgr2=0x7fa40013f040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:03.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.272+0000 7fa407dc6700 1 --2- 172.21.15.111:0/906428543 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa4000a31c0 0x7fa40013f040 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa3fc0099b0 tx=0x7fa3fc009250 comp rx=0 tx=0).stop 2024-04-25T02:23:03.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.272+0000 7fa407dc6700 1 -- 172.21.15.111:0/906428543 shutdown_connections 2024-04-25T02:23:03.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.272+0000 7fa407dc6700 1 --2- 172.21.15.111:0/906428543 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa40006dab0 0x7fa40006df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:03.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.272+0000 7fa407dc6700 1 --2- 172.21.15.111:0/906428543 >> v2:172.21.15.111:3300/0 conn(0x7fa4000a2600 0x7fa4000a4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:03.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.272+0000 7fa407dc6700 1 --2- 172.21.15.111:0/906428543 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa4000a31c0 0x7fa40013f040 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:03.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.272+0000 7fa407dc6700 1 -- 172.21.15.111:0/906428543 >> 172.21.15.111:0/906428543 conn(0x7fa40006d200 msgr2=0x7fa40006aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:03.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.272+0000 7fa407dc6700 1 -- 172.21.15.111:0/906428543 shutdown_connections 2024-04-25T02:23:03.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.272+0000 7fa407dc6700 1 -- 172.21.15.111:0/906428543 wait complete. 2024-04-25T02:23:03.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.273+0000 7fa407dc6700 1 Processor -- start 2024-04-25T02:23:03.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.273+0000 7fa407dc6700 1 -- start start 2024-04-25T02:23:03.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.274+0000 7fa407dc6700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa40006dab0 0x7fa40014f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:03.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.274+0000 7fa407dc6700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa4000a2600 0x7fa4001374e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:03.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.274+0000 7fa407dc6700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4000a31c0 0x7fa400137a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:03.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.274+0000 7fa407dc6700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4000aeb40 con 0x7fa4000a31c0 2024-04-25T02:23:03.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.274+0000 7fa407dc6700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4000ae120 con 0x7fa40006dab0 2024-04-25T02:23:03.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.274+0000 7fa407dc6700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa40014fed0 con 0x7fa4000a2600 2024-04-25T02:23:03.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.274+0000 7fa405361700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa4000a2600 0x7fa4001374e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:03.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.274+0000 7fa405361700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa4000a2600 0x7fa4001374e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:35474/0 (socket says 172.21.15.111:35474) 2024-04-25T02:23:03.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.274+0000 7fa405361700 1 -- 172.21.15.111:0/3177935705 learned_addr learned my addr 172.21.15.111:0/3177935705 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:03.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.274+0000 7fa406363700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4000a31c0 0x7fa400137a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:03.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.274+0000 7fa405b62700 1 --2- 172.21.15.111:0/3177935705 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa40006dab0 0x7fa40014f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:03.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.274+0000 7fa405361700 1 -- 172.21.15.111:0/3177935705 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa40006dab0 msgr2=0x7fa40014f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:03.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.274+0000 7fa405361700 1 --2- 172.21.15.111:0/3177935705 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa40006dab0 0x7fa40014f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:03.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.274+0000 7fa405361700 1 -- 172.21.15.111:0/3177935705 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4000a31c0 msgr2=0x7fa400137a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:03.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.274+0000 7fa405361700 1 --2- 172.21.15.111:0/3177935705 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4000a31c0 0x7fa400137a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:03.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.274+0000 7fa405361700 1 -- 172.21.15.111:0/3177935705 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3f8009a20 con 0x7fa4000a2600 2024-04-25T02:23:03.282 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.274+0000 7fa405b62700 1 --2- 172.21.15.111:0/3177935705 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa40006dab0 0x7fa40014f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:03.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.274+0000 7fa406363700 1 --2- 172.21.15.111:0/3177935705 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4000a31c0 0x7fa400137a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:03.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.274+0000 7fa405361700 1 --2- 172.21.15.111:0/3177935705 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa4000a2600 0x7fa4001374e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa4000a4080 tx=0x7fa3fc017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:03.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.274+0000 7fa3f5ffb700 1 -- 172.21.15.111:0/3177935705 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc00b950 con 0x7fa4000a2600 2024-04-25T02:23:03.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.274+0000 7fa3f5ffb700 1 -- 172.21.15.111:0/3177935705 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3fc00bab0 con 0x7fa4000a2600 2024-04-25T02:23:03.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.274+0000 7fa407dc6700 1 -- 172.21.15.111:0/3177935705 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3f0009420 con 0x7fa4000a2600 2024-04-25T02:23:03.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.274+0000 7fa3f5ffb700 1 -- 172.21.15.111:0/3177935705 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3fc01a6a0 con 0x7fa4000a2600 2024-04-25T02:23:03.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.275+0000 7fa407dc6700 1 -- 172.21.15.111:0/3177935705 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3fc0094f0 con 0x7fa4000a2600 2024-04-25T02:23:03.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.275+0000 7fa3f5ffb700 1 -- 172.21.15.111:0/3177935705 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7fa3fc01aa10 con 0x7fa4000a2600 2024-04-25T02:23:03.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.275+0000 7fa407dc6700 1 -- 172.21.15.111:0/3177935705 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa400071790 con 0x7fa4000a2600 2024-04-25T02:23:03.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.276+0000 7fa3f5ffb700 1 -- 172.21.15.111:0/3177935705 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3840+0+0 (secure 0 0 0) 0x7fa3fc05c8b0 con 0x7fa4000a2600 2024-04-25T02:23:03.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.279+0000 7fa3f5ffb700 1 -- 172.21.15.111:0/3177935705 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fa3fc026700 con 0x7fa4000a2600 2024-04-25T02:23:03.449 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.446+0000 7fa407dc6700 1 -- 172.21.15.111:0/3177935705 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "osd down", "ids": ["0"]} v 0) v1 -- 0x7fa4000a5750 con 0x7fa4000a2600 2024-04-25T02:23:03.450 INFO:tasks.ceph.mon.a.smithi111.stderr:2024-04-25T02:23:03.446+0000 7f45487c3700 -1 mon.a@0(leader).osd e22 definitely_dead 0 2024-04-25T02:23:03.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.769+0000 7fa3f5ffb700 1 -- 172.21.15.111:0/3177935705 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["0"]}]=0 marked down osd.0. v23) v1 ==== 89+0+0 (secure 0 0 0) 0x7fa3fc02a030 con 0x7fa4000a2600 2024-04-25T02:23:03.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.771+0000 7fa407dc6700 1 -- 172.21.15.111:0/3177935705 >> v1:172.21.15.111:6816/46482 conn(0x7fa3e4046010 legacy=0x7fa3e40484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:03.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.771+0000 7fa407dc6700 1 -- 172.21.15.111:0/3177935705 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa4000a2600 msgr2=0x7fa4001374e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:03.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.771+0000 7fa407dc6700 1 --2- 172.21.15.111:0/3177935705 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa4000a2600 0x7fa4001374e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa4000a4080 tx=0x7fa3fc017000 comp rx=0 tx=0).stop 2024-04-25T02:23:03.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.772+0000 7fa407dc6700 1 -- 172.21.15.111:0/3177935705 shutdown_connections 2024-04-25T02:23:03.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.772+0000 7fa407dc6700 1 --2- 172.21.15.111:0/3177935705 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4000a31c0 0x7fa400137a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:03.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.772+0000 7fa407dc6700 1 --2- 172.21.15.111:0/3177935705 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa40006dab0 0x7fa40014f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:03.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.772+0000 7fa407dc6700 1 --2- 172.21.15.111:0/3177935705 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa4000a2600 0x7fa4001374e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:03.776 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.773+0000 7fa407dc6700 1 -- 172.21.15.111:0/3177935705 >> 172.21.15.111:0/3177935705 conn(0x7fa40006d200 msgr2=0x7fa40006df30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:03.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.773+0000 7fa407dc6700 1 -- 172.21.15.111:0/3177935705 shutdown_connections 2024-04-25T02:23:03.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.773+0000 7fa407dc6700 1 -- 172.21.15.111:0/3177935705 wait complete. 2024-04-25T02:23:03.778 INFO:teuthology.orchestra.run.smithi111.stderr:marked down osd.0. 2024-04-25T02:23:03.789 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-25T02:23:03.790 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-25T02:23:03.792 INFO:tasks.ceph.osd.0:Started 2024-04-25T02:23:03.792 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-25T02:23:03.792 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:23:03.827 INFO:tasks.ceph.osd.1:Stopped 2024-04-25T02:23:03.827 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 1 2024-04-25T02:23:03.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.981+0000 7fcb262a8700 1 Processor -- start 2024-04-25T02:23:03.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.981+0000 7fcb262a8700 1 -- start start 2024-04-25T02:23:03.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.981+0000 7fcb262a8700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcb200a6e00 0x7fcb20140010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:03.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.981+0000 7fcb262a8700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fcb20140550 0x7fcb20146c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:03.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.981+0000 7fcb262a8700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb200a75a0 con 0x7fcb200b3600 2024-04-25T02:23:03.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.981+0000 7fcb262a8700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb200a44f0 con 0x7fcb200a6e00 2024-04-25T02:23:03.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.981+0000 7fcb262a8700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb2006c960 con 0x7fcb20140550 2024-04-25T02:23:03.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.981+0000 7fcb1f7fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcb200a6e00 0x7fcb20140010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:03.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.981+0000 7fcb1ffff700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7fcb200b3600 0x7fcb200a3ca0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:35736/0 (socket says 172.21.15.111:35736) 2024-04-25T02:23:03.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.982+0000 7fcb24845700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fcb20140550 0x7fcb20146c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:03.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.982+0000 7fcb1ffff700 1 -- 172.21.15.111:0/4123076077 learned_addr learned my addr 172.21.15.111:0/4123076077 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:23:03.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.982+0000 7fcb1effd700 1 -- 172.21.15.111:0/4123076077 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4144271224 0 0) 0x7fcb200a75a0 con 0x7fcb200b3600 2024-04-25T02:23:03.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.982+0000 7fcb1effd700 1 -- 172.21.15.111:0/4123076077 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcb08003570 con 0x7fcb200b3600 2024-04-25T02:23:03.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.982+0000 7fcb24845700 1 -- 172.21.15.111:0/4123076077 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcb200a6e00 msgr2=0x7fcb20140010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:03.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.982+0000 7fcb24845700 1 --2- 172.21.15.111:0/4123076077 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcb200a6e00 0x7fcb20140010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:03.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.982+0000 7fcb24845700 1 -- 172.21.15.111:0/4123076077 >> v1:172.21.15.111:6789/0 conn(0x7fcb200b3600 legacy=0x7fcb200a3ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:03.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.982+0000 7fcb24845700 1 -- 172.21.15.111:0/4123076077 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb200a51a0 con 0x7fcb20140550 2024-04-25T02:23:03.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.982+0000 7fcb1f7fe700 1 --2- 172.21.15.111:0/4123076077 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcb200a6e00 0x7fcb20140010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:03.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.982+0000 7fcb24845700 1 --2- 172.21.15.111:0/4123076077 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fcb20140550 0x7fcb20146c90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcb18009e90 tx=0x7fcb18009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9c6ea42955ff1c80 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:03.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.982+0000 7fcb1effd700 1 -- 172.21.15.111:0/4123076077 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb1800e070 con 0x7fcb20140550 2024-04-25T02:23:03.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.982+0000 7fcb1effd700 1 -- 172.21.15.111:0/4123076077 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb1800bb80 con 0x7fcb20140550 2024-04-25T02:23:03.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.982+0000 7fcb1effd700 1 -- 172.21.15.111:0/4123076077 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb18012430 con 0x7fcb20140550 2024-04-25T02:23:03.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.983+0000 7fcb262a8700 1 -- 172.21.15.111:0/4123076077 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fcb20140550 msgr2=0x7fcb20146c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:03.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.983+0000 7fcb262a8700 1 --2- 172.21.15.111:0/4123076077 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fcb20140550 0x7fcb20146c90 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcb18009e90 tx=0x7fcb18009780 comp rx=0 tx=0).stop 2024-04-25T02:23:03.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.983+0000 7fcb262a8700 1 -- 172.21.15.111:0/4123076077 shutdown_connections 2024-04-25T02:23:03.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.983+0000 7fcb262a8700 1 --2- 172.21.15.111:0/4123076077 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fcb20140550 0x7fcb20146c90 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:03.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.983+0000 7fcb262a8700 1 --2- 172.21.15.111:0/4123076077 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcb200a6e00 0x7fcb20140010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:03.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.983+0000 7fcb262a8700 1 -- 172.21.15.111:0/4123076077 >> 172.21.15.111:0/4123076077 conn(0x7fcb2006e260 msgr2=0x7fcb2006bf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:03.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.983+0000 7fcb262a8700 1 -- 172.21.15.111:0/4123076077 shutdown_connections 2024-04-25T02:23:03.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.983+0000 7fcb262a8700 1 -- 172.21.15.111:0/4123076077 wait complete. 2024-04-25T02:23:03.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.984+0000 7fcb262a8700 1 Processor -- start 2024-04-25T02:23:03.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.984+0000 7fcb262a8700 1 -- start start 2024-04-25T02:23:03.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.985+0000 7fcb262a8700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcb200a6e00 0x7fcb20096a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:03.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.985+0000 7fcb262a8700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcb200b3600 0x7fcb2013e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:03.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.985+0000 7fcb262a8700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fcb20140550 0x7fcb2013eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:03.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.985+0000 7fcb262a8700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb200aca20 con 0x7fcb200b3600 2024-04-25T02:23:03.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.985+0000 7fcb262a8700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb20098490 con 0x7fcb200a6e00 2024-04-25T02:23:03.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.985+0000 7fcb262a8700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb200aeca0 con 0x7fcb20140550 2024-04-25T02:23:03.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.985+0000 7fcb1f7fe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcb200b3600 0x7fcb2013e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:03.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.985+0000 7fcb24845700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fcb20140550 0x7fcb2013eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:03.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.985+0000 7fcb24845700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fcb20140550 0x7fcb2013eef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:35478/0 (socket says 172.21.15.111:35478) 2024-04-25T02:23:03.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.985+0000 7fcb1f7fe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcb200b3600 0x7fcb2013e9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44640/0 (socket says 172.21.15.111:44640) 2024-04-25T02:23:03.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.985+0000 7fcb24845700 1 -- 172.21.15.111:0/2758571774 learned_addr learned my addr 172.21.15.111:0/2758571774 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:03.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.985+0000 7fcb1ffff700 1 --2- 172.21.15.111:0/2758571774 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcb200a6e00 0x7fcb20096a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:03.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.985+0000 7fcb24845700 1 -- 172.21.15.111:0/2758571774 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcb200a6e00 msgr2=0x7fcb20096a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:03.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.985+0000 7fcb24845700 1 --2- 172.21.15.111:0/2758571774 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcb200a6e00 0x7fcb20096a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:03.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.985+0000 7fcb24845700 1 -- 172.21.15.111:0/2758571774 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcb200b3600 msgr2=0x7fcb2013e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:03.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.985+0000 7fcb24845700 1 --2- 172.21.15.111:0/2758571774 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcb200b3600 0x7fcb2013e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:03.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.985+0000 7fcb24845700 1 -- 172.21.15.111:0/2758571774 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb14009420 con 0x7fcb20140550 2024-04-25T02:23:03.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.985+0000 7fcb1f7fe700 1 --2- 172.21.15.111:0/2758571774 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcb200b3600 0x7fcb2013e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:03.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.985+0000 7fcb24845700 1 --2- 172.21.15.111:0/2758571774 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fcb20140550 0x7fcb2013eef0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcb18012ad0 tx=0x7fcb18019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:03.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.986+0000 7fcb07fff700 1 -- 172.21.15.111:0/2758571774 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb18027470 con 0x7fcb20140550 2024-04-25T02:23:03.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.986+0000 7fcb07fff700 1 -- 172.21.15.111:0/2758571774 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb18027610 con 0x7fcb20140550 2024-04-25T02:23:03.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.986+0000 7fcb07fff700 1 -- 172.21.15.111:0/2758571774 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb180279d0 con 0x7fcb20140550 2024-04-25T02:23:03.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.986+0000 7fcb262a8700 1 -- 172.21.15.111:0/2758571774 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb18009a20 con 0x7fcb20140550 2024-04-25T02:23:03.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.986+0000 7fcb262a8700 1 -- 172.21.15.111:0/2758571774 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb20098110 con 0x7fcb20140550 2024-04-25T02:23:03.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.986+0000 7fcb262a8700 1 -- 172.21.15.111:0/2758571774 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb20071790 con 0x7fcb20140550 2024-04-25T02:23:03.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.986+0000 7fcb07fff700 1 -- 172.21.15.111:0/2758571774 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7fcb18024070 con 0x7fcb20140550 2024-04-25T02:23:03.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.987+0000 7fcb07fff700 1 -- 172.21.15.111:0/2758571774 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 3840+0+0 (secure 0 0 0) 0x7fcb1805d850 con 0x7fcb20140550 2024-04-25T02:23:03.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:03.990+0000 7fcb07fff700 1 -- 172.21.15.111:0/2758571774 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fcb1801fb10 con 0x7fcb20140550 2024-04-25T02:23:04.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.159+0000 7fcb262a8700 1 -- 172.21.15.111:0/2758571774 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "osd down", "ids": ["1"]} v 0) v1 -- 0x7fcb200a7ed0 con 0x7fcb20140550 2024-04-25T02:23:04.163 INFO:tasks.ceph.mon.a.smithi111.stderr:2024-04-25T02:23:04.159+0000 7f45487c3700 -1 mon.a@0(leader).osd e23 definitely_dead 0 2024-04-25T02:23:04.377 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-25T02:23:04.373+0000 7f12e60d1540 -1 Falling back to public interface 2024-04-25T02:23:04.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.773+0000 7fcb07fff700 1 -- 172.21.15.111:0/2758571774 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["1"]}]=0 marked down osd.1. v24) v1 ==== 89+0+0 (secure 0 0 0) 0x7fcb1802c020 con 0x7fcb20140550 2024-04-25T02:23:04.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.776+0000 7fcb262a8700 1 -- 172.21.15.111:0/2758571774 >> v1:172.21.15.111:6816/46482 conn(0x7fcb0c046010 legacy=0x7fcb0c0484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:04.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.776+0000 7fcb262a8700 1 -- 172.21.15.111:0/2758571774 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fcb20140550 msgr2=0x7fcb2013eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:04.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.776+0000 7fcb262a8700 1 --2- 172.21.15.111:0/2758571774 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fcb20140550 0x7fcb2013eef0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fcb18012ad0 tx=0x7fcb18019000 comp rx=0 tx=0).stop 2024-04-25T02:23:04.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.776+0000 7fcb262a8700 1 -- 172.21.15.111:0/2758571774 shutdown_connections 2024-04-25T02:23:04.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.776+0000 7fcb262a8700 1 --2- 172.21.15.111:0/2758571774 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fcb20140550 0x7fcb2013eef0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:04.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.776+0000 7fcb262a8700 1 --2- 172.21.15.111:0/2758571774 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcb200a6e00 0x7fcb20096a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:04.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.776+0000 7fcb262a8700 1 --2- 172.21.15.111:0/2758571774 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcb200b3600 0x7fcb2013e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:04.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.776+0000 7fcb262a8700 1 -- 172.21.15.111:0/2758571774 >> 172.21.15.111:0/2758571774 conn(0x7fcb2006e260 msgr2=0x7fcb2006eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:04.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.777+0000 7fcb262a8700 1 -- 172.21.15.111:0/2758571774 shutdown_connections 2024-04-25T02:23:04.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.777+0000 7fcb262a8700 1 -- 172.21.15.111:0/2758571774 wait complete. 2024-04-25T02:23:04.788 INFO:teuthology.orchestra.run.smithi111.stderr:marked down osd.1. 2024-04-25T02:23:04.796 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-25T02:23:04.796 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-25T02:23:04.798 INFO:tasks.ceph.osd.1:Started 2024-04-25T02:23:04.798 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-25T02:23:04.799 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:23:04.829 INFO:tasks.ceph.osd.2:Stopped 2024-04-25T02:23:04.830 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 2 2024-04-25T02:23:04.834 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-04-25T02:23:04.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.984+0000 7fc4b5d99700 1 Processor -- start 2024-04-25T02:23:04.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.984+0000 7fc4b5d99700 1 -- start start 2024-04-25T02:23:04.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.985+0000 7fc4b5d99700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc4b00b2400 0x7fc4b00a49f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:04.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.985+0000 7fc4b5d99700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fc4b0067940 0x7fc4b0067d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:04.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.985+0000 7fc4b5d99700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc4b0068290 0x7fc4b0148520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:04.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.985+0000 7fc4b5d99700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4b00a3320 con 0x7fc4b0067940 2024-04-25T02:23:04.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.985+0000 7fc4b5d99700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b00a2e20 con 0x7fc4b00b2400 2024-04-25T02:23:04.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.985+0000 7fc4b5d99700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b006f090 con 0x7fc4b0068290 2024-04-25T02:23:04.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.985+0000 7fc4a6ffd700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fc4b0067940 0x7fc4b0067d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:04.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.985+0000 7fc4affff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc4b0068290 0x7fc4b0148520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:04.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.985+0000 7fc4af7fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc4b00b2400 0x7fc4b00a49f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:04.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.985+0000 7fc4a6ffd700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fc4b0067940 0x7fc4b0067d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44660/0 (socket says 172.21.15.111:44660) 2024-04-25T02:23:04.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.985+0000 7fc4affff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc4b0068290 0x7fc4b0148520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:35492/0 (socket says 172.21.15.111:35492) 2024-04-25T02:23:04.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.985+0000 7fc4a6ffd700 1 -- 172.21.15.111:0/3297698567 learned_addr learned my addr 172.21.15.111:0/3297698567 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:04.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.985+0000 7fc4af7fe700 1 -- 172.21.15.111:0/3297698567 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc4b0068290 msgr2=0x7fc4b0148520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:04.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.985+0000 7fc4af7fe700 1 --2- 172.21.15.111:0/3297698567 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc4b0068290 0x7fc4b0148520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:04.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.985+0000 7fc4af7fe700 1 -- 172.21.15.111:0/3297698567 >> v2:172.21.15.111:3300/0 conn(0x7fc4b0067940 msgr2=0x7fc4b0067d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:04.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.985+0000 7fc4af7fe700 1 --2- 172.21.15.111:0/3297698567 >> v2:172.21.15.111:3300/0 conn(0x7fc4b0067940 0x7fc4b0067d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:04.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.985+0000 7fc4af7fe700 1 -- 172.21.15.111:0/3297698567 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b00a3550 con 0x7fc4b00b2400 2024-04-25T02:23:04.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.985+0000 7fc4affff700 1 --2- 172.21.15.111:0/3297698567 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc4b0068290 0x7fc4b0148520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:04.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.985+0000 7fc4a6ffd700 1 --2- 172.21.15.111:0/3297698567 >> v2:172.21.15.111:3300/0 conn(0x7fc4b0067940 0x7fc4b0067d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:04.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.985+0000 7fc4af7fe700 1 --2- 172.21.15.111:0/3297698567 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc4b00b2400 0x7fc4b00a49f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc4a00098e0 tx=0x7fc4a00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d0f99d5c23b0f770 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:04.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.985+0000 7fc4aeffd700 1 -- 172.21.15.111:0/3297698567 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a0011630 con 0x7fc4b00b2400 2024-04-25T02:23:04.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.985+0000 7fc4aeffd700 1 -- 172.21.15.111:0/3297698567 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a0011790 con 0x7fc4b00b2400 2024-04-25T02:23:04.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.985+0000 7fc4aeffd700 1 -- 172.21.15.111:0/3297698567 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a0011b30 con 0x7fc4b00b2400 2024-04-25T02:23:04.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.986+0000 7fc4b5d99700 1 -- 172.21.15.111:0/3297698567 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc4b00b2400 msgr2=0x7fc4b00a49f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:04.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.986+0000 7fc4b5d99700 1 --2- 172.21.15.111:0/3297698567 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc4b00b2400 0x7fc4b00a49f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fc4a00098e0 tx=0x7fc4a00091a0 comp rx=0 tx=0).stop 2024-04-25T02:23:04.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.986+0000 7fc4b5d99700 1 -- 172.21.15.111:0/3297698567 shutdown_connections 2024-04-25T02:23:04.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.986+0000 7fc4b5d99700 1 --2- 172.21.15.111:0/3297698567 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc4b0068290 0x7fc4b0148520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:04.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.986+0000 7fc4b5d99700 1 --2- 172.21.15.111:0/3297698567 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc4b00b2400 0x7fc4b00a49f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:04.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.986+0000 7fc4b5d99700 1 --2- 172.21.15.111:0/3297698567 >> v2:172.21.15.111:3300/0 conn(0x7fc4b0067940 0x7fc4b0067d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:04.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.986+0000 7fc4b5d99700 1 -- 172.21.15.111:0/3297698567 >> 172.21.15.111:0/3297698567 conn(0x7fc4b006ac90 msgr2=0x7fc4b00b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:04.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.986+0000 7fc4b5d99700 1 -- 172.21.15.111:0/3297698567 shutdown_connections 2024-04-25T02:23:04.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.986+0000 7fc4b5d99700 1 -- 172.21.15.111:0/3297698567 wait complete. 2024-04-25T02:23:04.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.987+0000 7fc4b5d99700 1 Processor -- start 2024-04-25T02:23:04.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.987+0000 7fc4b5d99700 1 -- start start 2024-04-25T02:23:04.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.987+0000 7fc4b5d99700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc4b0067940 0x7fc4b00981a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:04.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.987+0000 7fc4b5d99700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc4b0068290 0x7fc4b013d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:04.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.987+0000 7fc4b5d99700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc4b00b2400 0x7fc4b013dd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:04.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.987+0000 7fc4b5d99700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b00976b0 con 0x7fc4b00b2400 2024-04-25T02:23:04.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.987+0000 7fc4b5d99700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b0097990 con 0x7fc4b0068290 2024-04-25T02:23:04.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.987+0000 7fc4b5d99700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc4b00ae100 con 0x7fc4b0067940 2024-04-25T02:23:04.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.988+0000 7fc4affff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc4b00b2400 0x7fc4b013dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:04.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.988+0000 7fc4af7fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc4b0067940 0x7fc4b00981a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:04.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.988+0000 7fc4a6ffd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc4b0068290 0x7fc4b013d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:04.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.988+0000 7fc4affff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc4b00b2400 0x7fc4b013dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44672/0 (socket says 172.21.15.111:44672) 2024-04-25T02:23:04.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.988+0000 7fc4a6ffd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc4b0068290 0x7fc4b013d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:50318/0 (socket says 172.21.15.111:50318) 2024-04-25T02:23:04.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.988+0000 7fc4af7fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc4b0067940 0x7fc4b00981a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:35500/0 (socket says 172.21.15.111:35500) 2024-04-25T02:23:04.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.988+0000 7fc4affff700 1 -- 172.21.15.111:0/2572069253 learned_addr learned my addr 172.21.15.111:0/2572069253 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:04.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.988+0000 7fc4affff700 1 -- 172.21.15.111:0/2572069253 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc4b0067940 msgr2=0x7fc4b00981a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:04.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.988+0000 7fc4affff700 1 --2- 172.21.15.111:0/2572069253 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc4b0067940 0x7fc4b00981a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:04.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.988+0000 7fc4affff700 1 -- 172.21.15.111:0/2572069253 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc4b0068290 msgr2=0x7fc4b013d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:04.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.988+0000 7fc4affff700 1 --2- 172.21.15.111:0/2572069253 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc4b0068290 0x7fc4b013d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:04.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.988+0000 7fc4affff700 1 -- 172.21.15.111:0/2572069253 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4980094f0 con 0x7fc4b00b2400 2024-04-25T02:23:04.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.988+0000 7fc4af7fe700 1 --2- 172.21.15.111:0/2572069253 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc4b0067940 0x7fc4b00981a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:04.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.988+0000 7fc4a6ffd700 1 --2- 172.21.15.111:0/2572069253 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc4b0068290 0x7fc4b013d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:04.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.988+0000 7fc4affff700 1 --2- 172.21.15.111:0/2572069253 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc4b00b2400 0x7fc4b013dd40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc4a8009fc0 tx=0x7fc4a800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:04.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.988+0000 7fc4a7fff700 1 -- 172.21.15.111:0/2572069253 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a8009d20 con 0x7fc4b00b2400 2024-04-25T02:23:04.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.988+0000 7fc4a7fff700 1 -- 172.21.15.111:0/2572069253 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4a800f040 con 0x7fc4b00b2400 2024-04-25T02:23:04.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.988+0000 7fc4b5d99700 1 -- 172.21.15.111:0/2572069253 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4a8009a20 con 0x7fc4b00b2400 2024-04-25T02:23:04.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.988+0000 7fc4a7fff700 1 -- 172.21.15.111:0/2572069253 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4a800ce20 con 0x7fc4b00b2400 2024-04-25T02:23:04.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.988+0000 7fc4b5d99700 1 -- 172.21.15.111:0/2572069253 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4a0009420 con 0x7fc4b00b2400 2024-04-25T02:23:04.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.989+0000 7fc4a7fff700 1 -- 172.21.15.111:0/2572069253 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7fc4a8003020 con 0x7fc4b00b2400 2024-04-25T02:23:04.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.989+0000 7fc4b5d99700 1 -- 172.21.15.111:0/2572069253 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4b013e2e0 con 0x7fc4b00b2400 2024-04-25T02:23:04.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.990+0000 7fc4a7fff700 1 -- 172.21.15.111:0/2572069253 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(24..24 src has 1..24) v4 ==== 3840+0+0 (secure 0 0 0) 0x7fc4a805ba50 con 0x7fc4b00b2400 2024-04-25T02:23:04.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:04.993+0000 7fc4a7fff700 1 -- 172.21.15.111:0/2572069253 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fc4a8039d60 con 0x7fc4b00b2400 2024-04-25T02:23:05.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.161+0000 7fc4b5d99700 1 -- 172.21.15.111:0/2572069253 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd down", "ids": ["2"]} v 0) v1 -- 0x7fc4b006e7c0 con 0x7fc4b00b2400 2024-04-25T02:23:05.165 INFO:tasks.ceph.mon.a.smithi111.stderr:2024-04-25T02:23:05.161+0000 7f45487c3700 -1 mon.a@0(leader).osd e24 definitely_dead 0 2024-04-25T02:23:05.395 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-25T02:23:05.391+0000 7fbf03bcb540 -1 Falling back to public interface 2024-04-25T02:23:05.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.773+0000 7fc4a7fff700 1 -- 172.21.15.111:0/2572069253 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["2"]}]=0 marked down osd.2. v25) v1 ==== 89+0+0 (secure 0 0 0) 0x7fc4a8018030 con 0x7fc4b00b2400 2024-04-25T02:23:05.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.777+0000 7fc4b5d99700 1 -- 172.21.15.111:0/2572069253 >> v1:172.21.15.111:6816/46482 conn(0x7fc490046040 legacy=0x7fc4900484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:05.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.777+0000 7fc4b5d99700 1 -- 172.21.15.111:0/2572069253 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc4b00b2400 msgr2=0x7fc4b013dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:05.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.777+0000 7fc4b5d99700 1 --2- 172.21.15.111:0/2572069253 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc4b00b2400 0x7fc4b013dd40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7fc4a8009fc0 tx=0x7fc4a800b040 comp rx=0 tx=0).stop 2024-04-25T02:23:05.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.777+0000 7fc4b5d99700 1 -- 172.21.15.111:0/2572069253 shutdown_connections 2024-04-25T02:23:05.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.777+0000 7fc4b5d99700 1 --2- 172.21.15.111:0/2572069253 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc4b00b2400 0x7fc4b013dd40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:05.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.777+0000 7fc4b5d99700 1 --2- 172.21.15.111:0/2572069253 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc4b0067940 0x7fc4b00981a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:05.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.777+0000 7fc4b5d99700 1 --2- 172.21.15.111:0/2572069253 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc4b0068290 0x7fc4b013d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:05.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.777+0000 7fc4b5d99700 1 -- 172.21.15.111:0/2572069253 >> 172.21.15.111:0/2572069253 conn(0x7fc4b006ac90 msgr2=0x7fc4b0069170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:05.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.777+0000 7fc4b5d99700 1 -- 172.21.15.111:0/2572069253 shutdown_connections 2024-04-25T02:23:05.782 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.777+0000 7fc4b5d99700 1 -- 172.21.15.111:0/2572069253 wait complete. 2024-04-25T02:23:05.788 INFO:teuthology.orchestra.run.smithi111.stderr:marked down osd.2. 2024-04-25T02:23:05.798 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-25T02:23:05.798 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-25T02:23:05.800 INFO:tasks.ceph.osd.2:Started 2024-04-25T02:23:05.801 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-25T02:23:05.801 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:23:05.841 INFO:tasks.ceph.osd.3:Stopped 2024-04-25T02:23:05.841 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd down 3 2024-04-25T02:23:05.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.995+0000 7faf8c8e5700 1 Processor -- start 2024-04-25T02:23:05.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.995+0000 7faf8c8e5700 1 -- start start 2024-04-25T02:23:06.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.996+0000 7faf8c8e5700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7faf880b26f0 0x7faf880a5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:06.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.996+0000 7faf8c8e5700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7faf880af5b0 0x7faf8813fb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:06.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.996+0000 7faf8c8e5700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7faf88140040 0x7faf88067940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:06.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.996+0000 7faf8c8e5700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf880a2750 con 0x7faf880af5b0 2024-04-25T02:23:06.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.996+0000 7faf8c8e5700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf880a4140 con 0x7faf88140040 2024-04-25T02:23:06.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.996+0000 7faf8c8e5700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf880a6200 con 0x7faf880b26f0 2024-04-25T02:23:06.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.996+0000 7faf85d9b700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7faf880af5b0 0x7faf8813fb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:06.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.996+0000 7faf86d9d700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7faf88140040 0x7faf88067940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:06.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.996+0000 7faf8659c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7faf880b26f0 0x7faf880a5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:06.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.996+0000 7faf8659c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7faf880b26f0 0x7faf880a5bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:35530/0 (socket says 172.21.15.111:35530) 2024-04-25T02:23:06.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.996+0000 7faf85d9b700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7faf880af5b0 0x7faf8813fb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44690/0 (socket says 172.21.15.111:44690) 2024-04-25T02:23:06.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.996+0000 7faf86d9d700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7faf88140040 0x7faf88067940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:50328/0 (socket says 172.21.15.111:50328) 2024-04-25T02:23:06.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.996+0000 7faf85d9b700 1 -- 172.21.15.111:0/3727421164 learned_addr learned my addr 172.21.15.111:0/3727421164 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:06.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.996+0000 7faf85d9b700 1 -- 172.21.15.111:0/3727421164 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7faf880b26f0 msgr2=0x7faf880a5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:06.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.996+0000 7faf85d9b700 1 --2- 172.21.15.111:0/3727421164 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7faf880b26f0 0x7faf880a5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:06.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.996+0000 7faf85d9b700 1 -- 172.21.15.111:0/3727421164 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7faf88140040 msgr2=0x7faf88067940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:06.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.996+0000 7faf85d9b700 1 --2- 172.21.15.111:0/3727421164 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7faf88140040 0x7faf88067940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:06.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.996+0000 7faf85d9b700 1 -- 172.21.15.111:0/3727421164 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf8813f6d0 con 0x7faf880af5b0 2024-04-25T02:23:06.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.996+0000 7faf8659c700 1 --2- 172.21.15.111:0/3727421164 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7faf880b26f0 0x7faf880a5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:06.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.996+0000 7faf86d9d700 1 --2- 172.21.15.111:0/3727421164 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7faf88140040 0x7faf88067940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:06.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.997+0000 7faf85d9b700 1 --2- 172.21.15.111:0/3727421164 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faf880af5b0 0x7faf8813fb00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7faf700099b0 tx=0x7faf70009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc2512e61b66dc6f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:06.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.997+0000 7faf8559a700 1 -- 172.21.15.111:0/3727421164 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7000b680 con 0x7faf880af5b0 2024-04-25T02:23:06.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.997+0000 7faf8559a700 1 -- 172.21.15.111:0/3727421164 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf7000b7e0 con 0x7faf880af5b0 2024-04-25T02:23:06.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.997+0000 7faf8559a700 1 -- 172.21.15.111:0/3727421164 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf7000bb80 con 0x7faf880af5b0 2024-04-25T02:23:06.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.997+0000 7faf8c8e5700 1 -- 172.21.15.111:0/3727421164 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faf880af5b0 msgr2=0x7faf8813fb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:06.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.997+0000 7faf8c8e5700 1 --2- 172.21.15.111:0/3727421164 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faf880af5b0 0x7faf8813fb00 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7faf700099b0 tx=0x7faf70009250 comp rx=0 tx=0).stop 2024-04-25T02:23:06.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.997+0000 7faf8c8e5700 1 -- 172.21.15.111:0/3727421164 shutdown_connections 2024-04-25T02:23:06.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.997+0000 7faf8c8e5700 1 --2- 172.21.15.111:0/3727421164 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7faf88140040 0x7faf88067940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:06.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.997+0000 7faf8c8e5700 1 --2- 172.21.15.111:0/3727421164 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7faf880b26f0 0x7faf880a5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:06.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.997+0000 7faf8c8e5700 1 --2- 172.21.15.111:0/3727421164 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faf880af5b0 0x7faf8813fb00 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:06.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.997+0000 7faf8c8e5700 1 -- 172.21.15.111:0/3727421164 >> 172.21.15.111:0/3727421164 conn(0x7faf8806ae80 msgr2=0x7faf880b1d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:06.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.997+0000 7faf8c8e5700 1 -- 172.21.15.111:0/3727421164 shutdown_connections 2024-04-25T02:23:06.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.997+0000 7faf8c8e5700 1 -- 172.21.15.111:0/3727421164 wait complete. 2024-04-25T02:23:06.006 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.998+0000 7faf8c8e5700 1 Processor -- start 2024-04-25T02:23:06.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.998+0000 7faf8c8e5700 1 -- start start 2024-04-25T02:23:06.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.999+0000 7faf8c8e5700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7faf880af5b0 0x7faf880a9b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:06.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.999+0000 7faf8c8e5700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faf880b26f0 0x7faf8814f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:06.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.999+0000 7faf8c8e5700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7faf88140040 0x7faf8814f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:06.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.999+0000 7faf8c8e5700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf880aa070 con 0x7faf880b26f0 2024-04-25T02:23:06.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.999+0000 7faf8c8e5700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf880aac70 con 0x7faf88140040 2024-04-25T02:23:06.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.999+0000 7faf8c8e5700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faf880a98f0 con 0x7faf880af5b0 2024-04-25T02:23:06.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.999+0000 7faf8659c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7faf880af5b0 0x7faf880a9b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:06.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.999+0000 7faf85d9b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faf880b26f0 0x7faf8814f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:06.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.999+0000 7faf8659c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7faf880af5b0 0x7faf880a9b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:35540/0 (socket says 172.21.15.111:35540) 2024-04-25T02:23:06.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.999+0000 7faf8659c700 1 -- 172.21.15.111:0/41508119 learned_addr learned my addr 172.21.15.111:0/41508119 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:06.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.999+0000 7faf85d9b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faf880b26f0 0x7faf8814f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44704/0 (socket says 172.21.15.111:44704) 2024-04-25T02:23:06.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.999+0000 7faf86d9d700 1 --2- 172.21.15.111:0/41508119 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7faf88140040 0x7faf8814f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:06.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.999+0000 7faf8659c700 1 -- 172.21.15.111:0/41508119 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7faf88140040 msgr2=0x7faf8814f680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:06.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.999+0000 7faf8659c700 1 --2- 172.21.15.111:0/41508119 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7faf88140040 0x7faf8814f680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:06.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.999+0000 7faf8659c700 1 -- 172.21.15.111:0/41508119 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faf880b26f0 msgr2=0x7faf8814f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:06.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.999+0000 7faf8659c700 1 --2- 172.21.15.111:0/41508119 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faf880b26f0 0x7faf8814f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:06.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.999+0000 7faf8659c700 1 -- 172.21.15.111:0/41508119 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf80009a20 con 0x7faf880af5b0 2024-04-25T02:23:06.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.999+0000 7faf85d9b700 1 --2- 172.21.15.111:0/41508119 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faf880b26f0 0x7faf8814f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:06.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.999+0000 7faf8659c700 1 --2- 172.21.15.111:0/41508119 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7faf880af5b0 0x7faf880a9b30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7faf8000c1a0 tx=0x7faf8000b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:06.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.999+0000 7faf7e7fc700 1 -- 172.21.15.111:0/41508119 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8000cd90 con 0x7faf880af5b0 2024-04-25T02:23:06.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:05.999+0000 7faf7e7fc700 1 -- 172.21.15.111:0/41508119 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8000f040 con 0x7faf880af5b0 2024-04-25T02:23:06.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.000+0000 7faf7e7fc700 1 -- 172.21.15.111:0/41508119 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf80014690 con 0x7faf880af5b0 2024-04-25T02:23:06.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.000+0000 7faf8c8e5700 1 -- 172.21.15.111:0/41508119 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf78009420 con 0x7faf880af5b0 2024-04-25T02:23:06.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.000+0000 7faf8c8e5700 1 -- 172.21.15.111:0/41508119 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf700094f0 con 0x7faf880af5b0 2024-04-25T02:23:06.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.000+0000 7faf8c8e5700 1 -- 172.21.15.111:0/41508119 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf880aaf30 con 0x7faf880af5b0 2024-04-25T02:23:06.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.001+0000 7faf7e7fc700 1 -- 172.21.15.111:0/41508119 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7faf80014a00 con 0x7faf880af5b0 2024-04-25T02:23:06.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.001+0000 7faf7e7fc700 1 -- 172.21.15.111:0/41508119 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(25..25 src has 1..25) v4 ==== 3840+0+0 (secure 0 0 0) 0x7faf8005c4a0 con 0x7faf880af5b0 2024-04-25T02:23:06.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.004+0000 7faf7e7fc700 1 -- 172.21.15.111:0/41508119 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7faf8003a720 con 0x7faf880af5b0 2024-04-25T02:23:06.175 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.171+0000 7faf8c8e5700 1 -- 172.21.15.111:0/41508119 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "osd down", "ids": ["3"]} v 0) v1 -- 0x7faf880aeb30 con 0x7faf880af5b0 2024-04-25T02:23:06.176 INFO:tasks.ceph.mon.a.smithi111.stderr:2024-04-25T02:23:06.172+0000 7f45487c3700 -1 mon.a@0(leader).osd e25 definitely_dead 0 2024-04-25T02:23:06.387 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-25T02:23:06.383+0000 7f5c9bf11540 -1 Falling back to public interface 2024-04-25T02:23:06.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.775+0000 7faf7e7fc700 1 -- 172.21.15.111:0/41508119 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "osd down", "ids": ["3"]}]=0 marked down osd.3. v26) v1 ==== 89+0+0 (secure 0 0 0) 0x7faf8002a070 con 0x7faf880af5b0 2024-04-25T02:23:06.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.777+0000 7faf8c8e5700 1 -- 172.21.15.111:0/41508119 >> v1:172.21.15.111:6816/46482 conn(0x7faf68046010 legacy=0x7faf680484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:06.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.777+0000 7faf8c8e5700 1 -- 172.21.15.111:0/41508119 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7faf880af5b0 msgr2=0x7faf880a9b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:06.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.777+0000 7faf8c8e5700 1 --2- 172.21.15.111:0/41508119 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7faf880af5b0 0x7faf880a9b30 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7faf8000c1a0 tx=0x7faf8000b040 comp rx=0 tx=0).stop 2024-04-25T02:23:06.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.777+0000 7faf8c8e5700 1 -- 172.21.15.111:0/41508119 shutdown_connections 2024-04-25T02:23:06.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.777+0000 7faf8c8e5700 1 --2- 172.21.15.111:0/41508119 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7faf88140040 0x7faf8814f680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:06.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.777+0000 7faf8c8e5700 1 --2- 172.21.15.111:0/41508119 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7faf880af5b0 0x7faf880a9b30 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:06.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.777+0000 7faf8c8e5700 1 --2- 172.21.15.111:0/41508119 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faf880b26f0 0x7faf8814f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:06.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.777+0000 7faf8c8e5700 1 -- 172.21.15.111:0/41508119 >> 172.21.15.111:0/41508119 conn(0x7faf8806ae80 msgr2=0x7faf88064900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:06.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.777+0000 7faf8c8e5700 1 -- 172.21.15.111:0/41508119 shutdown_connections 2024-04-25T02:23:06.781 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.777+0000 7faf8c8e5700 1 -- 172.21.15.111:0/41508119 wait complete. 2024-04-25T02:23:06.782 INFO:teuthology.orchestra.run.smithi111.stderr:marked down osd.3. 2024-04-25T02:23:06.797 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-25T02:23:06.797 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-25T02:23:06.799 INFO:tasks.ceph.osd.3:Started 2024-04-25T02:23:06.800 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-25T02:23:06.800 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:23:06.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.916+0000 7fc592664700 1 Processor -- start 2024-04-25T02:23:06.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.916+0000 7fc592664700 1 -- start start 2024-04-25T02:23:06.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.917+0000 7fc592664700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fc58c06e9d0 0x7fc58c068050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:06.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.917+0000 7fc592664700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc58c0a3830 0x7fc58c149530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:06.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.917+0000 7fc592664700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc58c06eed0 con 0x7fc58c0b2400 2024-04-25T02:23:06.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.917+0000 7fc592664700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc58c0a3da0 con 0x7fc58c06e9d0 2024-04-25T02:23:06.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.917+0000 7fc592664700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c0a4060 con 0x7fc58c0a3830 2024-04-25T02:23:06.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.917+0000 7fc58b7fe700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fc58c06e9d0 0x7fc58c068050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:06.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.917+0000 7fc58b7fe700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fc58c06e9d0 0x7fc58c068050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44722/0 (socket says 172.21.15.111:44722) 2024-04-25T02:23:06.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.917+0000 7fc58b7fe700 1 -- 172.21.15.111:0/1977486677 learned_addr learned my addr 172.21.15.111:0/1977486677 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:06.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.917+0000 7fc58bfff700 1 --1- 172.21.15.111:0/1977486677 >> v1:172.21.15.111:6789/0 conn(0x7fc58c0b2400 0x7fc58c067940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:35748/0 (socket says 172.21.15.111:35748) 2024-04-25T02:23:06.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.917+0000 7fc590c01700 1 --2- 172.21.15.111:0/1977486677 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc58c0a3830 0x7fc58c149530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:06.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.917+0000 7fc58b7fe700 1 -- 172.21.15.111:0/1977486677 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc58c0a3830 msgr2=0x7fc58c149530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:06.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.917+0000 7fc58b7fe700 1 --2- 172.21.15.111:0/1977486677 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc58c0a3830 0x7fc58c149530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:06.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.917+0000 7fc58b7fe700 1 -- 172.21.15.111:0/1977486677 >> v1:172.21.15.111:6789/0 conn(0x7fc58c0b2400 legacy=0x7fc58c067940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:06.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.917+0000 7fc58b7fe700 1 -- 172.21.15.111:0/1977486677 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc58c0a2510 con 0x7fc58c06e9d0 2024-04-25T02:23:06.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.917+0000 7fc58b7fe700 1 --2- 172.21.15.111:0/1977486677 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc58c06e9d0 0x7fc58c068050 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc5800099b0 tx=0x7fc580009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd51097f314cd355 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:06.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.917+0000 7fc58affd700 1 -- 172.21.15.111:0/1977486677 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc580009ea0 con 0x7fc58c06e9d0 2024-04-25T02:23:06.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.917+0000 7fc58affd700 1 -- 172.21.15.111:0/1977486677 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc58000b860 con 0x7fc58c06e9d0 2024-04-25T02:23:06.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.917+0000 7fc58affd700 1 -- 172.21.15.111:0/1977486677 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc58000bc00 con 0x7fc58c06e9d0 2024-04-25T02:23:06.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.918+0000 7fc592664700 1 -- 172.21.15.111:0/1977486677 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc58c06e9d0 msgr2=0x7fc58c068050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:06.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.918+0000 7fc592664700 1 --2- 172.21.15.111:0/1977486677 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc58c06e9d0 0x7fc58c068050 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fc5800099b0 tx=0x7fc580009250 comp rx=0 tx=0).stop 2024-04-25T02:23:06.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.918+0000 7fc592664700 1 -- 172.21.15.111:0/1977486677 shutdown_connections 2024-04-25T02:23:06.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.918+0000 7fc592664700 1 --2- 172.21.15.111:0/1977486677 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc58c0a3830 0x7fc58c149530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:06.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.918+0000 7fc592664700 1 --2- 172.21.15.111:0/1977486677 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc58c06e9d0 0x7fc58c068050 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:06.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.918+0000 7fc592664700 1 -- 172.21.15.111:0/1977486677 >> 172.21.15.111:0/1977486677 conn(0x7fc58c06adf0 msgr2=0x7fc58c0b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:06.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.918+0000 7fc592664700 1 -- 172.21.15.111:0/1977486677 shutdown_connections 2024-04-25T02:23:06.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.918+0000 7fc592664700 1 -- 172.21.15.111:0/1977486677 wait complete. 2024-04-25T02:23:06.926 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.919+0000 7fc592664700 1 Processor -- start 2024-04-25T02:23:06.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.919+0000 7fc592664700 1 -- start start 2024-04-25T02:23:06.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.920+0000 7fc592664700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc58c06e9d0 0x7fc58c0aca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:06.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.920+0000 7fc592664700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc58c0a3830 0x7fc58c13daa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:06.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.920+0000 7fc592664700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc58c0b2400 0x7fc58c151460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:06.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.920+0000 7fc592664700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c0aa460 con 0x7fc58c0a3830 2024-04-25T02:23:06.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.920+0000 7fc592664700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c0aa6c0 con 0x7fc58c06e9d0 2024-04-25T02:23:06.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.920+0000 7fc592664700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc58c0ae0d0 con 0x7fc58c0b2400 2024-04-25T02:23:06.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.920+0000 7fc58bfff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc58c06e9d0 0x7fc58c0aca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:06.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.920+0000 7fc58b7fe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc58c0a3830 0x7fc58c13daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:06.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.920+0000 7fc58bfff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc58c06e9d0 0x7fc58c0aca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:50372/0 (socket says 172.21.15.111:50372) 2024-04-25T02:23:06.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.920+0000 7fc58bfff700 1 -- 172.21.15.111:0/3004999770 learned_addr learned my addr 172.21.15.111:0/3004999770 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:06.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.920+0000 7fc590c01700 1 --2- 172.21.15.111:0/3004999770 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc58c0b2400 0x7fc58c151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:06.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.920+0000 7fc58b7fe700 1 -- 172.21.15.111:0/3004999770 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc58c0b2400 msgr2=0x7fc58c151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:06.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.920+0000 7fc58b7fe700 1 --2- 172.21.15.111:0/3004999770 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc58c0b2400 0x7fc58c151460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:06.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.920+0000 7fc58b7fe700 1 -- 172.21.15.111:0/3004999770 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc58c06e9d0 msgr2=0x7fc58c0aca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:06.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.920+0000 7fc58b7fe700 1 --2- 172.21.15.111:0/3004999770 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc58c06e9d0 0x7fc58c0aca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:06.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.920+0000 7fc58b7fe700 1 -- 172.21.15.111:0/3004999770 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5800094f0 con 0x7fc58c0a3830 2024-04-25T02:23:06.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.920+0000 7fc58bfff700 1 --2- 172.21.15.111:0/3004999770 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc58c06e9d0 0x7fc58c0aca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:06.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.921+0000 7fc58b7fe700 1 --2- 172.21.15.111:0/3004999770 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc58c0a3830 0x7fc58c13daa0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc58c0b2bc0 tx=0x7fc580017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:06.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.921+0000 7fc573fff700 1 -- 172.21.15.111:0/3004999770 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc580000d10 con 0x7fc58c0a3830 2024-04-25T02:23:06.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.921+0000 7fc573fff700 1 -- 172.21.15.111:0/3004999770 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc58000bbe0 con 0x7fc58c0a3830 2024-04-25T02:23:06.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.921+0000 7fc592664700 1 -- 172.21.15.111:0/3004999770 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc58c0ae6a0 con 0x7fc58c0a3830 2024-04-25T02:23:06.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.921+0000 7fc573fff700 1 -- 172.21.15.111:0/3004999770 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc580011670 con 0x7fc58c0a3830 2024-04-25T02:23:06.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.921+0000 7fc592664700 1 -- 172.21.15.111:0/3004999770 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc58c0ae340 con 0x7fc58c0a3830 2024-04-25T02:23:06.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.922+0000 7fc592664700 1 -- 172.21.15.111:0/3004999770 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc58c071790 con 0x7fc58c0a3830 2024-04-25T02:23:06.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.922+0000 7fc573fff700 1 -- 172.21.15.111:0/3004999770 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7fc580011aa0 con 0x7fc58c0a3830 2024-04-25T02:23:06.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.922+0000 7fc573fff700 1 -- 172.21.15.111:0/3004999770 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(26..26 src has 1..26) v4 ==== 3840+0+0 (secure 0 0 0) 0x7fc58005ca60 con 0x7fc58c0a3830 2024-04-25T02:23:06.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:06.926+0000 7fc573fff700 1 -- 172.21.15.111:0/3004999770 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fc58002f370 con 0x7fc58c0a3830 2024-04-25T02:23:07.088 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:07.084+0000 7fc592664700 1 -- 172.21.15.111:0/3004999770 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc58c0ad9e0 con 0x7fc58c0a3830 2024-04-25T02:23:07.088 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:07.085+0000 7fc573fff700 1 -- 172.21.15.111:0/3004999770 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) v1 ==== 74+0+11575 (secure 0 0 0) 0x7fc58002f370 con 0x7fc58c0a3830 2024-04-25T02:23:07.088 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:23:07.089 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":26,"fsid":"4643f974-f93a-4436-93b8-460ff320e62e","created":"2024-04-25T02:20:05.450475+0000","modified":"2024-04-25T02:23:06.771296+0000","last_up_change":"2024-04-25T02:23:06.771296+0000","last_in_change":"2024-04-25T02:20:10.439204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:20:07.471248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:20:14.420378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:20:22.251868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T02:20:23.128289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"df3f17ca-3b12-42c8-8cf7-8f1b7189e587","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6800","nonce":40214}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6801","nonce":40214}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6803","nonce":40214}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6802","nonce":40214}]},"public_addr":"172.21.15.111:6800/40214","cluster_addr":"172.21.15.111:6801/40214","heartbeat_back_addr":"172.21.15.111:6803/40214","heartbeat_front_addr":"172.21.15.111:6802/40214","state":["exists"]},{"osd":1,"uuid":"93d54815-f215-4285-bba6-32f2d1cabf10","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6812","nonce":40216}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6813","nonce":40216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6815","nonce":40216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6814","nonce":40216}]},"public_addr":"172.21.15.111:6812/40216","cluster_addr":"172.21.15.111:6813/40216","heartbeat_back_addr":"172.21.15.111:6815/40216","heartbeat_front_addr":"172.21.15.111:6814/40216","state":["exists"]},{"osd":2,"uuid":"b26b2104-2a2e-408f-9ce7-3587a32a2ebe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":24,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6804","nonce":40215}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6805","nonce":40215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6807","nonce":40215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6806","nonce":40215}]},"public_addr":"172.21.15.111:6804/40215","cluster_addr":"172.21.15.111:6805/40215","heartbeat_back_addr":"172.21.15.111:6807/40215","heartbeat_front_addr":"172.21.15.111:6806/40215","state":["exists"]},{"osd":3,"uuid":"43c25820-1edc-4031-badf-72e87dd6bf15","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":25,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6808","nonce":40213}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6809","nonce":40213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6811","nonce":40213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6810","nonce":40213}]},"public_addr":"172.21.15.111:6808/40213","cluster_addr":"172.21.15.111:6809/40213","heartbeat_back_addr":"172.21.15.111:6811/40213","heartbeat_front_addr":"172.21.15.111:6810/40213","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.372427+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.411480+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.361508+0000","dead_epoch":25},{"osd":3,"down_stamp":"2024-04-25T02:23:06.771296+0000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.377212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.111:0/2148931273":"2024-04-26T02:22:54.713254+0000","172.21.15.111:6816/39585":"2024-04-26T02:22:54.713254+0000","172.21.15.111:0/3911588907":"2024-04-26T02:22:54.713254+0000","172.21.15.111:0/1276843622":"2024-04-26T02:22:54.713254+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:23:07.091 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:07.087+0000 7fc592664700 1 -- 172.21.15.111:0/3004999770 >> v1:172.21.15.111:6816/46482 conn(0x7fc578046010 legacy=0x7fc5780484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:07.091 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:07.087+0000 7fc592664700 1 -- 172.21.15.111:0/3004999770 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc58c0a3830 msgr2=0x7fc58c13daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:07.091 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:07.087+0000 7fc592664700 1 --2- 172.21.15.111:0/3004999770 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc58c0a3830 0x7fc58c13daa0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fc58c0b2bc0 tx=0x7fc580017000 comp rx=0 tx=0).stop 2024-04-25T02:23:07.091 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:07.087+0000 7fc592664700 1 -- 172.21.15.111:0/3004999770 shutdown_connections 2024-04-25T02:23:07.091 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:07.087+0000 7fc592664700 1 --2- 172.21.15.111:0/3004999770 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc58c0b2400 0x7fc58c151460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:07.091 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:07.087+0000 7fc592664700 1 --2- 172.21.15.111:0/3004999770 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc58c06e9d0 0x7fc58c0aca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:07.091 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:07.087+0000 7fc592664700 1 --2- 172.21.15.111:0/3004999770 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc58c0a3830 0x7fc58c13daa0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:07.091 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:07.087+0000 7fc592664700 1 -- 172.21.15.111:0/3004999770 >> 172.21.15.111:0/3004999770 conn(0x7fc58c06adf0 msgr2=0x7fc58c068090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:07.091 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:07.087+0000 7fc592664700 1 -- 172.21.15.111:0/3004999770 shutdown_connections 2024-04-25T02:23:07.091 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:07.087+0000 7fc592664700 1 -- 172.21.15.111:0/3004999770 wait complete. 2024-04-25T02:23:07.103 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-25T02:23:07.099+0000 7f12e60d1540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: store not yet converted to per-pg omap 2024-04-25T02:23:07.106 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-25T02:23:07.101+0000 7f12e60d1540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2024-04-25T02:23:07.106 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-25T02:23:07.101+0000 7f12e60d1540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:09401a81:::601.00000000:head# has omap that is not per-pg or pgmeta 2024-04-25T02:23:07.106 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-25T02:23:07.101+0000 7f12e60d1540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:0bd6d154:::602.00000000:head# has omap that is not per-pg or pgmeta 2024-04-25T02:23:07.106 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-25T02:23:07.101+0000 7f12e60d1540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:0d82a743:::600.00000000:head# has omap that is not per-pg or pgmeta 2024-04-25T02:23:07.106 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-25T02:23:07.101+0000 7f12e60d1540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:0d89b25e:::603.00000000:head# has omap that is not per-pg or pgmeta 2024-04-25T02:23:07.106 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-25T02:23:07.101+0000 7f12e60d1540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:0f65c9b8:::60a.00000000:head# has omap that is not per-pg or pgmeta 2024-04-25T02:23:07.106 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-25T02:23:07.101+0000 7f12e60d1540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:3ed09add:::607.00000000:head# has omap that is not per-pg or pgmeta 2024-04-25T02:23:07.106 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-25T02:23:07.101+0000 7f12e60d1540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:48cd7578:::60e.00000000:head# has omap that is not per-pg or pgmeta 2024-04-25T02:23:07.106 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-25T02:23:07.101+0000 7f12e60d1540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:654134d2:::mds0_openfiles.0:head# has omap that is not per-pg or pgmeta 2024-04-25T02:23:07.106 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-25T02:23:07.101+0000 7f12e60d1540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:717a0223:::608.00000000:head# has omap that is not per-pg or pgmeta 2024-04-25T02:23:07.106 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-25T02:23:07.101+0000 7f12e60d1540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:a93a17c2:::604.00000000:head# has omap that is not per-pg or pgmeta 2024-04-25T02:23:07.106 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-25T02:23:07.101+0000 7f12e60d1540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:b871830b:::605.00000000:head# has omap that is not per-pg or pgmeta 2024-04-25T02:23:07.106 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-25T02:23:07.101+0000 7f12e60d1540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:c112adae:::101.00000000:head# has omap that is not per-pg or pgmeta 2024-04-25T02:23:07.107 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-25T02:23:07.101+0000 7f12e60d1540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:c27f454c:::mds1_sessionmap:head# has omap that is not per-pg or pgmeta 2024-04-25T02:23:07.107 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-25T02:23:07.101+0000 7f12e60d1540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:ca4dd7f5:::611.00000000:head# has omap that is not per-pg or pgmeta 2024-04-25T02:23:07.107 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-25T02:23:07.101+0000 7f12e60d1540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:cd5a64a3:::100.00000000:head# has omap that is not per-pg or pgmeta 2024-04-25T02:23:07.107 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-25T02:23:07.101+0000 7f12e60d1540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:d0630e4c:::mds0_sessionmap:head# has omap that is not per-pg or pgmeta 2024-04-25T02:23:07.107 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-25T02:23:07.101+0000 7f12e60d1540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:d70a01c6:::60c.00000000:head# has omap that is not per-pg or pgmeta 2024-04-25T02:23:07.107 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-25T02:23:07.101+0000 7f12e60d1540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:e8b9846e:::60d.00000000:head# has omap that is not per-pg or pgmeta 2024-04-25T02:23:07.107 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-25T02:23:07.101+0000 7f12e60d1540 -1 bluestore(/var/lib/ceph/osd/ceph-0) fsck warning: #3:ff5b34d6:::1.00000000:head# has omap that is not per-pg or pgmeta 2024-04-25T02:23:07.385 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-25T02:23:07.381+0000 7fb8863f7540 -1 Falling back to public interface 2024-04-25T02:23:07.823 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-25T02:23:07.819+0000 7f12e60d1540 -1 osd.0 0 read_superblock omap replica is missing. 2024-04-25T02:23:07.848 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-25T02:23:07.844+0000 7f12e60d1540 -1 osd.0 22 log_to_monitors true 2024-04-25T02:23:08.135 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-25T02:23:08.132+0000 7fbf03bcb540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: store not yet converted to per-pg omap 2024-04-25T02:23:08.138 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-25T02:23:08.133+0000 7fbf03bcb540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2024-04-25T02:23:08.138 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-25T02:23:08.134+0000 7fbf03bcb540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:09401a81:::601.00000000:head# has omap that is not per-pg or pgmeta 2024-04-25T02:23:08.138 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-25T02:23:08.134+0000 7fbf03bcb540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:0bd6d154:::602.00000000:head# has omap that is not per-pg or pgmeta 2024-04-25T02:23:08.138 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-25T02:23:08.134+0000 7fbf03bcb540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:0d82a743:::600.00000000:head# has omap that is not per-pg or pgmeta 2024-04-25T02:23:08.138 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-25T02:23:08.134+0000 7fbf03bcb540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:0d89b25e:::603.00000000:head# has omap that is not per-pg or pgmeta 2024-04-25T02:23:08.138 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-25T02:23:08.134+0000 7fbf03bcb540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:0f65c9b8:::60a.00000000:head# has omap that is not per-pg or pgmeta 2024-04-25T02:23:08.138 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-25T02:23:08.134+0000 7fbf03bcb540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:1470b2f8:::613.00000000:head# has omap that is not per-pg or pgmeta 2024-04-25T02:23:08.138 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-25T02:23:08.134+0000 7fbf03bcb540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:3ed09add:::607.00000000:head# has omap that is not per-pg or pgmeta 2024-04-25T02:23:08.138 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-25T02:23:08.134+0000 7fbf03bcb540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:54ba6923:::mds1_openfiles.0:head# has omap that is not per-pg or pgmeta 2024-04-25T02:23:08.139 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-25T02:23:08.134+0000 7fbf03bcb540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:654134d2:::mds0_openfiles.0:head# has omap that is not per-pg or pgmeta 2024-04-25T02:23:08.139 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-25T02:23:08.134+0000 7fbf03bcb540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:e0b41d06:::609.00000000:head# has omap that is not per-pg or pgmeta 2024-04-25T02:23:08.139 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-25T02:23:08.134+0000 7fbf03bcb540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:e455cf45:::60b.00000000:head# has omap that is not per-pg or pgmeta 2024-04-25T02:23:08.139 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-25T02:23:08.134+0000 7fbf03bcb540 -1 bluestore(/var/lib/ceph/osd/ceph-1) fsck warning: #3:ff5b34d6:::1.00000000:head# has omap that is not per-pg or pgmeta 2024-04-25T02:23:08.908 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-25T02:23:08.905+0000 7fbf03bcb540 -1 osd.1 0 read_superblock omap replica is missing. 2024-04-25T02:23:08.939 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-25T02:23:08.936+0000 7fbf03bcb540 -1 osd.1 22 log_to_monitors true 2024-04-25T02:23:09.118 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-25T02:23:09.114+0000 7f5c9bf11540 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: store not yet converted to per-pg omap 2024-04-25T02:23:09.120 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-25T02:23:09.116+0000 7f5c9bf11540 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2024-04-25T02:23:09.121 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-25T02:23:09.116+0000 7f5c9bf11540 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #3:2e2b5214:::610.00000000:head# has omap that is not per-pg or pgmeta 2024-04-25T02:23:09.121 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-25T02:23:09.116+0000 7f5c9bf11540 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #3:2f55791f:::606.00000000:head# has omap that is not per-pg or pgmeta 2024-04-25T02:23:09.121 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-25T02:23:09.116+0000 7f5c9bf11540 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #3:6f2c300e:::60f.00000000:head# has omap that is not per-pg or pgmeta 2024-04-25T02:23:09.121 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-25T02:23:09.116+0000 7f5c9bf11540 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #3:717a0223:::608.00000000:head# has omap that is not per-pg or pgmeta 2024-04-25T02:23:09.121 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-25T02:23:09.116+0000 7f5c9bf11540 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #3:92e99a1d:::612.00000000:head# has omap that is not per-pg or pgmeta 2024-04-25T02:23:09.121 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-25T02:23:09.116+0000 7f5c9bf11540 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #3:c112adae:::101.00000000:head# has omap that is not per-pg or pgmeta 2024-04-25T02:23:09.121 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-25T02:23:09.116+0000 7f5c9bf11540 -1 bluestore(/var/lib/ceph/osd/ceph-2) fsck warning: #3:c27f454c:::mds1_sessionmap:head# has omap that is not per-pg or pgmeta 2024-04-25T02:23:09.713 INFO:tasks.ceph.osd.0.smithi111.stderr:2024-04-25T02:23:09.710+0000 7f12d5acd700 -1 osd.0 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:23:09.869 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-25T02:23:09.865+0000 7f5c9bf11540 -1 osd.2 0 read_superblock omap replica is missing. 2024-04-25T02:23:09.905 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-25T02:23:09.901+0000 7f5c9bf11540 -1 osd.2 24 log_to_monitors true 2024-04-25T02:23:10.109 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:23:10.155 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-25T02:23:10.151+0000 7fb8863f7540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: store not yet converted to per-pg omap 2024-04-25T02:23:10.158 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-25T02:23:10.153+0000 7fb8863f7540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #-1:c1a3fc6e:::purged_snaps:0# has omap that is not per-pg or pgmeta 2024-04-25T02:23:10.158 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-25T02:23:10.153+0000 7fb8863f7540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:1470b2f8:::613.00000000:head# has omap that is not per-pg or pgmeta 2024-04-25T02:23:10.158 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-25T02:23:10.153+0000 7fb8863f7540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:2e2b5214:::610.00000000:head# has omap that is not per-pg or pgmeta 2024-04-25T02:23:10.158 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-25T02:23:10.153+0000 7fb8863f7540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:2f55791f:::606.00000000:head# has omap that is not per-pg or pgmeta 2024-04-25T02:23:10.158 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-25T02:23:10.153+0000 7fb8863f7540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:48cd7578:::60e.00000000:head# has omap that is not per-pg or pgmeta 2024-04-25T02:23:10.158 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-25T02:23:10.153+0000 7fb8863f7540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:54ba6923:::mds1_openfiles.0:head# has omap that is not per-pg or pgmeta 2024-04-25T02:23:10.158 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-25T02:23:10.153+0000 7fb8863f7540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:6f2c300e:::60f.00000000:head# has omap that is not per-pg or pgmeta 2024-04-25T02:23:10.158 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-25T02:23:10.153+0000 7fb8863f7540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:92e99a1d:::612.00000000:head# has omap that is not per-pg or pgmeta 2024-04-25T02:23:10.158 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-25T02:23:10.153+0000 7fb8863f7540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:a93a17c2:::604.00000000:head# has omap that is not per-pg or pgmeta 2024-04-25T02:23:10.158 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-25T02:23:10.153+0000 7fb8863f7540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:b871830b:::605.00000000:head# has omap that is not per-pg or pgmeta 2024-04-25T02:23:10.159 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-25T02:23:10.153+0000 7fb8863f7540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:ca4dd7f5:::611.00000000:head# has omap that is not per-pg or pgmeta 2024-04-25T02:23:10.159 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-25T02:23:10.153+0000 7fb8863f7540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:cd5a64a3:::100.00000000:head# has omap that is not per-pg or pgmeta 2024-04-25T02:23:10.159 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-25T02:23:10.153+0000 7fb8863f7540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:d0630e4c:::mds0_sessionmap:head# has omap that is not per-pg or pgmeta 2024-04-25T02:23:10.159 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-25T02:23:10.153+0000 7fb8863f7540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:d70a01c6:::60c.00000000:head# has omap that is not per-pg or pgmeta 2024-04-25T02:23:10.159 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-25T02:23:10.153+0000 7fb8863f7540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:e0b41d06:::609.00000000:head# has omap that is not per-pg or pgmeta 2024-04-25T02:23:10.159 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-25T02:23:10.153+0000 7fb8863f7540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:e455cf45:::60b.00000000:head# has omap that is not per-pg or pgmeta 2024-04-25T02:23:10.159 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-25T02:23:10.153+0000 7fb8863f7540 -1 bluestore(/var/lib/ceph/osd/ceph-3) fsck warning: #3:e8b9846e:::60d.00000000:head# has omap that is not per-pg or pgmeta 2024-04-25T02:23:10.244 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.241+0000 7fa25c6de700 1 Processor -- start 2024-04-25T02:23:10.245 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.241+0000 7fa25c6de700 1 -- start start 2024-04-25T02:23:10.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.241+0000 7fa25c6de700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fa2540a4ed0 0x7fa2540a6e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:10.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.241+0000 7fa25c6de700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa2540b30c0 0x7fa25406f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:10.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.242+0000 7fa25c6de700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa25406eb60 con 0x7fa25406f9c0 2024-04-25T02:23:10.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.242+0000 7fa25c6de700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa25406ed90 con 0x7fa2540a4ed0 2024-04-25T02:23:10.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.242+0000 7fa25c6de700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2540a7370 con 0x7fa2540b30c0 2024-04-25T02:23:10.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.242+0000 7fa25a47a700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fa2540a4ed0 0x7fa2540a6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:10.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.242+0000 7fa25a47a700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fa2540a4ed0 0x7fa2540a6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44746/0 (socket says 172.21.15.111:44746) 2024-04-25T02:23:10.247 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.242+0000 7fa25a47a700 1 -- 172.21.15.111:0/3203496048 learned_addr learned my addr 172.21.15.111:0/3203496048 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:10.247 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.242+0000 7fa259c79700 1 --2- 172.21.15.111:0/3203496048 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa2540b30c0 0x7fa25406f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:10.247 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.242+0000 7fa25a47a700 1 -- 172.21.15.111:0/3203496048 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa2540b30c0 msgr2=0x7fa25406f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:10.247 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.242+0000 7fa25a47a700 1 --2- 172.21.15.111:0/3203496048 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa2540b30c0 0x7fa25406f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:10.247 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.242+0000 7fa25a47a700 1 -- 172.21.15.111:0/3203496048 >> v1:172.21.15.111:6789/0 conn(0x7fa25406f9c0 legacy=0x7fa25413f850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:10.247 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.242+0000 7fa25a47a700 1 -- 172.21.15.111:0/3203496048 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2540a74e0 con 0x7fa2540a4ed0 2024-04-25T02:23:10.247 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.242+0000 7fa259c79700 1 --2- 172.21.15.111:0/3203496048 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa2540b30c0 0x7fa25406f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:10.247 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.242+0000 7fa25a47a700 1 --2- 172.21.15.111:0/3203496048 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa2540a4ed0 0x7fa2540a6e30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa2500099b0 tx=0x7fa250009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bed8fe0f34be2fef server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:10.247 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.242+0000 7fa259478700 1 -- 172.21.15.111:0/3203496048 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa250009ea0 con 0x7fa2540a4ed0 2024-04-25T02:23:10.247 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.242+0000 7fa259478700 1 -- 172.21.15.111:0/3203496048 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa25000b860 con 0x7fa2540a4ed0 2024-04-25T02:23:10.247 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.242+0000 7fa259478700 1 -- 172.21.15.111:0/3203496048 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25000bc00 con 0x7fa2540a4ed0 2024-04-25T02:23:10.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.243+0000 7fa25c6de700 1 -- 172.21.15.111:0/3203496048 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa2540a4ed0 msgr2=0x7fa2540a6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:10.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.243+0000 7fa25c6de700 1 --2- 172.21.15.111:0/3203496048 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa2540a4ed0 0x7fa2540a6e30 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa2500099b0 tx=0x7fa250009250 comp rx=0 tx=0).stop 2024-04-25T02:23:10.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.243+0000 7fa25c6de700 1 -- 172.21.15.111:0/3203496048 shutdown_connections 2024-04-25T02:23:10.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.243+0000 7fa25c6de700 1 --2- 172.21.15.111:0/3203496048 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa2540a4ed0 0x7fa2540a6e30 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:10.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.243+0000 7fa25c6de700 1 --2- 172.21.15.111:0/3203496048 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa2540b30c0 0x7fa25406f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:10.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.243+0000 7fa25c6de700 1 -- 172.21.15.111:0/3203496048 >> 172.21.15.111:0/3203496048 conn(0x7fa25406e2b0 msgr2=0x7fa25406be80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:10.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.243+0000 7fa25c6de700 1 -- 172.21.15.111:0/3203496048 shutdown_connections 2024-04-25T02:23:10.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.243+0000 7fa25c6de700 1 -- 172.21.15.111:0/3203496048 wait complete. 2024-04-25T02:23:10.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.244+0000 7fa25c6de700 1 Processor -- start 2024-04-25T02:23:10.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.245+0000 7fa25c6de700 1 -- start start 2024-04-25T02:23:10.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.245+0000 7fa25c6de700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa25406f9c0 0x7fa2540ad260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:10.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.245+0000 7fa25c6de700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa2540a4ed0 0x7fa2540ae2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:10.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.245+0000 7fa25c6de700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa2540b30c0 0x7fa25414fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:10.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.245+0000 7fa25c6de700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa254150540 con 0x7fa25406f9c0 2024-04-25T02:23:10.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.245+0000 7fa25c6de700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa254150800 con 0x7fa2540a4ed0 2024-04-25T02:23:10.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.245+0000 7fa25c6de700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa2540ae7f0 con 0x7fa2540b30c0 2024-04-25T02:23:10.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.245+0000 7fa25a47a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa25406f9c0 0x7fa2540ad260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:10.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.245+0000 7fa259c79700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa2540a4ed0 0x7fa2540ae2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:10.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.245+0000 7fa25a47a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa25406f9c0 0x7fa2540ad260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:44756/0 (socket says 172.21.15.111:44756) 2024-04-25T02:23:10.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.245+0000 7fa25a47a700 1 -- 172.21.15.111:0/4269938346 learned_addr learned my addr 172.21.15.111:0/4269938346 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:10.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.246+0000 7fa25ac7b700 1 --2- 172.21.15.111:0/4269938346 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa2540b30c0 0x7fa25414fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:10.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.246+0000 7fa259c79700 1 -- 172.21.15.111:0/4269938346 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa2540b30c0 msgr2=0x7fa25414fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:10.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.246+0000 7fa259c79700 1 --2- 172.21.15.111:0/4269938346 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa2540b30c0 0x7fa25414fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:10.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.246+0000 7fa259c79700 1 -- 172.21.15.111:0/4269938346 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa25406f9c0 msgr2=0x7fa2540ad260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:10.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.246+0000 7fa259c79700 1 --2- 172.21.15.111:0/4269938346 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa25406f9c0 0x7fa2540ad260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:10.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.246+0000 7fa259c79700 1 -- 172.21.15.111:0/4269938346 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa244009420 con 0x7fa2540a4ed0 2024-04-25T02:23:10.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.246+0000 7fa25a47a700 1 --2- 172.21.15.111:0/4269938346 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa25406f9c0 0x7fa2540ad260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:10.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.246+0000 7fa259c79700 1 --2- 172.21.15.111:0/4269938346 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa2540a4ed0 0x7fa2540ae2b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa24400ec80 tx=0x7fa2440091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:10.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.246+0000 7fa24a7fc700 1 -- 172.21.15.111:0/4269938346 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24400c850 con 0x7fa2540a4ed0 2024-04-25T02:23:10.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.246+0000 7fa24a7fc700 1 -- 172.21.15.111:0/4269938346 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa24400c9b0 con 0x7fa2540a4ed0 2024-04-25T02:23:10.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.246+0000 7fa25c6de700 1 -- 172.21.15.111:0/4269938346 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2500094f0 con 0x7fa2540a4ed0 2024-04-25T02:23:10.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.246+0000 7fa24a7fc700 1 -- 172.21.15.111:0/4269938346 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa24400cd70 con 0x7fa2540a4ed0 2024-04-25T02:23:10.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.246+0000 7fa25c6de700 1 -- 172.21.15.111:0/4269938346 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2541500b0 con 0x7fa2540a4ed0 2024-04-25T02:23:10.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.247+0000 7fa25c6de700 1 -- 172.21.15.111:0/4269938346 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa254065190 con 0x7fa2540a4ed0 2024-04-25T02:23:10.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.248+0000 7fa24a7fc700 1 -- 172.21.15.111:0/4269938346 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7fa244013680 con 0x7fa2540a4ed0 2024-04-25T02:23:10.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.248+0000 7fa24a7fc700 1 -- 172.21.15.111:0/4269938346 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 3840+0+0 (secure 0 0 0) 0x7fa24405b380 con 0x7fa2540a4ed0 2024-04-25T02:23:10.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.253+0000 7fa24a7fc700 1 -- 172.21.15.111:0/4269938346 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fa2440395d0 con 0x7fa2540a4ed0 2024-04-25T02:23:10.471 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.467+0000 7fa25c6de700 1 -- 172.21.15.111:0/4269938346 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa2540a7820 con 0x7fa2540a4ed0 2024-04-25T02:23:10.472 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.468+0000 7fa24a7fc700 1 -- 172.21.15.111:0/4269938346 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v28) v1 ==== 74+0+11582 (secure 0 0 0) 0x7fa24403cdc0 con 0x7fa2540a4ed0 2024-04-25T02:23:10.472 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:23:10.472 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":28,"fsid":"4643f974-f93a-4436-93b8-460ff320e62e","created":"2024-04-25T02:20:05.450475+0000","modified":"2024-04-25T02:23:09.793431+0000","last_up_change":"2024-04-25T02:23:09.793431+0000","last_in_change":"2024-04-25T02:20:10.439204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:20:07.471248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:20:14.420378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:20:22.251868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T02:20:23.128289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"df3f17ca-3b12-42c8-8cf7-8f1b7189e587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":16,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6800","nonce":48862}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6801","nonce":48862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6803","nonce":48862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6802","nonce":48862}]},"public_addr":"172.21.15.111:6800/48862","cluster_addr":"172.21.15.111:6801/48862","heartbeat_back_addr":"172.21.15.111:6803/48862","heartbeat_front_addr":"172.21.15.111:6802/48862","state":["exists","up"]},{"osd":1,"uuid":"93d54815-f215-4285-bba6-32f2d1cabf10","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6812","nonce":40216}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6813","nonce":40216}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6815","nonce":40216}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6814","nonce":40216}]},"public_addr":"172.21.15.111:6812/40216","cluster_addr":"172.21.15.111:6813/40216","heartbeat_back_addr":"172.21.15.111:6815/40216","heartbeat_front_addr":"172.21.15.111:6814/40216","state":["exists"]},{"osd":2,"uuid":"b26b2104-2a2e-408f-9ce7-3587a32a2ebe","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":24,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6804","nonce":40215}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6805","nonce":40215}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6807","nonce":40215}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6806","nonce":40215}]},"public_addr":"172.21.15.111:6804/40215","cluster_addr":"172.21.15.111:6805/40215","heartbeat_back_addr":"172.21.15.111:6807/40215","heartbeat_front_addr":"172.21.15.111:6806/40215","state":["exists"]},{"osd":3,"uuid":"43c25820-1edc-4031-badf-72e87dd6bf15","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":25,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6808","nonce":40213}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6809","nonce":40213}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6811","nonce":40213}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6810","nonce":40213}]},"public_addr":"172.21.15.111:6808/40213","cluster_addr":"172.21.15.111:6809/40213","heartbeat_back_addr":"172.21.15.111:6811/40213","heartbeat_front_addr":"172.21.15.111:6810/40213","state":["exists"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.372427+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.411480+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.361508+0000","dead_epoch":25},{"osd":3,"down_stamp":"2024-04-25T02:23:06.771296+0000","laggy_probability":0,"laggy_interval":0,"features":4540138292840890367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.377212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.111:0/2148931273":"2024-04-26T02:22:54.713254+0000","172.21.15.111:6816/39585":"2024-04-26T02:22:54.713254+0000","172.21.15.111:0/3911588907":"2024-04-26T02:22:54.713254+0000","172.21.15.111:0/1276843622":"2024-04-26T02:22:54.713254+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:23:10.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.470+0000 7fa25c6de700 1 -- 172.21.15.111:0/4269938346 >> v1:172.21.15.111:6816/46482 conn(0x7fa238046040 legacy=0x7fa2380484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:10.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.470+0000 7fa25c6de700 1 -- 172.21.15.111:0/4269938346 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa2540a4ed0 msgr2=0x7fa2540ae2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:10.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.470+0000 7fa25c6de700 1 --2- 172.21.15.111:0/4269938346 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa2540a4ed0 0x7fa2540ae2b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fa24400ec80 tx=0x7fa2440091a0 comp rx=0 tx=0).stop 2024-04-25T02:23:10.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.470+0000 7fa25c6de700 1 -- 172.21.15.111:0/4269938346 shutdown_connections 2024-04-25T02:23:10.474 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.470+0000 7fa25c6de700 1 --2- 172.21.15.111:0/4269938346 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa2540b30c0 0x7fa25414fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:10.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.470+0000 7fa25c6de700 1 --2- 172.21.15.111:0/4269938346 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa25406f9c0 0x7fa2540ad260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:10.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.470+0000 7fa25c6de700 1 --2- 172.21.15.111:0/4269938346 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa2540a4ed0 0x7fa2540ae2b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:10.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.470+0000 7fa25c6de700 1 -- 172.21.15.111:0/4269938346 >> 172.21.15.111:0/4269938346 conn(0x7fa25406e2b0 msgr2=0x7fa25406bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:10.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.470+0000 7fa25c6de700 1 -- 172.21.15.111:0/4269938346 shutdown_connections 2024-04-25T02:23:10.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:10.470+0000 7fa25c6de700 1 -- 172.21.15.111:0/4269938346 wait complete. 2024-04-25T02:23:10.680 INFO:tasks.ceph.osd.1.smithi111.stderr:2024-04-25T02:23:10.676+0000 7fbef35c7700 -1 osd.1 22 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:23:11.043 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-04-25T02:23:11.150 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-25T02:23:11.147+0000 7fb8863f7540 -1 osd.3 0 read_superblock omap replica is missing. 2024-04-25T02:23:11.185 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-25T02:23:11.181+0000 7fb8863f7540 -1 osd.3 25 log_to_monitors true 2024-04-25T02:23:11.662 INFO:tasks.ceph.osd.2.smithi111.stderr:2024-04-25T02:23:11.659+0000 7f5c8b90d700 -1 osd.2 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:23:12.693 INFO:tasks.ceph.osd.3.smithi111.stderr:2024-04-25T02:23:12.689+0000 7fb875df3700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-25T02:23:13.487 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:23:13.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.603+0000 7f03325da700 1 Processor -- start 2024-04-25T02:23:13.607 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.603+0000 7f03325da700 1 -- start start 2024-04-25T02:23:13.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.603+0000 7f03325da700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f032c06e370 0x7f032c06d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:13.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.603+0000 7f03325da700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f032c13ebb0 0x7f032c145230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:13.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.603+0000 7f03325da700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f032c1383a0 con 0x7f032c0ad730 2024-04-25T02:23:13.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.603+0000 7f03325da700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f032c0abff0 con 0x7f032c13ebb0 2024-04-25T02:23:13.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.603+0000 7f03325da700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f032c13e200 con 0x7f032c06e370 2024-04-25T02:23:13.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.603+0000 7f032bfff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f032c06e370 0x7f032c06d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:13.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.603+0000 7f032b7fe700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f032c0ad730 0x7f032c13e4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:43818/0 (socket says 172.21.15.111:43818) 2024-04-25T02:23:13.610 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.603+0000 7f032b7fe700 1 -- 172.21.15.111:0/3816853430 learned_addr learned my addr 172.21.15.111:0/3816853430 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:23:13.610 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.603+0000 7f0330b77700 1 --2- 172.21.15.111:0/3816853430 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f032c13ebb0 0x7f032c145230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:13.610 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.604+0000 7f032affd700 1 -- 172.21.15.111:0/3816853430 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1931028328 0 0) 0x7f032c1383a0 con 0x7f032c0ad730 2024-04-25T02:23:13.610 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.604+0000 7f032bfff700 1 -- 172.21.15.111:0/3816853430 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f032c13ebb0 msgr2=0x7f032c145230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:13.610 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.604+0000 7f032bfff700 1 --2- 172.21.15.111:0/3816853430 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f032c13ebb0 0x7f032c145230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:13.610 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.604+0000 7f032bfff700 1 -- 172.21.15.111:0/3816853430 >> v1:172.21.15.111:6789/0 conn(0x7f032c0ad730 legacy=0x7f032c13e4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:13.610 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.604+0000 7f032bfff700 1 -- 172.21.15.111:0/3816853430 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f032c0ad290 con 0x7f032c06e370 2024-04-25T02:23:13.610 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.604+0000 7f0330b77700 1 --2- 172.21.15.111:0/3816853430 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f032c13ebb0 0x7f032c145230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:13.610 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.604+0000 7f032bfff700 1 --2- 172.21.15.111:0/3816853430 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f032c06e370 0x7f032c06d1d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f031c009910 tx=0x7f031c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=be48e6cacf2f680e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:13.610 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.604+0000 7f032affd700 1 -- 172.21.15.111:0/3816853430 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031c00b680 con 0x7f032c06e370 2024-04-25T02:23:13.610 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.604+0000 7f032affd700 1 -- 172.21.15.111:0/3816853430 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f031c00b7e0 con 0x7f032c06e370 2024-04-25T02:23:13.610 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.604+0000 7f032affd700 1 -- 172.21.15.111:0/3816853430 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031c00bba0 con 0x7f032c06e370 2024-04-25T02:23:13.610 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.605+0000 7f03325da700 1 -- 172.21.15.111:0/3816853430 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f032c06e370 msgr2=0x7f032c06d1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:13.610 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.605+0000 7f03325da700 1 --2- 172.21.15.111:0/3816853430 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f032c06e370 0x7f032c06d1d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f031c009910 tx=0x7f031c0091a0 comp rx=0 tx=0).stop 2024-04-25T02:23:13.611 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.605+0000 7f03325da700 1 -- 172.21.15.111:0/3816853430 shutdown_connections 2024-04-25T02:23:13.611 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.605+0000 7f03325da700 1 --2- 172.21.15.111:0/3816853430 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f032c06e370 0x7f032c06d1d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:13.611 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.605+0000 7f03325da700 1 --2- 172.21.15.111:0/3816853430 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f032c13ebb0 0x7f032c145230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:13.611 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.605+0000 7f03325da700 1 -- 172.21.15.111:0/3816853430 >> 172.21.15.111:0/3816853430 conn(0x7f032c0b1390 msgr2=0x7f032c0b1760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:13.611 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.605+0000 7f03325da700 1 -- 172.21.15.111:0/3816853430 shutdown_connections 2024-04-25T02:23:13.611 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.605+0000 7f03325da700 1 -- 172.21.15.111:0/3816853430 wait complete. 2024-04-25T02:23:13.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.606+0000 7f03325da700 1 Processor -- start 2024-04-25T02:23:13.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.606+0000 7f03325da700 1 -- start start 2024-04-25T02:23:13.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.607+0000 7f03325da700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f032c06e370 0x7f032c14efd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:13.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.607+0000 7f03325da700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f032c0ad730 0x7f032c12f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:13.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.607+0000 7f03325da700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f032c13ebb0 0x7f032c12f620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:13.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.607+0000 7f03325da700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f032c13add0 con 0x7f032c06e370 2024-04-25T02:23:13.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.607+0000 7f03325da700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f032c136960 con 0x7f032c0ad730 2024-04-25T02:23:13.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.607+0000 7f03325da700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f032c135f30 con 0x7f032c13ebb0 2024-04-25T02:23:13.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.607+0000 7f032bfff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f032c06e370 0x7f032c14efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:13.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.607+0000 7f032b7fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f032c0ad730 0x7f032c12f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:13.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.607+0000 7f032bfff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f032c06e370 0x7f032c14efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:35320/0 (socket says 172.21.15.111:35320) 2024-04-25T02:23:13.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.607+0000 7f032bfff700 1 -- 172.21.15.111:0/1554663094 learned_addr learned my addr 172.21.15.111:0/1554663094 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:13.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.607+0000 7f0330b77700 1 --2- 172.21.15.111:0/1554663094 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f032c13ebb0 0x7f032c12f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:13.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.607+0000 7f032bfff700 1 -- 172.21.15.111:0/1554663094 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f032c13ebb0 msgr2=0x7f032c12f620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:13.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.607+0000 7f032bfff700 1 --2- 172.21.15.111:0/1554663094 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f032c13ebb0 0x7f032c12f620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:13.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.607+0000 7f032bfff700 1 -- 172.21.15.111:0/1554663094 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f032c0ad730 msgr2=0x7f032c12f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:13.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.607+0000 7f032bfff700 1 --2- 172.21.15.111:0/1554663094 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f032c0ad730 0x7f032c12f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:13.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.607+0000 7f032bfff700 1 -- 172.21.15.111:0/1554663094 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f032400ab30 con 0x7f032c06e370 2024-04-25T02:23:13.615 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.607+0000 7f032b7fe700 1 --2- 172.21.15.111:0/1554663094 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f032c0ad730 0x7f032c12f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:13.615 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.607+0000 7f032bfff700 1 --2- 172.21.15.111:0/1554663094 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f032c06e370 0x7f032c14efd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f032c13e390 tx=0x7f031c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:13.615 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.607+0000 7f0313fff700 1 -- 172.21.15.111:0/1554663094 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031c00bb60 con 0x7f032c06e370 2024-04-25T02:23:13.615 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.607+0000 7f0313fff700 1 -- 172.21.15.111:0/1554663094 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f031c01e160 con 0x7f032c06e370 2024-04-25T02:23:13.615 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.607+0000 7f03325da700 1 -- 172.21.15.111:0/1554663094 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f031c009420 con 0x7f032c06e370 2024-04-25T02:23:13.615 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.608+0000 7f0313fff700 1 -- 172.21.15.111:0/1554663094 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031c01e520 con 0x7f032c06e370 2024-04-25T02:23:13.615 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.608+0000 7f03325da700 1 -- 172.21.15.111:0/1554663094 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f032c14fc40 con 0x7f032c06e370 2024-04-25T02:23:13.615 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.608+0000 7f03325da700 1 -- 172.21.15.111:0/1554663094 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f032c071790 con 0x7f032c06e370 2024-04-25T02:23:13.615 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.608+0000 7f0313fff700 1 -- 172.21.15.111:0/1554663094 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f031c01a660 con 0x7f032c06e370 2024-04-25T02:23:13.615 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.609+0000 7f0313fff700 1 -- 172.21.15.111:0/1554663094 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f031c05c970 con 0x7f032c06e370 2024-04-25T02:23:13.616 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.612+0000 7f0313fff700 1 -- 172.21.15.111:0/1554663094 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f031c007ad0 con 0x7f032c06e370 2024-04-25T02:23:13.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.768+0000 7f03325da700 1 -- 172.21.15.111:0/1554663094 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f032c0ac890 con 0x7f032c06e370 2024-04-25T02:23:13.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.769+0000 7f0313fff700 1 -- 172.21.15.111:0/1554663094 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v31) v1 ==== 74+0+11603 (secure 0 0 0) 0x7f031c023030 con 0x7f032c06e370 2024-04-25T02:23:13.772 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:23:13.773 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":31,"fsid":"4643f974-f93a-4436-93b8-460ff320e62e","created":"2024-04-25T02:20:05.450475+0000","modified":"2024-04-25T02:23:12.818028+0000","last_up_change":"2024-04-25T02:23:12.818028+0000","last_in_change":"2024-04-25T02:20:10.439204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:20:07.471248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:20:14.420378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:20:22.251868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T02:20:23.128289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"df3f17ca-3b12-42c8-8cf7-8f1b7189e587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":30,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6800","nonce":48862}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6801","nonce":48862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6803","nonce":48862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6802","nonce":48862}]},"public_addr":"172.21.15.111:6800/48862","cluster_addr":"172.21.15.111:6801/48862","heartbeat_back_addr":"172.21.15.111:6803/48862","heartbeat_front_addr":"172.21.15.111:6802/48862","state":["exists","up"]},{"osd":1,"uuid":"93d54815-f215-4285-bba6-32f2d1cabf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":29,"up_thru":30,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6804","nonce":48960}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6805","nonce":48960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6807","nonce":48960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6806","nonce":48960}]},"public_addr":"172.21.15.111:6804/48960","cluster_addr":"172.21.15.111:6805/48960","heartbeat_back_addr":"172.21.15.111:6807/48960","heartbeat_front_addr":"172.21.15.111:6806/48960","state":["exists","up"]},{"osd":2,"uuid":"b26b2104-2a2e-408f-9ce7-3587a32a2ebe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":30,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6808","nonce":49070}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6809","nonce":49070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6811","nonce":49070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6810","nonce":49070}]},"public_addr":"172.21.15.111:6808/49070","cluster_addr":"172.21.15.111:6809/49070","heartbeat_back_addr":"172.21.15.111:6811/49070","heartbeat_front_addr":"172.21.15.111:6810/49070","state":["exists","up"]},{"osd":3,"uuid":"43c25820-1edc-4031-badf-72e87dd6bf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":25,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6812","nonce":49243}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6813","nonce":49243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6815","nonce":49243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6814","nonce":49243}]},"public_addr":"172.21.15.111:6812/49243","cluster_addr":"172.21.15.111:6813/49243","heartbeat_back_addr":"172.21.15.111:6815/49243","heartbeat_front_addr":"172.21.15.111:6814/49243","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.372427+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.411480+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.361508+0000","dead_epoch":25},{"osd":3,"down_stamp":"2024-04-25T02:23:06.771296+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.377212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.111:0/2148931273":"2024-04-26T02:22:54.713254+0000","172.21.15.111:6816/39585":"2024-04-26T02:22:54.713254+0000","172.21.15.111:0/3911588907":"2024-04-26T02:22:54.713254+0000","172.21.15.111:0/1276843622":"2024-04-26T02:22:54.713254+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:23:13.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.770+0000 7f03325da700 1 -- 172.21.15.111:0/1554663094 >> v1:172.21.15.111:6816/46482 conn(0x7f0318046010 legacy=0x7f03180484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:13.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.770+0000 7f03325da700 1 -- 172.21.15.111:0/1554663094 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f032c06e370 msgr2=0x7f032c14efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:13.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.770+0000 7f03325da700 1 --2- 172.21.15.111:0/1554663094 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f032c06e370 0x7f032c14efd0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f032c13e390 tx=0x7f031c017000 comp rx=0 tx=0).stop 2024-04-25T02:23:13.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.770+0000 7f03325da700 1 -- 172.21.15.111:0/1554663094 shutdown_connections 2024-04-25T02:23:13.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.770+0000 7f03325da700 1 --2- 172.21.15.111:0/1554663094 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f032c13ebb0 0x7f032c12f620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:13.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.770+0000 7f03325da700 1 --2- 172.21.15.111:0/1554663094 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f032c06e370 0x7f032c14efd0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:13.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.770+0000 7f03325da700 1 --2- 172.21.15.111:0/1554663094 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f032c0ad730 0x7f032c12f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:13.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.770+0000 7f03325da700 1 -- 172.21.15.111:0/1554663094 >> 172.21.15.111:0/1554663094 conn(0x7f032c0b1390 msgr2=0x7f032c13ce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:13.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.771+0000 7f03325da700 1 -- 172.21.15.111:0/1554663094 shutdown_connections 2024-04-25T02:23:13.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:13.771+0000 7f03325da700 1 -- 172.21.15.111:0/1554663094 wait complete. 2024-04-25T02:23:13.786 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-25T02:23:13.786 INFO:teuthology.run_tasks:Running task ceph.stop... 2024-04-25T02:23:13.800 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T02:23:13.800 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:23:13.809 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T02:23:13.809 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T02:23:13.809 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:23:13.861 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T02:23:13.861 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T02:23:13.861 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:23:13.910 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T02:23:16.045 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog finished 2024-04-25T02:23:16.045 INFO:teuthology.run_tasks:Running task ceph.restart... 2024-04-25T02:23:16.073 ERROR:tasks.ceph.mds.a:tried to stop a non-running daemon 2024-04-25T02:23:16.073 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-25T02:23:16.073 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-25T02:23:16.077 INFO:tasks.ceph.mds.a:Started 2024-04-25T02:23:16.077 ERROR:tasks.ceph.mds.b:tried to stop a non-running daemon 2024-04-25T02:23:16.077 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-25T02:23:16.077 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-25T02:23:16.085 INFO:tasks.ceph.mds.b:Started 2024-04-25T02:23:16.085 ERROR:tasks.ceph.mds.c:tried to stop a non-running daemon 2024-04-25T02:23:16.085 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-25T02:23:16.085 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-25T02:23:16.088 INFO:tasks.ceph.mds.c:Started 2024-04-25T02:23:16.088 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-25T02:23:16.088 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:23:16.168 INFO:tasks.ceph.mds.a.smithi111.stdout:starting mds.a at 2024-04-25T02:23:16.174 INFO:tasks.ceph.mds.c.smithi111.stdout:starting mds.c at 2024-04-25T02:23:16.175 INFO:tasks.ceph.mds.b.smithi111.stdout:starting mds.b at 2024-04-25T02:23:16.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.221+0000 7f238f8b1700 1 Processor -- start 2024-04-25T02:23:16.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.221+0000 7f238f8b1700 1 -- start start 2024-04-25T02:23:16.228 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.222+0000 7f238f8b1700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f23880a31c0 0x7f23880a4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:16.228 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.222+0000 7f238f8b1700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2388143b70 0x7f2388145f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:16.228 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.222+0000 7f238f8b1700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23880a3f40 con 0x7f23880a2600 2024-04-25T02:23:16.228 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.222+0000 7f238f8b1700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f238813f750 con 0x7f23880a31c0 2024-04-25T02:23:16.228 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.222+0000 7f238f8b1700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23880a4980 con 0x7f2388143b70 2024-04-25T02:23:16.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.222+0000 7f238d64d700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f23880a2600 0x7f238813f040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:43868/0 (socket says 172.21.15.111:43868) 2024-04-25T02:23:16.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.222+0000 7f238d64d700 1 -- 172.21.15.111:0/3081750463 learned_addr learned my addr 172.21.15.111:0/3081750463 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:23:16.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.222+0000 7f238de4e700 1 --2- 172.21.15.111:0/3081750463 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2388143b70 0x7f2388145f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:16.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.222+0000 7f238ce4c700 1 --2- 172.21.15.111:0/3081750463 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f23880a31c0 0x7f23880a4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:16.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.222+0000 7f237ffff700 1 -- 172.21.15.111:0/3081750463 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1564109404 0 0) 0x7f23880a3f40 con 0x7f23880a2600 2024-04-25T02:23:16.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.222+0000 7f237ffff700 1 -- 172.21.15.111:0/3081750463 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2374003570 con 0x7f23880a2600 2024-04-25T02:23:16.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.222+0000 7f238ce4c700 1 -- 172.21.15.111:0/3081750463 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2388143b70 msgr2=0x7f2388145f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:16.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.222+0000 7f238ce4c700 1 --2- 172.21.15.111:0/3081750463 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2388143b70 0x7f2388145f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:16.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.222+0000 7f238ce4c700 1 -- 172.21.15.111:0/3081750463 >> v1:172.21.15.111:6789/0 conn(0x7f23880a2600 legacy=0x7f238813f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:16.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.222+0000 7f238ce4c700 1 -- 172.21.15.111:0/3081750463 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23880a4b90 con 0x7f23880a31c0 2024-04-25T02:23:16.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.222+0000 7f238de4e700 1 --2- 172.21.15.111:0/3081750463 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2388143b70 0x7f2388145f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:16.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.222+0000 7f238ce4c700 1 --2- 172.21.15.111:0/3081750463 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f23880a31c0 0x7f23880a4440 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2378009910 tx=0x7f23780091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9540f46861da8459 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:16.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.222+0000 7f237ffff700 1 -- 172.21.15.111:0/3081750463 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2378011630 con 0x7f23880a31c0 2024-04-25T02:23:16.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.222+0000 7f237ffff700 1 -- 172.21.15.111:0/3081750463 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2378011790 con 0x7f23880a31c0 2024-04-25T02:23:16.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.222+0000 7f237ffff700 1 -- 172.21.15.111:0/3081750463 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2378011b10 con 0x7f23880a31c0 2024-04-25T02:23:16.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.223+0000 7f238f8b1700 1 -- 172.21.15.111:0/3081750463 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f23880a31c0 msgr2=0x7f23880a4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:16.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.223+0000 7f238f8b1700 1 --2- 172.21.15.111:0/3081750463 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f23880a31c0 0x7f23880a4440 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f2378009910 tx=0x7f23780091a0 comp rx=0 tx=0).stop 2024-04-25T02:23:16.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.223+0000 7f238f8b1700 1 -- 172.21.15.111:0/3081750463 shutdown_connections 2024-04-25T02:23:16.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.223+0000 7f238f8b1700 1 --2- 172.21.15.111:0/3081750463 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2388143b70 0x7f2388145f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:16.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.223+0000 7f238f8b1700 1 --2- 172.21.15.111:0/3081750463 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f23880a31c0 0x7f23880a4440 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:16.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.223+0000 7f238f8b1700 1 -- 172.21.15.111:0/3081750463 >> 172.21.15.111:0/3081750463 conn(0x7f238806d200 msgr2=0x7f238806aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:16.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.223+0000 7f238f8b1700 1 -- 172.21.15.111:0/3081750463 shutdown_connections 2024-04-25T02:23:16.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.223+0000 7f238f8b1700 1 -- 172.21.15.111:0/3081750463 wait complete. 2024-04-25T02:23:16.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.224+0000 7f238f8b1700 1 Processor -- start 2024-04-25T02:23:16.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.224+0000 7f238f8b1700 1 -- start start 2024-04-25T02:23:16.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.225+0000 7f238f8b1700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f23880a2600 0x7f23880a7c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:16.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.225+0000 7f238f8b1700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f23880a31c0 0x7f23881374e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:16.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.225+0000 7f238f8b1700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2388143b70 0x7f2388137a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:16.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.225+0000 7f238f8b1700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2388068780 con 0x7f2388143b70 2024-04-25T02:23:16.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.225+0000 7f238f8b1700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23880a82a0 con 0x7f23880a2600 2024-04-25T02:23:16.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.225+0000 7f238f8b1700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f23880a8560 con 0x7f23880a31c0 2024-04-25T02:23:16.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.225+0000 7f238d64d700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f23880a2600 0x7f23880a7c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:16.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.225+0000 7f238d64d700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f23880a2600 0x7f23880a7c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:57422/0 (socket says 172.21.15.111:57422) 2024-04-25T02:23:16.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.225+0000 7f238d64d700 1 -- 172.21.15.111:0/2690779531 learned_addr learned my addr 172.21.15.111:0/2690779531 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:16.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.225+0000 7f238de4e700 1 --2- 172.21.15.111:0/2690779531 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2388143b70 0x7f2388137a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:16.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.225+0000 7f238ce4c700 1 --2- 172.21.15.111:0/2690779531 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f23880a31c0 0x7f23881374e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:16.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.225+0000 7f238d64d700 1 -- 172.21.15.111:0/2690779531 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f23880a31c0 msgr2=0x7f23881374e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:16.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.225+0000 7f238d64d700 1 --2- 172.21.15.111:0/2690779531 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f23880a31c0 0x7f23881374e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:16.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.225+0000 7f238d64d700 1 -- 172.21.15.111:0/2690779531 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2388143b70 msgr2=0x7f2388137a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:16.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.225+0000 7f238d64d700 1 --2- 172.21.15.111:0/2690779531 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2388143b70 0x7f2388137a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:16.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.225+0000 7f238d64d700 1 -- 172.21.15.111:0/2690779531 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2380009a20 con 0x7f23880a2600 2024-04-25T02:23:16.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.225+0000 7f238d64d700 1 --2- 172.21.15.111:0/2690779531 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f23880a2600 0x7f23880a7c20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f238400c7c0 tx=0x7f2384007e00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:16.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.225+0000 7f237d7fa700 1 -- 172.21.15.111:0/2690779531 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2384005b30 con 0x7f23880a2600 2024-04-25T02:23:16.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.225+0000 7f237d7fa700 1 -- 172.21.15.111:0/2690779531 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2384005cb0 con 0x7f23880a2600 2024-04-25T02:23:16.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.225+0000 7f238f8b1700 1 -- 172.21.15.111:0/2690779531 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2378009420 con 0x7f23880a2600 2024-04-25T02:23:16.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.225+0000 7f237d7fa700 1 -- 172.21.15.111:0/2690779531 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2384007320 con 0x7f23880a2600 2024-04-25T02:23:16.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.225+0000 7f238f8b1700 1 -- 172.21.15.111:0/2690779531 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23880a8c40 con 0x7f23880a2600 2024-04-25T02:23:16.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.226+0000 7f237d7fa700 1 -- 172.21.15.111:0/2690779531 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f238401b3b0 con 0x7f23880a2600 2024-04-25T02:23:16.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.226+0000 7f238f8b1700 1 -- 172.21.15.111:0/2690779531 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2388071790 con 0x7f23880a2600 2024-04-25T02:23:16.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.227+0000 7f237d7fa700 1 -- 172.21.15.111:0/2690779531 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f238405a660 con 0x7f23880a2600 2024-04-25T02:23:16.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.230+0000 7f237d7fa700 1 -- 172.21.15.111:0/2690779531 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f2384038910 con 0x7f23880a2600 2024-04-25T02:23:16.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.386+0000 7f238f8b1700 1 -- 172.21.15.111:0/2690779531 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23880b0ca0 con 0x7f23880a2600 2024-04-25T02:23:16.391 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.387+0000 7f237d7fa700 1 -- 172.21.15.111:0/2690779531 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+11603 (secure 0 0 0) 0x7f2384017070 con 0x7f23880a2600 2024-04-25T02:23:16.391 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:23:16.392 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":32,"fsid":"4643f974-f93a-4436-93b8-460ff320e62e","created":"2024-04-25T02:20:05.450475+0000","modified":"2024-04-25T02:23:13.822671+0000","last_up_change":"2024-04-25T02:23:12.818028+0000","last_in_change":"2024-04-25T02:20:10.439204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"octopus","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:20:07.471248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:20:14.420378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"14","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:20:22.251868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T02:20:23.128289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"df3f17ca-3b12-42c8-8cf7-8f1b7189e587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":31,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6800","nonce":48862}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6801","nonce":48862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6803","nonce":48862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6802","nonce":48862}]},"public_addr":"172.21.15.111:6800/48862","cluster_addr":"172.21.15.111:6801/48862","heartbeat_back_addr":"172.21.15.111:6803/48862","heartbeat_front_addr":"172.21.15.111:6802/48862","state":["exists","up"]},{"osd":1,"uuid":"93d54815-f215-4285-bba6-32f2d1cabf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":29,"up_thru":31,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6804","nonce":48960}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6805","nonce":48960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6807","nonce":48960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6806","nonce":48960}]},"public_addr":"172.21.15.111:6804/48960","cluster_addr":"172.21.15.111:6805/48960","heartbeat_back_addr":"172.21.15.111:6807/48960","heartbeat_front_addr":"172.21.15.111:6806/48960","state":["exists","up"]},{"osd":2,"uuid":"b26b2104-2a2e-408f-9ce7-3587a32a2ebe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":31,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6808","nonce":49070}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6809","nonce":49070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6811","nonce":49070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6810","nonce":49070}]},"public_addr":"172.21.15.111:6808/49070","cluster_addr":"172.21.15.111:6809/49070","heartbeat_back_addr":"172.21.15.111:6811/49070","heartbeat_front_addr":"172.21.15.111:6810/49070","state":["exists","up"]},{"osd":3,"uuid":"43c25820-1edc-4031-badf-72e87dd6bf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":31,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6812","nonce":49243}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6813","nonce":49243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6815","nonce":49243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6814","nonce":49243}]},"public_addr":"172.21.15.111:6812/49243","cluster_addr":"172.21.15.111:6813/49243","heartbeat_back_addr":"172.21.15.111:6815/49243","heartbeat_front_addr":"172.21.15.111:6814/49243","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.372427+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.411480+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.361508+0000","dead_epoch":25},{"osd":3,"down_stamp":"2024-04-25T02:23:06.771296+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.377212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.111:0/2148931273":"2024-04-26T02:22:54.713254+0000","172.21.15.111:6816/39585":"2024-04-26T02:22:54.713254+0000","172.21.15.111:0/3911588907":"2024-04-26T02:22:54.713254+0000","172.21.15.111:0/1276843622":"2024-04-26T02:22:54.713254+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:23:16.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.389+0000 7f238f8b1700 1 -- 172.21.15.111:0/2690779531 >> v1:172.21.15.111:6816/46482 conn(0x7f236c046010 legacy=0x7f236c0484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:16.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.389+0000 7f238f8b1700 1 -- 172.21.15.111:0/2690779531 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f23880a2600 msgr2=0x7f23880a7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:16.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.389+0000 7f238f8b1700 1 --2- 172.21.15.111:0/2690779531 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f23880a2600 0x7f23880a7c20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f238400c7c0 tx=0x7f2384007e00 comp rx=0 tx=0).stop 2024-04-25T02:23:16.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.389+0000 7f238f8b1700 1 -- 172.21.15.111:0/2690779531 shutdown_connections 2024-04-25T02:23:16.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.389+0000 7f238f8b1700 1 --2- 172.21.15.111:0/2690779531 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2388143b70 0x7f2388137a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:16.394 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.389+0000 7f238f8b1700 1 --2- 172.21.15.111:0/2690779531 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f23880a2600 0x7f23880a7c20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:16.394 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.389+0000 7f238f8b1700 1 --2- 172.21.15.111:0/2690779531 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f23880a31c0 0x7f23881374e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:16.394 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.389+0000 7f238f8b1700 1 -- 172.21.15.111:0/2690779531 >> 172.21.15.111:0/2690779531 conn(0x7f238806d200 msgr2=0x7f238806dab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:16.394 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.389+0000 7f238f8b1700 1 -- 172.21.15.111:0/2690779531 shutdown_connections 2024-04-25T02:23:16.394 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.389+0000 7f238f8b1700 1 -- 172.21.15.111:0/2690779531 wait complete. 2024-04-25T02:23:16.405 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-25T02:23:16.405 INFO:teuthology.run_tasks:Running task exec... 2024-04-25T02:23:16.417 INFO:teuthology.task.exec:Executing custom commands... 2024-04-25T02:23:16.418 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi111.front.sepia.ceph.com 2024-04-25T02:23:16.418 DEBUG:teuthology.orchestra.run.smithi111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph versions' 2024-04-25T02:23:16.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.527+0000 7f74bddc0700 1 Processor -- start 2024-04-25T02:23:16.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.527+0000 7f74bddc0700 1 -- start start 2024-04-25T02:23:16.533 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.527+0000 7f74bddc0700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f74b80ad320 0x7f74b80ad750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:16.533 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.527+0000 7f74bddc0700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f74b813b6e0 0x7f74b813bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:16.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.527+0000 7f74bddc0700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74b8071540 con 0x7f74b8071170 2024-04-25T02:23:16.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.527+0000 7f74bddc0700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b80abce0 con 0x7f74b813b6e0 2024-04-25T02:23:16.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.527+0000 7f74bddc0700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f74b80ace20 con 0x7f74b80ad320 2024-04-25T02:23:16.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.528+0000 7f74b7fff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f74b813b6e0 0x7f74b813bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:16.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.528+0000 7f74b6ffd700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f74b80ad320 0x7f74b80ad750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:16.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.528+0000 7f74b7fff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f74b813b6e0 0x7f74b813bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:57430/0 (socket says 172.21.15.111:57430) 2024-04-25T02:23:16.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.528+0000 7f74b7fff700 1 -- 172.21.15.111:0/3848948399 learned_addr learned my addr 172.21.15.111:0/3848948399 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:16.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.528+0000 7f74b77fe700 1 --1- 172.21.15.111:0/3848948399 >> v1:172.21.15.111:6789/0 conn(0x7f74b8071170 0x7f74b806eb50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:43882/0 (socket says 172.21.15.111:43882) 2024-04-25T02:23:16.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.528+0000 7f74b6ffd700 1 -- 172.21.15.111:0/3848948399 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f74b813b6e0 msgr2=0x7f74b813bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:16.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.528+0000 7f74b67fc700 1 -- 172.21.15.111:0/3848948399 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2075977393 0 0) 0x7f74b8071540 con 0x7f74b8071170 2024-04-25T02:23:16.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.528+0000 7f74b6ffd700 1 --2- 172.21.15.111:0/3848948399 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f74b813b6e0 0x7f74b813bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:16.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.528+0000 7f74b6ffd700 1 -- 172.21.15.111:0/3848948399 >> v1:172.21.15.111:6789/0 conn(0x7f74b8071170 legacy=0x7f74b806eb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:16.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.528+0000 7f74b6ffd700 1 -- 172.21.15.111:0/3848948399 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b80abf40 con 0x7f74b80ad320 2024-04-25T02:23:16.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.528+0000 7f74b7fff700 1 --2- 172.21.15.111:0/3848948399 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f74b813b6e0 0x7f74b813bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:16.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.528+0000 7f74b6ffd700 1 --2- 172.21.15.111:0/3848948399 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f74b80ad320 0x7f74b80ad750 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f74ac009910 tx=0x7f74ac0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=df48294877ff7dfa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:16.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.528+0000 7f74b67fc700 1 -- 172.21.15.111:0/3848948399 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac00b680 con 0x7f74b80ad320 2024-04-25T02:23:16.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.528+0000 7f74b67fc700 1 -- 172.21.15.111:0/3848948399 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74ac00b7e0 con 0x7f74b80ad320 2024-04-25T02:23:16.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.528+0000 7f74b67fc700 1 -- 172.21.15.111:0/3848948399 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ac00bba0 con 0x7f74b80ad320 2024-04-25T02:23:16.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.529+0000 7f74bddc0700 1 -- 172.21.15.111:0/3848948399 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f74b80ad320 msgr2=0x7f74b80ad750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:16.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.529+0000 7f74bddc0700 1 --2- 172.21.15.111:0/3848948399 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f74b80ad320 0x7f74b80ad750 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f74ac009910 tx=0x7f74ac0091a0 comp rx=0 tx=0).stop 2024-04-25T02:23:16.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.529+0000 7f74bddc0700 1 -- 172.21.15.111:0/3848948399 shutdown_connections 2024-04-25T02:23:16.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.529+0000 7f74bddc0700 1 --2- 172.21.15.111:0/3848948399 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f74b813b6e0 0x7f74b813bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:16.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.529+0000 7f74bddc0700 1 --2- 172.21.15.111:0/3848948399 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f74b80ad320 0x7f74b80ad750 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:16.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.529+0000 7f74bddc0700 1 -- 172.21.15.111:0/3848948399 >> 172.21.15.111:0/3848948399 conn(0x7f74b80699d0 msgr2=0x7f74b8069da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:16.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.529+0000 7f74bddc0700 1 -- 172.21.15.111:0/3848948399 shutdown_connections 2024-04-25T02:23:16.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.529+0000 7f74bddc0700 1 -- 172.21.15.111:0/3848948399 wait complete. 2024-04-25T02:23:16.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.530+0000 7f74bddc0700 1 Processor -- start 2024-04-25T02:23:16.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.530+0000 7f74bddc0700 1 -- start start 2024-04-25T02:23:16.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.530+0000 7f74bddc0700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f74b8071170 0x7f74b81476c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:16.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.530+0000 7f74bddc0700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f74b80ad320 0x7f74b8144cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:16.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.530+0000 7f74bddc0700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f74b813b6e0 0x7f74b813a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:16.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.530+0000 7f74bddc0700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74b8146ad0 con 0x7f74b80ad320 2024-04-25T02:23:16.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.530+0000 7f74bddc0700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74b81452e0 con 0x7f74b8071170 2024-04-25T02:23:16.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.530+0000 7f74bddc0700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f74b8145bd0 con 0x7f74b813b6e0 2024-04-25T02:23:16.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.530+0000 7f74b77fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f74b8071170 0x7f74b81476c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:16.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.530+0000 7f74b6ffd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f74b80ad320 0x7f74b8144cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:16.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.530+0000 7f74b77fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f74b8071170 0x7f74b81476c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:57438/0 (socket says 172.21.15.111:57438) 2024-04-25T02:23:16.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.530+0000 7f74b6ffd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f74b80ad320 0x7f74b8144cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:35350/0 (socket says 172.21.15.111:35350) 2024-04-25T02:23:16.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.531+0000 7f74b77fe700 1 -- 172.21.15.111:0/1871824799 learned_addr learned my addr 172.21.15.111:0/1871824799 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:16.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.530+0000 7f74b7fff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f74b813b6e0 0x7f74b813a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:16.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.531+0000 7f74b77fe700 1 -- 172.21.15.111:0/1871824799 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f74b813b6e0 msgr2=0x7f74b813a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:16.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.531+0000 7f74b77fe700 1 --2- 172.21.15.111:0/1871824799 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f74b813b6e0 0x7f74b813a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:16.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.531+0000 7f74b77fe700 1 -- 172.21.15.111:0/1871824799 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f74b80ad320 msgr2=0x7f74b8144cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:16.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.531+0000 7f74b77fe700 1 --2- 172.21.15.111:0/1871824799 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f74b80ad320 0x7f74b8144cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:16.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.531+0000 7f74b77fe700 1 -- 172.21.15.111:0/1871824799 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74b0009ae0 con 0x7f74b8071170 2024-04-25T02:23:16.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.531+0000 7f74b7fff700 1 --2- 172.21.15.111:0/1871824799 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f74b813b6e0 0x7f74b813a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:16.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.531+0000 7f74b77fe700 1 --2- 172.21.15.111:0/1871824799 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f74b8071170 0x7f74b81476c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f74a800c810 tx=0x7f74a8007d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:16.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.531+0000 7f749f7fe700 1 -- 172.21.15.111:0/1871824799 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a8005b40 con 0x7f74b8071170 2024-04-25T02:23:16.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.531+0000 7f749f7fe700 1 -- 172.21.15.111:0/1871824799 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74a8005ca0 con 0x7f74b8071170 2024-04-25T02:23:16.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.531+0000 7f74bddc0700 1 -- 172.21.15.111:0/1871824799 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74ac009420 con 0x7f74b8071170 2024-04-25T02:23:16.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.531+0000 7f749f7fe700 1 -- 172.21.15.111:0/1871824799 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74a8007320 con 0x7f74b8071170 2024-04-25T02:23:16.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.531+0000 7f74bddc0700 1 -- 172.21.15.111:0/1871824799 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74b8141c80 con 0x7f74b8071170 2024-04-25T02:23:16.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.532+0000 7f74bddc0700 1 -- 172.21.15.111:0/1871824799 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74b8072200 con 0x7f74b8071170 2024-04-25T02:23:16.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.533+0000 7f749f7fe700 1 -- 172.21.15.111:0/1871824799 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f74a801b3b0 con 0x7f74b8071170 2024-04-25T02:23:16.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.533+0000 7f749f7fe700 1 -- 172.21.15.111:0/1871824799 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 3840+0+0 (secure 0 0 0) 0x7f74a805aa20 con 0x7f74b8071170 2024-04-25T02:23:16.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.536+0000 7f749f7fe700 1 -- 172.21.15.111:0/1871824799 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f74a8038c90 con 0x7f74b8071170 2024-04-25T02:23:16.751 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.747+0000 7f74bddc0700 1 -- 172.21.15.111:0/1871824799 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f74b8145630 con 0x7f74b8071170 2024-04-25T02:23:16.751 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.748+0000 7f749f7fe700 1 -- 172.21.15.111:0/1871824799 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+720 (secure 0 0 0) 0x7f74a8017070 con 0x7f74b8071170 2024-04-25T02:23:16.751 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-25T02:23:16.752 INFO:teuthology.orchestra.run.smithi111.stdout: "mon": { 2024-04-25T02:23:16.752 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 3 2024-04-25T02:23:16.752 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:23:16.752 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr": { 2024-04-25T02:23:16.752 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 2 2024-04-25T02:23:16.752 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:23:16.752 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": { 2024-04-25T02:23:16.752 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 4 2024-04-25T02:23:16.752 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:23:16.752 INFO:teuthology.orchestra.run.smithi111.stdout: "mds": { 2024-04-25T02:23:16.752 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 15.2.17 (8a82819d84cf884bd39c17e3236e0632ac146dc4) octopus (stable)": 3 2024-04-25T02:23:16.752 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:23:16.752 INFO:teuthology.orchestra.run.smithi111.stdout: "overall": { 2024-04-25T02:23:16.753 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 15.2.17 (8a82819d84cf884bd39c17e3236e0632ac146dc4) octopus (stable)": 3, 2024-04-25T02:23:16.753 INFO:teuthology.orchestra.run.smithi111.stdout: "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)": 9 2024-04-25T02:23:16.753 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-25T02:23:16.753 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-25T02:23:16.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.749+0000 7f74bddc0700 1 -- 172.21.15.111:0/1871824799 >> v1:172.21.15.111:6816/46482 conn(0x7f74a4046010 legacy=0x7f74a40484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:16.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.749+0000 7f74bddc0700 1 -- 172.21.15.111:0/1871824799 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f74b8071170 msgr2=0x7f74b81476c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:16.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.749+0000 7f74bddc0700 1 --2- 172.21.15.111:0/1871824799 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f74b8071170 0x7f74b81476c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f74a800c810 tx=0x7f74a8007d90 comp rx=0 tx=0).stop 2024-04-25T02:23:16.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.749+0000 7f74bddc0700 1 -- 172.21.15.111:0/1871824799 shutdown_connections 2024-04-25T02:23:16.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.749+0000 7f74bddc0700 1 --2- 172.21.15.111:0/1871824799 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f74b813b6e0 0x7f74b813a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:16.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.749+0000 7f74bddc0700 1 --2- 172.21.15.111:0/1871824799 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f74b8071170 0x7f74b81476c0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:16.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.749+0000 7f74bddc0700 1 --2- 172.21.15.111:0/1871824799 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f74b80ad320 0x7f74b8144cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:16.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.749+0000 7f74bddc0700 1 -- 172.21.15.111:0/1871824799 >> 172.21.15.111:0/1871824799 conn(0x7f74b80699d0 msgr2=0x7f74b8148700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:16.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.749+0000 7f74bddc0700 1 -- 172.21.15.111:0/1871824799 shutdown_connections 2024-04-25T02:23:16.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.750+0000 7f74bddc0700 1 -- 172.21.15.111:0/1871824799 wait complete. 2024-04-25T02:23:16.765 DEBUG:teuthology.orchestra.run.smithi111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd dump -f json-pretty' 2024-04-25T02:23:16.842 INFO:tasks.ceph.mon.a.smithi111.stderr:2024-04-25T02:23:16.838+0000 7f4545fbe700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-04-25T02:23:16.891 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.888+0000 7f22d44f8700 1 Processor -- start 2024-04-25T02:23:16.892 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.888+0000 7f22d44f8700 1 -- start start 2024-04-25T02:23:16.894 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.888+0000 7f22d44f8700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f22cc06da60 0x7f22cc1464c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:16.894 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.888+0000 7f22d44f8700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f22cc146a00 0x7f22cc148de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:16.894 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.888+0000 7f22d44f8700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22cc06cd90 con 0x7f22cc0682e0 2024-04-25T02:23:16.895 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.888+0000 7f22d44f8700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22cc0a25e0 con 0x7f22cc06da60 2024-04-25T02:23:16.895 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.888+0000 7f22d44f8700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc06e450 con 0x7f22cc146a00 2024-04-25T02:23:16.895 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.889+0000 7f22d1a93700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f22cc06da60 0x7f22cc1464c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:16.895 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.889+0000 7f22d2a95700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f22cc146a00 0x7f22cc148de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:16.895 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.889+0000 7f22d2294700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f22cc0682e0 0x7f22cc0a3d00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:43892/0 (socket says 172.21.15.111:43892) 2024-04-25T02:23:16.895 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.889+0000 7f22d2294700 1 -- 172.21.15.111:0/2931450969 learned_addr learned my addr 172.21.15.111:0/2931450969 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:23:16.895 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.889+0000 7f22d2a95700 1 -- 172.21.15.111:0/2931450969 >> v2:172.21.15.111:3300/0 conn(0x7f22cc06da60 msgr2=0x7f22cc1464c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:16.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.889+0000 7f22d2a95700 1 --2- 172.21.15.111:0/2931450969 >> v2:172.21.15.111:3300/0 conn(0x7f22cc06da60 0x7f22cc1464c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:16.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.889+0000 7f22d2a95700 1 -- 172.21.15.111:0/2931450969 >> v1:172.21.15.111:6789/0 conn(0x7f22cc0682e0 legacy=0x7f22cc0a3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:16.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.889+0000 7f22d2a95700 1 -- 172.21.15.111:0/2931450969 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22cc0a4410 con 0x7f22cc146a00 2024-04-25T02:23:16.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.889+0000 7f22d1a93700 1 --2- 172.21.15.111:0/2931450969 >> v2:172.21.15.111:3300/0 conn(0x7f22cc06da60 0x7f22cc1464c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:16.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.889+0000 7f22d2a95700 1 --2- 172.21.15.111:0/2931450969 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f22cc146a00 0x7f22cc148de0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f22c4009e60 tx=0x7f22c4009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=bedad4d1262b8a05 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:16.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.889+0000 7f22d1292700 1 -- 172.21.15.111:0/2931450969 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c400e070 con 0x7f22cc146a00 2024-04-25T02:23:16.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.889+0000 7f22d1292700 1 -- 172.21.15.111:0/2931450969 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c400bb60 con 0x7f22cc146a00 2024-04-25T02:23:16.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.889+0000 7f22d1292700 1 -- 172.21.15.111:0/2931450969 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c4012430 con 0x7f22cc146a00 2024-04-25T02:23:16.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.890+0000 7f22d44f8700 1 -- 172.21.15.111:0/2931450969 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f22cc146a00 msgr2=0x7f22cc148de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:16.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.890+0000 7f22d44f8700 1 --2- 172.21.15.111:0/2931450969 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f22cc146a00 0x7f22cc148de0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f22c4009e60 tx=0x7f22c4009780 comp rx=0 tx=0).stop 2024-04-25T02:23:16.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.890+0000 7f22d44f8700 1 -- 172.21.15.111:0/2931450969 shutdown_connections 2024-04-25T02:23:16.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.890+0000 7f22d44f8700 1 --2- 172.21.15.111:0/2931450969 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f22cc146a00 0x7f22cc148de0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:16.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.890+0000 7f22d44f8700 1 --2- 172.21.15.111:0/2931450969 >> v2:172.21.15.111:3300/0 conn(0x7f22cc06da60 0x7f22cc1464c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:16.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.890+0000 7f22d44f8700 1 -- 172.21.15.111:0/2931450969 >> 172.21.15.111:0/2931450969 conn(0x7f22cc069ce0 msgr2=0x7f22cc067980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:16.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.890+0000 7f22d44f8700 1 -- 172.21.15.111:0/2931450969 shutdown_connections 2024-04-25T02:23:16.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.890+0000 7f22d44f8700 1 -- 172.21.15.111:0/2931450969 wait complete. 2024-04-25T02:23:16.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.891+0000 7f22d44f8700 1 Processor -- start 2024-04-25T02:23:16.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.891+0000 7f22d44f8700 1 -- start start 2024-04-25T02:23:16.900 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.891+0000 7f22d44f8700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f22cc0682e0 0x7f22cc0adca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:16.900 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.891+0000 7f22d44f8700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f22cc06da60 0x7f22cc1408e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:16.900 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.891+0000 7f22d44f8700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f22cc146a00 0x7f22cc140e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:16.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.891+0000 7f22d44f8700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc098240 con 0x7f22cc0682e0 2024-04-25T02:23:16.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.891+0000 7f22d44f8700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc098a40 con 0x7f22cc06da60 2024-04-25T02:23:16.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.891+0000 7f22d44f8700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f22cc0ae670 con 0x7f22cc146a00 2024-04-25T02:23:16.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.891+0000 7f22d2294700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f22cc0682e0 0x7f22cc0adca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:16.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.891+0000 7f22d2294700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f22cc0682e0 0x7f22cc0adca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:35362/0 (socket says 172.21.15.111:35362) 2024-04-25T02:23:16.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.891+0000 7f22d2294700 1 -- 172.21.15.111:0/3475764173 learned_addr learned my addr 172.21.15.111:0/3475764173 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:16.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.891+0000 7f22d1a93700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f22cc06da60 0x7f22cc1408e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:16.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.891+0000 7f22d2a95700 1 --2- 172.21.15.111:0/3475764173 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f22cc146a00 0x7f22cc140e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:16.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.892+0000 7f22d2294700 1 -- 172.21.15.111:0/3475764173 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f22cc146a00 msgr2=0x7f22cc140e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:16.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.892+0000 7f22d2294700 1 --2- 172.21.15.111:0/3475764173 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f22cc146a00 0x7f22cc140e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:16.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.892+0000 7f22d2294700 1 -- 172.21.15.111:0/3475764173 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f22cc06da60 msgr2=0x7f22cc1408e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:16.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.892+0000 7f22d2294700 1 --2- 172.21.15.111:0/3475764173 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f22cc06da60 0x7f22cc1408e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:16.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.892+0000 7f22d2294700 1 -- 172.21.15.111:0/3475764173 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22bc009420 con 0x7f22cc0682e0 2024-04-25T02:23:16.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.892+0000 7f22d1a93700 1 --2- 172.21.15.111:0/3475764173 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f22cc06da60 0x7f22cc1408e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:16.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.892+0000 7f22d2a95700 1 --2- 172.21.15.111:0/3475764173 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f22cc146a00 0x7f22cc140e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:16.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.892+0000 7f22d2294700 1 --2- 172.21.15.111:0/3475764173 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f22cc0682e0 0x7f22cc0adca0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f22c800c560 tx=0x7f22c8001020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:16.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.892+0000 7f22c27fc700 1 -- 172.21.15.111:0/3475764173 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c8005b30 con 0x7f22cc0682e0 2024-04-25T02:23:16.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.892+0000 7f22c27fc700 1 -- 172.21.15.111:0/3475764173 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c8005c90 con 0x7f22cc0682e0 2024-04-25T02:23:16.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.892+0000 7f22d44f8700 1 -- 172.21.15.111:0/3475764173 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22c4009a20 con 0x7f22cc0682e0 2024-04-25T02:23:16.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.892+0000 7f22c27fc700 1 -- 172.21.15.111:0/3475764173 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c8007320 con 0x7f22cc0682e0 2024-04-25T02:23:16.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.892+0000 7f22d44f8700 1 -- 172.21.15.111:0/3475764173 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22cc098760 con 0x7f22cc0682e0 2024-04-25T02:23:16.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.893+0000 7f22c27fc700 1 -- 172.21.15.111:0/3475764173 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f22c801b3b0 con 0x7f22cc0682e0 2024-04-25T02:23:16.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.893+0000 7f22d44f8700 1 -- 172.21.15.111:0/3475764173 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f22cc0a16f0 con 0x7f22cc0682e0 2024-04-25T02:23:16.903 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.893+0000 7f22c27fc700 1 -- 172.21.15.111:0/3475764173 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f22c805a5a0 con 0x7f22cc0682e0 2024-04-25T02:23:16.903 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:16.897+0000 7f22c27fc700 1 -- 172.21.15.111:0/3475764173 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f22c8038760 con 0x7f22cc0682e0 2024-04-25T02:23:17.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.052+0000 7f22d44f8700 1 -- 172.21.15.111:0/3475764173 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f22cc072200 con 0x7f22cc0682e0 2024-04-25T02:23:17.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.053+0000 7f22c27fc700 1 -- 172.21.15.111:0/3475764173 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v35) v1 ==== 81+0+21191 (secure 0 0 0) 0x7f22c8017070 con 0x7f22cc0682e0 2024-04-25T02:23:17.057 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:23:17.057 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-25T02:23:17.058 INFO:teuthology.orchestra.run.smithi111.stdout: "epoch": 35, 2024-04-25T02:23:17.058 INFO:teuthology.orchestra.run.smithi111.stdout: "fsid": "4643f974-f93a-4436-93b8-460ff320e62e", 2024-04-25T02:23:17.058 INFO:teuthology.orchestra.run.smithi111.stdout: "created": "2024-04-25T02:20:05.450475+0000", 2024-04-25T02:23:17.058 INFO:teuthology.orchestra.run.smithi111.stdout: "modified": "2024-04-25T02:23:16.845047+0000", 2024-04-25T02:23:17.058 INFO:teuthology.orchestra.run.smithi111.stdout: "last_up_change": "2024-04-25T02:23:12.818028+0000", 2024-04-25T02:23:17.058 INFO:teuthology.orchestra.run.smithi111.stdout: "last_in_change": "2024-04-25T02:20:10.439204+0000", 2024-04-25T02:23:17.058 INFO:teuthology.orchestra.run.smithi111.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-25T02:23:17.058 INFO:teuthology.orchestra.run.smithi111.stdout: "flags_num": 5799936, 2024-04-25T02:23:17.058 INFO:teuthology.orchestra.run.smithi111.stdout: "flags_set": [ 2024-04-25T02:23:17.058 INFO:teuthology.orchestra.run.smithi111.stdout: "pglog_hardlimit", 2024-04-25T02:23:17.058 INFO:teuthology.orchestra.run.smithi111.stdout: "purged_snapdirs", 2024-04-25T02:23:17.059 INFO:teuthology.orchestra.run.smithi111.stdout: "recovery_deletes", 2024-04-25T02:23:17.059 INFO:teuthology.orchestra.run.smithi111.stdout: "sortbitwise" 2024-04-25T02:23:17.059 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-04-25T02:23:17.059 INFO:teuthology.orchestra.run.smithi111.stdout: "crush_version": 8, 2024-04-25T02:23:17.059 INFO:teuthology.orchestra.run.smithi111.stdout: "full_ratio": 0.94999998807907104, 2024-04-25T02:23:17.059 INFO:teuthology.orchestra.run.smithi111.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-25T02:23:17.059 INFO:teuthology.orchestra.run.smithi111.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-25T02:23:17.059 INFO:teuthology.orchestra.run.smithi111.stdout: "cluster_snapshot": "", 2024-04-25T02:23:17.059 INFO:teuthology.orchestra.run.smithi111.stdout: "pool_max": 4, 2024-04-25T02:23:17.059 INFO:teuthology.orchestra.run.smithi111.stdout: "max_osd": 4, 2024-04-25T02:23:17.059 INFO:teuthology.orchestra.run.smithi111.stdout: "require_min_compat_client": "octopus", 2024-04-25T02:23:17.060 INFO:teuthology.orchestra.run.smithi111.stdout: "min_compat_client": "jewel", 2024-04-25T02:23:17.060 INFO:teuthology.orchestra.run.smithi111.stdout: "require_osd_release": "octopus", 2024-04-25T02:23:17.060 INFO:teuthology.orchestra.run.smithi111.stdout: "pools": [ 2024-04-25T02:23:17.060 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-25T02:23:17.060 INFO:teuthology.orchestra.run.smithi111.stdout: "pool": 1, 2024-04-25T02:23:17.060 INFO:teuthology.orchestra.run.smithi111.stdout: "pool_name": ".mgr", 2024-04-25T02:23:17.060 INFO:teuthology.orchestra.run.smithi111.stdout: "create_time": "2024-04-25T02:20:07.471248+0000", 2024-04-25T02:23:17.060 INFO:teuthology.orchestra.run.smithi111.stdout: "flags": 1, 2024-04-25T02:23:17.060 INFO:teuthology.orchestra.run.smithi111.stdout: "flags_names": "hashpspool", 2024-04-25T02:23:17.060 INFO:teuthology.orchestra.run.smithi111.stdout: "type": 1, 2024-04-25T02:23:17.060 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 2, 2024-04-25T02:23:17.060 INFO:teuthology.orchestra.run.smithi111.stdout: "min_size": 1, 2024-04-25T02:23:17.060 INFO:teuthology.orchestra.run.smithi111.stdout: "crush_rule": 0, 2024-04-25T02:23:17.060 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_count": 0, 2024-04-25T02:23:17.061 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_target": 0, 2024-04-25T02:23:17.061 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_barrier": 0, 2024-04-25T02:23:17.061 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-25T02:23:17.061 INFO:teuthology.orchestra.run.smithi111.stdout: "object_hash": 2, 2024-04-25T02:23:17.061 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_autoscale_mode": "off", 2024-04-25T02:23:17.061 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num": 1, 2024-04-25T02:23:17.061 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_placement_num": 1, 2024-04-25T02:23:17.061 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_placement_num_target": 1, 2024-04-25T02:23:17.061 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num_target": 1, 2024-04-25T02:23:17.061 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num_pending": 1, 2024-04-25T02:23:17.061 INFO:teuthology.orchestra.run.smithi111.stdout: "last_pg_merge_meta": { 2024-04-25T02:23:17.061 INFO:teuthology.orchestra.run.smithi111.stdout: "source_pgid": "0.0", 2024-04-25T02:23:17.061 INFO:teuthology.orchestra.run.smithi111.stdout: "ready_epoch": 0, 2024-04-25T02:23:17.061 INFO:teuthology.orchestra.run.smithi111.stdout: "last_epoch_started": 0, 2024-04-25T02:23:17.062 INFO:teuthology.orchestra.run.smithi111.stdout: "last_epoch_clean": 0, 2024-04-25T02:23:17.062 INFO:teuthology.orchestra.run.smithi111.stdout: "source_version": "0'0", 2024-04-25T02:23:17.062 INFO:teuthology.orchestra.run.smithi111.stdout: "target_version": "0'0" 2024-04-25T02:23:17.062 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:23:17.062 INFO:teuthology.orchestra.run.smithi111.stdout: "last_change": "22", 2024-04-25T02:23:17.062 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend": "0", 2024-04-25T02:23:17.062 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-25T02:23:17.062 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend_preluminous": "0", 2024-04-25T02:23:17.062 INFO:teuthology.orchestra.run.smithi111.stdout: "auid": 0, 2024-04-25T02:23:17.062 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_mode": "selfmanaged", 2024-04-25T02:23:17.062 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_seq": 0, 2024-04-25T02:23:17.062 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_epoch": 0, 2024-04-25T02:23:17.062 INFO:teuthology.orchestra.run.smithi111.stdout: "pool_snaps": [], 2024-04-25T02:23:17.063 INFO:teuthology.orchestra.run.smithi111.stdout: "removed_snaps": "[]", 2024-04-25T02:23:17.063 INFO:teuthology.orchestra.run.smithi111.stdout: "quota_max_bytes": 0, 2024-04-25T02:23:17.063 INFO:teuthology.orchestra.run.smithi111.stdout: "quota_max_objects": 0, 2024-04-25T02:23:17.063 INFO:teuthology.orchestra.run.smithi111.stdout: "tiers": [], 2024-04-25T02:23:17.063 INFO:teuthology.orchestra.run.smithi111.stdout: "tier_of": -1, 2024-04-25T02:23:17.063 INFO:teuthology.orchestra.run.smithi111.stdout: "read_tier": -1, 2024-04-25T02:23:17.063 INFO:teuthology.orchestra.run.smithi111.stdout: "write_tier": -1, 2024-04-25T02:23:17.063 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_mode": "none", 2024-04-25T02:23:17.063 INFO:teuthology.orchestra.run.smithi111.stdout: "target_max_bytes": 0, 2024-04-25T02:23:17.063 INFO:teuthology.orchestra.run.smithi111.stdout: "target_max_objects": 0, 2024-04-25T02:23:17.063 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-25T02:23:17.063 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-25T02:23:17.063 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-25T02:23:17.063 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_min_flush_age": 0, 2024-04-25T02:23:17.064 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_min_evict_age": 0, 2024-04-25T02:23:17.064 INFO:teuthology.orchestra.run.smithi111.stdout: "erasure_code_profile": "", 2024-04-25T02:23:17.064 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_params": { 2024-04-25T02:23:17.064 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "none" 2024-04-25T02:23:17.064 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:23:17.064 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_period": 0, 2024-04-25T02:23:17.064 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_count": 0, 2024-04-25T02:23:17.064 INFO:teuthology.orchestra.run.smithi111.stdout: "use_gmt_hitset": true, 2024-04-25T02:23:17.064 INFO:teuthology.orchestra.run.smithi111.stdout: "min_read_recency_for_promote": 0, 2024-04-25T02:23:17.064 INFO:teuthology.orchestra.run.smithi111.stdout: "min_write_recency_for_promote": 0, 2024-04-25T02:23:17.064 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_grade_decay_rate": 0, 2024-04-25T02:23:17.064 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_search_last_n": 0, 2024-04-25T02:23:17.064 INFO:teuthology.orchestra.run.smithi111.stdout: "grade_table": [], 2024-04-25T02:23:17.064 INFO:teuthology.orchestra.run.smithi111.stdout: "stripe_width": 0, 2024-04-25T02:23:17.064 INFO:teuthology.orchestra.run.smithi111.stdout: "expected_num_objects": 0, 2024-04-25T02:23:17.065 INFO:teuthology.orchestra.run.smithi111.stdout: "fast_read": false, 2024-04-25T02:23:17.065 INFO:teuthology.orchestra.run.smithi111.stdout: "options": { 2024-04-25T02:23:17.065 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num_min": 1 2024-04-25T02:23:17.065 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:23:17.065 INFO:teuthology.orchestra.run.smithi111.stdout: "application_metadata": { 2024-04-25T02:23:17.065 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr": {}, 2024-04-25T02:23:17.065 INFO:teuthology.orchestra.run.smithi111.stdout: "mgr_devicehealth": {} 2024-04-25T02:23:17.065 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-25T02:23:17.065 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:23:17.065 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-25T02:23:17.065 INFO:teuthology.orchestra.run.smithi111.stdout: "pool": 2, 2024-04-25T02:23:17.065 INFO:teuthology.orchestra.run.smithi111.stdout: "pool_name": "rbd", 2024-04-25T02:23:17.065 INFO:teuthology.orchestra.run.smithi111.stdout: "create_time": "2024-04-25T02:20:14.420378+0000", 2024-04-25T02:23:17.065 INFO:teuthology.orchestra.run.smithi111.stdout: "flags": 1, 2024-04-25T02:23:17.065 INFO:teuthology.orchestra.run.smithi111.stdout: "flags_names": "hashpspool", 2024-04-25T02:23:17.066 INFO:teuthology.orchestra.run.smithi111.stdout: "type": 1, 2024-04-25T02:23:17.066 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 2, 2024-04-25T02:23:17.066 INFO:teuthology.orchestra.run.smithi111.stdout: "min_size": 1, 2024-04-25T02:23:17.066 INFO:teuthology.orchestra.run.smithi111.stdout: "crush_rule": 0, 2024-04-25T02:23:17.066 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_count": 0, 2024-04-25T02:23:17.066 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_target": 0, 2024-04-25T02:23:17.066 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_barrier": 0, 2024-04-25T02:23:17.066 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-25T02:23:17.066 INFO:teuthology.orchestra.run.smithi111.stdout: "object_hash": 2, 2024-04-25T02:23:17.066 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_autoscale_mode": "off", 2024-04-25T02:23:17.066 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num": 8, 2024-04-25T02:23:17.066 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_placement_num": 8, 2024-04-25T02:23:17.066 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_placement_num_target": 8, 2024-04-25T02:23:17.067 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num_target": 8, 2024-04-25T02:23:17.067 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num_pending": 8, 2024-04-25T02:23:17.067 INFO:teuthology.orchestra.run.smithi111.stdout: "last_pg_merge_meta": { 2024-04-25T02:23:17.067 INFO:teuthology.orchestra.run.smithi111.stdout: "source_pgid": "0.0", 2024-04-25T02:23:17.067 INFO:teuthology.orchestra.run.smithi111.stdout: "ready_epoch": 0, 2024-04-25T02:23:17.067 INFO:teuthology.orchestra.run.smithi111.stdout: "last_epoch_started": 0, 2024-04-25T02:23:17.067 INFO:teuthology.orchestra.run.smithi111.stdout: "last_epoch_clean": 0, 2024-04-25T02:23:17.067 INFO:teuthology.orchestra.run.smithi111.stdout: "source_version": "0'0", 2024-04-25T02:23:17.067 INFO:teuthology.orchestra.run.smithi111.stdout: "target_version": "0'0" 2024-04-25T02:23:17.067 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:23:17.067 INFO:teuthology.orchestra.run.smithi111.stdout: "last_change": "14", 2024-04-25T02:23:17.067 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend": "0", 2024-04-25T02:23:17.067 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-25T02:23:17.067 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend_preluminous": "0", 2024-04-25T02:23:17.068 INFO:teuthology.orchestra.run.smithi111.stdout: "auid": 0, 2024-04-25T02:23:17.068 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_mode": "selfmanaged", 2024-04-25T02:23:17.068 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_seq": 0, 2024-04-25T02:23:17.068 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_epoch": 0, 2024-04-25T02:23:17.068 INFO:teuthology.orchestra.run.smithi111.stdout: "pool_snaps": [], 2024-04-25T02:23:17.068 INFO:teuthology.orchestra.run.smithi111.stdout: "removed_snaps": "[]", 2024-04-25T02:23:17.068 INFO:teuthology.orchestra.run.smithi111.stdout: "quota_max_bytes": 0, 2024-04-25T02:23:17.068 INFO:teuthology.orchestra.run.smithi111.stdout: "quota_max_objects": 0, 2024-04-25T02:23:17.068 INFO:teuthology.orchestra.run.smithi111.stdout: "tiers": [], 2024-04-25T02:23:17.068 INFO:teuthology.orchestra.run.smithi111.stdout: "tier_of": -1, 2024-04-25T02:23:17.068 INFO:teuthology.orchestra.run.smithi111.stdout: "read_tier": -1, 2024-04-25T02:23:17.068 INFO:teuthology.orchestra.run.smithi111.stdout: "write_tier": -1, 2024-04-25T02:23:17.068 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_mode": "none", 2024-04-25T02:23:17.068 INFO:teuthology.orchestra.run.smithi111.stdout: "target_max_bytes": 0, 2024-04-25T02:23:17.068 INFO:teuthology.orchestra.run.smithi111.stdout: "target_max_objects": 0, 2024-04-25T02:23:17.069 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-25T02:23:17.069 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-25T02:23:17.069 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-25T02:23:17.069 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_min_flush_age": 0, 2024-04-25T02:23:17.069 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_min_evict_age": 0, 2024-04-25T02:23:17.069 INFO:teuthology.orchestra.run.smithi111.stdout: "erasure_code_profile": "", 2024-04-25T02:23:17.069 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_params": { 2024-04-25T02:23:17.069 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "none" 2024-04-25T02:23:17.070 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:23:17.070 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_period": 0, 2024-04-25T02:23:17.070 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_count": 0, 2024-04-25T02:23:17.070 INFO:teuthology.orchestra.run.smithi111.stdout: "use_gmt_hitset": true, 2024-04-25T02:23:17.070 INFO:teuthology.orchestra.run.smithi111.stdout: "min_read_recency_for_promote": 0, 2024-04-25T02:23:17.070 INFO:teuthology.orchestra.run.smithi111.stdout: "min_write_recency_for_promote": 0, 2024-04-25T02:23:17.071 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_grade_decay_rate": 0, 2024-04-25T02:23:17.071 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_search_last_n": 0, 2024-04-25T02:23:17.071 INFO:teuthology.orchestra.run.smithi111.stdout: "grade_table": [], 2024-04-25T02:23:17.071 INFO:teuthology.orchestra.run.smithi111.stdout: "stripe_width": 0, 2024-04-25T02:23:17.071 INFO:teuthology.orchestra.run.smithi111.stdout: "expected_num_objects": 0, 2024-04-25T02:23:17.071 INFO:teuthology.orchestra.run.smithi111.stdout: "fast_read": false, 2024-04-25T02:23:17.071 INFO:teuthology.orchestra.run.smithi111.stdout: "options": {}, 2024-04-25T02:23:17.071 INFO:teuthology.orchestra.run.smithi111.stdout: "application_metadata": { 2024-04-25T02:23:17.073 INFO:teuthology.orchestra.run.smithi111.stdout: "rbd": {} 2024-04-25T02:23:17.073 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-25T02:23:17.073 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:23:17.073 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-25T02:23:17.073 INFO:teuthology.orchestra.run.smithi111.stdout: "pool": 3, 2024-04-25T02:23:17.073 INFO:teuthology.orchestra.run.smithi111.stdout: "pool_name": "cephfs_metadata", 2024-04-25T02:23:17.073 INFO:teuthology.orchestra.run.smithi111.stdout: "create_time": "2024-04-25T02:20:22.251868+0000", 2024-04-25T02:23:17.073 INFO:teuthology.orchestra.run.smithi111.stdout: "flags": 1, 2024-04-25T02:23:17.074 INFO:teuthology.orchestra.run.smithi111.stdout: "flags_names": "hashpspool", 2024-04-25T02:23:17.074 INFO:teuthology.orchestra.run.smithi111.stdout: "type": 1, 2024-04-25T02:23:17.074 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 2, 2024-04-25T02:23:17.074 INFO:teuthology.orchestra.run.smithi111.stdout: "min_size": 1, 2024-04-25T02:23:17.074 INFO:teuthology.orchestra.run.smithi111.stdout: "crush_rule": 0, 2024-04-25T02:23:17.074 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_count": 0, 2024-04-25T02:23:17.074 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_target": 0, 2024-04-25T02:23:17.074 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_barrier": 0, 2024-04-25T02:23:17.074 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-25T02:23:17.074 INFO:teuthology.orchestra.run.smithi111.stdout: "object_hash": 2, 2024-04-25T02:23:17.074 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_autoscale_mode": "off", 2024-04-25T02:23:17.074 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num": 32, 2024-04-25T02:23:17.074 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_placement_num": 32, 2024-04-25T02:23:17.075 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_placement_num_target": 32, 2024-04-25T02:23:17.075 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num_target": 32, 2024-04-25T02:23:17.075 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num_pending": 32, 2024-04-25T02:23:17.075 INFO:teuthology.orchestra.run.smithi111.stdout: "last_pg_merge_meta": { 2024-04-25T02:23:17.075 INFO:teuthology.orchestra.run.smithi111.stdout: "source_pgid": "0.0", 2024-04-25T02:23:17.075 INFO:teuthology.orchestra.run.smithi111.stdout: "ready_epoch": 0, 2024-04-25T02:23:17.075 INFO:teuthology.orchestra.run.smithi111.stdout: "last_epoch_started": 0, 2024-04-25T02:23:17.075 INFO:teuthology.orchestra.run.smithi111.stdout: "last_epoch_clean": 0, 2024-04-25T02:23:17.075 INFO:teuthology.orchestra.run.smithi111.stdout: "source_version": "0'0", 2024-04-25T02:23:17.075 INFO:teuthology.orchestra.run.smithi111.stdout: "target_version": "0'0" 2024-04-25T02:23:17.075 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:23:17.076 INFO:teuthology.orchestra.run.smithi111.stdout: "last_change": "17", 2024-04-25T02:23:17.076 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend": "0", 2024-04-25T02:23:17.076 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-25T02:23:17.076 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend_preluminous": "0", 2024-04-25T02:23:17.076 INFO:teuthology.orchestra.run.smithi111.stdout: "auid": 0, 2024-04-25T02:23:17.076 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_mode": "selfmanaged", 2024-04-25T02:23:17.076 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_seq": 0, 2024-04-25T02:23:17.076 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_epoch": 0, 2024-04-25T02:23:17.076 INFO:teuthology.orchestra.run.smithi111.stdout: "pool_snaps": [], 2024-04-25T02:23:17.076 INFO:teuthology.orchestra.run.smithi111.stdout: "removed_snaps": "[]", 2024-04-25T02:23:17.076 INFO:teuthology.orchestra.run.smithi111.stdout: "quota_max_bytes": 0, 2024-04-25T02:23:17.076 INFO:teuthology.orchestra.run.smithi111.stdout: "quota_max_objects": 0, 2024-04-25T02:23:17.076 INFO:teuthology.orchestra.run.smithi111.stdout: "tiers": [], 2024-04-25T02:23:17.076 INFO:teuthology.orchestra.run.smithi111.stdout: "tier_of": -1, 2024-04-25T02:23:17.076 INFO:teuthology.orchestra.run.smithi111.stdout: "read_tier": -1, 2024-04-25T02:23:17.077 INFO:teuthology.orchestra.run.smithi111.stdout: "write_tier": -1, 2024-04-25T02:23:17.077 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_mode": "none", 2024-04-25T02:23:17.077 INFO:teuthology.orchestra.run.smithi111.stdout: "target_max_bytes": 0, 2024-04-25T02:23:17.077 INFO:teuthology.orchestra.run.smithi111.stdout: "target_max_objects": 0, 2024-04-25T02:23:17.077 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-25T02:23:17.077 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-25T02:23:17.077 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-25T02:23:17.077 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_min_flush_age": 0, 2024-04-25T02:23:17.077 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_min_evict_age": 0, 2024-04-25T02:23:17.077 INFO:teuthology.orchestra.run.smithi111.stdout: "erasure_code_profile": "", 2024-04-25T02:23:17.077 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_params": { 2024-04-25T02:23:17.077 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "none" 2024-04-25T02:23:17.077 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:23:17.077 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_period": 0, 2024-04-25T02:23:17.078 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_count": 0, 2024-04-25T02:23:17.078 INFO:teuthology.orchestra.run.smithi111.stdout: "use_gmt_hitset": true, 2024-04-25T02:23:17.078 INFO:teuthology.orchestra.run.smithi111.stdout: "min_read_recency_for_promote": 0, 2024-04-25T02:23:17.078 INFO:teuthology.orchestra.run.smithi111.stdout: "min_write_recency_for_promote": 0, 2024-04-25T02:23:17.078 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_grade_decay_rate": 0, 2024-04-25T02:23:17.078 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_search_last_n": 0, 2024-04-25T02:23:17.078 INFO:teuthology.orchestra.run.smithi111.stdout: "grade_table": [], 2024-04-25T02:23:17.078 INFO:teuthology.orchestra.run.smithi111.stdout: "stripe_width": 0, 2024-04-25T02:23:17.078 INFO:teuthology.orchestra.run.smithi111.stdout: "expected_num_objects": 0, 2024-04-25T02:23:17.078 INFO:teuthology.orchestra.run.smithi111.stdout: "fast_read": false, 2024-04-25T02:23:17.078 INFO:teuthology.orchestra.run.smithi111.stdout: "options": { 2024-04-25T02:23:17.078 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_autoscale_bias": 4, 2024-04-25T02:23:17.078 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num_min": 16, 2024-04-25T02:23:17.079 INFO:teuthology.orchestra.run.smithi111.stdout: "recovery_priority": 5 2024-04-25T02:23:17.079 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:23:17.079 INFO:teuthology.orchestra.run.smithi111.stdout: "application_metadata": { 2024-04-25T02:23:17.079 INFO:teuthology.orchestra.run.smithi111.stdout: "cephfs": { 2024-04-25T02:23:17.079 INFO:teuthology.orchestra.run.smithi111.stdout: "metadata": "cephfs" 2024-04-25T02:23:17.079 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-25T02:23:17.079 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-25T02:23:17.079 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:23:17.079 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-25T02:23:17.079 INFO:teuthology.orchestra.run.smithi111.stdout: "pool": 4, 2024-04-25T02:23:17.079 INFO:teuthology.orchestra.run.smithi111.stdout: "pool_name": "cephfs_data", 2024-04-25T02:23:17.079 INFO:teuthology.orchestra.run.smithi111.stdout: "create_time": "2024-04-25T02:20:23.128289+0000", 2024-04-25T02:23:17.079 INFO:teuthology.orchestra.run.smithi111.stdout: "flags": 1, 2024-04-25T02:23:17.079 INFO:teuthology.orchestra.run.smithi111.stdout: "flags_names": "hashpspool", 2024-04-25T02:23:17.079 INFO:teuthology.orchestra.run.smithi111.stdout: "type": 1, 2024-04-25T02:23:17.080 INFO:teuthology.orchestra.run.smithi111.stdout: "size": 2, 2024-04-25T02:23:17.080 INFO:teuthology.orchestra.run.smithi111.stdout: "min_size": 1, 2024-04-25T02:23:17.080 INFO:teuthology.orchestra.run.smithi111.stdout: "crush_rule": 0, 2024-04-25T02:23:17.080 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_count": 0, 2024-04-25T02:23:17.080 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_target": 0, 2024-04-25T02:23:17.080 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_barrier": 0, 2024-04-25T02:23:17.080 INFO:teuthology.orchestra.run.smithi111.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-25T02:23:17.080 INFO:teuthology.orchestra.run.smithi111.stdout: "object_hash": 2, 2024-04-25T02:23:17.080 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_autoscale_mode": "off", 2024-04-25T02:23:17.080 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num": 64, 2024-04-25T02:23:17.080 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_placement_num": 64, 2024-04-25T02:23:17.080 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_placement_num_target": 64, 2024-04-25T02:23:17.080 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num_target": 64, 2024-04-25T02:23:17.081 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num_pending": 64, 2024-04-25T02:23:17.081 INFO:teuthology.orchestra.run.smithi111.stdout: "last_pg_merge_meta": { 2024-04-25T02:23:17.081 INFO:teuthology.orchestra.run.smithi111.stdout: "source_pgid": "0.0", 2024-04-25T02:23:17.081 INFO:teuthology.orchestra.run.smithi111.stdout: "ready_epoch": 0, 2024-04-25T02:23:17.081 INFO:teuthology.orchestra.run.smithi111.stdout: "last_epoch_started": 0, 2024-04-25T02:23:17.081 INFO:teuthology.orchestra.run.smithi111.stdout: "last_epoch_clean": 0, 2024-04-25T02:23:17.081 INFO:teuthology.orchestra.run.smithi111.stdout: "source_version": "0'0", 2024-04-25T02:23:17.081 INFO:teuthology.orchestra.run.smithi111.stdout: "target_version": "0'0" 2024-04-25T02:23:17.081 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:23:17.081 INFO:teuthology.orchestra.run.smithi111.stdout: "last_change": "18", 2024-04-25T02:23:17.081 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend": "0", 2024-04-25T02:23:17.081 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-25T02:23:17.082 INFO:teuthology.orchestra.run.smithi111.stdout: "last_force_op_resend_preluminous": "0", 2024-04-25T02:23:17.082 INFO:teuthology.orchestra.run.smithi111.stdout: "auid": 0, 2024-04-25T02:23:17.082 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_mode": "selfmanaged", 2024-04-25T02:23:17.082 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_seq": 0, 2024-04-25T02:23:17.082 INFO:teuthology.orchestra.run.smithi111.stdout: "snap_epoch": 0, 2024-04-25T02:23:17.082 INFO:teuthology.orchestra.run.smithi111.stdout: "pool_snaps": [], 2024-04-25T02:23:17.082 INFO:teuthology.orchestra.run.smithi111.stdout: "removed_snaps": "[]", 2024-04-25T02:23:17.082 INFO:teuthology.orchestra.run.smithi111.stdout: "quota_max_bytes": 0, 2024-04-25T02:23:17.082 INFO:teuthology.orchestra.run.smithi111.stdout: "quota_max_objects": 0, 2024-04-25T02:23:17.082 INFO:teuthology.orchestra.run.smithi111.stdout: "tiers": [], 2024-04-25T02:23:17.082 INFO:teuthology.orchestra.run.smithi111.stdout: "tier_of": -1, 2024-04-25T02:23:17.082 INFO:teuthology.orchestra.run.smithi111.stdout: "read_tier": -1, 2024-04-25T02:23:17.082 INFO:teuthology.orchestra.run.smithi111.stdout: "write_tier": -1, 2024-04-25T02:23:17.082 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_mode": "none", 2024-04-25T02:23:17.082 INFO:teuthology.orchestra.run.smithi111.stdout: "target_max_bytes": 0, 2024-04-25T02:23:17.083 INFO:teuthology.orchestra.run.smithi111.stdout: "target_max_objects": 0, 2024-04-25T02:23:17.083 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-25T02:23:17.083 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-25T02:23:17.083 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-25T02:23:17.083 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_min_flush_age": 0, 2024-04-25T02:23:17.083 INFO:teuthology.orchestra.run.smithi111.stdout: "cache_min_evict_age": 0, 2024-04-25T02:23:17.083 INFO:teuthology.orchestra.run.smithi111.stdout: "erasure_code_profile": "", 2024-04-25T02:23:17.083 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_params": { 2024-04-25T02:23:17.083 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "none" 2024-04-25T02:23:17.083 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:23:17.083 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_period": 0, 2024-04-25T02:23:17.083 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_count": 0, 2024-04-25T02:23:17.084 INFO:teuthology.orchestra.run.smithi111.stdout: "use_gmt_hitset": true, 2024-04-25T02:23:17.084 INFO:teuthology.orchestra.run.smithi111.stdout: "min_read_recency_for_promote": 0, 2024-04-25T02:23:17.084 INFO:teuthology.orchestra.run.smithi111.stdout: "min_write_recency_for_promote": 0, 2024-04-25T02:23:17.084 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_grade_decay_rate": 0, 2024-04-25T02:23:17.084 INFO:teuthology.orchestra.run.smithi111.stdout: "hit_set_search_last_n": 0, 2024-04-25T02:23:17.084 INFO:teuthology.orchestra.run.smithi111.stdout: "grade_table": [], 2024-04-25T02:23:17.084 INFO:teuthology.orchestra.run.smithi111.stdout: "stripe_width": 0, 2024-04-25T02:23:17.084 INFO:teuthology.orchestra.run.smithi111.stdout: "expected_num_objects": 0, 2024-04-25T02:23:17.084 INFO:teuthology.orchestra.run.smithi111.stdout: "fast_read": false, 2024-04-25T02:23:17.084 INFO:teuthology.orchestra.run.smithi111.stdout: "options": { 2024-04-25T02:23:17.084 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_num_min": 64, 2024-04-25T02:23:17.084 INFO:teuthology.orchestra.run.smithi111.stdout: "target_size_ratio": 0.89999997615814209 2024-04-25T02:23:17.084 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:23:17.084 INFO:teuthology.orchestra.run.smithi111.stdout: "application_metadata": { 2024-04-25T02:23:17.084 INFO:teuthology.orchestra.run.smithi111.stdout: "cephfs": { 2024-04-25T02:23:17.085 INFO:teuthology.orchestra.run.smithi111.stdout: "data": "cephfs" 2024-04-25T02:23:17.085 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-25T02:23:17.085 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-25T02:23:17.085 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-25T02:23:17.085 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-04-25T02:23:17.085 INFO:teuthology.orchestra.run.smithi111.stdout: "osds": [ 2024-04-25T02:23:17.085 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-25T02:23:17.085 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": 0, 2024-04-25T02:23:17.085 INFO:teuthology.orchestra.run.smithi111.stdout: "uuid": "df3f17ca-3b12-42c8-8cf7-8f1b7189e587", 2024-04-25T02:23:17.085 INFO:teuthology.orchestra.run.smithi111.stdout: "up": 1, 2024-04-25T02:23:17.085 INFO:teuthology.orchestra.run.smithi111.stdout: "in": 1, 2024-04-25T02:23:17.085 INFO:teuthology.orchestra.run.smithi111.stdout: "weight": 1, 2024-04-25T02:23:17.085 INFO:teuthology.orchestra.run.smithi111.stdout: "primary_affinity": 1, 2024-04-25T02:23:17.085 INFO:teuthology.orchestra.run.smithi111.stdout: "last_clean_begin": 9, 2024-04-25T02:23:17.086 INFO:teuthology.orchestra.run.smithi111.stdout: "last_clean_end": 22, 2024-04-25T02:23:17.086 INFO:teuthology.orchestra.run.smithi111.stdout: "up_from": 28, 2024-04-25T02:23:17.086 INFO:teuthology.orchestra.run.smithi111.stdout: "up_thru": 31, 2024-04-25T02:23:17.086 INFO:teuthology.orchestra.run.smithi111.stdout: "down_at": 23, 2024-04-25T02:23:17.086 INFO:teuthology.orchestra.run.smithi111.stdout: "lost_at": 0, 2024-04-25T02:23:17.086 INFO:teuthology.orchestra.run.smithi111.stdout: "public_addrs": { 2024-04-25T02:23:17.086 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-25T02:23:17.086 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-25T02:23:17.086 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-25T02:23:17.086 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6800", 2024-04-25T02:23:17.086 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 48862 2024-04-25T02:23:17.087 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-25T02:23:17.087 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-25T02:23:17.087 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:23:17.087 INFO:teuthology.orchestra.run.smithi111.stdout: "cluster_addrs": { 2024-04-25T02:23:17.087 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-25T02:23:17.087 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-25T02:23:17.087 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-25T02:23:17.087 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6801", 2024-04-25T02:23:17.087 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 48862 2024-04-25T02:23:17.087 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-25T02:23:17.087 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-25T02:23:17.087 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:23:17.087 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_back_addrs": { 2024-04-25T02:23:17.087 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-25T02:23:17.087 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-25T02:23:17.088 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-25T02:23:17.088 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6803", 2024-04-25T02:23:17.088 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 48862 2024-04-25T02:23:17.088 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-25T02:23:17.088 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-25T02:23:17.088 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:23:17.088 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_front_addrs": { 2024-04-25T02:23:17.088 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-25T02:23:17.088 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-25T02:23:17.088 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-25T02:23:17.088 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6802", 2024-04-25T02:23:17.088 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 48862 2024-04-25T02:23:17.088 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-25T02:23:17.089 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-25T02:23:17.089 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:23:17.089 INFO:teuthology.orchestra.run.smithi111.stdout: "public_addr": "172.21.15.111:6800/48862", 2024-04-25T02:23:17.089 INFO:teuthology.orchestra.run.smithi111.stdout: "cluster_addr": "172.21.15.111:6801/48862", 2024-04-25T02:23:17.089 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_back_addr": "172.21.15.111:6803/48862", 2024-04-25T02:23:17.089 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_front_addr": "172.21.15.111:6802/48862", 2024-04-25T02:23:17.089 INFO:teuthology.orchestra.run.smithi111.stdout: "state": [ 2024-04-25T02:23:17.089 INFO:teuthology.orchestra.run.smithi111.stdout: "exists", 2024-04-25T02:23:17.089 INFO:teuthology.orchestra.run.smithi111.stdout: "up" 2024-04-25T02:23:17.089 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-25T02:23:17.089 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:23:17.090 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-25T02:23:17.090 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": 1, 2024-04-25T02:23:17.090 INFO:teuthology.orchestra.run.smithi111.stdout: "uuid": "93d54815-f215-4285-bba6-32f2d1cabf10", 2024-04-25T02:23:17.090 INFO:teuthology.orchestra.run.smithi111.stdout: "up": 1, 2024-04-25T02:23:17.090 INFO:teuthology.orchestra.run.smithi111.stdout: "in": 1, 2024-04-25T02:23:17.090 INFO:teuthology.orchestra.run.smithi111.stdout: "weight": 1, 2024-04-25T02:23:17.090 INFO:teuthology.orchestra.run.smithi111.stdout: "primary_affinity": 1, 2024-04-25T02:23:17.090 INFO:teuthology.orchestra.run.smithi111.stdout: "last_clean_begin": 9, 2024-04-25T02:23:17.090 INFO:teuthology.orchestra.run.smithi111.stdout: "last_clean_end": 22, 2024-04-25T02:23:17.090 INFO:teuthology.orchestra.run.smithi111.stdout: "up_from": 29, 2024-04-25T02:23:17.090 INFO:teuthology.orchestra.run.smithi111.stdout: "up_thru": 31, 2024-04-25T02:23:17.090 INFO:teuthology.orchestra.run.smithi111.stdout: "down_at": 24, 2024-04-25T02:23:17.090 INFO:teuthology.orchestra.run.smithi111.stdout: "lost_at": 0, 2024-04-25T02:23:17.091 INFO:teuthology.orchestra.run.smithi111.stdout: "public_addrs": { 2024-04-25T02:23:17.091 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-25T02:23:17.091 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-25T02:23:17.091 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-25T02:23:17.091 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6804", 2024-04-25T02:23:17.091 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 48960 2024-04-25T02:23:17.091 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-25T02:23:17.091 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-25T02:23:17.091 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:23:17.091 INFO:teuthology.orchestra.run.smithi111.stdout: "cluster_addrs": { 2024-04-25T02:23:17.091 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-25T02:23:17.091 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-25T02:23:17.092 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-25T02:23:17.092 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6805", 2024-04-25T02:23:17.092 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 48960 2024-04-25T02:23:17.092 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-25T02:23:17.092 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-25T02:23:17.092 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:23:17.092 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_back_addrs": { 2024-04-25T02:23:17.092 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-25T02:23:17.092 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-25T02:23:17.092 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-25T02:23:17.092 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6807", 2024-04-25T02:23:17.092 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 48960 2024-04-25T02:23:17.093 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-25T02:23:17.093 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-25T02:23:17.093 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:23:17.093 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_front_addrs": { 2024-04-25T02:23:17.093 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-25T02:23:17.093 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-25T02:23:17.093 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-25T02:23:17.093 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6806", 2024-04-25T02:23:17.093 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 48960 2024-04-25T02:23:17.093 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-25T02:23:17.093 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-25T02:23:17.093 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:23:17.093 INFO:teuthology.orchestra.run.smithi111.stdout: "public_addr": "172.21.15.111:6804/48960", 2024-04-25T02:23:17.093 INFO:teuthology.orchestra.run.smithi111.stdout: "cluster_addr": "172.21.15.111:6805/48960", 2024-04-25T02:23:17.093 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_back_addr": "172.21.15.111:6807/48960", 2024-04-25T02:23:17.094 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_front_addr": "172.21.15.111:6806/48960", 2024-04-25T02:23:17.094 INFO:teuthology.orchestra.run.smithi111.stdout: "state": [ 2024-04-25T02:23:17.094 INFO:teuthology.orchestra.run.smithi111.stdout: "exists", 2024-04-25T02:23:17.095 INFO:teuthology.orchestra.run.smithi111.stdout: "up" 2024-04-25T02:23:17.095 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-25T02:23:17.095 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:23:17.096 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-25T02:23:17.096 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": 2, 2024-04-25T02:23:17.096 INFO:teuthology.orchestra.run.smithi111.stdout: "uuid": "b26b2104-2a2e-408f-9ce7-3587a32a2ebe", 2024-04-25T02:23:17.096 INFO:teuthology.orchestra.run.smithi111.stdout: "up": 1, 2024-04-25T02:23:17.096 INFO:teuthology.orchestra.run.smithi111.stdout: "in": 1, 2024-04-25T02:23:17.096 INFO:teuthology.orchestra.run.smithi111.stdout: "weight": 1, 2024-04-25T02:23:17.096 INFO:teuthology.orchestra.run.smithi111.stdout: "primary_affinity": 1, 2024-04-25T02:23:17.096 INFO:teuthology.orchestra.run.smithi111.stdout: "last_clean_begin": 9, 2024-04-25T02:23:17.096 INFO:teuthology.orchestra.run.smithi111.stdout: "last_clean_end": 24, 2024-04-25T02:23:17.096 INFO:teuthology.orchestra.run.smithi111.stdout: "up_from": 30, 2024-04-25T02:23:17.097 INFO:teuthology.orchestra.run.smithi111.stdout: "up_thru": 31, 2024-04-25T02:23:17.097 INFO:teuthology.orchestra.run.smithi111.stdout: "down_at": 25, 2024-04-25T02:23:17.097 INFO:teuthology.orchestra.run.smithi111.stdout: "lost_at": 0, 2024-04-25T02:23:17.097 INFO:teuthology.orchestra.run.smithi111.stdout: "public_addrs": { 2024-04-25T02:23:17.097 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-25T02:23:17.097 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-25T02:23:17.097 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-25T02:23:17.097 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6808", 2024-04-25T02:23:17.097 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 49070 2024-04-25T02:23:17.097 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-25T02:23:17.098 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-25T02:23:17.098 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:23:17.098 INFO:teuthology.orchestra.run.smithi111.stdout: "cluster_addrs": { 2024-04-25T02:23:17.098 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-25T02:23:17.098 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-25T02:23:17.098 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-25T02:23:17.098 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6809", 2024-04-25T02:23:17.098 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 49070 2024-04-25T02:23:17.098 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-25T02:23:17.098 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-25T02:23:17.099 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:23:17.099 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_back_addrs": { 2024-04-25T02:23:17.099 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-25T02:23:17.099 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-25T02:23:17.099 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-25T02:23:17.099 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6811", 2024-04-25T02:23:17.099 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 49070 2024-04-25T02:23:17.099 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-25T02:23:17.099 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-25T02:23:17.100 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:23:17.100 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_front_addrs": { 2024-04-25T02:23:17.100 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-25T02:23:17.100 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-25T02:23:17.100 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-25T02:23:17.100 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6810", 2024-04-25T02:23:17.100 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 49070 2024-04-25T02:23:17.100 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-25T02:23:17.100 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-25T02:23:17.100 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:23:17.100 INFO:teuthology.orchestra.run.smithi111.stdout: "public_addr": "172.21.15.111:6808/49070", 2024-04-25T02:23:17.100 INFO:teuthology.orchestra.run.smithi111.stdout: "cluster_addr": "172.21.15.111:6809/49070", 2024-04-25T02:23:17.101 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_back_addr": "172.21.15.111:6811/49070", 2024-04-25T02:23:17.101 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_front_addr": "172.21.15.111:6810/49070", 2024-04-25T02:23:17.101 INFO:teuthology.orchestra.run.smithi111.stdout: "state": [ 2024-04-25T02:23:17.101 INFO:teuthology.orchestra.run.smithi111.stdout: "exists", 2024-04-25T02:23:17.101 INFO:teuthology.orchestra.run.smithi111.stdout: "up" 2024-04-25T02:23:17.101 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-25T02:23:17.101 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:23:17.101 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-25T02:23:17.101 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": 3, 2024-04-25T02:23:17.101 INFO:teuthology.orchestra.run.smithi111.stdout: "uuid": "43c25820-1edc-4031-badf-72e87dd6bf15", 2024-04-25T02:23:17.101 INFO:teuthology.orchestra.run.smithi111.stdout: "up": 1, 2024-04-25T02:23:17.101 INFO:teuthology.orchestra.run.smithi111.stdout: "in": 1, 2024-04-25T02:23:17.102 INFO:teuthology.orchestra.run.smithi111.stdout: "weight": 1, 2024-04-25T02:23:17.102 INFO:teuthology.orchestra.run.smithi111.stdout: "primary_affinity": 1, 2024-04-25T02:23:17.102 INFO:teuthology.orchestra.run.smithi111.stdout: "last_clean_begin": 9, 2024-04-25T02:23:17.102 INFO:teuthology.orchestra.run.smithi111.stdout: "last_clean_end": 25, 2024-04-25T02:23:17.102 INFO:teuthology.orchestra.run.smithi111.stdout: "up_from": 31, 2024-04-25T02:23:17.102 INFO:teuthology.orchestra.run.smithi111.stdout: "up_thru": 31, 2024-04-25T02:23:17.102 INFO:teuthology.orchestra.run.smithi111.stdout: "down_at": 26, 2024-04-25T02:23:17.102 INFO:teuthology.orchestra.run.smithi111.stdout: "lost_at": 0, 2024-04-25T02:23:17.102 INFO:teuthology.orchestra.run.smithi111.stdout: "public_addrs": { 2024-04-25T02:23:17.102 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-25T02:23:17.102 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-25T02:23:17.103 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-25T02:23:17.103 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6812", 2024-04-25T02:23:17.103 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 49243 2024-04-25T02:23:17.103 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-25T02:23:17.103 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-25T02:23:17.103 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:23:17.103 INFO:teuthology.orchestra.run.smithi111.stdout: "cluster_addrs": { 2024-04-25T02:23:17.103 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-25T02:23:17.103 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-25T02:23:17.103 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-25T02:23:17.103 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6813", 2024-04-25T02:23:17.103 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 49243 2024-04-25T02:23:17.104 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-25T02:23:17.104 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-25T02:23:17.104 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:23:17.104 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_back_addrs": { 2024-04-25T02:23:17.104 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-25T02:23:17.104 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-25T02:23:17.104 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-25T02:23:17.104 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6815", 2024-04-25T02:23:17.104 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 49243 2024-04-25T02:23:17.104 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-25T02:23:17.104 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-25T02:23:17.104 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:23:17.105 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_front_addrs": { 2024-04-25T02:23:17.105 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-25T02:23:17.105 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-25T02:23:17.105 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-25T02:23:17.105 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6814", 2024-04-25T02:23:17.105 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 49243 2024-04-25T02:23:17.105 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-25T02:23:17.105 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-25T02:23:17.105 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:23:17.105 INFO:teuthology.orchestra.run.smithi111.stdout: "public_addr": "172.21.15.111:6812/49243", 2024-04-25T02:23:17.105 INFO:teuthology.orchestra.run.smithi111.stdout: "cluster_addr": "172.21.15.111:6813/49243", 2024-04-25T02:23:17.105 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_back_addr": "172.21.15.111:6815/49243", 2024-04-25T02:23:17.105 INFO:teuthology.orchestra.run.smithi111.stdout: "heartbeat_front_addr": "172.21.15.111:6814/49243", 2024-04-25T02:23:17.106 INFO:teuthology.orchestra.run.smithi111.stdout: "state": [ 2024-04-25T02:23:17.106 INFO:teuthology.orchestra.run.smithi111.stdout: "exists", 2024-04-25T02:23:17.106 INFO:teuthology.orchestra.run.smithi111.stdout: "up" 2024-04-25T02:23:17.106 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-25T02:23:17.106 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-25T02:23:17.106 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-04-25T02:23:17.106 INFO:teuthology.orchestra.run.smithi111.stdout: "osd_xinfo": [ 2024-04-25T02:23:17.106 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-25T02:23:17.106 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": 0, 2024-04-25T02:23:17.106 INFO:teuthology.orchestra.run.smithi111.stdout: "down_stamp": "0.000000", 2024-04-25T02:23:17.106 INFO:teuthology.orchestra.run.smithi111.stdout: "laggy_probability": 0, 2024-04-25T02:23:17.106 INFO:teuthology.orchestra.run.smithi111.stdout: "laggy_interval": 0, 2024-04-25T02:23:17.107 INFO:teuthology.orchestra.run.smithi111.stdout: "features": 4540138320759226367, 2024-04-25T02:23:17.107 INFO:teuthology.orchestra.run.smithi111.stdout: "old_weight": 0, 2024-04-25T02:23:17.107 INFO:teuthology.orchestra.run.smithi111.stdout: "last_purged_snaps_scrub": "2024-04-25T02:20:09.372427+0000", 2024-04-25T02:23:17.107 INFO:teuthology.orchestra.run.smithi111.stdout: "dead_epoch": 23 2024-04-25T02:23:17.107 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:23:17.107 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-25T02:23:17.107 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": 1, 2024-04-25T02:23:17.107 INFO:teuthology.orchestra.run.smithi111.stdout: "down_stamp": "0.000000", 2024-04-25T02:23:17.107 INFO:teuthology.orchestra.run.smithi111.stdout: "laggy_probability": 0, 2024-04-25T02:23:17.107 INFO:teuthology.orchestra.run.smithi111.stdout: "laggy_interval": 0, 2024-04-25T02:23:17.107 INFO:teuthology.orchestra.run.smithi111.stdout: "features": 4540138320759226367, 2024-04-25T02:23:17.108 INFO:teuthology.orchestra.run.smithi111.stdout: "old_weight": 0, 2024-04-25T02:23:17.108 INFO:teuthology.orchestra.run.smithi111.stdout: "last_purged_snaps_scrub": "2024-04-25T02:20:09.411480+0000", 2024-04-25T02:23:17.108 INFO:teuthology.orchestra.run.smithi111.stdout: "dead_epoch": 24 2024-04-25T02:23:17.108 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:23:17.108 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-25T02:23:17.108 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": 2, 2024-04-25T02:23:17.108 INFO:teuthology.orchestra.run.smithi111.stdout: "down_stamp": "0.000000", 2024-04-25T02:23:17.108 INFO:teuthology.orchestra.run.smithi111.stdout: "laggy_probability": 0, 2024-04-25T02:23:17.108 INFO:teuthology.orchestra.run.smithi111.stdout: "laggy_interval": 0, 2024-04-25T02:23:17.109 INFO:teuthology.orchestra.run.smithi111.stdout: "features": 4540138320759226367, 2024-04-25T02:23:17.109 INFO:teuthology.orchestra.run.smithi111.stdout: "old_weight": 0, 2024-04-25T02:23:17.109 INFO:teuthology.orchestra.run.smithi111.stdout: "last_purged_snaps_scrub": "2024-04-25T02:20:09.361508+0000", 2024-04-25T02:23:17.109 INFO:teuthology.orchestra.run.smithi111.stdout: "dead_epoch": 25 2024-04-25T02:23:17.109 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:23:17.109 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-25T02:23:17.109 INFO:teuthology.orchestra.run.smithi111.stdout: "osd": 3, 2024-04-25T02:23:17.109 INFO:teuthology.orchestra.run.smithi111.stdout: "down_stamp": "2024-04-25T02:23:06.771296+0000", 2024-04-25T02:23:17.109 INFO:teuthology.orchestra.run.smithi111.stdout: "laggy_probability": 0, 2024-04-25T02:23:17.109 INFO:teuthology.orchestra.run.smithi111.stdout: "laggy_interval": 0, 2024-04-25T02:23:17.109 INFO:teuthology.orchestra.run.smithi111.stdout: "features": 4540138320759226367, 2024-04-25T02:23:17.109 INFO:teuthology.orchestra.run.smithi111.stdout: "old_weight": 0, 2024-04-25T02:23:17.110 INFO:teuthology.orchestra.run.smithi111.stdout: "last_purged_snaps_scrub": "2024-04-25T02:20:09.377212+0000", 2024-04-25T02:23:17.110 INFO:teuthology.orchestra.run.smithi111.stdout: "dead_epoch": 0 2024-04-25T02:23:17.110 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-25T02:23:17.110 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-04-25T02:23:17.110 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_upmap": [], 2024-04-25T02:23:17.110 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_upmap_items": [], 2024-04-25T02:23:17.110 INFO:teuthology.orchestra.run.smithi111.stdout: "pg_temp": [], 2024-04-25T02:23:17.110 INFO:teuthology.orchestra.run.smithi111.stdout: "primary_temp": [], 2024-04-25T02:23:17.110 INFO:teuthology.orchestra.run.smithi111.stdout: "blocklist": { 2024-04-25T02:23:17.110 INFO:teuthology.orchestra.run.smithi111.stdout: "172.21.15.111:6819/4003866251": "2024-04-26T02:23:16.839679+0000", 2024-04-25T02:23:17.110 INFO:teuthology.orchestra.run.smithi111.stdout: "172.21.15.111:0/2148931273": "2024-04-26T02:22:54.713254+0000", 2024-04-25T02:23:17.110 INFO:teuthology.orchestra.run.smithi111.stdout: "172.21.15.111:6816/39585": "2024-04-26T02:22:54.713254+0000", 2024-04-25T02:23:17.111 INFO:teuthology.orchestra.run.smithi111.stdout: "172.21.15.111:0/3911588907": "2024-04-26T02:22:54.713254+0000", 2024-04-25T02:23:17.111 INFO:teuthology.orchestra.run.smithi111.stdout: "172.21.15.111:0/1276843622": "2024-04-26T02:22:54.713254+0000" 2024-04-25T02:23:17.111 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:23:17.111 INFO:teuthology.orchestra.run.smithi111.stdout: "range_blocklist": {}, 2024-04-25T02:23:17.111 INFO:teuthology.orchestra.run.smithi111.stdout: "erasure_code_profiles": { 2024-04-25T02:23:17.111 INFO:teuthology.orchestra.run.smithi111.stdout: "default": { 2024-04-25T02:23:17.111 INFO:teuthology.orchestra.run.smithi111.stdout: "crush-failure-domain": "osd", 2024-04-25T02:23:17.111 INFO:teuthology.orchestra.run.smithi111.stdout: "k": "2", 2024-04-25T02:23:17.111 INFO:teuthology.orchestra.run.smithi111.stdout: "m": "1", 2024-04-25T02:23:17.111 INFO:teuthology.orchestra.run.smithi111.stdout: "plugin": "jerasure", 2024-04-25T02:23:17.111 INFO:teuthology.orchestra.run.smithi111.stdout: "technique": "reed_sol_van" 2024-04-25T02:23:17.112 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-25T02:23:17.112 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:23:17.112 INFO:teuthology.orchestra.run.smithi111.stdout: "removed_snaps_queue": [], 2024-04-25T02:23:17.112 INFO:teuthology.orchestra.run.smithi111.stdout: "new_removed_snaps": [], 2024-04-25T02:23:17.112 INFO:teuthology.orchestra.run.smithi111.stdout: "new_purged_snaps": [], 2024-04-25T02:23:17.112 INFO:teuthology.orchestra.run.smithi111.stdout: "crush_node_flags": {}, 2024-04-25T02:23:17.112 INFO:teuthology.orchestra.run.smithi111.stdout: "device_class_flags": {}, 2024-04-25T02:23:17.112 INFO:teuthology.orchestra.run.smithi111.stdout: "stretch_mode": { 2024-04-25T02:23:17.112 INFO:teuthology.orchestra.run.smithi111.stdout: "stretch_mode_enabled": false, 2024-04-25T02:23:17.112 INFO:teuthology.orchestra.run.smithi111.stdout: "stretch_bucket_count": 0, 2024-04-25T02:23:17.112 INFO:teuthology.orchestra.run.smithi111.stdout: "degraded_stretch_mode": 0, 2024-04-25T02:23:17.112 INFO:teuthology.orchestra.run.smithi111.stdout: "recovering_stretch_mode": 0, 2024-04-25T02:23:17.112 INFO:teuthology.orchestra.run.smithi111.stdout: "stretch_mode_bucket": 0 2024-04-25T02:23:17.113 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-25T02:23:17.113 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-25T02:23:17.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.055+0000 7f22d44f8700 1 -- 172.21.15.111:0/3475764173 >> v1:172.21.15.111:6816/46482 conn(0x7f22b0046040 legacy=0x7f22b00484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:17.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.055+0000 7f22d44f8700 1 -- 172.21.15.111:0/3475764173 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f22cc0682e0 msgr2=0x7f22cc0adca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:17.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.055+0000 7f22d44f8700 1 --2- 172.21.15.111:0/3475764173 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f22cc0682e0 0x7f22cc0adca0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f22c800c560 tx=0x7f22c8001020 comp rx=0 tx=0).stop 2024-04-25T02:23:17.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.055+0000 7f22d44f8700 1 -- 172.21.15.111:0/3475764173 shutdown_connections 2024-04-25T02:23:17.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.055+0000 7f22d44f8700 1 --2- 172.21.15.111:0/3475764173 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f22cc146a00 0x7f22cc140e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:17.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.055+0000 7f22d44f8700 1 --2- 172.21.15.111:0/3475764173 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f22cc0682e0 0x7f22cc0adca0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:17.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.055+0000 7f22d44f8700 1 --2- 172.21.15.111:0/3475764173 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f22cc06da60 0x7f22cc1408e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:17.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.055+0000 7f22d44f8700 1 -- 172.21.15.111:0/3475764173 >> 172.21.15.111:0/3475764173 conn(0x7f22cc069ce0 msgr2=0x7f22cc0af990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:17.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.055+0000 7f22d44f8700 1 -- 172.21.15.111:0/3475764173 shutdown_connections 2024-04-25T02:23:17.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.055+0000 7f22d44f8700 1 -- 172.21.15.111:0/3475764173 wait complete. 2024-04-25T02:23:17.116 DEBUG:teuthology.orchestra.run.smithi111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph osd require-osd-release quincy' 2024-04-25T02:23:17.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.227+0000 7f64aa314700 1 Processor -- start 2024-04-25T02:23:17.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.227+0000 7f64aa314700 1 -- start start 2024-04-25T02:23:17.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.228+0000 7f64aa314700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f64a40b3070 0x7f64a40a33e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:17.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.228+0000 7f64aa314700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f64a40a5480 0x7f64a4067980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:17.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.228+0000 7f64aa314700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64a40a4a50 con 0x7f64a4067ec0 2024-04-25T02:23:17.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.228+0000 7f64aa314700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64a40a3920 con 0x7f64a40b3070 2024-04-25T02:23:17.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.228+0000 7f64aa314700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64a4069010 con 0x7f64a40a5480 2024-04-25T02:23:17.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.228+0000 7f64a37fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f64a40a5480 0x7f64a4067980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:17.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.228+0000 7f64a3fff700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f64a40b3070 0x7f64a40a33e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:17.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.228+0000 7f64a88b1700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f64a4067ec0 0x7f64a41485e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:43896/0 (socket says 172.21.15.111:43896) 2024-04-25T02:23:17.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.228+0000 7f64a88b1700 1 -- 172.21.15.111:0/425429109 learned_addr learned my addr 172.21.15.111:0/425429109 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:23:17.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.228+0000 7f64a3fff700 1 -- 172.21.15.111:0/425429109 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f64a40a5480 msgr2=0x7f64a4067980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:17.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.228+0000 7f64a3fff700 1 --2- 172.21.15.111:0/425429109 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f64a40a5480 0x7f64a4067980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:17.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.228+0000 7f64a3fff700 1 -- 172.21.15.111:0/425429109 >> v1:172.21.15.111:6789/0 conn(0x7f64a4067ec0 legacy=0x7f64a41485e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:17.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.228+0000 7f64a3fff700 1 -- 172.21.15.111:0/425429109 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64a40a4470 con 0x7f64a40b3070 2024-04-25T02:23:17.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.228+0000 7f64a37fe700 1 --2- 172.21.15.111:0/425429109 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f64a40a5480 0x7f64a4067980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:17.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.228+0000 7f64a2ffd700 1 -- 172.21.15.111:0/425429109 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 142109127 0 0) 0x7f64a40a4a50 con 0x7f64a4067ec0 2024-04-25T02:23:17.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.229+0000 7f64a3fff700 1 --2- 172.21.15.111:0/425429109 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f64a40b3070 0x7f64a40a33e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f64980098e0 tx=0x7f64980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff2e9e419e795cf8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:17.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.229+0000 7f64a2ffd700 1 -- 172.21.15.111:0/425429109 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f649800b640 con 0x7f64a40b3070 2024-04-25T02:23:17.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.229+0000 7f64a2ffd700 1 -- 172.21.15.111:0/425429109 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f649800b7a0 con 0x7f64a40b3070 2024-04-25T02:23:17.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.229+0000 7f64a2ffd700 1 -- 172.21.15.111:0/425429109 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f649800bb40 con 0x7f64a40b3070 2024-04-25T02:23:17.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.229+0000 7f64aa314700 1 -- 172.21.15.111:0/425429109 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f64a40b3070 msgr2=0x7f64a40a33e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:17.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.229+0000 7f64aa314700 1 --2- 172.21.15.111:0/425429109 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f64a40b3070 0x7f64a40a33e0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f64980098e0 tx=0x7f64980091a0 comp rx=0 tx=0).stop 2024-04-25T02:23:17.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.229+0000 7f64aa314700 1 -- 172.21.15.111:0/425429109 shutdown_connections 2024-04-25T02:23:17.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.229+0000 7f64aa314700 1 --2- 172.21.15.111:0/425429109 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f64a40b3070 0x7f64a40a33e0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:17.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.229+0000 7f64aa314700 1 --2- 172.21.15.111:0/425429109 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f64a40a5480 0x7f64a4067980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:17.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.229+0000 7f64aa314700 1 -- 172.21.15.111:0/425429109 >> 172.21.15.111:0/425429109 conn(0x7f64a406aca0 msgr2=0x7f64a406b0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:17.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.229+0000 7f64aa314700 1 -- 172.21.15.111:0/425429109 shutdown_connections 2024-04-25T02:23:17.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.229+0000 7f64aa314700 1 -- 172.21.15.111:0/425429109 wait complete. 2024-04-25T02:23:17.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.230+0000 7f64aa314700 1 Processor -- start 2024-04-25T02:23:17.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.230+0000 7f64aa314700 1 -- start start 2024-04-25T02:23:17.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.231+0000 7f64aa314700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f64a4067ec0 0x7f64a40ae950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:17.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.231+0000 7f64aa314700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f64a40b3070 0x7f64a4151650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:17.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.231+0000 7f64aa314700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f64a4098f40 0x7f64a4151b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:17.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.231+0000 7f64aa314700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64a4098760 con 0x7f64a4067ec0 2024-04-25T02:23:17.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.231+0000 7f64aa314700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64a40aee90 con 0x7f64a40b3070 2024-04-25T02:23:17.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.231+0000 7f64aa314700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f64a40af0f0 con 0x7f64a4098f40 2024-04-25T02:23:17.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.231+0000 7f64a3fff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f64a4067ec0 0x7f64a40ae950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:17.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.231+0000 7f64a3fff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f64a4067ec0 0x7f64a40ae950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:35390/0 (socket says 172.21.15.111:35390) 2024-04-25T02:23:17.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.231+0000 7f64a3fff700 1 -- 172.21.15.111:0/952320907 learned_addr learned my addr 172.21.15.111:0/952320907 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:17.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.231+0000 7f64a88b1700 1 --2- 172.21.15.111:0/952320907 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f64a4098f40 0x7f64a4151b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:17.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.231+0000 7f64a37fe700 1 --2- 172.21.15.111:0/952320907 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f64a40b3070 0x7f64a4151650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:17.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.231+0000 7f64a88b1700 1 -- 172.21.15.111:0/952320907 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f64a40b3070 msgr2=0x7f64a4151650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:17.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.231+0000 7f64a88b1700 1 --2- 172.21.15.111:0/952320907 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f64a40b3070 0x7f64a4151650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:17.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.231+0000 7f64a88b1700 1 -- 172.21.15.111:0/952320907 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f64a4067ec0 msgr2=0x7f64a40ae950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:17.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.231+0000 7f64a88b1700 1 --2- 172.21.15.111:0/952320907 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f64a4067ec0 0x7f64a40ae950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:17.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.231+0000 7f64a88b1700 1 -- 172.21.15.111:0/952320907 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6494009420 con 0x7f64a4098f40 2024-04-25T02:23:17.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.231+0000 7f64a3fff700 1 --2- 172.21.15.111:0/952320907 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f64a4067ec0 0x7f64a40ae950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:17.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.231+0000 7f64a88b1700 1 --2- 172.21.15.111:0/952320907 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f64a4098f40 0x7f64a4151b90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f649c00cb90 tx=0x7f649c0018f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:17.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.232+0000 7f648bfff700 1 -- 172.21.15.111:0/952320907 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f649c00a810 con 0x7f64a4098f40 2024-04-25T02:23:17.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.232+0000 7f648bfff700 1 -- 172.21.15.111:0/952320907 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f649c00a970 con 0x7f64a4098f40 2024-04-25T02:23:17.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.232+0000 7f648bfff700 1 -- 172.21.15.111:0/952320907 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f649c00ad30 con 0x7f64a4098f40 2024-04-25T02:23:17.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.232+0000 7f64aa314700 1 -- 172.21.15.111:0/952320907 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6498009420 con 0x7f64a4098f40 2024-04-25T02:23:17.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.232+0000 7f64aa314700 1 -- 172.21.15.111:0/952320907 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64a4099660 con 0x7f64a4098f40 2024-04-25T02:23:17.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.233+0000 7f648bfff700 1 -- 172.21.15.111:0/952320907 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f649c007300 con 0x7f64a4098f40 2024-04-25T02:23:17.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.233+0000 7f64aa314700 1 -- 172.21.15.111:0/952320907 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64a4099380 con 0x7f64a4098f40 2024-04-25T02:23:17.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.233+0000 7f648bfff700 1 -- 172.21.15.111:0/952320907 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f649c05b380 con 0x7f64a4098f40 2024-04-25T02:23:17.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.236+0000 7f648bfff700 1 -- 172.21.15.111:0/952320907 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f649c039620 con 0x7f64a4098f40 2024-04-25T02:23:17.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.401+0000 7f64aa314700 1 -- 172.21.15.111:0/952320907 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "osd require-osd-release", "release": "quincy"} v 0) v1 -- 0x7f64a4097a90 con 0x7f64a4098f40 2024-04-25T02:23:17.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.862+0000 7f648bfff700 1 -- 172.21.15.111:0/952320907 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "osd require-osd-release", "release": "quincy"}]=0 v36) v1 ==== 92+0+0 (secure 0 0 0) 0x7f649c03ce10 con 0x7f64a4098f40 2024-04-25T02:23:17.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.864+0000 7f64aa314700 1 -- 172.21.15.111:0/952320907 >> v1:172.21.15.111:6816/46482 conn(0x7f6490046010 legacy=0x7f64900484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:17.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.864+0000 7f64aa314700 1 -- 172.21.15.111:0/952320907 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f64a4098f40 msgr2=0x7f64a4151b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:17.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.864+0000 7f64aa314700 1 --2- 172.21.15.111:0/952320907 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f64a4098f40 0x7f64a4151b90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f649c00cb90 tx=0x7f649c0018f0 comp rx=0 tx=0).stop 2024-04-25T02:23:17.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.864+0000 7f64aa314700 1 -- 172.21.15.111:0/952320907 shutdown_connections 2024-04-25T02:23:17.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.864+0000 7f64aa314700 1 --2- 172.21.15.111:0/952320907 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f64a4098f40 0x7f64a4151b90 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:17.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.864+0000 7f64aa314700 1 --2- 172.21.15.111:0/952320907 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f64a4067ec0 0x7f64a40ae950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:17.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.864+0000 7f64aa314700 1 --2- 172.21.15.111:0/952320907 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f64a40b3070 0x7f64a4151650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:17.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.864+0000 7f64aa314700 1 -- 172.21.15.111:0/952320907 >> 172.21.15.111:0/952320907 conn(0x7f64a406aca0 msgr2=0x7f64a4068310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:17.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.865+0000 7f64aa314700 1 -- 172.21.15.111:0/952320907 shutdown_connections 2024-04-25T02:23:17.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.865+0000 7f64aa314700 1 -- 172.21.15.111:0/952320907 wait complete. 2024-04-25T02:23:17.880 DEBUG:teuthology.orchestra.run.smithi111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'for f in `ceph osd pool ls` ; do ceph osd pool set $f pg_autoscale_mode off ; done' 2024-04-25T02:23:17.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.991+0000 7f426aa33700 1 Processor -- start 2024-04-25T02:23:17.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.991+0000 7f426aa33700 1 -- start start 2024-04-25T02:23:17.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.991+0000 7f426aa33700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4264071200 0x7f426406edc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:17.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.991+0000 7f426aa33700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f426413b750 0x7f426413bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:17.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.991+0000 7f426aa33700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4264141a10 0x7f4264141eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:17.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.991+0000 7f426aa33700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f42640acc10 con 0x7f426413b750 2024-04-25T02:23:17.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.991+0000 7f426aa33700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42640b1ff0 con 0x7f4264071200 2024-04-25T02:23:17.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.991+0000 7f426aa33700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f42640abfd0 con 0x7f4264141a10 2024-04-25T02:23:17.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.991+0000 7f4268fd0700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4264141a10 0x7f4264141eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:17.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.991+0000 7f42637fe700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f426413b750 0x7f426413bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:17.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.991+0000 7f4263fff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4264071200 0x7f426406edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:17.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.991+0000 7f4263fff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4264071200 0x7f426406edc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:57470/0 (socket says 172.21.15.111:57470) 2024-04-25T02:23:17.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.991+0000 7f42637fe700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f426413b750 0x7f426413bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:35394/0 (socket says 172.21.15.111:35394) 2024-04-25T02:23:17.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.991+0000 7f4268fd0700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4264141a10 0x7f4264141eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:33116/0 (socket says 172.21.15.111:33116) 2024-04-25T02:23:17.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.991+0000 7f4263fff700 1 -- 172.21.15.111:0/3026583602 learned_addr learned my addr 172.21.15.111:0/3026583602 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:17.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.992+0000 7f4268fd0700 1 -- 172.21.15.111:0/3026583602 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4264071200 msgr2=0x7f426406edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:17.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.992+0000 7f4268fd0700 1 --2- 172.21.15.111:0/3026583602 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4264071200 0x7f426406edc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:17.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.992+0000 7f4268fd0700 1 -- 172.21.15.111:0/3026583602 >> v2:172.21.15.111:3300/0 conn(0x7f426413b750 msgr2=0x7f426413bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:17.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.992+0000 7f4268fd0700 1 --2- 172.21.15.111:0/3026583602 >> v2:172.21.15.111:3300/0 conn(0x7f426413b750 0x7f426413bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:17.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.992+0000 7f4268fd0700 1 -- 172.21.15.111:0/3026583602 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42640ac290 con 0x7f4264141a10 2024-04-25T02:23:17.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.992+0000 7f4263fff700 1 --2- 172.21.15.111:0/3026583602 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4264071200 0x7f426406edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:17.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.992+0000 7f42637fe700 1 --2- 172.21.15.111:0/3026583602 >> v2:172.21.15.111:3300/0 conn(0x7f426413b750 0x7f426413bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:17.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.992+0000 7f4268fd0700 1 --2- 172.21.15.111:0/3026583602 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4264141a10 0x7f4264141eb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f425c009e90 tx=0x7f425c009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4c7f8ccee1edf5e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:17.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.992+0000 7f4262ffd700 1 -- 172.21.15.111:0/3026583602 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425c00e070 con 0x7f4264141a10 2024-04-25T02:23:17.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.992+0000 7f4262ffd700 1 -- 172.21.15.111:0/3026583602 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f425c00bbd0 con 0x7f4264141a10 2024-04-25T02:23:17.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.992+0000 7f4262ffd700 1 -- 172.21.15.111:0/3026583602 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425c012430 con 0x7f4264141a10 2024-04-25T02:23:17.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.993+0000 7f426aa33700 1 -- 172.21.15.111:0/3026583602 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4264141a10 msgr2=0x7f4264141eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:17.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.993+0000 7f426aa33700 1 --2- 172.21.15.111:0/3026583602 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4264141a10 0x7f4264141eb0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f425c009e90 tx=0x7f425c009780 comp rx=0 tx=0).stop 2024-04-25T02:23:17.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.993+0000 7f426aa33700 1 -- 172.21.15.111:0/3026583602 shutdown_connections 2024-04-25T02:23:17.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.993+0000 7f426aa33700 1 --2- 172.21.15.111:0/3026583602 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4264141a10 0x7f4264141eb0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:17.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.993+0000 7f426aa33700 1 --2- 172.21.15.111:0/3026583602 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4264071200 0x7f426406edc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:17.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.993+0000 7f426aa33700 1 --2- 172.21.15.111:0/3026583602 >> v2:172.21.15.111:3300/0 conn(0x7f426413b750 0x7f426413bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:17.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.993+0000 7f426aa33700 1 -- 172.21.15.111:0/3026583602 >> 172.21.15.111:0/3026583602 conn(0x7f4264069370 msgr2=0x7f4264069770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:17.999 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.993+0000 7f426aa33700 1 -- 172.21.15.111:0/3026583602 shutdown_connections 2024-04-25T02:23:18.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.993+0000 7f426aa33700 1 -- 172.21.15.111:0/3026583602 wait complete. 2024-04-25T02:23:18.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.993+0000 7f426aa33700 1 Processor -- start 2024-04-25T02:23:18.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.994+0000 7f426aa33700 1 -- start start 2024-04-25T02:23:18.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.994+0000 7f426aa33700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4264071200 0x7f4264118fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:18.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.994+0000 7f426aa33700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f426413b750 0x7f426413c370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:18.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.994+0000 7f426aa33700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4264141a10 0x7f426413c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:18.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.994+0000 7f426aa33700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f426411a370 con 0x7f426413b750 2024-04-25T02:23:18.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.994+0000 7f426aa33700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4264119b90 con 0x7f4264071200 2024-04-25T02:23:18.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.994+0000 7f426aa33700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4264119500 con 0x7f4264141a10 2024-04-25T02:23:18.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.994+0000 7f4268fd0700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4264141a10 0x7f426413c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:18.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.994+0000 7f42637fe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f426413b750 0x7f426413c370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:18.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.994+0000 7f4263fff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4264071200 0x7f4264118fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:18.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.994+0000 7f42637fe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f426413b750 0x7f426413c370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:35404/0 (socket says 172.21.15.111:35404) 2024-04-25T02:23:18.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.994+0000 7f4268fd0700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4264141a10 0x7f426413c8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:33126/0 (socket says 172.21.15.111:33126) 2024-04-25T02:23:18.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.994+0000 7f42637fe700 1 -- 172.21.15.111:0/345615377 learned_addr learned my addr 172.21.15.111:0/345615377 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:18.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.995+0000 7f42637fe700 1 -- 172.21.15.111:0/345615377 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4264141a10 msgr2=0x7f426413c8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:18.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.995+0000 7f42637fe700 1 --2- 172.21.15.111:0/345615377 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4264141a10 0x7f426413c8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:18.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.995+0000 7f42637fe700 1 -- 172.21.15.111:0/345615377 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4264071200 msgr2=0x7f4264118fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:18.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.995+0000 7f42637fe700 1 --2- 172.21.15.111:0/345615377 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4264071200 0x7f4264118fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:18.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.995+0000 7f42637fe700 1 -- 172.21.15.111:0/345615377 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42540094f0 con 0x7f426413b750 2024-04-25T02:23:18.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.995+0000 7f4263fff700 1 --2- 172.21.15.111:0/345615377 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4264071200 0x7f4264118fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:18.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.995+0000 7f42637fe700 1 --2- 172.21.15.111:0/345615377 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f426413b750 0x7f426413c370 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f425800ec50 tx=0x7f42580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:18.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.995+0000 7f424bfff700 1 -- 172.21.15.111:0/345615377 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425800c850 con 0x7f426413b750 2024-04-25T02:23:18.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.995+0000 7f424bfff700 1 -- 172.21.15.111:0/345615377 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f425800c9b0 con 0x7f426413b750 2024-04-25T02:23:18.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.995+0000 7f426aa33700 1 -- 172.21.15.111:0/345615377 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4258009420 con 0x7f426413b750 2024-04-25T02:23:18.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.995+0000 7f424bfff700 1 -- 172.21.15.111:0/345615377 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f425800cd50 con 0x7f426413b750 2024-04-25T02:23:18.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.995+0000 7f426aa33700 1 -- 172.21.15.111:0/345615377 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f425c009a20 con 0x7f426413b750 2024-04-25T02:23:18.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.996+0000 7f426aa33700 1 -- 172.21.15.111:0/345615377 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f426413e460 con 0x7f426413b750 2024-04-25T02:23:18.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.996+0000 7f424bfff700 1 -- 172.21.15.111:0/345615377 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f4258013680 con 0x7f426413b750 2024-04-25T02:23:18.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:17.996+0000 7f424bfff700 1 -- 172.21.15.111:0/345615377 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f425805b4c0 con 0x7f426413b750 2024-04-25T02:23:18.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.000+0000 7f424bfff700 1 -- 172.21.15.111:0/345615377 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f42580396e0 con 0x7f426413b750 2024-04-25T02:23:18.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.156+0000 7f426aa33700 1 -- 172.21.15.111:0/345615377 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd pool ls"} v 0) v1 -- 0x7f4264072200 con 0x7f426413b750 2024-04-25T02:23:18.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.156+0000 7f424bfff700 1 -- 172.21.15.111:0/345615377 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool ls"}]=0 v36) v1 ==== 59+0+37 (secure 0 0 0) 0x7f425803ced0 con 0x7f426413b750 2024-04-25T02:23:18.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.158+0000 7f426aa33700 1 -- 172.21.15.111:0/345615377 >> v1:172.21.15.111:6816/46482 conn(0x7f4250046010 legacy=0x7f42500484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:18.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.158+0000 7f426aa33700 1 -- 172.21.15.111:0/345615377 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f426413b750 msgr2=0x7f426413c370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:18.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.158+0000 7f426aa33700 1 --2- 172.21.15.111:0/345615377 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f426413b750 0x7f426413c370 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f425800ec50 tx=0x7f42580091a0 comp rx=0 tx=0).stop 2024-04-25T02:23:18.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.158+0000 7f426aa33700 1 -- 172.21.15.111:0/345615377 shutdown_connections 2024-04-25T02:23:18.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.158+0000 7f426aa33700 1 --2- 172.21.15.111:0/345615377 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f4264141a10 0x7f426413c8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:18.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.158+0000 7f426aa33700 1 --2- 172.21.15.111:0/345615377 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4264071200 0x7f4264118fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:18.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.158+0000 7f426aa33700 1 --2- 172.21.15.111:0/345615377 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f426413b750 0x7f426413c370 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:18.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.158+0000 7f426aa33700 1 -- 172.21.15.111:0/345615377 >> 172.21.15.111:0/345615377 conn(0x7f4264069370 msgr2=0x7f4264141e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:18.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.158+0000 7f426aa33700 1 -- 172.21.15.111:0/345615377 shutdown_connections 2024-04-25T02:23:18.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.158+0000 7f426aa33700 1 -- 172.21.15.111:0/345615377 wait complete. 2024-04-25T02:23:18.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.260+0000 7ff0d8e0a700 1 Processor -- start 2024-04-25T02:23:18.264 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.260+0000 7ff0d8e0a700 1 -- start start 2024-04-25T02:23:18.266 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.261+0000 7ff0d8e0a700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff0d406f600 0x7ff0d413fc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:18.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.261+0000 7ff0d8e0a700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7ff0d4140190 0x7ff0d41469c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:18.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.261+0000 7ff0d8e0a700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0d40a5600 con 0x7ff0d405ed00 2024-04-25T02:23:18.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.261+0000 7ff0d8e0a700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0d406e7d0 con 0x7ff0d4140190 2024-04-25T02:23:18.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.261+0000 7ff0d8e0a700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d413f680 con 0x7ff0d406f600 2024-04-25T02:23:18.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.261+0000 7ff0d1d9b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff0d406f600 0x7ff0d413fc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:18.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.261+0000 7ff0d2d9d700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7ff0d4140190 0x7ff0d41469c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:18.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.261+0000 7ff0d1d9b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff0d406f600 0x7ff0d413fc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:33134/0 (socket says 172.21.15.111:33134) 2024-04-25T02:23:18.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.261+0000 7ff0d259c700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7ff0d405ed00 0x7ff0d406de00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:43904/0 (socket says 172.21.15.111:43904) 2024-04-25T02:23:18.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.261+0000 7ff0d1d9b700 1 -- 172.21.15.111:0/3151193217 learned_addr learned my addr 172.21.15.111:0/3151193217 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:18.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.261+0000 7ff0d2d9d700 1 -- 172.21.15.111:0/3151193217 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff0d406f600 msgr2=0x7ff0d413fc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:18.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.261+0000 7ff0d2d9d700 1 --2- 172.21.15.111:0/3151193217 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff0d406f600 0x7ff0d413fc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:18.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.261+0000 7ff0d2d9d700 1 -- 172.21.15.111:0/3151193217 >> v1:172.21.15.111:6789/0 conn(0x7ff0d405ed00 legacy=0x7ff0d406de00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:18.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.261+0000 7ff0d2d9d700 1 -- 172.21.15.111:0/3151193217 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0d406e510 con 0x7ff0d4140190 2024-04-25T02:23:18.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.261+0000 7ff0d159a700 1 -- 172.21.15.111:0/3151193217 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3698644424 0 0) 0x7ff0d40a5600 con 0x7ff0d405ed00 2024-04-25T02:23:18.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.261+0000 7ff0d1d9b700 1 --2- 172.21.15.111:0/3151193217 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff0d406f600 0x7ff0d413fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:18.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.262+0000 7ff0d2d9d700 1 --2- 172.21.15.111:0/3151193217 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff0d4140190 0x7ff0d41469c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc009e60 tx=0x7ff0cc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4af663adc03bec24 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:18.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.262+0000 7ff0d159a700 1 -- 172.21.15.111:0/3151193217 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc00e070 con 0x7ff0d4140190 2024-04-25T02:23:18.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.262+0000 7ff0d159a700 1 -- 172.21.15.111:0/3151193217 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0cc00bb60 con 0x7ff0d4140190 2024-04-25T02:23:18.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.262+0000 7ff0d159a700 1 -- 172.21.15.111:0/3151193217 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0cc012430 con 0x7ff0d4140190 2024-04-25T02:23:18.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.262+0000 7ff0d8e0a700 1 -- 172.21.15.111:0/3151193217 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff0d4140190 msgr2=0x7ff0d41469c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:18.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.262+0000 7ff0d8e0a700 1 --2- 172.21.15.111:0/3151193217 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff0d4140190 0x7ff0d41469c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff0cc009e60 tx=0x7ff0cc009780 comp rx=0 tx=0).stop 2024-04-25T02:23:18.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.262+0000 7ff0d8e0a700 1 -- 172.21.15.111:0/3151193217 shutdown_connections 2024-04-25T02:23:18.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.262+0000 7ff0d8e0a700 1 --2- 172.21.15.111:0/3151193217 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff0d4140190 0x7ff0d41469c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:18.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.262+0000 7ff0d8e0a700 1 --2- 172.21.15.111:0/3151193217 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff0d406f600 0x7ff0d413fc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:18.268 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.262+0000 7ff0d8e0a700 1 -- 172.21.15.111:0/3151193217 >> 172.21.15.111:0/3151193217 conn(0x7ff0d406ce60 msgr2=0x7ff0d405e3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:18.269 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.262+0000 7ff0d8e0a700 1 -- 172.21.15.111:0/3151193217 shutdown_connections 2024-04-25T02:23:18.269 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.262+0000 7ff0d8e0a700 1 -- 172.21.15.111:0/3151193217 wait complete. 2024-04-25T02:23:18.269 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.263+0000 7ff0d8e0a700 1 Processor -- start 2024-04-25T02:23:18.269 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.263+0000 7ff0d8e0a700 1 -- start start 2024-04-25T02:23:18.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.264+0000 7ff0d8e0a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff0d405ed00 0x7ff0d40aea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:18.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.264+0000 7ff0d8e0a700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff0d406f600 0x7ff0d40ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:18.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.264+0000 7ff0d8e0a700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff0d4140190 0x7ff0d414b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:18.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.264+0000 7ff0d8e0a700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d414b770 con 0x7ff0d405ed00 2024-04-25T02:23:18.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.264+0000 7ff0d8e0a700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d40aefa0 con 0x7ff0d4140190 2024-04-25T02:23:18.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.264+0000 7ff0d8e0a700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff0d40ab6c0 con 0x7ff0d406f600 2024-04-25T02:23:18.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.264+0000 7ff0d259c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff0d405ed00 0x7ff0d40aea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:18.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.264+0000 7ff0d259c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff0d405ed00 0x7ff0d40aea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:35422/0 (socket says 172.21.15.111:35422) 2024-04-25T02:23:18.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.264+0000 7ff0d259c700 1 -- 172.21.15.111:0/969833135 learned_addr learned my addr 172.21.15.111:0/969833135 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:18.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.264+0000 7ff0d2d9d700 1 --2- 172.21.15.111:0/969833135 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff0d4140190 0x7ff0d414b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:18.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.264+0000 7ff0d1d9b700 1 --2- 172.21.15.111:0/969833135 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff0d406f600 0x7ff0d40ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:18.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.264+0000 7ff0d259c700 1 -- 172.21.15.111:0/969833135 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff0d406f600 msgr2=0x7ff0d40ad5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:18.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.264+0000 7ff0d259c700 1 --2- 172.21.15.111:0/969833135 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff0d406f600 0x7ff0d40ad5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:18.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.264+0000 7ff0d259c700 1 -- 172.21.15.111:0/969833135 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff0d4140190 msgr2=0x7ff0d414b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:18.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.264+0000 7ff0d259c700 1 --2- 172.21.15.111:0/969833135 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff0d4140190 0x7ff0d414b9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:18.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.264+0000 7ff0d259c700 1 -- 172.21.15.111:0/969833135 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c40094f0 con 0x7ff0d405ed00 2024-04-25T02:23:18.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.264+0000 7ff0d1d9b700 1 --2- 172.21.15.111:0/969833135 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff0d406f600 0x7ff0d40ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:18.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.264+0000 7ff0d2d9d700 1 --2- 172.21.15.111:0/969833135 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff0d4140190 0x7ff0d414b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:18.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.264+0000 7ff0d259c700 1 --2- 172.21.15.111:0/969833135 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff0d405ed00 0x7ff0d40aea60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff0c800c810 tx=0x7ff0c8007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:18.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.264+0000 7ff0c27fc700 1 -- 172.21.15.111:0/969833135 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c8005b40 con 0x7ff0d405ed00 2024-04-25T02:23:18.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.264+0000 7ff0c27fc700 1 -- 172.21.15.111:0/969833135 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0c8005ca0 con 0x7ff0d405ed00 2024-04-25T02:23:18.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.264+0000 7ff0d8e0a700 1 -- 172.21.15.111:0/969833135 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0cc009a20 con 0x7ff0d405ed00 2024-04-25T02:23:18.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.264+0000 7ff0c27fc700 1 -- 172.21.15.111:0/969833135 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0c8007320 con 0x7ff0d405ed00 2024-04-25T02:23:18.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.264+0000 7ff0d8e0a700 1 -- 172.21.15.111:0/969833135 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0d40af650 con 0x7ff0d405ed00 2024-04-25T02:23:18.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.265+0000 7ff0c27fc700 1 -- 172.21.15.111:0/969833135 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7ff0c801b3b0 con 0x7ff0d405ed00 2024-04-25T02:23:18.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.265+0000 7ff0d8e0a700 1 -- 172.21.15.111:0/969833135 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0d4072200 con 0x7ff0d405ed00 2024-04-25T02:23:18.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.266+0000 7ff0c27fc700 1 -- 172.21.15.111:0/969833135 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 3883+0+0 (secure 0 0 0) 0x7ff0c805a620 con 0x7ff0d405ed00 2024-04-25T02:23:18.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.269+0000 7ff0c27fc700 1 -- 172.21.15.111:0/969833135 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7ff0c80387e0 con 0x7ff0d405ed00 2024-04-25T02:23:18.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.422+0000 7ff0d8e0a700 1 -- 172.21.15.111:0/969833135 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd pool set", "pool": ".mgr", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7ff0d413d690 con 0x7ff0d405ed00 2024-04-25T02:23:18.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.871+0000 7ff0c27fc700 1 -- 172.21.15.111:0/969833135 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": ".mgr", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 1 pg_autoscale_mode to off v37) v1 ==== 153+0+0 (secure 0 0 0) 0x7ff0c8017070 con 0x7ff0d405ed00 2024-04-25T02:23:18.878 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.874+0000 7ff0d8e0a700 1 -- 172.21.15.111:0/969833135 >> v1:172.21.15.111:6816/46482 conn(0x7ff0b4046010 legacy=0x7ff0b40484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:18.878 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.874+0000 7ff0d8e0a700 1 -- 172.21.15.111:0/969833135 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff0d405ed00 msgr2=0x7ff0d40aea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:18.878 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.874+0000 7ff0d8e0a700 1 --2- 172.21.15.111:0/969833135 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff0d405ed00 0x7ff0d40aea60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7ff0c800c810 tx=0x7ff0c8007d90 comp rx=0 tx=0).stop 2024-04-25T02:23:18.878 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.874+0000 7ff0d8e0a700 1 -- 172.21.15.111:0/969833135 shutdown_connections 2024-04-25T02:23:18.878 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.874+0000 7ff0d8e0a700 1 --2- 172.21.15.111:0/969833135 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff0d4140190 0x7ff0d414b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:18.878 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.874+0000 7ff0d8e0a700 1 --2- 172.21.15.111:0/969833135 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff0d405ed00 0x7ff0d40aea60 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:18.878 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.874+0000 7ff0d8e0a700 1 --2- 172.21.15.111:0/969833135 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff0d406f600 0x7ff0d40ad5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:18.879 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.874+0000 7ff0d8e0a700 1 -- 172.21.15.111:0/969833135 >> 172.21.15.111:0/969833135 conn(0x7ff0d406ce60 msgr2=0x7ff0d40a3370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:18.879 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.874+0000 7ff0d8e0a700 1 -- 172.21.15.111:0/969833135 shutdown_connections 2024-04-25T02:23:18.879 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.874+0000 7ff0d8e0a700 1 -- 172.21.15.111:0/969833135 wait complete. 2024-04-25T02:23:18.879 INFO:teuthology.orchestra.run.smithi111.stderr:set pool 1 pg_autoscale_mode to off 2024-04-25T02:23:18.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.978+0000 7fd3f4616700 1 Processor -- start 2024-04-25T02:23:18.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.979+0000 7fd3f4616700 1 -- start start 2024-04-25T02:23:18.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.979+0000 7fd3f4616700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd3ec0a59e0 0x7fd3ec13fc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:18.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.979+0000 7fd3f4616700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fd3ec140170 0x7fd3ec146b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:18.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.979+0000 7fd3f4616700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3ec0a4d20 con 0x7fd3ec0b3160 2024-04-25T02:23:18.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.979+0000 7fd3f4616700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3ec06f790 con 0x7fd3ec140170 2024-04-25T02:23:18.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.979+0000 7fd3f4616700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ec0a4850 con 0x7fd3ec0a59e0 2024-04-25T02:23:18.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.979+0000 7fd3f1bb1700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd3ec0a59e0 0x7fd3ec13fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:18.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.979+0000 7fd3f2bb3700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fd3ec140170 0x7fd3ec146b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:18.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.979+0000 7fd3f23b2700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7fd3ec0b3160 0x7fd3ec0a4140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:43918/0 (socket says 172.21.15.111:43918) 2024-04-25T02:23:18.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.979+0000 7fd3f23b2700 1 -- 172.21.15.111:0/1851390613 learned_addr learned my addr 172.21.15.111:0/1851390613 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:23:18.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.980+0000 7fd3f1bb1700 1 -- 172.21.15.111:0/1851390613 >> v2:172.21.15.111:3300/0 conn(0x7fd3ec140170 msgr2=0x7fd3ec146b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:18.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.980+0000 7fd3f1bb1700 1 --2- 172.21.15.111:0/1851390613 >> v2:172.21.15.111:3300/0 conn(0x7fd3ec140170 0x7fd3ec146b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:18.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.980+0000 7fd3f1bb1700 1 -- 172.21.15.111:0/1851390613 >> v1:172.21.15.111:6789/0 conn(0x7fd3ec0b3160 legacy=0x7fd3ec0a4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:18.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.980+0000 7fd3f1bb1700 1 -- 172.21.15.111:0/1851390613 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3ec13f970 con 0x7fd3ec0a59e0 2024-04-25T02:23:18.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.980+0000 7fd3f2bb3700 1 --2- 172.21.15.111:0/1851390613 >> v2:172.21.15.111:3300/0 conn(0x7fd3ec140170 0x7fd3ec146b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:18.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.980+0000 7fd3f1bb1700 1 --2- 172.21.15.111:0/1851390613 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd3ec0a59e0 0x7fd3ec13fc30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd3e80098e0 tx=0x7fd3e80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ab374d7ecaca841 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:18.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.980+0000 7fd3f13b0700 1 -- 172.21.15.111:0/1851390613 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e800b640 con 0x7fd3ec0a59e0 2024-04-25T02:23:18.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.980+0000 7fd3f13b0700 1 -- 172.21.15.111:0/1851390613 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e800b7a0 con 0x7fd3ec0a59e0 2024-04-25T02:23:18.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.980+0000 7fd3f13b0700 1 -- 172.21.15.111:0/1851390613 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e800bb40 con 0x7fd3ec0a59e0 2024-04-25T02:23:18.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.980+0000 7fd3f4616700 1 -- 172.21.15.111:0/1851390613 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd3ec0a59e0 msgr2=0x7fd3ec13fc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:18.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.980+0000 7fd3f4616700 1 --2- 172.21.15.111:0/1851390613 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd3ec0a59e0 0x7fd3ec13fc30 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd3e80098e0 tx=0x7fd3e80091a0 comp rx=0 tx=0).stop 2024-04-25T02:23:18.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.981+0000 7fd3f4616700 1 -- 172.21.15.111:0/1851390613 shutdown_connections 2024-04-25T02:23:18.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.981+0000 7fd3f4616700 1 --2- 172.21.15.111:0/1851390613 >> v2:172.21.15.111:3300/0 conn(0x7fd3ec140170 0x7fd3ec146b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:18.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.981+0000 7fd3f4616700 1 --2- 172.21.15.111:0/1851390613 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd3ec0a59e0 0x7fd3ec13fc30 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:18.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.981+0000 7fd3f4616700 1 -- 172.21.15.111:0/1851390613 >> 172.21.15.111:0/1851390613 conn(0x7fd3ec06b210 msgr2=0x7fd3ec06ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:18.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.981+0000 7fd3f4616700 1 -- 172.21.15.111:0/1851390613 shutdown_connections 2024-04-25T02:23:18.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.981+0000 7fd3f4616700 1 -- 172.21.15.111:0/1851390613 wait complete. 2024-04-25T02:23:18.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.981+0000 7fd3f4616700 1 Processor -- start 2024-04-25T02:23:18.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.982+0000 7fd3f4616700 1 -- start start 2024-04-25T02:23:18.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.982+0000 7fd3f4616700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd3ec0a59e0 0x7fd3ec14c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:18.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.982+0000 7fd3f4616700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd3ec0b3160 0x7fd3ec14c6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:18.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.982+0000 7fd3f4616700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd3ec140170 0x7fd3ec14cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:18.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.982+0000 7fd3f4616700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ec0aa730 con 0x7fd3ec0b3160 2024-04-25T02:23:18.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.982+0000 7fd3f4616700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ec0aa9d0 con 0x7fd3ec140170 2024-04-25T02:23:18.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.982+0000 7fd3f4616700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ec0ac230 con 0x7fd3ec0a59e0 2024-04-25T02:23:18.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.982+0000 7fd3f23b2700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd3ec0a59e0 0x7fd3ec14c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:18.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.982+0000 7fd3f1bb1700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd3ec0b3160 0x7fd3ec14c6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:18.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.982+0000 7fd3f1bb1700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd3ec0b3160 0x7fd3ec14c6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:35440/0 (socket says 172.21.15.111:35440) 2024-04-25T02:23:18.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.982+0000 7fd3f2bb3700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd3ec140170 0x7fd3ec14cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:18.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.982+0000 7fd3f23b2700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd3ec0a59e0 0x7fd3ec14c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:33158/0 (socket says 172.21.15.111:33158) 2024-04-25T02:23:18.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.982+0000 7fd3f1bb1700 1 -- 172.21.15.111:0/2910887923 learned_addr learned my addr 172.21.15.111:0/2910887923 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:18.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.982+0000 7fd3f1bb1700 1 -- 172.21.15.111:0/2910887923 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd3ec0a59e0 msgr2=0x7fd3ec14c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:18.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.982+0000 7fd3f1bb1700 1 --2- 172.21.15.111:0/2910887923 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd3ec0a59e0 0x7fd3ec14c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:18.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.982+0000 7fd3f1bb1700 1 -- 172.21.15.111:0/2910887923 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd3ec140170 msgr2=0x7fd3ec14cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:18.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.982+0000 7fd3f1bb1700 1 --2- 172.21.15.111:0/2910887923 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd3ec140170 0x7fd3ec14cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:18.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.982+0000 7fd3f1bb1700 1 -- 172.21.15.111:0/2910887923 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3e4009a20 con 0x7fd3ec0b3160 2024-04-25T02:23:18.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.982+0000 7fd3f2bb3700 1 --2- 172.21.15.111:0/2910887923 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd3ec140170 0x7fd3ec14cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:18.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.983+0000 7fd3f1bb1700 1 --2- 172.21.15.111:0/2910887923 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd3ec0b3160 0x7fd3ec14c6b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec0a4990 tx=0x7fd3e8017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:18.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.983+0000 7fd3e27fc700 1 -- 172.21.15.111:0/2910887923 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e801bcf0 con 0x7fd3ec0b3160 2024-04-25T02:23:18.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.983+0000 7fd3e27fc700 1 -- 172.21.15.111:0/2910887923 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3e801be90 con 0x7fd3ec0b3160 2024-04-25T02:23:18.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.983+0000 7fd3f4616700 1 -- 172.21.15.111:0/2910887923 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3e8009420 con 0x7fd3ec0b3160 2024-04-25T02:23:18.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.983+0000 7fd3e27fc700 1 -- 172.21.15.111:0/2910887923 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3e8011670 con 0x7fd3ec0b3160 2024-04-25T02:23:18.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.983+0000 7fd3f4616700 1 -- 172.21.15.111:0/2910887923 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3ec141aa0 con 0x7fd3ec0b3160 2024-04-25T02:23:18.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.984+0000 7fd3f4616700 1 -- 172.21.15.111:0/2910887923 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3ec072200 con 0x7fd3ec0b3160 2024-04-25T02:23:18.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.984+0000 7fd3e27fc700 1 -- 172.21.15.111:0/2910887923 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7fd3e80119e0 con 0x7fd3ec0b3160 2024-04-25T02:23:18.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.984+0000 7fd3e27fc700 1 -- 172.21.15.111:0/2910887923 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fd3e805c6c0 con 0x7fd3ec0b3160 2024-04-25T02:23:18.991 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:18.988+0000 7fd3e27fc700 1 -- 172.21.15.111:0/2910887923 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fd3e803e5a0 con 0x7fd3ec0b3160 2024-04-25T02:23:19.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.141+0000 7fd3f4616700 1 -- 172.21.15.111:0/2910887923 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "rbd", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7fd3ec13f4f0 con 0x7fd3ec0b3160 2024-04-25T02:23:19.881 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.877+0000 7fd3e27fc700 1 -- 172.21.15.111:0/2910887923 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "rbd", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 2 pg_autoscale_mode to off v38) v1 ==== 152+0+0 (secure 0 0 0) 0x7fd3e8015020 con 0x7fd3ec0b3160 2024-04-25T02:23:19.885 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.881+0000 7fd3f4616700 1 -- 172.21.15.111:0/2910887923 >> v1:172.21.15.111:6816/46482 conn(0x7fd3d0046010 legacy=0x7fd3d00484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:19.885 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.881+0000 7fd3f4616700 1 -- 172.21.15.111:0/2910887923 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd3ec0b3160 msgr2=0x7fd3ec14c6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:19.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.881+0000 7fd3f4616700 1 --2- 172.21.15.111:0/2910887923 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd3ec0b3160 0x7fd3ec14c6b0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fd3ec0a4990 tx=0x7fd3e8017000 comp rx=0 tx=0).stop 2024-04-25T02:23:19.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.882+0000 7fd3f4616700 1 -- 172.21.15.111:0/2910887923 shutdown_connections 2024-04-25T02:23:19.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.882+0000 7fd3f4616700 1 --2- 172.21.15.111:0/2910887923 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd3ec140170 0x7fd3ec14cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:19.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.882+0000 7fd3f4616700 1 --2- 172.21.15.111:0/2910887923 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd3ec0a59e0 0x7fd3ec14c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:19.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.882+0000 7fd3f4616700 1 --2- 172.21.15.111:0/2910887923 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd3ec0b3160 0x7fd3ec14c6b0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:19.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.882+0000 7fd3f4616700 1 -- 172.21.15.111:0/2910887923 >> 172.21.15.111:0/2910887923 conn(0x7fd3ec06b210 msgr2=0x7fd3ec0b1130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:19.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.882+0000 7fd3f4616700 1 -- 172.21.15.111:0/2910887923 shutdown_connections 2024-04-25T02:23:19.886 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.882+0000 7fd3f4616700 1 -- 172.21.15.111:0/2910887923 wait complete. 2024-04-25T02:23:19.886 INFO:teuthology.orchestra.run.smithi111.stderr:set pool 2 pg_autoscale_mode to off 2024-04-25T02:23:19.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.985+0000 7fe6c6ac0700 1 Processor -- start 2024-04-25T02:23:19.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.985+0000 7fe6c6ac0700 1 -- start start 2024-04-25T02:23:19.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.986+0000 7fe6c6ac0700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe6c00a36c0 0x7fe6c00a5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:19.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.986+0000 7fe6c6ac0700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fe6c006e5e0 0x7fe6c0068090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:19.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.986+0000 7fe6c6ac0700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6c006ebe0 con 0x7fe6c006e210 2024-04-25T02:23:19.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.986+0000 7fe6c6ac0700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6c006ee80 con 0x7fe6c006e5e0 2024-04-25T02:23:19.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.986+0000 7fe6c6ac0700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c00b0730 con 0x7fe6c00a36c0 2024-04-25T02:23:19.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.986+0000 7fe6c485c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe6c00a36c0 0x7fe6c00a5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:19.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.986+0000 7fe6c505d700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fe6c006e5e0 0x7fe6c0068090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:19.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.986+0000 7fe6c485c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe6c00a36c0 0x7fe6c00a5340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:33172/0 (socket says 172.21.15.111:33172) 2024-04-25T02:23:19.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.986+0000 7fe6c485c700 1 -- 172.21.15.111:0/2290397881 learned_addr learned my addr 172.21.15.111:0/2290397881 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:19.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.986+0000 7fe6bffff700 1 --1- 172.21.15.111:0/2290397881 >> v1:172.21.15.111:6789/0 conn(0x7fe6c006e210 0x7fe6c0067980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:43930/0 (socket says 172.21.15.111:43930) 2024-04-25T02:23:19.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.986+0000 7fe6c485c700 1 -- 172.21.15.111:0/2290397881 >> v2:172.21.15.111:3300/0 conn(0x7fe6c006e5e0 msgr2=0x7fe6c0068090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:19.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.986+0000 7fe6c485c700 1 --2- 172.21.15.111:0/2290397881 >> v2:172.21.15.111:3300/0 conn(0x7fe6c006e5e0 0x7fe6c0068090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:19.992 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.986+0000 7fe6c485c700 1 -- 172.21.15.111:0/2290397881 >> v1:172.21.15.111:6789/0 conn(0x7fe6c006e210 legacy=0x7fe6c0067980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:19.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.986+0000 7fe6c485c700 1 -- 172.21.15.111:0/2290397881 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6c006f4c0 con 0x7fe6c00a36c0 2024-04-25T02:23:19.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.987+0000 7fe6c485c700 1 --2- 172.21.15.111:0/2290397881 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe6c00a36c0 0x7fe6c00a5340 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe6b40099e0 tx=0x7fe6b4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=94b06733bfcfd518 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:19.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.987+0000 7fe6bf7fe700 1 -- 172.21.15.111:0/2290397881 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b400b820 con 0x7fe6c00a36c0 2024-04-25T02:23:19.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.987+0000 7fe6bf7fe700 1 -- 172.21.15.111:0/2290397881 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6b400b980 con 0x7fe6c00a36c0 2024-04-25T02:23:19.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.987+0000 7fe6bf7fe700 1 -- 172.21.15.111:0/2290397881 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b400bd20 con 0x7fe6c00a36c0 2024-04-25T02:23:19.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.987+0000 7fe6c6ac0700 1 -- 172.21.15.111:0/2290397881 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe6c00a36c0 msgr2=0x7fe6c00a5340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:19.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.987+0000 7fe6c6ac0700 1 --2- 172.21.15.111:0/2290397881 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe6c00a36c0 0x7fe6c00a5340 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fe6b40099e0 tx=0x7fe6b4009250 comp rx=0 tx=0).stop 2024-04-25T02:23:19.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.987+0000 7fe6c6ac0700 1 -- 172.21.15.111:0/2290397881 shutdown_connections 2024-04-25T02:23:19.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.987+0000 7fe6c6ac0700 1 --2- 172.21.15.111:0/2290397881 >> v2:172.21.15.111:3300/0 conn(0x7fe6c006e5e0 0x7fe6c0068090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:19.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.987+0000 7fe6c6ac0700 1 --2- 172.21.15.111:0/2290397881 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe6c00a36c0 0x7fe6c00a5340 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:19.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.987+0000 7fe6c6ac0700 1 -- 172.21.15.111:0/2290397881 >> 172.21.15.111:0/2290397881 conn(0x7fe6c006b210 msgr2=0x7fe6c006ce30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:19.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.987+0000 7fe6c6ac0700 1 -- 172.21.15.111:0/2290397881 shutdown_connections 2024-04-25T02:23:19.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.987+0000 7fe6c6ac0700 1 -- 172.21.15.111:0/2290397881 wait complete. 2024-04-25T02:23:19.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.988+0000 7fe6c6ac0700 1 Processor -- start 2024-04-25T02:23:19.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.988+0000 7fe6c6ac0700 1 -- start start 2024-04-25T02:23:19.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.989+0000 7fe6c6ac0700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe6c006e210 0x7fe6c00aee30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:19.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.989+0000 7fe6c6ac0700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe6c006e5e0 0x7fe6c00ad680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:19.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.989+0000 7fe6c6ac0700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe6c00a36c0 0x7fe6c014e190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:19.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.989+0000 7fe6c6ac0700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c014ba10 con 0x7fe6c00a36c0 2024-04-25T02:23:19.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.989+0000 7fe6c6ac0700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c00ac1b0 con 0x7fe6c006e210 2024-04-25T02:23:19.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.989+0000 7fe6c6ac0700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe6c00acce0 con 0x7fe6c006e5e0 2024-04-25T02:23:19.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.989+0000 7fe6c505d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe6c00a36c0 0x7fe6c014e190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:19.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.989+0000 7fe6c485c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe6c006e210 0x7fe6c00aee30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:19.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.989+0000 7fe6c505d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe6c00a36c0 0x7fe6c014e190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:35458/0 (socket says 172.21.15.111:35458) 2024-04-25T02:23:19.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.989+0000 7fe6c485c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe6c006e210 0x7fe6c00aee30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:57522/0 (socket says 172.21.15.111:57522) 2024-04-25T02:23:19.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.989+0000 7fe6bffff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe6c006e5e0 0x7fe6c00ad680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:19.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.989+0000 7fe6c505d700 1 -- 172.21.15.111:0/3503603775 learned_addr learned my addr 172.21.15.111:0/3503603775 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:19.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.989+0000 7fe6c505d700 1 -- 172.21.15.111:0/3503603775 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe6c006e5e0 msgr2=0x7fe6c00ad680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:19.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.989+0000 7fe6c505d700 1 --2- 172.21.15.111:0/3503603775 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe6c006e5e0 0x7fe6c00ad680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:19.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.989+0000 7fe6c505d700 1 -- 172.21.15.111:0/3503603775 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe6c006e210 msgr2=0x7fe6c00aee30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:19.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.989+0000 7fe6c505d700 1 --2- 172.21.15.111:0/3503603775 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe6c006e210 0x7fe6c00aee30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:19.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.989+0000 7fe6c505d700 1 -- 172.21.15.111:0/3503603775 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6b40094f0 con 0x7fe6c00a36c0 2024-04-25T02:23:19.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.989+0000 7fe6c485c700 1 --2- 172.21.15.111:0/3503603775 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe6c006e210 0x7fe6c00aee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:19.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.989+0000 7fe6c505d700 1 --2- 172.21.15.111:0/3503603775 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe6c00a36c0 0x7fe6c014e190 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8009e90 tx=0x7fe6b800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:19.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.989+0000 7fe6bcff9700 1 -- 172.21.15.111:0/3503603775 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b800cc00 con 0x7fe6c00a36c0 2024-04-25T02:23:19.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.990+0000 7fe6bcff9700 1 -- 172.21.15.111:0/3503603775 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6b800f040 con 0x7fe6c00a36c0 2024-04-25T02:23:19.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.990+0000 7fe6c6ac0700 1 -- 172.21.15.111:0/3503603775 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6c00ae050 con 0x7fe6c00a36c0 2024-04-25T02:23:19.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.990+0000 7fe6bcff9700 1 -- 172.21.15.111:0/3503603775 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6b8014480 con 0x7fe6c00a36c0 2024-04-25T02:23:19.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.990+0000 7fe6c6ac0700 1 -- 172.21.15.111:0/3503603775 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6c014dd70 con 0x7fe6c00a36c0 2024-04-25T02:23:19.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.991+0000 7fe6bcff9700 1 -- 172.21.15.111:0/3503603775 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7fe6b80147f0 con 0x7fe6c00a36c0 2024-04-25T02:23:19.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.991+0000 7fe6c6ac0700 1 -- 172.21.15.111:0/3503603775 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6c0072200 con 0x7fe6c00a36c0 2024-04-25T02:23:19.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.991+0000 7fe6bcff9700 1 -- 172.21.15.111:0/3503603775 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fe6b805bf70 con 0x7fe6c00a36c0 2024-04-25T02:23:19.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:19.994+0000 7fe6bcff9700 1 -- 172.21.15.111:0/3503603775 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fe6b8085260 con 0x7fe6c00a36c0 2024-04-25T02:23:20.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.149+0000 7fe6c6ac0700 1 -- 172.21.15.111:0/3503603775 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_metadata", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7fe6c006d540 con 0x7fe6c00a36c0 2024-04-25T02:23:20.879 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.875+0000 7fe6bcff9700 1 -- 172.21.15.111:0/3503603775 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_metadata", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 3 pg_autoscale_mode to off v39) v1 ==== 164+0+0 (secure 0 0 0) 0x7fe6b8018070 con 0x7fe6c00a36c0 2024-04-25T02:23:20.882 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.879+0000 7fe6c6ac0700 1 -- 172.21.15.111:0/3503603775 >> v1:172.21.15.111:6816/46482 conn(0x7fe6a4046010 legacy=0x7fe6a40484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:20.882 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.879+0000 7fe6c6ac0700 1 -- 172.21.15.111:0/3503603775 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe6c00a36c0 msgr2=0x7fe6c014e190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:20.883 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.879+0000 7fe6c6ac0700 1 --2- 172.21.15.111:0/3503603775 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe6c00a36c0 0x7fe6c014e190 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fe6b8009e90 tx=0x7fe6b800b040 comp rx=0 tx=0).stop 2024-04-25T02:23:20.883 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.880+0000 7fe6c6ac0700 1 -- 172.21.15.111:0/3503603775 shutdown_connections 2024-04-25T02:23:20.883 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.880+0000 7fe6c6ac0700 1 --2- 172.21.15.111:0/3503603775 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe6c00a36c0 0x7fe6c014e190 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:20.884 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.880+0000 7fe6c6ac0700 1 --2- 172.21.15.111:0/3503603775 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe6c006e210 0x7fe6c00aee30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:20.884 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.880+0000 7fe6c6ac0700 1 --2- 172.21.15.111:0/3503603775 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe6c006e5e0 0x7fe6c00ad680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:20.884 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.880+0000 7fe6c6ac0700 1 -- 172.21.15.111:0/3503603775 >> 172.21.15.111:0/3503603775 conn(0x7fe6c006b210 msgr2=0x7fe6c0064af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:20.884 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.880+0000 7fe6c6ac0700 1 -- 172.21.15.111:0/3503603775 shutdown_connections 2024-04-25T02:23:20.884 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.880+0000 7fe6c6ac0700 1 -- 172.21.15.111:0/3503603775 wait complete. 2024-04-25T02:23:20.884 INFO:teuthology.orchestra.run.smithi111.stderr:set pool 3 pg_autoscale_mode to off 2024-04-25T02:23:20.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.989+0000 7f007e768700 1 Processor -- start 2024-04-25T02:23:20.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.989+0000 7f007e768700 1 -- start start 2024-04-25T02:23:20.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.990+0000 7f007e768700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f007806eaf0 0x7f0078143970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:20.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.990+0000 7f007e768700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f007813bfa0 0x7f0078145ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:20.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.990+0000 7f007e768700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f007806e130 con 0x7f00780682e0 2024-04-25T02:23:20.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.990+0000 7f007e768700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f007806dec0 con 0x7f007806eaf0 2024-04-25T02:23:20.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.990+0000 7f007e768700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f007806d1b0 con 0x7f007813bfa0 2024-04-25T02:23:20.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.990+0000 7f00777fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f007806eaf0 0x7f0078143970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:20.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.990+0000 7f0077fff700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f00780682e0 0x7f007813b890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:33676/0 (socket says 172.21.15.111:33676) 2024-04-25T02:23:20.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.990+0000 7f007cd05700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f007813bfa0 0x7f0078145ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:20.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.990+0000 7f0077fff700 1 -- 172.21.15.111:0/2419697361 learned_addr learned my addr 172.21.15.111:0/2419697361 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:23:20.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.990+0000 7f0076ffd700 1 -- 172.21.15.111:0/2419697361 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3848588085 0 0) 0x7f007806e130 con 0x7f00780682e0 2024-04-25T02:23:20.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.990+0000 7f007cd05700 1 -- 172.21.15.111:0/2419697361 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f007806eaf0 msgr2=0x7f0078143970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:20.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.990+0000 7f007cd05700 1 --2- 172.21.15.111:0/2419697361 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f007806eaf0 0x7f0078143970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:20.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.990+0000 7f007cd05700 1 -- 172.21.15.111:0/2419697361 >> v1:172.21.15.111:6789/0 conn(0x7f00780682e0 legacy=0x7f007813b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:20.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.990+0000 7f007cd05700 1 -- 172.21.15.111:0/2419697361 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f007806d450 con 0x7f007813bfa0 2024-04-25T02:23:20.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.990+0000 7f00777fe700 1 --2- 172.21.15.111:0/2419697361 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f007806eaf0 0x7f0078143970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:20.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.991+0000 7f007cd05700 1 --2- 172.21.15.111:0/2419697361 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f007813bfa0 0x7f0078145ec0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0070009e90 tx=0x7f0070009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a7f81b8883d97b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:20.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.991+0000 7f0076ffd700 1 -- 172.21.15.111:0/2419697361 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f007000e070 con 0x7f007813bfa0 2024-04-25T02:23:20.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.991+0000 7f0076ffd700 1 -- 172.21.15.111:0/2419697361 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f007000bc30 con 0x7f007813bfa0 2024-04-25T02:23:20.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.991+0000 7f0076ffd700 1 -- 172.21.15.111:0/2419697361 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0070012430 con 0x7f007813bfa0 2024-04-25T02:23:20.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.991+0000 7f007e768700 1 -- 172.21.15.111:0/2419697361 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f007813bfa0 msgr2=0x7f0078145ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:20.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.991+0000 7f007e768700 1 --2- 172.21.15.111:0/2419697361 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f007813bfa0 0x7f0078145ec0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f0070009e90 tx=0x7f0070009780 comp rx=0 tx=0).stop 2024-04-25T02:23:20.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.991+0000 7f007e768700 1 -- 172.21.15.111:0/2419697361 shutdown_connections 2024-04-25T02:23:20.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.991+0000 7f007e768700 1 --2- 172.21.15.111:0/2419697361 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f007813bfa0 0x7f0078145ec0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:20.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.991+0000 7f007e768700 1 --2- 172.21.15.111:0/2419697361 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f007806eaf0 0x7f0078143970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:20.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.991+0000 7f007e768700 1 -- 172.21.15.111:0/2419697361 >> 172.21.15.111:0/2419697361 conn(0x7f0078069ce0 msgr2=0x7f0078067980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:20.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.991+0000 7f007e768700 1 -- 172.21.15.111:0/2419697361 shutdown_connections 2024-04-25T02:23:20.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.991+0000 7f007e768700 1 -- 172.21.15.111:0/2419697361 wait complete. 2024-04-25T02:23:21.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.993+0000 7f007e768700 1 Processor -- start 2024-04-25T02:23:21.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.993+0000 7f007e768700 1 -- start start 2024-04-25T02:23:21.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.993+0000 7f007e768700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f00780682e0 0x7f00780a9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:21.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.993+0000 7f007e768700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f007806eaf0 0x7f007814df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:21.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.993+0000 7f007e768700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f007813bfa0 0x7f007814e470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:21.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.993+0000 7f007e768700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00780a6d80 con 0x7f00780682e0 2024-04-25T02:23:21.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.993+0000 7f007e768700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00780a9f60 con 0x7f007813bfa0 2024-04-25T02:23:21.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.993+0000 7f007e768700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f00780aab60 con 0x7f007806eaf0 2024-04-25T02:23:21.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.993+0000 7f00777fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f007806eaf0 0x7f007814df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:21.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.993+0000 7f007cd05700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f007813bfa0 0x7f007814e470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:21.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.993+0000 7f0077fff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f00780682e0 0x7f00780a9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:21.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.993+0000 7f00777fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f007806eaf0 0x7f007814df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:40930/0 (socket says 172.21.15.111:40930) 2024-04-25T02:23:21.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.993+0000 7f007cd05700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f007813bfa0 0x7f007814e470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:35328/0 (socket says 172.21.15.111:35328) 2024-04-25T02:23:21.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.993+0000 7f00777fe700 1 -- 172.21.15.111:0/3878485738 learned_addr learned my addr 172.21.15.111:0/3878485738 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:21.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.994+0000 7f007cd05700 1 -- 172.21.15.111:0/3878485738 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f007806eaf0 msgr2=0x7f007814df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:21.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.994+0000 7f007cd05700 1 --2- 172.21.15.111:0/3878485738 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f007806eaf0 0x7f007814df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:21.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.994+0000 7f007cd05700 1 -- 172.21.15.111:0/3878485738 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f00780682e0 msgr2=0x7f00780a9a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:21.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.994+0000 7f007cd05700 1 --2- 172.21.15.111:0/3878485738 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f00780682e0 0x7f00780a9a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:21.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.994+0000 7f007cd05700 1 -- 172.21.15.111:0/3878485738 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0068009420 con 0x7f007813bfa0 2024-04-25T02:23:21.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.994+0000 7f00777fe700 1 --2- 172.21.15.111:0/3878485738 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f007806eaf0 0x7f007814df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:21.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.994+0000 7f007cd05700 1 --2- 172.21.15.111:0/3878485738 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f007813bfa0 0x7f007814e470 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0070016000 tx=0x7f0070019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:21.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.994+0000 7f005ffff700 1 -- 172.21.15.111:0/3878485738 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0070027470 con 0x7f007813bfa0 2024-04-25T02:23:21.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.994+0000 7f005ffff700 1 -- 172.21.15.111:0/3878485738 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0070027610 con 0x7f007813bfa0 2024-04-25T02:23:21.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.994+0000 7f007e768700 1 -- 172.21.15.111:0/3878485738 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0070009a20 con 0x7f007813bfa0 2024-04-25T02:23:21.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.994+0000 7f005ffff700 1 -- 172.21.15.111:0/3878485738 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00700279d0 con 0x7f007813bfa0 2024-04-25T02:23:21.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.994+0000 7f007e768700 1 -- 172.21.15.111:0/3878485738 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00780a9000 con 0x7f007813bfa0 2024-04-25T02:23:21.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.995+0000 7f005ffff700 1 -- 172.21.15.111:0/3878485738 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f0070024070 con 0x7f007813bfa0 2024-04-25T02:23:21.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.995+0000 7f007e768700 1 -- 172.21.15.111:0/3878485738 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f00780ab560 con 0x7f007813bfa0 2024-04-25T02:23:21.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.995+0000 7f005ffff700 1 -- 172.21.15.111:0/3878485738 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(39..39 src has 1..39) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f007005d920 con 0x7f007813bfa0 2024-04-25T02:23:21.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:20.999+0000 7f005ffff700 1 -- 172.21.15.111:0/3878485738 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f0070029e70 con 0x7f007813bfa0 2024-04-25T02:23:21.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:21.155+0000 7f007e768700 1 -- 172.21.15.111:0/3878485738 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data", "var": "pg_autoscale_mode", "val": "off"} v 0) v1 -- 0x7f0078072200 con 0x7f007813bfa0 2024-04-25T02:23:21.852 INFO:tasks.ceph.mds.b.smithi111.stderr:2024-04-25T02:23:21.848+0000 7fc0fc177700 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-04-25T02:23:21.883 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:21.880+0000 7f005ffff700 1 -- 172.21.15.111:0/3878485738 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data", "var": "pg_autoscale_mode", "val": "off"}]=0 set pool 4 pg_autoscale_mode to off v40) v1 ==== 160+0+0 (secure 0 0 0) 0x7f00700298d0 con 0x7f007813bfa0 2024-04-25T02:23:21.887 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:21.883+0000 7f007e768700 1 -- 172.21.15.111:0/3878485738 >> v1:172.21.15.111:6816/46482 conn(0x7f0064046010 legacy=0x7f00640484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:21.887 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:21.883+0000 7f007e768700 1 -- 172.21.15.111:0/3878485738 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f007813bfa0 msgr2=0x7f007814e470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:21.887 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:21.883+0000 7f007e768700 1 --2- 172.21.15.111:0/3878485738 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f007813bfa0 0x7f007814e470 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f0070016000 tx=0x7f0070019000 comp rx=0 tx=0).stop 2024-04-25T02:23:21.887 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:21.883+0000 7f007e768700 1 -- 172.21.15.111:0/3878485738 shutdown_connections 2024-04-25T02:23:21.887 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:21.883+0000 7f007e768700 1 --2- 172.21.15.111:0/3878485738 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f007813bfa0 0x7f007814e470 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:21.887 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:21.883+0000 7f007e768700 1 --2- 172.21.15.111:0/3878485738 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f00780682e0 0x7f00780a9a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:21.887 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:21.883+0000 7f007e768700 1 --2- 172.21.15.111:0/3878485738 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f007806eaf0 0x7f007814df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:21.888 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:21.883+0000 7f007e768700 1 -- 172.21.15.111:0/3878485738 >> 172.21.15.111:0/3878485738 conn(0x7f0078069ce0 msgr2=0x7f00780a2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:21.888 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:21.883+0000 7f007e768700 1 -- 172.21.15.111:0/3878485738 shutdown_connections 2024-04-25T02:23:21.888 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:21.883+0000 7f007e768700 1 -- 172.21.15.111:0/3878485738 wait complete. 2024-04-25T02:23:21.888 INFO:teuthology.orchestra.run.smithi111.stderr:set pool 4 pg_autoscale_mode to off 2024-04-25T02:23:21.901 INFO:teuthology.run_tasks:Running task ceph.healthy... 2024-04-25T02:23:21.912 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-25T02:23:21.912 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-25T02:23:21.912 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-25T02:23:22.034 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.030+0000 7f0b275cd700 1 Processor -- start 2024-04-25T02:23:22.034 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.030+0000 7f0b275cd700 1 -- start start 2024-04-25T02:23:22.036 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.031+0000 7f0b275cd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0b200a3410 0x7f0b200a4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:22.036 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.031+0000 7f0b275cd700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f0b200a22a0 0x7f0b2013e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:22.036 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.031+0000 7f0b275cd700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b2006da60 con 0x7f0b2013eb60 2024-04-25T02:23:22.037 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.031+0000 7f0b275cd700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b200a2a20 con 0x7f0b200a22a0 2024-04-25T02:23:22.037 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.031+0000 7f0b275cd700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b200a3c80 con 0x7f0b200a3410 2024-04-25T02:23:22.037 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.031+0000 7f0b25369700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0b200a3410 0x7f0b200a4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:22.037 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.031+0000 7f0b24b68700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f0b200a22a0 0x7f0b2013e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:22.037 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.031+0000 7f0b24b68700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f0b200a22a0 0x7f0b2013e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:60250/0 (socket says 172.21.15.111:60250) 2024-04-25T02:23:22.037 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.031+0000 7f0b25369700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0b200a3410 0x7f0b200a4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:35334/0 (socket says 172.21.15.111:35334) 2024-04-25T02:23:22.037 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.031+0000 7f0b24b68700 1 -- 172.21.15.111:0/3551759178 learned_addr learned my addr 172.21.15.111:0/3551759178 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:22.037 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.031+0000 7f0b25b6a700 1 --1- 172.21.15.111:0/3551759178 >> v1:172.21.15.111:6789/0 conn(0x7f0b2013eb60 0x7f0b2013b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:33686/0 (socket says 172.21.15.111:33686) 2024-04-25T02:23:22.037 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.031+0000 7f0b24b68700 1 -- 172.21.15.111:0/3551759178 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0b200a3410 msgr2=0x7f0b200a4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:22.037 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.031+0000 7f0b24b68700 1 --2- 172.21.15.111:0/3551759178 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0b200a3410 0x7f0b200a4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:22.037 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.031+0000 7f0b24b68700 1 -- 172.21.15.111:0/3551759178 >> v1:172.21.15.111:6789/0 conn(0x7f0b2013eb60 legacy=0x7f0b2013b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:22.037 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.031+0000 7f0b17fff700 1 -- 172.21.15.111:0/3551759178 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4064945501 0 0) 0x7f0b2006da60 con 0x7f0b2013eb60 2024-04-25T02:23:22.037 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.031+0000 7f0b24b68700 1 -- 172.21.15.111:0/3551759178 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b200a37e0 con 0x7f0b200a22a0 2024-04-25T02:23:22.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.031+0000 7f0b25369700 1 --2- 172.21.15.111:0/3551759178 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0b200a3410 0x7f0b200a4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:22.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.031+0000 7f0b24b68700 1 --2- 172.21.15.111:0/3551759178 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0b200a22a0 0x7f0b2013e620 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c00bc50 tx=0x7f0b1c00b4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c42f6cbdfa5e02a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:22.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.031+0000 7f0b17fff700 1 -- 172.21.15.111:0/3551759178 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c00dbf0 con 0x7f0b200a22a0 2024-04-25T02:23:22.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.031+0000 7f0b17fff700 1 -- 172.21.15.111:0/3551759178 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b1c00dd50 con 0x7f0b200a22a0 2024-04-25T02:23:22.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.031+0000 7f0b17fff700 1 -- 172.21.15.111:0/3551759178 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1c0196b0 con 0x7f0b200a22a0 2024-04-25T02:23:22.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.032+0000 7f0b275cd700 1 -- 172.21.15.111:0/3551759178 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0b200a22a0 msgr2=0x7f0b2013e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:22.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.032+0000 7f0b275cd700 1 --2- 172.21.15.111:0/3551759178 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0b200a22a0 0x7f0b2013e620 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f0b1c00bc50 tx=0x7f0b1c00b4f0 comp rx=0 tx=0).stop 2024-04-25T02:23:22.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.032+0000 7f0b275cd700 1 -- 172.21.15.111:0/3551759178 shutdown_connections 2024-04-25T02:23:22.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.032+0000 7f0b275cd700 1 --2- 172.21.15.111:0/3551759178 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0b200a3410 0x7f0b200a4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:22.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.032+0000 7f0b275cd700 1 --2- 172.21.15.111:0/3551759178 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0b200a22a0 0x7f0b2013e620 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:22.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.032+0000 7f0b275cd700 1 -- 172.21.15.111:0/3551759178 >> 172.21.15.111:0/3551759178 conn(0x7f0b200b1cf0 msgr2=0x7f0b200b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:22.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.032+0000 7f0b275cd700 1 -- 172.21.15.111:0/3551759178 shutdown_connections 2024-04-25T02:23:22.038 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.032+0000 7f0b275cd700 1 -- 172.21.15.111:0/3551759178 wait complete. 2024-04-25T02:23:22.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.033+0000 7f0b275cd700 1 Processor -- start 2024-04-25T02:23:22.039 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.033+0000 7f0b275cd700 1 -- start start 2024-04-25T02:23:22.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.034+0000 7f0b275cd700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0b200a22a0 0x7f0b200acfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:22.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.034+0000 7f0b275cd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0b200a3410 0x7f0b2014d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:22.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.034+0000 7f0b275cd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0b2013eb60 0x7f0b2014d550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:22.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.034+0000 7f0b275cd700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b200a9ee0 con 0x7f0b2013eb60 2024-04-25T02:23:22.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.034+0000 7f0b275cd700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b200aacb0 con 0x7f0b200a3410 2024-04-25T02:23:22.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.034+0000 7f0b275cd700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0b200aaf70 con 0x7f0b200a22a0 2024-04-25T02:23:22.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.034+0000 7f0b25369700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0b200a22a0 0x7f0b200acfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:22.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.034+0000 7f0b24b68700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0b200a3410 0x7f0b2014d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:22.041 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.034+0000 7f0b25b6a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0b2013eb60 0x7f0b2014d550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:22.042 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.034+0000 7f0b25369700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0b200a22a0 0x7f0b200acfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:40934/0 (socket says 172.21.15.111:40934) 2024-04-25T02:23:22.042 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.034+0000 7f0b25369700 1 -- 172.21.15.111:0/2049212866 learned_addr learned my addr 172.21.15.111:0/2049212866 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:22.042 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.034+0000 7f0b25369700 1 -- 172.21.15.111:0/2049212866 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0b200a3410 msgr2=0x7f0b2014d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:22.042 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.034+0000 7f0b25369700 1 --2- 172.21.15.111:0/2049212866 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0b200a3410 0x7f0b2014d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:22.042 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.034+0000 7f0b25369700 1 -- 172.21.15.111:0/2049212866 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0b2013eb60 msgr2=0x7f0b2014d550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:22.042 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.034+0000 7f0b25369700 1 --2- 172.21.15.111:0/2049212866 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0b2013eb60 0x7f0b2014d550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:22.042 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.034+0000 7f0b25369700 1 -- 172.21.15.111:0/2049212866 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b10009420 con 0x7f0b200a22a0 2024-04-25T02:23:22.042 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.034+0000 7f0b24b68700 1 --2- 172.21.15.111:0/2049212866 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0b200a3410 0x7f0b2014d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:22.042 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.034+0000 7f0b25b6a700 1 --2- 172.21.15.111:0/2049212866 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0b2013eb60 0x7f0b2014d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:22.042 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.034+0000 7f0b25369700 1 --2- 172.21.15.111:0/2049212866 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0b200a22a0 0x7f0b200acfc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0b1000ec80 tx=0x7f0b100091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:22.042 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.034+0000 7f0b157fa700 1 -- 172.21.15.111:0/2049212866 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1000c920 con 0x7f0b200a22a0 2024-04-25T02:23:22.042 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.034+0000 7f0b157fa700 1 -- 172.21.15.111:0/2049212866 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b1000ca80 con 0x7f0b200a22a0 2024-04-25T02:23:22.042 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.034+0000 7f0b157fa700 1 -- 172.21.15.111:0/2049212866 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b1000ce00 con 0x7f0b200a22a0 2024-04-25T02:23:22.042 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.034+0000 7f0b275cd700 1 -- 172.21.15.111:0/2049212866 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b1c00b790 con 0x7f0b200a22a0 2024-04-25T02:23:22.043 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.034+0000 7f0b275cd700 1 -- 172.21.15.111:0/2049212866 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b200ac4e0 con 0x7f0b200a22a0 2024-04-25T02:23:22.043 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.035+0000 7f0b275cd700 1 -- 172.21.15.111:0/2049212866 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b2013d5e0 con 0x7f0b200a22a0 2024-04-25T02:23:22.043 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.036+0000 7f0b157fa700 1 -- 172.21.15.111:0/2049212866 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f0b10013680 con 0x7f0b200a22a0 2024-04-25T02:23:22.043 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.036+0000 7f0b157fa700 1 -- 172.21.15.111:0/2049212866 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f0b1005bce0 con 0x7f0b200a22a0 2024-04-25T02:23:22.043 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.039+0000 7f0b157fa700 1 -- 172.21.15.111:0/2049212866 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f0b1003a0f0 con 0x7f0b200a22a0 2024-04-25T02:23:22.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.230+0000 7f0b275cd700 1 -- 172.21.15.111:0/2049212866 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f0b2006fcc0 con 0x7f0b200a22a0 2024-04-25T02:23:22.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.232+0000 7f0b157fa700 1 -- 172.21.15.111:0/2049212866 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v10) v1 ==== 74+0+105284 (secure 0 0 0) 0x7f0b1003d710 con 0x7f0b200a22a0 2024-04-25T02:23:22.237 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:23:22.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.234+0000 7f0b275cd700 1 -- 172.21.15.111:0/2049212866 >> v1:172.21.15.111:6816/46482 conn(0x7f0b04046010 legacy=0x7f0b040484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:22.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.234+0000 7f0b275cd700 1 -- 172.21.15.111:0/2049212866 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0b200a22a0 msgr2=0x7f0b200acfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:22.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.234+0000 7f0b275cd700 1 --2- 172.21.15.111:0/2049212866 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0b200a22a0 0x7f0b200acfc0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f0b1000ec80 tx=0x7f0b100091a0 comp rx=0 tx=0).stop 2024-04-25T02:23:22.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.234+0000 7f0b275cd700 1 -- 172.21.15.111:0/2049212866 shutdown_connections 2024-04-25T02:23:22.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.234+0000 7f0b275cd700 1 --2- 172.21.15.111:0/2049212866 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0b2013eb60 0x7f0b2014d550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:22.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.234+0000 7f0b275cd700 1 --2- 172.21.15.111:0/2049212866 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0b200a22a0 0x7f0b200acfc0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:22.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.234+0000 7f0b275cd700 1 --2- 172.21.15.111:0/2049212866 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0b200a3410 0x7f0b2014d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:22.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.234+0000 7f0b275cd700 1 -- 172.21.15.111:0/2049212866 >> 172.21.15.111:0/2049212866 conn(0x7f0b200b1cf0 msgr2=0x7f0b200afc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:22.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.234+0000 7f0b275cd700 1 -- 172.21.15.111:0/2049212866 shutdown_connections 2024-04-25T02:23:22.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.234+0000 7f0b275cd700 1 -- 172.21.15.111:0/2049212866 wait complete. 2024-04-25T02:23:22.249 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":10,"flags":0,"active_gid":14107,"active_name":"y","active_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6816","nonce":46482}]},"active_addr":"172.21.15.111:6816/46482","active_change":"2024-04-25T02:22:54.713402+0000","active_mgr_features":4540138320759226367,"available":true,"standbys":[{"gid":14103,"name":"x","mgr_features":4540138320759226367,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":20,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.111:0","nonce":2040126233}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.111:0","nonce":3616562653}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.111:0","nonce":2753955981}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.111:0","nonce":1196847504}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.111:0","nonce":2037109459}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.111:0","nonce":3354937449}]}]} 2024-04-25T02:23:22.251 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-25T02:23:22.252 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-25T02:23:22.252 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:23:22.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.364+0000 7f3ce576d700 1 Processor -- start 2024-04-25T02:23:22.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.364+0000 7f3ce576d700 1 -- start start 2024-04-25T02:23:22.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.365+0000 7f3ce576d700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3ce00b4fd0 0x7f3ce00a2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:22.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.365+0000 7f3ce576d700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3ce00a3980 0x7f3ce00a3d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:22.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.365+0000 7f3ce576d700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ce00a46d0 con 0x7f3ce013ea00 2024-04-25T02:23:22.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.365+0000 7f3ce576d700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce00a6710 con 0x7f3ce00a3980 2024-04-25T02:23:22.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.365+0000 7f3ce576d700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce00a4930 con 0x7f3ce00b4fd0 2024-04-25T02:23:22.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.365+0000 7f3cdeffd700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3ce00b4fd0 0x7f3ce00a2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:22.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.365+0000 7f3cde7fc700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3ce00a3980 0x7f3ce00a3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:22.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.365+0000 7f3cdf7fe700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f3ce013ea00 0x7f3ce013eea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:33688/0 (socket says 172.21.15.111:33688) 2024-04-25T02:23:22.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.365+0000 7f3cdf7fe700 1 -- 172.21.15.111:0/425231639 learned_addr learned my addr 172.21.15.111:0/425231639 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:23:22.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.365+0000 7f3cddffb700 1 -- 172.21.15.111:0/425231639 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1363358115 0 0) 0x7f3ce00a46d0 con 0x7f3ce013ea00 2024-04-25T02:23:22.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.365+0000 7f3cde7fc700 1 -- 172.21.15.111:0/425231639 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3ce00b4fd0 msgr2=0x7f3ce00a2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:22.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.365+0000 7f3cde7fc700 1 --2- 172.21.15.111:0/425231639 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3ce00b4fd0 0x7f3ce00a2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:22.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.365+0000 7f3cde7fc700 1 -- 172.21.15.111:0/425231639 >> v1:172.21.15.111:6789/0 conn(0x7f3ce013ea00 legacy=0x7f3ce013eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:22.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.365+0000 7f3cde7fc700 1 -- 172.21.15.111:0/425231639 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce00a31a0 con 0x7f3ce00a3980 2024-04-25T02:23:22.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.365+0000 7f3cdeffd700 1 --2- 172.21.15.111:0/425231639 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3ce00b4fd0 0x7f3ce00a2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:22.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.365+0000 7f3cde7fc700 1 --2- 172.21.15.111:0/425231639 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3ce00a3980 0x7f3ce00a3d50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0009910 tx=0x7f3cd00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea6acb0668c6c5f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:22.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.365+0000 7f3cddffb700 1 -- 172.21.15.111:0/425231639 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd000b680 con 0x7f3ce00a3980 2024-04-25T02:23:22.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.365+0000 7f3cddffb700 1 -- 172.21.15.111:0/425231639 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd000b7e0 con 0x7f3ce00a3980 2024-04-25T02:23:22.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.365+0000 7f3cddffb700 1 -- 172.21.15.111:0/425231639 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd000bba0 con 0x7f3ce00a3980 2024-04-25T02:23:22.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.366+0000 7f3ce576d700 1 -- 172.21.15.111:0/425231639 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3ce00a3980 msgr2=0x7f3ce00a3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:22.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.366+0000 7f3ce576d700 1 --2- 172.21.15.111:0/425231639 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3ce00a3980 0x7f3ce00a3d50 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0009910 tx=0x7f3cd00091a0 comp rx=0 tx=0).stop 2024-04-25T02:23:22.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.366+0000 7f3ce576d700 1 -- 172.21.15.111:0/425231639 shutdown_connections 2024-04-25T02:23:22.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.366+0000 7f3ce576d700 1 --2- 172.21.15.111:0/425231639 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3ce00b4fd0 0x7f3ce00a2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:22.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.366+0000 7f3ce576d700 1 --2- 172.21.15.111:0/425231639 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3ce00a3980 0x7f3ce00a3d50 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:22.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.366+0000 7f3ce576d700 1 -- 172.21.15.111:0/425231639 >> 172.21.15.111:0/425231639 conn(0x7f3ce00883e0 msgr2=0x7f3ce0068b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:22.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.366+0000 7f3ce576d700 1 -- 172.21.15.111:0/425231639 shutdown_connections 2024-04-25T02:23:22.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.366+0000 7f3ce576d700 1 -- 172.21.15.111:0/425231639 wait complete. 2024-04-25T02:23:22.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.367+0000 7f3ce576d700 1 Processor -- start 2024-04-25T02:23:22.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.367+0000 7f3ce576d700 1 -- start start 2024-04-25T02:23:22.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.368+0000 7f3ce576d700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3ce00a3980 0x7f3ce0146930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:22.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.368+0000 7f3ce576d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3ce00b4fd0 0x7f3ce0145890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:22.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.368+0000 7f3ce576d700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3ce013ea00 0x7f3ce0151550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:22.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.368+0000 7f3ce576d700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce0147220 con 0x7f3ce00b4fd0 2024-04-25T02:23:22.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.368+0000 7f3ce576d700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce0142d30 con 0x7f3ce013ea00 2024-04-25T02:23:22.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.368+0000 7f3ce576d700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ce0146220 con 0x7f3ce00a3980 2024-04-25T02:23:22.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.368+0000 7f3cdeffd700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3ce00a3980 0x7f3ce0146930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:22.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.368+0000 7f3cde7fc700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3ce00b4fd0 0x7f3ce0145890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:22.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.368+0000 7f3cdeffd700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3ce00a3980 0x7f3ce0146930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:40946/0 (socket says 172.21.15.111:40946) 2024-04-25T02:23:22.376 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.368+0000 7f3cde7fc700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3ce00b4fd0 0x7f3ce0145890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:60270/0 (socket says 172.21.15.111:60270) 2024-04-25T02:23:22.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.368+0000 7f3cdeffd700 1 -- 172.21.15.111:0/1656242198 learned_addr learned my addr 172.21.15.111:0/1656242198 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:22.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.368+0000 7f3cdf7fe700 1 --2- 172.21.15.111:0/1656242198 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3ce013ea00 0x7f3ce0151550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:22.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.368+0000 7f3cdeffd700 1 -- 172.21.15.111:0/1656242198 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3ce013ea00 msgr2=0x7f3ce0151550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:22.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.368+0000 7f3cdeffd700 1 --2- 172.21.15.111:0/1656242198 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3ce013ea00 0x7f3ce0151550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:22.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.368+0000 7f3cdeffd700 1 -- 172.21.15.111:0/1656242198 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3ce00b4fd0 msgr2=0x7f3ce0145890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:22.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.368+0000 7f3cdeffd700 1 --2- 172.21.15.111:0/1656242198 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3ce00b4fd0 0x7f3ce0145890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:22.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.368+0000 7f3cdeffd700 1 -- 172.21.15.111:0/1656242198 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd4009420 con 0x7f3ce00a3980 2024-04-25T02:23:22.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.368+0000 7f3cde7fc700 1 --2- 172.21.15.111:0/1656242198 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3ce00b4fd0 0x7f3ce0145890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:22.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.368+0000 7f3cdeffd700 1 --2- 172.21.15.111:0/1656242198 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3ce00a3980 0x7f3ce0146930 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3cd400ec80 tx=0x7f3cd40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:22.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.368+0000 7f3cc6ffd700 1 -- 172.21.15.111:0/1656242198 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd400c920 con 0x7f3ce00a3980 2024-04-25T02:23:22.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.368+0000 7f3cc6ffd700 1 -- 172.21.15.111:0/1656242198 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd400ca80 con 0x7f3ce00a3980 2024-04-25T02:23:22.377 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.368+0000 7f3ce576d700 1 -- 172.21.15.111:0/1656242198 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cd0009420 con 0x7f3ce00a3980 2024-04-25T02:23:22.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.368+0000 7f3cc6ffd700 1 -- 172.21.15.111:0/1656242198 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd400ce00 con 0x7f3ce00a3980 2024-04-25T02:23:22.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.368+0000 7f3ce576d700 1 -- 172.21.15.111:0/1656242198 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ce0147a00 con 0x7f3ce00a3980 2024-04-25T02:23:22.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.369+0000 7f3cc6ffd700 1 -- 172.21.15.111:0/1656242198 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f3cd4013680 con 0x7f3ce00a3980 2024-04-25T02:23:22.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.369+0000 7f3ce576d700 1 -- 172.21.15.111:0/1656242198 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ce0146780 con 0x7f3ce00a3980 2024-04-25T02:23:22.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.370+0000 7f3cc6ffd700 1 -- 172.21.15.111:0/1656242198 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f3cd405b540 con 0x7f3ce00a3980 2024-04-25T02:23:22.378 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.373+0000 7f3cc6ffd700 1 -- 172.21.15.111:0/1656242198 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f3cd4039700 con 0x7f3ce00a3980 2024-04-25T02:23:22.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.529+0000 7f3ce576d700 1 -- 172.21.15.111:0/1656242198 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ce0145480 con 0x7f3ce00a3980 2024-04-25T02:23:22.533 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.530+0000 7f3cc6ffd700 1 -- 172.21.15.111:0/1656242198 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11668 (secure 0 0 0) 0x7f3ce0145480 con 0x7f3ce00a3980 2024-04-25T02:23:22.533 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:23:22.534 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":40,"fsid":"4643f974-f93a-4436-93b8-460ff320e62e","created":"2024-04-25T02:20:05.450475+0000","modified":"2024-04-25T02:23:21.875192+0000","last_up_change":"2024-04-25T02:23:12.818028+0000","last_in_change":"2024-04-25T02:20:10.439204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:20:07.471248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:20:14.420378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:20:22.251868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T02:20:23.128289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"df3f17ca-3b12-42c8-8cf7-8f1b7189e587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":31,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6800","nonce":48862}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6801","nonce":48862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6803","nonce":48862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6802","nonce":48862}]},"public_addr":"172.21.15.111:6800/48862","cluster_addr":"172.21.15.111:6801/48862","heartbeat_back_addr":"172.21.15.111:6803/48862","heartbeat_front_addr":"172.21.15.111:6802/48862","state":["exists","up"]},{"osd":1,"uuid":"93d54815-f215-4285-bba6-32f2d1cabf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":29,"up_thru":31,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6804","nonce":48960}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6805","nonce":48960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6807","nonce":48960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6806","nonce":48960}]},"public_addr":"172.21.15.111:6804/48960","cluster_addr":"172.21.15.111:6805/48960","heartbeat_back_addr":"172.21.15.111:6807/48960","heartbeat_front_addr":"172.21.15.111:6806/48960","state":["exists","up"]},{"osd":2,"uuid":"b26b2104-2a2e-408f-9ce7-3587a32a2ebe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":31,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6808","nonce":49070}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6809","nonce":49070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6811","nonce":49070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6810","nonce":49070}]},"public_addr":"172.21.15.111:6808/49070","cluster_addr":"172.21.15.111:6809/49070","heartbeat_back_addr":"172.21.15.111:6811/49070","heartbeat_front_addr":"172.21.15.111:6810/49070","state":["exists","up"]},{"osd":3,"uuid":"43c25820-1edc-4031-badf-72e87dd6bf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":31,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6812","nonce":49243}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6813","nonce":49243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6815","nonce":49243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6814","nonce":49243}]},"public_addr":"172.21.15.111:6812/49243","cluster_addr":"172.21.15.111:6813/49243","heartbeat_back_addr":"172.21.15.111:6815/49243","heartbeat_front_addr":"172.21.15.111:6814/49243","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.372427+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.411480+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.361508+0000","dead_epoch":25},{"osd":3,"down_stamp":"2024-04-25T02:23:06.771296+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.377212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.111:6819/4003866251":"2024-04-26T02:23:16.839679+0000","172.21.15.111:0/2148931273":"2024-04-26T02:22:54.713254+0000","172.21.15.111:6816/39585":"2024-04-26T02:22:54.713254+0000","172.21.15.111:0/3911588907":"2024-04-26T02:22:54.713254+0000","172.21.15.111:0/1276843622":"2024-04-26T02:22:54.713254+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:23:22.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.531+0000 7f3ce576d700 1 -- 172.21.15.111:0/1656242198 >> v1:172.21.15.111:6816/46482 conn(0x7f3ccc046010 legacy=0x7f3ccc0484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:22.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.531+0000 7f3ce576d700 1 -- 172.21.15.111:0/1656242198 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3ce00a3980 msgr2=0x7f3ce0146930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:22.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.531+0000 7f3ce576d700 1 --2- 172.21.15.111:0/1656242198 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3ce00a3980 0x7f3ce0146930 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f3cd400ec80 tx=0x7f3cd40091a0 comp rx=0 tx=0).stop 2024-04-25T02:23:22.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.531+0000 7f3ce576d700 1 -- 172.21.15.111:0/1656242198 shutdown_connections 2024-04-25T02:23:22.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.531+0000 7f3ce576d700 1 --2- 172.21.15.111:0/1656242198 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3ce013ea00 0x7f3ce0151550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:22.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.531+0000 7f3ce576d700 1 --2- 172.21.15.111:0/1656242198 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3ce00a3980 0x7f3ce0146930 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:22.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.531+0000 7f3ce576d700 1 --2- 172.21.15.111:0/1656242198 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3ce00b4fd0 0x7f3ce0145890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:22.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.531+0000 7f3ce576d700 1 -- 172.21.15.111:0/1656242198 >> 172.21.15.111:0/1656242198 conn(0x7f3ce00883e0 msgr2=0x7f3ce0063d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:22.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.531+0000 7f3ce576d700 1 -- 172.21.15.111:0/1656242198 shutdown_connections 2024-04-25T02:23:22.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.531+0000 7f3ce576d700 1 -- 172.21.15.111:0/1656242198 wait complete. 2024-04-25T02:23:22.548 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-25T02:23:22.548 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:23:22.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.660+0000 7f8a3a729700 1 Processor -- start 2024-04-25T02:23:22.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.660+0000 7f8a3a729700 1 -- start start 2024-04-25T02:23:22.669 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.661+0000 7f8a3a729700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8a340a3410 0x7f8a340a4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:22.669 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.661+0000 7f8a3a729700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8a340a22a0 0x7f8a3413e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:22.669 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.661+0000 7f8a3a729700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f8a3413eb60 0x7f8a3413f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:22.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.661+0000 7f8a3a729700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a340a2a20 con 0x7f8a3413eb60 2024-04-25T02:23:22.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.661+0000 7f8a3a729700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3406da60 con 0x7f8a340a22a0 2024-04-25T02:23:22.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.661+0000 7f8a3a729700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a340a3c80 con 0x7f8a340a3410 2024-04-25T02:23:22.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.661+0000 7f8a337fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8a340a22a0 0x7f8a3413e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:22.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.661+0000 7f8a38cc6700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f8a3413eb60 0x7f8a3413f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:22.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.661+0000 7f8a33fff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8a340a3410 0x7f8a340a4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:22.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.661+0000 7f8a38cc6700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f8a3413eb60 0x7f8a3413f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:60272/0 (socket says 172.21.15.111:60272) 2024-04-25T02:23:22.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.661+0000 7f8a337fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8a340a22a0 0x7f8a3413e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:35394/0 (socket says 172.21.15.111:35394) 2024-04-25T02:23:22.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.661+0000 7f8a38cc6700 1 -- 172.21.15.111:0/2328362020 learned_addr learned my addr 172.21.15.111:0/2328362020 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:22.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.661+0000 7f8a38cc6700 1 -- 172.21.15.111:0/2328362020 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8a340a3410 msgr2=0x7f8a340a4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:22.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.661+0000 7f8a38cc6700 1 --2- 172.21.15.111:0/2328362020 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8a340a3410 0x7f8a340a4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:22.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.661+0000 7f8a38cc6700 1 -- 172.21.15.111:0/2328362020 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8a340a22a0 msgr2=0x7f8a3413e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:22.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.661+0000 7f8a38cc6700 1 --2- 172.21.15.111:0/2328362020 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8a340a22a0 0x7f8a3413e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:22.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.661+0000 7f8a38cc6700 1 -- 172.21.15.111:0/2328362020 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a340a37e0 con 0x7f8a3413eb60 2024-04-25T02:23:22.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.661+0000 7f8a33fff700 1 --2- 172.21.15.111:0/2328362020 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8a340a3410 0x7f8a340a4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:22.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.661+0000 7f8a337fe700 1 --2- 172.21.15.111:0/2328362020 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8a340a22a0 0x7f8a3413e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:22.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.662+0000 7f8a38cc6700 1 --2- 172.21.15.111:0/2328362020 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8a3413eb60 0x7f8a3413f000 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c009f50 tx=0x7f8a2c009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6988a8c5700ba9a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:22.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.662+0000 7f8a32ffd700 1 -- 172.21.15.111:0/2328362020 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c00e070 con 0x7f8a3413eb60 2024-04-25T02:23:22.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.662+0000 7f8a32ffd700 1 -- 172.21.15.111:0/2328362020 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a2c00b910 con 0x7f8a3413eb60 2024-04-25T02:23:22.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.662+0000 7f8a32ffd700 1 -- 172.21.15.111:0/2328362020 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c0092e0 con 0x7f8a3413eb60 2024-04-25T02:23:22.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.662+0000 7f8a3a729700 1 -- 172.21.15.111:0/2328362020 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8a3413eb60 msgr2=0x7f8a3413f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:22.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.662+0000 7f8a3a729700 1 --2- 172.21.15.111:0/2328362020 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8a3413eb60 0x7f8a3413f000 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c009f50 tx=0x7f8a2c009840 comp rx=0 tx=0).stop 2024-04-25T02:23:22.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.662+0000 7f8a3a729700 1 -- 172.21.15.111:0/2328362020 shutdown_connections 2024-04-25T02:23:22.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.662+0000 7f8a3a729700 1 --2- 172.21.15.111:0/2328362020 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8a3413eb60 0x7f8a3413f000 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:22.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.662+0000 7f8a3a729700 1 --2- 172.21.15.111:0/2328362020 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8a340a3410 0x7f8a340a4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:22.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.662+0000 7f8a3a729700 1 --2- 172.21.15.111:0/2328362020 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8a340a22a0 0x7f8a3413e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:22.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.662+0000 7f8a3a729700 1 -- 172.21.15.111:0/2328362020 >> 172.21.15.111:0/2328362020 conn(0x7f8a340b1cf0 msgr2=0x7f8a340b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:22.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.662+0000 7f8a3a729700 1 -- 172.21.15.111:0/2328362020 shutdown_connections 2024-04-25T02:23:22.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.662+0000 7f8a3a729700 1 -- 172.21.15.111:0/2328362020 wait complete. 2024-04-25T02:23:22.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.663+0000 7f8a3a729700 1 Processor -- start 2024-04-25T02:23:22.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.663+0000 7f8a3a729700 1 -- start start 2024-04-25T02:23:22.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.664+0000 7f8a3a729700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8a340a22a0 0x7f8a3414df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:22.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.664+0000 7f8a3a729700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8a340a3410 0x7f8a34138820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:22.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.664+0000 7f8a3a729700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8a3413eb60 0x7f8a34138d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:22.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.664+0000 7f8a3a729700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a3414e920 con 0x7f8a340a22a0 2024-04-25T02:23:22.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.664+0000 7f8a3a729700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a340ac0f0 con 0x7f8a3413eb60 2024-04-25T02:23:22.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.664+0000 7f8a3a729700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a340ad970 con 0x7f8a340a3410 2024-04-25T02:23:22.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.664+0000 7f8a33fff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8a340a22a0 0x7f8a3414df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:22.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.664+0000 7f8a38cc6700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8a3413eb60 0x7f8a34138d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:22.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.664+0000 7f8a33fff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8a340a22a0 0x7f8a3414df50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:60280/0 (socket says 172.21.15.111:60280) 2024-04-25T02:23:22.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.664+0000 7f8a38cc6700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8a3413eb60 0x7f8a34138d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:35398/0 (socket says 172.21.15.111:35398) 2024-04-25T02:23:22.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.664+0000 7f8a33fff700 1 -- 172.21.15.111:0/54295745 learned_addr learned my addr 172.21.15.111:0/54295745 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:22.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.664+0000 7f8a337fe700 1 --2- 172.21.15.111:0/54295745 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8a340a3410 0x7f8a34138820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:22.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.664+0000 7f8a38cc6700 1 -- 172.21.15.111:0/54295745 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8a340a3410 msgr2=0x7f8a34138820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:22.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.664+0000 7f8a38cc6700 1 --2- 172.21.15.111:0/54295745 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8a340a3410 0x7f8a34138820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:22.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.664+0000 7f8a38cc6700 1 -- 172.21.15.111:0/54295745 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8a340a22a0 msgr2=0x7f8a3414df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:22.673 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.664+0000 7f8a38cc6700 1 --2- 172.21.15.111:0/54295745 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8a340a22a0 0x7f8a3414df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:22.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.664+0000 7f8a38cc6700 1 -- 172.21.15.111:0/54295745 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a28009420 con 0x7f8a3413eb60 2024-04-25T02:23:22.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.664+0000 7f8a33fff700 1 --2- 172.21.15.111:0/54295745 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8a340a22a0 0x7f8a3414df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:22.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.665+0000 7f8a38cc6700 1 --2- 172.21.15.111:0/54295745 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8a3413eb60 0x7f8a34138d60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c009f50 tx=0x7f8a2c018000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:22.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.665+0000 7f8a1bfff700 1 -- 172.21.15.111:0/54295745 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c0094e0 con 0x7f8a3413eb60 2024-04-25T02:23:22.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.665+0000 7f8a1bfff700 1 -- 172.21.15.111:0/54295745 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a2c0032f0 con 0x7f8a3413eb60 2024-04-25T02:23:22.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.665+0000 7f8a1bfff700 1 -- 172.21.15.111:0/54295745 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a2c007d90 con 0x7f8a3413eb60 2024-04-25T02:23:22.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.665+0000 7f8a3a729700 1 -- 172.21.15.111:0/54295745 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a2400b6d0 con 0x7f8a3413eb60 2024-04-25T02:23:22.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.665+0000 7f8a3a729700 1 -- 172.21.15.111:0/54295745 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a2c009ae0 con 0x7f8a3413eb60 2024-04-25T02:23:22.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.666+0000 7f8a3a729700 1 -- 172.21.15.111:0/54295745 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a34139300 con 0x7f8a3413eb60 2024-04-25T02:23:22.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.666+0000 7f8a1bfff700 1 -- 172.21.15.111:0/54295745 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f8a2c003040 con 0x7f8a3413eb60 2024-04-25T02:23:22.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.666+0000 7f8a1bfff700 1 -- 172.21.15.111:0/54295745 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f8a2c05cdf0 con 0x7f8a3413eb60 2024-04-25T02:23:22.675 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.669+0000 7f8a1bfff700 1 -- 172.21.15.111:0/54295745 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f8a2c006810 con 0x7f8a3413eb60 2024-04-25T02:23:22.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.829+0000 7f8a3a729700 1 -- 172.21.15.111:0/54295745 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8a3413e200 con 0x7f8a3413eb60 2024-04-25T02:23:22.833 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.830+0000 7f8a1bfff700 1 -- 172.21.15.111:0/54295745 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11668 (secure 0 0 0) 0x7f8a2c006810 con 0x7f8a3413eb60 2024-04-25T02:23:22.833 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:23:22.834 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":40,"fsid":"4643f974-f93a-4436-93b8-460ff320e62e","created":"2024-04-25T02:20:05.450475+0000","modified":"2024-04-25T02:23:21.875192+0000","last_up_change":"2024-04-25T02:23:12.818028+0000","last_in_change":"2024-04-25T02:20:10.439204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:20:07.471248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:20:14.420378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:20:22.251868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T02:20:23.128289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"df3f17ca-3b12-42c8-8cf7-8f1b7189e587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":31,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6800","nonce":48862}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6801","nonce":48862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6803","nonce":48862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6802","nonce":48862}]},"public_addr":"172.21.15.111:6800/48862","cluster_addr":"172.21.15.111:6801/48862","heartbeat_back_addr":"172.21.15.111:6803/48862","heartbeat_front_addr":"172.21.15.111:6802/48862","state":["exists","up"]},{"osd":1,"uuid":"93d54815-f215-4285-bba6-32f2d1cabf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":29,"up_thru":31,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6804","nonce":48960}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6805","nonce":48960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6807","nonce":48960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6806","nonce":48960}]},"public_addr":"172.21.15.111:6804/48960","cluster_addr":"172.21.15.111:6805/48960","heartbeat_back_addr":"172.21.15.111:6807/48960","heartbeat_front_addr":"172.21.15.111:6806/48960","state":["exists","up"]},{"osd":2,"uuid":"b26b2104-2a2e-408f-9ce7-3587a32a2ebe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":31,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6808","nonce":49070}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6809","nonce":49070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6811","nonce":49070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6810","nonce":49070}]},"public_addr":"172.21.15.111:6808/49070","cluster_addr":"172.21.15.111:6809/49070","heartbeat_back_addr":"172.21.15.111:6811/49070","heartbeat_front_addr":"172.21.15.111:6810/49070","state":["exists","up"]},{"osd":3,"uuid":"43c25820-1edc-4031-badf-72e87dd6bf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":31,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6812","nonce":49243}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6813","nonce":49243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6815","nonce":49243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6814","nonce":49243}]},"public_addr":"172.21.15.111:6812/49243","cluster_addr":"172.21.15.111:6813/49243","heartbeat_back_addr":"172.21.15.111:6815/49243","heartbeat_front_addr":"172.21.15.111:6814/49243","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.372427+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.411480+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.361508+0000","dead_epoch":25},{"osd":3,"down_stamp":"2024-04-25T02:23:06.771296+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.377212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.111:6819/4003866251":"2024-04-26T02:23:16.839679+0000","172.21.15.111:0/2148931273":"2024-04-26T02:22:54.713254+0000","172.21.15.111:6816/39585":"2024-04-26T02:22:54.713254+0000","172.21.15.111:0/3911588907":"2024-04-26T02:22:54.713254+0000","172.21.15.111:0/1276843622":"2024-04-26T02:22:54.713254+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:23:22.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.831+0000 7f8a3a729700 1 -- 172.21.15.111:0/54295745 >> v1:172.21.15.111:6816/46482 conn(0x7f8a20046090 legacy=0x7f8a20048540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:22.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.831+0000 7f8a3a729700 1 -- 172.21.15.111:0/54295745 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8a3413eb60 msgr2=0x7f8a34138d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:22.836 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.831+0000 7f8a3a729700 1 --2- 172.21.15.111:0/54295745 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8a3413eb60 0x7f8a34138d60 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f8a2c009f50 tx=0x7f8a2c018000 comp rx=0 tx=0).stop 2024-04-25T02:23:22.836 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.831+0000 7f8a3a729700 1 -- 172.21.15.111:0/54295745 shutdown_connections 2024-04-25T02:23:22.836 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.831+0000 7f8a3a729700 1 --2- 172.21.15.111:0/54295745 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8a3413eb60 0x7f8a34138d60 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:22.836 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.831+0000 7f8a3a729700 1 --2- 172.21.15.111:0/54295745 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8a340a22a0 0x7f8a3414df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:22.836 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.831+0000 7f8a3a729700 1 --2- 172.21.15.111:0/54295745 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8a340a3410 0x7f8a34138820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:22.836 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.831+0000 7f8a3a729700 1 -- 172.21.15.111:0/54295745 >> 172.21.15.111:0/54295745 conn(0x7f8a340b1cf0 msgr2=0x7f8a3413d320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:22.836 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.831+0000 7f8a3a729700 1 -- 172.21.15.111:0/54295745 shutdown_connections 2024-04-25T02:23:22.836 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.831+0000 7f8a3a729700 1 -- 172.21.15.111:0/54295745 wait complete. 2024-04-25T02:23:22.847 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-25T02:23:22.848 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-25T02:23:22.848 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-25T02:23:22.849 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-25T02:23:22.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.971+0000 7fba2e12f700 1 Processor -- start 2024-04-25T02:23:22.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.971+0000 7fba2e12f700 1 -- start start 2024-04-25T02:23:22.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.972+0000 7fba2e12f700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fba280b20d0 0x7fba28067940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:22.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.972+0000 7fba2e12f700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fba280a3360 0x7fba28149530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:22.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.972+0000 7fba2e12f700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba280a2b80 con 0x7fba280af520 2024-04-25T02:23:22.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.972+0000 7fba2e12f700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba280a38c0 con 0x7fba280a3360 2024-04-25T02:23:22.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.972+0000 7fba2e12f700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba2806e0f0 con 0x7fba280b20d0 2024-04-25T02:23:22.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.972+0000 7fba27fff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fba280a3360 0x7fba28149530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:22.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.972+0000 7fba277fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fba280b20d0 0x7fba28067940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:22.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.972+0000 7fba27fff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fba280a3360 0x7fba28149530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:35410/0 (socket says 172.21.15.111:35410) 2024-04-25T02:23:22.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.972+0000 7fba27fff700 1 -- 172.21.15.111:0/2085309793 learned_addr learned my addr 172.21.15.111:0/2085309793 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:22.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.972+0000 7fba27fff700 1 -- 172.21.15.111:0/2085309793 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fba280b20d0 msgr2=0x7fba28067940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:22.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.972+0000 7fba27fff700 1 --2- 172.21.15.111:0/2085309793 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fba280b20d0 0x7fba28067940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:22.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.972+0000 7fba27fff700 1 -- 172.21.15.111:0/2085309793 >> v1:172.21.15.111:6789/0 conn(0x7fba280af520 legacy=0x7fba28067e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:22.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.972+0000 7fba267fc700 1 -- 172.21.15.111:0/2085309793 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2240548716 0 0) 0x7fba280a2b80 con 0x7fba280af520 2024-04-25T02:23:22.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.972+0000 7fba27fff700 1 -- 172.21.15.111:0/2085309793 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba2806e790 con 0x7fba280a3360 2024-04-25T02:23:22.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.972+0000 7fba27fff700 1 --2- 172.21.15.111:0/2085309793 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fba280a3360 0x7fba28149530 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fba20009f50 tx=0x7fba20009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7ce1d433a8e0806 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:22.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.973+0000 7fba267fc700 1 -- 172.21.15.111:0/2085309793 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2000e070 con 0x7fba280a3360 2024-04-25T02:23:22.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.973+0000 7fba267fc700 1 -- 172.21.15.111:0/2085309793 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba2000ba90 con 0x7fba280a3360 2024-04-25T02:23:22.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.973+0000 7fba267fc700 1 -- 172.21.15.111:0/2085309793 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba200092e0 con 0x7fba280a3360 2024-04-25T02:23:22.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.973+0000 7f98ba720700 1 Processor -- start 2024-04-25T02:23:22.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.973+0000 7f98ba720700 1 -- start start 2024-04-25T02:23:22.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.973+0000 7fba2e12f700 1 -- 172.21.15.111:0/2085309793 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fba280a3360 msgr2=0x7fba28149530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:22.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.973+0000 7fba2e12f700 1 --2- 172.21.15.111:0/2085309793 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fba280a3360 0x7fba28149530 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fba20009f50 tx=0x7fba20009840 comp rx=0 tx=0).stop 2024-04-25T02:23:22.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.973+0000 7fba2e12f700 1 -- 172.21.15.111:0/2085309793 shutdown_connections 2024-04-25T02:23:22.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.973+0000 7fba2e12f700 1 --2- 172.21.15.111:0/2085309793 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fba280b20d0 0x7fba28067940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:22.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.973+0000 7fba2e12f700 1 --2- 172.21.15.111:0/2085309793 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fba280a3360 0x7fba28149530 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:22.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.973+0000 7fba2e12f700 1 -- 172.21.15.111:0/2085309793 >> 172.21.15.111:0/2085309793 conn(0x7fba2806abb0 msgr2=0x7fba2806afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:22.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.973+0000 7fba2e12f700 1 -- 172.21.15.111:0/2085309793 shutdown_connections 2024-04-25T02:23:22.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.974+0000 7fba2e12f700 1 -- 172.21.15.111:0/2085309793 wait complete. 2024-04-25T02:23:22.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.974+0000 7f98ba720700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f98b40b1520 0x7f98b406d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:22.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.974+0000 7f98ba720700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f98b406f730 0x7f98b4142030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:22.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.974+0000 7f98ba720700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f98b406eb40 0x7f98b4142570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:22.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.974+0000 7f98ba720700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98b406e410 con 0x7f98b40b1520 2024-04-25T02:23:22.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.974+0000 7f98ba720700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98b406db80 con 0x7f98b406f730 2024-04-25T02:23:22.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.974+0000 7f98ba720700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98b406f270 con 0x7f98b406eb40 2024-04-25T02:23:22.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.974+0000 7f98b3fff700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f98b40b1520 0x7f98b406d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:22.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.974+0000 7f98b3fff700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f98b40b1520 0x7f98b406d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:60296/0 (socket says 172.21.15.111:60296) 2024-04-25T02:23:22.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.974+0000 7f98b3fff700 1 -- 172.21.15.111:0/3001010737 learned_addr learned my addr 172.21.15.111:0/3001010737 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:22.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.974+0000 7f98ab7fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f98b406f730 0x7f98b4142030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:22.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.974+0000 7f98b8cbd700 1 --2- 172.21.15.111:0/3001010737 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f98b406eb40 0x7f98b4142570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:22.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.974+0000 7f98b3fff700 1 -- 172.21.15.111:0/3001010737 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f98b406eb40 msgr2=0x7f98b4142570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:22.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.974+0000 7f98b3fff700 1 --2- 172.21.15.111:0/3001010737 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f98b406eb40 0x7f98b4142570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:22.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.974+0000 7f98b3fff700 1 -- 172.21.15.111:0/3001010737 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f98b406f730 msgr2=0x7f98b4142030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:22.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.974+0000 7f98b3fff700 1 --2- 172.21.15.111:0/3001010737 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f98b406f730 0x7f98b4142030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:22.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.974+0000 7f98b3fff700 1 -- 172.21.15.111:0/3001010737 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98b406dde0 con 0x7f98b40b1520 2024-04-25T02:23:22.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.974+0000 7f98b3fff700 1 --2- 172.21.15.111:0/3001010737 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f98b40b1520 0x7f98b406d640 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f98a40099b0 tx=0x7f98a4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=669fa9745ddf090a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:22.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.975+0000 7f98b37fe700 1 -- 172.21.15.111:0/3001010737 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a4009ea0 con 0x7f98b40b1520 2024-04-25T02:23:22.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.975+0000 7f98b37fe700 1 -- 172.21.15.111:0/3001010737 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98a400b860 con 0x7f98b40b1520 2024-04-25T02:23:22.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.975+0000 7f98b37fe700 1 -- 172.21.15.111:0/3001010737 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98a400bc00 con 0x7f98b40b1520 2024-04-25T02:23:22.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.975+0000 7fba2e12f700 1 Processor -- start 2024-04-25T02:23:22.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.975+0000 7fba2e12f700 1 -- start start 2024-04-25T02:23:22.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.975+0000 7fba2e12f700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fba280a3360 0x7fba280add10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:22.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.975+0000 7fba2e12f700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fba280af520 0x7fba280aa600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:22.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.975+0000 7f98ba720700 1 -- 172.21.15.111:0/3001010737 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f98b40b1520 msgr2=0x7f98b406d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:22.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.975+0000 7f98ba720700 1 --2- 172.21.15.111:0/3001010737 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f98b40b1520 0x7f98b406d640 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f98a40099b0 tx=0x7f98a4009250 comp rx=0 tx=0).stop 2024-04-25T02:23:22.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.975+0000 7fba2e12f700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fba280b20d0 0x7fba280aab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:22.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.975+0000 7fba2e12f700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba28096cc0 con 0x7fba280b20d0 2024-04-25T02:23:22.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.975+0000 7fba2e12f700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba280ae860 con 0x7fba280af520 2024-04-25T02:23:22.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.975+0000 7fba2e12f700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fba28141350 con 0x7fba280a3360 2024-04-25T02:23:22.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.976+0000 7fba27fff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fba280b20d0 0x7fba280aab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:22.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.976+0000 7fba27fff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fba280b20d0 0x7fba280aab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:60308/0 (socket says 172.21.15.111:60308) 2024-04-25T02:23:22.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.976+0000 7fba27fff700 1 -- 172.21.15.111:0/980153870 learned_addr learned my addr 172.21.15.111:0/980153870 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:22.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.976+0000 7fba26ffd700 1 --2- 172.21.15.111:0/980153870 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fba280af520 0x7fba280aa600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:22.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.976+0000 7f98ba720700 1 -- 172.21.15.111:0/3001010737 shutdown_connections 2024-04-25T02:23:22.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.976+0000 7f98ba720700 1 --2- 172.21.15.111:0/3001010737 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f98b406eb40 0x7f98b4142570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:22.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.976+0000 7f98ba720700 1 --2- 172.21.15.111:0/3001010737 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f98b40b1520 0x7f98b406d640 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:22.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.976+0000 7f98ba720700 1 --2- 172.21.15.111:0/3001010737 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f98b406f730 0x7f98b4142030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:22.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.976+0000 7f98ba720700 1 -- 172.21.15.111:0/3001010737 >> 172.21.15.111:0/3001010737 conn(0x7f98b406c040 msgr2=0x7f98b4069a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:22.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.976+0000 7fba277fe700 1 --2- 172.21.15.111:0/980153870 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fba280a3360 0x7fba280add10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:22.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.976+0000 7fba27fff700 1 -- 172.21.15.111:0/980153870 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fba280a3360 msgr2=0x7fba280add10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:22.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.976+0000 7fba27fff700 1 --2- 172.21.15.111:0/980153870 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fba280a3360 0x7fba280add10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:22.987 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.976+0000 7fba27fff700 1 -- 172.21.15.111:0/980153870 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fba280af520 msgr2=0x7fba280aa600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:22.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.976+0000 7fba27fff700 1 --2- 172.21.15.111:0/980153870 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fba280af520 0x7fba280aa600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:22.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.976+0000 7fba27fff700 1 -- 172.21.15.111:0/980153870 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba20009ae0 con 0x7fba280b20d0 2024-04-25T02:23:22.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.976+0000 7fba277fe700 1 --2- 172.21.15.111:0/980153870 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fba280a3360 0x7fba280add10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:23:22.988 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.976+0000 7f98ba720700 1 -- 172.21.15.111:0/3001010737 shutdown_connections 2024-04-25T02:23:22.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.976+0000 7f98ba720700 1 -- 172.21.15.111:0/3001010737 wait complete. 2024-04-25T02:23:22.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.976+0000 7fba27fff700 1 --2- 172.21.15.111:0/980153870 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fba280b20d0 0x7fba280aab40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fba280a4d90 tx=0x7fba20018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:22.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.976+0000 7fba0f7fe700 1 -- 172.21.15.111:0/980153870 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba20025070 con 0x7fba280b20d0 2024-04-25T02:23:22.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.976+0000 7fba0f7fe700 1 -- 172.21.15.111:0/980153870 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba200032f0 con 0x7fba280b20d0 2024-04-25T02:23:22.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.976+0000 7fba0f7fe700 1 -- 172.21.15.111:0/980153870 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba20007a70 con 0x7fba280b20d0 2024-04-25T02:23:22.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.976+0000 7fba2e12f700 1 -- 172.21.15.111:0/980153870 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba280ae580 con 0x7fba280b20d0 2024-04-25T02:23:22.990 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.976+0000 7fba2e12f700 1 -- 172.21.15.111:0/980153870 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba28140ec0 con 0x7fba280b20d0 2024-04-25T02:23:22.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.977+0000 7f98ba720700 1 Processor -- start 2024-04-25T02:23:22.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.977+0000 7f98ba720700 1 -- start start 2024-04-25T02:23:22.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.978+0000 7f98ba720700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f98b406eb40 0x7f98b40acf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:22.993 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.978+0000 7f98ba720700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f98b406f730 0x7f98b409ae20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:22.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.978+0000 7f98ba720700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f98b40b1520 0x7f98b4151490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:22.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.978+0000 7f98ba720700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98b409a360 con 0x7f98b406f730 2024-04-25T02:23:22.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.978+0000 7f98ba720700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98b40ad490 con 0x7f98b40b1520 2024-04-25T02:23:22.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.978+0000 7f98ba720700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f98b4097fd0 con 0x7f98b406eb40 2024-04-25T02:23:22.994 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.978+0000 7f98b8cbd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f98b40b1520 0x7f98b4151490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:22.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.978+0000 7f98b3fff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f98b406eb40 0x7f98b40acf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:22.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.978+0000 7f98b8cbd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f98b40b1520 0x7f98b4151490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:35436/0 (socket says 172.21.15.111:35436) 2024-04-25T02:23:22.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.978+0000 7f98b8cbd700 1 -- 172.21.15.111:0/1186273980 learned_addr learned my addr 172.21.15.111:0/1186273980 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:22.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.978+0000 7f98ab7fe700 1 --2- 172.21.15.111:0/1186273980 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f98b406f730 0x7f98b409ae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:22.995 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.978+0000 7f98b8cbd700 1 -- 172.21.15.111:0/1186273980 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f98b406eb40 msgr2=0x7f98b40acf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:22.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.978+0000 7f98b8cbd700 1 --2- 172.21.15.111:0/1186273980 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f98b406eb40 0x7f98b40acf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:22.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.979+0000 7f98b8cbd700 1 -- 172.21.15.111:0/1186273980 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f98b406f730 msgr2=0x7f98b409ae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:22.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.979+0000 7f98b8cbd700 1 --2- 172.21.15.111:0/1186273980 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f98b406f730 0x7f98b409ae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:22.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.979+0000 7f98b8cbd700 1 -- 172.21.15.111:0/1186273980 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98a40094f0 con 0x7f98b40b1520 2024-04-25T02:23:22.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.979+0000 7f98b3fff700 1 --2- 172.21.15.111:0/1186273980 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f98b406eb40 0x7f98b40acf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:22.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.979+0000 7f98b8cbd700 1 --2- 172.21.15.111:0/1186273980 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f98b40b1520 0x7f98b4151490 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f98ac00d890 tx=0x7f98ac008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:22.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.979+0000 7f98b0ff9700 1 -- 172.21.15.111:0/1186273980 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ac0125f0 con 0x7f98b40b1520 2024-04-25T02:23:22.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.979+0000 7f98b0ff9700 1 -- 172.21.15.111:0/1186273980 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98ac012750 con 0x7f98b40b1520 2024-04-25T02:23:22.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.979+0000 7f98ba720700 1 -- 172.21.15.111:0/1186273980 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98b4098830 con 0x7f98b40b1520 2024-04-25T02:23:22.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.979+0000 7f98b0ff9700 1 -- 172.21.15.111:0/1186273980 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98ac012b10 con 0x7f98b40b1520 2024-04-25T02:23:22.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.979+0000 7f98ba720700 1 -- 172.21.15.111:0/1186273980 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98b409b360 con 0x7f98b40b1520 2024-04-25T02:23:22.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.978+0000 7fba0f7fe700 1 -- 172.21.15.111:0/980153870 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7fba20003040 con 0x7fba280b20d0 2024-04-25T02:23:22.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.979+0000 7fba0f7fe700 1 -- 172.21.15.111:0/980153870 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fba20064260 con 0x7fba280b20d0 2024-04-25T02:23:23.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.980+0000 7f98ba720700 1 -- 172.21.15.111:0/1186273980 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f98b4065190 con 0x7f98b40b1520 2024-04-25T02:23:23.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.980+0000 7f98b0ff9700 1 -- 172.21.15.111:0/1186273980 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f98ac013480 con 0x7f98b40b1520 2024-04-25T02:23:23.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.980+0000 7f98b0ff9700 1 -- 172.21.15.111:0/1186273980 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f98ac05b4d0 con 0x7f98b40b1520 2024-04-25T02:23:23.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.980+0000 7f98b0ff9700 1 -- 172.21.15.111:0/1186273980 --> v1:172.21.15.111:6812/49243 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9894052a60 con 0x7f989404eda0 2024-04-25T02:23:23.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.980+0000 7f98b0ff9700 1 -- 172.21.15.111:0/1186273980 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7f98ac05db10 con 0x7f98b40b1520 2024-04-25T02:23:23.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.981+0000 7f98b0ff9700 1 -- 172.21.15.111:0/1186273980 <== osd.3 v1:172.21.15.111:6812/49243 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (unknown 0 0 1173804961) 0x7f9894052a60 con 0x7f989404eda0 2024-04-25T02:23:23.000 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.984+0000 7fba2e12f700 1 -- 172.21.15.111:0/980153870 --> v1:172.21.15.111:6800/48862 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fba080053a0 con 0x7fba080015c0 2024-04-25T02:23:23.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.985+0000 7fade9b3e700 1 Processor -- start 2024-04-25T02:23:23.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.985+0000 7fade9b3e700 1 -- start start 2024-04-25T02:23:23.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.985+0000 7fba0f7fe700 1 -- 172.21.15.111:0/980153870 <== osd.0 v1:172.21.15.111:6800/48862 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (unknown 0 0 1173804961) 0x7fba080053a0 con 0x7fba080015c0 2024-04-25T02:23:23.001 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.985+0000 7fc06311b700 1 Processor -- start 2024-04-25T02:23:23.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.985+0000 7fc06311b700 1 -- start start 2024-04-25T02:23:23.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.985+0000 7fade9b3e700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fade40b4fd0 0x7fade40a2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:23.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.985+0000 7fade9b3e700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fade413f110 0x7fade40a3d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:23.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.985+0000 7fade9b3e700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fade40a46d0 con 0x7fade40a3980 2024-04-25T02:23:23.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.985+0000 7fade9b3e700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fade40a6710 con 0x7fade40b4fd0 2024-04-25T02:23:23.002 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.985+0000 7fade9b3e700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fade40a4930 con 0x7fade413f110 2024-04-25T02:23:23.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.985+0000 7fc06311b700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fc05c0b30c0 0x7fc05c06f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:23.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.985+0000 7fc06311b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc05c06f9c0 0x7fc05c146bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:23.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.985+0000 7fc06311b700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc05c06eb60 con 0x7fc05c0a4ed0 2024-04-25T02:23:23.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.985+0000 7fc06311b700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc05c06ed90 con 0x7fc05c0b30c0 2024-04-25T02:23:23.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.985+0000 7fc06311b700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc05c0a3ce0 con 0x7fc05c06f9c0 2024-04-25T02:23:23.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.986+0000 7fc05bfff700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fc05c0b30c0 0x7fc05c06f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:23.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.986+0000 7fc05bfff700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fc05c0b30c0 0x7fc05c06f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:60334/0 (socket says 172.21.15.111:60334) 2024-04-25T02:23:23.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.986+0000 7fc05bfff700 1 -- 172.21.15.111:0/2776885956 learned_addr learned my addr 172.21.15.111:0/2776885956 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:23.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.986+0000 7fc0616b8700 1 --2- 172.21.15.111:0/2776885956 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc05c06f9c0 0x7fc05c146bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:23.003 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.986+0000 7fc05bfff700 1 -- 172.21.15.111:0/2776885956 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc05c06f9c0 msgr2=0x7fc05c146bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:23.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.986+0000 7fc05bfff700 1 --2- 172.21.15.111:0/2776885956 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc05c06f9c0 0x7fc05c146bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:23.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.986+0000 7fc05bfff700 1 -- 172.21.15.111:0/2776885956 >> v1:172.21.15.111:6789/0 conn(0x7fc05c0a4ed0 legacy=0x7fc05c0a6e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:23.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.986+0000 7fc05bfff700 1 -- 172.21.15.111:0/2776885956 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc05c0a3e50 con 0x7fc05c0b30c0 2024-04-25T02:23:23.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.986+0000 7fc05bfff700 1 --2- 172.21.15.111:0/2776885956 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc05c0b30c0 0x7fc05c06f480 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc04c013260 tx=0x7fc04c011af0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c251acc9770a668f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:23.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.986+0000 7fade37fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fade40b4fd0 0x7fade40a2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:23.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.986+0000 7fade37fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fade40b4fd0 0x7fade40a2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:35442/0 (socket says 172.21.15.111:35442) 2024-04-25T02:23:23.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.986+0000 7fade37fe700 1 -- 172.21.15.111:0/839326993 learned_addr learned my addr 172.21.15.111:0/839326993 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:23.004 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.986+0000 7fade3fff700 1 --2- 172.21.15.111:0/839326993 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fade413f110 0x7fade40a3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:23.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.986+0000 7fade3fff700 1 -- 172.21.15.111:0/839326993 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fade40b4fd0 msgr2=0x7fade40a2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:23.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.986+0000 7fade3fff700 1 --2- 172.21.15.111:0/839326993 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fade40b4fd0 0x7fade40a2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:23.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.986+0000 7fade3fff700 1 -- 172.21.15.111:0/839326993 >> v1:172.21.15.111:6789/0 conn(0x7fade40a3980 legacy=0x7fade413ea00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-25T02:23:23.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.986+0000 7fade3fff700 1 -- 172.21.15.111:0/839326993 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fade40a31a0 con 0x7fade413f110 2024-04-25T02:23:23.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.986+0000 7fade3fff700 1 --2- 172.21.15.111:0/839326993 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fade413f110 0x7fade40a3d50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7faddc009e90 tx=0x7faddc009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6be472f516de50bc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:23.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.987+0000 7fade27fc700 1 -- 172.21.15.111:0/839326993 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faddc00e070 con 0x7fade413f110 2024-04-25T02:23:23.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.986+0000 7fc05b7fe700 1 -- 172.21.15.111:0/2776885956 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04c016070 con 0x7fc05c0b30c0 2024-04-25T02:23:23.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.987+0000 7fc05b7fe700 1 -- 172.21.15.111:0/2776885956 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc04c013e90 con 0x7fc05c0b30c0 2024-04-25T02:23:23.005 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.987+0000 7fc05b7fe700 1 -- 172.21.15.111:0/2776885956 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04c011300 con 0x7fc05c0b30c0 2024-04-25T02:23:23.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.987+0000 7fade27fc700 1 -- 172.21.15.111:0/839326993 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faddc00bb90 con 0x7fade413f110 2024-04-25T02:23:23.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.987+0000 7fade27fc700 1 -- 172.21.15.111:0/839326993 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faddc012430 con 0x7fade413f110 2024-04-25T02:23:23.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.987+0000 7fade9b3e700 1 -- 172.21.15.111:0/839326993 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fade413f110 msgr2=0x7fade40a3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:23.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.987+0000 7fade9b3e700 1 --2- 172.21.15.111:0/839326993 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fade413f110 0x7fade40a3d50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7faddc009e90 tx=0x7faddc009780 comp rx=0 tx=0).stop 2024-04-25T02:23:23.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.987+0000 7fade9b3e700 1 -- 172.21.15.111:0/839326993 shutdown_connections 2024-04-25T02:23:23.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.987+0000 7fade9b3e700 1 --2- 172.21.15.111:0/839326993 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fade413f110 0x7fade40a3d50 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:23.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.987+0000 7fade9b3e700 1 --2- 172.21.15.111:0/839326993 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fade40b4fd0 0x7fade40a2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:23.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.987+0000 7fade9b3e700 1 -- 172.21.15.111:0/839326993 >> 172.21.15.111:0/839326993 conn(0x7fade40883e0 msgr2=0x7fade4068b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:23.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.988+0000 7fade9b3e700 1 -- 172.21.15.111:0/839326993 shutdown_connections 2024-04-25T02:23:23.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.988+0000 7fade9b3e700 1 -- 172.21.15.111:0/839326993 wait complete. 2024-04-25T02:23:23.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.989+0000 7fade9b3e700 1 Processor -- start 2024-04-25T02:23:23.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.989+0000 7fade9b3e700 1 -- start start 2024-04-25T02:23:23.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.989+0000 7fade9b3e700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fade40a3980 0x7fade4146270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:23.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.989+0000 7fade9b3e700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fade40b4fd0 0x7fade4144700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:23.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.989+0000 7fade9b3e700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fade413f110 0x7fade4144c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:23.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.989+0000 7fade9b3e700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fade4146c60 con 0x7fade40a3980 2024-04-25T02:23:23.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.989+0000 7fade9b3e700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fade406dc50 con 0x7fade40b4fd0 2024-04-25T02:23:23.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.989+0000 7fade9b3e700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fade406def0 con 0x7fade413f110 2024-04-25T02:23:23.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.989+0000 7fade3fff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fade413f110 0x7fade4144c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:23.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.989+0000 7fade3fff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fade413f110 0x7fade4144c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:41028/0 (socket says 172.21.15.111:41028) 2024-04-25T02:23:23.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.989+0000 7fade3fff700 1 -- 172.21.15.111:0/2994191120 learned_addr learned my addr 172.21.15.111:0/2994191120 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:23.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.989+0000 7fade37fe700 1 --2- 172.21.15.111:0/2994191120 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fade40a3980 0x7fade4146270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:23.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.989+0000 7fc06311b700 1 -- 172.21.15.111:0/2776885956 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc05c0b30c0 msgr2=0x7fc05c06f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:23.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.989+0000 7fc06311b700 1 --2- 172.21.15.111:0/2776885956 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc05c0b30c0 0x7fc05c06f480 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fc04c013260 tx=0x7fc04c011af0 comp rx=0 tx=0).stop 2024-04-25T02:23:23.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.990+0000 7fade2ffd700 1 --2- 172.21.15.111:0/2994191120 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fade40b4fd0 0x7fade4144700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:23.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.990+0000 7fade37fe700 1 -- 172.21.15.111:0/2994191120 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fade413f110 msgr2=0x7fade4144c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:23.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.990+0000 7fade37fe700 1 --2- 172.21.15.111:0/2994191120 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fade413f110 0x7fade4144c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:23.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.990+0000 7fade37fe700 1 -- 172.21.15.111:0/2994191120 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fade40b4fd0 msgr2=0x7fade4144700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:23.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.990+0000 7fade37fe700 1 --2- 172.21.15.111:0/2994191120 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fade40b4fd0 0x7fade4144700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:23.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.990+0000 7fade37fe700 1 -- 172.21.15.111:0/2994191120 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faddc009a20 con 0x7fade40a3980 2024-04-25T02:23:23.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.990+0000 7fc06311b700 1 -- 172.21.15.111:0/2776885956 shutdown_connections 2024-04-25T02:23:23.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.990+0000 7fc06311b700 1 --2- 172.21.15.111:0/2776885956 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc05c06f9c0 0x7fc05c146bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:23.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.990+0000 7fc06311b700 1 --2- 172.21.15.111:0/2776885956 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc05c0b30c0 0x7fc05c06f480 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:23.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.990+0000 7fc06311b700 1 -- 172.21.15.111:0/2776885956 >> 172.21.15.111:0/2776885956 conn(0x7fc05c06e2b0 msgr2=0x7fc05c06be80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:23.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.990+0000 7fade3fff700 1 --2- 172.21.15.111:0/2994191120 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fade413f110 0x7fade4144c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:23.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.990+0000 7fade37fe700 1 --2- 172.21.15.111:0/2994191120 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fade40a3980 0x7fade4146270 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fadd4006d40 tx=0x7fadd4009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:23.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.990+0000 7fc06311b700 1 -- 172.21.15.111:0/2776885956 shutdown_connections 2024-04-25T02:23:23.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.990+0000 7fadcb7fe700 1 -- 172.21.15.111:0/2994191120 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd4013680 con 0x7fade40a3980 2024-04-25T02:23:23.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.990+0000 7fadcb7fe700 1 -- 172.21.15.111:0/2994191120 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadd40137e0 con 0x7fade40a3980 2024-04-25T02:23:23.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.990+0000 7fade9b3e700 1 -- 172.21.15.111:0/2994191120 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fade41467b0 con 0x7fade40a3980 2024-04-25T02:23:23.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.990+0000 7fadcb7fe700 1 -- 172.21.15.111:0/2994191120 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadd4013b60 con 0x7fade40a3980 2024-04-25T02:23:23.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.990+0000 7fade9b3e700 1 -- 172.21.15.111:0/2994191120 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fade4142ef0 con 0x7fade40a3980 2024-04-25T02:23:23.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.991+0000 7fade9b3e700 1 -- 172.21.15.111:0/2994191120 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fade4065190 con 0x7fade40a3980 2024-04-25T02:23:23.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.990+0000 7fc06311b700 1 -- 172.21.15.111:0/2776885956 wait complete. 2024-04-25T02:23:23.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.992+0000 7fc06311b700 1 Processor -- start 2024-04-25T02:23:23.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.992+0000 7fc06311b700 1 -- start start 2024-04-25T02:23:23.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.993+0000 7fc06311b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc05c06f9c0 0x7fc05c0a9480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:23.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.993+0000 7fc06311b700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc05c0a4ed0 0x7fc05c14efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:23.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.993+0000 7fc06311b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc05c0b30c0 0x7fc05c14f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:23.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.993+0000 7fc06311b700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc05c13fd80 con 0x7fc05c0b30c0 2024-04-25T02:23:23.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.993+0000 7fc06311b700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc05c06c510 con 0x7fc05c0a4ed0 2024-04-25T02:23:23.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.993+0000 7fc06311b700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc05c0aa650 con 0x7fc05c06f9c0 2024-04-25T02:23:23.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.993+0000 7fc060eb7700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc05c06f9c0 0x7fc05c0a9480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:23.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.993+0000 7fc060eb7700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc05c06f9c0 0x7fc05c0a9480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:41034/0 (socket says 172.21.15.111:41034) 2024-04-25T02:23:23.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.993+0000 7fc060eb7700 1 -- 172.21.15.111:0/1940827765 learned_addr learned my addr 172.21.15.111:0/1940827765 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:23.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.993+0000 7fc060eb7700 1 -- 172.21.15.111:0/1940827765 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc05c0a4ed0 msgr2=0x7fc05c14efe0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T02:23:23.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.994+0000 7fc060eb7700 1 --2- 172.21.15.111:0/1940827765 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc05c0a4ed0 0x7fc05c14efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:23.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.994+0000 7fc060eb7700 1 -- 172.21.15.111:0/1940827765 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc05c0b30c0 msgr2=0x7fc05c14f520 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T02:23:23.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.994+0000 7fc060eb7700 1 --2- 172.21.15.111:0/1940827765 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc05c0b30c0 0x7fc05c14f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:23.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.994+0000 7fc060eb7700 1 -- 172.21.15.111:0/1940827765 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc04c011d90 con 0x7fc05c06f9c0 2024-04-25T02:23:23.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.994+0000 7fc060eb7700 1 --2- 172.21.15.111:0/1940827765 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc05c06f9c0 0x7fc05c0a9480 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc05000c590 tx=0x7fc05000c950 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:23.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.994+0000 7fc058ff9700 1 -- 172.21.15.111:0/1940827765 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc050011590 con 0x7fc05c06f9c0 2024-04-25T02:23:23.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.994+0000 7fc058ff9700 1 -- 172.21.15.111:0/1940827765 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0500116f0 con 0x7fc05c06f9c0 2024-04-25T02:23:23.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.994+0000 7fc058ff9700 1 -- 172.21.15.111:0/1940827765 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc050011ab0 con 0x7fc05c06f9c0 2024-04-25T02:23:23.015 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.994+0000 7fadcb7fe700 1 -- 172.21.15.111:0/2994191120 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7fadd4025420 con 0x7fade40a3980 2024-04-25T02:23:23.015 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.994+0000 7fadcb7fe700 1 -- 172.21.15.111:0/2994191120 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fadd405b6f0 con 0x7fade40a3980 2024-04-25T02:23:23.015 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.994+0000 7fadcb7fe700 1 -- 172.21.15.111:0/2994191120 --> v1:172.21.15.111:6808/49070 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fadd0052a60 con 0x7fadd004eda0 2024-04-25T02:23:23.015 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.994+0000 7fc06311b700 1 -- 172.21.15.111:0/1940827765 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc05c14fa60 con 0x7fc05c06f9c0 2024-04-25T02:23:23.015 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.994+0000 7fc06311b700 1 -- 172.21.15.111:0/1940827765 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc05c140390 con 0x7fc05c06f9c0 2024-04-25T02:23:23.015 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.995+0000 7fadcb7fe700 1 -- 172.21.15.111:0/2994191120 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fadd405bac0 con 0x7fade40a3980 2024-04-25T02:23:23.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.995+0000 7fc06311b700 1 -- 172.21.15.111:0/1940827765 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc05c0b1e40 con 0x7fc05c06f9c0 2024-04-25T02:23:23.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.996+0000 7fc058ff9700 1 -- 172.21.15.111:0/1940827765 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7fc05001b3b0 con 0x7fc05c06f9c0 2024-04-25T02:23:23.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.996+0000 7fadcb7fe700 1 -- 172.21.15.111:0/2994191120 <== osd.2 v1:172.21.15.111:6808/49070 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (unknown 0 0 1173804961) 0x7fadd0052a60 con 0x7fadd004eda0 2024-04-25T02:23:23.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.996+0000 7fc058ff9700 1 -- 172.21.15.111:0/1940827765 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fc05005aec0 con 0x7fc05c06f9c0 2024-04-25T02:23:23.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.996+0000 7fc058ff9700 1 -- 172.21.15.111:0/1940827765 --> v1:172.21.15.111:6804/48960 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc048052b30 con 0x7fc04804ee70 2024-04-25T02:23:23.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.996+0000 7fc058ff9700 1 -- 172.21.15.111:0/1940827765 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_get_version_reply(handle=1 version=40) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc05005b290 con 0x7fc05c06f9c0 2024-04-25T02:23:23.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:22.998+0000 7fc058ff9700 1 -- 172.21.15.111:0/1940827765 <== osd.1 v1:172.21.15.111:6804/48960 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (unknown 0 0 1173804961) 0x7fc048052b30 con 0x7fc04804ee70 2024-04-25T02:23:23.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.001+0000 7f98ba720700 1 -- 172.21.15.111:0/1186273980 --> v1:172.21.15.111:6812/49243 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f98b4099ec0 con 0x7f989404eda0 2024-04-25T02:23:23.017 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.001+0000 7f98b0ff9700 1 -- 172.21.15.111:0/1186273980 <== osd.3 v1:172.21.15.111:6812/49243 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 3918910179) 0x7f98b4099ec0 con 0x7f989404eda0 2024-04-25T02:23:23.018 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.002+0000 7f98ba720700 1 -- 172.21.15.111:0/1186273980 >> v1:172.21.15.111:6812/49243 conn(0x7f989404eda0 legacy=0x7f98940511f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:23.018 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.002+0000 7f98ba720700 1 -- 172.21.15.111:0/1186273980 >> v1:172.21.15.111:6816/46482 conn(0x7f9894046010 legacy=0x7f98940484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:23.018 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.002+0000 7f98ba720700 1 -- 172.21.15.111:0/1186273980 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f98b40b1520 msgr2=0x7f98b4151490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:23.018 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.002+0000 7f98ba720700 1 --2- 172.21.15.111:0/1186273980 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f98b40b1520 0x7f98b4151490 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f98ac00d890 tx=0x7f98ac008040 comp rx=0 tx=0).stop 2024-04-25T02:23:23.018 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.005+0000 7f98b8cbd700 1 -- 172.21.15.111:0/1186273980 reap_dead start 2024-04-25T02:23:23.018 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.005+0000 7f98ba720700 1 -- 172.21.15.111:0/1186273980 shutdown_connections 2024-04-25T02:23:23.019 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.005+0000 7f98ba720700 1 -- 172.21.15.111:0/1186273980 >> 172.21.15.111:0/1186273980 conn(0x7f98b406c040 msgr2=0x7f98b40a4750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:23.019 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.005+0000 7f98ba720700 1 -- 172.21.15.111:0/1186273980 shutdown_connections 2024-04-25T02:23:23.019 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.005+0000 7f98ba720700 1 -- 172.21.15.111:0/1186273980 wait complete. 2024-04-25T02:23:23.019 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.006+0000 7fba2e12f700 1 -- 172.21.15.111:0/980153870 --> v1:172.21.15.111:6800/48862 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fba080070d0 con 0x7fba080015c0 2024-04-25T02:23:23.019 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.006+0000 7fba0f7fe700 1 -- 172.21.15.111:0/980153870 <== osd.0 v1:172.21.15.111:6800/48862 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 3232526981) 0x7fba080070d0 con 0x7fba080015c0 2024-04-25T02:23:23.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.006+0000 7fba2e12f700 1 -- 172.21.15.111:0/980153870 >> v1:172.21.15.111:6800/48862 conn(0x7fba080015c0 legacy=0x7fba08003a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:23.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.010+0000 7fba2e12f700 1 -- 172.21.15.111:0/980153870 >> v1:172.21.15.111:6816/46482 conn(0x7fba10046100 legacy=0x7fba100485b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:23.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.010+0000 7fba2e12f700 1 -- 172.21.15.111:0/980153870 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fba280b20d0 msgr2=0x7fba280aab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:23.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.010+0000 7fba2e12f700 1 --2- 172.21.15.111:0/980153870 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fba280b20d0 0x7fba280aab40 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7fba280a4d90 tx=0x7fba20018000 comp rx=0 tx=0).stop 2024-04-25T02:23:23.020 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.012+0000 7fba27fff700 1 -- 172.21.15.111:0/980153870 reap_dead start 2024-04-25T02:23:23.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.012+0000 7fba2e12f700 1 -- 172.21.15.111:0/980153870 shutdown_connections 2024-04-25T02:23:23.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.012+0000 7fba2e12f700 1 -- 172.21.15.111:0/980153870 >> 172.21.15.111:0/980153870 conn(0x7fba2806abb0 msgr2=0x7fba28064900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:23.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.012+0000 7fba2e12f700 1 -- 172.21.15.111:0/980153870 shutdown_connections 2024-04-25T02:23:23.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.012+0000 7fba2e12f700 1 -- 172.21.15.111:0/980153870 wait complete. 2024-04-25T02:23:23.021 INFO:teuthology.orchestra.run.smithi111.stdout:133143986180 2024-04-25T02:23:23.022 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T02:23:23.027 INFO:teuthology.orchestra.run.smithi111.stdout:120259084292 2024-04-25T02:23:23.027 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T02:23:23.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.024+0000 7fade9b3e700 1 -- 172.21.15.111:0/2994191120 --> v1:172.21.15.111:6808/49070 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fade40a2ee0 con 0x7fadd004eda0 2024-04-25T02:23:23.029 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.025+0000 7fadcb7fe700 1 -- 172.21.15.111:0/2994191120 <== osd.2 v1:172.21.15.111:6808/49070 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 2827348261) 0x7fade40a2ee0 con 0x7fadd004eda0 2024-04-25T02:23:23.029 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.025+0000 7fade9b3e700 1 -- 172.21.15.111:0/2994191120 >> v1:172.21.15.111:6808/49070 conn(0x7fadd004eda0 legacy=0x7fadd00511f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:23.030 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.025+0000 7fade9b3e700 1 -- 172.21.15.111:0/2994191120 >> v1:172.21.15.111:6816/46482 conn(0x7fadd0046010 legacy=0x7fadd00484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:23.030 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.025+0000 7fade9b3e700 1 -- 172.21.15.111:0/2994191120 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fade40a3980 msgr2=0x7fade4146270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:23.030 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.025+0000 7fade9b3e700 1 --2- 172.21.15.111:0/2994191120 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fade40a3980 0x7fade4146270 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fadd4006d40 tx=0x7fadd4009250 comp rx=0 tx=0).stop 2024-04-25T02:23:23.030 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.025+0000 7fade3fff700 1 -- 172.21.15.111:0/2994191120 reap_dead start 2024-04-25T02:23:23.030 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.026+0000 7fade9b3e700 1 -- 172.21.15.111:0/2994191120 shutdown_connections 2024-04-25T02:23:23.030 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.026+0000 7fade9b3e700 1 -- 172.21.15.111:0/2994191120 >> 172.21.15.111:0/2994191120 conn(0x7fade40883e0 msgr2=0x7fade413e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:23.030 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.026+0000 7fade9b3e700 1 -- 172.21.15.111:0/2994191120 shutdown_connections 2024-04-25T02:23:23.030 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.026+0000 7fade9b3e700 1 -- 172.21.15.111:0/2994191120 wait complete. 2024-04-25T02:23:23.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.027+0000 7fc06311b700 1 -- 172.21.15.111:0/1940827765 --> v1:172.21.15.111:6804/48960 -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fc05c0b01e0 con 0x7fc04804ee70 2024-04-25T02:23:23.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.027+0000 7fc058ff9700 1 -- 172.21.15.111:0/1940827765 <== osd.1 v1:172.21.15.111:6804/48960 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (unknown 0 0 277563570) 0x7fc05c0b01e0 con 0x7fc04804ee70 2024-04-25T02:23:23.032 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.027+0000 7fc06311b700 1 -- 172.21.15.111:0/1940827765 >> v1:172.21.15.111:6804/48960 conn(0x7fc04804ee70 legacy=0x7fc0480512c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:23.032 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.028+0000 7fc06311b700 1 -- 172.21.15.111:0/1940827765 >> v1:172.21.15.111:6816/46482 conn(0x7fc0480460e0 legacy=0x7fc048048590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:23.032 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.028+0000 7fc06311b700 1 -- 172.21.15.111:0/1940827765 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc05c06f9c0 msgr2=0x7fc05c0a9480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:23.032 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.028+0000 7fc06311b700 1 --2- 172.21.15.111:0/1940827765 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc05c06f9c0 0x7fc05c0a9480 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc05000c590 tx=0x7fc05000c950 comp rx=0 tx=0).stop 2024-04-25T02:23:23.032 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.028+0000 7fc0616b8700 1 -- 172.21.15.111:0/1940827765 reap_dead start 2024-04-25T02:23:23.032 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.028+0000 7fc06311b700 1 -- 172.21.15.111:0/1940827765 shutdown_connections 2024-04-25T02:23:23.032 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.028+0000 7fc06311b700 1 -- 172.21.15.111:0/1940827765 >> 172.21.15.111:0/1940827765 conn(0x7fc05c06e2b0 msgr2=0x7fc05c064900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:23.032 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.028+0000 7fc06311b700 1 -- 172.21.15.111:0/1940827765 shutdown_connections 2024-04-25T02:23:23.032 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.028+0000 7fc06311b700 1 -- 172.21.15.111:0/1940827765 wait complete. 2024-04-25T02:23:23.045 INFO:teuthology.orchestra.run.smithi111.stdout:128849018884 2024-04-25T02:23:23.046 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T02:23:23.048 INFO:teuthology.orchestra.run.smithi111.stdout:124554051588 2024-04-25T02:23:23.048 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T02:23:23.150 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.146+0000 7f92cfd05700 1 Processor -- start 2024-04-25T02:23:23.150 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.146+0000 7f92cfd05700 1 -- start start 2024-04-25T02:23:23.153 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.147+0000 7f92cfd05700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f92c80b3440 0x7f92c813f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:23.153 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.147+0000 7f92cfd05700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f92c80a4ff0 0x7f92c8146fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:23.153 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.147+0000 7f92cfd05700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92c80a4540 con 0x7f92c80a73c0 2024-04-25T02:23:23.153 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.147+0000 7f92cfd05700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c806fef0 con 0x7f92c80a4ff0 2024-04-25T02:23:23.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.147+0000 7f92cfd05700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92c80a42a0 con 0x7f92c80b3440 2024-04-25T02:23:23.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.147+0000 7f92cdaa1700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f92c80b3440 0x7f92c813f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:23.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.147+0000 7f92cdaa1700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f92c80b3440 0x7f92c813f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:41042/0 (socket says 172.21.15.111:41042) 2024-04-25T02:23:23.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.147+0000 7f92cdaa1700 1 -- 172.21.15.111:0/926710340 learned_addr learned my addr 172.21.15.111:0/926710340 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:23.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.147+0000 7f92ce2a2700 1 --2- 172.21.15.111:0/926710340 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f92c80a4ff0 0x7f92c8146fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:23.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.147+0000 7f92cca9f700 1 -- 172.21.15.111:0/926710340 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 747141784 0 0) 0x7f92c80a4540 con 0x7f92c80a73c0 2024-04-25T02:23:23.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.147+0000 7f92cdaa1700 1 -- 172.21.15.111:0/926710340 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f92c80a4ff0 msgr2=0x7f92c8146fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:23.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.147+0000 7f92cdaa1700 1 --2- 172.21.15.111:0/926710340 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f92c80a4ff0 0x7f92c8146fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:23.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.147+0000 7f92cdaa1700 1 -- 172.21.15.111:0/926710340 >> v1:172.21.15.111:6789/0 conn(0x7f92c80a73c0 legacy=0x7f92c813ff20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:23.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.147+0000 7f92cdaa1700 1 -- 172.21.15.111:0/926710340 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c80b08a0 con 0x7f92c80b3440 2024-04-25T02:23:23.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.147+0000 7f92cdaa1700 1 --2- 172.21.15.111:0/926710340 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f92c80b3440 0x7f92c813f9e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f92c40099e0 tx=0x7f92c4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c012ff303e16a962 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:23.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.148+0000 7f92cca9f700 1 -- 172.21.15.111:0/926710340 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c400b8f0 con 0x7f92c80b3440 2024-04-25T02:23:23.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.148+0000 7f92cca9f700 1 -- 172.21.15.111:0/926710340 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92c400ba50 con 0x7f92c80b3440 2024-04-25T02:23:23.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.148+0000 7f92cca9f700 1 -- 172.21.15.111:0/926710340 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92c400bdf0 con 0x7f92c80b3440 2024-04-25T02:23:23.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.148+0000 7f92cfd05700 1 -- 172.21.15.111:0/926710340 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f92c80b3440 msgr2=0x7f92c813f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:23.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.148+0000 7f92cfd05700 1 --2- 172.21.15.111:0/926710340 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f92c80b3440 0x7f92c813f9e0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f92c40099e0 tx=0x7f92c4009250 comp rx=0 tx=0).stop 2024-04-25T02:23:23.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.148+0000 7f92cfd05700 1 -- 172.21.15.111:0/926710340 shutdown_connections 2024-04-25T02:23:23.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.148+0000 7f92cfd05700 1 --2- 172.21.15.111:0/926710340 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f92c80b3440 0x7f92c813f9e0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:23.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.148+0000 7f92cfd05700 1 --2- 172.21.15.111:0/926710340 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f92c80a4ff0 0x7f92c8146fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:23.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.148+0000 7f92cfd05700 1 -- 172.21.15.111:0/926710340 >> 172.21.15.111:0/926710340 conn(0x7f92c806e080 msgr2=0x7f92c806bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:23.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.148+0000 7f92cfd05700 1 -- 172.21.15.111:0/926710340 shutdown_connections 2024-04-25T02:23:23.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.149+0000 7f92cfd05700 1 -- 172.21.15.111:0/926710340 wait complete. 2024-04-25T02:23:23.156 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.149+0000 7f18b852c700 1 Processor -- start 2024-04-25T02:23:23.156 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.149+0000 7f18b852c700 1 -- start start 2024-04-25T02:23:23.156 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.149+0000 7f92cfd05700 1 Processor -- start 2024-04-25T02:23:23.156 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.149+0000 7f92cfd05700 1 -- start start 2024-04-25T02:23:23.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.150+0000 7f18b852c700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f18b006eef0 0x7f18b0131100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:23.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.150+0000 7f18b852c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f18b0131640 0x7f18b01459a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:23.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.150+0000 7f18b852c700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18b006e510 con 0x7f18b0063d30 2024-04-25T02:23:23.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.150+0000 7f18b852c700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18b013e660 con 0x7f18b006eef0 2024-04-25T02:23:23.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.150+0000 7f18b852c700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18b013e900 con 0x7f18b0131640 2024-04-25T02:23:23.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.150+0000 7f18b5ac7700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f18b006eef0 0x7f18b0131100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:23.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.150+0000 7f18b6ac9700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f18b0131640 0x7f18b01459a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:23.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.150+0000 7f18b5ac7700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f18b006eef0 0x7f18b0131100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:60362/0 (socket says 172.21.15.111:60362) 2024-04-25T02:23:23.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.150+0000 7f18b5ac7700 1 -- 172.21.15.111:0/3888204929 learned_addr learned my addr 172.21.15.111:0/3888204929 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:23.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.151+0000 7f18b6ac9700 1 -- 172.21.15.111:0/3888204929 >> v2:172.21.15.111:3300/0 conn(0x7f18b006eef0 msgr2=0x7f18b0131100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:23.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.151+0000 7f18b6ac9700 1 --2- 172.21.15.111:0/3888204929 >> v2:172.21.15.111:3300/0 conn(0x7f18b006eef0 0x7f18b0131100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:23.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.151+0000 7f18b6ac9700 1 -- 172.21.15.111:0/3888204929 >> v1:172.21.15.111:6789/0 conn(0x7f18b0063d30 legacy=0x7f18b00ad3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:23.159 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.151+0000 7f18b6ac9700 1 -- 172.21.15.111:0/3888204929 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18b013eba0 con 0x7f18b0131640 2024-04-25T02:23:23.159 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.150+0000 7f92cfd05700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f92c80a4ff0 0x7f92c80a8250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:23.159 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.150+0000 7f92cfd05700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f92c80a73c0 0x7f92c81369a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:23.159 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.150+0000 7f92cfd05700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f92c80b3440 0x7f92c8136ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:23.159 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.150+0000 7f92cfd05700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92c80a9f10 con 0x7f92c80b3440 2024-04-25T02:23:23.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.150+0000 7f92cfd05700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92c8137420 con 0x7f92c80a73c0 2024-04-25T02:23:23.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.150+0000 7f92cfd05700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f92c80a8c20 con 0x7f92c80a4ff0 2024-04-25T02:23:23.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.151+0000 7f92cdaa1700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f92c80a4ff0 0x7f92c80a8250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:23.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.151+0000 7f92cd2a0700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f92c80a73c0 0x7f92c81369a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:23.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.151+0000 7f92cdaa1700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f92c80a4ff0 0x7f92c80a8250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:41064/0 (socket says 172.21.15.111:41064) 2024-04-25T02:23:23.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.151+0000 7f92cdaa1700 1 -- 172.21.15.111:0/1033187822 learned_addr learned my addr 172.21.15.111:0/1033187822 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:23.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.151+0000 7f92ce2a2700 1 --2- 172.21.15.111:0/1033187822 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f92c80b3440 0x7f92c8136ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:23.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.151+0000 7f92cd2a0700 1 -- 172.21.15.111:0/1033187822 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f92c80a4ff0 msgr2=0x7f92c80a8250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:23.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.151+0000 7f92cd2a0700 1 --2- 172.21.15.111:0/1033187822 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f92c80a4ff0 0x7f92c80a8250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:23.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.151+0000 7f92cd2a0700 1 -- 172.21.15.111:0/1033187822 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f92c80b3440 msgr2=0x7f92c8136ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:23.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.151+0000 7f92cd2a0700 1 --2- 172.21.15.111:0/1033187822 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f92c80b3440 0x7f92c8136ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:23.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.151+0000 7f92cd2a0700 1 -- 172.21.15.111:0/1033187822 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92c40094f0 con 0x7f92c80a73c0 2024-04-25T02:23:23.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.151+0000 7f18b6ac9700 1 --2- 172.21.15.111:0/3888204929 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f18b0131640 0x7f18b01459a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f18a8009e60 tx=0x7f18a8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=74594cc2d419b8f5 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:23.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.151+0000 7f92cd2a0700 1 --2- 172.21.15.111:0/1033187822 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f92c80a73c0 0x7f92c81369a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f92b80011e0 tx=0x7f92b8007d30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:23.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.151+0000 7f18b52c6700 1 -- 172.21.15.111:0/3888204929 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a800e070 con 0x7f18b0131640 2024-04-25T02:23:23.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.151+0000 7f18b52c6700 1 -- 172.21.15.111:0/3888204929 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a800bb60 con 0x7f18b0131640 2024-04-25T02:23:23.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.151+0000 7f18b52c6700 1 -- 172.21.15.111:0/3888204929 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a8012430 con 0x7f18b0131640 2024-04-25T02:23:23.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.151+0000 7f92bdffb700 1 -- 172.21.15.111:0/1033187822 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b8011590 con 0x7f92c80a73c0 2024-04-25T02:23:23.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.151+0000 7f92bdffb700 1 -- 172.21.15.111:0/1033187822 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f92b80116f0 con 0x7f92c80a73c0 2024-04-25T02:23:23.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.151+0000 7f92cfd05700 1 -- 172.21.15.111:0/1033187822 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92c8137890 con 0x7f92c80a73c0 2024-04-25T02:23:23.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.151+0000 7f92bdffb700 1 -- 172.21.15.111:0/1033187822 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f92b8011ab0 con 0x7f92c80a73c0 2024-04-25T02:23:23.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.152+0000 7f92cfd05700 1 -- 172.21.15.111:0/1033187822 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f92c80a8790 con 0x7f92c80a73c0 2024-04-25T02:23:23.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.152+0000 7f18b852c700 1 -- 172.21.15.111:0/3888204929 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f18b0131640 msgr2=0x7f18b01459a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:23.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.152+0000 7f18b852c700 1 --2- 172.21.15.111:0/3888204929 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f18b0131640 0x7f18b01459a0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f18a8009e60 tx=0x7f18a8009780 comp rx=0 tx=0).stop 2024-04-25T02:23:23.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.152+0000 7f18b852c700 1 -- 172.21.15.111:0/3888204929 shutdown_connections 2024-04-25T02:23:23.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.152+0000 7f18b852c700 1 --2- 172.21.15.111:0/3888204929 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f18b0131640 0x7f18b01459a0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:23.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.152+0000 7f18b852c700 1 --2- 172.21.15.111:0/3888204929 >> v2:172.21.15.111:3300/0 conn(0x7f18b006eef0 0x7f18b0131100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:23.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.152+0000 7f18b852c700 1 -- 172.21.15.111:0/3888204929 >> 172.21.15.111:0/3888204929 conn(0x7f18b00b1e10 msgr2=0x7f18b00ade80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:23.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.152+0000 7f18b852c700 1 -- 172.21.15.111:0/3888204929 shutdown_connections 2024-04-25T02:23:23.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.153+0000 7f92cfd05700 1 -- 172.21.15.111:0/1033187822 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92a80052a0 con 0x7f92c80a73c0 2024-04-25T02:23:23.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.153+0000 7f92bdffb700 1 -- 172.21.15.111:0/1033187822 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f92b801b3b0 con 0x7f92c80a73c0 2024-04-25T02:23:23.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.153+0000 7f18b852c700 1 -- 172.21.15.111:0/3888204929 wait complete. 2024-04-25T02:23:23.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.153+0000 7f92bdffb700 1 -- 172.21.15.111:0/1033187822 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f92b805c5d0 con 0x7f92c80a73c0 2024-04-25T02:23:23.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.155+0000 7f18b852c700 1 Processor -- start 2024-04-25T02:23:23.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.155+0000 7f18b852c700 1 -- start start 2024-04-25T02:23:23.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.155+0000 7f18b852c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f18b0063d30 0x7f18b00aa0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:23.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.155+0000 7f18b852c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f18b006eef0 0x7f18b00aa600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:23.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.155+0000 7f18b852c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18b012dd00 0x7f18b00aab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:23.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.155+0000 7f18b852c700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18b012d0d0 con 0x7f18b012dd00 2024-04-25T02:23:23.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.155+0000 7f18b852c700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18b012c900 con 0x7f18b006eef0 2024-04-25T02:23:23.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.155+0000 7f18b852c700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f18b0065140 con 0x7f18b0063d30 2024-04-25T02:23:23.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.155+0000 7f18b6ac9700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18b012dd00 0x7f18b00aab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:23.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.155+0000 7f18b6ac9700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18b012dd00 0x7f18b00aab40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:60384/0 (socket says 172.21.15.111:60384) 2024-04-25T02:23:23.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.155+0000 7f18b6ac9700 1 -- 172.21.15.111:0/2973493100 learned_addr learned my addr 172.21.15.111:0/2973493100 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:23.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.155+0000 7f18b62c8700 1 --2- 172.21.15.111:0/2973493100 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f18b0063d30 0x7f18b00aa0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:23.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.156+0000 7f18b6ac9700 1 -- 172.21.15.111:0/2973493100 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f18b0063d30 msgr2=0x7f18b00aa0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:23.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.156+0000 7f18b6ac9700 1 --2- 172.21.15.111:0/2973493100 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f18b0063d30 0x7f18b00aa0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:23.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.156+0000 7f18b6ac9700 1 -- 172.21.15.111:0/2973493100 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f18b006eef0 msgr2=0x7f18b00aa600 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T02:23:23.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.156+0000 7f18b6ac9700 1 --2- 172.21.15.111:0/2973493100 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f18b006eef0 0x7f18b00aa600 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:23.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.156+0000 7f18b6ac9700 1 -- 172.21.15.111:0/2973493100 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18a8009a20 con 0x7f18b012dd00 2024-04-25T02:23:23.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.156+0000 7f18b6ac9700 1 --2- 172.21.15.111:0/2973493100 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18b012dd00 0x7f18b00aab40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f18a8013000 tx=0x7f18a8019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:23.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.156+0000 7f18a67fc700 1 -- 172.21.15.111:0/2973493100 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a8027470 con 0x7f18b012dd00 2024-04-25T02:23:23.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.156+0000 7f18a67fc700 1 -- 172.21.15.111:0/2973493100 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18a80275d0 con 0x7f18b012dd00 2024-04-25T02:23:23.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.156+0000 7f18b852c700 1 -- 172.21.15.111:0/2973493100 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18b012d7d0 con 0x7f18b012dd00 2024-04-25T02:23:23.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.156+0000 7f18a67fc700 1 -- 172.21.15.111:0/2973493100 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18a8027990 con 0x7f18b012dd00 2024-04-25T02:23:23.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.156+0000 7f18b852c700 1 -- 172.21.15.111:0/2973493100 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18b00ab5a0 con 0x7f18b012dd00 2024-04-25T02:23:23.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.157+0000 7f18a67fc700 1 -- 172.21.15.111:0/2973493100 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f18a8024070 con 0x7f18b012dd00 2024-04-25T02:23:23.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.157+0000 7f18a67fc700 1 -- 172.21.15.111:0/2973493100 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f18a805dcc0 con 0x7f18b012dd00 2024-04-25T02:23:23.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.159+0000 7f92cdaa1700 1 --2- 172.21.15.111:0/1033187822 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f92c80a4ff0 0x7f92c80a8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:23:23.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.160+0000 7f18b852c700 1 -- 172.21.15.111:0/2973493100 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18b0071790 con 0x7f18b012dd00 2024-04-25T02:23:23.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.160+0000 7f92bdffb700 1 -- 172.21.15.111:0/1033187822 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f92b8060060 con 0x7f92c80a73c0 2024-04-25T02:23:23.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.164+0000 7f18a67fc700 1 -- 172.21.15.111:0/2973493100 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f18a8006a30 con 0x7f18b012dd00 2024-04-25T02:23:23.218 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.214+0000 7f0f2732c700 1 Processor -- start 2024-04-25T02:23:23.218 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.215+0000 7f0f2732c700 1 -- start start 2024-04-25T02:23:23.220 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.215+0000 7f0f2732c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0f20067940 0x7f0f200a2380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:23.221 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.215+0000 7f0f2732c700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f0f200a3400 0x7f0f2006da60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:23.221 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.215+0000 7f0f2732c700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f200a38b0 con 0x7f0f2006dfa0 2024-04-25T02:23:23.221 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.215+0000 7f0f2732c700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f2006b760 con 0x7f0f200a3400 2024-04-25T02:23:23.221 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.215+0000 7f0f2732c700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f200a3b50 con 0x7f0f20067940 2024-04-25T02:23:23.221 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.215+0000 7f0f250c8700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0f20067940 0x7f0f200a2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:23.221 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.215+0000 7f0f258c9700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f0f2006dfa0 0x7f0f20148520 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:33748/0 (socket says 172.21.15.111:33748) 2024-04-25T02:23:23.221 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.215+0000 7f0f258c9700 1 -- 172.21.15.111:0/659408883 learned_addr learned my addr 172.21.15.111:0/659408883 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:23:23.221 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.215+0000 7f0f248c7700 1 --2- 172.21.15.111:0/659408883 >> v2:172.21.15.111:3300/0 conn(0x7f0f200a3400 0x7f0f2006da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:23.221 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.216+0000 7f0f250c8700 1 -- 172.21.15.111:0/659408883 >> v2:172.21.15.111:3300/0 conn(0x7f0f200a3400 msgr2=0x7f0f2006da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:23.221 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.216+0000 7f0f250c8700 1 --2- 172.21.15.111:0/659408883 >> v2:172.21.15.111:3300/0 conn(0x7f0f200a3400 0x7f0f2006da60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:23.221 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.216+0000 7f0f250c8700 1 -- 172.21.15.111:0/659408883 >> v1:172.21.15.111:6789/0 conn(0x7f0f2006dfa0 legacy=0x7f0f20148520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:23.221 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.216+0000 7f0f250c8700 1 -- 172.21.15.111:0/659408883 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f2006ff60 con 0x7f0f20067940 2024-04-25T02:23:23.221 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.216+0000 7f0f250c8700 1 --2- 172.21.15.111:0/659408883 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0f20067940 0x7f0f200a2380 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c009910 tx=0x7f0f1c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cebf51b6aa2166d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:23.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.216+0000 7f0f17fff700 1 -- 172.21.15.111:0/659408883 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1c00b640 con 0x7f0f20067940 2024-04-25T02:23:23.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.216+0000 7f0f17fff700 1 -- 172.21.15.111:0/659408883 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f1c00b7a0 con 0x7f0f20067940 2024-04-25T02:23:23.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.216+0000 7f0f17fff700 1 -- 172.21.15.111:0/659408883 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f1c00bb60 con 0x7f0f20067940 2024-04-25T02:23:23.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.217+0000 7f0f2732c700 1 -- 172.21.15.111:0/659408883 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0f20067940 msgr2=0x7f0f200a2380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:23.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.217+0000 7f0f2732c700 1 --2- 172.21.15.111:0/659408883 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0f20067940 0x7f0f200a2380 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f0f1c009910 tx=0x7f0f1c0091a0 comp rx=0 tx=0).stop 2024-04-25T02:23:23.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.217+0000 7f0f2732c700 1 -- 172.21.15.111:0/659408883 shutdown_connections 2024-04-25T02:23:23.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.217+0000 7f0f2732c700 1 --2- 172.21.15.111:0/659408883 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0f20067940 0x7f0f200a2380 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:23.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.217+0000 7f0f2732c700 1 --2- 172.21.15.111:0/659408883 >> v2:172.21.15.111:3300/0 conn(0x7f0f200a3400 0x7f0f2006da60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:23.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.217+0000 7f0f2732c700 1 -- 172.21.15.111:0/659408883 >> 172.21.15.111:0/659408883 conn(0x7f0f200b1cf0 msgr2=0x7f0f200b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:23.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.217+0000 7f0f2732c700 1 -- 172.21.15.111:0/659408883 shutdown_connections 2024-04-25T02:23:23.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.217+0000 7f0f2732c700 1 -- 172.21.15.111:0/659408883 wait complete. 2024-04-25T02:23:23.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.218+0000 7f0f2732c700 1 Processor -- start 2024-04-25T02:23:23.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.218+0000 7f0f2732c700 1 -- start start 2024-04-25T02:23:23.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.218+0000 7f0f2732c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0f20067940 0x7f0f200acb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:23.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.218+0000 7f0f2732c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0f2006dfa0 0x7f0f201514d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:23.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.218+0000 7f0f2732c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0f200a3400 0x7f0f20151a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:23.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.219+0000 7f0f2732c700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f20097b80 con 0x7f0f2006dfa0 2024-04-25T02:23:23.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.219+0000 7f0f2732c700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f200aa6b0 con 0x7f0f200a3400 2024-04-25T02:23:23.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.219+0000 7f0f2732c700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0f200ac2f0 con 0x7f0f20067940 2024-04-25T02:23:23.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.219+0000 7f0f250c8700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0f20067940 0x7f0f200acb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:23.224 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.219+0000 7f0f258c9700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0f200a3400 0x7f0f20151a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:23.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.219+0000 7f0f250c8700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0f20067940 0x7f0f200acb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:41090/0 (socket says 172.21.15.111:41090) 2024-04-25T02:23:23.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.219+0000 7f0f250c8700 1 -- 172.21.15.111:0/447202117 learned_addr learned my addr 172.21.15.111:0/447202117 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:23.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.219+0000 7f0f248c7700 1 --2- 172.21.15.111:0/447202117 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0f2006dfa0 0x7f0f201514d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:23.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.219+0000 7f0f248c7700 1 -- 172.21.15.111:0/447202117 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0f20067940 msgr2=0x7f0f200acb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:23.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.219+0000 7f0f248c7700 1 --2- 172.21.15.111:0/447202117 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0f20067940 0x7f0f200acb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:23.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.219+0000 7f0f248c7700 1 -- 172.21.15.111:0/447202117 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0f200a3400 msgr2=0x7f0f20151a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:23.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.219+0000 7f0f248c7700 1 --2- 172.21.15.111:0/447202117 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0f200a3400 0x7f0f20151a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:23.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.219+0000 7f0f248c7700 1 -- 172.21.15.111:0/447202117 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f1c009420 con 0x7f0f2006dfa0 2024-04-25T02:23:23.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.219+0000 7f0f258c9700 1 --2- 172.21.15.111:0/447202117 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0f200a3400 0x7f0f20151a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:23:23.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.219+0000 7f0f248c7700 1 --2- 172.21.15.111:0/447202117 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0f2006dfa0 0x7f0f201514d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0f20069ad0 tx=0x7f0f100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:23.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.219+0000 7f0f157fa700 1 -- 172.21.15.111:0/447202117 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f10013680 con 0x7f0f2006dfa0 2024-04-25T02:23:23.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.219+0000 7f0f157fa700 1 -- 172.21.15.111:0/447202117 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f100137e0 con 0x7f0f2006dfa0 2024-04-25T02:23:23.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.219+0000 7f0f2732c700 1 -- 172.21.15.111:0/447202117 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f200ad560 con 0x7f0f2006dfa0 2024-04-25T02:23:23.225 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.219+0000 7f0f157fa700 1 -- 172.21.15.111:0/447202117 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f10013ba0 con 0x7f0f2006dfa0 2024-04-25T02:23:23.226 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.220+0000 7f0f2732c700 1 -- 172.21.15.111:0/447202117 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f200ad0d0 con 0x7f0f2006dfa0 2024-04-25T02:23:23.226 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.220+0000 7f0f2732c700 1 -- 172.21.15.111:0/447202117 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f200aa490 con 0x7f0f2006dfa0 2024-04-25T02:23:23.226 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.221+0000 7f0f157fa700 1 -- 172.21.15.111:0/447202117 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f0f100123d0 con 0x7f0f2006dfa0 2024-04-25T02:23:23.226 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.221+0000 7f0f157fa700 1 -- 172.21.15.111:0/447202117 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f0f1005b600 con 0x7f0f2006dfa0 2024-04-25T02:23:23.228 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.224+0000 7f0f157fa700 1 -- 172.21.15.111:0/447202117 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f0f100397c0 con 0x7f0f2006dfa0 2024-04-25T02:23:23.229 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.226+0000 7f7c1bdd4700 1 Processor -- start 2024-04-25T02:23:23.230 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.226+0000 7f7c1bdd4700 1 -- start start 2024-04-25T02:23:23.231 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.227+0000 7f7c1bdd4700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7c140ad550 0x7f7c1406d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:23.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.227+0000 7f7c1bdd4700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f7c1406e5a0 0x7f7c1413ea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:23.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.227+0000 7f7c1bdd4700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7c1413ef90 0x7f7c14141850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:23.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.227+0000 7f7c1bdd4700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c1406d490 con 0x7f7c1406e5a0 2024-04-25T02:23:23.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.227+0000 7f7c1bdd4700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c1406dfd0 con 0x7f7c1413ef90 2024-04-25T02:23:23.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.227+0000 7f7c1bdd4700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c14069030 con 0x7f7c140ad550 2024-04-25T02:23:23.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.227+0000 7f7c1936f700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f7c1406e5a0 0x7f7c1413ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:23.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.227+0000 7f7c1936f700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f7c1406e5a0 0x7f7c1413ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:60396/0 (socket says 172.21.15.111:60396) 2024-04-25T02:23:23.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.227+0000 7f7c1a371700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7c1413ef90 0x7f7c14141850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:23.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.227+0000 7f7c1936f700 1 -- 172.21.15.111:0/3456043699 learned_addr learned my addr 172.21.15.111:0/3456043699 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:23.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.227+0000 7f7c19b70700 1 --2- 172.21.15.111:0/3456043699 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7c140ad550 0x7f7c1406d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:23.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.228+0000 7f7c1936f700 1 -- 172.21.15.111:0/3456043699 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7c140ad550 msgr2=0x7f7c1406d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:23.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.228+0000 7f7c1936f700 1 --2- 172.21.15.111:0/3456043699 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7c140ad550 0x7f7c1406d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:23.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.228+0000 7f7c1936f700 1 -- 172.21.15.111:0/3456043699 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7c1413ef90 msgr2=0x7f7c14141850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:23.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.228+0000 7f7c1936f700 1 --2- 172.21.15.111:0/3456043699 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7c1413ef90 0x7f7c14141850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:23.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.228+0000 7f7c1936f700 1 -- 172.21.15.111:0/3456043699 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c1413e2d0 con 0x7f7c1406e5a0 2024-04-25T02:23:23.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.228+0000 7f7c1a371700 1 --2- 172.21.15.111:0/3456043699 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7c1413ef90 0x7f7c14141850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:23.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.228+0000 7f7c1936f700 1 --2- 172.21.15.111:0/3456043699 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7c1406e5a0 0x7f7c1413ea50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7c040099b0 tx=0x7f7c04009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=852169429487c8d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:23.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.228+0000 7f7c18b6e700 1 -- 172.21.15.111:0/3456043699 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c04009ea0 con 0x7f7c1406e5a0 2024-04-25T02:23:23.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.228+0000 7f7c18b6e700 1 -- 172.21.15.111:0/3456043699 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0400b860 con 0x7f7c1406e5a0 2024-04-25T02:23:23.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.228+0000 7f7c18b6e700 1 -- 172.21.15.111:0/3456043699 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0400bc00 con 0x7f7c1406e5a0 2024-04-25T02:23:23.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.229+0000 7f7c1bdd4700 1 -- 172.21.15.111:0/3456043699 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7c1406e5a0 msgr2=0x7f7c1413ea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:23.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.229+0000 7f7c1bdd4700 1 --2- 172.21.15.111:0/3456043699 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7c1406e5a0 0x7f7c1413ea50 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f7c040099b0 tx=0x7f7c04009250 comp rx=0 tx=0).stop 2024-04-25T02:23:23.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.229+0000 7f7c1bdd4700 1 -- 172.21.15.111:0/3456043699 shutdown_connections 2024-04-25T02:23:23.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.229+0000 7f7c1bdd4700 1 --2- 172.21.15.111:0/3456043699 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7c1413ef90 0x7f7c14141850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:23.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.229+0000 7f7c1bdd4700 1 --2- 172.21.15.111:0/3456043699 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7c140ad550 0x7f7c1406d990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:23.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.229+0000 7f7c1bdd4700 1 --2- 172.21.15.111:0/3456043699 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7c1406e5a0 0x7f7c1413ea50 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:23.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.229+0000 7f7c1bdd4700 1 -- 172.21.15.111:0/3456043699 >> 172.21.15.111:0/3456043699 conn(0x7f7c140b1e10 msgr2=0x7f7c140ade80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:23.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.229+0000 7f7c1bdd4700 1 -- 172.21.15.111:0/3456043699 shutdown_connections 2024-04-25T02:23:23.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.229+0000 7f7c1bdd4700 1 -- 172.21.15.111:0/3456043699 wait complete. 2024-04-25T02:23:23.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.230+0000 7f7c1bdd4700 1 Processor -- start 2024-04-25T02:23:23.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.230+0000 7f7c1bdd4700 1 -- start start 2024-04-25T02:23:23.235 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.230+0000 7f7c1bdd4700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7c1406e5a0 0x7f7c141562c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:23.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.230+0000 7f7c1bdd4700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7c140ad550 0x7f7c140a54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:23.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.230+0000 7f7c1bdd4700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7c1413ef90 0x7f7c140a5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:23.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.230+0000 7f7c1bdd4700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c140a9320 con 0x7f7c1413ef90 2024-04-25T02:23:23.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.230+0000 7f7c1bdd4700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c141220c0 con 0x7f7c140ad550 2024-04-25T02:23:23.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.230+0000 7f7c1bdd4700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7c14156b10 con 0x7f7c1406e5a0 2024-04-25T02:23:23.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.231+0000 7f7c1a371700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7c1413ef90 0x7f7c140a5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:23.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.231+0000 7f7c1a371700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7c1413ef90 0x7f7c140a5a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:60406/0 (socket says 172.21.15.111:60406) 2024-04-25T02:23:23.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.231+0000 7f7c1a371700 1 -- 172.21.15.111:0/2987903298 learned_addr learned my addr 172.21.15.111:0/2987903298 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:23.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.231+0000 7f7c1936f700 1 --2- 172.21.15.111:0/2987903298 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7c140ad550 0x7f7c140a54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:23.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.231+0000 7f7c1a371700 1 -- 172.21.15.111:0/2987903298 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7c1406e5a0 msgr2=0x7f7c141562c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:23.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.231+0000 7f7c1a371700 1 --2- 172.21.15.111:0/2987903298 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7c1406e5a0 0x7f7c141562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:23.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.231+0000 7f7c1a371700 1 -- 172.21.15.111:0/2987903298 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7c140ad550 msgr2=0x7f7c140a54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:23.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.231+0000 7f7c1a371700 1 --2- 172.21.15.111:0/2987903298 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7c140ad550 0x7f7c140a54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:23.236 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.231+0000 7f7c1a371700 1 -- 172.21.15.111:0/2987903298 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c0c009a20 con 0x7f7c1413ef90 2024-04-25T02:23:23.237 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.231+0000 7f7c1a371700 1 --2- 172.21.15.111:0/2987903298 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7c1413ef90 0x7f7c140a5a20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c009f80 tx=0x7f7c0c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:23.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.232+0000 7f7c09ffb700 1 -- 172.21.15.111:0/2987903298 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c00cc20 con 0x7f7c1413ef90 2024-04-25T02:23:23.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.232+0000 7f7c09ffb700 1 -- 172.21.15.111:0/2987903298 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c0c00f040 con 0x7f7c1413ef90 2024-04-25T02:23:23.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.232+0000 7f7c1bdd4700 1 -- 172.21.15.111:0/2987903298 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c040094f0 con 0x7f7c1413ef90 2024-04-25T02:23:23.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.232+0000 7f7c09ffb700 1 -- 172.21.15.111:0/2987903298 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c0c014480 con 0x7f7c1413ef90 2024-04-25T02:23:23.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.232+0000 7f7c1bdd4700 1 -- 172.21.15.111:0/2987903298 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c140a6770 con 0x7f7c1413ef90 2024-04-25T02:23:23.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.233+0000 7f7c1bdd4700 1 -- 172.21.15.111:0/2987903298 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c14156e10 con 0x7f7c1413ef90 2024-04-25T02:23:23.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.233+0000 7f7c09ffb700 1 -- 172.21.15.111:0/2987903298 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f7c0c014830 con 0x7f7c1413ef90 2024-04-25T02:23:23.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.234+0000 7f7c09ffb700 1 -- 172.21.15.111:0/2987903298 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f7c0c05bf60 con 0x7f7c1413ef90 2024-04-25T02:23:23.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.237+0000 7f7c09ffb700 1 -- 172.21.15.111:0/2987903298 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f7c14156e10 con 0x7f7c1413ef90 2024-04-25T02:23:23.338 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.334+0000 7f18b852c700 1 -- 172.21.15.111:0/2973493100 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f18b006a520 con 0x7f18b012dd00 2024-04-25T02:23:23.339 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.335+0000 7f18a67fc700 1 -- 172.21.15.111:0/2973493100 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f18a8006860 con 0x7f18b012dd00 2024-04-25T02:23:23.339 INFO:teuthology.orchestra.run.smithi111.stdout:120259084291 2024-04-25T02:23:23.340 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.336+0000 7f18b852c700 1 -- 172.21.15.111:0/2973493100 >> v1:172.21.15.111:6816/46482 conn(0x7f1894046010 legacy=0x7f18940484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:23.340 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.336+0000 7f18b852c700 1 -- 172.21.15.111:0/2973493100 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18b012dd00 msgr2=0x7f18b00aab40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:23.340 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.336+0000 7f18b852c700 1 --2- 172.21.15.111:0/2973493100 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18b012dd00 0x7f18b00aab40 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f18a8013000 tx=0x7f18a8019000 comp rx=0 tx=0).stop 2024-04-25T02:23:23.341 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.337+0000 7f18b852c700 1 -- 172.21.15.111:0/2973493100 shutdown_connections 2024-04-25T02:23:23.341 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.337+0000 7f18b852c700 1 --2- 172.21.15.111:0/2973493100 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f18b012dd00 0x7f18b00aab40 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:23.341 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.337+0000 7f18b852c700 1 --2- 172.21.15.111:0/2973493100 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f18b0063d30 0x7f18b00aa0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:23.341 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.337+0000 7f18b852c700 1 --2- 172.21.15.111:0/2973493100 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f18b006eef0 0x7f18b00aa600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:23.341 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.337+0000 7f18b852c700 1 -- 172.21.15.111:0/2973493100 >> 172.21.15.111:0/2973493100 conn(0x7f18b00b1e10 msgr2=0x7f18b0064900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:23.341 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.337+0000 7f18b852c700 1 -- 172.21.15.111:0/2973493100 shutdown_connections 2024-04-25T02:23:23.341 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.337+0000 7f18b852c700 1 -- 172.21.15.111:0/2973493100 wait complete. 2024-04-25T02:23:23.342 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.338+0000 7f92cfd05700 1 -- 172.21.15.111:0/1033187822 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f92a8005820 con 0x7f92c80a73c0 2024-04-25T02:23:23.342 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.338+0000 7f92bdffb700 1 -- 172.21.15.111:0/1033187822 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f92b8060030 con 0x7f92c80a73c0 2024-04-25T02:23:23.342 INFO:teuthology.orchestra.run.smithi111.stdout:133143986179 2024-04-25T02:23:23.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.341+0000 7f92cfd05700 1 -- 172.21.15.111:0/1033187822 >> v1:172.21.15.111:6816/46482 conn(0x7f92ac046010 legacy=0x7f92ac0484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:23.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.341+0000 7f92cfd05700 1 -- 172.21.15.111:0/1033187822 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f92c80a73c0 msgr2=0x7f92c81369a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:23.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.341+0000 7f92cfd05700 1 --2- 172.21.15.111:0/1033187822 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f92c80a73c0 0x7f92c81369a0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f92b80011e0 tx=0x7f92b8007d30 comp rx=0 tx=0).stop 2024-04-25T02:23:23.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.341+0000 7f92cfd05700 1 -- 172.21.15.111:0/1033187822 shutdown_connections 2024-04-25T02:23:23.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.341+0000 7f92cfd05700 1 --2- 172.21.15.111:0/1033187822 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f92c80b3440 0x7f92c8136ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:23.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.341+0000 7f92cfd05700 1 --2- 172.21.15.111:0/1033187822 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f92c80a4ff0 0x7f92c80a8250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:23.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.341+0000 7f92cfd05700 1 --2- 172.21.15.111:0/1033187822 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f92c80a73c0 0x7f92c81369a0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:23.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.341+0000 7f92cfd05700 1 -- 172.21.15.111:0/1033187822 >> 172.21.15.111:0/1033187822 conn(0x7f92c806e080 msgr2=0x7f92c8068090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:23.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.342+0000 7f92cfd05700 1 -- 172.21.15.111:0/1033187822 shutdown_connections 2024-04-25T02:23:23.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.342+0000 7f92cfd05700 1 -- 172.21.15.111:0/1033187822 wait complete. 2024-04-25T02:23:23.357 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084291 for osd.0 2024-04-25T02:23:23.361 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.3 2024-04-25T02:23:23.395 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.391+0000 7f0f2732c700 1 -- 172.21.15.111:0/447202117 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0f200a1b80 con 0x7f0f2006dfa0 2024-04-25T02:23:23.395 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.391+0000 7f0f157fa700 1 -- 172.21.15.111:0/447202117 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f0f10021030 con 0x7f0f2006dfa0 2024-04-25T02:23:23.395 INFO:teuthology.orchestra.run.smithi111.stdout:124554051587 2024-04-25T02:23:23.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.393+0000 7f0f2732c700 1 -- 172.21.15.111:0/447202117 >> v1:172.21.15.111:6816/46482 conn(0x7f0f04046010 legacy=0x7f0f040484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:23.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.393+0000 7f0f2732c700 1 -- 172.21.15.111:0/447202117 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0f2006dfa0 msgr2=0x7f0f201514d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:23.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.393+0000 7f0f2732c700 1 --2- 172.21.15.111:0/447202117 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0f2006dfa0 0x7f0f201514d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0f20069ad0 tx=0x7f0f100091a0 comp rx=0 tx=0).stop 2024-04-25T02:23:23.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.393+0000 7f0f2732c700 1 -- 172.21.15.111:0/447202117 shutdown_connections 2024-04-25T02:23:23.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.393+0000 7f0f2732c700 1 --2- 172.21.15.111:0/447202117 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0f200a3400 0x7f0f20151a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:23.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.393+0000 7f0f2732c700 1 --2- 172.21.15.111:0/447202117 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0f20067940 0x7f0f200acb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:23.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.393+0000 7f0f2732c700 1 --2- 172.21.15.111:0/447202117 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0f2006dfa0 0x7f0f201514d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:23.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.393+0000 7f0f2732c700 1 -- 172.21.15.111:0/447202117 >> 172.21.15.111:0/447202117 conn(0x7f0f200b1cf0 msgr2=0x7f0f201406b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:23.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.393+0000 7f0f2732c700 1 -- 172.21.15.111:0/447202117 shutdown_connections 2024-04-25T02:23:23.397 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.393+0000 7f0f2732c700 1 -- 172.21.15.111:0/447202117 wait complete. 2024-04-25T02:23:23.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.401+0000 7f7c1bdd4700 1 -- 172.21.15.111:0/2987903298 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f7c14156e10 con 0x7f7c1413ef90 2024-04-25T02:23:23.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.401+0000 7f7c09ffb700 1 -- 172.21.15.111:0/2987903298 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f7c14156e10 con 0x7f7c1413ef90 2024-04-25T02:23:23.405 INFO:teuthology.orchestra.run.smithi111.stdout:128849018883 2024-04-25T02:23:23.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.403+0000 7f7c1bdd4700 1 -- 172.21.15.111:0/2987903298 >> v1:172.21.15.111:6816/46482 conn(0x7f7bf8046010 legacy=0x7f7bf80484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:23.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.403+0000 7f7c1bdd4700 1 -- 172.21.15.111:0/2987903298 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7c1413ef90 msgr2=0x7f7c140a5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:23.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.403+0000 7f7c1bdd4700 1 --2- 172.21.15.111:0/2987903298 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7c1413ef90 0x7f7c140a5a20 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f7c0c009f80 tx=0x7f7c0c00b040 comp rx=0 tx=0).stop 2024-04-25T02:23:23.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.403+0000 7f7c1bdd4700 1 -- 172.21.15.111:0/2987903298 shutdown_connections 2024-04-25T02:23:23.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.403+0000 7f7c1bdd4700 1 --2- 172.21.15.111:0/2987903298 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7c1413ef90 0x7f7c140a5a20 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:23.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.403+0000 7f7c1bdd4700 1 --2- 172.21.15.111:0/2987903298 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7c1406e5a0 0x7f7c141562c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:23.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.403+0000 7f7c1bdd4700 1 --2- 172.21.15.111:0/2987903298 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7c140ad550 0x7f7c140a54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:23.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.403+0000 7f7c1bdd4700 1 -- 172.21.15.111:0/2987903298 >> 172.21.15.111:0/2987903298 conn(0x7f7c140b1e10 msgr2=0x7f7c1413ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:23.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.403+0000 7f7c1bdd4700 1 -- 172.21.15.111:0/2987903298 shutdown_connections 2024-04-25T02:23:23.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:23.403+0000 7f7c1bdd4700 1 -- 172.21.15.111:0/2987903298 wait complete. 2024-04-25T02:23:23.409 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.1 2024-04-25T02:23:23.419 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.2 2024-04-25T02:23:24.359 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T02:23:24.362 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T02:23:24.410 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T02:23:24.420 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T02:23:24.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.494+0000 7f20b58f2700 1 Processor -- start 2024-04-25T02:23:24.498 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.494+0000 7f20b58f2700 1 -- start start 2024-04-25T02:23:24.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.495+0000 7f20b58f2700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f20b01396e0 0x7f20b0063ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:24.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.495+0000 7f20b58f2700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f20b00a5c30 0x7f20b013c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:24.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.495+0000 7f20b58f2700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f20b013f600 0x7f20b013faa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:24.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.495+0000 7f20b58f2700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20b0139ab0 con 0x7f20b013f600 2024-04-25T02:23:24.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.495+0000 7f20b58f2700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20b00a5730 con 0x7f20b01396e0 2024-04-25T02:23:24.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.495+0000 7f20b58f2700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f20b00a6360 con 0x7f20b00a5c30 2024-04-25T02:23:24.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.495+0000 7f20af7fe700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f20b013f600 0x7f20b013faa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:24.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.495+0000 7f20af7fe700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f20b013f600 0x7f20b013faa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:60416/0 (socket says 172.21.15.111:60416) 2024-04-25T02:23:24.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.495+0000 7f20af7fe700 1 -- 172.21.15.111:0/1988958565 learned_addr learned my addr 172.21.15.111:0/1988958565 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:24.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.495+0000 7f20aeffd700 1 --2- 172.21.15.111:0/1988958565 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f20b01396e0 0x7f20b0063ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:24.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.495+0000 7f20ae7fc700 1 --2- 172.21.15.111:0/1988958565 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f20b00a5c30 0x7f20b013c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:24.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.495+0000 7f20af7fe700 1 -- 172.21.15.111:0/1988958565 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f20b00a5c30 msgr2=0x7f20b013c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:24.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.495+0000 7f20af7fe700 1 --2- 172.21.15.111:0/1988958565 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f20b00a5c30 0x7f20b013c000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:24.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.495+0000 7f20af7fe700 1 -- 172.21.15.111:0/1988958565 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f20b01396e0 msgr2=0x7f20b0063ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:24.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.495+0000 7f20af7fe700 1 --2- 172.21.15.111:0/1988958565 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f20b01396e0 0x7f20b0063ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:24.502 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.495+0000 7f20af7fe700 1 -- 172.21.15.111:0/1988958565 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20b013c810 con 0x7f20b013f600 2024-04-25T02:23:24.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.495+0000 7f20aeffd700 1 --2- 172.21.15.111:0/1988958565 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f20b01396e0 0x7f20b0063ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:24.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.495+0000 7f20ae7fc700 1 --2- 172.21.15.111:0/1988958565 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f20b00a5c30 0x7f20b013c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:24.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.496+0000 7f20af7fe700 1 --2- 172.21.15.111:0/1988958565 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f20b013f600 0x7f20b013faa0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f20a8009f20 tx=0x7f20a8009840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22aaae785c9e7d8b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:24.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.496+0000 7f20adffb700 1 -- 172.21.15.111:0/1988958565 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a800e070 con 0x7f20b013f600 2024-04-25T02:23:24.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.496+0000 7f20adffb700 1 -- 172.21.15.111:0/1988958565 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a800b970 con 0x7f20b013f600 2024-04-25T02:23:24.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.496+0000 7f20adffb700 1 -- 172.21.15.111:0/1988958565 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a80092e0 con 0x7f20b013f600 2024-04-25T02:23:24.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.497+0000 7f20b58f2700 1 -- 172.21.15.111:0/1988958565 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f20b013f600 msgr2=0x7f20b013faa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:24.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.497+0000 7f20b58f2700 1 --2- 172.21.15.111:0/1988958565 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f20b013f600 0x7f20b013faa0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f20a8009f20 tx=0x7f20a8009840 comp rx=0 tx=0).stop 2024-04-25T02:23:24.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.497+0000 7f20b58f2700 1 -- 172.21.15.111:0/1988958565 shutdown_connections 2024-04-25T02:23:24.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.497+0000 7f20b58f2700 1 --2- 172.21.15.111:0/1988958565 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f20b013f600 0x7f20b013faa0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:24.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.497+0000 7f20b58f2700 1 --2- 172.21.15.111:0/1988958565 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f20b01396e0 0x7f20b0063ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:24.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.497+0000 7f20b58f2700 1 --2- 172.21.15.111:0/1988958565 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f20b00a5c30 0x7f20b013c000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:24.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.497+0000 7f20b58f2700 1 -- 172.21.15.111:0/1988958565 >> 172.21.15.111:0/1988958565 conn(0x7f20b00b1e10 msgr2=0x7f20b00ade80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:24.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.497+0000 7f20b58f2700 1 -- 172.21.15.111:0/1988958565 shutdown_connections 2024-04-25T02:23:24.504 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.497+0000 7f20b58f2700 1 -- 172.21.15.111:0/1988958565 wait complete. 2024-04-25T02:23:24.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.498+0000 7f20b58f2700 1 Processor -- start 2024-04-25T02:23:24.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.499+0000 7f20b58f2700 1 -- start start 2024-04-25T02:23:24.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.499+0000 7f20b58f2700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f20b00a5c30 0x7f20b00a6950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:24.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.499+0000 7f20b58f2700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f20b01396e0 0x7f20b0137e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:24.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.499+0000 7f20b58f2700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f20b013f600 0x7f20b014f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:24.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.499+0000 7f20b58f2700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b0139000 con 0x7f20b013f600 2024-04-25T02:23:24.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.499+0000 7f20b58f2700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20b0138780 con 0x7f20b00a5c30 2024-04-25T02:23:24.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.499+0000 7f20b58f2700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f20b0138a20 con 0x7f20b01396e0 2024-04-25T02:23:24.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.500+0000 7f20aeffd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f20b00a5c30 0x7f20b00a6950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:24.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.500+0000 7f20aeffd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f20b00a5c30 0x7f20b00a6950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:35530/0 (socket says 172.21.15.111:35530) 2024-04-25T02:23:24.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.500+0000 7f20aeffd700 1 -- 172.21.15.111:0/2452174636 learned_addr learned my addr 172.21.15.111:0/2452174636 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:24.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.500+0000 7f20ae7fc700 1 --2- 172.21.15.111:0/2452174636 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f20b01396e0 0x7f20b0137e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:24.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.500+0000 7f20af7fe700 1 --2- 172.21.15.111:0/2452174636 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f20b013f600 0x7f20b014f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:24.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.500+0000 7f20aeffd700 1 -- 172.21.15.111:0/2452174636 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f20b01396e0 msgr2=0x7f20b0137e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:24.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.500+0000 7f20aeffd700 1 --2- 172.21.15.111:0/2452174636 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f20b01396e0 0x7f20b0137e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:24.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.500+0000 7f20aeffd700 1 -- 172.21.15.111:0/2452174636 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f20b013f600 msgr2=0x7f20b014f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:24.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.500+0000 7f20aeffd700 1 --2- 172.21.15.111:0/2452174636 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f20b013f600 0x7f20b014f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:24.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.500+0000 7f20aeffd700 1 -- 172.21.15.111:0/2452174636 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a4009420 con 0x7f20b00a5c30 2024-04-25T02:23:24.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.500+0000 7f20aeffd700 1 --2- 172.21.15.111:0/2452174636 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f20b00a5c30 0x7f20b00a6950 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f20a000ebd0 tx=0x7f20a00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:24.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.500+0000 7f2096ffd700 1 -- 172.21.15.111:0/2452174636 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a000c9b0 con 0x7f20b00a5c30 2024-04-25T02:23:24.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.501+0000 7f2096ffd700 1 -- 172.21.15.111:0/2452174636 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20a000cb10 con 0x7f20b00a5c30 2024-04-25T02:23:24.507 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.501+0000 7f2096ffd700 1 -- 172.21.15.111:0/2452174636 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20a000ce90 con 0x7f20b00a5c30 2024-04-25T02:23:24.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.501+0000 7fcbb9385700 1 Processor -- start 2024-04-25T02:23:24.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.501+0000 7fcbb9385700 1 -- start start 2024-04-25T02:23:24.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.501+0000 7fcbb9385700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcbb40b4fd0 0x7fcbb40a2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:24.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.501+0000 7fcbb9385700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fcbb413f110 0x7fcbb40a3d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:24.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.501+0000 7fcbb9385700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbb40a46d0 con 0x7fcbb40a3980 2024-04-25T02:23:24.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.502+0000 7fcbb9385700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbb40a6710 con 0x7fcbb413f110 2024-04-25T02:23:24.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.502+0000 7fcbb9385700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb40a4930 con 0x7fcbb40b4fd0 2024-04-25T02:23:24.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.502+0000 7f20b58f2700 1 -- 172.21.15.111:0/2452174636 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20a0009420 con 0x7f20b00a5c30 2024-04-25T02:23:24.509 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.502+0000 7fcbb27fc700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7fcbb40a3980 0x7fcbb413ea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:33750/0 (socket says 172.21.15.111:33750) 2024-04-25T02:23:24.509 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.502+0000 7fcbb27fc700 1 -- 172.21.15.111:0/2046301295 learned_addr learned my addr 172.21.15.111:0/2046301295 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:23:24.509 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.502+0000 7fcbb37fe700 1 --2- 172.21.15.111:0/2046301295 >> v2:172.21.15.111:3300/0 conn(0x7fcbb413f110 0x7fcbb40a3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:24.509 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.502+0000 7fcbb2ffd700 1 --2- 172.21.15.111:0/2046301295 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcbb40b4fd0 0x7fcbb40a2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:24.509 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.502+0000 7f20b58f2700 1 -- 172.21.15.111:0/2452174636 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20a8009ae0 con 0x7f20b00a5c30 2024-04-25T02:23:24.510 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.502+0000 7fcbb37fe700 1 -- 172.21.15.111:0/2046301295 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcbb40b4fd0 msgr2=0x7fcbb40a2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:24.510 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.502+0000 7fcbb37fe700 1 --2- 172.21.15.111:0/2046301295 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcbb40b4fd0 0x7fcbb40a2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:24.510 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.502+0000 7fcbb37fe700 1 -- 172.21.15.111:0/2046301295 >> v1:172.21.15.111:6789/0 conn(0x7fcbb40a3980 legacy=0x7fcbb413ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:24.510 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.502+0000 7fcbb37fe700 1 -- 172.21.15.111:0/2046301295 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbb40a31a0 con 0x7fcbb413f110 2024-04-25T02:23:24.510 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.502+0000 7fcbb1ffb700 1 -- 172.21.15.111:0/2046301295 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1809856553 0 0) 0x7fcbb40a46d0 con 0x7fcbb40a3980 2024-04-25T02:23:24.510 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.502+0000 7fcbb37fe700 1 --2- 172.21.15.111:0/2046301295 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcbb413f110 0x7fcbb40a3d50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcbac009e60 tx=0x7fcbac009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d6f436111a4cef1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:24.510 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.503+0000 7f20b58f2700 1 -- 172.21.15.111:0/2452174636 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20b013c380 con 0x7f20b00a5c30 2024-04-25T02:23:24.510 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.503+0000 7f2096ffd700 1 -- 172.21.15.111:0/2452174636 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f20a0013860 con 0x7f20b00a5c30 2024-04-25T02:23:24.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.503+0000 7fcbb1ffb700 1 -- 172.21.15.111:0/2046301295 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbac00e070 con 0x7fcbb413f110 2024-04-25T02:23:24.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.503+0000 7fcbb1ffb700 1 -- 172.21.15.111:0/2046301295 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbac00bc30 con 0x7fcbb413f110 2024-04-25T02:23:24.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.503+0000 7fcbb1ffb700 1 -- 172.21.15.111:0/2046301295 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbac012430 con 0x7fcbb413f110 2024-04-25T02:23:24.512 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.503+0000 7f2096ffd700 1 -- 172.21.15.111:0/2452174636 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f20a005f380 con 0x7f20b00a5c30 2024-04-25T02:23:24.514 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.504+0000 7fcbb9385700 1 -- 172.21.15.111:0/2046301295 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcbb413f110 msgr2=0x7fcbb40a3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:24.514 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.504+0000 7fcbb9385700 1 --2- 172.21.15.111:0/2046301295 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcbb413f110 0x7fcbb40a3d50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fcbac009e60 tx=0x7fcbac009780 comp rx=0 tx=0).stop 2024-04-25T02:23:24.514 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.504+0000 7fcbb9385700 1 -- 172.21.15.111:0/2046301295 shutdown_connections 2024-04-25T02:23:24.514 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.504+0000 7fcbb9385700 1 --2- 172.21.15.111:0/2046301295 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcbb413f110 0x7fcbb40a3d50 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:24.514 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.504+0000 7fcbb9385700 1 --2- 172.21.15.111:0/2046301295 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcbb40b4fd0 0x7fcbb40a2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:24.514 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.504+0000 7fcbb9385700 1 -- 172.21.15.111:0/2046301295 >> 172.21.15.111:0/2046301295 conn(0x7fcbb40883e0 msgr2=0x7fcbb4068b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:24.514 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.504+0000 7fcbb9385700 1 -- 172.21.15.111:0/2046301295 shutdown_connections 2024-04-25T02:23:24.514 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.504+0000 7fcbb9385700 1 -- 172.21.15.111:0/2046301295 wait complete. 2024-04-25T02:23:24.514 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.506+0000 7fcbb9385700 1 Processor -- start 2024-04-25T02:23:24.514 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.506+0000 7fcbb9385700 1 -- start start 2024-04-25T02:23:24.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.507+0000 7fcbb9385700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcbb40a3980 0x7fcbb41457d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:24.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.507+0000 7fcbb9385700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcbb40b4fd0 0x7fcbb40a9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:24.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.507+0000 7fcbb9385700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fcbb413f110 0x7fcbb4146440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:24.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.507+0000 7fcbb9385700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb40a8a50 con 0x7fcbb40a3980 2024-04-25T02:23:24.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.507+0000 7fcbb9385700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb4146d70 con 0x7fcbb40b4fd0 2024-04-25T02:23:24.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.507+0000 7fcbb9385700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcbb40a8c50 con 0x7fcbb413f110 2024-04-25T02:23:24.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.507+0000 7fcbb2ffd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcbb40a3980 0x7fcbb41457d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:24.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.507+0000 7fcbb2ffd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcbb40a3980 0x7fcbb41457d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:60436/0 (socket says 172.21.15.111:60436) 2024-04-25T02:23:24.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.507+0000 7fcbb2ffd700 1 -- 172.21.15.111:0/1729536287 learned_addr learned my addr 172.21.15.111:0/1729536287 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:24.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.507+0000 7fcbb27fc700 1 --2- 172.21.15.111:0/1729536287 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcbb40b4fd0 0x7fcbb40a9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:24.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.507+0000 7fcbb37fe700 1 --2- 172.21.15.111:0/1729536287 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fcbb413f110 0x7fcbb4146440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:24.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.507+0000 7fcbb2ffd700 1 -- 172.21.15.111:0/1729536287 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fcbb413f110 msgr2=0x7fcbb4146440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:24.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.507+0000 7fcbb2ffd700 1 --2- 172.21.15.111:0/1729536287 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fcbb413f110 0x7fcbb4146440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:24.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.507+0000 7fcbb2ffd700 1 -- 172.21.15.111:0/1729536287 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcbb40b4fd0 msgr2=0x7fcbb40a9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:24.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.507+0000 7fcbb2ffd700 1 --2- 172.21.15.111:0/1729536287 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcbb40b4fd0 0x7fcbb40a9330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:24.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.507+0000 7fcbb2ffd700 1 -- 172.21.15.111:0/1729536287 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbac009a20 con 0x7fcbb40a3980 2024-04-25T02:23:24.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.507+0000 7fcbb37fe700 1 --2- 172.21.15.111:0/1729536287 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fcbb413f110 0x7fcbb4146440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:23:24.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.508+0000 7fcbb2ffd700 1 --2- 172.21.15.111:0/1729536287 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcbb40a3980 0x7fcbb41457d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcba800d890 tx=0x7fcba8008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:24.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.508+0000 7f2096ffd700 1 -- 172.21.15.111:0/2452174636 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f20a003d540 con 0x7f20b00a5c30 2024-04-25T02:23:24.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.508+0000 7fcb9affd700 1 -- 172.21.15.111:0/1729536287 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba80125f0 con 0x7fcbb40a3980 2024-04-25T02:23:24.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.508+0000 7fcb9affd700 1 -- 172.21.15.111:0/1729536287 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcba8012750 con 0x7fcbb40a3980 2024-04-25T02:23:24.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.508+0000 7fcbb9385700 1 -- 172.21.15.111:0/1729536287 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbb4143e00 con 0x7fcbb40a3980 2024-04-25T02:23:24.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.508+0000 7fcb9affd700 1 -- 172.21.15.111:0/1729536287 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba8012ad0 con 0x7fcbb40a3980 2024-04-25T02:23:24.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.508+0000 7fcbb9385700 1 -- 172.21.15.111:0/1729536287 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbb4147620 con 0x7fcbb40a3980 2024-04-25T02:23:24.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.509+0000 7fcb9affd700 1 -- 172.21.15.111:0/1729536287 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7fcba801e460 con 0x7fcbb40a3980 2024-04-25T02:23:24.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.509+0000 7fcbb9385700 1 -- 172.21.15.111:0/1729536287 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbb4147840 con 0x7fcbb40a3980 2024-04-25T02:23:24.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.510+0000 7fcb9affd700 1 -- 172.21.15.111:0/1729536287 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fcba805e1e0 con 0x7fcbb40a3980 2024-04-25T02:23:24.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.513+0000 7fcb9affd700 1 -- 172.21.15.111:0/1729536287 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fcbb4147840 con 0x7fcbb40a3980 2024-04-25T02:23:24.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.543+0000 7f1cd6e10700 1 Processor -- start 2024-04-25T02:23:24.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.543+0000 7f1cd6e10700 1 -- start start 2024-04-25T02:23:24.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.543+0000 7f1cd6e10700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1cd00a3410 0x7f1cd00a4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:24.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.543+0000 7f1cd6e10700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1cd00a22a0 0x7f1cd013e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:24.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.543+0000 7f1cd6e10700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f1cd013eb60 0x7f1cd013f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:24.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.543+0000 7f1cd6e10700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1cd00a2a20 con 0x7f1cd013eb60 2024-04-25T02:23:24.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.543+0000 7f1cd6e10700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd006da60 con 0x7f1cd00a22a0 2024-04-25T02:23:24.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.543+0000 7f1cd6e10700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd00a3c80 con 0x7f1cd00a3410 2024-04-25T02:23:24.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.544+0000 7f1cd4bac700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1cd00a3410 0x7f1cd00a4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:24.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.544+0000 7f1ccffff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1cd00a22a0 0x7f1cd013e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:24.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.544+0000 7f1cd4bac700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1cd00a3410 0x7f1cd00a4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:41144/0 (socket says 172.21.15.111:41144) 2024-04-25T02:23:24.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.544+0000 7f1cd4bac700 1 -- 172.21.15.111:0/3256523016 learned_addr learned my addr 172.21.15.111:0/3256523016 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:24.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.544+0000 7f1cd53ad700 1 --2- 172.21.15.111:0/3256523016 >> v2:172.21.15.111:3300/0 conn(0x7f1cd013eb60 0x7f1cd013f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:24.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.544+0000 7f1cd4bac700 1 -- 172.21.15.111:0/3256523016 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1cd00a22a0 msgr2=0x7f1cd013e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:24.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.544+0000 7f1cd4bac700 1 --2- 172.21.15.111:0/3256523016 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1cd00a22a0 0x7f1cd013e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:24.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.544+0000 7f1cd4bac700 1 -- 172.21.15.111:0/3256523016 >> v2:172.21.15.111:3300/0 conn(0x7f1cd013eb60 msgr2=0x7f1cd013f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:24.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.544+0000 7f1cd4bac700 1 --2- 172.21.15.111:0/3256523016 >> v2:172.21.15.111:3300/0 conn(0x7f1cd013eb60 0x7f1cd013f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:24.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.544+0000 7f1cd4bac700 1 -- 172.21.15.111:0/3256523016 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cd00a37e0 con 0x7f1cd00a3410 2024-04-25T02:23:24.550 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.544+0000 7f1cd4bac700 1 --2- 172.21.15.111:0/3256523016 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1cd00a3410 0x7f1cd00a4460 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1cc4009a10 tx=0x7f1cc4009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6a312f7bddc32d0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:24.550 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.544+0000 7f1ccf7fe700 1 -- 172.21.15.111:0/3256523016 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc400b7e0 con 0x7f1cd00a3410 2024-04-25T02:23:24.550 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.544+0000 7f1ccf7fe700 1 -- 172.21.15.111:0/3256523016 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc400b940 con 0x7f1cd00a3410 2024-04-25T02:23:24.550 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.544+0000 7f1ccf7fe700 1 -- 172.21.15.111:0/3256523016 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc400bce0 con 0x7f1cd00a3410 2024-04-25T02:23:24.552 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.545+0000 7f1cd6e10700 1 -- 172.21.15.111:0/3256523016 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1cd00a3410 msgr2=0x7f1cd00a4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:24.553 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.545+0000 7f1cd6e10700 1 --2- 172.21.15.111:0/3256523016 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1cd00a3410 0x7f1cd00a4460 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f1cc4009a10 tx=0x7f1cc4009250 comp rx=0 tx=0).stop 2024-04-25T02:23:24.553 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.545+0000 7f1cd6e10700 1 -- 172.21.15.111:0/3256523016 shutdown_connections 2024-04-25T02:23:24.553 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.545+0000 7f1cd6e10700 1 --2- 172.21.15.111:0/3256523016 >> v2:172.21.15.111:3300/0 conn(0x7f1cd013eb60 0x7f1cd013f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:24.553 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.545+0000 7f1cd6e10700 1 --2- 172.21.15.111:0/3256523016 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1cd00a3410 0x7f1cd00a4460 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:24.553 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.545+0000 7f1cd6e10700 1 --2- 172.21.15.111:0/3256523016 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1cd00a22a0 0x7f1cd013e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:24.553 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.545+0000 7f1cd6e10700 1 -- 172.21.15.111:0/3256523016 >> 172.21.15.111:0/3256523016 conn(0x7f1cd00b1cf0 msgr2=0x7f1cd00b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:24.553 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.545+0000 7f1cd6e10700 1 -- 172.21.15.111:0/3256523016 shutdown_connections 2024-04-25T02:23:24.553 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.545+0000 7f1cd6e10700 1 -- 172.21.15.111:0/3256523016 wait complete. 2024-04-25T02:23:24.553 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.546+0000 7f1cd6e10700 1 Processor -- start 2024-04-25T02:23:24.553 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.547+0000 7f1cd6e10700 1 -- start start 2024-04-25T02:23:24.553 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.548+0000 7f1cd6e10700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1cd00a22a0 0x7f1cd013be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:24.553 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.548+0000 7f1cd6e10700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1cd00a3410 0x7f1cd0137680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:24.553 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.548+0000 7f1cd6e10700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1cd013eb60 0x7f1cd0136500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:24.553 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.548+0000 7f1cd6e10700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd0138b00 con 0x7f1cd00a22a0 2024-04-25T02:23:24.554 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.548+0000 7f1cd6e10700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd0138da0 con 0x7f1cd013eb60 2024-04-25T02:23:24.554 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.548+0000 7f1cd6e10700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1cd0130ed0 con 0x7f1cd00a3410 2024-04-25T02:23:24.554 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.548+0000 7f1cd53ad700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1cd013eb60 0x7f1cd0136500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:24.554 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.548+0000 7f1cd53ad700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1cd013eb60 0x7f1cd0136500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:35566/0 (socket says 172.21.15.111:35566) 2024-04-25T02:23:24.554 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.548+0000 7f1cd53ad700 1 -- 172.21.15.111:0/3164113959 learned_addr learned my addr 172.21.15.111:0/3164113959 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:24.554 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.548+0000 7f1ccffff700 1 --2- 172.21.15.111:0/3164113959 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1cd00a3410 0x7f1cd0137680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:24.554 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.548+0000 7f1cd53ad700 1 -- 172.21.15.111:0/3164113959 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1cd00a3410 msgr2=0x7f1cd0137680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:24.554 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.548+0000 7f1cd53ad700 1 --2- 172.21.15.111:0/3164113959 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1cd00a3410 0x7f1cd0137680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:24.554 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.548+0000 7f1cd53ad700 1 -- 172.21.15.111:0/3164113959 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1cd00a22a0 msgr2=0x7f1cd013be60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:24.554 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.548+0000 7f1cd53ad700 1 --2- 172.21.15.111:0/3164113959 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1cd00a22a0 0x7f1cd013be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:24.554 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.548+0000 7f1cd53ad700 1 -- 172.21.15.111:0/3164113959 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1cc40094f0 con 0x7f1cd013eb60 2024-04-25T02:23:24.554 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.548+0000 7f1cd53ad700 1 --2- 172.21.15.111:0/3164113959 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1cd013eb60 0x7f1cd0136500 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1cc8007f20 tx=0x7f1cc8009860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:24.554 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.549+0000 7f1cccff9700 1 -- 172.21.15.111:0/3164113959 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc800ebf0 con 0x7f1cd013eb60 2024-04-25T02:23:24.554 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.549+0000 7f1cccff9700 1 -- 172.21.15.111:0/3164113959 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1cc800ed70 con 0x7f1cd013eb60 2024-04-25T02:23:24.555 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.549+0000 7f1cd6e10700 1 -- 172.21.15.111:0/3164113959 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1cd0137bc0 con 0x7f1cd013eb60 2024-04-25T02:23:24.555 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.549+0000 7f1cccff9700 1 -- 172.21.15.111:0/3164113959 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1cc8014670 con 0x7f1cd013eb60 2024-04-25T02:23:24.555 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.549+0000 7f1cd6e10700 1 -- 172.21.15.111:0/3164113959 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1cd0136a40 con 0x7f1cd013eb60 2024-04-25T02:23:24.555 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.550+0000 7f1cd6e10700 1 -- 172.21.15.111:0/3164113959 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1cd00008d0 con 0x7f1cd013eb60 2024-04-25T02:23:24.555 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.550+0000 7f1cccff9700 1 -- 172.21.15.111:0/3164113959 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f1cc80149e0 con 0x7f1cd013eb60 2024-04-25T02:23:24.555 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.550+0000 7f1cccff9700 1 -- 172.21.15.111:0/3164113959 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f1cc805b7c0 con 0x7f1cd013eb60 2024-04-25T02:23:24.561 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.557+0000 7f1cccff9700 1 -- 172.21.15.111:0/3164113959 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f1cc8039980 con 0x7f1cd013eb60 2024-04-25T02:23:24.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.582+0000 7fad0cafe700 1 Processor -- start 2024-04-25T02:23:24.587 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.582+0000 7fad0cafe700 1 -- start start 2024-04-25T02:23:24.587 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.583+0000 7fad0cafe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fad080a3410 0x7fad080a4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:24.587 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.583+0000 7fad0cafe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fad080a22a0 0x7fad0813e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:24.587 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.583+0000 7fad0cafe700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fad0813eb60 0x7fad0813f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:24.587 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.583+0000 7fad0cafe700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad080a2a20 con 0x7fad0813eb60 2024-04-25T02:23:24.587 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.583+0000 7fad0cafe700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad0806da60 con 0x7fad080a22a0 2024-04-25T02:23:24.588 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.583+0000 7fad0cafe700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad080a3c80 con 0x7fad080a3410 2024-04-25T02:23:24.588 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.583+0000 7fad05d9b700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fad080a22a0 0x7fad0813e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:24.588 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.583+0000 7fad05d9b700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fad080a22a0 0x7fad0813e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:35582/0 (socket says 172.21.15.111:35582) 2024-04-25T02:23:24.588 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.583+0000 7fad05d9b700 1 -- 172.21.15.111:0/1361566331 learned_addr learned my addr 172.21.15.111:0/1361566331 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:24.588 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.583+0000 7fad06d9d700 1 --2- 172.21.15.111:0/1361566331 >> v2:172.21.15.111:3300/0 conn(0x7fad0813eb60 0x7fad0813f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:24.588 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.583+0000 7fad0659c700 1 --2- 172.21.15.111:0/1361566331 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fad080a3410 0x7fad080a4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:24.588 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.583+0000 7fad05d9b700 1 -- 172.21.15.111:0/1361566331 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fad080a3410 msgr2=0x7fad080a4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:24.588 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.583+0000 7fad05d9b700 1 --2- 172.21.15.111:0/1361566331 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fad080a3410 0x7fad080a4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:24.588 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.583+0000 7fad05d9b700 1 -- 172.21.15.111:0/1361566331 >> v2:172.21.15.111:3300/0 conn(0x7fad0813eb60 msgr2=0x7fad0813f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:24.588 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.583+0000 7fad05d9b700 1 --2- 172.21.15.111:0/1361566331 >> v2:172.21.15.111:3300/0 conn(0x7fad0813eb60 0x7fad0813f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:24.588 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.583+0000 7fad05d9b700 1 -- 172.21.15.111:0/1361566331 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad080a37e0 con 0x7fad080a22a0 2024-04-25T02:23:24.588 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.584+0000 7fad05d9b700 1 --2- 172.21.15.111:0/1361566331 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fad080a22a0 0x7fad0813e620 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7facfc0099e0 tx=0x7facfc009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=888c5dae4c8575e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:24.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.584+0000 7fad0559a700 1 -- 172.21.15.111:0/1361566331 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc00b640 con 0x7fad080a22a0 2024-04-25T02:23:24.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.584+0000 7fad0559a700 1 -- 172.21.15.111:0/1361566331 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facfc00b7a0 con 0x7fad080a22a0 2024-04-25T02:23:24.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.584+0000 7fad0559a700 1 -- 172.21.15.111:0/1361566331 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc00bb40 con 0x7fad080a22a0 2024-04-25T02:23:24.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.584+0000 7fad0cafe700 1 -- 172.21.15.111:0/1361566331 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fad080a22a0 msgr2=0x7fad0813e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:24.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.584+0000 7fad0cafe700 1 --2- 172.21.15.111:0/1361566331 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fad080a22a0 0x7fad0813e620 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7facfc0099e0 tx=0x7facfc009250 comp rx=0 tx=0).stop 2024-04-25T02:23:24.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.585+0000 7fad0cafe700 1 -- 172.21.15.111:0/1361566331 shutdown_connections 2024-04-25T02:23:24.591 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.585+0000 7fad0cafe700 1 --2- 172.21.15.111:0/1361566331 >> v2:172.21.15.111:3300/0 conn(0x7fad0813eb60 0x7fad0813f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:24.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.585+0000 7fad0cafe700 1 --2- 172.21.15.111:0/1361566331 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fad080a3410 0x7fad080a4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:24.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.585+0000 7fad0cafe700 1 --2- 172.21.15.111:0/1361566331 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fad080a22a0 0x7fad0813e620 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:24.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.585+0000 7fad0cafe700 1 -- 172.21.15.111:0/1361566331 >> 172.21.15.111:0/1361566331 conn(0x7fad080b1cf0 msgr2=0x7fad080b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:24.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.585+0000 7fad0cafe700 1 -- 172.21.15.111:0/1361566331 shutdown_connections 2024-04-25T02:23:24.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.585+0000 7fad0cafe700 1 -- 172.21.15.111:0/1361566331 wait complete. 2024-04-25T02:23:24.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.586+0000 7fad0cafe700 1 Processor -- start 2024-04-25T02:23:24.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.586+0000 7fad0cafe700 1 -- start start 2024-04-25T02:23:24.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.586+0000 7fad0cafe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fad080a22a0 0x7fad08141660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:24.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.586+0000 7fad0cafe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fad080a3410 0x7fad081427a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:24.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.586+0000 7fad0cafe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fad0813eb60 0x7fad0813ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:24.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.586+0000 7fad0cafe700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad08141fc0 con 0x7fad080a22a0 2024-04-25T02:23:24.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.586+0000 7fad0cafe700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad0813b060 con 0x7fad080a3410 2024-04-25T02:23:24.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.586+0000 7fad0cafe700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fad0813b300 con 0x7fad0813eb60 2024-04-25T02:23:24.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.586+0000 7fad05d9b700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fad080a3410 0x7fad081427a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:24.592 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.586+0000 7fad05d9b700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fad080a3410 0x7fad081427a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:35586/0 (socket says 172.21.15.111:35586) 2024-04-25T02:23:24.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.586+0000 7fad05d9b700 1 -- 172.21.15.111:0/1485054371 learned_addr learned my addr 172.21.15.111:0/1485054371 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:24.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.586+0000 7fad06d9d700 1 --2- 172.21.15.111:0/1485054371 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fad0813eb60 0x7fad0813ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:24.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.587+0000 7fad0659c700 1 --2- 172.21.15.111:0/1485054371 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fad080a22a0 0x7fad08141660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:24.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.587+0000 7fad05d9b700 1 -- 172.21.15.111:0/1485054371 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fad0813eb60 msgr2=0x7fad0813ba80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:24.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.587+0000 7fad05d9b700 1 --2- 172.21.15.111:0/1485054371 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fad0813eb60 0x7fad0813ba80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:24.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.587+0000 7fad05d9b700 1 -- 172.21.15.111:0/1485054371 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fad080a22a0 msgr2=0x7fad08141660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:24.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.587+0000 7fad05d9b700 1 --2- 172.21.15.111:0/1485054371 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fad080a22a0 0x7fad08141660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:24.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.587+0000 7fad05d9b700 1 -- 172.21.15.111:0/1485054371 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facfc0094f0 con 0x7fad080a3410 2024-04-25T02:23:24.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.587+0000 7fad05d9b700 1 --2- 172.21.15.111:0/1485054371 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fad080a3410 0x7fad081427a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7facfc013000 tx=0x7facfc017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:24.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.587+0000 7fad0659c700 1 --2- 172.21.15.111:0/1485054371 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fad080a22a0 0x7fad08141660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:23:24.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.587+0000 7facf67fc700 1 -- 172.21.15.111:0/1485054371 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc00bb20 con 0x7fad080a3410 2024-04-25T02:23:24.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.587+0000 7facf67fc700 1 -- 172.21.15.111:0/1485054371 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facfc000c90 con 0x7fad080a3410 2024-04-25T02:23:24.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.587+0000 7facf67fc700 1 -- 172.21.15.111:0/1485054371 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facfc011650 con 0x7fad080a3410 2024-04-25T02:23:24.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.587+0000 7fad0cafe700 1 -- 172.21.15.111:0/1485054371 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad08142ce0 con 0x7fad080a3410 2024-04-25T02:23:24.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.587+0000 7fad0cafe700 1 -- 172.21.15.111:0/1485054371 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad08135a40 con 0x7fad080a3410 2024-04-25T02:23:24.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.588+0000 7fad0cafe700 1 -- 172.21.15.111:0/1485054371 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad080008d0 con 0x7fad080a3410 2024-04-25T02:23:24.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.589+0000 7facf67fc700 1 -- 172.21.15.111:0/1485054371 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7facfc0119c0 con 0x7fad080a3410 2024-04-25T02:23:24.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.589+0000 7facf67fc700 1 -- 172.21.15.111:0/1485054371 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7facfc05ce10 con 0x7fad080a3410 2024-04-25T02:23:24.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.595+0000 7facf67fc700 1 -- 172.21.15.111:0/1485054371 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7facfc01b270 con 0x7fad080a3410 2024-04-25T02:23:24.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.682+0000 7f20b58f2700 1 -- 172.21.15.111:0/2452174636 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f20b00a66b0 con 0x7f20b00a5c30 2024-04-25T02:23:24.686 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.682+0000 7f2096ffd700 1 -- 172.21.15.111:0/2452174636 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f20a0020070 con 0x7f20b00a5c30 2024-04-25T02:23:24.686 INFO:teuthology.orchestra.run.smithi111.stdout:120259084291 2024-04-25T02:23:24.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.684+0000 7f20b58f2700 1 -- 172.21.15.111:0/2452174636 >> v1:172.21.15.111:6816/46482 conn(0x7f209c046010 legacy=0x7f209c0484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:24.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.684+0000 7f20b58f2700 1 -- 172.21.15.111:0/2452174636 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f20b00a5c30 msgr2=0x7f20b00a6950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:24.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.684+0000 7f20b58f2700 1 --2- 172.21.15.111:0/2452174636 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f20b00a5c30 0x7f20b00a6950 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f20a000ebd0 tx=0x7f20a00091a0 comp rx=0 tx=0).stop 2024-04-25T02:23:24.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.684+0000 7f20b58f2700 1 -- 172.21.15.111:0/2452174636 shutdown_connections 2024-04-25T02:23:24.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.684+0000 7f20b58f2700 1 --2- 172.21.15.111:0/2452174636 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f20b013f600 0x7f20b014f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:24.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.684+0000 7f20b58f2700 1 --2- 172.21.15.111:0/2452174636 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f20b00a5c30 0x7f20b00a6950 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:24.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.684+0000 7f20b58f2700 1 --2- 172.21.15.111:0/2452174636 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f20b01396e0 0x7f20b0137e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:24.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.684+0000 7f20b58f2700 1 -- 172.21.15.111:0/2452174636 >> 172.21.15.111:0/2452174636 conn(0x7f20b00b1e10 msgr2=0x7f20b013fa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:24.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.685+0000 7f20b58f2700 1 -- 172.21.15.111:0/2452174636 shutdown_connections 2024-04-25T02:23:24.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.685+0000 7fcbb9385700 1 -- 172.21.15.111:0/1729536287 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7fcbb4143e00 con 0x7fcbb40a3980 2024-04-25T02:23:24.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.685+0000 7f20b58f2700 1 -- 172.21.15.111:0/2452174636 wait complete. 2024-04-25T02:23:24.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.685+0000 7fcb9affd700 1 -- 172.21.15.111:0/1729536287 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcbb4143e00 con 0x7fcbb40a3980 2024-04-25T02:23:24.690 INFO:teuthology.orchestra.run.smithi111.stdout:133143986179 2024-04-25T02:23:24.691 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.687+0000 7fcbb9385700 1 -- 172.21.15.111:0/1729536287 >> v1:172.21.15.111:6816/46482 conn(0x7fcba0046010 legacy=0x7fcba00484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:24.691 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.687+0000 7fcbb9385700 1 -- 172.21.15.111:0/1729536287 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcbb40a3980 msgr2=0x7fcbb41457d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:24.691 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.687+0000 7fcbb9385700 1 --2- 172.21.15.111:0/1729536287 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcbb40a3980 0x7fcbb41457d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fcba800d890 tx=0x7fcba8008040 comp rx=0 tx=0).stop 2024-04-25T02:23:24.694 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.691+0000 7fcbb9385700 1 -- 172.21.15.111:0/1729536287 shutdown_connections 2024-04-25T02:23:24.694 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.691+0000 7fcbb9385700 1 --2- 172.21.15.111:0/1729536287 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fcbb413f110 0x7fcbb4146440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:24.694 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.691+0000 7fcbb9385700 1 --2- 172.21.15.111:0/1729536287 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcbb40a3980 0x7fcbb41457d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:24.694 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.691+0000 7fcbb9385700 1 --2- 172.21.15.111:0/1729536287 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcbb40b4fd0 0x7fcbb40a9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:24.695 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.691+0000 7fcbb9385700 1 -- 172.21.15.111:0/1729536287 >> 172.21.15.111:0/1729536287 conn(0x7fcbb40883e0 msgr2=0x7fcbb40a52c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:24.695 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.691+0000 7fcbb9385700 1 -- 172.21.15.111:0/1729536287 shutdown_connections 2024-04-25T02:23:24.695 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.691+0000 7fcbb9385700 1 -- 172.21.15.111:0/1729536287 wait complete. 2024-04-25T02:23:24.701 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084291 for osd.0 2024-04-25T02:23:24.712 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986179 for osd.3 2024-04-25T02:23:24.736 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.732+0000 7f1cd6e10700 1 -- 172.21.15.111:0/3164113959 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f1cd0071680 con 0x7f1cd013eb60 2024-04-25T02:23:24.737 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.733+0000 7f1cccff9700 1 -- 172.21.15.111:0/3164113959 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f1cc803d170 con 0x7f1cd013eb60 2024-04-25T02:23:24.737 INFO:teuthology.orchestra.run.smithi111.stdout:124554051587 2024-04-25T02:23:24.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.735+0000 7f1cd6e10700 1 -- 172.21.15.111:0/3164113959 >> v1:172.21.15.111:6816/46482 conn(0x7f1cb4046010 legacy=0x7f1cb40484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:24.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.735+0000 7f1cd6e10700 1 -- 172.21.15.111:0/3164113959 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1cd013eb60 msgr2=0x7f1cd0136500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:24.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.735+0000 7f1cd6e10700 1 --2- 172.21.15.111:0/3164113959 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1cd013eb60 0x7f1cd0136500 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1cc8007f20 tx=0x7f1cc8009860 comp rx=0 tx=0).stop 2024-04-25T02:23:24.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.735+0000 7f1cd6e10700 1 -- 172.21.15.111:0/3164113959 shutdown_connections 2024-04-25T02:23:24.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.735+0000 7f1cd6e10700 1 --2- 172.21.15.111:0/3164113959 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1cd013eb60 0x7f1cd0136500 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:24.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.735+0000 7f1cd6e10700 1 --2- 172.21.15.111:0/3164113959 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1cd00a22a0 0x7f1cd013be60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:24.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.735+0000 7f1cd6e10700 1 --2- 172.21.15.111:0/3164113959 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1cd00a3410 0x7f1cd0137680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:24.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.735+0000 7f1cd6e10700 1 -- 172.21.15.111:0/3164113959 >> 172.21.15.111:0/3164113959 conn(0x7f1cd00b1cf0 msgr2=0x7f1cd013cc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:24.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.735+0000 7f1cd6e10700 1 -- 172.21.15.111:0/3164113959 shutdown_connections 2024-04-25T02:23:24.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.735+0000 7f1cd6e10700 1 -- 172.21.15.111:0/3164113959 wait complete. 2024-04-25T02:23:24.750 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051587 for osd.1 2024-04-25T02:23:24.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.761+0000 7fad0cafe700 1 -- 172.21.15.111:0/1485054371 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fad08140540 con 0x7fad080a3410 2024-04-25T02:23:24.765 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.761+0000 7facf67fc700 1 -- 172.21.15.111:0/1485054371 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7facfc032020 con 0x7fad080a3410 2024-04-25T02:23:24.765 INFO:teuthology.orchestra.run.smithi111.stdout:128849018883 2024-04-25T02:23:24.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.763+0000 7fad0cafe700 1 -- 172.21.15.111:0/1485054371 >> v1:172.21.15.111:6816/46482 conn(0x7face8046010 legacy=0x7face80484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:24.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.763+0000 7fad0cafe700 1 -- 172.21.15.111:0/1485054371 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fad080a3410 msgr2=0x7fad081427a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:24.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.763+0000 7fad0cafe700 1 --2- 172.21.15.111:0/1485054371 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fad080a3410 0x7fad081427a0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7facfc013000 tx=0x7facfc017000 comp rx=0 tx=0).stop 2024-04-25T02:23:24.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.763+0000 7fad0cafe700 1 -- 172.21.15.111:0/1485054371 shutdown_connections 2024-04-25T02:23:24.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.763+0000 7fad0cafe700 1 --2- 172.21.15.111:0/1485054371 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fad0813eb60 0x7fad0813ba80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:24.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.763+0000 7fad0cafe700 1 --2- 172.21.15.111:0/1485054371 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fad080a22a0 0x7fad08141660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:24.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.763+0000 7fad0cafe700 1 --2- 172.21.15.111:0/1485054371 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fad080a3410 0x7fad081427a0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:24.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.763+0000 7fad0cafe700 1 -- 172.21.15.111:0/1485054371 >> 172.21.15.111:0/1485054371 conn(0x7fad080b1cf0 msgr2=0x7fad08067d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:24.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.763+0000 7fad0cafe700 1 -- 172.21.15.111:0/1485054371 shutdown_connections 2024-04-25T02:23:24.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:24.763+0000 7fad0cafe700 1 -- 172.21.15.111:0/1485054371 wait complete. 2024-04-25T02:23:24.778 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018883 for osd.2 2024-04-25T02:23:25.702 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-25T02:23:25.713 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-25T02:23:25.751 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-25T02:23:25.779 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-25T02:23:25.846 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.842+0000 7f7809001700 1 Processor -- start 2024-04-25T02:23:25.846 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.842+0000 7f7809001700 1 -- start start 2024-04-25T02:23:25.847 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.843+0000 7f7809001700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7804063d50 0x7f780406e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:25.847 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.843+0000 7f7809001700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f780406d9d0 0x7f780413b930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:25.847 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.843+0000 7f7809001700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f780406eb30 con 0x7f7804141910 2024-04-25T02:23:25.847 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.843+0000 7f7809001700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78040ad920 con 0x7f780406d9d0 2024-04-25T02:23:25.847 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.843+0000 7f7809001700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f780406edb0 con 0x7f7804063d50 2024-04-25T02:23:25.847 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.844+0000 7f780359e700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f7804141910 0x7f7804141db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:33752/0 (socket says 172.21.15.111:33752) 2024-04-25T02:23:25.847 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.844+0000 7f780359e700 1 -- 172.21.15.111:0/2714648318 learned_addr learned my addr 172.21.15.111:0/2714648318 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:23:25.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.844+0000 7f7802d9d700 1 --2- 172.21.15.111:0/2714648318 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7804063d50 0x7f780406e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:25.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.844+0000 7f780259c700 1 --2- 172.21.15.111:0/2714648318 >> v2:172.21.15.111:3300/0 conn(0x7f780406d9d0 0x7f780413b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:25.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.844+0000 7f7802d9d700 1 -- 172.21.15.111:0/2714648318 >> v2:172.21.15.111:3300/0 conn(0x7f780406d9d0 msgr2=0x7f780413b930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:25.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.844+0000 7f7802d9d700 1 --2- 172.21.15.111:0/2714648318 >> v2:172.21.15.111:3300/0 conn(0x7f780406d9d0 0x7f780413b930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:25.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.844+0000 7f7802d9d700 1 -- 172.21.15.111:0/2714648318 >> v1:172.21.15.111:6789/0 conn(0x7f7804141910 legacy=0x7f7804141db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:25.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.844+0000 7f7802d9d700 1 -- 172.21.15.111:0/2714648318 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f780406f050 con 0x7f7804063d50 2024-04-25T02:23:25.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.844+0000 7f7802d9d700 1 --2- 172.21.15.111:0/2714648318 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7804063d50 0x7f780406e5f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f77f40098e0 tx=0x7f77f40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=55a348b14f673640 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:25.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.844+0000 7f7801d9b700 1 -- 172.21.15.111:0/2714648318 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f400b640 con 0x7f7804063d50 2024-04-25T02:23:25.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.844+0000 7f7801d9b700 1 -- 172.21.15.111:0/2714648318 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f400b7a0 con 0x7f7804063d50 2024-04-25T02:23:25.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.844+0000 7f7801d9b700 1 -- 172.21.15.111:0/2714648318 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f400bb20 con 0x7f7804063d50 2024-04-25T02:23:25.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.845+0000 7f7809001700 1 -- 172.21.15.111:0/2714648318 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7804063d50 msgr2=0x7f780406e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:25.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.845+0000 7f7809001700 1 --2- 172.21.15.111:0/2714648318 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7804063d50 0x7f780406e5f0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f77f40098e0 tx=0x7f77f40091a0 comp rx=0 tx=0).stop 2024-04-25T02:23:25.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.845+0000 7f7809001700 1 -- 172.21.15.111:0/2714648318 shutdown_connections 2024-04-25T02:23:25.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.845+0000 7f7809001700 1 --2- 172.21.15.111:0/2714648318 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7804063d50 0x7f780406e5f0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:25.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.845+0000 7f7809001700 1 --2- 172.21.15.111:0/2714648318 >> v2:172.21.15.111:3300/0 conn(0x7f780406d9d0 0x7f780413b930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:25.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.845+0000 7f7809001700 1 -- 172.21.15.111:0/2714648318 >> 172.21.15.111:0/2714648318 conn(0x7f78040b1e10 msgr2=0x7f78040ade80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:25.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.845+0000 7f7809001700 1 -- 172.21.15.111:0/2714648318 shutdown_connections 2024-04-25T02:23:25.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.845+0000 7f7809001700 1 -- 172.21.15.111:0/2714648318 wait complete. 2024-04-25T02:23:25.851 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.847+0000 7f7809001700 1 Processor -- start 2024-04-25T02:23:25.851 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.847+0000 7f7809001700 1 -- start start 2024-04-25T02:23:25.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.848+0000 7f7809001700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7804063d50 0x7f780413be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:25.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.848+0000 7f7809001700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7804141910 0x7f780413c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:25.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.848+0000 7f7809001700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f780414eae0 0x7f7804151410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:25.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.848+0000 7f7809001700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f780413f970 con 0x7f780414eae0 2024-04-25T02:23:25.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.848+0000 7f7809001700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f780413fb80 con 0x7f7804063d50 2024-04-25T02:23:25.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.848+0000 7f7809001700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f780414e6a0 con 0x7f7804141910 2024-04-25T02:23:25.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.848+0000 7f7802d9d700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7804063d50 0x7f780413be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:25.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.848+0000 7f7802d9d700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7804063d50 0x7f780413be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:35606/0 (socket says 172.21.15.111:35606) 2024-04-25T02:23:25.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.848+0000 7f7802d9d700 1 -- 172.21.15.111:0/885926767 learned_addr learned my addr 172.21.15.111:0/885926767 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:25.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.848+0000 7f780359e700 1 --2- 172.21.15.111:0/885926767 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f780414eae0 0x7f7804151410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:25.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.848+0000 7f780259c700 1 --2- 172.21.15.111:0/885926767 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7804141910 0x7f780413c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:25.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.848+0000 7f7802d9d700 1 -- 172.21.15.111:0/885926767 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7804141910 msgr2=0x7f780413c3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:25.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.848+0000 7f7802d9d700 1 --2- 172.21.15.111:0/885926767 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7804141910 0x7f780413c3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:25.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.848+0000 7f7802d9d700 1 -- 172.21.15.111:0/885926767 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f780414eae0 msgr2=0x7f7804151410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:25.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.848+0000 7f7802d9d700 1 --2- 172.21.15.111:0/885926767 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f780414eae0 0x7f7804151410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:25.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.848+0000 7f7802d9d700 1 -- 172.21.15.111:0/885926767 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77f4009420 con 0x7f7804063d50 2024-04-25T02:23:25.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.849+0000 7f780259c700 1 --2- 172.21.15.111:0/885926767 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7804141910 0x7f780413c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:23:25.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.849+0000 7f7802d9d700 1 --2- 172.21.15.111:0/885926767 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7804063d50 0x7f780413be60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f77f40091e0 tx=0x7f77f4017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:25.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.849+0000 7f77eaffd700 1 -- 172.21.15.111:0/885926767 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f401f070 con 0x7f7804063d50 2024-04-25T02:23:25.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.849+0000 7f7809001700 1 -- 172.21.15.111:0/885926767 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f780414e410 con 0x7f7804063d50 2024-04-25T02:23:25.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.849+0000 7f7809001700 1 -- 172.21.15.111:0/885926767 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7804136ff0 con 0x7f7804063d50 2024-04-25T02:23:25.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.849+0000 7f77eaffd700 1 -- 172.21.15.111:0/885926767 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77f4000be0 con 0x7f7804063d50 2024-04-25T02:23:25.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.849+0000 7f77eaffd700 1 -- 172.21.15.111:0/885926767 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77f400bb40 con 0x7f7804063d50 2024-04-25T02:23:25.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.850+0000 7f7809001700 1 -- 172.21.15.111:0/885926767 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77e40052a0 con 0x7f7804063d50 2024-04-25T02:23:25.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.851+0000 7f77eaffd700 1 -- 172.21.15.111:0/885926767 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f77f4023070 con 0x7f7804063d50 2024-04-25T02:23:25.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.851+0000 7f77eaffd700 1 -- 172.21.15.111:0/885926767 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f77f405c1c0 con 0x7f7804063d50 2024-04-25T02:23:25.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.858+0000 7f77eaffd700 1 -- 172.21.15.111:0/885926767 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f77f4002d70 con 0x7f7804063d50 2024-04-25T02:23:25.904 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.900+0000 7f85db5ee700 1 Processor -- start 2024-04-25T02:23:25.905 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.900+0000 7f85db5ee700 1 -- start start 2024-04-25T02:23:25.905 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.901+0000 7f85db5ee700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f85d4068ba0 0x7f85d406d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:25.906 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.901+0000 7f85db5ee700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f85d406e730 0x7f85d4137b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:25.906 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.901+0000 7f85db5ee700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f85d4138060 0x7f85d40abd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:25.906 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.901+0000 7f85db5ee700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85d406daa0 con 0x7f85d406e730 2024-04-25T02:23:25.906 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.901+0000 7f85db5ee700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85d40ad810 con 0x7f85d4138060 2024-04-25T02:23:25.906 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.901+0000 7f85db5ee700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f85d40adad0 con 0x7f85d4068ba0 2024-04-25T02:23:25.906 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.901+0000 7f85d9b8b700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f85d4138060 0x7f85d40abd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:25.906 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.901+0000 7f85d9b8b700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f85d4138060 0x7f85d40abd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:35622/0 (socket says 172.21.15.111:35622) 2024-04-25T02:23:25.906 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.901+0000 7f85d9b8b700 1 -- 172.21.15.111:0/3397516133 learned_addr learned my addr 172.21.15.111:0/3397516133 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:25.906 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.901+0000 7f85d8b89700 1 --2- 172.21.15.111:0/3397516133 >> v2:172.21.15.111:3300/0 conn(0x7f85d406e730 0x7f85d4137b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:25.906 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.901+0000 7f85d938a700 1 --2- 172.21.15.111:0/3397516133 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f85d4068ba0 0x7f85d406d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:25.906 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.901+0000 7f85d8b89700 1 -- 172.21.15.111:0/3397516133 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f85d4068ba0 msgr2=0x7f85d406d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:25.906 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.901+0000 7f85d8b89700 1 --2- 172.21.15.111:0/3397516133 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f85d4068ba0 0x7f85d406d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:25.906 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.901+0000 7f85d8b89700 1 -- 172.21.15.111:0/3397516133 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f85d4138060 msgr2=0x7f85d40abd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:25.906 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.901+0000 7f85d8b89700 1 --2- 172.21.15.111:0/3397516133 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f85d4138060 0x7f85d40abd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:25.907 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.901+0000 7f85d8b89700 1 -- 172.21.15.111:0/3397516133 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d406e210 con 0x7f85d406e730 2024-04-25T02:23:25.907 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.901+0000 7f85d938a700 1 --2- 172.21.15.111:0/3397516133 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f85d4068ba0 0x7f85d406d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:25.907 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.902+0000 7f85d8b89700 1 --2- 172.21.15.111:0/3397516133 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f85d406e730 0x7f85d4137b20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f85c40098e0 tx=0x7f85c40091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da99f551f90d506c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:25.907 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.902+0000 7f85cbfff700 1 -- 172.21.15.111:0/3397516133 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c4011630 con 0x7f85d406e730 2024-04-25T02:23:25.907 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.902+0000 7f85cbfff700 1 -- 172.21.15.111:0/3397516133 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c4011790 con 0x7f85d406e730 2024-04-25T02:23:25.907 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.902+0000 7f85cbfff700 1 -- 172.21.15.111:0/3397516133 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c4011b30 con 0x7f85d406e730 2024-04-25T02:23:25.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.902+0000 7f85db5ee700 1 -- 172.21.15.111:0/3397516133 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f85d406e730 msgr2=0x7f85d4137b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:25.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.902+0000 7f85db5ee700 1 --2- 172.21.15.111:0/3397516133 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f85d406e730 0x7f85d4137b20 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f85c40098e0 tx=0x7f85c40091a0 comp rx=0 tx=0).stop 2024-04-25T02:23:25.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.903+0000 7f85db5ee700 1 -- 172.21.15.111:0/3397516133 shutdown_connections 2024-04-25T02:23:25.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.903+0000 7f85db5ee700 1 --2- 172.21.15.111:0/3397516133 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f85d4138060 0x7f85d40abd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:25.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.903+0000 7f85db5ee700 1 --2- 172.21.15.111:0/3397516133 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f85d4068ba0 0x7f85d406d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:25.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.903+0000 7f85db5ee700 1 --2- 172.21.15.111:0/3397516133 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f85d406e730 0x7f85d4137b20 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:25.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.903+0000 7f85db5ee700 1 -- 172.21.15.111:0/3397516133 >> 172.21.15.111:0/3397516133 conn(0x7f85d40b1e10 msgr2=0x7f85d40ade80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:25.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.903+0000 7f85db5ee700 1 -- 172.21.15.111:0/3397516133 shutdown_connections 2024-04-25T02:23:25.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.903+0000 7f85db5ee700 1 -- 172.21.15.111:0/3397516133 wait complete. 2024-04-25T02:23:25.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.904+0000 7f85db5ee700 1 Processor -- start 2024-04-25T02:23:25.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.904+0000 7f85db5ee700 1 -- start start 2024-04-25T02:23:25.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.904+0000 7f85db5ee700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f85d4068ba0 0x7f85d41395a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:25.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.904+0000 7f85db5ee700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f85d406e730 0x7f85d41518f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:25.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.904+0000 7f85db5ee700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f85d413f780 0x7f85d4151e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:25.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.904+0000 7f85db5ee700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85d413b210 con 0x7f85d413f780 2024-04-25T02:23:25.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.904+0000 7f85db5ee700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85d4139ae0 con 0x7f85d4068ba0 2024-04-25T02:23:25.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.904+0000 7f85db5ee700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f85d4144e40 con 0x7f85d406e730 2024-04-25T02:23:25.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.904+0000 7f85d8b89700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f85d406e730 0x7f85d41518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:25.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.905+0000 7f85d8b89700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f85d406e730 0x7f85d41518f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:41200/0 (socket says 172.21.15.111:41200) 2024-04-25T02:23:25.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.905+0000 7f85d8b89700 1 -- 172.21.15.111:0/3828844753 learned_addr learned my addr 172.21.15.111:0/3828844753 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:25.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.905+0000 7f85d9b8b700 1 --2- 172.21.15.111:0/3828844753 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f85d413f780 0x7f85d4151e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:25.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.905+0000 7f85d8b89700 1 -- 172.21.15.111:0/3828844753 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f85d4068ba0 msgr2=0x7f85d41395a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:25.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.905+0000 7f85d8b89700 1 --2- 172.21.15.111:0/3828844753 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f85d4068ba0 0x7f85d41395a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:25.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.905+0000 7f85d8b89700 1 -- 172.21.15.111:0/3828844753 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f85d413f780 msgr2=0x7f85d4151e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:25.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.905+0000 7f85d8b89700 1 --2- 172.21.15.111:0/3828844753 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f85d413f780 0x7f85d4151e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:25.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.905+0000 7f85d8b89700 1 -- 172.21.15.111:0/3828844753 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85d0009420 con 0x7f85d406e730 2024-04-25T02:23:25.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.905+0000 7f85d8b89700 1 --2- 172.21.15.111:0/3828844753 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f85d406e730 0x7f85d41518f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f85c4013000 tx=0x7f85c4017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:25.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.906+0000 7f85c97fa700 1 -- 172.21.15.111:0/3828844753 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c4011b10 con 0x7f85d406e730 2024-04-25T02:23:25.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.906+0000 7f85c97fa700 1 -- 172.21.15.111:0/3828844753 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85c40253f0 con 0x7f85d406e730 2024-04-25T02:23:25.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.906+0000 7f85db5ee700 1 -- 172.21.15.111:0/3828844753 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85c4009420 con 0x7f85d406e730 2024-04-25T02:23:25.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.906+0000 7f85db5ee700 1 -- 172.21.15.111:0/3828844753 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85d4139d40 con 0x7f85d406e730 2024-04-25T02:23:25.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.906+0000 7f85c97fa700 1 -- 172.21.15.111:0/3828844753 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85c4025770 con 0x7f85d406e730 2024-04-25T02:23:25.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.907+0000 7f85c97fa700 1 -- 172.21.15.111:0/3828844753 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f85c4025b20 con 0x7f85d406e730 2024-04-25T02:23:25.912 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.907+0000 7f85c97fa700 1 -- 172.21.15.111:0/3828844753 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f85c405c980 con 0x7f85d406e730 2024-04-25T02:23:25.913 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.910+0000 7f85db5ee700 1 -- 172.21.15.111:0/3828844753 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85d4138d00 con 0x7f85d406e730 2024-04-25T02:23:25.918 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.915+0000 7f85c97fa700 1 -- 172.21.15.111:0/3828844753 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f85c4033030 con 0x7f85d406e730 2024-04-25T02:23:25.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.916+0000 7f69f607b700 1 Processor -- start 2024-04-25T02:23:25.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.916+0000 7f69f607b700 1 -- start start 2024-04-25T02:23:25.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.917+0000 7f69f607b700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f69f0068ba0 0x7f69f00ad0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:25.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.917+0000 7f69f607b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f69f006d180 0x7f69f0137990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:25.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.917+0000 7f69f607b700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f69f0137ed0 0x7f69f00abd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:25.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.917+0000 7f69f607b700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69f006ec60 con 0x7f69f0068ba0 2024-04-25T02:23:25.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.917+0000 7f69f607b700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69f006d940 con 0x7f69f0137ed0 2024-04-25T02:23:25.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.917+0000 7f69f607b700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f69f00ad6f0 con 0x7f69f006d180 2024-04-25T02:23:25.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.917+0000 7f69ef7fe700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f69f0068ba0 0x7f69f00ad0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:25.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.917+0000 7f69ef7fe700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f69f0068ba0 0x7f69f00ad0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:60506/0 (socket says 172.21.15.111:60506) 2024-04-25T02:23:25.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.917+0000 7f69ef7fe700 1 -- 172.21.15.111:0/10596498 learned_addr learned my addr 172.21.15.111:0/10596498 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:25.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.917+0000 7f69effff700 1 --2- 172.21.15.111:0/10596498 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f69f0137ed0 0x7f69f00abd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:25.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.918+0000 7f33ec154700 1 Processor -- start 2024-04-25T02:23:25.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.918+0000 7f69eeffd700 1 --2- 172.21.15.111:0/10596498 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f69f006d180 0x7f69f0137990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:25.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.918+0000 7f69ef7fe700 1 -- 172.21.15.111:0/10596498 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f69f006d180 msgr2=0x7f69f0137990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:25.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.918+0000 7f69ef7fe700 1 --2- 172.21.15.111:0/10596498 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f69f006d180 0x7f69f0137990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:25.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.918+0000 7f69ef7fe700 1 -- 172.21.15.111:0/10596498 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f69f0137ed0 msgr2=0x7f69f00abd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:25.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.918+0000 7f69ef7fe700 1 --2- 172.21.15.111:0/10596498 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f69f0137ed0 0x7f69f00abd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:25.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.918+0000 7f69ef7fe700 1 -- 172.21.15.111:0/10596498 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69f00ad990 con 0x7f69f0068ba0 2024-04-25T02:23:25.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.918+0000 7f69eeffd700 1 --2- 172.21.15.111:0/10596498 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f69f006d180 0x7f69f0137990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-25T02:23:25.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.918+0000 7f69ef7fe700 1 --2- 172.21.15.111:0/10596498 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f69f0068ba0 0x7f69f00ad0d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f69e00099e0 tx=0x7f69e0009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35a15a8791f83bfa server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:25.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.918+0000 7f69ee7fc700 1 -- 172.21.15.111:0/10596498 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e000b820 con 0x7f69f0068ba0 2024-04-25T02:23:25.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.918+0000 7f69ee7fc700 1 -- 172.21.15.111:0/10596498 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e000b980 con 0x7f69f0068ba0 2024-04-25T02:23:25.924 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.918+0000 7f69ee7fc700 1 -- 172.21.15.111:0/10596498 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e000bd20 con 0x7f69f0068ba0 2024-04-25T02:23:25.925 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.918+0000 7f33ec154700 1 -- start start 2024-04-25T02:23:25.925 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.919+0000 7f33ec154700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f33e4063d30 0x7f33e406e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:25.925 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.919+0000 7f33ec154700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f33e406dd30 0x7f33e414d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:25.925 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.919+0000 7f33ec154700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33e4064100 con 0x7f33e406d960 2024-04-25T02:23:25.925 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.919+0000 7f33ec154700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e40abe90 con 0x7f33e406dd30 2024-04-25T02:23:25.925 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.919+0000 7f33ec154700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33e40ac130 con 0x7f33e4063d30 2024-04-25T02:23:25.925 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.919+0000 7f33e9ef0700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f33e4063d30 0x7f33e406e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:25.925 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.919+0000 7f33ea6f1700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f33e406dd30 0x7f33e414d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:25.925 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.919+0000 7f33e9ef0700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f33e4063d30 0x7f33e406e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:41216/0 (socket says 172.21.15.111:41216) 2024-04-25T02:23:25.926 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.919+0000 7f33e96ef700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f33e406d960 0x7f33e4142fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:33762/0 (socket says 172.21.15.111:33762) 2024-04-25T02:23:25.926 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.919+0000 7f33e9ef0700 1 -- 172.21.15.111:0/353008736 learned_addr learned my addr 172.21.15.111:0/353008736 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:25.926 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.919+0000 7f69f607b700 1 -- 172.21.15.111:0/10596498 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f69f0068ba0 msgr2=0x7f69f00ad0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:25.926 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.919+0000 7f69f607b700 1 --2- 172.21.15.111:0/10596498 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f69f0068ba0 0x7f69f00ad0d0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f69e00099e0 tx=0x7f69e0009250 comp rx=0 tx=0).stop 2024-04-25T02:23:25.926 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.919+0000 7f69f607b700 1 -- 172.21.15.111:0/10596498 shutdown_connections 2024-04-25T02:23:25.926 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.919+0000 7f69f607b700 1 --2- 172.21.15.111:0/10596498 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f69f0137ed0 0x7f69f00abd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:25.926 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.919+0000 7f69f607b700 1 --2- 172.21.15.111:0/10596498 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f69f0068ba0 0x7f69f00ad0d0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:25.926 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.919+0000 7f69f607b700 1 --2- 172.21.15.111:0/10596498 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f69f006d180 0x7f69f0137990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:25.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.919+0000 7f69f607b700 1 -- 172.21.15.111:0/10596498 >> 172.21.15.111:0/10596498 conn(0x7f69f00b1e10 msgr2=0x7f69f00ade80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:25.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.919+0000 7f33ea6f1700 1 -- 172.21.15.111:0/353008736 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f33e4063d30 msgr2=0x7f33e406e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:25.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.919+0000 7f33ea6f1700 1 --2- 172.21.15.111:0/353008736 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f33e4063d30 0x7f33e406e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:25.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.919+0000 7f33ea6f1700 1 -- 172.21.15.111:0/353008736 >> v1:172.21.15.111:6789/0 conn(0x7f33e406d960 legacy=0x7f33e4142fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:25.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.919+0000 7f33ea6f1700 1 -- 172.21.15.111:0/353008736 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e4068950 con 0x7f33e406dd30 2024-04-25T02:23:25.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.919+0000 7f69f607b700 1 -- 172.21.15.111:0/10596498 shutdown_connections 2024-04-25T02:23:25.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.919+0000 7f69f607b700 1 -- 172.21.15.111:0/10596498 wait complete. 2024-04-25T02:23:25.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.920+0000 7f33ea6f1700 1 --2- 172.21.15.111:0/353008736 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f33e406dd30 0x7f33e414d100 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f33dc009e90 tx=0x7f33dc009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=915e7114592c8e15 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:25.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.920+0000 7f33e8eee700 1 -- 172.21.15.111:0/353008736 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33dc00e070 con 0x7f33e406dd30 2024-04-25T02:23:25.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.920+0000 7f33e8eee700 1 -- 172.21.15.111:0/353008736 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33dc00bc30 con 0x7f33e406dd30 2024-04-25T02:23:25.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.920+0000 7f33e8eee700 1 -- 172.21.15.111:0/353008736 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33dc012430 con 0x7f33e406dd30 2024-04-25T02:23:25.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.920+0000 7f33ec154700 1 -- 172.21.15.111:0/353008736 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f33e406dd30 msgr2=0x7f33e414d100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:25.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.920+0000 7f33ec154700 1 --2- 172.21.15.111:0/353008736 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f33e406dd30 0x7f33e414d100 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f33dc009e90 tx=0x7f33dc009780 comp rx=0 tx=0).stop 2024-04-25T02:23:25.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.921+0000 7f33ec154700 1 -- 172.21.15.111:0/353008736 shutdown_connections 2024-04-25T02:23:25.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.921+0000 7f33ec154700 1 --2- 172.21.15.111:0/353008736 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f33e4063d30 0x7f33e406e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:25.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.921+0000 7f33ec154700 1 --2- 172.21.15.111:0/353008736 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f33e406dd30 0x7f33e414d100 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:25.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.921+0000 7f33ec154700 1 -- 172.21.15.111:0/353008736 >> 172.21.15.111:0/353008736 conn(0x7f33e40b1e10 msgr2=0x7f33e40ade80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:25.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.921+0000 7f69f607b700 1 Processor -- start 2024-04-25T02:23:25.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.921+0000 7f69f607b700 1 -- start start 2024-04-25T02:23:25.930 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.921+0000 7f33ec154700 1 -- 172.21.15.111:0/353008736 shutdown_connections 2024-04-25T02:23:25.931 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.921+0000 7f69f607b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f69f0068ba0 0x7f69f013bdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:25.931 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.921+0000 7f69f607b700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f69f006d180 0x7f69f0155530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:25.931 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.921+0000 7f69f607b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f69f0137ed0 0x7f69f0155a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:25.931 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.921+0000 7f69f607b700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69f0139d70 con 0x7f69f0068ba0 2024-04-25T02:23:25.931 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.921+0000 7f69f607b700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69f0139ab0 con 0x7f69f006d180 2024-04-25T02:23:25.931 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.921+0000 7f69f607b700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f69f00a9a60 con 0x7f69f0137ed0 2024-04-25T02:23:25.931 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.921+0000 7f69eeffd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f69f006d180 0x7f69f0155530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:25.931 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.921+0000 7f69eeffd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f69f006d180 0x7f69f0155530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:35648/0 (socket says 172.21.15.111:35648) 2024-04-25T02:23:25.931 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.921+0000 7f69eeffd700 1 -- 172.21.15.111:0/1662621315 learned_addr learned my addr 172.21.15.111:0/1662621315 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:25.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.921+0000 7f69effff700 1 --2- 172.21.15.111:0/1662621315 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f69f0137ed0 0x7f69f0155a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:25.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.922+0000 7f69ef7fe700 1 --2- 172.21.15.111:0/1662621315 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f69f0068ba0 0x7f69f013bdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:25.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.922+0000 7f69eeffd700 1 -- 172.21.15.111:0/1662621315 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f69f0137ed0 msgr2=0x7f69f0155a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:25.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.922+0000 7f69eeffd700 1 --2- 172.21.15.111:0/1662621315 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f69f0137ed0 0x7f69f0155a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:25.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.922+0000 7f69eeffd700 1 -- 172.21.15.111:0/1662621315 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f69f0068ba0 msgr2=0x7f69f013bdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:25.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.922+0000 7f69eeffd700 1 --2- 172.21.15.111:0/1662621315 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f69f0068ba0 0x7f69f013bdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:25.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.922+0000 7f69eeffd700 1 -- 172.21.15.111:0/1662621315 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e00094f0 con 0x7f69f006d180 2024-04-25T02:23:25.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.922+0000 7f69eeffd700 1 --2- 172.21.15.111:0/1662621315 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f69f006d180 0x7f69f0155530 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f69e400c830 tx=0x7f69e4008040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:25.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.922+0000 7f69d77fe700 1 -- 172.21.15.111:0/1662621315 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e4011600 con 0x7f69f006d180 2024-04-25T02:23:25.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.922+0000 7f69d77fe700 1 -- 172.21.15.111:0/1662621315 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69e4011760 con 0x7f69f006d180 2024-04-25T02:23:25.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.922+0000 7f69f607b700 1 -- 172.21.15.111:0/1662621315 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69f013c300 con 0x7f69f006d180 2024-04-25T02:23:25.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.922+0000 7f69f607b700 1 -- 172.21.15.111:0/1662621315 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69f013b190 con 0x7f69f006d180 2024-04-25T02:23:25.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.921+0000 7f33ec154700 1 -- 172.21.15.111:0/353008736 wait complete. 2024-04-25T02:23:25.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.923+0000 7f33ec154700 1 Processor -- start 2024-04-25T02:23:25.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.923+0000 7f69d77fe700 1 -- 172.21.15.111:0/1662621315 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69e4011b20 con 0x7f69f006d180 2024-04-25T02:23:25.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.923+0000 7f69f607b700 1 -- 172.21.15.111:0/1662621315 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69f0071790 con 0x7f69f006d180 2024-04-25T02:23:25.934 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.924+0000 7f69d77fe700 1 -- 172.21.15.111:0/1662621315 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f69e40233a0 con 0x7f69f006d180 2024-04-25T02:23:25.934 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.923+0000 7f33ec154700 1 -- start start 2024-04-25T02:23:25.934 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.924+0000 7f33ec154700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f33e4063d30 0x7f33e40a6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:25.934 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.924+0000 7f33ec154700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f33e406d960 0x7f33e40a5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:25.934 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.924+0000 7f33ec154700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f33e406dd30 0x7f33e412e0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:25.934 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.924+0000 7f33ec154700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e40a6ea0 con 0x7f33e406dd30 2024-04-25T02:23:25.934 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.924+0000 7f33ec154700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e40ab3d0 con 0x7f33e406d960 2024-04-25T02:23:25.935 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.924+0000 7f33ec154700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f33e40a7090 con 0x7f33e4063d30 2024-04-25T02:23:25.935 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.924+0000 7f33e9ef0700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f33e4063d30 0x7f33e40a6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:25.935 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.924+0000 7f33e9ef0700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f33e4063d30 0x7f33e40a6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:41228/0 (socket says 172.21.15.111:41228) 2024-04-25T02:23:25.935 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.924+0000 7f33e9ef0700 1 -- 172.21.15.111:0/2511073018 learned_addr learned my addr 172.21.15.111:0/2511073018 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:25.935 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.924+0000 7f69d77fe700 1 -- 172.21.15.111:0/1662621315 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f69e405b580 con 0x7f69f006d180 2024-04-25T02:23:25.936 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.924+0000 7f33ea6f1700 1 --2- 172.21.15.111:0/2511073018 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f33e406dd30 0x7f33e412e0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:25.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.924+0000 7f33e9ef0700 1 -- 172.21.15.111:0/2511073018 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f33e406d960 msgr2=0x7f33e40a5670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-25T02:23:25.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.924+0000 7f33e9ef0700 1 --2- 172.21.15.111:0/2511073018 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f33e406d960 0x7f33e40a5670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:25.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.924+0000 7f33e9ef0700 1 -- 172.21.15.111:0/2511073018 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f33e406dd30 msgr2=0x7f33e412e0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:25.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.924+0000 7f33e9ef0700 1 --2- 172.21.15.111:0/2511073018 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f33e406dd30 0x7f33e412e0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:25.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.924+0000 7f33e9ef0700 1 -- 172.21.15.111:0/2511073018 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33dc009a20 con 0x7f33e4063d30 2024-04-25T02:23:25.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.924+0000 7f33e9ef0700 1 --2- 172.21.15.111:0/2511073018 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f33e4063d30 0x7f33e40a6960 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f33e000ea50 tx=0x7f33e0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:25.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.925+0000 7f33d9ffb700 1 -- 172.21.15.111:0/2511073018 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e000c850 con 0x7f33e4063d30 2024-04-25T02:23:25.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.925+0000 7f33d9ffb700 1 -- 172.21.15.111:0/2511073018 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e000c9b0 con 0x7f33e4063d30 2024-04-25T02:23:25.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.925+0000 7f33d9ffb700 1 -- 172.21.15.111:0/2511073018 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e000cd50 con 0x7f33e4063d30 2024-04-25T02:23:25.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.926+0000 7f33ea6f1700 1 --2- 172.21.15.111:0/2511073018 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f33e406dd30 0x7f33e412e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-25T02:23:25.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.926+0000 7f33ec154700 1 -- 172.21.15.111:0/2511073018 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33e40a78b0 con 0x7f33e4063d30 2024-04-25T02:23:25.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.926+0000 7f33ec154700 1 -- 172.21.15.111:0/2511073018 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33e40a5bb0 con 0x7f33e4063d30 2024-04-25T02:23:25.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.927+0000 7f33d9ffb700 1 -- 172.21.15.111:0/2511073018 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f33e0013680 con 0x7f33e4063d30 2024-04-25T02:23:25.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.927+0000 7f33ec154700 1 -- 172.21.15.111:0/2511073018 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33e40a7f40 con 0x7f33e4063d30 2024-04-25T02:23:25.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.928+0000 7f33d9ffb700 1 -- 172.21.15.111:0/2511073018 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f33e005b470 con 0x7f33e4063d30 2024-04-25T02:23:25.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.932+0000 7f69d77fe700 1 -- 172.21.15.111:0/1662621315 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f69e4039630 con 0x7f69f006d180 2024-04-25T02:23:25.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:25.935+0000 7f33d9ffb700 1 -- 172.21.15.111:0/2511073018 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f33e0039630 con 0x7f33e4063d30 2024-04-25T02:23:26.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.047+0000 7f7809001700 1 -- 172.21.15.111:0/885926767 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f77e4005820 con 0x7f7804063d50 2024-04-25T02:23:26.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.047+0000 7f77eaffd700 1 -- 172.21.15.111:0/885926767 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f77f4015020 con 0x7f7804063d50 2024-04-25T02:23:26.052 INFO:teuthology.orchestra.run.smithi111.stdout:120259084293 2024-04-25T02:23:26.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.050+0000 7f7809001700 1 -- 172.21.15.111:0/885926767 >> v1:172.21.15.111:6816/46482 conn(0x7f77f0046010 legacy=0x7f77f00484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:26.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.050+0000 7f7809001700 1 -- 172.21.15.111:0/885926767 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7804063d50 msgr2=0x7f780413be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:26.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.050+0000 7f7809001700 1 --2- 172.21.15.111:0/885926767 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7804063d50 0x7f780413be60 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f77f40091e0 tx=0x7f77f4017000 comp rx=0 tx=0).stop 2024-04-25T02:23:26.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.050+0000 7f7809001700 1 -- 172.21.15.111:0/885926767 shutdown_connections 2024-04-25T02:23:26.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.050+0000 7f7809001700 1 --2- 172.21.15.111:0/885926767 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f780414eae0 0x7f7804151410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:26.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.050+0000 7f7809001700 1 --2- 172.21.15.111:0/885926767 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7804063d50 0x7f780413be60 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:26.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.050+0000 7f7809001700 1 --2- 172.21.15.111:0/885926767 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7804141910 0x7f780413c3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:26.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.050+0000 7f7809001700 1 -- 172.21.15.111:0/885926767 >> 172.21.15.111:0/885926767 conn(0x7f78040b1e10 msgr2=0x7f78040aa390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:26.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.050+0000 7f7809001700 1 -- 172.21.15.111:0/885926767 shutdown_connections 2024-04-25T02:23:26.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.050+0000 7f7809001700 1 -- 172.21.15.111:0/885926767 wait complete. 2024-04-25T02:23:26.070 INFO:tasks.ceph.ceph_manager.ceph:need seq 120259084292 got 120259084293 for osd.0 2024-04-25T02:23:26.070 DEBUG:teuthology.parallel:result is None 2024-04-25T02:23:26.089 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.086+0000 7f85db5ee700 1 -- 172.21.15.111:0/3828844753 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f85d406ec70 con 0x7f85d406e730 2024-04-25T02:23:26.089 INFO:teuthology.orchestra.run.smithi111.stdout:133143986180 2024-04-25T02:23:26.090 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.086+0000 7f85c97fa700 1 -- 172.21.15.111:0/3828844753 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f85c4015020 con 0x7f85d406e730 2024-04-25T02:23:26.092 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.089+0000 7f85db5ee700 1 -- 172.21.15.111:0/3828844753 >> v1:172.21.15.111:6816/46482 conn(0x7f85b8046160 legacy=0x7f85b8048610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:26.092 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.089+0000 7f85db5ee700 1 -- 172.21.15.111:0/3828844753 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f85d406e730 msgr2=0x7f85d41518f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:26.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.089+0000 7f85db5ee700 1 --2- 172.21.15.111:0/3828844753 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f85d406e730 0x7f85d41518f0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f85c4013000 tx=0x7f85c4017000 comp rx=0 tx=0).stop 2024-04-25T02:23:26.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.089+0000 7f85db5ee700 1 -- 172.21.15.111:0/3828844753 shutdown_connections 2024-04-25T02:23:26.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.089+0000 7f85db5ee700 1 --2- 172.21.15.111:0/3828844753 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f85d413f780 0x7f85d4151e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:26.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.089+0000 7f85db5ee700 1 --2- 172.21.15.111:0/3828844753 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f85d4068ba0 0x7f85d41395a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:26.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.089+0000 7f85db5ee700 1 --2- 172.21.15.111:0/3828844753 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f85d406e730 0x7f85d41518f0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:26.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.089+0000 7f85db5ee700 1 -- 172.21.15.111:0/3828844753 >> 172.21.15.111:0/3828844753 conn(0x7f85d40b1e10 msgr2=0x7f85d413e5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:26.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.089+0000 7f85db5ee700 1 -- 172.21.15.111:0/3828844753 shutdown_connections 2024-04-25T02:23:26.093 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.089+0000 7f85db5ee700 1 -- 172.21.15.111:0/3828844753 wait complete. 2024-04-25T02:23:26.102 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.099+0000 7f33ec154700 1 -- 172.21.15.111:0/2511073018 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f33e4068c20 con 0x7f33e4063d30 2024-04-25T02:23:26.103 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.099+0000 7f33d9ffb700 1 -- 172.21.15.111:0/2511073018 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f33e003ce20 con 0x7f33e4063d30 2024-04-25T02:23:26.103 INFO:teuthology.orchestra.run.smithi111.stdout:128849018884 2024-04-25T02:23:26.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.101+0000 7f33ec154700 1 -- 172.21.15.111:0/2511073018 >> v1:172.21.15.111:6816/46482 conn(0x7f33c8046040 legacy=0x7f33c80484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:26.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.101+0000 7f33ec154700 1 -- 172.21.15.111:0/2511073018 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f33e4063d30 msgr2=0x7f33e40a6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:26.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.101+0000 7f33ec154700 1 --2- 172.21.15.111:0/2511073018 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f33e4063d30 0x7f33e40a6960 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f33e000ea50 tx=0x7f33e0009250 comp rx=0 tx=0).stop 2024-04-25T02:23:26.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.101+0000 7f33ec154700 1 -- 172.21.15.111:0/2511073018 shutdown_connections 2024-04-25T02:23:26.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.101+0000 7f33ec154700 1 --2- 172.21.15.111:0/2511073018 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f33e406dd30 0x7f33e412e0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:26.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.101+0000 7f33ec154700 1 --2- 172.21.15.111:0/2511073018 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f33e4063d30 0x7f33e40a6960 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:26.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.101+0000 7f33ec154700 1 --2- 172.21.15.111:0/2511073018 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f33e406d960 0x7f33e40a5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:26.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.101+0000 7f33ec154700 1 -- 172.21.15.111:0/2511073018 >> 172.21.15.111:0/2511073018 conn(0x7f33e40b1e10 msgr2=0x7f33e4142d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:26.105 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.101+0000 7f33ec154700 1 -- 172.21.15.111:0/2511073018 shutdown_connections 2024-04-25T02:23:26.106 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.101+0000 7f33ec154700 1 -- 172.21.15.111:0/2511073018 wait complete. 2024-04-25T02:23:26.108 INFO:tasks.ceph.ceph_manager.ceph:need seq 133143986180 got 133143986180 for osd.3 2024-04-25T02:23:26.108 DEBUG:teuthology.parallel:result is None 2024-04-25T02:23:26.115 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.112+0000 7f69f607b700 1 -- 172.21.15.111:0/1662621315 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f69f00ae7b0 con 0x7f69f006d180 2024-04-25T02:23:26.116 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.112+0000 7f69d77fe700 1 -- 172.21.15.111:0/1662621315 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f69e403ce20 con 0x7f69f006d180 2024-04-25T02:23:26.116 INFO:teuthology.orchestra.run.smithi111.stdout:124554051588 2024-04-25T02:23:26.117 INFO:tasks.ceph.ceph_manager.ceph:need seq 128849018884 got 128849018884 for osd.2 2024-04-25T02:23:26.117 DEBUG:teuthology.parallel:result is None 2024-04-25T02:23:26.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.114+0000 7f69f607b700 1 -- 172.21.15.111:0/1662621315 >> v1:172.21.15.111:6816/46482 conn(0x7f69dc046010 legacy=0x7f69dc0484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:26.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.114+0000 7f69f607b700 1 -- 172.21.15.111:0/1662621315 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f69f006d180 msgr2=0x7f69f0155530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:26.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.114+0000 7f69f607b700 1 --2- 172.21.15.111:0/1662621315 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f69f006d180 0x7f69f0155530 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f69e400c830 tx=0x7f69e4008040 comp rx=0 tx=0).stop 2024-04-25T02:23:26.119 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.114+0000 7f69f607b700 1 -- 172.21.15.111:0/1662621315 shutdown_connections 2024-04-25T02:23:26.119 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.114+0000 7f69f607b700 1 --2- 172.21.15.111:0/1662621315 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f69f0137ed0 0x7f69f0155a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:26.119 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.114+0000 7f69f607b700 1 --2- 172.21.15.111:0/1662621315 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f69f0068ba0 0x7f69f013bdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:26.119 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.114+0000 7f69f607b700 1 --2- 172.21.15.111:0/1662621315 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f69f006d180 0x7f69f0155530 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:26.119 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.114+0000 7f69f607b700 1 -- 172.21.15.111:0/1662621315 >> 172.21.15.111:0/1662621315 conn(0x7f69f00b1e10 msgr2=0x7f69f00abc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:26.119 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.114+0000 7f69f607b700 1 -- 172.21.15.111:0/1662621315 shutdown_connections 2024-04-25T02:23:26.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.114+0000 7f69f607b700 1 -- 172.21.15.111:0/1662621315 wait complete. 2024-04-25T02:23:26.129 INFO:tasks.ceph.ceph_manager.ceph:need seq 124554051588 got 124554051588 for osd.1 2024-04-25T02:23:26.130 DEBUG:teuthology.parallel:result is None 2024-04-25T02:23:26.130 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T02:23:26.130 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:23:26.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.282+0000 7f525d56c700 1 Processor -- start 2024-04-25T02:23:27.046 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.282+0000 7f525d56c700 1 -- start start 2024-04-25T02:23:27.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.283+0000 7f525d56c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f52580b4fd0 0x7f52580a2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:27.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.283+0000 7f525d56c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f52580a3980 0x7f52580a3d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:27.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.283+0000 7f525d56c700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f525813ea00 0x7f525813eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:27.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.283+0000 7f525d56c700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52580a6710 con 0x7f525813ea00 2024-04-25T02:23:27.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.283+0000 7f525d56c700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52580a46d0 con 0x7f52580a3980 2024-04-25T02:23:27.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.283+0000 7f525d56c700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f525813f3e0 con 0x7f52580b4fd0 2024-04-25T02:23:27.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.283+0000 7f52567fc700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f52580a3980 0x7f52580a3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:27.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.283+0000 7f5256ffd700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f52580b4fd0 0x7f52580a2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:27.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.283+0000 7f52577fe700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f525813ea00 0x7f525813eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:27.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.283+0000 7f5256ffd700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f52580b4fd0 0x7f52580a2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:41232/0 (socket says 172.21.15.111:41232) 2024-04-25T02:23:27.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.283+0000 7f52567fc700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f52580a3980 0x7f52580a3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:35654/0 (socket says 172.21.15.111:35654) 2024-04-25T02:23:27.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.283+0000 7f52577fe700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f525813ea00 0x7f525813eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:60550/0 (socket says 172.21.15.111:60550) 2024-04-25T02:23:27.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.283+0000 7f5256ffd700 1 -- 172.21.15.111:0/2592816799 learned_addr learned my addr 172.21.15.111:0/2592816799 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:27.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.283+0000 7f52567fc700 1 -- 172.21.15.111:0/2592816799 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f52580b4fd0 msgr2=0x7f52580a2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:27.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.283+0000 7f52567fc700 1 --2- 172.21.15.111:0/2592816799 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f52580b4fd0 0x7f52580a2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:27.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.283+0000 7f52567fc700 1 -- 172.21.15.111:0/2592816799 >> v2:172.21.15.111:3300/0 conn(0x7f525813ea00 msgr2=0x7f525813eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:27.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.283+0000 7f52567fc700 1 --2- 172.21.15.111:0/2592816799 >> v2:172.21.15.111:3300/0 conn(0x7f525813ea00 0x7f525813eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:27.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.283+0000 7f52567fc700 1 -- 172.21.15.111:0/2592816799 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52580a4930 con 0x7f52580a3980 2024-04-25T02:23:27.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.283+0000 7f5256ffd700 1 --2- 172.21.15.111:0/2592816799 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f52580b4fd0 0x7f52580a2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:27.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.283+0000 7f52577fe700 1 --2- 172.21.15.111:0/2592816799 >> v2:172.21.15.111:3300/0 conn(0x7f525813ea00 0x7f525813eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:27.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.283+0000 7f52567fc700 1 --2- 172.21.15.111:0/2592816799 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f52580a3980 0x7f52580a3d50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f52480098e0 tx=0x7f52480091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=953cfd6a595124e9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:27.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.283+0000 7f5255ffb700 1 -- 172.21.15.111:0/2592816799 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5248011630 con 0x7f52580a3980 2024-04-25T02:23:27.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.283+0000 7f5255ffb700 1 -- 172.21.15.111:0/2592816799 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5248011790 con 0x7f52580a3980 2024-04-25T02:23:27.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.283+0000 7f5255ffb700 1 -- 172.21.15.111:0/2592816799 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5248011b30 con 0x7f52580a3980 2024-04-25T02:23:27.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.284+0000 7f525d56c700 1 -- 172.21.15.111:0/2592816799 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f52580a3980 msgr2=0x7f52580a3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:27.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.284+0000 7f525d56c700 1 --2- 172.21.15.111:0/2592816799 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f52580a3980 0x7f52580a3d50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f52480098e0 tx=0x7f52480091a0 comp rx=0 tx=0).stop 2024-04-25T02:23:27.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.284+0000 7f525d56c700 1 -- 172.21.15.111:0/2592816799 shutdown_connections 2024-04-25T02:23:27.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.284+0000 7f525d56c700 1 --2- 172.21.15.111:0/2592816799 >> v2:172.21.15.111:3300/0 conn(0x7f525813ea00 0x7f525813eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:27.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.284+0000 7f525d56c700 1 --2- 172.21.15.111:0/2592816799 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f52580b4fd0 0x7f52580a2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:27.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.284+0000 7f525d56c700 1 --2- 172.21.15.111:0/2592816799 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f52580a3980 0x7f52580a3d50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:27.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.284+0000 7f525d56c700 1 -- 172.21.15.111:0/2592816799 >> 172.21.15.111:0/2592816799 conn(0x7f52580883e0 msgr2=0x7f5258068b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:27.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.284+0000 7f525d56c700 1 -- 172.21.15.111:0/2592816799 shutdown_connections 2024-04-25T02:23:27.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.284+0000 7f525d56c700 1 -- 172.21.15.111:0/2592816799 wait complete. 2024-04-25T02:23:27.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.285+0000 7f525d56c700 1 Processor -- start 2024-04-25T02:23:27.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.285+0000 7f525d56c700 1 -- start start 2024-04-25T02:23:27.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.286+0000 7f525d56c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f52580a3980 0x7f525809ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:27.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.286+0000 7f525d56c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f52580b4fd0 0x7f525809a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:27.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.286+0000 7f525d56c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f525813ea00 0x7f5258151f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:27.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.286+0000 7f525d56c700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f525809b180 con 0x7f52580a3980 2024-04-25T02:23:27.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.286+0000 7f525d56c700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f525809c980 con 0x7f525813ea00 2024-04-25T02:23:27.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.286+0000 7f525d56c700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5258151b30 con 0x7f52580b4fd0 2024-04-25T02:23:27.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.286+0000 7f52567fc700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f52580b4fd0 0x7f525809a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:27.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.286+0000 7f5256ffd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f52580a3980 0x7f525809ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:27.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.286+0000 7f52577fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f525813ea00 0x7f5258151f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:27.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.286+0000 7f5256ffd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f52580a3980 0x7f525809ce80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:60564/0 (socket says 172.21.15.111:60564) 2024-04-25T02:23:27.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.286+0000 7f52567fc700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f52580b4fd0 0x7f525809a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:41248/0 (socket says 172.21.15.111:41248) 2024-04-25T02:23:27.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.286+0000 7f5256ffd700 1 -- 172.21.15.111:0/3198529066 learned_addr learned my addr 172.21.15.111:0/3198529066 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:27.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.286+0000 7f52577fe700 1 -- 172.21.15.111:0/3198529066 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f52580b4fd0 msgr2=0x7f525809a7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:27.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.286+0000 7f52577fe700 1 --2- 172.21.15.111:0/3198529066 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f52580b4fd0 0x7f525809a7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:27.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.286+0000 7f52577fe700 1 -- 172.21.15.111:0/3198529066 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f52580a3980 msgr2=0x7f525809ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:27.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.286+0000 7f52577fe700 1 --2- 172.21.15.111:0/3198529066 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f52580a3980 0x7f525809ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:27.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.286+0000 7f52577fe700 1 -- 172.21.15.111:0/3198529066 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f524c0094f0 con 0x7f525813ea00 2024-04-25T02:23:27.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.286+0000 7f5256ffd700 1 --2- 172.21.15.111:0/3198529066 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f52580a3980 0x7f525809ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:27.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.286+0000 7f52567fc700 1 --2- 172.21.15.111:0/3198529066 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f52580b4fd0 0x7f525809a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:27.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.286+0000 7f52577fe700 1 --2- 172.21.15.111:0/3198529066 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f525813ea00 0x7f5258151f60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5250009e70 tx=0x7f525000b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:27.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.286+0000 7f523effd700 1 -- 172.21.15.111:0/3198529066 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525000caa0 con 0x7f525813ea00 2024-04-25T02:23:27.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.286+0000 7f523effd700 1 -- 172.21.15.111:0/3198529066 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f525000f040 con 0x7f525813ea00 2024-04-25T02:23:27.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.286+0000 7f523effd700 1 -- 172.21.15.111:0/3198529066 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f525000ce90 con 0x7f525813ea00 2024-04-25T02:23:27.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.286+0000 7f525d56c700 1 -- 172.21.15.111:0/3198529066 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5250009a20 con 0x7f525813ea00 2024-04-25T02:23:27.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.286+0000 7f525d56c700 1 -- 172.21.15.111:0/3198529066 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5248009420 con 0x7f525813ea00 2024-04-25T02:23:27.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.287+0000 7f523effd700 1 -- 172.21.15.111:0/3198529066 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f5250003020 con 0x7f525813ea00 2024-04-25T02:23:27.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.287+0000 7f525d56c700 1 -- 172.21.15.111:0/3198529066 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52580a4b50 con 0x7f525813ea00 2024-04-25T02:23:27.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.288+0000 7f523effd700 1 -- 172.21.15.111:0/3198529066 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f525005ba60 con 0x7f525813ea00 2024-04-25T02:23:27.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.291+0000 7f523effd700 1 -- 172.21.15.111:0/3198529066 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f5250039b70 con 0x7f525813ea00 2024-04-25T02:23:27.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.441+0000 7f525d56c700 1 -- 172.21.15.111:0/3198529066 --> v1:172.21.15.111:6816/46482 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f5258099b50 con 0x7f5244046010 2024-04-25T02:23:27.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.448+0000 7f523effd700 1 -- 172.21.15.111:0/3198529066 <== mgr.14107 v1:172.21.15.111:6816/46482 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+271408 (unknown 2965378022 0 641881088) 0x7f5258099b50 con 0x7f5244046010 2024-04-25T02:23:27.062 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:23:27.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.450+0000 7f525d56c700 1 -- 172.21.15.111:0/3198529066 >> v1:172.21.15.111:6816/46482 conn(0x7f5244046010 legacy=0x7f52440484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:27.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.450+0000 7f525d56c700 1 -- 172.21.15.111:0/3198529066 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f525813ea00 msgr2=0x7f5258151f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:27.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.450+0000 7f525d56c700 1 --2- 172.21.15.111:0/3198529066 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f525813ea00 0x7f5258151f60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5250009e70 tx=0x7f525000b040 comp rx=0 tx=0).stop 2024-04-25T02:23:27.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.450+0000 7f525d56c700 1 -- 172.21.15.111:0/3198529066 shutdown_connections 2024-04-25T02:23:27.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.450+0000 7f525d56c700 1 --2- 172.21.15.111:0/3198529066 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f525813ea00 0x7f5258151f60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:27.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.450+0000 7f525d56c700 1 --2- 172.21.15.111:0/3198529066 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f52580a3980 0x7f525809ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:27.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.450+0000 7f525d56c700 1 --2- 172.21.15.111:0/3198529066 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f52580b4fd0 0x7f525809a7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:27.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.450+0000 7f525d56c700 1 -- 172.21.15.111:0/3198529066 >> 172.21.15.111:0/3198529066 conn(0x7f52580883e0 msgr2=0x7f5258063d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:27.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.450+0000 7f525d56c700 1 -- 172.21.15.111:0/3198529066 shutdown_connections 2024-04-25T02:23:27.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:26.451+0000 7f525d56c700 1 -- 172.21.15.111:0/3198529066 wait complete. 2024-04-25T02:23:27.065 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2024-04-25T02:23:27.066 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-04-25T02:23:24.733374+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":599151,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":166,"num_read_kb":160,"num_write":273,"num_write_kb":2336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":221,"ondisk_log_size":221,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1199516,"kb_used_data":2584,"kb_used_omap":38,"kb_used_meta":1196825,"kb_avail":376287844,"statfs":{"total":386547056640,"available":385318752256,"internally_reserved":0,"allocated":2646016,"data_stored":1803444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39115,"internal_metadata":1225549621},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":272,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":50,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.862972"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.880096+0000","last_change":"2024-04-25T02:23:13.846111+0000","last_active":"2024-04-25T02:23:20.880096+0000","last_peered":"2024-04-25T02:23:20.880096+0000","last_clean":"2024-04-25T02:23:20.880096+0000","last_became_active":"2024-04-25T02:23:13.845848+0000","last_became_peered":"2024-04-25T02:23:13.845848+0000","last_unstale":"2024-04-25T02:23:20.880096+0000","last_undegraded":"2024-04-25T02:23:20.880096+0000","last_fullsized":"2024-04-25T02:23:20.880096+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:48:53.653719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.880552+0000","last_change":"2024-04-25T02:23:12.845761+0000","last_active":"2024-04-25T02:23:20.880552+0000","last_peered":"2024-04-25T02:23:20.880552+0000","last_clean":"2024-04-25T02:23:20.880552+0000","last_became_active":"2024-04-25T02:23:12.845429+0000","last_became_peered":"2024-04-25T02:23:12.845429+0000","last_unstale":"2024-04-25T02:23:20.880552+0000","last_undegraded":"2024-04-25T02:23:20.880552+0000","last_fullsized":"2024-04-25T02:23:20.880552+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:39:23.193473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.881310+0000","last_change":"2024-04-25T02:23:11.838311+0000","last_active":"2024-04-25T02:23:20.881310+0000","last_peered":"2024-04-25T02:23:20.881310+0000","last_clean":"2024-04-25T02:23:20.881310+0000","last_became_active":"2024-04-25T02:23:11.838054+0000","last_became_peered":"2024-04-25T02:23:11.838054+0000","last_unstale":"2024-04-25T02:23:20.881310+0000","last_undegraded":"2024-04-25T02:23:20.881310+0000","last_fullsized":"2024-04-25T02:23:20.881310+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:55:20.837592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.881110+0000","last_change":"2024-04-25T02:23:11.837015+0000","last_active":"2024-04-25T02:23:20.881110+0000","last_peered":"2024-04-25T02:23:20.881110+0000","last_clean":"2024-04-25T02:23:20.881110+0000","last_became_active":"2024-04-25T02:23:11.836681+0000","last_became_peered":"2024-04-25T02:23:11.836681+0000","last_unstale":"2024-04-25T02:23:20.881110+0000","last_undegraded":"2024-04-25T02:23:20.881110+0000","last_fullsized":"2024-04-25T02:23:20.881110+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:57:52.130438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.880288+0000","last_change":"2024-04-25T02:23:13.843174+0000","last_active":"2024-04-25T02:23:20.880288+0000","last_peered":"2024-04-25T02:23:20.880288+0000","last_clean":"2024-04-25T02:23:20.880288+0000","last_became_active":"2024-04-25T02:23:13.842918+0000","last_became_peered":"2024-04-25T02:23:13.842918+0000","last_unstale":"2024-04-25T02:23:20.880288+0000","last_undegraded":"2024-04-25T02:23:20.880288+0000","last_fullsized":"2024-04-25T02:23:20.880288+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:18:04.676996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.878614+0000","last_change":"2024-04-25T02:23:13.848493+0000","last_active":"2024-04-25T02:23:20.878614+0000","last_peered":"2024-04-25T02:23:20.878614+0000","last_clean":"2024-04-25T02:23:20.878614+0000","last_became_active":"2024-04-25T02:23:13.848160+0000","last_became_peered":"2024-04-25T02:23:13.848160+0000","last_unstale":"2024-04-25T02:23:20.878614+0000","last_undegraded":"2024-04-25T02:23:20.878614+0000","last_fullsized":"2024-04-25T02:23:20.878614+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:40:38.221942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.878956+0000","last_change":"2024-04-25T02:23:13.842324+0000","last_active":"2024-04-25T02:23:20.878956+0000","last_peered":"2024-04-25T02:23:20.878956+0000","last_clean":"2024-04-25T02:23:20.878956+0000","last_became_active":"2024-04-25T02:23:13.840374+0000","last_became_peered":"2024-04-25T02:23:13.840374+0000","last_unstale":"2024-04-25T02:23:20.878956+0000","last_undegraded":"2024-04-25T02:23:20.878956+0000","last_fullsized":"2024-04-25T02:23:20.878956+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:04:41.899219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:21.178467+0000","last_change":"2024-04-25T02:23:11.835781+0000","last_active":"2024-04-25T02:23:21.178467+0000","last_peered":"2024-04-25T02:23:21.178467+0000","last_clean":"2024-04-25T02:23:21.178467+0000","last_became_active":"2024-04-25T02:23:11.834759+0000","last_became_peered":"2024-04-25T02:23:11.834759+0000","last_unstale":"2024-04-25T02:23:21.178467+0000","last_undegraded":"2024-04-25T02:23:21.178467+0000","last_fullsized":"2024-04-25T02:23:21.178467+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:17:37.320529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.881899+0000","last_change":"2024-04-25T02:23:13.842786+0000","last_active":"2024-04-25T02:23:20.881899+0000","last_peered":"2024-04-25T02:23:20.881899+0000","last_clean":"2024-04-25T02:23:20.881899+0000","last_became_active":"2024-04-25T02:23:13.841883+0000","last_became_peered":"2024-04-25T02:23:13.841883+0000","last_unstale":"2024-04-25T02:23:20.881899+0000","last_undegraded":"2024-04-25T02:23:20.881899+0000","last_fullsized":"2024-04-25T02:23:20.881899+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:13:08.256311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:21.179100+0000","last_change":"2024-04-25T02:23:11.836289+0000","last_active":"2024-04-25T02:23:21.179100+0000","last_peered":"2024-04-25T02:23:21.179100+0000","last_clean":"2024-04-25T02:23:21.179100+0000","last_became_active":"2024-04-25T02:23:11.835958+0000","last_became_peered":"2024-04-25T02:23:11.835958+0000","last_unstale":"2024-04-25T02:23:21.179100+0000","last_undegraded":"2024-04-25T02:23:21.179100+0000","last_fullsized":"2024-04-25T02:23:21.179100+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:56:00.639964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:21.179030+0000","last_change":"2024-04-25T02:23:11.836468+0000","last_active":"2024-04-25T02:23:21.179030+0000","last_peered":"2024-04-25T02:23:21.179030+0000","last_clean":"2024-04-25T02:23:21.179030+0000","last_became_active":"2024-04-25T02:23:11.836214+0000","last_became_peered":"2024-04-25T02:23:11.836214+0000","last_unstale":"2024-04-25T02:23:21.179030+0000","last_undegraded":"2024-04-25T02:23:21.179030+0000","last_fullsized":"2024-04-25T02:23:21.179030+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:55:43.874015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.879884+0000","last_change":"2024-04-25T02:23:13.847944+0000","last_active":"2024-04-25T02:23:20.879884+0000","last_peered":"2024-04-25T02:23:20.879884+0000","last_clean":"2024-04-25T02:23:20.879884+0000","last_became_active":"2024-04-25T02:23:13.847446+0000","last_became_peered":"2024-04-25T02:23:13.847446+0000","last_unstale":"2024-04-25T02:23:20.879884+0000","last_undegraded":"2024-04-25T02:23:20.879884+0000","last_fullsized":"2024-04-25T02:23:20.879884+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:18:53.324436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.880306+0000","last_change":"2024-04-25T02:23:13.847825+0000","last_active":"2024-04-25T02:23:20.880306+0000","last_peered":"2024-04-25T02:23:20.880306+0000","last_clean":"2024-04-25T02:23:20.880306+0000","last_became_active":"2024-04-25T02:23:13.847009+0000","last_became_peered":"2024-04-25T02:23:13.847009+0000","last_unstale":"2024-04-25T02:23:20.880306+0000","last_undegraded":"2024-04-25T02:23:20.880306+0000","last_fullsized":"2024-04-25T02:23:20.880306+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:04:01.988527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:21.178519+0000","last_change":"2024-04-25T02:23:12.841952+0000","last_active":"2024-04-25T02:23:21.178519+0000","last_peered":"2024-04-25T02:23:21.178519+0000","last_clean":"2024-04-25T02:23:21.178519+0000","last_became_active":"2024-04-25T02:23:12.841783+0000","last_became_peered":"2024-04-25T02:23:12.841783+0000","last_unstale":"2024-04-25T02:23:21.178519+0000","last_undegraded":"2024-04-25T02:23:21.178519+0000","last_fullsized":"2024-04-25T02:23:21.178519+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:42:53.655107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.879735+0000","last_change":"2024-04-25T02:23:11.836069+0000","last_active":"2024-04-25T02:23:20.879735+0000","last_peered":"2024-04-25T02:23:20.879735+0000","last_clean":"2024-04-25T02:23:20.879735+0000","last_became_active":"2024-04-25T02:23:11.835815+0000","last_became_peered":"2024-04-25T02:23:11.835815+0000","last_unstale":"2024-04-25T02:23:20.879735+0000","last_undegraded":"2024-04-25T02:23:20.879735+0000","last_fullsized":"2024-04-25T02:23:20.879735+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:07.444694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.877877+0000","last_change":"2024-04-25T02:23:13.839341+0000","last_active":"2024-04-25T02:23:20.877877+0000","last_peered":"2024-04-25T02:23:20.877877+0000","last_clean":"2024-04-25T02:23:20.877877+0000","last_became_active":"2024-04-25T02:23:13.839084+0000","last_became_peered":"2024-04-25T02:23:13.839084+0000","last_unstale":"2024-04-25T02:23:20.877877+0000","last_undegraded":"2024-04-25T02:23:20.877877+0000","last_fullsized":"2024-04-25T02:23:20.877877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:29:17.043820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.882020+0000","last_change":"2024-04-25T02:23:13.844591+0000","last_active":"2024-04-25T02:23:20.882020+0000","last_peered":"2024-04-25T02:23:20.882020+0000","last_clean":"2024-04-25T02:23:20.882020+0000","last_became_active":"2024-04-25T02:23:13.844343+0000","last_became_peered":"2024-04-25T02:23:13.844343+0000","last_unstale":"2024-04-25T02:23:20.882020+0000","last_undegraded":"2024-04-25T02:23:20.882020+0000","last_fullsized":"2024-04-25T02:23:20.882020+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:52:55.994134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.882082+0000","last_change":"2024-04-25T02:23:12.848314+0000","last_active":"2024-04-25T02:23:20.882082+0000","last_peered":"2024-04-25T02:23:20.882082+0000","last_clean":"2024-04-25T02:23:20.882082+0000","last_became_active":"2024-04-25T02:23:12.848051+0000","last_became_peered":"2024-04-25T02:23:12.848051+0000","last_unstale":"2024-04-25T02:23:20.882082+0000","last_undegraded":"2024-04-25T02:23:20.882082+0000","last_fullsized":"2024-04-25T02:23:20.882082+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:53:59.236832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.880637+0000","last_change":"2024-04-25T02:23:13.848250+0000","last_active":"2024-04-25T02:23:20.880637+0000","last_peered":"2024-04-25T02:23:20.880637+0000","last_clean":"2024-04-25T02:23:20.880637+0000","last_became_active":"2024-04-25T02:23:13.847602+0000","last_became_peered":"2024-04-25T02:23:13.847602+0000","last_unstale":"2024-04-25T02:23:20.880637+0000","last_undegraded":"2024-04-25T02:23:20.880637+0000","last_fullsized":"2024-04-25T02:23:20.880637+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:36:05.652157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:21.178830+0000","last_change":"2024-04-25T02:23:13.846327+0000","last_active":"2024-04-25T02:23:21.178830+0000","last_peered":"2024-04-25T02:23:21.178830+0000","last_clean":"2024-04-25T02:23:21.178830+0000","last_became_active":"2024-04-25T02:23:13.845934+0000","last_became_peered":"2024-04-25T02:23:13.845934+0000","last_unstale":"2024-04-25T02:23:21.178830+0000","last_undegraded":"2024-04-25T02:23:21.178830+0000","last_fullsized":"2024-04-25T02:23:21.178830+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:01:47.261604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:21.178988+0000","last_change":"2024-04-25T02:23:13.847117+0000","last_active":"2024-04-25T02:23:21.178988+0000","last_peered":"2024-04-25T02:23:21.178988+0000","last_clean":"2024-04-25T02:23:21.178988+0000","last_became_active":"2024-04-25T02:23:13.846758+0000","last_became_peered":"2024-04-25T02:23:13.846758+0000","last_unstale":"2024-04-25T02:23:21.178988+0000","last_undegraded":"2024-04-25T02:23:21.178988+0000","last_fullsized":"2024-04-25T02:23:21.178988+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:53:10.872495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.879925+0000","last_change":"2024-04-25T02:23:11.835581+0000","last_active":"2024-04-25T02:23:20.879925+0000","last_peered":"2024-04-25T02:23:20.879925+0000","last_clean":"2024-04-25T02:23:20.879925+0000","last_became_active":"2024-04-25T02:23:11.835319+0000","last_became_peered":"2024-04-25T02:23:11.835319+0000","last_unstale":"2024-04-25T02:23:20.879925+0000","last_undegraded":"2024-04-25T02:23:20.879925+0000","last_fullsized":"2024-04-25T02:23:20.879925+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:19:02.978966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.878288+0000","last_change":"2024-04-25T02:23:13.840011+0000","last_active":"2024-04-25T02:23:20.878288+0000","last_peered":"2024-04-25T02:23:20.878288+0000","last_clean":"2024-04-25T02:23:20.878288+0000","last_became_active":"2024-04-25T02:23:13.838917+0000","last_became_peered":"2024-04-25T02:23:13.838917+0000","last_unstale":"2024-04-25T02:23:20.878288+0000","last_undegraded":"2024-04-25T02:23:20.878288+0000","last_fullsized":"2024-04-25T02:23:20.878288+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:53:06.476265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:21.178405+0000","last_change":"2024-04-25T02:23:13.846482+0000","last_active":"2024-04-25T02:23:21.178405+0000","last_peered":"2024-04-25T02:23:21.178405+0000","last_clean":"2024-04-25T02:23:21.178405+0000","last_became_active":"2024-04-25T02:23:13.845814+0000","last_became_peered":"2024-04-25T02:23:13.845814+0000","last_unstale":"2024-04-25T02:23:21.178405+0000","last_undegraded":"2024-04-25T02:23:21.178405+0000","last_fullsized":"2024-04-25T02:23:21.178405+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:33:00.487666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:21.179138+0000","last_change":"2024-04-25T02:23:13.852668+0000","last_active":"2024-04-25T02:23:21.179138+0000","last_peered":"2024-04-25T02:23:21.179138+0000","last_clean":"2024-04-25T02:23:21.179138+0000","last_became_active":"2024-04-25T02:23:13.852093+0000","last_became_peered":"2024-04-25T02:23:13.852093+0000","last_unstale":"2024-04-25T02:23:21.179138+0000","last_undegraded":"2024-04-25T02:23:21.179138+0000","last_fullsized":"2024-04-25T02:23:21.179138+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:57.422935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:21.179239+0000","last_change":"2024-04-25T02:23:12.841653+0000","last_active":"2024-04-25T02:23:21.179239+0000","last_peered":"2024-04-25T02:23:21.179239+0000","last_clean":"2024-04-25T02:23:21.179239+0000","last_became_active":"2024-04-25T02:23:12.841477+0000","last_became_peered":"2024-04-25T02:23:12.841477+0000","last_unstale":"2024-04-25T02:23:21.179239+0000","last_undegraded":"2024-04-25T02:23:21.179239+0000","last_fullsized":"2024-04-25T02:23:21.179239+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:16:17.108262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.878786+0000","last_change":"2024-04-25T02:23:13.842553+0000","last_active":"2024-04-25T02:23:20.878786+0000","last_peered":"2024-04-25T02:23:20.878786+0000","last_clean":"2024-04-25T02:23:20.878786+0000","last_became_active":"2024-04-25T02:23:13.840422+0000","last_became_peered":"2024-04-25T02:23:13.840422+0000","last_unstale":"2024-04-25T02:23:20.878786+0000","last_undegraded":"2024-04-25T02:23:20.878786+0000","last_fullsized":"2024-04-25T02:23:20.878786+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:44:38.010033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"35'2","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:21.178638+0000","last_change":"2024-04-25T02:23:12.846241+0000","last_active":"2024-04-25T02:23:21.178638+0000","last_peered":"2024-04-25T02:23:21.178638+0000","last_clean":"2024-04-25T02:23:21.178638+0000","last_became_active":"2024-04-25T02:23:12.845923+0000","last_became_peered":"2024-04-25T02:23:12.845923+0000","last_unstale":"2024-04-25T02:23:21.178638+0000","last_undegraded":"2024-04-25T02:23:21.178638+0000","last_fullsized":"2024-04-25T02:23:21.178638+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:59:31.094638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.881274+0000","last_change":"2024-04-25T02:23:13.850625+0000","last_active":"2024-04-25T02:23:20.881274+0000","last_peered":"2024-04-25T02:23:20.881274+0000","last_clean":"2024-04-25T02:23:20.881274+0000","last_became_active":"2024-04-25T02:23:13.848844+0000","last_became_peered":"2024-04-25T02:23:13.848844+0000","last_unstale":"2024-04-25T02:23:20.881274+0000","last_undegraded":"2024-04-25T02:23:20.881274+0000","last_fullsized":"2024-04-25T02:23:20.881274+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:32.796023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:21.178480+0000","last_change":"2024-04-25T02:23:13.850242+0000","last_active":"2024-04-25T02:23:21.178480+0000","last_peered":"2024-04-25T02:23:21.178480+0000","last_clean":"2024-04-25T02:23:21.178480+0000","last_became_active":"2024-04-25T02:23:13.846821+0000","last_became_peered":"2024-04-25T02:23:13.846821+0000","last_unstale":"2024-04-25T02:23:21.178480+0000","last_undegraded":"2024-04-25T02:23:21.178480+0000","last_fullsized":"2024-04-25T02:23:21.178480+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:16.733579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.882222+0000","last_change":"2024-04-25T02:23:11.840787+0000","last_active":"2024-04-25T02:23:20.882222+0000","last_peered":"2024-04-25T02:23:20.882222+0000","last_clean":"2024-04-25T02:23:20.882222+0000","last_became_active":"2024-04-25T02:23:11.840274+0000","last_became_peered":"2024-04-25T02:23:11.840274+0000","last_unstale":"2024-04-25T02:23:20.882222+0000","last_undegraded":"2024-04-25T02:23:20.882222+0000","last_fullsized":"2024-04-25T02:23:20.882222+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:26:15.381838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"18'1","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.878170+0000","last_change":"2024-04-25T02:23:13.839791+0000","last_active":"2024-04-25T02:23:20.878170+0000","last_peered":"2024-04-25T02:23:20.878170+0000","last_clean":"2024-04-25T02:23:20.878170+0000","last_became_active":"2024-04-25T02:23:13.839361+0000","last_became_peered":"2024-04-25T02:23:13.839361+0000","last_unstale":"2024-04-25T02:23:20.878170+0000","last_undegraded":"2024-04-25T02:23:20.878170+0000","last_fullsized":"2024-04-25T02:23:20.878170+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:48:03.634232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.881308+0000","last_change":"2024-04-25T02:23:13.844099+0000","last_active":"2024-04-25T02:23:20.881308+0000","last_peered":"2024-04-25T02:23:20.881308+0000","last_clean":"2024-04-25T02:23:20.881308+0000","last_became_active":"2024-04-25T02:23:13.843656+0000","last_became_peered":"2024-04-25T02:23:13.843656+0000","last_unstale":"2024-04-25T02:23:20.881308+0000","last_undegraded":"2024-04-25T02:23:20.881308+0000","last_fullsized":"2024-04-25T02:23:20.881308+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:18:44.036616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"19'7","reported_seq":43,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.881978+0000","last_change":"2024-04-25T02:23:13.842946+0000","last_active":"2024-04-25T02:23:20.881978+0000","last_peered":"2024-04-25T02:23:20.881978+0000","last_clean":"2024-04-25T02:23:20.881978+0000","last_became_active":"2024-04-25T02:23:13.842598+0000","last_became_peered":"2024-04-25T02:23:13.842598+0000","last_unstale":"2024-04-25T02:23:20.881978+0000","last_undegraded":"2024-04-25T02:23:20.881978+0000","last_fullsized":"2024-04-25T02:23:20.881978+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:27.597908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.878004+0000","last_change":"2024-04-25T02:23:13.849957+0000","last_active":"2024-04-25T02:23:20.878004+0000","last_peered":"2024-04-25T02:23:20.878004+0000","last_clean":"2024-04-25T02:23:20.878004+0000","last_became_active":"2024-04-25T02:23:13.848675+0000","last_became_peered":"2024-04-25T02:23:13.848675+0000","last_unstale":"2024-04-25T02:23:20.878004+0000","last_undegraded":"2024-04-25T02:23:20.878004+0000","last_fullsized":"2024-04-25T02:23:20.878004+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:09:49.581897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"18'2","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.880418+0000","last_change":"2024-04-25T02:23:13.847353+0000","last_active":"2024-04-25T02:23:20.880418+0000","last_peered":"2024-04-25T02:23:20.880418+0000","last_clean":"2024-04-25T02:23:20.880418+0000","last_became_active":"2024-04-25T02:23:13.846764+0000","last_became_peered":"2024-04-25T02:23:13.846764+0000","last_unstale":"2024-04-25T02:23:20.880418+0000","last_undegraded":"2024-04-25T02:23:20.880418+0000","last_fullsized":"2024-04-25T02:23:20.880418+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:38:36.095151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.878786+0000","last_change":"2024-04-25T02:23:13.844687+0000","last_active":"2024-04-25T02:23:20.878786+0000","last_peered":"2024-04-25T02:23:20.878786+0000","last_clean":"2024-04-25T02:23:20.878786+0000","last_became_active":"2024-04-25T02:23:13.839702+0000","last_became_peered":"2024-04-25T02:23:13.839702+0000","last_unstale":"2024-04-25T02:23:20.878786+0000","last_undegraded":"2024-04-25T02:23:20.878786+0000","last_fullsized":"2024-04-25T02:23:20.878786+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:10:23.178715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"18'4","reported_seq":43,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.881407+0000","last_change":"2024-04-25T02:23:13.844668+0000","last_active":"2024-04-25T02:23:20.881407+0000","last_peered":"2024-04-25T02:23:20.881407+0000","last_clean":"2024-04-25T02:23:20.881407+0000","last_became_active":"2024-04-25T02:23:13.843625+0000","last_became_peered":"2024-04-25T02:23:13.843625+0000","last_unstale":"2024-04-25T02:23:20.881407+0000","last_undegraded":"2024-04-25T02:23:20.881407+0000","last_fullsized":"2024-04-25T02:23:20.881407+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:19:41.521042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:21.178720+0000","last_change":"2024-04-25T02:23:13.851184+0000","last_active":"2024-04-25T02:23:21.178720+0000","last_peered":"2024-04-25T02:23:21.178720+0000","last_clean":"2024-04-25T02:23:21.178720+0000","last_became_active":"2024-04-25T02:23:13.850845+0000","last_became_peered":"2024-04-25T02:23:13.850845+0000","last_unstale":"2024-04-25T02:23:21.178720+0000","last_undegraded":"2024-04-25T02:23:21.178720+0000","last_fullsized":"2024-04-25T02:23:21.178720+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:07:20.048534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"36'19","reported_seq":60,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.878154+0000","last_change":"2024-04-25T02:23:13.849389+0000","last_active":"2024-04-25T02:23:20.878154+0000","last_peered":"2024-04-25T02:23:20.878154+0000","last_clean":"2024-04-25T02:23:20.878154+0000","last_became_active":"2024-04-25T02:23:13.845176+0000","last_became_peered":"2024-04-25T02:23:13.845176+0000","last_unstale":"2024-04-25T02:23:20.878154+0000","last_undegraded":"2024-04-25T02:23:20.878154+0000","last_fullsized":"2024-04-25T02:23:20.878154+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:50:14.041957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5015,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":10,"num_write":19,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.880258+0000","last_change":"2024-04-25T02:23:13.847990+0000","last_active":"2024-04-25T02:23:20.880258+0000","last_peered":"2024-04-25T02:23:20.880258+0000","last_clean":"2024-04-25T02:23:20.880258+0000","last_became_active":"2024-04-25T02:23:13.847343+0000","last_became_peered":"2024-04-25T02:23:13.847343+0000","last_unstale":"2024-04-25T02:23:20.880258+0000","last_undegraded":"2024-04-25T02:23:20.880258+0000","last_fullsized":"2024-04-25T02:23:20.880258+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:27:22.027187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'4","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.878861+0000","last_change":"2024-04-25T02:23:13.839481+0000","last_active":"2024-04-25T02:23:20.878861+0000","last_peered":"2024-04-25T02:23:20.878861+0000","last_clean":"2024-04-25T02:23:20.878861+0000","last_became_active":"2024-04-25T02:23:13.839158+0000","last_became_peered":"2024-04-25T02:23:13.839158+0000","last_unstale":"2024-04-25T02:23:20.878861+0000","last_undegraded":"2024-04-25T02:23:20.878861+0000","last_fullsized":"2024-04-25T02:23:20.878861+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:07:04.590892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":7,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.881441+0000","last_change":"2024-04-25T02:23:13.843740+0000","last_active":"2024-04-25T02:23:20.881441+0000","last_peered":"2024-04-25T02:23:20.881441+0000","last_clean":"2024-04-25T02:23:20.881441+0000","last_became_active":"2024-04-25T02:23:13.843441+0000","last_became_peered":"2024-04-25T02:23:13.843441+0000","last_unstale":"2024-04-25T02:23:20.881441+0000","last_undegraded":"2024-04-25T02:23:20.881441+0000","last_fullsized":"2024-04-25T02:23:20.881441+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:53:20.763788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"18'3","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.880029+0000","last_change":"2024-04-25T02:23:13.844290+0000","last_active":"2024-04-25T02:23:20.880029+0000","last_peered":"2024-04-25T02:23:20.880029+0000","last_clean":"2024-04-25T02:23:20.880029+0000","last_became_active":"2024-04-25T02:23:13.841976+0000","last_became_peered":"2024-04-25T02:23:13.841976+0000","last_unstale":"2024-04-25T02:23:20.880029+0000","last_undegraded":"2024-04-25T02:23:20.880029+0000","last_fullsized":"2024-04-25T02:23:20.880029+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:16:25.998330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.881373+0000","last_change":"2024-04-25T02:23:13.843455+0000","last_active":"2024-04-25T02:23:20.881373+0000","last_peered":"2024-04-25T02:23:20.881373+0000","last_clean":"2024-04-25T02:23:20.881373+0000","last_became_active":"2024-04-25T02:23:13.842163+0000","last_became_peered":"2024-04-25T02:23:13.842163+0000","last_unstale":"2024-04-25T02:23:20.881373+0000","last_undegraded":"2024-04-25T02:23:20.881373+0000","last_fullsized":"2024-04-25T02:23:20.881373+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:59:59.924648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.877933+0000","last_change":"2024-04-25T02:23:13.839221+0000","last_active":"2024-04-25T02:23:20.877933+0000","last_peered":"2024-04-25T02:23:20.877933+0000","last_clean":"2024-04-25T02:23:20.877933+0000","last_became_active":"2024-04-25T02:23:13.838616+0000","last_became_peered":"2024-04-25T02:23:13.838616+0000","last_unstale":"2024-04-25T02:23:20.877933+0000","last_undegraded":"2024-04-25T02:23:20.877933+0000","last_fullsized":"2024-04-25T02:23:20.877933+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:24:48.817920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.882322+0000","last_change":"2024-04-25T02:23:13.842908+0000","last_active":"2024-04-25T02:23:20.882322+0000","last_peered":"2024-04-25T02:23:20.882322+0000","last_clean":"2024-04-25T02:23:20.882322+0000","last_became_active":"2024-04-25T02:23:13.842649+0000","last_became_peered":"2024-04-25T02:23:13.842649+0000","last_unstale":"2024-04-25T02:23:20.882322+0000","last_undegraded":"2024-04-25T02:23:20.882322+0000","last_fullsized":"2024-04-25T02:23:20.882322+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:04:07.758366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'10","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:21.178643+0000","last_change":"2024-04-25T02:23:11.835951+0000","last_active":"2024-04-25T02:23:21.178643+0000","last_peered":"2024-04-25T02:23:21.178643+0000","last_clean":"2024-04-25T02:23:21.178643+0000","last_became_active":"2024-04-25T02:23:11.835077+0000","last_became_peered":"2024-04-25T02:23:11.835077+0000","last_unstale":"2024-04-25T02:23:21.178643+0000","last_undegraded":"2024-04-25T02:23:21.178643+0000","last_fullsized":"2024-04-25T02:23:21.178643+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:24:42.651723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.879107+0000","last_change":"2024-04-25T02:23:13.843899+0000","last_active":"2024-04-25T02:23:20.879107+0000","last_peered":"2024-04-25T02:23:20.879107+0000","last_clean":"2024-04-25T02:23:20.879107+0000","last_became_active":"2024-04-25T02:23:13.843347+0000","last_became_peered":"2024-04-25T02:23:13.843347+0000","last_unstale":"2024-04-25T02:23:20.879107+0000","last_undegraded":"2024-04-25T02:23:20.879107+0000","last_fullsized":"2024-04-25T02:23:20.879107+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:46:23.518991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.881772+0000","last_change":"2024-04-25T02:23:11.839659+0000","last_active":"2024-04-25T02:23:20.881772+0000","last_peered":"2024-04-25T02:23:20.881772+0000","last_clean":"2024-04-25T02:23:20.881772+0000","last_became_active":"2024-04-25T02:23:11.839157+0000","last_became_peered":"2024-04-25T02:23:11.839157+0000","last_unstale":"2024-04-25T02:23:20.881772+0000","last_undegraded":"2024-04-25T02:23:20.881772+0000","last_fullsized":"2024-04-25T02:23:20.881772+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:06:42.930490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.877870+0000","last_change":"2024-04-25T02:23:13.841226+0000","last_active":"2024-04-25T02:23:20.877870+0000","last_peered":"2024-04-25T02:23:20.877870+0000","last_clean":"2024-04-25T02:23:20.877870+0000","last_became_active":"2024-04-25T02:23:13.840951+0000","last_became_peered":"2024-04-25T02:23:13.840951+0000","last_unstale":"2024-04-25T02:23:20.877870+0000","last_undegraded":"2024-04-25T02:23:20.877870+0000","last_fullsized":"2024-04-25T02:23:20.877870+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:16:58.212703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":43,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.880685+0000","last_change":"2024-04-25T02:23:12.848098+0000","last_active":"2024-04-25T02:23:20.880685+0000","last_peered":"2024-04-25T02:23:20.880685+0000","last_clean":"2024-04-25T02:23:20.880685+0000","last_became_active":"2024-04-25T02:23:12.847813+0000","last_became_peered":"2024-04-25T02:23:12.847813+0000","last_unstale":"2024-04-25T02:23:20.880685+0000","last_undegraded":"2024-04-25T02:23:20.880685+0000","last_fullsized":"2024-04-25T02:23:20.880685+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:31:10.538399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:21.178568+0000","last_change":"2024-04-25T02:23:13.847124+0000","last_active":"2024-04-25T02:23:21.178568+0000","last_peered":"2024-04-25T02:23:21.178568+0000","last_clean":"2024-04-25T02:23:21.178568+0000","last_became_active":"2024-04-25T02:23:13.846492+0000","last_became_peered":"2024-04-25T02:23:13.846492+0000","last_unstale":"2024-04-25T02:23:21.178568+0000","last_undegraded":"2024-04-25T02:23:21.178568+0000","last_fullsized":"2024-04-25T02:23:21.178568+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:21:05.467823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":41,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.878845+0000","last_change":"2024-04-25T02:23:13.848143+0000","last_active":"2024-04-25T02:23:20.878845+0000","last_peered":"2024-04-25T02:23:20.878845+0000","last_clean":"2024-04-25T02:23:20.878845+0000","last_became_active":"2024-04-25T02:23:13.843704+0000","last_became_peered":"2024-04-25T02:23:13.843704+0000","last_unstale":"2024-04-25T02:23:20.878845+0000","last_undegraded":"2024-04-25T02:23:20.878845+0000","last_fullsized":"2024-04-25T02:23:20.878845+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:54:31.975503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.881003+0000","last_change":"2024-04-25T02:23:13.847842+0000","last_active":"2024-04-25T02:23:20.881003+0000","last_peered":"2024-04-25T02:23:20.881003+0000","last_clean":"2024-04-25T02:23:20.881003+0000","last_became_active":"2024-04-25T02:23:13.845782+0000","last_became_peered":"2024-04-25T02:23:13.845782+0000","last_unstale":"2024-04-25T02:23:20.881003+0000","last_undegraded":"2024-04-25T02:23:20.881003+0000","last_fullsized":"2024-04-25T02:23:20.881003+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:56:46.820624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.880962+0000","last_change":"2024-04-25T02:23:13.842426+0000","last_active":"2024-04-25T02:23:20.880962+0000","last_peered":"2024-04-25T02:23:20.880962+0000","last_clean":"2024-04-25T02:23:20.880962+0000","last_became_active":"2024-04-25T02:23:13.841815+0000","last_became_peered":"2024-04-25T02:23:13.841815+0000","last_unstale":"2024-04-25T02:23:20.880962+0000","last_undegraded":"2024-04-25T02:23:20.880962+0000","last_fullsized":"2024-04-25T02:23:20.880962+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:20:54.760986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.880469+0000","last_change":"2024-04-25T02:23:11.839840+0000","last_active":"2024-04-25T02:23:20.880469+0000","last_peered":"2024-04-25T02:23:20.880469+0000","last_clean":"2024-04-25T02:23:20.880469+0000","last_became_active":"2024-04-25T02:23:11.837258+0000","last_became_peered":"2024-04-25T02:23:11.837258+0000","last_unstale":"2024-04-25T02:23:20.880469+0000","last_undegraded":"2024-04-25T02:23:20.880469+0000","last_fullsized":"2024-04-25T02:23:20.880469+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:49:17.616748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"35'5","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.878421+0000","last_change":"2024-04-25T02:23:13.838948+0000","last_active":"2024-04-25T02:23:20.878421+0000","last_peered":"2024-04-25T02:23:20.878421+0000","last_clean":"2024-04-25T02:23:20.878421+0000","last_became_active":"2024-04-25T02:23:13.838665+0000","last_became_peered":"2024-04-25T02:23:13.838665+0000","last_unstale":"2024-04-25T02:23:20.878421+0000","last_undegraded":"2024-04-25T02:23:20.878421+0000","last_fullsized":"2024-04-25T02:23:20.878421+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:29:28.670027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.881038+0000","last_change":"2024-04-25T02:23:13.844700+0000","last_active":"2024-04-25T02:23:20.881038+0000","last_peered":"2024-04-25T02:23:20.881038+0000","last_clean":"2024-04-25T02:23:20.881038+0000","last_became_active":"2024-04-25T02:23:13.844337+0000","last_became_peered":"2024-04-25T02:23:13.844337+0000","last_unstale":"2024-04-25T02:23:20.881038+0000","last_undegraded":"2024-04-25T02:23:20.881038+0000","last_fullsized":"2024-04-25T02:23:20.881038+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:22.169266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"19'4","reported_seq":43,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.878106+0000","last_change":"2024-04-25T02:23:13.843937+0000","last_active":"2024-04-25T02:23:20.878106+0000","last_peered":"2024-04-25T02:23:20.878106+0000","last_clean":"2024-04-25T02:23:20.878106+0000","last_became_active":"2024-04-25T02:23:13.843652+0000","last_became_peered":"2024-04-25T02:23:13.843652+0000","last_unstale":"2024-04-25T02:23:20.878106+0000","last_undegraded":"2024-04-25T02:23:20.878106+0000","last_fullsized":"2024-04-25T02:23:20.878106+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:13:15.374851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.882802+0000","last_change":"2024-04-25T02:23:13.848659+0000","last_active":"2024-04-25T02:23:20.882802+0000","last_peered":"2024-04-25T02:23:20.882802+0000","last_clean":"2024-04-25T02:23:20.882802+0000","last_became_active":"2024-04-25T02:23:13.847863+0000","last_became_peered":"2024-04-25T02:23:13.847863+0000","last_unstale":"2024-04-25T02:23:20.882802+0000","last_undegraded":"2024-04-25T02:23:20.882802+0000","last_fullsized":"2024-04-25T02:23:20.882802+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:21:50.452616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"18'3","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.879187+0000","last_change":"2024-04-25T02:23:13.842533+0000","last_active":"2024-04-25T02:23:20.879187+0000","last_peered":"2024-04-25T02:23:20.879187+0000","last_clean":"2024-04-25T02:23:20.879187+0000","last_became_active":"2024-04-25T02:23:13.841049+0000","last_became_peered":"2024-04-25T02:23:13.841049+0000","last_unstale":"2024-04-25T02:23:20.879187+0000","last_undegraded":"2024-04-25T02:23:20.879187+0000","last_fullsized":"2024-04-25T02:23:20.879187+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:26:00.892546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.880825+0000","last_change":"2024-04-25T02:23:13.847171+0000","last_active":"2024-04-25T02:23:20.880825+0000","last_peered":"2024-04-25T02:23:20.880825+0000","last_clean":"2024-04-25T02:23:20.880825+0000","last_became_active":"2024-04-25T02:23:13.846425+0000","last_became_peered":"2024-04-25T02:23:13.846425+0000","last_unstale":"2024-04-25T02:23:20.880825+0000","last_undegraded":"2024-04-25T02:23:20.880825+0000","last_fullsized":"2024-04-25T02:23:20.880825+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:40:12.956129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"18'2","reported_seq":41,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.877686+0000","last_change":"2024-04-25T02:23:13.841178+0000","last_active":"2024-04-25T02:23:20.877686+0000","last_peered":"2024-04-25T02:23:20.877686+0000","last_clean":"2024-04-25T02:23:20.877686+0000","last_became_active":"2024-04-25T02:23:13.840876+0000","last_became_peered":"2024-04-25T02:23:13.840876+0000","last_unstale":"2024-04-25T02:23:20.877686+0000","last_undegraded":"2024-04-25T02:23:20.877686+0000","last_fullsized":"2024-04-25T02:23:20.877686+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:29:47.026682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:21.179291+0000","last_change":"2024-04-25T02:23:13.852754+0000","last_active":"2024-04-25T02:23:21.179291+0000","last_peered":"2024-04-25T02:23:21.179291+0000","last_clean":"2024-04-25T02:23:21.179291+0000","last_became_active":"2024-04-25T02:23:13.852398+0000","last_became_peered":"2024-04-25T02:23:13.852398+0000","last_unstale":"2024-04-25T02:23:21.179291+0000","last_undegraded":"2024-04-25T02:23:21.179291+0000","last_fullsized":"2024-04-25T02:23:21.179291+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:48:40.857184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:21.178793+0000","last_change":"2024-04-25T02:23:11.834419+0000","last_active":"2024-04-25T02:23:21.178793+0000","last_peered":"2024-04-25T02:23:21.178793+0000","last_clean":"2024-04-25T02:23:21.178793+0000","last_became_active":"2024-04-25T02:23:11.834171+0000","last_became_peered":"2024-04-25T02:23:11.834171+0000","last_unstale":"2024-04-25T02:23:21.178793+0000","last_undegraded":"2024-04-25T02:23:21.178793+0000","last_fullsized":"2024-04-25T02:23:21.178793+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:13:40.419554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"18'1","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.880544+0000","last_change":"2024-04-25T02:23:13.848449+0000","last_active":"2024-04-25T02:23:20.880544+0000","last_peered":"2024-04-25T02:23:20.880544+0000","last_clean":"2024-04-25T02:23:20.880544+0000","last_became_active":"2024-04-25T02:23:13.847970+0000","last_became_peered":"2024-04-25T02:23:13.847970+0000","last_unstale":"2024-04-25T02:23:20.880544+0000","last_undegraded":"2024-04-25T02:23:20.880544+0000","last_fullsized":"2024-04-25T02:23:20.880544+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:00:21.733260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:21.178617+0000","last_change":"2024-04-25T02:23:13.850097+0000","last_active":"2024-04-25T02:23:21.178617+0000","last_peered":"2024-04-25T02:23:21.178617+0000","last_clean":"2024-04-25T02:23:21.178617+0000","last_became_active":"2024-04-25T02:23:13.849556+0000","last_became_peered":"2024-04-25T02:23:13.849556+0000","last_unstale":"2024-04-25T02:23:21.178617+0000","last_undegraded":"2024-04-25T02:23:21.178617+0000","last_fullsized":"2024-04-25T02:23:21.178617+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:25:42.876612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.878242+0000","last_change":"2024-04-25T02:23:13.848430+0000","last_active":"2024-04-25T02:23:20.878242+0000","last_peered":"2024-04-25T02:23:20.878242+0000","last_clean":"2024-04-25T02:23:20.878242+0000","last_became_active":"2024-04-25T02:23:13.847888+0000","last_became_peered":"2024-04-25T02:23:13.847888+0000","last_unstale":"2024-04-25T02:23:20.878242+0000","last_undegraded":"2024-04-25T02:23:20.878242+0000","last_fullsized":"2024-04-25T02:23:20.878242+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:57:11.831417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"19'3","reported_seq":41,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.880392+0000","last_change":"2024-04-25T02:23:12.848598+0000","last_active":"2024-04-25T02:23:20.880392+0000","last_peered":"2024-04-25T02:23:20.880392+0000","last_clean":"2024-04-25T02:23:20.880392+0000","last_became_active":"2024-04-25T02:23:12.848312+0000","last_became_peered":"2024-04-25T02:23:12.848312+0000","last_unstale":"2024-04-25T02:23:20.880392+0000","last_undegraded":"2024-04-25T02:23:20.880392+0000","last_fullsized":"2024-04-25T02:23:20.880392+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:58:41.830406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:21.178756+0000","last_change":"2024-04-25T02:23:12.842182+0000","last_active":"2024-04-25T02:23:21.178756+0000","last_peered":"2024-04-25T02:23:21.178756+0000","last_clean":"2024-04-25T02:23:21.178756+0000","last_became_active":"2024-04-25T02:23:12.841408+0000","last_became_peered":"2024-04-25T02:23:12.841408+0000","last_unstale":"2024-04-25T02:23:21.178756+0000","last_undegraded":"2024-04-25T02:23:21.178756+0000","last_fullsized":"2024-04-25T02:23:21.178756+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:06:31.558059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.879963+0000","last_change":"2024-04-25T02:23:13.848743+0000","last_active":"2024-04-25T02:23:20.879963+0000","last_peered":"2024-04-25T02:23:20.879963+0000","last_clean":"2024-04-25T02:23:20.879963+0000","last_became_active":"2024-04-25T02:23:13.848076+0000","last_became_peered":"2024-04-25T02:23:13.848076+0000","last_unstale":"2024-04-25T02:23:20.879963+0000","last_undegraded":"2024-04-25T02:23:20.879963+0000","last_fullsized":"2024-04-25T02:23:20.879963+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:08:43.341421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"18'1","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:21.178680+0000","last_change":"2024-04-25T02:23:12.848506+0000","last_active":"2024-04-25T02:23:21.178680+0000","last_peered":"2024-04-25T02:23:21.178680+0000","last_clean":"2024-04-25T02:23:21.178680+0000","last_became_active":"2024-04-25T02:23:12.848229+0000","last_became_peered":"2024-04-25T02:23:12.848229+0000","last_unstale":"2024-04-25T02:23:21.178680+0000","last_undegraded":"2024-04-25T02:23:21.178680+0000","last_fullsized":"2024-04-25T02:23:21.178680+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:24:34.129737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:21.179201+0000","last_change":"2024-04-25T02:23:11.835239+0000","last_active":"2024-04-25T02:23:21.179201+0000","last_peered":"2024-04-25T02:23:21.179201+0000","last_clean":"2024-04-25T02:23:21.179201+0000","last_became_active":"2024-04-25T02:23:11.834994+0000","last_became_peered":"2024-04-25T02:23:11.834994+0000","last_unstale":"2024-04-25T02:23:21.179201+0000","last_undegraded":"2024-04-25T02:23:21.179201+0000","last_fullsized":"2024-04-25T02:23:21.179201+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:51.196318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.878300+0000","last_change":"2024-04-25T02:23:13.849321+0000","last_active":"2024-04-25T02:23:20.878300+0000","last_peered":"2024-04-25T02:23:20.878300+0000","last_clean":"2024-04-25T02:23:20.878300+0000","last_became_active":"2024-04-25T02:23:13.848628+0000","last_became_peered":"2024-04-25T02:23:13.848628+0000","last_unstale":"2024-04-25T02:23:20.878300+0000","last_undegraded":"2024-04-25T02:23:20.878300+0000","last_fullsized":"2024-04-25T02:23:20.878300+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:46:12.919462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"22'115","reported_seq":189,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:21.178395+0000","last_change":"2024-04-25T02:23:11.836134+0000","last_active":"2024-04-25T02:23:21.178395+0000","last_peered":"2024-04-25T02:23:21.178395+0000","last_clean":"2024-04-25T02:23:21.178395+0000","last_became_active":"2024-04-25T02:23:11.835430+0000","last_became_peered":"2024-04-25T02:23:11.835430+0000","last_unstale":"2024-04-25T02:23:21.178395+0000","last_undegraded":"2024-04-25T02:23:21.178395+0000","last_fullsized":"2024-04-25T02:23:21.178395+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:08.432182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:08.432182+0000","last_clean_scrub_stamp":"2024-04-25T02:20:08.432182+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:45:18.572525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.878850+0000","last_change":"2024-04-25T02:23:13.848149+0000","last_active":"2024-04-25T02:23:20.878850+0000","last_peered":"2024-04-25T02:23:20.878850+0000","last_clean":"2024-04-25T02:23:20.878850+0000","last_became_active":"2024-04-25T02:23:13.845029+0000","last_became_peered":"2024-04-25T02:23:13.845029+0000","last_unstale":"2024-04-25T02:23:20.878850+0000","last_undegraded":"2024-04-25T02:23:20.878850+0000","last_fullsized":"2024-04-25T02:23:20.878850+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:17.775866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.879110+0000","last_change":"2024-04-25T02:23:13.848481+0000","last_active":"2024-04-25T02:23:20.879110+0000","last_peered":"2024-04-25T02:23:20.879110+0000","last_clean":"2024-04-25T02:23:20.879110+0000","last_became_active":"2024-04-25T02:23:13.844018+0000","last_became_peered":"2024-04-25T02:23:13.844018+0000","last_unstale":"2024-04-25T02:23:20.879110+0000","last_undegraded":"2024-04-25T02:23:20.879110+0000","last_fullsized":"2024-04-25T02:23:20.879110+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:28:48.151869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.877666+0000","last_change":"2024-04-25T02:23:13.848526+0000","last_active":"2024-04-25T02:23:20.877666+0000","last_peered":"2024-04-25T02:23:20.877666+0000","last_clean":"2024-04-25T02:23:20.877666+0000","last_became_active":"2024-04-25T02:23:13.844753+0000","last_became_peered":"2024-04-25T02:23:13.844753+0000","last_unstale":"2024-04-25T02:23:20.877666+0000","last_undegraded":"2024-04-25T02:23:20.877666+0000","last_fullsized":"2024-04-25T02:23:20.877666+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:01:01.038928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"18'1","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.879553+0000","last_change":"2024-04-25T02:23:12.845945+0000","last_active":"2024-04-25T02:23:20.879553+0000","last_peered":"2024-04-25T02:23:20.879553+0000","last_clean":"2024-04-25T02:23:20.879553+0000","last_became_active":"2024-04-25T02:23:12.845638+0000","last_became_peered":"2024-04-25T02:23:12.845638+0000","last_unstale":"2024-04-25T02:23:20.879553+0000","last_undegraded":"2024-04-25T02:23:20.879553+0000","last_fullsized":"2024-04-25T02:23:20.879553+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:47:37.213557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.882182+0000","last_change":"2024-04-25T02:23:11.840630+0000","last_active":"2024-04-25T02:23:20.882182+0000","last_peered":"2024-04-25T02:23:20.882182+0000","last_clean":"2024-04-25T02:23:20.882182+0000","last_became_active":"2024-04-25T02:23:11.840215+0000","last_became_peered":"2024-04-25T02:23:11.840215+0000","last_unstale":"2024-04-25T02:23:20.882182+0000","last_undegraded":"2024-04-25T02:23:20.882182+0000","last_fullsized":"2024-04-25T02:23:20.882182+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:18:40.221229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.879266+0000","last_change":"2024-04-25T02:23:13.845169+0000","last_active":"2024-04-25T02:23:20.879266+0000","last_peered":"2024-04-25T02:23:20.879266+0000","last_clean":"2024-04-25T02:23:20.879266+0000","last_became_active":"2024-04-25T02:23:13.841324+0000","last_became_peered":"2024-04-25T02:23:13.841324+0000","last_unstale":"2024-04-25T02:23:20.879266+0000","last_undegraded":"2024-04-25T02:23:20.879266+0000","last_fullsized":"2024-04-25T02:23:20.879266+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:23.490432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:21.178912+0000","last_change":"2024-04-25T02:23:12.842493+0000","last_active":"2024-04-25T02:23:21.178912+0000","last_peered":"2024-04-25T02:23:21.178912+0000","last_clean":"2024-04-25T02:23:21.178912+0000","last_became_active":"2024-04-25T02:23:12.841930+0000","last_became_peered":"2024-04-25T02:23:12.841930+0000","last_unstale":"2024-04-25T02:23:21.178912+0000","last_undegraded":"2024-04-25T02:23:21.178912+0000","last_fullsized":"2024-04-25T02:23:21.178912+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:36:52.589994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.880541+0000","last_change":"2024-04-25T02:23:12.848221+0000","last_active":"2024-04-25T02:23:20.880541+0000","last_peered":"2024-04-25T02:23:20.880541+0000","last_clean":"2024-04-25T02:23:20.880541+0000","last_became_active":"2024-04-25T02:23:12.847949+0000","last_became_peered":"2024-04-25T02:23:12.847949+0000","last_unstale":"2024-04-25T02:23:20.880541+0000","last_undegraded":"2024-04-25T02:23:20.880541+0000","last_fullsized":"2024-04-25T02:23:20.880541+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:17.728665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'4","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.881213+0000","last_change":"2024-04-25T02:23:13.844968+0000","last_active":"2024-04-25T02:23:20.881213+0000","last_peered":"2024-04-25T02:23:20.881213+0000","last_clean":"2024-04-25T02:23:20.881213+0000","last_became_active":"2024-04-25T02:23:13.844133+0000","last_became_peered":"2024-04-25T02:23:13.844133+0000","last_unstale":"2024-04-25T02:23:20.881213+0000","last_undegraded":"2024-04-25T02:23:20.881213+0000","last_fullsized":"2024-04-25T02:23:20.881213+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:02.533959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:21.179276+0000","last_change":"2024-04-25T02:23:11.837086+0000","last_active":"2024-04-25T02:23:21.179276+0000","last_peered":"2024-04-25T02:23:21.179276+0000","last_clean":"2024-04-25T02:23:21.179276+0000","last_became_active":"2024-04-25T02:23:11.836737+0000","last_became_peered":"2024-04-25T02:23:11.836737+0000","last_unstale":"2024-04-25T02:23:21.179276+0000","last_undegraded":"2024-04-25T02:23:21.179276+0000","last_fullsized":"2024-04-25T02:23:21.179276+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:10:23.058045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.878002+0000","last_change":"2024-04-25T02:23:13.848280+0000","last_active":"2024-04-25T02:23:20.878002+0000","last_peered":"2024-04-25T02:23:20.878002+0000","last_clean":"2024-04-25T02:23:20.878002+0000","last_became_active":"2024-04-25T02:23:13.843915+0000","last_became_peered":"2024-04-25T02:23:13.843915+0000","last_unstale":"2024-04-25T02:23:20.878002+0000","last_undegraded":"2024-04-25T02:23:20.878002+0000","last_fullsized":"2024-04-25T02:23:20.878002+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:25:56.800969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.879065+0000","last_change":"2024-04-25T02:23:13.839018+0000","last_active":"2024-04-25T02:23:20.879065+0000","last_peered":"2024-04-25T02:23:20.879065+0000","last_clean":"2024-04-25T02:23:20.879065+0000","last_became_active":"2024-04-25T02:23:13.838746+0000","last_became_peered":"2024-04-25T02:23:13.838746+0000","last_unstale":"2024-04-25T02:23:20.879065+0000","last_undegraded":"2024-04-25T02:23:20.879065+0000","last_fullsized":"2024-04-25T02:23:20.879065+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:33:00.283023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"39'4","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:21.177377+0000","last_change":"2024-04-25T02:23:11.840837+0000","last_active":"2024-04-25T02:23:21.177377+0000","last_peered":"2024-04-25T02:23:21.177377+0000","last_clean":"2024-04-25T02:23:21.177377+0000","last_became_active":"2024-04-25T02:23:11.840553+0000","last_became_peered":"2024-04-25T02:23:11.840553+0000","last_unstale":"2024-04-25T02:23:21.177377+0000","last_undegraded":"2024-04-25T02:23:21.177377+0000","last_fullsized":"2024-04-25T02:23:21.177377+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:56:05.056497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.879910+0000","last_change":"2024-04-25T02:23:13.848907+0000","last_active":"2024-04-25T02:23:20.879910+0000","last_peered":"2024-04-25T02:23:20.879910+0000","last_clean":"2024-04-25T02:23:20.879910+0000","last_became_active":"2024-04-25T02:23:13.848374+0000","last_became_peered":"2024-04-25T02:23:13.848374+0000","last_unstale":"2024-04-25T02:23:20.879910+0000","last_undegraded":"2024-04-25T02:23:20.879910+0000","last_fullsized":"2024-04-25T02:23:20.879910+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:31:18.538296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"35'11","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.880643+0000","last_change":"2024-04-25T02:23:13.842766+0000","last_active":"2024-04-25T02:23:20.880643+0000","last_peered":"2024-04-25T02:23:20.880643+0000","last_clean":"2024-04-25T02:23:20.880643+0000","last_became_active":"2024-04-25T02:23:13.842438+0000","last_became_peered":"2024-04-25T02:23:13.842438+0000","last_unstale":"2024-04-25T02:23:20.880643+0000","last_undegraded":"2024-04-25T02:23:20.880643+0000","last_fullsized":"2024-04-25T02:23:20.880643+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:25:58.471982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2244,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.880039+0000","last_change":"2024-04-25T02:23:12.844587+0000","last_active":"2024-04-25T02:23:20.880039+0000","last_peered":"2024-04-25T02:23:20.880039+0000","last_clean":"2024-04-25T02:23:20.880039+0000","last_became_active":"2024-04-25T02:23:12.844258+0000","last_became_peered":"2024-04-25T02:23:12.844258+0000","last_unstale":"2024-04-25T02:23:20.880039+0000","last_undegraded":"2024-04-25T02:23:20.880039+0000","last_fullsized":"2024-04-25T02:23:20.880039+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:32:01.305698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:21.178639+0000","last_change":"2024-04-25T02:23:11.833629+0000","last_active":"2024-04-25T02:23:21.178639+0000","last_peered":"2024-04-25T02:23:21.178639+0000","last_clean":"2024-04-25T02:23:21.178639+0000","last_became_active":"2024-04-25T02:23:11.833348+0000","last_became_peered":"2024-04-25T02:23:11.833348+0000","last_unstale":"2024-04-25T02:23:21.178639+0000","last_undegraded":"2024-04-25T02:23:21.178639+0000","last_fullsized":"2024-04-25T02:23:21.178639+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:10:06.587875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.880346+0000","last_change":"2024-04-25T02:23:13.847609+0000","last_active":"2024-04-25T02:23:20.880346+0000","last_peered":"2024-04-25T02:23:20.880346+0000","last_clean":"2024-04-25T02:23:20.880346+0000","last_became_active":"2024-04-25T02:23:13.846697+0000","last_became_peered":"2024-04-25T02:23:13.846697+0000","last_unstale":"2024-04-25T02:23:20.880346+0000","last_undegraded":"2024-04-25T02:23:20.880346+0000","last_fullsized":"2024-04-25T02:23:20.880346+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:43:05.950601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.878974+0000","last_change":"2024-04-25T02:23:13.842735+0000","last_active":"2024-04-25T02:23:20.878974+0000","last_peered":"2024-04-25T02:23:20.878974+0000","last_clean":"2024-04-25T02:23:20.878974+0000","last_became_active":"2024-04-25T02:23:13.840492+0000","last_became_peered":"2024-04-25T02:23:13.840492+0000","last_unstale":"2024-04-25T02:23:20.878974+0000","last_undegraded":"2024-04-25T02:23:20.878974+0000","last_fullsized":"2024-04-25T02:23:20.878974+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:25:52.486919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.880962+0000","last_change":"2024-04-25T02:23:13.848028+0000","last_active":"2024-04-25T02:23:20.880962+0000","last_peered":"2024-04-25T02:23:20.880962+0000","last_clean":"2024-04-25T02:23:20.880962+0000","last_became_active":"2024-04-25T02:23:13.847264+0000","last_became_peered":"2024-04-25T02:23:13.847264+0000","last_unstale":"2024-04-25T02:23:20.880962+0000","last_undegraded":"2024-04-25T02:23:20.880962+0000","last_fullsized":"2024-04-25T02:23:20.880962+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:16.329989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"35'2","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.879317+0000","last_change":"2024-04-25T02:23:13.848227+0000","last_active":"2024-04-25T02:23:20.879317+0000","last_peered":"2024-04-25T02:23:20.879317+0000","last_clean":"2024-04-25T02:23:20.879317+0000","last_became_active":"2024-04-25T02:23:13.845143+0000","last_became_peered":"2024-04-25T02:23:13.845143+0000","last_unstale":"2024-04-25T02:23:20.879317+0000","last_undegraded":"2024-04-25T02:23:20.879317+0000","last_fullsized":"2024-04-25T02:23:20.879317+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:54.494068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.878411+0000","last_change":"2024-04-25T02:23:13.841084+0000","last_active":"2024-04-25T02:23:20.878411+0000","last_peered":"2024-04-25T02:23:20.878411+0000","last_clean":"2024-04-25T02:23:20.878411+0000","last_became_active":"2024-04-25T02:23:13.839417+0000","last_became_peered":"2024-04-25T02:23:13.839417+0000","last_unstale":"2024-04-25T02:23:20.878411+0000","last_undegraded":"2024-04-25T02:23:20.878411+0000","last_fullsized":"2024-04-25T02:23:20.878411+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:42.358780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"35'5","reported_seq":37,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.881853+0000","last_change":"2024-04-25T02:23:11.839479+0000","last_active":"2024-04-25T02:23:20.881853+0000","last_peered":"2024-04-25T02:23:20.881853+0000","last_clean":"2024-04-25T02:23:20.881853+0000","last_became_active":"2024-04-25T02:23:11.838807+0000","last_became_peered":"2024-04-25T02:23:11.838807+0000","last_unstale":"2024-04-25T02:23:20.881853+0000","last_undegraded":"2024-04-25T02:23:20.881853+0000","last_fullsized":"2024-04-25T02:23:20.881853+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:08:41.334897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":553,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.879798+0000","last_change":"2024-04-25T02:23:12.845755+0000","last_active":"2024-04-25T02:23:20.879798+0000","last_peered":"2024-04-25T02:23:20.879798+0000","last_clean":"2024-04-25T02:23:20.879798+0000","last_became_active":"2024-04-25T02:23:12.845497+0000","last_became_peered":"2024-04-25T02:23:12.845497+0000","last_unstale":"2024-04-25T02:23:20.879798+0000","last_undegraded":"2024-04-25T02:23:20.879798+0000","last_fullsized":"2024-04-25T02:23:20.879798+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:04:37.689024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:21.178616+0000","last_change":"2024-04-25T02:23:12.847086+0000","last_active":"2024-04-25T02:23:21.178616+0000","last_peered":"2024-04-25T02:23:21.178616+0000","last_clean":"2024-04-25T02:23:21.178616+0000","last_became_active":"2024-04-25T02:23:12.846719+0000","last_became_peered":"2024-04-25T02:23:12.846719+0000","last_unstale":"2024-04-25T02:23:21.178616+0000","last_undegraded":"2024-04-25T02:23:21.178616+0000","last_fullsized":"2024-04-25T02:23:21.178616+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:19.196820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.878605+0000","last_change":"2024-04-25T02:23:13.843074+0000","last_active":"2024-04-25T02:23:20.878605+0000","last_peered":"2024-04-25T02:23:20.878605+0000","last_clean":"2024-04-25T02:23:20.878605+0000","last_became_active":"2024-04-25T02:23:13.842820+0000","last_became_peered":"2024-04-25T02:23:13.842820+0000","last_unstale":"2024-04-25T02:23:20.878605+0000","last_undegraded":"2024-04-25T02:23:20.878605+0000","last_fullsized":"2024-04-25T02:23:20.878605+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:41:56.972648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.880108+0000","last_change":"2024-04-25T02:23:13.844518+0000","last_active":"2024-04-25T02:23:20.880108+0000","last_peered":"2024-04-25T02:23:20.880108+0000","last_clean":"2024-04-25T02:23:20.880108+0000","last_became_active":"2024-04-25T02:23:13.844235+0000","last_became_peered":"2024-04-25T02:23:13.844235+0000","last_unstale":"2024-04-25T02:23:20.880108+0000","last_undegraded":"2024-04-25T02:23:20.880108+0000","last_fullsized":"2024-04-25T02:23:20.880108+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:01:33.237637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.878914+0000","last_change":"2024-04-25T02:23:13.849525+0000","last_active":"2024-04-25T02:23:20.878914+0000","last_peered":"2024-04-25T02:23:20.878914+0000","last_clean":"2024-04-25T02:23:20.878914+0000","last_became_active":"2024-04-25T02:23:13.845193+0000","last_became_peered":"2024-04-25T02:23:13.845193+0000","last_unstale":"2024-04-25T02:23:20.878914+0000","last_undegraded":"2024-04-25T02:23:20.878914+0000","last_fullsized":"2024-04-25T02:23:20.878914+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:17:33.318731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:21.178868+0000","last_change":"2024-04-25T02:23:12.842342+0000","last_active":"2024-04-25T02:23:21.178868+0000","last_peered":"2024-04-25T02:23:21.178868+0000","last_clean":"2024-04-25T02:23:21.178868+0000","last_became_active":"2024-04-25T02:23:12.841677+0000","last_became_peered":"2024-04-25T02:23:12.841677+0000","last_unstale":"2024-04-25T02:23:21.178868+0000","last_undegraded":"2024-04-25T02:23:21.178868+0000","last_fullsized":"2024-04-25T02:23:21.178868+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:27.480264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":8783,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":49,"num_read_kb":55,"num_write":116,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":17566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39115,"internal_metadata":0},"log_size":106,"ondisk_log_size":106,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":31,"seq":133143986180,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":372,"kb_used_omap":9,"kb_used_meta":297142,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":380928,"data_stored":156144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9975,"internal_metadata":304273673},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]}]},{"osd":2,"up_from":30,"seq":128849018884,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297460,"kb_used_data":352,"kb_used_omap":8,"kb_used_meta":297079,"kb_avail":94074380,"statfs":{"total":96636764160,"available":96332165120,"internally_reserved":0,"allocated":360448,"data_stored":157529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8387,"internal_metadata":304209725},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]}]},{"osd":0,"up_from":28,"seq":120259084293,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302272,"kb_used_data":940,"kb_used_omap":15,"kb_used_meta":301296,"kb_avail":94069568,"statfs":{"total":96636764160,"available":96327237632,"internally_reserved":0,"allocated":962560,"data_stored":746356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15790,"internal_metadata":308527698},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.218}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]}]},{"osd":1,"up_from":29,"seq":124554051588,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302248,"kb_used_data":920,"kb_used_omap":4,"kb_used_meta":301307,"kb_avail":94069592,"statfs":{"total":96636764160,"available":96327262208,"internally_reserved":0,"allocated":942080,"data_stored":743415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4963,"internal_metadata":308538525},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.222}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15790,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4963,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8387,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":8208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9975,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:23:27.071 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:23:27.196 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.193+0000 7fd68a60a700 1 Processor -- start 2024-04-25T02:23:27.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.193+0000 7fd68a60a700 1 -- start start 2024-04-25T02:23:27.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.193+0000 7fd68a60a700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fd6840b3140 0x7fd684069ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:27.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.193+0000 7fd68a60a700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd6840a3d40 0x7fd68406eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:27.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.193+0000 7fd68a60a700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd68406f090 0x7fd68406f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:27.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.193+0000 7fd68a60a700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd68406a020 con 0x7fd6840b3140 2024-04-25T02:23:27.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.193+0000 7fd68a60a700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6840b0470 con 0x7fd6840a3d40 2024-04-25T02:23:27.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.193+0000 7fd68a60a700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd68406a280 con 0x7fd68406f090 2024-04-25T02:23:27.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.193+0000 7fd683fff700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fd6840b3140 0x7fd684069ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:27.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.193+0000 7fd6837fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd6840a3d40 0x7fd68406eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:27.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.194+0000 7fd688ba7700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd68406f090 0x7fd68406f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:27.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.194+0000 7fd6837fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd6840a3d40 0x7fd68406eb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:35666/0 (socket says 172.21.15.111:35666) 2024-04-25T02:23:27.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.194+0000 7fd683fff700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fd6840b3140 0x7fd684069ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:60576/0 (socket says 172.21.15.111:60576) 2024-04-25T02:23:27.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.194+0000 7fd6837fe700 1 -- 172.21.15.111:0/4185958483 learned_addr learned my addr 172.21.15.111:0/4185958483 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:27.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.194+0000 7fd6837fe700 1 -- 172.21.15.111:0/4185958483 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd68406f090 msgr2=0x7fd68406f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:27.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.194+0000 7fd6837fe700 1 --2- 172.21.15.111:0/4185958483 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd68406f090 0x7fd68406f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:27.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.194+0000 7fd6837fe700 1 -- 172.21.15.111:0/4185958483 >> v2:172.21.15.111:3300/0 conn(0x7fd6840b3140 msgr2=0x7fd684069ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:27.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.194+0000 7fd6837fe700 1 --2- 172.21.15.111:0/4185958483 >> v2:172.21.15.111:3300/0 conn(0x7fd6840b3140 0x7fd684069ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:27.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.194+0000 7fd6837fe700 1 -- 172.21.15.111:0/4185958483 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd68406a520 con 0x7fd6840a3d40 2024-04-25T02:23:27.200 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.194+0000 7fd688ba7700 1 --2- 172.21.15.111:0/4185958483 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd68406f090 0x7fd68406f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:27.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.194+0000 7fd683fff700 1 --2- 172.21.15.111:0/4185958483 >> v2:172.21.15.111:3300/0 conn(0x7fd6840b3140 0x7fd684069ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:27.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.194+0000 7fd6837fe700 1 --2- 172.21.15.111:0/4185958483 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd6840a3d40 0x7fd68406eb50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd6780099b0 tx=0x7fd678009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f33a9256c7d49dc7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:27.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.194+0000 7fd682ffd700 1 -- 172.21.15.111:0/4185958483 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67800b680 con 0x7fd6840a3d40 2024-04-25T02:23:27.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.194+0000 7fd682ffd700 1 -- 172.21.15.111:0/4185958483 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd67800b7e0 con 0x7fd6840a3d40 2024-04-25T02:23:27.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.194+0000 7fd682ffd700 1 -- 172.21.15.111:0/4185958483 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67800bb80 con 0x7fd6840a3d40 2024-04-25T02:23:27.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.195+0000 7fd68a60a700 1 -- 172.21.15.111:0/4185958483 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd6840a3d40 msgr2=0x7fd68406eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:27.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.195+0000 7fd68a60a700 1 --2- 172.21.15.111:0/4185958483 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd6840a3d40 0x7fd68406eb50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd6780099b0 tx=0x7fd678009250 comp rx=0 tx=0).stop 2024-04-25T02:23:27.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.195+0000 7fd68a60a700 1 -- 172.21.15.111:0/4185958483 shutdown_connections 2024-04-25T02:23:27.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.195+0000 7fd68a60a700 1 --2- 172.21.15.111:0/4185958483 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd68406f090 0x7fd68406f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:27.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.195+0000 7fd68a60a700 1 --2- 172.21.15.111:0/4185958483 >> v2:172.21.15.111:3300/0 conn(0x7fd6840b3140 0x7fd684069ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:27.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.195+0000 7fd68a60a700 1 --2- 172.21.15.111:0/4185958483 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd6840a3d40 0x7fd68406eb50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:27.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.195+0000 7fd68a60a700 1 -- 172.21.15.111:0/4185958483 >> 172.21.15.111:0/4185958483 conn(0x7fd68406e080 msgr2=0x7fd68406bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:27.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.195+0000 7fd68a60a700 1 -- 172.21.15.111:0/4185958483 shutdown_connections 2024-04-25T02:23:27.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.195+0000 7fd68a60a700 1 -- 172.21.15.111:0/4185958483 wait complete. 2024-04-25T02:23:27.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.196+0000 7fd68a60a700 1 Processor -- start 2024-04-25T02:23:27.203 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.196+0000 7fd68a60a700 1 -- start start 2024-04-25T02:23:27.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.196+0000 7fd68a60a700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd68406f090 0x7fd6840ab640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:27.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.196+0000 7fd68a60a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd6840a3d40 0x7fd6840abb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:27.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.196+0000 7fd68a60a700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd6840b3140 0x7fd6840ac0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:27.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.196+0000 7fd68a60a700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6841448a0 con 0x7fd6840a3d40 2024-04-25T02:23:27.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.196+0000 7fd68a60a700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd684096e60 con 0x7fd6840b3140 2024-04-25T02:23:27.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.196+0000 7fd68a60a700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd6840ac870 con 0x7fd68406f090 2024-04-25T02:23:27.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.196+0000 7fd688ba7700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd6840b3140 0x7fd6840ac0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:27.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.196+0000 7fd683fff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd68406f090 0x7fd6840ab640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:27.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.196+0000 7fd6837fe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd6840a3d40 0x7fd6840abb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:27.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.196+0000 7fd688ba7700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd6840b3140 0x7fd6840ac0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:35674/0 (socket says 172.21.15.111:35674) 2024-04-25T02:23:27.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.196+0000 7fd688ba7700 1 -- 172.21.15.111:0/2523258193 learned_addr learned my addr 172.21.15.111:0/2523258193 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:27.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.197+0000 7fd683fff700 1 -- 172.21.15.111:0/2523258193 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd6840b3140 msgr2=0x7fd6840ac0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:27.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.197+0000 7fd683fff700 1 --2- 172.21.15.111:0/2523258193 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd6840b3140 0x7fd6840ac0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:27.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.197+0000 7fd683fff700 1 -- 172.21.15.111:0/2523258193 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd6840a3d40 msgr2=0x7fd6840abb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:27.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.197+0000 7fd683fff700 1 --2- 172.21.15.111:0/2523258193 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd6840a3d40 0x7fd6840abb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:27.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.197+0000 7fd683fff700 1 -- 172.21.15.111:0/2523258193 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd67c009a20 con 0x7fd68406f090 2024-04-25T02:23:27.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.197+0000 7fd683fff700 1 --2- 172.21.15.111:0/2523258193 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd68406f090 0x7fd6840ab640 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd67400ea00 tx=0x7fd6740091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:27.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.197+0000 7fd66bfff700 1 -- 172.21.15.111:0/2523258193 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67400c6a0 con 0x7fd68406f090 2024-04-25T02:23:27.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.197+0000 7fd66bfff700 1 -- 172.21.15.111:0/2523258193 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd67400c800 con 0x7fd68406f090 2024-04-25T02:23:27.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.197+0000 7fd66bfff700 1 -- 172.21.15.111:0/2523258193 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd67400cba0 con 0x7fd68406f090 2024-04-25T02:23:27.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.197+0000 7fd68a60a700 1 -- 172.21.15.111:0/2523258193 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd674009420 con 0x7fd68406f090 2024-04-25T02:23:27.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.197+0000 7fd68a60a700 1 -- 172.21.15.111:0/2523258193 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6780094f0 con 0x7fd68406f090 2024-04-25T02:23:27.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.198+0000 7fd68a60a700 1 -- 172.21.15.111:0/2523258193 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd684071790 con 0x7fd68406f090 2024-04-25T02:23:27.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.198+0000 7fd66bfff700 1 -- 172.21.15.111:0/2523258193 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7fd674013470 con 0x7fd68406f090 2024-04-25T02:23:27.205 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.198+0000 7fd66bfff700 1 -- 172.21.15.111:0/2523258193 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fd67405b370 con 0x7fd68406f090 2024-04-25T02:23:27.206 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.202+0000 7fd66bfff700 1 -- 172.21.15.111:0/2523258193 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fd674039530 con 0x7fd68406f090 2024-04-25T02:23:27.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.352+0000 7fd68a60a700 1 -- 172.21.15.111:0/2523258193 --> v1:172.21.15.111:6816/46482 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd6840aee90 con 0x7fd670046010 2024-04-25T02:23:27.363 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.359+0000 7fd66bfff700 1 -- 172.21.15.111:0/2523258193 <== mgr.14107 v1:172.21.15.111:6816/46482 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+271372 (unknown 2965378022 0 3677682802) 0x7fd678006d30 con 0x7fd670046010 2024-04-25T02:23:27.368 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:23:27.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.361+0000 7fd68a60a700 1 -- 172.21.15.111:0/2523258193 >> v1:172.21.15.111:6816/46482 conn(0x7fd670046010 legacy=0x7fd6700484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:27.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.361+0000 7fd68a60a700 1 -- 172.21.15.111:0/2523258193 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd68406f090 msgr2=0x7fd6840ab640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:27.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.361+0000 7fd68a60a700 1 --2- 172.21.15.111:0/2523258193 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd68406f090 0x7fd6840ab640 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd67400ea00 tx=0x7fd6740091a0 comp rx=0 tx=0).stop 2024-04-25T02:23:27.371 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.362+0000 7fd68a60a700 1 -- 172.21.15.111:0/2523258193 shutdown_connections 2024-04-25T02:23:27.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.362+0000 7fd68a60a700 1 --2- 172.21.15.111:0/2523258193 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd6840b3140 0x7fd6840ac0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:27.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.362+0000 7fd68a60a700 1 --2- 172.21.15.111:0/2523258193 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd68406f090 0x7fd6840ab640 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:27.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.362+0000 7fd68a60a700 1 --2- 172.21.15.111:0/2523258193 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd6840a3d40 0x7fd6840abb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:27.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.362+0000 7fd68a60a700 1 -- 172.21.15.111:0/2523258193 >> 172.21.15.111:0/2523258193 conn(0x7fd68406e080 msgr2=0x7fd684068090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:27.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.362+0000 7fd68a60a700 1 -- 172.21.15.111:0/2523258193 shutdown_connections 2024-04-25T02:23:27.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.362+0000 7fd68a60a700 1 -- 172.21.15.111:0/2523258193 wait complete. 2024-04-25T02:23:27.372 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2024-04-25T02:23:27.381 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":39,"stamp":"2024-04-25T02:23:26.733831+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":599151,"num_objects":43,"num_object_clones":0,"num_object_copies":86,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":0,"num_read":166,"num_read_kb":160,"num_write":273,"num_write_kb":2336,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":221,"ondisk_log_size":221,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1199516,"kb_used_data":2584,"kb_used_omap":38,"kb_used_meta":1196825,"kb_avail":376287844,"statfs":{"total":386547056640,"available":385318752256,"internally_reserved":0,"allocated":2646016,"data_stored":1803444,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39115,"internal_metadata":1225549621},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":272,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":50,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.856858"},"pg_stats":[{"pgid":"4.3f","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.880096+0000","last_change":"2024-04-25T02:23:13.846111+0000","last_active":"2024-04-25T02:23:20.880096+0000","last_peered":"2024-04-25T02:23:20.880096+0000","last_clean":"2024-04-25T02:23:20.880096+0000","last_became_active":"2024-04-25T02:23:13.845848+0000","last_became_peered":"2024-04-25T02:23:13.845848+0000","last_unstale":"2024-04-25T02:23:20.880096+0000","last_undegraded":"2024-04-25T02:23:20.880096+0000","last_fullsized":"2024-04-25T02:23:20.880096+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:48:53.653719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.880552+0000","last_change":"2024-04-25T02:23:12.845761+0000","last_active":"2024-04-25T02:23:20.880552+0000","last_peered":"2024-04-25T02:23:20.880552+0000","last_clean":"2024-04-25T02:23:20.880552+0000","last_became_active":"2024-04-25T02:23:12.845429+0000","last_became_peered":"2024-04-25T02:23:12.845429+0000","last_unstale":"2024-04-25T02:23:20.880552+0000","last_undegraded":"2024-04-25T02:23:20.880552+0000","last_fullsized":"2024-04-25T02:23:20.880552+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:39:23.193473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.881310+0000","last_change":"2024-04-25T02:23:11.838311+0000","last_active":"2024-04-25T02:23:20.881310+0000","last_peered":"2024-04-25T02:23:20.881310+0000","last_clean":"2024-04-25T02:23:20.881310+0000","last_became_active":"2024-04-25T02:23:11.838054+0000","last_became_peered":"2024-04-25T02:23:11.838054+0000","last_unstale":"2024-04-25T02:23:20.881310+0000","last_undegraded":"2024-04-25T02:23:20.881310+0000","last_fullsized":"2024-04-25T02:23:20.881310+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:55:20.837592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.881110+0000","last_change":"2024-04-25T02:23:11.837015+0000","last_active":"2024-04-25T02:23:20.881110+0000","last_peered":"2024-04-25T02:23:20.881110+0000","last_clean":"2024-04-25T02:23:20.881110+0000","last_became_active":"2024-04-25T02:23:11.836681+0000","last_became_peered":"2024-04-25T02:23:11.836681+0000","last_unstale":"2024-04-25T02:23:20.881110+0000","last_undegraded":"2024-04-25T02:23:20.881110+0000","last_fullsized":"2024-04-25T02:23:20.881110+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:57:52.130438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.880288+0000","last_change":"2024-04-25T02:23:13.843174+0000","last_active":"2024-04-25T02:23:20.880288+0000","last_peered":"2024-04-25T02:23:20.880288+0000","last_clean":"2024-04-25T02:23:20.880288+0000","last_became_active":"2024-04-25T02:23:13.842918+0000","last_became_peered":"2024-04-25T02:23:13.842918+0000","last_unstale":"2024-04-25T02:23:20.880288+0000","last_undegraded":"2024-04-25T02:23:20.880288+0000","last_fullsized":"2024-04-25T02:23:20.880288+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:18:04.676996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.878614+0000","last_change":"2024-04-25T02:23:13.848493+0000","last_active":"2024-04-25T02:23:20.878614+0000","last_peered":"2024-04-25T02:23:20.878614+0000","last_clean":"2024-04-25T02:23:20.878614+0000","last_became_active":"2024-04-25T02:23:13.848160+0000","last_became_peered":"2024-04-25T02:23:13.848160+0000","last_unstale":"2024-04-25T02:23:20.878614+0000","last_undegraded":"2024-04-25T02:23:20.878614+0000","last_fullsized":"2024-04-25T02:23:20.878614+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:40:38.221942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.878956+0000","last_change":"2024-04-25T02:23:13.842324+0000","last_active":"2024-04-25T02:23:20.878956+0000","last_peered":"2024-04-25T02:23:20.878956+0000","last_clean":"2024-04-25T02:23:20.878956+0000","last_became_active":"2024-04-25T02:23:13.840374+0000","last_became_peered":"2024-04-25T02:23:13.840374+0000","last_unstale":"2024-04-25T02:23:20.878956+0000","last_undegraded":"2024-04-25T02:23:20.878956+0000","last_fullsized":"2024-04-25T02:23:20.878956+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:04:41.899219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:21.178467+0000","last_change":"2024-04-25T02:23:11.835781+0000","last_active":"2024-04-25T02:23:21.178467+0000","last_peered":"2024-04-25T02:23:21.178467+0000","last_clean":"2024-04-25T02:23:21.178467+0000","last_became_active":"2024-04-25T02:23:11.834759+0000","last_became_peered":"2024-04-25T02:23:11.834759+0000","last_unstale":"2024-04-25T02:23:21.178467+0000","last_undegraded":"2024-04-25T02:23:21.178467+0000","last_fullsized":"2024-04-25T02:23:21.178467+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:17:37.320529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.881899+0000","last_change":"2024-04-25T02:23:13.842786+0000","last_active":"2024-04-25T02:23:20.881899+0000","last_peered":"2024-04-25T02:23:20.881899+0000","last_clean":"2024-04-25T02:23:20.881899+0000","last_became_active":"2024-04-25T02:23:13.841883+0000","last_became_peered":"2024-04-25T02:23:13.841883+0000","last_unstale":"2024-04-25T02:23:20.881899+0000","last_undegraded":"2024-04-25T02:23:20.881899+0000","last_fullsized":"2024-04-25T02:23:20.881899+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:13:08.256311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:21.179100+0000","last_change":"2024-04-25T02:23:11.836289+0000","last_active":"2024-04-25T02:23:21.179100+0000","last_peered":"2024-04-25T02:23:21.179100+0000","last_clean":"2024-04-25T02:23:21.179100+0000","last_became_active":"2024-04-25T02:23:11.835958+0000","last_became_peered":"2024-04-25T02:23:11.835958+0000","last_unstale":"2024-04-25T02:23:21.179100+0000","last_undegraded":"2024-04-25T02:23:21.179100+0000","last_fullsized":"2024-04-25T02:23:21.179100+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:56:00.639964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:21.179030+0000","last_change":"2024-04-25T02:23:11.836468+0000","last_active":"2024-04-25T02:23:21.179030+0000","last_peered":"2024-04-25T02:23:21.179030+0000","last_clean":"2024-04-25T02:23:21.179030+0000","last_became_active":"2024-04-25T02:23:11.836214+0000","last_became_peered":"2024-04-25T02:23:11.836214+0000","last_unstale":"2024-04-25T02:23:21.179030+0000","last_undegraded":"2024-04-25T02:23:21.179030+0000","last_fullsized":"2024-04-25T02:23:21.179030+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:55:43.874015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.879884+0000","last_change":"2024-04-25T02:23:13.847944+0000","last_active":"2024-04-25T02:23:20.879884+0000","last_peered":"2024-04-25T02:23:20.879884+0000","last_clean":"2024-04-25T02:23:20.879884+0000","last_became_active":"2024-04-25T02:23:13.847446+0000","last_became_peered":"2024-04-25T02:23:13.847446+0000","last_unstale":"2024-04-25T02:23:20.879884+0000","last_undegraded":"2024-04-25T02:23:20.879884+0000","last_fullsized":"2024-04-25T02:23:20.879884+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:18:53.324436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.880306+0000","last_change":"2024-04-25T02:23:13.847825+0000","last_active":"2024-04-25T02:23:20.880306+0000","last_peered":"2024-04-25T02:23:20.880306+0000","last_clean":"2024-04-25T02:23:20.880306+0000","last_became_active":"2024-04-25T02:23:13.847009+0000","last_became_peered":"2024-04-25T02:23:13.847009+0000","last_unstale":"2024-04-25T02:23:20.880306+0000","last_undegraded":"2024-04-25T02:23:20.880306+0000","last_fullsized":"2024-04-25T02:23:20.880306+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:04:01.988527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:21.178519+0000","last_change":"2024-04-25T02:23:12.841952+0000","last_active":"2024-04-25T02:23:21.178519+0000","last_peered":"2024-04-25T02:23:21.178519+0000","last_clean":"2024-04-25T02:23:21.178519+0000","last_became_active":"2024-04-25T02:23:12.841783+0000","last_became_peered":"2024-04-25T02:23:12.841783+0000","last_unstale":"2024-04-25T02:23:21.178519+0000","last_undegraded":"2024-04-25T02:23:21.178519+0000","last_fullsized":"2024-04-25T02:23:21.178519+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:42:53.655107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.879735+0000","last_change":"2024-04-25T02:23:11.836069+0000","last_active":"2024-04-25T02:23:20.879735+0000","last_peered":"2024-04-25T02:23:20.879735+0000","last_clean":"2024-04-25T02:23:20.879735+0000","last_became_active":"2024-04-25T02:23:11.835815+0000","last_became_peered":"2024-04-25T02:23:11.835815+0000","last_unstale":"2024-04-25T02:23:20.879735+0000","last_undegraded":"2024-04-25T02:23:20.879735+0000","last_fullsized":"2024-04-25T02:23:20.879735+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:07.444694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.877877+0000","last_change":"2024-04-25T02:23:13.839341+0000","last_active":"2024-04-25T02:23:20.877877+0000","last_peered":"2024-04-25T02:23:20.877877+0000","last_clean":"2024-04-25T02:23:20.877877+0000","last_became_active":"2024-04-25T02:23:13.839084+0000","last_became_peered":"2024-04-25T02:23:13.839084+0000","last_unstale":"2024-04-25T02:23:20.877877+0000","last_undegraded":"2024-04-25T02:23:20.877877+0000","last_fullsized":"2024-04-25T02:23:20.877877+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:29:17.043820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.882020+0000","last_change":"2024-04-25T02:23:13.844591+0000","last_active":"2024-04-25T02:23:20.882020+0000","last_peered":"2024-04-25T02:23:20.882020+0000","last_clean":"2024-04-25T02:23:20.882020+0000","last_became_active":"2024-04-25T02:23:13.844343+0000","last_became_peered":"2024-04-25T02:23:13.844343+0000","last_unstale":"2024-04-25T02:23:20.882020+0000","last_undegraded":"2024-04-25T02:23:20.882020+0000","last_fullsized":"2024-04-25T02:23:20.882020+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:52:55.994134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.882082+0000","last_change":"2024-04-25T02:23:12.848314+0000","last_active":"2024-04-25T02:23:20.882082+0000","last_peered":"2024-04-25T02:23:20.882082+0000","last_clean":"2024-04-25T02:23:20.882082+0000","last_became_active":"2024-04-25T02:23:12.848051+0000","last_became_peered":"2024-04-25T02:23:12.848051+0000","last_unstale":"2024-04-25T02:23:20.882082+0000","last_undegraded":"2024-04-25T02:23:20.882082+0000","last_fullsized":"2024-04-25T02:23:20.882082+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:53:59.236832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.880637+0000","last_change":"2024-04-25T02:23:13.848250+0000","last_active":"2024-04-25T02:23:20.880637+0000","last_peered":"2024-04-25T02:23:20.880637+0000","last_clean":"2024-04-25T02:23:20.880637+0000","last_became_active":"2024-04-25T02:23:13.847602+0000","last_became_peered":"2024-04-25T02:23:13.847602+0000","last_unstale":"2024-04-25T02:23:20.880637+0000","last_undegraded":"2024-04-25T02:23:20.880637+0000","last_fullsized":"2024-04-25T02:23:20.880637+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:36:05.652157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:21.178830+0000","last_change":"2024-04-25T02:23:13.846327+0000","last_active":"2024-04-25T02:23:21.178830+0000","last_peered":"2024-04-25T02:23:21.178830+0000","last_clean":"2024-04-25T02:23:21.178830+0000","last_became_active":"2024-04-25T02:23:13.845934+0000","last_became_peered":"2024-04-25T02:23:13.845934+0000","last_unstale":"2024-04-25T02:23:21.178830+0000","last_undegraded":"2024-04-25T02:23:21.178830+0000","last_fullsized":"2024-04-25T02:23:21.178830+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:01:47.261604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:21.178988+0000","last_change":"2024-04-25T02:23:13.847117+0000","last_active":"2024-04-25T02:23:21.178988+0000","last_peered":"2024-04-25T02:23:21.178988+0000","last_clean":"2024-04-25T02:23:21.178988+0000","last_became_active":"2024-04-25T02:23:13.846758+0000","last_became_peered":"2024-04-25T02:23:13.846758+0000","last_unstale":"2024-04-25T02:23:21.178988+0000","last_undegraded":"2024-04-25T02:23:21.178988+0000","last_fullsized":"2024-04-25T02:23:21.178988+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:53:10.872495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.879925+0000","last_change":"2024-04-25T02:23:11.835581+0000","last_active":"2024-04-25T02:23:20.879925+0000","last_peered":"2024-04-25T02:23:20.879925+0000","last_clean":"2024-04-25T02:23:20.879925+0000","last_became_active":"2024-04-25T02:23:11.835319+0000","last_became_peered":"2024-04-25T02:23:11.835319+0000","last_unstale":"2024-04-25T02:23:20.879925+0000","last_undegraded":"2024-04-25T02:23:20.879925+0000","last_fullsized":"2024-04-25T02:23:20.879925+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:19:02.978966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.878288+0000","last_change":"2024-04-25T02:23:13.840011+0000","last_active":"2024-04-25T02:23:20.878288+0000","last_peered":"2024-04-25T02:23:20.878288+0000","last_clean":"2024-04-25T02:23:20.878288+0000","last_became_active":"2024-04-25T02:23:13.838917+0000","last_became_peered":"2024-04-25T02:23:13.838917+0000","last_unstale":"2024-04-25T02:23:20.878288+0000","last_undegraded":"2024-04-25T02:23:20.878288+0000","last_fullsized":"2024-04-25T02:23:20.878288+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:53:06.476265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:21.178405+0000","last_change":"2024-04-25T02:23:13.846482+0000","last_active":"2024-04-25T02:23:21.178405+0000","last_peered":"2024-04-25T02:23:21.178405+0000","last_clean":"2024-04-25T02:23:21.178405+0000","last_became_active":"2024-04-25T02:23:13.845814+0000","last_became_peered":"2024-04-25T02:23:13.845814+0000","last_unstale":"2024-04-25T02:23:21.178405+0000","last_undegraded":"2024-04-25T02:23:21.178405+0000","last_fullsized":"2024-04-25T02:23:21.178405+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:33:00.487666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:21.179138+0000","last_change":"2024-04-25T02:23:13.852668+0000","last_active":"2024-04-25T02:23:21.179138+0000","last_peered":"2024-04-25T02:23:21.179138+0000","last_clean":"2024-04-25T02:23:21.179138+0000","last_became_active":"2024-04-25T02:23:13.852093+0000","last_became_peered":"2024-04-25T02:23:13.852093+0000","last_unstale":"2024-04-25T02:23:21.179138+0000","last_undegraded":"2024-04-25T02:23:21.179138+0000","last_fullsized":"2024-04-25T02:23:21.179138+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:57.422935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:21.179239+0000","last_change":"2024-04-25T02:23:12.841653+0000","last_active":"2024-04-25T02:23:21.179239+0000","last_peered":"2024-04-25T02:23:21.179239+0000","last_clean":"2024-04-25T02:23:21.179239+0000","last_became_active":"2024-04-25T02:23:12.841477+0000","last_became_peered":"2024-04-25T02:23:12.841477+0000","last_unstale":"2024-04-25T02:23:21.179239+0000","last_undegraded":"2024-04-25T02:23:21.179239+0000","last_fullsized":"2024-04-25T02:23:21.179239+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:16:17.108262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.878786+0000","last_change":"2024-04-25T02:23:13.842553+0000","last_active":"2024-04-25T02:23:20.878786+0000","last_peered":"2024-04-25T02:23:20.878786+0000","last_clean":"2024-04-25T02:23:20.878786+0000","last_became_active":"2024-04-25T02:23:13.840422+0000","last_became_peered":"2024-04-25T02:23:13.840422+0000","last_unstale":"2024-04-25T02:23:20.878786+0000","last_undegraded":"2024-04-25T02:23:20.878786+0000","last_fullsized":"2024-04-25T02:23:20.878786+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:44:38.010033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"35'2","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:21.178638+0000","last_change":"2024-04-25T02:23:12.846241+0000","last_active":"2024-04-25T02:23:21.178638+0000","last_peered":"2024-04-25T02:23:21.178638+0000","last_clean":"2024-04-25T02:23:21.178638+0000","last_became_active":"2024-04-25T02:23:12.845923+0000","last_became_peered":"2024-04-25T02:23:12.845923+0000","last_unstale":"2024-04-25T02:23:21.178638+0000","last_undegraded":"2024-04-25T02:23:21.178638+0000","last_fullsized":"2024-04-25T02:23:21.178638+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:59:31.094638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.881274+0000","last_change":"2024-04-25T02:23:13.850625+0000","last_active":"2024-04-25T02:23:20.881274+0000","last_peered":"2024-04-25T02:23:20.881274+0000","last_clean":"2024-04-25T02:23:20.881274+0000","last_became_active":"2024-04-25T02:23:13.848844+0000","last_became_peered":"2024-04-25T02:23:13.848844+0000","last_unstale":"2024-04-25T02:23:20.881274+0000","last_undegraded":"2024-04-25T02:23:20.881274+0000","last_fullsized":"2024-04-25T02:23:20.881274+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:32.796023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:21.178480+0000","last_change":"2024-04-25T02:23:13.850242+0000","last_active":"2024-04-25T02:23:21.178480+0000","last_peered":"2024-04-25T02:23:21.178480+0000","last_clean":"2024-04-25T02:23:21.178480+0000","last_became_active":"2024-04-25T02:23:13.846821+0000","last_became_peered":"2024-04-25T02:23:13.846821+0000","last_unstale":"2024-04-25T02:23:21.178480+0000","last_undegraded":"2024-04-25T02:23:21.178480+0000","last_fullsized":"2024-04-25T02:23:21.178480+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:16.733579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.882222+0000","last_change":"2024-04-25T02:23:11.840787+0000","last_active":"2024-04-25T02:23:20.882222+0000","last_peered":"2024-04-25T02:23:20.882222+0000","last_clean":"2024-04-25T02:23:20.882222+0000","last_became_active":"2024-04-25T02:23:11.840274+0000","last_became_peered":"2024-04-25T02:23:11.840274+0000","last_unstale":"2024-04-25T02:23:20.882222+0000","last_undegraded":"2024-04-25T02:23:20.882222+0000","last_fullsized":"2024-04-25T02:23:20.882222+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:26:15.381838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"18'1","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.878170+0000","last_change":"2024-04-25T02:23:13.839791+0000","last_active":"2024-04-25T02:23:20.878170+0000","last_peered":"2024-04-25T02:23:20.878170+0000","last_clean":"2024-04-25T02:23:20.878170+0000","last_became_active":"2024-04-25T02:23:13.839361+0000","last_became_peered":"2024-04-25T02:23:13.839361+0000","last_unstale":"2024-04-25T02:23:20.878170+0000","last_undegraded":"2024-04-25T02:23:20.878170+0000","last_fullsized":"2024-04-25T02:23:20.878170+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:48:03.634232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.881308+0000","last_change":"2024-04-25T02:23:13.844099+0000","last_active":"2024-04-25T02:23:20.881308+0000","last_peered":"2024-04-25T02:23:20.881308+0000","last_clean":"2024-04-25T02:23:20.881308+0000","last_became_active":"2024-04-25T02:23:13.843656+0000","last_became_peered":"2024-04-25T02:23:13.843656+0000","last_unstale":"2024-04-25T02:23:20.881308+0000","last_undegraded":"2024-04-25T02:23:20.881308+0000","last_fullsized":"2024-04-25T02:23:20.881308+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:18:44.036616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"19'7","reported_seq":43,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.881978+0000","last_change":"2024-04-25T02:23:13.842946+0000","last_active":"2024-04-25T02:23:20.881978+0000","last_peered":"2024-04-25T02:23:20.881978+0000","last_clean":"2024-04-25T02:23:20.881978+0000","last_became_active":"2024-04-25T02:23:13.842598+0000","last_became_peered":"2024-04-25T02:23:13.842598+0000","last_unstale":"2024-04-25T02:23:20.881978+0000","last_undegraded":"2024-04-25T02:23:20.881978+0000","last_fullsized":"2024-04-25T02:23:20.881978+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:27.597908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.878004+0000","last_change":"2024-04-25T02:23:13.849957+0000","last_active":"2024-04-25T02:23:20.878004+0000","last_peered":"2024-04-25T02:23:20.878004+0000","last_clean":"2024-04-25T02:23:20.878004+0000","last_became_active":"2024-04-25T02:23:13.848675+0000","last_became_peered":"2024-04-25T02:23:13.848675+0000","last_unstale":"2024-04-25T02:23:20.878004+0000","last_undegraded":"2024-04-25T02:23:20.878004+0000","last_fullsized":"2024-04-25T02:23:20.878004+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:09:49.581897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"18'2","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.880418+0000","last_change":"2024-04-25T02:23:13.847353+0000","last_active":"2024-04-25T02:23:20.880418+0000","last_peered":"2024-04-25T02:23:20.880418+0000","last_clean":"2024-04-25T02:23:20.880418+0000","last_became_active":"2024-04-25T02:23:13.846764+0000","last_became_peered":"2024-04-25T02:23:13.846764+0000","last_unstale":"2024-04-25T02:23:20.880418+0000","last_undegraded":"2024-04-25T02:23:20.880418+0000","last_fullsized":"2024-04-25T02:23:20.880418+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:38:36.095151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.878786+0000","last_change":"2024-04-25T02:23:13.844687+0000","last_active":"2024-04-25T02:23:20.878786+0000","last_peered":"2024-04-25T02:23:20.878786+0000","last_clean":"2024-04-25T02:23:20.878786+0000","last_became_active":"2024-04-25T02:23:13.839702+0000","last_became_peered":"2024-04-25T02:23:13.839702+0000","last_unstale":"2024-04-25T02:23:20.878786+0000","last_undegraded":"2024-04-25T02:23:20.878786+0000","last_fullsized":"2024-04-25T02:23:20.878786+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:10:23.178715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"18'4","reported_seq":43,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.881407+0000","last_change":"2024-04-25T02:23:13.844668+0000","last_active":"2024-04-25T02:23:20.881407+0000","last_peered":"2024-04-25T02:23:20.881407+0000","last_clean":"2024-04-25T02:23:20.881407+0000","last_became_active":"2024-04-25T02:23:13.843625+0000","last_became_peered":"2024-04-25T02:23:13.843625+0000","last_unstale":"2024-04-25T02:23:20.881407+0000","last_undegraded":"2024-04-25T02:23:20.881407+0000","last_fullsized":"2024-04-25T02:23:20.881407+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:19:41.521042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:21.178720+0000","last_change":"2024-04-25T02:23:13.851184+0000","last_active":"2024-04-25T02:23:21.178720+0000","last_peered":"2024-04-25T02:23:21.178720+0000","last_clean":"2024-04-25T02:23:21.178720+0000","last_became_active":"2024-04-25T02:23:13.850845+0000","last_became_peered":"2024-04-25T02:23:13.850845+0000","last_unstale":"2024-04-25T02:23:21.178720+0000","last_undegraded":"2024-04-25T02:23:21.178720+0000","last_fullsized":"2024-04-25T02:23:21.178720+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:07:20.048534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"36'19","reported_seq":60,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.878154+0000","last_change":"2024-04-25T02:23:13.849389+0000","last_active":"2024-04-25T02:23:20.878154+0000","last_peered":"2024-04-25T02:23:20.878154+0000","last_clean":"2024-04-25T02:23:20.878154+0000","last_became_active":"2024-04-25T02:23:13.845176+0000","last_became_peered":"2024-04-25T02:23:13.845176+0000","last_unstale":"2024-04-25T02:23:20.878154+0000","last_undegraded":"2024-04-25T02:23:20.878154+0000","last_fullsized":"2024-04-25T02:23:20.878154+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:50:14.041957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5015,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":7,"num_read_kb":10,"num_write":19,"num_write_kb":13,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.880258+0000","last_change":"2024-04-25T02:23:13.847990+0000","last_active":"2024-04-25T02:23:20.880258+0000","last_peered":"2024-04-25T02:23:20.880258+0000","last_clean":"2024-04-25T02:23:20.880258+0000","last_became_active":"2024-04-25T02:23:13.847343+0000","last_became_peered":"2024-04-25T02:23:13.847343+0000","last_unstale":"2024-04-25T02:23:20.880258+0000","last_undegraded":"2024-04-25T02:23:20.880258+0000","last_fullsized":"2024-04-25T02:23:20.880258+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:27:22.027187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"18'4","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.878861+0000","last_change":"2024-04-25T02:23:13.839481+0000","last_active":"2024-04-25T02:23:20.878861+0000","last_peered":"2024-04-25T02:23:20.878861+0000","last_clean":"2024-04-25T02:23:20.878861+0000","last_became_active":"2024-04-25T02:23:13.839158+0000","last_became_peered":"2024-04-25T02:23:13.839158+0000","last_unstale":"2024-04-25T02:23:20.878861+0000","last_undegraded":"2024-04-25T02:23:20.878861+0000","last_fullsized":"2024-04-25T02:23:20.878861+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:07:04.590892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":7,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.881441+0000","last_change":"2024-04-25T02:23:13.843740+0000","last_active":"2024-04-25T02:23:20.881441+0000","last_peered":"2024-04-25T02:23:20.881441+0000","last_clean":"2024-04-25T02:23:20.881441+0000","last_became_active":"2024-04-25T02:23:13.843441+0000","last_became_peered":"2024-04-25T02:23:13.843441+0000","last_unstale":"2024-04-25T02:23:20.881441+0000","last_undegraded":"2024-04-25T02:23:20.881441+0000","last_fullsized":"2024-04-25T02:23:20.881441+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:53:20.763788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"18'3","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.880029+0000","last_change":"2024-04-25T02:23:13.844290+0000","last_active":"2024-04-25T02:23:20.880029+0000","last_peered":"2024-04-25T02:23:20.880029+0000","last_clean":"2024-04-25T02:23:20.880029+0000","last_became_active":"2024-04-25T02:23:13.841976+0000","last_became_peered":"2024-04-25T02:23:13.841976+0000","last_unstale":"2024-04-25T02:23:20.880029+0000","last_undegraded":"2024-04-25T02:23:20.880029+0000","last_fullsized":"2024-04-25T02:23:20.880029+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:16:25.998330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.881373+0000","last_change":"2024-04-25T02:23:13.843455+0000","last_active":"2024-04-25T02:23:20.881373+0000","last_peered":"2024-04-25T02:23:20.881373+0000","last_clean":"2024-04-25T02:23:20.881373+0000","last_became_active":"2024-04-25T02:23:13.842163+0000","last_became_peered":"2024-04-25T02:23:13.842163+0000","last_unstale":"2024-04-25T02:23:20.881373+0000","last_undegraded":"2024-04-25T02:23:20.881373+0000","last_fullsized":"2024-04-25T02:23:20.881373+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:59:59.924648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.877933+0000","last_change":"2024-04-25T02:23:13.839221+0000","last_active":"2024-04-25T02:23:20.877933+0000","last_peered":"2024-04-25T02:23:20.877933+0000","last_clean":"2024-04-25T02:23:20.877933+0000","last_became_active":"2024-04-25T02:23:13.838616+0000","last_became_peered":"2024-04-25T02:23:13.838616+0000","last_unstale":"2024-04-25T02:23:20.877933+0000","last_undegraded":"2024-04-25T02:23:20.877933+0000","last_fullsized":"2024-04-25T02:23:20.877933+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:24:48.817920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.882322+0000","last_change":"2024-04-25T02:23:13.842908+0000","last_active":"2024-04-25T02:23:20.882322+0000","last_peered":"2024-04-25T02:23:20.882322+0000","last_clean":"2024-04-25T02:23:20.882322+0000","last_became_active":"2024-04-25T02:23:13.842649+0000","last_became_peered":"2024-04-25T02:23:13.842649+0000","last_unstale":"2024-04-25T02:23:20.882322+0000","last_undegraded":"2024-04-25T02:23:20.882322+0000","last_fullsized":"2024-04-25T02:23:20.882322+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:04:07.758366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"18'10","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:21.178643+0000","last_change":"2024-04-25T02:23:11.835951+0000","last_active":"2024-04-25T02:23:21.178643+0000","last_peered":"2024-04-25T02:23:21.178643+0000","last_clean":"2024-04-25T02:23:21.178643+0000","last_became_active":"2024-04-25T02:23:11.835077+0000","last_became_peered":"2024-04-25T02:23:11.835077+0000","last_unstale":"2024-04-25T02:23:21.178643+0000","last_undegraded":"2024-04-25T02:23:21.178643+0000","last_fullsized":"2024-04-25T02:23:21.178643+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:24:42.651723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.879107+0000","last_change":"2024-04-25T02:23:13.843899+0000","last_active":"2024-04-25T02:23:20.879107+0000","last_peered":"2024-04-25T02:23:20.879107+0000","last_clean":"2024-04-25T02:23:20.879107+0000","last_became_active":"2024-04-25T02:23:13.843347+0000","last_became_peered":"2024-04-25T02:23:13.843347+0000","last_unstale":"2024-04-25T02:23:20.879107+0000","last_undegraded":"2024-04-25T02:23:20.879107+0000","last_fullsized":"2024-04-25T02:23:20.879107+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:46:23.518991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"17'1","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.881772+0000","last_change":"2024-04-25T02:23:11.839659+0000","last_active":"2024-04-25T02:23:20.881772+0000","last_peered":"2024-04-25T02:23:20.881772+0000","last_clean":"2024-04-25T02:23:20.881772+0000","last_became_active":"2024-04-25T02:23:11.839157+0000","last_became_peered":"2024-04-25T02:23:11.839157+0000","last_unstale":"2024-04-25T02:23:20.881772+0000","last_undegraded":"2024-04-25T02:23:20.881772+0000","last_fullsized":"2024-04-25T02:23:20.881772+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:06:42.930490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.877870+0000","last_change":"2024-04-25T02:23:13.841226+0000","last_active":"2024-04-25T02:23:20.877870+0000","last_peered":"2024-04-25T02:23:20.877870+0000","last_clean":"2024-04-25T02:23:20.877870+0000","last_became_active":"2024-04-25T02:23:13.840951+0000","last_became_peered":"2024-04-25T02:23:13.840951+0000","last_unstale":"2024-04-25T02:23:20.877870+0000","last_undegraded":"2024-04-25T02:23:20.877870+0000","last_fullsized":"2024-04-25T02:23:20.877870+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:16:58.212703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"17'2","reported_seq":43,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.880685+0000","last_change":"2024-04-25T02:23:12.848098+0000","last_active":"2024-04-25T02:23:20.880685+0000","last_peered":"2024-04-25T02:23:20.880685+0000","last_clean":"2024-04-25T02:23:20.880685+0000","last_became_active":"2024-04-25T02:23:12.847813+0000","last_became_peered":"2024-04-25T02:23:12.847813+0000","last_unstale":"2024-04-25T02:23:20.880685+0000","last_undegraded":"2024-04-25T02:23:20.880685+0000","last_fullsized":"2024-04-25T02:23:20.880685+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:31:10.538399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:21.178568+0000","last_change":"2024-04-25T02:23:13.847124+0000","last_active":"2024-04-25T02:23:21.178568+0000","last_peered":"2024-04-25T02:23:21.178568+0000","last_clean":"2024-04-25T02:23:21.178568+0000","last_became_active":"2024-04-25T02:23:13.846492+0000","last_became_peered":"2024-04-25T02:23:13.846492+0000","last_unstale":"2024-04-25T02:23:21.178568+0000","last_undegraded":"2024-04-25T02:23:21.178568+0000","last_fullsized":"2024-04-25T02:23:21.178568+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:21:05.467823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.d","version":"17'1","reported_seq":41,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.878845+0000","last_change":"2024-04-25T02:23:13.848143+0000","last_active":"2024-04-25T02:23:20.878845+0000","last_peered":"2024-04-25T02:23:20.878845+0000","last_clean":"2024-04-25T02:23:20.878845+0000","last_became_active":"2024-04-25T02:23:13.843704+0000","last_became_peered":"2024-04-25T02:23:13.843704+0000","last_unstale":"2024-04-25T02:23:20.878845+0000","last_undegraded":"2024-04-25T02:23:20.878845+0000","last_fullsized":"2024-04-25T02:23:20.878845+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:54:31.975503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.881003+0000","last_change":"2024-04-25T02:23:13.847842+0000","last_active":"2024-04-25T02:23:20.881003+0000","last_peered":"2024-04-25T02:23:20.881003+0000","last_clean":"2024-04-25T02:23:20.881003+0000","last_became_active":"2024-04-25T02:23:13.845782+0000","last_became_peered":"2024-04-25T02:23:13.845782+0000","last_unstale":"2024-04-25T02:23:20.881003+0000","last_undegraded":"2024-04-25T02:23:20.881003+0000","last_fullsized":"2024-04-25T02:23:20.881003+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:56:46.820624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.880962+0000","last_change":"2024-04-25T02:23:13.842426+0000","last_active":"2024-04-25T02:23:20.880962+0000","last_peered":"2024-04-25T02:23:20.880962+0000","last_clean":"2024-04-25T02:23:20.880962+0000","last_became_active":"2024-04-25T02:23:13.841815+0000","last_became_peered":"2024-04-25T02:23:13.841815+0000","last_unstale":"2024-04-25T02:23:20.880962+0000","last_undegraded":"2024-04-25T02:23:20.880962+0000","last_fullsized":"2024-04-25T02:23:20.880962+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:20:54.760986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.880469+0000","last_change":"2024-04-25T02:23:11.839840+0000","last_active":"2024-04-25T02:23:20.880469+0000","last_peered":"2024-04-25T02:23:20.880469+0000","last_clean":"2024-04-25T02:23:20.880469+0000","last_became_active":"2024-04-25T02:23:11.837258+0000","last_became_peered":"2024-04-25T02:23:11.837258+0000","last_unstale":"2024-04-25T02:23:20.880469+0000","last_undegraded":"2024-04-25T02:23:20.880469+0000","last_fullsized":"2024-04-25T02:23:20.880469+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:49:17.616748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"35'5","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.878421+0000","last_change":"2024-04-25T02:23:13.838948+0000","last_active":"2024-04-25T02:23:20.878421+0000","last_peered":"2024-04-25T02:23:20.878421+0000","last_clean":"2024-04-25T02:23:20.878421+0000","last_became_active":"2024-04-25T02:23:13.838665+0000","last_became_peered":"2024-04-25T02:23:13.838665+0000","last_unstale":"2024-04-25T02:23:20.878421+0000","last_undegraded":"2024-04-25T02:23:20.878421+0000","last_fullsized":"2024-04-25T02:23:20.878421+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:29:28.670027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.881038+0000","last_change":"2024-04-25T02:23:13.844700+0000","last_active":"2024-04-25T02:23:20.881038+0000","last_peered":"2024-04-25T02:23:20.881038+0000","last_clean":"2024-04-25T02:23:20.881038+0000","last_became_active":"2024-04-25T02:23:13.844337+0000","last_became_peered":"2024-04-25T02:23:13.844337+0000","last_unstale":"2024-04-25T02:23:20.881038+0000","last_undegraded":"2024-04-25T02:23:20.881038+0000","last_fullsized":"2024-04-25T02:23:20.881038+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:50:22.169266+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"19'4","reported_seq":43,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.878106+0000","last_change":"2024-04-25T02:23:13.843937+0000","last_active":"2024-04-25T02:23:20.878106+0000","last_peered":"2024-04-25T02:23:20.878106+0000","last_clean":"2024-04-25T02:23:20.878106+0000","last_became_active":"2024-04-25T02:23:13.843652+0000","last_became_peered":"2024-04-25T02:23:13.843652+0000","last_unstale":"2024-04-25T02:23:20.878106+0000","last_undegraded":"2024-04-25T02:23:20.878106+0000","last_fullsized":"2024-04-25T02:23:20.878106+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:13:15.374851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.882802+0000","last_change":"2024-04-25T02:23:13.848659+0000","last_active":"2024-04-25T02:23:20.882802+0000","last_peered":"2024-04-25T02:23:20.882802+0000","last_clean":"2024-04-25T02:23:20.882802+0000","last_became_active":"2024-04-25T02:23:13.847863+0000","last_became_peered":"2024-04-25T02:23:13.847863+0000","last_unstale":"2024-04-25T02:23:20.882802+0000","last_undegraded":"2024-04-25T02:23:20.882802+0000","last_fullsized":"2024-04-25T02:23:20.882802+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:21:50.452616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.9","version":"18'3","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.879187+0000","last_change":"2024-04-25T02:23:13.842533+0000","last_active":"2024-04-25T02:23:20.879187+0000","last_peered":"2024-04-25T02:23:20.879187+0000","last_clean":"2024-04-25T02:23:20.879187+0000","last_became_active":"2024-04-25T02:23:13.841049+0000","last_became_peered":"2024-04-25T02:23:13.841049+0000","last_unstale":"2024-04-25T02:23:20.879187+0000","last_undegraded":"2024-04-25T02:23:20.879187+0000","last_fullsized":"2024-04-25T02:23:20.879187+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:26:00.892546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.880825+0000","last_change":"2024-04-25T02:23:13.847171+0000","last_active":"2024-04-25T02:23:20.880825+0000","last_peered":"2024-04-25T02:23:20.880825+0000","last_clean":"2024-04-25T02:23:20.880825+0000","last_became_active":"2024-04-25T02:23:13.846425+0000","last_became_peered":"2024-04-25T02:23:13.846425+0000","last_unstale":"2024-04-25T02:23:20.880825+0000","last_undegraded":"2024-04-25T02:23:20.880825+0000","last_fullsized":"2024-04-25T02:23:20.880825+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:40:12.956129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"18'2","reported_seq":41,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.877686+0000","last_change":"2024-04-25T02:23:13.841178+0000","last_active":"2024-04-25T02:23:20.877686+0000","last_peered":"2024-04-25T02:23:20.877686+0000","last_clean":"2024-04-25T02:23:20.877686+0000","last_became_active":"2024-04-25T02:23:13.840876+0000","last_became_peered":"2024-04-25T02:23:13.840876+0000","last_unstale":"2024-04-25T02:23:20.877686+0000","last_undegraded":"2024-04-25T02:23:20.877686+0000","last_fullsized":"2024-04-25T02:23:20.877686+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:29:47.026682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:21.179291+0000","last_change":"2024-04-25T02:23:13.852754+0000","last_active":"2024-04-25T02:23:21.179291+0000","last_peered":"2024-04-25T02:23:21.179291+0000","last_clean":"2024-04-25T02:23:21.179291+0000","last_became_active":"2024-04-25T02:23:13.852398+0000","last_became_peered":"2024-04-25T02:23:13.852398+0000","last_unstale":"2024-04-25T02:23:21.179291+0000","last_undegraded":"2024-04-25T02:23:21.179291+0000","last_fullsized":"2024-04-25T02:23:21.179291+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:48:40.857184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:21.178793+0000","last_change":"2024-04-25T02:23:11.834419+0000","last_active":"2024-04-25T02:23:21.178793+0000","last_peered":"2024-04-25T02:23:21.178793+0000","last_clean":"2024-04-25T02:23:21.178793+0000","last_became_active":"2024-04-25T02:23:11.834171+0000","last_became_peered":"2024-04-25T02:23:11.834171+0000","last_unstale":"2024-04-25T02:23:21.178793+0000","last_undegraded":"2024-04-25T02:23:21.178793+0000","last_fullsized":"2024-04-25T02:23:21.178793+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:13:40.419554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"18'1","reported_seq":33,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.880544+0000","last_change":"2024-04-25T02:23:13.848449+0000","last_active":"2024-04-25T02:23:20.880544+0000","last_peered":"2024-04-25T02:23:20.880544+0000","last_clean":"2024-04-25T02:23:20.880544+0000","last_became_active":"2024-04-25T02:23:13.847970+0000","last_became_peered":"2024-04-25T02:23:13.847970+0000","last_unstale":"2024-04-25T02:23:20.880544+0000","last_undegraded":"2024-04-25T02:23:20.880544+0000","last_fullsized":"2024-04-25T02:23:20.880544+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:00:21.733260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:21.178617+0000","last_change":"2024-04-25T02:23:13.850097+0000","last_active":"2024-04-25T02:23:21.178617+0000","last_peered":"2024-04-25T02:23:21.178617+0000","last_clean":"2024-04-25T02:23:21.178617+0000","last_became_active":"2024-04-25T02:23:13.849556+0000","last_became_peered":"2024-04-25T02:23:13.849556+0000","last_unstale":"2024-04-25T02:23:21.178617+0000","last_undegraded":"2024-04-25T02:23:21.178617+0000","last_fullsized":"2024-04-25T02:23:21.178617+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:25:42.876612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.878242+0000","last_change":"2024-04-25T02:23:13.848430+0000","last_active":"2024-04-25T02:23:20.878242+0000","last_peered":"2024-04-25T02:23:20.878242+0000","last_clean":"2024-04-25T02:23:20.878242+0000","last_became_active":"2024-04-25T02:23:13.847888+0000","last_became_peered":"2024-04-25T02:23:13.847888+0000","last_unstale":"2024-04-25T02:23:20.878242+0000","last_undegraded":"2024-04-25T02:23:20.878242+0000","last_fullsized":"2024-04-25T02:23:20.878242+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:57:11.831417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"19'3","reported_seq":41,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.880392+0000","last_change":"2024-04-25T02:23:12.848598+0000","last_active":"2024-04-25T02:23:20.880392+0000","last_peered":"2024-04-25T02:23:20.880392+0000","last_clean":"2024-04-25T02:23:20.880392+0000","last_became_active":"2024-04-25T02:23:12.848312+0000","last_became_peered":"2024-04-25T02:23:12.848312+0000","last_unstale":"2024-04-25T02:23:20.880392+0000","last_undegraded":"2024-04-25T02:23:20.880392+0000","last_fullsized":"2024-04-25T02:23:20.880392+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:58:41.830406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:21.178756+0000","last_change":"2024-04-25T02:23:12.842182+0000","last_active":"2024-04-25T02:23:21.178756+0000","last_peered":"2024-04-25T02:23:21.178756+0000","last_clean":"2024-04-25T02:23:21.178756+0000","last_became_active":"2024-04-25T02:23:12.841408+0000","last_became_peered":"2024-04-25T02:23:12.841408+0000","last_unstale":"2024-04-25T02:23:21.178756+0000","last_undegraded":"2024-04-25T02:23:21.178756+0000","last_fullsized":"2024-04-25T02:23:21.178756+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:06:31.558059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.879963+0000","last_change":"2024-04-25T02:23:13.848743+0000","last_active":"2024-04-25T02:23:20.879963+0000","last_peered":"2024-04-25T02:23:20.879963+0000","last_clean":"2024-04-25T02:23:20.879963+0000","last_became_active":"2024-04-25T02:23:13.848076+0000","last_became_peered":"2024-04-25T02:23:13.848076+0000","last_unstale":"2024-04-25T02:23:20.879963+0000","last_undegraded":"2024-04-25T02:23:20.879963+0000","last_fullsized":"2024-04-25T02:23:20.879963+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:08:43.341421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"18'1","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:21.178680+0000","last_change":"2024-04-25T02:23:12.848506+0000","last_active":"2024-04-25T02:23:21.178680+0000","last_peered":"2024-04-25T02:23:21.178680+0000","last_clean":"2024-04-25T02:23:21.178680+0000","last_became_active":"2024-04-25T02:23:12.848229+0000","last_became_peered":"2024-04-25T02:23:12.848229+0000","last_unstale":"2024-04-25T02:23:21.178680+0000","last_undegraded":"2024-04-25T02:23:21.178680+0000","last_fullsized":"2024-04-25T02:23:21.178680+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:24:34.129737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:21.179201+0000","last_change":"2024-04-25T02:23:11.835239+0000","last_active":"2024-04-25T02:23:21.179201+0000","last_peered":"2024-04-25T02:23:21.179201+0000","last_clean":"2024-04-25T02:23:21.179201+0000","last_became_active":"2024-04-25T02:23:11.834994+0000","last_became_peered":"2024-04-25T02:23:11.834994+0000","last_unstale":"2024-04-25T02:23:21.179201+0000","last_undegraded":"2024-04-25T02:23:21.179201+0000","last_fullsized":"2024-04-25T02:23:21.179201+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:51.196318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.878300+0000","last_change":"2024-04-25T02:23:13.849321+0000","last_active":"2024-04-25T02:23:20.878300+0000","last_peered":"2024-04-25T02:23:20.878300+0000","last_clean":"2024-04-25T02:23:20.878300+0000","last_became_active":"2024-04-25T02:23:13.848628+0000","last_became_peered":"2024-04-25T02:23:13.848628+0000","last_unstale":"2024-04-25T02:23:20.878300+0000","last_undegraded":"2024-04-25T02:23:20.878300+0000","last_fullsized":"2024-04-25T02:23:20.878300+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:46:12.919462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"22'115","reported_seq":189,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:21.178395+0000","last_change":"2024-04-25T02:23:11.836134+0000","last_active":"2024-04-25T02:23:21.178395+0000","last_peered":"2024-04-25T02:23:21.178395+0000","last_clean":"2024-04-25T02:23:21.178395+0000","last_became_active":"2024-04-25T02:23:11.835430+0000","last_became_peered":"2024-04-25T02:23:11.835430+0000","last_unstale":"2024-04-25T02:23:21.178395+0000","last_undegraded":"2024-04-25T02:23:21.178395+0000","last_fullsized":"2024-04-25T02:23:21.178395+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:08.432182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:08.432182+0000","last_clean_scrub_stamp":"2024-04-25T02:20:08.432182+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:45:18.572525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.878850+0000","last_change":"2024-04-25T02:23:13.848149+0000","last_active":"2024-04-25T02:23:20.878850+0000","last_peered":"2024-04-25T02:23:20.878850+0000","last_clean":"2024-04-25T02:23:20.878850+0000","last_became_active":"2024-04-25T02:23:13.845029+0000","last_became_peered":"2024-04-25T02:23:13.845029+0000","last_unstale":"2024-04-25T02:23:20.878850+0000","last_undegraded":"2024-04-25T02:23:20.878850+0000","last_fullsized":"2024-04-25T02:23:20.878850+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:17.775866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.879110+0000","last_change":"2024-04-25T02:23:13.848481+0000","last_active":"2024-04-25T02:23:20.879110+0000","last_peered":"2024-04-25T02:23:20.879110+0000","last_clean":"2024-04-25T02:23:20.879110+0000","last_became_active":"2024-04-25T02:23:13.844018+0000","last_became_peered":"2024-04-25T02:23:13.844018+0000","last_unstale":"2024-04-25T02:23:20.879110+0000","last_undegraded":"2024-04-25T02:23:20.879110+0000","last_fullsized":"2024-04-25T02:23:20.879110+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:28:48.151869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.877666+0000","last_change":"2024-04-25T02:23:13.848526+0000","last_active":"2024-04-25T02:23:20.877666+0000","last_peered":"2024-04-25T02:23:20.877666+0000","last_clean":"2024-04-25T02:23:20.877666+0000","last_became_active":"2024-04-25T02:23:13.844753+0000","last_became_peered":"2024-04-25T02:23:13.844753+0000","last_unstale":"2024-04-25T02:23:20.877666+0000","last_undegraded":"2024-04-25T02:23:20.877666+0000","last_fullsized":"2024-04-25T02:23:20.877666+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:01:01.038928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"18'1","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.879553+0000","last_change":"2024-04-25T02:23:12.845945+0000","last_active":"2024-04-25T02:23:20.879553+0000","last_peered":"2024-04-25T02:23:20.879553+0000","last_clean":"2024-04-25T02:23:20.879553+0000","last_became_active":"2024-04-25T02:23:12.845638+0000","last_became_peered":"2024-04-25T02:23:12.845638+0000","last_unstale":"2024-04-25T02:23:20.879553+0000","last_undegraded":"2024-04-25T02:23:20.879553+0000","last_fullsized":"2024-04-25T02:23:20.879553+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:47:37.213557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.882182+0000","last_change":"2024-04-25T02:23:11.840630+0000","last_active":"2024-04-25T02:23:20.882182+0000","last_peered":"2024-04-25T02:23:20.882182+0000","last_clean":"2024-04-25T02:23:20.882182+0000","last_became_active":"2024-04-25T02:23:11.840215+0000","last_became_peered":"2024-04-25T02:23:11.840215+0000","last_unstale":"2024-04-25T02:23:20.882182+0000","last_undegraded":"2024-04-25T02:23:20.882182+0000","last_fullsized":"2024-04-25T02:23:20.882182+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:18:40.221229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.879266+0000","last_change":"2024-04-25T02:23:13.845169+0000","last_active":"2024-04-25T02:23:20.879266+0000","last_peered":"2024-04-25T02:23:20.879266+0000","last_clean":"2024-04-25T02:23:20.879266+0000","last_became_active":"2024-04-25T02:23:13.841324+0000","last_became_peered":"2024-04-25T02:23:13.841324+0000","last_unstale":"2024-04-25T02:23:20.879266+0000","last_undegraded":"2024-04-25T02:23:20.879266+0000","last_fullsized":"2024-04-25T02:23:20.879266+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:23.490432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:21.178912+0000","last_change":"2024-04-25T02:23:12.842493+0000","last_active":"2024-04-25T02:23:21.178912+0000","last_peered":"2024-04-25T02:23:21.178912+0000","last_clean":"2024-04-25T02:23:21.178912+0000","last_became_active":"2024-04-25T02:23:12.841930+0000","last_became_peered":"2024-04-25T02:23:12.841930+0000","last_unstale":"2024-04-25T02:23:21.178912+0000","last_undegraded":"2024-04-25T02:23:21.178912+0000","last_fullsized":"2024-04-25T02:23:21.178912+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:36:52.589994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.880541+0000","last_change":"2024-04-25T02:23:12.848221+0000","last_active":"2024-04-25T02:23:20.880541+0000","last_peered":"2024-04-25T02:23:20.880541+0000","last_clean":"2024-04-25T02:23:20.880541+0000","last_became_active":"2024-04-25T02:23:12.847949+0000","last_became_peered":"2024-04-25T02:23:12.847949+0000","last_unstale":"2024-04-25T02:23:20.880541+0000","last_undegraded":"2024-04-25T02:23:20.880541+0000","last_fullsized":"2024-04-25T02:23:20.880541+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:17.728665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"18'4","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.881213+0000","last_change":"2024-04-25T02:23:13.844968+0000","last_active":"2024-04-25T02:23:20.881213+0000","last_peered":"2024-04-25T02:23:20.881213+0000","last_clean":"2024-04-25T02:23:20.881213+0000","last_became_active":"2024-04-25T02:23:13.844133+0000","last_became_peered":"2024-04-25T02:23:13.844133+0000","last_unstale":"2024-04-25T02:23:20.881213+0000","last_undegraded":"2024-04-25T02:23:20.881213+0000","last_fullsized":"2024-04-25T02:23:20.881213+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:02.533959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:21.179276+0000","last_change":"2024-04-25T02:23:11.837086+0000","last_active":"2024-04-25T02:23:21.179276+0000","last_peered":"2024-04-25T02:23:21.179276+0000","last_clean":"2024-04-25T02:23:21.179276+0000","last_became_active":"2024-04-25T02:23:11.836737+0000","last_became_peered":"2024-04-25T02:23:11.836737+0000","last_unstale":"2024-04-25T02:23:21.179276+0000","last_undegraded":"2024-04-25T02:23:21.179276+0000","last_fullsized":"2024-04-25T02:23:21.179276+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:10:23.058045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.878002+0000","last_change":"2024-04-25T02:23:13.848280+0000","last_active":"2024-04-25T02:23:20.878002+0000","last_peered":"2024-04-25T02:23:20.878002+0000","last_clean":"2024-04-25T02:23:20.878002+0000","last_became_active":"2024-04-25T02:23:13.843915+0000","last_became_peered":"2024-04-25T02:23:13.843915+0000","last_unstale":"2024-04-25T02:23:20.878002+0000","last_undegraded":"2024-04-25T02:23:20.878002+0000","last_fullsized":"2024-04-25T02:23:20.878002+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:25:56.800969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.879065+0000","last_change":"2024-04-25T02:23:13.839018+0000","last_active":"2024-04-25T02:23:20.879065+0000","last_peered":"2024-04-25T02:23:20.879065+0000","last_clean":"2024-04-25T02:23:20.879065+0000","last_became_active":"2024-04-25T02:23:13.838746+0000","last_became_peered":"2024-04-25T02:23:13.838746+0000","last_unstale":"2024-04-25T02:23:20.879065+0000","last_undegraded":"2024-04-25T02:23:20.879065+0000","last_fullsized":"2024-04-25T02:23:20.879065+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:33:00.283023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"39'4","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:21.177377+0000","last_change":"2024-04-25T02:23:11.840837+0000","last_active":"2024-04-25T02:23:21.177377+0000","last_peered":"2024-04-25T02:23:21.177377+0000","last_clean":"2024-04-25T02:23:21.177377+0000","last_became_active":"2024-04-25T02:23:11.840553+0000","last_became_peered":"2024-04-25T02:23:11.840553+0000","last_unstale":"2024-04-25T02:23:21.177377+0000","last_undegraded":"2024-04-25T02:23:21.177377+0000","last_fullsized":"2024-04-25T02:23:21.177377+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:56:05.056497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.879910+0000","last_change":"2024-04-25T02:23:13.848907+0000","last_active":"2024-04-25T02:23:20.879910+0000","last_peered":"2024-04-25T02:23:20.879910+0000","last_clean":"2024-04-25T02:23:20.879910+0000","last_became_active":"2024-04-25T02:23:13.848374+0000","last_became_peered":"2024-04-25T02:23:13.848374+0000","last_unstale":"2024-04-25T02:23:20.879910+0000","last_undegraded":"2024-04-25T02:23:20.879910+0000","last_fullsized":"2024-04-25T02:23:20.879910+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:31:18.538296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"35'11","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.880643+0000","last_change":"2024-04-25T02:23:13.842766+0000","last_active":"2024-04-25T02:23:20.880643+0000","last_peered":"2024-04-25T02:23:20.880643+0000","last_clean":"2024-04-25T02:23:20.880643+0000","last_became_active":"2024-04-25T02:23:13.842438+0000","last_became_peered":"2024-04-25T02:23:13.842438+0000","last_unstale":"2024-04-25T02:23:20.880643+0000","last_undegraded":"2024-04-25T02:23:20.880643+0000","last_fullsized":"2024-04-25T02:23:20.880643+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:25:58.471982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2244,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.880039+0000","last_change":"2024-04-25T02:23:12.844587+0000","last_active":"2024-04-25T02:23:20.880039+0000","last_peered":"2024-04-25T02:23:20.880039+0000","last_clean":"2024-04-25T02:23:20.880039+0000","last_became_active":"2024-04-25T02:23:12.844258+0000","last_became_peered":"2024-04-25T02:23:12.844258+0000","last_unstale":"2024-04-25T02:23:20.880039+0000","last_undegraded":"2024-04-25T02:23:20.880039+0000","last_fullsized":"2024-04-25T02:23:20.880039+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:32:01.305698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"17'2","reported_seq":32,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:21.178639+0000","last_change":"2024-04-25T02:23:11.833629+0000","last_active":"2024-04-25T02:23:21.178639+0000","last_peered":"2024-04-25T02:23:21.178639+0000","last_clean":"2024-04-25T02:23:21.178639+0000","last_became_active":"2024-04-25T02:23:11.833348+0000","last_became_peered":"2024-04-25T02:23:11.833348+0000","last_unstale":"2024-04-25T02:23:21.178639+0000","last_undegraded":"2024-04-25T02:23:21.178639+0000","last_fullsized":"2024-04-25T02:23:21.178639+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:10:06.587875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.880346+0000","last_change":"2024-04-25T02:23:13.847609+0000","last_active":"2024-04-25T02:23:20.880346+0000","last_peered":"2024-04-25T02:23:20.880346+0000","last_clean":"2024-04-25T02:23:20.880346+0000","last_became_active":"2024-04-25T02:23:13.846697+0000","last_became_peered":"2024-04-25T02:23:13.846697+0000","last_unstale":"2024-04-25T02:23:20.880346+0000","last_undegraded":"2024-04-25T02:23:20.880346+0000","last_fullsized":"2024-04-25T02:23:20.880346+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:43:05.950601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"17'2","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.878974+0000","last_change":"2024-04-25T02:23:13.842735+0000","last_active":"2024-04-25T02:23:20.878974+0000","last_peered":"2024-04-25T02:23:20.878974+0000","last_clean":"2024-04-25T02:23:20.878974+0000","last_became_active":"2024-04-25T02:23:13.840492+0000","last_became_peered":"2024-04-25T02:23:13.840492+0000","last_unstale":"2024-04-25T02:23:20.878974+0000","last_undegraded":"2024-04-25T02:23:20.878974+0000","last_fullsized":"2024-04-25T02:23:20.878974+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:25:52.486919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.880962+0000","last_change":"2024-04-25T02:23:13.848028+0000","last_active":"2024-04-25T02:23:20.880962+0000","last_peered":"2024-04-25T02:23:20.880962+0000","last_clean":"2024-04-25T02:23:20.880962+0000","last_became_active":"2024-04-25T02:23:13.847264+0000","last_became_peered":"2024-04-25T02:23:13.847264+0000","last_unstale":"2024-04-25T02:23:20.880962+0000","last_undegraded":"2024-04-25T02:23:20.880962+0000","last_fullsized":"2024-04-25T02:23:20.880962+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:16.329989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"35'2","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.879317+0000","last_change":"2024-04-25T02:23:13.848227+0000","last_active":"2024-04-25T02:23:20.879317+0000","last_peered":"2024-04-25T02:23:20.879317+0000","last_clean":"2024-04-25T02:23:20.879317+0000","last_became_active":"2024-04-25T02:23:13.845143+0000","last_became_peered":"2024-04-25T02:23:13.845143+0000","last_unstale":"2024-04-25T02:23:20.879317+0000","last_undegraded":"2024-04-25T02:23:20.879317+0000","last_fullsized":"2024-04-25T02:23:20.879317+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:54.494068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.878411+0000","last_change":"2024-04-25T02:23:13.841084+0000","last_active":"2024-04-25T02:23:20.878411+0000","last_peered":"2024-04-25T02:23:20.878411+0000","last_clean":"2024-04-25T02:23:20.878411+0000","last_became_active":"2024-04-25T02:23:13.839417+0000","last_became_peered":"2024-04-25T02:23:13.839417+0000","last_unstale":"2024-04-25T02:23:20.878411+0000","last_undegraded":"2024-04-25T02:23:20.878411+0000","last_fullsized":"2024-04-25T02:23:20.878411+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:23:42.358780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"35'5","reported_seq":37,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.881853+0000","last_change":"2024-04-25T02:23:11.839479+0000","last_active":"2024-04-25T02:23:20.881853+0000","last_peered":"2024-04-25T02:23:20.881853+0000","last_clean":"2024-04-25T02:23:20.881853+0000","last_became_active":"2024-04-25T02:23:11.838807+0000","last_became_peered":"2024-04-25T02:23:11.838807+0000","last_unstale":"2024-04-25T02:23:20.881853+0000","last_undegraded":"2024-04-25T02:23:20.881853+0000","last_fullsized":"2024-04-25T02:23:20.881853+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:08:41.334897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":553,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.879798+0000","last_change":"2024-04-25T02:23:12.845755+0000","last_active":"2024-04-25T02:23:20.879798+0000","last_peered":"2024-04-25T02:23:20.879798+0000","last_clean":"2024-04-25T02:23:20.879798+0000","last_became_active":"2024-04-25T02:23:12.845497+0000","last_became_peered":"2024-04-25T02:23:12.845497+0000","last_unstale":"2024-04-25T02:23:20.879798+0000","last_undegraded":"2024-04-25T02:23:20.879798+0000","last_fullsized":"2024-04-25T02:23:20.879798+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:04:37.689024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:21.178616+0000","last_change":"2024-04-25T02:23:12.847086+0000","last_active":"2024-04-25T02:23:21.178616+0000","last_peered":"2024-04-25T02:23:21.178616+0000","last_clean":"2024-04-25T02:23:21.178616+0000","last_became_active":"2024-04-25T02:23:12.846719+0000","last_became_peered":"2024-04-25T02:23:12.846719+0000","last_unstale":"2024-04-25T02:23:21.178616+0000","last_undegraded":"2024-04-25T02:23:21.178616+0000","last_fullsized":"2024-04-25T02:23:21.178616+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:19.196820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.878605+0000","last_change":"2024-04-25T02:23:13.843074+0000","last_active":"2024-04-25T02:23:20.878605+0000","last_peered":"2024-04-25T02:23:20.878605+0000","last_clean":"2024-04-25T02:23:20.878605+0000","last_became_active":"2024-04-25T02:23:13.842820+0000","last_became_peered":"2024-04-25T02:23:13.842820+0000","last_unstale":"2024-04-25T02:23:20.878605+0000","last_undegraded":"2024-04-25T02:23:20.878605+0000","last_fullsized":"2024-04-25T02:23:20.878605+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:41:56.972648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.880108+0000","last_change":"2024-04-25T02:23:13.844518+0000","last_active":"2024-04-25T02:23:20.880108+0000","last_peered":"2024-04-25T02:23:20.880108+0000","last_clean":"2024-04-25T02:23:20.880108+0000","last_became_active":"2024-04-25T02:23:13.844235+0000","last_became_peered":"2024-04-25T02:23:13.844235+0000","last_unstale":"2024-04-25T02:23:20.880108+0000","last_undegraded":"2024-04-25T02:23:20.880108+0000","last_fullsized":"2024-04-25T02:23:20.880108+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:01:33.237637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:20.878914+0000","last_change":"2024-04-25T02:23:13.849525+0000","last_active":"2024-04-25T02:23:20.878914+0000","last_peered":"2024-04-25T02:23:20.878914+0000","last_clean":"2024-04-25T02:23:20.878914+0000","last_became_active":"2024-04-25T02:23:13.845193+0000","last_became_peered":"2024-04-25T02:23:13.845193+0000","last_unstale":"2024-04-25T02:23:20.878914+0000","last_undegraded":"2024-04-25T02:23:20.878914+0000","last_fullsized":"2024-04-25T02:23:20.878914+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:17:33.318731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-25T02:23:21.178868+0000","last_change":"2024-04-25T02:23:12.842342+0000","last_active":"2024-04-25T02:23:21.178868+0000","last_peered":"2024-04-25T02:23:21.178868+0000","last_clean":"2024-04-25T02:23:21.178868+0000","last_became_active":"2024-04-25T02:23:12.841677+0000","last_became_peered":"2024-04-25T02:23:12.841677+0000","last_unstale":"2024-04-25T02:23:21.178868+0000","last_undegraded":"2024-04-25T02:23:21.178868+0000","last_fullsized":"2024-04-25T02:23:21.178868+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:27.480264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":8783,"num_objects":41,"num_object_clones":0,"num_object_copies":82,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":0,"num_read":49,"num_read_kb":55,"num_write":116,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":17566,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39115,"internal_metadata":0},"log_size":106,"ondisk_log_size":106,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":31,"seq":133143986180,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297536,"kb_used_data":372,"kb_used_omap":9,"kb_used_meta":297142,"kb_avail":94074304,"statfs":{"total":96636764160,"available":96332087296,"internally_reserved":0,"allocated":380928,"data_stored":156144,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9975,"internal_metadata":304273673},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.32400000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.313}]}]},{"osd":2,"up_from":30,"seq":128849018885,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":297460,"kb_used_data":352,"kb_used_omap":8,"kb_used_meta":297079,"kb_avail":94074380,"statfs":{"total":96636764160,"available":96332165120,"internally_reserved":0,"allocated":360448,"data_stored":157529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8387,"internal_metadata":304209725},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22700000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28399999999999997}]}]},{"osd":0,"up_from":28,"seq":120259084293,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302272,"kb_used_data":940,"kb_used_omap":15,"kb_used_meta":301296,"kb_avail":94069568,"statfs":{"total":96636764160,"available":96327237632,"internally_reserved":0,"allocated":962560,"data_stored":746356,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15790,"internal_metadata":308527698},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.218}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35999999999999999}]}]},{"osd":1,"up_from":29,"seq":124554051589,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":302248,"kb_used_data":920,"kb_used_omap":4,"kb_used_meta":301307,"kb_avail":94069592,"statfs":{"total":96636764160,"available":96327262208,"internally_reserved":0,"allocated":942080,"data_stored":743415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4963,"internal_metadata":308538525},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.222}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29099999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.317}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":3586,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15790,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4963,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":5127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8387,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":8208,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9975,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:23:27.389 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T02:23:27.389 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-25T02:23:27.389 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-25T02:23:27.389 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-25T02:23:27.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.532+0000 7ffb1890b700 1 Processor -- start 2024-04-25T02:23:27.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.532+0000 7ffb1890b700 1 -- start start 2024-04-25T02:23:27.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.533+0000 7ffb1890b700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ffb140ad900 0x7ffb1406eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:27.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.533+0000 7ffb1890b700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7ffb1406de30 0x7ffb14148b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:27.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.533+0000 7ffb1890b700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb14141ea0 con 0x7ffb14063d10 2024-04-25T02:23:27.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.533+0000 7ffb1890b700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb14141c90 con 0x7ffb1406de30 2024-04-25T02:23:27.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.533+0000 7ffb1890b700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb14068f90 con 0x7ffb140ad900 2024-04-25T02:23:27.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.533+0000 7ffb11d9b700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ffb140ad900 0x7ffb1406eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:27.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.533+0000 7ffb12d9d700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7ffb1406de30 0x7ffb14148b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:27.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.533+0000 7ffb1259c700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7ffb14063d10 0x7ffb140ad1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:33778/0 (socket says 172.21.15.111:33778) 2024-04-25T02:23:27.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.533+0000 7ffb11d9b700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ffb140ad900 0x7ffb1406eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:35680/0 (socket says 172.21.15.111:35680) 2024-04-25T02:23:27.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.533+0000 7ffb12d9d700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7ffb1406de30 0x7ffb14148b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:60586/0 (socket says 172.21.15.111:60586) 2024-04-25T02:23:27.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.533+0000 7ffb1259c700 1 -- 172.21.15.111:0/2635550325 learned_addr learned my addr 172.21.15.111:0/2635550325 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:23:27.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.533+0000 7ffb11d9b700 1 -- 172.21.15.111:0/2635550325 >> v2:172.21.15.111:3300/0 conn(0x7ffb1406de30 msgr2=0x7ffb14148b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:27.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.533+0000 7ffb11d9b700 1 --2- 172.21.15.111:0/2635550325 >> v2:172.21.15.111:3300/0 conn(0x7ffb1406de30 0x7ffb14148b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:27.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.533+0000 7ffb11d9b700 1 -- 172.21.15.111:0/2635550325 >> v1:172.21.15.111:6789/0 conn(0x7ffb14063d10 legacy=0x7ffb140ad1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:27.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.533+0000 7ffb1159a700 1 -- 172.21.15.111:0/2635550325 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1364545300 0 0) 0x7ffb14141ea0 con 0x7ffb14063d10 2024-04-25T02:23:27.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.533+0000 7ffb11d9b700 1 -- 172.21.15.111:0/2635550325 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb14069100 con 0x7ffb140ad900 2024-04-25T02:23:27.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.533+0000 7ffb12d9d700 1 --2- 172.21.15.111:0/2635550325 >> v2:172.21.15.111:3300/0 conn(0x7ffb1406de30 0x7ffb14148b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:27.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.533+0000 7ffb11d9b700 1 --2- 172.21.15.111:0/2635550325 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ffb140ad900 0x7ffb1406eb70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ffb040098e0 tx=0x7ffb040091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=263b0da8450f9513 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:27.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.534+0000 7ffb1159a700 1 -- 172.21.15.111:0/2635550325 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0400b640 con 0x7ffb140ad900 2024-04-25T02:23:27.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.534+0000 7ffb1159a700 1 -- 172.21.15.111:0/2635550325 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb0400b7a0 con 0x7ffb140ad900 2024-04-25T02:23:27.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.534+0000 7ffb1159a700 1 -- 172.21.15.111:0/2635550325 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb0400bb40 con 0x7ffb140ad900 2024-04-25T02:23:27.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.534+0000 7ffb1890b700 1 -- 172.21.15.111:0/2635550325 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ffb140ad900 msgr2=0x7ffb1406eb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:27.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.534+0000 7ffb1890b700 1 --2- 172.21.15.111:0/2635550325 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ffb140ad900 0x7ffb1406eb70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ffb040098e0 tx=0x7ffb040091a0 comp rx=0 tx=0).stop 2024-04-25T02:23:27.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.534+0000 7ffb1890b700 1 -- 172.21.15.111:0/2635550325 shutdown_connections 2024-04-25T02:23:27.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.534+0000 7ffb1890b700 1 --2- 172.21.15.111:0/2635550325 >> v2:172.21.15.111:3300/0 conn(0x7ffb1406de30 0x7ffb14148b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:27.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.534+0000 7ffb1890b700 1 --2- 172.21.15.111:0/2635550325 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ffb140ad900 0x7ffb1406eb70 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:27.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.534+0000 7ffb1890b700 1 -- 172.21.15.111:0/2635550325 >> 172.21.15.111:0/2635550325 conn(0x7ffb140b1e10 msgr2=0x7ffb140ade80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:27.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.534+0000 7ffb1890b700 1 -- 172.21.15.111:0/2635550325 shutdown_connections 2024-04-25T02:23:27.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.534+0000 7ffb1890b700 1 -- 172.21.15.111:0/2635550325 wait complete. 2024-04-25T02:23:27.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.535+0000 7ffb1890b700 1 Processor -- start 2024-04-25T02:23:27.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.535+0000 7ffb1890b700 1 -- start start 2024-04-25T02:23:27.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.536+0000 7ffb1890b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffb14063d10 0x7ffb141515c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:27.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.536+0000 7ffb1890b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ffb1406de30 0x7ffb141395c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:27.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.536+0000 7ffb1890b700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ffb14145460 0x7ffb14139b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:27.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.536+0000 7ffb1890b700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb14151b00 con 0x7ffb14063d10 2024-04-25T02:23:27.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.536+0000 7ffb1890b700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb1413a040 con 0x7ffb14145460 2024-04-25T02:23:27.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.536+0000 7ffb1890b700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb14145d20 con 0x7ffb1406de30 2024-04-25T02:23:27.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.536+0000 7ffb1259c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffb14063d10 0x7ffb141515c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:27.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.536+0000 7ffb1259c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffb14063d10 0x7ffb141515c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:60598/0 (socket says 172.21.15.111:60598) 2024-04-25T02:23:27.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.536+0000 7ffb1259c700 1 -- 172.21.15.111:0/4185912932 learned_addr learned my addr 172.21.15.111:0/4185912932 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:27.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.536+0000 7ffb11d9b700 1 --2- 172.21.15.111:0/4185912932 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ffb1406de30 0x7ffb141395c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:27.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.536+0000 7ffb12d9d700 1 --2- 172.21.15.111:0/4185912932 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ffb14145460 0x7ffb14139b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:27.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.536+0000 7ffb1259c700 1 -- 172.21.15.111:0/4185912932 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ffb1406de30 msgr2=0x7ffb141395c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:27.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.536+0000 7ffb1259c700 1 --2- 172.21.15.111:0/4185912932 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ffb1406de30 0x7ffb141395c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:27.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.536+0000 7ffb1259c700 1 -- 172.21.15.111:0/4185912932 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ffb14145460 msgr2=0x7ffb14139b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:27.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.536+0000 7ffb1259c700 1 --2- 172.21.15.111:0/4185912932 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ffb14145460 0x7ffb14139b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:27.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.536+0000 7ffb1259c700 1 -- 172.21.15.111:0/4185912932 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb0c009a20 con 0x7ffb14063d10 2024-04-25T02:23:27.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.536+0000 7ffb1259c700 1 --2- 172.21.15.111:0/4185912932 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffb14063d10 0x7ffb141515c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ffb0800c840 tx=0x7ffb08007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:27.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.536+0000 7ffb027fc700 1 -- 172.21.15.111:0/4185912932 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb08005c00 con 0x7ffb14063d10 2024-04-25T02:23:27.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.536+0000 7ffb027fc700 1 -- 172.21.15.111:0/4185912932 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb08005d60 con 0x7ffb14063d10 2024-04-25T02:23:27.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.536+0000 7ffb027fc700 1 -- 172.21.15.111:0/4185912932 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb08007320 con 0x7ffb14063d10 2024-04-25T02:23:27.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.536+0000 7ffb1890b700 1 -- 172.21.15.111:0/4185912932 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb04009420 con 0x7ffb14063d10 2024-04-25T02:23:27.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.536+0000 7ffb1890b700 1 -- 172.21.15.111:0/4185912932 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb14146b90 con 0x7ffb14063d10 2024-04-25T02:23:27.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.537+0000 7ffb027fc700 1 -- 172.21.15.111:0/4185912932 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7ffb0801b3b0 con 0x7ffb14063d10 2024-04-25T02:23:27.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.537+0000 7ffb1890b700 1 -- 172.21.15.111:0/4185912932 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb14071790 con 0x7ffb14063d10 2024-04-25T02:23:27.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.537+0000 7ffb027fc700 1 -- 172.21.15.111:0/4185912932 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7ffb0805a6e0 con 0x7ffb14063d10 2024-04-25T02:23:27.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.541+0000 7ffb027fc700 1 -- 172.21.15.111:0/4185912932 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7ffb08038960 con 0x7ffb14063d10 2024-04-25T02:23:27.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.719+0000 7ffb1890b700 1 -- 172.21.15.111:0/4185912932 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7ffb14148ea0 con 0x7ffb14063d10 2024-04-25T02:23:27.723 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.719+0000 7ffb027fc700 1 -- 172.21.15.111:0/4185912932 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7ffb08017020 con 0x7ffb14063d10 2024-04-25T02:23:27.724 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:23:27.724 INFO:teuthology.orchestra.run.smithi111.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-25T02:23:27.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.721+0000 7ffb1890b700 1 -- 172.21.15.111:0/4185912932 >> v1:172.21.15.111:6816/46482 conn(0x7ffaf4046010 legacy=0x7ffaf40484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:27.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.721+0000 7ffb1890b700 1 -- 172.21.15.111:0/4185912932 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffb14063d10 msgr2=0x7ffb141515c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:27.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.721+0000 7ffb1890b700 1 --2- 172.21.15.111:0/4185912932 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffb14063d10 0x7ffb141515c0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ffb0800c840 tx=0x7ffb08007d90 comp rx=0 tx=0).stop 2024-04-25T02:23:27.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.721+0000 7ffb1890b700 1 -- 172.21.15.111:0/4185912932 shutdown_connections 2024-04-25T02:23:27.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.721+0000 7ffb1890b700 1 --2- 172.21.15.111:0/4185912932 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ffb14145460 0x7ffb14139b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:27.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.721+0000 7ffb1890b700 1 --2- 172.21.15.111:0/4185912932 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffb14063d10 0x7ffb141515c0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:27.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.721+0000 7ffb1890b700 1 --2- 172.21.15.111:0/4185912932 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ffb1406de30 0x7ffb141395c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:27.726 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.721+0000 7ffb1890b700 1 -- 172.21.15.111:0/4185912932 >> 172.21.15.111:0/4185912932 conn(0x7ffb140b1e10 msgr2=0x7ffb140acfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:27.726 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.721+0000 7ffb1890b700 1 -- 172.21.15.111:0/4185912932 shutdown_connections 2024-04-25T02:23:27.726 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.721+0000 7ffb1890b700 1 -- 172.21.15.111:0/4185912932 wait complete. 2024-04-25T02:23:27.736 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-25T02:23:27.737 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:23:27.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.851+0000 7f13de4fb700 1 Processor -- start 2024-04-25T02:23:27.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.851+0000 7f13de4fb700 1 -- start start 2024-04-25T02:23:27.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.852+0000 7f13de4fb700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f13d80af5b0 0x7f13d81449d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:27.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.852+0000 7f13de4fb700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f13d80a6130 0x7f13d8146f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:27.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.852+0000 7f13de4fb700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13d80a2850 con 0x7f13d8067b90 2024-04-25T02:23:27.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.852+0000 7f13de4fb700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13d80a2b10 con 0x7f13d80a6130 2024-04-25T02:23:27.857 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.852+0000 7f13de4fb700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13d80a5c50 con 0x7f13d80af5b0 2024-04-25T02:23:27.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.852+0000 7f13d77fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f13d80af5b0 0x7f13d81449d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:27.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.852+0000 7f13dca98700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f13d80a6130 0x7f13d8146f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:27.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.852+0000 7f13d7fff700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f13d8067b90 0x7f13d80a3100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:33786/0 (socket says 172.21.15.111:33786) 2024-04-25T02:23:27.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.852+0000 7f13d7fff700 1 -- 172.21.15.111:0/1380732054 learned_addr learned my addr 172.21.15.111:0/1380732054 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:23:27.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.852+0000 7f13d77fe700 1 -- 172.21.15.111:0/1380732054 >> v2:172.21.15.111:3300/0 conn(0x7f13d80a6130 msgr2=0x7f13d8146f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:27.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.852+0000 7f13d77fe700 1 --2- 172.21.15.111:0/1380732054 >> v2:172.21.15.111:3300/0 conn(0x7f13d80a6130 0x7f13d8146f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:27.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.852+0000 7f13d77fe700 1 -- 172.21.15.111:0/1380732054 >> v1:172.21.15.111:6789/0 conn(0x7f13d8067b90 legacy=0x7f13d80a3100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:27.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.852+0000 7f13d77fe700 1 -- 172.21.15.111:0/1380732054 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d806c940 con 0x7f13d80af5b0 2024-04-25T02:23:27.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.852+0000 7f13d6ffd700 1 -- 172.21.15.111:0/1380732054 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1000090614 0 0) 0x7f13d80a2850 con 0x7f13d8067b90 2024-04-25T02:23:27.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.852+0000 7f13dca98700 1 --2- 172.21.15.111:0/1380732054 >> v2:172.21.15.111:3300/0 conn(0x7f13d80a6130 0x7f13d8146f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:27.858 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.852+0000 7f13d77fe700 1 --2- 172.21.15.111:0/1380732054 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f13d80af5b0 0x7f13d81449d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f13c80098e0 tx=0x7f13c80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b97c996d608a2d9b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:27.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.852+0000 7f13d6ffd700 1 -- 172.21.15.111:0/1380732054 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c800b640 con 0x7f13d80af5b0 2024-04-25T02:23:27.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.852+0000 7f13d6ffd700 1 -- 172.21.15.111:0/1380732054 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13c800b7a0 con 0x7f13d80af5b0 2024-04-25T02:23:27.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.852+0000 7f13d6ffd700 1 -- 172.21.15.111:0/1380732054 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13c800bb40 con 0x7f13d80af5b0 2024-04-25T02:23:27.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.853+0000 7f13de4fb700 1 -- 172.21.15.111:0/1380732054 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f13d80af5b0 msgr2=0x7f13d81449d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:27.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.853+0000 7f13de4fb700 1 --2- 172.21.15.111:0/1380732054 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f13d80af5b0 0x7f13d81449d0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f13c80098e0 tx=0x7f13c80091a0 comp rx=0 tx=0).stop 2024-04-25T02:23:27.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.853+0000 7f13de4fb700 1 -- 172.21.15.111:0/1380732054 shutdown_connections 2024-04-25T02:23:27.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.853+0000 7f13de4fb700 1 --2- 172.21.15.111:0/1380732054 >> v2:172.21.15.111:3300/0 conn(0x7f13d80a6130 0x7f13d8146f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:27.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.853+0000 7f13de4fb700 1 --2- 172.21.15.111:0/1380732054 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f13d80af5b0 0x7f13d81449d0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:27.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.853+0000 7f13de4fb700 1 -- 172.21.15.111:0/1380732054 >> 172.21.15.111:0/1380732054 conn(0x7f13d80b1cf0 msgr2=0x7f13d80b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:27.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.853+0000 7f13de4fb700 1 -- 172.21.15.111:0/1380732054 shutdown_connections 2024-04-25T02:23:27.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.853+0000 7f13de4fb700 1 -- 172.21.15.111:0/1380732054 wait complete. 2024-04-25T02:23:27.859 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.854+0000 7f13de4fb700 1 Processor -- start 2024-04-25T02:23:27.861 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.854+0000 7f13de4fb700 1 -- start start 2024-04-25T02:23:27.862 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.855+0000 7f13de4fb700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f13d8067b90 0x7f13d814c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:27.862 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.855+0000 7f13de4fb700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f13d80a6130 0x7f13d80ad4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:27.862 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.855+0000 7f13de4fb700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f13d80af5b0 0x7f13d8096df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:27.862 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.855+0000 7f13de4fb700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13d80ada30 con 0x7f13d8067b90 2024-04-25T02:23:27.862 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.855+0000 7f13de4fb700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13d80ae710 con 0x7f13d80af5b0 2024-04-25T02:23:27.862 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.855+0000 7f13de4fb700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f13d814c8c0 con 0x7f13d80a6130 2024-04-25T02:23:27.862 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.855+0000 7f13d7fff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f13d8067b90 0x7f13d814c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:27.862 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.855+0000 7f13dca98700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f13d80af5b0 0x7f13d8096df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:27.862 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.855+0000 7f13d7fff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f13d8067b90 0x7f13d814c2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:60614/0 (socket says 172.21.15.111:60614) 2024-04-25T02:23:27.862 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.855+0000 7f13d7fff700 1 -- 172.21.15.111:0/4185886952 learned_addr learned my addr 172.21.15.111:0/4185886952 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:27.862 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.855+0000 7f13d77fe700 1 --2- 172.21.15.111:0/4185886952 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f13d80a6130 0x7f13d80ad4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:27.862 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.855+0000 7f13d7fff700 1 -- 172.21.15.111:0/4185886952 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f13d80a6130 msgr2=0x7f13d80ad4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:27.862 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.855+0000 7f13d7fff700 1 --2- 172.21.15.111:0/4185886952 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f13d80a6130 0x7f13d80ad4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:27.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.855+0000 7f13d7fff700 1 -- 172.21.15.111:0/4185886952 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f13d80af5b0 msgr2=0x7f13d8096df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:27.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.855+0000 7f13d7fff700 1 --2- 172.21.15.111:0/4185886952 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f13d80af5b0 0x7f13d8096df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:27.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.855+0000 7f13d7fff700 1 -- 172.21.15.111:0/4185886952 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13d0009a20 con 0x7f13d8067b90 2024-04-25T02:23:27.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.855+0000 7f13dca98700 1 --2- 172.21.15.111:0/4185886952 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f13d80af5b0 0x7f13d8096df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:27.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.855+0000 7f13d7fff700 1 --2- 172.21.15.111:0/4185886952 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f13d8067b90 0x7f13d814c2e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f13cc00c560 tx=0x7f13cc000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:27.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.855+0000 7f13bffff700 1 -- 172.21.15.111:0/4185886952 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13cc005b30 con 0x7f13d8067b90 2024-04-25T02:23:27.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.855+0000 7f13bffff700 1 -- 172.21.15.111:0/4185886952 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13cc005c90 con 0x7f13d8067b90 2024-04-25T02:23:27.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.855+0000 7f13de4fb700 1 -- 172.21.15.111:0/4185886952 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13c8009420 con 0x7f13d8067b90 2024-04-25T02:23:27.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.855+0000 7f13bffff700 1 -- 172.21.15.111:0/4185886952 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f13cc007320 con 0x7f13d8067b90 2024-04-25T02:23:27.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.855+0000 7f13de4fb700 1 -- 172.21.15.111:0/4185886952 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13d8097330 con 0x7f13d8067b90 2024-04-25T02:23:27.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.856+0000 7f13de4fb700 1 -- 172.21.15.111:0/4185886952 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13d80a25a0 con 0x7f13d8067b90 2024-04-25T02:23:27.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.856+0000 7f13bffff700 1 -- 172.21.15.111:0/4185886952 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f13cc01b3b0 con 0x7f13d8067b90 2024-04-25T02:23:27.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.856+0000 7f13bffff700 1 -- 172.21.15.111:0/4185886952 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f13cc05a610 con 0x7f13d8067b90 2024-04-25T02:23:27.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:27.860+0000 7f13bffff700 1 -- 172.21.15.111:0/4185886952 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f13cc038890 con 0x7f13d8067b90 2024-04-25T02:23:28.025 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.021+0000 7f13de4fb700 1 -- 172.21.15.111:0/4185886952 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f13d8065140 con 0x7f13d8067b90 2024-04-25T02:23:28.026 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.022+0000 7f13bffff700 1 -- 172.21.15.111:0/4185886952 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11668 (secure 0 0 0) 0x7f13cc017070 con 0x7f13d8067b90 2024-04-25T02:23:28.026 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:23:28.026 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":40,"fsid":"4643f974-f93a-4436-93b8-460ff320e62e","created":"2024-04-25T02:20:05.450475+0000","modified":"2024-04-25T02:23:21.875192+0000","last_up_change":"2024-04-25T02:23:12.818028+0000","last_in_change":"2024-04-25T02:20:10.439204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:20:07.471248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:20:14.420378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:20:22.251868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T02:20:23.128289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"df3f17ca-3b12-42c8-8cf7-8f1b7189e587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":31,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6800","nonce":48862}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6801","nonce":48862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6803","nonce":48862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6802","nonce":48862}]},"public_addr":"172.21.15.111:6800/48862","cluster_addr":"172.21.15.111:6801/48862","heartbeat_back_addr":"172.21.15.111:6803/48862","heartbeat_front_addr":"172.21.15.111:6802/48862","state":["exists","up"]},{"osd":1,"uuid":"93d54815-f215-4285-bba6-32f2d1cabf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":29,"up_thru":31,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6804","nonce":48960}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6805","nonce":48960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6807","nonce":48960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6806","nonce":48960}]},"public_addr":"172.21.15.111:6804/48960","cluster_addr":"172.21.15.111:6805/48960","heartbeat_back_addr":"172.21.15.111:6807/48960","heartbeat_front_addr":"172.21.15.111:6806/48960","state":["exists","up"]},{"osd":2,"uuid":"b26b2104-2a2e-408f-9ce7-3587a32a2ebe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":31,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6808","nonce":49070}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6809","nonce":49070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6811","nonce":49070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6810","nonce":49070}]},"public_addr":"172.21.15.111:6808/49070","cluster_addr":"172.21.15.111:6809/49070","heartbeat_back_addr":"172.21.15.111:6811/49070","heartbeat_front_addr":"172.21.15.111:6810/49070","state":["exists","up"]},{"osd":3,"uuid":"43c25820-1edc-4031-badf-72e87dd6bf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":31,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6812","nonce":49243}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6813","nonce":49243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6815","nonce":49243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6814","nonce":49243}]},"public_addr":"172.21.15.111:6812/49243","cluster_addr":"172.21.15.111:6813/49243","heartbeat_back_addr":"172.21.15.111:6815/49243","heartbeat_front_addr":"172.21.15.111:6814/49243","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.372427+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.411480+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.361508+0000","dead_epoch":25},{"osd":3,"down_stamp":"2024-04-25T02:23:06.771296+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.377212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.111:6819/4003866251":"2024-04-26T02:23:16.839679+0000","172.21.15.111:0/2148931273":"2024-04-26T02:22:54.713254+0000","172.21.15.111:6816/39585":"2024-04-26T02:22:54.713254+0000","172.21.15.111:0/3911588907":"2024-04-26T02:22:54.713254+0000","172.21.15.111:0/1276843622":"2024-04-26T02:22:54.713254+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:23:28.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.024+0000 7f13de4fb700 1 -- 172.21.15.111:0/4185886952 >> v1:172.21.15.111:6816/46482 conn(0x7f13c4046010 legacy=0x7f13c40484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:28.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.024+0000 7f13de4fb700 1 -- 172.21.15.111:0/4185886952 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f13d8067b90 msgr2=0x7f13d814c2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:28.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.024+0000 7f13de4fb700 1 --2- 172.21.15.111:0/4185886952 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f13d8067b90 0x7f13d814c2e0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f13cc00c560 tx=0x7f13cc000fe0 comp rx=0 tx=0).stop 2024-04-25T02:23:28.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.024+0000 7f13de4fb700 1 -- 172.21.15.111:0/4185886952 shutdown_connections 2024-04-25T02:23:28.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.024+0000 7f13de4fb700 1 --2- 172.21.15.111:0/4185886952 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f13d80af5b0 0x7f13d8096df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:28.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.024+0000 7f13de4fb700 1 --2- 172.21.15.111:0/4185886952 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f13d8067b90 0x7f13d814c2e0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:28.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.024+0000 7f13de4fb700 1 --2- 172.21.15.111:0/4185886952 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f13d80a6130 0x7f13d80ad4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:28.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.024+0000 7f13de4fb700 1 -- 172.21.15.111:0/4185886952 >> 172.21.15.111:0/4185886952 conn(0x7f13d80b1cf0 msgr2=0x7f13d813da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:28.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.024+0000 7f13de4fb700 1 -- 172.21.15.111:0/4185886952 shutdown_connections 2024-04-25T02:23:28.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.024+0000 7f13de4fb700 1 -- 172.21.15.111:0/4185886952 wait complete. 2024-04-25T02:23:28.040 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:20:07.471248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T02:20:14.420378+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:20:22.251868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:20:23.128289+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T02:23:28.040 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:23:28.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.156+0000 7f500d3e2700 1 Processor -- start 2024-04-25T02:23:28.160 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.156+0000 7f500d3e2700 1 -- start start 2024-04-25T02:23:28.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.157+0000 7f500d3e2700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f50080a2bb0 0x7f50080a3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:28.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.157+0000 7f500d3e2700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f500813edf0 0x7f5008141bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:28.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.157+0000 7f500d3e2700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f500813f240 0x7f5008142100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:28.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.157+0000 7f500d3e2700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f500813e750 con 0x7f500813f240 2024-04-25T02:23:28.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.157+0000 7f500d3e2700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f50080a3430 con 0x7f50080a2bb0 2024-04-25T02:23:28.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.157+0000 7f500d3e2700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50080a3710 con 0x7f500813edf0 2024-04-25T02:23:28.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.157+0000 7f50067fc700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f500813edf0 0x7f5008141bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:28.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.157+0000 7f5006ffd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f50080a2bb0 0x7f50080a3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:28.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.157+0000 7f50077fe700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f500813f240 0x7f5008142100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:28.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.157+0000 7f50077fe700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f500813f240 0x7f5008142100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:60628/0 (socket says 172.21.15.111:60628) 2024-04-25T02:23:28.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.157+0000 7f50067fc700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f500813edf0 0x7f5008141bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:41296/0 (socket says 172.21.15.111:41296) 2024-04-25T02:23:28.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.157+0000 7f5006ffd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f50080a2bb0 0x7f50080a3c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:35714/0 (socket says 172.21.15.111:35714) 2024-04-25T02:23:28.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.157+0000 7f50077fe700 1 -- 172.21.15.111:0/1838113883 learned_addr learned my addr 172.21.15.111:0/1838113883 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:28.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.157+0000 7f50067fc700 1 -- 172.21.15.111:0/1838113883 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f50080a2bb0 msgr2=0x7f50080a3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:28.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.157+0000 7f50067fc700 1 --2- 172.21.15.111:0/1838113883 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f50080a2bb0 0x7f50080a3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:28.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.157+0000 7f50067fc700 1 -- 172.21.15.111:0/1838113883 >> v2:172.21.15.111:3300/0 conn(0x7f500813f240 msgr2=0x7f5008142100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:28.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.157+0000 7f50067fc700 1 --2- 172.21.15.111:0/1838113883 >> v2:172.21.15.111:3300/0 conn(0x7f500813f240 0x7f5008142100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:28.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.157+0000 7f50067fc700 1 -- 172.21.15.111:0/1838113883 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50080a1db0 con 0x7f500813edf0 2024-04-25T02:23:28.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.157+0000 7f50077fe700 1 --2- 172.21.15.111:0/1838113883 >> v2:172.21.15.111:3300/0 conn(0x7f500813f240 0x7f5008142100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:28.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.157+0000 7f5006ffd700 1 --2- 172.21.15.111:0/1838113883 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f50080a2bb0 0x7f50080a3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:28.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.157+0000 7f50067fc700 1 --2- 172.21.15.111:0/1838113883 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f500813edf0 0x7f5008141bc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8009910 tx=0x7f4ff80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1c930ee30320d594 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:28.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.157+0000 7f5005ffb700 1 -- 172.21.15.111:0/1838113883 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff8011630 con 0x7f500813edf0 2024-04-25T02:23:28.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.157+0000 7f5005ffb700 1 -- 172.21.15.111:0/1838113883 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff8011790 con 0x7f500813edf0 2024-04-25T02:23:28.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.157+0000 7f5005ffb700 1 -- 172.21.15.111:0/1838113883 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff8011b30 con 0x7f500813edf0 2024-04-25T02:23:28.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.158+0000 7f500d3e2700 1 -- 172.21.15.111:0/1838113883 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f500813edf0 msgr2=0x7f5008141bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:28.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.158+0000 7f500d3e2700 1 --2- 172.21.15.111:0/1838113883 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f500813edf0 0x7f5008141bc0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f4ff8009910 tx=0x7f4ff80091a0 comp rx=0 tx=0).stop 2024-04-25T02:23:28.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.158+0000 7f500d3e2700 1 -- 172.21.15.111:0/1838113883 shutdown_connections 2024-04-25T02:23:28.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.158+0000 7f500d3e2700 1 --2- 172.21.15.111:0/1838113883 >> v2:172.21.15.111:3300/0 conn(0x7f500813f240 0x7f5008142100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:28.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.158+0000 7f500d3e2700 1 --2- 172.21.15.111:0/1838113883 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f50080a2bb0 0x7f50080a3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:28.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.158+0000 7f500d3e2700 1 --2- 172.21.15.111:0/1838113883 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f500813edf0 0x7f5008141bc0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:28.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.158+0000 7f500d3e2700 1 -- 172.21.15.111:0/1838113883 >> 172.21.15.111:0/1838113883 conn(0x7f5008069c10 msgr2=0x7f50080635e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:28.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.158+0000 7f500d3e2700 1 -- 172.21.15.111:0/1838113883 shutdown_connections 2024-04-25T02:23:28.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.158+0000 7f500d3e2700 1 -- 172.21.15.111:0/1838113883 wait complete. 2024-04-25T02:23:28.167 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.159+0000 7f500d3e2700 1 Processor -- start 2024-04-25T02:23:28.167 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.159+0000 7f500d3e2700 1 -- start start 2024-04-25T02:23:28.167 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.160+0000 7f500d3e2700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f50080a2bb0 0x7f50080acd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:28.167 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.160+0000 7f500d3e2700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f500813edf0 0x7f50080ad5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:28.167 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.160+0000 7f500d3e2700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f500813f240 0x7f50080ae800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:28.167 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.160+0000 7f500d3e2700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50080adaf0 con 0x7f50080a2bb0 2024-04-25T02:23:28.167 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.160+0000 7f500d3e2700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f500814eb20 con 0x7f500813f240 2024-04-25T02:23:28.167 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.160+0000 7f500d3e2700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f50080ab060 con 0x7f500813edf0 2024-04-25T02:23:28.167 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.160+0000 7f50067fc700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f500813edf0 0x7f50080ad5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:28.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.160+0000 7f5006ffd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f50080a2bb0 0x7f50080acd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:28.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.160+0000 7f50067fc700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f500813edf0 0x7f50080ad5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:41304/0 (socket says 172.21.15.111:41304) 2024-04-25T02:23:28.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.160+0000 7f5006ffd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f50080a2bb0 0x7f50080acd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:60632/0 (socket says 172.21.15.111:60632) 2024-04-25T02:23:28.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.160+0000 7f50067fc700 1 -- 172.21.15.111:0/513947360 learned_addr learned my addr 172.21.15.111:0/513947360 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:28.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.160+0000 7f50077fe700 1 --2- 172.21.15.111:0/513947360 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f500813f240 0x7f50080ae800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:28.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.160+0000 7f50067fc700 1 -- 172.21.15.111:0/513947360 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f500813f240 msgr2=0x7f50080ae800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:28.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.160+0000 7f50067fc700 1 --2- 172.21.15.111:0/513947360 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f500813f240 0x7f50080ae800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:28.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.160+0000 7f50067fc700 1 -- 172.21.15.111:0/513947360 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f50080a2bb0 msgr2=0x7f50080acd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:28.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.160+0000 7f50067fc700 1 --2- 172.21.15.111:0/513947360 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f50080a2bb0 0x7f50080acd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:28.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.160+0000 7f50067fc700 1 -- 172.21.15.111:0/513947360 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ffc009420 con 0x7f500813edf0 2024-04-25T02:23:28.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.160+0000 7f5006ffd700 1 --2- 172.21.15.111:0/513947360 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f50080a2bb0 0x7f50080acd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:28.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.160+0000 7f50067fc700 1 --2- 172.21.15.111:0/513947360 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f500813edf0 0x7f50080ad5b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f50080a3850 tx=0x7f4ff8017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:28.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.160+0000 7f4feeffd700 1 -- 172.21.15.111:0/513947360 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff8000d10 con 0x7f500813edf0 2024-04-25T02:23:28.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.160+0000 7f4feeffd700 1 -- 172.21.15.111:0/513947360 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ff8011900 con 0x7f500813edf0 2024-04-25T02:23:28.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.160+0000 7f4feeffd700 1 -- 172.21.15.111:0/513947360 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ff8026430 con 0x7f500813edf0 2024-04-25T02:23:28.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.160+0000 7f500d3e2700 1 -- 172.21.15.111:0/513947360 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5000009ae0 con 0x7f500813edf0 2024-04-25T02:23:28.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.160+0000 7f500d3e2700 1 -- 172.21.15.111:0/513947360 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ff8009420 con 0x7f500813edf0 2024-04-25T02:23:28.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.161+0000 7f4feeffd700 1 -- 172.21.15.111:0/513947360 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f4ff8023030 con 0x7f500813edf0 2024-04-25T02:23:28.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.161+0000 7f500d3e2700 1 -- 172.21.15.111:0/513947360 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5008065190 con 0x7f500813edf0 2024-04-25T02:23:28.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.162+0000 7f4feeffd700 1 -- 172.21.15.111:0/513947360 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f4ff805c720 con 0x7f500813edf0 2024-04-25T02:23:28.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.165+0000 7f4feeffd700 1 -- 172.21.15.111:0/513947360 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f4ff8006320 con 0x7f500813edf0 2024-04-25T02:23:28.322 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.318+0000 7f500d3e2700 1 -- 172.21.15.111:0/513947360 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f5008140290 con 0x7f500813edf0 2024-04-25T02:23:28.322 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.319+0000 7f4feeffd700 1 -- 172.21.15.111:0/513947360 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4ff8015070 con 0x7f500813edf0 2024-04-25T02:23:28.323 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 1 2024-04-25T02:23:28.324 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.320+0000 7f500d3e2700 1 -- 172.21.15.111:0/513947360 >> v1:172.21.15.111:6816/46482 conn(0x7f4ff4046010 legacy=0x7f4ff40484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:28.324 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.320+0000 7f500d3e2700 1 -- 172.21.15.111:0/513947360 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f500813edf0 msgr2=0x7f50080ad5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:28.325 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.320+0000 7f500d3e2700 1 --2- 172.21.15.111:0/513947360 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f500813edf0 0x7f50080ad5b0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f50080a3850 tx=0x7f4ff8017000 comp rx=0 tx=0).stop 2024-04-25T02:23:28.325 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.320+0000 7f500d3e2700 1 -- 172.21.15.111:0/513947360 shutdown_connections 2024-04-25T02:23:28.325 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.320+0000 7f500d3e2700 1 --2- 172.21.15.111:0/513947360 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f500813f240 0x7f50080ae800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:28.325 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.320+0000 7f500d3e2700 1 --2- 172.21.15.111:0/513947360 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f50080a2bb0 0x7f50080acd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:28.325 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.320+0000 7f500d3e2700 1 --2- 172.21.15.111:0/513947360 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f500813edf0 0x7f50080ad5b0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:28.325 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.320+0000 7f500d3e2700 1 -- 172.21.15.111:0/513947360 >> 172.21.15.111:0/513947360 conn(0x7f5008069c10 msgr2=0x7f500813f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:28.325 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.320+0000 7f500d3e2700 1 -- 172.21.15.111:0/513947360 shutdown_connections 2024-04-25T02:23:28.325 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.320+0000 7f500d3e2700 1 -- 172.21.15.111:0/513947360 wait complete. 2024-04-25T02:23:28.336 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T02:23:28.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.450+0000 7f5dede28700 1 Processor -- start 2024-04-25T02:23:28.454 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.450+0000 7f5dede28700 1 -- start start 2024-04-25T02:23:28.457 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.451+0000 7f5dede28700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5de806fb50 0x7f5de813b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:28.457 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.451+0000 7f5dede28700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5de813b6c0 0x7f5de8145810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:28.457 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.451+0000 7f5dede28700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5de81388f0 con 0x7f5de8063cf0 2024-04-25T02:23:28.457 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.451+0000 7f5dede28700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de813bb50 con 0x7f5de806fb50 2024-04-25T02:23:28.457 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.451+0000 7f5dede28700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5de813bdf0 con 0x7f5de813b6c0 2024-04-25T02:23:28.457 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.451+0000 7f5de6ffd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5de806fb50 0x7f5de813b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:28.457 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.451+0000 7f5de7fff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5de813b6c0 0x7f5de8145810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:28.458 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.451+0000 7f5de77fe700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f5de8063cf0 0x7f5de81381e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:33788/0 (socket says 172.21.15.111:33788) 2024-04-25T02:23:28.458 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.451+0000 7f5de77fe700 1 -- 172.21.15.111:0/1670081865 learned_addr learned my addr 172.21.15.111:0/1670081865 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:23:28.458 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.451+0000 7f5de67fc700 1 -- 172.21.15.111:0/1670081865 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 365914057 0 0) 0x7f5de81388f0 con 0x7f5de8063cf0 2024-04-25T02:23:28.458 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.451+0000 7f5de7fff700 1 -- 172.21.15.111:0/1670081865 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5de806fb50 msgr2=0x7f5de813b180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:28.458 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.451+0000 7f5de7fff700 1 --2- 172.21.15.111:0/1670081865 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5de806fb50 0x7f5de813b180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:28.458 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.451+0000 7f5de7fff700 1 -- 172.21.15.111:0/1670081865 >> v1:172.21.15.111:6789/0 conn(0x7f5de8063cf0 legacy=0x7f5de81381e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:28.458 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.451+0000 7f5de7fff700 1 -- 172.21.15.111:0/1670081865 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de806ee80 con 0x7f5de813b6c0 2024-04-25T02:23:28.458 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.451+0000 7f5de6ffd700 1 --2- 172.21.15.111:0/1670081865 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5de806fb50 0x7f5de813b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:28.458 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.452+0000 7f5de7fff700 1 --2- 172.21.15.111:0/1670081865 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5de813b6c0 0x7f5de8145810 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5de0009e90 tx=0x7f5de0009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4f3c4dfec3596096 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:28.458 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.452+0000 7f5de67fc700 1 -- 172.21.15.111:0/1670081865 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de000e070 con 0x7f5de813b6c0 2024-04-25T02:23:28.458 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.452+0000 7f5de67fc700 1 -- 172.21.15.111:0/1670081865 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de000bc30 con 0x7f5de813b6c0 2024-04-25T02:23:28.458 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.452+0000 7f5de67fc700 1 -- 172.21.15.111:0/1670081865 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de0012430 con 0x7f5de813b6c0 2024-04-25T02:23:28.458 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.452+0000 7f5dede28700 1 -- 172.21.15.111:0/1670081865 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5de813b6c0 msgr2=0x7f5de8145810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:28.459 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.452+0000 7f5dede28700 1 --2- 172.21.15.111:0/1670081865 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5de813b6c0 0x7f5de8145810 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f5de0009e90 tx=0x7f5de0009780 comp rx=0 tx=0).stop 2024-04-25T02:23:28.459 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.452+0000 7f5dede28700 1 -- 172.21.15.111:0/1670081865 shutdown_connections 2024-04-25T02:23:28.459 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.452+0000 7f5dede28700 1 --2- 172.21.15.111:0/1670081865 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5de813b6c0 0x7f5de8145810 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:28.459 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.452+0000 7f5dede28700 1 --2- 172.21.15.111:0/1670081865 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5de806fb50 0x7f5de813b180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:28.459 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.452+0000 7f5dede28700 1 -- 172.21.15.111:0/1670081865 >> 172.21.15.111:0/1670081865 conn(0x7f5de80b1e80 msgr2=0x7f5de80adef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:28.459 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.452+0000 7f5dede28700 1 -- 172.21.15.111:0/1670081865 shutdown_connections 2024-04-25T02:23:28.459 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.452+0000 7f5dede28700 1 -- 172.21.15.111:0/1670081865 wait complete. 2024-04-25T02:23:28.459 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.453+0000 7f5dede28700 1 Processor -- start 2024-04-25T02:23:28.459 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.453+0000 7f5dede28700 1 -- start start 2024-04-25T02:23:28.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.454+0000 7f5dede28700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5de8063cf0 0x7f5de813ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:28.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.454+0000 7f5dede28700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5de806fb50 0x7f5de80a94f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:28.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.454+0000 7f5dede28700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5de813b6c0 0x7f5de80abdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:28.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.454+0000 7f5dede28700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de80aa360 con 0x7f5de8063cf0 2024-04-25T02:23:28.461 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.454+0000 7f5dede28700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de80a9bb0 con 0x7f5de813b6c0 2024-04-25T02:23:28.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.454+0000 7f5dede28700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5de80a9e50 con 0x7f5de806fb50 2024-04-25T02:23:28.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.454+0000 7f5de6ffd700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5de806fb50 0x7f5de80a94f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:28.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.454+0000 7f5de77fe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5de8063cf0 0x7f5de813ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:28.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.454+0000 7f5de7fff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5de813b6c0 0x7f5de80abdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:28.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.454+0000 7f5de6ffd700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5de806fb50 0x7f5de80a94f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:41328/0 (socket says 172.21.15.111:41328) 2024-04-25T02:23:28.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.454+0000 7f5de6ffd700 1 -- 172.21.15.111:0/2543042281 learned_addr learned my addr 172.21.15.111:0/2543042281 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:28.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.454+0000 7f5de6ffd700 1 -- 172.21.15.111:0/2543042281 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5de813b6c0 msgr2=0x7f5de80abdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:28.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.454+0000 7f5de6ffd700 1 --2- 172.21.15.111:0/2543042281 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5de813b6c0 0x7f5de80abdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:28.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.454+0000 7f5de6ffd700 1 -- 172.21.15.111:0/2543042281 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5de8063cf0 msgr2=0x7f5de813ec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:28.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.454+0000 7f5de6ffd700 1 --2- 172.21.15.111:0/2543042281 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5de8063cf0 0x7f5de813ec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:28.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.454+0000 7f5de6ffd700 1 -- 172.21.15.111:0/2543042281 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd8009420 con 0x7f5de806fb50 2024-04-25T02:23:28.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.454+0000 7f5de6ffd700 1 --2- 172.21.15.111:0/2543042281 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5de806fb50 0x7f5de80a94f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5dd800ec50 tx=0x7f5dd80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:28.463 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.454+0000 7f5dcf7fe700 1 -- 172.21.15.111:0/2543042281 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd800c8e0 con 0x7f5de806fb50 2024-04-25T02:23:28.463 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.455+0000 7f5dcf7fe700 1 -- 172.21.15.111:0/2543042281 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd800ca40 con 0x7f5de806fb50 2024-04-25T02:23:28.463 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.455+0000 7f5dede28700 1 -- 172.21.15.111:0/2543042281 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5de0009a20 con 0x7f5de806fb50 2024-04-25T02:23:28.463 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.455+0000 7f5dcf7fe700 1 -- 172.21.15.111:0/2543042281 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd800cde0 con 0x7f5de806fb50 2024-04-25T02:23:28.463 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.455+0000 7f5dede28700 1 -- 172.21.15.111:0/2543042281 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5de80a79a0 con 0x7f5de806fb50 2024-04-25T02:23:28.463 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.455+0000 7f5dcf7fe700 1 -- 172.21.15.111:0/2543042281 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f5dd8013680 con 0x7f5de806fb50 2024-04-25T02:23:28.463 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.456+0000 7f5dede28700 1 -- 172.21.15.111:0/2543042281 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5de8065190 con 0x7f5de806fb50 2024-04-25T02:23:28.463 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.456+0000 7f5dcf7fe700 1 -- 172.21.15.111:0/2543042281 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f5dd805b530 con 0x7f5de806fb50 2024-04-25T02:23:28.463 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.459+0000 7f5dcf7fe700 1 -- 172.21.15.111:0/2543042281 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f5dd8039750 con 0x7f5de806fb50 2024-04-25T02:23:28.617 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.613+0000 7f5dede28700 1 -- 172.21.15.111:0/2543042281 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f5de80ab450 con 0x7f5de806fb50 2024-04-25T02:23:28.617 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.613+0000 7f5dcf7fe700 1 -- 172.21.15.111:0/2543042281 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v40) v1 ==== 92+0+10 (secure 0 0 0) 0x7f5dd803cf40 con 0x7f5de806fb50 2024-04-25T02:23:28.617 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 8 2024-04-25T02:23:28.619 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.615+0000 7f5dede28700 1 -- 172.21.15.111:0/2543042281 >> v1:172.21.15.111:6816/46482 conn(0x7f5dd4046010 legacy=0x7f5dd40484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:28.619 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.615+0000 7f5dede28700 1 -- 172.21.15.111:0/2543042281 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5de806fb50 msgr2=0x7f5de80a94f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:28.619 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.615+0000 7f5dede28700 1 --2- 172.21.15.111:0/2543042281 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5de806fb50 0x7f5de80a94f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f5dd800ec50 tx=0x7f5dd80091a0 comp rx=0 tx=0).stop 2024-04-25T02:23:28.619 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.615+0000 7f5dede28700 1 -- 172.21.15.111:0/2543042281 shutdown_connections 2024-04-25T02:23:28.619 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.615+0000 7f5dede28700 1 --2- 172.21.15.111:0/2543042281 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5de813b6c0 0x7f5de80abdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:28.619 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.615+0000 7f5dede28700 1 --2- 172.21.15.111:0/2543042281 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5de8063cf0 0x7f5de813ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:28.619 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.615+0000 7f5dede28700 1 --2- 172.21.15.111:0/2543042281 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5de806fb50 0x7f5de80a94f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:28.619 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.615+0000 7f5dede28700 1 -- 172.21.15.111:0/2543042281 >> 172.21.15.111:0/2543042281 conn(0x7f5de80b1e80 msgr2=0x7f5de813a0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:28.620 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.615+0000 7f5dede28700 1 -- 172.21.15.111:0/2543042281 shutdown_connections 2024-04-25T02:23:28.620 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.615+0000 7f5dede28700 1 -- 172.21.15.111:0/2543042281 wait complete. 2024-04-25T02:23:28.632 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:23:28.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.747+0000 7f6b4d712700 1 Processor -- start 2024-04-25T02:23:28.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.747+0000 7f6b4d712700 1 -- start start 2024-04-25T02:23:28.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.747+0000 7f6b4d712700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6b48068210 0x7f6b480a5320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:28.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.747+0000 7f6b4d712700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6b481403e0 0x7f6b48146a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:28.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.747+0000 7f6b4d712700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b480685e0 con 0x7f6b4813ffd0 2024-04-25T02:23:28.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.748+0000 7f6b4d712700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4813f900 con 0x7f6b48068210 2024-04-25T02:23:28.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.748+0000 7f6b4d712700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4813fba0 con 0x7f6b481403e0 2024-04-25T02:23:28.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.748+0000 7f6b46ffd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6b48068210 0x7f6b480a5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:28.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.748+0000 7f6b477fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6b481403e0 0x7f6b48146a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:28.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.748+0000 7f6b467fc700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f6b4813ffd0 0x7f6b480a6e40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:33792/0 (socket says 172.21.15.111:33792) 2024-04-25T02:23:28.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.748+0000 7f6b467fc700 1 -- 172.21.15.111:0/25233631 learned_addr learned my addr 172.21.15.111:0/25233631 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:23:28.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.748+0000 7f6b45ffb700 1 -- 172.21.15.111:0/25233631 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 601594846 0 0) 0x7f6b480685e0 con 0x7f6b4813ffd0 2024-04-25T02:23:28.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.748+0000 7f6b45ffb700 1 -- 172.21.15.111:0/25233631 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b30003570 con 0x7f6b4813ffd0 2024-04-25T02:23:28.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.748+0000 7f6b46ffd700 1 -- 172.21.15.111:0/25233631 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6b481403e0 msgr2=0x7f6b48146a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:28.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.748+0000 7f6b46ffd700 1 --2- 172.21.15.111:0/25233631 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6b481403e0 0x7f6b48146a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:28.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.748+0000 7f6b46ffd700 1 -- 172.21.15.111:0/25233631 >> v1:172.21.15.111:6789/0 conn(0x7f6b4813ffd0 legacy=0x7f6b480a6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:28.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.748+0000 7f6b46ffd700 1 -- 172.21.15.111:0/25233631 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b480a5e10 con 0x7f6b48068210 2024-04-25T02:23:28.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.748+0000 7f6b477fe700 1 --2- 172.21.15.111:0/25233631 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6b481403e0 0x7f6b48146a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:28.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.748+0000 7f6b46ffd700 1 --2- 172.21.15.111:0/25233631 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6b48068210 0x7f6b480a5320 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c009910 tx=0x7f6b3c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6f02c90683ae297e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:28.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.748+0000 7f6b45ffb700 1 -- 172.21.15.111:0/25233631 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c00b690 con 0x7f6b48068210 2024-04-25T02:23:28.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.748+0000 7f6b45ffb700 1 -- 172.21.15.111:0/25233631 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b3c00b7f0 con 0x7f6b48068210 2024-04-25T02:23:28.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.748+0000 7f6b45ffb700 1 -- 172.21.15.111:0/25233631 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c00bb90 con 0x7f6b48068210 2024-04-25T02:23:28.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.749+0000 7f6b4d712700 1 -- 172.21.15.111:0/25233631 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6b48068210 msgr2=0x7f6b480a5320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:28.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.749+0000 7f6b4d712700 1 --2- 172.21.15.111:0/25233631 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6b48068210 0x7f6b480a5320 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c009910 tx=0x7f6b3c0091a0 comp rx=0 tx=0).stop 2024-04-25T02:23:28.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.749+0000 7f6b4d712700 1 -- 172.21.15.111:0/25233631 shutdown_connections 2024-04-25T02:23:28.755 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.749+0000 7f6b4d712700 1 --2- 172.21.15.111:0/25233631 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6b481403e0 0x7f6b48146a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:28.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.749+0000 7f6b4d712700 1 --2- 172.21.15.111:0/25233631 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6b48068210 0x7f6b480a5320 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:28.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.749+0000 7f6b4d712700 1 -- 172.21.15.111:0/25233631 >> 172.21.15.111:0/25233631 conn(0x7f6b4806bfb0 msgr2=0x7f6b48067940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:28.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.749+0000 7f6b4d712700 1 -- 172.21.15.111:0/25233631 shutdown_connections 2024-04-25T02:23:28.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.749+0000 7f6b4d712700 1 -- 172.21.15.111:0/25233631 wait complete. 2024-04-25T02:23:28.758 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.750+0000 7f6b4d712700 1 Processor -- start 2024-04-25T02:23:28.758 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.750+0000 7f6b4d712700 1 -- start start 2024-04-25T02:23:28.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.750+0000 7f6b4d712700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6b48068210 0x7f6b4814f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:28.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.750+0000 7f6b4d712700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6b4813ffd0 0x7f6b480adb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:28.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.750+0000 7f6b4d712700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6b480977f0 0x7f6b480ae050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:28.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.750+0000 7f6b4d712700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b480ab320 con 0x7f6b4813ffd0 2024-04-25T02:23:28.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.750+0000 7f6b4d712700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4814fee0 con 0x7f6b48068210 2024-04-25T02:23:28.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.750+0000 7f6b4d712700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6b480a2c20 con 0x7f6b480977f0 2024-04-25T02:23:28.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.751+0000 7f6b46ffd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6b48068210 0x7f6b4814f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:28.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.751+0000 7f6b467fc700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6b4813ffd0 0x7f6b480adb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:28.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.751+0000 7f6b46ffd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6b48068210 0x7f6b4814f510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:35762/0 (socket says 172.21.15.111:35762) 2024-04-25T02:23:28.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.751+0000 7f6b467fc700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6b4813ffd0 0x7f6b480adb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:60646/0 (socket says 172.21.15.111:60646) 2024-04-25T02:23:28.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.751+0000 7f6b46ffd700 1 -- 172.21.15.111:0/126779691 learned_addr learned my addr 172.21.15.111:0/126779691 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:28.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.751+0000 7f6b477fe700 1 --2- 172.21.15.111:0/126779691 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6b480977f0 0x7f6b480ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:28.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.751+0000 7f6b46ffd700 1 -- 172.21.15.111:0/126779691 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6b480977f0 msgr2=0x7f6b480ae050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:28.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.751+0000 7f6b46ffd700 1 --2- 172.21.15.111:0/126779691 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6b480977f0 0x7f6b480ae050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:28.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.751+0000 7f6b46ffd700 1 -- 172.21.15.111:0/126779691 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6b4813ffd0 msgr2=0x7f6b480adb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:28.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.751+0000 7f6b46ffd700 1 --2- 172.21.15.111:0/126779691 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6b4813ffd0 0x7f6b480adb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:28.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.751+0000 7f6b46ffd700 1 -- 172.21.15.111:0/126779691 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b40009a20 con 0x7f6b48068210 2024-04-25T02:23:28.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.751+0000 7f6b467fc700 1 --2- 172.21.15.111:0/126779691 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6b4813ffd0 0x7f6b480adb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:28.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.751+0000 7f6b46ffd700 1 --2- 172.21.15.111:0/126779691 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6b48068210 0x7f6b4814f510 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6b480a3c80 tx=0x7f6b3c017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:28.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.751+0000 7f6b2effd700 1 -- 172.21.15.111:0/126779691 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c000d10 con 0x7f6b48068210 2024-04-25T02:23:28.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.751+0000 7f6b2effd700 1 -- 172.21.15.111:0/126779691 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b3c00bb70 con 0x7f6b48068210 2024-04-25T02:23:28.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.751+0000 7f6b4d712700 1 -- 172.21.15.111:0/126779691 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b3c009420 con 0x7f6b48068210 2024-04-25T02:23:28.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.751+0000 7f6b2effd700 1 -- 172.21.15.111:0/126779691 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b3c011650 con 0x7f6b48068210 2024-04-25T02:23:28.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.751+0000 7f6b4d712700 1 -- 172.21.15.111:0/126779691 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b4814fa50 con 0x7f6b48068210 2024-04-25T02:23:28.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.752+0000 7f6b4d712700 1 -- 172.21.15.111:0/126779691 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b4814fca0 con 0x7f6b48068210 2024-04-25T02:23:28.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.752+0000 7f6b2effd700 1 -- 172.21.15.111:0/126779691 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f6b3c011a80 con 0x7f6b48068210 2024-04-25T02:23:28.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.752+0000 7f6b2effd700 1 -- 172.21.15.111:0/126779691 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f6b3c05ca50 con 0x7f6b48068210 2024-04-25T02:23:28.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.756+0000 7f6b2effd700 1 -- 172.21.15.111:0/126779691 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f6b4814fca0 con 0x7f6b48068210 2024-04-25T02:23:28.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.916+0000 7f6b4d712700 1 -- 172.21.15.111:0/126779691 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6b4814fca0 con 0x7f6b48068210 2024-04-25T02:23:28.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.916+0000 7f6b2effd700 1 -- 172.21.15.111:0/126779691 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6b4814fca0 con 0x7f6b48068210 2024-04-25T02:23:28.920 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 32 2024-04-25T02:23:28.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.918+0000 7f6b4d712700 1 -- 172.21.15.111:0/126779691 >> v1:172.21.15.111:6816/46482 conn(0x7f6b34046010 legacy=0x7f6b340484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:28.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.918+0000 7f6b4d712700 1 -- 172.21.15.111:0/126779691 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6b48068210 msgr2=0x7f6b4814f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:28.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.918+0000 7f6b4d712700 1 --2- 172.21.15.111:0/126779691 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6b48068210 0x7f6b4814f510 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f6b480a3c80 tx=0x7f6b3c017000 comp rx=0 tx=0).stop 2024-04-25T02:23:28.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.918+0000 7f6b4d712700 1 -- 172.21.15.111:0/126779691 shutdown_connections 2024-04-25T02:23:28.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.918+0000 7f6b4d712700 1 --2- 172.21.15.111:0/126779691 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6b480977f0 0x7f6b480ae050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:28.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.918+0000 7f6b4d712700 1 --2- 172.21.15.111:0/126779691 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6b48068210 0x7f6b4814f510 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:28.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.918+0000 7f6b4d712700 1 --2- 172.21.15.111:0/126779691 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6b4813ffd0 0x7f6b480adb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:28.922 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.918+0000 7f6b4d712700 1 -- 172.21.15.111:0/126779691 >> 172.21.15.111:0/126779691 conn(0x7f6b4806bfb0 msgr2=0x7f6b4813e6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:28.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.918+0000 7f6b4d712700 1 -- 172.21.15.111:0/126779691 shutdown_connections 2024-04-25T02:23:28.923 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:28.918+0000 7f6b4d712700 1 -- 172.21.15.111:0/126779691 wait complete. 2024-04-25T02:23:28.934 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:23:29.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.048+0000 7fb132640700 1 Processor -- start 2024-04-25T02:23:29.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.048+0000 7fb132640700 1 -- start start 2024-04-25T02:23:29.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.049+0000 7fb132640700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fb12c13b090 0x7fb12c143240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:29.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.049+0000 7fb132640700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb12c13b4e0 0x7fb12c145790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:29.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.049+0000 7fb132640700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb12c13a9c0 con 0x7fb12c06e380 2024-04-25T02:23:29.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.049+0000 7fb132640700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb12c06dca0 con 0x7fb12c13b090 2024-04-25T02:23:29.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.049+0000 7fb132640700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb12c0ac6a0 con 0x7fb12c13b4e0 2024-04-25T02:23:29.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.049+0000 7fb130bdd700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb12c13b4e0 0x7fb12c145790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:29.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.049+0000 7fb12b7fe700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fb12c13b090 0x7fb12c143240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:29.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.049+0000 7fb12bfff700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7fb12c06e380 0x7fb12c06ed40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:33794/0 (socket says 172.21.15.111:33794) 2024-04-25T02:23:29.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.049+0000 7fb12b7fe700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fb12c13b090 0x7fb12c143240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:60654/0 (socket says 172.21.15.111:60654) 2024-04-25T02:23:29.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.049+0000 7fb130bdd700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb12c13b4e0 0x7fb12c145790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:41360/0 (socket says 172.21.15.111:41360) 2024-04-25T02:23:29.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.049+0000 7fb12bfff700 1 -- 172.21.15.111:0/3640882335 learned_addr learned my addr 172.21.15.111:0/3640882335 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:23:29.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.049+0000 7fb130bdd700 1 -- 172.21.15.111:0/3640882335 >> v2:172.21.15.111:3300/0 conn(0x7fb12c13b090 msgr2=0x7fb12c143240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:29.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.049+0000 7fb130bdd700 1 --2- 172.21.15.111:0/3640882335 >> v2:172.21.15.111:3300/0 conn(0x7fb12c13b090 0x7fb12c143240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:29.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.049+0000 7fb130bdd700 1 -- 172.21.15.111:0/3640882335 >> v1:172.21.15.111:6789/0 conn(0x7fb12c06e380 legacy=0x7fb12c06ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:29.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.049+0000 7fb130bdd700 1 -- 172.21.15.111:0/3640882335 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb12c13ac40 con 0x7fb12c13b4e0 2024-04-25T02:23:29.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.049+0000 7fb12b7fe700 1 --2- 172.21.15.111:0/3640882335 >> v2:172.21.15.111:3300/0 conn(0x7fb12c13b090 0x7fb12c143240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:29.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.049+0000 7fb130bdd700 1 --2- 172.21.15.111:0/3640882335 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb12c13b4e0 0x7fb12c145790 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb12400af70 tx=0x7fb12400a890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a178c23c784f8c29 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:29.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.049+0000 7fb12affd700 1 -- 172.21.15.111:0/3640882335 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12400f070 con 0x7fb12c13b4e0 2024-04-25T02:23:29.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.050+0000 7fb12affd700 1 -- 172.21.15.111:0/3640882335 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb12400a2e0 con 0x7fb12c13b4e0 2024-04-25T02:23:29.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.050+0000 7fb12affd700 1 -- 172.21.15.111:0/3640882335 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb12400cc70 con 0x7fb12c13b4e0 2024-04-25T02:23:29.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.050+0000 7fb132640700 1 -- 172.21.15.111:0/3640882335 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb12c13b4e0 msgr2=0x7fb12c145790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:29.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.050+0000 7fb132640700 1 --2- 172.21.15.111:0/3640882335 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb12c13b4e0 0x7fb12c145790 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fb12400af70 tx=0x7fb12400a890 comp rx=0 tx=0).stop 2024-04-25T02:23:29.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.050+0000 7fb132640700 1 -- 172.21.15.111:0/3640882335 shutdown_connections 2024-04-25T02:23:29.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.050+0000 7fb132640700 1 --2- 172.21.15.111:0/3640882335 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb12c13b4e0 0x7fb12c145790 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:29.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.050+0000 7fb132640700 1 --2- 172.21.15.111:0/3640882335 >> v2:172.21.15.111:3300/0 conn(0x7fb12c13b090 0x7fb12c143240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:29.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.050+0000 7fb132640700 1 -- 172.21.15.111:0/3640882335 >> 172.21.15.111:0/3640882335 conn(0x7fb12c0b1400 msgr2=0x7fb12c0b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:29.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.050+0000 7fb132640700 1 -- 172.21.15.111:0/3640882335 shutdown_connections 2024-04-25T02:23:29.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.050+0000 7fb132640700 1 -- 172.21.15.111:0/3640882335 wait complete. 2024-04-25T02:23:29.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.051+0000 7fb132640700 1 Processor -- start 2024-04-25T02:23:29.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.051+0000 7fb132640700 1 -- start start 2024-04-25T02:23:29.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.052+0000 7fb132640700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb12c06e380 0x7fb12c0a9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:29.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.052+0000 7fb132640700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb12c13b090 0x7fb12c0a54e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:29.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.052+0000 7fb132640700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb12c13b4e0 0x7fb12c0a5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:29.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.052+0000 7fb132640700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb12c0a8e30 con 0x7fb12c13b4e0 2024-04-25T02:23:29.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.052+0000 7fb132640700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb12c0a6f70 con 0x7fb12c13b090 2024-04-25T02:23:29.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.052+0000 7fb132640700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb12c0a71d0 con 0x7fb12c06e380 2024-04-25T02:23:29.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.052+0000 7fb12bfff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb12c06e380 0x7fb12c0a9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:29.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.052+0000 7fb130bdd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb12c13b4e0 0x7fb12c0a5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:29.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.052+0000 7fb12bfff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb12c06e380 0x7fb12c0a9610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:41374/0 (socket says 172.21.15.111:41374) 2024-04-25T02:23:29.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.052+0000 7fb12b7fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb12c13b090 0x7fb12c0a54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:29.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.052+0000 7fb12bfff700 1 -- 172.21.15.111:0/3698385070 learned_addr learned my addr 172.21.15.111:0/3698385070 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:29.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.052+0000 7fb12bfff700 1 -- 172.21.15.111:0/3698385070 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb12c13b090 msgr2=0x7fb12c0a54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:29.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.052+0000 7fb12bfff700 1 --2- 172.21.15.111:0/3698385070 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb12c13b090 0x7fb12c0a54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:29.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.052+0000 7fb12bfff700 1 -- 172.21.15.111:0/3698385070 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb12c13b4e0 msgr2=0x7fb12c0a5a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:29.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.052+0000 7fb12bfff700 1 --2- 172.21.15.111:0/3698385070 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb12c13b4e0 0x7fb12c0a5a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:29.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.052+0000 7fb12bfff700 1 -- 172.21.15.111:0/3698385070 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb11c009420 con 0x7fb12c06e380 2024-04-25T02:23:29.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.052+0000 7fb12bfff700 1 --2- 172.21.15.111:0/3698385070 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb12c06e380 0x7fb12c0a9610 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb12000c7c0 tx=0x7fb120007f70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:29.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.052+0000 7fb113fff700 1 -- 172.21.15.111:0/3698385070 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb120005b30 con 0x7fb12c06e380 2024-04-25T02:23:29.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.052+0000 7fb113fff700 1 -- 172.21.15.111:0/3698385070 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb120005c90 con 0x7fb12c06e380 2024-04-25T02:23:29.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.052+0000 7fb132640700 1 -- 172.21.15.111:0/3698385070 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb12400ab30 con 0x7fb12c06e380 2024-04-25T02:23:29.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.052+0000 7fb113fff700 1 -- 172.21.15.111:0/3698385070 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb120004a80 con 0x7fb12c06e380 2024-04-25T02:23:29.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.053+0000 7fb132640700 1 -- 172.21.15.111:0/3698385070 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb12c0a9d60 con 0x7fb12c06e380 2024-04-25T02:23:29.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.053+0000 7fb113fff700 1 -- 172.21.15.111:0/3698385070 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7fb1200070d0 con 0x7fb12c06e380 2024-04-25T02:23:29.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.054+0000 7fb132640700 1 -- 172.21.15.111:0/3698385070 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb12c065190 con 0x7fb12c06e380 2024-04-25T02:23:29.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.054+0000 7fb113fff700 1 -- 172.21.15.111:0/3698385070 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fb12005a4f0 con 0x7fb12c06e380 2024-04-25T02:23:29.062 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.057+0000 7fb113fff700 1 -- 172.21.15.111:0/3698385070 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fb1200388e0 con 0x7fb12c06e380 2024-04-25T02:23:29.217 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.213+0000 7fb132640700 1 -- 172.21.15.111:0/3698385070 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb12c0b2240 con 0x7fb12c06e380 2024-04-25T02:23:29.217 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.213+0000 7fb113fff700 1 -- 172.21.15.111:0/3698385070 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb120005e00 con 0x7fb12c06e380 2024-04-25T02:23:29.217 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 64 2024-04-25T02:23:29.219 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.215+0000 7fb132640700 1 -- 172.21.15.111:0/3698385070 >> v1:172.21.15.111:6816/46482 conn(0x7fb118046040 legacy=0x7fb1180484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:29.219 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.215+0000 7fb132640700 1 -- 172.21.15.111:0/3698385070 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb12c06e380 msgr2=0x7fb12c0a9610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:29.219 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.215+0000 7fb132640700 1 --2- 172.21.15.111:0/3698385070 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb12c06e380 0x7fb12c0a9610 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fb12000c7c0 tx=0x7fb120007f70 comp rx=0 tx=0).stop 2024-04-25T02:23:29.219 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.215+0000 7fb132640700 1 -- 172.21.15.111:0/3698385070 shutdown_connections 2024-04-25T02:23:29.219 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.215+0000 7fb132640700 1 --2- 172.21.15.111:0/3698385070 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb12c13b4e0 0x7fb12c0a5a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:29.219 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.215+0000 7fb132640700 1 --2- 172.21.15.111:0/3698385070 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb12c06e380 0x7fb12c0a9610 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:29.219 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.215+0000 7fb132640700 1 --2- 172.21.15.111:0/3698385070 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb12c13b090 0x7fb12c0a54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:29.220 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.215+0000 7fb132640700 1 -- 172.21.15.111:0/3698385070 >> 172.21.15.111:0/3698385070 conn(0x7fb12c0b1400 msgr2=0x7fb12c0b17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:29.220 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.215+0000 7fb132640700 1 -- 172.21.15.111:0/3698385070 shutdown_connections 2024-04-25T02:23:29.220 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.215+0000 7fb132640700 1 -- 172.21.15.111:0/3698385070 wait complete. 2024-04-25T02:23:29.231 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:23:29.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.342+0000 7f88a3097700 1 Processor -- start 2024-04-25T02:23:29.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.342+0000 7f88a3097700 1 -- start start 2024-04-25T02:23:29.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.343+0000 7f88a3097700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f889c0a4e80 0x7f889c1465b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:29.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.343+0000 7f88a3097700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f889c146af0 0x7f889c148ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:29.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.343+0000 7f88a3097700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f889c068de0 con 0x7f889c06a820 2024-04-25T02:23:29.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.343+0000 7f88a3097700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f889c0a3930 con 0x7f889c0a4e80 2024-04-25T02:23:29.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.343+0000 7f88a3097700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f889c0a56d0 con 0x7f889c146af0 2024-04-25T02:23:29.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.343+0000 7f889bfff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f889c0a4e80 0x7f889c1465b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:29.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.343+0000 7f88a1634700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f889c146af0 0x7f889c148ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:29.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.343+0000 7f88a0e33700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f889c06a820 0x7f889c0b3410 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:33810/0 (socket says 172.21.15.111:33810) 2024-04-25T02:23:29.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.343+0000 7f889bfff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f889c0a4e80 0x7f889c1465b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:35776/0 (socket says 172.21.15.111:35776) 2024-04-25T02:23:29.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.343+0000 7f88a1634700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f889c146af0 0x7f889c148ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:41384/0 (socket says 172.21.15.111:41384) 2024-04-25T02:23:29.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.343+0000 7f88a0e33700 1 -- 172.21.15.111:0/3977493843 learned_addr learned my addr 172.21.15.111:0/3977493843 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:23:29.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.343+0000 7f889b7fe700 1 -- 172.21.15.111:0/3977493843 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1129584640 0 0) 0x7f889c068de0 con 0x7f889c06a820 2024-04-25T02:23:29.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.343+0000 7f889bfff700 1 -- 172.21.15.111:0/3977493843 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f889c146af0 msgr2=0x7f889c148ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:29.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.343+0000 7f889bfff700 1 --2- 172.21.15.111:0/3977493843 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f889c146af0 0x7f889c148ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:29.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.343+0000 7f889bfff700 1 -- 172.21.15.111:0/3977493843 >> v1:172.21.15.111:6789/0 conn(0x7f889c06a820 legacy=0x7f889c0b3410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:29.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.343+0000 7f889bfff700 1 -- 172.21.15.111:0/3977493843 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f889c069fc0 con 0x7f889c0a4e80 2024-04-25T02:23:29.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.343+0000 7f88a1634700 1 --2- 172.21.15.111:0/3977493843 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f889c146af0 0x7f889c148ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:29.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.343+0000 7f889bfff700 1 --2- 172.21.15.111:0/3977493843 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f889c0a4e80 0x7f889c1465b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8888009910 tx=0x7f88880091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fbe54d46a6d7800b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:29.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.343+0000 7f889b7fe700 1 -- 172.21.15.111:0/3977493843 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888800b680 con 0x7f889c0a4e80 2024-04-25T02:23:29.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.343+0000 7f889b7fe700 1 -- 172.21.15.111:0/3977493843 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f888800b7e0 con 0x7f889c0a4e80 2024-04-25T02:23:29.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.343+0000 7f889b7fe700 1 -- 172.21.15.111:0/3977493843 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888800bba0 con 0x7f889c0a4e80 2024-04-25T02:23:29.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.344+0000 7f88a3097700 1 -- 172.21.15.111:0/3977493843 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f889c0a4e80 msgr2=0x7f889c1465b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:29.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.344+0000 7f88a3097700 1 --2- 172.21.15.111:0/3977493843 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f889c0a4e80 0x7f889c1465b0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8888009910 tx=0x7f88880091a0 comp rx=0 tx=0).stop 2024-04-25T02:23:29.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.344+0000 7f88a3097700 1 -- 172.21.15.111:0/3977493843 shutdown_connections 2024-04-25T02:23:29.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.344+0000 7f88a3097700 1 --2- 172.21.15.111:0/3977493843 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f889c146af0 0x7f889c148ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:29.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.344+0000 7f88a3097700 1 --2- 172.21.15.111:0/3977493843 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f889c0a4e80 0x7f889c1465b0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:29.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.344+0000 7f88a3097700 1 -- 172.21.15.111:0/3977493843 >> 172.21.15.111:0/3977493843 conn(0x7f889c06bd70 msgr2=0x7f889c06c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:29.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.344+0000 7f88a3097700 1 -- 172.21.15.111:0/3977493843 shutdown_connections 2024-04-25T02:23:29.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.344+0000 7f88a3097700 1 -- 172.21.15.111:0/3977493843 wait complete. 2024-04-25T02:23:29.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.345+0000 7f88a3097700 1 Processor -- start 2024-04-25T02:23:29.354 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.345+0000 7f88a3097700 1 -- start start 2024-04-25T02:23:29.354 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.345+0000 7f88a3097700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f889c06a820 0x7f889c0970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:29.354 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.345+0000 7f88a3097700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f889c0a4e80 0x7f889c1513d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:29.354 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.345+0000 7f88a3097700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f889c146af0 0x7f889c151910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:29.354 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.345+0000 7f88a3097700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f889c097d90 con 0x7f889c146af0 2024-04-25T02:23:29.354 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.345+0000 7f88a3097700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f889c099960 con 0x7f889c06a820 2024-04-25T02:23:29.354 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.345+0000 7f88a3097700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f889c097ad0 con 0x7f889c0a4e80 2024-04-25T02:23:29.354 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.346+0000 7f88a0e33700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f889c06a820 0x7f889c0970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:29.354 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.346+0000 7f889bfff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f889c0a4e80 0x7f889c1513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:29.355 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.346+0000 7f88a1634700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f889c146af0 0x7f889c151910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:29.355 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.346+0000 7f88a0e33700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f889c06a820 0x7f889c0970e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:35786/0 (socket says 172.21.15.111:35786) 2024-04-25T02:23:29.355 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.346+0000 7f88a0e33700 1 -- 172.21.15.111:0/981652061 learned_addr learned my addr 172.21.15.111:0/981652061 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:29.355 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.346+0000 7f889bfff700 1 -- 172.21.15.111:0/981652061 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f889c06a820 msgr2=0x7f889c0970e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:29.355 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.346+0000 7f889bfff700 1 --2- 172.21.15.111:0/981652061 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f889c06a820 0x7f889c0970e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:29.355 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.346+0000 7f889bfff700 1 -- 172.21.15.111:0/981652061 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f889c146af0 msgr2=0x7f889c151910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:29.355 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.346+0000 7f889bfff700 1 --2- 172.21.15.111:0/981652061 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f889c146af0 0x7f889c151910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:29.355 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.346+0000 7f889bfff700 1 -- 172.21.15.111:0/981652061 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8894009a20 con 0x7f889c0a4e80 2024-04-25T02:23:29.355 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.346+0000 7f88a0e33700 1 --2- 172.21.15.111:0/981652061 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f889c06a820 0x7f889c0970e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:29.355 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.346+0000 7f889bfff700 1 --2- 172.21.15.111:0/981652061 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f889c0a4e80 0x7f889c1513d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8888016000 tx=0x7f8888017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:29.355 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.346+0000 7f8898ff9700 1 -- 172.21.15.111:0/981652061 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888801f070 con 0x7f889c0a4e80 2024-04-25T02:23:29.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.346+0000 7f8898ff9700 1 -- 172.21.15.111:0/981652061 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8888000bc0 con 0x7f889c0a4e80 2024-04-25T02:23:29.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.346+0000 7f88a3097700 1 -- 172.21.15.111:0/981652061 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8888009420 con 0x7f889c0a4e80 2024-04-25T02:23:29.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.346+0000 7f8898ff9700 1 -- 172.21.15.111:0/981652061 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f888800bba0 con 0x7f889c0a4e80 2024-04-25T02:23:29.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.346+0000 7f88a3097700 1 -- 172.21.15.111:0/981652061 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f889c0988f0 con 0x7f889c0a4e80 2024-04-25T02:23:29.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.347+0000 7f88a3097700 1 -- 172.21.15.111:0/981652061 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f889c099aa0 con 0x7f889c0a4e80 2024-04-25T02:23:29.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.347+0000 7f8898ff9700 1 -- 172.21.15.111:0/981652061 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f8888023070 con 0x7f889c0a4e80 2024-04-25T02:23:29.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.347+0000 7f8898ff9700 1 -- 172.21.15.111:0/981652061 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f888805c3d0 con 0x7f889c0a4e80 2024-04-25T02:23:29.356 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.351+0000 7f8898ff9700 1 -- 172.21.15.111:0/981652061 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f88880074b0 con 0x7f889c0a4e80 2024-04-25T02:23:29.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.532+0000 7f88a3097700 1 -- 172.21.15.111:0/981652061 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f889c071790 con 0x7f889c0a4e80 2024-04-25T02:23:29.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.532+0000 7f8898ff9700 1 -- 172.21.15.111:0/981652061 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+3672 (secure 0 0 0) 0x7f888802a020 con 0x7f889c0a4e80 2024-04-25T02:23:29.536 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:23:29.536 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":true},"standbys":[{"gid":14404,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6818/4022954817","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6818","nonce":4022954817}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":14405,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6817/1113530749","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6817","nonce":1113530749}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:20:24.150791+0000","modified":"2024-04-25T02:23:19.864524+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14417},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14417":{"gid":14417,"name":"b","rank":0,"incarnation":16,"state":"up:active","state_seq":4,"addr":"172.21.15.111:6819/696898730","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6819","nonce":696898730}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-25T02:23:29.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.534+0000 7f88a3097700 1 -- 172.21.15.111:0/981652061 >> v1:172.21.15.111:6816/46482 conn(0x7f8880046040 legacy=0x7f88800484f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:29.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.534+0000 7f88a3097700 1 -- 172.21.15.111:0/981652061 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f889c0a4e80 msgr2=0x7f889c1513d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:29.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.534+0000 7f88a3097700 1 --2- 172.21.15.111:0/981652061 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f889c0a4e80 0x7f889c1513d0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8888016000 tx=0x7f8888017000 comp rx=0 tx=0).stop 2024-04-25T02:23:29.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.534+0000 7f88a3097700 1 -- 172.21.15.111:0/981652061 shutdown_connections 2024-04-25T02:23:29.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.534+0000 7f88a3097700 1 --2- 172.21.15.111:0/981652061 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f889c146af0 0x7f889c151910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:29.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.534+0000 7f88a3097700 1 --2- 172.21.15.111:0/981652061 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f889c06a820 0x7f889c0970e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:29.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.534+0000 7f88a3097700 1 --2- 172.21.15.111:0/981652061 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f889c0a4e80 0x7f889c1513d0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:29.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.534+0000 7f88a3097700 1 -- 172.21.15.111:0/981652061 >> 172.21.15.111:0/981652061 conn(0x7f889c06bd70 msgr2=0x7f889c0b1b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:29.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.534+0000 7f88a3097700 1 -- 172.21.15.111:0/981652061 shutdown_connections 2024-04-25T02:23:29.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.534+0000 7f88a3097700 1 -- 172.21.15.111:0/981652061 wait complete. 2024-04-25T02:23:29.539 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 19 2024-04-25T02:23:29.550 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:23:29.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.662+0000 7f0ed3dc1700 1 Processor -- start 2024-04-25T02:23:29.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.662+0000 7f0ed3dc1700 1 -- start start 2024-04-25T02:23:29.669 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.663+0000 7f0ed3dc1700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0ecc063d10 0x7f0ecc06eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:29.669 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.663+0000 7f0ed3dc1700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f0ecc06de30 0x7f0ecc0ad1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:29.669 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.663+0000 7f0ed3dc1700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0ecc0ad730 0x7f0ecc13e240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:29.669 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.663+0000 7f0ed3dc1700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ecc141c00 con 0x7f0ecc06de30 2024-04-25T02:23:29.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.663+0000 7f0ed3dc1700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ecc141ea0 con 0x7f0ecc0ad730 2024-04-25T02:23:29.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.663+0000 7f0ed3dc1700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ecc068f90 con 0x7f0ecc063d10 2024-04-25T02:23:29.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.663+0000 7f0ed135c700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f0ecc06de30 0x7f0ecc0ad1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:29.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.663+0000 7f0ed1b5d700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0ecc063d10 0x7f0ecc06eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:29.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.663+0000 7f0ed235e700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0ecc0ad730 0x7f0ecc13e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:29.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.663+0000 7f0ed135c700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f0ecc06de30 0x7f0ecc0ad1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:60676/0 (socket says 172.21.15.111:60676) 2024-04-25T02:23:29.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.663+0000 7f0ed235e700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0ecc0ad730 0x7f0ecc13e240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:35788/0 (socket says 172.21.15.111:35788) 2024-04-25T02:23:29.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.663+0000 7f0ed1b5d700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0ecc063d10 0x7f0ecc06eb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:41396/0 (socket says 172.21.15.111:41396) 2024-04-25T02:23:29.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.663+0000 7f0ed135c700 1 -- 172.21.15.111:0/638675385 learned_addr learned my addr 172.21.15.111:0/638675385 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:29.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.663+0000 7f0ed135c700 1 -- 172.21.15.111:0/638675385 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0ecc063d10 msgr2=0x7f0ecc06eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:29.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.663+0000 7f0ed135c700 1 --2- 172.21.15.111:0/638675385 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0ecc063d10 0x7f0ecc06eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:29.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.663+0000 7f0ed135c700 1 -- 172.21.15.111:0/638675385 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0ecc0ad730 msgr2=0x7f0ecc13e240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:29.670 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.663+0000 7f0ed135c700 1 --2- 172.21.15.111:0/638675385 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0ecc0ad730 0x7f0ecc13e240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:29.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.663+0000 7f0ed135c700 1 -- 172.21.15.111:0/638675385 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ecc069100 con 0x7f0ecc06de30 2024-04-25T02:23:29.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.663+0000 7f0ed235e700 1 --2- 172.21.15.111:0/638675385 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0ecc0ad730 0x7f0ecc13e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:29.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.663+0000 7f0ed135c700 1 --2- 172.21.15.111:0/638675385 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0ecc06de30 0x7f0ecc0ad1f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0ec80099b0 tx=0x7f0ec8009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23d53ec87ac8bd0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:29.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.664+0000 7f0ed0b5b700 1 -- 172.21.15.111:0/638675385 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec800b680 con 0x7f0ecc06de30 2024-04-25T02:23:29.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.664+0000 7f0ed0b5b700 1 -- 172.21.15.111:0/638675385 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ec800b7e0 con 0x7f0ecc06de30 2024-04-25T02:23:29.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.664+0000 7f0ed0b5b700 1 -- 172.21.15.111:0/638675385 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ec800bb80 con 0x7f0ecc06de30 2024-04-25T02:23:29.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.664+0000 7f0ed3dc1700 1 -- 172.21.15.111:0/638675385 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0ecc06de30 msgr2=0x7f0ecc0ad1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:29.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.664+0000 7f0ed3dc1700 1 --2- 172.21.15.111:0/638675385 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0ecc06de30 0x7f0ecc0ad1f0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f0ec80099b0 tx=0x7f0ec8009250 comp rx=0 tx=0).stop 2024-04-25T02:23:29.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.664+0000 7f0ed3dc1700 1 -- 172.21.15.111:0/638675385 shutdown_connections 2024-04-25T02:23:29.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.664+0000 7f0ed3dc1700 1 --2- 172.21.15.111:0/638675385 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0ecc0ad730 0x7f0ecc13e240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:29.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.664+0000 7f0ed3dc1700 1 --2- 172.21.15.111:0/638675385 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0ecc063d10 0x7f0ecc06eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:29.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.664+0000 7f0ed3dc1700 1 --2- 172.21.15.111:0/638675385 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0ecc06de30 0x7f0ecc0ad1f0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:29.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.664+0000 7f0ed3dc1700 1 -- 172.21.15.111:0/638675385 >> 172.21.15.111:0/638675385 conn(0x7f0ecc0b1e10 msgr2=0x7f0ecc0ade80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:29.671 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.664+0000 7f0ed3dc1700 1 -- 172.21.15.111:0/638675385 shutdown_connections 2024-04-25T02:23:29.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.664+0000 7f0ed3dc1700 1 -- 172.21.15.111:0/638675385 wait complete. 2024-04-25T02:23:29.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.665+0000 7f0ed3dc1700 1 Processor -- start 2024-04-25T02:23:29.672 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.665+0000 7f0ed3dc1700 1 -- start start 2024-04-25T02:23:29.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.666+0000 7f0ed3dc1700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0ecc063d10 0x7f0ecc11aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:29.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.666+0000 7f0ed3dc1700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0ecc06de30 0x7f0ecc13b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:29.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.666+0000 7f0ed3dc1700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0ecc0ad730 0x7f0ecc13be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:29.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.666+0000 7f0ed3dc1700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ecc11cb50 con 0x7f0ecc06de30 2024-04-25T02:23:29.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.666+0000 7f0ed3dc1700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ecc0af480 con 0x7f0ecc0ad730 2024-04-25T02:23:29.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.666+0000 7f0ed3dc1700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0ecc13c3c0 con 0x7f0ecc063d10 2024-04-25T02:23:29.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.666+0000 7f0ed235e700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0ecc0ad730 0x7f0ecc13be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:29.675 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.666+0000 7f0ed135c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0ecc06de30 0x7f0ecc13b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:29.675 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.666+0000 7f0ed1b5d700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0ecc063d10 0x7f0ecc11aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:29.675 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.666+0000 7f0ed235e700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0ecc0ad730 0x7f0ecc13be80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:35800/0 (socket says 172.21.15.111:35800) 2024-04-25T02:23:29.675 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.666+0000 7f0ed135c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0ecc06de30 0x7f0ecc13b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:60692/0 (socket says 172.21.15.111:60692) 2024-04-25T02:23:29.675 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.666+0000 7f0ed235e700 1 -- 172.21.15.111:0/655748249 learned_addr learned my addr 172.21.15.111:0/655748249 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:29.675 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.666+0000 7f0ed1b5d700 1 -- 172.21.15.111:0/655748249 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0ecc0ad730 msgr2=0x7f0ecc13be80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:29.675 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.666+0000 7f0ed1b5d700 1 --2- 172.21.15.111:0/655748249 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0ecc0ad730 0x7f0ecc13be80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:29.675 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.666+0000 7f0ed1b5d700 1 -- 172.21.15.111:0/655748249 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0ecc06de30 msgr2=0x7f0ecc13b940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:29.675 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.666+0000 7f0ed1b5d700 1 --2- 172.21.15.111:0/655748249 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0ecc06de30 0x7f0ecc13b940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:29.675 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.666+0000 7f0ed1b5d700 1 -- 172.21.15.111:0/655748249 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ec4009a20 con 0x7f0ecc063d10 2024-04-25T02:23:29.675 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.666+0000 7f0ed235e700 1 --2- 172.21.15.111:0/655748249 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0ecc0ad730 0x7f0ecc13be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:29.675 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.666+0000 7f0ed135c700 1 --2- 172.21.15.111:0/655748249 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0ecc06de30 0x7f0ecc13b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:29.675 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.666+0000 7f0ed1b5d700 1 --2- 172.21.15.111:0/655748249 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0ecc063d10 0x7f0ecc11aa30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc00ea50 tx=0x7f0ebc0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:29.675 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.666+0000 7f0ec1ffb700 1 -- 172.21.15.111:0/655748249 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ebc00ee90 con 0x7f0ecc063d10 2024-04-25T02:23:29.676 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.666+0000 7f0ec1ffb700 1 -- 172.21.15.111:0/655748249 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ebc00c7f0 con 0x7f0ecc063d10 2024-04-25T02:23:29.676 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.666+0000 7f0ed3dc1700 1 -- 172.21.15.111:0/655748249 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ec80094f0 con 0x7f0ecc063d10 2024-04-25T02:23:29.676 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.666+0000 7f0ec1ffb700 1 -- 172.21.15.111:0/655748249 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ebc00cb90 con 0x7f0ecc063d10 2024-04-25T02:23:29.676 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.667+0000 7f0ed3dc1700 1 -- 172.21.15.111:0/655748249 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ecc13c6f0 con 0x7f0ecc063d10 2024-04-25T02:23:29.676 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.668+0000 7f0ec1ffb700 1 -- 172.21.15.111:0/655748249 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f0ebc013470 con 0x7f0ecc063d10 2024-04-25T02:23:29.676 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.668+0000 7f0ed3dc1700 1 -- 172.21.15.111:0/655748249 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ecc071790 con 0x7f0ecc063d10 2024-04-25T02:23:29.676 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.668+0000 7f0ec1ffb700 1 -- 172.21.15.111:0/655748249 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f0ebc05b3d0 con 0x7f0ecc063d10 2024-04-25T02:23:29.677 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.671+0000 7f0ec1ffb700 1 -- 172.21.15.111:0/655748249 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f0ebc039590 con 0x7f0ecc063d10 2024-04-25T02:23:29.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.830+0000 7f0ed3dc1700 1 -- 172.21.15.111:0/655748249 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0ecc06e330 con 0x7f0ecc063d10 2024-04-25T02:23:29.835 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.831+0000 7f0ec1ffb700 1 -- 172.21.15.111:0/655748249 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11668 (secure 0 0 0) 0x7f0ebc021070 con 0x7f0ecc063d10 2024-04-25T02:23:29.835 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:23:29.835 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":40,"fsid":"4643f974-f93a-4436-93b8-460ff320e62e","created":"2024-04-25T02:20:05.450475+0000","modified":"2024-04-25T02:23:21.875192+0000","last_up_change":"2024-04-25T02:23:12.818028+0000","last_in_change":"2024-04-25T02:20:10.439204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:20:07.471248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:20:14.420378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:20:22.251868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T02:20:23.128289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"df3f17ca-3b12-42c8-8cf7-8f1b7189e587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":31,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6800","nonce":48862}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6801","nonce":48862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6803","nonce":48862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6802","nonce":48862}]},"public_addr":"172.21.15.111:6800/48862","cluster_addr":"172.21.15.111:6801/48862","heartbeat_back_addr":"172.21.15.111:6803/48862","heartbeat_front_addr":"172.21.15.111:6802/48862","state":["exists","up"]},{"osd":1,"uuid":"93d54815-f215-4285-bba6-32f2d1cabf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":29,"up_thru":31,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6804","nonce":48960}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6805","nonce":48960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6807","nonce":48960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6806","nonce":48960}]},"public_addr":"172.21.15.111:6804/48960","cluster_addr":"172.21.15.111:6805/48960","heartbeat_back_addr":"172.21.15.111:6807/48960","heartbeat_front_addr":"172.21.15.111:6806/48960","state":["exists","up"]},{"osd":2,"uuid":"b26b2104-2a2e-408f-9ce7-3587a32a2ebe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":31,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6808","nonce":49070}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6809","nonce":49070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6811","nonce":49070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6810","nonce":49070}]},"public_addr":"172.21.15.111:6808/49070","cluster_addr":"172.21.15.111:6809/49070","heartbeat_back_addr":"172.21.15.111:6811/49070","heartbeat_front_addr":"172.21.15.111:6810/49070","state":["exists","up"]},{"osd":3,"uuid":"43c25820-1edc-4031-badf-72e87dd6bf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":31,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6812","nonce":49243}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6813","nonce":49243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6815","nonce":49243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6814","nonce":49243}]},"public_addr":"172.21.15.111:6812/49243","cluster_addr":"172.21.15.111:6813/49243","heartbeat_back_addr":"172.21.15.111:6815/49243","heartbeat_front_addr":"172.21.15.111:6814/49243","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.372427+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.411480+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.361508+0000","dead_epoch":25},{"osd":3,"down_stamp":"2024-04-25T02:23:06.771296+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.377212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.111:6819/4003866251":"2024-04-26T02:23:16.839679+0000","172.21.15.111:0/2148931273":"2024-04-26T02:22:54.713254+0000","172.21.15.111:6816/39585":"2024-04-26T02:22:54.713254+0000","172.21.15.111:0/3911588907":"2024-04-26T02:22:54.713254+0000","172.21.15.111:0/1276843622":"2024-04-26T02:22:54.713254+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:23:29.837 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.832+0000 7f0ed3dc1700 1 -- 172.21.15.111:0/655748249 >> v1:172.21.15.111:6816/46482 conn(0x7f0eb0046010 legacy=0x7f0eb00484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:29.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.832+0000 7f0ed3dc1700 1 -- 172.21.15.111:0/655748249 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0ecc063d10 msgr2=0x7f0ecc11aa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:29.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.832+0000 7f0ed3dc1700 1 --2- 172.21.15.111:0/655748249 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0ecc063d10 0x7f0ecc11aa30 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0ebc00ea50 tx=0x7f0ebc0091a0 comp rx=0 tx=0).stop 2024-04-25T02:23:29.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.832+0000 7f0ed3dc1700 1 -- 172.21.15.111:0/655748249 shutdown_connections 2024-04-25T02:23:29.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.832+0000 7f0ed3dc1700 1 --2- 172.21.15.111:0/655748249 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0ecc0ad730 0x7f0ecc13be80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:29.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.832+0000 7f0ed3dc1700 1 --2- 172.21.15.111:0/655748249 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0ecc063d10 0x7f0ecc11aa30 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:29.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.832+0000 7f0ed3dc1700 1 --2- 172.21.15.111:0/655748249 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0ecc06de30 0x7f0ecc13b940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:29.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.832+0000 7f0ed3dc1700 1 -- 172.21.15.111:0/655748249 >> 172.21.15.111:0/655748249 conn(0x7f0ecc0b1e10 msgr2=0x7f0ecc0ade80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:29.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.832+0000 7f0ed3dc1700 1 -- 172.21.15.111:0/655748249 shutdown_connections 2024-04-25T02:23:29.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.832+0000 7f0ed3dc1700 1 -- 172.21.15.111:0/655748249 wait complete. 2024-04-25T02:23:29.849 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:20:07.471248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T02:20:14.420378+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:20:22.251868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:20:23.128289+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T02:23:29.850 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:23:29.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.965+0000 7f2c225b9700 1 Processor -- start 2024-04-25T02:23:29.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.965+0000 7f2c225b9700 1 -- start start 2024-04-25T02:23:29.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.966+0000 7f2c225b9700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2c1c068050 0x7f2c1c0a5210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:29.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.966+0000 7f2c225b9700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f2c1c0a6db0 0x7f2c1c13fb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:29.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.966+0000 7f2c225b9700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c1c140510 con 0x7f2c1c140070 2024-04-25T02:23:29.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.966+0000 7f2c225b9700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c1c0a5750 con 0x7f2c1c0a6db0 2024-04-25T02:23:29.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.966+0000 7f2c225b9700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1c13f5f0 con 0x7f2c1c068050 2024-04-25T02:23:29.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.966+0000 7f2c1bfff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2c1c068050 0x7f2c1c0a5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:29.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.966+0000 7f2c20b56700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f2c1c140070 0x7f2c1c06eb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:33820/0 (socket says 172.21.15.111:33820) 2024-04-25T02:23:29.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.966+0000 7f2c1bfff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2c1c068050 0x7f2c1c0a5210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:41426/0 (socket says 172.21.15.111:41426) 2024-04-25T02:23:29.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.966+0000 7f2c20b56700 1 -- 172.21.15.111:0/1571102342 learned_addr learned my addr 172.21.15.111:0/1571102342 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:23:29.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.966+0000 7f2c1b7fe700 1 --2- 172.21.15.111:0/1571102342 >> v2:172.21.15.111:3300/0 conn(0x7f2c1c0a6db0 0x7f2c1c13fb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:29.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.966+0000 7f2c1bfff700 1 -- 172.21.15.111:0/1571102342 >> v2:172.21.15.111:3300/0 conn(0x7f2c1c0a6db0 msgr2=0x7f2c1c13fb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:29.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.966+0000 7f2c1bfff700 1 --2- 172.21.15.111:0/1571102342 >> v2:172.21.15.111:3300/0 conn(0x7f2c1c0a6db0 0x7f2c1c13fb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:29.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.966+0000 7f2c1bfff700 1 -- 172.21.15.111:0/1571102342 >> v1:172.21.15.111:6789/0 conn(0x7f2c1c140070 legacy=0x7f2c1c06eb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:29.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.966+0000 7f2c1bfff700 1 -- 172.21.15.111:0/1571102342 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c1c13f890 con 0x7f2c1c068050 2024-04-25T02:23:29.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.966+0000 7f2c1b7fe700 1 --2- 172.21.15.111:0/1571102342 >> v2:172.21.15.111:3300/0 conn(0x7f2c1c0a6db0 0x7f2c1c13fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:29.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.967+0000 7f2c1bfff700 1 --2- 172.21.15.111:0/1571102342 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2c1c068050 0x7f2c1c0a5210 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2c100098e0 tx=0x7f2c100091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d6baf69bbe4089d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:29.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.967+0000 7f2c1affd700 1 -- 172.21.15.111:0/1571102342 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1000b6d0 con 0x7f2c1c068050 2024-04-25T02:23:29.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.967+0000 7f2c1affd700 1 -- 172.21.15.111:0/1571102342 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c1000b830 con 0x7f2c1c068050 2024-04-25T02:23:29.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.967+0000 7f2c1affd700 1 -- 172.21.15.111:0/1571102342 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1000bbd0 con 0x7f2c1c068050 2024-04-25T02:23:29.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.967+0000 7f2c225b9700 1 -- 172.21.15.111:0/1571102342 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2c1c068050 msgr2=0x7f2c1c0a5210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:29.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.967+0000 7f2c225b9700 1 --2- 172.21.15.111:0/1571102342 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2c1c068050 0x7f2c1c0a5210 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f2c100098e0 tx=0x7f2c100091a0 comp rx=0 tx=0).stop 2024-04-25T02:23:29.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.967+0000 7f2c225b9700 1 -- 172.21.15.111:0/1571102342 shutdown_connections 2024-04-25T02:23:29.973 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.967+0000 7f2c225b9700 1 --2- 172.21.15.111:0/1571102342 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2c1c068050 0x7f2c1c0a5210 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:29.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.967+0000 7f2c225b9700 1 --2- 172.21.15.111:0/1571102342 >> v2:172.21.15.111:3300/0 conn(0x7f2c1c0a6db0 0x7f2c1c13fb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:29.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.967+0000 7f2c225b9700 1 -- 172.21.15.111:0/1571102342 >> 172.21.15.111:0/1571102342 conn(0x7f2c1c06c010 msgr2=0x7f2c1c067940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:29.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.967+0000 7f2c225b9700 1 -- 172.21.15.111:0/1571102342 shutdown_connections 2024-04-25T02:23:29.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.967+0000 7f2c225b9700 1 -- 172.21.15.111:0/1571102342 wait complete. 2024-04-25T02:23:29.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.968+0000 7f2c225b9700 1 Processor -- start 2024-04-25T02:23:29.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.968+0000 7f2c225b9700 1 -- start start 2024-04-25T02:23:29.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.969+0000 7f2c225b9700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2c1c068050 0x7f2c1c13abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:29.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.969+0000 7f2c225b9700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2c1c0a6db0 0x7f2c1c133c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:29.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.969+0000 7f2c225b9700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2c1c140070 0x7f2c1c134170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:29.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.969+0000 7f2c225b9700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1c13cf20 con 0x7f2c1c140070 2024-04-25T02:23:29.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.969+0000 7f2c225b9700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1c13d370 con 0x7f2c1c0a6db0 2024-04-25T02:23:29.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.969+0000 7f2c225b9700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1c13b660 con 0x7f2c1c068050 2024-04-25T02:23:29.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.969+0000 7f2c1b7fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2c1c0a6db0 0x7f2c1c133c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:29.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.969+0000 7f2c1bfff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2c1c068050 0x7f2c1c13abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:29.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.969+0000 7f2c20b56700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2c1c140070 0x7f2c1c134170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:29.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.969+0000 7f2c1b7fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2c1c0a6db0 0x7f2c1c133c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:35808/0 (socket says 172.21.15.111:35808) 2024-04-25T02:23:29.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.969+0000 7f2c1bfff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2c1c068050 0x7f2c1c13abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:41440/0 (socket says 172.21.15.111:41440) 2024-04-25T02:23:29.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.969+0000 7f2c1b7fe700 1 -- 172.21.15.111:0/2135031360 learned_addr learned my addr 172.21.15.111:0/2135031360 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:29.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.969+0000 7f2c20b56700 1 -- 172.21.15.111:0/2135031360 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2c1c068050 msgr2=0x7f2c1c13abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:29.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.969+0000 7f2c20b56700 1 --2- 172.21.15.111:0/2135031360 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2c1c068050 0x7f2c1c13abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:29.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.969+0000 7f2c20b56700 1 -- 172.21.15.111:0/2135031360 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2c1c0a6db0 msgr2=0x7f2c1c133c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:29.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.969+0000 7f2c20b56700 1 --2- 172.21.15.111:0/2135031360 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2c1c0a6db0 0x7f2c1c133c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:29.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.969+0000 7f2c20b56700 1 -- 172.21.15.111:0/2135031360 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c0c009420 con 0x7f2c1c140070 2024-04-25T02:23:29.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.969+0000 7f2c1bfff700 1 --2- 172.21.15.111:0/2135031360 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2c1c068050 0x7f2c1c13abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:29.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.969+0000 7f2c1b7fe700 1 --2- 172.21.15.111:0/2135031360 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2c1c0a6db0 0x7f2c1c133c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:29.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.970+0000 7f2c20b56700 1 --2- 172.21.15.111:0/2135031360 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2c1c140070 0x7f2c1c134170 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2c1400cb40 tx=0x7f2c14001900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:29.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.970+0000 7f2c03fff700 1 -- 172.21.15.111:0/2135031360 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1400a7e0 con 0x7f2c1c140070 2024-04-25T02:23:29.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.970+0000 7f2c03fff700 1 -- 172.21.15.111:0/2135031360 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c1400a940 con 0x7f2c1c140070 2024-04-25T02:23:29.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.970+0000 7f2c225b9700 1 -- 172.21.15.111:0/2135031360 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c10009420 con 0x7f2c1c140070 2024-04-25T02:23:29.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.970+0000 7f2c03fff700 1 -- 172.21.15.111:0/2135031360 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1400ace0 con 0x7f2c1c140070 2024-04-25T02:23:29.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.970+0000 7f2c225b9700 1 -- 172.21.15.111:0/2135031360 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c1c13b940 con 0x7f2c1c140070 2024-04-25T02:23:29.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.971+0000 7f2c225b9700 1 -- 172.21.15.111:0/2135031360 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c1c13d060 con 0x7f2c1c140070 2024-04-25T02:23:29.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.971+0000 7f2c03fff700 1 -- 172.21.15.111:0/2135031360 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f2c14007300 con 0x7f2c1c140070 2024-04-25T02:23:29.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.971+0000 7f2c03fff700 1 -- 172.21.15.111:0/2135031360 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f2c1405b110 con 0x7f2c1c140070 2024-04-25T02:23:29.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:29.975+0000 7f2c03fff700 1 -- 172.21.15.111:0/2135031360 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f2c14039350 con 0x7f2c1c140070 2024-04-25T02:23:30.132 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.128+0000 7f2c225b9700 1 -- 172.21.15.111:0/2135031360 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2c1c140510 con 0x7f2c1c140070 2024-04-25T02:23:30.132 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.129+0000 7f2c03fff700 1 -- 172.21.15.111:0/2135031360 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v40) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2c1c140510 con 0x7f2c1c140070 2024-04-25T02:23:30.133 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 1 2024-04-25T02:23:30.134 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.130+0000 7f2c225b9700 1 -- 172.21.15.111:0/2135031360 >> v1:172.21.15.111:6816/46482 conn(0x7f2c08046010 legacy=0x7f2c080484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:30.134 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.130+0000 7f2c225b9700 1 -- 172.21.15.111:0/2135031360 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2c1c140070 msgr2=0x7f2c1c134170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:30.134 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.130+0000 7f2c225b9700 1 --2- 172.21.15.111:0/2135031360 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2c1c140070 0x7f2c1c134170 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2c1400cb40 tx=0x7f2c14001900 comp rx=0 tx=0).stop 2024-04-25T02:23:30.134 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.130+0000 7f2c225b9700 1 -- 172.21.15.111:0/2135031360 shutdown_connections 2024-04-25T02:23:30.134 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.130+0000 7f2c225b9700 1 --2- 172.21.15.111:0/2135031360 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2c1c140070 0x7f2c1c134170 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:30.134 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.130+0000 7f2c225b9700 1 --2- 172.21.15.111:0/2135031360 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2c1c068050 0x7f2c1c13abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:30.135 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.130+0000 7f2c225b9700 1 --2- 172.21.15.111:0/2135031360 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2c1c0a6db0 0x7f2c1c133c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:30.135 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.130+0000 7f2c225b9700 1 -- 172.21.15.111:0/2135031360 >> 172.21.15.111:0/2135031360 conn(0x7f2c1c06c010 msgr2=0x7f2c1c06f3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:30.135 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.130+0000 7f2c225b9700 1 -- 172.21.15.111:0/2135031360 shutdown_connections 2024-04-25T02:23:30.135 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.130+0000 7f2c225b9700 1 -- 172.21.15.111:0/2135031360 wait complete. 2024-04-25T02:23:30.146 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T02:23:30.266 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.263+0000 7ff3543cd700 1 Processor -- start 2024-04-25T02:23:30.267 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.263+0000 7ff3543cd700 1 -- start start 2024-04-25T02:23:30.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.263+0000 7ff3543cd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff34c0a30f0 0x7ff34c0b22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:30.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.263+0000 7ff3543cd700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7ff34c143850 0x7ff34c145c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:30.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.263+0000 7ff3543cd700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff34c1388c0 con 0x7ff34c13baf0 2024-04-25T02:23:30.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.263+0000 7ff3543cd700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff34c0a3f40 con 0x7ff34c143850 2024-04-25T02:23:30.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.263+0000 7ff3543cd700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff34c13b1d0 con 0x7ff34c0a30f0 2024-04-25T02:23:30.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.263+0000 7ff351968700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff34c0a30f0 0x7ff34c0b22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:30.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.263+0000 7ff35296a700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7ff34c143850 0x7ff34c145c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:30.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.264+0000 7ff351968700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff34c0a30f0 0x7ff34c0b22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:35820/0 (socket says 172.21.15.111:35820) 2024-04-25T02:23:30.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.263+0000 7ff352169700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7ff34c13baf0 0x7ff34c0a45d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:33826/0 (socket says 172.21.15.111:33826) 2024-04-25T02:23:30.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.264+0000 7ff351968700 1 -- 172.21.15.111:0/562385551 learned_addr learned my addr 172.21.15.111:0/562385551 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:30.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.264+0000 7ff35296a700 1 -- 172.21.15.111:0/562385551 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff34c0a30f0 msgr2=0x7ff34c0b22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:30.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.264+0000 7ff35296a700 1 --2- 172.21.15.111:0/562385551 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff34c0a30f0 0x7ff34c0b22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:30.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.264+0000 7ff35296a700 1 -- 172.21.15.111:0/562385551 >> v1:172.21.15.111:6789/0 conn(0x7ff34c13baf0 legacy=0x7ff34c0a45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:30.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.264+0000 7ff35296a700 1 -- 172.21.15.111:0/562385551 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff34c13b470 con 0x7ff34c143850 2024-04-25T02:23:30.272 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.264+0000 7ff351968700 1 --2- 172.21.15.111:0/562385551 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff34c0a30f0 0x7ff34c0b22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:30.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.264+0000 7ff35296a700 1 --2- 172.21.15.111:0/562385551 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff34c143850 0x7ff34c145c30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff348009e60 tx=0x7ff348009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=233dfca1e83252a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:30.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.264+0000 7ff351167700 1 -- 172.21.15.111:0/562385551 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff34800e070 con 0x7ff34c143850 2024-04-25T02:23:30.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.264+0000 7ff351167700 1 -- 172.21.15.111:0/562385551 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff34800bb60 con 0x7ff34c143850 2024-04-25T02:23:30.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.264+0000 7ff351167700 1 -- 172.21.15.111:0/562385551 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff348012430 con 0x7ff34c143850 2024-04-25T02:23:30.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.265+0000 7ff3543cd700 1 -- 172.21.15.111:0/562385551 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff34c143850 msgr2=0x7ff34c145c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:30.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.265+0000 7ff3543cd700 1 --2- 172.21.15.111:0/562385551 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff34c143850 0x7ff34c145c30 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7ff348009e60 tx=0x7ff348009780 comp rx=0 tx=0).stop 2024-04-25T02:23:30.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.265+0000 7ff3543cd700 1 -- 172.21.15.111:0/562385551 shutdown_connections 2024-04-25T02:23:30.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.265+0000 7ff3543cd700 1 --2- 172.21.15.111:0/562385551 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff34c143850 0x7ff34c145c30 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:30.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.265+0000 7ff3543cd700 1 --2- 172.21.15.111:0/562385551 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff34c0a30f0 0x7ff34c0b22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:30.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.265+0000 7ff3543cd700 1 -- 172.21.15.111:0/562385551 >> 172.21.15.111:0/562385551 conn(0x7ff34c06d200 msgr2=0x7ff34c06af90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:30.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.265+0000 7ff3543cd700 1 -- 172.21.15.111:0/562385551 shutdown_connections 2024-04-25T02:23:30.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.265+0000 7ff3543cd700 1 -- 172.21.15.111:0/562385551 wait complete. 2024-04-25T02:23:30.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.266+0000 7ff3543cd700 1 Processor -- start 2024-04-25T02:23:30.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.266+0000 7ff3543cd700 1 -- start start 2024-04-25T02:23:30.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.266+0000 7ff3543cd700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff34c0a30f0 0x7ff34c0a60d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:30.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.266+0000 7ff3543cd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff34c13baf0 0x7ff34c14e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:30.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.266+0000 7ff3543cd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff34c143850 0x7ff34c14e670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:30.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.266+0000 7ff3543cd700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff34c0a6aa0 con 0x7ff34c13baf0 2024-04-25T02:23:30.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.266+0000 7ff3543cd700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff34c13d3a0 con 0x7ff34c143850 2024-04-25T02:23:30.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.266+0000 7ff3543cd700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff34c0a5a20 con 0x7ff34c0a30f0 2024-04-25T02:23:30.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.266+0000 7ff35296a700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff34c143850 0x7ff34c14e670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:30.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.266+0000 7ff352169700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff34c0a30f0 0x7ff34c0a60d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:30.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.266+0000 7ff35296a700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff34c143850 0x7ff34c14e670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:35834/0 (socket says 172.21.15.111:35834) 2024-04-25T02:23:30.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.266+0000 7ff35296a700 1 -- 172.21.15.111:0/3938535189 learned_addr learned my addr 172.21.15.111:0/3938535189 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:30.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.266+0000 7ff351968700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff34c13baf0 0x7ff34c14e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:30.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.267+0000 7ff352169700 1 -- 172.21.15.111:0/3938535189 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff34c143850 msgr2=0x7ff34c14e670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:30.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.267+0000 7ff352169700 1 --2- 172.21.15.111:0/3938535189 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff34c143850 0x7ff34c14e670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:30.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.267+0000 7ff352169700 1 -- 172.21.15.111:0/3938535189 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff34c13baf0 msgr2=0x7ff34c14e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:30.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.267+0000 7ff352169700 1 --2- 172.21.15.111:0/3938535189 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff34c13baf0 0x7ff34c14e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:30.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.267+0000 7ff352169700 1 -- 172.21.15.111:0/3938535189 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff33c0094f0 con 0x7ff34c0a30f0 2024-04-25T02:23:30.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.267+0000 7ff351968700 1 --2- 172.21.15.111:0/3938535189 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff34c13baf0 0x7ff34c14e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:30.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.267+0000 7ff352169700 1 --2- 172.21.15.111:0/3938535189 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff34c0a30f0 0x7ff34c0a60d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff34400e9a0 tx=0x7ff344007f40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:30.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.267+0000 7ff3427fc700 1 -- 172.21.15.111:0/3938535189 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff344005a70 con 0x7ff34c0a30f0 2024-04-25T02:23:30.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.267+0000 7ff3427fc700 1 -- 172.21.15.111:0/3938535189 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff344005bf0 con 0x7ff34c0a30f0 2024-04-25T02:23:30.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.267+0000 7ff3543cd700 1 -- 172.21.15.111:0/3938535189 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff348009a20 con 0x7ff34c0a30f0 2024-04-25T02:23:30.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.267+0000 7ff3427fc700 1 -- 172.21.15.111:0/3938535189 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3440070f0 con 0x7ff34c0a30f0 2024-04-25T02:23:30.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.267+0000 7ff3543cd700 1 -- 172.21.15.111:0/3938535189 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff34c0a6850 con 0x7ff34c0a30f0 2024-04-25T02:23:30.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.268+0000 7ff3427fc700 1 -- 172.21.15.111:0/3938535189 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7ff3440074a0 con 0x7ff34c0a30f0 2024-04-25T02:23:30.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.268+0000 7ff3543cd700 1 -- 172.21.15.111:0/3938535189 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff34c0b02a0 con 0x7ff34c0a30f0 2024-04-25T02:23:30.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.268+0000 7ff3427fc700 1 -- 172.21.15.111:0/3938535189 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7ff34405d340 con 0x7ff34c0a30f0 2024-04-25T02:23:30.276 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.272+0000 7ff3427fc700 1 -- 172.21.15.111:0/3938535189 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7ff34403b4d0 con 0x7ff34c0a30f0 2024-04-25T02:23:30.429 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.426+0000 7ff3543cd700 1 -- 172.21.15.111:0/3938535189 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7ff34c1388c0 con 0x7ff34c0a30f0 2024-04-25T02:23:30.430 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.426+0000 7ff3427fc700 1 -- 172.21.15.111:0/3938535189 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v40) v1 ==== 92+0+10 (secure 0 0 0) 0x7ff34c1388c0 con 0x7ff34c0a30f0 2024-04-25T02:23:30.430 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 8 2024-04-25T02:23:30.431 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.428+0000 7ff3543cd700 1 -- 172.21.15.111:0/3938535189 >> v1:172.21.15.111:6816/46482 conn(0x7ff330046010 legacy=0x7ff3300484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:30.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.428+0000 7ff3543cd700 1 -- 172.21.15.111:0/3938535189 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff34c0a30f0 msgr2=0x7ff34c0a60d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:30.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.428+0000 7ff3543cd700 1 --2- 172.21.15.111:0/3938535189 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff34c0a30f0 0x7ff34c0a60d0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff34400e9a0 tx=0x7ff344007f40 comp rx=0 tx=0).stop 2024-04-25T02:23:30.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.428+0000 7ff3543cd700 1 -- 172.21.15.111:0/3938535189 shutdown_connections 2024-04-25T02:23:30.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.428+0000 7ff3543cd700 1 --2- 172.21.15.111:0/3938535189 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff34c143850 0x7ff34c14e670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:30.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.428+0000 7ff3543cd700 1 --2- 172.21.15.111:0/3938535189 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff34c0a30f0 0x7ff34c0a60d0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:30.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.428+0000 7ff3543cd700 1 --2- 172.21.15.111:0/3938535189 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff34c13baf0 0x7ff34c14e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:30.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.428+0000 7ff3543cd700 1 -- 172.21.15.111:0/3938535189 >> 172.21.15.111:0/3938535189 conn(0x7ff34c06d200 msgr2=0x7ff34c064900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:30.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.428+0000 7ff3543cd700 1 -- 172.21.15.111:0/3938535189 shutdown_connections 2024-04-25T02:23:30.432 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.428+0000 7ff3543cd700 1 -- 172.21.15.111:0/3938535189 wait complete. 2024-04-25T02:23:30.443 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:23:30.561 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.557+0000 7fe40487a700 1 Processor -- start 2024-04-25T02:23:30.561 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.557+0000 7fe40487a700 1 -- start start 2024-04-25T02:23:30.563 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.558+0000 7fe40487a700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe400063a40 0x7fe4000abdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:30.563 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.558+0000 7fe40487a700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe400132180 0x7fe40013f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:30.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.558+0000 7fe40487a700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fe4001325d0 0x7fe40013fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:30.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.558+0000 7fe40487a700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4000ada70 con 0x7fe4001325d0 2024-04-25T02:23:30.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.558+0000 7fe40487a700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4000abac0 con 0x7fe400063a40 2024-04-25T02:23:30.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.558+0000 7fe40487a700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe4000ae600 con 0x7fe400132180 2024-04-25T02:23:30.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.558+0000 7fe3fe59c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe400063a40 0x7fe4000abdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:30.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.558+0000 7fe3fdd9b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe400132180 0x7fe40013f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:30.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.558+0000 7fe3fed9d700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fe4001325d0 0x7fe40013fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:30.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.558+0000 7fe3fe59c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe400063a40 0x7fe4000abdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:36368/0 (socket says 172.21.15.111:36368) 2024-04-25T02:23:30.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.558+0000 7fe3fdd9b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe400132180 0x7fe40013f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:45302/0 (socket says 172.21.15.111:45302) 2024-04-25T02:23:30.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.558+0000 7fe3fe59c700 1 -- 172.21.15.111:0/3943248978 learned_addr learned my addr 172.21.15.111:0/3943248978 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:30.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.558+0000 7fe3fdd9b700 1 -- 172.21.15.111:0/3943248978 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe400063a40 msgr2=0x7fe4000abdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:30.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.558+0000 7fe3fdd9b700 1 --2- 172.21.15.111:0/3943248978 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe400063a40 0x7fe4000abdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:30.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.558+0000 7fe3fdd9b700 1 -- 172.21.15.111:0/3943248978 >> v2:172.21.15.111:3300/0 conn(0x7fe4001325d0 msgr2=0x7fe40013fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:30.564 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.558+0000 7fe3fdd9b700 1 --2- 172.21.15.111:0/3943248978 >> v2:172.21.15.111:3300/0 conn(0x7fe4001325d0 0x7fe40013fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:30.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.558+0000 7fe3fdd9b700 1 -- 172.21.15.111:0/3943248978 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4000ac720 con 0x7fe400132180 2024-04-25T02:23:30.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.558+0000 7fe3fed9d700 1 --2- 172.21.15.111:0/3943248978 >> v2:172.21.15.111:3300/0 conn(0x7fe4001325d0 0x7fe40013fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:30.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.558+0000 7fe3fe59c700 1 --2- 172.21.15.111:0/3943248978 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe400063a40 0x7fe4000abdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:30.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.558+0000 7fe3fdd9b700 1 --2- 172.21.15.111:0/3943248978 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe400132180 0x7fe40013f6e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe3f40098e0 tx=0x7fe3f40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7871ffc6a6d88851 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:30.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.558+0000 7fe3fd59a700 1 -- 172.21.15.111:0/3943248978 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f4011630 con 0x7fe400132180 2024-04-25T02:23:30.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.558+0000 7fe3fd59a700 1 -- 172.21.15.111:0/3943248978 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f4011790 con 0x7fe400132180 2024-04-25T02:23:30.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.558+0000 7fe3fd59a700 1 -- 172.21.15.111:0/3943248978 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f4011b30 con 0x7fe400132180 2024-04-25T02:23:30.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.559+0000 7fe40487a700 1 -- 172.21.15.111:0/3943248978 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe400132180 msgr2=0x7fe40013f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:30.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.559+0000 7fe40487a700 1 --2- 172.21.15.111:0/3943248978 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe400132180 0x7fe40013f6e0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fe3f40098e0 tx=0x7fe3f40091a0 comp rx=0 tx=0).stop 2024-04-25T02:23:30.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.559+0000 7fe40487a700 1 -- 172.21.15.111:0/3943248978 shutdown_connections 2024-04-25T02:23:30.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.559+0000 7fe40487a700 1 --2- 172.21.15.111:0/3943248978 >> v2:172.21.15.111:3300/0 conn(0x7fe4001325d0 0x7fe40013fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:30.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.559+0000 7fe40487a700 1 --2- 172.21.15.111:0/3943248978 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe400063a40 0x7fe4000abdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:30.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.559+0000 7fe40487a700 1 --2- 172.21.15.111:0/3943248978 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe400132180 0x7fe40013f6e0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:30.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.559+0000 7fe40487a700 1 -- 172.21.15.111:0/3943248978 >> 172.21.15.111:0/3943248978 conn(0x7fe4000b1e80 msgr2=0x7fe4000adef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:30.565 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.559+0000 7fe40487a700 1 -- 172.21.15.111:0/3943248978 shutdown_connections 2024-04-25T02:23:30.566 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.559+0000 7fe40487a700 1 -- 172.21.15.111:0/3943248978 wait complete. 2024-04-25T02:23:30.566 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.560+0000 7fe40487a700 1 Processor -- start 2024-04-25T02:23:30.566 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.560+0000 7fe40487a700 1 -- start start 2024-04-25T02:23:30.567 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.560+0000 7fe40487a700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe400063a40 0x7fe4001386f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:30.568 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.560+0000 7fe40487a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe400132180 0x7fe4000aa2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:30.568 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.560+0000 7fe40487a700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe4001325d0 0x7fe400131540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:30.568 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.560+0000 7fe40487a700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe400139240 con 0x7fe400132180 2024-04-25T02:23:30.568 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.560+0000 7fe40487a700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4000aa830 con 0x7fe4001325d0 2024-04-25T02:23:30.568 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.560+0000 7fe40487a700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe400139970 con 0x7fe400063a40 2024-04-25T02:23:30.568 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.561+0000 7fe3fe59c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe400063a40 0x7fe4001386f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:30.568 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.561+0000 7fe3fdd9b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe400132180 0x7fe4000aa2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:30.568 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.561+0000 7fe3fed9d700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe4001325d0 0x7fe400131540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:30.568 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.561+0000 7fe3fe59c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe400063a40 0x7fe4001386f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:45310/0 (socket says 172.21.15.111:45310) 2024-04-25T02:23:30.568 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.561+0000 7fe3fdd9b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe400132180 0x7fe4000aa2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:56644/0 (socket says 172.21.15.111:56644) 2024-04-25T02:23:30.568 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.561+0000 7fe3fe59c700 1 -- 172.21.15.111:0/2684589765 learned_addr learned my addr 172.21.15.111:0/2684589765 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:30.568 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.561+0000 7fe3fe59c700 1 -- 172.21.15.111:0/2684589765 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe4001325d0 msgr2=0x7fe400131540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:30.568 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.561+0000 7fe3fe59c700 1 --2- 172.21.15.111:0/2684589765 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe4001325d0 0x7fe400131540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:30.569 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.561+0000 7fe3fe59c700 1 -- 172.21.15.111:0/2684589765 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe400132180 msgr2=0x7fe4000aa2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:30.569 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.561+0000 7fe3fe59c700 1 --2- 172.21.15.111:0/2684589765 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe400132180 0x7fe4000aa2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:30.569 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.561+0000 7fe3fe59c700 1 -- 172.21.15.111:0/2684589765 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3f00094f0 con 0x7fe400063a40 2024-04-25T02:23:30.569 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.561+0000 7fe3fdd9b700 1 --2- 172.21.15.111:0/2684589765 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe400132180 0x7fe4000aa2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:30.569 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.561+0000 7fe3fed9d700 1 --2- 172.21.15.111:0/2684589765 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe4001325d0 0x7fe400131540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:30.569 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.561+0000 7fe3fe59c700 1 --2- 172.21.15.111:0/2684589765 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe400063a40 0x7fe4001386f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe3f000ec50 tx=0x7fe3f0009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:30.569 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.561+0000 7fe3ee7fc700 1 -- 172.21.15.111:0/2684589765 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f000c850 con 0x7fe400063a40 2024-04-25T02:23:30.569 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.561+0000 7fe3ee7fc700 1 -- 172.21.15.111:0/2684589765 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe3f000c9b0 con 0x7fe400063a40 2024-04-25T02:23:30.569 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.561+0000 7fe40487a700 1 -- 172.21.15.111:0/2684589765 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3f8009a20 con 0x7fe400063a40 2024-04-25T02:23:30.569 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.561+0000 7fe3ee7fc700 1 -- 172.21.15.111:0/2684589765 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe3f000cd50 con 0x7fe400063a40 2024-04-25T02:23:30.569 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.561+0000 7fe40487a700 1 -- 172.21.15.111:0/2684589765 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3f4009420 con 0x7fe400063a40 2024-04-25T02:23:30.569 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.562+0000 7fe40487a700 1 -- 172.21.15.111:0/2684589765 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe400065190 con 0x7fe400063a40 2024-04-25T02:23:30.569 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.562+0000 7fe3ee7fc700 1 -- 172.21.15.111:0/2684589765 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7fe3f0013680 con 0x7fe400063a40 2024-04-25T02:23:30.569 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.563+0000 7fe3ee7fc700 1 -- 172.21.15.111:0/2684589765 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7fe3f005b270 con 0x7fe400063a40 2024-04-25T02:23:30.570 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.566+0000 7fe3ee7fc700 1 -- 172.21.15.111:0/2684589765 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fe3f0039490 con 0x7fe400063a40 2024-04-25T02:23:30.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.718+0000 7fe40487a700 1 -- 172.21.15.111:0/2684589765 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe4000af200 con 0x7fe400063a40 2024-04-25T02:23:30.722 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.719+0000 7fe3ee7fc700 1 -- 172.21.15.111:0/2684589765 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v40) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe3f003cc80 con 0x7fe400063a40 2024-04-25T02:23:30.723 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 32 2024-04-25T02:23:30.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.720+0000 7fe40487a700 1 -- 172.21.15.111:0/2684589765 >> v1:172.21.15.111:6816/46482 conn(0x7fe3e0046010 legacy=0x7fe3e00484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:30.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.721+0000 7fe40487a700 1 -- 172.21.15.111:0/2684589765 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe400063a40 msgr2=0x7fe4001386f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:30.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.721+0000 7fe40487a700 1 --2- 172.21.15.111:0/2684589765 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe400063a40 0x7fe4001386f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe3f000ec50 tx=0x7fe3f0009250 comp rx=0 tx=0).stop 2024-04-25T02:23:30.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.721+0000 7fe40487a700 1 -- 172.21.15.111:0/2684589765 shutdown_connections 2024-04-25T02:23:30.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.721+0000 7fe40487a700 1 --2- 172.21.15.111:0/2684589765 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe4001325d0 0x7fe400131540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:30.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.721+0000 7fe40487a700 1 --2- 172.21.15.111:0/2684589765 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe400063a40 0x7fe4001386f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:30.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.721+0000 7fe40487a700 1 --2- 172.21.15.111:0/2684589765 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe400132180 0x7fe4000aa2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:30.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.721+0000 7fe40487a700 1 -- 172.21.15.111:0/2684589765 >> 172.21.15.111:0/2684589765 conn(0x7fe4000b1e80 msgr2=0x7fe4000abcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:30.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.721+0000 7fe40487a700 1 -- 172.21.15.111:0/2684589765 shutdown_connections 2024-04-25T02:23:30.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.721+0000 7fe40487a700 1 -- 172.21.15.111:0/2684589765 wait complete. 2024-04-25T02:23:30.736 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:23:30.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.850+0000 7ffb44870700 1 Processor -- start 2024-04-25T02:23:30.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.850+0000 7ffb44870700 1 -- start start 2024-04-25T02:23:30.862 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.851+0000 7ffb44870700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ffb400b2da0 0x7ffb40069d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:30.862 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.851+0000 7ffb44870700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ffb400a42e0 0x7ffb4006eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:30.862 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.851+0000 7ffb44870700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb4006a930 con 0x7ffb4006f0d0 2024-04-25T02:23:30.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.851+0000 7ffb44870700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb4006a690 con 0x7ffb400a42e0 2024-04-25T02:23:30.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.851+0000 7ffb44870700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb400a56f0 con 0x7ffb400b2da0 2024-04-25T02:23:30.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.851+0000 7ffb3e59c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ffb400b2da0 0x7ffb40069d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:30.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.851+0000 7ffb3dd9b700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ffb400a42e0 0x7ffb4006eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:30.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.851+0000 7ffb3ed9d700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7ffb4006f0d0 0x7ffb40148630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:48118/0 (socket says 172.21.15.111:48118) 2024-04-25T02:23:30.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.851+0000 7ffb3ed9d700 1 -- 172.21.15.111:0/10317646 learned_addr learned my addr 172.21.15.111:0/10317646 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:23:30.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.852+0000 7ffb3d59a700 1 -- 172.21.15.111:0/10317646 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3318238683 0 0) 0x7ffb4006a930 con 0x7ffb4006f0d0 2024-04-25T02:23:30.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.852+0000 7ffb3dd9b700 1 -- 172.21.15.111:0/10317646 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ffb400b2da0 msgr2=0x7ffb40069d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:30.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.852+0000 7ffb3dd9b700 1 --2- 172.21.15.111:0/10317646 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ffb400b2da0 0x7ffb40069d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:30.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.852+0000 7ffb3dd9b700 1 -- 172.21.15.111:0/10317646 >> v1:172.21.15.111:6789/0 conn(0x7ffb4006f0d0 legacy=0x7ffb40148630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:30.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.852+0000 7ffb3dd9b700 1 -- 172.21.15.111:0/10317646 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb400a3610 con 0x7ffb400a42e0 2024-04-25T02:23:30.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.852+0000 7ffb3dd9b700 1 --2- 172.21.15.111:0/10317646 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ffb400a42e0 0x7ffb4006eb90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ffb30009910 tx=0x7ffb300091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=88d9f58117a45235 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:30.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.852+0000 7ffb3d59a700 1 -- 172.21.15.111:0/10317646 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3000b680 con 0x7ffb400a42e0 2024-04-25T02:23:30.863 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.852+0000 7ffb3d59a700 1 -- 172.21.15.111:0/10317646 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb3000b7e0 con 0x7ffb400a42e0 2024-04-25T02:23:30.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.852+0000 7ffb3d59a700 1 -- 172.21.15.111:0/10317646 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3000bba0 con 0x7ffb400a42e0 2024-04-25T02:23:30.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.852+0000 7ffb44870700 1 -- 172.21.15.111:0/10317646 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ffb400a42e0 msgr2=0x7ffb4006eb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:30.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.852+0000 7ffb44870700 1 --2- 172.21.15.111:0/10317646 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ffb400a42e0 0x7ffb4006eb90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ffb30009910 tx=0x7ffb300091a0 comp rx=0 tx=0).stop 2024-04-25T02:23:30.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.852+0000 7ffb44870700 1 -- 172.21.15.111:0/10317646 shutdown_connections 2024-04-25T02:23:30.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.852+0000 7ffb44870700 1 --2- 172.21.15.111:0/10317646 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ffb400b2da0 0x7ffb40069d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:30.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.852+0000 7ffb44870700 1 --2- 172.21.15.111:0/10317646 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ffb400a42e0 0x7ffb4006eb90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:30.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.852+0000 7ffb44870700 1 -- 172.21.15.111:0/10317646 >> 172.21.15.111:0/10317646 conn(0x7ffb4006bcb0 msgr2=0x7ffb4006c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:30.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.853+0000 7ffb44870700 1 -- 172.21.15.111:0/10317646 shutdown_connections 2024-04-25T02:23:30.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.853+0000 7ffb44870700 1 -- 172.21.15.111:0/10317646 wait complete. 2024-04-25T02:23:30.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.853+0000 7ffb44870700 1 Processor -- start 2024-04-25T02:23:30.864 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.853+0000 7ffb44870700 1 -- start start 2024-04-25T02:23:30.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.854+0000 7ffb44870700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ffb4006f0d0 0x7ffb400ae3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:30.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.854+0000 7ffb44870700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ffb400a42e0 0x7ffb401516f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:30.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.854+0000 7ffb44870700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffb400b2da0 0x7ffb40151c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:30.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.854+0000 7ffb44870700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb40096a70 con 0x7ffb400b2da0 2024-04-25T02:23:30.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.854+0000 7ffb44870700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb40097f20 con 0x7ffb4006f0d0 2024-04-25T02:23:30.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.854+0000 7ffb44870700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ffb400aea70 con 0x7ffb400a42e0 2024-04-25T02:23:30.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.854+0000 7ffb3e59c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ffb4006f0d0 0x7ffb400ae3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:30.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.854+0000 7ffb3dd9b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ffb400a42e0 0x7ffb401516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:30.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.854+0000 7ffb3e59c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ffb4006f0d0 0x7ffb400ae3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:36406/0 (socket says 172.21.15.111:36406) 2024-04-25T02:23:30.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.854+0000 7ffb3e59c700 1 -- 172.21.15.111:0/1543855312 learned_addr learned my addr 172.21.15.111:0/1543855312 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:30.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.854+0000 7ffb3ed9d700 1 --2- 172.21.15.111:0/1543855312 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffb400b2da0 0x7ffb40151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:30.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.854+0000 7ffb3e59c700 1 -- 172.21.15.111:0/1543855312 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ffb400a42e0 msgr2=0x7ffb401516f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:30.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.854+0000 7ffb3e59c700 1 --2- 172.21.15.111:0/1543855312 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ffb400a42e0 0x7ffb401516f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:30.865 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.854+0000 7ffb3e59c700 1 -- 172.21.15.111:0/1543855312 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffb400b2da0 msgr2=0x7ffb40151c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:30.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.854+0000 7ffb3e59c700 1 --2- 172.21.15.111:0/1543855312 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffb400b2da0 0x7ffb40151c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:30.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.854+0000 7ffb3e59c700 1 -- 172.21.15.111:0/1543855312 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb30009420 con 0x7ffb4006f0d0 2024-04-25T02:23:30.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.854+0000 7ffb3dd9b700 1 --2- 172.21.15.111:0/1543855312 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ffb400a42e0 0x7ffb401516f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:30.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.854+0000 7ffb3e59c700 1 --2- 172.21.15.111:0/1543855312 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ffb4006f0d0 0x7ffb400ae3b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ffb3400ec80 tx=0x7ffb340091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:30.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.855+0000 7ffb2e7fc700 1 -- 172.21.15.111:0/1543855312 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3400c850 con 0x7ffb4006f0d0 2024-04-25T02:23:30.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.855+0000 7ffb2e7fc700 1 -- 172.21.15.111:0/1543855312 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb3400c9b0 con 0x7ffb4006f0d0 2024-04-25T02:23:30.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.855+0000 7ffb44870700 1 -- 172.21.15.111:0/1543855312 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb4006c710 con 0x7ffb4006f0d0 2024-04-25T02:23:30.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.855+0000 7ffb2e7fc700 1 -- 172.21.15.111:0/1543855312 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb3400cd50 con 0x7ffb4006f0d0 2024-04-25T02:23:30.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.855+0000 7ffb44870700 1 -- 172.21.15.111:0/1543855312 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb40098a30 con 0x7ffb4006f0d0 2024-04-25T02:23:30.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.855+0000 7ffb44870700 1 -- 172.21.15.111:0/1543855312 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb40096bb0 con 0x7ffb4006f0d0 2024-04-25T02:23:30.866 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.856+0000 7ffb2e7fc700 1 -- 172.21.15.111:0/1543855312 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7ffb34013680 con 0x7ffb4006f0d0 2024-04-25T02:23:30.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.856+0000 7ffb2e7fc700 1 -- 172.21.15.111:0/1543855312 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7ffb3405b490 con 0x7ffb4006f0d0 2024-04-25T02:23:30.867 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:30.859+0000 7ffb2e7fc700 1 -- 172.21.15.111:0/1543855312 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7ffb340396b0 con 0x7ffb4006f0d0 2024-04-25T02:23:31.021 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.017+0000 7ffb44870700 1 -- 172.21.15.111:0/1543855312 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ffb40065190 con 0x7ffb4006f0d0 2024-04-25T02:23:31.022 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.018+0000 7ffb2e7fc700 1 -- 172.21.15.111:0/1543855312 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v40) v1 ==== 100+0+11 (secure 0 0 0) 0x7ffb3403cea0 con 0x7ffb4006f0d0 2024-04-25T02:23:31.022 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 64 2024-04-25T02:23:31.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.020+0000 7ffb44870700 1 -- 172.21.15.111:0/1543855312 >> v1:172.21.15.111:6816/46482 conn(0x7ffb20046010 legacy=0x7ffb200484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:31.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.020+0000 7ffb44870700 1 -- 172.21.15.111:0/1543855312 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ffb4006f0d0 msgr2=0x7ffb400ae3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:31.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.020+0000 7ffb44870700 1 --2- 172.21.15.111:0/1543855312 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ffb4006f0d0 0x7ffb400ae3b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ffb3400ec80 tx=0x7ffb340091a0 comp rx=0 tx=0).stop 2024-04-25T02:23:31.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.020+0000 7ffb44870700 1 -- 172.21.15.111:0/1543855312 shutdown_connections 2024-04-25T02:23:31.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.020+0000 7ffb44870700 1 --2- 172.21.15.111:0/1543855312 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ffb400b2da0 0x7ffb40151c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:31.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.020+0000 7ffb44870700 1 --2- 172.21.15.111:0/1543855312 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ffb4006f0d0 0x7ffb400ae3b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:31.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.020+0000 7ffb44870700 1 --2- 172.21.15.111:0/1543855312 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ffb400a42e0 0x7ffb401516f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:31.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.020+0000 7ffb44870700 1 -- 172.21.15.111:0/1543855312 >> 172.21.15.111:0/1543855312 conn(0x7ffb4006bcb0 msgr2=0x7ffb40145150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:31.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.020+0000 7ffb44870700 1 -- 172.21.15.111:0/1543855312 shutdown_connections 2024-04-25T02:23:31.024 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.020+0000 7ffb44870700 1 -- 172.21.15.111:0/1543855312 wait complete. 2024-04-25T02:23:31.035 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:23:31.150 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.147+0000 7f28ec44a700 1 Processor -- start 2024-04-25T02:23:31.150 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.147+0000 7f28ec44a700 1 -- start start 2024-04-25T02:23:31.153 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.147+0000 7f28ec44a700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f28e40b32c0 0x7f28e4069be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:31.153 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.147+0000 7f28ec44a700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f28e406a120 0x7f28e406eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:31.153 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.147+0000 7f28ec44a700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28e406a5b0 con 0x7f28e40a42a0 2024-04-25T02:23:31.153 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.147+0000 7f28ec44a700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28e40a4850 con 0x7f28e40b32c0 2024-04-25T02:23:31.153 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.147+0000 7f28ec44a700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28e406a850 con 0x7f28e406a120 2024-04-25T02:23:31.153 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.147+0000 7f28e99e5700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f28e406a120 0x7f28e406eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:31.153 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.147+0000 7f28ea1e6700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f28e40b32c0 0x7f28e4069be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:31.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.147+0000 7f28ea1e6700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f28e40b32c0 0x7f28e4069be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:56656/0 (socket says 172.21.15.111:56656) 2024-04-25T02:23:31.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.147+0000 7f28e99e5700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f28e406a120 0x7f28e406eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:45330/0 (socket says 172.21.15.111:45330) 2024-04-25T02:23:31.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.147+0000 7f28ea9e7700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f28e40a42a0 0x7f28e406f0a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:48130/0 (socket says 172.21.15.111:48130) 2024-04-25T02:23:31.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.147+0000 7f28ea1e6700 1 -- 172.21.15.111:0/2572320057 learned_addr learned my addr 172.21.15.111:0/2572320057 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:31.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.148+0000 7f28e99e5700 1 -- 172.21.15.111:0/2572320057 >> v2:172.21.15.111:3300/0 conn(0x7f28e40b32c0 msgr2=0x7f28e4069be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:31.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.148+0000 7f28e99e5700 1 --2- 172.21.15.111:0/2572320057 >> v2:172.21.15.111:3300/0 conn(0x7f28e40b32c0 0x7f28e4069be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:31.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.148+0000 7f28e99e5700 1 -- 172.21.15.111:0/2572320057 >> v1:172.21.15.111:6789/0 conn(0x7f28e40a42a0 legacy=0x7f28e406f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:31.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.148+0000 7f28e99e5700 1 -- 172.21.15.111:0/2572320057 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e40a49c0 con 0x7f28e406a120 2024-04-25T02:23:31.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.148+0000 7f28ea1e6700 1 --2- 172.21.15.111:0/2572320057 >> v2:172.21.15.111:3300/0 conn(0x7f28e40b32c0 0x7f28e4069be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:31.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.148+0000 7f28e99e5700 1 --2- 172.21.15.111:0/2572320057 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f28e406a120 0x7f28e406eb60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f28d40098e0 tx=0x7f28d40091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a42366bd0fd11f30 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:31.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.148+0000 7f28e91e4700 1 -- 172.21.15.111:0/2572320057 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d400b640 con 0x7f28e406a120 2024-04-25T02:23:31.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.148+0000 7f28e91e4700 1 -- 172.21.15.111:0/2572320057 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28d400b7a0 con 0x7f28e406a120 2024-04-25T02:23:31.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.148+0000 7f28e91e4700 1 -- 172.21.15.111:0/2572320057 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28d400bb40 con 0x7f28e406a120 2024-04-25T02:23:31.154 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.149+0000 7f28ec44a700 1 -- 172.21.15.111:0/2572320057 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f28e406a120 msgr2=0x7f28e406eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:31.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.149+0000 7f28ec44a700 1 --2- 172.21.15.111:0/2572320057 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f28e406a120 0x7f28e406eb60 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f28d40098e0 tx=0x7f28d40091a0 comp rx=0 tx=0).stop 2024-04-25T02:23:31.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.149+0000 7f28ec44a700 1 -- 172.21.15.111:0/2572320057 shutdown_connections 2024-04-25T02:23:31.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.149+0000 7f28ec44a700 1 --2- 172.21.15.111:0/2572320057 >> v2:172.21.15.111:3300/0 conn(0x7f28e40b32c0 0x7f28e4069be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:31.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.149+0000 7f28ec44a700 1 --2- 172.21.15.111:0/2572320057 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f28e406a120 0x7f28e406eb60 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:31.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.149+0000 7f28ec44a700 1 -- 172.21.15.111:0/2572320057 >> 172.21.15.111:0/2572320057 conn(0x7f28e406e2b0 msgr2=0x7f28e406be80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:31.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.149+0000 7f28ec44a700 1 -- 172.21.15.111:0/2572320057 shutdown_connections 2024-04-25T02:23:31.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.149+0000 7f28ec44a700 1 -- 172.21.15.111:0/2572320057 wait complete. 2024-04-25T02:23:31.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.150+0000 7f28ec44a700 1 Processor -- start 2024-04-25T02:23:31.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.150+0000 7f28ec44a700 1 -- start start 2024-04-25T02:23:31.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.150+0000 7f28ec44a700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f28e406a120 0x7f28e40ae630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:31.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.150+0000 7f28ec44a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f28e40a42a0 0x7f28e413ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:31.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.150+0000 7f28ec44a700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f28e40b32c0 0x7f28e413ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:31.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.150+0000 7f28ec44a700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28e4097f60 con 0x7f28e40a42a0 2024-04-25T02:23:31.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.150+0000 7f28ec44a700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28e4098810 con 0x7f28e406a120 2024-04-25T02:23:31.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.150+0000 7f28ec44a700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f28e4098ad0 con 0x7f28e40b32c0 2024-04-25T02:23:31.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.150+0000 7f28ea9e7700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f28e40b32c0 0x7f28e413ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:31.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.150+0000 7f28e99e5700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f28e40a42a0 0x7f28e413ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:31.157 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.150+0000 7f28ea1e6700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f28e406a120 0x7f28e40ae630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:31.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.150+0000 7f28e99e5700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f28e40a42a0 0x7f28e413ea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:56660/0 (socket says 172.21.15.111:56660) 2024-04-25T02:23:31.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.150+0000 7f28ea1e6700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f28e406a120 0x7f28e40ae630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:36418/0 (socket says 172.21.15.111:36418) 2024-04-25T02:23:31.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.150+0000 7f28ea9e7700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f28e40b32c0 0x7f28e413ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:45334/0 (socket says 172.21.15.111:45334) 2024-04-25T02:23:31.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.150+0000 7f28e99e5700 1 -- 172.21.15.111:0/2510395459 learned_addr learned my addr 172.21.15.111:0/2510395459 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:31.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.150+0000 7f28ea9e7700 1 -- 172.21.15.111:0/2510395459 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f28e406a120 msgr2=0x7f28e40ae630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:31.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.150+0000 7f28ea9e7700 1 --2- 172.21.15.111:0/2510395459 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f28e406a120 0x7f28e40ae630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:31.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.151+0000 7f28ea9e7700 1 -- 172.21.15.111:0/2510395459 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f28e40a42a0 msgr2=0x7f28e413ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:31.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.151+0000 7f28ea9e7700 1 --2- 172.21.15.111:0/2510395459 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f28e40a42a0 0x7f28e413ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:31.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.151+0000 7f28ea9e7700 1 -- 172.21.15.111:0/2510395459 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28e00094f0 con 0x7f28e40b32c0 2024-04-25T02:23:31.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.151+0000 7f28ea9e7700 1 --2- 172.21.15.111:0/2510395459 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f28e40b32c0 0x7f28e413ef60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f28dc00cc40 tx=0x7f28dc001a50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:31.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.151+0000 7f28da7fc700 1 -- 172.21.15.111:0/2510395459 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28dc005df0 con 0x7f28e40b32c0 2024-04-25T02:23:31.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.151+0000 7f28da7fc700 1 -- 172.21.15.111:0/2510395459 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28dc00a730 con 0x7f28e40b32c0 2024-04-25T02:23:31.158 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.151+0000 7f28da7fc700 1 -- 172.21.15.111:0/2510395459 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28dc00aaf0 con 0x7f28e40b32c0 2024-04-25T02:23:31.159 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.151+0000 7f28ec44a700 1 -- 172.21.15.111:0/2510395459 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28d4009420 con 0x7f28e40b32c0 2024-04-25T02:23:31.159 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.151+0000 7f28ec44a700 1 -- 172.21.15.111:0/2510395459 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28e413f4a0 con 0x7f28e40b32c0 2024-04-25T02:23:31.159 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.152+0000 7f28da7fc700 1 -- 172.21.15.111:0/2510395459 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f28dc0070f0 con 0x7f28e40b32c0 2024-04-25T02:23:31.159 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.152+0000 7f28ec44a700 1 -- 172.21.15.111:0/2510395459 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28e40aeff0 con 0x7f28e40b32c0 2024-04-25T02:23:31.159 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.152+0000 7f28da7fc700 1 -- 172.21.15.111:0/2510395459 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f28dc05b100 con 0x7f28e40b32c0 2024-04-25T02:23:31.159 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.156+0000 7f28da7fc700 1 -- 172.21.15.111:0/2510395459 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f28dc039340 con 0x7f28e40b32c0 2024-04-25T02:23:31.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.342+0000 7f28ec44a700 1 -- 172.21.15.111:0/2510395459 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f28e40aedc0 con 0x7f28e40b32c0 2024-04-25T02:23:31.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.342+0000 7f28da7fc700 1 -- 172.21.15.111:0/2510395459 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+3672 (secure 0 0 0) 0x7f28dc03e090 con 0x7f28e40b32c0 2024-04-25T02:23:31.346 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:23:31.346 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":true},"standbys":[{"gid":14404,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6818/4022954817","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6818","nonce":4022954817}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":14405,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6817/1113530749","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6817","nonce":1113530749}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:20:24.150791+0000","modified":"2024-04-25T02:23:19.864524+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14417},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14417":{"gid":14417,"name":"b","rank":0,"incarnation":16,"state":"up:active","state_seq":4,"addr":"172.21.15.111:6819/696898730","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6819","nonce":696898730}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-25T02:23:31.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.344+0000 7f28ec44a700 1 -- 172.21.15.111:0/2510395459 >> v1:172.21.15.111:6816/46482 conn(0x7f28c8046010 legacy=0x7f28c80484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:31.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.344+0000 7f28ec44a700 1 -- 172.21.15.111:0/2510395459 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f28e40b32c0 msgr2=0x7f28e413ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:31.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.344+0000 7f28ec44a700 1 --2- 172.21.15.111:0/2510395459 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f28e40b32c0 0x7f28e413ef60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f28dc00cc40 tx=0x7f28dc001a50 comp rx=0 tx=0).stop 2024-04-25T02:23:31.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.344+0000 7f28ec44a700 1 -- 172.21.15.111:0/2510395459 shutdown_connections 2024-04-25T02:23:31.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.344+0000 7f28ec44a700 1 --2- 172.21.15.111:0/2510395459 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f28e40b32c0 0x7f28e413ef60 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:31.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.344+0000 7f28ec44a700 1 --2- 172.21.15.111:0/2510395459 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f28e406a120 0x7f28e40ae630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:31.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.344+0000 7f28ec44a700 1 --2- 172.21.15.111:0/2510395459 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f28e40a42a0 0x7f28e413ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:31.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.344+0000 7f28ec44a700 1 -- 172.21.15.111:0/2510395459 >> 172.21.15.111:0/2510395459 conn(0x7f28e406e2b0 msgr2=0x7f28e4063d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:31.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.344+0000 7f28ec44a700 1 -- 172.21.15.111:0/2510395459 shutdown_connections 2024-04-25T02:23:31.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.344+0000 7f28ec44a700 1 -- 172.21.15.111:0/2510395459 wait complete. 2024-04-25T02:23:31.349 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 19 2024-04-25T02:23:31.359 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:23:31.476 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.470+0000 7f3ea992d700 1 Processor -- start 2024-04-25T02:23:31.476 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.470+0000 7f3ea992d700 1 -- start start 2024-04-25T02:23:31.476 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.471+0000 7f3ea992d700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3ea406c8f0 0x7f3ea40a53e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:31.477 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.471+0000 7f3ea992d700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f3ea40a6920 0x7f3ea4138350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:31.477 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.471+0000 7f3ea992d700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3ea4138890 0x7f3ea406e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:31.477 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.471+0000 7f3ea992d700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ea40a5920 con 0x7f3ea40a6920 2024-04-25T02:23:31.477 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.471+0000 7f3ea992d700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea40a6040 con 0x7f3ea4138890 2024-04-25T02:23:31.477 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.471+0000 7f3ea992d700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea413e830 con 0x7f3ea406c8f0 2024-04-25T02:23:31.477 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.471+0000 7f3ea27fc700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f3ea40a6920 0x7f3ea4138350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:31.477 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.471+0000 7f3ea2ffd700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3ea406c8f0 0x7f3ea40a53e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:31.477 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.471+0000 7f3ea37fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3ea4138890 0x7f3ea406e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:31.477 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.471+0000 7f3ea27fc700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f3ea40a6920 0x7f3ea4138350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:56666/0 (socket says 172.21.15.111:56666) 2024-04-25T02:23:31.477 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.471+0000 7f3ea2ffd700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3ea406c8f0 0x7f3ea40a53e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:45346/0 (socket says 172.21.15.111:45346) 2024-04-25T02:23:31.477 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.471+0000 7f3ea37fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3ea4138890 0x7f3ea406e290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:36424/0 (socket says 172.21.15.111:36424) 2024-04-25T02:23:31.477 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.471+0000 7f3ea27fc700 1 -- 172.21.15.111:0/2643595962 learned_addr learned my addr 172.21.15.111:0/2643595962 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:31.477 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.471+0000 7f3ea37fe700 1 -- 172.21.15.111:0/2643595962 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3ea406c8f0 msgr2=0x7f3ea40a53e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:31.477 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.471+0000 7f3ea37fe700 1 --2- 172.21.15.111:0/2643595962 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3ea406c8f0 0x7f3ea40a53e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:31.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.471+0000 7f3ea37fe700 1 -- 172.21.15.111:0/2643595962 >> v2:172.21.15.111:3300/0 conn(0x7f3ea40a6920 msgr2=0x7f3ea4138350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:31.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.471+0000 7f3ea37fe700 1 --2- 172.21.15.111:0/2643595962 >> v2:172.21.15.111:3300/0 conn(0x7f3ea40a6920 0x7f3ea4138350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:31.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.471+0000 7f3ea37fe700 1 -- 172.21.15.111:0/2643595962 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ea413eaf0 con 0x7f3ea4138890 2024-04-25T02:23:31.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.471+0000 7f3ea27fc700 1 --2- 172.21.15.111:0/2643595962 >> v2:172.21.15.111:3300/0 conn(0x7f3ea40a6920 0x7f3ea4138350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:31.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.471+0000 7f3ea2ffd700 1 --2- 172.21.15.111:0/2643595962 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3ea406c8f0 0x7f3ea40a53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:31.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.472+0000 7f3ea37fe700 1 --2- 172.21.15.111:0/2643595962 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3ea4138890 0x7f3ea406e290 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c009e60 tx=0x7f3e9c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=28764d89bbe0730c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:31.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.472+0000 7f3ea1ffb700 1 -- 172.21.15.111:0/2643595962 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c00e070 con 0x7f3ea4138890 2024-04-25T02:23:31.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.472+0000 7f3ea1ffb700 1 -- 172.21.15.111:0/2643595962 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e9c00bab0 con 0x7f3ea4138890 2024-04-25T02:23:31.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.472+0000 7f3ea1ffb700 1 -- 172.21.15.111:0/2643595962 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c00be70 con 0x7f3ea4138890 2024-04-25T02:23:31.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.472+0000 7f3ea992d700 1 -- 172.21.15.111:0/2643595962 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3ea4138890 msgr2=0x7f3ea406e290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:31.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.472+0000 7f3ea992d700 1 --2- 172.21.15.111:0/2643595962 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3ea4138890 0x7f3ea406e290 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c009e60 tx=0x7f3e9c009780 comp rx=0 tx=0).stop 2024-04-25T02:23:31.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.472+0000 7f3ea992d700 1 -- 172.21.15.111:0/2643595962 shutdown_connections 2024-04-25T02:23:31.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.472+0000 7f3ea992d700 1 --2- 172.21.15.111:0/2643595962 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3ea4138890 0x7f3ea406e290 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:31.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.472+0000 7f3ea992d700 1 --2- 172.21.15.111:0/2643595962 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3ea406c8f0 0x7f3ea40a53e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:31.479 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.472+0000 7f3ea992d700 1 --2- 172.21.15.111:0/2643595962 >> v2:172.21.15.111:3300/0 conn(0x7f3ea40a6920 0x7f3ea4138350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:31.479 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.472+0000 7f3ea992d700 1 -- 172.21.15.111:0/2643595962 >> 172.21.15.111:0/2643595962 conn(0x7f3ea4069bf0 msgr2=0x7f3ea4067940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:31.479 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.472+0000 7f3ea992d700 1 -- 172.21.15.111:0/2643595962 shutdown_connections 2024-04-25T02:23:31.479 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.472+0000 7f3ea992d700 1 -- 172.21.15.111:0/2643595962 wait complete. 2024-04-25T02:23:31.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.474+0000 7f3ea992d700 1 Processor -- start 2024-04-25T02:23:31.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.474+0000 7f3ea992d700 1 -- start start 2024-04-25T02:23:31.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.474+0000 7f3ea992d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3ea406c8f0 0x7f3ea40a7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:31.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.474+0000 7f3ea992d700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3ea40a6920 0x7f3ea40b0770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:31.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.474+0000 7f3ea992d700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3ea4138890 0x7f3ea4149f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:31.481 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.474+0000 7f3ea992d700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea413b910 con 0x7f3ea406c8f0 2024-04-25T02:23:31.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.474+0000 7f3ea992d700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea40a7dd0 con 0x7f3ea40a6920 2024-04-25T02:23:31.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.474+0000 7f3ea992d700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3ea4149b10 con 0x7f3ea4138890 2024-04-25T02:23:31.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.475+0000 7f3ea2ffd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3ea406c8f0 0x7f3ea40a7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:31.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.475+0000 7f3ea2ffd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3ea406c8f0 0x7f3ea40a7890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:56678/0 (socket says 172.21.15.111:56678) 2024-04-25T02:23:31.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.475+0000 7f3ea2ffd700 1 -- 172.21.15.111:0/1110672790 learned_addr learned my addr 172.21.15.111:0/1110672790 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:31.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.475+0000 7f3ea27fc700 1 --2- 172.21.15.111:0/1110672790 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3ea40a6920 0x7f3ea40b0770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:31.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.475+0000 7f3ea37fe700 1 --2- 172.21.15.111:0/1110672790 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3ea4138890 0x7f3ea4149f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:31.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.475+0000 7f3ea37fe700 1 -- 172.21.15.111:0/1110672790 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3ea40a6920 msgr2=0x7f3ea40b0770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:31.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.475+0000 7f3ea37fe700 1 --2- 172.21.15.111:0/1110672790 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3ea40a6920 0x7f3ea40b0770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:31.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.475+0000 7f3ea37fe700 1 -- 172.21.15.111:0/1110672790 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3ea406c8f0 msgr2=0x7f3ea40a7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:31.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.475+0000 7f3ea37fe700 1 --2- 172.21.15.111:0/1110672790 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3ea406c8f0 0x7f3ea40a7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:31.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.475+0000 7f3ea37fe700 1 -- 172.21.15.111:0/1110672790 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e98009420 con 0x7f3ea4138890 2024-04-25T02:23:31.482 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.475+0000 7f3ea27fc700 1 --2- 172.21.15.111:0/1110672790 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3ea40a6920 0x7f3ea40b0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:31.483 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.475+0000 7f3ea2ffd700 1 --2- 172.21.15.111:0/1110672790 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3ea406c8f0 0x7f3ea40a7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:31.483 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.475+0000 7f3ea37fe700 1 --2- 172.21.15.111:0/1110672790 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3ea4138890 0x7f3ea4149f40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c016000 tx=0x7f3e9c019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:31.483 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.475+0000 7f3e8affd700 1 -- 172.21.15.111:0/1110672790 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c012e50 con 0x7f3ea4138890 2024-04-25T02:23:31.483 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.475+0000 7f3e8affd700 1 -- 172.21.15.111:0/1110672790 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e9c027470 con 0x7f3ea4138890 2024-04-25T02:23:31.483 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.475+0000 7f3ea992d700 1 -- 172.21.15.111:0/1110672790 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e9400b790 con 0x7f3ea4138890 2024-04-25T02:23:31.483 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.475+0000 7f3e8affd700 1 -- 172.21.15.111:0/1110672790 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e9c027830 con 0x7f3ea4138890 2024-04-25T02:23:31.483 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.475+0000 7f3ea992d700 1 -- 172.21.15.111:0/1110672790 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e9c009a20 con 0x7f3ea4138890 2024-04-25T02:23:31.483 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.476+0000 7f3ea992d700 1 -- 172.21.15.111:0/1110672790 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ea40683b0 con 0x7f3ea4138890 2024-04-25T02:23:31.483 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.476+0000 7f3e8affd700 1 -- 172.21.15.111:0/1110672790 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f3e9c024070 con 0x7f3ea4138890 2024-04-25T02:23:31.483 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.476+0000 7f3e8affd700 1 -- 172.21.15.111:0/1110672790 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f3e9c05d730 con 0x7f3ea4138890 2024-04-25T02:23:31.483 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.480+0000 7f3e8affd700 1 -- 172.21.15.111:0/1110672790 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f3e9c01f940 con 0x7f3ea4138890 2024-04-25T02:23:31.640 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.637+0000 7f3ea992d700 1 -- 172.21.15.111:0/1110672790 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ea40a7f10 con 0x7f3ea4138890 2024-04-25T02:23:31.642 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.638+0000 7f3e8affd700 1 -- 172.21.15.111:0/1110672790 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v40) v1 ==== 74+0+11668 (secure 0 0 0) 0x7f3e9c01f940 con 0x7f3ea4138890 2024-04-25T02:23:31.643 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:23:31.643 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":40,"fsid":"4643f974-f93a-4436-93b8-460ff320e62e","created":"2024-04-25T02:20:05.450475+0000","modified":"2024-04-25T02:23:21.875192+0000","last_up_change":"2024-04-25T02:23:12.818028+0000","last_in_change":"2024-04-25T02:20:10.439204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:20:07.471248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:20:14.420378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:20:22.251868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T02:20:23.128289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"df3f17ca-3b12-42c8-8cf7-8f1b7189e587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":31,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6800","nonce":48862}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6801","nonce":48862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6803","nonce":48862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6802","nonce":48862}]},"public_addr":"172.21.15.111:6800/48862","cluster_addr":"172.21.15.111:6801/48862","heartbeat_back_addr":"172.21.15.111:6803/48862","heartbeat_front_addr":"172.21.15.111:6802/48862","state":["exists","up"]},{"osd":1,"uuid":"93d54815-f215-4285-bba6-32f2d1cabf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":29,"up_thru":31,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6804","nonce":48960}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6805","nonce":48960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6807","nonce":48960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6806","nonce":48960}]},"public_addr":"172.21.15.111:6804/48960","cluster_addr":"172.21.15.111:6805/48960","heartbeat_back_addr":"172.21.15.111:6807/48960","heartbeat_front_addr":"172.21.15.111:6806/48960","state":["exists","up"]},{"osd":2,"uuid":"b26b2104-2a2e-408f-9ce7-3587a32a2ebe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":31,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6808","nonce":49070}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6809","nonce":49070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6811","nonce":49070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6810","nonce":49070}]},"public_addr":"172.21.15.111:6808/49070","cluster_addr":"172.21.15.111:6809/49070","heartbeat_back_addr":"172.21.15.111:6811/49070","heartbeat_front_addr":"172.21.15.111:6810/49070","state":["exists","up"]},{"osd":3,"uuid":"43c25820-1edc-4031-badf-72e87dd6bf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":31,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6812","nonce":49243}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6813","nonce":49243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6815","nonce":49243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6814","nonce":49243}]},"public_addr":"172.21.15.111:6812/49243","cluster_addr":"172.21.15.111:6813/49243","heartbeat_back_addr":"172.21.15.111:6815/49243","heartbeat_front_addr":"172.21.15.111:6814/49243","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.372427+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.411480+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.361508+0000","dead_epoch":25},{"osd":3,"down_stamp":"2024-04-25T02:23:06.771296+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.377212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.111:6819/4003866251":"2024-04-26T02:23:16.839679+0000","172.21.15.111:0/2148931273":"2024-04-26T02:22:54.713254+0000","172.21.15.111:6816/39585":"2024-04-26T02:22:54.713254+0000","172.21.15.111:0/3911588907":"2024-04-26T02:22:54.713254+0000","172.21.15.111:0/1276843622":"2024-04-26T02:22:54.713254+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:23:31.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.639+0000 7f3ea992d700 1 -- 172.21.15.111:0/1110672790 >> v1:172.21.15.111:6816/46482 conn(0x7f3e90046010 legacy=0x7f3e900484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:31.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.639+0000 7f3ea992d700 1 -- 172.21.15.111:0/1110672790 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3ea4138890 msgr2=0x7f3ea4149f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:31.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.639+0000 7f3ea992d700 1 --2- 172.21.15.111:0/1110672790 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3ea4138890 0x7f3ea4149f40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f3e9c016000 tx=0x7f3e9c019000 comp rx=0 tx=0).stop 2024-04-25T02:23:31.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.639+0000 7f3ea992d700 1 -- 172.21.15.111:0/1110672790 shutdown_connections 2024-04-25T02:23:31.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.639+0000 7f3ea992d700 1 --2- 172.21.15.111:0/1110672790 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3ea4138890 0x7f3ea4149f40 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:31.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.639+0000 7f3ea992d700 1 --2- 172.21.15.111:0/1110672790 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3ea406c8f0 0x7f3ea40a7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:31.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.639+0000 7f3ea992d700 1 --2- 172.21.15.111:0/1110672790 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3ea40a6920 0x7f3ea40b0770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:31.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.639+0000 7f3ea992d700 1 -- 172.21.15.111:0/1110672790 >> 172.21.15.111:0/1110672790 conn(0x7f3ea4069bf0 msgr2=0x7f3ea4071320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:31.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.639+0000 7f3ea992d700 1 -- 172.21.15.111:0/1110672790 shutdown_connections 2024-04-25T02:23:31.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.639+0000 7f3ea992d700 1 -- 172.21.15.111:0/1110672790 wait complete. 2024-04-25T02:23:31.655 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:23:31.772 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.767+0000 7efd1a3cd700 1 Processor -- start 2024-04-25T02:23:31.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.767+0000 7efd1a3cd700 1 -- start start 2024-04-25T02:23:31.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.767+0000 7efd1a3cd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efd140a22a0 0x7efd1413b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:31.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.767+0000 7efd1a3cd700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7efd1413b9c0 0x7efd1413bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:31.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.767+0000 7efd1a3cd700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd1406da60 con 0x7efd140a3410 2024-04-25T02:23:31.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.767+0000 7efd1a3cd700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd1413c320 con 0x7efd1413b9c0 2024-04-25T02:23:31.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.767+0000 7efd1a3cd700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd140a2a20 con 0x7efd140a22a0 2024-04-25T02:23:31.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.768+0000 7efd137fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efd140a22a0 0x7efd1413b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:31.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.768+0000 7efd1896a700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7efd1413b9c0 0x7efd1413bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:31.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.768+0000 7efd13fff700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7efd140a3410 0x7efd140a4460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:48136/0 (socket says 172.21.15.111:48136) 2024-04-25T02:23:31.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.768+0000 7efd137fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efd140a22a0 0x7efd1413b480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:36428/0 (socket says 172.21.15.111:36428) 2024-04-25T02:23:31.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.768+0000 7efd13fff700 1 -- 172.21.15.111:0/1293311409 learned_addr learned my addr 172.21.15.111:0/1293311409 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:23:31.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.768+0000 7efd137fe700 1 -- 172.21.15.111:0/1293311409 >> v2:172.21.15.111:3300/0 conn(0x7efd1413b9c0 msgr2=0x7efd1413bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:31.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.768+0000 7efd137fe700 1 --2- 172.21.15.111:0/1293311409 >> v2:172.21.15.111:3300/0 conn(0x7efd1413b9c0 0x7efd1413bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:31.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.768+0000 7efd137fe700 1 -- 172.21.15.111:0/1293311409 >> v1:172.21.15.111:6789/0 conn(0x7efd140a3410 legacy=0x7efd140a4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:31.774 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.768+0000 7efd137fe700 1 -- 172.21.15.111:0/1293311409 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd140a3c80 con 0x7efd140a22a0 2024-04-25T02:23:31.774 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.768+0000 7efd1896a700 1 --2- 172.21.15.111:0/1293311409 >> v2:172.21.15.111:3300/0 conn(0x7efd1413b9c0 0x7efd1413bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:31.774 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.768+0000 7efd137fe700 1 --2- 172.21.15.111:0/1293311409 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efd140a22a0 0x7efd1413b480 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7efd040098e0 tx=0x7efd040091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6573c9bf93b7002a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:31.774 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.768+0000 7efd12ffd700 1 -- 172.21.15.111:0/1293311409 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0400b640 con 0x7efd140a22a0 2024-04-25T02:23:31.774 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.768+0000 7efd12ffd700 1 -- 172.21.15.111:0/1293311409 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd0400b7a0 con 0x7efd140a22a0 2024-04-25T02:23:31.774 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.768+0000 7efd12ffd700 1 -- 172.21.15.111:0/1293311409 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0400bb40 con 0x7efd140a22a0 2024-04-25T02:23:31.774 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.769+0000 7efd1a3cd700 1 -- 172.21.15.111:0/1293311409 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efd140a22a0 msgr2=0x7efd1413b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:31.774 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.769+0000 7efd1a3cd700 1 --2- 172.21.15.111:0/1293311409 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efd140a22a0 0x7efd1413b480 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7efd040098e0 tx=0x7efd040091a0 comp rx=0 tx=0).stop 2024-04-25T02:23:31.774 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.769+0000 7efd1a3cd700 1 -- 172.21.15.111:0/1293311409 shutdown_connections 2024-04-25T02:23:31.774 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.769+0000 7efd1a3cd700 1 --2- 172.21.15.111:0/1293311409 >> v2:172.21.15.111:3300/0 conn(0x7efd1413b9c0 0x7efd1413bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:31.774 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.769+0000 7efd1a3cd700 1 --2- 172.21.15.111:0/1293311409 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efd140a22a0 0x7efd1413b480 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:31.774 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.769+0000 7efd1a3cd700 1 -- 172.21.15.111:0/1293311409 >> 172.21.15.111:0/1293311409 conn(0x7efd140b1cf0 msgr2=0x7efd140b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:31.774 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.769+0000 7efd1a3cd700 1 -- 172.21.15.111:0/1293311409 shutdown_connections 2024-04-25T02:23:31.774 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.769+0000 7efd1a3cd700 1 -- 172.21.15.111:0/1293311409 wait complete. 2024-04-25T02:23:31.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.770+0000 7efd1a3cd700 1 Processor -- start 2024-04-25T02:23:31.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.770+0000 7efd1a3cd700 1 -- start start 2024-04-25T02:23:31.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.771+0000 7efd1a3cd700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7efd140a22a0 0x7efd14067b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:31.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.771+0000 7efd1a3cd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efd140a3410 0x7efd1414f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:31.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.771+0000 7efd1a3cd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efd1413b9c0 0x7efd1414f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:31.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.771+0000 7efd1a3cd700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd140ab6a0 con 0x7efd1413b9c0 2024-04-25T02:23:31.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.771+0000 7efd1a3cd700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd140a9ba0 con 0x7efd140a3410 2024-04-25T02:23:31.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.771+0000 7efd1a3cd700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7efd140a9e40 con 0x7efd140a22a0 2024-04-25T02:23:31.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.771+0000 7efd137fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efd140a3410 0x7efd1414f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:31.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.771+0000 7efd13fff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7efd140a22a0 0x7efd14067b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:31.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.771+0000 7efd1896a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efd1413b9c0 0x7efd1414f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:31.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.771+0000 7efd137fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efd140a3410 0x7efd1414f020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:36438/0 (socket says 172.21.15.111:36438) 2024-04-25T02:23:31.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.771+0000 7efd137fe700 1 -- 172.21.15.111:0/301403796 learned_addr learned my addr 172.21.15.111:0/301403796 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:31.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.771+0000 7efd1896a700 1 -- 172.21.15.111:0/301403796 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7efd140a22a0 msgr2=0x7efd14067b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:31.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.771+0000 7efd1896a700 1 --2- 172.21.15.111:0/301403796 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7efd140a22a0 0x7efd14067b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:31.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.771+0000 7efd1896a700 1 -- 172.21.15.111:0/301403796 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efd140a3410 msgr2=0x7efd1414f020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:31.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.771+0000 7efd1896a700 1 --2- 172.21.15.111:0/301403796 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efd140a3410 0x7efd1414f020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:31.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.771+0000 7efd1896a700 1 -- 172.21.15.111:0/301403796 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd0c009a20 con 0x7efd1413b9c0 2024-04-25T02:23:31.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.771+0000 7efd137fe700 1 --2- 172.21.15.111:0/301403796 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efd140a3410 0x7efd1414f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:31.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.771+0000 7efd1896a700 1 --2- 172.21.15.111:0/301403796 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efd1413b9c0 0x7efd1414f560 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7efd0c009e70 tx=0x7efd0c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:31.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.772+0000 7efcfbfff700 1 -- 172.21.15.111:0/301403796 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0c00caa0 con 0x7efd1413b9c0 2024-04-25T02:23:31.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.772+0000 7efcfbfff700 1 -- 172.21.15.111:0/301403796 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd0c00f040 con 0x7efd1413b9c0 2024-04-25T02:23:31.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.772+0000 7efcfbfff700 1 -- 172.21.15.111:0/301403796 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd0c00ce90 con 0x7efd1413b9c0 2024-04-25T02:23:31.778 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.772+0000 7efd1a3cd700 1 -- 172.21.15.111:0/301403796 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd04009420 con 0x7efd1413b9c0 2024-04-25T02:23:31.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.772+0000 7efd1a3cd700 1 -- 172.21.15.111:0/301403796 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd140685b0 con 0x7efd1413b9c0 2024-04-25T02:23:31.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.772+0000 7efd1a3cd700 1 -- 172.21.15.111:0/301403796 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd1413cc80 con 0x7efd1413b9c0 2024-04-25T02:23:31.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.773+0000 7efcfbfff700 1 -- 172.21.15.111:0/301403796 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7efd0c003020 con 0x7efd1413b9c0 2024-04-25T02:23:31.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.773+0000 7efcfbfff700 1 -- 172.21.15.111:0/301403796 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7efd0c05b9f0 con 0x7efd1413b9c0 2024-04-25T02:23:31.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.776+0000 7efcfbfff700 1 -- 172.21.15.111:0/301403796 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7efd0c039b00 con 0x7efd1413b9c0 2024-04-25T02:23:31.967 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.963+0000 7efd1a3cd700 1 -- 172.21.15.111:0/301403796 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efd1406a150 con 0x7efd1413b9c0 2024-04-25T02:23:31.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.964+0000 7efcfbfff700 1 -- 172.21.15.111:0/301403796 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+3672 (secure 0 0 0) 0x7efd0c018070 con 0x7efd1413b9c0 2024-04-25T02:23:31.968 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:23:31.968 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":true},"standbys":[{"gid":14404,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6818/4022954817","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6818","nonce":4022954817}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":14405,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6817/1113530749","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6817","nonce":1113530749}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:20:24.150791+0000","modified":"2024-04-25T02:23:19.864524+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14417},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14417":{"gid":14417,"name":"b","rank":0,"incarnation":16,"state":"up:active","state_seq":4,"addr":"172.21.15.111:6819/696898730","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6819","nonce":696898730}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-25T02:23:31.969 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.966+0000 7efd1a3cd700 1 -- 172.21.15.111:0/301403796 >> v1:172.21.15.111:6816/46482 conn(0x7efd00046010 legacy=0x7efd000484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:31.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.966+0000 7efd1a3cd700 1 -- 172.21.15.111:0/301403796 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efd1413b9c0 msgr2=0x7efd1414f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:31.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.966+0000 7efd1a3cd700 1 --2- 172.21.15.111:0/301403796 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efd1413b9c0 0x7efd1414f560 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7efd0c009e70 tx=0x7efd0c00b040 comp rx=0 tx=0).stop 2024-04-25T02:23:31.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.966+0000 7efd1a3cd700 1 -- 172.21.15.111:0/301403796 shutdown_connections 2024-04-25T02:23:31.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.966+0000 7efd1a3cd700 1 --2- 172.21.15.111:0/301403796 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7efd1413b9c0 0x7efd1414f560 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:31.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.966+0000 7efd1a3cd700 1 --2- 172.21.15.111:0/301403796 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7efd140a22a0 0x7efd14067b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:31.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.966+0000 7efd1a3cd700 1 --2- 172.21.15.111:0/301403796 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7efd140a3410 0x7efd1414f020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:31.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.966+0000 7efd1a3cd700 1 -- 172.21.15.111:0/301403796 >> 172.21.15.111:0/301403796 conn(0x7efd140b1cf0 msgr2=0x7efd1413c490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:31.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.966+0000 7efd1a3cd700 1 -- 172.21.15.111:0/301403796 shutdown_connections 2024-04-25T02:23:31.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:31.966+0000 7efd1a3cd700 1 -- 172.21.15.111:0/301403796 wait complete. 2024-04-25T02:23:31.971 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 19 2024-04-25T02:23:32.284 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 19, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-25T02:20:24.150791+0000', 'modified': '2024-04-25T02:23:19.864524+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'last_failure': 0, 'last_failure_osd_epoch': 34, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 14417}, 'failed': [], 'damaged': [], 'stopped': [1], 'info': {'gid_14417': {'gid': 14417, 'name': 'b', 'rank': 0, 'incarnation': 16, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.111:6819/696898730', 'addrs': {'addrvec': [{'type': 'v1', 'addr': '172.21.15.111:6819', 'nonce': 696898730}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138320759226367, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [4], 'metadata_pool': 3, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'standby_count_wanted': 0} 2024-04-25T02:23:32.284 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-25T02:23:32.284 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2024-04-25T02:23:32.404 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.399+0000 7f5e4623f700 1 Processor -- start 2024-04-25T02:23:32.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.399+0000 7f5e4623f700 1 -- start start 2024-04-25T02:23:32.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.399+0000 7f5e4623f700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5e400a3410 0x7f5e400a4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:32.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.399+0000 7f5e4623f700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5e4013ed30 0x7f5e40145b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:32.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.400+0000 7f5e4623f700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e4006da60 con 0x7f5e400a22a0 2024-04-25T02:23:32.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.400+0000 7f5e4623f700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e400a2a20 con 0x7f5e4013ed30 2024-04-25T02:23:32.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.400+0000 7f5e4623f700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e400a3c80 con 0x7f5e400a3410 2024-04-25T02:23:32.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.400+0000 7f5e3f7fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5e400a3410 0x7f5e400a4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:32.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.400+0000 7f5e3ffff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5e4013ed30 0x7f5e40145b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:32.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.400+0000 7f5e3effd700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f5e400a22a0 0x7f5e4013e620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:48148/0 (socket says 172.21.15.111:48148) 2024-04-25T02:23:32.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.400+0000 7f5e3effd700 1 -- 172.21.15.111:0/3238667578 learned_addr learned my addr 172.21.15.111:0/3238667578 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:23:32.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.400+0000 7f5e3f7fe700 1 -- 172.21.15.111:0/3238667578 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5e4013ed30 msgr2=0x7f5e40145b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:32.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.400+0000 7f5e3f7fe700 1 --2- 172.21.15.111:0/3238667578 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5e4013ed30 0x7f5e40145b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:32.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.400+0000 7f5e3f7fe700 1 -- 172.21.15.111:0/3238667578 >> v1:172.21.15.111:6789/0 conn(0x7f5e400a22a0 legacy=0x7f5e4013e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:32.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.400+0000 7f5e3e7fc700 1 -- 172.21.15.111:0/3238667578 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1577492546 0 0) 0x7f5e4006da60 con 0x7f5e400a22a0 2024-04-25T02:23:32.406 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.400+0000 7f5e3f7fe700 1 -- 172.21.15.111:0/3238667578 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e400a37e0 con 0x7f5e400a3410 2024-04-25T02:23:32.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.400+0000 7f5e3ffff700 1 --2- 172.21.15.111:0/3238667578 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5e4013ed30 0x7f5e40145b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:32.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.400+0000 7f5e3f7fe700 1 --2- 172.21.15.111:0/3238667578 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5e400a3410 0x7f5e400a4460 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5e38009ec0 tx=0x7f5e38009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=58db605bf1ba5056 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:32.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.400+0000 7f5e3e7fc700 1 -- 172.21.15.111:0/3238667578 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3800e070 con 0x7f5e400a3410 2024-04-25T02:23:32.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.400+0000 7f5e3e7fc700 1 -- 172.21.15.111:0/3238667578 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3800bbf0 con 0x7f5e400a3410 2024-04-25T02:23:32.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.400+0000 7f5e3e7fc700 1 -- 172.21.15.111:0/3238667578 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e38012430 con 0x7f5e400a3410 2024-04-25T02:23:32.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.401+0000 7f5e4623f700 1 -- 172.21.15.111:0/3238667578 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5e400a3410 msgr2=0x7f5e400a4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:32.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.401+0000 7f5e4623f700 1 --2- 172.21.15.111:0/3238667578 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5e400a3410 0x7f5e400a4460 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f5e38009ec0 tx=0x7f5e38009780 comp rx=0 tx=0).stop 2024-04-25T02:23:32.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.401+0000 7f5e4623f700 1 -- 172.21.15.111:0/3238667578 shutdown_connections 2024-04-25T02:23:32.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.401+0000 7f5e4623f700 1 --2- 172.21.15.111:0/3238667578 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5e400a3410 0x7f5e400a4460 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:32.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.401+0000 7f5e4623f700 1 --2- 172.21.15.111:0/3238667578 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5e4013ed30 0x7f5e40145b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:32.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.401+0000 7f5e4623f700 1 -- 172.21.15.111:0/3238667578 >> 172.21.15.111:0/3238667578 conn(0x7f5e400b1cf0 msgr2=0x7f5e400b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:32.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.401+0000 7f5e4623f700 1 -- 172.21.15.111:0/3238667578 shutdown_connections 2024-04-25T02:23:32.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.401+0000 7f5e4623f700 1 -- 172.21.15.111:0/3238667578 wait complete. 2024-04-25T02:23:32.410 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.402+0000 7f5e4623f700 1 Processor -- start 2024-04-25T02:23:32.410 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.402+0000 7f5e4623f700 1 -- start start 2024-04-25T02:23:32.411 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.402+0000 7f5e4623f700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5e400a22a0 0x7f5e400ade40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:32.411 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.402+0000 7f5e4623f700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5e400a3410 0x7f5e4013fde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:32.411 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.402+0000 7f5e4623f700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5e4013ed30 0x7f5e40140320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:32.411 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.402+0000 7f5e4623f700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e4013fb20 con 0x7f5e400a3410 2024-04-25T02:23:32.411 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.402+0000 7f5e4623f700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e400ad6d0 con 0x7f5e4013ed30 2024-04-25T02:23:32.411 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.402+0000 7f5e4623f700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5e401412a0 con 0x7f5e400a22a0 2024-04-25T02:23:32.411 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.403+0000 7f5e3effd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5e400a3410 0x7f5e4013fde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:32.411 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.403+0000 7f5e3ffff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5e4013ed30 0x7f5e40140320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:32.411 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.403+0000 7f5e3ffff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5e4013ed30 0x7f5e40140320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:36460/0 (socket says 172.21.15.111:36460) 2024-04-25T02:23:32.411 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.403+0000 7f5e3effd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5e400a3410 0x7f5e4013fde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:56690/0 (socket says 172.21.15.111:56690) 2024-04-25T02:23:32.411 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.403+0000 7f5e3ffff700 1 -- 172.21.15.111:0/480319019 learned_addr learned my addr 172.21.15.111:0/480319019 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:32.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.403+0000 7f5e3f7fe700 1 --2- 172.21.15.111:0/480319019 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5e400a22a0 0x7f5e400ade40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:32.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.403+0000 7f5e3ffff700 1 -- 172.21.15.111:0/480319019 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5e400a22a0 msgr2=0x7f5e400ade40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:32.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.403+0000 7f5e3ffff700 1 --2- 172.21.15.111:0/480319019 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5e400a22a0 0x7f5e400ade40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:32.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.403+0000 7f5e3ffff700 1 -- 172.21.15.111:0/480319019 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5e400a3410 msgr2=0x7f5e4013fde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:32.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.403+0000 7f5e3ffff700 1 --2- 172.21.15.111:0/480319019 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5e400a3410 0x7f5e4013fde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:32.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.403+0000 7f5e3ffff700 1 -- 172.21.15.111:0/480319019 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e30009420 con 0x7f5e4013ed30 2024-04-25T02:23:32.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.403+0000 7f5e3effd700 1 --2- 172.21.15.111:0/480319019 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5e400a3410 0x7f5e4013fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:32.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.403+0000 7f5e3ffff700 1 --2- 172.21.15.111:0/480319019 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5e4013ed30 0x7f5e40140320 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5e3000ea20 tx=0x7f5e300091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:32.412 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.403+0000 7f5e377fe700 1 -- 172.21.15.111:0/480319019 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3000ee60 con 0x7f5e4013ed30 2024-04-25T02:23:32.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.403+0000 7f5e377fe700 1 -- 172.21.15.111:0/480319019 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3000c850 con 0x7f5e4013ed30 2024-04-25T02:23:32.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.403+0000 7f5e4623f700 1 -- 172.21.15.111:0/480319019 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e38009a20 con 0x7f5e4013ed30 2024-04-25T02:23:32.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.403+0000 7f5e377fe700 1 -- 172.21.15.111:0/480319019 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3000cc10 con 0x7f5e4013ed30 2024-04-25T02:23:32.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.403+0000 7f5e4623f700 1 -- 172.21.15.111:0/480319019 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e4014ea60 con 0x7f5e4013ed30 2024-04-25T02:23:32.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.404+0000 7f5e377fe700 1 -- 172.21.15.111:0/480319019 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 10) v1 ==== 53600+0+0 (secure 0 0 0) 0x7f5e30013470 con 0x7f5e4013ed30 2024-04-25T02:23:32.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.404+0000 7f5e377fe700 1 -- 172.21.15.111:0/480319019 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f5e3005b180 con 0x7f5e4013ed30 2024-04-25T02:23:32.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.407+0000 7f5e4f558b80 1 Processor -- start 2024-04-25T02:23:32.413 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.407+0000 7f5e4f558b80 1 -- start start 2024-04-25T02:23:32.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.407+0000 7f5e4f558b80 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x563cd7a4e990 0x563cd7a6e440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:32.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.407+0000 7f5e4f558b80 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563cd7a6bb60 0x563cd7a6bf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:32.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.407+0000 7f5e4f558b80 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x563cd7a81a90 0x563cd7a81f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:32.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.407+0000 7f5e4f558b80 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cd79a47a0 con 0x563cd7a6bb60 2024-04-25T02:23:32.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.407+0000 7f5e4f558b80 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x563cd79a2160 con 0x563cd7a81a90 2024-04-25T02:23:32.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.407+0000 7f5e4f558b80 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x563cd799df50 con 0x563cd7a4e990 2024-04-25T02:23:32.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.408+0000 7f5e3f7fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x563cd7a4e990 0x563cd7a6e440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:32.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.408+0000 7f5e3ffff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x563cd7a81a90 0x563cd7a81f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:32.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.408+0000 7f5e3effd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563cd7a6bb60 0x563cd7a6bf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:32.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.408+0000 7f5e3ffff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x563cd7a81a90 0x563cd7a81f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:36470/0 (socket says 172.21.15.111:36470) 2024-04-25T02:23:32.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.408+0000 7f5e3effd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563cd7a6bb60 0x563cd7a6bf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:56696/0 (socket says 172.21.15.111:56696) 2024-04-25T02:23:32.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.408+0000 7f5e3f7fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x563cd7a4e990 0x563cd7a6e440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:45394/0 (socket says 172.21.15.111:45394) 2024-04-25T02:23:32.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.408+0000 7f5e3ffff700 1 -- 172.21.15.111:0/3152269268 learned_addr learned my addr 172.21.15.111:0/3152269268 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:32.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.408+0000 7f5e3ffff700 1 -- 172.21.15.111:0/3152269268 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x563cd7a4e990 msgr2=0x563cd7a6e440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:32.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.408+0000 7f5e3ffff700 1 --2- 172.21.15.111:0/3152269268 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x563cd7a4e990 0x563cd7a6e440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:32.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.408+0000 7f5e3ffff700 1 -- 172.21.15.111:0/3152269268 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563cd7a6bb60 msgr2=0x563cd7a6bf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:32.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.408+0000 7f5e3ffff700 1 --2- 172.21.15.111:0/3152269268 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563cd7a6bb60 0x563cd7a6bf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:32.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.408+0000 7f5e3ffff700 1 -- 172.21.15.111:0/3152269268 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x563cd77dc230 con 0x563cd7a81a90 2024-04-25T02:23:32.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.408+0000 7f5e3f7fe700 1 --2- 172.21.15.111:0/3152269268 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x563cd7a4e990 0x563cd7a6e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:32.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.408+0000 7f5e3effd700 1 --2- 172.21.15.111:0/3152269268 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563cd7a6bb60 0x563cd7a6bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:32.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.408+0000 7f5e3ffff700 1 --2- 172.21.15.111:0/3152269268 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x563cd7a81a90 0x563cd7a81f00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5e30059d30 tx=0x7f5e30015000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=16473ddf6541999c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:32.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.408+0000 7f5e34ff9700 1 -- 172.21.15.111:0/3152269268 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e300390f0 con 0x563cd7a81a90 2024-04-25T02:23:32.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.408+0000 7f5e34ff9700 1 -- 172.21.15.111:0/3152269268 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3003b310 con 0x563cd7a81a90 2024-04-25T02:23:32.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.408+0000 7f5e34ff9700 1 -- 172.21.15.111:0/3152269268 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e300398e0 con 0x563cd7a81a90 2024-04-25T02:23:32.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.409+0000 7f5e4f558b80 1 -- 172.21.15.111:0/3152269268 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x563cd7a81a90 msgr2=0x563cd7a81f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:32.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.409+0000 7f5e4f558b80 1 --2- 172.21.15.111:0/3152269268 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x563cd7a81a90 0x563cd7a81f00 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5e30059d30 tx=0x7f5e30015000 comp rx=0 tx=0).stop 2024-04-25T02:23:32.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.409+0000 7f5e4f558b80 1 -- 172.21.15.111:0/3152269268 shutdown_connections 2024-04-25T02:23:32.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.409+0000 7f5e4f558b80 1 --2- 172.21.15.111:0/3152269268 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x563cd7a81a90 0x563cd7a81f00 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:32.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.409+0000 7f5e4f558b80 1 --2- 172.21.15.111:0/3152269268 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x563cd7a4e990 0x563cd7a6e440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:32.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.409+0000 7f5e4f558b80 1 --2- 172.21.15.111:0/3152269268 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563cd7a6bb60 0x563cd7a6bf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:32.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.409+0000 7f5e4f558b80 1 -- 172.21.15.111:0/3152269268 >> 172.21.15.111:0/3152269268 conn(0x563cd7a4c350 msgr2=0x563cd7a4f830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:32.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.409+0000 7f5e4f558b80 1 -- 172.21.15.111:0/3152269268 shutdown_connections 2024-04-25T02:23:32.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.409+0000 7f5e4f558b80 1 -- 172.21.15.111:0/3152269268 wait complete. 2024-04-25T02:23:32.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.409+0000 7f5e4f558b80 1 -- start start 2024-04-25T02:23:32.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.409+0000 7f5e4f558b80 1 Processor -- start 2024-04-25T02:23:32.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.410+0000 7f5e4f558b80 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x563cd7a4e990 0x563cd7a80c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:32.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.410+0000 7f5e4f558b80 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x563cd7a6bb60 0x563cd7a7d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:32.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.410+0000 7f5e4f558b80 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563cd7a81a90 0x563cd7a7de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:32.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.410+0000 7f5e4f558b80 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cd7948d70 con 0x563cd7a81a90 2024-04-25T02:23:32.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.410+0000 7f5e4f558b80 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x563cd7948a10 con 0x563cd7a4e990 2024-04-25T02:23:32.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.410+0000 7f5e4f558b80 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x563cd7896290 con 0x563cd7a6bb60 2024-04-25T02:23:32.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.410+0000 7f5e4f558b80 10 client.0 _ll_register_callbacks cb 0x563cd7898c00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:23:32.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.410+0000 7f5e3f7fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x563cd7a4e990 0x563cd7a80c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:32.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.410+0000 7f5e3ffff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563cd7a81a90 0x563cd7a7de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:32.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.410+0000 7f5e3f7fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x563cd7a4e990 0x563cd7a80c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:36486/0 (socket says 172.21.15.111:36486) 2024-04-25T02:23:32.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.410+0000 7f5e3f7fe700 1 -- 172.21.15.111:0/3395135153 learned_addr learned my addr 172.21.15.111:0/3395135153 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:32.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.410+0000 7f5e3ffff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563cd7a81a90 0x563cd7a7de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:56712/0 (socket says 172.21.15.111:56712) 2024-04-25T02:23:32.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.411+0000 7f5e3effd700 1 --2- 172.21.15.111:0/3395135153 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x563cd7a6bb60 0x563cd7a7d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:32.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.411+0000 7f5e3f7fe700 1 -- 172.21.15.111:0/3395135153 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x563cd7a6bb60 msgr2=0x563cd7a7d8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:32.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.411+0000 7f5e3f7fe700 1 --2- 172.21.15.111:0/3395135153 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x563cd7a6bb60 0x563cd7a7d8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:32.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.411+0000 7f5e3f7fe700 1 -- 172.21.15.111:0/3395135153 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563cd7a81a90 msgr2=0x563cd7a7de20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:32.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.411+0000 7f5e3f7fe700 1 --2- 172.21.15.111:0/3395135153 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563cd7a81a90 0x563cd7a7de20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:32.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.411+0000 7f5e3f7fe700 1 -- 172.21.15.111:0/3395135153 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e400a37e0 con 0x563cd7a4e990 2024-04-25T02:23:32.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.411+0000 7f5e3ffff700 1 --2- 172.21.15.111:0/3395135153 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563cd7a81a90 0x563cd7a7de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:32.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.411+0000 7f5e3f7fe700 1 --2- 172.21.15.111:0/3395135153 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x563cd7a4e990 0x563cd7a80c20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5e400a3dc0 tx=0x7f5e38019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c31c6347ed05a1ca server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:32.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.411+0000 7f5e1dffb700 10 client.0 ms_handle_connect on v2:172.21.15.111:3301/0 2024-04-25T02:23:32.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.411+0000 7f5e1dffb700 1 -- 172.21.15.111:0/3395135153 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3801c610 con 0x563cd7a4e990 2024-04-25T02:23:32.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.411+0000 7f5e1dffb700 1 -- 172.21.15.111:0/3395135153 <== mon.1 v2:172.21.15.111:3301/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f5e3801c770 con 0x563cd7a4e990 2024-04-25T02:23:32.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.411+0000 7f5e4f558b80 1 -- 172.21.15.111:0/3395135153 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x563cd79a23d0 con 0x563cd7a4e990 2024-04-25T02:23:32.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.411+0000 7f5e1dffb700 1 -- 172.21.15.111:0/3395135153 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e3801cb40 con 0x563cd7a4e990 2024-04-25T02:23:32.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.411+0000 7f5e4f558b80 10 client.14653 fetch_fsmap learned FSMap version 19 2024-04-25T02:23:32.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.411+0000 7f5e4f558b80 1 -- 172.21.15.111:0/3395135153 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,fsmap=19,monmap=3+}) v3 -- 0x7f5e280019b0 con 0x563cd7a4e990 2024-04-25T02:23:32.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.411+0000 7f5e1dffb700 1 -- 172.21.15.111:0/3395135153 <== mon.1 v2:172.21.15.111:3301/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x563cd79a23d0 con 0x563cd7a4e990 2024-04-25T02:23:32.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.411+0000 7f5e1dffb700 1 -- 172.21.15.111:0/3395135153 <== mon.1 v2:172.21.15.111:3301/0 5 ==== fsmap(e 19) v1 ==== 2454+0+0 (secure 0 0 0) 0x7f5e3801cce0 con 0x563cd7a4e990 2024-04-25T02:23:32.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.411+0000 7f5e4f558b80 10 client.14653 fetch_fsmap finished waiting for FSMap version 19 2024-04-25T02:23:32.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.411+0000 7f5e4f558b80 10 client.14653 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T02:23:32.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.411+0000 7f5e4f558b80 20 client.14653 populate_metadata read hostname 'smithi111' 2024-04-25T02:23:32.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.411+0000 7f5e4f558b80 4 client.14653 mds_command: new command op to 14417 tid=0[{"prefix": "get_command_descriptions"}] 2024-04-25T02:23:32.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.411+0000 7f5e4f558b80 1 -- 172.21.15.111:0/3395135153 --> v1:172.21.15.111:6819/696898730 -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x563cd79400e0 con 0x563cd7a68920 2024-04-25T02:23:32.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.412+0000 7f5e1dffb700 10 client.14653 ms_handle_connect on v1:172.21.15.111:6819/696898730 2024-04-25T02:23:32.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.412+0000 7f5e1dffb700 1 -- 172.21.15.111:0/3395135153 <== mds.0 v1:172.21.15.111:6819/696898730 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17536 (unknown 0 0 610023333) 0x563cd79400e0 con 0x563cd7a68920 2024-04-25T02:23:32.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.412+0000 7f5e1dffb700 10 client.14653 handle_command_reply: tid=0 2024-04-25T02:23:32.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.412+0000 7f5e4f558b80 1 client.14653 shutdown 2024-04-25T02:23:32.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.413+0000 7f5e4f558b80 1 -- 172.21.15.111:0/3395135153 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x563cd7a4e990 msgr2=0x563cd7a80c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:32.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.413+0000 7f5e4f558b80 1 --2- 172.21.15.111:0/3395135153 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x563cd7a4e990 0x563cd7a80c20 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f5e400a3dc0 tx=0x7f5e38019000 comp rx=0 tx=0).stop 2024-04-25T02:23:32.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.413+0000 7f5e4f558b80 1 -- 172.21.15.111:0/3395135153 shutdown_connections 2024-04-25T02:23:32.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.413+0000 7f5e4f558b80 1 --2- 172.21.15.111:0/3395135153 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563cd7a81a90 0x563cd7a7de20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:32.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.413+0000 7f5e1dffb700 0 client.14653 ms_handle_reset on v1:172.21.15.111:6819/696898730 2024-04-25T02:23:32.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.413+0000 7f5e4f558b80 1 --2- 172.21.15.111:0/3395135153 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x563cd7a4e990 0x563cd7a80c20 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:32.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.413+0000 7f5e4f558b80 1 --2- 172.21.15.111:0/3395135153 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x563cd7a6bb60 0x563cd7a7d8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:32.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.413+0000 7f5e4f558b80 1 -- 172.21.15.111:0/3395135153 >> 172.21.15.111:0/3395135153 conn(0x563cd7a4c350 msgr2=0x563cd7a4ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:32.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.413+0000 7f5e4f558b80 1 -- 172.21.15.111:0/3395135153 shutdown_connections 2024-04-25T02:23:32.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.413+0000 7f5e4f558b80 1 -- 172.21.15.111:0/3395135153 wait complete. 2024-04-25T02:23:32.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.413+0000 7f5e4f558b80 20 client.14653 trim_cache size 0 max 16384 2024-04-25T02:23:32.433 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.430+0000 7f5e4f558b80 1 Processor -- start 2024-04-25T02:23:32.433 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.430+0000 7f5e4f558b80 1 -- start start 2024-04-25T02:23:32.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.430+0000 7f5e4f558b80 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x563cd7a4e990 0x563cd7a6f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:32.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.430+0000 7f5e4f558b80 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x563cd7a6bb60 0x563cd7a4aa80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:32.439 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.430+0000 7f5e4f558b80 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563cd7a81a90 0x563cd7a4afc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:32.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.430+0000 7f5e4f558b80 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cd7a4b500 con 0x563cd7a81a90 2024-04-25T02:23:32.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.430+0000 7f5e4f558b80 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x563cd7a70810 con 0x563cd7a6bb60 2024-04-25T02:23:32.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.430+0000 7f5e4f558b80 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x563cd7a7c430 con 0x563cd7a4e990 2024-04-25T02:23:32.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.430+0000 7f5e3ffff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563cd7a81a90 0x563cd7a4afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:32.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.430+0000 7f5e3f7fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x563cd7a4e990 0x563cd7a6f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:32.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.430+0000 7f5e3effd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x563cd7a6bb60 0x563cd7a4aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:32.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.430+0000 7f5e3ffff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563cd7a81a90 0x563cd7a4afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:56726/0 (socket says 172.21.15.111:56726) 2024-04-25T02:23:32.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.430+0000 7f5e3ffff700 1 -- 172.21.15.111:0/1288004690 learned_addr learned my addr 172.21.15.111:0/1288004690 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:32.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.430+0000 7f5e3f7fe700 1 -- 172.21.15.111:0/1288004690 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x563cd7a6bb60 msgr2=0x563cd7a4aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:32.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.430+0000 7f5e3f7fe700 1 --2- 172.21.15.111:0/1288004690 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x563cd7a6bb60 0x563cd7a4aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:32.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.430+0000 7f5e3f7fe700 1 -- 172.21.15.111:0/1288004690 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563cd7a81a90 msgr2=0x563cd7a4afc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:32.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.430+0000 7f5e3f7fe700 1 --2- 172.21.15.111:0/1288004690 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563cd7a81a90 0x563cd7a4afc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:32.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.431+0000 7f5e3f7fe700 1 -- 172.21.15.111:0/1288004690 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e4014ea60 con 0x563cd7a4e990 2024-04-25T02:23:32.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.431+0000 7f5e3ffff700 1 --2- 172.21.15.111:0/1288004690 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563cd7a81a90 0x563cd7a4afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:32.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.431+0000 7f5e3f7fe700 1 --2- 172.21.15.111:0/1288004690 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x563cd7a4e990 0x563cd7a6f4b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5e38009f40 tx=0x7f5e38027000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e718e90a8c777bb8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:32.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.431+0000 7f5e357fa700 1 -- 172.21.15.111:0/1288004690 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e38040070 con 0x563cd7a4e990 2024-04-25T02:23:32.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.431+0000 7f5e357fa700 1 -- 172.21.15.111:0/1288004690 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e38023040 con 0x563cd7a4e990 2024-04-25T02:23:32.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.431+0000 7f5e357fa700 1 -- 172.21.15.111:0/1288004690 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3801c610 con 0x563cd7a4e990 2024-04-25T02:23:32.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.431+0000 7f5e4f558b80 1 -- 172.21.15.111:0/1288004690 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x563cd7a4e990 msgr2=0x563cd7a6f4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:32.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.431+0000 7f5e4f558b80 1 --2- 172.21.15.111:0/1288004690 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x563cd7a4e990 0x563cd7a6f4b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5e38009f40 tx=0x7f5e38027000 comp rx=0 tx=0).stop 2024-04-25T02:23:32.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.431+0000 7f5e4f558b80 1 -- 172.21.15.111:0/1288004690 shutdown_connections 2024-04-25T02:23:32.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.431+0000 7f5e4f558b80 1 --2- 172.21.15.111:0/1288004690 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563cd7a81a90 0x563cd7a4afc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:32.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.431+0000 7f5e4f558b80 1 --2- 172.21.15.111:0/1288004690 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x563cd7a4e990 0x563cd7a6f4b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:32.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.431+0000 7f5e4f558b80 1 --2- 172.21.15.111:0/1288004690 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x563cd7a6bb60 0x563cd7a4aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:32.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.431+0000 7f5e4f558b80 1 -- 172.21.15.111:0/1288004690 >> 172.21.15.111:0/1288004690 conn(0x563cd7a4c350 msgr2=0x563cd7a46a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:32.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.431+0000 7f5e4f558b80 1 -- 172.21.15.111:0/1288004690 shutdown_connections 2024-04-25T02:23:32.441 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.431+0000 7f5e4f558b80 1 -- 172.21.15.111:0/1288004690 wait complete. 2024-04-25T02:23:32.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.432+0000 7f5e4f558b80 1 -- start start 2024-04-25T02:23:32.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.432+0000 7f5e4f558b80 1 Processor -- start 2024-04-25T02:23:32.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.432+0000 7f5e4f558b80 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x563cd7a4e990 0x563cd7a97a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:32.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.432+0000 7f5e4f558b80 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x563cd7a6bb60 0x563cd7a96870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:32.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.432+0000 7f5e4f558b80 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563cd7a81a90 0x563cd7a96db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:23:32.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.432+0000 7f5e4f558b80 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x563cd7a98140 con 0x563cd7a81a90 2024-04-25T02:23:32.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.432+0000 7f5e4f558b80 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x563cd7a98400 con 0x563cd7a4e990 2024-04-25T02:23:32.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.432+0000 7f5e4f558b80 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x563cd7a98fa0 con 0x563cd7a6bb60 2024-04-25T02:23:32.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.432+0000 7f5e4f558b80 10 client.0 _ll_register_callbacks cb 0x7f5e38012ab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-25T02:23:32.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.432+0000 7f5e3f7fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x563cd7a4e990 0x563cd7a97a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:32.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.433+0000 7f5e3f7fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x563cd7a4e990 0x563cd7a97a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:36516/0 (socket says 172.21.15.111:36516) 2024-04-25T02:23:32.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.433+0000 7f5e3ffff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563cd7a81a90 0x563cd7a96db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:32.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.433+0000 7f5e3f7fe700 1 -- 172.21.15.111:0/3241299997 learned_addr learned my addr 172.21.15.111:0/3241299997 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:23:32.442 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.433+0000 7f5e3effd700 1 --2- 172.21.15.111:0/3241299997 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x563cd7a6bb60 0x563cd7a96870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:23:32.443 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.433+0000 7f5e3ffff700 1 -- 172.21.15.111:0/3241299997 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x563cd7a6bb60 msgr2=0x563cd7a96870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:32.443 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.433+0000 7f5e3ffff700 1 --2- 172.21.15.111:0/3241299997 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x563cd7a6bb60 0x563cd7a96870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:32.443 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.433+0000 7f5e3ffff700 1 -- 172.21.15.111:0/3241299997 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x563cd7a4e990 msgr2=0x563cd7a97a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:23:32.443 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.433+0000 7f5e3ffff700 1 --2- 172.21.15.111:0/3241299997 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x563cd7a4e990 0x563cd7a97a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:32.443 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.433+0000 7f5e3ffff700 1 -- 172.21.15.111:0/3241299997 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x563cd77dc230 con 0x563cd7a81a90 2024-04-25T02:23:32.443 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.433+0000 7f5e3f7fe700 1 --2- 172.21.15.111:0/3241299997 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x563cd7a4e990 0x563cd7a97a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:23:32.443 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.433+0000 7f5e3ffff700 1 --2- 172.21.15.111:0/3241299997 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563cd7a81a90 0x563cd7a96db0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5e30041010 tx=0x7f5e30039000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c3a66cb0b7bf649 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:23:32.443 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.433+0000 7f5e1dffb700 10 client.0 ms_handle_connect on v2:172.21.15.111:3300/0 2024-04-25T02:23:32.443 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.433+0000 7f5e1dffb700 1 -- 172.21.15.111:0/3241299997 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e3004e070 con 0x563cd7a81a90 2024-04-25T02:23:32.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.433+0000 7f5e1dffb700 1 -- 172.21.15.111:0/3241299997 <== mon.0 v2:172.21.15.111:3300/0 2 ==== osd_map(40..40 src has 1..40) v4 ==== 3883+0+0 (secure 0 0 0) 0x7f5e30039070 con 0x563cd7a81a90 2024-04-25T02:23:32.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.433+0000 7f5e4f558b80 1 -- 172.21.15.111:0/3241299997 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5e3003b310 con 0x563cd7a81a90 2024-04-25T02:23:32.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.433+0000 7f5e1dffb700 1 -- 172.21.15.111:0/3241299997 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5e3003c8d0 con 0x563cd7a81a90 2024-04-25T02:23:32.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.433+0000 7f5e4f558b80 10 client.14874 fetch_fsmap learned FSMap version 19 2024-04-25T02:23:32.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.433+0000 7f5e4f558b80 1 -- 172.21.15.111:0/3241299997 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=3+}) v3 -- 0x7f5e280019b0 con 0x563cd7a81a90 2024-04-25T02:23:32.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.433+0000 7f5e1dffb700 1 -- 172.21.15.111:0/3241299997 <== mon.0 v2:172.21.15.111:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e3003b310 con 0x563cd7a81a90 2024-04-25T02:23:32.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.433+0000 7f5e1dffb700 1 -- 172.21.15.111:0/3241299997 <== mon.0 v2:172.21.15.111:3300/0 5 ==== fsmap(e 19) v1 ==== 2454+0+0 (secure 0 0 0) 0x7f5e3003c130 con 0x563cd7a81a90 2024-04-25T02:23:32.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.433+0000 7f5e4f558b80 10 client.14874 fetch_fsmap finished waiting for FSMap version 19 2024-04-25T02:23:32.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.433+0000 7f5e4f558b80 10 client.14874 resolve_mds: resolved name 'b' to daemon mds.b 2024-04-25T02:23:32.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.433+0000 7f5e4f558b80 20 client.14874 populate_metadata read hostname 'smithi111' 2024-04-25T02:23:32.444 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.433+0000 7f5e4f558b80 4 client.14874 mds_command: new command op to 14417 tid=0[{"prefix": "status"}] 2024-04-25T02:23:32.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.433+0000 7f5e4f558b80 1 -- 172.21.15.111:0/3241299997 --> v1:172.21.15.111:6819/696898730 -- command(tid 0: {"prefix": "status"}) v1 -- 0x563cd77ff100 con 0x563cd7adc000 2024-04-25T02:23:32.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.434+0000 7f5e1dffb700 10 client.14874 ms_handle_connect on v1:172.21.15.111:6819/696898730 2024-04-25T02:23:32.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.434+0000 7f5e1dffb700 1 -- 172.21.15.111:0/3241299997 <== mds.0 v1:172.21.15.111:6819/696898730 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (unknown 0 0 208551873) 0x563cd77ff100 con 0x563cd7adc000 2024-04-25T02:23:32.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.434+0000 7f5e1dffb700 10 client.14874 handle_command_reply: tid=0 2024-04-25T02:23:32.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.434+0000 7f5e4f558b80 1 client.14874 shutdown 2024-04-25T02:23:32.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.434+0000 7f5e4f558b80 1 -- 172.21.15.111:0/3241299997 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563cd7a81a90 msgr2=0x563cd7a96db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:32.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.434+0000 7f5e4f558b80 1 --2- 172.21.15.111:0/3241299997 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563cd7a81a90 0x563cd7a96db0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5e30041010 tx=0x7f5e30039000 comp rx=0 tx=0).stop 2024-04-25T02:23:32.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.434+0000 7f5e4f558b80 1 -- 172.21.15.111:0/3241299997 shutdown_connections 2024-04-25T02:23:32.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.434+0000 7f5e4f558b80 1 --2- 172.21.15.111:0/3241299997 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x563cd7a81a90 0x563cd7a96db0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:32.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.434+0000 7f5e4f558b80 1 --2- 172.21.15.111:0/3241299997 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x563cd7a4e990 0x563cd7a97a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:32.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.434+0000 7f5e4f558b80 1 --2- 172.21.15.111:0/3241299997 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x563cd7a6bb60 0x563cd7a96870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:32.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.434+0000 7f5e1dffb700 0 client.14874 ms_handle_reset on v1:172.21.15.111:6819/696898730 2024-04-25T02:23:32.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.434+0000 7f5e4f558b80 1 -- 172.21.15.111:0/3241299997 >> 172.21.15.111:0/3241299997 conn(0x563cd7a4c350 msgr2=0x563cd7a4ba70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:32.445 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.434+0000 7f5e4f558b80 1 -- 172.21.15.111:0/3241299997 shutdown_connections 2024-04-25T02:23:32.446 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.434+0000 7f5e4f558b80 1 -- 172.21.15.111:0/3241299997 wait complete. 2024-04-25T02:23:32.446 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.434+0000 7f5e4f558b80 20 client.14874 trim_cache size 0 max 16384 2024-04-25T02:23:32.446 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-25T02:23:32.446 INFO:teuthology.orchestra.run.smithi111.stdout: "cluster_fsid": "4643f974-f93a-4436-93b8-460ff320e62e", 2024-04-25T02:23:32.446 INFO:teuthology.orchestra.run.smithi111.stdout: "whoami": 0, 2024-04-25T02:23:32.446 INFO:teuthology.orchestra.run.smithi111.stdout: "id": 14417, 2024-04-25T02:23:32.447 INFO:teuthology.orchestra.run.smithi111.stdout: "want_state": "up:active", 2024-04-25T02:23:32.447 INFO:teuthology.orchestra.run.smithi111.stdout: "state": "up:active", 2024-04-25T02:23:32.447 INFO:teuthology.orchestra.run.smithi111.stdout: "fs_name": "cephfs", 2024-04-25T02:23:32.447 INFO:teuthology.orchestra.run.smithi111.stdout: "rank_uptime": 15.583656078000001, 2024-04-25T02:23:32.447 INFO:teuthology.orchestra.run.smithi111.stdout: "mdsmap_epoch": 19, 2024-04-25T02:23:32.447 INFO:teuthology.orchestra.run.smithi111.stdout: "osdmap_epoch": 40, 2024-04-25T02:23:32.447 INFO:teuthology.orchestra.run.smithi111.stdout: "osdmap_epoch_barrier": 37, 2024-04-25T02:23:32.447 INFO:teuthology.orchestra.run.smithi111.stdout: "uptime": 16.261931246 2024-04-25T02:23:32.447 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-25T02:23:32.449 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.435+0000 7f5e4623f700 1 -- 172.21.15.111:0/480319019 >> v1:172.21.15.111:6816/46482 conn(0x7f5e20046010 legacy=0x7f5e200484c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:32.449 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.435+0000 7f5e4623f700 1 -- 172.21.15.111:0/480319019 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5e4013ed30 msgr2=0x7f5e40140320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:23:32.449 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.435+0000 7f5e4623f700 1 --2- 172.21.15.111:0/480319019 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5e4013ed30 0x7f5e40140320 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f5e3000ea20 tx=0x7f5e300091a0 comp rx=0 tx=0).stop 2024-04-25T02:23:32.449 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.435+0000 7f5e4623f700 1 -- 172.21.15.111:0/480319019 shutdown_connections 2024-04-25T02:23:32.449 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.435+0000 7f5e4623f700 1 --2- 172.21.15.111:0/480319019 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f5e4013ed30 0x7f5e40140320 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:32.450 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.435+0000 7f5e4623f700 1 --2- 172.21.15.111:0/480319019 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f5e400a22a0 0x7f5e400ade40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:32.450 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.435+0000 7f5e4623f700 1 --2- 172.21.15.111:0/480319019 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f5e400a3410 0x7f5e4013fde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:23:32.450 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.435+0000 7f5e4623f700 1 -- 172.21.15.111:0/480319019 >> 172.21.15.111:0/480319019 conn(0x7f5e400b1cf0 msgr2=0x7f5e40067940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:23:32.450 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.435+0000 7f5e4623f700 1 -- 172.21.15.111:0/480319019 shutdown_connections 2024-04-25T02:23:32.450 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:23:32.435+0000 7f5e4623f700 1 -- 172.21.15.111:0/480319019 wait complete. 2024-04-25T02:23:32.451 INFO:teuthology.run_tasks:Running task print... 2024-04-25T02:23:32.463 INFO:teuthology.task.print:**** done ceph.restart 2024-04-25T02:23:32.463 INFO:teuthology.run_tasks:Running task install.upgrade... 2024-04-25T02:23:32.478 INFO:teuthology.task.install:project ceph config {'client.0': {'branch': 'quincy'}} overrides {'flavor': 'default', 'sha1': 'd2c45d977142e024a59b68a8f1dce8f0b9840551'} 2024-04-25T02:23:32.478 INFO:teuthology.task.install:config contains sha1|tag|branch, removing those keys from override 2024-04-25T02:23:32.478 INFO:teuthology.task.install:remote ubuntu@smithi114.front.sepia.ceph.com config {'branch': 'quincy', 'flavor': 'default'} 2024-04-25T02:23:32.479 INFO:teuthology.task.install:extra packages: [] 2024-04-25T02:23:32.486 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-25T02:23:32.486 INFO:teuthology.task.install:Upgrading ceph rpm packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd 2024-04-25T02:23:32.486 DEBUG:teuthology.orchestra.run.smithi114:> rpm -q ceph-common --qf '%{VERSION}-%{RELEASE}' 2024-04-25T02:23:32.515 INFO:teuthology.orchestra.run.smithi114.stdout:15.2.17-0.el8 2024-04-25T02:23:32.515 INFO:teuthology.packaging:The installed version of ceph-common is 15.2.17-0.el8 2024-04-25T02:23:32.516 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2024-04-25T02:23:32.745 INFO:teuthology.task.install:Ceph rpm upgrade from 15.2.17-0.el8 to 17.2.7-902.gc61472c8 2024-04-25T02:23:32.746 INFO:teuthology.task.install.rpm:Host smithi114 is: centos 8 x86_64 2024-04-25T02:23:32.746 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2024-04-25T02:23:32.955 INFO:teuthology.task.install.rpm:Repo base URL: https://3.chacra.ceph.com/r/ceph/quincy/c61472c83ce76869b0fe076c19ed2f4bcc3fb4af/centos/8/flavors/default/ 2024-04-25T02:23:32.955 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f /etc/yum.repos.d/ceph.repo 2024-04-25T02:23:33.159 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://3.chacra.ceph.com/r/ceph/quincy/c61472c83ce76869b0fe076c19ed2f4bcc3fb4af/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy/c61472c83ce76869b0fe076c19ed2f4bcc3fb4af/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://3.chacra.ceph.com/r/ceph/quincy/c61472c83ce76869b0fe076c19ed2f4bcc3fb4af/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-04-25T02:23:33.160 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-25T02:23:33.160 DEBUG:teuthology.orchestra.run.smithi114:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-04-25T02:23:33.193 DEBUG:teuthology.orchestra.run.smithi114:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/quincy/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-04-25T02:23:33.266 DEBUG:teuthology.orchestra.run.smithi114:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-04-25T02:23:33.337 DEBUG:teuthology.orchestra.run.smithi114:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-04-25T02:23:33.396 INFO:teuthology.orchestra.run.smithi114.stdout:check_obsoletes = 1 2024-04-25T02:23:33.408 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum clean all 2024-04-25T02:23:33.672 INFO:teuthology.orchestra.run.smithi114.stdout:71 files removed 2024-04-25T02:23:33.699 DEBUG:teuthology.orchestra.run.smithi114:> sudo yum -y upgrade ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd 2024-04-25T02:23:34.367 INFO:teuthology.orchestra.run.smithi114.stdout:ceph packages for x86_64 298 kB/s | 79 kB 00:00 2024-04-25T02:23:34.735 INFO:teuthology.orchestra.run.smithi114.stdout:ceph noarch packages 32 kB/s | 11 kB 00:00 2024-04-25T02:23:35.110 INFO:teuthology.orchestra.run.smithi114.stdout:ceph source packages 4.2 kB/s | 1.5 kB 00:00 2024-04-25T02:23:35.835 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 8 - AppStream 40 MB/s | 28 MB 00:00 2024-04-25T02:23:41.544 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 8 - BaseOS 16 MB/s | 10 MB 00:00 2024-04-25T02:23:43.670 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 8 - Extras 34 kB/s | 18 kB 00:00 2024-04-25T02:23:44.062 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 8 - Extras common packages 27 kB/s | 7.7 kB 00:00 2024-04-25T02:23:44.664 INFO:teuthology.orchestra.run.smithi114.stdout:CentOS Stream 8 - PowerTools 9.7 MB/s | 5.0 MB 00:00 2024-04-25T02:23:45.765 INFO:teuthology.orchestra.run.smithi114.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2024-04-25T02:23:47.033 INFO:teuthology.orchestra.run.smithi114.stdout:Extra Packages for Enterprise Linux 14 MB/s | 16 MB 00:01 2024-04-25T02:23:50.824 INFO:teuthology.orchestra.run.smithi114.stdout:lab-extras 395 kB/s | 24 kB 00:00 2024-04-25T02:23:54.458 INFO:teuthology.orchestra.run.smithi114.stderr:Package cephadm available, but not installed. 2024-04-25T02:23:54.458 INFO:teuthology.orchestra.run.smithi114.stdout:No match for argument: cephadm 2024-04-25T02:23:54.463 INFO:teuthology.orchestra.run.smithi114.stderr:Package ceph-mgr-dashboard available, but not installed. 2024-04-25T02:23:54.463 INFO:teuthology.orchestra.run.smithi114.stdout:No match for argument: ceph-mgr-dashboard 2024-04-25T02:23:54.464 INFO:teuthology.orchestra.run.smithi114.stderr:Package ceph-mgr-diskprediction-local available, but not installed. 2024-04-25T02:23:54.464 INFO:teuthology.orchestra.run.smithi114.stdout:No match for argument: ceph-mgr-diskprediction-local 2024-04-25T02:23:54.464 INFO:teuthology.orchestra.run.smithi114.stderr:Package ceph-mgr-rook available, but not installed. 2024-04-25T02:23:54.464 INFO:teuthology.orchestra.run.smithi114.stdout:No match for argument: ceph-mgr-rook 2024-04-25T02:23:54.465 INFO:teuthology.orchestra.run.smithi114.stderr:Package ceph-mgr-cephadm available, but not installed. 2024-04-25T02:23:54.465 INFO:teuthology.orchestra.run.smithi114.stdout:No match for argument: ceph-mgr-cephadm 2024-04-25T02:23:54.467 INFO:teuthology.orchestra.run.smithi114.stderr:Package ceph-volume available, but not installed. 2024-04-25T02:23:54.468 INFO:teuthology.orchestra.run.smithi114.stdout:No match for argument: ceph-volume 2024-04-25T02:23:54.569 INFO:teuthology.orchestra.run.smithi114.stdout:Dependencies resolved. 2024-04-25T02:23:54.574 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-04-25T02:23:54.574 INFO:teuthology.orchestra.run.smithi114.stdout: Package Arch Version Repository Size 2024-04-25T02:23:54.574 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-04-25T02:23:54.574 INFO:teuthology.orchestra.run.smithi114.stdout:Upgrading: 2024-04-25T02:23:54.574 INFO:teuthology.orchestra.run.smithi114.stdout: ceph x86_64 2:17.2.7-902.gc61472c8.el8 ceph 6.4 k 2024-04-25T02:23:54.574 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-base x86_64 2:17.2.7-902.gc61472c8.el8 ceph 5.3 M 2024-04-25T02:23:54.574 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-common x86_64 2:17.2.7-902.gc61472c8.el8 ceph 24 M 2024-04-25T02:23:54.574 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-fuse x86_64 2:17.2.7-902.gc61472c8.el8 ceph 876 k 2024-04-25T02:23:54.574 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-immutable-object-cache 2024-04-25T02:23:54.575 INFO:teuthology.orchestra.run.smithi114.stdout: x86_64 2:17.2.7-902.gc61472c8.el8 ceph 162 k 2024-04-25T02:23:54.575 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mds x86_64 2:17.2.7-902.gc61472c8.el8 ceph 2.3 M 2024-04-25T02:23:54.575 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr x86_64 2:17.2.7-902.gc61472c8.el8 ceph 1.6 M 2024-04-25T02:23:54.575 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-modules-core noarch 2:17.2.7-902.gc61472c8.el8 ceph-noarch 240 k 2024-04-25T02:23:54.575 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mon x86_64 2:17.2.7-902.gc61472c8.el8 ceph 4.0 M 2024-04-25T02:23:54.575 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-osd x86_64 2:17.2.7-902.gc61472c8.el8 ceph 17 M 2024-04-25T02:23:54.575 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-radosgw x86_64 2:17.2.7-902.gc61472c8.el8 ceph 17 M 2024-04-25T02:23:54.575 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-selinux x86_64 2:17.2.7-902.gc61472c8.el8 ceph 24 k 2024-04-25T02:23:54.575 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-test x86_64 2:17.2.7-902.gc61472c8.el8 ceph 53 M 2024-04-25T02:23:54.575 INFO:teuthology.orchestra.run.smithi114.stdout: libcephfs-devel x86_64 2:17.2.7-902.gc61472c8.el8 ceph 25 k 2024-04-25T02:23:54.575 INFO:teuthology.orchestra.run.smithi114.stdout: libcephfs2 x86_64 2:17.2.7-902.gc61472c8.el8 ceph 798 k 2024-04-25T02:23:54.575 INFO:teuthology.orchestra.run.smithi114.stdout: librados-devel x86_64 2:17.2.7-902.gc61472c8.el8 ceph 130 k 2024-04-25T02:23:54.576 INFO:teuthology.orchestra.run.smithi114.stdout: librados2 x86_64 2:17.2.7-902.gc61472c8.el8 ceph 3.5 M 2024-04-25T02:23:54.576 INFO:teuthology.orchestra.run.smithi114.stdout: libradosstriper1 x86_64 2:17.2.7-902.gc61472c8.el8 ceph 505 k 2024-04-25T02:23:54.576 INFO:teuthology.orchestra.run.smithi114.stdout: librbd1 x86_64 2:17.2.7-902.gc61472c8.el8 ceph 3.6 M 2024-04-25T02:23:54.576 INFO:teuthology.orchestra.run.smithi114.stdout: librgw2 x86_64 2:17.2.7-902.gc61472c8.el8 ceph 5.6 M 2024-04-25T02:23:54.576 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-argparse x86_64 2:17.2.7-902.gc61472c8.el8 ceph 45 k 2024-04-25T02:23:54.576 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-common x86_64 2:17.2.7-902.gc61472c8.el8 ceph 117 k 2024-04-25T02:23:54.576 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cephfs x86_64 2:17.2.7-902.gc61472c8.el8 ceph 190 k 2024-04-25T02:23:54.576 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rados x86_64 2:17.2.7-902.gc61472c8.el8 ceph 371 k 2024-04-25T02:23:54.576 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rbd x86_64 2:17.2.7-902.gc61472c8.el8 ceph 359 k 2024-04-25T02:23:54.576 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rgw x86_64 2:17.2.7-902.gc61472c8.el8 ceph 106 k 2024-04-25T02:23:54.576 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-fuse x86_64 2:17.2.7-902.gc61472c8.el8 ceph 91 k 2024-04-25T02:23:54.576 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-mirror x86_64 2:17.2.7-902.gc61472c8.el8 ceph 3.5 M 2024-04-25T02:23:54.576 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-nbd x86_64 2:17.2.7-902.gc61472c8.el8 ceph 175 k 2024-04-25T02:23:54.576 INFO:teuthology.orchestra.run.smithi114.stdout:Installing dependencies: 2024-04-25T02:23:54.577 INFO:teuthology.orchestra.run.smithi114.stdout: libcephsqlite x86_64 2:17.2.7-902.gc61472c8.el8 ceph 179 k 2024-04-25T02:23:54.577 INFO:teuthology.orchestra.run.smithi114.stdout: thrift x86_64 0.13.0-2.el8 epel 1.7 M 2024-04-25T02:23:54.577 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:23:54.577 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction Summary 2024-04-25T02:23:54.577 INFO:teuthology.orchestra.run.smithi114.stdout:================================================================================ 2024-04-25T02:23:54.577 INFO:teuthology.orchestra.run.smithi114.stdout:Install 2 Packages 2024-04-25T02:23:54.578 INFO:teuthology.orchestra.run.smithi114.stdout:Upgrade 29 Packages 2024-04-25T02:23:54.578 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:23:54.578 INFO:teuthology.orchestra.run.smithi114.stdout:Total download size: 145 M 2024-04-25T02:23:54.578 INFO:teuthology.orchestra.run.smithi114.stdout:Downloading Packages: 2024-04-25T02:23:54.851 INFO:teuthology.orchestra.run.smithi114.stdout:(1/31): ceph-17.2.7-902.gc61472c8.el8.x86_64.rp 49 kB/s | 6.4 kB 00:00 2024-04-25T02:23:54.893 INFO:teuthology.orchestra.run.smithi114.stdout:(2/31): libcephsqlite-17.2.7-902.gc61472c8.el8. 1.0 MB/s | 179 kB 00:00 2024-04-25T02:23:55.051 INFO:teuthology.orchestra.run.smithi114.stdout:(3/31): thrift-0.13.0-2.el8.x86_64.rpm 5.2 MB/s | 1.7 MB 00:00 2024-04-25T02:23:55.360 INFO:teuthology.orchestra.run.smithi114.stdout:(4/31): ceph-base-17.2.7-902.gc61472c8.el8.x86_ 10 MB/s | 5.3 MB 00:00 2024-04-25T02:23:55.427 INFO:teuthology.orchestra.run.smithi114.stdout:(5/31): ceph-immutable-object-cache-17.2.7-902. 2.4 MB/s | 162 kB 00:00 2024-04-25T02:23:55.694 INFO:teuthology.orchestra.run.smithi114.stdout:(6/31): ceph-mds-17.2.7-902.gc61472c8.el8.x86_6 8.7 MB/s | 2.3 MB 00:00 2024-04-25T02:23:55.869 INFO:teuthology.orchestra.run.smithi114.stdout:(7/31): ceph-fuse-17.2.7-902.gc61472c8.el8.x86_ 1.0 MB/s | 876 kB 00:00 2024-04-25T02:23:55.903 INFO:teuthology.orchestra.run.smithi114.stdout:(8/31): ceph-mgr-17.2.7-902.gc61472c8.el8.x86_6 7.5 MB/s | 1.6 MB 00:00 2024-04-25T02:23:56.495 INFO:teuthology.orchestra.run.smithi114.stdout:(9/31): ceph-common-17.2.7-902.gc61472c8.el8.x8 15 MB/s | 24 MB 00:01 2024-04-25T02:23:57.387 INFO:teuthology.orchestra.run.smithi114.stdout:(10/31): ceph-mon-17.2.7-902.gc61472c8.el8.x86_ 2.7 MB/s | 4.0 MB 00:01 2024-04-25T02:23:57.604 INFO:teuthology.orchestra.run.smithi114.stdout:(11/31): ceph-osd-17.2.7-902.gc61472c8.el8.x86_ 10 MB/s | 17 MB 00:01 2024-04-25T02:23:57.629 INFO:teuthology.orchestra.run.smithi114.stdout:(12/31): ceph-selinux-17.2.7-902.gc61472c8.el8. 100 kB/s | 24 kB 00:00 2024-04-25T02:23:57.837 INFO:teuthology.orchestra.run.smithi114.stdout:(13/31): ceph-radosgw-17.2.7-902.gc61472c8.el8. 13 MB/s | 17 MB 00:01 2024-04-25T02:23:57.854 INFO:teuthology.orchestra.run.smithi114.stdout:(14/31): libcephfs-devel-17.2.7-902.gc61472c8.e 110 kB/s | 25 kB 00:00 2024-04-25T02:23:58.080 INFO:teuthology.orchestra.run.smithi114.stdout:(15/31): libcephfs2-17.2.7-902.gc61472c8.el8.x8 3.2 MB/s | 798 kB 00:00 2024-04-25T02:23:58.630 INFO:teuthology.orchestra.run.smithi114.stdout:(16/31): librados2-17.2.7-902.gc61472c8.el8.x86 6.3 MB/s | 3.5 MB 00:00 2024-04-25T02:23:58.680 INFO:teuthology.orchestra.run.smithi114.stdout:(17/31): librados-devel-17.2.7-902.gc61472c8.el 157 kB/s | 130 kB 00:00 2024-04-25T02:23:58.764 INFO:teuthology.orchestra.run.smithi114.stdout:(18/31): libradosstriper1-17.2.7-902.gc61472c8. 3.7 MB/s | 505 kB 00:00 2024-04-25T02:23:59.622 INFO:teuthology.orchestra.run.smithi114.stdout:(19/31): librgw2-17.2.7-902.gc61472c8.el8.x86_6 6.5 MB/s | 5.6 MB 00:00 2024-04-25T02:23:59.697 INFO:teuthology.orchestra.run.smithi114.stdout:(20/31): python3-ceph-argparse-17.2.7-902.gc614 597 kB/s | 45 kB 00:00 2024-04-25T02:23:59.781 INFO:teuthology.orchestra.run.smithi114.stdout:(21/31): python3-ceph-common-17.2.7-902.gc61472 1.4 MB/s | 117 kB 00:00 2024-04-25T02:23:59.865 INFO:teuthology.orchestra.run.smithi114.stdout:(22/31): python3-cephfs-17.2.7-902.gc61472c8.el 2.2 MB/s | 190 kB 00:00 2024-04-25T02:23:59.932 INFO:teuthology.orchestra.run.smithi114.stdout:(23/31): librbd1-17.2.7-902.gc61472c8.el8.x86_6 2.9 MB/s | 3.6 MB 00:01 2024-04-25T02:23:59.957 INFO:teuthology.orchestra.run.smithi114.stdout:(24/31): python3-rados-17.2.7-902.gc61472c8.el8 3.9 MB/s | 371 kB 00:00 2024-04-25T02:24:00.049 INFO:teuthology.orchestra.run.smithi114.stdout:(25/31): python3-rgw-17.2.7-902.gc61472c8.el8.x 1.1 MB/s | 106 kB 00:00 2024-04-25T02:24:00.130 INFO:teuthology.orchestra.run.smithi114.stdout:(26/31): python3-rbd-17.2.7-902.gc61472c8.el8.x 1.8 MB/s | 359 kB 00:00 2024-04-25T02:24:00.158 INFO:teuthology.orchestra.run.smithi114.stdout:(27/31): rbd-fuse-17.2.7-902.gc61472c8.el8.x86_ 833 kB/s | 91 kB 00:00 2024-04-25T02:24:00.250 INFO:teuthology.orchestra.run.smithi114.stdout:(28/31): rbd-nbd-17.2.7-902.gc61472c8.el8.x86_6 1.9 MB/s | 175 kB 00:00 2024-04-25T02:24:00.351 INFO:teuthology.orchestra.run.smithi114.stdout:(29/31): ceph-mgr-modules-core-17.2.7-902.gc614 2.3 MB/s | 240 kB 00:00 2024-04-25T02:24:01.217 INFO:teuthology.orchestra.run.smithi114.stdout:(30/31): rbd-mirror-17.2.7-902.gc61472c8.el8.x8 3.2 MB/s | 3.5 MB 00:01 2024-04-25T02:24:02.993 INFO:teuthology.orchestra.run.smithi114.stdout:(31/31): ceph-test-17.2.7-902.gc61472c8.el8.x86 9.8 MB/s | 53 MB 00:05 2024-04-25T02:24:02.996 INFO:teuthology.orchestra.run.smithi114.stdout:-------------------------------------------------------------------------------- 2024-04-25T02:24:02.996 INFO:teuthology.orchestra.run.smithi114.stdout:Total 17 MB/s | 145 MB 00:08 2024-04-25T02:24:02.996 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction check 2024-04-25T02:24:03.056 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction check succeeded. 2024-04-25T02:24:03.056 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction test 2024-04-25T02:24:03.717 INFO:teuthology.orchestra.run.smithi114.stdout:Transaction test succeeded. 2024-04-25T02:24:03.720 INFO:teuthology.orchestra.run.smithi114.stdout:Running transaction 2024-04-25T02:24:05.844 INFO:teuthology.orchestra.run.smithi114.stdout: Preparing : 1/1 2024-04-25T02:24:06.192 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librados2-2:17.2.7-902.gc61472c8.el8.x86_64 1/1 2024-04-25T02:24:06.449 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : librados2-2:17.2.7-902.gc61472c8.el8.x86_64 1/60 2024-04-25T02:24:06.879 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librados2-2:17.2.7-902.gc61472c8.el8.x86_64 1/60 2024-04-25T02:24:07.108 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : librbd1-2:17.2.7-902.gc61472c8.el8.x86_64 2/60 2024-04-25T02:24:07.246 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librbd1-2:17.2.7-902.gc61472c8.el8.x86_64 2/60 2024-04-25T02:24:07.433 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : libcephfs2-2:17.2.7-902.gc61472c8.el8.x86_64 3/60 2024-04-25T02:24:07.534 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: libcephfs2-2:17.2.7-902.gc61472c8.el8.x86_64 3/60 2024-04-25T02:24:07.929 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : python3-rados-2:17.2.7-902.gc61472c8.el8.x86_64 4/60 2024-04-25T02:24:08.734 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : thrift-0.13.0-2.el8.x86_64 5/60 2024-04-25T02:24:08.974 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : librgw2-2:17.2.7-902.gc61472c8.el8.x86_64 6/60 2024-04-25T02:24:09.050 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librgw2-2:17.2.7-902.gc61472c8.el8.x86_64 6/60 2024-04-25T02:24:09.274 INFO:teuthology.orchestra.run.smithi114.stdout: Installing : libcephsqlite-2:17.2.7-902.gc61472c8.el8.x86_64 7/60 2024-04-25T02:24:09.366 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: libcephsqlite-2:17.2.7-902.gc61472c8.el8.x86_64 7/60 2024-04-25T02:24:09.857 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : libradosstriper1-2:17.2.7-902.gc61472c8.el8.x86_64 8/60 2024-04-25T02:24:09.911 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: libradosstriper1-2:17.2.7-902.gc61472c8.el8.x86_64 8/60 2024-04-25T02:24:10.097 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : python3-ceph-argparse-2:17.2.7-902.gc61472c8.el8.x 9/60 2024-04-25T02:24:10.353 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : python3-cephfs-2:17.2.7-902.gc61472c8.el8.x86_64 10/60 2024-04-25T02:24:10.597 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : python3-rgw-2:17.2.7-902.gc61472c8.el8.x86_64 11/60 2024-04-25T02:24:10.855 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : python3-rbd-2:17.2.7-902.gc61472c8.el8.x86_64 12/60 2024-04-25T02:24:11.149 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : librados-devel-2:17.2.7-902.gc61472c8.el8.x86_64 13/60 2024-04-25T02:24:11.438 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : ceph-mgr-modules-core-2:17.2.7-902.gc61472c8.el8.n 14/60 2024-04-25T02:24:11.618 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : python3-ceph-common-2:17.2.7-902.gc61472c8.el8.x86 15/60 2024-04-25T02:24:13.892 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-common-2:17.2.7-902.gc61472c8.el8.x86_64 16/60 2024-04-25T02:24:14.157 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : ceph-common-2:17.2.7-902.gc61472c8.el8.x86_64 16/60 2024-04-25T02:24:14.795 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-common-2:17.2.7-902.gc61472c8.el8.x86_64 16/60 2024-04-25T02:24:15.384 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : ceph-base-2:17.2.7-902.gc61472c8.el8.x86_64 17/60 2024-04-25T02:24:15.454 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-base-2:17.2.7-902.gc61472c8.el8.x86_64 17/60 2024-04-25T02:24:15.632 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : ceph-selinux-2:17.2.7-902.gc61472c8.el8.x86_64 18/60 2024-04-25T02:24:33.858 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-selinux-2:17.2.7-902.gc61472c8.el8.x86_64 18/60 2024-04-25T02:24:34.038 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : ceph-mds-2:17.2.7-902.gc61472c8.el8.x86_64 19/60 2024-04-25T02:24:34.187 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mds-2:17.2.7-902.gc61472c8.el8.x86_64 19/60 2024-04-25T02:24:34.423 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : ceph-mgr-2:17.2.7-902.gc61472c8.el8.x86_64 20/60 2024-04-25T02:24:34.860 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mgr-2:17.2.7-902.gc61472c8.el8.x86_64 20/60 2024-04-25T02:24:35.104 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : ceph-mon-2:17.2.7-902.gc61472c8.el8.x86_64 21/60 2024-04-25T02:24:36.825 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mon-2:17.2.7-902.gc61472c8.el8.x86_64 21/60 2024-04-25T02:24:37.056 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : ceph-osd-2:17.2.7-902.gc61472c8.el8.x86_64 22/60 2024-04-25T02:24:37.066 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-osd-2:17.2.7-902.gc61472c8.el8.x86_64 22/60 2024-04-25T02:24:39.065 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : ceph-2:17.2.7-902.gc61472c8.el8.x86_64 23/60 2024-04-25T02:24:39.297 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : ceph-radosgw-2:17.2.7-902.gc61472c8.el8.x86_64 24/60 2024-04-25T02:24:39.377 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-radosgw-2:17.2.7-902.gc61472c8.el8.x86_64 24/60 2024-04-25T02:24:39.588 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : ceph-immutable-object-cache-2:17.2.7-902.gc61472c8 25/60 2024-04-25T02:24:39.994 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-immutable-object-cache-2:17.2.7-902.gc61472c8 25/60 2024-04-25T02:24:40.229 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : rbd-mirror-2:17.2.7-902.gc61472c8.el8.x86_64 26/60 2024-04-25T02:24:45.814 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: rbd-mirror-2:17.2.7-902.gc61472c8.el8.x86_64 26/60 2024-04-25T02:24:46.127 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : ceph-test-2:17.2.7-902.gc61472c8.el8.x86_64 27/60 2024-04-25T02:24:46.285 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : libcephfs-devel-2:17.2.7-902.gc61472c8.el8.x86_64 28/60 2024-04-25T02:24:46.518 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : rbd-fuse-2:17.2.7-902.gc61472c8.el8.x86_64 29/60 2024-04-25T02:24:46.795 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : rbd-nbd-2:17.2.7-902.gc61472c8.el8.x86_64 30/60 2024-04-25T02:24:47.028 INFO:teuthology.orchestra.run.smithi114.stdout: Upgrading : ceph-fuse-2:17.2.7-902.gc61472c8.el8.x86_64 31/60 2024-04-25T02:24:47.145 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : ceph-2:15.2.17-0.el8.x86_64 32/60 2024-04-25T02:24:47.347 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : ceph-test-2:15.2.17-0.el8.x86_64 33/60 2024-04-25T02:24:47.354 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-radosgw-2:15.2.17-0.el8.x86_64 34/60 2024-04-25T02:24:47.354 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : ceph-radosgw-2:15.2.17-0.el8.x86_64 34/60 2024-04-25T02:24:47.639 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-radosgw-2:15.2.17-0.el8.x86_64 34/60 2024-04-25T02:24:47.778 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : rbd-nbd-2:15.2.17-0.el8.x86_64 35/60 2024-04-25T02:24:47.785 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: rbd-mirror-2:15.2.17-0.el8.x86_64 36/60 2024-04-25T02:24:47.786 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : rbd-mirror-2:15.2.17-0.el8.x86_64 36/60 2024-04-25T02:24:47.954 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: rbd-mirror-2:15.2.17-0.el8.x86_64 36/60 2024-04-25T02:24:48.137 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : rbd-fuse-2:15.2.17-0.el8.x86_64 37/60 2024-04-25T02:24:48.143 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 38/60 2024-04-25T02:24:48.144 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 38/60 2024-04-25T02:24:48.328 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 38/60 2024-04-25T02:24:48.436 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : libcephfs-devel-2:15.2.17-0.el8.x86_64 39/60 2024-04-25T02:24:48.611 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : librados-devel-2:15.2.17-0.el8.x86_64 40/60 2024-04-25T02:24:48.618 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mgr-2:15.2.17-0.el8.x86_64 41/60 2024-04-25T02:24:48.619 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : ceph-mgr-2:15.2.17-0.el8.x86_64 41/60 2024-04-25T02:24:48.830 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mgr-2:15.2.17-0.el8.x86_64 41/60 2024-04-25T02:24:48.837 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-osd-2:15.2.17-0.el8.x86_64 42/60 2024-04-25T02:24:48.838 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : ceph-osd-2:15.2.17-0.el8.x86_64 42/60 2024-04-25T02:24:49.120 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-osd-2:15.2.17-0.el8.x86_64 42/60 2024-04-25T02:24:49.126 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mds-2:15.2.17-0.el8.x86_64 43/60 2024-04-25T02:24:49.126 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : ceph-mds-2:15.2.17-0.el8.x86_64 43/60 2024-04-25T02:24:49.287 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mds-2:15.2.17-0.el8.x86_64 43/60 2024-04-25T02:24:49.292 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mon-2:15.2.17-0.el8.x86_64 44/60 2024-04-25T02:24:49.292 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : ceph-mon-2:15.2.17-0.el8.x86_64 44/60 2024-04-25T02:24:49.495 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-mon-2:15.2.17-0.el8.x86_64 44/60 2024-04-25T02:24:49.495 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : ceph-selinux-2:15.2.17-0.el8.x86_64 45/60 2024-04-25T02:24:49.629 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-selinux-2:15.2.17-0.el8.x86_64 45/60 2024-04-25T02:24:49.649 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-base-2:15.2.17-0.el8.x86_64 46/60 2024-04-25T02:24:49.650 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : ceph-base-2:15.2.17-0.el8.x86_64 46/60 2024-04-25T02:24:49.990 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-base-2:15.2.17-0.el8.x86_64 46/60 2024-04-25T02:24:49.991 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : ceph-common-2:15.2.17-0.el8.x86_64 47/60 2024-04-25T02:24:50.203 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: ceph-common-2:15.2.17-0.el8.x86_64 47/60 2024-04-25T02:24:50.203 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : libradosstriper1-2:15.2.17-0.el8.x86_64 48/60 2024-04-25T02:24:50.387 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: libradosstriper1-2:15.2.17-0.el8.x86_64 48/60 2024-04-25T02:24:50.586 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : python3-cephfs-2:15.2.17-0.el8.x86_64 49/60 2024-04-25T02:24:50.770 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : python3-rbd-2:15.2.17-0.el8.x86_64 50/60 2024-04-25T02:24:50.771 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : librbd1-2:15.2.17-0.el8.x86_64 51/60 2024-04-25T02:24:51.020 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librbd1-2:15.2.17-0.el8.x86_64 51/60 2024-04-25T02:24:51.228 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : python3-rgw-2:15.2.17-0.el8.x86_64 52/60 2024-04-25T02:24:51.228 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : librgw2-2:15.2.17-0.el8.x86_64 53/60 2024-04-25T02:24:51.470 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librgw2-2:15.2.17-0.el8.x86_64 53/60 2024-04-25T02:24:51.661 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : python3-rados-2:15.2.17-0.el8.x86_64 54/60 2024-04-25T02:24:51.661 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : libcephfs2-2:15.2.17-0.el8.x86_64 55/60 2024-04-25T02:24:51.929 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: libcephfs2-2:15.2.17-0.el8.x86_64 55/60 2024-04-25T02:24:52.077 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : ceph-fuse-2:15.2.17-0.el8.x86_64 56/60 2024-04-25T02:24:52.204 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : python3-ceph-argparse-2:15.2.17-0.el8.x86_64 57/60 2024-04-25T02:24:52.397 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : python3-ceph-common-2:15.2.17-0.el8.x86_64 58/60 2024-04-25T02:24:52.571 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 59/60 2024-04-25T02:24:52.571 INFO:teuthology.orchestra.run.smithi114.stdout: Cleanup : librados2-2:15.2.17-0.el8.x86_64 60/60 2024-04-25T02:24:53.330 INFO:teuthology.orchestra.run.smithi114.stdout: Running scriptlet: librados2-2:15.2.17-0.el8.x86_64 60/60 2024-04-25T02:24:53.330 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libcephsqlite-2:17.2.7-902.gc61472c8.el8.x86_64 1/60 2024-04-25T02:24:53.330 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : thrift-0.13.0-2.el8.x86_64 2/60 2024-04-25T02:24:53.330 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-2:17.2.7-902.gc61472c8.el8.x86_64 3/60 2024-04-25T02:24:53.331 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-2:15.2.17-0.el8.x86_64 4/60 2024-04-25T02:24:53.331 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-base-2:17.2.7-902.gc61472c8.el8.x86_64 5/60 2024-04-25T02:24:53.331 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-base-2:15.2.17-0.el8.x86_64 6/60 2024-04-25T02:24:53.331 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-common-2:17.2.7-902.gc61472c8.el8.x86_64 7/60 2024-04-25T02:24:53.331 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-common-2:15.2.17-0.el8.x86_64 8/60 2024-04-25T02:24:53.331 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-fuse-2:17.2.7-902.gc61472c8.el8.x86_64 9/60 2024-04-25T02:24:53.331 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-fuse-2:15.2.17-0.el8.x86_64 10/60 2024-04-25T02:24:53.331 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-immutable-object-cache-2:17.2.7-902.gc61472c8 11/60 2024-04-25T02:24:53.331 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-immutable-object-cache-2:15.2.17-0.el8.x86_64 12/60 2024-04-25T02:24:53.331 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mds-2:17.2.7-902.gc61472c8.el8.x86_64 13/60 2024-04-25T02:24:53.331 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mds-2:15.2.17-0.el8.x86_64 14/60 2024-04-25T02:24:53.331 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-2:17.2.7-902.gc61472c8.el8.x86_64 15/60 2024-04-25T02:24:53.331 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-2:15.2.17-0.el8.x86_64 16/60 2024-04-25T02:24:53.332 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mon-2:17.2.7-902.gc61472c8.el8.x86_64 17/60 2024-04-25T02:24:53.332 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mon-2:15.2.17-0.el8.x86_64 18/60 2024-04-25T02:24:53.332 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-osd-2:17.2.7-902.gc61472c8.el8.x86_64 19/60 2024-04-25T02:24:53.332 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-osd-2:15.2.17-0.el8.x86_64 20/60 2024-04-25T02:24:53.332 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-radosgw-2:17.2.7-902.gc61472c8.el8.x86_64 21/60 2024-04-25T02:24:53.332 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-radosgw-2:15.2.17-0.el8.x86_64 22/60 2024-04-25T02:24:53.332 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-selinux-2:17.2.7-902.gc61472c8.el8.x86_64 23/60 2024-04-25T02:24:53.332 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-selinux-2:15.2.17-0.el8.x86_64 24/60 2024-04-25T02:24:53.332 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-test-2:17.2.7-902.gc61472c8.el8.x86_64 25/60 2024-04-25T02:24:53.332 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-test-2:15.2.17-0.el8.x86_64 26/60 2024-04-25T02:24:53.332 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libcephfs-devel-2:17.2.7-902.gc61472c8.el8.x86_64 27/60 2024-04-25T02:24:53.332 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libcephfs-devel-2:15.2.17-0.el8.x86_64 28/60 2024-04-25T02:24:53.332 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libcephfs2-2:17.2.7-902.gc61472c8.el8.x86_64 29/60 2024-04-25T02:24:53.332 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libcephfs2-2:15.2.17-0.el8.x86_64 30/60 2024-04-25T02:24:53.333 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librados-devel-2:17.2.7-902.gc61472c8.el8.x86_64 31/60 2024-04-25T02:24:53.335 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librados-devel-2:15.2.17-0.el8.x86_64 32/60 2024-04-25T02:24:53.335 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librados2-2:17.2.7-902.gc61472c8.el8.x86_64 33/60 2024-04-25T02:24:53.336 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librados2-2:15.2.17-0.el8.x86_64 34/60 2024-04-25T02:24:53.336 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libradosstriper1-2:17.2.7-902.gc61472c8.el8.x86_64 35/60 2024-04-25T02:24:53.336 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : libradosstriper1-2:15.2.17-0.el8.x86_64 36/60 2024-04-25T02:24:53.336 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librbd1-2:17.2.7-902.gc61472c8.el8.x86_64 37/60 2024-04-25T02:24:53.336 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librbd1-2:15.2.17-0.el8.x86_64 38/60 2024-04-25T02:24:53.336 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librgw2-2:17.2.7-902.gc61472c8.el8.x86_64 39/60 2024-04-25T02:24:53.336 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : librgw2-2:15.2.17-0.el8.x86_64 40/60 2024-04-25T02:24:53.336 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-ceph-argparse-2:17.2.7-902.gc61472c8.el8.x 41/60 2024-04-25T02:24:53.336 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-ceph-argparse-2:15.2.17-0.el8.x86_64 42/60 2024-04-25T02:24:53.336 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-ceph-common-2:17.2.7-902.gc61472c8.el8.x86 43/60 2024-04-25T02:24:53.336 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-ceph-common-2:15.2.17-0.el8.x86_64 44/60 2024-04-25T02:24:53.336 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cephfs-2:17.2.7-902.gc61472c8.el8.x86_64 45/60 2024-04-25T02:24:53.336 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-cephfs-2:15.2.17-0.el8.x86_64 46/60 2024-04-25T02:24:53.336 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-rados-2:17.2.7-902.gc61472c8.el8.x86_64 47/60 2024-04-25T02:24:53.336 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-rados-2:15.2.17-0.el8.x86_64 48/60 2024-04-25T02:24:53.337 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-rbd-2:17.2.7-902.gc61472c8.el8.x86_64 49/60 2024-04-25T02:24:53.337 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-rbd-2:15.2.17-0.el8.x86_64 50/60 2024-04-25T02:24:53.337 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-rgw-2:17.2.7-902.gc61472c8.el8.x86_64 51/60 2024-04-25T02:24:53.337 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : python3-rgw-2:15.2.17-0.el8.x86_64 52/60 2024-04-25T02:24:53.337 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : rbd-fuse-2:17.2.7-902.gc61472c8.el8.x86_64 53/60 2024-04-25T02:24:53.337 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : rbd-fuse-2:15.2.17-0.el8.x86_64 54/60 2024-04-25T02:24:53.337 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : rbd-mirror-2:17.2.7-902.gc61472c8.el8.x86_64 55/60 2024-04-25T02:24:53.337 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : rbd-mirror-2:15.2.17-0.el8.x86_64 56/60 2024-04-25T02:24:53.337 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : rbd-nbd-2:17.2.7-902.gc61472c8.el8.x86_64 57/60 2024-04-25T02:24:53.337 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : rbd-nbd-2:15.2.17-0.el8.x86_64 58/60 2024-04-25T02:24:53.337 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-modules-core-2:17.2.7-902.gc61472c8.el8.n 59/60 2024-04-25T02:24:54.778 INFO:teuthology.orchestra.run.smithi114.stdout: Verifying : ceph-mgr-modules-core-2:15.2.17-0.el8.noarch 60/60 2024-04-25T02:24:54.779 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:24:54.779 INFO:teuthology.orchestra.run.smithi114.stdout:Upgraded: 2024-04-25T02:24:54.779 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:24:54.779 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-base-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:24:54.779 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-common-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:24:54.779 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-fuse-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:24:54.779 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-immutable-object-cache-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:24:54.779 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mds-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:24:54.779 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:24:54.779 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mgr-modules-core-2:17.2.7-902.gc61472c8.el8.noarch 2024-04-25T02:24:54.779 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-mon-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:24:54.779 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-osd-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:24:54.779 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-radosgw-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:24:54.779 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-selinux-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:24:54.780 INFO:teuthology.orchestra.run.smithi114.stdout: ceph-test-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:24:54.780 INFO:teuthology.orchestra.run.smithi114.stdout: libcephfs-devel-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:24:54.780 INFO:teuthology.orchestra.run.smithi114.stdout: libcephfs2-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:24:54.780 INFO:teuthology.orchestra.run.smithi114.stdout: librados-devel-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:24:54.780 INFO:teuthology.orchestra.run.smithi114.stdout: librados2-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:24:54.780 INFO:teuthology.orchestra.run.smithi114.stdout: libradosstriper1-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:24:54.780 INFO:teuthology.orchestra.run.smithi114.stdout: librbd1-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:24:54.780 INFO:teuthology.orchestra.run.smithi114.stdout: librgw2-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:24:54.780 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-argparse-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:24:54.780 INFO:teuthology.orchestra.run.smithi114.stdout: python3-ceph-common-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:24:54.780 INFO:teuthology.orchestra.run.smithi114.stdout: python3-cephfs-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:24:54.780 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rados-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:24:54.780 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rbd-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:24:54.780 INFO:teuthology.orchestra.run.smithi114.stdout: python3-rgw-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:24:54.781 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-fuse-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:24:54.781 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-mirror-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:24:54.781 INFO:teuthology.orchestra.run.smithi114.stdout: rbd-nbd-2:17.2.7-902.gc61472c8.el8.x86_64 2024-04-25T02:24:54.781 INFO:teuthology.orchestra.run.smithi114.stdout:Installed: 2024-04-25T02:24:54.781 INFO:teuthology.orchestra.run.smithi114.stdout: libcephsqlite-2:17.2.7-902.gc61472c8.el8.x86_64 thrift-0.13.0-2.el8.x86_64 2024-04-25T02:24:54.781 INFO:teuthology.orchestra.run.smithi114.stdout: 2024-04-25T02:24:54.781 INFO:teuthology.orchestra.run.smithi114.stdout:Complete! 2024-04-25T02:24:54.936 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=quincy 2024-04-25T02:24:55.251 DEBUG:teuthology.orchestra.run.smithi114:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-04-25T02:24:55.275 INFO:teuthology.orchestra.run.smithi114.stdout:17.2.7-902.gc61472c8.el8 2024-04-25T02:24:55.275 INFO:teuthology.packaging:The installed version of ceph is 17.2.7-902.gc61472c8.el8 2024-04-25T02:24:55.275 INFO:teuthology.task.install:The correct ceph version 17.2.7-902.gc61472c8 is installed. 2024-04-25T02:24:55.277 INFO:teuthology.run_tasks:Running task print... 2024-04-25T02:24:55.289 INFO:teuthology.task.print:**** done install.upgrade on client.0 2024-04-25T02:24:55.289 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-25T02:24:55.316 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-25T02:24:55.316 INFO:tasks.ceph_fuse:config is {'client.0': {'mounted': False}, 'client.1': {'skip': True}} 2024-04-25T02:24:55.316 INFO:tasks.ceph_fuse:client.0 config is {'mounted': False} 2024-04-25T02:24:55.317 INFO:tasks.ceph_fuse:client.1 config is {'skip': True} 2024-04-25T02:24:55.317 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-25T02:24:55.317 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:24:55.335 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-25T02:24:55.335 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:24:55.393 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:24:55.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.518+0000 7fed79e21700 1 Processor -- start 2024-04-25T02:24:55.521 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.518+0000 7fed79e21700 1 -- start start 2024-04-25T02:24:55.524 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.518+0000 7fed79e21700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fed740af4d0 0x7fed7406eb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:55.524 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.518+0000 7fed79e21700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fed740a3e70 0x7fed74067940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:55.524 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.518+0000 7fed79e21700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fed74067e80 0x7fed74068300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:55.524 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.518+0000 7fed79e21700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed740af8a0 con 0x7fed740a3e70 2024-04-25T02:24:55.524 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.518+0000 7fed79e21700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed740a2b30 con 0x7fed740af4d0 2024-04-25T02:24:55.524 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.518+0000 7fed79e21700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed740a3340 con 0x7fed74067e80 2024-04-25T02:24:55.524 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.518+0000 7fed737fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fed740af4d0 0x7fed7406eb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:55.524 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.518+0000 7fed73fff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fed74067e80 0x7fed74068300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:55.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.518+0000 7fed72ffd700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fed740a3e70 0x7fed74067940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:55.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.518+0000 7fed737fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fed740af4d0 0x7fed7406eb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:37680/0 (socket says 172.21.15.111:37680) 2024-04-25T02:24:55.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.518+0000 7fed73fff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fed74067e80 0x7fed74068300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:53970/0 (socket says 172.21.15.111:53970) 2024-04-25T02:24:55.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.518+0000 7fed72ffd700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fed740a3e70 0x7fed74067940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52260/0 (socket says 172.21.15.111:52260) 2024-04-25T02:24:55.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.518+0000 7fed737fe700 1 -- 172.21.15.111:0/2952851993 learned_addr learned my addr 172.21.15.111:0/2952851993 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:24:55.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.519+0000 7fed737fe700 1 -- 172.21.15.111:0/2952851993 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fed74067e80 msgr2=0x7fed74068300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:24:55.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.519+0000 7fed737fe700 1 --2- 172.21.15.111:0/2952851993 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fed74067e80 0x7fed74068300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:55.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.519+0000 7fed737fe700 1 -- 172.21.15.111:0/2952851993 >> v2:172.21.15.111:3300/0 conn(0x7fed740a3e70 msgr2=0x7fed74067940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:24:55.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.519+0000 7fed737fe700 1 --2- 172.21.15.111:0/2952851993 >> v2:172.21.15.111:3300/0 conn(0x7fed740a3e70 0x7fed74067940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:55.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.519+0000 7fed737fe700 1 -- 172.21.15.111:0/2952851993 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed740a49e0 con 0x7fed740af4d0 2024-04-25T02:24:55.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.519+0000 7fed72ffd700 1 --2- 172.21.15.111:0/2952851993 >> v2:172.21.15.111:3300/0 conn(0x7fed740a3e70 0x7fed74067940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:24:55.525 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.519+0000 7fed73fff700 1 --2- 172.21.15.111:0/2952851993 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fed74067e80 0x7fed74068300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:24:55.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.519+0000 7fed737fe700 1 --2- 172.21.15.111:0/2952851993 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fed740af4d0 0x7fed7406eb80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fed640099b0 tx=0x7fed64009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f8f162897b36a9bc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:24:55.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.519+0000 7fed727fc700 1 -- 172.21.15.111:0/2952851993 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed6400b680 con 0x7fed740af4d0 2024-04-25T02:24:55.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.519+0000 7fed727fc700 1 -- 172.21.15.111:0/2952851993 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed6400b7e0 con 0x7fed740af4d0 2024-04-25T02:24:55.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.519+0000 7fed727fc700 1 -- 172.21.15.111:0/2952851993 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed6400bb80 con 0x7fed740af4d0 2024-04-25T02:24:55.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.520+0000 7fed79e21700 1 -- 172.21.15.111:0/2952851993 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fed740af4d0 msgr2=0x7fed7406eb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:55.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.520+0000 7fed79e21700 1 --2- 172.21.15.111:0/2952851993 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fed740af4d0 0x7fed7406eb80 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fed640099b0 tx=0x7fed64009250 comp rx=0 tx=0).stop 2024-04-25T02:24:55.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.520+0000 7fed79e21700 1 -- 172.21.15.111:0/2952851993 shutdown_connections 2024-04-25T02:24:55.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.520+0000 7fed79e21700 1 --2- 172.21.15.111:0/2952851993 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fed74067e80 0x7fed74068300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:55.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.520+0000 7fed79e21700 1 --2- 172.21.15.111:0/2952851993 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fed740af4d0 0x7fed7406eb80 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:55.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.520+0000 7fed79e21700 1 --2- 172.21.15.111:0/2952851993 >> v2:172.21.15.111:3300/0 conn(0x7fed740a3e70 0x7fed74067940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:55.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.520+0000 7fed79e21700 1 -- 172.21.15.111:0/2952851993 >> 172.21.15.111:0/2952851993 conn(0x7fed7406ab40 msgr2=0x7fed7406af40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:24:55.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.520+0000 7fed79e21700 1 -- 172.21.15.111:0/2952851993 shutdown_connections 2024-04-25T02:24:55.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.520+0000 7fed79e21700 1 -- 172.21.15.111:0/2952851993 wait complete. 2024-04-25T02:24:55.527 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.521+0000 7fed79e21700 1 Processor -- start 2024-04-25T02:24:55.527 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.521+0000 7fed79e21700 1 -- start start 2024-04-25T02:24:55.529 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.521+0000 7fed79e21700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fed74067e80 0x7fed740976f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:55.529 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.521+0000 7fed79e21700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fed740a3e70 0x7fed7413eba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:55.529 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.521+0000 7fed79e21700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fed740af4d0 0x7fed7413f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:55.529 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.521+0000 7fed79e21700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed74097f60 con 0x7fed740af4d0 2024-04-25T02:24:55.529 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.521+0000 7fed79e21700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed740aac60 con 0x7fed74067e80 2024-04-25T02:24:55.529 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.521+0000 7fed79e21700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fed740aaf20 con 0x7fed740a3e70 2024-04-25T02:24:55.529 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.521+0000 7fed737fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fed74067e80 0x7fed740976f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:55.529 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.521+0000 7fed72ffd700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fed740a3e70 0x7fed7413eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:55.529 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.521+0000 7fed73fff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fed740af4d0 0x7fed7413f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:55.529 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.521+0000 7fed737fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fed74067e80 0x7fed740976f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:37682/0 (socket says 172.21.15.111:37682) 2024-04-25T02:24:55.529 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.521+0000 7fed737fe700 1 -- 172.21.15.111:0/2875237343 learned_addr learned my addr 172.21.15.111:0/2875237343 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:24:55.529 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.521+0000 7fed72ffd700 1 --2- 172.21.15.111:0/2875237343 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fed740a3e70 0x7fed7413eba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:53974/0 (socket says 172.21.15.111:53974) 2024-04-25T02:24:55.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.522+0000 7fed737fe700 1 -- 172.21.15.111:0/2875237343 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fed740a3e70 msgr2=0x7fed7413eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:55.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.522+0000 7fed737fe700 1 --2- 172.21.15.111:0/2875237343 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fed740a3e70 0x7fed7413eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:55.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.522+0000 7fed737fe700 1 -- 172.21.15.111:0/2875237343 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fed740af4d0 msgr2=0x7fed7413f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:55.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.522+0000 7fed737fe700 1 --2- 172.21.15.111:0/2875237343 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fed740af4d0 0x7fed7413f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:55.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.522+0000 7fed737fe700 1 -- 172.21.15.111:0/2875237343 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed6c009a20 con 0x7fed74067e80 2024-04-25T02:24:55.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.522+0000 7fed73fff700 1 --2- 172.21.15.111:0/2875237343 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fed740af4d0 0x7fed7413f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:24:55.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.522+0000 7fed72ffd700 1 --2- 172.21.15.111:0/2875237343 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fed740a3e70 0x7fed7413eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:24:55.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.522+0000 7fed737fe700 1 --2- 172.21.15.111:0/2875237343 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fed74067e80 0x7fed740976f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fed64009290 tx=0x7fed64017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:24:55.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.522+0000 7fed5b7fe700 1 -- 172.21.15.111:0/2875237343 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed64000d10 con 0x7fed74067e80 2024-04-25T02:24:55.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.522+0000 7fed5b7fe700 1 -- 172.21.15.111:0/2875237343 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed6400bb60 con 0x7fed74067e80 2024-04-25T02:24:55.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.522+0000 7fed79e21700 1 -- 172.21.15.111:0/2875237343 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed68009420 con 0x7fed74067e80 2024-04-25T02:24:55.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.522+0000 7fed5b7fe700 1 -- 172.21.15.111:0/2875237343 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed6401a6c0 con 0x7fed74067e80 2024-04-25T02:24:55.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.522+0000 7fed79e21700 1 -- 172.21.15.111:0/2875237343 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed640094f0 con 0x7fed74067e80 2024-04-25T02:24:55.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.523+0000 7fed5b7fe700 1 -- 172.21.15.111:0/2875237343 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7fed6401aa30 con 0x7fed74067e80 2024-04-25T02:24:55.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.523+0000 7fed79e21700 1 -- 172.21.15.111:0/2875237343 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed74098ea0 con 0x7fed74067e80 2024-04-25T02:24:55.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.523+0000 7fed5b7fe700 1 -- 172.21.15.111:0/2875237343 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4115+0+0 (secure 0 0 0) 0x7fed6405c9f0 con 0x7fed74067e80 2024-04-25T02:24:55.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.527+0000 7fed5b7fe700 1 -- 172.21.15.111:0/2875237343 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fed6400ab70 con 0x7fed74067e80 2024-04-25T02:24:55.685 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.681+0000 7fed79e21700 1 -- 172.21.15.111:0/2875237343 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed74098cd0 con 0x7fed74067e80 2024-04-25T02:24:55.685 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.682+0000 7fed5b7fe700 1 -- 172.21.15.111:0/2875237343 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+12043 (secure 0 0 0) 0x7fed64029020 con 0x7fed74067e80 2024-04-25T02:24:55.685 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:24:55.686 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":42,"fsid":"4643f974-f93a-4436-93b8-460ff320e62e","created":"2024-04-25T02:20:05.450475+0000","modified":"2024-04-25T02:23:55.943818+0000","last_up_change":"2024-04-25T02:23:12.818028+0000","last_in_change":"2024-04-25T02:20:10.439204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:20:07.471248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:20:14.420378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:20:22.251868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T02:20:23.128289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"df3f17ca-3b12-42c8-8cf7-8f1b7189e587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":41,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6800","nonce":48862}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6801","nonce":48862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6803","nonce":48862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6802","nonce":48862}]},"public_addr":"172.21.15.111:6800/48862","cluster_addr":"172.21.15.111:6801/48862","heartbeat_back_addr":"172.21.15.111:6803/48862","heartbeat_front_addr":"172.21.15.111:6802/48862","state":["exists","up"]},{"osd":1,"uuid":"93d54815-f215-4285-bba6-32f2d1cabf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":29,"up_thru":31,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6804","nonce":48960}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6805","nonce":48960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6807","nonce":48960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6806","nonce":48960}]},"public_addr":"172.21.15.111:6804/48960","cluster_addr":"172.21.15.111:6805/48960","heartbeat_back_addr":"172.21.15.111:6807/48960","heartbeat_front_addr":"172.21.15.111:6806/48960","state":["exists","up"]},{"osd":2,"uuid":"b26b2104-2a2e-408f-9ce7-3587a32a2ebe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":41,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6808","nonce":49070}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6809","nonce":49070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6811","nonce":49070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6810","nonce":49070}]},"public_addr":"172.21.15.111:6808/49070","cluster_addr":"172.21.15.111:6809/49070","heartbeat_back_addr":"172.21.15.111:6811/49070","heartbeat_front_addr":"172.21.15.111:6810/49070","state":["exists","up"]},{"osd":3,"uuid":"43c25820-1edc-4031-badf-72e87dd6bf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":31,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6812","nonce":49243}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6813","nonce":49243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6815","nonce":49243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6814","nonce":49243}]},"public_addr":"172.21.15.111:6812/49243","cluster_addr":"172.21.15.111:6813/49243","heartbeat_back_addr":"172.21.15.111:6815/49243","heartbeat_front_addr":"172.21.15.111:6814/49243","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.372427+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.411480+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.361508+0000","dead_epoch":25},{"osd":3,"down_stamp":"2024-04-25T02:23:06.771296+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.377212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.d","mappings":[{"from":3,"to":2}]},{"pgid":"4.13","mappings":[{"from":3,"to":0}]},{"pgid":"4.19","mappings":[{"from":3,"to":0}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.30","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.111:6819/4003866251":"2024-04-26T02:23:16.839679+0000","172.21.15.111:0/2148931273":"2024-04-26T02:22:54.713254+0000","172.21.15.111:6816/39585":"2024-04-26T02:22:54.713254+0000","172.21.15.111:0/3911588907":"2024-04-26T02:22:54.713254+0000","172.21.15.111:0/1276843622":"2024-04-26T02:22:54.713254+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:24:55.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.683+0000 7fed79e21700 1 -- 172.21.15.111:0/2875237343 >> v1:172.21.15.111:6816/46482 conn(0x7fed60045f20 legacy=0x7fed600483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:55.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.683+0000 7fed79e21700 1 -- 172.21.15.111:0/2875237343 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fed74067e80 msgr2=0x7fed740976f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:55.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.683+0000 7fed79e21700 1 --2- 172.21.15.111:0/2875237343 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fed74067e80 0x7fed740976f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fed64009290 tx=0x7fed64017000 comp rx=0 tx=0).stop 2024-04-25T02:24:55.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.683+0000 7fed79e21700 1 -- 172.21.15.111:0/2875237343 shutdown_connections 2024-04-25T02:24:55.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.683+0000 7fed79e21700 1 --2- 172.21.15.111:0/2875237343 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fed740af4d0 0x7fed7413f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:55.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.683+0000 7fed79e21700 1 --2- 172.21.15.111:0/2875237343 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fed74067e80 0x7fed740976f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:55.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.683+0000 7fed79e21700 1 --2- 172.21.15.111:0/2875237343 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fed740a3e70 0x7fed7413eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:55.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.683+0000 7fed79e21700 1 -- 172.21.15.111:0/2875237343 >> 172.21.15.111:0/2875237343 conn(0x7fed7406ab40 msgr2=0x7fed740a2350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:24:55.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.683+0000 7fed79e21700 1 -- 172.21.15.111:0/2875237343 shutdown_connections 2024-04-25T02:24:55.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.684+0000 7fed79e21700 1 -- 172.21.15.111:0/2875237343 wait complete. 2024-04-25T02:24:55.699 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:20:07.471248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T02:20:14.420378+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:20:22.251868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:20:23.128289+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T02:24:55.699 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:24:55.817 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.814+0000 7fd7edc34700 1 Processor -- start 2024-04-25T02:24:55.817 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.814+0000 7fd7edc34700 1 -- start start 2024-04-25T02:24:55.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.814+0000 7fd7edc34700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd7e806e380 0x7fd7e806ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:55.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.814+0000 7fd7edc34700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd7e813b090 0x7fd7e813deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:55.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.814+0000 7fd7edc34700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fd7e813b4e0 0x7fd7e813e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:55.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.814+0000 7fd7edc34700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd7e806dca0 con 0x7fd7e813b4e0 2024-04-25T02:24:55.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.814+0000 7fd7edc34700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e813a9c0 con 0x7fd7e806e380 2024-04-25T02:24:55.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.814+0000 7fd7edc34700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e80ac6a0 con 0x7fd7e813b090 2024-04-25T02:24:55.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.814+0000 7fd7e6ffd700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd7e813b090 0x7fd7e813deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:55.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.814+0000 7fd7e77fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd7e806e380 0x7fd7e806ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:55.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.814+0000 7fd7e7fff700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fd7e813b4e0 0x7fd7e813e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:55.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.814+0000 7fd7e7fff700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fd7e813b4e0 0x7fd7e813e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52272/0 (socket says 172.21.15.111:52272) 2024-04-25T02:24:55.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.814+0000 7fd7e77fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd7e806e380 0x7fd7e806ed40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:37690/0 (socket says 172.21.15.111:37690) 2024-04-25T02:24:55.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.814+0000 7fd7e6ffd700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd7e813b090 0x7fd7e813deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:53980/0 (socket says 172.21.15.111:53980) 2024-04-25T02:24:55.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.814+0000 7fd7e7fff700 1 -- 172.21.15.111:0/1471489436 learned_addr learned my addr 172.21.15.111:0/1471489436 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:24:55.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.815+0000 7fd7e6ffd700 1 -- 172.21.15.111:0/1471489436 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd7e806e380 msgr2=0x7fd7e806ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:24:55.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.815+0000 7fd7e6ffd700 1 --2- 172.21.15.111:0/1471489436 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd7e806e380 0x7fd7e806ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:55.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.815+0000 7fd7e6ffd700 1 -- 172.21.15.111:0/1471489436 >> v2:172.21.15.111:3300/0 conn(0x7fd7e813b4e0 msgr2=0x7fd7e813e3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:24:55.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.815+0000 7fd7e6ffd700 1 --2- 172.21.15.111:0/1471489436 >> v2:172.21.15.111:3300/0 conn(0x7fd7e813b4e0 0x7fd7e813e3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:55.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.815+0000 7fd7e6ffd700 1 -- 172.21.15.111:0/1471489436 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7e813ac40 con 0x7fd7e813b090 2024-04-25T02:24:55.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.815+0000 7fd7e7fff700 1 --2- 172.21.15.111:0/1471489436 >> v2:172.21.15.111:3300/0 conn(0x7fd7e813b4e0 0x7fd7e813e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:24:55.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.815+0000 7fd7e77fe700 1 --2- 172.21.15.111:0/1471489436 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd7e806e380 0x7fd7e806ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:24:55.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.815+0000 7fd7e6ffd700 1 --2- 172.21.15.111:0/1471489436 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd7e813b090 0x7fd7e813deb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0009910 tx=0x7fd7d00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8f85d162f7088fe server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:24:55.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.815+0000 7fd7e67fc700 1 -- 172.21.15.111:0/1471489436 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d0011630 con 0x7fd7e813b090 2024-04-25T02:24:55.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.815+0000 7fd7e67fc700 1 -- 172.21.15.111:0/1471489436 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7d0011790 con 0x7fd7e813b090 2024-04-25T02:24:55.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.815+0000 7fd7e67fc700 1 -- 172.21.15.111:0/1471489436 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7d0011b30 con 0x7fd7e813b090 2024-04-25T02:24:55.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.816+0000 7fd7edc34700 1 -- 172.21.15.111:0/1471489436 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd7e813b090 msgr2=0x7fd7e813deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:55.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.816+0000 7fd7edc34700 1 --2- 172.21.15.111:0/1471489436 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd7e813b090 0x7fd7e813deb0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fd7d0009910 tx=0x7fd7d00091a0 comp rx=0 tx=0).stop 2024-04-25T02:24:55.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.816+0000 7fd7edc34700 1 -- 172.21.15.111:0/1471489436 shutdown_connections 2024-04-25T02:24:55.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.816+0000 7fd7edc34700 1 --2- 172.21.15.111:0/1471489436 >> v2:172.21.15.111:3300/0 conn(0x7fd7e813b4e0 0x7fd7e813e3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:55.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.816+0000 7fd7edc34700 1 --2- 172.21.15.111:0/1471489436 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd7e806e380 0x7fd7e806ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:55.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.816+0000 7fd7edc34700 1 --2- 172.21.15.111:0/1471489436 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd7e813b090 0x7fd7e813deb0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:55.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.816+0000 7fd7edc34700 1 -- 172.21.15.111:0/1471489436 >> 172.21.15.111:0/1471489436 conn(0x7fd7e80b1400 msgr2=0x7fd7e80b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:24:55.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.816+0000 7fd7edc34700 1 -- 172.21.15.111:0/1471489436 shutdown_connections 2024-04-25T02:24:55.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.816+0000 7fd7edc34700 1 -- 172.21.15.111:0/1471489436 wait complete. 2024-04-25T02:24:55.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.817+0000 7fd7edc34700 1 Processor -- start 2024-04-25T02:24:55.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.817+0000 7fd7edc34700 1 -- start start 2024-04-25T02:24:55.825 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.817+0000 7fd7edc34700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd7e806e380 0x7fd7e8119ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:55.825 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.817+0000 7fd7edc34700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd7e813b090 0x7fd7e8151a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:55.825 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.817+0000 7fd7edc34700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd7e813b4e0 0x7fd7e8151f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:55.825 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.817+0000 7fd7edc34700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e811b6a0 con 0x7fd7e813b090 2024-04-25T02:24:55.825 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.817+0000 7fd7edc34700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e811a3f0 con 0x7fd7e806e380 2024-04-25T02:24:55.825 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.817+0000 7fd7edc34700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd7e811a6b0 con 0x7fd7e813b4e0 2024-04-25T02:24:55.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.817+0000 7fd7e6ffd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd7e813b090 0x7fd7e8151a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:55.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.817+0000 7fd7e7fff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd7e813b4e0 0x7fd7e8151f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:55.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.817+0000 7fd7e77fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd7e806e380 0x7fd7e8119ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:55.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.817+0000 7fd7e7fff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd7e813b4e0 0x7fd7e8151f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:53990/0 (socket says 172.21.15.111:53990) 2024-04-25T02:24:55.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.817+0000 7fd7e6ffd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd7e813b090 0x7fd7e8151a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52280/0 (socket says 172.21.15.111:52280) 2024-04-25T02:24:55.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.817+0000 7fd7e77fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd7e806e380 0x7fd7e8119ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:37704/0 (socket says 172.21.15.111:37704) 2024-04-25T02:24:55.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.817+0000 7fd7e7fff700 1 -- 172.21.15.111:0/131614749 learned_addr learned my addr 172.21.15.111:0/131614749 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:24:55.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.818+0000 7fd7e7fff700 1 -- 172.21.15.111:0/131614749 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd7e806e380 msgr2=0x7fd7e8119ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:55.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.818+0000 7fd7e7fff700 1 --2- 172.21.15.111:0/131614749 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd7e806e380 0x7fd7e8119ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:55.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.818+0000 7fd7e7fff700 1 -- 172.21.15.111:0/131614749 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd7e813b090 msgr2=0x7fd7e8151a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:55.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.818+0000 7fd7e7fff700 1 --2- 172.21.15.111:0/131614749 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd7e813b090 0x7fd7e8151a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:55.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.818+0000 7fd7e7fff700 1 -- 172.21.15.111:0/131614749 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d8009a20 con 0x7fd7e813b4e0 2024-04-25T02:24:55.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.818+0000 7fd7e77fe700 1 --2- 172.21.15.111:0/131614749 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd7e806e380 0x7fd7e8119ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:24:55.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.818+0000 7fd7e6ffd700 1 --2- 172.21.15.111:0/131614749 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd7e813b090 0x7fd7e8151a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:24:55.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.818+0000 7fd7e7fff700 1 --2- 172.21.15.111:0/131614749 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd7e813b4e0 0x7fd7e8151f70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd7e000de50 tx=0x7fd7e000f040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:24:55.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.818+0000 7fd7df7fe700 1 -- 172.21.15.111:0/131614749 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e0009b00 con 0x7fd7e813b4e0 2024-04-25T02:24:55.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.818+0000 7fd7df7fe700 1 -- 172.21.15.111:0/131614749 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e0009c60 con 0x7fd7e813b4e0 2024-04-25T02:24:55.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.818+0000 7fd7df7fe700 1 -- 172.21.15.111:0/131614749 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e00173f0 con 0x7fd7e813b4e0 2024-04-25T02:24:55.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.818+0000 7fd7edc34700 1 -- 172.21.15.111:0/131614749 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7e000b780 con 0x7fd7e813b4e0 2024-04-25T02:24:55.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.818+0000 7fd7edc34700 1 -- 172.21.15.111:0/131614749 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7d0009420 con 0x7fd7e813b4e0 2024-04-25T02:24:55.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.819+0000 7fd7edc34700 1 -- 172.21.15.111:0/131614749 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7e8065190 con 0x7fd7e813b4e0 2024-04-25T02:24:55.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.819+0000 7fd7df7fe700 1 -- 172.21.15.111:0/131614749 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7fd7e0017820 con 0x7fd7e813b4e0 2024-04-25T02:24:55.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.819+0000 7fd7df7fe700 1 -- 172.21.15.111:0/131614749 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4115+0+0 (secure 0 0 0) 0x7fd7e005b460 con 0x7fd7e813b4e0 2024-04-25T02:24:55.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.823+0000 7fd7df7fe700 1 -- 172.21.15.111:0/131614749 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fd7e00396b0 con 0x7fd7e813b4e0 2024-04-25T02:24:55.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.980+0000 7fd7edc34700 1 -- 172.21.15.111:0/131614749 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd7e811c5c0 con 0x7fd7e813b4e0 2024-04-25T02:24:55.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.980+0000 7fd7df7fe700 1 -- 172.21.15.111:0/131614749 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd7e003cea0 con 0x7fd7e813b4e0 2024-04-25T02:24:55.984 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 1 2024-04-25T02:24:55.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.982+0000 7fd7edc34700 1 -- 172.21.15.111:0/131614749 >> v1:172.21.15.111:6816/46482 conn(0x7fd7c8045f20 legacy=0x7fd7c80483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:55.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.982+0000 7fd7edc34700 1 -- 172.21.15.111:0/131614749 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd7e813b4e0 msgr2=0x7fd7e8151f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:55.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.982+0000 7fd7edc34700 1 --2- 172.21.15.111:0/131614749 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd7e813b4e0 0x7fd7e8151f70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fd7e000de50 tx=0x7fd7e000f040 comp rx=0 tx=0).stop 2024-04-25T02:24:55.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.982+0000 7fd7edc34700 1 -- 172.21.15.111:0/131614749 shutdown_connections 2024-04-25T02:24:55.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.982+0000 7fd7edc34700 1 --2- 172.21.15.111:0/131614749 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd7e813b4e0 0x7fd7e8151f70 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:55.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.982+0000 7fd7edc34700 1 --2- 172.21.15.111:0/131614749 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd7e806e380 0x7fd7e8119ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:55.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.982+0000 7fd7edc34700 1 --2- 172.21.15.111:0/131614749 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd7e813b090 0x7fd7e8151a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:55.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.982+0000 7fd7edc34700 1 -- 172.21.15.111:0/131614749 >> 172.21.15.111:0/131614749 conn(0x7fd7e80b1400 msgr2=0x7fd7e80b17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:24:55.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.982+0000 7fd7edc34700 1 -- 172.21.15.111:0/131614749 shutdown_connections 2024-04-25T02:24:55.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:55.982+0000 7fd7edc34700 1 -- 172.21.15.111:0/131614749 wait complete. 2024-04-25T02:24:55.999 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T02:24:56.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.114+0000 7fc6097d4700 1 Processor -- start 2024-04-25T02:24:56.118 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.114+0000 7fc6097d4700 1 -- start start 2024-04-25T02:24:56.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.115+0000 7fc6097d4700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc6040b5040 0x7fc6040aa460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:56.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.115+0000 7fc6097d4700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fc60413f140 0x7fc6040a8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:56.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.115+0000 7fc6097d4700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6040a9c80 con 0x7fc6040a8b90 2024-04-25T02:24:56.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.115+0000 7fc6097d4700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6040a9800 con 0x7fc60413f140 2024-04-25T02:24:56.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.115+0000 7fc6097d4700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6040aa9a0 con 0x7fc6040b5040 2024-04-25T02:24:56.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.115+0000 7fc602ffd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc6040b5040 0x7fc6040aa460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:56.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.115+0000 7fc6037fe700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fc60413f140 0x7fc6040a8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:56.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.115+0000 7fc6027fc700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7fc6040a8b90 0x7fc60413ea30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:45372/0 (socket says 172.21.15.111:45372) 2024-04-25T02:24:56.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.115+0000 7fc602ffd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc6040b5040 0x7fc6040aa460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:37718/0 (socket says 172.21.15.111:37718) 2024-04-25T02:24:56.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.115+0000 7fc6027fc700 1 -- 172.21.15.111:0/496762011 learned_addr learned my addr 172.21.15.111:0/496762011 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:24:56.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.115+0000 7fc6037fe700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fc60413f140 0x7fc6040a8f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52294/0 (socket says 172.21.15.111:52294) 2024-04-25T02:24:56.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.115+0000 7fc6037fe700 1 -- 172.21.15.111:0/496762011 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc6040b5040 msgr2=0x7fc6040aa460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:24:56.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.115+0000 7fc6037fe700 1 --2- 172.21.15.111:0/496762011 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc6040b5040 0x7fc6040aa460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:56.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.115+0000 7fc6037fe700 1 -- 172.21.15.111:0/496762011 >> v1:172.21.15.111:6789/0 conn(0x7fc6040a8b90 legacy=0x7fc60413ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:56.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.115+0000 7fc601ffb700 1 -- 172.21.15.111:0/496762011 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 154694383 0 0) 0x7fc6040a9c80 con 0x7fc6040a8b90 2024-04-25T02:24:56.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.115+0000 7fc6037fe700 1 -- 172.21.15.111:0/496762011 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6040a6800 con 0x7fc60413f140 2024-04-25T02:24:56.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.115+0000 7fc602ffd700 1 --2- 172.21.15.111:0/496762011 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc6040b5040 0x7fc6040aa460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:24:56.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.116+0000 7fc6037fe700 1 --2- 172.21.15.111:0/496762011 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc60413f140 0x7fc6040a8f60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc009e60 tx=0x7fc5fc009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ed9766d127759fc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:24:56.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.116+0000 7fc601ffb700 1 -- 172.21.15.111:0/496762011 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc00e070 con 0x7fc60413f140 2024-04-25T02:24:56.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.116+0000 7fc601ffb700 1 -- 172.21.15.111:0/496762011 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5fc00bb60 con 0x7fc60413f140 2024-04-25T02:24:56.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.116+0000 7fc601ffb700 1 -- 172.21.15.111:0/496762011 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc012430 con 0x7fc60413f140 2024-04-25T02:24:56.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.116+0000 7fc6097d4700 1 -- 172.21.15.111:0/496762011 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc60413f140 msgr2=0x7fc6040a8f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:56.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.116+0000 7fc6097d4700 1 --2- 172.21.15.111:0/496762011 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc60413f140 0x7fc6040a8f60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc009e60 tx=0x7fc5fc009780 comp rx=0 tx=0).stop 2024-04-25T02:24:56.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.116+0000 7fc6097d4700 1 -- 172.21.15.111:0/496762011 shutdown_connections 2024-04-25T02:24:56.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.116+0000 7fc6097d4700 1 --2- 172.21.15.111:0/496762011 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc60413f140 0x7fc6040a8f60 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:56.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.116+0000 7fc6097d4700 1 --2- 172.21.15.111:0/496762011 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc6040b5040 0x7fc6040aa460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:56.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.116+0000 7fc6097d4700 1 -- 172.21.15.111:0/496762011 >> 172.21.15.111:0/496762011 conn(0x7fc604068970 msgr2=0x7fc604068d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:24:56.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.116+0000 7fc6097d4700 1 -- 172.21.15.111:0/496762011 shutdown_connections 2024-04-25T02:24:56.122 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.116+0000 7fc6097d4700 1 -- 172.21.15.111:0/496762011 wait complete. 2024-04-25T02:24:56.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.117+0000 7fc6097d4700 1 Processor -- start 2024-04-25T02:24:56.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.117+0000 7fc6097d4700 1 -- start start 2024-04-25T02:24:56.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.118+0000 7fc6097d4700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc6040a8b90 0x7fc604151340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:56.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.118+0000 7fc6097d4700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc6040b5040 0x7fc604151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:56.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.118+0000 7fc6097d4700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc60413f140 0x7fc604151dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:56.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.118+0000 7fc6097d4700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc604144b70 con 0x7fc60413f140 2024-04-25T02:24:56.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.118+0000 7fc6097d4700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc604145760 con 0x7fc6040b5040 2024-04-25T02:24:56.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.118+0000 7fc6097d4700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc6040abdc0 con 0x7fc6040a8b90 2024-04-25T02:24:56.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.118+0000 7fc602ffd700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc6040a8b90 0x7fc604151340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:56.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.118+0000 7fc6027fc700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc6040b5040 0x7fc604151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:56.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.118+0000 7fc6037fe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc60413f140 0x7fc604151dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:56.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.118+0000 7fc602ffd700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc6040a8b90 0x7fc604151340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:54002/0 (socket says 172.21.15.111:54002) 2024-04-25T02:24:56.125 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.118+0000 7fc602ffd700 1 -- 172.21.15.111:0/3431423396 learned_addr learned my addr 172.21.15.111:0/3431423396 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:24:56.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.118+0000 7fc6027fc700 1 -- 172.21.15.111:0/3431423396 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc6040a8b90 msgr2=0x7fc604151340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:56.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.118+0000 7fc6027fc700 1 --2- 172.21.15.111:0/3431423396 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc6040a8b90 0x7fc604151340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:56.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.118+0000 7fc6027fc700 1 -- 172.21.15.111:0/3431423396 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc60413f140 msgr2=0x7fc604151dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:56.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.118+0000 7fc6027fc700 1 --2- 172.21.15.111:0/3431423396 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc60413f140 0x7fc604151dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:56.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.118+0000 7fc6027fc700 1 -- 172.21.15.111:0/3431423396 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5f8009420 con 0x7fc6040b5040 2024-04-25T02:24:56.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.118+0000 7fc6037fe700 1 --2- 172.21.15.111:0/3431423396 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc60413f140 0x7fc604151dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:24:56.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.118+0000 7fc602ffd700 1 --2- 172.21.15.111:0/3431423396 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc6040a8b90 0x7fc604151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:24:56.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.119+0000 7fc6027fc700 1 --2- 172.21.15.111:0/3431423396 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc6040b5040 0x7fc604151880 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc5f40011e0 tx=0x7fc5f4007d10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:24:56.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.119+0000 7fc5eaffd700 1 -- 172.21.15.111:0/3431423396 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f4005b30 con 0x7fc6040b5040 2024-04-25T02:24:56.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.119+0000 7fc5eaffd700 1 -- 172.21.15.111:0/3431423396 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc5f4005cb0 con 0x7fc6040b5040 2024-04-25T02:24:56.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.119+0000 7fc6097d4700 1 -- 172.21.15.111:0/3431423396 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5fc009a20 con 0x7fc6040b5040 2024-04-25T02:24:56.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.119+0000 7fc5eaffd700 1 -- 172.21.15.111:0/3431423396 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5f4007320 con 0x7fc6040b5040 2024-04-25T02:24:56.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.119+0000 7fc6097d4700 1 -- 172.21.15.111:0/3431423396 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6041451a0 con 0x7fc6040b5040 2024-04-25T02:24:56.126 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.120+0000 7fc6097d4700 1 -- 172.21.15.111:0/3431423396 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc604065190 con 0x7fc6040b5040 2024-04-25T02:24:56.127 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.120+0000 7fc5eaffd700 1 -- 172.21.15.111:0/3431423396 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7fc5f4012400 con 0x7fc6040b5040 2024-04-25T02:24:56.127 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.120+0000 7fc5eaffd700 1 -- 172.21.15.111:0/3431423396 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4115+0+0 (secure 0 0 0) 0x7fc5f405a460 con 0x7fc6040b5040 2024-04-25T02:24:56.127 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.123+0000 7fc5eaffd700 1 -- 172.21.15.111:0/3431423396 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fc5f40386b0 con 0x7fc6040b5040 2024-04-25T02:24:56.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.281+0000 7fc6097d4700 1 -- 172.21.15.111:0/3431423396 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fc6040b3dc0 con 0x7fc6040b5040 2024-04-25T02:24:56.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.281+0000 7fc5eaffd700 1 -- 172.21.15.111:0/3431423396 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v42) v1 ==== 92+0+10 (secure 0 0 0) 0x7fc5f4017070 con 0x7fc6040b5040 2024-04-25T02:24:56.285 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 8 2024-04-25T02:24:56.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.283+0000 7fc6097d4700 1 -- 172.21.15.111:0/3431423396 >> v1:172.21.15.111:6816/46482 conn(0x7fc5f0045ef0 legacy=0x7fc5f00483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:56.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.283+0000 7fc6097d4700 1 -- 172.21.15.111:0/3431423396 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc6040b5040 msgr2=0x7fc604151880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:56.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.283+0000 7fc6097d4700 1 --2- 172.21.15.111:0/3431423396 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc6040b5040 0x7fc604151880 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc5f40011e0 tx=0x7fc5f4007d10 comp rx=0 tx=0).stop 2024-04-25T02:24:56.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.283+0000 7fc6097d4700 1 -- 172.21.15.111:0/3431423396 shutdown_connections 2024-04-25T02:24:56.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.283+0000 7fc6097d4700 1 --2- 172.21.15.111:0/3431423396 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc60413f140 0x7fc604151dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:56.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.283+0000 7fc6097d4700 1 --2- 172.21.15.111:0/3431423396 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc6040a8b90 0x7fc604151340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:56.288 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.283+0000 7fc6097d4700 1 --2- 172.21.15.111:0/3431423396 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc6040b5040 0x7fc604151880 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:56.288 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.283+0000 7fc6097d4700 1 -- 172.21.15.111:0/3431423396 >> 172.21.15.111:0/3431423396 conn(0x7fc604068970 msgr2=0x7fc6040a5dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:24:56.288 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.283+0000 7fc6097d4700 1 -- 172.21.15.111:0/3431423396 shutdown_connections 2024-04-25T02:24:56.288 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.283+0000 7fc6097d4700 1 -- 172.21.15.111:0/3431423396 wait complete. 2024-04-25T02:24:56.298 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:24:56.419 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.413+0000 7fa4fe46e700 1 Processor -- start 2024-04-25T02:24:56.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.413+0000 7fa4fe46e700 1 -- start start 2024-04-25T02:24:56.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.414+0000 7fa4fe46e700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa4f8068210 0x7fa4f80a5320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:56.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.414+0000 7fa4fe46e700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fa4f813ffd0 0x7fa4f80a6e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:56.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.414+0000 7fa4fe46e700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa4f81403e0 0x7fa4f806eb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:56.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.414+0000 7fa4fe46e700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4f80685e0 con 0x7fa4f813ffd0 2024-04-25T02:24:56.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.414+0000 7fa4fe46e700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f813f900 con 0x7fa4f8068210 2024-04-25T02:24:56.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.414+0000 7fa4fe46e700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f813fba0 con 0x7fa4f81403e0 2024-04-25T02:24:56.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.414+0000 7fa4fca0b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa4f81403e0 0x7fa4f806eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:56.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.414+0000 7fa4f7fff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa4f8068210 0x7fa4f80a5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:56.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.414+0000 7fa4f77fe700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fa4f813ffd0 0x7fa4f80a6e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:56.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.414+0000 7fa4fca0b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa4f81403e0 0x7fa4f806eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:54006/0 (socket says 172.21.15.111:54006) 2024-04-25T02:24:56.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.414+0000 7fa4f7fff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa4f8068210 0x7fa4f80a5320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:37740/0 (socket says 172.21.15.111:37740) 2024-04-25T02:24:56.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.414+0000 7fa4fca0b700 1 -- 172.21.15.111:0/2315229616 learned_addr learned my addr 172.21.15.111:0/2315229616 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:24:56.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.414+0000 7fa4fca0b700 1 -- 172.21.15.111:0/2315229616 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa4f8068210 msgr2=0x7fa4f80a5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:24:56.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.414+0000 7fa4fca0b700 1 --2- 172.21.15.111:0/2315229616 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa4f8068210 0x7fa4f80a5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:56.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.414+0000 7fa4fca0b700 1 -- 172.21.15.111:0/2315229616 >> v2:172.21.15.111:3300/0 conn(0x7fa4f813ffd0 msgr2=0x7fa4f80a6e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:24:56.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.414+0000 7fa4fca0b700 1 --2- 172.21.15.111:0/2315229616 >> v2:172.21.15.111:3300/0 conn(0x7fa4f813ffd0 0x7fa4f80a6e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:56.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.414+0000 7fa4fca0b700 1 -- 172.21.15.111:0/2315229616 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4f80a5e10 con 0x7fa4f81403e0 2024-04-25T02:24:56.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.414+0000 7fa4f7fff700 1 --2- 172.21.15.111:0/2315229616 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa4f8068210 0x7fa4f80a5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:24:56.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.414+0000 7fa4f77fe700 1 --2- 172.21.15.111:0/2315229616 >> v2:172.21.15.111:3300/0 conn(0x7fa4f813ffd0 0x7fa4f80a6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:24:56.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.415+0000 7fa4fca0b700 1 --2- 172.21.15.111:0/2315229616 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa4f81403e0 0x7fa4f806eb20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa4f0009f20 tx=0x7fa4f0009840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9cb5c58dd0a53156 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:24:56.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.415+0000 7fa4f6ffd700 1 -- 172.21.15.111:0/2315229616 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f000e070 con 0x7fa4f81403e0 2024-04-25T02:24:56.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.415+0000 7fa4f6ffd700 1 -- 172.21.15.111:0/2315229616 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4f000ba00 con 0x7fa4f81403e0 2024-04-25T02:24:56.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.415+0000 7fa4f6ffd700 1 -- 172.21.15.111:0/2315229616 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4f00092e0 con 0x7fa4f81403e0 2024-04-25T02:24:56.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.415+0000 7fa4fe46e700 1 -- 172.21.15.111:0/2315229616 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa4f81403e0 msgr2=0x7fa4f806eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:56.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.415+0000 7fa4fe46e700 1 --2- 172.21.15.111:0/2315229616 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa4f81403e0 0x7fa4f806eb20 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fa4f0009f20 tx=0x7fa4f0009840 comp rx=0 tx=0).stop 2024-04-25T02:24:56.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.415+0000 7fa4fe46e700 1 -- 172.21.15.111:0/2315229616 shutdown_connections 2024-04-25T02:24:56.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.415+0000 7fa4fe46e700 1 --2- 172.21.15.111:0/2315229616 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa4f81403e0 0x7fa4f806eb20 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:56.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.415+0000 7fa4fe46e700 1 --2- 172.21.15.111:0/2315229616 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa4f8068210 0x7fa4f80a5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:56.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.415+0000 7fa4fe46e700 1 --2- 172.21.15.111:0/2315229616 >> v2:172.21.15.111:3300/0 conn(0x7fa4f813ffd0 0x7fa4f80a6e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:56.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.415+0000 7fa4fe46e700 1 -- 172.21.15.111:0/2315229616 >> 172.21.15.111:0/2315229616 conn(0x7fa4f806bfb0 msgr2=0x7fa4f8067940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:24:56.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.415+0000 7fa4fe46e700 1 -- 172.21.15.111:0/2315229616 shutdown_connections 2024-04-25T02:24:56.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.415+0000 7fa4fe46e700 1 -- 172.21.15.111:0/2315229616 wait complete. 2024-04-25T02:24:56.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.416+0000 7fa4fe46e700 1 Processor -- start 2024-04-25T02:24:56.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.416+0000 7fa4fe46e700 1 -- start start 2024-04-25T02:24:56.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.417+0000 7fa4fe46e700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4f8068210 0x7fa4f80af390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:56.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.417+0000 7fa4fe46e700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa4f813ffd0 0x7fa4f814e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:56.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.417+0000 7fa4fe46e700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa4f814ee30 0x7fa4f80ad890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:56.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.417+0000 7fa4fe46e700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f806a0e0 con 0x7fa4f8068210 2024-04-25T02:24:56.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.417+0000 7fa4fe46e700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f80ae940 con 0x7fa4f814ee30 2024-04-25T02:24:56.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.417+0000 7fa4fe46e700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa4f80ad180 con 0x7fa4f813ffd0 2024-04-25T02:24:56.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.417+0000 7fa4f77fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa4f813ffd0 0x7fa4f814e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:56.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.417+0000 7fa4f77fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa4f813ffd0 0x7fa4f814e8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:54020/0 (socket says 172.21.15.111:54020) 2024-04-25T02:24:56.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.417+0000 7fa4f77fe700 1 -- 172.21.15.111:0/1473919160 learned_addr learned my addr 172.21.15.111:0/1473919160 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:24:56.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.417+0000 7fa4f7fff700 1 --2- 172.21.15.111:0/1473919160 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4f8068210 0x7fa4f80af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:56.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.417+0000 7fa4fca0b700 1 --2- 172.21.15.111:0/1473919160 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa4f814ee30 0x7fa4f80ad890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:56.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.417+0000 7fa4f77fe700 1 -- 172.21.15.111:0/1473919160 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa4f814ee30 msgr2=0x7fa4f80ad890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:56.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.417+0000 7fa4f77fe700 1 --2- 172.21.15.111:0/1473919160 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa4f814ee30 0x7fa4f80ad890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:56.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.417+0000 7fa4f77fe700 1 -- 172.21.15.111:0/1473919160 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4f8068210 msgr2=0x7fa4f80af390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:56.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.417+0000 7fa4f77fe700 1 --2- 172.21.15.111:0/1473919160 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4f8068210 0x7fa4f80af390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:56.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.417+0000 7fa4f77fe700 1 -- 172.21.15.111:0/1473919160 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4ec009420 con 0x7fa4f813ffd0 2024-04-25T02:24:56.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.417+0000 7fa4fca0b700 1 --2- 172.21.15.111:0/1473919160 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa4f814ee30 0x7fa4f80ad890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:24:56.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.417+0000 7fa4f7fff700 1 --2- 172.21.15.111:0/1473919160 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4f8068210 0x7fa4f80af390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:24:56.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.417+0000 7fa4f77fe700 1 --2- 172.21.15.111:0/1473919160 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa4f813ffd0 0x7fa4f814e8f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa4e800ec50 tx=0x7fa4e80091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:24:56.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.418+0000 7fa4dffff700 1 -- 172.21.15.111:0/1473919160 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e800c850 con 0x7fa4f813ffd0 2024-04-25T02:24:56.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.418+0000 7fa4dffff700 1 -- 172.21.15.111:0/1473919160 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4e800c9b0 con 0x7fa4f813ffd0 2024-04-25T02:24:56.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.418+0000 7fa4dffff700 1 -- 172.21.15.111:0/1473919160 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4e800cd50 con 0x7fa4f813ffd0 2024-04-25T02:24:56.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.418+0000 7fa4fe46e700 1 -- 172.21.15.111:0/1473919160 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4e8009420 con 0x7fa4f813ffd0 2024-04-25T02:24:56.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.418+0000 7fa4fe46e700 1 -- 172.21.15.111:0/1473919160 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4f0009ae0 con 0x7fa4f813ffd0 2024-04-25T02:24:56.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.418+0000 7fa4fe46e700 1 -- 172.21.15.111:0/1473919160 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4f80b0850 con 0x7fa4f813ffd0 2024-04-25T02:24:56.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.419+0000 7fa4dffff700 1 -- 172.21.15.111:0/1473919160 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7fa4e8013680 con 0x7fa4f813ffd0 2024-04-25T02:24:56.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.419+0000 7fa4dffff700 1 -- 172.21.15.111:0/1473919160 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4115+0+0 (secure 0 0 0) 0x7fa4e805b340 con 0x7fa4f813ffd0 2024-04-25T02:24:56.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.422+0000 7fa4dffff700 1 -- 172.21.15.111:0/1473919160 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fa4e80395f0 con 0x7fa4f813ffd0 2024-04-25T02:24:56.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.575+0000 7fa4fe46e700 1 -- 172.21.15.111:0/1473919160 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa4f8065190 con 0x7fa4f813ffd0 2024-04-25T02:24:56.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.575+0000 7fa4dffff700 1 -- 172.21.15.111:0/1473919160 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v42) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa4e803cde0 con 0x7fa4f813ffd0 2024-04-25T02:24:56.579 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 32 2024-04-25T02:24:56.581 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.577+0000 7fa4fe46e700 1 -- 172.21.15.111:0/1473919160 >> v1:172.21.15.111:6816/46482 conn(0x7fa4e4045ef0 legacy=0x7fa4e40483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:56.581 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.577+0000 7fa4fe46e700 1 -- 172.21.15.111:0/1473919160 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa4f813ffd0 msgr2=0x7fa4f814e8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:56.581 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.577+0000 7fa4fe46e700 1 --2- 172.21.15.111:0/1473919160 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa4f813ffd0 0x7fa4f814e8f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fa4e800ec50 tx=0x7fa4e80091a0 comp rx=0 tx=0).stop 2024-04-25T02:24:56.581 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.577+0000 7fa4fe46e700 1 -- 172.21.15.111:0/1473919160 shutdown_connections 2024-04-25T02:24:56.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.577+0000 7fa4fe46e700 1 --2- 172.21.15.111:0/1473919160 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa4f814ee30 0x7fa4f80ad890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:56.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.577+0000 7fa4fe46e700 1 --2- 172.21.15.111:0/1473919160 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa4f8068210 0x7fa4f80af390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:56.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.577+0000 7fa4fe46e700 1 --2- 172.21.15.111:0/1473919160 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa4f813ffd0 0x7fa4f814e8f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:56.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.577+0000 7fa4fe46e700 1 -- 172.21.15.111:0/1473919160 >> 172.21.15.111:0/1473919160 conn(0x7fa4f806bfb0 msgr2=0x7fa4f80a4d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:24:56.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.577+0000 7fa4fe46e700 1 -- 172.21.15.111:0/1473919160 shutdown_connections 2024-04-25T02:24:56.582 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.577+0000 7fa4fe46e700 1 -- 172.21.15.111:0/1473919160 wait complete. 2024-04-25T02:24:56.593 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:24:56.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.707+0000 7faa7f0df700 1 Processor -- start 2024-04-25T02:24:56.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.707+0000 7faa7f0df700 1 -- start start 2024-04-25T02:24:56.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.708+0000 7faa7f0df700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7faa78063a40 0x7faa780abdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:56.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.708+0000 7faa7f0df700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7faa78132180 0x7faa7813f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:56.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.708+0000 7faa7f0df700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7faa781325d0 0x7faa7813fc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:56.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.708+0000 7faa7f0df700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa780ada70 con 0x7faa78063a40 2024-04-25T02:24:56.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.708+0000 7faa7f0df700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa780abac0 con 0x7faa781325d0 2024-04-25T02:24:56.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.708+0000 7faa7f0df700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa780ae600 con 0x7faa78132180 2024-04-25T02:24:56.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.708+0000 7faa77fff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7faa78132180 0x7faa7813f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:56.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.708+0000 7faa7ce7b700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7faa78063a40 0x7faa780abdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:56.714 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.708+0000 7faa7d67c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7faa781325d0 0x7faa7813fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:56.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.708+0000 7faa77fff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7faa78132180 0x7faa7813f6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:54034/0 (socket says 172.21.15.111:54034) 2024-04-25T02:24:56.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.708+0000 7faa77fff700 1 -- 172.21.15.111:0/677145234 learned_addr learned my addr 172.21.15.111:0/677145234 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:24:56.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.708+0000 7faa77fff700 1 -- 172.21.15.111:0/677145234 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7faa781325d0 msgr2=0x7faa7813fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:24:56.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.708+0000 7faa77fff700 1 --2- 172.21.15.111:0/677145234 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7faa781325d0 0x7faa7813fc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:56.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.708+0000 7faa77fff700 1 -- 172.21.15.111:0/677145234 >> v2:172.21.15.111:3300/0 conn(0x7faa78063a40 msgr2=0x7faa780abdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:24:56.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.708+0000 7faa77fff700 1 --2- 172.21.15.111:0/677145234 >> v2:172.21.15.111:3300/0 conn(0x7faa78063a40 0x7faa780abdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:56.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.708+0000 7faa77fff700 1 -- 172.21.15.111:0/677145234 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa780ac720 con 0x7faa78132180 2024-04-25T02:24:56.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.708+0000 7faa7ce7b700 1 --2- 172.21.15.111:0/677145234 >> v2:172.21.15.111:3300/0 conn(0x7faa78063a40 0x7faa780abdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:24:56.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.708+0000 7faa7d67c700 1 --2- 172.21.15.111:0/677145234 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7faa781325d0 0x7faa7813fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:24:56.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.708+0000 7faa77fff700 1 --2- 172.21.15.111:0/677145234 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7faa78132180 0x7faa7813f6e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7faa640099b0 tx=0x7faa64009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1b6bd2681a0b7d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:24:56.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.709+0000 7faa777fe700 1 -- 172.21.15.111:0/677145234 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6400b680 con 0x7faa78132180 2024-04-25T02:24:56.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.709+0000 7faa777fe700 1 -- 172.21.15.111:0/677145234 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa6400b7e0 con 0x7faa78132180 2024-04-25T02:24:56.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.709+0000 7faa777fe700 1 -- 172.21.15.111:0/677145234 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6400bb80 con 0x7faa78132180 2024-04-25T02:24:56.715 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.709+0000 7faa7f0df700 1 -- 172.21.15.111:0/677145234 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7faa78132180 msgr2=0x7faa7813f6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:56.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.709+0000 7faa7f0df700 1 --2- 172.21.15.111:0/677145234 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7faa78132180 0x7faa7813f6e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7faa640099b0 tx=0x7faa64009250 comp rx=0 tx=0).stop 2024-04-25T02:24:56.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.709+0000 7faa7f0df700 1 -- 172.21.15.111:0/677145234 shutdown_connections 2024-04-25T02:24:56.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.709+0000 7faa7f0df700 1 --2- 172.21.15.111:0/677145234 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7faa781325d0 0x7faa7813fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:56.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.709+0000 7faa7f0df700 1 --2- 172.21.15.111:0/677145234 >> v2:172.21.15.111:3300/0 conn(0x7faa78063a40 0x7faa780abdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:56.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.709+0000 7faa7f0df700 1 --2- 172.21.15.111:0/677145234 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7faa78132180 0x7faa7813f6e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:56.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.709+0000 7faa7f0df700 1 -- 172.21.15.111:0/677145234 >> 172.21.15.111:0/677145234 conn(0x7faa780b1e80 msgr2=0x7faa780adef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:24:56.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.709+0000 7faa7f0df700 1 -- 172.21.15.111:0/677145234 shutdown_connections 2024-04-25T02:24:56.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.709+0000 7faa7f0df700 1 -- 172.21.15.111:0/677145234 wait complete. 2024-04-25T02:24:56.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.710+0000 7faa7f0df700 1 Processor -- start 2024-04-25T02:24:56.716 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.710+0000 7faa7f0df700 1 -- start start 2024-04-25T02:24:56.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.711+0000 7faa7f0df700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7faa78063a40 0x7faa78133dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:56.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.711+0000 7faa7f0df700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7faa78132180 0x7faa7806d1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:56.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.711+0000 7faa7f0df700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faa781325d0 0x7faa7806d700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:56.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.711+0000 7faa7f0df700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa78134700 con 0x7faa781325d0 2024-04-25T02:24:56.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.711+0000 7faa7f0df700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa7813f1a0 con 0x7faa78063a40 2024-04-25T02:24:56.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.711+0000 7faa7f0df700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7faa78134c00 con 0x7faa78132180 2024-04-25T02:24:56.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.711+0000 7faa77fff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7faa78132180 0x7faa7806d1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:56.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.711+0000 7faa7ce7b700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7faa78063a40 0x7faa78133dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:56.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.711+0000 7faa7d67c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faa781325d0 0x7faa7806d700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:56.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.711+0000 7faa7ce7b700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7faa78063a40 0x7faa78133dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:37766/0 (socket says 172.21.15.111:37766) 2024-04-25T02:24:56.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.711+0000 7faa7ce7b700 1 -- 172.21.15.111:0/329312221 learned_addr learned my addr 172.21.15.111:0/329312221 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:24:56.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.711+0000 7faa7d67c700 1 --2- 172.21.15.111:0/329312221 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faa781325d0 0x7faa7806d700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52330/0 (socket says 172.21.15.111:52330) 2024-04-25T02:24:56.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.711+0000 7faa7d67c700 1 -- 172.21.15.111:0/329312221 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7faa78132180 msgr2=0x7faa7806d1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:56.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.711+0000 7faa7d67c700 1 --2- 172.21.15.111:0/329312221 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7faa78132180 0x7faa7806d1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:56.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.711+0000 7faa7d67c700 1 -- 172.21.15.111:0/329312221 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7faa78063a40 msgr2=0x7faa78133dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:56.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.711+0000 7faa7d67c700 1 --2- 172.21.15.111:0/329312221 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7faa78063a40 0x7faa78133dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:56.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.711+0000 7faa7d67c700 1 -- 172.21.15.111:0/329312221 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa6c009420 con 0x7faa781325d0 2024-04-25T02:24:56.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.711+0000 7faa7ce7b700 1 --2- 172.21.15.111:0/329312221 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7faa78063a40 0x7faa78133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:24:56.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.711+0000 7faa77fff700 1 --2- 172.21.15.111:0/329312221 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7faa78132180 0x7faa7806d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:24:56.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.711+0000 7faa7d67c700 1 --2- 172.21.15.111:0/329312221 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faa781325d0 0x7faa7806d700 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7faa70009e70 tx=0x7faa7000b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:24:56.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.711+0000 7faa74ff9700 1 -- 172.21.15.111:0/329312221 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa7000cb30 con 0x7faa781325d0 2024-04-25T02:24:56.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.711+0000 7faa74ff9700 1 -- 172.21.15.111:0/329312221 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa7000f040 con 0x7faa781325d0 2024-04-25T02:24:56.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.711+0000 7faa7f0df700 1 -- 172.21.15.111:0/329312221 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa70009a20 con 0x7faa781325d0 2024-04-25T02:24:56.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.712+0000 7faa74ff9700 1 -- 172.21.15.111:0/329312221 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa70014480 con 0x7faa781325d0 2024-04-25T02:24:56.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.712+0000 7faa7f0df700 1 -- 172.21.15.111:0/329312221 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa640094f0 con 0x7faa781325d0 2024-04-25T02:24:56.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.712+0000 7faa74ff9700 1 -- 172.21.15.111:0/329312221 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7faa70003020 con 0x7faa781325d0 2024-04-25T02:24:56.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.713+0000 7faa7f0df700 1 -- 172.21.15.111:0/329312221 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa78135980 con 0x7faa781325d0 2024-04-25T02:24:56.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.713+0000 7faa74ff9700 1 -- 172.21.15.111:0/329312221 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4115+0+0 (secure 0 0 0) 0x7faa7005b8b0 con 0x7faa781325d0 2024-04-25T02:24:56.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.716+0000 7faa74ff9700 1 -- 172.21.15.111:0/329312221 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7faa78135980 con 0x7faa781325d0 2024-04-25T02:24:56.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.872+0000 7faa7f0df700 1 -- 172.21.15.111:0/329312221 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7faa78135980 con 0x7faa781325d0 2024-04-25T02:24:56.876 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.872+0000 7faa74ff9700 1 -- 172.21.15.111:0/329312221 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v42) v1 ==== 100+0+11 (secure 0 0 0) 0x7faa78135980 con 0x7faa781325d0 2024-04-25T02:24:56.876 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 64 2024-04-25T02:24:56.878 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.874+0000 7faa7f0df700 1 -- 172.21.15.111:0/329312221 >> v1:172.21.15.111:6816/46482 conn(0x7faa5c045ef0 legacy=0x7faa5c0483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:56.878 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.874+0000 7faa7f0df700 1 -- 172.21.15.111:0/329312221 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faa781325d0 msgr2=0x7faa7806d700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:56.878 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.874+0000 7faa7f0df700 1 --2- 172.21.15.111:0/329312221 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faa781325d0 0x7faa7806d700 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7faa70009e70 tx=0x7faa7000b040 comp rx=0 tx=0).stop 2024-04-25T02:24:56.878 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.874+0000 7faa7f0df700 1 -- 172.21.15.111:0/329312221 shutdown_connections 2024-04-25T02:24:56.878 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.874+0000 7faa7f0df700 1 --2- 172.21.15.111:0/329312221 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7faa781325d0 0x7faa7806d700 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:56.878 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.874+0000 7faa7f0df700 1 --2- 172.21.15.111:0/329312221 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7faa78063a40 0x7faa78133dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:56.878 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.874+0000 7faa7f0df700 1 --2- 172.21.15.111:0/329312221 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7faa78132180 0x7faa7806d1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:56.878 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.874+0000 7faa7f0df700 1 -- 172.21.15.111:0/329312221 >> 172.21.15.111:0/329312221 conn(0x7faa780b1e80 msgr2=0x7faa780abcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:24:56.878 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.874+0000 7faa7f0df700 1 -- 172.21.15.111:0/329312221 shutdown_connections 2024-04-25T02:24:56.879 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:56.874+0000 7faa7f0df700 1 -- 172.21.15.111:0/329312221 wait complete. 2024-04-25T02:24:56.889 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T02:24:57.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.001+0000 7f4205110700 1 Processor -- start 2024-04-25T02:24:57.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.002+0000 7f4205110700 1 -- start start 2024-04-25T02:24:57.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.002+0000 7f4205110700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f42001396e0 0x7f4200063ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:57.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.002+0000 7f4205110700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f4200144990 0x7f4200146d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:57.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.002+0000 7f4205110700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42000a5730 con 0x7f42000a5c30 2024-04-25T02:24:57.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.002+0000 7f4205110700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4200139ab0 con 0x7f4200144990 2024-04-25T02:24:57.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.002+0000 7f4205110700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42000a6360 con 0x7f42001396e0 2024-04-25T02:24:57.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.002+0000 7f41fed9d700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f42001396e0 0x7f4200063ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:57.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.002+0000 7f41ff59e700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f4200144990 0x7f4200146d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:57.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.002+0000 7f41fe59c700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f42000a5c30 0x7f420013c000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:45374/0 (socket says 172.21.15.111:45374) 2024-04-25T02:24:57.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.002+0000 7f41fe59c700 1 -- 172.21.15.111:0/701522267 learned_addr learned my addr 172.21.15.111:0/701522267 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:24:57.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.002+0000 7f41fed9d700 1 -- 172.21.15.111:0/701522267 >> v2:172.21.15.111:3300/0 conn(0x7f4200144990 msgr2=0x7f4200146d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:24:57.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.002+0000 7f41fed9d700 1 --2- 172.21.15.111:0/701522267 >> v2:172.21.15.111:3300/0 conn(0x7f4200144990 0x7f4200146d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:57.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.003+0000 7f41fed9d700 1 -- 172.21.15.111:0/701522267 >> v1:172.21.15.111:6789/0 conn(0x7f42000a5c30 legacy=0x7f420013c000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:57.008 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.003+0000 7f41fdd9b700 1 -- 172.21.15.111:0/701522267 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1736732811 0 0) 0x7f42000a5730 con 0x7f42000a5c30 2024-04-25T02:24:57.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.003+0000 7f41fed9d700 1 -- 172.21.15.111:0/701522267 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f420013c810 con 0x7f42001396e0 2024-04-25T02:24:57.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.003+0000 7f41ff59e700 1 --2- 172.21.15.111:0/701522267 >> v2:172.21.15.111:3300/0 conn(0x7f4200144990 0x7f4200146d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:24:57.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.003+0000 7f41fed9d700 1 --2- 172.21.15.111:0/701522267 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f42001396e0 0x7f4200063ac0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f41f40098e0 tx=0x7f41f40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa950f963614582d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:24:57.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.003+0000 7f41fdd9b700 1 -- 172.21.15.111:0/701522267 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f400b640 con 0x7f42001396e0 2024-04-25T02:24:57.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.003+0000 7f41fdd9b700 1 -- 172.21.15.111:0/701522267 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f400b7a0 con 0x7f42001396e0 2024-04-25T02:24:57.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.003+0000 7f41fdd9b700 1 -- 172.21.15.111:0/701522267 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f400bb40 con 0x7f42001396e0 2024-04-25T02:24:57.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.003+0000 7f4205110700 1 -- 172.21.15.111:0/701522267 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f42001396e0 msgr2=0x7f4200063ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:57.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.003+0000 7f4205110700 1 --2- 172.21.15.111:0/701522267 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f42001396e0 0x7f4200063ac0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f41f40098e0 tx=0x7f41f40091a0 comp rx=0 tx=0).stop 2024-04-25T02:24:57.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.003+0000 7f4205110700 1 -- 172.21.15.111:0/701522267 shutdown_connections 2024-04-25T02:24:57.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.003+0000 7f4205110700 1 --2- 172.21.15.111:0/701522267 >> v2:172.21.15.111:3300/0 conn(0x7f4200144990 0x7f4200146d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:57.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.003+0000 7f4205110700 1 --2- 172.21.15.111:0/701522267 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f42001396e0 0x7f4200063ac0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:57.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.003+0000 7f4205110700 1 -- 172.21.15.111:0/701522267 >> 172.21.15.111:0/701522267 conn(0x7f42000b1e10 msgr2=0x7f42000ade80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:24:57.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.003+0000 7f4205110700 1 -- 172.21.15.111:0/701522267 shutdown_connections 2024-04-25T02:24:57.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.003+0000 7f4205110700 1 -- 172.21.15.111:0/701522267 wait complete. 2024-04-25T02:24:57.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.004+0000 7f4205110700 1 Processor -- start 2024-04-25T02:24:57.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.004+0000 7f4205110700 1 -- start start 2024-04-25T02:24:57.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.005+0000 7f4205110700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f42000a5c30 0x7f420014fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:57.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.005+0000 7f4205110700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f42001396e0 0x7f420014bf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:57.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.005+0000 7f4205110700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4200144990 0x7f420014c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:57.012 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.005+0000 7f4205110700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42001369d0 con 0x7f42001396e0 2024-04-25T02:24:57.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.005+0000 7f4205110700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4200137130 con 0x7f4200144990 2024-04-25T02:24:57.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.005+0000 7f4205110700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4200138810 con 0x7f42000a5c30 2024-04-25T02:24:57.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.005+0000 7f41fe59c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f42001396e0 0x7f420014bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:57.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.005+0000 7f41fed9d700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f42000a5c30 0x7f420014fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:57.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.005+0000 7f41fe59c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f42001396e0 0x7f420014bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52360/0 (socket says 172.21.15.111:52360) 2024-04-25T02:24:57.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.005+0000 7f41fe59c700 1 -- 172.21.15.111:0/58995465 learned_addr learned my addr 172.21.15.111:0/58995465 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:24:57.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.005+0000 7f41ff59e700 1 --2- 172.21.15.111:0/58995465 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4200144990 0x7f420014c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:57.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.005+0000 7f41fe59c700 1 -- 172.21.15.111:0/58995465 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f42000a5c30 msgr2=0x7f420014fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:57.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.005+0000 7f41fe59c700 1 --2- 172.21.15.111:0/58995465 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f42000a5c30 0x7f420014fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:57.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.005+0000 7f41fe59c700 1 -- 172.21.15.111:0/58995465 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4200144990 msgr2=0x7f420014c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:57.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.005+0000 7f41fe59c700 1 --2- 172.21.15.111:0/58995465 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4200144990 0x7f420014c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:57.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.005+0000 7f41fe59c700 1 -- 172.21.15.111:0/58995465 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f41f8009a20 con 0x7f42001396e0 2024-04-25T02:24:57.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.005+0000 7f41fed9d700 1 --2- 172.21.15.111:0/58995465 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f42000a5c30 0x7f420014fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:24:57.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.005+0000 7f41ff59e700 1 --2- 172.21.15.111:0/58995465 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4200144990 0x7f420014c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:24:57.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.006+0000 7f41fe59c700 1 --2- 172.21.15.111:0/58995465 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f42001396e0 0x7f420014bf40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f41f00019b0 tx=0x7f41f0007e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:24:57.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.006+0000 7f41e6ffd700 1 -- 172.21.15.111:0/58995465 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f0013070 con 0x7f42001396e0 2024-04-25T02:24:57.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.006+0000 7f41e6ffd700 1 -- 172.21.15.111:0/58995465 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f41f000e300 con 0x7f42001396e0 2024-04-25T02:24:57.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.006+0000 7f41e6ffd700 1 -- 172.21.15.111:0/58995465 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f41f0005ad0 con 0x7f42001396e0 2024-04-25T02:24:57.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.006+0000 7f4205110700 1 -- 172.21.15.111:0/58995465 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41f4009420 con 0x7f42001396e0 2024-04-25T02:24:57.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.006+0000 7f4205110700 1 -- 172.21.15.111:0/58995465 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42000b0900 con 0x7f42001396e0 2024-04-25T02:24:57.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.007+0000 7f4205110700 1 -- 172.21.15.111:0/58995465 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4200136b80 con 0x7f42001396e0 2024-04-25T02:24:57.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.007+0000 7f41e6ffd700 1 -- 172.21.15.111:0/58995465 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f41f0007070 con 0x7f42001396e0 2024-04-25T02:24:57.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.007+0000 7f41e6ffd700 1 -- 172.21.15.111:0/58995465 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4115+0+0 (secure 0 0 0) 0x7f41f005edd0 con 0x7f42001396e0 2024-04-25T02:24:57.015 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.011+0000 7f41e6ffd700 1 -- 172.21.15.111:0/58995465 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f4200136b80 con 0x7f42001396e0 2024-04-25T02:24:57.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.182+0000 7f4205110700 1 -- 172.21.15.111:0/58995465 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f4200136b10 con 0x7f42001396e0 2024-04-25T02:24:57.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.182+0000 7f41e6ffd700 1 -- 172.21.15.111:0/58995465 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 5 entries v42) v1 ==== 80+0+296 (secure 0 0 0) 0x7f41f0060070 con 0x7f42001396e0 2024-04-25T02:24:57.186 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:6819/4003866251 2024-04-26T02:23:16.839679+0000 2024-04-25T02:24:57.186 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/2148931273 2024-04-26T02:22:54.713254+0000 2024-04-25T02:24:57.186 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:6816/39585 2024-04-26T02:22:54.713254+0000 2024-04-25T02:24:57.186 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/3911588907 2024-04-26T02:22:54.713254+0000 2024-04-25T02:24:57.186 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/1276843622 2024-04-26T02:22:54.713254+0000 2024-04-25T02:24:57.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.184+0000 7f4205110700 1 -- 172.21.15.111:0/58995465 >> v1:172.21.15.111:6816/46482 conn(0x7f41ec045ef0 legacy=0x7f41ec0483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:57.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.184+0000 7f4205110700 1 -- 172.21.15.111:0/58995465 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f42001396e0 msgr2=0x7f420014bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:57.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.184+0000 7f4205110700 1 --2- 172.21.15.111:0/58995465 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f42001396e0 0x7f420014bf40 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f41f00019b0 tx=0x7f41f0007e00 comp rx=0 tx=0).stop 2024-04-25T02:24:57.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.184+0000 7f4205110700 1 -- 172.21.15.111:0/58995465 shutdown_connections 2024-04-25T02:24:57.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.184+0000 7f4205110700 1 --2- 172.21.15.111:0/58995465 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f4200144990 0x7f420014c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:57.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.184+0000 7f4205110700 1 --2- 172.21.15.111:0/58995465 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f42000a5c30 0x7f420014fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:57.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.184+0000 7f4205110700 1 --2- 172.21.15.111:0/58995465 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f42001396e0 0x7f420014bf40 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:57.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.184+0000 7f4205110700 1 -- 172.21.15.111:0/58995465 >> 172.21.15.111:0/58995465 conn(0x7f42000b1e10 msgr2=0x7f42000635e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:24:57.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.184+0000 7f4205110700 1 -- 172.21.15.111:0/58995465 shutdown_connections 2024-04-25T02:24:57.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.184+0000 7f4205110700 1 -- 172.21.15.111:0/58995465 wait complete. 2024-04-25T02:24:57.189 INFO:teuthology.orchestra.run.smithi111.stderr:listed 5 entries 2024-04-25T02:24:57.199 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-25T02:24:57.199 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:24:57.225 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:24:57.341 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.337+0000 7f8510675700 1 Processor -- start 2024-04-25T02:24:57.341 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.337+0000 7f8510675700 1 -- start start 2024-04-25T02:24:57.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.338+0000 7f8510675700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f85081418c0 0x7f8508146bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:57.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.338+0000 7f8510675700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f85080a3d10 0x7f8508149140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:57.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.338+0000 7f8510675700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85080a6ff0 con 0x7f85080b4f70 2024-04-25T02:24:57.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.338+0000 7f8510675700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85080a6be0 con 0x7f85080a3d10 2024-04-25T02:24:57.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.338+0000 7f8510675700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8508141d50 con 0x7f85081418c0 2024-04-25T02:24:57.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.338+0000 7f850dc10700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f85081418c0 0x7f8508146bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:57.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.338+0000 7f850ec12700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f85080a3d10 0x7f8508149140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:57.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.338+0000 7f850e411700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f85080b4f70 0x7f850813ea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:45390/0 (socket says 172.21.15.111:45390) 2024-04-25T02:24:57.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.338+0000 7f850e411700 1 -- 172.21.15.111:0/882100376 learned_addr learned my addr 172.21.15.111:0/882100376 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:24:57.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.338+0000 7f850d40f700 1 -- 172.21.15.111:0/882100376 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 105167368 0 0) 0x7f85080a6ff0 con 0x7f85080b4f70 2024-04-25T02:24:57.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.338+0000 7f850d40f700 1 -- 172.21.15.111:0/882100376 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f84f4003570 con 0x7f85080b4f70 2024-04-25T02:24:57.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.338+0000 7f850ec12700 1 -- 172.21.15.111:0/882100376 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f85081418c0 msgr2=0x7f8508146bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:24:57.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.338+0000 7f850ec12700 1 --2- 172.21.15.111:0/882100376 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f85081418c0 0x7f8508146bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:57.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.338+0000 7f850ec12700 1 -- 172.21.15.111:0/882100376 >> v1:172.21.15.111:6789/0 conn(0x7f85080b4f70 legacy=0x7f850813ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:57.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.338+0000 7f850ec12700 1 -- 172.21.15.111:0/882100376 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8508141ff0 con 0x7f85080a3d10 2024-04-25T02:24:57.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.338+0000 7f850dc10700 1 --2- 172.21.15.111:0/882100376 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f85081418c0 0x7f8508146bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:24:57.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.339+0000 7f850ec12700 1 --2- 172.21.15.111:0/882100376 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f85080a3d10 0x7f8508149140 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8500009e90 tx=0x7f8500009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab44ae322700ad52 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:24:57.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.339+0000 7f850d40f700 1 -- 172.21.15.111:0/882100376 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850000e070 con 0x7f85080a3d10 2024-04-25T02:24:57.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.339+0000 7f850d40f700 1 -- 172.21.15.111:0/882100376 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f850000bb80 con 0x7f85080a3d10 2024-04-25T02:24:57.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.339+0000 7f850d40f700 1 -- 172.21.15.111:0/882100376 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8500012430 con 0x7f85080a3d10 2024-04-25T02:24:57.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.339+0000 7f8510675700 1 -- 172.21.15.111:0/882100376 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f85080a3d10 msgr2=0x7f8508149140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:57.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.339+0000 7f8510675700 1 --2- 172.21.15.111:0/882100376 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f85080a3d10 0x7f8508149140 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f8500009e90 tx=0x7f8500009780 comp rx=0 tx=0).stop 2024-04-25T02:24:57.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.339+0000 7f8510675700 1 -- 172.21.15.111:0/882100376 shutdown_connections 2024-04-25T02:24:57.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.339+0000 7f8510675700 1 --2- 172.21.15.111:0/882100376 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f85080a3d10 0x7f8508149140 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:57.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.339+0000 7f8510675700 1 --2- 172.21.15.111:0/882100376 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f85081418c0 0x7f8508146bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:57.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.339+0000 7f8510675700 1 -- 172.21.15.111:0/882100376 >> 172.21.15.111:0/882100376 conn(0x7f850806f070 msgr2=0x7f850806f470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:24:57.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.339+0000 7f8510675700 1 -- 172.21.15.111:0/882100376 shutdown_connections 2024-04-25T02:24:57.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.339+0000 7f8510675700 1 -- 172.21.15.111:0/882100376 wait complete. 2024-04-25T02:24:57.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.340+0000 7f8510675700 1 Processor -- start 2024-04-25T02:24:57.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.340+0000 7f8510675700 1 -- start start 2024-04-25T02:24:57.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.341+0000 7f8510675700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f85080a3d10 0x7f85080ac1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:57.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.341+0000 7f8510675700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f85080b4f70 0x7f85081511f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:57.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.341+0000 7f8510675700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f85081418c0 0x7f8508151730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:57.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.341+0000 7f8510675700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85080acbc0 con 0x7f85080b4f70 2024-04-25T02:24:57.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.341+0000 7f8510675700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85080ada10 con 0x7f85081418c0 2024-04-25T02:24:57.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.341+0000 7f8510675700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f85080a98b0 con 0x7f85080a3d10 2024-04-25T02:24:57.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.341+0000 7f850e411700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f85080a3d10 0x7f85080ac1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:57.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.341+0000 7f850dc10700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f85080b4f70 0x7f85081511f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:57.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.341+0000 7f850dc10700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f85080b4f70 0x7f85081511f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52364/0 (socket says 172.21.15.111:52364) 2024-04-25T02:24:57.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.341+0000 7f850e411700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f85080a3d10 0x7f85080ac1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:54080/0 (socket says 172.21.15.111:54080) 2024-04-25T02:24:57.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.341+0000 7f850dc10700 1 -- 172.21.15.111:0/557887762 learned_addr learned my addr 172.21.15.111:0/557887762 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:24:57.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.341+0000 7f850ec12700 1 --2- 172.21.15.111:0/557887762 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f85081418c0 0x7f8508151730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:57.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.341+0000 7f850dc10700 1 -- 172.21.15.111:0/557887762 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f85080a3d10 msgr2=0x7f85080ac1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:57.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.341+0000 7f850dc10700 1 --2- 172.21.15.111:0/557887762 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f85080a3d10 0x7f85080ac1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:57.352 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.341+0000 7f850dc10700 1 -- 172.21.15.111:0/557887762 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f85081418c0 msgr2=0x7f8508151730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:57.352 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.341+0000 7f850dc10700 1 --2- 172.21.15.111:0/557887762 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f85081418c0 0x7f8508151730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:57.352 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.341+0000 7f850dc10700 1 -- 172.21.15.111:0/557887762 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8504009420 con 0x7f85080b4f70 2024-04-25T02:24:57.352 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.341+0000 7f850dc10700 1 --2- 172.21.15.111:0/557887762 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f85080b4f70 0x7f85081511f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f850400ec80 tx=0x7f85040091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:24:57.352 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.341+0000 7f84fe7fc700 1 -- 172.21.15.111:0/557887762 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850400c8e0 con 0x7f85080b4f70 2024-04-25T02:24:57.352 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.341+0000 7f84fe7fc700 1 -- 172.21.15.111:0/557887762 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f850400ca40 con 0x7f85080b4f70 2024-04-25T02:24:57.352 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.341+0000 7f84fe7fc700 1 -- 172.21.15.111:0/557887762 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850400cdc0 con 0x7f85080b4f70 2024-04-25T02:24:57.352 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.341+0000 7f8510675700 1 -- 172.21.15.111:0/557887762 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8500009a20 con 0x7f85080b4f70 2024-04-25T02:24:57.352 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.342+0000 7f8510675700 1 -- 172.21.15.111:0/557887762 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f85080ac730 con 0x7f85080b4f70 2024-04-25T02:24:57.352 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.342+0000 7f8510675700 1 -- 172.21.15.111:0/557887762 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8508071790 con 0x7f85080b4f70 2024-04-25T02:24:57.352 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.343+0000 7f84fe7fc700 1 -- 172.21.15.111:0/557887762 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f8504013680 con 0x7f85080b4f70 2024-04-25T02:24:57.352 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.343+0000 7f84fe7fc700 1 -- 172.21.15.111:0/557887762 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4115+0+0 (secure 0 0 0) 0x7f850405bac0 con 0x7f85080b4f70 2024-04-25T02:24:57.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.346+0000 7f84fe7fc700 1 -- 172.21.15.111:0/557887762 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f8504039d90 con 0x7f85080b4f70 2024-04-25T02:24:57.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.504+0000 7f8510675700 1 -- 172.21.15.111:0/557887762 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85081425d0 con 0x7f85080b4f70 2024-04-25T02:24:57.509 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.505+0000 7f84fe7fc700 1 -- 172.21.15.111:0/557887762 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v42) v1 ==== 74+0+12043 (secure 0 0 0) 0x7f850403d580 con 0x7f85080b4f70 2024-04-25T02:24:57.509 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:24:57.509 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":42,"fsid":"4643f974-f93a-4436-93b8-460ff320e62e","created":"2024-04-25T02:20:05.450475+0000","modified":"2024-04-25T02:23:55.943818+0000","last_up_change":"2024-04-25T02:23:12.818028+0000","last_in_change":"2024-04-25T02:20:10.439204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:20:07.471248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:20:14.420378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:20:22.251868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T02:20:23.128289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"df3f17ca-3b12-42c8-8cf7-8f1b7189e587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":41,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6800","nonce":48862}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6801","nonce":48862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6803","nonce":48862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6802","nonce":48862}]},"public_addr":"172.21.15.111:6800/48862","cluster_addr":"172.21.15.111:6801/48862","heartbeat_back_addr":"172.21.15.111:6803/48862","heartbeat_front_addr":"172.21.15.111:6802/48862","state":["exists","up"]},{"osd":1,"uuid":"93d54815-f215-4285-bba6-32f2d1cabf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":29,"up_thru":31,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6804","nonce":48960}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6805","nonce":48960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6807","nonce":48960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6806","nonce":48960}]},"public_addr":"172.21.15.111:6804/48960","cluster_addr":"172.21.15.111:6805/48960","heartbeat_back_addr":"172.21.15.111:6807/48960","heartbeat_front_addr":"172.21.15.111:6806/48960","state":["exists","up"]},{"osd":2,"uuid":"b26b2104-2a2e-408f-9ce7-3587a32a2ebe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":41,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6808","nonce":49070}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6809","nonce":49070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6811","nonce":49070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6810","nonce":49070}]},"public_addr":"172.21.15.111:6808/49070","cluster_addr":"172.21.15.111:6809/49070","heartbeat_back_addr":"172.21.15.111:6811/49070","heartbeat_front_addr":"172.21.15.111:6810/49070","state":["exists","up"]},{"osd":3,"uuid":"43c25820-1edc-4031-badf-72e87dd6bf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":31,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6812","nonce":49243}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6813","nonce":49243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6815","nonce":49243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6814","nonce":49243}]},"public_addr":"172.21.15.111:6812/49243","cluster_addr":"172.21.15.111:6813/49243","heartbeat_back_addr":"172.21.15.111:6815/49243","heartbeat_front_addr":"172.21.15.111:6814/49243","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.372427+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.411480+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.361508+0000","dead_epoch":25},{"osd":3,"down_stamp":"2024-04-25T02:23:06.771296+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.377212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.d","mappings":[{"from":3,"to":2}]},{"pgid":"4.13","mappings":[{"from":3,"to":0}]},{"pgid":"4.19","mappings":[{"from":3,"to":0}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.30","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.111:6819/4003866251":"2024-04-26T02:23:16.839679+0000","172.21.15.111:0/2148931273":"2024-04-26T02:22:54.713254+0000","172.21.15.111:6816/39585":"2024-04-26T02:22:54.713254+0000","172.21.15.111:0/3911588907":"2024-04-26T02:22:54.713254+0000","172.21.15.111:0/1276843622":"2024-04-26T02:22:54.713254+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:24:57.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.507+0000 7f8510675700 1 -- 172.21.15.111:0/557887762 >> v1:172.21.15.111:6816/46482 conn(0x7f84ec045ef0 legacy=0x7f84ec0483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:57.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.507+0000 7f8510675700 1 -- 172.21.15.111:0/557887762 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f85080b4f70 msgr2=0x7f85081511f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:57.512 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.507+0000 7f8510675700 1 --2- 172.21.15.111:0/557887762 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f85080b4f70 0x7f85081511f0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f850400ec80 tx=0x7f85040091a0 comp rx=0 tx=0).stop 2024-04-25T02:24:57.512 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.507+0000 7f8510675700 1 -- 172.21.15.111:0/557887762 shutdown_connections 2024-04-25T02:24:57.512 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.507+0000 7f8510675700 1 --2- 172.21.15.111:0/557887762 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f85081418c0 0x7f8508151730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:57.512 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.507+0000 7f8510675700 1 --2- 172.21.15.111:0/557887762 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f85080a3d10 0x7f85080ac1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:57.512 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.507+0000 7f8510675700 1 --2- 172.21.15.111:0/557887762 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f85080b4f70 0x7f85081511f0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:57.512 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.507+0000 7f8510675700 1 -- 172.21.15.111:0/557887762 >> 172.21.15.111:0/557887762 conn(0x7f850806f070 msgr2=0x7f850813e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:24:57.512 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.507+0000 7f8510675700 1 -- 172.21.15.111:0/557887762 shutdown_connections 2024-04-25T02:24:57.512 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.507+0000 7f8510675700 1 -- 172.21.15.111:0/557887762 wait complete. 2024-04-25T02:24:57.522 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:20:07.471248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T02:20:14.420378+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:20:22.251868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:20:23.128289+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T02:24:57.523 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:24:57.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.638+0000 7f7cdf8f2700 1 Processor -- start 2024-04-25T02:24:57.641 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.638+0000 7f7cdf8f2700 1 -- start start 2024-04-25T02:24:57.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.638+0000 7f7cdf8f2700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7cd80682a0 0x7f7cd813c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:57.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.638+0000 7f7cdf8f2700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f7cd80b0670 0x7f7cd813ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:57.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.638+0000 7f7cdf8f2700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7cd80a3f60 0x7f7cd813cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:57.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.638+0000 7f7cdf8f2700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cd80a56f0 con 0x7f7cd80b0670 2024-04-25T02:24:57.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.638+0000 7f7cdf8f2700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd80a3b30 con 0x7f7cd80a3f60 2024-04-25T02:24:57.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.638+0000 7f7cdf8f2700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd80a7290 con 0x7f7cd80682a0 2024-04-25T02:24:57.644 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.639+0000 7f7cdce8d700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f7cd80b0670 0x7f7cd813ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:57.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.639+0000 7f7cdde8f700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7cd80a3f60 0x7f7cd813cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:57.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.639+0000 7f7cdd68e700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7cd80682a0 0x7f7cd813c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:57.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.639+0000 7f7cdde8f700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7cd80a3f60 0x7f7cd813cfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:37802/0 (socket says 172.21.15.111:37802) 2024-04-25T02:24:57.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.639+0000 7f7cdd68e700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7cd80682a0 0x7f7cd813c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:54094/0 (socket says 172.21.15.111:54094) 2024-04-25T02:24:57.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.639+0000 7f7cdce8d700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f7cd80b0670 0x7f7cd813ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52368/0 (socket says 172.21.15.111:52368) 2024-04-25T02:24:57.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.639+0000 7f7cdde8f700 1 -- 172.21.15.111:0/2147591265 learned_addr learned my addr 172.21.15.111:0/2147591265 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:24:57.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.639+0000 7f7cdde8f700 1 -- 172.21.15.111:0/2147591265 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7cd80682a0 msgr2=0x7f7cd813c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:24:57.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.639+0000 7f7cdde8f700 1 --2- 172.21.15.111:0/2147591265 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7cd80682a0 0x7f7cd813c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:57.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.639+0000 7f7cdde8f700 1 -- 172.21.15.111:0/2147591265 >> v2:172.21.15.111:3300/0 conn(0x7f7cd80b0670 msgr2=0x7f7cd813ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:24:57.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.639+0000 7f7cdde8f700 1 --2- 172.21.15.111:0/2147591265 >> v2:172.21.15.111:3300/0 conn(0x7f7cd80b0670 0x7f7cd813ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:57.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.639+0000 7f7cdde8f700 1 -- 172.21.15.111:0/2147591265 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd806c700 con 0x7f7cd80a3f60 2024-04-25T02:24:57.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.639+0000 7f7cdd68e700 1 --2- 172.21.15.111:0/2147591265 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7cd80682a0 0x7f7cd813c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:24:57.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.639+0000 7f7cdce8d700 1 --2- 172.21.15.111:0/2147591265 >> v2:172.21.15.111:3300/0 conn(0x7f7cd80b0670 0x7f7cd813ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:24:57.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.639+0000 7f7cdde8f700 1 --2- 172.21.15.111:0/2147591265 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7cd80a3f60 0x7f7cd813cfb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7cd0009f20 tx=0x7f7cd0009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1cff0e4a660aa06e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:24:57.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.639+0000 7f7ccffff700 1 -- 172.21.15.111:0/2147591265 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd000e070 con 0x7f7cd80a3f60 2024-04-25T02:24:57.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.639+0000 7f7ccffff700 1 -- 172.21.15.111:0/2147591265 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cd000b970 con 0x7f7cd80a3f60 2024-04-25T02:24:57.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.639+0000 7f7ccffff700 1 -- 172.21.15.111:0/2147591265 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cd00092e0 con 0x7f7cd80a3f60 2024-04-25T02:24:57.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.640+0000 7f7cdf8f2700 1 -- 172.21.15.111:0/2147591265 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7cd80a3f60 msgr2=0x7f7cd813cfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:57.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.640+0000 7f7cdf8f2700 1 --2- 172.21.15.111:0/2147591265 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7cd80a3f60 0x7f7cd813cfb0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f7cd0009f20 tx=0x7f7cd0009840 comp rx=0 tx=0).stop 2024-04-25T02:24:57.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.640+0000 7f7cdf8f2700 1 -- 172.21.15.111:0/2147591265 shutdown_connections 2024-04-25T02:24:57.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.640+0000 7f7cdf8f2700 1 --2- 172.21.15.111:0/2147591265 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7cd80a3f60 0x7f7cd813cfb0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:57.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.640+0000 7f7cdf8f2700 1 --2- 172.21.15.111:0/2147591265 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7cd80682a0 0x7f7cd813c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:57.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.640+0000 7f7cdf8f2700 1 --2- 172.21.15.111:0/2147591265 >> v2:172.21.15.111:3300/0 conn(0x7f7cd80b0670 0x7f7cd813ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:57.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.640+0000 7f7cdf8f2700 1 -- 172.21.15.111:0/2147591265 >> 172.21.15.111:0/2147591265 conn(0x7f7cd806bee0 msgr2=0x7f7cd8067940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:24:57.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.640+0000 7f7cdf8f2700 1 -- 172.21.15.111:0/2147591265 shutdown_connections 2024-04-25T02:24:57.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.640+0000 7f7cdf8f2700 1 -- 172.21.15.111:0/2147591265 wait complete. 2024-04-25T02:24:57.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.641+0000 7f7cdf8f2700 1 Processor -- start 2024-04-25T02:24:57.647 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.641+0000 7f7cdf8f2700 1 -- start start 2024-04-25T02:24:57.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.641+0000 7f7cdf8f2700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7cd80682a0 0x7f7cd80addc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:57.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.641+0000 7f7cdf8f2700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7cd80a3f60 0x7f7cd813b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:57.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.641+0000 7f7cdf8f2700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7cd80b0670 0x7f7cd813ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:57.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.641+0000 7f7cdf8f2700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd80ab100 con 0x7f7cd80b0670 2024-04-25T02:24:57.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.641+0000 7f7cdf8f2700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd80ab970 con 0x7f7cd80a3f60 2024-04-25T02:24:57.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.641+0000 7f7cdf8f2700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd80ad8c0 con 0x7f7cd80682a0 2024-04-25T02:24:57.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.641+0000 7f7cdce8d700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7cd80a3f60 0x7f7cd813b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:57.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.641+0000 7f7cdd68e700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7cd80682a0 0x7f7cd80addc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:57.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.641+0000 7f7cdde8f700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7cd80b0670 0x7f7cd813ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:57.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.641+0000 7f7cdce8d700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7cd80a3f60 0x7f7cd813b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:37816/0 (socket says 172.21.15.111:37816) 2024-04-25T02:24:57.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.641+0000 7f7cdce8d700 1 -- 172.21.15.111:0/381201476 learned_addr learned my addr 172.21.15.111:0/381201476 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:24:57.649 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.641+0000 7f7cdd68e700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7cd80682a0 0x7f7cd80addc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:54108/0 (socket says 172.21.15.111:54108) 2024-04-25T02:24:57.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.642+0000 7f7cdce8d700 1 -- 172.21.15.111:0/381201476 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7cd80682a0 msgr2=0x7f7cd80addc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:57.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.642+0000 7f7cdce8d700 1 --2- 172.21.15.111:0/381201476 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7cd80682a0 0x7f7cd80addc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:57.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.642+0000 7f7cdce8d700 1 -- 172.21.15.111:0/381201476 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7cd80b0670 msgr2=0x7f7cd813ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:57.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.642+0000 7f7cdce8d700 1 --2- 172.21.15.111:0/381201476 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7cd80b0670 0x7f7cd813ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:57.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.642+0000 7f7cdce8d700 1 -- 172.21.15.111:0/381201476 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cd4009420 con 0x7f7cd80a3f60 2024-04-25T02:24:57.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.642+0000 7f7cdde8f700 1 --2- 172.21.15.111:0/381201476 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7cd80b0670 0x7f7cd813ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:24:57.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.642+0000 7f7cdce8d700 1 --2- 172.21.15.111:0/381201476 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7cd80a3f60 0x7f7cd813b520 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7cc800ea50 tx=0x7f7cc80091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:24:57.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.642+0000 7f7ccd7fa700 1 -- 172.21.15.111:0/381201476 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc800ee90 con 0x7f7cd80a3f60 2024-04-25T02:24:57.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.642+0000 7f7ccd7fa700 1 -- 172.21.15.111:0/381201476 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc800c850 con 0x7f7cd80a3f60 2024-04-25T02:24:57.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.642+0000 7f7cdf8f2700 1 -- 172.21.15.111:0/381201476 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cc8009420 con 0x7f7cd80a3f60 2024-04-25T02:24:57.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.642+0000 7f7ccd7fa700 1 -- 172.21.15.111:0/381201476 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc800cc10 con 0x7f7cd80a3f60 2024-04-25T02:24:57.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.642+0000 7f7cdf8f2700 1 -- 172.21.15.111:0/381201476 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cd0009ae0 con 0x7f7cd80a3f60 2024-04-25T02:24:57.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.643+0000 7f7cdf8f2700 1 -- 172.21.15.111:0/381201476 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cd80af8e0 con 0x7f7cd80a3f60 2024-04-25T02:24:57.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.643+0000 7f7ccd7fa700 1 -- 172.21.15.111:0/381201476 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f7cc8013470 con 0x7f7cd80a3f60 2024-04-25T02:24:57.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.643+0000 7f7ccd7fa700 1 -- 172.21.15.111:0/381201476 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4115+0+0 (secure 0 0 0) 0x7f7cc805b2c0 con 0x7f7cd80a3f60 2024-04-25T02:24:57.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.647+0000 7f7ccd7fa700 1 -- 172.21.15.111:0/381201476 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f7cc8039510 con 0x7f7cd80a3f60 2024-04-25T02:24:57.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.800+0000 7f7cdf8f2700 1 -- 172.21.15.111:0/381201476 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7cd8065190 con 0x7f7cd80a3f60 2024-04-25T02:24:57.804 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.800+0000 7f7ccd7fa700 1 -- 172.21.15.111:0/381201476 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v42) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7cc803cd00 con 0x7f7cd80a3f60 2024-04-25T02:24:57.804 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 1 2024-04-25T02:24:57.806 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.802+0000 7f7cdf8f2700 1 -- 172.21.15.111:0/381201476 >> v1:172.21.15.111:6816/46482 conn(0x7f7cbc045ef0 legacy=0x7f7cbc0483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:57.806 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.802+0000 7f7cdf8f2700 1 -- 172.21.15.111:0/381201476 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7cd80a3f60 msgr2=0x7f7cd813b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:57.806 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.802+0000 7f7cdf8f2700 1 --2- 172.21.15.111:0/381201476 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7cd80a3f60 0x7f7cd813b520 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f7cc800ea50 tx=0x7f7cc80091a0 comp rx=0 tx=0).stop 2024-04-25T02:24:57.806 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.802+0000 7f7cdf8f2700 1 -- 172.21.15.111:0/381201476 shutdown_connections 2024-04-25T02:24:57.806 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.802+0000 7f7cdf8f2700 1 --2- 172.21.15.111:0/381201476 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7cd80b0670 0x7f7cd813ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:57.806 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.802+0000 7f7cdf8f2700 1 --2- 172.21.15.111:0/381201476 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7cd80682a0 0x7f7cd80addc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:57.806 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.802+0000 7f7cdf8f2700 1 --2- 172.21.15.111:0/381201476 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7cd80a3f60 0x7f7cd813b520 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:57.806 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.802+0000 7f7cdf8f2700 1 -- 172.21.15.111:0/381201476 >> 172.21.15.111:0/381201476 conn(0x7f7cd806bee0 msgr2=0x7f7cd813fe40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:24:57.806 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.802+0000 7f7cdf8f2700 1 -- 172.21.15.111:0/381201476 shutdown_connections 2024-04-25T02:24:57.807 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.802+0000 7f7cdf8f2700 1 -- 172.21.15.111:0/381201476 wait complete. 2024-04-25T02:24:57.817 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T02:24:57.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.933+0000 7fe23fef5700 1 Processor -- start 2024-04-25T02:24:57.937 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.933+0000 7fe23fef5700 1 -- start start 2024-04-25T02:24:57.939 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.934+0000 7fe23fef5700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe2380b2650 0x7fe23813b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:57.939 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.934+0000 7fe23fef5700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe2380a4bb0 0x7fe23813be20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:57.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.934+0000 7fe23fef5700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fe2380a22a0 0x7fe23806da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:57.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.934+0000 7fe23fef5700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2380a3ef0 con 0x7fe2380a22a0 2024-04-25T02:24:57.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.934+0000 7fe23fef5700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2380a2b10 con 0x7fe2380a4bb0 2024-04-25T02:24:57.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.934+0000 7fe23fef5700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2380a2850 con 0x7fe2380b2650 2024-04-25T02:24:57.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.934+0000 7fe23e492700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fe2380a22a0 0x7fe23806da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:57.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.934+0000 7fe23dc91700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe2380b2650 0x7fe23813b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:57.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.934+0000 7fe23d490700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe2380a4bb0 0x7fe23813be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:57.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.934+0000 7fe23d490700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe2380a4bb0 0x7fe23813be20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:37822/0 (socket says 172.21.15.111:37822) 2024-04-25T02:24:57.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.934+0000 7fe23e492700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fe2380a22a0 0x7fe23806da40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52380/0 (socket says 172.21.15.111:52380) 2024-04-25T02:24:57.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.934+0000 7fe23dc91700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe2380b2650 0x7fe23813b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:54124/0 (socket says 172.21.15.111:54124) 2024-04-25T02:24:57.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.934+0000 7fe23d490700 1 -- 172.21.15.111:0/3919817310 learned_addr learned my addr 172.21.15.111:0/3919817310 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:24:57.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.934+0000 7fe23d490700 1 -- 172.21.15.111:0/3919817310 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe2380b2650 msgr2=0x7fe23813b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:24:57.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.934+0000 7fe23d490700 1 --2- 172.21.15.111:0/3919817310 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe2380b2650 0x7fe23813b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:57.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.934+0000 7fe23d490700 1 -- 172.21.15.111:0/3919817310 >> v2:172.21.15.111:3300/0 conn(0x7fe2380a22a0 msgr2=0x7fe23806da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:24:57.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.934+0000 7fe23d490700 1 --2- 172.21.15.111:0/3919817310 >> v2:172.21.15.111:3300/0 conn(0x7fe2380a22a0 0x7fe23806da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:57.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.934+0000 7fe23d490700 1 -- 172.21.15.111:0/3919817310 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2380a3810 con 0x7fe2380a4bb0 2024-04-25T02:24:57.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.934+0000 7fe23e492700 1 --2- 172.21.15.111:0/3919817310 >> v2:172.21.15.111:3300/0 conn(0x7fe2380a22a0 0x7fe23806da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:24:57.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.934+0000 7fe23d490700 1 --2- 172.21.15.111:0/3919817310 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe2380a4bb0 0x7fe23813be20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe23400bc50 tx=0x7fe23400b4f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3dc7b88c8f2c426e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:24:57.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.935+0000 7fe23cc8f700 1 -- 172.21.15.111:0/3919817310 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe23400db40 con 0x7fe2380a4bb0 2024-04-25T02:24:57.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.935+0000 7fe23cc8f700 1 -- 172.21.15.111:0/3919817310 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe23400dca0 con 0x7fe2380a4bb0 2024-04-25T02:24:57.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.935+0000 7fe23cc8f700 1 -- 172.21.15.111:0/3919817310 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2340196b0 con 0x7fe2380a4bb0 2024-04-25T02:24:57.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.935+0000 7fe23fef5700 1 -- 172.21.15.111:0/3919817310 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe2380a4bb0 msgr2=0x7fe23813be20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:57.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.935+0000 7fe23fef5700 1 --2- 172.21.15.111:0/3919817310 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe2380a4bb0 0x7fe23813be20 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fe23400bc50 tx=0x7fe23400b4f0 comp rx=0 tx=0).stop 2024-04-25T02:24:57.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.935+0000 7fe23fef5700 1 -- 172.21.15.111:0/3919817310 shutdown_connections 2024-04-25T02:24:57.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.935+0000 7fe23fef5700 1 --2- 172.21.15.111:0/3919817310 >> v2:172.21.15.111:3300/0 conn(0x7fe2380a22a0 0x7fe23806da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:57.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.935+0000 7fe23fef5700 1 --2- 172.21.15.111:0/3919817310 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe2380b2650 0x7fe23813b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:57.941 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.935+0000 7fe23fef5700 1 --2- 172.21.15.111:0/3919817310 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe2380a4bb0 0x7fe23813be20 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:57.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.935+0000 7fe23fef5700 1 -- 172.21.15.111:0/3919817310 >> 172.21.15.111:0/3919817310 conn(0x7fe23806ada0 msgr2=0x7fe2380b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:24:57.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.935+0000 7fe23fef5700 1 -- 172.21.15.111:0/3919817310 shutdown_connections 2024-04-25T02:24:57.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.935+0000 7fe23fef5700 1 -- 172.21.15.111:0/3919817310 wait complete. 2024-04-25T02:24:57.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.936+0000 7fe23fef5700 1 Processor -- start 2024-04-25T02:24:57.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.936+0000 7fe23fef5700 1 -- start start 2024-04-25T02:24:57.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.937+0000 7fe23fef5700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe2380a22a0 0x7fe2380ab560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:57.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.937+0000 7fe23fef5700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe2380a4bb0 0x7fe23814d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:57.944 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.937+0000 7fe23fef5700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe2380b2650 0x7fe23814db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:57.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.937+0000 7fe23fef5700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2380abf50 con 0x7fe2380a4bb0 2024-04-25T02:24:57.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.937+0000 7fe23fef5700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2380abaa0 con 0x7fe2380b2650 2024-04-25T02:24:57.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.937+0000 7fe23fef5700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe2380ab1c0 con 0x7fe2380a22a0 2024-04-25T02:24:57.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.937+0000 7fe23d490700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe2380a4bb0 0x7fe23814d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:57.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.937+0000 7fe23e492700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe2380b2650 0x7fe23814db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:57.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.937+0000 7fe23d490700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe2380a4bb0 0x7fe23814d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52394/0 (socket says 172.21.15.111:52394) 2024-04-25T02:24:57.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.937+0000 7fe23d490700 1 -- 172.21.15.111:0/2579992168 learned_addr learned my addr 172.21.15.111:0/2579992168 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:24:57.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.937+0000 7fe23e492700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe2380b2650 0x7fe23814db50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:37824/0 (socket says 172.21.15.111:37824) 2024-04-25T02:24:57.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.937+0000 7fe23dc91700 1 --2- 172.21.15.111:0/2579992168 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe2380a22a0 0x7fe2380ab560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:57.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.937+0000 7fe23d490700 1 -- 172.21.15.111:0/2579992168 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe2380a22a0 msgr2=0x7fe2380ab560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:57.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.937+0000 7fe23d490700 1 --2- 172.21.15.111:0/2579992168 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe2380a22a0 0x7fe2380ab560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:57.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.937+0000 7fe23d490700 1 -- 172.21.15.111:0/2579992168 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe2380b2650 msgr2=0x7fe23814db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:57.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.937+0000 7fe23d490700 1 --2- 172.21.15.111:0/2579992168 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe2380b2650 0x7fe23814db50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:57.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.937+0000 7fe23d490700 1 -- 172.21.15.111:0/2579992168 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe230009a20 con 0x7fe2380a4bb0 2024-04-25T02:24:57.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.937+0000 7fe23e492700 1 --2- 172.21.15.111:0/2579992168 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe2380b2650 0x7fe23814db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:24:57.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.937+0000 7fe23d490700 1 --2- 172.21.15.111:0/2579992168 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe2380a4bb0 0x7fe23814d610 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe234015000 tx=0x7fe23401b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:24:57.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.937+0000 7fe22dffb700 1 -- 172.21.15.111:0/2579992168 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe234010470 con 0x7fe2380a4bb0 2024-04-25T02:24:57.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.937+0000 7fe22dffb700 1 -- 172.21.15.111:0/2579992168 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2340105f0 con 0x7fe2380a4bb0 2024-04-25T02:24:57.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.937+0000 7fe23fef5700 1 -- 172.21.15.111:0/2579992168 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe23400b790 con 0x7fe2380a4bb0 2024-04-25T02:24:57.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.937+0000 7fe22dffb700 1 -- 172.21.15.111:0/2579992168 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2340109b0 con 0x7fe2380a4bb0 2024-04-25T02:24:57.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.938+0000 7fe23fef5700 1 -- 172.21.15.111:0/2579992168 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2380aea60 con 0x7fe2380a4bb0 2024-04-25T02:24:57.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.938+0000 7fe22dffb700 1 -- 172.21.15.111:0/2579992168 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7fe234022030 con 0x7fe2380a4bb0 2024-04-25T02:24:57.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.939+0000 7fe23fef5700 1 -- 172.21.15.111:0/2579992168 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe238065190 con 0x7fe2380a4bb0 2024-04-25T02:24:57.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.939+0000 7fe22dffb700 1 -- 172.21.15.111:0/2579992168 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4115+0+0 (secure 0 0 0) 0x7fe234014070 con 0x7fe2380a4bb0 2024-04-25T02:24:57.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:57.942+0000 7fe22dffb700 1 -- 172.21.15.111:0/2579992168 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fe23400c4b0 con 0x7fe2380a4bb0 2024-04-25T02:24:58.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.097+0000 7fe23fef5700 1 -- 172.21.15.111:0/2579992168 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fe23813d330 con 0x7fe2380a4bb0 2024-04-25T02:24:58.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.098+0000 7fe22dffb700 1 -- 172.21.15.111:0/2579992168 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v42) v1 ==== 92+0+10 (secure 0 0 0) 0x7fe23400c2e0 con 0x7fe2380a4bb0 2024-04-25T02:24:58.102 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 8 2024-04-25T02:24:58.103 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.099+0000 7fe23fef5700 1 -- 172.21.15.111:0/2579992168 >> v1:172.21.15.111:6816/46482 conn(0x7fe21c045ef0 legacy=0x7fe21c0483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:58.103 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.099+0000 7fe23fef5700 1 -- 172.21.15.111:0/2579992168 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe2380a4bb0 msgr2=0x7fe23814d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:58.103 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.099+0000 7fe23fef5700 1 --2- 172.21.15.111:0/2579992168 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe2380a4bb0 0x7fe23814d610 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fe234015000 tx=0x7fe23401b000 comp rx=0 tx=0).stop 2024-04-25T02:24:58.103 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.099+0000 7fe23fef5700 1 -- 172.21.15.111:0/2579992168 shutdown_connections 2024-04-25T02:24:58.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.099+0000 7fe23fef5700 1 --2- 172.21.15.111:0/2579992168 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe2380b2650 0x7fe23814db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:58.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.099+0000 7fe23fef5700 1 --2- 172.21.15.111:0/2579992168 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe2380a22a0 0x7fe2380ab560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:58.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.099+0000 7fe23fef5700 1 --2- 172.21.15.111:0/2579992168 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe2380a4bb0 0x7fe23814d610 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:58.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.099+0000 7fe23fef5700 1 -- 172.21.15.111:0/2579992168 >> 172.21.15.111:0/2579992168 conn(0x7fe23806ada0 msgr2=0x7fe2380b19f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:24:58.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.099+0000 7fe23fef5700 1 -- 172.21.15.111:0/2579992168 shutdown_connections 2024-04-25T02:24:58.104 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.099+0000 7fe23fef5700 1 -- 172.21.15.111:0/2579992168 wait complete. 2024-04-25T02:24:58.115 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:24:58.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.229+0000 7fd39e6f4700 1 Processor -- start 2024-04-25T02:24:58.233 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.229+0000 7fd39e6f4700 1 -- start start 2024-04-25T02:24:58.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.230+0000 7fd39e6f4700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd398068050 0x7fd3980a51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:58.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.230+0000 7fd39e6f4700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fd39806eb20 0x7fd39806ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:58.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.230+0000 7fd39e6f4700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd39806f4d0 0x7fd3981485c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:58.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.230+0000 7fd39e6f4700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd3980b0950 con 0x7fd39806eb20 2024-04-25T02:24:58.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.230+0000 7fd39e6f4700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3980a33c0 con 0x7fd398068050 2024-04-25T02:24:58.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.230+0000 7fd39e6f4700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3980a5720 con 0x7fd39806f4d0 2024-04-25T02:24:58.238 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.230+0000 7fd3977fe700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fd39806eb20 0x7fd39806ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:58.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.230+0000 7fd39cc91700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd39806f4d0 0x7fd3981485c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:58.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.230+0000 7fd397fff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd398068050 0x7fd3980a51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:58.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.230+0000 7fd39cc91700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd39806f4d0 0x7fd3981485c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:54148/0 (socket says 172.21.15.111:54148) 2024-04-25T02:24:58.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.230+0000 7fd3977fe700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fd39806eb20 0x7fd39806ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52406/0 (socket says 172.21.15.111:52406) 2024-04-25T02:24:58.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.230+0000 7fd39cc91700 1 -- 172.21.15.111:0/2158954112 learned_addr learned my addr 172.21.15.111:0/2158954112 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:24:58.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.230+0000 7fd397fff700 1 -- 172.21.15.111:0/2158954112 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd39806f4d0 msgr2=0x7fd3981485c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:24:58.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.230+0000 7fd397fff700 1 --2- 172.21.15.111:0/2158954112 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd39806f4d0 0x7fd3981485c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:58.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.230+0000 7fd397fff700 1 -- 172.21.15.111:0/2158954112 >> v2:172.21.15.111:3300/0 conn(0x7fd39806eb20 msgr2=0x7fd39806ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:24:58.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.230+0000 7fd397fff700 1 --2- 172.21.15.111:0/2158954112 >> v2:172.21.15.111:3300/0 conn(0x7fd39806eb20 0x7fd39806ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:58.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.230+0000 7fd397fff700 1 -- 172.21.15.111:0/2158954112 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3980a3530 con 0x7fd398068050 2024-04-25T02:24:58.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.230+0000 7fd39cc91700 1 --2- 172.21.15.111:0/2158954112 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd39806f4d0 0x7fd3981485c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:24:58.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.230+0000 7fd3977fe700 1 --2- 172.21.15.111:0/2158954112 >> v2:172.21.15.111:3300/0 conn(0x7fd39806eb20 0x7fd39806ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:24:58.239 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.231+0000 7fd397fff700 1 --2- 172.21.15.111:0/2158954112 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd398068050 0x7fd3980a51e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd38c0098e0 tx=0x7fd38c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=838dfed7307601a2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:24:58.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.231+0000 7fd396ffd700 1 -- 172.21.15.111:0/2158954112 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38c011630 con 0x7fd398068050 2024-04-25T02:24:58.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.231+0000 7fd396ffd700 1 -- 172.21.15.111:0/2158954112 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38c011790 con 0x7fd398068050 2024-04-25T02:24:58.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.231+0000 7fd396ffd700 1 -- 172.21.15.111:0/2158954112 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38c011b30 con 0x7fd398068050 2024-04-25T02:24:58.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.231+0000 7fd39e6f4700 1 -- 172.21.15.111:0/2158954112 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd398068050 msgr2=0x7fd3980a51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:58.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.231+0000 7fd39e6f4700 1 --2- 172.21.15.111:0/2158954112 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd398068050 0x7fd3980a51e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fd38c0098e0 tx=0x7fd38c0091a0 comp rx=0 tx=0).stop 2024-04-25T02:24:58.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.231+0000 7fd39e6f4700 1 -- 172.21.15.111:0/2158954112 shutdown_connections 2024-04-25T02:24:58.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.231+0000 7fd39e6f4700 1 --2- 172.21.15.111:0/2158954112 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd39806f4d0 0x7fd3981485c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:58.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.231+0000 7fd39e6f4700 1 --2- 172.21.15.111:0/2158954112 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd398068050 0x7fd3980a51e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:58.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.231+0000 7fd39e6f4700 1 --2- 172.21.15.111:0/2158954112 >> v2:172.21.15.111:3300/0 conn(0x7fd39806eb20 0x7fd39806ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:58.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.231+0000 7fd39e6f4700 1 -- 172.21.15.111:0/2158954112 >> 172.21.15.111:0/2158954112 conn(0x7fd39806bfb0 msgr2=0x7fd398067940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:24:58.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.231+0000 7fd39e6f4700 1 -- 172.21.15.111:0/2158954112 shutdown_connections 2024-04-25T02:24:58.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.231+0000 7fd39e6f4700 1 -- 172.21.15.111:0/2158954112 wait complete. 2024-04-25T02:24:58.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.232+0000 7fd39e6f4700 1 Processor -- start 2024-04-25T02:24:58.240 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.232+0000 7fd39e6f4700 1 -- start start 2024-04-25T02:24:58.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.233+0000 7fd39e6f4700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd398068050 0x7fd3980ae070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:58.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.233+0000 7fd39e6f4700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd39806eb20 0x7fd398151840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:58.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.233+0000 7fd39e6f4700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd39806f4d0 0x7fd398151d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:58.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.233+0000 7fd39e6f4700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3980ad3a0 con 0x7fd39806eb20 2024-04-25T02:24:58.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.233+0000 7fd39e6f4700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3980ab8e0 con 0x7fd398068050 2024-04-25T02:24:58.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.233+0000 7fd39e6f4700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd3980af9a0 con 0x7fd39806f4d0 2024-04-25T02:24:58.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.233+0000 7fd3977fe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd39806eb20 0x7fd398151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:58.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.233+0000 7fd397fff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd398068050 0x7fd3980ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:58.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.233+0000 7fd39cc91700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd39806f4d0 0x7fd398151d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:58.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.233+0000 7fd3977fe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd39806eb20 0x7fd398151840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52414/0 (socket says 172.21.15.111:52414) 2024-04-25T02:24:58.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.233+0000 7fd397fff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd398068050 0x7fd3980ae070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:37834/0 (socket says 172.21.15.111:37834) 2024-04-25T02:24:58.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.233+0000 7fd3977fe700 1 -- 172.21.15.111:0/3916102523 learned_addr learned my addr 172.21.15.111:0/3916102523 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:24:58.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.233+0000 7fd397fff700 1 -- 172.21.15.111:0/3916102523 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd39806f4d0 msgr2=0x7fd398151d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:58.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.233+0000 7fd397fff700 1 --2- 172.21.15.111:0/3916102523 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd39806f4d0 0x7fd398151d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:58.241 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.233+0000 7fd397fff700 1 -- 172.21.15.111:0/3916102523 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd39806eb20 msgr2=0x7fd398151840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:58.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.233+0000 7fd397fff700 1 --2- 172.21.15.111:0/3916102523 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd39806eb20 0x7fd398151840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:58.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.233+0000 7fd397fff700 1 -- 172.21.15.111:0/3916102523 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd388009420 con 0x7fd398068050 2024-04-25T02:24:58.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.233+0000 7fd39cc91700 1 --2- 172.21.15.111:0/3916102523 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd39806f4d0 0x7fd398151d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:24:58.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.233+0000 7fd397fff700 1 --2- 172.21.15.111:0/3916102523 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd398068050 0x7fd3980ae070 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd38c016000 tx=0x7fd38c017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:24:58.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.234+0000 7fd37ffff700 1 -- 172.21.15.111:0/3916102523 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38c000d10 con 0x7fd398068050 2024-04-25T02:24:58.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.234+0000 7fd37ffff700 1 -- 172.21.15.111:0/3916102523 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd38c011b10 con 0x7fd398068050 2024-04-25T02:24:58.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.234+0000 7fd39e6f4700 1 -- 172.21.15.111:0/3916102523 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd390009ae0 con 0x7fd398068050 2024-04-25T02:24:58.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.234+0000 7fd37ffff700 1 -- 172.21.15.111:0/3916102523 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd38c025660 con 0x7fd398068050 2024-04-25T02:24:58.242 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.234+0000 7fd39e6f4700 1 -- 172.21.15.111:0/3916102523 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd38c009420 con 0x7fd398068050 2024-04-25T02:24:58.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.235+0000 7fd37ffff700 1 -- 172.21.15.111:0/3916102523 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7fd38c0193b0 con 0x7fd398068050 2024-04-25T02:24:58.246 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.235+0000 7fd39e6f4700 1 -- 172.21.15.111:0/3916102523 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd398065190 con 0x7fd398068050 2024-04-25T02:24:58.247 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.235+0000 7fd37ffff700 1 -- 172.21.15.111:0/3916102523 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4115+0+0 (secure 0 0 0) 0x7fd38c05c7e0 con 0x7fd398068050 2024-04-25T02:24:58.247 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.238+0000 7fd37ffff700 1 -- 172.21.15.111:0/3916102523 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fd38c026cd0 con 0x7fd398068050 2024-04-25T02:24:58.393 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.390+0000 7fd39e6f4700 1 -- 172.21.15.111:0/3916102523 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fd3980ab540 con 0x7fd398068050 2024-04-25T02:24:58.394 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.390+0000 7fd37ffff700 1 -- 172.21.15.111:0/3916102523 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v42) v1 ==== 104+0+11 (secure 0 0 0) 0x7fd38c026cd0 con 0x7fd398068050 2024-04-25T02:24:58.394 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 32 2024-04-25T02:24:58.395 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.391+0000 7fd39e6f4700 1 -- 172.21.15.111:0/3916102523 >> v1:172.21.15.111:6816/46482 conn(0x7fd384045ef0 legacy=0x7fd3840483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:58.395 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.391+0000 7fd39e6f4700 1 -- 172.21.15.111:0/3916102523 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd398068050 msgr2=0x7fd3980ae070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:58.395 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.391+0000 7fd39e6f4700 1 --2- 172.21.15.111:0/3916102523 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd398068050 0x7fd3980ae070 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd38c016000 tx=0x7fd38c017000 comp rx=0 tx=0).stop 2024-04-25T02:24:58.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.392+0000 7fd39e6f4700 1 -- 172.21.15.111:0/3916102523 shutdown_connections 2024-04-25T02:24:58.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.392+0000 7fd39e6f4700 1 --2- 172.21.15.111:0/3916102523 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd39806f4d0 0x7fd398151d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:58.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.392+0000 7fd39e6f4700 1 --2- 172.21.15.111:0/3916102523 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd398068050 0x7fd3980ae070 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:58.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.392+0000 7fd39e6f4700 1 --2- 172.21.15.111:0/3916102523 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd39806eb20 0x7fd398151840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:58.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.392+0000 7fd39e6f4700 1 -- 172.21.15.111:0/3916102523 >> 172.21.15.111:0/3916102523 conn(0x7fd39806bfb0 msgr2=0x7fd398143e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:24:58.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.392+0000 7fd39e6f4700 1 -- 172.21.15.111:0/3916102523 shutdown_connections 2024-04-25T02:24:58.396 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.392+0000 7fd39e6f4700 1 -- 172.21.15.111:0/3916102523 wait complete. 2024-04-25T02:24:58.407 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:24:58.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.521+0000 7f6ca1fc6700 1 Processor -- start 2024-04-25T02:24:58.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.521+0000 7f6ca1fc6700 1 -- start start 2024-04-25T02:24:58.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.521+0000 7f6ca1fc6700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6c9c068050 0x7f6c9c0a51e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:58.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.521+0000 7f6ca1fc6700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f6c9c06eb20 0x7f6c9c06ef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:58.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.521+0000 7f6ca1fc6700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c9c0a3530 con 0x7f6c9c06f4d0 2024-04-25T02:24:58.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.521+0000 7f6ca1fc6700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c9c0b0950 con 0x7f6c9c06eb20 2024-04-25T02:24:58.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.521+0000 7f6ca1fc6700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9c0a33c0 con 0x7f6c9c068050 2024-04-25T02:24:58.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.522+0000 7f6c9b7fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6c9c068050 0x7f6c9c0a51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:58.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.522+0000 7f6c9affd700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f6c9c06eb20 0x7f6c9c06ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:58.527 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.522+0000 7f6c9bfff700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f6c9c06f4d0 0x7f6c9c1485c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:45396/0 (socket says 172.21.15.111:45396) 2024-04-25T02:24:58.527 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.522+0000 7f6c9bfff700 1 -- 172.21.15.111:0/845520313 learned_addr learned my addr 172.21.15.111:0/845520313 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:24:58.527 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.522+0000 7f6c9b7fe700 1 -- 172.21.15.111:0/845520313 >> v2:172.21.15.111:3300/0 conn(0x7f6c9c06eb20 msgr2=0x7f6c9c06ef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:24:58.527 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.522+0000 7f6c9b7fe700 1 --2- 172.21.15.111:0/845520313 >> v2:172.21.15.111:3300/0 conn(0x7f6c9c06eb20 0x7f6c9c06ef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:58.527 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.522+0000 7f6c9b7fe700 1 -- 172.21.15.111:0/845520313 >> v1:172.21.15.111:6789/0 conn(0x7f6c9c06f4d0 legacy=0x7f6c9c1485c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:58.527 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.522+0000 7f6c9b7fe700 1 -- 172.21.15.111:0/845520313 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c9c0a3e80 con 0x7f6c9c068050 2024-04-25T02:24:58.527 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.522+0000 7f6c9b7fe700 1 --2- 172.21.15.111:0/845520313 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6c9c068050 0x7f6c9c0a51e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c0098e0 tx=0x7f6c8c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b74cbd40c109c100 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:24:58.527 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.522+0000 7f6c9a7fc700 1 -- 172.21.15.111:0/845520313 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c00b640 con 0x7f6c9c068050 2024-04-25T02:24:58.527 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.522+0000 7f6c9a7fc700 1 -- 172.21.15.111:0/845520313 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c8c00b7a0 con 0x7f6c9c068050 2024-04-25T02:24:58.527 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.522+0000 7f6c9a7fc700 1 -- 172.21.15.111:0/845520313 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c00bb40 con 0x7f6c9c068050 2024-04-25T02:24:58.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.523+0000 7f6ca1fc6700 1 -- 172.21.15.111:0/845520313 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6c9c068050 msgr2=0x7f6c9c0a51e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:58.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.523+0000 7f6ca1fc6700 1 --2- 172.21.15.111:0/845520313 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6c9c068050 0x7f6c9c0a51e0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c0098e0 tx=0x7f6c8c0091a0 comp rx=0 tx=0).stop 2024-04-25T02:24:58.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.523+0000 7f6ca1fc6700 1 -- 172.21.15.111:0/845520313 shutdown_connections 2024-04-25T02:24:58.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.523+0000 7f6ca1fc6700 1 --2- 172.21.15.111:0/845520313 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6c9c068050 0x7f6c9c0a51e0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:58.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.523+0000 7f6ca1fc6700 1 --2- 172.21.15.111:0/845520313 >> v2:172.21.15.111:3300/0 conn(0x7f6c9c06eb20 0x7f6c9c06ef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:58.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.523+0000 7f6ca1fc6700 1 -- 172.21.15.111:0/845520313 >> 172.21.15.111:0/845520313 conn(0x7f6c9c06bfb0 msgr2=0x7f6c9c067940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:24:58.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.523+0000 7f6ca1fc6700 1 -- 172.21.15.111:0/845520313 shutdown_connections 2024-04-25T02:24:58.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.523+0000 7f6ca1fc6700 1 -- 172.21.15.111:0/845520313 wait complete. 2024-04-25T02:24:58.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.524+0000 7f6ca1fc6700 1 Processor -- start 2024-04-25T02:24:58.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.524+0000 7f6ca1fc6700 1 -- start start 2024-04-25T02:24:58.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.524+0000 7f6ca1fc6700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6c9c068050 0x7f6c9c096ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:58.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.524+0000 7f6ca1fc6700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6c9c06eb20 0x7f6c9c0add30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:58.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.524+0000 7f6ca1fc6700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6c9c06f4d0 0x7f6c9c151790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:58.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.524+0000 7f6ca1fc6700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9c098040 con 0x7f6c9c068050 2024-04-25T02:24:58.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.524+0000 7f6ca1fc6700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9c0981d0 con 0x7f6c9c06f4d0 2024-04-25T02:24:58.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.524+0000 7f6ca1fc6700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6c9c0ae3f0 con 0x7f6c9c06eb20 2024-04-25T02:24:58.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.524+0000 7f6c9b7fe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6c9c068050 0x7f6c9c096ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:58.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.524+0000 7f6c9bfff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6c9c06f4d0 0x7f6c9c151790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:58.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.524+0000 7f6c9affd700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6c9c06eb20 0x7f6c9c0add30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:58.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.524+0000 7f6c9b7fe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6c9c068050 0x7f6c9c096ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52430/0 (socket says 172.21.15.111:52430) 2024-04-25T02:24:58.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.524+0000 7f6c9b7fe700 1 -- 172.21.15.111:0/1656150173 learned_addr learned my addr 172.21.15.111:0/1656150173 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:24:58.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.525+0000 7f6c9b7fe700 1 -- 172.21.15.111:0/1656150173 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6c9c06eb20 msgr2=0x7f6c9c0add30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:58.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.525+0000 7f6c9b7fe700 1 --2- 172.21.15.111:0/1656150173 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6c9c06eb20 0x7f6c9c0add30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:58.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.525+0000 7f6c9b7fe700 1 -- 172.21.15.111:0/1656150173 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6c9c06f4d0 msgr2=0x7f6c9c151790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:58.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.525+0000 7f6c9b7fe700 1 --2- 172.21.15.111:0/1656150173 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6c9c06f4d0 0x7f6c9c151790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:58.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.525+0000 7f6c9b7fe700 1 -- 172.21.15.111:0/1656150173 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c8c009420 con 0x7f6c9c068050 2024-04-25T02:24:58.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.525+0000 7f6c9bfff700 1 --2- 172.21.15.111:0/1656150173 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6c9c06f4d0 0x7f6c9c151790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:24:58.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.525+0000 7f6c9b7fe700 1 --2- 172.21.15.111:0/1656150173 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6c9c068050 0x7f6c9c096ff0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c068f60 tx=0x7f6c8c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:24:58.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.525+0000 7f6c837fe700 1 -- 172.21.15.111:0/1656150173 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c01bc40 con 0x7f6c9c068050 2024-04-25T02:24:58.533 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.525+0000 7f6c837fe700 1 -- 172.21.15.111:0/1656150173 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c8c01bdc0 con 0x7f6c9c068050 2024-04-25T02:24:58.533 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.525+0000 7f6ca1fc6700 1 -- 172.21.15.111:0/1656150173 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c9c0ae690 con 0x7f6c9c068050 2024-04-25T02:24:58.533 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.525+0000 7f6c837fe700 1 -- 172.21.15.111:0/1656150173 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c8c011670 con 0x7f6c9c068050 2024-04-25T02:24:58.533 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.525+0000 7f6ca1fc6700 1 -- 172.21.15.111:0/1656150173 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c9c0ad1c0 con 0x7f6c9c068050 2024-04-25T02:24:58.533 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.526+0000 7f6ca1fc6700 1 -- 172.21.15.111:0/1656150173 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6c9c065190 con 0x7f6c9c068050 2024-04-25T02:24:58.533 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.526+0000 7f6c837fe700 1 -- 172.21.15.111:0/1656150173 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f6c8c011a20 con 0x7f6c9c068050 2024-04-25T02:24:58.533 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.526+0000 7f6c837fe700 1 -- 172.21.15.111:0/1656150173 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4115+0+0 (secure 0 0 0) 0x7f6c8c05c570 con 0x7f6c9c068050 2024-04-25T02:24:58.533 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.530+0000 7f6c837fe700 1 -- 172.21.15.111:0/1656150173 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f6c8c03e420 con 0x7f6c9c068050 2024-04-25T02:24:58.687 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.684+0000 7f6ca1fc6700 1 -- 172.21.15.111:0/1656150173 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6c9c0ab6f0 con 0x7f6c9c068050 2024-04-25T02:24:58.688 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.684+0000 7f6c837fe700 1 -- 172.21.15.111:0/1656150173 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v42) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6c8c0150a0 con 0x7f6c9c068050 2024-04-25T02:24:58.688 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 64 2024-04-25T02:24:58.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.686+0000 7f6ca1fc6700 1 -- 172.21.15.111:0/1656150173 >> v1:172.21.15.111:6816/46482 conn(0x7f6c88045f20 legacy=0x7f6c880483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:58.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.686+0000 7f6ca1fc6700 1 -- 172.21.15.111:0/1656150173 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6c9c068050 msgr2=0x7f6c9c096ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:58.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.686+0000 7f6ca1fc6700 1 --2- 172.21.15.111:0/1656150173 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6c9c068050 0x7f6c9c096ff0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f6c9c068f60 tx=0x7f6c8c017000 comp rx=0 tx=0).stop 2024-04-25T02:24:58.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.686+0000 7f6ca1fc6700 1 -- 172.21.15.111:0/1656150173 shutdown_connections 2024-04-25T02:24:58.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.686+0000 7f6ca1fc6700 1 --2- 172.21.15.111:0/1656150173 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6c9c06f4d0 0x7f6c9c151790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:58.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.686+0000 7f6ca1fc6700 1 --2- 172.21.15.111:0/1656150173 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6c9c068050 0x7f6c9c096ff0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:58.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.686+0000 7f6ca1fc6700 1 --2- 172.21.15.111:0/1656150173 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6c9c06eb20 0x7f6c9c0add30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:58.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.686+0000 7f6ca1fc6700 1 -- 172.21.15.111:0/1656150173 >> 172.21.15.111:0/1656150173 conn(0x7f6c9c06bfb0 msgr2=0x7f6c9c1450e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:24:58.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.686+0000 7f6ca1fc6700 1 -- 172.21.15.111:0/1656150173 shutdown_connections 2024-04-25T02:24:58.690 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.686+0000 7f6ca1fc6700 1 -- 172.21.15.111:0/1656150173 wait complete. 2024-04-25T02:24:58.701 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T02:24:58.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.813+0000 7fd5214f0700 1 Processor -- start 2024-04-25T02:24:58.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.813+0000 7fd5214f0700 1 -- start start 2024-04-25T02:24:58.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.814+0000 7fd5214f0700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fd51c0ae2c0 0x7fd51c0a4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:58.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.814+0000 7fd5214f0700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd51c0a6410 0x7fd51c13b210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:58.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.814+0000 7fd5214f0700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd51c0a57b0 con 0x7fd51c13ded0 2024-04-25T02:24:58.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.814+0000 7fd5214f0700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd51c13a950 con 0x7fd51c0ae2c0 2024-04-25T02:24:58.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.814+0000 7fd5214f0700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd51c13ab40 con 0x7fd51c0a6410 2024-04-25T02:24:58.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.814+0000 7fd51a7fc700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd51c0a6410 0x7fd51c13b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:58.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.814+0000 7fd51affd700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fd51c0ae2c0 0x7fd51c0a4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:58.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.814+0000 7fd51a7fc700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd51c0a6410 0x7fd51c13b210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:54174/0 (socket says 172.21.15.111:54174) 2024-04-25T02:24:58.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.814+0000 7fd51a7fc700 1 -- 172.21.15.111:0/647880911 learned_addr learned my addr 172.21.15.111:0/647880911 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:24:58.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.814+0000 7fd51a7fc700 1 -- 172.21.15.111:0/647880911 >> v2:172.21.15.111:3300/0 conn(0x7fd51c0ae2c0 msgr2=0x7fd51c0a4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:24:58.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.814+0000 7fd51a7fc700 1 --2- 172.21.15.111:0/647880911 >> v2:172.21.15.111:3300/0 conn(0x7fd51c0ae2c0 0x7fd51c0a4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:58.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.814+0000 7fd51a7fc700 1 -- 172.21.15.111:0/647880911 >> v1:172.21.15.111:6789/0 conn(0x7fd51c13ded0 legacy=0x7fd51c13e2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:58.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.814+0000 7fd51a7fc700 1 -- 172.21.15.111:0/647880911 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd51c13ade0 con 0x7fd51c0a6410 2024-04-25T02:24:58.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.815+0000 7fd51affd700 1 --2- 172.21.15.111:0/647880911 >> v2:172.21.15.111:3300/0 conn(0x7fd51c0ae2c0 0x7fd51c0a4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:24:58.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.814+0000 7fd519ffb700 1 -- 172.21.15.111:0/647880911 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1966167287 0 0) 0x7fd51c0a57b0 con 0x7fd51c13ded0 2024-04-25T02:24:58.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.815+0000 7fd51a7fc700 1 --2- 172.21.15.111:0/647880911 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd51c0a6410 0x7fd51c13b210 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd50c0099e0 tx=0x7fd50c009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2a312e055cc4ccab server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:24:58.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.815+0000 7fd519ffb700 1 -- 172.21.15.111:0/647880911 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c00b820 con 0x7fd51c0a6410 2024-04-25T02:24:58.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.815+0000 7fd519ffb700 1 -- 172.21.15.111:0/647880911 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50c00b980 con 0x7fd51c0a6410 2024-04-25T02:24:58.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.815+0000 7fd519ffb700 1 -- 172.21.15.111:0/647880911 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c00bd20 con 0x7fd51c0a6410 2024-04-25T02:24:58.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.815+0000 7fd5214f0700 1 -- 172.21.15.111:0/647880911 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd51c0a6410 msgr2=0x7fd51c13b210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:58.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.815+0000 7fd5214f0700 1 --2- 172.21.15.111:0/647880911 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd51c0a6410 0x7fd51c13b210 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd50c0099e0 tx=0x7fd50c009250 comp rx=0 tx=0).stop 2024-04-25T02:24:58.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.815+0000 7fd5214f0700 1 -- 172.21.15.111:0/647880911 shutdown_connections 2024-04-25T02:24:58.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.815+0000 7fd5214f0700 1 --2- 172.21.15.111:0/647880911 >> v2:172.21.15.111:3300/0 conn(0x7fd51c0ae2c0 0x7fd51c0a4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:58.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.815+0000 7fd5214f0700 1 --2- 172.21.15.111:0/647880911 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd51c0a6410 0x7fd51c13b210 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:58.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.815+0000 7fd5214f0700 1 -- 172.21.15.111:0/647880911 >> 172.21.15.111:0/647880911 conn(0x7fd51c069bf0 msgr2=0x7fd51c067940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:24:58.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.815+0000 7fd5214f0700 1 -- 172.21.15.111:0/647880911 shutdown_connections 2024-04-25T02:24:58.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.815+0000 7fd5214f0700 1 -- 172.21.15.111:0/647880911 wait complete. 2024-04-25T02:24:58.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.816+0000 7fd5214f0700 1 Processor -- start 2024-04-25T02:24:58.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.817+0000 7fd5214f0700 1 -- start start 2024-04-25T02:24:58.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.817+0000 7fd5214f0700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd51c0a6410 0x7fd51c0a9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:58.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.817+0000 7fd5214f0700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd51c0ae2c0 0x7fd51c0ac610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:58.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.817+0000 7fd5214f0700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd51c13ded0 0x7fd51c0acb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:24:58.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.817+0000 7fd5214f0700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd51c0abf40 con 0x7fd51c0ae2c0 2024-04-25T02:24:58.829 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.817+0000 7fd5214f0700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd51c0ac1e0 con 0x7fd51c13ded0 2024-04-25T02:24:58.829 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.817+0000 7fd5214f0700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fd51c13da50 con 0x7fd51c0a6410 2024-04-25T02:24:58.829 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.817+0000 7fd51a7fc700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd51c0ae2c0 0x7fd51c0ac610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:58.829 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.817+0000 7fd51a7fc700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd51c0ae2c0 0x7fd51c0ac610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52444/0 (socket says 172.21.15.111:52444) 2024-04-25T02:24:58.829 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.817+0000 7fd51b7fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd51c13ded0 0x7fd51c0acb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:58.829 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.817+0000 7fd51a7fc700 1 -- 172.21.15.111:0/4126802440 learned_addr learned my addr 172.21.15.111:0/4126802440 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:24:58.829 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.817+0000 7fd51affd700 1 --2- 172.21.15.111:0/4126802440 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd51c0a6410 0x7fd51c0a9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:24:58.829 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.817+0000 7fd51a7fc700 1 -- 172.21.15.111:0/4126802440 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd51c0a6410 msgr2=0x7fd51c0a9310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:58.829 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.817+0000 7fd51a7fc700 1 --2- 172.21.15.111:0/4126802440 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd51c0a6410 0x7fd51c0a9310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:58.829 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.817+0000 7fd51a7fc700 1 -- 172.21.15.111:0/4126802440 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd51c13ded0 msgr2=0x7fd51c0acb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:58.829 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.817+0000 7fd51a7fc700 1 --2- 172.21.15.111:0/4126802440 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd51c13ded0 0x7fd51c0acb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:58.829 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.817+0000 7fd51a7fc700 1 -- 172.21.15.111:0/4126802440 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd51000a5d0 con 0x7fd51c0ae2c0 2024-04-25T02:24:58.829 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.817+0000 7fd51b7fe700 1 --2- 172.21.15.111:0/4126802440 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd51c13ded0 0x7fd51c0acb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:24:58.830 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.818+0000 7fd51a7fc700 1 --2- 172.21.15.111:0/4126802440 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd51c0ae2c0 0x7fd51c0ac610 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd51c13ac80 tx=0x7fd50c017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:24:58.830 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.818+0000 7fd502ffd700 1 -- 172.21.15.111:0/4126802440 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c011d70 con 0x7fd51c0ae2c0 2024-04-25T02:24:58.830 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.818+0000 7fd502ffd700 1 -- 172.21.15.111:0/4126802440 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd50c024440 con 0x7fd51c0ae2c0 2024-04-25T02:24:58.830 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.818+0000 7fd502ffd700 1 -- 172.21.15.111:0/4126802440 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd50c024800 con 0x7fd51c0ae2c0 2024-04-25T02:24:58.830 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.818+0000 7fd5214f0700 1 -- 172.21.15.111:0/4126802440 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd50c0094f0 con 0x7fd51c0ae2c0 2024-04-25T02:24:58.830 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.818+0000 7fd5214f0700 1 -- 172.21.15.111:0/4126802440 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd51c071810 con 0x7fd51c0ae2c0 2024-04-25T02:24:58.830 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.819+0000 7fd5214f0700 1 -- 172.21.15.111:0/4126802440 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd51c065190 con 0x7fd51c0ae2c0 2024-04-25T02:24:58.830 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.819+0000 7fd502ffd700 1 -- 172.21.15.111:0/4126802440 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7fd50c02d440 con 0x7fd51c0ae2c0 2024-04-25T02:24:58.830 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.819+0000 7fd502ffd700 1 -- 172.21.15.111:0/4126802440 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4115+0+0 (secure 0 0 0) 0x7fd50c05c850 con 0x7fd51c0ae2c0 2024-04-25T02:24:58.830 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.822+0000 7fd502ffd700 1 -- 172.21.15.111:0/4126802440 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fd50c025df0 con 0x7fd51c0ae2c0 2024-04-25T02:24:58.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.991+0000 7fd5214f0700 1 -- 172.21.15.111:0/4126802440 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd51c06ee10 con 0x7fd51c0ae2c0 2024-04-25T02:24:58.996 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.992+0000 7fd502ffd700 1 -- 172.21.15.111:0/4126802440 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 5 entries v42) v1 ==== 80+0+296 (secure 0 0 0) 0x7fd50c015070 con 0x7fd51c0ae2c0 2024-04-25T02:24:58.996 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:6819/4003866251 2024-04-26T02:23:16.839679+0000 2024-04-25T02:24:58.996 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/2148931273 2024-04-26T02:22:54.713254+0000 2024-04-25T02:24:58.996 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:6816/39585 2024-04-26T02:22:54.713254+0000 2024-04-25T02:24:58.996 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/3911588907 2024-04-26T02:22:54.713254+0000 2024-04-25T02:24:58.996 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/1276843622 2024-04-26T02:22:54.713254+0000 2024-04-25T02:24:58.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.993+0000 7fd5214f0700 1 -- 172.21.15.111:0/4126802440 >> v1:172.21.15.111:6816/46482 conn(0x7fd508045ef0 legacy=0x7fd5080483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:58.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.993+0000 7fd5214f0700 1 -- 172.21.15.111:0/4126802440 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd51c0ae2c0 msgr2=0x7fd51c0ac610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:24:58.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.993+0000 7fd5214f0700 1 --2- 172.21.15.111:0/4126802440 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd51c0ae2c0 0x7fd51c0ac610 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fd51c13ac80 tx=0x7fd50c017000 comp rx=0 tx=0).stop 2024-04-25T02:24:58.997 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.993+0000 7fd5214f0700 1 -- 172.21.15.111:0/4126802440 shutdown_connections 2024-04-25T02:24:58.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.993+0000 7fd5214f0700 1 --2- 172.21.15.111:0/4126802440 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fd51c13ded0 0x7fd51c0acb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:58.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.993+0000 7fd5214f0700 1 --2- 172.21.15.111:0/4126802440 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fd51c0a6410 0x7fd51c0a9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:58.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.993+0000 7fd5214f0700 1 --2- 172.21.15.111:0/4126802440 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fd51c0ae2c0 0x7fd51c0ac610 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:24:58.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.993+0000 7fd5214f0700 1 -- 172.21.15.111:0/4126802440 >> 172.21.15.111:0/4126802440 conn(0x7fd51c069bf0 msgr2=0x7fd51c13e2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:24:58.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.994+0000 7fd5214f0700 1 -- 172.21.15.111:0/4126802440 shutdown_connections 2024-04-25T02:24:58.998 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:24:58.994+0000 7fd5214f0700 1 -- 172.21.15.111:0/4126802440 wait complete. 2024-04-25T02:24:58.998 INFO:teuthology.orchestra.run.smithi111.stderr:listed 5 entries 2024-04-25T02:24:59.009 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi114.front.sepia.ceph.com... 2024-04-25T02:24:59.009 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:24:59.009 DEBUG:teuthology.orchestra.run.smithi114:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-25T02:24:59.050 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:ceph-fuse[37442]: fuse finished with error 0 and tester_r 0 2024-04-25T02:24:59.051 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:25:05.153 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2024-04-25T02:25:05.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:25:05.153 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T02:25:05.185 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:25:05.185 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-04-25T02:25:05.247 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T02:25:05.247 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:25:05.248 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T02:25:05.329 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:25:05.329 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link delete ceph-brx 2024-04-25T02:25:05.426 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:25:05.426 DEBUG:teuthology.orchestra.run.smithi186:> ip netns list 2024-04-25T02:25:05.450 INFO:teuthology.orchestra.run.smithi186.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2024-04-25T02:25:05.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:25:05.451 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2024-04-25T02:25:05.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:25:05.533 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip link delete ceph-brx 2024-04-25T02:25:05.641 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-25T02:25:05.641 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-25T02:25:05.653 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-25T02:25:05.654 INFO:tasks.ceph_fuse:config is {'client.0': None, 'client.1': {'skip': True}} 2024-04-25T02:25:05.654 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-25T02:25:05.654 INFO:tasks.ceph_fuse:client.1 config is {'skip': True} 2024-04-25T02:25:05.654 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:25:05.654 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-04-25T02:25:05.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:25:05.676 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link delete ceph-brx 2024-04-25T02:25:05.748 INFO:teuthology.orchestra.run.smithi114.stderr:Cannot find device "ceph-brx" 2024-04-25T02:25:05.748 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:25:05.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:25:05.749 DEBUG:teuthology.orchestra.run.smithi186:> ip netns list 2024-04-25T02:25:05.769 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:25:05.769 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip link delete ceph-brx 2024-04-25T02:25:05.839 INFO:teuthology.orchestra.run.smithi186.stderr:Cannot find device "ceph-brx" 2024-04-25T02:25:05.840 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:25:05.841 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-25T02:25:05.841 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-25T02:25:05.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.967+0000 7effc1468700 1 Processor -- start 2024-04-25T02:25:05.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.967+0000 7effc1468700 1 -- start start 2024-04-25T02:25:05.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.967+0000 7effc1468700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7effbc063c80 0x7effbc13b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:25:05.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.967+0000 7effc1468700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7effbc06eaf0 0x7effbc06d970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:25:05.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.968+0000 7effc1468700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7effbc0ac6b0 con 0x7effbc13bde0 2024-04-25T02:25:05.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.968+0000 7effc1468700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effbc0ac970 con 0x7effbc063c80 2024-04-25T02:25:05.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.968+0000 7effc1468700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7effbc069f90 con 0x7effbc06eaf0 2024-04-25T02:25:05.978 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.968+0000 7effbaffd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7effbc063c80 0x7effbc13b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:25:05.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.968+0000 7effbb7fe700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7effbc13bde0 0x7effbc067940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:53454/0 (socket says 172.21.15.111:53454) 2024-04-25T02:25:05.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.968+0000 7effbb7fe700 1 -- 172.21.15.111:0/555075628 learned_addr learned my addr 172.21.15.111:0/555075628 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:25:05.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.968+0000 7effba7fc700 1 --2- 172.21.15.111:0/555075628 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7effbc06eaf0 0x7effbc06d970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:25:05.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.968+0000 7effbaffd700 1 -- 172.21.15.111:0/555075628 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7effbc06eaf0 msgr2=0x7effbc06d970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:25:05.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.968+0000 7effb9ffb700 1 -- 172.21.15.111:0/555075628 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1130860939 0 0) 0x7effbc0ac6b0 con 0x7effbc13bde0 2024-04-25T02:25:05.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.968+0000 7effbaffd700 1 --2- 172.21.15.111:0/555075628 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7effbc06eaf0 0x7effbc06d970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:05.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.968+0000 7effbaffd700 1 -- 172.21.15.111:0/555075628 >> v1:172.21.15.111:6789/0 conn(0x7effbc13bde0 legacy=0x7effbc067940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:05.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.968+0000 7effbaffd700 1 -- 172.21.15.111:0/555075628 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effbc06f1f0 con 0x7effbc063c80 2024-04-25T02:25:05.979 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.968+0000 7effba7fc700 1 --2- 172.21.15.111:0/555075628 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7effbc06eaf0 0x7effbc06d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:25:05.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.968+0000 7effbaffd700 1 --2- 172.21.15.111:0/555075628 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7effbc063c80 0x7effbc13b8a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7effb0009940 tx=0x7effb00091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a004ee81c77be743 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:25:05.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.968+0000 7effb9ffb700 1 -- 172.21.15.111:0/555075628 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb000b670 con 0x7effbc063c80 2024-04-25T02:25:05.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.968+0000 7effb9ffb700 1 -- 172.21.15.111:0/555075628 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effb000b7d0 con 0x7effbc063c80 2024-04-25T02:25:05.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.968+0000 7effb9ffb700 1 -- 172.21.15.111:0/555075628 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effb000bb90 con 0x7effbc063c80 2024-04-25T02:25:05.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.969+0000 7effc1468700 1 -- 172.21.15.111:0/555075628 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7effbc063c80 msgr2=0x7effbc13b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:05.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.969+0000 7effc1468700 1 --2- 172.21.15.111:0/555075628 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7effbc063c80 0x7effbc13b8a0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7effb0009940 tx=0x7effb00091a0 comp rx=0 tx=0).stop 2024-04-25T02:25:05.980 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.969+0000 7effc1468700 1 -- 172.21.15.111:0/555075628 shutdown_connections 2024-04-25T02:25:05.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.969+0000 7effc1468700 1 --2- 172.21.15.111:0/555075628 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7effbc063c80 0x7effbc13b8a0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:05.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.969+0000 7effc1468700 1 --2- 172.21.15.111:0/555075628 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7effbc06eaf0 0x7effbc06d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:05.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.969+0000 7effc1468700 1 -- 172.21.15.111:0/555075628 >> 172.21.15.111:0/555075628 conn(0x7effbc0b1400 msgr2=0x7effbc0b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:25:05.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.969+0000 7effc1468700 1 -- 172.21.15.111:0/555075628 shutdown_connections 2024-04-25T02:25:05.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.969+0000 7effc1468700 1 -- 172.21.15.111:0/555075628 wait complete. 2024-04-25T02:25:05.981 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.970+0000 7effc1468700 1 Processor -- start 2024-04-25T02:25:05.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.970+0000 7effc1468700 1 -- start start 2024-04-25T02:25:05.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.971+0000 7effc1468700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7effbc063c80 0x7effbc141e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:25:05.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.971+0000 7effc1468700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7effbc06eaf0 0x7effbc140c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:25:05.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.971+0000 7effc1468700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7effbc13bde0 0x7effbc138540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:25:05.982 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.971+0000 7effc1468700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7effbc119090 con 0x7effbc13bde0 2024-04-25T02:25:05.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.971+0000 7effc1468700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7effbc0b0b50 con 0x7effbc063c80 2024-04-25T02:25:05.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.971+0000 7effc1468700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7effbc14e890 con 0x7effbc06eaf0 2024-04-25T02:25:05.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.971+0000 7effbaffd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7effbc063c80 0x7effbc141e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:25:05.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.971+0000 7effba7fc700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7effbc06eaf0 0x7effbc140c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:25:05.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.971+0000 7effbb7fe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7effbc13bde0 0x7effbc138540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:25:05.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.971+0000 7effbaffd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7effbc063c80 0x7effbc141e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:41478/0 (socket says 172.21.15.111:41478) 2024-04-25T02:25:05.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.971+0000 7effbaffd700 1 -- 172.21.15.111:0/1476999532 learned_addr learned my addr 172.21.15.111:0/1476999532 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:25:05.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.971+0000 7effba7fc700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7effbc06eaf0 0x7effbc140c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:38392/0 (socket says 172.21.15.111:38392) 2024-04-25T02:25:05.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.971+0000 7effbb7fe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7effbc13bde0 0x7effbc138540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52562/0 (socket says 172.21.15.111:52562) 2024-04-25T02:25:05.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.971+0000 7effba7fc700 1 -- 172.21.15.111:0/1476999532 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7effbc063c80 msgr2=0x7effbc141e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:05.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.971+0000 7effba7fc700 1 --2- 172.21.15.111:0/1476999532 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7effbc063c80 0x7effbc141e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:05.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.971+0000 7effba7fc700 1 -- 172.21.15.111:0/1476999532 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7effbc13bde0 msgr2=0x7effbc138540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:05.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.971+0000 7effba7fc700 1 --2- 172.21.15.111:0/1476999532 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7effbc13bde0 0x7effbc138540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:05.984 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.971+0000 7effba7fc700 1 -- 172.21.15.111:0/1476999532 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7effac009420 con 0x7effbc06eaf0 2024-04-25T02:25:05.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.971+0000 7effbb7fe700 1 --2- 172.21.15.111:0/1476999532 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7effbc13bde0 0x7effbc138540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:25:05.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.971+0000 7effba7fc700 1 --2- 172.21.15.111:0/1476999532 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7effbc06eaf0 0x7effbc140c00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7effbc06d3a0 tx=0x7effac0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:25:05.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.971+0000 7effa2ffd700 1 -- 172.21.15.111:0/1476999532 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac00c820 con 0x7effbc06eaf0 2024-04-25T02:25:05.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.971+0000 7effa2ffd700 1 -- 172.21.15.111:0/1476999532 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7effac00c980 con 0x7effbc06eaf0 2024-04-25T02:25:05.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.971+0000 7effa2ffd700 1 -- 172.21.15.111:0/1476999532 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7effac00cd40 con 0x7effbc06eaf0 2024-04-25T02:25:05.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.971+0000 7effc1468700 1 -- 172.21.15.111:0/1476999532 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7effb0009420 con 0x7effbc06eaf0 2024-04-25T02:25:05.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.971+0000 7effc1468700 1 -- 172.21.15.111:0/1476999532 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7effbc141620 con 0x7effbc06eaf0 2024-04-25T02:25:05.985 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.972+0000 7effc1468700 1 -- 172.21.15.111:0/1476999532 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7effbc065190 con 0x7effbc06eaf0 2024-04-25T02:25:05.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.973+0000 7effa2ffd700 1 -- 172.21.15.111:0/1476999532 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7effac013680 con 0x7effbc06eaf0 2024-04-25T02:25:05.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.973+0000 7effa2ffd700 1 -- 172.21.15.111:0/1476999532 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4115+0+0 (secure 0 0 0) 0x7effac05bac0 con 0x7effbc06eaf0 2024-04-25T02:25:05.986 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:05.976+0000 7effa2ffd700 1 -- 172.21.15.111:0/1476999532 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7effac039ec0 con 0x7effbc06eaf0 2024-04-25T02:25:06.167 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:06.163+0000 7effc1468700 1 -- 172.21.15.111:0/1476999532 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7effbc13e030 con 0x7effbc06eaf0 2024-04-25T02:25:06.167 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:06.163+0000 7effa2ffd700 1 -- 172.21.15.111:0/1476999532 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) v1 ==== 53+0+73 (secure 0 0 0) 0x7effac021070 con 0x7effbc06eaf0 2024-04-25T02:25:06.168 INFO:teuthology.orchestra.run.smithi111.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-04-25T02:25:06.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:06.165+0000 7effc1468700 1 -- 172.21.15.111:0/1476999532 >> v1:172.21.15.111:6816/46482 conn(0x7effa8045ef0 legacy=0x7effa80483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:06.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:06.165+0000 7effc1468700 1 -- 172.21.15.111:0/1476999532 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7effbc06eaf0 msgr2=0x7effbc140c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:06.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:06.165+0000 7effc1468700 1 --2- 172.21.15.111:0/1476999532 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7effbc06eaf0 0x7effbc140c00 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7effbc06d3a0 tx=0x7effac0091a0 comp rx=0 tx=0).stop 2024-04-25T02:25:06.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:06.165+0000 7effc1468700 1 -- 172.21.15.111:0/1476999532 shutdown_connections 2024-04-25T02:25:06.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:06.165+0000 7effc1468700 1 --2- 172.21.15.111:0/1476999532 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7effbc13bde0 0x7effbc138540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:06.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:06.165+0000 7effc1468700 1 --2- 172.21.15.111:0/1476999532 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7effbc063c80 0x7effbc141e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:06.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:06.165+0000 7effc1468700 1 --2- 172.21.15.111:0/1476999532 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7effbc06eaf0 0x7effbc140c00 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:06.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:06.165+0000 7effc1468700 1 -- 172.21.15.111:0/1476999532 >> 172.21.15.111:0/1476999532 conn(0x7effbc0b1400 msgr2=0x7effbc0ae5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:25:06.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:06.165+0000 7effc1468700 1 -- 172.21.15.111:0/1476999532 shutdown_connections 2024-04-25T02:25:06.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:06.165+0000 7effc1468700 1 -- 172.21.15.111:0/1476999532 wait complete. 2024-04-25T02:25:06.180 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-25T02:25:06.180 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-25T02:25:06.180 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi114.front.sepia.ceph.com 2024-04-25T02:25:06.180 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-25T02:25:06.180 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-25T02:25:06.180 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-25T02:25:06.181 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-25T02:25:06.181 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-25T02:25:06.181 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:25:06.181 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:25:06.182 DEBUG:teuthology.orchestra.run.smithi114:> ip addr 2024-04-25T02:25:06.205 INFO:teuthology.orchestra.run.smithi114.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-25T02:25:06.374 INFO:teuthology.orchestra.run.smithi114.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-25T02:25:06.374 INFO:teuthology.orchestra.run.smithi114.stdout: inet 127.0.0.1/8 scope host lo 2024-04-25T02:25:06.374 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:25:06.374 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 ::1/128 scope host 2024-04-25T02:25:06.374 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:25:06.375 INFO:teuthology.orchestra.run.smithi114.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:25:06.375 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:92 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:25:06.375 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f0 2024-04-25T02:25:06.375 INFO:teuthology.orchestra.run.smithi114.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:25:06.375 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:d8:a8:93 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:25:06.375 INFO:teuthology.orchestra.run.smithi114.stdout: altname enp7s0f1 2024-04-25T02:25:06.375 INFO:teuthology.orchestra.run.smithi114.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-04-25T02:25:06.375 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:62 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:25:06.375 INFO:teuthology.orchestra.run.smithi114.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-25T02:25:06.375 INFO:teuthology.orchestra.run.smithi114.stdout: link/ether 0c:c4:7a:8f:cb:63 brd ff:ff:ff:ff:ff:ff 2024-04-25T02:25:06.375 INFO:teuthology.orchestra.run.smithi114.stdout: inet 172.21.15.114/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-04-25T02:25:06.375 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft 42335sec preferred_lft 42335sec 2024-04-25T02:25:06.375 INFO:teuthology.orchestra.run.smithi114.stdout: inet6 fe80::ec4:7aff:fe8f:cb63/64 scope link 2024-04-25T02:25:06.375 INFO:teuthology.orchestra.run.smithi114.stdout: valid_lft forever preferred_lft forever 2024-04-25T02:25:06.376 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-25T02:25:06.376 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:25:06.376 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-04-25T02:25:06.376 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link add name ceph-brx type bridge 2024-04-25T02:25:06.376 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip addr flush dev ceph-brx 2024-04-25T02:25:06.376 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set ceph-brx up 2024-04-25T02:25:06.376 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-25T02:25:06.376 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-04-25T02:25:06.439 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-25T02:25:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:25:06.500 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-25T02:25:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:25:06.506 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:25:06.506 DEBUG:teuthology.orchestra.run.smithi114:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-25T02:25:06.536 INFO:teuthology.orchestra.run.smithi114.stdout:1 2024-04-25T02:25:06.537 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:25:06.537 DEBUG:teuthology.orchestra.run.smithi114:> route 2024-04-25T02:25:06.598 INFO:teuthology.orchestra.run.smithi114.stdout:Kernel IP routing table 2024-04-25T02:25:06.598 INFO:teuthology.orchestra.run.smithi114.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-25T02:25:06.598 INFO:teuthology.orchestra.run.smithi114.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-04-25T02:25:06.598 INFO:teuthology.orchestra.run.smithi114.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-04-25T02:25:06.598 INFO:teuthology.orchestra.run.smithi114.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-25T02:25:06.599 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:25:06.599 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-04-25T02:25:06.599 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-04-25T02:25:06.599 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-04-25T02:25:06.599 DEBUG:teuthology.orchestra.run.smithi114:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-04-25T02:25:06.599 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-04-25T02:25:06.688 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-25T02:25:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:25:06.736 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-25T02:25:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:25:06.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:25:06.741 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-04-25T02:25:06.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:25:06.759 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list-id 2024-04-25T02:25:06.817 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:25:06.817 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-04-25T02:25:06.817 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T02:25:06.818 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-25T02:25:06.818 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-04-25T02:25:06.907 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-25T02:25:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:25:06.943 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-25T02:25:06 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:25:06.948 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-25T02:25:06.948 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:25:06.949 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-04-25T02:25:06.949 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-25T02:25:06.949 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-25T02:25:06.949 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-25T02:25:06.949 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-25T02:25:06.949 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-25T02:25:06.949 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-04-25T02:25:06.998 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-25T02:25:06 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:25:07.191 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-25T02:25:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:25:07.197 DEBUG:teuthology.orchestra.run.smithi114:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-25T02:25:07.197 DEBUG:teuthology.orchestra.run.smithi114:> set -e 2024-04-25T02:25:07.197 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set brx.0 up 2024-04-25T02:25:07.197 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link set dev brx.0 master ceph-brx 2024-04-25T02:25:07.197 DEBUG:teuthology.orchestra.run.smithi114:> ') 2024-04-25T02:25:07.247 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-25T02:25:07 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-25T02:25:07.326 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-25T02:25:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:25:07.332 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-25T02:25:07.332 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:25:07.332 DEBUG:teuthology.orchestra.run.smithi114:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-25T02:25:07.350 INFO:teuthology.orchestra.run.smithi114.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-25T02:25:07.350 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-25T02:25:07.350 DEBUG:teuthology.orchestra.run.smithi114:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-25T02:25:07.407 DEBUG:teuthology.orchestra.run.smithi114:> sudo modprobe fuse 2024-04-25T02:25:07.474 DEBUG:teuthology.orchestra.run.smithi114:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T02:25:07.533 INFO:teuthology.orchestra.run.smithi114.stdout:/sys 2024-04-25T02:25:07.533 INFO:teuthology.orchestra.run.smithi114.stdout:/proc 2024-04-25T02:25:07.533 INFO:teuthology.orchestra.run.smithi114.stdout:/dev 2024-04-25T02:25:07.533 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/security 2024-04-25T02:25:07.533 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/shm 2024-04-25T02:25:07.533 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/pts 2024-04-25T02:25:07.533 INFO:teuthology.orchestra.run.smithi114.stdout:/run 2024-04-25T02:25:07.533 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup 2024-04-25T02:25:07.533 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup/systemd 2024-04-25T02:25:07.533 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/pstore 2024-04-25T02:25:07.533 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/bpf 2024-04-25T02:25:07.533 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup/freezer 2024-04-25T02:25:07.534 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup/memory 2024-04-25T02:25:07.534 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup/hugetlb 2024-04-25T02:25:07.534 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup/devices 2024-04-25T02:25:07.534 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup/cpu,cpuacct 2024-04-25T02:25:07.534 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup/pids 2024-04-25T02:25:07.534 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup/rdma 2024-04-25T02:25:07.534 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup/net_cls,net_prio 2024-04-25T02:25:07.534 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup/cpuset 2024-04-25T02:25:07.534 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup/blkio 2024-04-25T02:25:07.534 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup/perf_event 2024-04-25T02:25:07.534 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/tracing 2024-04-25T02:25:07.534 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/config 2024-04-25T02:25:07.534 INFO:teuthology.orchestra.run.smithi114.stdout:/ 2024-04-25T02:25:07.535 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/selinux 2024-04-25T02:25:07.535 INFO:teuthology.orchestra.run.smithi114.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T02:25:07.535 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/hugepages 2024-04-25T02:25:07.535 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/mqueue 2024-04-25T02:25:07.535 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/debug 2024-04-25T02:25:07.535 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/fuse/connections 2024-04-25T02:25:07.535 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T02:25:07.535 INFO:teuthology.orchestra.run.smithi114.stdout:/run/user/1000 2024-04-25T02:25:07.535 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph 2024-04-25T02:25:07.535 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns 2024-04-25T02:25:07.535 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T02:25:07.535 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T02:25:07.536 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:25:07.536 DEBUG:teuthology.orchestra.run.smithi114:> ls /sys/fs/fuse/connections 2024-04-25T02:25:07.591 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-25T02:25:07.591 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-25T02:25:07.634 DEBUG:teuthology.orchestra.run.smithi114:> sudo modprobe fuse 2024-04-25T02:25:07.660 DEBUG:teuthology.orchestra.run.smithi114:> cat /proc/self/mounts | awk '{print $2}' 2024-04-25T02:25:07.716 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:2024-04-25T02:25:07.714+0000 7fd379743540 -1 init, newargv = 0x55c74bef2e20 newargc=15 2024-04-25T02:25:07.717 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:ceph-fuse[39056]: starting ceph client 2024-04-25T02:25:07.720 INFO:teuthology.orchestra.run.smithi114.stdout:/sys 2024-04-25T02:25:07.720 INFO:teuthology.orchestra.run.smithi114.stdout:/proc 2024-04-25T02:25:07.720 INFO:teuthology.orchestra.run.smithi114.stdout:/dev 2024-04-25T02:25:07.720 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/security 2024-04-25T02:25:07.720 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/shm 2024-04-25T02:25:07.720 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/pts 2024-04-25T02:25:07.721 INFO:teuthology.orchestra.run.smithi114.stdout:/run 2024-04-25T02:25:07.721 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup 2024-04-25T02:25:07.721 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup/systemd 2024-04-25T02:25:07.721 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/pstore 2024-04-25T02:25:07.721 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/bpf 2024-04-25T02:25:07.721 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup/freezer 2024-04-25T02:25:07.721 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup/memory 2024-04-25T02:25:07.721 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup/hugetlb 2024-04-25T02:25:07.721 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup/devices 2024-04-25T02:25:07.721 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup/cpu,cpuacct 2024-04-25T02:25:07.721 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup/pids 2024-04-25T02:25:07.721 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup/rdma 2024-04-25T02:25:07.721 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup/net_cls,net_prio 2024-04-25T02:25:07.721 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup/cpuset 2024-04-25T02:25:07.722 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup/blkio 2024-04-25T02:25:07.722 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/cgroup/perf_event 2024-04-25T02:25:07.722 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/tracing 2024-04-25T02:25:07.722 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/config 2024-04-25T02:25:07.722 INFO:teuthology.orchestra.run.smithi114.stdout:/ 2024-04-25T02:25:07.722 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/selinux 2024-04-25T02:25:07.722 INFO:teuthology.orchestra.run.smithi114.stdout:/proc/sys/fs/binfmt_misc 2024-04-25T02:25:07.722 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/hugepages 2024-04-25T02:25:07.722 INFO:teuthology.orchestra.run.smithi114.stdout:/dev/mqueue 2024-04-25T02:25:07.723 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/kernel/debug 2024-04-25T02:25:07.723 INFO:teuthology.orchestra.run.smithi114.stdout:/sys/fs/fuse/connections 2024-04-25T02:25:07.723 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/nfs/rpc_pipefs 2024-04-25T02:25:07.723 INFO:teuthology.orchestra.run.smithi114.stdout:/run/user/1000 2024-04-25T02:25:07.723 INFO:teuthology.orchestra.run.smithi114.stdout:/var/lib/ceph 2024-04-25T02:25:07.723 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns 2024-04-25T02:25:07.723 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T02:25:07.723 INFO:teuthology.orchestra.run.smithi114.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T02:25:07.723 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:25:07.723 DEBUG:teuthology.orchestra.run.smithi114:> ls /sys/fs/fuse/connections 2024-04-25T02:25:07.724 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:ceph-fuse[39056]: starting fuse 2024-04-25T02:25:07.741 INFO:teuthology.orchestra.run.smithi114.stdout:46 2024-04-25T02:25:07.742 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [46] 2024-04-25T02:25:07.742 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer -- python3 -c ' 2024-04-25T02:25:07.742 DEBUG:teuthology.orchestra.run.smithi114:> import glob 2024-04-25T02:25:07.743 DEBUG:teuthology.orchestra.run.smithi114:> import re 2024-04-25T02:25:07.743 DEBUG:teuthology.orchestra.run.smithi114:> import os 2024-04-25T02:25:07.743 DEBUG:teuthology.orchestra.run.smithi114:> import subprocess 2024-04-25T02:25:07.743 DEBUG:teuthology.orchestra.run.smithi114:> 2024-04-25T02:25:07.743 DEBUG:teuthology.orchestra.run.smithi114:> def _find_admin_socket(client_name): 2024-04-25T02:25:07.743 DEBUG:teuthology.orchestra.run.smithi114:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-25T02:25:07.744 DEBUG:teuthology.orchestra.run.smithi114:> files = glob.glob(asok_path) 2024-04-25T02:25:07.744 DEBUG:teuthology.orchestra.run.smithi114:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-25T02:25:07.744 DEBUG:teuthology.orchestra.run.smithi114:> 2024-04-25T02:25:07.744 DEBUG:teuthology.orchestra.run.smithi114:> # Given a non-glob path, it better be there 2024-04-25T02:25:07.744 DEBUG:teuthology.orchestra.run.smithi114:> if "*" not in asok_path: 2024-04-25T02:25:07.745 DEBUG:teuthology.orchestra.run.smithi114:> assert(len(files) == 1) 2024-04-25T02:25:07.745 DEBUG:teuthology.orchestra.run.smithi114:> return files[0] 2024-04-25T02:25:07.745 DEBUG:teuthology.orchestra.run.smithi114:> 2024-04-25T02:25:07.745 DEBUG:teuthology.orchestra.run.smithi114:> for f in files: 2024-04-25T02:25:07.745 DEBUG:teuthology.orchestra.run.smithi114:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-25T02:25:07.745 DEBUG:teuthology.orchestra.run.smithi114:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-25T02:25:07.745 DEBUG:teuthology.orchestra.run.smithi114:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-25T02:25:07.746 DEBUG:teuthology.orchestra.run.smithi114:> contents = proc_f.read() 2024-04-25T02:25:07.746 DEBUG:teuthology.orchestra.run.smithi114:> if mountpoint in contents: 2024-04-25T02:25:07.746 DEBUG:teuthology.orchestra.run.smithi114:> return f 2024-04-25T02:25:07.746 DEBUG:teuthology.orchestra.run.smithi114:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-25T02:25:07.746 DEBUG:teuthology.orchestra.run.smithi114:> 2024-04-25T02:25:07.746 DEBUG:teuthology.orchestra.run.smithi114:> print(_find_admin_socket("client.0")) 2024-04-25T02:25:07.747 DEBUG:teuthology.orchestra.run.smithi114:> ' 2024-04-25T02:25:07.863 INFO:teuthology.orchestra.run.smithi114.stdout:/var/run/ceph/ceph-client.0.39056.asok 2024-04-25T02:25:07.866 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-25T02:25:07 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:25:07.872 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.39056.asok 2024-04-25T02:25:07.872 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:25:07.872 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.39056.asok status 2024-04-25T02:25:08.023 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-04-25T02:25:08.024 INFO:teuthology.orchestra.run.smithi114.stdout: "metadata": { 2024-04-25T02:25:08.024 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_sha1": "c61472c83ce76869b0fe076c19ed2f4bcc3fb4af", 2024-04-25T02:25:08.024 INFO:teuthology.orchestra.run.smithi114.stdout: "ceph_version": "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)", 2024-04-25T02:25:08.024 INFO:teuthology.orchestra.run.smithi114.stdout: "entity_id": "0", 2024-04-25T02:25:08.024 INFO:teuthology.orchestra.run.smithi114.stdout: "hostname": "smithi114", 2024-04-25T02:25:08.024 INFO:teuthology.orchestra.run.smithi114.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-25T02:25:08.024 INFO:teuthology.orchestra.run.smithi114.stdout: "pid": "39056", 2024-04-25T02:25:08.024 INFO:teuthology.orchestra.run.smithi114.stdout: "root": "/" 2024-04-25T02:25:08.024 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-25T02:25:08.025 INFO:teuthology.orchestra.run.smithi114.stdout: "dentry_count": 0, 2024-04-25T02:25:08.025 INFO:teuthology.orchestra.run.smithi114.stdout: "dentry_pinned_count": 0, 2024-04-25T02:25:08.025 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 14741, 2024-04-25T02:25:08.025 INFO:teuthology.orchestra.run.smithi114.stdout: "inst": { 2024-04-25T02:25:08.025 INFO:teuthology.orchestra.run.smithi114.stdout: "name": { 2024-04-25T02:25:08.025 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "client", 2024-04-25T02:25:08.025 INFO:teuthology.orchestra.run.smithi114.stdout: "num": 14741 2024-04-25T02:25:08.025 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-25T02:25:08.025 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": { 2024-04-25T02:25:08.025 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v1", 2024-04-25T02:25:08.025 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "172.21.15.114:0", 2024-04-25T02:25:08.025 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 2005503483 2024-04-25T02:25:08.025 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-25T02:25:08.025 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-25T02:25:08.025 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": { 2024-04-25T02:25:08.026 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v1", 2024-04-25T02:25:08.026 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "172.21.15.114:0", 2024-04-25T02:25:08.026 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 2005503483 2024-04-25T02:25:08.026 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-25T02:25:08.026 INFO:teuthology.orchestra.run.smithi114.stdout: "inst_str": "client.14741 172.21.15.114:0/2005503483", 2024-04-25T02:25:08.026 INFO:teuthology.orchestra.run.smithi114.stdout: "addr_str": "172.21.15.114:0/2005503483", 2024-04-25T02:25:08.026 INFO:teuthology.orchestra.run.smithi114.stdout: "inode_count": 1, 2024-04-25T02:25:08.026 INFO:teuthology.orchestra.run.smithi114.stdout: "mds_epoch": 19, 2024-04-25T02:25:08.026 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_epoch": 42, 2024-04-25T02:25:08.026 INFO:teuthology.orchestra.run.smithi114.stdout: "osd_epoch_barrier": 0, 2024-04-25T02:25:08.026 INFO:teuthology.orchestra.run.smithi114.stdout: "blocklisted": false, 2024-04-25T02:25:08.026 INFO:teuthology.orchestra.run.smithi114.stdout: "fs_name": "cephfs" 2024-04-25T02:25:08.026 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-04-25T02:25:08.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:25:08.034 DEBUG:teuthology.orchestra.run.smithi114:> stat --file-system '--printf=%T 2024-04-25T02:25:08.034 DEBUG:teuthology.orchestra.run.smithi114:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-25T02:25:08.052 INFO:teuthology.orchestra.run.smithi114.stdout:fuseblk 2024-04-25T02:25:08.053 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-25T02:25:08.053 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:25:08.053 DEBUG:teuthology.orchestra.run.smithi114:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-25T02:25:08.118 INFO:teuthology.run_tasks:Running task print... 2024-04-25T02:25:08.130 INFO:teuthology.task.print:**** done remount client 2024-04-25T02:25:08.130 INFO:teuthology.run_tasks:Running task exec... 2024-04-25T02:25:08.153 INFO:teuthology.task.exec:Executing custom commands... 2024-04-25T02:25:08.153 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi111.front.sepia.ceph.com 2024-04-25T02:25:08.154 DEBUG:teuthology.orchestra.run.smithi111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs dump --format=json-pretty' 2024-04-25T02:25:08.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.277+0000 7f60ef20b700 1 Processor -- start 2024-04-25T02:25:08.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.277+0000 7f60ef20b700 1 -- start start 2024-04-25T02:25:08.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.278+0000 7f60ef20b700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f60e813b750 0x7f60e813bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:25:08.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.278+0000 7f60ef20b700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f60e8146d40 0x7f60e8149120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:25:08.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.278+0000 7f60ef20b700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60e80b1ff0 con 0x7f60e8071200 2024-04-25T02:25:08.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.278+0000 7f60ef20b700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60e80acc10 con 0x7f60e8146d40 2024-04-25T02:25:08.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.278+0000 7f60ef20b700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e806f4d0 con 0x7f60e813b750 2024-04-25T02:25:08.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.278+0000 7f60e7fff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f60e813b750 0x7f60e813bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:25:08.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.278+0000 7f60ed7a8700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f60e8146d40 0x7f60e8149120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:25:08.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.278+0000 7f60ecfa7700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f60e8071200 0x7f60e806edc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:53470/0 (socket says 172.21.15.111:53470) 2024-04-25T02:25:08.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.278+0000 7f60ecfa7700 1 -- 172.21.15.111:0/113944757 learned_addr learned my addr 172.21.15.111:0/113944757 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:25:08.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.278+0000 7f60ed7a8700 1 -- 172.21.15.111:0/113944757 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f60e813b750 msgr2=0x7f60e813bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:25:08.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.278+0000 7f60ed7a8700 1 --2- 172.21.15.111:0/113944757 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f60e813b750 0x7f60e813bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:08.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.278+0000 7f60ed7a8700 1 -- 172.21.15.111:0/113944757 >> v1:172.21.15.111:6789/0 conn(0x7f60e8071200 legacy=0x7f60e806edc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:08.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.278+0000 7f60ed7a8700 1 -- 172.21.15.111:0/113944757 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60e80abfd0 con 0x7f60e8146d40 2024-04-25T02:25:08.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.278+0000 7f60e77fe700 1 -- 172.21.15.111:0/113944757 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2879610213 0 0) 0x7f60e80b1ff0 con 0x7f60e8071200 2024-04-25T02:25:08.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.278+0000 7f60e7fff700 1 --2- 172.21.15.111:0/113944757 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f60e813b750 0x7f60e813bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:25:08.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.278+0000 7f60ed7a8700 1 --2- 172.21.15.111:0/113944757 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f60e8146d40 0x7f60e8149120 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f60e0009e60 tx=0x7f60e0009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61385293ec8b051a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:25:08.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.278+0000 7f60e77fe700 1 -- 172.21.15.111:0/113944757 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e000e070 con 0x7f60e8146d40 2024-04-25T02:25:08.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.278+0000 7f60e77fe700 1 -- 172.21.15.111:0/113944757 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e000bbf0 con 0x7f60e8146d40 2024-04-25T02:25:08.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.278+0000 7f60e77fe700 1 -- 172.21.15.111:0/113944757 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e0012430 con 0x7f60e8146d40 2024-04-25T02:25:08.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.279+0000 7f60ef20b700 1 -- 172.21.15.111:0/113944757 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f60e8146d40 msgr2=0x7f60e8149120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:08.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.279+0000 7f60ef20b700 1 --2- 172.21.15.111:0/113944757 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f60e8146d40 0x7f60e8149120 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f60e0009e60 tx=0x7f60e0009780 comp rx=0 tx=0).stop 2024-04-25T02:25:08.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.279+0000 7f60ef20b700 1 -- 172.21.15.111:0/113944757 shutdown_connections 2024-04-25T02:25:08.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.279+0000 7f60ef20b700 1 --2- 172.21.15.111:0/113944757 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f60e8146d40 0x7f60e8149120 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:08.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.279+0000 7f60ef20b700 1 --2- 172.21.15.111:0/113944757 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f60e813b750 0x7f60e813bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:08.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.279+0000 7f60ef20b700 1 -- 172.21.15.111:0/113944757 >> 172.21.15.111:0/113944757 conn(0x7f60e8069370 msgr2=0x7f60e8069770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:25:08.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.279+0000 7f60ef20b700 1 -- 172.21.15.111:0/113944757 shutdown_connections 2024-04-25T02:25:08.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.279+0000 7f60ef20b700 1 -- 172.21.15.111:0/113944757 wait complete. 2024-04-25T02:25:08.287 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.280+0000 7f60ef20b700 1 Processor -- start 2024-04-25T02:25:08.288 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.281+0000 7f60ef20b700 1 -- start start 2024-04-25T02:25:08.288 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.281+0000 7f60ef20b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f60e8071200 0x7f60e8141d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:25:08.288 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.281+0000 7f60ef20b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f60e813b750 0x7f60e8143cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:25:08.288 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.281+0000 7f60ef20b700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f60e8146d40 0x7f60e8144230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:25:08.288 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.281+0000 7f60ef20b700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60e81391d0 con 0x7f60e813b750 2024-04-25T02:25:08.289 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.281+0000 7f60ef20b700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60e81405c0 con 0x7f60e8146d40 2024-04-25T02:25:08.289 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.281+0000 7f60ef20b700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f60e8141850 con 0x7f60e8071200 2024-04-25T02:25:08.289 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.281+0000 7f60e7fff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f60e813b750 0x7f60e8143cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:25:08.289 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.281+0000 7f60ecfa7700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f60e8071200 0x7f60e8141d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:25:08.289 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.281+0000 7f60ed7a8700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f60e8146d40 0x7f60e8144230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:25:08.289 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.281+0000 7f60ecfa7700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f60e8071200 0x7f60e8141d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:38396/0 (socket says 172.21.15.111:38396) 2024-04-25T02:25:08.289 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.281+0000 7f60e7fff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f60e813b750 0x7f60e8143cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52584/0 (socket says 172.21.15.111:52584) 2024-04-25T02:25:08.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.281+0000 7f60ecfa7700 1 -- 172.21.15.111:0/3175090757 learned_addr learned my addr 172.21.15.111:0/3175090757 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:25:08.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.282+0000 7f60ed7a8700 1 -- 172.21.15.111:0/3175090757 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f60e8071200 msgr2=0x7f60e8141d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:08.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.282+0000 7f60ed7a8700 1 --2- 172.21.15.111:0/3175090757 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f60e8071200 0x7f60e8141d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:08.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.282+0000 7f60ed7a8700 1 -- 172.21.15.111:0/3175090757 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f60e813b750 msgr2=0x7f60e8143cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:08.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.282+0000 7f60ed7a8700 1 --2- 172.21.15.111:0/3175090757 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f60e813b750 0x7f60e8143cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:08.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.282+0000 7f60ed7a8700 1 -- 172.21.15.111:0/3175090757 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60d4009420 con 0x7f60e8146d40 2024-04-25T02:25:08.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.282+0000 7f60ecfa7700 1 --2- 172.21.15.111:0/3175090757 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f60e8071200 0x7f60e8141d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:25:08.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.282+0000 7f60ed7a8700 1 --2- 172.21.15.111:0/3175090757 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f60e8146d40 0x7f60e8144230 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f60e0009e60 tx=0x7f60e0019000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:25:08.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.282+0000 7f60e4ff9700 1 -- 172.21.15.111:0/3175090757 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e001b420 con 0x7f60e8146d40 2024-04-25T02:25:08.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.282+0000 7f60e4ff9700 1 -- 172.21.15.111:0/3175090757 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f60e001b580 con 0x7f60e8146d40 2024-04-25T02:25:08.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.282+0000 7f60e4ff9700 1 -- 172.21.15.111:0/3175090757 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60e001b940 con 0x7f60e8146d40 2024-04-25T02:25:08.290 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.282+0000 7f60ef20b700 1 -- 172.21.15.111:0/3175090757 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60e0009a20 con 0x7f60e8146d40 2024-04-25T02:25:08.291 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.282+0000 7f60ef20b700 1 -- 172.21.15.111:0/3175090757 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60e8141570 con 0x7f60e8146d40 2024-04-25T02:25:08.291 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.283+0000 7f60ef20b700 1 -- 172.21.15.111:0/3175090757 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60e8072200 con 0x7f60e8146d40 2024-04-25T02:25:08.291 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.283+0000 7f60e4ff9700 1 -- 172.21.15.111:0/3175090757 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f60e001bcf0 con 0x7f60e8146d40 2024-04-25T02:25:08.291 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.283+0000 7f60e4ff9700 1 -- 172.21.15.111:0/3175090757 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4115+0+0 (secure 0 0 0) 0x7f60e005cbc0 con 0x7f60e8146d40 2024-04-25T02:25:08.292 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.287+0000 7f60e4ff9700 1 -- 172.21.15.111:0/3175090757 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f60e002fe00 con 0x7f60e8146d40 2024-04-25T02:25:08.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.468+0000 7f60ef20b700 1 -- 172.21.15.111:0/3175090757 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "fs dump", "format": "json-pretty"} v 0) v1 -- 0x7f60e8069b70 con 0x7f60e8146d40 2024-04-25T02:25:08.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.469+0000 7f60e4ff9700 1 -- 172.21.15.111:0/3175090757 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json-pretty"}]=0 dumped fsmap epoch 19 v19) v1 ==== 101+0+7635 (secure 0 0 0) 0x7f60e002a020 con 0x7f60e8146d40 2024-04-25T02:25:08.476 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:25:08.476 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-25T02:25:08.476 INFO:teuthology.orchestra.run.smithi111.stdout: "epoch": 19, 2024-04-25T02:25:08.476 INFO:teuthology.orchestra.run.smithi111.stdout: "default_fscid": 1, 2024-04-25T02:25:08.476 INFO:teuthology.orchestra.run.smithi111.stdout: "compat": { 2024-04-25T02:25:08.476 INFO:teuthology.orchestra.run.smithi111.stdout: "compat": {}, 2024-04-25T02:25:08.477 INFO:teuthology.orchestra.run.smithi111.stdout: "ro_compat": {}, 2024-04-25T02:25:08.477 INFO:teuthology.orchestra.run.smithi111.stdout: "incompat": { 2024-04-25T02:25:08.477 INFO:teuthology.orchestra.run.smithi111.stdout: "feature_1": "base v0.20", 2024-04-25T02:25:08.477 INFO:teuthology.orchestra.run.smithi111.stdout: "feature_2": "client writeable ranges", 2024-04-25T02:25:08.477 INFO:teuthology.orchestra.run.smithi111.stdout: "feature_3": "default file layouts on dirs", 2024-04-25T02:25:08.477 INFO:teuthology.orchestra.run.smithi111.stdout: "feature_4": "dir inode in separate object", 2024-04-25T02:25:08.477 INFO:teuthology.orchestra.run.smithi111.stdout: "feature_5": "mds uses versioned encoding", 2024-04-25T02:25:08.477 INFO:teuthology.orchestra.run.smithi111.stdout: "feature_6": "dirfrag is stored in omap", 2024-04-25T02:25:08.477 INFO:teuthology.orchestra.run.smithi111.stdout: "feature_8": "no anchor table", 2024-04-25T02:25:08.478 INFO:teuthology.orchestra.run.smithi111.stdout: "feature_9": "file layout v2", 2024-04-25T02:25:08.478 INFO:teuthology.orchestra.run.smithi111.stdout: "feature_10": "snaprealm v2" 2024-04-25T02:25:08.478 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-25T02:25:08.478 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:25:08.478 INFO:teuthology.orchestra.run.smithi111.stdout: "feature_flags": { 2024-04-25T02:25:08.478 INFO:teuthology.orchestra.run.smithi111.stdout: "enable_multiple": false, 2024-04-25T02:25:08.478 INFO:teuthology.orchestra.run.smithi111.stdout: "ever_enabled_multiple": true 2024-04-25T02:25:08.479 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:25:08.479 INFO:teuthology.orchestra.run.smithi111.stdout: "standbys": [ 2024-04-25T02:25:08.479 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-25T02:25:08.479 INFO:teuthology.orchestra.run.smithi111.stdout: "gid": 14404, 2024-04-25T02:25:08.479 INFO:teuthology.orchestra.run.smithi111.stdout: "name": "c", 2024-04-25T02:25:08.479 INFO:teuthology.orchestra.run.smithi111.stdout: "rank": -1, 2024-04-25T02:25:08.479 INFO:teuthology.orchestra.run.smithi111.stdout: "incarnation": 0, 2024-04-25T02:25:08.479 INFO:teuthology.orchestra.run.smithi111.stdout: "state": "up:standby", 2024-04-25T02:25:08.479 INFO:teuthology.orchestra.run.smithi111.stdout: "state_seq": 1, 2024-04-25T02:25:08.479 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6818/4022954817", 2024-04-25T02:25:08.479 INFO:teuthology.orchestra.run.smithi111.stdout: "addrs": { 2024-04-25T02:25:08.479 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-25T02:25:08.479 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-25T02:25:08.479 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-25T02:25:08.480 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6818", 2024-04-25T02:25:08.480 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 4022954817 2024-04-25T02:25:08.480 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-25T02:25:08.480 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-25T02:25:08.480 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:25:08.480 INFO:teuthology.orchestra.run.smithi111.stdout: "join_fscid": -1, 2024-04-25T02:25:08.480 INFO:teuthology.orchestra.run.smithi111.stdout: "export_targets": [], 2024-04-25T02:25:08.480 INFO:teuthology.orchestra.run.smithi111.stdout: "features": 4540138320759226367, 2024-04-25T02:25:08.480 INFO:teuthology.orchestra.run.smithi111.stdout: "flags": 0, 2024-04-25T02:25:08.480 INFO:teuthology.orchestra.run.smithi111.stdout: "compat": { 2024-04-25T02:25:08.480 INFO:teuthology.orchestra.run.smithi111.stdout: "compat": {}, 2024-04-25T02:25:08.480 INFO:teuthology.orchestra.run.smithi111.stdout: "ro_compat": {}, 2024-04-25T02:25:08.480 INFO:teuthology.orchestra.run.smithi111.stdout: "incompat": { 2024-04-25T02:25:08.480 INFO:teuthology.orchestra.run.smithi111.stdout: "feature_1": "base v0.20", 2024-04-25T02:25:08.480 INFO:teuthology.orchestra.run.smithi111.stdout: "feature_2": "client writeable ranges", 2024-04-25T02:25:08.481 INFO:teuthology.orchestra.run.smithi111.stdout: "feature_3": "default file layouts on dirs", 2024-04-25T02:25:08.481 INFO:teuthology.orchestra.run.smithi111.stdout: "feature_4": "dir inode in separate object", 2024-04-25T02:25:08.481 INFO:teuthology.orchestra.run.smithi111.stdout: "feature_5": "mds uses versioned encoding", 2024-04-25T02:25:08.481 INFO:teuthology.orchestra.run.smithi111.stdout: "feature_6": "dirfrag is stored in omap", 2024-04-25T02:25:08.481 INFO:teuthology.orchestra.run.smithi111.stdout: "feature_7": "mds uses inline data", 2024-04-25T02:25:08.481 INFO:teuthology.orchestra.run.smithi111.stdout: "feature_8": "no anchor table", 2024-04-25T02:25:08.481 INFO:teuthology.orchestra.run.smithi111.stdout: "feature_9": "file layout v2", 2024-04-25T02:25:08.481 INFO:teuthology.orchestra.run.smithi111.stdout: "feature_10": "snaprealm v2" 2024-04-25T02:25:08.481 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-25T02:25:08.481 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:25:08.481 INFO:teuthology.orchestra.run.smithi111.stdout: "epoch": 14 2024-04-25T02:25:08.481 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:25:08.482 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-25T02:25:08.482 INFO:teuthology.orchestra.run.smithi111.stdout: "gid": 14405, 2024-04-25T02:25:08.482 INFO:teuthology.orchestra.run.smithi111.stdout: "name": "a", 2024-04-25T02:25:08.482 INFO:teuthology.orchestra.run.smithi111.stdout: "rank": -1, 2024-04-25T02:25:08.482 INFO:teuthology.orchestra.run.smithi111.stdout: "incarnation": 0, 2024-04-25T02:25:08.482 INFO:teuthology.orchestra.run.smithi111.stdout: "state": "up:standby", 2024-04-25T02:25:08.482 INFO:teuthology.orchestra.run.smithi111.stdout: "state_seq": 1, 2024-04-25T02:25:08.482 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6817/1113530749", 2024-04-25T02:25:08.482 INFO:teuthology.orchestra.run.smithi111.stdout: "addrs": { 2024-04-25T02:25:08.482 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-25T02:25:08.482 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-25T02:25:08.482 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-25T02:25:08.482 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6817", 2024-04-25T02:25:08.483 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 1113530749 2024-04-25T02:25:08.483 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-25T02:25:08.483 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-25T02:25:08.483 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:25:08.483 INFO:teuthology.orchestra.run.smithi111.stdout: "join_fscid": -1, 2024-04-25T02:25:08.483 INFO:teuthology.orchestra.run.smithi111.stdout: "export_targets": [], 2024-04-25T02:25:08.483 INFO:teuthology.orchestra.run.smithi111.stdout: "features": 4540138320759226367, 2024-04-25T02:25:08.483 INFO:teuthology.orchestra.run.smithi111.stdout: "flags": 0, 2024-04-25T02:25:08.483 INFO:teuthology.orchestra.run.smithi111.stdout: "compat": { 2024-04-25T02:25:08.484 INFO:teuthology.orchestra.run.smithi111.stdout: "compat": {}, 2024-04-25T02:25:08.484 INFO:teuthology.orchestra.run.smithi111.stdout: "ro_compat": {}, 2024-04-25T02:25:08.484 INFO:teuthology.orchestra.run.smithi111.stdout: "incompat": { 2024-04-25T02:25:08.484 INFO:teuthology.orchestra.run.smithi111.stdout: "feature_1": "base v0.20", 2024-04-25T02:25:08.484 INFO:teuthology.orchestra.run.smithi111.stdout: "feature_2": "client writeable ranges", 2024-04-25T02:25:08.484 INFO:teuthology.orchestra.run.smithi111.stdout: "feature_3": "default file layouts on dirs", 2024-04-25T02:25:08.484 INFO:teuthology.orchestra.run.smithi111.stdout: "feature_4": "dir inode in separate object", 2024-04-25T02:25:08.484 INFO:teuthology.orchestra.run.smithi111.stdout: "feature_5": "mds uses versioned encoding", 2024-04-25T02:25:08.484 INFO:teuthology.orchestra.run.smithi111.stdout: "feature_6": "dirfrag is stored in omap", 2024-04-25T02:25:08.484 INFO:teuthology.orchestra.run.smithi111.stdout: "feature_7": "mds uses inline data", 2024-04-25T02:25:08.484 INFO:teuthology.orchestra.run.smithi111.stdout: "feature_8": "no anchor table", 2024-04-25T02:25:08.484 INFO:teuthology.orchestra.run.smithi111.stdout: "feature_9": "file layout v2", 2024-04-25T02:25:08.484 INFO:teuthology.orchestra.run.smithi111.stdout: "feature_10": "snaprealm v2" 2024-04-25T02:25:08.484 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-25T02:25:08.485 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:25:08.485 INFO:teuthology.orchestra.run.smithi111.stdout: "epoch": 16 2024-04-25T02:25:08.485 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-25T02:25:08.485 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-04-25T02:25:08.485 INFO:teuthology.orchestra.run.smithi111.stdout: "filesystems": [ 2024-04-25T02:25:08.485 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-25T02:25:08.485 INFO:teuthology.orchestra.run.smithi111.stdout: "mdsmap": { 2024-04-25T02:25:08.485 INFO:teuthology.orchestra.run.smithi111.stdout: "epoch": 19, 2024-04-25T02:25:08.485 INFO:teuthology.orchestra.run.smithi111.stdout: "flags": 18, 2024-04-25T02:25:08.485 INFO:teuthology.orchestra.run.smithi111.stdout: "flags_state": { 2024-04-25T02:25:08.485 INFO:teuthology.orchestra.run.smithi111.stdout: "joinable": true, 2024-04-25T02:25:08.485 INFO:teuthology.orchestra.run.smithi111.stdout: "allow_snaps": true, 2024-04-25T02:25:08.485 INFO:teuthology.orchestra.run.smithi111.stdout: "allow_multimds_snaps": true, 2024-04-25T02:25:08.485 INFO:teuthology.orchestra.run.smithi111.stdout: "allow_standby_replay": false 2024-04-25T02:25:08.486 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:25:08.486 INFO:teuthology.orchestra.run.smithi111.stdout: "ever_allowed_features": 0, 2024-04-25T02:25:08.486 INFO:teuthology.orchestra.run.smithi111.stdout: "explicitly_allowed_features": 0, 2024-04-25T02:25:08.486 INFO:teuthology.orchestra.run.smithi111.stdout: "created": "2024-04-25T02:20:24.150791+0000", 2024-04-25T02:25:08.486 INFO:teuthology.orchestra.run.smithi111.stdout: "modified": "2024-04-25T02:23:19.864524+0000", 2024-04-25T02:25:08.486 INFO:teuthology.orchestra.run.smithi111.stdout: "tableserver": 0, 2024-04-25T02:25:08.486 INFO:teuthology.orchestra.run.smithi111.stdout: "root": 0, 2024-04-25T02:25:08.486 INFO:teuthology.orchestra.run.smithi111.stdout: "session_timeout": 60, 2024-04-25T02:25:08.486 INFO:teuthology.orchestra.run.smithi111.stdout: "session_autoclose": 300, 2024-04-25T02:25:08.486 INFO:teuthology.orchestra.run.smithi111.stdout: "required_client_features": {}, 2024-04-25T02:25:08.486 INFO:teuthology.orchestra.run.smithi111.stdout: "max_file_size": 1099511627776, 2024-04-25T02:25:08.486 INFO:teuthology.orchestra.run.smithi111.stdout: "last_failure": 0, 2024-04-25T02:25:08.486 INFO:teuthology.orchestra.run.smithi111.stdout: "last_failure_osd_epoch": 34, 2024-04-25T02:25:08.486 INFO:teuthology.orchestra.run.smithi111.stdout: "compat": { 2024-04-25T02:25:08.486 INFO:teuthology.orchestra.run.smithi111.stdout: "compat": {}, 2024-04-25T02:25:08.487 INFO:teuthology.orchestra.run.smithi111.stdout: "ro_compat": {}, 2024-04-25T02:25:08.487 INFO:teuthology.orchestra.run.smithi111.stdout: "incompat": { 2024-04-25T02:25:08.487 INFO:teuthology.orchestra.run.smithi111.stdout: "feature_1": "base v0.20", 2024-04-25T02:25:08.487 INFO:teuthology.orchestra.run.smithi111.stdout: "feature_2": "client writeable ranges", 2024-04-25T02:25:08.487 INFO:teuthology.orchestra.run.smithi111.stdout: "feature_3": "default file layouts on dirs", 2024-04-25T02:25:08.487 INFO:teuthology.orchestra.run.smithi111.stdout: "feature_4": "dir inode in separate object", 2024-04-25T02:25:08.487 INFO:teuthology.orchestra.run.smithi111.stdout: "feature_5": "mds uses versioned encoding", 2024-04-25T02:25:08.487 INFO:teuthology.orchestra.run.smithi111.stdout: "feature_6": "dirfrag is stored in omap", 2024-04-25T02:25:08.487 INFO:teuthology.orchestra.run.smithi111.stdout: "feature_7": "mds uses inline data", 2024-04-25T02:25:08.487 INFO:teuthology.orchestra.run.smithi111.stdout: "feature_8": "no anchor table", 2024-04-25T02:25:08.487 INFO:teuthology.orchestra.run.smithi111.stdout: "feature_9": "file layout v2", 2024-04-25T02:25:08.487 INFO:teuthology.orchestra.run.smithi111.stdout: "feature_10": "snaprealm v2" 2024-04-25T02:25:08.487 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-25T02:25:08.487 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:25:08.488 INFO:teuthology.orchestra.run.smithi111.stdout: "max_mds": 1, 2024-04-25T02:25:08.488 INFO:teuthology.orchestra.run.smithi111.stdout: "in": [ 2024-04-25T02:25:08.488 INFO:teuthology.orchestra.run.smithi111.stdout: 0 2024-04-25T02:25:08.488 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-04-25T02:25:08.488 INFO:teuthology.orchestra.run.smithi111.stdout: "up": { 2024-04-25T02:25:08.488 INFO:teuthology.orchestra.run.smithi111.stdout: "mds_0": 14417 2024-04-25T02:25:08.488 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:25:08.488 INFO:teuthology.orchestra.run.smithi111.stdout: "failed": [], 2024-04-25T02:25:08.488 INFO:teuthology.orchestra.run.smithi111.stdout: "damaged": [], 2024-04-25T02:25:08.488 INFO:teuthology.orchestra.run.smithi111.stdout: "stopped": [ 2024-04-25T02:25:08.488 INFO:teuthology.orchestra.run.smithi111.stdout: 1 2024-04-25T02:25:08.488 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-04-25T02:25:08.489 INFO:teuthology.orchestra.run.smithi111.stdout: "info": { 2024-04-25T02:25:08.489 INFO:teuthology.orchestra.run.smithi111.stdout: "gid_14417": { 2024-04-25T02:25:08.489 INFO:teuthology.orchestra.run.smithi111.stdout: "gid": 14417, 2024-04-25T02:25:08.489 INFO:teuthology.orchestra.run.smithi111.stdout: "name": "b", 2024-04-25T02:25:08.489 INFO:teuthology.orchestra.run.smithi111.stdout: "rank": 0, 2024-04-25T02:25:08.489 INFO:teuthology.orchestra.run.smithi111.stdout: "incarnation": 16, 2024-04-25T02:25:08.489 INFO:teuthology.orchestra.run.smithi111.stdout: "state": "up:active", 2024-04-25T02:25:08.489 INFO:teuthology.orchestra.run.smithi111.stdout: "state_seq": 4, 2024-04-25T02:25:08.489 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6819/696898730", 2024-04-25T02:25:08.489 INFO:teuthology.orchestra.run.smithi111.stdout: "addrs": { 2024-04-25T02:25:08.489 INFO:teuthology.orchestra.run.smithi111.stdout: "addrvec": [ 2024-04-25T02:25:08.489 INFO:teuthology.orchestra.run.smithi111.stdout: { 2024-04-25T02:25:08.489 INFO:teuthology.orchestra.run.smithi111.stdout: "type": "v1", 2024-04-25T02:25:08.490 INFO:teuthology.orchestra.run.smithi111.stdout: "addr": "172.21.15.111:6819", 2024-04-25T02:25:08.490 INFO:teuthology.orchestra.run.smithi111.stdout: "nonce": 696898730 2024-04-25T02:25:08.490 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-25T02:25:08.490 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-25T02:25:08.490 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:25:08.490 INFO:teuthology.orchestra.run.smithi111.stdout: "join_fscid": -1, 2024-04-25T02:25:08.490 INFO:teuthology.orchestra.run.smithi111.stdout: "export_targets": [], 2024-04-25T02:25:08.490 INFO:teuthology.orchestra.run.smithi111.stdout: "features": 4540138320759226367, 2024-04-25T02:25:08.490 INFO:teuthology.orchestra.run.smithi111.stdout: "flags": 0, 2024-04-25T02:25:08.491 INFO:teuthology.orchestra.run.smithi111.stdout: "compat": { 2024-04-25T02:25:08.491 INFO:teuthology.orchestra.run.smithi111.stdout: "compat": {}, 2024-04-25T02:25:08.491 INFO:teuthology.orchestra.run.smithi111.stdout: "ro_compat": {}, 2024-04-25T02:25:08.491 INFO:teuthology.orchestra.run.smithi111.stdout: "incompat": { 2024-04-25T02:25:08.491 INFO:teuthology.orchestra.run.smithi111.stdout: "feature_1": "base v0.20", 2024-04-25T02:25:08.491 INFO:teuthology.orchestra.run.smithi111.stdout: "feature_2": "client writeable ranges", 2024-04-25T02:25:08.491 INFO:teuthology.orchestra.run.smithi111.stdout: "feature_3": "default file layouts on dirs", 2024-04-25T02:25:08.491 INFO:teuthology.orchestra.run.smithi111.stdout: "feature_4": "dir inode in separate object", 2024-04-25T02:25:08.491 INFO:teuthology.orchestra.run.smithi111.stdout: "feature_5": "mds uses versioned encoding", 2024-04-25T02:25:08.491 INFO:teuthology.orchestra.run.smithi111.stdout: "feature_6": "dirfrag is stored in omap", 2024-04-25T02:25:08.491 INFO:teuthology.orchestra.run.smithi111.stdout: "feature_7": "mds uses inline data", 2024-04-25T02:25:08.491 INFO:teuthology.orchestra.run.smithi111.stdout: "feature_8": "no anchor table", 2024-04-25T02:25:08.491 INFO:teuthology.orchestra.run.smithi111.stdout: "feature_9": "file layout v2", 2024-04-25T02:25:08.491 INFO:teuthology.orchestra.run.smithi111.stdout: "feature_10": "snaprealm v2" 2024-04-25T02:25:08.492 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-25T02:25:08.492 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-25T02:25:08.492 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-25T02:25:08.492 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:25:08.492 INFO:teuthology.orchestra.run.smithi111.stdout: "data_pools": [ 2024-04-25T02:25:08.492 INFO:teuthology.orchestra.run.smithi111.stdout: 4 2024-04-25T02:25:08.492 INFO:teuthology.orchestra.run.smithi111.stdout: ], 2024-04-25T02:25:08.492 INFO:teuthology.orchestra.run.smithi111.stdout: "metadata_pool": 3, 2024-04-25T02:25:08.492 INFO:teuthology.orchestra.run.smithi111.stdout: "enabled": true, 2024-04-25T02:25:08.492 INFO:teuthology.orchestra.run.smithi111.stdout: "fs_name": "cephfs", 2024-04-25T02:25:08.492 INFO:teuthology.orchestra.run.smithi111.stdout: "balancer": "", 2024-04-25T02:25:08.492 INFO:teuthology.orchestra.run.smithi111.stdout: "standby_count_wanted": 0 2024-04-25T02:25:08.493 INFO:teuthology.orchestra.run.smithi111.stdout: }, 2024-04-25T02:25:08.493 INFO:teuthology.orchestra.run.smithi111.stdout: "id": 1 2024-04-25T02:25:08.493 INFO:teuthology.orchestra.run.smithi111.stdout: } 2024-04-25T02:25:08.493 INFO:teuthology.orchestra.run.smithi111.stdout: ] 2024-04-25T02:25:08.493 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-25T02:25:08.495 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.470+0000 7f60ef20b700 1 -- 172.21.15.111:0/3175090757 >> v1:172.21.15.111:6816/46482 conn(0x7f60cc045ef0 legacy=0x7f60cc0483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:08.495 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.470+0000 7f60ef20b700 1 -- 172.21.15.111:0/3175090757 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f60e8146d40 msgr2=0x7f60e8144230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:08.495 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.470+0000 7f60ef20b700 1 --2- 172.21.15.111:0/3175090757 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f60e8146d40 0x7f60e8144230 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f60e0009e60 tx=0x7f60e0019000 comp rx=0 tx=0).stop 2024-04-25T02:25:08.495 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.471+0000 7f60ef20b700 1 -- 172.21.15.111:0/3175090757 shutdown_connections 2024-04-25T02:25:08.495 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.471+0000 7f60ef20b700 1 --2- 172.21.15.111:0/3175090757 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f60e8146d40 0x7f60e8144230 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:08.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.471+0000 7f60ef20b700 1 --2- 172.21.15.111:0/3175090757 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f60e8071200 0x7f60e8141d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:08.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.471+0000 7f60ef20b700 1 --2- 172.21.15.111:0/3175090757 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f60e813b750 0x7f60e8143cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:08.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.471+0000 7f60ef20b700 1 -- 172.21.15.111:0/3175090757 >> 172.21.15.111:0/3175090757 conn(0x7f60e8069370 msgr2=0x7f60e80680d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:25:08.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.471+0000 7f60ef20b700 1 -- 172.21.15.111:0/3175090757 shutdown_connections 2024-04-25T02:25:08.496 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.471+0000 7f60ef20b700 1 -- 172.21.15.111:0/3175090757 wait complete. 2024-04-25T02:25:08.496 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 19 2024-04-25T02:25:08.496 DEBUG:teuthology.orchestra.run.smithi111:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs required_client_features cephfs add metric_collect' 2024-04-25T02:25:08.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.608+0000 7f8cb280c700 1 Processor -- start 2024-04-25T02:25:08.615 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.608+0000 7f8cb280c700 1 -- start start 2024-04-25T02:25:08.615 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.609+0000 7f8cb280c700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f8cac13bfa0 0x7f8cac06d3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:25:08.615 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.609+0000 7f8cb280c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8cac0a3260 0x7f8cac145910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:25:08.615 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.609+0000 7f8cb280c700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cac06e810 con 0x7f8cac0a1490 2024-04-25T02:25:08.615 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.609+0000 7f8cb280c700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cac06e600 con 0x7f8cac13bfa0 2024-04-25T02:25:08.615 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.609+0000 7f8cb280c700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac06de90 con 0x7f8cac0a3260 2024-04-25T02:25:08.615 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.609+0000 7f8cb0da9700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8cac0a3260 0x7f8cac145910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:25:08.616 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.609+0000 7f8cabfff700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f8cac0a1490 0x7f8cac13b890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:53474/0 (socket says 172.21.15.111:53474) 2024-04-25T02:25:08.616 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.609+0000 7f8cab7fe700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f8cac13bfa0 0x7f8cac06d3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:25:08.616 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.609+0000 7f8cabfff700 1 -- 172.21.15.111:0/2313901941 learned_addr learned my addr 172.21.15.111:0/2313901941 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:25:08.616 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.609+0000 7f8caaffd700 1 -- 172.21.15.111:0/2313901941 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2074210979 0 0) 0x7f8cac06e810 con 0x7f8cac0a1490 2024-04-25T02:25:08.616 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.609+0000 7f8caaffd700 1 -- 172.21.15.111:0/2313901941 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8c94003570 con 0x7f8cac0a1490 2024-04-25T02:25:08.616 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.609+0000 7f8cab7fe700 1 -- 172.21.15.111:0/2313901941 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8cac0a3260 msgr2=0x7f8cac145910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:25:08.616 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.609+0000 7f8cab7fe700 1 --2- 172.21.15.111:0/2313901941 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8cac0a3260 0x7f8cac145910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:08.616 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.609+0000 7f8cab7fe700 1 -- 172.21.15.111:0/2313901941 >> v1:172.21.15.111:6789/0 conn(0x7f8cac0a1490 legacy=0x7f8cac13b890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:08.616 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.609+0000 7f8cab7fe700 1 -- 172.21.15.111:0/2313901941 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cac0b19b0 con 0x7f8cac13bfa0 2024-04-25T02:25:08.616 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.609+0000 7f8cb0da9700 1 --2- 172.21.15.111:0/2313901941 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8cac0a3260 0x7f8cac145910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:25:08.616 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.609+0000 7f8cab7fe700 1 --2- 172.21.15.111:0/2313901941 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8cac13bfa0 0x7f8cac06d3f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c0098e0 tx=0x7f8c9c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=edac809079aae133 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:25:08.616 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.609+0000 7f8caaffd700 1 -- 172.21.15.111:0/2313901941 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c011630 con 0x7f8cac13bfa0 2024-04-25T02:25:08.616 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.609+0000 7f8caaffd700 1 -- 172.21.15.111:0/2313901941 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c9c011790 con 0x7f8cac13bfa0 2024-04-25T02:25:08.617 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.609+0000 7f8caaffd700 1 -- 172.21.15.111:0/2313901941 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c9c011b10 con 0x7f8cac13bfa0 2024-04-25T02:25:08.617 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.610+0000 7f8cb280c700 1 -- 172.21.15.111:0/2313901941 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8cac13bfa0 msgr2=0x7f8cac06d3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:08.617 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.610+0000 7f8cb280c700 1 --2- 172.21.15.111:0/2313901941 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8cac13bfa0 0x7f8cac06d3f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f8c9c0098e0 tx=0x7f8c9c0091a0 comp rx=0 tx=0).stop 2024-04-25T02:25:08.617 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.610+0000 7f8cb280c700 1 -- 172.21.15.111:0/2313901941 shutdown_connections 2024-04-25T02:25:08.617 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.610+0000 7f8cb280c700 1 --2- 172.21.15.111:0/2313901941 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8cac0a3260 0x7f8cac145910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:08.617 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.610+0000 7f8cb280c700 1 --2- 172.21.15.111:0/2313901941 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8cac13bfa0 0x7f8cac06d3f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:08.617 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.610+0000 7f8cb280c700 1 -- 172.21.15.111:0/2313901941 >> 172.21.15.111:0/2313901941 conn(0x7f8cac0b0c90 msgr2=0x7f8cac0b1090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:25:08.617 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.610+0000 7f8cb280c700 1 -- 172.21.15.111:0/2313901941 shutdown_connections 2024-04-25T02:25:08.618 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.610+0000 7f8cb280c700 1 -- 172.21.15.111:0/2313901941 wait complete. 2024-04-25T02:25:08.618 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.611+0000 7f8cb280c700 1 Processor -- start 2024-04-25T02:25:08.618 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.611+0000 7f8cb280c700 1 -- start start 2024-04-25T02:25:08.620 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.611+0000 7f8cb280c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8cac0a1490 0x7f8cac0a61d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:25:08.620 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.611+0000 7f8cb280c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8cac0a3260 0x7f8cac152070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:25:08.620 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.612+0000 7f8cb280c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8cac13bfa0 0x7f8cac14e780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:25:08.620 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.612+0000 7f8cb280c700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac09f0b0 con 0x7f8cac13bfa0 2024-04-25T02:25:08.620 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.612+0000 7f8cb280c700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac09fcb0 con 0x7f8cac0a1490 2024-04-25T02:25:08.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.612+0000 7f8cb280c700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8cac14e4c0 con 0x7f8cac0a3260 2024-04-25T02:25:08.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.612+0000 7f8cab7fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8cac0a3260 0x7f8cac152070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:25:08.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.612+0000 7f8cb0da9700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8cac13bfa0 0x7f8cac14e780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:25:08.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.612+0000 7f8cab7fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8cac0a3260 0x7f8cac152070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:38398/0 (socket says 172.21.15.111:38398) 2024-04-25T02:25:08.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.612+0000 7f8cab7fe700 1 -- 172.21.15.111:0/3334231982 learned_addr learned my addr 172.21.15.111:0/3334231982 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:25:08.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.612+0000 7f8cb0da9700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8cac13bfa0 0x7f8cac14e780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:52602/0 (socket says 172.21.15.111:52602) 2024-04-25T02:25:08.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.612+0000 7f8cabfff700 1 --2- 172.21.15.111:0/3334231982 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8cac0a1490 0x7f8cac0a61d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:25:08.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.612+0000 7f8cb0da9700 1 -- 172.21.15.111:0/3334231982 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8cac0a3260 msgr2=0x7f8cac152070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:08.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.612+0000 7f8cb0da9700 1 --2- 172.21.15.111:0/3334231982 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8cac0a3260 0x7f8cac152070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:08.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.612+0000 7f8cb0da9700 1 -- 172.21.15.111:0/3334231982 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8cac0a1490 msgr2=0x7f8cac0a61d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:08.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.612+0000 7f8cb0da9700 1 --2- 172.21.15.111:0/3334231982 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8cac0a1490 0x7f8cac0a61d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:08.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.612+0000 7f8cb0da9700 1 -- 172.21.15.111:0/3334231982 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ca4009a20 con 0x7f8cac13bfa0 2024-04-25T02:25:08.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.612+0000 7f8cabfff700 1 --2- 172.21.15.111:0/3334231982 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8cac0a1490 0x7f8cac0a61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:25:08.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.612+0000 7f8cb0da9700 1 --2- 172.21.15.111:0/3334231982 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8cac13bfa0 0x7f8cac14e780 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4009e70 tx=0x7f8ca400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:25:08.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.612+0000 7f8c93fff700 1 -- 172.21.15.111:0/3334231982 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca400caa0 con 0x7f8cac13bfa0 2024-04-25T02:25:08.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.612+0000 7f8c93fff700 1 -- 172.21.15.111:0/3334231982 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ca400f040 con 0x7f8cac13bfa0 2024-04-25T02:25:08.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.612+0000 7f8cb280c700 1 -- 172.21.15.111:0/3334231982 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c9c009420 con 0x7f8cac13bfa0 2024-04-25T02:25:08.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.612+0000 7f8c93fff700 1 -- 172.21.15.111:0/3334231982 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ca400ce90 con 0x7f8cac13bfa0 2024-04-25T02:25:08.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.612+0000 7f8cb280c700 1 -- 172.21.15.111:0/3334231982 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cac0a5690 con 0x7f8cac13bfa0 2024-04-25T02:25:08.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.613+0000 7f8c93fff700 1 -- 172.21.15.111:0/3334231982 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f8ca4003020 con 0x7f8cac13bfa0 2024-04-25T02:25:08.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.613+0000 7f8cb280c700 1 -- 172.21.15.111:0/3334231982 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cac04c710 con 0x7f8cac13bfa0 2024-04-25T02:25:08.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.613+0000 7f8c93fff700 1 -- 172.21.15.111:0/3334231982 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4115+0+0 (secure 0 0 0) 0x7f8ca405b8d0 con 0x7f8cac13bfa0 2024-04-25T02:25:08.622 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.617+0000 7f8c93fff700 1 -- 172.21.15.111:0/3334231982 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f8ca4039b80 con 0x7f8cac13bfa0 2024-04-25T02:25:08.805 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:08.801+0000 7f8cb280c700 1 -- 172.21.15.111:0/3334231982 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs required_client_features", "fs_name": "cephfs", "subop": "add", "val": "metric_collect"} v 0) v1 -- 0x7f8cac151e60 con 0x7f8cac13bfa0 2024-04-25T02:25:09.064 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:09.060+0000 7f8c93fff700 1 -- 172.21.15.111:0/3334231982 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs required_client_features", "fs_name": "cephfs", "subop": "add", "val": "metric_collect"}]=0 added feature 'metric_collect' to required_client_features v20) v1 ==== 195+0+0 (secure 0 0 0) 0x7f8ca4018020 con 0x7f8cac13bfa0 2024-04-25T02:25:09.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:09.062+0000 7f8cb280c700 1 -- 172.21.15.111:0/3334231982 >> v1:172.21.15.111:6816/46482 conn(0x7f8c98045ef0 legacy=0x7f8c980483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:09.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:09.062+0000 7f8cb280c700 1 -- 172.21.15.111:0/3334231982 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8cac13bfa0 msgr2=0x7f8cac14e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:09.068 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:09.062+0000 7f8cb280c700 1 --2- 172.21.15.111:0/3334231982 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8cac13bfa0 0x7f8cac14e780 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f8ca4009e70 tx=0x7f8ca400b040 comp rx=0 tx=0).stop 2024-04-25T02:25:09.069 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:09.062+0000 7f8cb280c700 1 -- 172.21.15.111:0/3334231982 shutdown_connections 2024-04-25T02:25:09.069 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:09.062+0000 7f8cb280c700 1 --2- 172.21.15.111:0/3334231982 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8cac13bfa0 0x7f8cac14e780 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:09.069 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:09.062+0000 7f8cb280c700 1 --2- 172.21.15.111:0/3334231982 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8cac0a1490 0x7f8cac0a61d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:09.069 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:09.062+0000 7f8cb280c700 1 --2- 172.21.15.111:0/3334231982 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8cac0a3260 0x7f8cac152070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:09.069 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:09.063+0000 7f8cb280c700 1 -- 172.21.15.111:0/3334231982 >> 172.21.15.111:0/3334231982 conn(0x7f8cac0b0c90 msgr2=0x7f8cac064af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:25:09.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:09.063+0000 7f8cb280c700 1 -- 172.21.15.111:0/3334231982 shutdown_connections 2024-04-25T02:25:09.070 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:09.063+0000 7f8cb280c700 1 -- 172.21.15.111:0/3334231982 wait complete. 2024-04-25T02:25:09.070 INFO:teuthology.orchestra.run.smithi111.stderr:added feature 'metric_collect' to required_client_features 2024-04-25T02:25:09.078 INFO:teuthology.run_tasks:Running task sleep... 2024-04-25T02:25:09.097 INFO:teuthology.task.sleep:Sleeping for 5 seconds 2024-04-25T02:25:14.098 INFO:teuthology.run_tasks:Running task fs.clients_evicted... 2024-04-25T02:25:14.463 INFO:tasks.fs:clients is {'client.0': False, 'client.1': True} 2024-04-25T02:25:14.464 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:25:14.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.588+0000 7f21b3971700 1 Processor -- start 2024-04-25T02:25:14.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.588+0000 7f21b3971700 1 -- start start 2024-04-25T02:25:14.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.589+0000 7f21b3971700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f21ac0b32c0 0x7f21ac069be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:25:14.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.589+0000 7f21b3971700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f21ac06a120 0x7f21ac06eb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:25:14.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.589+0000 7f21b3971700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f21ac0a42a0 0x7f21ac06f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:25:14.593 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.589+0000 7f21b3971700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21ac0a4850 con 0x7f21ac0b32c0 2024-04-25T02:25:14.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.589+0000 7f21b3971700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21ac06a5b0 con 0x7f21ac0a42a0 2024-04-25T02:25:14.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.589+0000 7f21b3971700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21ac06a850 con 0x7f21ac06a120 2024-04-25T02:25:14.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.589+0000 7f21b170d700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f21ac0b32c0 0x7f21ac069be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:25:14.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.589+0000 7f21b0f0c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f21ac06a120 0x7f21ac06eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:25:14.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.589+0000 7f21b0f0c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f21ac06a120 0x7f21ac06eb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:36262/0 (socket says 172.21.15.111:36262) 2024-04-25T02:25:14.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.589+0000 7f21b1f0e700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f21ac0a42a0 0x7f21ac06f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:25:14.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.589+0000 7f21b170d700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f21ac0b32c0 0x7f21ac069be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:40180/0 (socket says 172.21.15.111:40180) 2024-04-25T02:25:14.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.589+0000 7f21b0f0c700 1 -- 172.21.15.111:0/3113197662 learned_addr learned my addr 172.21.15.111:0/3113197662 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:25:14.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.589+0000 7f21b0f0c700 1 -- 172.21.15.111:0/3113197662 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f21ac0a42a0 msgr2=0x7f21ac06f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:25:14.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.589+0000 7f21b0f0c700 1 --2- 172.21.15.111:0/3113197662 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f21ac0a42a0 0x7f21ac06f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:14.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.589+0000 7f21b0f0c700 1 -- 172.21.15.111:0/3113197662 >> v2:172.21.15.111:3300/0 conn(0x7f21ac0b32c0 msgr2=0x7f21ac069be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:25:14.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.589+0000 7f21b0f0c700 1 --2- 172.21.15.111:0/3113197662 >> v2:172.21.15.111:3300/0 conn(0x7f21ac0b32c0 0x7f21ac069be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:14.594 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.589+0000 7f21b0f0c700 1 -- 172.21.15.111:0/3113197662 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21ac0a49c0 con 0x7f21ac06a120 2024-04-25T02:25:14.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.589+0000 7f21b1f0e700 1 --2- 172.21.15.111:0/3113197662 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f21ac0a42a0 0x7f21ac06f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:25:14.595 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.589+0000 7f21b170d700 1 --2- 172.21.15.111:0/3113197662 >> v2:172.21.15.111:3300/0 conn(0x7f21ac0b32c0 0x7f21ac069be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:25:14.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.589+0000 7f21b0f0c700 1 --2- 172.21.15.111:0/3113197662 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f21ac06a120 0x7f21ac06eb60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f21a80099b0 tx=0x7f21a8009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b5bda1a11288e326 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:25:14.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.589+0000 7f21a3fff700 1 -- 172.21.15.111:0/3113197662 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a800b680 con 0x7f21ac06a120 2024-04-25T02:25:14.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.589+0000 7f21a3fff700 1 -- 172.21.15.111:0/3113197662 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21a800b7e0 con 0x7f21ac06a120 2024-04-25T02:25:14.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.589+0000 7f21a3fff700 1 -- 172.21.15.111:0/3113197662 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21a800bb80 con 0x7f21ac06a120 2024-04-25T02:25:14.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.590+0000 7f21b3971700 1 -- 172.21.15.111:0/3113197662 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f21ac06a120 msgr2=0x7f21ac06eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:14.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.590+0000 7f21b3971700 1 --2- 172.21.15.111:0/3113197662 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f21ac06a120 0x7f21ac06eb60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f21a80099b0 tx=0x7f21a8009250 comp rx=0 tx=0).stop 2024-04-25T02:25:14.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.590+0000 7f21b3971700 1 -- 172.21.15.111:0/3113197662 shutdown_connections 2024-04-25T02:25:14.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.590+0000 7f21b3971700 1 --2- 172.21.15.111:0/3113197662 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f21ac0a42a0 0x7f21ac06f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:14.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.590+0000 7f21b3971700 1 --2- 172.21.15.111:0/3113197662 >> v2:172.21.15.111:3300/0 conn(0x7f21ac0b32c0 0x7f21ac069be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:14.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.590+0000 7f21b3971700 1 --2- 172.21.15.111:0/3113197662 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f21ac06a120 0x7f21ac06eb60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:14.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.590+0000 7f21b3971700 1 -- 172.21.15.111:0/3113197662 >> 172.21.15.111:0/3113197662 conn(0x7f21ac06e2b0 msgr2=0x7f21ac06be80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:25:14.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.590+0000 7f21b3971700 1 -- 172.21.15.111:0/3113197662 shutdown_connections 2024-04-25T02:25:14.598 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.590+0000 7f21b3971700 1 -- 172.21.15.111:0/3113197662 wait complete. 2024-04-25T02:25:14.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.591+0000 7f21b3971700 1 Processor -- start 2024-04-25T02:25:14.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.591+0000 7f21b3971700 1 -- start start 2024-04-25T02:25:14.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.592+0000 7f21b3971700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f21ac06a120 0x7f21ac1516b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:25:14.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.592+0000 7f21b3971700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f21ac0a42a0 0x7f21ac151bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:25:14.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.592+0000 7f21b3971700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f21ac0b32c0 0x7f21ac152130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:25:14.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.592+0000 7f21b3971700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21ac098da0 con 0x7f21ac06a120 2024-04-25T02:25:14.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.592+0000 7f21b3971700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21ac0abd70 con 0x7f21ac0a42a0 2024-04-25T02:25:14.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.592+0000 7f21b3971700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f21ac097ab0 con 0x7f21ac0b32c0 2024-04-25T02:25:14.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.592+0000 7f21b170d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f21ac06a120 0x7f21ac1516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:25:14.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.592+0000 7f21b170d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f21ac06a120 0x7f21ac1516b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:40188/0 (socket says 172.21.15.111:40188) 2024-04-25T02:25:14.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.592+0000 7f21b170d700 1 -- 172.21.15.111:0/2497731574 learned_addr learned my addr 172.21.15.111:0/2497731574 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:25:14.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.592+0000 7f21b0f0c700 1 --2- 172.21.15.111:0/2497731574 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f21ac0a42a0 0x7f21ac151bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:25:14.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.592+0000 7f21b1f0e700 1 --2- 172.21.15.111:0/2497731574 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f21ac0b32c0 0x7f21ac152130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:25:14.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.592+0000 7f21b170d700 1 -- 172.21.15.111:0/2497731574 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f21ac0b32c0 msgr2=0x7f21ac152130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:14.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.592+0000 7f21b170d700 1 --2- 172.21.15.111:0/2497731574 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f21ac0b32c0 0x7f21ac152130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:14.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.592+0000 7f21b170d700 1 -- 172.21.15.111:0/2497731574 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f21ac0a42a0 msgr2=0x7f21ac151bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:14.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.592+0000 7f21b170d700 1 --2- 172.21.15.111:0/2497731574 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f21ac0a42a0 0x7f21ac151bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:14.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.592+0000 7f21b170d700 1 -- 172.21.15.111:0/2497731574 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a4009a20 con 0x7f21ac06a120 2024-04-25T02:25:14.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.592+0000 7f21b0f0c700 1 --2- 172.21.15.111:0/2497731574 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f21ac0a42a0 0x7f21ac151bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:25:14.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.592+0000 7f21b170d700 1 --2- 172.21.15.111:0/2497731574 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f21ac06a120 0x7f21ac1516b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f219c00ec80 tx=0x7f219c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:25:14.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.592+0000 7f21a17fa700 1 -- 172.21.15.111:0/2497731574 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219c00c850 con 0x7f21ac06a120 2024-04-25T02:25:14.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.592+0000 7f21a17fa700 1 -- 172.21.15.111:0/2497731574 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f219c00c9b0 con 0x7f21ac06a120 2024-04-25T02:25:14.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.592+0000 7f21a17fa700 1 -- 172.21.15.111:0/2497731574 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f219c00cd30 con 0x7f21ac06a120 2024-04-25T02:25:14.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.592+0000 7f21b3971700 1 -- 172.21.15.111:0/2497731574 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f219c009420 con 0x7f21ac06a120 2024-04-25T02:25:14.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.593+0000 7f21b3971700 1 -- 172.21.15.111:0/2497731574 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21a80094f0 con 0x7f21ac06a120 2024-04-25T02:25:14.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.593+0000 7f21b3971700 1 -- 172.21.15.111:0/2497731574 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21ac065190 con 0x7f21ac06a120 2024-04-25T02:25:14.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.594+0000 7f21a17fa700 1 -- 172.21.15.111:0/2497731574 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f219c013680 con 0x7f21ac06a120 2024-04-25T02:25:14.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.594+0000 7f21a17fa700 1 -- 172.21.15.111:0/2497731574 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4158+0+0 (secure 0 0 0) 0x7f219c05b380 con 0x7f21ac06a120 2024-04-25T02:25:14.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.597+0000 7f21a17fa700 1 -- 172.21.15.111:0/2497731574 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f219c039670 con 0x7f21ac06a120 2024-04-25T02:25:14.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.753+0000 7f21b3971700 1 -- 172.21.15.111:0/2497731574 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f21ac0abb50 con 0x7f21ac06a120 2024-04-25T02:25:14.757 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.753+0000 7f21a17fa700 1 -- 172.21.15.111:0/2497731574 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+12106 (secure 0 0 0) 0x7f219c021020 con 0x7f21ac06a120 2024-04-25T02:25:14.757 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:25:14.757 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":43,"fsid":"4643f974-f93a-4436-93b8-460ff320e62e","created":"2024-04-25T02:20:05.450475+0000","modified":"2024-04-25T02:25:10.060341+0000","last_up_change":"2024-04-25T02:23:12.818028+0000","last_in_change":"2024-04-25T02:20:10.439204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:20:07.471248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:20:14.420378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:20:22.251868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T02:20:23.128289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"df3f17ca-3b12-42c8-8cf7-8f1b7189e587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":41,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6800","nonce":48862}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6801","nonce":48862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6803","nonce":48862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6802","nonce":48862}]},"public_addr":"172.21.15.111:6800/48862","cluster_addr":"172.21.15.111:6801/48862","heartbeat_back_addr":"172.21.15.111:6803/48862","heartbeat_front_addr":"172.21.15.111:6802/48862","state":["exists","up"]},{"osd":1,"uuid":"93d54815-f215-4285-bba6-32f2d1cabf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":29,"up_thru":31,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6804","nonce":48960}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6805","nonce":48960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6807","nonce":48960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6806","nonce":48960}]},"public_addr":"172.21.15.111:6804/48960","cluster_addr":"172.21.15.111:6805/48960","heartbeat_back_addr":"172.21.15.111:6807/48960","heartbeat_front_addr":"172.21.15.111:6806/48960","state":["exists","up"]},{"osd":2,"uuid":"b26b2104-2a2e-408f-9ce7-3587a32a2ebe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":41,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6808","nonce":49070}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6809","nonce":49070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6811","nonce":49070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6810","nonce":49070}]},"public_addr":"172.21.15.111:6808/49070","cluster_addr":"172.21.15.111:6809/49070","heartbeat_back_addr":"172.21.15.111:6811/49070","heartbeat_front_addr":"172.21.15.111:6810/49070","state":["exists","up"]},{"osd":3,"uuid":"43c25820-1edc-4031-badf-72e87dd6bf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":31,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6812","nonce":49243}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6813","nonce":49243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6815","nonce":49243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6814","nonce":49243}]},"public_addr":"172.21.15.111:6812/49243","cluster_addr":"172.21.15.111:6813/49243","heartbeat_back_addr":"172.21.15.111:6815/49243","heartbeat_front_addr":"172.21.15.111:6814/49243","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.372427+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.411480+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.361508+0000","dead_epoch":25},{"osd":3,"down_stamp":"2024-04-25T02:23:06.771296+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.377212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.d","mappings":[{"from":3,"to":2}]},{"pgid":"4.13","mappings":[{"from":3,"to":0}]},{"pgid":"4.19","mappings":[{"from":3,"to":0}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.30","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.186:0/1473940677":"2024-04-25T03:25:09.063135+0000","172.21.15.111:6819/4003866251":"2024-04-26T02:23:16.839679+0000","172.21.15.111:0/2148931273":"2024-04-26T02:22:54.713254+0000","172.21.15.111:6816/39585":"2024-04-26T02:22:54.713254+0000","172.21.15.111:0/3911588907":"2024-04-26T02:22:54.713254+0000","172.21.15.111:0/1276843622":"2024-04-26T02:22:54.713254+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:25:14.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.755+0000 7f21b3971700 1 -- 172.21.15.111:0/2497731574 >> v1:172.21.15.111:6816/46482 conn(0x7f2190045ef0 legacy=0x7f21900483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:14.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.755+0000 7f21b3971700 1 -- 172.21.15.111:0/2497731574 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f21ac06a120 msgr2=0x7f21ac1516b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:14.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.755+0000 7f21b3971700 1 --2- 172.21.15.111:0/2497731574 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f21ac06a120 0x7f21ac1516b0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f219c00ec80 tx=0x7f219c0091a0 comp rx=0 tx=0).stop 2024-04-25T02:25:14.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.755+0000 7f21b3971700 1 -- 172.21.15.111:0/2497731574 shutdown_connections 2024-04-25T02:25:14.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.755+0000 7f21b3971700 1 --2- 172.21.15.111:0/2497731574 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f21ac0b32c0 0x7f21ac152130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:14.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.755+0000 7f21b3971700 1 --2- 172.21.15.111:0/2497731574 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f21ac06a120 0x7f21ac1516b0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:14.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.755+0000 7f21b3971700 1 --2- 172.21.15.111:0/2497731574 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f21ac0a42a0 0x7f21ac151bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:14.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.755+0000 7f21b3971700 1 -- 172.21.15.111:0/2497731574 >> 172.21.15.111:0/2497731574 conn(0x7f21ac06e2b0 msgr2=0x7f21ac063d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:25:14.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.755+0000 7f21b3971700 1 -- 172.21.15.111:0/2497731574 shutdown_connections 2024-04-25T02:25:14.759 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.755+0000 7f21b3971700 1 -- 172.21.15.111:0/2497731574 wait complete. 2024-04-25T02:25:14.770 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:20:07.471248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T02:20:14.420378+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:20:22.251868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:20:23.128289+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T02:25:14.771 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:25:14.889 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.886+0000 7f7501aa8700 1 Processor -- start 2024-04-25T02:25:14.890 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.886+0000 7f7501aa8700 1 -- start start 2024-04-25T02:25:14.892 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.886+0000 7f7501aa8700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f74fc068ba0 0x7f74fc0ad820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:25:14.892 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.886+0000 7f7501aa8700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f74fc06ee20 0x7f74fc13a750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:25:14.892 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.886+0000 7f7501aa8700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f74fc13b010 con 0x7f74fc137a90 2024-04-25T02:25:14.892 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.886+0000 7f7501aa8700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f74fc0add60 con 0x7f74fc068ba0 2024-04-25T02:25:14.892 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.886+0000 7f7501aa8700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f74fc06f5c0 con 0x7f74fc06ee20 2024-04-25T02:25:14.892 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.886+0000 7f74fb7fe700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f74fc068ba0 0x7f74fc0ad820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:25:14.892 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.886+0000 7f74fbfff700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f74fc137a90 0x7f74fc13dcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:33092/0 (socket says 172.21.15.111:33092) 2024-04-25T02:25:14.892 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.886+0000 7f74faffd700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f74fc06ee20 0x7f74fc13a750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:25:14.892 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.886+0000 7f74fbfff700 1 -- 172.21.15.111:0/1962808377 learned_addr learned my addr 172.21.15.111:0/1962808377 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:25:14.892 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.887+0000 7f74fa7fc700 1 -- 172.21.15.111:0/1962808377 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 677505269 0 0) 0x7f74fc13b010 con 0x7f74fc137a90 2024-04-25T02:25:14.892 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.887+0000 7f74fa7fc700 1 -- 172.21.15.111:0/1962808377 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74e4003570 con 0x7f74fc137a90 2024-04-25T02:25:14.893 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.887+0000 7f74faffd700 1 -- 172.21.15.111:0/1962808377 >> v2:172.21.15.111:3300/0 conn(0x7f74fc068ba0 msgr2=0x7f74fc0ad820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:25:14.893 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.887+0000 7f74faffd700 1 --2- 172.21.15.111:0/1962808377 >> v2:172.21.15.111:3300/0 conn(0x7f74fc068ba0 0x7f74fc0ad820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:14.893 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.887+0000 7f74faffd700 1 -- 172.21.15.111:0/1962808377 >> v1:172.21.15.111:6789/0 conn(0x7f74fc137a90 legacy=0x7f74fc13dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:14.893 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.887+0000 7f74faffd700 1 -- 172.21.15.111:0/1962808377 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74fc13b2b0 con 0x7f74fc06ee20 2024-04-25T02:25:14.893 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.887+0000 7f74fb7fe700 1 --2- 172.21.15.111:0/1962808377 >> v2:172.21.15.111:3300/0 conn(0x7f74fc068ba0 0x7f74fc0ad820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:25:14.893 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.887+0000 7f74faffd700 1 --2- 172.21.15.111:0/1962808377 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f74fc06ee20 0x7f74fc13a750 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f74f00098e0 tx=0x7f74f00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fecb2dc39f2a5e26 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:25:14.893 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.887+0000 7f74fa7fc700 1 -- 172.21.15.111:0/1962808377 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f0011630 con 0x7f74fc06ee20 2024-04-25T02:25:14.893 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.887+0000 7f74fa7fc700 1 -- 172.21.15.111:0/1962808377 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74f0011790 con 0x7f74fc06ee20 2024-04-25T02:25:14.893 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.887+0000 7f74fa7fc700 1 -- 172.21.15.111:0/1962808377 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74f0011b30 con 0x7f74fc06ee20 2024-04-25T02:25:14.893 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.888+0000 7f7501aa8700 1 -- 172.21.15.111:0/1962808377 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f74fc06ee20 msgr2=0x7f74fc13a750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:14.893 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.888+0000 7f7501aa8700 1 --2- 172.21.15.111:0/1962808377 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f74fc06ee20 0x7f74fc13a750 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f74f00098e0 tx=0x7f74f00091a0 comp rx=0 tx=0).stop 2024-04-25T02:25:14.893 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.888+0000 7f7501aa8700 1 -- 172.21.15.111:0/1962808377 shutdown_connections 2024-04-25T02:25:14.893 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.888+0000 7f7501aa8700 1 --2- 172.21.15.111:0/1962808377 >> v2:172.21.15.111:3300/0 conn(0x7f74fc068ba0 0x7f74fc0ad820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:14.893 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.888+0000 7f7501aa8700 1 --2- 172.21.15.111:0/1962808377 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f74fc06ee20 0x7f74fc13a750 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:14.893 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.888+0000 7f7501aa8700 1 -- 172.21.15.111:0/1962808377 >> 172.21.15.111:0/1962808377 conn(0x7f74fc0b1e80 msgr2=0x7f74fc0adef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:25:14.894 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.888+0000 7f7501aa8700 1 -- 172.21.15.111:0/1962808377 shutdown_connections 2024-04-25T02:25:14.894 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.888+0000 7f7501aa8700 1 -- 172.21.15.111:0/1962808377 wait complete. 2024-04-25T02:25:14.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.889+0000 7f7501aa8700 1 Processor -- start 2024-04-25T02:25:14.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.889+0000 7f7501aa8700 1 -- start start 2024-04-25T02:25:14.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.889+0000 7f7501aa8700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f74fc068ba0 0x7f74fc131ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:25:14.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.889+0000 7f7501aa8700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f74fc06ee20 0x7f74fc130400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:25:14.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.889+0000 7f7501aa8700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f74fc137a90 0x7f74fc0aa900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:25:14.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.889+0000 7f7501aa8700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74fc1329e0 con 0x7f74fc068ba0 2024-04-25T02:25:14.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.889+0000 7f7501aa8700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74fc14e5e0 con 0x7f74fc06ee20 2024-04-25T02:25:14.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.889+0000 7f7501aa8700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f74fc14e880 con 0x7f74fc137a90 2024-04-25T02:25:14.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.889+0000 7f74fbfff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f74fc137a90 0x7f74fc0aa900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:25:14.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.889+0000 7f74fb7fe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f74fc068ba0 0x7f74fc131ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:25:14.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.889+0000 7f74faffd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f74fc06ee20 0x7f74fc130400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:25:14.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.889+0000 7f74fb7fe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f74fc068ba0 0x7f74fc131ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:40202/0 (socket says 172.21.15.111:40202) 2024-04-25T02:25:14.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.889+0000 7f74fb7fe700 1 -- 172.21.15.111:0/1141861590 learned_addr learned my addr 172.21.15.111:0/1141861590 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:25:14.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.889+0000 7f74fbfff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f74fc137a90 0x7f74fc0aa900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:36302/0 (socket says 172.21.15.111:36302) 2024-04-25T02:25:14.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.890+0000 7f74fb7fe700 1 -- 172.21.15.111:0/1141861590 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f74fc137a90 msgr2=0x7f74fc0aa900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:14.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.890+0000 7f74fb7fe700 1 --2- 172.21.15.111:0/1141861590 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f74fc137a90 0x7f74fc0aa900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:14.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.890+0000 7f74fb7fe700 1 -- 172.21.15.111:0/1141861590 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f74fc06ee20 msgr2=0x7f74fc130400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:14.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.890+0000 7f74fb7fe700 1 --2- 172.21.15.111:0/1141861590 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f74fc06ee20 0x7f74fc130400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:14.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.890+0000 7f74fb7fe700 1 -- 172.21.15.111:0/1141861590 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74ec009420 con 0x7f74fc068ba0 2024-04-25T02:25:14.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.890+0000 7f74fbfff700 1 --2- 172.21.15.111:0/1141861590 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f74fc137a90 0x7f74fc0aa900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:25:14.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.890+0000 7f74fb7fe700 1 --2- 172.21.15.111:0/1141861590 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f74fc068ba0 0x7f74fc131ff0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f74ec00ec80 tx=0x7f74ec0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:25:14.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.890+0000 7f74e37fe700 1 -- 172.21.15.111:0/1141861590 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ec00c920 con 0x7f74fc068ba0 2024-04-25T02:25:14.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.890+0000 7f74e37fe700 1 -- 172.21.15.111:0/1141861590 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f74ec00ca80 con 0x7f74fc068ba0 2024-04-25T02:25:14.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.890+0000 7f7501aa8700 1 -- 172.21.15.111:0/1141861590 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74f0009420 con 0x7f74fc068ba0 2024-04-25T02:25:14.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.890+0000 7f74e37fe700 1 -- 172.21.15.111:0/1141861590 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74ec00ce00 con 0x7f74fc068ba0 2024-04-25T02:25:14.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.890+0000 7f7501aa8700 1 -- 172.21.15.111:0/1141861590 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74fc1312c0 con 0x7f74fc068ba0 2024-04-25T02:25:14.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.891+0000 7f74e37fe700 1 -- 172.21.15.111:0/1141861590 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f74ec013680 con 0x7f74fc068ba0 2024-04-25T02:25:14.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.891+0000 7f7501aa8700 1 -- 172.21.15.111:0/1141861590 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74fc131930 con 0x7f74fc068ba0 2024-04-25T02:25:14.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.891+0000 7f74e37fe700 1 -- 172.21.15.111:0/1141861590 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4158+0+0 (secure 0 0 0) 0x7f74ec05b830 con 0x7f74fc068ba0 2024-04-25T02:25:14.899 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:14.895+0000 7f74e37fe700 1 -- 172.21.15.111:0/1141861590 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f74ec039a60 con 0x7f74fc068ba0 2024-04-25T02:25:15.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.048+0000 7f7501aa8700 1 -- 172.21.15.111:0/1141861590 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f74fc065190 con 0x7f74fc068ba0 2024-04-25T02:25:15.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.049+0000 7f74e37fe700 1 -- 172.21.15.111:0/1141861590 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7f74ec03d250 con 0x7f74fc068ba0 2024-04-25T02:25:15.052 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 1 2024-04-25T02:25:15.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.050+0000 7f7501aa8700 1 -- 172.21.15.111:0/1141861590 >> v1:172.21.15.111:6816/46482 conn(0x7f74e8045ef0 legacy=0x7f74e80483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:15.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.050+0000 7f7501aa8700 1 -- 172.21.15.111:0/1141861590 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f74fc068ba0 msgr2=0x7f74fc131ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:15.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.050+0000 7f7501aa8700 1 --2- 172.21.15.111:0/1141861590 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f74fc068ba0 0x7f74fc131ff0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f74ec00ec80 tx=0x7f74ec0091a0 comp rx=0 tx=0).stop 2024-04-25T02:25:15.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.050+0000 7f7501aa8700 1 -- 172.21.15.111:0/1141861590 shutdown_connections 2024-04-25T02:25:15.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.050+0000 7f7501aa8700 1 --2- 172.21.15.111:0/1141861590 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f74fc137a90 0x7f74fc0aa900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:15.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.050+0000 7f7501aa8700 1 --2- 172.21.15.111:0/1141861590 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f74fc068ba0 0x7f74fc131ff0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:15.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.050+0000 7f7501aa8700 1 --2- 172.21.15.111:0/1141861590 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f74fc06ee20 0x7f74fc130400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:15.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.050+0000 7f7501aa8700 1 -- 172.21.15.111:0/1141861590 >> 172.21.15.111:0/1141861590 conn(0x7f74fc0b1e80 msgr2=0x7f74fc0adea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:25:15.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.050+0000 7f7501aa8700 1 -- 172.21.15.111:0/1141861590 shutdown_connections 2024-04-25T02:25:15.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.050+0000 7f7501aa8700 1 -- 172.21.15.111:0/1141861590 wait complete. 2024-04-25T02:25:15.066 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T02:25:15.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.181+0000 7fdf781b3700 1 Processor -- start 2024-04-25T02:25:15.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.181+0000 7fdf781b3700 1 -- start start 2024-04-25T02:25:15.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.181+0000 7fdf781b3700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fdf700b2400 0x7fdf7006f570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:25:15.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.181+0000 7fdf781b3700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdf70067940 0x7fdf70067d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:25:15.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.181+0000 7fdf781b3700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fdf70068250 0x7fdf70148520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:25:15.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.181+0000 7fdf781b3700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf700af850 con 0x7fdf700b2400 2024-04-25T02:25:15.187 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.181+0000 7fdf781b3700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf700a3c70 con 0x7fdf70067940 2024-04-25T02:25:15.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.181+0000 7fdf781b3700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdf7006fab0 con 0x7fdf70068250 2024-04-25T02:25:15.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.181+0000 7fdf75f4f700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fdf700b2400 0x7fdf7006f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:25:15.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.181+0000 7fdf76750700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fdf70068250 0x7fdf70148520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:25:15.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.181+0000 7fdf7574e700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdf70067940 0x7fdf70067d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:25:15.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.182+0000 7fdf75f4f700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fdf700b2400 0x7fdf7006f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:40216/0 (socket says 172.21.15.111:40216) 2024-04-25T02:25:15.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.182+0000 7fdf7574e700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdf70067940 0x7fdf70067d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:43776/0 (socket says 172.21.15.111:43776) 2024-04-25T02:25:15.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.182+0000 7fdf76750700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fdf70068250 0x7fdf70148520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:36304/0 (socket says 172.21.15.111:36304) 2024-04-25T02:25:15.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.182+0000 7fdf75f4f700 1 -- 172.21.15.111:0/3948773943 learned_addr learned my addr 172.21.15.111:0/3948773943 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:25:15.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.182+0000 7fdf75f4f700 1 -- 172.21.15.111:0/3948773943 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fdf70068250 msgr2=0x7fdf70148520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:25:15.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.182+0000 7fdf75f4f700 1 --2- 172.21.15.111:0/3948773943 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fdf70068250 0x7fdf70148520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:15.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.182+0000 7fdf75f4f700 1 -- 172.21.15.111:0/3948773943 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdf70067940 msgr2=0x7fdf70067d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:25:15.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.182+0000 7fdf75f4f700 1 --2- 172.21.15.111:0/3948773943 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdf70067940 0x7fdf70067d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:15.188 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.182+0000 7fdf75f4f700 1 -- 172.21.15.111:0/3948773943 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf700a3540 con 0x7fdf700b2400 2024-04-25T02:25:15.189 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.182+0000 7fdf7574e700 1 --2- 172.21.15.111:0/3948773943 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdf70067940 0x7fdf70067d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:25:15.189 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.182+0000 7fdf75f4f700 1 --2- 172.21.15.111:0/3948773943 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdf700b2400 0x7fdf7006f570 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fdf600099b0 tx=0x7fdf60009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8ffb4d31375ad11 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:25:15.189 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.182+0000 7fdf74f4d700 1 -- 172.21.15.111:0/3948773943 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6000b680 con 0x7fdf700b2400 2024-04-25T02:25:15.189 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.182+0000 7fdf74f4d700 1 -- 172.21.15.111:0/3948773943 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf6000b7e0 con 0x7fdf700b2400 2024-04-25T02:25:15.189 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.182+0000 7fdf74f4d700 1 -- 172.21.15.111:0/3948773943 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6000bb80 con 0x7fdf700b2400 2024-04-25T02:25:15.189 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.183+0000 7fdf781b3700 1 -- 172.21.15.111:0/3948773943 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdf700b2400 msgr2=0x7fdf7006f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:15.189 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.183+0000 7fdf781b3700 1 --2- 172.21.15.111:0/3948773943 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdf700b2400 0x7fdf7006f570 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fdf600099b0 tx=0x7fdf60009250 comp rx=0 tx=0).stop 2024-04-25T02:25:15.189 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.183+0000 7fdf781b3700 1 -- 172.21.15.111:0/3948773943 shutdown_connections 2024-04-25T02:25:15.189 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.183+0000 7fdf781b3700 1 --2- 172.21.15.111:0/3948773943 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fdf70068250 0x7fdf70148520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:15.189 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.183+0000 7fdf781b3700 1 --2- 172.21.15.111:0/3948773943 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdf700b2400 0x7fdf7006f570 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:15.189 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.183+0000 7fdf781b3700 1 --2- 172.21.15.111:0/3948773943 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdf70067940 0x7fdf70067d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:15.189 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.183+0000 7fdf781b3700 1 -- 172.21.15.111:0/3948773943 >> 172.21.15.111:0/3948773943 conn(0x7fdf7006ada0 msgr2=0x7fdf700b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:25:15.189 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.183+0000 7fdf781b3700 1 -- 172.21.15.111:0/3948773943 shutdown_connections 2024-04-25T02:25:15.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.183+0000 7fdf781b3700 1 -- 172.21.15.111:0/3948773943 wait complete. 2024-04-25T02:25:15.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.184+0000 7fdf781b3700 1 Processor -- start 2024-04-25T02:25:15.190 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.184+0000 7fdf781b3700 1 -- start start 2024-04-25T02:25:15.192 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.184+0000 7fdf781b3700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fdf70067940 0x7fdf700ad780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:25:15.192 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.184+0000 7fdf781b3700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdf70068250 0x7fdf70151820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:25:15.192 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.184+0000 7fdf781b3700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdf700b2400 0x7fdf70151d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:25:15.192 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.184+0000 7fdf781b3700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf700adcc0 con 0x7fdf70068250 2024-04-25T02:25:15.192 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.184+0000 7fdf781b3700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf700adee0 con 0x7fdf700b2400 2024-04-25T02:25:15.192 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.184+0000 7fdf781b3700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fdf700ad520 con 0x7fdf70067940 2024-04-25T02:25:15.193 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.184+0000 7fdf7574e700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdf70068250 0x7fdf70151820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:25:15.193 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.184+0000 7fdf76750700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdf700b2400 0x7fdf70151d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:25:15.193 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.184+0000 7fdf76750700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdf700b2400 0x7fdf70151d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:43782/0 (socket says 172.21.15.111:43782) 2024-04-25T02:25:15.193 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.184+0000 7fdf7574e700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdf70068250 0x7fdf70151820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:40228/0 (socket says 172.21.15.111:40228) 2024-04-25T02:25:15.193 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.184+0000 7fdf76750700 1 -- 172.21.15.111:0/2500118141 learned_addr learned my addr 172.21.15.111:0/2500118141 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:25:15.193 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.184+0000 7fdf75f4f700 1 --2- 172.21.15.111:0/2500118141 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fdf70067940 0x7fdf700ad780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:25:15.193 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.184+0000 7fdf7574e700 1 -- 172.21.15.111:0/2500118141 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fdf70067940 msgr2=0x7fdf700ad780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:15.193 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.185+0000 7fdf7574e700 1 --2- 172.21.15.111:0/2500118141 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fdf70067940 0x7fdf700ad780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:15.193 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.185+0000 7fdf7574e700 1 -- 172.21.15.111:0/2500118141 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdf700b2400 msgr2=0x7fdf70151d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:15.193 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.185+0000 7fdf7574e700 1 --2- 172.21.15.111:0/2500118141 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdf700b2400 0x7fdf70151d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:15.193 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.185+0000 7fdf7574e700 1 -- 172.21.15.111:0/2500118141 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf6c009420 con 0x7fdf70068250 2024-04-25T02:25:15.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.185+0000 7fdf76750700 1 --2- 172.21.15.111:0/2500118141 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdf700b2400 0x7fdf70151d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:25:15.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.185+0000 7fdf7574e700 1 --2- 172.21.15.111:0/2500118141 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdf70068250 0x7fdf70151820 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c00ea30 tx=0x7fdf6c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:25:15.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.185+0000 7fdf65ffb700 1 -- 172.21.15.111:0/2500118141 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6c00ee70 con 0x7fdf70068250 2024-04-25T02:25:15.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.185+0000 7fdf65ffb700 1 -- 172.21.15.111:0/2500118141 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf6c00c850 con 0x7fdf70068250 2024-04-25T02:25:15.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.185+0000 7fdf65ffb700 1 -- 172.21.15.111:0/2500118141 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf6c00cbf0 con 0x7fdf70068250 2024-04-25T02:25:15.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.185+0000 7fdf781b3700 1 -- 172.21.15.111:0/2500118141 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf600094f0 con 0x7fdf70068250 2024-04-25T02:25:15.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.185+0000 7fdf781b3700 1 -- 172.21.15.111:0/2500118141 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf700ac7c0 con 0x7fdf70068250 2024-04-25T02:25:15.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.186+0000 7fdf781b3700 1 -- 172.21.15.111:0/2500118141 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf7006c5b0 con 0x7fdf70068250 2024-04-25T02:25:15.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.186+0000 7fdf65ffb700 1 -- 172.21.15.111:0/2500118141 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7fdf6c013470 con 0x7fdf70068250 2024-04-25T02:25:15.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.187+0000 7fdf65ffb700 1 -- 172.21.15.111:0/2500118141 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4158+0+0 (secure 0 0 0) 0x7fdf6c05baa0 con 0x7fdf70068250 2024-04-25T02:25:15.195 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.190+0000 7fdf65ffb700 1 -- 172.21.15.111:0/2500118141 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fdf6c039cb0 con 0x7fdf70068250 2024-04-25T02:25:15.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.344+0000 7fdf781b3700 1 -- 172.21.15.111:0/2500118141 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7fdf700a3890 con 0x7fdf70068250 2024-04-25T02:25:15.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.345+0000 7fdf65ffb700 1 -- 172.21.15.111:0/2500118141 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v43) v1 ==== 92+0+10 (secure 0 0 0) 0x7fdf700a3890 con 0x7fdf70068250 2024-04-25T02:25:15.349 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 8 2024-04-25T02:25:15.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.347+0000 7fdf781b3700 1 -- 172.21.15.111:0/2500118141 >> v1:172.21.15.111:6816/46482 conn(0x7fdf54045ef0 legacy=0x7fdf540483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:15.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.347+0000 7fdf781b3700 1 -- 172.21.15.111:0/2500118141 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdf70068250 msgr2=0x7fdf70151820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:15.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.347+0000 7fdf781b3700 1 --2- 172.21.15.111:0/2500118141 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdf70068250 0x7fdf70151820 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fdf6c00ea30 tx=0x7fdf6c0091a0 comp rx=0 tx=0).stop 2024-04-25T02:25:15.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.347+0000 7fdf781b3700 1 -- 172.21.15.111:0/2500118141 shutdown_connections 2024-04-25T02:25:15.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.347+0000 7fdf781b3700 1 --2- 172.21.15.111:0/2500118141 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fdf700b2400 0x7fdf70151d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:15.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.347+0000 7fdf781b3700 1 --2- 172.21.15.111:0/2500118141 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fdf70067940 0x7fdf700ad780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:15.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.347+0000 7fdf781b3700 1 --2- 172.21.15.111:0/2500118141 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fdf70068250 0x7fdf70151820 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:15.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.347+0000 7fdf781b3700 1 -- 172.21.15.111:0/2500118141 >> 172.21.15.111:0/2500118141 conn(0x7fdf7006ada0 msgr2=0x7fdf700b13f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:25:15.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.347+0000 7fdf781b3700 1 -- 172.21.15.111:0/2500118141 shutdown_connections 2024-04-25T02:25:15.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.347+0000 7fdf781b3700 1 -- 172.21.15.111:0/2500118141 wait complete. 2024-04-25T02:25:15.362 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:25:15.480 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.476+0000 7f2546108700 1 Processor -- start 2024-04-25T02:25:15.480 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.476+0000 7f2546108700 1 -- start start 2024-04-25T02:25:15.483 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.477+0000 7f2546108700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f25400639c0 0x7f25400a5b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:25:15.483 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.477+0000 7f2546108700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2540144c20 0x7f2540147000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:25:15.483 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.477+0000 7f2546108700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25400ada50 con 0x7f25400ac230 2024-04-25T02:25:15.483 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.477+0000 7f2546108700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25400aca80 con 0x7f25400639c0 2024-04-25T02:25:15.483 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.477+0000 7f2546108700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2540068bc0 con 0x7f2540144c20 2024-04-25T02:25:15.483 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.477+0000 7f253ffff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2540144c20 0x7f2540147000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:25:15.483 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.477+0000 7f253ffff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2540144c20 0x7f2540147000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:43796/0 (socket says 172.21.15.111:43796) 2024-04-25T02:25:15.483 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.477+0000 7f253f7fe700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f25400639c0 0x7f25400a5b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:25:15.484 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.477+0000 7f253ffff700 1 -- 172.21.15.111:0/912116515 learned_addr learned my addr 172.21.15.111:0/912116515 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:25:15.484 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.477+0000 7f253f7fe700 1 -- 172.21.15.111:0/912116515 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2540144c20 msgr2=0x7f2540147000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:25:15.484 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.477+0000 7f253f7fe700 1 --2- 172.21.15.111:0/912116515 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2540144c20 0x7f2540147000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:15.484 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.477+0000 7f253f7fe700 1 -- 172.21.15.111:0/912116515 >> v1:172.21.15.111:6789/0 conn(0x7f25400ac230 legacy=0x7f2540132180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:15.484 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.477+0000 7f253f7fe700 1 -- 172.21.15.111:0/912116515 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2540067ac0 con 0x7f25400639c0 2024-04-25T02:25:15.484 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.477+0000 7f253ffff700 1 --2- 172.21.15.111:0/912116515 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2540144c20 0x7f2540147000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:25:15.484 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.478+0000 7f253f7fe700 1 --2- 172.21.15.111:0/912116515 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f25400639c0 0x7f25400a5b10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f25280098e0 tx=0x7f25280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7238e75222fd5dd server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:25:15.484 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.478+0000 7f253e7fc700 1 -- 172.21.15.111:0/912116515 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252800b640 con 0x7f25400639c0 2024-04-25T02:25:15.484 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.478+0000 7f253e7fc700 1 -- 172.21.15.111:0/912116515 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f252800b7a0 con 0x7f25400639c0 2024-04-25T02:25:15.484 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.478+0000 7f253e7fc700 1 -- 172.21.15.111:0/912116515 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f252800bb40 con 0x7f25400639c0 2024-04-25T02:25:15.484 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.478+0000 7f2546108700 1 -- 172.21.15.111:0/912116515 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f25400639c0 msgr2=0x7f25400a5b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:15.484 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.478+0000 7f2546108700 1 --2- 172.21.15.111:0/912116515 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f25400639c0 0x7f25400a5b10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f25280098e0 tx=0x7f25280091a0 comp rx=0 tx=0).stop 2024-04-25T02:25:15.485 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.478+0000 7f2546108700 1 -- 172.21.15.111:0/912116515 shutdown_connections 2024-04-25T02:25:15.485 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.478+0000 7f2546108700 1 --2- 172.21.15.111:0/912116515 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f25400639c0 0x7f25400a5b10 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:15.485 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.478+0000 7f2546108700 1 --2- 172.21.15.111:0/912116515 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2540144c20 0x7f2540147000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:15.485 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.478+0000 7f2546108700 1 -- 172.21.15.111:0/912116515 >> 172.21.15.111:0/912116515 conn(0x7f25400b1400 msgr2=0x7f25400b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:25:15.485 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.478+0000 7f2546108700 1 -- 172.21.15.111:0/912116515 shutdown_connections 2024-04-25T02:25:15.485 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.478+0000 7f2546108700 1 -- 172.21.15.111:0/912116515 wait complete. 2024-04-25T02:25:15.485 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.479+0000 7f2546108700 1 Processor -- start 2024-04-25T02:25:15.485 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.479+0000 7f2546108700 1 -- start start 2024-04-25T02:25:15.488 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.480+0000 7f2546108700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f25400639c0 0x7f2540142390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:25:15.488 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.480+0000 7f2546108700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f25400ac230 0x7f25401418f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:25:15.488 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.480+0000 7f2546108700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2540144c20 0x7f254014fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:25:15.488 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.480+0000 7f2546108700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f254014f8d0 con 0x7f2540144c20 2024-04-25T02:25:15.488 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.480+0000 7f2546108700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f25401428d0 con 0x7f25400ac230 2024-04-25T02:25:15.488 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.480+0000 7f2546108700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f254012cb90 con 0x7f25400639c0 2024-04-25T02:25:15.488 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.480+0000 7f253f7fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f25400639c0 0x7f2540142390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:25:15.488 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.480+0000 7f253ffff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2540144c20 0x7f254014fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:25:15.488 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.480+0000 7f253f7fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f25400639c0 0x7f2540142390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:36336/0 (socket says 172.21.15.111:36336) 2024-04-25T02:25:15.488 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.480+0000 7f253f7fe700 1 -- 172.21.15.111:0/3093193659 learned_addr learned my addr 172.21.15.111:0/3093193659 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:25:15.489 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.480+0000 7f253ffff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2540144c20 0x7f254014fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:40234/0 (socket says 172.21.15.111:40234) 2024-04-25T02:25:15.489 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.480+0000 7f253effd700 1 --2- 172.21.15.111:0/3093193659 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f25400ac230 0x7f25401418f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:25:15.489 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.480+0000 7f253ffff700 1 -- 172.21.15.111:0/3093193659 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f25400639c0 msgr2=0x7f2540142390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:15.489 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.480+0000 7f253ffff700 1 --2- 172.21.15.111:0/3093193659 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f25400639c0 0x7f2540142390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:15.489 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.480+0000 7f253ffff700 1 -- 172.21.15.111:0/3093193659 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f25400ac230 msgr2=0x7f25401418f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:15.489 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.480+0000 7f253ffff700 1 --2- 172.21.15.111:0/3093193659 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f25400ac230 0x7f25401418f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:15.489 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.480+0000 7f253ffff700 1 -- 172.21.15.111:0/3093193659 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2538009ae0 con 0x7f2540144c20 2024-04-25T02:25:15.489 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.480+0000 7f253f7fe700 1 --2- 172.21.15.111:0/3093193659 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f25400639c0 0x7f2540142390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:25:15.489 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.481+0000 7f253ffff700 1 --2- 172.21.15.111:0/3093193659 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2540144c20 0x7f254014fb70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f25400ad080 tx=0x7f253800b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:25:15.489 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.481+0000 7f25377fe700 1 -- 172.21.15.111:0/3093193659 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f253800c960 con 0x7f2540144c20 2024-04-25T02:25:15.489 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.481+0000 7f25377fe700 1 -- 172.21.15.111:0/3093193659 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f253800f040 con 0x7f2540144c20 2024-04-25T02:25:15.489 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.481+0000 7f2546108700 1 -- 172.21.15.111:0/3093193659 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2528009420 con 0x7f2540144c20 2024-04-25T02:25:15.489 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.481+0000 7f25377fe700 1 -- 172.21.15.111:0/3093193659 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f253800cd30 con 0x7f2540144c20 2024-04-25T02:25:15.490 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.481+0000 7f2546108700 1 -- 172.21.15.111:0/3093193659 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25400a69f0 con 0x7f2540144c20 2024-04-25T02:25:15.490 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.482+0000 7f25377fe700 1 -- 172.21.15.111:0/3093193659 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f2538014690 con 0x7f2540144c20 2024-04-25T02:25:15.490 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.482+0000 7f2546108700 1 -- 172.21.15.111:0/3093193659 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2540065190 con 0x7f2540144c20 2024-04-25T02:25:15.490 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.482+0000 7f25377fe700 1 -- 172.21.15.111:0/3093193659 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4158+0+0 (secure 0 0 0) 0x7f253805b5a0 con 0x7f2540144c20 2024-04-25T02:25:15.490 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.486+0000 7f25377fe700 1 -- 172.21.15.111:0/3093193659 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f2538039830 con 0x7f2540144c20 2024-04-25T02:25:15.643 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.639+0000 7f2546108700 1 -- 172.21.15.111:0/3093193659 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f25401402e0 con 0x7f2540144c20 2024-04-25T02:25:15.643 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.639+0000 7f25377fe700 1 -- 172.21.15.111:0/3093193659 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v43) v1 ==== 104+0+11 (secure 0 0 0) 0x7f253803d020 con 0x7f2540144c20 2024-04-25T02:25:15.643 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 32 2024-04-25T02:25:15.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.641+0000 7f2546108700 1 -- 172.21.15.111:0/3093193659 >> v1:172.21.15.111:6816/46482 conn(0x7f2520045ef0 legacy=0x7f25200483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:15.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.641+0000 7f2546108700 1 -- 172.21.15.111:0/3093193659 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2540144c20 msgr2=0x7f254014fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:15.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.641+0000 7f2546108700 1 --2- 172.21.15.111:0/3093193659 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2540144c20 0x7f254014fb70 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f25400ad080 tx=0x7f253800b040 comp rx=0 tx=0).stop 2024-04-25T02:25:15.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.641+0000 7f2546108700 1 -- 172.21.15.111:0/3093193659 shutdown_connections 2024-04-25T02:25:15.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.641+0000 7f2546108700 1 --2- 172.21.15.111:0/3093193659 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2540144c20 0x7f254014fb70 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:15.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.641+0000 7f2546108700 1 --2- 172.21.15.111:0/3093193659 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f25400639c0 0x7f2540142390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:15.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.641+0000 7f2546108700 1 --2- 172.21.15.111:0/3093193659 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f25400ac230 0x7f25401418f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:15.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.641+0000 7f2546108700 1 -- 172.21.15.111:0/3093193659 >> 172.21.15.111:0/3093193659 conn(0x7f25400b1400 msgr2=0x7f254013d650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:25:15.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.641+0000 7f2546108700 1 -- 172.21.15.111:0/3093193659 shutdown_connections 2024-04-25T02:25:15.646 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.641+0000 7f2546108700 1 -- 172.21.15.111:0/3093193659 wait complete. 2024-04-25T02:25:15.656 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:25:15.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.771+0000 7fcb5f5b8700 1 Processor -- start 2024-04-25T02:25:15.775 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.772+0000 7fcb5f5b8700 1 -- start start 2024-04-25T02:25:15.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.772+0000 7fcb5f5b8700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fcb58063c90 0x7fcb5806f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:25:15.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.772+0000 7fcb5f5b8700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcb580aad90 0x7fcb5813eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:25:15.783 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.772+0000 7fcb5f5b8700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fcb5813f000 0x7fcb581418c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:25:15.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.772+0000 7fcb5f5b8700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb580aa0d0 con 0x7fcb5813f000 2024-04-25T02:25:15.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.772+0000 7fcb5f5b8700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5806f930 con 0x7fcb580aad90 2024-04-25T02:25:15.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.772+0000 7fcb5f5b8700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5806fb90 con 0x7fcb58063c90 2024-04-25T02:25:15.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.772+0000 7fcb5d354700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fcb58063c90 0x7fcb5806f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:25:15.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.772+0000 7fcb5cb53700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcb580aad90 0x7fcb5813eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:25:15.784 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.772+0000 7fcb5db55700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fcb5813f000 0x7fcb581418c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:25:15.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.772+0000 7fcb5d354700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fcb58063c90 0x7fcb5806f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:36352/0 (socket says 172.21.15.111:36352) 2024-04-25T02:25:15.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.772+0000 7fcb5cb53700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcb580aad90 0x7fcb5813eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:43812/0 (socket says 172.21.15.111:43812) 2024-04-25T02:25:15.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.772+0000 7fcb5db55700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fcb5813f000 0x7fcb581418c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:40248/0 (socket says 172.21.15.111:40248) 2024-04-25T02:25:15.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.772+0000 7fcb5d354700 1 -- 172.21.15.111:0/3865623852 learned_addr learned my addr 172.21.15.111:0/3865623852 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:25:15.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.773+0000 7fcb5d354700 1 -- 172.21.15.111:0/3865623852 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcb580aad90 msgr2=0x7fcb5813eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:25:15.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.773+0000 7fcb5d354700 1 --2- 172.21.15.111:0/3865623852 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcb580aad90 0x7fcb5813eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:15.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.773+0000 7fcb5d354700 1 -- 172.21.15.111:0/3865623852 >> v2:172.21.15.111:3300/0 conn(0x7fcb5813f000 msgr2=0x7fcb581418c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:25:15.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.773+0000 7fcb5d354700 1 --2- 172.21.15.111:0/3865623852 >> v2:172.21.15.111:3300/0 conn(0x7fcb5813f000 0x7fcb581418c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:15.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.773+0000 7fcb5d354700 1 -- 172.21.15.111:0/3865623852 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb580adc70 con 0x7fcb58063c90 2024-04-25T02:25:15.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.773+0000 7fcb5cb53700 1 --2- 172.21.15.111:0/3865623852 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcb580aad90 0x7fcb5813eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:25:15.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.773+0000 7fcb5d354700 1 --2- 172.21.15.111:0/3865623852 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fcb58063c90 0x7fcb5806f3f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcb480099e0 tx=0x7fcb48009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b741673cf0bed7cc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:25:15.785 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.773+0000 7fcb4ffff700 1 -- 172.21.15.111:0/3865623852 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4800b640 con 0x7fcb58063c90 2024-04-25T02:25:15.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.773+0000 7fcb4ffff700 1 -- 172.21.15.111:0/3865623852 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb4800b7a0 con 0x7fcb58063c90 2024-04-25T02:25:15.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.773+0000 7fcb4ffff700 1 -- 172.21.15.111:0/3865623852 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4800bb40 con 0x7fcb58063c90 2024-04-25T02:25:15.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.773+0000 7fcb5f5b8700 1 -- 172.21.15.111:0/3865623852 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fcb58063c90 msgr2=0x7fcb5806f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:15.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.773+0000 7fcb5f5b8700 1 --2- 172.21.15.111:0/3865623852 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fcb58063c90 0x7fcb5806f3f0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fcb480099e0 tx=0x7fcb48009250 comp rx=0 tx=0).stop 2024-04-25T02:25:15.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.774+0000 7fcb5f5b8700 1 -- 172.21.15.111:0/3865623852 shutdown_connections 2024-04-25T02:25:15.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.774+0000 7fcb5f5b8700 1 --2- 172.21.15.111:0/3865623852 >> v2:172.21.15.111:3300/0 conn(0x7fcb5813f000 0x7fcb581418c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:15.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.774+0000 7fcb5f5b8700 1 --2- 172.21.15.111:0/3865623852 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fcb58063c90 0x7fcb5806f3f0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:15.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.774+0000 7fcb5f5b8700 1 --2- 172.21.15.111:0/3865623852 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcb580aad90 0x7fcb5813eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:15.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.774+0000 7fcb5f5b8700 1 -- 172.21.15.111:0/3865623852 >> 172.21.15.111:0/3865623852 conn(0x7fcb580b1e80 msgr2=0x7fcb580adef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:25:15.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.774+0000 7fcb5f5b8700 1 -- 172.21.15.111:0/3865623852 shutdown_connections 2024-04-25T02:25:15.786 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.774+0000 7fcb5f5b8700 1 -- 172.21.15.111:0/3865623852 wait complete. 2024-04-25T02:25:15.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.775+0000 7fcb5f5b8700 1 Processor -- start 2024-04-25T02:25:15.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.775+0000 7fcb5f5b8700 1 -- start start 2024-04-25T02:25:15.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.775+0000 7fcb5f5b8700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcb58063c90 0x7fcb5814e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:25:15.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.775+0000 7fcb5f5b8700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fcb5813f000 0x7fcb58151670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:25:15.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.775+0000 7fcb5f5b8700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcb5811cb70 0x7fcb58151bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:25:15.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.775+0000 7fcb5f5b8700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5811c400 con 0x7fcb5811cb70 2024-04-25T02:25:15.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.775+0000 7fcb5f5b8700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5814e900 con 0x7fcb58063c90 2024-04-25T02:25:15.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.775+0000 7fcb5f5b8700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fcb5814ebc0 con 0x7fcb5813f000 2024-04-25T02:25:15.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.775+0000 7fcb5d354700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcb58063c90 0x7fcb5814e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:25:15.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.775+0000 7fcb5d354700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcb58063c90 0x7fcb5814e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:43826/0 (socket says 172.21.15.111:43826) 2024-04-25T02:25:15.787 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.775+0000 7fcb5d354700 1 -- 172.21.15.111:0/3953915987 learned_addr learned my addr 172.21.15.111:0/3953915987 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:25:15.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.775+0000 7fcb5db55700 1 --2- 172.21.15.111:0/3953915987 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcb5811cb70 0x7fcb58151bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:25:15.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.775+0000 7fcb5cb53700 1 --2- 172.21.15.111:0/3953915987 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fcb5813f000 0x7fcb58151670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:25:15.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.776+0000 7fcb5d354700 1 -- 172.21.15.111:0/3953915987 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fcb5813f000 msgr2=0x7fcb58151670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:15.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.776+0000 7fcb5d354700 1 --2- 172.21.15.111:0/3953915987 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fcb5813f000 0x7fcb58151670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:15.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.776+0000 7fcb5d354700 1 -- 172.21.15.111:0/3953915987 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcb5811cb70 msgr2=0x7fcb58151bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:15.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.776+0000 7fcb5d354700 1 --2- 172.21.15.111:0/3953915987 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcb5811cb70 0x7fcb58151bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:15.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.776+0000 7fcb5d354700 1 -- 172.21.15.111:0/3953915987 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb54009420 con 0x7fcb58063c90 2024-04-25T02:25:15.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.776+0000 7fcb5db55700 1 --2- 172.21.15.111:0/3953915987 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcb5811cb70 0x7fcb58151bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:25:15.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.776+0000 7fcb5d354700 1 --2- 172.21.15.111:0/3953915987 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcb58063c90 0x7fcb5814e0f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcb5806fd20 tx=0x7fcb48017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:25:15.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.776+0000 7fcb4d7fa700 1 -- 172.21.15.111:0/3953915987 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb4800b910 con 0x7fcb58063c90 2024-04-25T02:25:15.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.776+0000 7fcb4d7fa700 1 -- 172.21.15.111:0/3953915987 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb4800ba90 con 0x7fcb58063c90 2024-04-25T02:25:15.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.776+0000 7fcb5f5b8700 1 -- 172.21.15.111:0/3953915987 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb480094f0 con 0x7fcb58063c90 2024-04-25T02:25:15.788 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.776+0000 7fcb4d7fa700 1 -- 172.21.15.111:0/3953915987 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb48024690 con 0x7fcb58063c90 2024-04-25T02:25:15.789 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.776+0000 7fcb5f5b8700 1 -- 172.21.15.111:0/3953915987 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb5814e6b0 con 0x7fcb58063c90 2024-04-25T02:25:15.789 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.777+0000 7fcb5f5b8700 1 -- 172.21.15.111:0/3953915987 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb580a9e50 con 0x7fcb58063c90 2024-04-25T02:25:15.789 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.777+0000 7fcb4d7fa700 1 -- 172.21.15.111:0/3953915987 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7fcb4802d440 con 0x7fcb58063c90 2024-04-25T02:25:15.789 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.777+0000 7fcb4d7fa700 1 -- 172.21.15.111:0/3953915987 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4158+0+0 (secure 0 0 0) 0x7fcb4805c830 con 0x7fcb58063c90 2024-04-25T02:25:15.789 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.781+0000 7fcb4d7fa700 1 -- 172.21.15.111:0/3953915987 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fcb4805b470 con 0x7fcb58063c90 2024-04-25T02:25:15.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.936+0000 7fcb5f5b8700 1 -- 172.21.15.111:0/3953915987 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcb5811cf90 con 0x7fcb58063c90 2024-04-25T02:25:15.940 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.936+0000 7fcb4d7fa700 1 -- 172.21.15.111:0/3953915987 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v43) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcb5811cf90 con 0x7fcb58063c90 2024-04-25T02:25:15.940 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 64 2024-04-25T02:25:15.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.938+0000 7fcb5f5b8700 1 -- 172.21.15.111:0/3953915987 >> v1:172.21.15.111:6816/46482 conn(0x7fcb3c045f20 legacy=0x7fcb3c0483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:15.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.938+0000 7fcb5f5b8700 1 -- 172.21.15.111:0/3953915987 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcb58063c90 msgr2=0x7fcb5814e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:15.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.938+0000 7fcb5f5b8700 1 --2- 172.21.15.111:0/3953915987 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcb58063c90 0x7fcb5814e0f0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fcb5806fd20 tx=0x7fcb48017000 comp rx=0 tx=0).stop 2024-04-25T02:25:15.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.938+0000 7fcb5f5b8700 1 -- 172.21.15.111:0/3953915987 shutdown_connections 2024-04-25T02:25:15.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.938+0000 7fcb5f5b8700 1 --2- 172.21.15.111:0/3953915987 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fcb5811cb70 0x7fcb58151bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:15.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.938+0000 7fcb5f5b8700 1 --2- 172.21.15.111:0/3953915987 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fcb58063c90 0x7fcb5814e0f0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:15.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.938+0000 7fcb5f5b8700 1 --2- 172.21.15.111:0/3953915987 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fcb5813f000 0x7fcb58151670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:15.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.938+0000 7fcb5f5b8700 1 -- 172.21.15.111:0/3953915987 >> 172.21.15.111:0/3953915987 conn(0x7fcb580b1e80 msgr2=0x7fcb5813dbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:25:15.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.938+0000 7fcb5f5b8700 1 -- 172.21.15.111:0/3953915987 shutdown_connections 2024-04-25T02:25:15.942 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:15.938+0000 7fcb5f5b8700 1 -- 172.21.15.111:0/3953915987 wait complete. 2024-04-25T02:25:15.954 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:25:16.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.065+0000 7fb56aac4700 1 Processor -- start 2024-04-25T02:25:16.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.065+0000 7fb56aac4700 1 -- start start 2024-04-25T02:25:16.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.066+0000 7fb56aac4700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fb5640b2650 0x7fb5640a22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:25:16.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.066+0000 7fb56aac4700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb56406e170 0x7fb564145d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:25:16.071 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.066+0000 7fb56aac4700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb5640a2b60 con 0x7fb5640a3650 2024-04-25T02:25:16.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.066+0000 7fb56aac4700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5640a4180 con 0x7fb5640b2650 2024-04-25T02:25:16.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.066+0000 7fb56aac4700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb5640a28c0 con 0x7fb56406e170 2024-04-25T02:25:16.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.066+0000 7fb568860700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fb5640b2650 0x7fb5640a22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:25:16.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.066+0000 7fb569061700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb56406e170 0x7fb564145d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:25:16.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.066+0000 7fb563fff700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7fb5640a3650 0x7fb56406da60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:33102/0 (socket says 172.21.15.111:33102) 2024-04-25T02:25:16.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.066+0000 7fb563fff700 1 -- 172.21.15.111:0/2411716560 learned_addr learned my addr 172.21.15.111:0/2411716560 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:25:16.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.066+0000 7fb568860700 1 -- 172.21.15.111:0/2411716560 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb56406e170 msgr2=0x7fb564145d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:25:16.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.066+0000 7fb568860700 1 --2- 172.21.15.111:0/2411716560 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb56406e170 0x7fb564145d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:16.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.066+0000 7fb568860700 1 -- 172.21.15.111:0/2411716560 >> v1:172.21.15.111:6789/0 conn(0x7fb5640a3650 legacy=0x7fb56406da60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:16.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.066+0000 7fb568860700 1 -- 172.21.15.111:0/2411716560 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5640af710 con 0x7fb5640b2650 2024-04-25T02:25:16.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.066+0000 7fb5637fe700 1 -- 172.21.15.111:0/2411716560 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2549713083 0 0) 0x7fb5640a2b60 con 0x7fb5640a3650 2024-04-25T02:25:16.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.066+0000 7fb569061700 1 --2- 172.21.15.111:0/2411716560 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb56406e170 0x7fb564145d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:25:16.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.066+0000 7fb568860700 1 --2- 172.21.15.111:0/2411716560 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb5640b2650 0x7fb5640a22a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb5580098e0 tx=0x7fb5580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=639f594d56c3e5b0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:25:16.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.066+0000 7fb5637fe700 1 -- 172.21.15.111:0/2411716560 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55800b640 con 0x7fb5640b2650 2024-04-25T02:25:16.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.066+0000 7fb5637fe700 1 -- 172.21.15.111:0/2411716560 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb55800b7a0 con 0x7fb5640b2650 2024-04-25T02:25:16.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.066+0000 7fb5637fe700 1 -- 172.21.15.111:0/2411716560 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55800bb40 con 0x7fb5640b2650 2024-04-25T02:25:16.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.067+0000 7fb56aac4700 1 -- 172.21.15.111:0/2411716560 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb5640b2650 msgr2=0x7fb5640a22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:16.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.067+0000 7fb56aac4700 1 --2- 172.21.15.111:0/2411716560 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb5640b2650 0x7fb5640a22a0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb5580098e0 tx=0x7fb5580091a0 comp rx=0 tx=0).stop 2024-04-25T02:25:16.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.067+0000 7fb56aac4700 1 -- 172.21.15.111:0/2411716560 shutdown_connections 2024-04-25T02:25:16.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.067+0000 7fb56aac4700 1 --2- 172.21.15.111:0/2411716560 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb56406e170 0x7fb564145d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:16.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.067+0000 7fb56aac4700 1 --2- 172.21.15.111:0/2411716560 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb5640b2650 0x7fb5640a22a0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:16.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.067+0000 7fb56aac4700 1 -- 172.21.15.111:0/2411716560 >> 172.21.15.111:0/2411716560 conn(0x7fb56406ac90 msgr2=0x7fb5640b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:25:16.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.067+0000 7fb56aac4700 1 -- 172.21.15.111:0/2411716560 shutdown_connections 2024-04-25T02:25:16.073 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.067+0000 7fb56aac4700 1 -- 172.21.15.111:0/2411716560 wait complete. 2024-04-25T02:25:16.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.068+0000 7fb56aac4700 1 Processor -- start 2024-04-25T02:25:16.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.068+0000 7fb56aac4700 1 -- start start 2024-04-25T02:25:16.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.068+0000 7fb56aac4700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb56406e170 0x7fb5641391e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:25:16.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.068+0000 7fb56aac4700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb5640a3650 0x7fb56409ffc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:25:16.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.068+0000 7fb56aac4700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb5640b2650 0x7fb5640a0500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:25:16.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.068+0000 7fb56aac4700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb564139bb0 con 0x7fb56406e170 2024-04-25T02:25:16.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.068+0000 7fb56aac4700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb564067940 con 0x7fb5640b2650 2024-04-25T02:25:16.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.068+0000 7fb56aac4700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fb564139d70 con 0x7fb5640a3650 2024-04-25T02:25:16.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.069+0000 7fb568860700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb56406e170 0x7fb5641391e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:25:16.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.069+0000 7fb563fff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb5640a3650 0x7fb56409ffc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:25:16.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.069+0000 7fb568860700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb56406e170 0x7fb5641391e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:40274/0 (socket says 172.21.15.111:40274) 2024-04-25T02:25:16.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.069+0000 7fb568860700 1 -- 172.21.15.111:0/3926169744 learned_addr learned my addr 172.21.15.111:0/3926169744 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:25:16.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.069+0000 7fb569061700 1 --2- 172.21.15.111:0/3926169744 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb5640b2650 0x7fb5640a0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:25:16.077 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.069+0000 7fb568860700 1 -- 172.21.15.111:0/3926169744 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb5640a3650 msgr2=0x7fb56409ffc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:16.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.069+0000 7fb568860700 1 --2- 172.21.15.111:0/3926169744 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb5640a3650 0x7fb56409ffc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:16.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.069+0000 7fb568860700 1 -- 172.21.15.111:0/3926169744 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb5640b2650 msgr2=0x7fb5640a0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:16.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.069+0000 7fb568860700 1 --2- 172.21.15.111:0/3926169744 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb5640b2650 0x7fb5640a0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:16.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.069+0000 7fb568860700 1 -- 172.21.15.111:0/3926169744 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb55c009a20 con 0x7fb56406e170 2024-04-25T02:25:16.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.069+0000 7fb563fff700 1 --2- 172.21.15.111:0/3926169744 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb5640a3650 0x7fb56409ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:25:16.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.069+0000 7fb569061700 1 --2- 172.21.15.111:0/3926169744 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb5640b2650 0x7fb5640a0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:25:16.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.069+0000 7fb568860700 1 --2- 172.21.15.111:0/3926169744 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb56406e170 0x7fb5641391e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb558009f80 tx=0x7fb558017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:25:16.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.069+0000 7fb560ff9700 1 -- 172.21.15.111:0/3926169744 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55800bb20 con 0x7fb56406e170 2024-04-25T02:25:16.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.069+0000 7fb560ff9700 1 -- 172.21.15.111:0/3926169744 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb558000c40 con 0x7fb56406e170 2024-04-25T02:25:16.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.069+0000 7fb56aac4700 1 -- 172.21.15.111:0/3926169744 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb558009420 con 0x7fb56406e170 2024-04-25T02:25:16.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.069+0000 7fb560ff9700 1 -- 172.21.15.111:0/3926169744 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb558011630 con 0x7fb56406e170 2024-04-25T02:25:16.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.069+0000 7fb56aac4700 1 -- 172.21.15.111:0/3926169744 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb564139fc0 con 0x7fb56406e170 2024-04-25T02:25:16.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.070+0000 7fb56aac4700 1 -- 172.21.15.111:0/3926169744 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5640b2b50 con 0x7fb56406e170 2024-04-25T02:25:16.079 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.070+0000 7fb560ff9700 1 -- 172.21.15.111:0/3926169744 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7fb5580119e0 con 0x7fb56406e170 2024-04-25T02:25:16.079 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.070+0000 7fb560ff9700 1 -- 172.21.15.111:0/3926169744 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4158+0+0 (secure 0 0 0) 0x7fb55805c510 con 0x7fb56406e170 2024-04-25T02:25:16.079 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.074+0000 7fb560ff9700 1 -- 172.21.15.111:0/3926169744 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fb55805b150 con 0x7fb56406e170 2024-04-25T02:25:16.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.255+0000 7fb56aac4700 1 -- 172.21.15.111:0/3926169744 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb56406a150 con 0x7fb56406e170 2024-04-25T02:25:16.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.256+0000 7fb560ff9700 1 -- 172.21.15.111:0/3926169744 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+3701 (secure 0 0 0) 0x7fb55805b150 con 0x7fb56406e170 2024-04-25T02:25:16.260 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:25:16.260 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":true},"standbys":[{"gid":14404,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6818/4022954817","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6818","nonce":4022954817}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":14405,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6817/1113530749","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6817","nonce":1113530749}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:20:24.150791+0000","modified":"2024-04-25T02:25:09.056753+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{"feature_14":"metric_collect"},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14417},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14417":{"gid":14417,"name":"b","rank":0,"incarnation":16,"state":"up:active","state_seq":4,"addr":"172.21.15.111:6819/696898730","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6819","nonce":696898730}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-25T02:25:16.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.257+0000 7fb56aac4700 1 -- 172.21.15.111:0/3926169744 >> v1:172.21.15.111:6816/46482 conn(0x7fb548045ef0 legacy=0x7fb5480483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:16.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.257+0000 7fb56aac4700 1 -- 172.21.15.111:0/3926169744 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb56406e170 msgr2=0x7fb5641391e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:16.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.257+0000 7fb56aac4700 1 --2- 172.21.15.111:0/3926169744 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb56406e170 0x7fb5641391e0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fb558009f80 tx=0x7fb558017000 comp rx=0 tx=0).stop 2024-04-25T02:25:16.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.258+0000 7fb56aac4700 1 -- 172.21.15.111:0/3926169744 shutdown_connections 2024-04-25T02:25:16.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.258+0000 7fb56aac4700 1 --2- 172.21.15.111:0/3926169744 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fb5640b2650 0x7fb5640a0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:16.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.258+0000 7fb56aac4700 1 --2- 172.21.15.111:0/3926169744 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fb56406e170 0x7fb5641391e0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:16.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.258+0000 7fb56aac4700 1 --2- 172.21.15.111:0/3926169744 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fb5640a3650 0x7fb56409ffc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:16.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.258+0000 7fb56aac4700 1 -- 172.21.15.111:0/3926169744 >> 172.21.15.111:0/3926169744 conn(0x7fb56406ac90 msgr2=0x7fb56413ef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:25:16.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.258+0000 7fb56aac4700 1 -- 172.21.15.111:0/3926169744 shutdown_connections 2024-04-25T02:25:16.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:16.258+0000 7fb56aac4700 1 -- 172.21.15.111:0/3926169744 wait complete. 2024-04-25T02:25:16.262 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 20 2024-04-25T02:25:16.273 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json session ls 2024-04-25T02:25:16.408 INFO:teuthology.orchestra.run.smithi111.stdout:[{"id":14741,"entity":{"name":{"type":"client","num":14741},"addr":{"type":"v1","addr":"172.21.15.114:0","nonce":2005503483}},"state":"open","num_leases":0,"num_caps":1,"request_load_avg":0,"uptime":8.6788501579999995,"requests_in_flight":0,"num_completed_requests":0,"num_completed_flushes":0,"reconnecting":false,"recall_caps":{"value":0,"halflife":60},"release_caps":{"value":0,"halflife":60},"recall_caps_throttle":{"value":0,"halflife":1.5},"recall_caps_throttle2o":{"value":0,"halflife":0.5},"session_cache_liveness":{"value":0.98015183972462783,"halflife":300},"cap_acquisition":{"value":0,"halflife":30},"last_trim_completed_requests_tid":1,"last_trim_completed_flushes_tid":0,"delegated_inos":[],"inst":"client.14741 v1:172.21.15.114:0/2005503483","completed_requests":[],"prealloc_inos":[],"client_metadata":{"client_features":{"feature_bits":"0x00000000001fffff"},"metric_spec":{"metric_flags":{"feature_bits":"0x000000000000ffff"}},"ceph_sha1":"c61472c83ce76869b0fe076c19ed2f4bcc3fb4af","ceph_version":"ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)","entity_id":"0","hostname":"smithi114","mount_point":"/home/ubuntu/cephtest/mnt.0","pid":"39056","root":"/"}}] 2024-04-25T02:25:16.408 DEBUG:tasks.cephfs.filesystem:_json_asok output [ { "cap_acquisition": { "halflife": 30, "value": 0 }, "client_metadata": { "ceph_sha1": "c61472c83ce76869b0fe076c19ed2f4bcc3fb4af", "ceph_version": "ceph version 17.2.7-902-gc61472c8 (c61472c83ce76869b0fe076c19ed2f4bcc3fb4af) quincy (stable)", "client_features": { "feature_bits": "0x00000000001fffff" }, "entity_id": "0", "hostname": "smithi114", "metric_spec": { "metric_flags": { "feature_bits": "0x000000000000ffff" } }, "mount_point": "/home/ubuntu/cephtest/mnt.0", "pid": "39056", "root": "/" }, "completed_requests": [], "delegated_inos": [], "entity": { "addr": { "addr": "172.21.15.114:0", "nonce": 2005503483, "type": "v1" }, "name": { "num": 14741, "type": "client" } }, "id": 14741, "inst": "client.14741 v1:172.21.15.114:0/2005503483", "last_trim_completed_flushes_tid": 0, "last_trim_completed_requests_tid": 1, "num_caps": 1, "num_completed_flushes": 0, "num_completed_requests": 0, "num_leases": 0, "prealloc_inos": [], "recall_caps": { "halflife": 60, "value": 0 }, "recall_caps_throttle": { "halflife": 1.5, "value": 0 }, "recall_caps_throttle2o": { "halflife": 0.5, "value": 0 }, "reconnecting": false, "release_caps": { "halflife": 60, "value": 0 }, "request_load_avg": 0, "requests_in_flight": 0, "session_cache_liveness": { "halflife": 300, "value": 0.9801518397246278 }, "state": "open", "uptime": 8.678850158 } ] 2024-04-25T02:25:16.409 DEBUG:teuthology.orchestra.run.smithi114:> sudo stdin-killer -- python3 -c ' 2024-04-25T02:25:16.409 DEBUG:teuthology.orchestra.run.smithi114:> import glob 2024-04-25T02:25:16.409 DEBUG:teuthology.orchestra.run.smithi114:> import re 2024-04-25T02:25:16.409 DEBUG:teuthology.orchestra.run.smithi114:> import os 2024-04-25T02:25:16.409 DEBUG:teuthology.orchestra.run.smithi114:> import subprocess 2024-04-25T02:25:16.409 DEBUG:teuthology.orchestra.run.smithi114:> 2024-04-25T02:25:16.409 DEBUG:teuthology.orchestra.run.smithi114:> def _find_admin_socket(client_name): 2024-04-25T02:25:16.409 DEBUG:teuthology.orchestra.run.smithi114:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-25T02:25:16.409 DEBUG:teuthology.orchestra.run.smithi114:> files = glob.glob(asok_path) 2024-04-25T02:25:16.410 DEBUG:teuthology.orchestra.run.smithi114:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-25T02:25:16.410 DEBUG:teuthology.orchestra.run.smithi114:> 2024-04-25T02:25:16.410 DEBUG:teuthology.orchestra.run.smithi114:> # Given a non-glob path, it better be there 2024-04-25T02:25:16.410 DEBUG:teuthology.orchestra.run.smithi114:> if "*" not in asok_path: 2024-04-25T02:25:16.410 DEBUG:teuthology.orchestra.run.smithi114:> assert(len(files) == 1) 2024-04-25T02:25:16.410 DEBUG:teuthology.orchestra.run.smithi114:> return files[0] 2024-04-25T02:25:16.410 DEBUG:teuthology.orchestra.run.smithi114:> 2024-04-25T02:25:16.410 DEBUG:teuthology.orchestra.run.smithi114:> for f in files: 2024-04-25T02:25:16.410 DEBUG:teuthology.orchestra.run.smithi114:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-25T02:25:16.410 DEBUG:teuthology.orchestra.run.smithi114:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-25T02:25:16.410 DEBUG:teuthology.orchestra.run.smithi114:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-25T02:25:16.410 DEBUG:teuthology.orchestra.run.smithi114:> contents = proc_f.read() 2024-04-25T02:25:16.410 DEBUG:teuthology.orchestra.run.smithi114:> if mountpoint in contents: 2024-04-25T02:25:16.411 DEBUG:teuthology.orchestra.run.smithi114:> return f 2024-04-25T02:25:16.411 DEBUG:teuthology.orchestra.run.smithi114:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-25T02:25:16.411 DEBUG:teuthology.orchestra.run.smithi114:> 2024-04-25T02:25:16.411 DEBUG:teuthology.orchestra.run.smithi114:> print(_find_admin_socket("client.0")) 2024-04-25T02:25:16.411 DEBUG:teuthology.orchestra.run.smithi114:> ' 2024-04-25T02:25:16.505 INFO:teuthology.orchestra.run.smithi114.stdout:/var/run/ceph/ceph-client.0.39056.asok 2024-04-25T02:25:16.508 INFO:teuthology.orchestra.run.smithi114.stderr:2024-04-25T02:25:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:25:16.515 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.39056.asok 2024-04-25T02:25:16.515 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:25:16.515 DEBUG:teuthology.orchestra.run.smithi114:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.39056.asok mds_sessions 2024-04-25T02:25:16.668 INFO:teuthology.orchestra.run.smithi114.stdout:{ 2024-04-25T02:25:16.668 INFO:teuthology.orchestra.run.smithi114.stdout: "id": 14741, 2024-04-25T02:25:16.668 INFO:teuthology.orchestra.run.smithi114.stdout: "inst": { 2024-04-25T02:25:16.668 INFO:teuthology.orchestra.run.smithi114.stdout: "name": { 2024-04-25T02:25:16.668 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "client", 2024-04-25T02:25:16.668 INFO:teuthology.orchestra.run.smithi114.stdout: "num": 14741 2024-04-25T02:25:16.668 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-25T02:25:16.668 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": { 2024-04-25T02:25:16.668 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v1", 2024-04-25T02:25:16.669 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "172.21.15.114:0", 2024-04-25T02:25:16.669 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 2005503483 2024-04-25T02:25:16.669 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-25T02:25:16.669 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-25T02:25:16.669 INFO:teuthology.orchestra.run.smithi114.stdout: "inst_str": "client.14741 v1:172.21.15.114:0/2005503483", 2024-04-25T02:25:16.669 INFO:teuthology.orchestra.run.smithi114.stdout: "addr_str": "v1:172.21.15.114:0/2005503483", 2024-04-25T02:25:16.669 INFO:teuthology.orchestra.run.smithi114.stdout: "sessions": [ 2024-04-25T02:25:16.669 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-25T02:25:16.669 INFO:teuthology.orchestra.run.smithi114.stdout: "mds": 0, 2024-04-25T02:25:16.669 INFO:teuthology.orchestra.run.smithi114.stdout: "addrs": { 2024-04-25T02:25:16.669 INFO:teuthology.orchestra.run.smithi114.stdout: "addrvec": [ 2024-04-25T02:25:16.669 INFO:teuthology.orchestra.run.smithi114.stdout: { 2024-04-25T02:25:16.669 INFO:teuthology.orchestra.run.smithi114.stdout: "type": "v1", 2024-04-25T02:25:16.669 INFO:teuthology.orchestra.run.smithi114.stdout: "addr": "172.21.15.111:6819", 2024-04-25T02:25:16.669 INFO:teuthology.orchestra.run.smithi114.stdout: "nonce": 696898730 2024-04-25T02:25:16.670 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-25T02:25:16.670 INFO:teuthology.orchestra.run.smithi114.stdout: ] 2024-04-25T02:25:16.670 INFO:teuthology.orchestra.run.smithi114.stdout: }, 2024-04-25T02:25:16.670 INFO:teuthology.orchestra.run.smithi114.stdout: "seq": 0, 2024-04-25T02:25:16.670 INFO:teuthology.orchestra.run.smithi114.stdout: "cap_gen": 0, 2024-04-25T02:25:16.670 INFO:teuthology.orchestra.run.smithi114.stdout: "cap_ttl": "2024-04-25T02:26:08.716114+0000", 2024-04-25T02:25:16.670 INFO:teuthology.orchestra.run.smithi114.stdout: "last_cap_renew_request": "2024-04-25T02:25:08.716114+0000", 2024-04-25T02:25:16.670 INFO:teuthology.orchestra.run.smithi114.stdout: "cap_renew_seq": 2, 2024-04-25T02:25:16.670 INFO:teuthology.orchestra.run.smithi114.stdout: "num_caps": 1, 2024-04-25T02:25:16.670 INFO:teuthology.orchestra.run.smithi114.stdout: "state": "open" 2024-04-25T02:25:16.670 INFO:teuthology.orchestra.run.smithi114.stdout: } 2024-04-25T02:25:16.670 INFO:teuthology.orchestra.run.smithi114.stdout: ], 2024-04-25T02:25:16.670 INFO:teuthology.orchestra.run.smithi114.stdout: "mdsmap_epoch": 20 2024-04-25T02:25:16.670 INFO:teuthology.orchestra.run.smithi114.stdout:} 2024-04-25T02:25:16.680 INFO:tasks.fs:client client.0 has a session with MDS None.0 2024-04-25T02:25:16.680 DEBUG:teuthology.orchestra.run.smithi186:> sudo stdin-killer -- python3 -c ' 2024-04-25T02:25:16.680 DEBUG:teuthology.orchestra.run.smithi186:> import glob 2024-04-25T02:25:16.680 DEBUG:teuthology.orchestra.run.smithi186:> import re 2024-04-25T02:25:16.680 DEBUG:teuthology.orchestra.run.smithi186:> import os 2024-04-25T02:25:16.680 DEBUG:teuthology.orchestra.run.smithi186:> import subprocess 2024-04-25T02:25:16.680 DEBUG:teuthology.orchestra.run.smithi186:> 2024-04-25T02:25:16.680 DEBUG:teuthology.orchestra.run.smithi186:> def _find_admin_socket(client_name): 2024-04-25T02:25:16.681 DEBUG:teuthology.orchestra.run.smithi186:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-04-25T02:25:16.681 DEBUG:teuthology.orchestra.run.smithi186:> files = glob.glob(asok_path) 2024-04-25T02:25:16.681 DEBUG:teuthology.orchestra.run.smithi186:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-04-25T02:25:16.681 DEBUG:teuthology.orchestra.run.smithi186:> 2024-04-25T02:25:16.681 DEBUG:teuthology.orchestra.run.smithi186:> # Given a non-glob path, it better be there 2024-04-25T02:25:16.681 DEBUG:teuthology.orchestra.run.smithi186:> if "*" not in asok_path: 2024-04-25T02:25:16.681 DEBUG:teuthology.orchestra.run.smithi186:> assert(len(files) == 1) 2024-04-25T02:25:16.681 DEBUG:teuthology.orchestra.run.smithi186:> return files[0] 2024-04-25T02:25:16.681 DEBUG:teuthology.orchestra.run.smithi186:> 2024-04-25T02:25:16.681 DEBUG:teuthology.orchestra.run.smithi186:> for f in files: 2024-04-25T02:25:16.681 DEBUG:teuthology.orchestra.run.smithi186:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-25T02:25:16.681 DEBUG:teuthology.orchestra.run.smithi186:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-25T02:25:16.681 DEBUG:teuthology.orchestra.run.smithi186:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-25T02:25:16.681 DEBUG:teuthology.orchestra.run.smithi186:> contents = proc_f.read() 2024-04-25T02:25:16.681 DEBUG:teuthology.orchestra.run.smithi186:> if mountpoint in contents: 2024-04-25T02:25:16.681 DEBUG:teuthology.orchestra.run.smithi186:> return f 2024-04-25T02:25:16.682 DEBUG:teuthology.orchestra.run.smithi186:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-25T02:25:16.682 DEBUG:teuthology.orchestra.run.smithi186:> 2024-04-25T02:25:16.682 DEBUG:teuthology.orchestra.run.smithi186:> print(_find_admin_socket("client.1")) 2024-04-25T02:25:16.682 DEBUG:teuthology.orchestra.run.smithi186:> ' 2024-04-25T02:25:16.777 INFO:teuthology.orchestra.run.smithi186.stdout:/var/run/ceph/ceph-client.1.37471.asok 2024-04-25T02:25:16.780 INFO:teuthology.orchestra.run.smithi186.stderr:2024-04-25T02:25:16 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-25T02:25:16.786 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.37471.asok 2024-04-25T02:25:16.787 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:25:16.787 DEBUG:teuthology.orchestra.run.smithi186:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.37471.asok mds_sessions 2024-04-25T02:25:16.927 INFO:teuthology.orchestra.run.smithi186.stdout:{ 2024-04-25T02:25:16.927 INFO:teuthology.orchestra.run.smithi186.stdout: "id": 4538, 2024-04-25T02:25:16.927 INFO:teuthology.orchestra.run.smithi186.stdout: "inst": { 2024-04-25T02:25:16.927 INFO:teuthology.orchestra.run.smithi186.stdout: "name": { 2024-04-25T02:25:16.927 INFO:teuthology.orchestra.run.smithi186.stdout: "type": "client", 2024-04-25T02:25:16.928 INFO:teuthology.orchestra.run.smithi186.stdout: "num": 4538 2024-04-25T02:25:16.928 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-25T02:25:16.928 INFO:teuthology.orchestra.run.smithi186.stdout: "addr": { 2024-04-25T02:25:16.928 INFO:teuthology.orchestra.run.smithi186.stdout: "type": "v1", 2024-04-25T02:25:16.928 INFO:teuthology.orchestra.run.smithi186.stdout: "addr": "172.21.15.186:0", 2024-04-25T02:25:16.928 INFO:teuthology.orchestra.run.smithi186.stdout: "nonce": 1473940677 2024-04-25T02:25:16.929 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-25T02:25:16.929 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-25T02:25:16.929 INFO:teuthology.orchestra.run.smithi186.stdout: "inst_str": "client.4538 v1:172.21.15.186:0/1473940677", 2024-04-25T02:25:16.929 INFO:teuthology.orchestra.run.smithi186.stdout: "addr_str": "v1:172.21.15.186:0/1473940677", 2024-04-25T02:25:16.929 INFO:teuthology.orchestra.run.smithi186.stdout: "sessions": [ 2024-04-25T02:25:16.930 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-25T02:25:16.930 INFO:teuthology.orchestra.run.smithi186.stdout: "mds": 0, 2024-04-25T02:25:16.930 INFO:teuthology.orchestra.run.smithi186.stdout: "addrs": { 2024-04-25T02:25:16.931 INFO:teuthology.orchestra.run.smithi186.stdout: "addrvec": [ 2024-04-25T02:25:16.931 INFO:teuthology.orchestra.run.smithi186.stdout: { 2024-04-25T02:25:16.931 INFO:teuthology.orchestra.run.smithi186.stdout: "type": "v1", 2024-04-25T02:25:16.931 INFO:teuthology.orchestra.run.smithi186.stdout: "addr": "172.21.15.111:6819", 2024-04-25T02:25:16.931 INFO:teuthology.orchestra.run.smithi186.stdout: "nonce": 696898730 2024-04-25T02:25:16.932 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-25T02:25:16.932 INFO:teuthology.orchestra.run.smithi186.stdout: ] 2024-04-25T02:25:16.932 INFO:teuthology.orchestra.run.smithi186.stdout: }, 2024-04-25T02:25:16.932 INFO:teuthology.orchestra.run.smithi186.stdout: "seq": 1, 2024-04-25T02:25:16.932 INFO:teuthology.orchestra.run.smithi186.stdout: "cap_gen": 0, 2024-04-25T02:25:16.933 INFO:teuthology.orchestra.run.smithi186.stdout: "cap_ttl": "2024-04-25T02:26:01.647277+0000", 2024-04-25T02:25:16.934 INFO:teuthology.orchestra.run.smithi186.stdout: "last_cap_renew_request": "2024-04-25T02:25:01.647277+0000", 2024-04-25T02:25:16.934 INFO:teuthology.orchestra.run.smithi186.stdout: "cap_renew_seq": 16, 2024-04-25T02:25:16.934 INFO:teuthology.orchestra.run.smithi186.stdout: "num_caps": 1, 2024-04-25T02:25:16.934 INFO:teuthology.orchestra.run.smithi186.stdout: "state": "open" 2024-04-25T02:25:16.934 INFO:teuthology.orchestra.run.smithi186.stdout: } 2024-04-25T02:25:16.934 INFO:teuthology.orchestra.run.smithi186.stdout: ], 2024-04-25T02:25:16.934 INFO:teuthology.orchestra.run.smithi186.stdout: "mdsmap_epoch": 19 2024-04-25T02:25:16.934 INFO:teuthology.orchestra.run.smithi186.stdout:} 2024-04-25T02:25:16.936 INFO:tasks.fs:confirming client client.1 is blocklisted 2024-04-25T02:25:16.936 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:25:17.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.048+0000 7f374f09a700 1 Processor -- start 2024-04-25T02:25:17.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.048+0000 7f374f09a700 1 -- start start 2024-04-25T02:25:17.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.049+0000 7f374f09a700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f37480a73c0 0x7f37481400f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:25:17.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.049+0000 7f374f09a700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f37480a4ff0 0x7f3748146fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:25:17.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.049+0000 7f374f09a700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f37480a4540 con 0x7f37480b3440 2024-04-25T02:25:17.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.049+0000 7f374f09a700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f374806fef0 con 0x7f37480a73c0 2024-04-25T02:25:17.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.049+0000 7f374f09a700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37480a42a0 con 0x7f37480a4ff0 2024-04-25T02:25:17.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.049+0000 7f374d637700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f37480a4ff0 0x7f3748146fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:25:17.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.049+0000 7f3747fff700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f37480a73c0 0x7f37481400f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:25:17.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.049+0000 7f374ce36700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f37480b3440 0x7f374813f9e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:33108/0 (socket says 172.21.15.111:33108) 2024-04-25T02:25:17.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.049+0000 7f374ce36700 1 -- 172.21.15.111:0/4216731232 learned_addr learned my addr 172.21.15.111:0/4216731232 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:25:17.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.049+0000 7f3747fff700 1 -- 172.21.15.111:0/4216731232 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f37480a4ff0 msgr2=0x7f3748146fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:25:17.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.049+0000 7f3747fff700 1 --2- 172.21.15.111:0/4216731232 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f37480a4ff0 0x7f3748146fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:17.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.049+0000 7f3747fff700 1 -- 172.21.15.111:0/4216731232 >> v1:172.21.15.111:6789/0 conn(0x7f37480b3440 legacy=0x7f374813f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:17.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.049+0000 7f3747fff700 1 -- 172.21.15.111:0/4216731232 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f37480b08a0 con 0x7f37480a73c0 2024-04-25T02:25:17.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.049+0000 7f37477fe700 1 -- 172.21.15.111:0/4216731232 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3704513569 0 0) 0x7f37480a4540 con 0x7f37480b3440 2024-04-25T02:25:17.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.049+0000 7f374d637700 1 --2- 172.21.15.111:0/4216731232 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f37480a4ff0 0x7f3748146fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:25:17.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.049+0000 7f3747fff700 1 --2- 172.21.15.111:0/4216731232 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f37480a73c0 0x7f37481400f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f37340098e0 tx=0x7f37340091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66b4949a983fb5c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:25:17.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.050+0000 7f37477fe700 1 -- 172.21.15.111:0/4216731232 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373400b6d0 con 0x7f37480a73c0 2024-04-25T02:25:17.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.050+0000 7f37477fe700 1 -- 172.21.15.111:0/4216731232 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f373400b830 con 0x7f37480a73c0 2024-04-25T02:25:17.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.050+0000 7f37477fe700 1 -- 172.21.15.111:0/4216731232 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f373400bbd0 con 0x7f37480a73c0 2024-04-25T02:25:17.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.050+0000 7f374f09a700 1 -- 172.21.15.111:0/4216731232 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f37480a73c0 msgr2=0x7f37481400f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:17.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.050+0000 7f374f09a700 1 --2- 172.21.15.111:0/4216731232 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f37480a73c0 0x7f37481400f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f37340098e0 tx=0x7f37340091a0 comp rx=0 tx=0).stop 2024-04-25T02:25:17.055 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.050+0000 7f374f09a700 1 -- 172.21.15.111:0/4216731232 shutdown_connections 2024-04-25T02:25:17.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.050+0000 7f374f09a700 1 --2- 172.21.15.111:0/4216731232 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f37480a4ff0 0x7f3748146fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:17.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.050+0000 7f374f09a700 1 --2- 172.21.15.111:0/4216731232 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f37480a73c0 0x7f37481400f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:17.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.050+0000 7f374f09a700 1 -- 172.21.15.111:0/4216731232 >> 172.21.15.111:0/4216731232 conn(0x7f374806e080 msgr2=0x7f374806bf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:25:17.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.050+0000 7f374f09a700 1 -- 172.21.15.111:0/4216731232 shutdown_connections 2024-04-25T02:25:17.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.050+0000 7f374f09a700 1 -- 172.21.15.111:0/4216731232 wait complete. 2024-04-25T02:25:17.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.051+0000 7f374f09a700 1 Processor -- start 2024-04-25T02:25:17.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.051+0000 7f374f09a700 1 -- start start 2024-04-25T02:25:17.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.052+0000 7f374f09a700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f37480a4ff0 0x7f37480acf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:25:17.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.052+0000 7f374f09a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f37480a73c0 0x7f37480ae070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:25:17.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.052+0000 7f374f09a700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f37480b3440 0x7f374814c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:25:17.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.052+0000 7f374f09a700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f374814c0d0 con 0x7f37480a73c0 2024-04-25T02:25:17.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.052+0000 7f374f09a700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37480ae5b0 con 0x7f37480a4ff0 2024-04-25T02:25:17.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.052+0000 7f374f09a700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f37480aad40 con 0x7f37480b3440 2024-04-25T02:25:17.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.052+0000 7f374d637700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f37480b3440 0x7f374814c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:25:17.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.052+0000 7f3747fff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f37480a73c0 0x7f37480ae070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:25:17.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.052+0000 7f374ce36700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f37480a4ff0 0x7f37480acf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:25:17.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.052+0000 7f374d637700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f37480b3440 0x7f374814c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:36398/0 (socket says 172.21.15.111:36398) 2024-04-25T02:25:17.059 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.052+0000 7f374d637700 1 -- 172.21.15.111:0/1842491615 learned_addr learned my addr 172.21.15.111:0/1842491615 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:25:17.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.052+0000 7f3747fff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f37480a73c0 0x7f37480ae070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:40290/0 (socket says 172.21.15.111:40290) 2024-04-25T02:25:17.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.052+0000 7f374d637700 1 -- 172.21.15.111:0/1842491615 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f37480a4ff0 msgr2=0x7f37480acf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:17.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.052+0000 7f374d637700 1 --2- 172.21.15.111:0/1842491615 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f37480a4ff0 0x7f37480acf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:17.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.052+0000 7f374d637700 1 -- 172.21.15.111:0/1842491615 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f37480a73c0 msgr2=0x7f37480ae070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:17.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.052+0000 7f374d637700 1 --2- 172.21.15.111:0/1842491615 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f37480a73c0 0x7f37480ae070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:17.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.052+0000 7f374d637700 1 -- 172.21.15.111:0/1842491615 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3740009a20 con 0x7f37480b3440 2024-04-25T02:25:17.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.052+0000 7f374d637700 1 --2- 172.21.15.111:0/1842491615 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f37480b3440 0x7f374814c390 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3740009fc0 tx=0x7f374000b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:25:17.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.052+0000 7f3744ff9700 1 -- 172.21.15.111:0/1842491615 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374000cd30 con 0x7f37480b3440 2024-04-25T02:25:17.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.053+0000 7f3744ff9700 1 -- 172.21.15.111:0/1842491615 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f374000f040 con 0x7f37480b3440 2024-04-25T02:25:17.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.053+0000 7f3744ff9700 1 -- 172.21.15.111:0/1842491615 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f37400146d0 con 0x7f37480b3440 2024-04-25T02:25:17.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.053+0000 7f374f09a700 1 -- 172.21.15.111:0/1842491615 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3734009420 con 0x7f37480b3440 2024-04-25T02:25:17.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.053+0000 7f374f09a700 1 -- 172.21.15.111:0/1842491615 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37481497b0 con 0x7f37480b3440 2024-04-25T02:25:17.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.053+0000 7f3744ff9700 1 -- 172.21.15.111:0/1842491615 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f3740003020 con 0x7f37480b3440 2024-04-25T02:25:17.060 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.053+0000 7f374f09a700 1 -- 172.21.15.111:0/1842491615 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3748071790 con 0x7f37480b3440 2024-04-25T02:25:17.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.054+0000 7f3744ff9700 1 -- 172.21.15.111:0/1842491615 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4158+0+0 (secure 0 0 0) 0x7f374005bb30 con 0x7f37480b3440 2024-04-25T02:25:17.061 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.057+0000 7f3744ff9700 1 -- 172.21.15.111:0/1842491615 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f3740039dc0 con 0x7f37480b3440 2024-04-25T02:25:17.219 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.216+0000 7f374f09a700 1 -- 172.21.15.111:0/1842491615 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f37480a3ad0 con 0x7f37480b3440 2024-04-25T02:25:17.220 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.217+0000 7f3744ff9700 1 -- 172.21.15.111:0/1842491615 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+12106 (secure 0 0 0) 0x7f3740018070 con 0x7f37480b3440 2024-04-25T02:25:17.220 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:25:17.220 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":43,"fsid":"4643f974-f93a-4436-93b8-460ff320e62e","created":"2024-04-25T02:20:05.450475+0000","modified":"2024-04-25T02:25:10.060341+0000","last_up_change":"2024-04-25T02:23:12.818028+0000","last_in_change":"2024-04-25T02:20:10.439204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:20:07.471248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:20:14.420378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:20:22.251868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T02:20:23.128289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"df3f17ca-3b12-42c8-8cf7-8f1b7189e587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":41,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6800","nonce":48862}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6801","nonce":48862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6803","nonce":48862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6802","nonce":48862}]},"public_addr":"172.21.15.111:6800/48862","cluster_addr":"172.21.15.111:6801/48862","heartbeat_back_addr":"172.21.15.111:6803/48862","heartbeat_front_addr":"172.21.15.111:6802/48862","state":["exists","up"]},{"osd":1,"uuid":"93d54815-f215-4285-bba6-32f2d1cabf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":29,"up_thru":31,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6804","nonce":48960}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6805","nonce":48960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6807","nonce":48960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6806","nonce":48960}]},"public_addr":"172.21.15.111:6804/48960","cluster_addr":"172.21.15.111:6805/48960","heartbeat_back_addr":"172.21.15.111:6807/48960","heartbeat_front_addr":"172.21.15.111:6806/48960","state":["exists","up"]},{"osd":2,"uuid":"b26b2104-2a2e-408f-9ce7-3587a32a2ebe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":41,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6808","nonce":49070}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6809","nonce":49070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6811","nonce":49070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6810","nonce":49070}]},"public_addr":"172.21.15.111:6808/49070","cluster_addr":"172.21.15.111:6809/49070","heartbeat_back_addr":"172.21.15.111:6811/49070","heartbeat_front_addr":"172.21.15.111:6810/49070","state":["exists","up"]},{"osd":3,"uuid":"43c25820-1edc-4031-badf-72e87dd6bf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":31,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6812","nonce":49243}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6813","nonce":49243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6815","nonce":49243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6814","nonce":49243}]},"public_addr":"172.21.15.111:6812/49243","cluster_addr":"172.21.15.111:6813/49243","heartbeat_back_addr":"172.21.15.111:6815/49243","heartbeat_front_addr":"172.21.15.111:6814/49243","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.372427+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.411480+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.361508+0000","dead_epoch":25},{"osd":3,"down_stamp":"2024-04-25T02:23:06.771296+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.377212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.d","mappings":[{"from":3,"to":2}]},{"pgid":"4.13","mappings":[{"from":3,"to":0}]},{"pgid":"4.19","mappings":[{"from":3,"to":0}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.30","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.186:0/1473940677":"2024-04-25T03:25:09.063135+0000","172.21.15.111:6819/4003866251":"2024-04-26T02:23:16.839679+0000","172.21.15.111:0/2148931273":"2024-04-26T02:22:54.713254+0000","172.21.15.111:6816/39585":"2024-04-26T02:22:54.713254+0000","172.21.15.111:0/3911588907":"2024-04-26T02:22:54.713254+0000","172.21.15.111:0/1276843622":"2024-04-26T02:22:54.713254+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:25:17.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.218+0000 7f374f09a700 1 -- 172.21.15.111:0/1842491615 >> v1:172.21.15.111:6816/46482 conn(0x7f372c045ef0 legacy=0x7f372c0483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:17.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.218+0000 7f374f09a700 1 -- 172.21.15.111:0/1842491615 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f37480b3440 msgr2=0x7f374814c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:25:17.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.218+0000 7f374f09a700 1 --2- 172.21.15.111:0/1842491615 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f37480b3440 0x7f374814c390 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f3740009fc0 tx=0x7f374000b040 comp rx=0 tx=0).stop 2024-04-25T02:25:17.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.218+0000 7f374f09a700 1 -- 172.21.15.111:0/1842491615 shutdown_connections 2024-04-25T02:25:17.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.218+0000 7f374f09a700 1 --2- 172.21.15.111:0/1842491615 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f37480b3440 0x7f374814c390 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:17.222 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.218+0000 7f374f09a700 1 --2- 172.21.15.111:0/1842491615 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f37480a4ff0 0x7f37480acf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:17.223 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.218+0000 7f374f09a700 1 --2- 172.21.15.111:0/1842491615 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f37480a73c0 0x7f37480ae070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:25:17.223 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.218+0000 7f374f09a700 1 -- 172.21.15.111:0/1842491615 >> 172.21.15.111:0/1842491615 conn(0x7f374806e080 msgr2=0x7f3748068090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:25:17.223 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.219+0000 7f374f09a700 1 -- 172.21.15.111:0/1842491615 shutdown_connections 2024-04-25T02:25:17.223 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:25:17.219+0000 7f374f09a700 1 -- 172.21.15.111:0/1842491615 wait complete. 2024-04-25T02:25:17.234 INFO:teuthology.run_tasks:Running task workunit... 2024-04-25T02:25:17.250 INFO:tasks.workunit:Pulling workunits from ref d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T02:25:17.251 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-25T02:25:17.252 DEBUG:teuthology.orchestra.run.smithi114:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-25T02:25:17.272 INFO:teuthology.orchestra.run.smithi114.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-25T02:25:17.272 INFO:teuthology.orchestra.run.smithi114.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-25T02:25:17.272 INFO:teuthology.orchestra.run.smithi114.stdout:Device: 2eh/46d Inode: 1 Links: 2 2024-04-25T02:25:17.272 INFO:teuthology.orchestra.run.smithi114.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-25T02:25:17.272 INFO:teuthology.orchestra.run.smithi114.stdout:Context: system_u:object_r:fusefs_t:s0 2024-04-25T02:25:17.272 INFO:teuthology.orchestra.run.smithi114.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-25T02:25:17.272 INFO:teuthology.orchestra.run.smithi114.stdout:Modify: 2024-04-25 02:20:24.152663023 +0000 2024-04-25T02:25:17.272 INFO:teuthology.orchestra.run.smithi114.stdout:Change: 2024-04-25 02:20:45.600023763 +0000 2024-04-25T02:25:17.272 INFO:teuthology.orchestra.run.smithi114.stdout: Birth: - 2024-04-25T02:25:17.273 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-25T02:25:17.273 DEBUG:teuthology.orchestra.run.smithi114:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-25T02:25:17.345 INFO:tasks.workunit:timeout=3h 2024-04-25T02:25:17.345 INFO:tasks.workunit:cleanup=True 2024-04-25T02:25:17.345 DEBUG:teuthology.orchestra.run.smithi114:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout d2c45d977142e024a59b68a8f1dce8f0b9840551 2024-04-25T02:25:17.405 INFO:tasks.workunit.client.0.smithi114.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-25T02:26:27.218 INFO:tasks.workunit.client.0.smithi114.stderr:Note: switching to 'd2c45d977142e024a59b68a8f1dce8f0b9840551'. 2024-04-25T02:26:27.218 INFO:tasks.workunit.client.0.smithi114.stderr: 2024-04-25T02:26:27.218 INFO:tasks.workunit.client.0.smithi114.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-25T02:26:27.218 INFO:tasks.workunit.client.0.smithi114.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-25T02:26:27.218 INFO:tasks.workunit.client.0.smithi114.stderr:state without impacting any branches by switching back to a branch. 2024-04-25T02:26:27.218 INFO:tasks.workunit.client.0.smithi114.stderr: 2024-04-25T02:26:27.219 INFO:tasks.workunit.client.0.smithi114.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-25T02:26:27.219 INFO:tasks.workunit.client.0.smithi114.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-25T02:26:27.219 INFO:tasks.workunit.client.0.smithi114.stderr: 2024-04-25T02:26:27.219 INFO:tasks.workunit.client.0.smithi114.stderr: git switch -c 2024-04-25T02:26:27.219 INFO:tasks.workunit.client.0.smithi114.stderr: 2024-04-25T02:26:27.219 INFO:tasks.workunit.client.0.smithi114.stderr:Or undo this operation with: 2024-04-25T02:26:27.219 INFO:tasks.workunit.client.0.smithi114.stderr: 2024-04-25T02:26:27.219 INFO:tasks.workunit.client.0.smithi114.stderr: git switch - 2024-04-25T02:26:27.219 INFO:tasks.workunit.client.0.smithi114.stderr: 2024-04-25T02:26:27.219 INFO:tasks.workunit.client.0.smithi114.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-25T02:26:27.219 INFO:tasks.workunit.client.0.smithi114.stderr: 2024-04-25T02:26:27.219 INFO:tasks.workunit.client.0.smithi114.stderr:HEAD is now at d2c45d97714 Merge pull request #56528 from adk3798/squid-mypy-bump 2024-04-25T02:26:27.221 DEBUG:teuthology.orchestra.run.smithi114:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-25T02:26:27.284 INFO:tasks.workunit.client.0.smithi114.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-25T02:26:27.286 INFO:tasks.workunit.client.0.smithi114.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-25T02:26:27.287 INFO:tasks.workunit.client.0.smithi114.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-25T02:26:27.823 INFO:tasks.workunit.client.0.smithi114.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-25T02:26:27.887 INFO:tasks.workunit.client.0.smithi114.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-25T02:26:27.925 INFO:tasks.workunit.client.0.smithi114.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-25T02:26:27.926 INFO:tasks.workunit.client.0.smithi114.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-25T02:26:27.926 INFO:tasks.workunit.client.0.smithi114.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-25T02:26:27.963 INFO:tasks.workunit.client.0.smithi114.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-25T02:26:27.966 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-25T02:26:27.966 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-25T02:26:28.025 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-04-25T02:26:28.026 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-25T02:26:28.026 DEBUG:teuthology.orchestra.run.smithi114:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=d2c45d977142e024a59b68a8f1dce8f0b9840551 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-04-25T02:26:28.093 INFO:tasks.workunit.client.0.smithi114.stderr:+ mkdir -p fsstress 2024-04-25T02:26:28.095 INFO:tasks.workunit.client.0.smithi114.stderr:+ pushd fsstress 2024-04-25T02:26:28.097 INFO:tasks.workunit.client.0.smithi114.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-25T02:26:28.097 INFO:tasks.workunit.client.0.smithi114.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-25T02:26:29.303 INFO:tasks.workunit.client.0.smithi114.stderr:+ tar xzf ltp-full.tgz 2024-04-25T02:27:01.652 INFO:tasks.workunit.client.0.smithi114.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-25T02:27:01.656 INFO:tasks.workunit.client.0.smithi114.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-25T02:27:01.656 INFO:tasks.workunit.client.0.smithi114.stderr:+ make 2024-04-25T02:27:01.716 INFO:tasks.workunit.client.0.smithi114.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-25T02:27:02.041 INFO:tasks.workunit.client.0.smithi114.stderr:++ readlink -f fsstress 2024-04-25T02:27:02.050 INFO:tasks.workunit.client.0.smithi114.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-25T02:27:02.050 INFO:tasks.workunit.client.0.smithi114.stderr:+ popd 2024-04-25T02:27:02.051 INFO:tasks.workunit.client.0.smithi114.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-25T02:27:02.051 INFO:tasks.workunit.client.0.smithi114.stderr:+ popd 2024-04-25T02:27:02.051 INFO:tasks.workunit.client.0.smithi114.stdout:~/cephtest/mnt.0/client.0/tmp 2024-04-25T02:27:02.052 INFO:tasks.workunit.client.0.smithi114.stderr:++ mktemp -d -p . 2024-04-25T02:27:02.052 INFO:tasks.workunit.client.0.smithi114.stderr:+ T=./tmp.ptayTPa6nf 2024-04-25T02:27:02.052 INFO:tasks.workunit.client.0.smithi114.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.ptayTPa6nf -l 1 -n 1000 -p 10 -v 2024-04-25T02:27:02.052 INFO:tasks.workunit.client.0.smithi114.stdout:seed = 1713964959 2024-04-25T02:27:02.052 INFO:tasks.workunit.client.0.smithi114.stdout:0/0: stat - no entries 2024-04-25T02:27:02.052 INFO:tasks.workunit.client.0.smithi114.stdout:0/1: dread - no filename 2024-04-25T02:27:02.053 INFO:tasks.workunit.client.0.smithi114.stdout:0/2: dwrite - no filename 2024-04-25T02:27:02.053 INFO:tasks.workunit.client.0.smithi114.stdout:0/3: fdatasync - no filename 2024-04-25T02:27:02.053 INFO:tasks.workunit.client.0.smithi114.stdout:0/4: mkdir d0 0 2024-04-25T02:27:02.053 INFO:tasks.workunit.client.0.smithi114.stdout:0/5: write - no filename 2024-04-25T02:27:02.054 INFO:tasks.workunit.client.0.smithi114.stdout:2/0: write - no filename 2024-04-25T02:27:02.055 INFO:tasks.workunit.client.0.smithi114.stdout:2/1: write - no filename 2024-04-25T02:27:02.055 INFO:tasks.workunit.client.0.smithi114.stdout:2/2: dread - no filename 2024-04-25T02:27:02.055 INFO:tasks.workunit.client.0.smithi114.stdout:1/0: getdents . 0 2024-04-25T02:27:02.055 INFO:tasks.workunit.client.0.smithi114.stdout:1/1: rmdir - no directory 2024-04-25T02:27:02.055 INFO:tasks.workunit.client.0.smithi114.stdout:1/2: dread - no filename 2024-04-25T02:27:02.055 INFO:tasks.workunit.client.0.smithi114.stdout:1/3: dread - no filename 2024-04-25T02:27:02.055 INFO:tasks.workunit.client.0.smithi114.stdout:1/4: write - no filename 2024-04-25T02:27:02.056 INFO:tasks.workunit.client.0.smithi114.stdout:1/5: dwrite - no filename 2024-04-25T02:27:02.056 INFO:tasks.workunit.client.0.smithi114.stdout:1/6: write - no filename 2024-04-25T02:27:02.056 INFO:tasks.workunit.client.0.smithi114.stdout:1/7: chown . 4 1 2024-04-25T02:27:02.056 INFO:tasks.workunit.client.0.smithi114.stdout:1/8: write - no filename 2024-04-25T02:27:02.057 INFO:tasks.workunit.client.0.smithi114.stdout:0/6: rmdir d0 0 2024-04-25T02:27:02.057 INFO:tasks.workunit.client.0.smithi114.stdout:0/7: dread - no filename 2024-04-25T02:27:02.057 INFO:tasks.workunit.client.0.smithi114.stdout:2/3: getdents . 0 2024-04-25T02:27:02.058 INFO:tasks.workunit.client.0.smithi114.stdout:2/4: dread - no filename 2024-04-25T02:27:02.058 INFO:tasks.workunit.client.0.smithi114.stdout:2/5: dwrite - no filename 2024-04-25T02:27:02.058 INFO:tasks.workunit.client.0.smithi114.stdout:4/0: fdatasync - no filename 2024-04-25T02:27:02.058 INFO:tasks.workunit.client.0.smithi114.stdout:1/9: creat f0 x:0 0 0 2024-04-25T02:27:02.059 INFO:tasks.workunit.client.0.smithi114.stdout:0/8: mkdir d1 0 2024-04-25T02:27:02.060 INFO:tasks.workunit.client.0.smithi114.stdout:5/0: fdatasync - no filename 2024-04-25T02:27:02.060 INFO:tasks.workunit.client.0.smithi114.stdout:5/1: chown . 199 1 2024-04-25T02:27:02.060 INFO:tasks.workunit.client.0.smithi114.stdout:5/2: truncate - no filename 2024-04-25T02:27:02.060 INFO:tasks.workunit.client.0.smithi114.stdout:1/10: mknod c1 0 2024-04-25T02:27:02.062 INFO:tasks.workunit.client.0.smithi114.stdout:2/6: creat f0 x:0 0 0 2024-04-25T02:27:02.062 INFO:tasks.workunit.client.0.smithi114.stdout:1/11: chown f0 14356 1 2024-04-25T02:27:02.062 INFO:tasks.workunit.client.0.smithi114.stdout:4/1: creat f0 x:0 0 0 2024-04-25T02:27:02.062 INFO:tasks.workunit.client.0.smithi114.stdout:2/7: write f0 [453693,37105] 0 2024-04-25T02:27:02.064 INFO:tasks.workunit.client.0.smithi114.stdout:0/9: getdents d1 0 2024-04-25T02:27:02.065 INFO:tasks.workunit.client.0.smithi114.stdout:6/0: link - no file 2024-04-25T02:27:02.065 INFO:tasks.workunit.client.0.smithi114.stdout:6/1: stat - no entries 2024-04-25T02:27:02.065 INFO:tasks.workunit.client.0.smithi114.stdout:5/3: symlink l0 0 2024-04-25T02:27:02.065 INFO:tasks.workunit.client.0.smithi114.stdout:4/2: chown f0 1796013 1 2024-04-25T02:27:02.065 INFO:tasks.workunit.client.0.smithi114.stdout:0/10: chown d1 53 1 2024-04-25T02:27:02.066 INFO:tasks.workunit.client.0.smithi114.stdout:4/3: stat f0 0 2024-04-25T02:27:02.066 INFO:tasks.workunit.client.0.smithi114.stdout:5/4: mkdir d1 0 2024-04-25T02:27:02.068 INFO:tasks.workunit.client.0.smithi114.stdout:7/0: link - no file 2024-04-25T02:27:02.068 INFO:tasks.workunit.client.0.smithi114.stdout:0/11: rename d1 to d1/d2 22 2024-04-25T02:27:02.068 INFO:tasks.workunit.client.0.smithi114.stdout:0/12: dwrite - no filename 2024-04-25T02:27:02.069 INFO:tasks.workunit.client.0.smithi114.stdout:2/8: dread f0 [0,4194304] 0 2024-04-25T02:27:02.069 INFO:tasks.workunit.client.0.smithi114.stdout:4/4: dread - f0 zero size 2024-04-25T02:27:02.069 INFO:tasks.workunit.client.0.smithi114.stdout:6/2: mknod c0 0 2024-04-25T02:27:02.069 INFO:tasks.workunit.client.0.smithi114.stdout:6/3: dread - no filename 2024-04-25T02:27:02.069 INFO:tasks.workunit.client.0.smithi114.stdout:5/5: unlink l0 0 2024-04-25T02:27:02.069 INFO:tasks.workunit.client.0.smithi114.stdout:5/6: dread - no filename 2024-04-25T02:27:02.069 INFO:tasks.workunit.client.0.smithi114.stdout:5/7: fdatasync - no filename 2024-04-25T02:27:02.069 INFO:tasks.workunit.client.0.smithi114.stdout:2/9: mknod c1 0 2024-04-25T02:27:02.070 INFO:tasks.workunit.client.0.smithi114.stdout:4/5: truncate f0 278092 0 2024-04-25T02:27:02.071 INFO:tasks.workunit.client.0.smithi114.stdout:7/1: mknod c0 0 2024-04-25T02:27:02.071 INFO:tasks.workunit.client.0.smithi114.stdout:9/0: fsync - no filename 2024-04-25T02:27:02.071 INFO:tasks.workunit.client.0.smithi114.stdout:9/1: dread - no filename 2024-04-25T02:27:02.071 INFO:tasks.workunit.client.0.smithi114.stdout:9/2: unlink - no file 2024-04-25T02:27:02.072 INFO:tasks.workunit.client.0.smithi114.stdout:0/13: creat d1/f3 x:0 0 0 2024-04-25T02:27:02.072 INFO:tasks.workunit.client.0.smithi114.stdout:6/4: rename c0 to c1 0 2024-04-25T02:27:02.072 INFO:tasks.workunit.client.0.smithi114.stdout:6/5: truncate - no filename 2024-04-25T02:27:02.073 INFO:tasks.workunit.client.0.smithi114.stdout:1/12: dwrite f0 [0,4194304] 0 2024-04-25T02:27:02.073 INFO:tasks.workunit.client.0.smithi114.stdout:0/14: read - d1/f3 zero size 2024-04-25T02:27:02.074 INFO:tasks.workunit.client.0.smithi114.stdout:2/10: creat f2 x:0 0 0 2024-04-25T02:27:02.074 INFO:tasks.workunit.client.0.smithi114.stdout:4/6: symlink l1 0 2024-04-25T02:27:02.076 INFO:tasks.workunit.client.0.smithi114.stdout:7/2: creat f1 x:0 0 0 2024-04-25T02:27:02.078 INFO:tasks.workunit.client.0.smithi114.stdout:8/0: mknod c0 0 2024-04-25T02:27:02.078 INFO:tasks.workunit.client.0.smithi114.stdout:8/1: fsync - no filename 2024-04-25T02:27:02.078 INFO:tasks.workunit.client.0.smithi114.stdout:8/2: fsync - no filename 2024-04-25T02:27:02.078 INFO:tasks.workunit.client.0.smithi114.stdout:8/3: write - no filename 2024-04-25T02:27:02.078 INFO:tasks.workunit.client.0.smithi114.stdout:8/4: chown c0 37 1 2024-04-25T02:27:02.078 INFO:tasks.workunit.client.0.smithi114.stdout:8/5: write - no filename 2024-04-25T02:27:02.079 INFO:tasks.workunit.client.0.smithi114.stdout:8/6: chown c0 622 1 2024-04-25T02:27:02.079 INFO:tasks.workunit.client.0.smithi114.stdout:5/8: mknod d1/c2 0 2024-04-25T02:27:02.079 INFO:tasks.workunit.client.0.smithi114.stdout:1/13: symlink l2 0 2024-04-25T02:27:02.080 INFO:tasks.workunit.client.0.smithi114.stdout:1/14: write f0 [1578036,61019] 0 2024-04-25T02:27:02.080 INFO:tasks.workunit.client.0.smithi114.stdout:0/15: mkdir d1/d4 0 2024-04-25T02:27:02.081 INFO:tasks.workunit.client.0.smithi114.stdout:0/16: truncate d1/f3 792408 0 2024-04-25T02:27:02.082 INFO:tasks.workunit.client.0.smithi114.stdout:4/7: symlink l2 0 2024-04-25T02:27:02.082 INFO:tasks.workunit.client.0.smithi114.stdout:0/17: write d1/f3 [370168,28590] 0 2024-04-25T02:27:02.083 INFO:tasks.workunit.client.0.smithi114.stdout:7/3: symlink l2 0 2024-04-25T02:27:02.084 INFO:tasks.workunit.client.0.smithi114.stdout:9/3: creat f0 x:0 0 0 2024-04-25T02:27:02.085 INFO:tasks.workunit.client.0.smithi114.stdout:7/4: truncate f1 361689 0 2024-04-25T02:27:02.085 INFO:tasks.workunit.client.0.smithi114.stdout:9/4: fdatasync f0 0 2024-04-25T02:27:02.092 INFO:tasks.workunit.client.0.smithi114.stdout:1/15: dwrite f0 [0,4194304] 0 2024-04-25T02:27:02.094 INFO:tasks.workunit.client.0.smithi114.stdout:9/5: unlink f0 0 2024-04-25T02:27:02.094 INFO:tasks.workunit.client.0.smithi114.stdout:9/6: link - no file 2024-04-25T02:27:02.094 INFO:tasks.workunit.client.0.smithi114.stdout:9/7: rmdir - no directory 2024-04-25T02:27:02.095 INFO:tasks.workunit.client.0.smithi114.stdout:4/8: dwrite f0 [0,4194304] 0 2024-04-25T02:27:02.097 INFO:tasks.workunit.client.0.smithi114.stdout:7/5: dwrite f1 [0,4194304] 0 2024-04-25T02:27:02.097 INFO:tasks.workunit.client.0.smithi114.stdout:7/6: rmdir - no directory 2024-04-25T02:27:02.097 INFO:tasks.workunit.client.0.smithi114.stdout:0/18: creat d1/d4/f5 x:0 0 0 2024-04-25T02:27:02.098 INFO:tasks.workunit.client.0.smithi114.stdout:8/7: link c0 c1 0 2024-04-25T02:27:02.101 INFO:tasks.workunit.client.0.smithi114.stdout:4/9: dread f0 [0,4194304] 0 2024-04-25T02:27:02.102 INFO:tasks.workunit.client.0.smithi114.stdout:9/8: creat f1 x:0 0 0 2024-04-25T02:27:02.104 INFO:tasks.workunit.client.0.smithi114.stdout:6/6: stat c1 0 2024-04-25T02:27:02.104 INFO:tasks.workunit.client.0.smithi114.stdout:6/7: dwrite - no filename 2024-04-25T02:27:02.104 INFO:tasks.workunit.client.0.smithi114.stdout:6/8: write - no filename 2024-04-25T02:27:02.104 INFO:tasks.workunit.client.0.smithi114.stdout:6/9: fdatasync - no filename 2024-04-25T02:27:02.104 INFO:tasks.workunit.client.0.smithi114.stdout:4/10: chown f0 15347 1 2024-04-25T02:27:02.105 INFO:tasks.workunit.client.0.smithi114.stdout:7/7: dread f1 [0,4194304] 0 2024-04-25T02:27:02.106 INFO:tasks.workunit.client.0.smithi114.stdout:2/11: getdents . 0 2024-04-25T02:27:02.107 INFO:tasks.workunit.client.0.smithi114.stdout:0/19: dwrite d1/f3 [0,4194304] 0 2024-04-25T02:27:02.111 INFO:tasks.workunit.client.0.smithi114.stdout:0/20: write d1/d4/f5 [419183,88050] 0 2024-04-25T02:27:02.112 INFO:tasks.workunit.client.0.smithi114.stdout:9/9: dwrite f1 [0,4194304] 0 2024-04-25T02:27:02.112 INFO:tasks.workunit.client.0.smithi114.stdout:6/10: symlink l2 0 2024-04-25T02:27:02.112 INFO:tasks.workunit.client.0.smithi114.stdout:6/11: dread - no filename 2024-04-25T02:27:02.112 INFO:tasks.workunit.client.0.smithi114.stdout:6/12: dread - no filename 2024-04-25T02:27:02.113 INFO:tasks.workunit.client.0.smithi114.stdout:4/11: mkdir d3 0 2024-04-25T02:27:02.114 INFO:tasks.workunit.client.0.smithi114.stdout:7/8: mknod c3 0 2024-04-25T02:27:02.116 INFO:tasks.workunit.client.0.smithi114.stdout:4/12: dread f0 [0,4194304] 0 2024-04-25T02:27:02.117 INFO:tasks.workunit.client.0.smithi114.stdout:8/8: rename c0 to c2 0 2024-04-25T02:27:02.117 INFO:tasks.workunit.client.0.smithi114.stdout:4/13: readlink l2 0 2024-04-25T02:27:02.117 INFO:tasks.workunit.client.0.smithi114.stdout:2/12: mknod c3 0 2024-04-25T02:27:02.117 INFO:tasks.workunit.client.0.smithi114.stdout:2/13: chown c3 26 1 2024-04-25T02:27:02.119 INFO:tasks.workunit.client.0.smithi114.stdout:1/16: link l2 l3 0 2024-04-25T02:27:02.127 INFO:tasks.workunit.client.0.smithi114.stdout:6/13: symlink l3 0 2024-04-25T02:27:02.127 INFO:tasks.workunit.client.0.smithi114.stdout:6/14: write - no filename 2024-04-25T02:27:02.127 INFO:tasks.workunit.client.0.smithi114.stdout:6/15: fdatasync - no filename 2024-04-25T02:27:02.127 INFO:tasks.workunit.client.0.smithi114.stdout:6/16: dread - no filename 2024-04-25T02:27:02.129 INFO:tasks.workunit.client.0.smithi114.stdout:8/9: creat f3 x:0 0 0 2024-04-25T02:27:02.131 INFO:tasks.workunit.client.0.smithi114.stdout:2/14: mkdir d4 0 2024-04-25T02:27:02.133 INFO:tasks.workunit.client.0.smithi114.stdout:1/17: creat f4 x:0 0 0 2024-04-25T02:27:02.137 INFO:tasks.workunit.client.0.smithi114.stdout:7/9: dwrite f1 [0,4194304] 0 2024-04-25T02:27:02.139 INFO:tasks.workunit.client.0.smithi114.stdout:6/17: creat f4 x:0 0 0 2024-04-25T02:27:02.139 INFO:tasks.workunit.client.0.smithi114.stdout:1/18: write f4 [223142,60239] 0 2024-04-25T02:27:02.139 INFO:tasks.workunit.client.0.smithi114.stdout:8/10: creat f4 x:0 0 0 2024-04-25T02:27:02.143 INFO:tasks.workunit.client.0.smithi114.stdout:9/10: getdents . 0 2024-04-25T02:27:02.143 INFO:tasks.workunit.client.0.smithi114.stdout:4/14: dwrite f0 [4194304,4194304] 0 2024-04-25T02:27:02.143 INFO:tasks.workunit.client.0.smithi114.stdout:2/15: rmdir d4 0 2024-04-25T02:27:02.145 INFO:tasks.workunit.client.0.smithi114.stdout:7/10: dread f1 [0,4194304] 0 2024-04-25T02:27:02.146 INFO:tasks.workunit.client.0.smithi114.stdout:8/11: dwrite f3 [0,4194304] 0 2024-04-25T02:27:02.147 INFO:tasks.workunit.client.0.smithi114.stdout:7/11: rename c3 to c4 0 2024-04-25T02:27:02.148 INFO:tasks.workunit.client.0.smithi114.stdout:7/12: mkdir d5 0 2024-04-25T02:27:02.149 INFO:tasks.workunit.client.0.smithi114.stdout:2/16: dwrite f0 [0,4194304] 0 2024-04-25T02:27:02.149 INFO:tasks.workunit.client.0.smithi114.stdout:8/12: chown c1 36 1 2024-04-25T02:27:02.149 INFO:tasks.workunit.client.0.smithi114.stdout:8/13: dread - f4 zero size 2024-04-25T02:27:02.152 INFO:tasks.workunit.client.0.smithi114.stdout:2/17: write f0 [2439555,40857] 0 2024-04-25T02:27:02.152 INFO:tasks.workunit.client.0.smithi114.stdout:2/18: write f0 [2048254,51792] 0 2024-04-25T02:27:02.153 INFO:tasks.workunit.client.0.smithi114.stdout:8/14: symlink l5 0 2024-04-25T02:27:02.153 INFO:tasks.workunit.client.0.smithi114.stdout:8/15: dread - f4 zero size 2024-04-25T02:27:02.154 INFO:tasks.workunit.client.0.smithi114.stdout:2/19: mkdir d5 0 2024-04-25T02:27:02.158 INFO:tasks.workunit.client.0.smithi114.stdout:2/20: chown f2 238 1 2024-04-25T02:27:02.159 INFO:tasks.workunit.client.0.smithi114.stdout:7/13: dwrite f1 [0,4194304] 0 2024-04-25T02:27:02.160 INFO:tasks.workunit.client.0.smithi114.stdout:2/21: mkdir d5/d6 0 2024-04-25T02:27:02.160 INFO:tasks.workunit.client.0.smithi114.stdout:7/14: read f1 [910313,4923] 0 2024-04-25T02:27:02.162 INFO:tasks.workunit.client.0.smithi114.stdout:2/22: mknod d5/d6/c7 0 2024-04-25T02:27:02.166 INFO:tasks.workunit.client.0.smithi114.stdout:7/15: dwrite f1 [0,4194304] 0 2024-04-25T02:27:02.195 INFO:tasks.workunit.client.0.smithi114.stdout:0/21: truncate d1/f3 3586681 0 2024-04-25T02:27:02.196 INFO:tasks.workunit.client.0.smithi114.stdout:6/18: getdents . 0 2024-04-25T02:27:02.196 INFO:tasks.workunit.client.0.smithi114.stdout:6/19: chown f4 15 1 2024-04-25T02:27:02.197 INFO:tasks.workunit.client.0.smithi114.stdout:6/20: write f4 [498223,120009] 0 2024-04-25T02:27:02.197 INFO:tasks.workunit.client.0.smithi114.stdout:0/22: creat d1/f6 x:0 0 0 2024-04-25T02:27:02.197 INFO:tasks.workunit.client.0.smithi114.stdout:8/16: fdatasync f3 0 2024-04-25T02:27:02.198 INFO:tasks.workunit.client.0.smithi114.stdout:9/11: truncate f1 2762139 0 2024-04-25T02:27:02.199 INFO:tasks.workunit.client.0.smithi114.stdout:6/21: dread f4 [0,4194304] 0 2024-04-25T02:27:02.200 INFO:tasks.workunit.client.0.smithi114.stdout:0/23: dwrite d1/d4/f5 [0,4194304] 0 2024-04-25T02:27:02.201 INFO:tasks.workunit.client.0.smithi114.stdout:6/22: creat f5 x:0 0 0 2024-04-25T02:27:02.201 INFO:tasks.workunit.client.0.smithi114.stdout:8/17: link l5 l6 0 2024-04-25T02:27:02.201 INFO:tasks.workunit.client.0.smithi114.stdout:0/24: chown d1/f6 241518642 1 2024-04-25T02:27:02.201 INFO:tasks.workunit.client.0.smithi114.stdout:8/18: write f4 [679246,97788] 0 2024-04-25T02:27:02.202 INFO:tasks.workunit.client.0.smithi114.stdout:6/23: mknod c6 0 2024-04-25T02:27:02.205 INFO:tasks.workunit.client.0.smithi114.stdout:6/24: creat f7 x:0 0 0 2024-04-25T02:27:02.207 INFO:tasks.workunit.client.0.smithi114.stdout:6/25: write f4 [130864,109852] 0 2024-04-25T02:27:02.207 INFO:tasks.workunit.client.0.smithi114.stdout:2/23: truncate f0 811709 0 2024-04-25T02:27:02.208 INFO:tasks.workunit.client.0.smithi114.stdout:0/25: read d1/f3 [1167471,39029] 0 2024-04-25T02:27:02.209 INFO:tasks.workunit.client.0.smithi114.stdout:6/26: creat f8 x:0 0 0 2024-04-25T02:27:02.212 INFO:tasks.workunit.client.0.smithi114.stdout:6/27: symlink l9 0 2024-04-25T02:27:02.213 INFO:tasks.workunit.client.0.smithi114.stdout:9/12: write f1 [3121382,123423] 0 2024-04-25T02:27:02.214 INFO:tasks.workunit.client.0.smithi114.stdout:8/19: getdents . 0 2024-04-25T02:27:02.215 INFO:tasks.workunit.client.0.smithi114.stdout:6/28: creat fa x:0 0 0 2024-04-25T02:27:02.216 INFO:tasks.workunit.client.0.smithi114.stdout:0/26: dwrite d1/f6 [0,4194304] 0 2024-04-25T02:27:02.219 INFO:tasks.workunit.client.0.smithi114.stdout:6/29: mknod cb 0 2024-04-25T02:27:02.220 INFO:tasks.workunit.client.0.smithi114.stdout:0/27: mkdir d1/d7 0 2024-04-25T02:27:02.221 INFO:tasks.workunit.client.0.smithi114.stdout:8/20: getdents . 0 2024-04-25T02:27:02.224 INFO:tasks.workunit.client.0.smithi114.stdout:2/24: write f0 [1170762,29771] 0 2024-04-25T02:27:02.226 INFO:tasks.workunit.client.0.smithi114.stdout:0/28: creat d1/d4/f8 x:0 0 0 2024-04-25T02:27:02.230 INFO:tasks.workunit.client.0.smithi114.stdout:6/30: dwrite f8 [0,4194304] 0 2024-04-25T02:27:02.230 INFO:tasks.workunit.client.0.smithi114.stdout:0/29: read d1/d4/f5 [1368966,34628] 0 2024-04-25T02:27:02.231 INFO:tasks.workunit.client.0.smithi114.stdout:8/21: getdents . 0 2024-04-25T02:27:02.233 INFO:tasks.workunit.client.0.smithi114.stdout:6/31: mkdir dc 0 2024-04-25T02:27:02.235 INFO:tasks.workunit.client.0.smithi114.stdout:6/32: write f7 [618726,57743] 0 2024-04-25T02:27:02.235 INFO:tasks.workunit.client.0.smithi114.stdout:2/25: getdents d5/d6 0 2024-04-25T02:27:02.235 INFO:tasks.workunit.client.0.smithi114.stdout:8/22: dread f4 [0,4194304] 0 2024-04-25T02:27:02.236 INFO:tasks.workunit.client.0.smithi114.stdout:0/30: dwrite d1/d4/f8 [0,4194304] 0 2024-04-25T02:27:02.238 INFO:tasks.workunit.client.0.smithi114.stdout:8/23: mknod c7 0 2024-04-25T02:27:02.239 INFO:tasks.workunit.client.0.smithi114.stdout:6/33: rmdir dc 0 2024-04-25T02:27:02.240 INFO:tasks.workunit.client.0.smithi114.stdout:2/26: dwrite f0 [0,4194304] 0 2024-04-25T02:27:02.242 INFO:tasks.workunit.client.0.smithi114.stdout:0/31: unlink d1/d4/f5 0 2024-04-25T02:27:02.244 INFO:tasks.workunit.client.0.smithi114.stdout:8/24: mknod c8 0 2024-04-25T02:27:02.246 INFO:tasks.workunit.client.0.smithi114.stdout:9/13: truncate f1 1227096 0 2024-04-25T02:27:02.251 INFO:tasks.workunit.client.0.smithi114.stdout:8/25: chown c1 1875428 1 2024-04-25T02:27:02.253 INFO:tasks.workunit.client.0.smithi114.stdout:9/14: creat f2 x:0 0 0 2024-04-25T02:27:02.254 INFO:tasks.workunit.client.0.smithi114.stdout:0/32: mkdir d1/d7/d9 0 2024-04-25T02:27:02.255 INFO:tasks.workunit.client.0.smithi114.stdout:9/15: creat f3 x:0 0 0 2024-04-25T02:27:02.256 INFO:tasks.workunit.client.0.smithi114.stdout:9/16: symlink l4 0 2024-04-25T02:27:02.256 INFO:tasks.workunit.client.0.smithi114.stdout:8/26: dwrite f3 [0,4194304] 0 2024-04-25T02:27:02.256 INFO:tasks.workunit.client.0.smithi114.stdout:9/17: dread - f2 zero size 2024-04-25T02:27:02.257 INFO:tasks.workunit.client.0.smithi114.stdout:9/18: dread - f2 zero size 2024-04-25T02:27:02.257 INFO:tasks.workunit.client.0.smithi114.stdout:9/19: readlink l4 0 2024-04-25T02:27:02.257 INFO:tasks.workunit.client.0.smithi114.stdout:9/20: chown l4 1646700 1 2024-04-25T02:27:02.258 INFO:tasks.workunit.client.0.smithi114.stdout:8/27: link c1 c9 0 2024-04-25T02:27:02.260 INFO:tasks.workunit.client.0.smithi114.stdout:8/28: mkdir da 0 2024-04-25T02:27:02.263 INFO:tasks.workunit.client.0.smithi114.stdout:9/21: dwrite f3 [0,4194304] 0 2024-04-25T02:27:02.264 INFO:tasks.workunit.client.0.smithi114.stdout:9/22: chown f1 104857 1 2024-04-25T02:27:02.265 INFO:tasks.workunit.client.0.smithi114.stdout:8/29: rename c1 to da/cb 0 2024-04-25T02:27:02.269 INFO:tasks.workunit.client.0.smithi114.stdout:9/23: dwrite f2 [0,4194304] 0 2024-04-25T02:27:02.271 INFO:tasks.workunit.client.0.smithi114.stdout:0/33: fdatasync d1/d4/f8 0 2024-04-25T02:27:02.272 INFO:tasks.workunit.client.0.smithi114.stdout:2/27: fsync f0 0 2024-04-25T02:27:02.274 INFO:tasks.workunit.client.0.smithi114.stdout:6/34: getdents . 0 2024-04-25T02:27:02.275 INFO:tasks.workunit.client.0.smithi114.stdout:0/34: dwrite d1/f6 [0,4194304] 0 2024-04-25T02:27:02.275 INFO:tasks.workunit.client.0.smithi114.stdout:2/28: dwrite f0 [0,4194304] 0 2024-04-25T02:27:02.277 INFO:tasks.workunit.client.0.smithi114.stdout:2/29: write f2 [616244,84412] 0 2024-04-25T02:27:02.277 INFO:tasks.workunit.client.0.smithi114.stdout:2/30: readlink - no filename 2024-04-25T02:27:02.278 INFO:tasks.workunit.client.0.smithi114.stdout:6/35: unlink f4 0 2024-04-25T02:27:02.296 INFO:tasks.workunit.client.0.smithi114.stdout:6/36: readlink l2 0 2024-04-25T02:27:02.297 INFO:tasks.workunit.client.0.smithi114.stdout:9/24: getdents . 0 2024-04-25T02:27:02.297 INFO:tasks.workunit.client.0.smithi114.stdout:8/30: truncate f3 2016708 0 2024-04-25T02:27:02.298 INFO:tasks.workunit.client.0.smithi114.stdout:9/25: chown f1 8 1 2024-04-25T02:27:02.303 INFO:tasks.workunit.client.0.smithi114.stdout:0/35: dwrite d1/f3 [0,4194304] 0 2024-04-25T02:27:02.304 INFO:tasks.workunit.client.0.smithi114.stdout:6/37: dwrite f8 [0,4194304] 0 2024-04-25T02:27:02.307 INFO:tasks.workunit.client.0.smithi114.stdout:9/26: dwrite f2 [4194304,4194304] 0 2024-04-25T02:27:02.310 INFO:tasks.workunit.client.0.smithi114.stdout:6/38: dread f8 [0,4194304] 0 2024-04-25T02:27:02.311 INFO:tasks.workunit.client.0.smithi114.stdout:6/39: dread - fa zero size 2024-04-25T02:27:02.312 INFO:tasks.workunit.client.0.smithi114.stdout:0/36: dwrite d1/f6 [0,4194304] 0 2024-04-25T02:27:02.315 INFO:tasks.workunit.client.0.smithi114.stdout:0/37: dread d1/d4/f8 [0,4194304] 0 2024-04-25T02:27:02.501 INFO:tasks.workunit.client.0.smithi114.stdout:8/31: creat da/fc x:0 0 0 2024-04-25T02:27:02.502 INFO:tasks.workunit.client.0.smithi114.stdout:9/27: write f1 [943193,57115] 0 2024-04-25T02:27:02.502 INFO:tasks.workunit.client.0.smithi114.stdout:9/28: chown f1 10475127 1 2024-04-25T02:27:02.503 INFO:tasks.workunit.client.0.smithi114.stdout:0/38: rmdir d1/d4 39 2024-04-25T02:27:02.504 INFO:tasks.workunit.client.0.smithi114.stdout:9/29: dread f1 [0,4194304] 0 2024-04-25T02:27:02.504 INFO:tasks.workunit.client.0.smithi114.stdout:8/32: symlink da/ld 0 2024-04-25T02:27:02.505 INFO:tasks.workunit.client.0.smithi114.stdout:9/30: dread f1 [0,4194304] 0 2024-04-25T02:27:02.505 INFO:tasks.workunit.client.0.smithi114.stdout:6/40: link fa fd 0 2024-04-25T02:27:02.506 INFO:tasks.workunit.client.0.smithi114.stdout:9/31: readlink l4 0 2024-04-25T02:27:02.506 INFO:tasks.workunit.client.0.smithi114.stdout:6/41: dread - fa zero size 2024-04-25T02:27:02.512 INFO:tasks.workunit.client.0.smithi114.stdout:2/31: getdents d5 0 2024-04-25T02:27:02.512 INFO:tasks.workunit.client.0.smithi114.stdout:2/32: chown d5 25 1 2024-04-25T02:27:02.516 INFO:tasks.workunit.client.0.smithi114.stdout:9/32: symlink l5 0 2024-04-25T02:27:02.516 INFO:tasks.workunit.client.0.smithi114.stdout:9/33: chown l5 340628 1 2024-04-25T02:27:02.516 INFO:tasks.workunit.client.0.smithi114.stdout:6/42: mkdir de 0 2024-04-25T02:27:02.516 INFO:tasks.workunit.client.0.smithi114.stdout:6/43: write f7 [358538,127034] 0 2024-04-25T02:27:02.517 INFO:tasks.workunit.client.0.smithi114.stdout:0/39: unlink d1/d4/f8 0 2024-04-25T02:27:02.518 INFO:tasks.workunit.client.0.smithi114.stdout:2/33: creat d5/d6/f8 x:0 0 0 2024-04-25T02:27:02.518 INFO:tasks.workunit.client.0.smithi114.stdout:9/34: creat f6 x:0 0 0 2024-04-25T02:27:02.520 INFO:tasks.workunit.client.0.smithi114.stdout:8/33: dwrite f3 [0,4194304] 0 2024-04-25T02:27:02.520 INFO:tasks.workunit.client.0.smithi114.stdout:6/44: write fd [429190,12576] 0 2024-04-25T02:27:02.522 INFO:tasks.workunit.client.0.smithi114.stdout:9/35: rename f1 to f7 0 2024-04-25T02:27:02.523 INFO:tasks.workunit.client.0.smithi114.stdout:0/40: dread d1/f3 [0,4194304] 0 2024-04-25T02:27:02.524 INFO:tasks.workunit.client.0.smithi114.stdout:9/36: mkdir d8 0 2024-04-25T02:27:02.524 INFO:tasks.workunit.client.0.smithi114.stdout:2/34: dwrite f0 [0,4194304] 0 2024-04-25T02:27:02.526 INFO:tasks.workunit.client.0.smithi114.stdout:6/45: creat de/ff x:0 0 0 2024-04-25T02:27:02.527 INFO:tasks.workunit.client.0.smithi114.stdout:6/46: write fa [1175720,14239] 0 2024-04-25T02:27:02.527 INFO:tasks.workunit.client.0.smithi114.stdout:8/34: rename l6 to da/le 0 2024-04-25T02:27:02.534 INFO:tasks.workunit.client.0.smithi114.stdout:8/35: read f3 [1403901,81606] 0 2024-04-25T02:27:02.535 INFO:tasks.workunit.client.0.smithi114.stdout:8/36: chown c8 504817601 1 2024-04-25T02:27:02.536 INFO:tasks.workunit.client.0.smithi114.stdout:2/35: dwrite f0 [0,4194304] 0 2024-04-25T02:27:02.536 INFO:tasks.workunit.client.0.smithi114.stdout:8/37: read f4 [509165,2742] 0 2024-04-25T02:27:02.538 INFO:tasks.workunit.client.0.smithi114.stdout:6/47: symlink de/l10 0 2024-04-25T02:27:02.539 INFO:tasks.workunit.client.0.smithi114.stdout:8/38: dread f3 [0,4194304] 0 2024-04-25T02:27:02.540 INFO:tasks.workunit.client.0.smithi114.stdout:9/37: mknod d8/c9 0 2024-04-25T02:27:02.540 INFO:tasks.workunit.client.0.smithi114.stdout:9/38: chown f2 858 1 2024-04-25T02:27:02.541 INFO:tasks.workunit.client.0.smithi114.stdout:6/48: mknod de/c11 0 2024-04-25T02:27:02.543 INFO:tasks.workunit.client.0.smithi114.stdout:8/39: write f4 [1348441,1316] 0 2024-04-25T02:27:02.544 INFO:tasks.workunit.client.0.smithi114.stdout:9/39: rmdir d8 39 2024-04-25T02:27:02.545 INFO:tasks.workunit.client.0.smithi114.stdout:2/36: link f0 d5/d6/f9 0 2024-04-25T02:27:02.546 INFO:tasks.workunit.client.0.smithi114.stdout:6/49: creat de/f12 x:0 0 0 2024-04-25T02:27:02.546 INFO:tasks.workunit.client.0.smithi114.stdout:0/41: getdents d1/d7 0 2024-04-25T02:27:02.551 INFO:tasks.workunit.client.0.smithi114.stdout:9/40: dread f3 [0,4194304] 0 2024-04-25T02:27:02.551 INFO:tasks.workunit.client.0.smithi114.stdout:8/40: write f3 [3444410,91925] 0 2024-04-25T02:27:02.554 INFO:tasks.workunit.client.0.smithi114.stdout:0/42: fdatasync d1/f3 0 2024-04-25T02:27:02.555 INFO:tasks.workunit.client.0.smithi114.stdout:2/37: dwrite f2 [0,4194304] 0 2024-04-25T02:27:02.556 INFO:tasks.workunit.client.0.smithi114.stdout:0/43: fdatasync d1/f6 0 2024-04-25T02:27:02.591 INFO:tasks.workunit.client.0.smithi114.stdout:2/38: creat d5/d6/fa x:0 0 0 2024-04-25T02:27:02.591 INFO:tasks.workunit.client.0.smithi114.stdout:8/41: dread f4 [0,4194304] 0 2024-04-25T02:27:02.593 INFO:tasks.workunit.client.0.smithi114.stdout:6/50: dwrite f8 [0,4194304] 0 2024-04-25T02:27:02.596 INFO:tasks.workunit.client.0.smithi114.stdout:6/51: write f8 [1669587,63457] 0 2024-04-25T02:27:02.598 INFO:tasks.workunit.client.0.smithi114.stdout:8/42: creat da/ff x:0 0 0 2024-04-25T02:27:02.598 INFO:tasks.workunit.client.0.smithi114.stdout:0/44: rename d1/d7/d9 to d1/d4/da 0 2024-04-25T02:27:02.598 INFO:tasks.workunit.client.0.smithi114.stdout:2/39: symlink d5/d6/lb 0 2024-04-25T02:27:02.598 INFO:tasks.workunit.client.0.smithi114.stdout:8/43: dread - da/fc zero size 2024-04-25T02:27:02.598 INFO:tasks.workunit.client.0.smithi114.stdout:6/52: creat de/f13 x:0 0 0 2024-04-25T02:27:02.598 INFO:tasks.workunit.client.0.smithi114.stdout:0/45: mknod d1/d7/cb 0 2024-04-25T02:27:02.599 INFO:tasks.workunit.client.0.smithi114.stdout:2/40: write d5/d6/f9 [2748073,46865] 0 2024-04-25T02:27:02.600 INFO:tasks.workunit.client.0.smithi114.stdout:2/41: read - d5/d6/fa zero size 2024-04-25T02:27:02.601 INFO:tasks.workunit.client.0.smithi114.stdout:6/53: dread fa [0,4194304] 0 2024-04-25T02:27:02.606 INFO:tasks.workunit.client.0.smithi114.stdout:2/42: creat d5/d6/fc x:0 0 0 2024-04-25T02:27:02.606 INFO:tasks.workunit.client.0.smithi114.stdout:6/54: unlink de/f13 0 2024-04-25T02:27:02.611 INFO:tasks.workunit.client.0.smithi114.stdout:6/55: write de/f12 [364155,49660] 0 2024-04-25T02:27:02.611 INFO:tasks.workunit.client.0.smithi114.stdout:0/46: creat d1/fc x:0 0 0 2024-04-25T02:27:02.611 INFO:tasks.workunit.client.0.smithi114.stdout:8/44: dwrite f4 [0,4194304] 0 2024-04-25T02:27:02.612 INFO:tasks.workunit.client.0.smithi114.stdout:2/43: creat d5/fd x:0 0 0 2024-04-25T02:27:02.612 INFO:tasks.workunit.client.0.smithi114.stdout:6/56: mknod de/c14 0 2024-04-25T02:27:02.613 INFO:tasks.workunit.client.0.smithi114.stdout:6/57: chown f8 234 1 2024-04-25T02:27:02.614 INFO:tasks.workunit.client.0.smithi114.stdout:2/44: rename f0 to d5/fe 0 2024-04-25T02:27:02.615 INFO:tasks.workunit.client.0.smithi114.stdout:0/47: dwrite d1/fc [0,4194304] 0 2024-04-25T02:27:02.616 INFO:tasks.workunit.client.0.smithi114.stdout:6/58: mknod de/c15 0 2024-04-25T02:27:02.617 INFO:tasks.workunit.client.0.smithi114.stdout:1/19: sync 2024-04-25T02:27:02.618 INFO:tasks.workunit.client.0.smithi114.stdout:4/15: sync 2024-04-25T02:27:02.618 INFO:tasks.workunit.client.0.smithi114.stdout:7/16: sync 2024-04-25T02:27:02.618 INFO:tasks.workunit.client.0.smithi114.stdout:5/9: sync 2024-04-25T02:27:02.618 INFO:tasks.workunit.client.0.smithi114.stdout:5/10: dwrite - no filename 2024-04-25T02:27:02.618 INFO:tasks.workunit.client.0.smithi114.stdout:5/11: read - no filename 2024-04-25T02:27:02.618 INFO:tasks.workunit.client.0.smithi114.stdout:3/0: sync 2024-04-25T02:27:02.618 INFO:tasks.workunit.client.0.smithi114.stdout:6/59: creat de/f16 x:0 0 0 2024-04-25T02:27:02.619 INFO:tasks.workunit.client.0.smithi114.stdout:2/45: write d5/d6/f9 [4042522,100944] 0 2024-04-25T02:27:02.619 INFO:tasks.workunit.client.0.smithi114.stdout:7/17: write f1 [3907436,103997] 0 2024-04-25T02:27:02.619 INFO:tasks.workunit.client.0.smithi114.stdout:4/16: write f0 [5783809,74332] 0 2024-04-25T02:27:02.619 INFO:tasks.workunit.client.0.smithi114.stdout:6/60: stat f7 0 2024-04-25T02:27:02.620 INFO:tasks.workunit.client.0.smithi114.stdout:2/46: write f2 [2547668,85694] 0 2024-04-25T02:27:02.621 INFO:tasks.workunit.client.0.smithi114.stdout:6/61: write de/f12 [1026188,112855] 0 2024-04-25T02:27:02.621 INFO:tasks.workunit.client.0.smithi114.stdout:3/1: mkdir d0 0 2024-04-25T02:27:02.621 INFO:tasks.workunit.client.0.smithi114.stdout:3/2: dread - no filename 2024-04-25T02:27:02.621 INFO:tasks.workunit.client.0.smithi114.stdout:3/3: read - no filename 2024-04-25T02:27:02.621 INFO:tasks.workunit.client.0.smithi114.stdout:3/4: dread - no filename 2024-04-25T02:27:02.621 INFO:tasks.workunit.client.0.smithi114.stdout:3/5: dwrite - no filename 2024-04-25T02:27:02.621 INFO:tasks.workunit.client.0.smithi114.stdout:3/6: read - no filename 2024-04-25T02:27:02.621 INFO:tasks.workunit.client.0.smithi114.stdout:3/7: write - no filename 2024-04-25T02:27:02.621 INFO:tasks.workunit.client.0.smithi114.stdout:4/17: write f0 [6642910,122876] 0 2024-04-25T02:27:02.622 INFO:tasks.workunit.client.0.smithi114.stdout:4/18: chown l1 1189753725 1 2024-04-25T02:27:02.622 INFO:tasks.workunit.client.0.smithi114.stdout:0/48: dwrite d1/f3 [0,4194304] 0 2024-04-25T02:27:02.623 INFO:tasks.workunit.client.0.smithi114.stdout:2/47: mkdir d5/df 0 2024-04-25T02:27:02.625 INFO:tasks.workunit.client.0.smithi114.stdout:2/48: write d5/d6/fc [664171,65688] 0 2024-04-25T02:27:02.625 INFO:tasks.workunit.client.0.smithi114.stdout:4/19: dwrite f0 [0,4194304] 0 2024-04-25T02:27:02.626 INFO:tasks.workunit.client.0.smithi114.stdout:2/49: stat d5/fe 0 2024-04-25T02:27:02.632 INFO:tasks.workunit.client.0.smithi114.stdout:6/62: symlink de/l17 0 2024-04-25T02:27:02.633 INFO:tasks.workunit.client.0.smithi114.stdout:2/50: truncate d5/d6/fc 1332673 0 2024-04-25T02:27:02.636 INFO:tasks.workunit.client.0.smithi114.stdout:0/49: creat d1/d7/fd x:0 0 0 2024-04-25T02:27:02.636 INFO:tasks.workunit.client.0.smithi114.stdout:7/18: getdents d5 0 2024-04-25T02:27:02.637 INFO:tasks.workunit.client.0.smithi114.stdout:0/50: chown d1/fc 2370 1 2024-04-25T02:27:02.637 INFO:tasks.workunit.client.0.smithi114.stdout:2/51: dread d5/d6/f9 [0,4194304] 0 2024-04-25T02:27:02.637 INFO:tasks.workunit.client.0.smithi114.stdout:5/12: link d1/c2 d1/c3 0 2024-04-25T02:27:02.637 INFO:tasks.workunit.client.0.smithi114.stdout:2/52: fdatasync d5/d6/f8 0 2024-04-25T02:27:02.637 INFO:tasks.workunit.client.0.smithi114.stdout:2/53: dread - d5/d6/fa zero size 2024-04-25T02:27:02.638 INFO:tasks.workunit.client.0.smithi114.stdout:6/63: creat de/f18 x:0 0 0 2024-04-25T02:27:02.638 INFO:tasks.workunit.client.0.smithi114.stdout:3/8: getdents d0 0 2024-04-25T02:27:02.639 INFO:tasks.workunit.client.0.smithi114.stdout:5/13: symlink d1/l4 0 2024-04-25T02:27:02.646 INFO:tasks.workunit.client.0.smithi114.stdout:7/19: creat d5/f6 x:0 0 0 2024-04-25T02:27:02.646 INFO:tasks.workunit.client.0.smithi114.stdout:7/20: chown d5/f6 266 1 2024-04-25T02:27:02.646 INFO:tasks.workunit.client.0.smithi114.stdout:7/21: stat d5 0 2024-04-25T02:27:02.647 INFO:tasks.workunit.client.0.smithi114.stdout:7/22: read f1 [4176287,127395] 0 2024-04-25T02:27:02.647 INFO:tasks.workunit.client.0.smithi114.stdout:7/23: readlink l2 0 2024-04-25T02:27:02.650 INFO:tasks.workunit.client.0.smithi114.stdout:3/9: creat d0/f1 x:0 0 0 2024-04-25T02:27:02.651 INFO:tasks.workunit.client.0.smithi114.stdout:3/10: fdatasync d0/f1 0 2024-04-25T02:27:02.651 INFO:tasks.workunit.client.0.smithi114.stdout:3/11: chown d0/f1 7681 1 2024-04-25T02:27:02.652 INFO:tasks.workunit.client.0.smithi114.stdout:7/24: symlink d5/l7 0 2024-04-25T02:27:02.652 INFO:tasks.workunit.client.0.smithi114.stdout:2/54: link d5/d6/lb d5/l10 0 2024-04-25T02:27:02.653 INFO:tasks.workunit.client.0.smithi114.stdout:3/12: creat d0/f2 x:0 0 0 2024-04-25T02:27:02.654 INFO:tasks.workunit.client.0.smithi114.stdout:5/14: link d1/c2 d1/c5 0 2024-04-25T02:27:02.654 INFO:tasks.workunit.client.0.smithi114.stdout:5/15: dwrite - no filename 2024-04-25T02:27:02.654 INFO:tasks.workunit.client.0.smithi114.stdout:5/16: fdatasync - no filename 2024-04-25T02:27:02.655 INFO:tasks.workunit.client.0.smithi114.stdout:7/25: read f1 [1719649,71669] 0 2024-04-25T02:27:02.656 INFO:tasks.workunit.client.0.smithi114.stdout:5/17: mkdir d1/d6 0 2024-04-25T02:27:02.656 INFO:tasks.workunit.client.0.smithi114.stdout:5/18: dread - no filename 2024-04-25T02:27:02.656 INFO:tasks.workunit.client.0.smithi114.stdout:5/19: dread - no filename 2024-04-25T02:27:02.656 INFO:tasks.workunit.client.0.smithi114.stdout:7/26: creat d5/f8 x:0 0 0 2024-04-25T02:27:02.657 INFO:tasks.workunit.client.0.smithi114.stdout:7/27: stat c0 0 2024-04-25T02:27:02.657 INFO:tasks.workunit.client.0.smithi114.stdout:2/55: dwrite f2 [0,4194304] 0 2024-04-25T02:27:02.659 INFO:tasks.workunit.client.0.smithi114.stdout:7/28: creat d5/f9 x:0 0 0 2024-04-25T02:27:02.660 INFO:tasks.workunit.client.0.smithi114.stdout:3/13: dwrite d0/f1 [0,4194304] 0 2024-04-25T02:27:02.664 INFO:tasks.workunit.client.0.smithi114.stdout:2/56: creat d5/df/f11 x:0 0 0 2024-04-25T02:27:02.672 INFO:tasks.workunit.client.0.smithi114.stdout:9/41: sync 2024-04-25T02:27:02.673 INFO:tasks.workunit.client.0.smithi114.stdout:3/14: link d0/f1 d0/f3 0 2024-04-25T02:27:02.673 INFO:tasks.workunit.client.0.smithi114.stdout:7/29: dwrite f1 [0,4194304] 0 2024-04-25T02:27:02.673 INFO:tasks.workunit.client.0.smithi114.stdout:2/57: creat d5/df/f12 x:0 0 0 2024-04-25T02:27:02.673 INFO:tasks.workunit.client.0.smithi114.stdout:7/30: rename d5/f8 to d5/fa 0 2024-04-25T02:27:02.674 INFO:tasks.workunit.client.0.smithi114.stdout:7/31: creat d5/fb x:0 0 0 2024-04-25T02:27:02.691 INFO:tasks.workunit.client.0.smithi114.stdout:9/42: rmdir d8 39 2024-04-25T02:27:02.693 INFO:tasks.workunit.client.0.smithi114.stdout:8/45: unlink da/le 0 2024-04-25T02:27:02.697 INFO:tasks.workunit.client.0.smithi114.stdout:8/46: dread f4 [0,4194304] 0 2024-04-25T02:27:02.698 INFO:tasks.workunit.client.0.smithi114.stdout:8/47: chown da/cb 549490881 1 2024-04-25T02:27:02.699 INFO:tasks.workunit.client.0.smithi114.stdout:6/64: fsync de/f12 0 2024-04-25T02:27:02.699 INFO:tasks.workunit.client.0.smithi114.stdout:8/48: write f4 [793782,15637] 0 2024-04-25T02:27:02.700 INFO:tasks.workunit.client.0.smithi114.stdout:8/49: mknod da/c10 0 2024-04-25T02:27:02.700 INFO:tasks.workunit.client.0.smithi114.stdout:2/58: fsync d5/d6/fa 0 2024-04-25T02:27:02.701 INFO:tasks.workunit.client.0.smithi114.stdout:6/65: link de/f16 de/f19 0 2024-04-25T02:27:02.703 INFO:tasks.workunit.client.0.smithi114.stdout:2/59: write d5/d6/f9 [3619943,48768] 0 2024-04-25T02:27:02.706 INFO:tasks.workunit.client.0.smithi114.stdout:2/60: mknod d5/d6/c13 0 2024-04-25T02:27:02.711 INFO:tasks.workunit.client.0.smithi114.stdout:2/61: dwrite d5/d6/fa [0,4194304] 0 2024-04-25T02:27:02.712 INFO:tasks.workunit.client.0.smithi114.stdout:2/62: truncate d5/fd 597225 0 2024-04-25T02:27:02.713 INFO:tasks.workunit.client.0.smithi114.stdout:2/63: dread - d5/d6/f8 zero size 2024-04-25T02:27:02.715 INFO:tasks.workunit.client.0.smithi114.stdout:1/20: truncate f0 1891759 0 2024-04-25T02:27:02.715 INFO:tasks.workunit.client.0.smithi114.stdout:1/21: fdatasync f4 0 2024-04-25T02:27:02.718 INFO:tasks.workunit.client.0.smithi114.stdout:4/20: truncate f0 3741205 0 2024-04-25T02:27:02.719 INFO:tasks.workunit.client.0.smithi114.stdout:2/64: dwrite d5/d6/fc [0,4194304] 0 2024-04-25T02:27:02.719 INFO:tasks.workunit.client.0.smithi114.stdout:4/21: rename d3 to d3/d4 22 2024-04-25T02:27:02.720 INFO:tasks.workunit.client.0.smithi114.stdout:0/51: truncate d1/fc 2675422 0 2024-04-25T02:27:02.721 INFO:tasks.workunit.client.0.smithi114.stdout:0/52: fsync d1/f3 0 2024-04-25T02:27:02.721 INFO:tasks.workunit.client.0.smithi114.stdout:0/53: chown d1/d7 561 1 2024-04-25T02:27:02.722 INFO:tasks.workunit.client.0.smithi114.stdout:2/65: creat d5/df/f14 x:0 0 0 2024-04-25T02:27:02.722 INFO:tasks.workunit.client.0.smithi114.stdout:4/22: getdents d3 0 2024-04-25T02:27:02.723 INFO:tasks.workunit.client.0.smithi114.stdout:2/66: write d5/df/f12 [737941,123280] 0 2024-04-25T02:27:02.727 INFO:tasks.workunit.client.0.smithi114.stdout:0/54: getdents d1/d4/da 0 2024-04-25T02:27:02.728 INFO:tasks.workunit.client.0.smithi114.stdout:5/20: getdents d1 0 2024-04-25T02:27:02.729 INFO:tasks.workunit.client.0.smithi114.stdout:5/21: mknod d1/c7 0 2024-04-25T02:27:02.730 INFO:tasks.workunit.client.0.smithi114.stdout:7/32: sync 2024-04-25T02:27:02.731 INFO:tasks.workunit.client.0.smithi114.stdout:7/33: dread - d5/fa zero size 2024-04-25T02:27:02.731 INFO:tasks.workunit.client.0.smithi114.stdout:3/15: truncate d0/f1 1230627 0 2024-04-25T02:27:02.733 INFO:tasks.workunit.client.0.smithi114.stdout:5/22: rename d1/c2 to d1/d6/c8 0 2024-04-25T02:27:02.733 INFO:tasks.workunit.client.0.smithi114.stdout:5/23: fdatasync - no filename 2024-04-25T02:27:02.740 INFO:tasks.workunit.client.0.smithi114.stdout:3/16: creat d0/f4 x:0 0 0 2024-04-25T02:27:02.741 INFO:tasks.workunit.client.0.smithi114.stdout:5/24: rmdir d1 39 2024-04-25T02:27:02.741 INFO:tasks.workunit.client.0.smithi114.stdout:5/25: write - no filename 2024-04-25T02:27:02.741 INFO:tasks.workunit.client.0.smithi114.stdout:7/34: dwrite f1 [0,4194304] 0 2024-04-25T02:27:02.742 INFO:tasks.workunit.client.0.smithi114.stdout:2/67: fsync d5/d6/fc 0 2024-04-25T02:27:02.743 INFO:tasks.workunit.client.0.smithi114.stdout:3/17: mkdir d0/d5 0 2024-04-25T02:27:02.760 INFO:tasks.workunit.client.0.smithi114.stdout:8/50: rmdir da 39 2024-04-25T02:27:02.761 INFO:tasks.workunit.client.0.smithi114.stdout:3/18: unlink d0/f2 0 2024-04-25T02:27:02.761 INFO:tasks.workunit.client.0.smithi114.stdout:6/66: getdents de 0 2024-04-25T02:27:02.765 INFO:tasks.workunit.client.0.smithi114.stdout:5/26: symlink d1/l9 0 2024-04-25T02:27:02.765 INFO:tasks.workunit.client.0.smithi114.stdout:5/27: write - no filename 2024-04-25T02:27:02.767 INFO:tasks.workunit.client.0.smithi114.stdout:9/43: dwrite f7 [0,4194304] 0 2024-04-25T02:27:02.767 INFO:tasks.workunit.client.0.smithi114.stdout:7/35: link c0 d5/cc 0 2024-04-25T02:27:02.767 INFO:tasks.workunit.client.0.smithi114.stdout:7/36: chown d5 0 1 2024-04-25T02:27:02.767 INFO:tasks.workunit.client.0.smithi114.stdout:1/22: fsync f0 0 2024-04-25T02:27:02.767 INFO:tasks.workunit.client.0.smithi114.stdout:2/68: dwrite d5/d6/f8 [0,4194304] 0 2024-04-25T02:27:02.767 INFO:tasks.workunit.client.0.smithi114.stdout:7/37: write d5/f9 [296925,80806] 0 2024-04-25T02:27:02.767 INFO:tasks.workunit.client.0.smithi114.stdout:2/69: chown d5/d6/c7 246341 1 2024-04-25T02:27:02.767 INFO:tasks.workunit.client.0.smithi114.stdout:7/38: chown d5 1070 1 2024-04-25T02:27:02.767 INFO:tasks.workunit.client.0.smithi114.stdout:4/23: dread f0 [0,4194304] 0 2024-04-25T02:27:02.767 INFO:tasks.workunit.client.0.smithi114.stdout:5/28: creat d1/d6/fa x:0 0 0 2024-04-25T02:27:02.768 INFO:tasks.workunit.client.0.smithi114.stdout:5/29: fdatasync d1/d6/fa 0 2024-04-25T02:27:02.768 INFO:tasks.workunit.client.0.smithi114.stdout:8/51: rename c7 to da/c11 0 2024-04-25T02:27:02.771 INFO:tasks.workunit.client.0.smithi114.stdout:3/19: symlink d0/d5/l6 0 2024-04-25T02:27:02.772 INFO:tasks.workunit.client.0.smithi114.stdout:2/70: readlink d5/d6/lb 0 2024-04-25T02:27:02.772 INFO:tasks.workunit.client.0.smithi114.stdout:7/39: mknod d5/cd 0 2024-04-25T02:27:02.772 INFO:tasks.workunit.client.0.smithi114.stdout:7/40: readlink l2 0 2024-04-25T02:27:02.772 INFO:tasks.workunit.client.0.smithi114.stdout:7/41: readlink d5/l7 0 2024-04-25T02:27:02.772 INFO:tasks.workunit.client.0.smithi114.stdout:8/52: creat da/f12 x:0 0 0 2024-04-25T02:27:02.773 INFO:tasks.workunit.client.0.smithi114.stdout:8/53: write f3 [5140098,3527] 0 2024-04-25T02:27:02.774 INFO:tasks.workunit.client.0.smithi114.stdout:9/44: creat d8/fa x:0 0 0 2024-04-25T02:27:02.774 INFO:tasks.workunit.client.0.smithi114.stdout:2/71: creat d5/f15 x:0 0 0 2024-04-25T02:27:02.791 INFO:tasks.workunit.client.0.smithi114.stdout:4/24: getdents d3 0 2024-04-25T02:27:02.792 INFO:tasks.workunit.client.0.smithi114.stdout:7/42: mknod d5/ce 0 2024-04-25T02:27:02.792 INFO:tasks.workunit.client.0.smithi114.stdout:2/72: dread - d5/df/f11 zero size 2024-04-25T02:27:02.792 INFO:tasks.workunit.client.0.smithi114.stdout:6/67: write de/f16 [954854,43955] 0 2024-04-25T02:27:02.799 INFO:tasks.workunit.client.0.smithi114.stdout:0/55: sync 2024-04-25T02:27:02.799 INFO:tasks.workunit.client.0.smithi114.stdout:2/73: chown d5/d6/lb 379355 1 2024-04-25T02:27:02.799 INFO:tasks.workunit.client.0.smithi114.stdout:7/43: symlink d5/lf 0 2024-04-25T02:27:02.799 INFO:tasks.workunit.client.0.smithi114.stdout:6/68: mknod de/c1a 0 2024-04-25T02:27:02.799 INFO:tasks.workunit.client.0.smithi114.stdout:8/54: dwrite da/fc [0,4194304] 0 2024-04-25T02:27:02.799 INFO:tasks.workunit.client.0.smithi114.stdout:1/23: dwrite f0 [0,4194304] 0 2024-04-25T02:27:02.799 INFO:tasks.workunit.client.0.smithi114.stdout:4/25: creat d3/f5 x:0 0 0 2024-04-25T02:27:02.799 INFO:tasks.workunit.client.0.smithi114.stdout:9/45: dwrite f2 [0,4194304] 0 2024-04-25T02:27:02.799 INFO:tasks.workunit.client.0.smithi114.stdout:1/24: fdatasync f4 0 2024-04-25T02:27:02.799 INFO:tasks.workunit.client.0.smithi114.stdout:4/26: stat l2 0 2024-04-25T02:27:02.800 INFO:tasks.workunit.client.0.smithi114.stdout:4/27: write d3/f5 [270103,82056] 0 2024-04-25T02:27:02.800 INFO:tasks.workunit.client.0.smithi114.stdout:8/55: mkdir da/d13 0 2024-04-25T02:27:02.800 INFO:tasks.workunit.client.0.smithi114.stdout:4/28: chown l1 0 1 2024-04-25T02:27:02.800 INFO:tasks.workunit.client.0.smithi114.stdout:0/56: dread d1/f6 [0,4194304] 0 2024-04-25T02:27:02.800 INFO:tasks.workunit.client.0.smithi114.stdout:8/56: dread - da/f12 zero size 2024-04-25T02:27:02.800 INFO:tasks.workunit.client.0.smithi114.stdout:6/69: dread de/f16 [0,4194304] 0 2024-04-25T02:27:02.800 INFO:tasks.workunit.client.0.smithi114.stdout:3/20: truncate d0/f3 1186841 0 2024-04-25T02:27:02.800 INFO:tasks.workunit.client.0.smithi114.stdout:7/44: dwrite f1 [0,4194304] 0 2024-04-25T02:27:02.800 INFO:tasks.workunit.client.0.smithi114.stdout:2/74: dwrite f2 [0,4194304] 0 2024-04-25T02:27:02.802 INFO:tasks.workunit.client.0.smithi114.stdout:8/57: fsync da/f12 0 2024-04-25T02:27:02.802 INFO:tasks.workunit.client.0.smithi114.stdout:2/75: chown d5/fd 8363737 1 2024-04-25T02:27:02.802 INFO:tasks.workunit.client.0.smithi114.stdout:1/25: dwrite f4 [0,4194304] 0 2024-04-25T02:27:02.804 INFO:tasks.workunit.client.0.smithi114.stdout:6/70: creat de/f1b x:0 0 0 2024-04-25T02:27:02.805 INFO:tasks.workunit.client.0.smithi114.stdout:9/46: getdents d8 0 2024-04-25T02:27:02.805 INFO:tasks.workunit.client.0.smithi114.stdout:8/58: dread da/fc [0,4194304] 0 2024-04-25T02:27:02.805 INFO:tasks.workunit.client.0.smithi114.stdout:3/21: mknod d0/c7 0 2024-04-25T02:27:02.811 INFO:tasks.workunit.client.0.smithi114.stdout:7/45: creat d5/f10 x:0 0 0 2024-04-25T02:27:02.811 INFO:tasks.workunit.client.0.smithi114.stdout:5/30: sync 2024-04-25T02:27:02.812 INFO:tasks.workunit.client.0.smithi114.stdout:8/59: dread f4 [0,4194304] 0 2024-04-25T02:27:02.812 INFO:tasks.workunit.client.0.smithi114.stdout:4/29: read d3/f5 [10623,13633] 0 2024-04-25T02:27:02.812 INFO:tasks.workunit.client.0.smithi114.stdout:2/76: symlink d5/d6/l16 0 2024-04-25T02:27:02.813 INFO:tasks.workunit.client.0.smithi114.stdout:4/30: chown d3/f5 2360 1 2024-04-25T02:27:02.813 INFO:tasks.workunit.client.0.smithi114.stdout:1/26: mknod c5 0 2024-04-25T02:27:02.813 INFO:tasks.workunit.client.0.smithi114.stdout:7/46: dread f1 [0,4194304] 0 2024-04-25T02:27:02.813 INFO:tasks.workunit.client.0.smithi114.stdout:6/71: mkdir de/d1c 0 2024-04-25T02:27:02.813 INFO:tasks.workunit.client.0.smithi114.stdout:6/72: dread de/f16 [0,4194304] 0 2024-04-25T02:27:02.813 INFO:tasks.workunit.client.0.smithi114.stdout:9/47: creat d8/fb x:0 0 0 2024-04-25T02:27:02.815 INFO:tasks.workunit.client.0.smithi114.stdout:0/57: creat d1/fe x:0 0 0 2024-04-25T02:27:02.816 INFO:tasks.workunit.client.0.smithi114.stdout:5/31: mknod d1/cb 0 2024-04-25T02:27:02.817 INFO:tasks.workunit.client.0.smithi114.stdout:8/60: mkdir da/d14 0 2024-04-25T02:27:02.818 INFO:tasks.workunit.client.0.smithi114.stdout:2/77: creat d5/df/f17 x:0 0 0 2024-04-25T02:27:02.818 INFO:tasks.workunit.client.0.smithi114.stdout:8/61: truncate da/ff 284964 0 2024-04-25T02:27:02.819 INFO:tasks.workunit.client.0.smithi114.stdout:1/27: mknod c6 0 2024-04-25T02:27:02.820 INFO:tasks.workunit.client.0.smithi114.stdout:7/47: creat d5/f11 x:0 0 0 2024-04-25T02:27:02.820 INFO:tasks.workunit.client.0.smithi114.stdout:7/48: truncate d5/f11 434277 0 2024-04-25T02:27:02.822 INFO:tasks.workunit.client.0.smithi114.stdout:6/73: rename f7 to de/f1d 0 2024-04-25T02:27:02.824 INFO:tasks.workunit.client.0.smithi114.stdout:5/32: creat d1/d6/fc x:0 0 0 2024-04-25T02:27:02.824 INFO:tasks.workunit.client.0.smithi114.stdout:8/62: fdatasync f4 0 2024-04-25T02:27:02.824 INFO:tasks.workunit.client.0.smithi114.stdout:2/78: creat d5/df/f18 x:0 0 0 2024-04-25T02:27:02.825 INFO:tasks.workunit.client.0.smithi114.stdout:9/48: dwrite f3 [0,4194304] 0 2024-04-25T02:27:02.825 INFO:tasks.workunit.client.0.smithi114.stdout:1/28: symlink l7 0 2024-04-25T02:27:02.826 INFO:tasks.workunit.client.0.smithi114.stdout:7/49: mknod d5/c12 0 2024-04-25T02:27:02.827 INFO:tasks.workunit.client.0.smithi114.stdout:6/74: creat de/f1e x:0 0 0 2024-04-25T02:27:02.828 INFO:tasks.workunit.client.0.smithi114.stdout:0/58: truncate d1/fc 2866715 0 2024-04-25T02:27:02.829 INFO:tasks.workunit.client.0.smithi114.stdout:0/59: write d1/f3 [4664139,112415] 0 2024-04-25T02:27:02.829 INFO:tasks.workunit.client.0.smithi114.stdout:5/33: mknod d1/cd 0 2024-04-25T02:27:02.829 INFO:tasks.workunit.client.0.smithi114.stdout:0/60: write d1/fe [429109,22191] 0 2024-04-25T02:27:02.830 INFO:tasks.workunit.client.0.smithi114.stdout:2/79: symlink d5/df/l19 0 2024-04-25T02:27:02.830 INFO:tasks.workunit.client.0.smithi114.stdout:2/80: chown d5 2520 1 2024-04-25T02:27:02.831 INFO:tasks.workunit.client.0.smithi114.stdout:2/81: read f2 [1901886,82260] 0 2024-04-25T02:27:02.832 INFO:tasks.workunit.client.0.smithi114.stdout:9/49: unlink f3 0 2024-04-25T02:27:02.834 INFO:tasks.workunit.client.0.smithi114.stdout:6/75: rename fd to de/f1f 0 2024-04-25T02:27:02.834 INFO:tasks.workunit.client.0.smithi114.stdout:8/63: getdents da/d13 0 2024-04-25T02:27:02.835 INFO:tasks.workunit.client.0.smithi114.stdout:5/34: rmdir d1 39 2024-04-25T02:27:02.837 INFO:tasks.workunit.client.0.smithi114.stdout:2/82: mknod d5/c1a 0 2024-04-25T02:27:02.839 INFO:tasks.workunit.client.0.smithi114.stdout:9/50: mknod d8/cc 0 2024-04-25T02:27:02.842 INFO:tasks.workunit.client.0.smithi114.stdout:0/61: fdatasync d1/fc 0 2024-04-25T02:27:02.842 INFO:tasks.workunit.client.0.smithi114.stdout:2/83: mknod d5/df/c1b 0 2024-04-25T02:27:02.844 INFO:tasks.workunit.client.0.smithi114.stdout:8/64: creat da/d14/f15 x:0 0 0 2024-04-25T02:27:02.875 INFO:tasks.workunit.client.0.smithi114.stdout:9/51: symlink d8/ld 0 2024-04-25T02:27:02.875 INFO:tasks.workunit.client.0.smithi114.stdout:8/65: truncate f3 5552816 0 2024-04-25T02:27:02.875 INFO:tasks.workunit.client.0.smithi114.stdout:5/35: mkdir d1/d6/de 0 2024-04-25T02:27:02.881 INFO:tasks.workunit.client.0.smithi114.stdout:2/84: dwrite d5/df/f18 [0,4194304] 0 2024-04-25T02:27:02.882 INFO:tasks.workunit.client.0.smithi114.stdout:7/50: getdents d5 0 2024-04-25T02:27:02.885 INFO:tasks.workunit.client.0.smithi114.stdout:1/29: truncate f0 4186042 0 2024-04-25T02:27:02.887 INFO:tasks.workunit.client.0.smithi114.stdout:9/52: dwrite f6 [0,4194304] 0 2024-04-25T02:27:02.887 INFO:tasks.workunit.client.0.smithi114.stdout:3/22: write d0/f3 [879050,11822] 0 2024-04-25T02:27:02.889 INFO:tasks.workunit.client.0.smithi114.stdout:0/62: write d1/fc [1742210,132] 0 2024-04-25T02:27:02.889 INFO:tasks.workunit.client.0.smithi114.stdout:4/31: sync 2024-04-25T02:27:02.890 INFO:tasks.workunit.client.0.smithi114.stdout:5/36: dwrite d1/d6/fc [0,4194304] 0 2024-04-25T02:27:02.891 INFO:tasks.workunit.client.0.smithi114.stdout:8/66: read da/fc [3692161,104382] 0 2024-04-25T02:27:02.892 INFO:tasks.workunit.client.0.smithi114.stdout:2/85: mkdir d5/d1c 0 2024-04-25T02:27:02.893 INFO:tasks.workunit.client.0.smithi114.stdout:0/63: write d1/f6 [4384573,92757] 0 2024-04-25T02:27:02.895 INFO:tasks.workunit.client.0.smithi114.stdout:9/53: creat d8/fe x:0 0 0 2024-04-25T02:27:02.895 INFO:tasks.workunit.client.0.smithi114.stdout:4/32: mkdir d3/d6 0 2024-04-25T02:27:02.896 INFO:tasks.workunit.client.0.smithi114.stdout:8/67: truncate da/ff 958602 0 2024-04-25T02:27:02.898 INFO:tasks.workunit.client.0.smithi114.stdout:5/37: rename d1/d6/fc to d1/ff 0 2024-04-25T02:27:02.898 INFO:tasks.workunit.client.0.smithi114.stdout:2/86: truncate d5/df/f17 255931 0 2024-04-25T02:27:02.899 INFO:tasks.workunit.client.0.smithi114.stdout:7/51: dwrite d5/f9 [0,4194304] 0 2024-04-25T02:27:02.899 INFO:tasks.workunit.client.0.smithi114.stdout:9/54: fdatasync d8/fb 0 2024-04-25T02:27:02.899 INFO:tasks.workunit.client.0.smithi114.stdout:8/68: stat da/fc 0 2024-04-25T02:27:02.899 INFO:tasks.workunit.client.0.smithi114.stdout:4/33: truncate f0 4106031 0 2024-04-25T02:27:02.899 INFO:tasks.workunit.client.0.smithi114.stdout:3/23: link d0/f4 d0/d5/f8 0 2024-04-25T02:27:02.900 INFO:tasks.workunit.client.0.smithi114.stdout:9/55: chown d8/ld 101992 1 2024-04-25T02:27:02.900 INFO:tasks.workunit.client.0.smithi114.stdout:3/24: stat d0 0 2024-04-25T02:27:02.900 INFO:tasks.workunit.client.0.smithi114.stdout:8/69: truncate f4 4487167 0 2024-04-25T02:27:02.901 INFO:tasks.workunit.client.0.smithi114.stdout:3/25: chown d0/f1 2873826 1 2024-04-25T02:27:02.901 INFO:tasks.workunit.client.0.smithi114.stdout:0/64: creat d1/d4/ff x:0 0 0 2024-04-25T02:27:02.903 INFO:tasks.workunit.client.0.smithi114.stdout:5/38: mknod d1/c10 0 2024-04-25T02:27:02.903 INFO:tasks.workunit.client.0.smithi114.stdout:5/39: fsync d1/d6/fa 0 2024-04-25T02:27:02.904 INFO:tasks.workunit.client.0.smithi114.stdout:7/52: mknod d5/c13 0 2024-04-25T02:27:02.904 INFO:tasks.workunit.client.0.smithi114.stdout:7/53: fdatasync d5/f6 0 2024-04-25T02:27:02.904 INFO:tasks.workunit.client.0.smithi114.stdout:2/87: creat d5/f1d x:0 0 0 2024-04-25T02:27:02.905 INFO:tasks.workunit.client.0.smithi114.stdout:5/40: write d1/d6/fa [146942,25343] 0 2024-04-25T02:27:02.913 INFO:tasks.workunit.client.0.smithi114.stdout:7/54: write d5/f6 [292021,5808] 0 2024-04-25T02:27:02.913 INFO:tasks.workunit.client.0.smithi114.stdout:1/30: getdents . 0 2024-04-25T02:27:02.914 INFO:tasks.workunit.client.0.smithi114.stdout:1/31: rmdir - no directory 2024-04-25T02:27:02.914 INFO:tasks.workunit.client.0.smithi114.stdout:9/56: rename f6 to d8/ff 0 2024-04-25T02:27:02.914 INFO:tasks.workunit.client.0.smithi114.stdout:0/65: dread d1/f3 [0,4194304] 0 2024-04-25T02:27:02.915 INFO:tasks.workunit.client.0.smithi114.stdout:7/55: stat d5/cd 0 2024-04-25T02:27:02.915 INFO:tasks.workunit.client.0.smithi114.stdout:1/32: write f4 [614909,6829] 0 2024-04-25T02:27:02.916 INFO:tasks.workunit.client.0.smithi114.stdout:2/88: mkdir d5/df/d1e 0 2024-04-25T02:27:02.917 INFO:tasks.workunit.client.0.smithi114.stdout:5/41: chown d1/c3 47 1 2024-04-25T02:27:02.917 INFO:tasks.workunit.client.0.smithi114.stdout:1/33: readlink l7 0 2024-04-25T02:27:02.920 INFO:tasks.workunit.client.0.smithi114.stdout:1/34: symlink l8 0 2024-04-25T02:27:02.921 INFO:tasks.workunit.client.0.smithi114.stdout:0/66: write d1/f3 [5186820,100518] 0 2024-04-25T02:27:02.921 INFO:tasks.workunit.client.0.smithi114.stdout:7/56: rename c4 to d5/c14 0 2024-04-25T02:27:02.923 INFO:tasks.workunit.client.0.smithi114.stdout:1/35: chown f4 0 1 2024-04-25T02:27:02.924 INFO:tasks.workunit.client.0.smithi114.stdout:5/42: creat d1/d6/de/f11 x:0 0 0 2024-04-25T02:27:02.926 INFO:tasks.workunit.client.0.smithi114.stdout:4/34: dwrite d3/f5 [0,4194304] 0 2024-04-25T02:27:02.926 INFO:tasks.workunit.client.0.smithi114.stdout:2/89: rename d5/d6/f8 to d5/df/d1e/f1f 0 2024-04-25T02:27:02.928 INFO:tasks.workunit.client.0.smithi114.stdout:2/90: stat d5/l10 0 2024-04-25T02:27:02.929 INFO:tasks.workunit.client.0.smithi114.stdout:9/57: dread d8/ff [0,4194304] 0 2024-04-25T02:27:02.929 INFO:tasks.workunit.client.0.smithi114.stdout:1/36: creat f9 x:0 0 0 2024-04-25T02:27:02.931 INFO:tasks.workunit.client.0.smithi114.stdout:6/76: sync 2024-04-25T02:27:02.931 INFO:tasks.workunit.client.0.smithi114.stdout:6/77: rename de to de/d1c/d20 22 2024-04-25T02:27:02.932 INFO:tasks.workunit.client.0.smithi114.stdout:6/78: chown de 87658004 1 2024-04-25T02:27:02.932 INFO:tasks.workunit.client.0.smithi114.stdout:5/43: rename d1/cb to d1/c12 0 2024-04-25T02:27:02.934 INFO:tasks.workunit.client.0.smithi114.stdout:4/35: creat d3/f7 x:0 0 0 2024-04-25T02:27:02.935 INFO:tasks.workunit.client.0.smithi114.stdout:2/91: creat d5/d6/f20 x:0 0 0 2024-04-25T02:27:02.936 INFO:tasks.workunit.client.0.smithi114.stdout:3/26: dwrite d0/f4 [0,4194304] 0 2024-04-25T02:27:02.937 INFO:tasks.workunit.client.0.smithi114.stdout:9/58: creat d8/f10 x:0 0 0 2024-04-25T02:27:02.938 INFO:tasks.workunit.client.0.smithi114.stdout:1/37: creat fa x:0 0 0 2024-04-25T02:27:02.939 INFO:tasks.workunit.client.0.smithi114.stdout:5/44: symlink d1/l13 0 2024-04-25T02:27:02.941 INFO:tasks.workunit.client.0.smithi114.stdout:4/36: unlink f0 0 2024-04-25T02:27:02.943 INFO:tasks.workunit.client.0.smithi114.stdout:5/45: dread d1/d6/fa [0,4194304] 0 2024-04-25T02:27:02.944 INFO:tasks.workunit.client.0.smithi114.stdout:3/27: dwrite d0/f1 [0,4194304] 0 2024-04-25T02:27:02.945 INFO:tasks.workunit.client.0.smithi114.stdout:3/28: readlink d0/d5/l6 0 2024-04-25T02:27:02.945 INFO:tasks.workunit.client.0.smithi114.stdout:5/46: write d1/d6/de/f11 [162726,108884] 0 2024-04-25T02:27:02.946 INFO:tasks.workunit.client.0.smithi114.stdout:9/59: creat d8/f11 x:0 0 0 2024-04-25T02:27:02.947 INFO:tasks.workunit.client.0.smithi114.stdout:6/79: mknod de/d1c/c21 0 2024-04-25T02:27:02.948 INFO:tasks.workunit.client.0.smithi114.stdout:6/80: write de/f1b [1026456,9102] 0 2024-04-25T02:27:02.951 INFO:tasks.workunit.client.0.smithi114.stdout:1/38: dread f0 [0,4194304] 0 2024-04-25T02:27:02.952 INFO:tasks.workunit.client.0.smithi114.stdout:1/39: write fa [669953,4383] 0 2024-04-25T02:27:02.952 INFO:tasks.workunit.client.0.smithi114.stdout:4/37: unlink d3/f7 0 2024-04-25T02:27:02.952 INFO:tasks.workunit.client.0.smithi114.stdout:4/38: fsync d3/f5 0 2024-04-25T02:27:02.954 INFO:tasks.workunit.client.0.smithi114.stdout:0/67: getdents d1/d7 0 2024-04-25T02:27:02.954 INFO:tasks.workunit.client.0.smithi114.stdout:2/92: mkdir d5/d1c/d21 0 2024-04-25T02:27:02.955 INFO:tasks.workunit.client.0.smithi114.stdout:3/29: mknod d0/d5/c9 0 2024-04-25T02:27:02.957 INFO:tasks.workunit.client.0.smithi114.stdout:8/70: sync 2024-04-25T02:27:02.958 INFO:tasks.workunit.client.0.smithi114.stdout:5/47: rename d1/l4 to d1/l14 0 2024-04-25T02:27:02.959 INFO:tasks.workunit.client.0.smithi114.stdout:6/81: symlink de/d1c/l22 0 2024-04-25T02:27:02.959 INFO:tasks.workunit.client.0.smithi114.stdout:6/82: write de/f1e [325768,10382] 0 2024-04-25T02:27:02.960 INFO:tasks.workunit.client.0.smithi114.stdout:1/40: creat fb x:0 0 0 2024-04-25T02:27:02.961 INFO:tasks.workunit.client.0.smithi114.stdout:1/41: truncate f9 962618 0 2024-04-25T02:27:02.961 INFO:tasks.workunit.client.0.smithi114.stdout:1/42: truncate fb 546859 0 2024-04-25T02:27:02.962 INFO:tasks.workunit.client.0.smithi114.stdout:4/39: rename d3/d6 to d3/d8 0 2024-04-25T02:27:02.963 INFO:tasks.workunit.client.0.smithi114.stdout:2/93: mkdir d5/d1c/d22 0 2024-04-25T02:27:02.965 INFO:tasks.workunit.client.0.smithi114.stdout:9/60: rmdir d8 39 2024-04-25T02:27:02.965 INFO:tasks.workunit.client.0.smithi114.stdout:4/40: dread d3/f5 [0,4194304] 0 2024-04-25T02:27:02.966 INFO:tasks.workunit.client.0.smithi114.stdout:4/41: chown d3/f5 78 1 2024-04-25T02:27:02.966 INFO:tasks.workunit.client.0.smithi114.stdout:8/71: mkdir da/d16 0 2024-04-25T02:27:02.967 INFO:tasks.workunit.client.0.smithi114.stdout:5/48: symlink d1/d6/de/l15 0 2024-04-25T02:27:02.967 INFO:tasks.workunit.client.0.smithi114.stdout:5/49: fsync d1/d6/de/f11 0 2024-04-25T02:27:02.967 INFO:tasks.workunit.client.0.smithi114.stdout:5/50: readlink d1/l9 0 2024-04-25T02:27:02.968 INFO:tasks.workunit.client.0.smithi114.stdout:6/83: creat de/d1c/f23 x:0 0 0 2024-04-25T02:27:02.969 INFO:tasks.workunit.client.0.smithi114.stdout:6/84: dread de/f1f [0,4194304] 0 2024-04-25T02:27:02.969 INFO:tasks.workunit.client.0.smithi114.stdout:1/43: creat fc x:0 0 0 2024-04-25T02:27:02.970 INFO:tasks.workunit.client.0.smithi114.stdout:6/85: dread de/f16 [0,4194304] 0 2024-04-25T02:27:02.971 INFO:tasks.workunit.client.0.smithi114.stdout:2/94: unlink d5/d6/f9 0 2024-04-25T02:27:02.972 INFO:tasks.workunit.client.0.smithi114.stdout:6/86: dread de/f1f [0,4194304] 0 2024-04-25T02:27:02.986 INFO:tasks.workunit.client.0.smithi114.stdout:5/51: fsync d1/ff 0 2024-04-25T02:27:02.987 INFO:tasks.workunit.client.0.smithi114.stdout:6/87: truncate de/f16 1223035 0 2024-04-25T02:27:02.987 INFO:tasks.workunit.client.0.smithi114.stdout:1/44: symlink ld 0 2024-04-25T02:27:02.987 INFO:tasks.workunit.client.0.smithi114.stdout:9/61: truncate d8/fa 292453 0 2024-04-25T02:27:02.987 INFO:tasks.workunit.client.0.smithi114.stdout:0/68: creat d1/f10 x:0 0 0 2024-04-25T02:27:02.988 INFO:tasks.workunit.client.0.smithi114.stdout:2/95: symlink d5/d1c/l23 0 2024-04-25T02:27:02.988 INFO:tasks.workunit.client.0.smithi114.stdout:8/72: symlink da/d13/l17 0 2024-04-25T02:27:02.988 INFO:tasks.workunit.client.0.smithi114.stdout:3/30: write d0/f1 [4671513,63402] 0 2024-04-25T02:27:02.988 INFO:tasks.workunit.client.0.smithi114.stdout:5/52: write d1/ff [738799,41460] 0 2024-04-25T02:27:02.989 INFO:tasks.workunit.client.0.smithi114.stdout:1/45: creat fe x:0 0 0 2024-04-25T02:27:02.989 INFO:tasks.workunit.client.0.smithi114.stdout:6/88: rename de/c1a to de/c24 0 2024-04-25T02:27:02.990 INFO:tasks.workunit.client.0.smithi114.stdout:6/89: fdatasync de/f18 0 2024-04-25T02:27:02.990 INFO:tasks.workunit.client.0.smithi114.stdout:1/46: mkdir df 0 2024-04-25T02:27:02.991 INFO:tasks.workunit.client.0.smithi114.stdout:5/53: mkdir d1/d6/de/d16 0 2024-04-25T02:27:02.992 INFO:tasks.workunit.client.0.smithi114.stdout:3/31: rename d0/d5/f8 to d0/fa 0 2024-04-25T02:27:02.993 INFO:tasks.workunit.client.0.smithi114.stdout:0/69: creat d1/f11 x:0 0 0 2024-04-25T02:27:02.993 INFO:tasks.workunit.client.0.smithi114.stdout:0/70: chown d1/d7/fd 206 1 2024-04-25T02:27:02.994 INFO:tasks.workunit.client.0.smithi114.stdout:6/90: mkdir de/d25 0 2024-04-25T02:27:02.994 INFO:tasks.workunit.client.0.smithi114.stdout:8/73: mknod da/d16/c18 0 2024-04-25T02:27:02.994 INFO:tasks.workunit.client.0.smithi114.stdout:6/91: truncate f5 261441 0 2024-04-25T02:27:02.995 INFO:tasks.workunit.client.0.smithi114.stdout:8/74: write da/d14/f15 [886736,120448] 0 2024-04-25T02:27:02.996 INFO:tasks.workunit.client.0.smithi114.stdout:5/54: fdatasync d1/d6/fa 0 2024-04-25T02:27:02.996 INFO:tasks.workunit.client.0.smithi114.stdout:8/75: fsync da/f12 0 2024-04-25T02:27:02.996 INFO:tasks.workunit.client.0.smithi114.stdout:3/32: creat d0/fb x:0 0 0 2024-04-25T02:27:02.997 INFO:tasks.workunit.client.0.smithi114.stdout:1/47: mknod df/c10 0 2024-04-25T02:27:02.997 INFO:tasks.workunit.client.0.smithi114.stdout:7/57: sync 2024-04-25T02:27:02.998 INFO:tasks.workunit.client.0.smithi114.stdout:1/48: truncate fe 130016 0 2024-04-25T02:27:02.998 INFO:tasks.workunit.client.0.smithi114.stdout:6/92: symlink de/l26 0 2024-04-25T02:27:02.999 INFO:tasks.workunit.client.0.smithi114.stdout:6/93: dread - de/ff zero size 2024-04-25T02:27:03.001 INFO:tasks.workunit.client.0.smithi114.stdout:8/76: creat da/f19 x:0 0 0 2024-04-25T02:27:03.002 INFO:tasks.workunit.client.0.smithi114.stdout:8/77: stat da/f19 0 2024-04-25T02:27:03.002 INFO:tasks.workunit.client.0.smithi114.stdout:3/33: creat d0/d5/fc x:0 0 0 2024-04-25T02:27:03.003 INFO:tasks.workunit.client.0.smithi114.stdout:3/34: dread - d0/fb zero size 2024-04-25T02:27:03.005 INFO:tasks.workunit.client.0.smithi114.stdout:7/58: write d5/fa [785536,63593] 0 2024-04-25T02:27:03.007 INFO:tasks.workunit.client.0.smithi114.stdout:6/94: mkdir de/d27 0 2024-04-25T02:27:03.008 INFO:tasks.workunit.client.0.smithi114.stdout:3/35: symlink d0/ld 0 2024-04-25T02:27:03.009 INFO:tasks.workunit.client.0.smithi114.stdout:8/78: dwrite da/f19 [0,4194304] 0 2024-04-25T02:27:03.016 INFO:tasks.workunit.client.0.smithi114.stdout:7/59: mknod d5/c15 0 2024-04-25T02:27:03.016 INFO:tasks.workunit.client.0.smithi114.stdout:3/36: symlink d0/le 0 2024-04-25T02:27:03.016 INFO:tasks.workunit.client.0.smithi114.stdout:3/37: unlink d0/ld 0 2024-04-25T02:27:03.017 INFO:tasks.workunit.client.0.smithi114.stdout:6/95: dwrite de/f1e [0,4194304] 0 2024-04-25T02:27:03.018 INFO:tasks.workunit.client.0.smithi114.stdout:1/49: getdents df 0 2024-04-25T02:27:03.022 INFO:tasks.workunit.client.0.smithi114.stdout:0/71: truncate d1/f6 150206 0 2024-04-25T02:27:03.023 INFO:tasks.workunit.client.0.smithi114.stdout:1/50: mkdir df/d11 0 2024-04-25T02:27:03.025 INFO:tasks.workunit.client.0.smithi114.stdout:8/79: dwrite da/d14/f15 [0,4194304] 0 2024-04-25T02:27:03.027 INFO:tasks.workunit.client.0.smithi114.stdout:6/96: creat de/d25/f28 x:0 0 0 2024-04-25T02:27:03.028 INFO:tasks.workunit.client.0.smithi114.stdout:5/55: dwrite d1/d6/fa [0,4194304] 0 2024-04-25T02:27:03.028 INFO:tasks.workunit.client.0.smithi114.stdout:8/80: write f3 [5123002,30985] 0 2024-04-25T02:27:03.029 INFO:tasks.workunit.client.0.smithi114.stdout:1/51: unlink f9 0 2024-04-25T02:27:03.030 INFO:tasks.workunit.client.0.smithi114.stdout:7/60: dwrite f1 [4194304,4194304] 0 2024-04-25T02:27:03.030 INFO:tasks.workunit.client.0.smithi114.stdout:0/72: creat d1/d4/da/f12 x:0 0 0 2024-04-25T02:27:03.031 INFO:tasks.workunit.client.0.smithi114.stdout:7/61: chown l2 3 1 2024-04-25T02:27:03.034 INFO:tasks.workunit.client.0.smithi114.stdout:3/38: rmdir d0 39 2024-04-25T02:27:03.037 INFO:tasks.workunit.client.0.smithi114.stdout:6/97: rename de/d1c/l22 to de/l29 0 2024-04-25T02:27:03.040 INFO:tasks.workunit.client.0.smithi114.stdout:1/52: symlink df/l12 0 2024-04-25T02:27:03.042 INFO:tasks.workunit.client.0.smithi114.stdout:3/39: stat d0/d5/l6 0 2024-04-25T02:27:03.044 INFO:tasks.workunit.client.0.smithi114.stdout:8/81: rename da/d13 to da/d16/d1a 0 2024-04-25T02:27:03.044 INFO:tasks.workunit.client.0.smithi114.stdout:7/62: dread d5/fa [0,4194304] 0 2024-04-25T02:27:03.044 INFO:tasks.workunit.client.0.smithi114.stdout:3/40: rename d0/d5 to d0/d5/df 22 2024-04-25T02:27:03.046 INFO:tasks.workunit.client.0.smithi114.stdout:6/98: mkdir de/d2a 0 2024-04-25T02:27:03.046 INFO:tasks.workunit.client.0.smithi114.stdout:8/82: write da/f19 [1628184,76204] 0 2024-04-25T02:27:03.046 INFO:tasks.workunit.client.0.smithi114.stdout:1/53: mkdir df/d13 0 2024-04-25T02:27:03.046 INFO:tasks.workunit.client.0.smithi114.stdout:3/41: write d0/fb [585507,50779] 0 2024-04-25T02:27:03.047 INFO:tasks.workunit.client.0.smithi114.stdout:0/73: symlink d1/l13 0 2024-04-25T02:27:03.047 INFO:tasks.workunit.client.0.smithi114.stdout:0/74: truncate d1/d4/ff 161729 0 2024-04-25T02:27:03.049 INFO:tasks.workunit.client.0.smithi114.stdout:0/75: stat d1/d7/cb 0 2024-04-25T02:27:03.049 INFO:tasks.workunit.client.0.smithi114.stdout:8/83: unlink f4 0 2024-04-25T02:27:03.049 INFO:tasks.workunit.client.0.smithi114.stdout:1/54: truncate f0 4814190 0 2024-04-25T02:27:03.051 INFO:tasks.workunit.client.0.smithi114.stdout:6/99: creat de/d2a/f2b x:0 0 0 2024-04-25T02:27:03.051 INFO:tasks.workunit.client.0.smithi114.stdout:8/84: write da/ff [1220185,104395] 0 2024-04-25T02:27:03.052 INFO:tasks.workunit.client.0.smithi114.stdout:1/55: rename df to df/d13/d14 22 2024-04-25T02:27:03.053 INFO:tasks.workunit.client.0.smithi114.stdout:8/85: stat f3 0 2024-04-25T02:27:03.053 INFO:tasks.workunit.client.0.smithi114.stdout:7/63: getdents d5 0 2024-04-25T02:27:03.054 INFO:tasks.workunit.client.0.smithi114.stdout:0/76: link d1/d7/fd d1/d7/f14 0 2024-04-25T02:27:03.055 INFO:tasks.workunit.client.0.smithi114.stdout:3/42: dwrite d0/fb [0,4194304] 0 2024-04-25T02:27:03.056 INFO:tasks.workunit.client.0.smithi114.stdout:6/100: dread de/f16 [0,4194304] 0 2024-04-25T02:27:03.056 INFO:tasks.workunit.client.0.smithi114.stdout:0/77: truncate d1/f11 1026674 0 2024-04-25T02:27:03.058 INFO:tasks.workunit.client.0.smithi114.stdout:1/56: getdents df/d13 0 2024-04-25T02:27:03.059 INFO:tasks.workunit.client.0.smithi114.stdout:6/101: fsync de/f19 0 2024-04-25T02:27:03.059 INFO:tasks.workunit.client.0.smithi114.stdout:8/86: fsync da/f19 0 2024-04-25T02:27:03.061 INFO:tasks.workunit.client.0.smithi114.stdout:1/57: rename fb to df/f15 0 2024-04-25T02:27:03.064 INFO:tasks.workunit.client.0.smithi114.stdout:0/78: getdents d1/d4 0 2024-04-25T02:27:03.064 INFO:tasks.workunit.client.0.smithi114.stdout:1/58: unlink c5 0 2024-04-25T02:27:03.065 INFO:tasks.workunit.client.0.smithi114.stdout:7/64: dwrite d5/f11 [0,4194304] 0 2024-04-25T02:27:03.065 INFO:tasks.workunit.client.0.smithi114.stdout:6/102: rename de/d1c/c21 to de/d27/c2c 0 2024-04-25T02:27:03.066 INFO:tasks.workunit.client.0.smithi114.stdout:8/87: truncate da/fc 3112579 0 2024-04-25T02:27:03.067 INFO:tasks.workunit.client.0.smithi114.stdout:0/79: creat d1/d4/f15 x:0 0 0 2024-04-25T02:27:03.068 INFO:tasks.workunit.client.0.smithi114.stdout:3/43: dwrite d0/fa [0,4194304] 0 2024-04-25T02:27:03.068 INFO:tasks.workunit.client.0.smithi114.stdout:0/80: truncate d1/d7/fd 463627 0 2024-04-25T02:27:03.069 INFO:tasks.workunit.client.0.smithi114.stdout:4/42: sync 2024-04-25T02:27:03.069 INFO:tasks.workunit.client.0.smithi114.stdout:7/65: creat d5/f16 x:0 0 0 2024-04-25T02:27:03.070 INFO:tasks.workunit.client.0.smithi114.stdout:3/44: write d0/f3 [4481759,112546] 0 2024-04-25T02:27:03.071 INFO:tasks.workunit.client.0.smithi114.stdout:7/66: dread - d5/f10 zero size 2024-04-25T02:27:03.071 INFO:tasks.workunit.client.0.smithi114.stdout:0/81: truncate d1/d4/da/f12 966966 0 2024-04-25T02:27:03.071 INFO:tasks.workunit.client.0.smithi114.stdout:3/45: readlink d0/le 0 2024-04-25T02:27:03.071 INFO:tasks.workunit.client.0.smithi114.stdout:3/46: stat d0/d5 0 2024-04-25T02:27:03.072 INFO:tasks.workunit.client.0.smithi114.stdout:1/59: rename c1 to df/c16 0 2024-04-25T02:27:03.073 INFO:tasks.workunit.client.0.smithi114.stdout:1/60: dread - fc zero size 2024-04-25T02:27:03.075 INFO:tasks.workunit.client.0.smithi114.stdout:1/61: read fa [127341,23468] 0 2024-04-25T02:27:03.076 INFO:tasks.workunit.client.0.smithi114.stdout:1/62: stat fe 0 2024-04-25T02:27:03.077 INFO:tasks.workunit.client.0.smithi114.stdout:6/103: creat de/d27/f2d x:0 0 0 2024-04-25T02:27:03.078 INFO:tasks.workunit.client.0.smithi114.stdout:4/43: dwrite d3/f5 [4194304,4194304] 0 2024-04-25T02:27:03.078 INFO:tasks.workunit.client.0.smithi114.stdout:6/104: readlink l2 0 2024-04-25T02:27:03.080 INFO:tasks.workunit.client.0.smithi114.stdout:7/67: mknod d5/c17 0 2024-04-25T02:27:03.081 INFO:tasks.workunit.client.0.smithi114.stdout:6/105: write de/d2a/f2b [901812,84494] 0 2024-04-25T02:27:03.081 INFO:tasks.workunit.client.0.smithi114.stdout:3/47: dwrite d0/fb [0,4194304] 0 2024-04-25T02:27:03.081 INFO:tasks.workunit.client.0.smithi114.stdout:0/82: rmdir d1/d4/da 39 2024-04-25T02:27:03.082 INFO:tasks.workunit.client.0.smithi114.stdout:3/48: write d0/d5/fc [305358,42095] 0 2024-04-25T02:27:03.088 INFO:tasks.workunit.client.0.smithi114.stdout:4/44: creat d3/d8/f9 x:0 0 0 2024-04-25T02:27:03.088 INFO:tasks.workunit.client.0.smithi114.stdout:0/83: dwrite d1/fc [0,4194304] 0 2024-04-25T02:27:03.089 INFO:tasks.workunit.client.0.smithi114.stdout:0/84: chown d1/d4/ff 7004 1 2024-04-25T02:27:03.089 INFO:tasks.workunit.client.0.smithi114.stdout:4/45: chown d3/d8/f9 247389 1 2024-04-25T02:27:03.090 INFO:tasks.workunit.client.0.smithi114.stdout:7/68: creat d5/f18 x:0 0 0 2024-04-25T02:27:03.090 INFO:tasks.workunit.client.0.smithi114.stdout:0/85: write d1/fe [760496,105801] 0 2024-04-25T02:27:03.091 INFO:tasks.workunit.client.0.smithi114.stdout:3/49: fsync d0/f1 0 2024-04-25T02:27:03.096 INFO:tasks.workunit.client.0.smithi114.stdout:0/86: dwrite d1/fc [0,4194304] 0 2024-04-25T02:27:03.096 INFO:tasks.workunit.client.0.smithi114.stdout:0/87: readlink d1/l13 0 2024-04-25T02:27:03.098 INFO:tasks.workunit.client.0.smithi114.stdout:1/63: mknod df/d13/c17 0 2024-04-25T02:27:03.100 INFO:tasks.workunit.client.0.smithi114.stdout:4/46: creat d3/fa x:0 0 0 2024-04-25T02:27:03.101 INFO:tasks.workunit.client.0.smithi114.stdout:7/69: mkdir d5/d19 0 2024-04-25T02:27:03.104 INFO:tasks.workunit.client.0.smithi114.stdout:3/50: rename d0/d5/c9 to d0/d5/c10 0 2024-04-25T02:27:03.106 INFO:tasks.workunit.client.0.smithi114.stdout:1/64: mknod df/c18 0 2024-04-25T02:27:03.107 INFO:tasks.workunit.client.0.smithi114.stdout:3/51: fsync d0/f3 0 2024-04-25T02:27:03.107 INFO:tasks.workunit.client.0.smithi114.stdout:4/47: dwrite d3/f5 [4194304,4194304] 0 2024-04-25T02:27:03.108 INFO:tasks.workunit.client.0.smithi114.stdout:9/62: sync 2024-04-25T02:27:03.110 INFO:tasks.workunit.client.0.smithi114.stdout:3/52: truncate d0/d5/fc 469080 0 2024-04-25T02:27:03.111 INFO:tasks.workunit.client.0.smithi114.stdout:3/53: stat d0/fb 0 2024-04-25T02:27:03.112 INFO:tasks.workunit.client.0.smithi114.stdout:7/70: dwrite d5/f16 [0,4194304] 0 2024-04-25T02:27:03.113 INFO:tasks.workunit.client.0.smithi114.stdout:7/71: chown d5/f18 6 1 2024-04-25T02:27:03.113 INFO:tasks.workunit.client.0.smithi114.stdout:0/88: link d1/fc d1/d4/da/f16 0 2024-04-25T02:27:03.115 INFO:tasks.workunit.client.0.smithi114.stdout:4/48: mkdir d3/d8/db 0 2024-04-25T02:27:03.115 INFO:tasks.workunit.client.0.smithi114.stdout:4/49: chown d3/d8/f9 1123668 1 2024-04-25T02:27:03.116 INFO:tasks.workunit.client.0.smithi114.stdout:4/50: fdatasync d3/d8/f9 0 2024-04-25T02:27:03.116 INFO:tasks.workunit.client.0.smithi114.stdout:3/54: mknod d0/d5/c11 0 2024-04-25T02:27:03.117 INFO:tasks.workunit.client.0.smithi114.stdout:4/51: fdatasync d3/fa 0 2024-04-25T02:27:03.120 INFO:tasks.workunit.client.0.smithi114.stdout:7/72: mkdir d5/d19/d1a 0 2024-04-25T02:27:03.121 INFO:tasks.workunit.client.0.smithi114.stdout:0/89: write d1/fc [3840178,14329] 0 2024-04-25T02:27:03.122 INFO:tasks.workunit.client.0.smithi114.stdout:3/55: creat d0/f12 x:0 0 0 2024-04-25T02:27:03.122 INFO:tasks.workunit.client.0.smithi114.stdout:0/90: chown d1 17 1 2024-04-25T02:27:03.122 INFO:tasks.workunit.client.0.smithi114.stdout:3/56: truncate d0/f12 730957 0 2024-04-25T02:27:03.123 INFO:tasks.workunit.client.0.smithi114.stdout:4/52: mknod d3/d8/db/cc 0 2024-04-25T02:27:03.124 INFO:tasks.workunit.client.0.smithi114.stdout:0/91: dread d1/d7/fd [0,4194304] 0 2024-04-25T02:27:03.124 INFO:tasks.workunit.client.0.smithi114.stdout:2/96: sync 2024-04-25T02:27:03.124 INFO:tasks.workunit.client.0.smithi114.stdout:8/88: sync 2024-04-25T02:27:03.124 INFO:tasks.workunit.client.0.smithi114.stdout:5/56: sync 2024-04-25T02:27:03.124 INFO:tasks.workunit.client.0.smithi114.stdout:3/57: creat d0/d5/f13 x:0 0 0 2024-04-25T02:27:03.126 INFO:tasks.workunit.client.0.smithi114.stdout:8/89: rename da/d16 to da/d16/d1b 22 2024-04-25T02:27:03.126 INFO:tasks.workunit.client.0.smithi114.stdout:7/73: dread d5/f16 [0,4194304] 0 2024-04-25T02:27:03.126 INFO:tasks.workunit.client.0.smithi114.stdout:2/97: truncate d5/f15 602018 0 2024-04-25T02:27:03.127 INFO:tasks.workunit.client.0.smithi114.stdout:0/92: fsync d1/d7/fd 0 2024-04-25T02:27:03.127 INFO:tasks.workunit.client.0.smithi114.stdout:4/53: link d3/fa d3/d8/db/fd 0 2024-04-25T02:27:03.129 INFO:tasks.workunit.client.0.smithi114.stdout:3/58: rename d0/c7 to d0/d5/c14 0 2024-04-25T02:27:03.130 INFO:tasks.workunit.client.0.smithi114.stdout:8/90: mknod da/d16/d1a/c1c 0 2024-04-25T02:27:03.130 INFO:tasks.workunit.client.0.smithi114.stdout:3/59: readlink d0/le 0 2024-04-25T02:27:03.133 INFO:tasks.workunit.client.0.smithi114.stdout:2/98: creat d5/d1c/d22/f24 x:0 0 0 2024-04-25T02:27:03.135 INFO:tasks.workunit.client.0.smithi114.stdout:5/57: dwrite d1/d6/de/f11 [0,4194304] 0 2024-04-25T02:27:03.137 INFO:tasks.workunit.client.0.smithi114.stdout:4/54: dread d3/f5 [0,4194304] 0 2024-04-25T02:27:03.144 INFO:tasks.workunit.client.0.smithi114.stdout:7/74: link d5/c15 d5/d19/d1a/c1b 0 2024-04-25T02:27:03.144 INFO:tasks.workunit.client.0.smithi114.stdout:6/106: rmdir de 39 2024-04-25T02:27:03.144 INFO:tasks.workunit.client.0.smithi114.stdout:2/99: creat d5/df/d1e/f25 x:0 0 0 2024-04-25T02:27:03.146 INFO:tasks.workunit.client.0.smithi114.stdout:3/60: dwrite d0/d5/fc [0,4194304] 0 2024-04-25T02:27:03.146 INFO:tasks.workunit.client.0.smithi114.stdout:4/55: truncate d3/d8/db/fd 258035 0 2024-04-25T02:27:03.147 INFO:tasks.workunit.client.0.smithi114.stdout:4/56: chown d3 22410697 1 2024-04-25T02:27:03.147 INFO:tasks.workunit.client.0.smithi114.stdout:3/61: fdatasync d0/f4 0 2024-04-25T02:27:03.148 INFO:tasks.workunit.client.0.smithi114.stdout:3/62: rename d0/d5 to d0/d5/d15 22 2024-04-25T02:27:03.149 INFO:tasks.workunit.client.0.smithi114.stdout:7/75: dread f1 [0,4194304] 0 2024-04-25T02:27:03.150 INFO:tasks.workunit.client.0.smithi114.stdout:7/76: stat d5/c14 0 2024-04-25T02:27:03.151 INFO:tasks.workunit.client.0.smithi114.stdout:7/77: write d5/f10 [847612,21234] 0 2024-04-25T02:27:03.151 INFO:tasks.workunit.client.0.smithi114.stdout:2/100: creat d5/df/d1e/f26 x:0 0 0 2024-04-25T02:27:03.152 INFO:tasks.workunit.client.0.smithi114.stdout:7/78: dread - d5/f18 zero size 2024-04-25T02:27:03.153 INFO:tasks.workunit.client.0.smithi114.stdout:3/63: dread d0/fa [0,4194304] 0 2024-04-25T02:27:03.154 INFO:tasks.workunit.client.0.smithi114.stdout:6/107: creat de/d27/f2e x:0 0 0 2024-04-25T02:27:03.155 INFO:tasks.workunit.client.0.smithi114.stdout:1/65: getdents df/d13 0 2024-04-25T02:27:03.156 INFO:tasks.workunit.client.0.smithi114.stdout:2/101: write d5/df/d1e/f1f [1078658,95302] 0 2024-04-25T02:27:03.157 INFO:tasks.workunit.client.0.smithi114.stdout:2/102: chown d5/f1d 5960542 1 2024-04-25T02:27:03.157 INFO:tasks.workunit.client.0.smithi114.stdout:7/79: creat d5/d19/f1c x:0 0 0 2024-04-25T02:27:03.158 INFO:tasks.workunit.client.0.smithi114.stdout:3/64: dread d0/f3 [0,4194304] 0 2024-04-25T02:27:03.158 INFO:tasks.workunit.client.0.smithi114.stdout:2/103: fsync d5/d6/fc 0 2024-04-25T02:27:03.158 INFO:tasks.workunit.client.0.smithi114.stdout:6/108: mknod de/d25/c2f 0 2024-04-25T02:27:03.159 INFO:tasks.workunit.client.0.smithi114.stdout:1/66: creat df/f19 x:0 0 0 2024-04-25T02:27:03.159 INFO:tasks.workunit.client.0.smithi114.stdout:3/65: write d0/f4 [1532129,14754] 0 2024-04-25T02:27:03.160 INFO:tasks.workunit.client.0.smithi114.stdout:2/104: write d5/df/f11 [599667,56810] 0 2024-04-25T02:27:03.161 INFO:tasks.workunit.client.0.smithi114.stdout:7/80: rename d5/f10 to d5/d19/f1d 0 2024-04-25T02:27:03.161 INFO:tasks.workunit.client.0.smithi114.stdout:2/105: write d5/f15 [1239784,64411] 0 2024-04-25T02:27:03.163 INFO:tasks.workunit.client.0.smithi114.stdout:6/109: mkdir de/d30 0 2024-04-25T02:27:03.167 INFO:tasks.workunit.client.0.smithi114.stdout:3/66: dread d0/d5/fc [0,4194304] 0 2024-04-25T02:27:03.168 INFO:tasks.workunit.client.0.smithi114.stdout:3/67: dread - d0/d5/f13 zero size 2024-04-25T02:27:03.169 INFO:tasks.workunit.client.0.smithi114.stdout:6/110: write fa [182144,89915] 0 2024-04-25T02:27:03.169 INFO:tasks.workunit.client.0.smithi114.stdout:1/67: truncate f0 4806721 0 2024-04-25T02:27:03.169 INFO:tasks.workunit.client.0.smithi114.stdout:9/63: truncate f7 4167402 0 2024-04-25T02:27:03.170 INFO:tasks.workunit.client.0.smithi114.stdout:1/68: write fe [1068408,51304] 0 2024-04-25T02:27:03.171 INFO:tasks.workunit.client.0.smithi114.stdout:2/106: dwrite d5/d6/fc [0,4194304] 0 2024-04-25T02:27:03.172 INFO:tasks.workunit.client.0.smithi114.stdout:3/68: dread d0/f12 [0,4194304] 0 2024-04-25T02:27:03.173 INFO:tasks.workunit.client.0.smithi114.stdout:6/111: mknod de/d27/c31 0 2024-04-25T02:27:03.175 INFO:tasks.workunit.client.0.smithi114.stdout:9/64: rename l5 to d8/l12 0 2024-04-25T02:27:03.175 INFO:tasks.workunit.client.0.smithi114.stdout:1/69: symlink df/d13/l1a 0 2024-04-25T02:27:03.177 INFO:tasks.workunit.client.0.smithi114.stdout:3/69: creat d0/f16 x:0 0 0 2024-04-25T02:27:03.179 INFO:tasks.workunit.client.0.smithi114.stdout:2/107: mknod d5/d1c/d21/c27 0 2024-04-25T02:27:03.180 INFO:tasks.workunit.client.0.smithi114.stdout:6/112: dwrite f5 [0,4194304] 0 2024-04-25T02:27:03.181 INFO:tasks.workunit.client.0.smithi114.stdout:9/65: rename d8/c9 to d8/c13 0 2024-04-25T02:27:03.182 INFO:tasks.workunit.client.0.smithi114.stdout:8/91: getdents da/d16/d1a 0 2024-04-25T02:27:03.183 INFO:tasks.workunit.client.0.smithi114.stdout:1/70: mknod df/d13/c1b 0 2024-04-25T02:27:03.185 INFO:tasks.workunit.client.0.smithi114.stdout:3/70: creat d0/d5/f17 x:0 0 0 2024-04-25T02:27:03.186 INFO:tasks.workunit.client.0.smithi114.stdout:6/113: dread de/f1d [0,4194304] 0 2024-04-25T02:27:03.188 INFO:tasks.workunit.client.0.smithi114.stdout:2/108: creat d5/d1c/d22/f28 x:0 0 0 2024-04-25T02:27:03.189 INFO:tasks.workunit.client.0.smithi114.stdout:9/66: mknod d8/c14 0 2024-04-25T02:27:03.189 INFO:tasks.workunit.client.0.smithi114.stdout:0/93: truncate d1/fc 1583578 0 2024-04-25T02:27:03.193 INFO:tasks.workunit.client.0.smithi114.stdout:2/109: mkdir d5/d1c/d29 0 2024-04-25T02:27:03.194 INFO:tasks.workunit.client.0.smithi114.stdout:5/58: truncate d1/ff 3765913 0 2024-04-25T02:27:03.194 INFO:tasks.workunit.client.0.smithi114.stdout:9/67: mknod d8/c15 0 2024-04-25T02:27:03.197 INFO:tasks.workunit.client.0.smithi114.stdout:8/92: truncate da/f19 960202 0 2024-04-25T02:27:03.197 INFO:tasks.workunit.client.0.smithi114.stdout:5/59: write d1/d6/fa [3004605,74825] 0 2024-04-25T02:27:03.198 INFO:tasks.workunit.client.0.smithi114.stdout:2/110: write d5/df/d1e/f25 [124076,39970] 0 2024-04-25T02:27:03.198 INFO:tasks.workunit.client.0.smithi114.stdout:6/114: fsync de/d27/f2e 0 2024-04-25T02:27:03.198 INFO:tasks.workunit.client.0.smithi114.stdout:1/71: mknod df/d11/c1c 0 2024-04-25T02:27:03.199 INFO:tasks.workunit.client.0.smithi114.stdout:0/94: dwrite d1/d4/f15 [0,4194304] 0 2024-04-25T02:27:03.201 INFO:tasks.workunit.client.0.smithi114.stdout:2/111: dread - d5/df/d1e/f26 zero size 2024-04-25T02:27:03.201 INFO:tasks.workunit.client.0.smithi114.stdout:3/71: dwrite d0/d5/fc [0,4194304] 0 2024-04-25T02:27:03.202 INFO:tasks.workunit.client.0.smithi114.stdout:9/68: mkdir d8/d16 0 2024-04-25T02:27:03.203 INFO:tasks.workunit.client.0.smithi114.stdout:3/72: fdatasync d0/d5/f17 0 2024-04-25T02:27:03.205 INFO:tasks.workunit.client.0.smithi114.stdout:6/115: readlink de/l29 0 2024-04-25T02:27:03.206 INFO:tasks.workunit.client.0.smithi114.stdout:6/116: chown de/d2a/f2b 49 1 2024-04-25T02:27:03.207 INFO:tasks.workunit.client.0.smithi114.stdout:5/60: dread d1/d6/fa [0,4194304] 0 2024-04-25T02:27:03.209 INFO:tasks.workunit.client.0.smithi114.stdout:2/112: mknod d5/d1c/c2a 0 2024-04-25T02:27:03.212 INFO:tasks.workunit.client.0.smithi114.stdout:9/69: creat d8/f17 x:0 0 0 2024-04-25T02:27:03.213 INFO:tasks.workunit.client.0.smithi114.stdout:5/61: dwrite d1/d6/de/f11 [0,4194304] 0 2024-04-25T02:27:03.221 INFO:tasks.workunit.client.0.smithi114.stdout:0/95: symlink d1/l17 0 2024-04-25T02:27:03.221 INFO:tasks.workunit.client.0.smithi114.stdout:7/81: sync 2024-04-25T02:27:03.221 INFO:tasks.workunit.client.0.smithi114.stdout:0/96: dread d1/d4/da/f12 [0,4194304] 0 2024-04-25T02:27:03.223 INFO:tasks.workunit.client.0.smithi114.stdout:6/117: mknod de/d30/c32 0 2024-04-25T02:27:03.226 INFO:tasks.workunit.client.0.smithi114.stdout:7/82: mkdir d5/d1e 0 2024-04-25T02:27:03.227 INFO:tasks.workunit.client.0.smithi114.stdout:0/97: mkdir d1/d7/d18 0 2024-04-25T02:27:03.227 INFO:tasks.workunit.client.0.smithi114.stdout:5/62: dwrite d1/d6/fa [0,4194304] 0 2024-04-25T02:27:03.229 INFO:tasks.workunit.client.0.smithi114.stdout:2/113: creat d5/d1c/d29/f2b x:0 0 0 2024-04-25T02:27:03.233 INFO:tasks.workunit.client.0.smithi114.stdout:2/114: dread d5/d6/fa [0,4194304] 0 2024-04-25T02:27:03.233 INFO:tasks.workunit.client.0.smithi114.stdout:6/118: unlink c6 0 2024-04-25T02:27:03.235 INFO:tasks.workunit.client.0.smithi114.stdout:1/72: getdents df/d13 0 2024-04-25T02:27:03.235 INFO:tasks.workunit.client.0.smithi114.stdout:1/73: dread - fc zero size 2024-04-25T02:27:03.238 INFO:tasks.workunit.client.0.smithi114.stdout:2/115: dread d5/df/f11 [0,4194304] 0 2024-04-25T02:27:03.240 INFO:tasks.workunit.client.0.smithi114.stdout:3/73: getdents d0 0 2024-04-25T02:27:03.241 INFO:tasks.workunit.client.0.smithi114.stdout:3/74: dread - d0/f16 zero size 2024-04-25T02:27:03.242 INFO:tasks.workunit.client.0.smithi114.stdout:3/75: fdatasync d0/f1 0 2024-04-25T02:27:03.243 INFO:tasks.workunit.client.0.smithi114.stdout:7/83: dwrite d5/fa [0,4194304] 0 2024-04-25T02:27:03.243 INFO:tasks.workunit.client.0.smithi114.stdout:3/76: fsync d0/f1 0 2024-04-25T02:27:03.243 INFO:tasks.workunit.client.0.smithi114.stdout:7/84: chown f1 11009634 1 2024-04-25T02:27:03.243 INFO:tasks.workunit.client.0.smithi114.stdout:3/77: fdatasync d0/f4 0 2024-04-25T02:27:03.247 INFO:tasks.workunit.client.0.smithi114.stdout:2/116: mkdir d5/df/d2c 0 2024-04-25T02:27:03.249 INFO:tasks.workunit.client.0.smithi114.stdout:5/63: rename d1/d6/fa to d1/d6/f17 0 2024-04-25T02:27:03.249 INFO:tasks.workunit.client.0.smithi114.stdout:2/117: readlink d5/d6/l16 0 2024-04-25T02:27:03.250 INFO:tasks.workunit.client.0.smithi114.stdout:2/118: readlink d5/d1c/l23 0 2024-04-25T02:27:03.251 INFO:tasks.workunit.client.0.smithi114.stdout:7/85: dwrite d5/fa [0,4194304] 0 2024-04-25T02:27:03.262 INFO:tasks.workunit.client.0.smithi114.stdout:0/98: creat d1/d4/f19 x:0 0 0 2024-04-25T02:27:03.262 INFO:tasks.workunit.client.0.smithi114.stdout:0/99: fdatasync d1/d4/f15 0 2024-04-25T02:27:03.263 INFO:tasks.workunit.client.0.smithi114.stdout:9/70: fsync f7 0 2024-04-25T02:27:03.263 INFO:tasks.workunit.client.0.smithi114.stdout:9/71: write d8/f17 [178030,11260] 0 2024-04-25T02:27:03.265 INFO:tasks.workunit.client.0.smithi114.stdout:4/57: sync 2024-04-25T02:27:03.266 INFO:tasks.workunit.client.0.smithi114.stdout:2/119: write d5/df/f11 [1424148,67017] 0 2024-04-25T02:27:03.266 INFO:tasks.workunit.client.0.smithi114.stdout:8/93: write da/f19 [1179447,82782] 0 2024-04-25T02:27:03.267 INFO:tasks.workunit.client.0.smithi114.stdout:4/58: dread d3/fa [0,4194304] 0 2024-04-25T02:27:03.267 INFO:tasks.workunit.client.0.smithi114.stdout:8/94: fsync f3 0 2024-04-25T02:27:03.268 INFO:tasks.workunit.client.0.smithi114.stdout:7/86: unlink d5/f11 0 2024-04-25T02:27:03.268 INFO:tasks.workunit.client.0.smithi114.stdout:1/74: link ld df/l1d 0 2024-04-25T02:27:03.268 INFO:tasks.workunit.client.0.smithi114.stdout:1/75: chown df/d11 317 1 2024-04-25T02:27:03.269 INFO:tasks.workunit.client.0.smithi114.stdout:1/76: chown l7 134356 1 2024-04-25T02:27:03.270 INFO:tasks.workunit.client.0.smithi114.stdout:3/78: rename d0/d5/c14 to d0/c18 0 2024-04-25T02:27:03.271 INFO:tasks.workunit.client.0.smithi114.stdout:8/95: dread da/f19 [0,4194304] 0 2024-04-25T02:27:03.272 INFO:tasks.workunit.client.0.smithi114.stdout:0/100: fsync d1/d4/da/f16 0 2024-04-25T02:27:03.275 INFO:tasks.workunit.client.0.smithi114.stdout:7/87: dwrite d5/f6 [0,4194304] 0 2024-04-25T02:27:03.275 INFO:tasks.workunit.client.0.smithi114.stdout:7/88: write d5/fa [4942316,6389] 0 2024-04-25T02:27:03.278 INFO:tasks.workunit.client.0.smithi114.stdout:4/59: symlink d3/le 0 2024-04-25T02:27:03.280 INFO:tasks.workunit.client.0.smithi114.stdout:7/89: dwrite d5/fa [0,4194304] 0 2024-04-25T02:27:03.283 INFO:tasks.workunit.client.0.smithi114.stdout:1/77: mkdir df/d13/d1e 0 2024-04-25T02:27:03.300 INFO:tasks.workunit.client.0.smithi114.stdout:6/119: sync 2024-04-25T02:27:03.302 INFO:tasks.workunit.client.0.smithi114.stdout:1/78: dwrite df/f19 [0,4194304] 0 2024-04-25T02:27:03.319 INFO:tasks.workunit.client.0.smithi114.stdout:0/101: creat d1/d4/da/f1a x:0 0 0 2024-04-25T02:27:03.320 INFO:tasks.workunit.client.0.smithi114.stdout:3/79: truncate d0/f4 2554961 0 2024-04-25T02:27:03.320 INFO:tasks.workunit.client.0.smithi114.stdout:6/120: chown de/c15 11002976 1 2024-04-25T02:27:03.321 INFO:tasks.workunit.client.0.smithi114.stdout:7/90: write d5/d19/f1d [1499800,125274] 0 2024-04-25T02:27:03.323 INFO:tasks.workunit.client.0.smithi114.stdout:3/80: write d0/d5/f13 [858146,21152] 0 2024-04-25T02:27:03.323 INFO:tasks.workunit.client.0.smithi114.stdout:2/120: truncate d5/fd 492599 0 2024-04-25T02:27:03.325 INFO:tasks.workunit.client.0.smithi114.stdout:8/96: sync 2024-04-25T02:27:03.325 INFO:tasks.workunit.client.0.smithi114.stdout:8/97: stat c2 0 2024-04-25T02:27:03.328 INFO:tasks.workunit.client.0.smithi114.stdout:5/64: dread d1/ff [0,4194304] 0 2024-04-25T02:27:03.329 INFO:tasks.workunit.client.0.smithi114.stdout:0/102: dwrite d1/f3 [4194304,4194304] 0 2024-04-25T02:27:03.330 INFO:tasks.workunit.client.0.smithi114.stdout:6/121: dwrite de/d2a/f2b [0,4194304] 0 2024-04-25T02:27:03.331 INFO:tasks.workunit.client.0.smithi114.stdout:0/103: chown d1/d4/da/f16 671 1 2024-04-25T02:27:03.332 INFO:tasks.workunit.client.0.smithi114.stdout:0/104: stat d1/l13 0 2024-04-25T02:27:03.332 INFO:tasks.workunit.client.0.smithi114.stdout:6/122: write de/d27/f2d [388151,80424] 0 2024-04-25T02:27:03.333 INFO:tasks.workunit.client.0.smithi114.stdout:0/105: write d1/f10 [995483,85592] 0 2024-04-25T02:27:03.357 INFO:tasks.workunit.client.0.smithi114.stdout:4/60: sync 2024-04-25T02:27:03.358 INFO:tasks.workunit.client.0.smithi114.stdout:4/61: fsync d3/d8/f9 0 2024-04-25T02:27:03.524 INFO:tasks.workunit.client.0.smithi114.stdout:9/72: getdents d8 0 2024-04-25T02:27:03.524 INFO:tasks.workunit.client.0.smithi114.stdout:9/73: chown d8/c15 7747111 1 2024-04-25T02:27:03.525 INFO:tasks.workunit.client.0.smithi114.stdout:2/121: symlink d5/d6/l2d 0 2024-04-25T02:27:03.525 INFO:tasks.workunit.client.0.smithi114.stdout:2/122: chown d5/d6/fa 61380 1 2024-04-25T02:27:03.527 INFO:tasks.workunit.client.0.smithi114.stdout:5/65: mkdir d1/d18 0 2024-04-25T02:27:03.527 INFO:tasks.workunit.client.0.smithi114.stdout:6/123: mknod de/c33 0 2024-04-25T02:27:03.528 INFO:tasks.workunit.client.0.smithi114.stdout:0/106: fsync d1/d7/fd 0 2024-04-25T02:27:03.529 INFO:tasks.workunit.client.0.smithi114.stdout:4/62: creat d3/d8/ff x:0 0 0 2024-04-25T02:27:03.529 INFO:tasks.workunit.client.0.smithi114.stdout:0/107: truncate d1/d4/da/f1a 169001 0 2024-04-25T02:27:03.532 INFO:tasks.workunit.client.0.smithi114.stdout:9/74: mkdir d8/d18 0 2024-04-25T02:27:03.532 INFO:tasks.workunit.client.0.smithi114.stdout:9/75: read - d8/fb zero size 2024-04-25T02:27:03.534 INFO:tasks.workunit.client.0.smithi114.stdout:3/81: link d0/d5/f13 d0/f19 0 2024-04-25T02:27:03.537 INFO:tasks.workunit.client.0.smithi114.stdout:2/123: creat d5/f2e x:0 0 0 2024-04-25T02:27:03.537 INFO:tasks.workunit.client.0.smithi114.stdout:2/124: read - d5/d1c/d29/f2b zero size 2024-04-25T02:27:03.538 INFO:tasks.workunit.client.0.smithi114.stdout:5/66: creat d1/d6/f19 x:0 0 0 2024-04-25T02:27:03.538 INFO:tasks.workunit.client.0.smithi114.stdout:6/124: mkdir de/d27/d34 0 2024-04-25T02:27:03.541 INFO:tasks.workunit.client.0.smithi114.stdout:4/63: write d3/f5 [2100656,51686] 0 2024-04-25T02:27:03.542 INFO:tasks.workunit.client.0.smithi114.stdout:4/64: truncate d3/d8/f9 987321 0 2024-04-25T02:27:03.543 INFO:tasks.workunit.client.0.smithi114.stdout:3/82: symlink d0/l1a 0 2024-04-25T02:27:03.545 INFO:tasks.workunit.client.0.smithi114.stdout:5/67: rename d1/d18 to d1/d6/d1a 0 2024-04-25T02:27:03.547 INFO:tasks.workunit.client.0.smithi114.stdout:6/125: symlink de/d2a/l35 0 2024-04-25T02:27:03.550 INFO:tasks.workunit.client.0.smithi114.stdout:9/76: truncate f7 2747471 0 2024-04-25T02:27:03.556 INFO:tasks.workunit.client.0.smithi114.stdout:4/65: creat d3/d8/db/f10 x:0 0 0 2024-04-25T02:27:03.557 INFO:tasks.workunit.client.0.smithi114.stdout:5/68: fdatasync d1/ff 0 2024-04-25T02:27:03.557 INFO:tasks.workunit.client.0.smithi114.stdout:6/126: symlink de/d27/l36 0 2024-04-25T02:27:03.557 INFO:tasks.workunit.client.0.smithi114.stdout:0/108: creat d1/d4/f1b x:0 0 0 2024-04-25T02:27:03.559 INFO:tasks.workunit.client.0.smithi114.stdout:5/69: write d1/d6/f19 [234494,31241] 0 2024-04-25T02:27:03.559 INFO:tasks.workunit.client.0.smithi114.stdout:4/66: unlink l2 0 2024-04-25T02:27:03.560 INFO:tasks.workunit.client.0.smithi114.stdout:9/77: getdents d8/d16 0 2024-04-25T02:27:03.562 INFO:tasks.workunit.client.0.smithi114.stdout:6/127: creat de/d30/f37 x:0 0 0 2024-04-25T02:27:03.562 INFO:tasks.workunit.client.0.smithi114.stdout:6/128: chown f5 4163 1 2024-04-25T02:27:03.563 INFO:tasks.workunit.client.0.smithi114.stdout:6/129: dread de/f19 [0,4194304] 0 2024-04-25T02:27:03.563 INFO:tasks.workunit.client.0.smithi114.stdout:4/67: creat d3/d8/f11 x:0 0 0 2024-04-25T02:27:03.563 INFO:tasks.workunit.client.0.smithi114.stdout:6/130: readlink de/l26 0 2024-04-25T02:27:03.565 INFO:tasks.workunit.client.0.smithi114.stdout:5/70: mknod d1/d6/de/d16/c1b 0 2024-04-25T02:27:03.568 INFO:tasks.workunit.client.0.smithi114.stdout:6/131: mkdir de/d27/d34/d38 0 2024-04-25T02:27:03.569 INFO:tasks.workunit.client.0.smithi114.stdout:5/71: write d1/d6/f17 [3470116,79773] 0 2024-04-25T02:27:03.595 INFO:tasks.workunit.client.0.smithi114.stdout:6/132: mkdir de/d25/d39 0 2024-04-25T02:27:03.596 INFO:tasks.workunit.client.0.smithi114.stdout:6/133: fdatasync de/f1f 0 2024-04-25T02:27:03.599 INFO:tasks.workunit.client.0.smithi114.stdout:6/134: creat de/d2a/f3a x:0 0 0 2024-04-25T02:27:03.599 INFO:tasks.workunit.client.0.smithi114.stdout:6/135: chown de/d27 163309072 1 2024-04-25T02:27:03.600 INFO:tasks.workunit.client.0.smithi114.stdout:6/136: readlink l3 0 2024-04-25T02:27:03.601 INFO:tasks.workunit.client.0.smithi114.stdout:6/137: symlink de/d30/l3b 0 2024-04-25T02:27:03.602 INFO:tasks.workunit.client.0.smithi114.stdout:6/138: dread de/f1d [0,4194304] 0 2024-04-25T02:27:03.604 INFO:tasks.workunit.client.0.smithi114.stdout:6/139: creat de/d25/f3c x:0 0 0 2024-04-25T02:27:03.605 INFO:tasks.workunit.client.0.smithi114.stdout:6/140: symlink de/d1c/l3d 0 2024-04-25T02:27:03.608 INFO:tasks.workunit.client.0.smithi114.stdout:6/141: rename de/d25/f28 to de/d25/f3e 0 2024-04-25T02:27:03.613 INFO:tasks.workunit.client.0.smithi114.stdout:7/91: write d5/f6 [4448609,14759] 0 2024-04-25T02:27:03.615 INFO:tasks.workunit.client.0.smithi114.stdout:7/92: mkdir d5/d19/d1f 0 2024-04-25T02:27:03.615 INFO:tasks.workunit.client.0.smithi114.stdout:7/93: chown d5/f18 154467 1 2024-04-25T02:27:03.616 INFO:tasks.workunit.client.0.smithi114.stdout:1/79: truncate df/f19 1147847 0 2024-04-25T02:27:03.617 INFO:tasks.workunit.client.0.smithi114.stdout:3/83: truncate d0/f19 341870 0 2024-04-25T02:27:03.619 INFO:tasks.workunit.client.0.smithi114.stdout:1/80: creat df/d13/f1f x:0 0 0 2024-04-25T02:27:03.620 INFO:tasks.workunit.client.0.smithi114.stdout:0/109: dwrite d1/d7/f14 [0,4194304] 0 2024-04-25T02:27:03.621 INFO:tasks.workunit.client.0.smithi114.stdout:3/84: symlink d0/d5/l1b 0 2024-04-25T02:27:03.622 INFO:tasks.workunit.client.0.smithi114.stdout:0/110: chown d1/d4/f15 712 1 2024-04-25T02:27:03.626 INFO:tasks.workunit.client.0.smithi114.stdout:7/94: rmdir d5/d19/d1f 0 2024-04-25T02:27:03.627 INFO:tasks.workunit.client.0.smithi114.stdout:8/98: dwrite da/fc [0,4194304] 0 2024-04-25T02:27:03.629 INFO:tasks.workunit.client.0.smithi114.stdout:7/95: mknod d5/d19/c20 0 2024-04-25T02:27:03.630 INFO:tasks.workunit.client.0.smithi114.stdout:8/99: dwrite f3 [0,4194304] 0 2024-04-25T02:27:03.630 INFO:tasks.workunit.client.0.smithi114.stdout:4/68: rename d3/d8/db to d3/d8/d12 0 2024-04-25T02:27:03.631 INFO:tasks.workunit.client.0.smithi114.stdout:5/72: write d1/ff [416334,100095] 0 2024-04-25T02:27:03.633 INFO:tasks.workunit.client.0.smithi114.stdout:0/111: rename d1/f6 to d1/d7/f1c 0 2024-04-25T02:27:03.634 INFO:tasks.workunit.client.0.smithi114.stdout:1/81: getdents df/d11 0 2024-04-25T02:27:03.637 INFO:tasks.workunit.client.0.smithi114.stdout:7/96: dwrite d5/d19/f1d [0,4194304] 0 2024-04-25T02:27:03.637 INFO:tasks.workunit.client.0.smithi114.stdout:5/73: dread d1/d6/de/f11 [0,4194304] 0 2024-04-25T02:27:03.639 INFO:tasks.workunit.client.0.smithi114.stdout:5/74: write d1/d6/f19 [914710,2982] 0 2024-04-25T02:27:03.639 INFO:tasks.workunit.client.0.smithi114.stdout:5/75: fdatasync d1/d6/f17 0 2024-04-25T02:27:03.640 INFO:tasks.workunit.client.0.smithi114.stdout:8/100: rename da/d16/d1a to da/d1d 0 2024-04-25T02:27:03.641 INFO:tasks.workunit.client.0.smithi114.stdout:2/125: sync 2024-04-25T02:27:03.642 INFO:tasks.workunit.client.0.smithi114.stdout:1/82: creat df/d11/f20 x:0 0 0 2024-04-25T02:27:03.646 INFO:tasks.workunit.client.0.smithi114.stdout:8/101: dread da/ff [0,4194304] 0 2024-04-25T02:27:03.646 INFO:tasks.workunit.client.0.smithi114.stdout:5/76: fsync d1/d6/de/f11 0 2024-04-25T02:27:03.649 INFO:tasks.workunit.client.0.smithi114.stdout:0/112: rename d1/f11 to d1/d7/d18/f1d 0 2024-04-25T02:27:03.651 INFO:tasks.workunit.client.0.smithi114.stdout:2/126: dwrite d5/d1c/d22/f28 [0,4194304] 0 2024-04-25T02:27:03.653 INFO:tasks.workunit.client.0.smithi114.stdout:1/83: dwrite df/d13/f1f [0,4194304] 0 2024-04-25T02:27:03.653 INFO:tasks.workunit.client.0.smithi114.stdout:2/127: dread - d5/df/d1e/f26 zero size 2024-04-25T02:27:03.655 INFO:tasks.workunit.client.0.smithi114.stdout:8/102: dread da/d14/f15 [0,4194304] 0 2024-04-25T02:27:03.658 INFO:tasks.workunit.client.0.smithi114.stdout:0/113: symlink d1/d7/d18/l1e 0 2024-04-25T02:27:03.663 INFO:tasks.workunit.client.0.smithi114.stdout:7/97: rename c0 to d5/d19/c21 0 2024-04-25T02:27:03.663 INFO:tasks.workunit.client.0.smithi114.stdout:7/98: chown d5/c12 58327 1 2024-04-25T02:27:03.664 INFO:tasks.workunit.client.0.smithi114.stdout:2/128: symlink d5/df/d2c/l2f 0 2024-04-25T02:27:03.665 INFO:tasks.workunit.client.0.smithi114.stdout:8/103: getdents da/d1d 0 2024-04-25T02:27:03.665 INFO:tasks.workunit.client.0.smithi114.stdout:8/104: chown da/ff 148745 1 2024-04-25T02:27:03.666 INFO:tasks.workunit.client.0.smithi114.stdout:2/129: symlink d5/d1c/d29/l30 0 2024-04-25T02:27:03.667 INFO:tasks.workunit.client.0.smithi114.stdout:8/105: mkdir da/d1e 0 2024-04-25T02:27:03.668 INFO:tasks.workunit.client.0.smithi114.stdout:0/114: getdents d1/d4 0 2024-04-25T02:27:03.669 INFO:tasks.workunit.client.0.smithi114.stdout:2/130: mkdir d5/d6/d31 0 2024-04-25T02:27:03.669 INFO:tasks.workunit.client.0.smithi114.stdout:0/115: chown d1/l13 0 1 2024-04-25T02:27:03.670 INFO:tasks.workunit.client.0.smithi114.stdout:7/99: dwrite d5/d19/f1d [0,4194304] 0 2024-04-25T02:27:03.672 INFO:tasks.workunit.client.0.smithi114.stdout:0/116: write d1/d4/f19 [513866,123798] 0 2024-04-25T02:27:03.674 INFO:tasks.workunit.client.0.smithi114.stdout:7/100: mknod d5/d19/c22 0 2024-04-25T02:27:03.675 INFO:tasks.workunit.client.0.smithi114.stdout:7/101: fdatasync f1 0 2024-04-25T02:27:03.675 INFO:tasks.workunit.client.0.smithi114.stdout:9/78: sync 2024-04-25T02:27:03.676 INFO:tasks.workunit.client.0.smithi114.stdout:9/79: dread - d8/f10 zero size 2024-04-25T02:27:03.676 INFO:tasks.workunit.client.0.smithi114.stdout:8/106: dwrite f3 [0,4194304] 0 2024-04-25T02:27:03.677 INFO:tasks.workunit.client.0.smithi114.stdout:9/80: write d8/fe [41558,57856] 0 2024-04-25T02:27:03.678 INFO:tasks.workunit.client.0.smithi114.stdout:7/102: mkdir d5/d19/d23 0 2024-04-25T02:27:03.680 INFO:tasks.workunit.client.0.smithi114.stdout:8/107: dread da/f19 [0,4194304] 0 2024-04-25T02:27:03.681 INFO:tasks.workunit.client.0.smithi114.stdout:7/103: dread d5/f9 [0,4194304] 0 2024-04-25T02:27:03.682 INFO:tasks.workunit.client.0.smithi114.stdout:7/104: readlink d5/lf 0 2024-04-25T02:27:03.683 INFO:tasks.workunit.client.0.smithi114.stdout:8/108: creat da/d1d/f1f x:0 0 0 2024-04-25T02:27:03.684 INFO:tasks.workunit.client.0.smithi114.stdout:8/109: write da/d1d/f1f [942324,118145] 0 2024-04-25T02:27:03.684 INFO:tasks.workunit.client.0.smithi114.stdout:8/110: write f3 [2715062,111296] 0 2024-04-25T02:27:03.685 INFO:tasks.workunit.client.0.smithi114.stdout:8/111: chown da/d1d/c1c 534 1 2024-04-25T02:27:03.685 INFO:tasks.workunit.client.0.smithi114.stdout:7/105: creat d5/d19/d1a/f24 x:0 0 0 2024-04-25T02:27:03.688 INFO:tasks.workunit.client.0.smithi114.stdout:7/106: symlink d5/d19/d23/l25 0 2024-04-25T02:27:03.688 INFO:tasks.workunit.client.0.smithi114.stdout:8/112: dread da/fc [0,4194304] 0 2024-04-25T02:27:03.689 INFO:tasks.workunit.client.0.smithi114.stdout:7/107: chown d5/lf 7 1 2024-04-25T02:27:03.689 INFO:tasks.workunit.client.0.smithi114.stdout:7/108: readlink l2 0 2024-04-25T02:27:03.690 INFO:tasks.workunit.client.0.smithi114.stdout:8/113: truncate da/f19 425498 0 2024-04-25T02:27:03.690 INFO:tasks.workunit.client.0.smithi114.stdout:8/114: write f3 [3893388,55357] 0 2024-04-25T02:27:03.691 INFO:tasks.workunit.client.0.smithi114.stdout:7/109: rename d5/lf to d5/d19/d23/l26 0 2024-04-25T02:27:03.691 INFO:tasks.workunit.client.0.smithi114.stdout:8/115: truncate f3 6110271 0 2024-04-25T02:27:03.694 INFO:tasks.workunit.client.0.smithi114.stdout:7/110: link d5/f18 d5/d19/f27 0 2024-04-25T02:27:03.694 INFO:tasks.workunit.client.0.smithi114.stdout:7/111: write d5/d19/f1d [205524,106481] 0 2024-04-25T02:27:03.695 INFO:tasks.workunit.client.0.smithi114.stdout:7/112: fdatasync d5/fa 0 2024-04-25T02:27:03.706 INFO:tasks.workunit.client.0.smithi114.stdout:4/69: rmdir d3/d8 39 2024-04-25T02:27:03.706 INFO:tasks.workunit.client.0.smithi114.stdout:5/77: dread d1/d6/f19 [0,4194304] 0 2024-04-25T02:27:03.707 INFO:tasks.workunit.client.0.smithi114.stdout:0/117: dread d1/d4/f19 [0,4194304] 0 2024-04-25T02:27:03.707 INFO:tasks.workunit.client.0.smithi114.stdout:4/70: dread - d3/d8/ff zero size 2024-04-25T02:27:03.708 INFO:tasks.workunit.client.0.smithi114.stdout:5/78: read d1/d6/f19 [202319,24117] 0 2024-04-25T02:27:03.708 INFO:tasks.workunit.client.0.smithi114.stdout:6/142: sync 2024-04-25T02:27:03.710 INFO:tasks.workunit.client.0.smithi114.stdout:5/79: dread d1/d6/f19 [0,4194304] 0 2024-04-25T02:27:03.711 INFO:tasks.workunit.client.0.smithi114.stdout:6/143: creat de/d27/f3f x:0 0 0 2024-04-25T02:27:03.712 INFO:tasks.workunit.client.0.smithi114.stdout:1/84: write df/d13/f1f [4765634,89382] 0 2024-04-25T02:27:03.713 INFO:tasks.workunit.client.0.smithi114.stdout:8/116: write da/d14/f15 [4445078,19749] 0 2024-04-25T02:27:03.714 INFO:tasks.workunit.client.0.smithi114.stdout:6/144: dread - de/d25/f3c zero size 2024-04-25T02:27:03.716 INFO:tasks.workunit.client.0.smithi114.stdout:7/113: chown d5/d19/c21 122876746 1 2024-04-25T02:27:03.720 INFO:tasks.workunit.client.0.smithi114.stdout:4/71: dwrite d3/d8/f9 [0,4194304] 0 2024-04-25T02:27:03.720 INFO:tasks.workunit.client.0.smithi114.stdout:0/118: dwrite d1/d4/f19 [0,4194304] 0 2024-04-25T02:27:03.721 INFO:tasks.workunit.client.0.smithi114.stdout:1/85: creat df/d13/d1e/f21 x:0 0 0 2024-04-25T02:27:03.722 INFO:tasks.workunit.client.0.smithi114.stdout:7/114: write d5/f9 [3481084,101804] 0 2024-04-25T02:27:03.725 INFO:tasks.workunit.client.0.smithi114.stdout:0/119: chown d1/d4/da/f16 7 1 2024-04-25T02:27:03.725 INFO:tasks.workunit.client.0.smithi114.stdout:5/80: dread d1/d6/f17 [0,4194304] 0 2024-04-25T02:27:03.727 INFO:tasks.workunit.client.0.smithi114.stdout:4/72: symlink d3/d8/l13 0 2024-04-25T02:27:03.729 INFO:tasks.workunit.client.0.smithi114.stdout:2/131: dwrite d5/fe [0,4194304] 0 2024-04-25T02:27:03.729 INFO:tasks.workunit.client.0.smithi114.stdout:5/81: truncate d1/d6/f19 1328503 0 2024-04-25T02:27:03.731 INFO:tasks.workunit.client.0.smithi114.stdout:1/86: rename df/d13/c1b to df/d13/c22 0 2024-04-25T02:27:03.733 INFO:tasks.workunit.client.0.smithi114.stdout:9/81: dwrite f7 [0,4194304] 0 2024-04-25T02:27:03.734 INFO:tasks.workunit.client.0.smithi114.stdout:6/145: getdents de/d2a 0 2024-04-25T02:27:03.734 INFO:tasks.workunit.client.0.smithi114.stdout:7/115: rename d5/f16 to d5/d19/d23/f28 0 2024-04-25T02:27:03.734 INFO:tasks.workunit.client.0.smithi114.stdout:2/132: truncate d5/df/f14 714744 0 2024-04-25T02:27:03.735 INFO:tasks.workunit.client.0.smithi114.stdout:5/82: symlink d1/d6/d1a/l1c 0 2024-04-25T02:27:03.736 INFO:tasks.workunit.client.0.smithi114.stdout:9/82: fsync d8/f17 0 2024-04-25T02:27:03.736 INFO:tasks.workunit.client.0.smithi114.stdout:3/85: truncate d0/f19 115202 0 2024-04-25T02:27:03.739 INFO:tasks.workunit.client.0.smithi114.stdout:4/73: dwrite d3/d8/ff [0,4194304] 0 2024-04-25T02:27:03.739 INFO:tasks.workunit.client.0.smithi114.stdout:0/120: rename d1/f3 to d1/d7/d18/f1f 0 2024-04-25T02:27:03.740 INFO:tasks.workunit.client.0.smithi114.stdout:0/121: fsync d1/d7/f14 0 2024-04-25T02:27:03.741 INFO:tasks.workunit.client.0.smithi114.stdout:8/117: write da/ff [1613955,73171] 0 2024-04-25T02:27:03.743 INFO:tasks.workunit.client.0.smithi114.stdout:6/146: creat de/d27/d34/f40 x:0 0 0 2024-04-25T02:27:03.744 INFO:tasks.workunit.client.0.smithi114.stdout:6/147: dread - de/ff zero size 2024-04-25T02:27:03.745 INFO:tasks.workunit.client.0.smithi114.stdout:2/133: unlink d5/d6/l16 0 2024-04-25T02:27:03.746 INFO:tasks.workunit.client.0.smithi114.stdout:7/116: symlink d5/d19/l29 0 2024-04-25T02:27:03.747 INFO:tasks.workunit.client.0.smithi114.stdout:3/86: mknod d0/c1c 0 2024-04-25T02:27:03.752 INFO:tasks.workunit.client.0.smithi114.stdout:6/148: mknod de/d2a/c41 0 2024-04-25T02:27:03.752 INFO:tasks.workunit.client.0.smithi114.stdout:7/117: dwrite d5/f9 [0,4194304] 0 2024-04-25T02:27:03.753 INFO:tasks.workunit.client.0.smithi114.stdout:0/122: dread d1/d4/da/f12 [0,4194304] 0 2024-04-25T02:27:03.754 INFO:tasks.workunit.client.0.smithi114.stdout:7/118: truncate d5/d19/f1c 326921 0 2024-04-25T02:27:03.754 INFO:tasks.workunit.client.0.smithi114.stdout:0/123: dread d1/d4/da/f1a [0,4194304] 0 2024-04-25T02:27:03.755 INFO:tasks.workunit.client.0.smithi114.stdout:3/87: rename d0/f1 to d0/f1d 0 2024-04-25T02:27:03.756 INFO:tasks.workunit.client.0.smithi114.stdout:1/87: link df/l12 df/d11/l23 0 2024-04-25T02:27:03.758 INFO:tasks.workunit.client.0.smithi114.stdout:0/124: dread d1/d7/d18/f1f [0,4194304] 0 2024-04-25T02:27:03.758 INFO:tasks.workunit.client.0.smithi114.stdout:8/118: mknod da/d1e/c20 0 2024-04-25T02:27:03.759 INFO:tasks.workunit.client.0.smithi114.stdout:0/125: write d1/d4/da/f16 [1180387,58075] 0 2024-04-25T02:27:03.759 INFO:tasks.workunit.client.0.smithi114.stdout:2/134: creat d5/d6/d31/f32 x:0 0 0 2024-04-25T02:27:03.762 INFO:tasks.workunit.client.0.smithi114.stdout:9/83: link d8/cc d8/d16/c19 0 2024-04-25T02:27:03.783 INFO:tasks.workunit.client.0.smithi114.stdout:1/88: creat df/d11/f24 x:0 0 0 2024-04-25T02:27:03.783 INFO:tasks.workunit.client.0.smithi114.stdout:6/149: unlink de/c24 0 2024-04-25T02:27:03.785 INFO:tasks.workunit.client.0.smithi114.stdout:0/126: write d1/d4/f19 [602959,102105] 0 2024-04-25T02:27:03.785 INFO:tasks.workunit.client.0.smithi114.stdout:1/89: chown f4 6719 1 2024-04-25T02:27:03.786 INFO:tasks.workunit.client.0.smithi114.stdout:6/150: write de/f1e [2593535,102850] 0 2024-04-25T02:27:03.786 INFO:tasks.workunit.client.0.smithi114.stdout:3/88: dread d0/d5/f13 [0,4194304] 0 2024-04-25T02:27:03.787 INFO:tasks.workunit.client.0.smithi114.stdout:1/90: chown df/c16 200 1 2024-04-25T02:27:03.788 INFO:tasks.workunit.client.0.smithi114.stdout:6/151: truncate de/d25/f3c 761198 0 2024-04-25T02:27:03.788 INFO:tasks.workunit.client.0.smithi114.stdout:8/119: read da/f19 [106862,105438] 0 2024-04-25T02:27:03.788 INFO:tasks.workunit.client.0.smithi114.stdout:1/91: fsync df/d11/f20 0 2024-04-25T02:27:03.788 INFO:tasks.workunit.client.0.smithi114.stdout:6/152: truncate de/f19 2032779 0 2024-04-25T02:27:03.789 INFO:tasks.workunit.client.0.smithi114.stdout:9/84: symlink d8/d18/l1a 0 2024-04-25T02:27:03.789 INFO:tasks.workunit.client.0.smithi114.stdout:8/120: chown da/ld 18960 1 2024-04-25T02:27:03.790 INFO:tasks.workunit.client.0.smithi114.stdout:9/85: dread - d8/fb zero size 2024-04-25T02:27:03.790 INFO:tasks.workunit.client.0.smithi114.stdout:8/121: write da/d1d/f1f [615023,127998] 0 2024-04-25T02:27:03.792 INFO:tasks.workunit.client.0.smithi114.stdout:0/127: unlink d1/d4/da/f1a 0 2024-04-25T02:27:03.793 INFO:tasks.workunit.client.0.smithi114.stdout:5/83: truncate d1/d6/f19 789396 0 2024-04-25T02:27:03.794 INFO:tasks.workunit.client.0.smithi114.stdout:5/84: chown d1/d6/de/l15 10064 1 2024-04-25T02:27:03.794 INFO:tasks.workunit.client.0.smithi114.stdout:4/74: truncate d3/f5 5761248 0 2024-04-25T02:27:03.797 INFO:tasks.workunit.client.0.smithi114.stdout:3/89: unlink d0/c18 0 2024-04-25T02:27:03.798 INFO:tasks.workunit.client.0.smithi114.stdout:9/86: creat d8/d18/f1b x:0 0 0 2024-04-25T02:27:03.799 INFO:tasks.workunit.client.0.smithi114.stdout:8/122: rename da/f19 to da/f21 0 2024-04-25T02:27:03.803 INFO:tasks.workunit.client.0.smithi114.stdout:5/85: creat d1/d6/de/f1d x:0 0 0 2024-04-25T02:27:03.803 INFO:tasks.workunit.client.0.smithi114.stdout:8/123: dread da/d14/f15 [0,4194304] 0 2024-04-25T02:27:03.804 INFO:tasks.workunit.client.0.smithi114.stdout:6/153: creat de/d27/d34/d38/f42 x:0 0 0 2024-04-25T02:27:03.804 INFO:tasks.workunit.client.0.smithi114.stdout:5/86: stat d1/l13 0 2024-04-25T02:27:03.804 INFO:tasks.workunit.client.0.smithi114.stdout:3/90: creat d0/d5/f1e x:0 0 0 2024-04-25T02:27:03.804 INFO:tasks.workunit.client.0.smithi114.stdout:6/154: chown de/d27/f3f 4780 1 2024-04-25T02:27:03.805 INFO:tasks.workunit.client.0.smithi114.stdout:5/87: fsync d1/d6/de/f11 0 2024-04-25T02:27:03.805 INFO:tasks.workunit.client.0.smithi114.stdout:6/155: chown l9 52819524 1 2024-04-25T02:27:03.805 INFO:tasks.workunit.client.0.smithi114.stdout:9/87: symlink d8/l1c 0 2024-04-25T02:27:03.806 INFO:tasks.workunit.client.0.smithi114.stdout:5/88: chown d1/d6/c8 3 1 2024-04-25T02:27:03.806 INFO:tasks.workunit.client.0.smithi114.stdout:9/88: write d8/f10 [619803,67741] 0 2024-04-25T02:27:03.807 INFO:tasks.workunit.client.0.smithi114.stdout:5/89: read d1/ff [280337,94550] 0 2024-04-25T02:27:03.807 INFO:tasks.workunit.client.0.smithi114.stdout:9/89: stat d8/c15 0 2024-04-25T02:27:03.807 INFO:tasks.workunit.client.0.smithi114.stdout:6/156: dread de/d25/f3c [0,4194304] 0 2024-04-25T02:27:03.808 INFO:tasks.workunit.client.0.smithi114.stdout:5/90: write d1/d6/de/f1d [805729,44080] 0 2024-04-25T02:27:03.808 INFO:tasks.workunit.client.0.smithi114.stdout:6/157: write de/d27/f2e [365710,97231] 0 2024-04-25T02:27:03.810 INFO:tasks.workunit.client.0.smithi114.stdout:4/75: mkdir d3/d14 0 2024-04-25T02:27:03.811 INFO:tasks.workunit.client.0.smithi114.stdout:3/91: mknod d0/c1f 0 2024-04-25T02:27:03.815 INFO:tasks.workunit.client.0.smithi114.stdout:1/92: truncate f4 3802457 0 2024-04-25T02:27:03.815 INFO:tasks.workunit.client.0.smithi114.stdout:1/93: chown df/d13/l1a 5086 1 2024-04-25T02:27:03.816 INFO:tasks.workunit.client.0.smithi114.stdout:9/90: creat d8/f1d x:0 0 0 2024-04-25T02:27:03.818 INFO:tasks.workunit.client.0.smithi114.stdout:6/158: creat de/d30/f43 x:0 0 0 2024-04-25T02:27:03.818 INFO:tasks.workunit.client.0.smithi114.stdout:6/159: readlink l2 0 2024-04-25T02:27:03.824 INFO:tasks.workunit.client.0.smithi114.stdout:0/128: getdents d1/d7 0 2024-04-25T02:27:03.824 INFO:tasks.workunit.client.0.smithi114.stdout:1/94: mkdir df/d11/d25 0 2024-04-25T02:27:03.825 INFO:tasks.workunit.client.0.smithi114.stdout:7/119: sync 2024-04-25T02:27:03.826 INFO:tasks.workunit.client.0.smithi114.stdout:7/120: fdatasync d5/d19/f1c 0 2024-04-25T02:27:03.827 INFO:tasks.workunit.client.0.smithi114.stdout:6/160: mkdir de/d27/d34/d44 0 2024-04-25T02:27:03.827 INFO:tasks.workunit.client.0.smithi114.stdout:6/161: write f5 [2354404,25977] 0 2024-04-25T02:27:03.829 INFO:tasks.workunit.client.0.smithi114.stdout:8/124: truncate da/f21 454048 0 2024-04-25T02:27:03.830 INFO:tasks.workunit.client.0.smithi114.stdout:9/91: symlink d8/d16/l1e 0 2024-04-25T02:27:03.836 INFO:tasks.workunit.client.0.smithi114.stdout:7/121: creat d5/d19/f2a x:0 0 0 2024-04-25T02:27:03.836 INFO:tasks.workunit.client.0.smithi114.stdout:3/92: dwrite d0/d5/f13 [0,4194304] 0 2024-04-25T02:27:03.837 INFO:tasks.workunit.client.0.smithi114.stdout:6/162: mknod de/d27/d34/d38/c45 0 2024-04-25T02:27:03.837 INFO:tasks.workunit.client.0.smithi114.stdout:8/125: rmdir da/d16 39 2024-04-25T02:27:03.838 INFO:tasks.workunit.client.0.smithi114.stdout:0/129: symlink d1/l20 0 2024-04-25T02:27:03.839 INFO:tasks.workunit.client.0.smithi114.stdout:9/92: creat d8/f1f x:0 0 0 2024-04-25T02:27:03.840 INFO:tasks.workunit.client.0.smithi114.stdout:1/95: rename f0 to df/d11/d25/f26 0 2024-04-25T02:27:03.845 INFO:tasks.workunit.client.0.smithi114.stdout:7/122: creat d5/d19/f2b x:0 0 0 2024-04-25T02:27:03.846 INFO:tasks.workunit.client.0.smithi114.stdout:6/163: dwrite de/f1e [0,4194304] 0 2024-04-25T02:27:03.847 INFO:tasks.workunit.client.0.smithi114.stdout:3/93: symlink d0/d5/l20 0 2024-04-25T02:27:03.848 INFO:tasks.workunit.client.0.smithi114.stdout:6/164: fdatasync de/f18 0 2024-04-25T02:27:03.849 INFO:tasks.workunit.client.0.smithi114.stdout:0/130: dwrite d1/fc [0,4194304] 0 2024-04-25T02:27:03.851 INFO:tasks.workunit.client.0.smithi114.stdout:1/96: creat df/d11/d25/f27 x:0 0 0 2024-04-25T02:27:03.851 INFO:tasks.workunit.client.0.smithi114.stdout:9/93: write d8/ff [1961374,32561] 0 2024-04-25T02:27:03.852 INFO:tasks.workunit.client.0.smithi114.stdout:5/91: dwrite d1/d6/f19 [0,4194304] 0 2024-04-25T02:27:03.852 INFO:tasks.workunit.client.0.smithi114.stdout:0/131: chown d1/d7 1048002828 1 2024-04-25T02:27:03.853 INFO:tasks.workunit.client.0.smithi114.stdout:6/165: mknod de/d1c/c46 0 2024-04-25T02:27:03.855 INFO:tasks.workunit.client.0.smithi114.stdout:3/94: dread d0/fb [0,4194304] 0 2024-04-25T02:27:03.857 INFO:tasks.workunit.client.0.smithi114.stdout:2/135: sync 2024-04-25T02:27:03.859 INFO:tasks.workunit.client.0.smithi114.stdout:0/132: unlink d1/fe 0 2024-04-25T02:27:03.859 INFO:tasks.workunit.client.0.smithi114.stdout:0/133: read d1/d7/fd [2546895,9727] 0 2024-04-25T02:27:03.862 INFO:tasks.workunit.client.0.smithi114.stdout:5/92: creat d1/d6/de/f1e x:0 0 0 2024-04-25T02:27:03.863 INFO:tasks.workunit.client.0.smithi114.stdout:5/93: write d1/d6/de/f1d [713853,55233] 0 2024-04-25T02:27:03.864 INFO:tasks.workunit.client.0.smithi114.stdout:1/97: rename df/d13/f1f to df/d11/f28 0 2024-04-25T02:27:03.866 INFO:tasks.workunit.client.0.smithi114.stdout:8/126: link da/c10 da/d16/c22 0 2024-04-25T02:27:03.870 INFO:tasks.workunit.client.0.smithi114.stdout:2/136: unlink d5/d6/f20 0 2024-04-25T02:27:03.871 INFO:tasks.workunit.client.0.smithi114.stdout:7/123: getdents d5/d19/d23 0 2024-04-25T02:27:03.872 INFO:tasks.workunit.client.0.smithi114.stdout:0/134: mknod d1/d7/d18/c21 0 2024-04-25T02:27:03.872 INFO:tasks.workunit.client.0.smithi114.stdout:1/98: dwrite df/d11/f24 [0,4194304] 0 2024-04-25T02:27:03.873 INFO:tasks.workunit.client.0.smithi114.stdout:2/137: chown d5/df/d2c/l2f 840617 1 2024-04-25T02:27:03.874 INFO:tasks.workunit.client.0.smithi114.stdout:4/76: dwrite d3/f5 [0,4194304] 0 2024-04-25T02:27:03.874 INFO:tasks.workunit.client.0.smithi114.stdout:5/94: creat d1/d6/de/d16/f1f x:0 0 0 2024-04-25T02:27:03.879 INFO:tasks.workunit.client.0.smithi114.stdout:1/99: readlink df/l12 0 2024-04-25T02:27:03.880 INFO:tasks.workunit.client.0.smithi114.stdout:2/138: fsync f2 0 2024-04-25T02:27:03.880 INFO:tasks.workunit.client.0.smithi114.stdout:2/139: write d5/d1c/d22/f24 [507374,53893] 0 2024-04-25T02:27:03.881 INFO:tasks.workunit.client.0.smithi114.stdout:0/135: creat d1/d7/d18/f22 x:0 0 0 2024-04-25T02:27:03.885 INFO:tasks.workunit.client.0.smithi114.stdout:8/127: symlink da/l23 0 2024-04-25T02:27:03.885 INFO:tasks.workunit.client.0.smithi114.stdout:5/95: mknod d1/d6/c20 0 2024-04-25T02:27:03.886 INFO:tasks.workunit.client.0.smithi114.stdout:9/94: getdents d8 0 2024-04-25T02:27:03.887 INFO:tasks.workunit.client.0.smithi114.stdout:1/100: creat df/f29 x:0 0 0 2024-04-25T02:27:03.887 INFO:tasks.workunit.client.0.smithi114.stdout:9/95: chown d8/l12 58 1 2024-04-25T02:27:03.887 INFO:tasks.workunit.client.0.smithi114.stdout:8/128: truncate da/d1d/f1f 1581824 0 2024-04-25T02:27:03.888 INFO:tasks.workunit.client.0.smithi114.stdout:4/77: mknod d3/c15 0 2024-04-25T02:27:03.888 INFO:tasks.workunit.client.0.smithi114.stdout:1/101: stat df/l1d 0 2024-04-25T02:27:03.889 INFO:tasks.workunit.client.0.smithi114.stdout:2/140: dread d5/fd [0,4194304] 0 2024-04-25T02:27:03.889 INFO:tasks.workunit.client.0.smithi114.stdout:4/78: fsync d3/d8/ff 0 2024-04-25T02:27:03.889 INFO:tasks.workunit.client.0.smithi114.stdout:0/136: symlink d1/l23 0 2024-04-25T02:27:03.890 INFO:tasks.workunit.client.0.smithi114.stdout:2/141: write d5/f15 [2164971,87524] 0 2024-04-25T02:27:03.891 INFO:tasks.workunit.client.0.smithi114.stdout:9/96: creat d8/f20 x:0 0 0 2024-04-25T02:27:03.892 INFO:tasks.workunit.client.0.smithi114.stdout:1/102: mkdir df/d2a 0 2024-04-25T02:27:03.893 INFO:tasks.workunit.client.0.smithi114.stdout:8/129: dread da/d14/f15 [0,4194304] 0 2024-04-25T02:27:03.894 INFO:tasks.workunit.client.0.smithi114.stdout:0/137: rmdir d1/d4/da 39 2024-04-25T02:27:03.895 INFO:tasks.workunit.client.0.smithi114.stdout:5/96: truncate d1/d6/de/f11 1427627 0 2024-04-25T02:27:03.896 INFO:tasks.workunit.client.0.smithi114.stdout:2/142: symlink d5/df/d1e/l33 0 2024-04-25T02:27:03.896 INFO:tasks.workunit.client.0.smithi114.stdout:1/103: dread fe [0,4194304] 0 2024-04-25T02:27:03.910 INFO:tasks.workunit.client.0.smithi114.stdout:8/130: symlink da/d1d/l24 0 2024-04-25T02:27:03.910 INFO:tasks.workunit.client.0.smithi114.stdout:1/104: chown l2 10451936 1 2024-04-25T02:27:03.912 INFO:tasks.workunit.client.0.smithi114.stdout:6/166: truncate de/f19 1049574 0 2024-04-25T02:27:03.914 INFO:tasks.workunit.client.0.smithi114.stdout:7/124: truncate d5/f9 2391554 0 2024-04-25T02:27:03.915 INFO:tasks.workunit.client.0.smithi114.stdout:8/131: symlink da/d1d/l25 0 2024-04-25T02:27:03.917 INFO:tasks.workunit.client.0.smithi114.stdout:5/97: rmdir d1/d6/de 39 2024-04-25T02:27:03.918 INFO:tasks.workunit.client.0.smithi114.stdout:8/132: write f3 [5607113,127319] 0 2024-04-25T02:27:03.919 INFO:tasks.workunit.client.0.smithi114.stdout:0/138: mkdir d1/d4/d24 0 2024-04-25T02:27:03.919 INFO:tasks.workunit.client.0.smithi114.stdout:2/143: dwrite d5/df/d1e/f1f [0,4194304] 0 2024-04-25T02:27:03.920 INFO:tasks.workunit.client.0.smithi114.stdout:7/125: creat d5/d19/f2c x:0 0 0 2024-04-25T02:27:03.920 INFO:tasks.workunit.client.0.smithi114.stdout:6/167: mkdir de/d25/d39/d47 0 2024-04-25T02:27:03.921 INFO:tasks.workunit.client.0.smithi114.stdout:5/98: symlink d1/l21 0 2024-04-25T02:27:03.922 INFO:tasks.workunit.client.0.smithi114.stdout:3/95: dwrite d0/f4 [0,4194304] 0 2024-04-25T02:27:03.922 INFO:tasks.workunit.client.0.smithi114.stdout:0/139: chown d1/d7/d18/f1d 58767 1 2024-04-25T02:27:03.924 INFO:tasks.workunit.client.0.smithi114.stdout:0/140: chown d1/d7/fd 1027724 1 2024-04-25T02:27:03.924 INFO:tasks.workunit.client.0.smithi114.stdout:2/144: symlink d5/d1c/l34 0 2024-04-25T02:27:03.927 INFO:tasks.workunit.client.0.smithi114.stdout:2/145: write d5/fe [4362065,92540] 0 2024-04-25T02:27:03.932 INFO:tasks.workunit.client.0.smithi114.stdout:7/126: link d5/d19/d23/l26 d5/l2d 0 2024-04-25T02:27:03.932 INFO:tasks.workunit.client.0.smithi114.stdout:8/133: dwrite da/d1d/f1f [0,4194304] 0 2024-04-25T02:27:03.935 INFO:tasks.workunit.client.0.smithi114.stdout:5/99: dread d1/d6/de/f1d [0,4194304] 0 2024-04-25T02:27:03.935 INFO:tasks.workunit.client.0.smithi114.stdout:2/146: symlink d5/df/d1e/l35 0 2024-04-25T02:27:03.935 INFO:tasks.workunit.client.0.smithi114.stdout:6/168: dwrite de/f1b [0,4194304] 0 2024-04-25T02:27:03.937 INFO:tasks.workunit.client.0.smithi114.stdout:8/134: mknod da/d1e/c26 0 2024-04-25T02:27:03.937 INFO:tasks.workunit.client.0.smithi114.stdout:8/135: truncate f3 6453192 0 2024-04-25T02:27:03.938 INFO:tasks.workunit.client.0.smithi114.stdout:7/127: dread d5/f6 [0,4194304] 0 2024-04-25T02:27:03.939 INFO:tasks.workunit.client.0.smithi114.stdout:5/100: mknod d1/c22 0 2024-04-25T02:27:03.939 INFO:tasks.workunit.client.0.smithi114.stdout:7/128: dread - d5/d19/f27 zero size 2024-04-25T02:27:03.939 INFO:tasks.workunit.client.0.smithi114.stdout:2/147: dread d5/df/f18 [0,4194304] 0 2024-04-25T02:27:03.939 INFO:tasks.workunit.client.0.smithi114.stdout:2/148: rename d5/d1c to d5/d1c/d36 22 2024-04-25T02:27:03.944 INFO:tasks.workunit.client.0.smithi114.stdout:6/169: rmdir de/d27/d34 39 2024-04-25T02:27:03.949 INFO:tasks.workunit.client.0.smithi114.stdout:5/101: symlink d1/d6/de/d16/l23 0 2024-04-25T02:27:03.950 INFO:tasks.workunit.client.0.smithi114.stdout:5/102: read - d1/d6/de/f1e zero size 2024-04-25T02:27:03.950 INFO:tasks.workunit.client.0.smithi114.stdout:3/96: write d0/f12 [654207,19294] 0 2024-04-25T02:27:03.951 INFO:tasks.workunit.client.0.smithi114.stdout:7/129: mknod d5/d1e/c2e 0 2024-04-25T02:27:03.951 INFO:tasks.workunit.client.0.smithi114.stdout:6/170: dread de/d25/f3c [0,4194304] 0 2024-04-25T02:27:03.952 INFO:tasks.workunit.client.0.smithi114.stdout:0/141: creat d1/d4/d24/f25 x:0 0 0 2024-04-25T02:27:03.953 INFO:tasks.workunit.client.0.smithi114.stdout:8/136: creat da/f27 x:0 0 0 2024-04-25T02:27:03.954 INFO:tasks.workunit.client.0.smithi114.stdout:7/130: creat d5/d1e/f2f x:0 0 0 2024-04-25T02:27:03.954 INFO:tasks.workunit.client.0.smithi114.stdout:3/97: dread d0/f1d [0,4194304] 0 2024-04-25T02:27:03.955 INFO:tasks.workunit.client.0.smithi114.stdout:6/171: write de/d27/d34/f40 [632801,47228] 0 2024-04-25T02:27:03.957 INFO:tasks.workunit.client.0.smithi114.stdout:0/142: symlink d1/d4/d24/l26 0 2024-04-25T02:27:03.958 INFO:tasks.workunit.client.0.smithi114.stdout:7/131: mknod d5/c30 0 2024-04-25T02:27:03.958 INFO:tasks.workunit.client.0.smithi114.stdout:3/98: rmdir d0/d5 39 2024-04-25T02:27:03.962 INFO:tasks.workunit.client.0.smithi114.stdout:8/137: creat da/f28 x:0 0 0 2024-04-25T02:27:03.962 INFO:tasks.workunit.client.0.smithi114.stdout:3/99: unlink d0/f4 0 2024-04-25T02:27:03.963 INFO:tasks.workunit.client.0.smithi114.stdout:4/79: sync 2024-04-25T02:27:03.963 INFO:tasks.workunit.client.0.smithi114.stdout:9/97: sync 2024-04-25T02:27:03.964 INFO:tasks.workunit.client.0.smithi114.stdout:6/172: dwrite de/ff [0,4194304] 0 2024-04-25T02:27:03.964 INFO:tasks.workunit.client.0.smithi114.stdout:9/98: chown d8 256400 1 2024-04-25T02:27:03.965 INFO:tasks.workunit.client.0.smithi114.stdout:9/99: fdatasync d8/f17 0 2024-04-25T02:27:03.966 INFO:tasks.workunit.client.0.smithi114.stdout:6/173: dread - de/d25/f3e zero size 2024-04-25T02:27:03.966 INFO:tasks.workunit.client.0.smithi114.stdout:8/138: creat da/d1e/f29 x:0 0 0 2024-04-25T02:27:03.967 INFO:tasks.workunit.client.0.smithi114.stdout:6/174: readlink l2 0 2024-04-25T02:27:03.967 INFO:tasks.workunit.client.0.smithi114.stdout:3/100: fdatasync d0/f3 0 2024-04-25T02:27:03.967 INFO:tasks.workunit.client.0.smithi114.stdout:0/143: dwrite d1/d7/fd [0,4194304] 0 2024-04-25T02:27:03.968 INFO:tasks.workunit.client.0.smithi114.stdout:9/100: mkdir d8/d16/d21 0 2024-04-25T02:27:03.970 INFO:tasks.workunit.client.0.smithi114.stdout:6/175: fsync de/f1f 0 2024-04-25T02:27:03.970 INFO:tasks.workunit.client.0.smithi114.stdout:3/101: stat d0/f1d 0 2024-04-25T02:27:03.971 INFO:tasks.workunit.client.0.smithi114.stdout:8/139: creat da/d16/f2a x:0 0 0 2024-04-25T02:27:03.971 INFO:tasks.workunit.client.0.smithi114.stdout:6/176: dread - de/f18 zero size 2024-04-25T02:27:03.972 INFO:tasks.workunit.client.0.smithi114.stdout:9/101: write d8/f20 [107993,83815] 0 2024-04-25T02:27:03.974 INFO:tasks.workunit.client.0.smithi114.stdout:4/80: dwrite d3/d8/f11 [0,4194304] 0 2024-04-25T02:27:03.976 INFO:tasks.workunit.client.0.smithi114.stdout:4/81: fsync d3/d8/f9 0 2024-04-25T02:27:03.979 INFO:tasks.workunit.client.0.smithi114.stdout:6/177: dwrite de/f1b [0,4194304] 0 2024-04-25T02:27:03.981 INFO:tasks.workunit.client.0.smithi114.stdout:9/102: rename d8/d18/f1b to d8/d16/d21/f22 0 2024-04-25T02:27:03.984 INFO:tasks.workunit.client.0.smithi114.stdout:3/102: unlink d0/d5/f13 0 2024-04-25T02:27:03.984 INFO:tasks.workunit.client.0.smithi114.stdout:7/132: fsync d5/d1e/f2f 0 2024-04-25T02:27:03.985 INFO:tasks.workunit.client.0.smithi114.stdout:1/105: sync 2024-04-25T02:27:03.988 INFO:tasks.workunit.client.0.smithi114.stdout:5/103: truncate d1/d6/de/f1d 835779 0 2024-04-25T02:27:03.988 INFO:tasks.workunit.client.0.smithi114.stdout:0/144: creat d1/f27 x:0 0 0 2024-04-25T02:27:03.989 INFO:tasks.workunit.client.0.smithi114.stdout:4/82: fsync d3/fa 0 2024-04-25T02:27:03.990 INFO:tasks.workunit.client.0.smithi114.stdout:3/103: dwrite d0/f16 [0,4194304] 0 2024-04-25T02:27:03.991 INFO:tasks.workunit.client.0.smithi114.stdout:4/83: fsync d3/d8/f9 0 2024-04-25T02:27:03.992 INFO:tasks.workunit.client.0.smithi114.stdout:6/178: creat de/d27/d34/f48 x:0 0 0 2024-04-25T02:27:03.992 INFO:tasks.workunit.client.0.smithi114.stdout:6/179: chown de/d1c 4099805 1 2024-04-25T02:27:03.993 INFO:tasks.workunit.client.0.smithi114.stdout:9/103: rename f7 to d8/d18/f23 0 2024-04-25T02:27:03.996 INFO:tasks.workunit.client.0.smithi114.stdout:7/133: stat d5/d19/d1a/c1b 0 2024-04-25T02:27:03.996 INFO:tasks.workunit.client.0.smithi114.stdout:5/104: dwrite d1/d6/f17 [0,4194304] 0 2024-04-25T02:27:03.997 INFO:tasks.workunit.client.0.smithi114.stdout:1/106: mkdir df/d11/d25/d2b 0 2024-04-25T02:27:03.998 INFO:tasks.workunit.client.0.smithi114.stdout:5/105: write d1/d6/f17 [3779094,8455] 0 2024-04-25T02:27:04.001 INFO:tasks.workunit.client.0.smithi114.stdout:8/140: link da/d16/c18 da/d1e/c2b 0 2024-04-25T02:27:04.001 INFO:tasks.workunit.client.0.smithi114.stdout:6/180: dwrite de/d30/f43 [0,4194304] 0 2024-04-25T02:27:04.002 INFO:tasks.workunit.client.0.smithi114.stdout:8/141: dread - da/f28 zero size 2024-04-25T02:27:04.003 INFO:tasks.workunit.client.0.smithi114.stdout:8/142: dread - da/f12 zero size 2024-04-25T02:27:04.003 INFO:tasks.workunit.client.0.smithi114.stdout:8/143: chown da/d1e/c26 125 1 2024-04-25T02:27:04.004 INFO:tasks.workunit.client.0.smithi114.stdout:5/106: dread d1/d6/f17 [0,4194304] 0 2024-04-25T02:27:04.006 INFO:tasks.workunit.client.0.smithi114.stdout:4/84: unlink d3/d8/d12/cc 0 2024-04-25T02:27:04.007 INFO:tasks.workunit.client.0.smithi114.stdout:9/104: stat d8/cc 0 2024-04-25T02:27:04.009 INFO:tasks.workunit.client.0.smithi114.stdout:6/181: dwrite de/d2a/f3a [0,4194304] 0 2024-04-25T02:27:04.015 INFO:tasks.workunit.client.0.smithi114.stdout:8/144: creat da/d14/f2c x:0 0 0 2024-04-25T02:27:04.015 INFO:tasks.workunit.client.0.smithi114.stdout:9/105: dwrite d8/f11 [0,4194304] 0 2024-04-25T02:27:04.016 INFO:tasks.workunit.client.0.smithi114.stdout:5/107: mkdir d1/d6/de/d16/d24 0 2024-04-25T02:27:04.016 INFO:tasks.workunit.client.0.smithi114.stdout:9/106: read - d8/f1f zero size 2024-04-25T02:27:04.017 INFO:tasks.workunit.client.0.smithi114.stdout:8/145: truncate da/d16/f2a 824752 0 2024-04-25T02:27:04.017 INFO:tasks.workunit.client.0.smithi114.stdout:8/146: stat da/d16 0 2024-04-25T02:27:04.017 INFO:tasks.workunit.client.0.smithi114.stdout:4/85: fsync d3/d8/d12/fd 0 2024-04-25T02:27:04.018 INFO:tasks.workunit.client.0.smithi114.stdout:5/108: truncate d1/d6/de/d16/f1f 490067 0 2024-04-25T02:27:04.019 INFO:tasks.workunit.client.0.smithi114.stdout:7/134: link d5/d19/f2b d5/d1e/f31 0 2024-04-25T02:27:04.019 INFO:tasks.workunit.client.0.smithi114.stdout:7/135: readlink d5/l7 0 2024-04-25T02:27:04.020 INFO:tasks.workunit.client.0.smithi114.stdout:1/107: mknod df/d2a/c2c 0 2024-04-25T02:27:04.022 INFO:tasks.workunit.client.0.smithi114.stdout:9/107: fdatasync d8/d16/d21/f22 0 2024-04-25T02:27:04.022 INFO:tasks.workunit.client.0.smithi114.stdout:8/147: chown da/c10 336762 1 2024-04-25T02:27:04.025 INFO:tasks.workunit.client.0.smithi114.stdout:2/149: sync 2024-04-25T02:27:04.027 INFO:tasks.workunit.client.0.smithi114.stdout:9/108: mkdir d8/d16/d21/d24 0 2024-04-25T02:27:04.028 INFO:tasks.workunit.client.0.smithi114.stdout:9/109: write f2 [549504,61736] 0 2024-04-25T02:27:04.029 INFO:tasks.workunit.client.0.smithi114.stdout:8/148: unlink da/ld 0 2024-04-25T02:27:04.030 INFO:tasks.workunit.client.0.smithi114.stdout:2/150: creat d5/d6/d31/f37 x:0 0 0 2024-04-25T02:27:04.034 INFO:tasks.workunit.client.0.smithi114.stdout:9/110: symlink d8/d16/d21/l25 0 2024-04-25T02:27:04.037 INFO:tasks.workunit.client.0.smithi114.stdout:9/111: creat d8/d16/d21/f26 x:0 0 0 2024-04-25T02:27:04.038 INFO:tasks.workunit.client.0.smithi114.stdout:1/108: getdents df/d13/d1e 0 2024-04-25T02:27:04.038 INFO:tasks.workunit.client.0.smithi114.stdout:9/112: stat l4 0 2024-04-25T02:27:04.038 INFO:tasks.workunit.client.0.smithi114.stdout:1/109: chown df/d11/d25/f27 192340 1 2024-04-25T02:27:04.041 INFO:tasks.workunit.client.0.smithi114.stdout:0/145: getdents d1 0 2024-04-25T02:27:04.042 INFO:tasks.workunit.client.0.smithi114.stdout:4/86: write d3/d8/d12/fd [903069,49214] 0 2024-04-25T02:27:04.042 INFO:tasks.workunit.client.0.smithi114.stdout:0/146: readlink d1/l17 0 2024-04-25T02:27:04.043 INFO:tasks.workunit.client.0.smithi114.stdout:4/87: fsync d3/d8/f11 0 2024-04-25T02:27:04.043 INFO:tasks.workunit.client.0.smithi114.stdout:4/88: readlink d3/le 0 2024-04-25T02:27:04.043 INFO:tasks.workunit.client.0.smithi114.stdout:0/147: read d1/d7/d18/f1f [8365987,17886] 0 2024-04-25T02:27:04.044 INFO:tasks.workunit.client.0.smithi114.stdout:9/113: link d8/f20 d8/d16/f27 0 2024-04-25T02:27:04.049 INFO:tasks.workunit.client.0.smithi114.stdout:9/114: creat d8/d16/f28 x:0 0 0 2024-04-25T02:27:04.050 INFO:tasks.workunit.client.0.smithi114.stdout:9/115: fsync d8/d16/d21/f22 0 2024-04-25T02:27:04.054 INFO:tasks.workunit.client.0.smithi114.stdout:0/148: truncate d1/d4/f15 1177488 0 2024-04-25T02:27:04.056 INFO:tasks.workunit.client.0.smithi114.stdout:3/104: creat d0/f21 x:0 0 0 2024-04-25T02:27:04.057 INFO:tasks.workunit.client.0.smithi114.stdout:4/89: getdents d3 0 2024-04-25T02:27:04.058 INFO:tasks.workunit.client.0.smithi114.stdout:9/116: mknod d8/d16/d21/d24/c29 0 2024-04-25T02:27:04.058 INFO:tasks.workunit.client.0.smithi114.stdout:9/117: fsync d8/fb 0 2024-04-25T02:27:04.059 INFO:tasks.workunit.client.0.smithi114.stdout:5/109: rename d1/d6/de/d16 to d1/d25 0 2024-04-25T02:27:04.060 INFO:tasks.workunit.client.0.smithi114.stdout:0/149: chown d1/d4/da 1598 1 2024-04-25T02:27:04.060 INFO:tasks.workunit.client.0.smithi114.stdout:0/150: chown d1/d4/da/f16 6 1 2024-04-25T02:27:04.061 INFO:tasks.workunit.client.0.smithi114.stdout:0/151: write d1/d7/d18/f22 [537098,39434] 0 2024-04-25T02:27:04.062 INFO:tasks.workunit.client.0.smithi114.stdout:0/152: chown d1/d4/f15 213332 1 2024-04-25T02:27:04.064 INFO:tasks.workunit.client.0.smithi114.stdout:5/110: creat d1/d25/f26 x:0 0 0 2024-04-25T02:27:04.064 INFO:tasks.workunit.client.0.smithi114.stdout:6/182: write de/d2a/f2b [4459922,120889] 0 2024-04-25T02:27:04.065 INFO:tasks.workunit.client.0.smithi114.stdout:4/90: rename d3/d8/d12/fd to d3/f16 0 2024-04-25T02:27:04.067 INFO:tasks.workunit.client.0.smithi114.stdout:0/153: write d1/d4/f1b [624432,91561] 0 2024-04-25T02:27:04.068 INFO:tasks.workunit.client.0.smithi114.stdout:8/149: sync 2024-04-25T02:27:04.068 INFO:tasks.workunit.client.0.smithi114.stdout:8/150: chown da/ff 666 1 2024-04-25T02:27:04.070 INFO:tasks.workunit.client.0.smithi114.stdout:9/118: rename d8/c15 to d8/d16/d21/c2a 0 2024-04-25T02:27:04.072 INFO:tasks.workunit.client.0.smithi114.stdout:7/136: dwrite d5/d19/f27 [0,4194304] 0 2024-04-25T02:27:04.072 INFO:tasks.workunit.client.0.smithi114.stdout:9/119: read d8/f17 [142782,83525] 0 2024-04-25T02:27:04.073 INFO:tasks.workunit.client.0.smithi114.stdout:9/120: truncate d8/f1d 294493 0 2024-04-25T02:27:04.075 INFO:tasks.workunit.client.0.smithi114.stdout:2/151: truncate d5/df/f14 189990 0 2024-04-25T02:27:04.076 INFO:tasks.workunit.client.0.smithi114.stdout:0/154: creat d1/d7/f28 x:0 0 0 2024-04-25T02:27:04.077 INFO:tasks.workunit.client.0.smithi114.stdout:8/151: fdatasync da/d14/f15 0 2024-04-25T02:27:04.078 INFO:tasks.workunit.client.0.smithi114.stdout:8/152: truncate da/d1e/f29 17994 0 2024-04-25T02:27:04.081 INFO:tasks.workunit.client.0.smithi114.stdout:9/121: mknod d8/d16/d21/d24/c2b 0 2024-04-25T02:27:04.082 INFO:tasks.workunit.client.0.smithi114.stdout:2/152: creat d5/df/d1e/f38 x:0 0 0 2024-04-25T02:27:04.082 INFO:tasks.workunit.client.0.smithi114.stdout:0/155: creat d1/d4/d24/f29 x:0 0 0 2024-04-25T02:27:04.083 INFO:tasks.workunit.client.0.smithi114.stdout:2/153: write d5/f15 [1298895,16555] 0 2024-04-25T02:27:04.087 INFO:tasks.workunit.client.0.smithi114.stdout:1/110: dwrite f4 [4194304,4194304] 0 2024-04-25T02:27:04.088 INFO:tasks.workunit.client.0.smithi114.stdout:1/111: stat l7 0 2024-04-25T02:27:04.089 INFO:tasks.workunit.client.0.smithi114.stdout:9/122: creat d8/d16/f2c x:0 0 0 2024-04-25T02:27:04.092 INFO:tasks.workunit.client.0.smithi114.stdout:0/156: dwrite d1/d7/d18/f22 [0,4194304] 0 2024-04-25T02:27:04.092 INFO:tasks.workunit.client.0.smithi114.stdout:2/154: dread d5/df/f18 [0,4194304] 0 2024-04-25T02:27:04.093 INFO:tasks.workunit.client.0.smithi114.stdout:2/155: chown d5/df/d2c 920551546 1 2024-04-25T02:27:04.098 INFO:tasks.workunit.client.0.smithi114.stdout:5/111: truncate d1/d25/f1f 52596 0 2024-04-25T02:27:04.099 INFO:tasks.workunit.client.0.smithi114.stdout:5/112: read d1/d6/f19 [1742054,107739] 0 2024-04-25T02:27:04.100 INFO:tasks.workunit.client.0.smithi114.stdout:6/183: truncate f5 3114204 0 2024-04-25T02:27:04.100 INFO:tasks.workunit.client.0.smithi114.stdout:5/113: chown d1/d25/f26 3381 1 2024-04-25T02:27:04.102 INFO:tasks.workunit.client.0.smithi114.stdout:1/112: mknod df/d13/c2d 0 2024-04-25T02:27:04.102 INFO:tasks.workunit.client.0.smithi114.stdout:9/123: chown d8/d16/d21/c2a 0 1 2024-04-25T02:27:04.104 INFO:tasks.workunit.client.0.smithi114.stdout:2/156: rmdir d5/d6 39 2024-04-25T02:27:04.108 INFO:tasks.workunit.client.0.smithi114.stdout:6/184: dread de/f16 [0,4194304] 0 2024-04-25T02:27:04.109 INFO:tasks.workunit.client.0.smithi114.stdout:6/185: dread - de/d27/f3f zero size 2024-04-25T02:27:04.109 INFO:tasks.workunit.client.0.smithi114.stdout:1/113: creat df/d2a/f2e x:0 0 0 2024-04-25T02:27:04.109 INFO:tasks.workunit.client.0.smithi114.stdout:7/137: truncate d5/d19/f27 859042 0 2024-04-25T02:27:04.110 INFO:tasks.workunit.client.0.smithi114.stdout:2/157: dread d5/f15 [0,4194304] 0 2024-04-25T02:27:04.114 INFO:tasks.workunit.client.0.smithi114.stdout:5/114: creat d1/d25/d24/f27 x:0 0 0 2024-04-25T02:27:04.114 INFO:tasks.workunit.client.0.smithi114.stdout:2/158: dread d5/df/f11 [0,4194304] 0 2024-04-25T02:27:04.115 INFO:tasks.workunit.client.0.smithi114.stdout:7/138: dread d5/d19/f1d [0,4194304] 0 2024-04-25T02:27:04.116 INFO:tasks.workunit.client.0.smithi114.stdout:7/139: chown d5/fb 0 1 2024-04-25T02:27:04.116 INFO:tasks.workunit.client.0.smithi114.stdout:7/140: stat d5/d19/f2b 0 2024-04-25T02:27:04.116 INFO:tasks.workunit.client.0.smithi114.stdout:6/186: rename de/f12 to de/d30/f49 0 2024-04-25T02:27:04.116 INFO:tasks.workunit.client.0.smithi114.stdout:6/187: fsync de/f18 0 2024-04-25T02:27:04.117 INFO:tasks.workunit.client.0.smithi114.stdout:6/188: chown de/d30/f37 323 1 2024-04-25T02:27:04.118 INFO:tasks.workunit.client.0.smithi114.stdout:6/189: truncate de/d27/f3f 834868 0 2024-04-25T02:27:04.118 INFO:tasks.workunit.client.0.smithi114.stdout:8/153: truncate da/d1d/f1f 3108348 0 2024-04-25T02:27:04.120 INFO:tasks.workunit.client.0.smithi114.stdout:4/91: getdents d3/d14 0 2024-04-25T02:27:04.125 INFO:tasks.workunit.client.0.smithi114.stdout:5/115: creat d1/d25/f28 x:0 0 0 2024-04-25T02:27:04.126 INFO:tasks.workunit.client.0.smithi114.stdout:7/141: rename d5/d1e to d5/d32 0 2024-04-25T02:27:04.128 INFO:tasks.workunit.client.0.smithi114.stdout:1/114: rename df/l1d to df/d11/d25/d2b/l2f 0 2024-04-25T02:27:04.132 INFO:tasks.workunit.client.0.smithi114.stdout:3/105: symlink d0/l22 0 2024-04-25T02:27:04.132 INFO:tasks.workunit.client.0.smithi114.stdout:6/190: creat de/d30/f4a x:0 0 0 2024-04-25T02:27:04.135 INFO:tasks.workunit.client.0.smithi114.stdout:9/124: getdents d8/d16/d21 0 2024-04-25T02:27:04.135 INFO:tasks.workunit.client.0.smithi114.stdout:9/125: fdatasync d8/fa 0 2024-04-25T02:27:04.136 INFO:tasks.workunit.client.0.smithi114.stdout:2/159: symlink d5/l39 0 2024-04-25T02:27:04.136 INFO:tasks.workunit.client.0.smithi114.stdout:2/160: write d5/f2e [275453,4435] 0 2024-04-25T02:27:04.137 INFO:tasks.workunit.client.0.smithi114.stdout:7/142: rename d5/fb to d5/f33 0 2024-04-25T02:27:04.138 INFO:tasks.workunit.client.0.smithi114.stdout:7/143: truncate d5/f6 4536040 0 2024-04-25T02:27:04.139 INFO:tasks.workunit.client.0.smithi114.stdout:7/144: dread - d5/d32/f31 zero size 2024-04-25T02:27:04.140 INFO:tasks.workunit.client.0.smithi114.stdout:1/115: creat df/d13/d1e/f30 x:0 0 0 2024-04-25T02:27:04.140 INFO:tasks.workunit.client.0.smithi114.stdout:1/116: chown df/d11/d25/d2b 1021843 1 2024-04-25T02:27:04.145 INFO:tasks.workunit.client.0.smithi114.stdout:5/116: mknod d1/d6/c29 0 2024-04-25T02:27:04.145 INFO:tasks.workunit.client.0.smithi114.stdout:5/117: readlink d1/l9 0 2024-04-25T02:27:04.146 INFO:tasks.workunit.client.0.smithi114.stdout:2/161: chown d5/d6/d31 115 1 2024-04-25T02:27:04.147 INFO:tasks.workunit.client.0.smithi114.stdout:2/162: fsync d5/d1c/d22/f24 0 2024-04-25T02:27:04.147 INFO:tasks.workunit.client.0.smithi114.stdout:2/163: truncate d5/df/d1e/f26 673958 0 2024-04-25T02:27:04.149 INFO:tasks.workunit.client.0.smithi114.stdout:7/145: creat d5/d19/f34 x:0 0 0 2024-04-25T02:27:04.150 INFO:tasks.workunit.client.0.smithi114.stdout:1/117: rmdir df/d11/d25/d2b 39 2024-04-25T02:27:04.150 INFO:tasks.workunit.client.0.smithi114.stdout:1/118: chown c6 11154 1 2024-04-25T02:27:04.151 INFO:tasks.workunit.client.0.smithi114.stdout:4/92: creat d3/f17 x:0 0 0 2024-04-25T02:27:04.153 INFO:tasks.workunit.client.0.smithi114.stdout:5/118: rmdir d1/d6/d1a 39 2024-04-25T02:27:04.153 INFO:tasks.workunit.client.0.smithi114.stdout:8/154: dwrite da/d14/f15 [0,4194304] 0 2024-04-25T02:27:04.154 INFO:tasks.workunit.client.0.smithi114.stdout:3/106: write d0/f12 [366876,32732] 0 2024-04-25T02:27:04.155 INFO:tasks.workunit.client.0.smithi114.stdout:2/164: symlink d5/d1c/l3a 0 2024-04-25T02:27:04.157 INFO:tasks.workunit.client.0.smithi114.stdout:1/119: symlink df/l31 0 2024-04-25T02:27:04.158 INFO:tasks.workunit.client.0.smithi114.stdout:9/126: link d8/cc d8/d18/c2d 0 2024-04-25T02:27:04.158 INFO:tasks.workunit.client.0.smithi114.stdout:0/157: sync 2024-04-25T02:27:04.159 INFO:tasks.workunit.client.0.smithi114.stdout:9/127: stat d8/f1f 0 2024-04-25T02:27:04.161 INFO:tasks.workunit.client.0.smithi114.stdout:2/165: rename d5/df/d1e/l35 to d5/d6/d31/l3b 0 2024-04-25T02:27:04.162 INFO:tasks.workunit.client.0.smithi114.stdout:3/107: truncate d0/f21 711021 0 2024-04-25T02:27:04.163 INFO:tasks.workunit.client.0.smithi114.stdout:8/155: dwrite da/f12 [0,4194304] 0 2024-04-25T02:27:04.166 INFO:tasks.workunit.client.0.smithi114.stdout:4/93: creat d3/d8/d12/f18 x:0 0 0 2024-04-25T02:27:04.166 INFO:tasks.workunit.client.0.smithi114.stdout:7/146: dwrite d5/f18 [0,4194304] 0 2024-04-25T02:27:04.166 INFO:tasks.workunit.client.0.smithi114.stdout:5/119: unlink d1/d6/de/f11 0 2024-04-25T02:27:04.169 INFO:tasks.workunit.client.0.smithi114.stdout:8/156: mknod da/d1e/c2d 0 2024-04-25T02:27:04.169 INFO:tasks.workunit.client.0.smithi114.stdout:0/158: write d1/d7/d18/f1f [3484208,79461] 0 2024-04-25T02:27:04.169 INFO:tasks.workunit.client.0.smithi114.stdout:5/120: chown d1/d6/de/f1e 2340917 1 2024-04-25T02:27:04.170 INFO:tasks.workunit.client.0.smithi114.stdout:9/128: dwrite d8/f1d [0,4194304] 0 2024-04-25T02:27:04.170 INFO:tasks.workunit.client.0.smithi114.stdout:7/147: mknod d5/c35 0 2024-04-25T02:27:04.171 INFO:tasks.workunit.client.0.smithi114.stdout:5/121: fdatasync d1/d25/f28 0 2024-04-25T02:27:04.171 INFO:tasks.workunit.client.0.smithi114.stdout:4/94: mkdir d3/d8/d12/d19 0 2024-04-25T02:27:04.172 INFO:tasks.workunit.client.0.smithi114.stdout:4/95: dread - d3/f17 zero size 2024-04-25T02:27:04.173 INFO:tasks.workunit.client.0.smithi114.stdout:5/122: write d1/d25/f28 [392617,45958] 0 2024-04-25T02:27:04.173 INFO:tasks.workunit.client.0.smithi114.stdout:2/166: mkdir d5/d3c 0 2024-04-25T02:27:04.176 INFO:tasks.workunit.client.0.smithi114.stdout:8/157: creat da/d1e/f2e x:0 0 0 2024-04-25T02:27:04.178 INFO:tasks.workunit.client.0.smithi114.stdout:7/148: creat d5/d19/d1a/f36 x:0 0 0 2024-04-25T02:27:04.180 INFO:tasks.workunit.client.0.smithi114.stdout:9/129: rename d8/c14 to d8/d16/c2e 0 2024-04-25T02:27:04.182 INFO:tasks.workunit.client.0.smithi114.stdout:1/120: rmdir df 39 2024-04-25T02:27:04.184 INFO:tasks.workunit.client.0.smithi114.stdout:2/167: dread d5/df/f14 [0,4194304] 0 2024-04-25T02:27:04.184 INFO:tasks.workunit.client.0.smithi114.stdout:2/168: chown d5/df/d1e/f1f 1982325 1 2024-04-25T02:27:04.184 INFO:tasks.workunit.client.0.smithi114.stdout:3/108: link d0/d5/f1e d0/d5/f23 0 2024-04-25T02:27:04.185 INFO:tasks.workunit.client.0.smithi114.stdout:6/191: sync 2024-04-25T02:27:04.188 INFO:tasks.workunit.client.0.smithi114.stdout:9/130: mkdir d8/d16/d2f 0 2024-04-25T02:27:04.190 INFO:tasks.workunit.client.0.smithi114.stdout:1/121: chown df/d13/c2d 25525844 1 2024-04-25T02:27:04.191 INFO:tasks.workunit.client.0.smithi114.stdout:9/131: dread d8/f10 [0,4194304] 0 2024-04-25T02:27:04.192 INFO:tasks.workunit.client.0.smithi114.stdout:0/159: link d1/d4/f19 d1/d4/da/f2a 0 2024-04-25T02:27:04.193 INFO:tasks.workunit.client.0.smithi114.stdout:6/192: mkdir de/d27/d34/d4b 0 2024-04-25T02:27:04.197 INFO:tasks.workunit.client.0.smithi114.stdout:4/96: link d3/f5 d3/d8/d12/d19/f1a 0 2024-04-25T02:27:04.199 INFO:tasks.workunit.client.0.smithi114.stdout:9/132: creat d8/d16/d21/f30 x:0 0 0 2024-04-25T02:27:04.202 INFO:tasks.workunit.client.0.smithi114.stdout:6/193: symlink de/d2a/l4c 0 2024-04-25T02:27:04.202 INFO:tasks.workunit.client.0.smithi114.stdout:6/194: chown de/d27/f3f 59504028 1 2024-04-25T02:27:04.205 INFO:tasks.workunit.client.0.smithi114.stdout:8/158: rename f3 to da/f2f 0 2024-04-25T02:27:04.207 INFO:tasks.workunit.client.0.smithi114.stdout:6/195: dread de/ff [0,4194304] 0 2024-04-25T02:27:04.207 INFO:tasks.workunit.client.0.smithi114.stdout:4/97: creat d3/d8/f1b x:0 0 0 2024-04-25T02:27:04.207 INFO:tasks.workunit.client.0.smithi114.stdout:4/98: chown d3/f5 2552818 1 2024-04-25T02:27:04.209 INFO:tasks.workunit.client.0.smithi114.stdout:7/149: write d5/f9 [3323281,123995] 0 2024-04-25T02:27:04.210 INFO:tasks.workunit.client.0.smithi114.stdout:8/159: stat da/f21 0 2024-04-25T02:27:04.210 INFO:tasks.workunit.client.0.smithi114.stdout:7/150: dread d5/d19/f1c [0,4194304] 0 2024-04-25T02:27:04.211 INFO:tasks.workunit.client.0.smithi114.stdout:5/123: rename d1/d25/c1b to d1/d6/d1a/c2a 0 2024-04-25T02:27:04.212 INFO:tasks.workunit.client.0.smithi114.stdout:7/151: chown d5/d19/d1a 1 1 2024-04-25T02:27:04.213 INFO:tasks.workunit.client.0.smithi114.stdout:4/99: dwrite d3/d8/f9 [0,4194304] 0 2024-04-25T02:27:04.213 INFO:tasks.workunit.client.0.smithi114.stdout:3/109: truncate d0/f21 371121 0 2024-04-25T02:27:04.215 INFO:tasks.workunit.client.0.smithi114.stdout:2/169: truncate d5/df/d1e/f1f 4057785 0 2024-04-25T02:27:04.217 INFO:tasks.workunit.client.0.smithi114.stdout:8/160: creat da/d1e/f30 x:0 0 0 2024-04-25T02:27:04.217 INFO:tasks.workunit.client.0.smithi114.stdout:8/161: readlink da/l23 0 2024-04-25T02:27:04.219 INFO:tasks.workunit.client.0.smithi114.stdout:5/124: dwrite d1/d25/f26 [0,4194304] 0 2024-04-25T02:27:04.221 INFO:tasks.workunit.client.0.smithi114.stdout:7/152: creat d5/d19/d23/f37 x:0 0 0 2024-04-25T02:27:04.221 INFO:tasks.workunit.client.0.smithi114.stdout:4/100: creat d3/d8/f1c x:0 0 0 2024-04-25T02:27:04.221 INFO:tasks.workunit.client.0.smithi114.stdout:7/153: write d5/d19/f2c [593433,82006] 0 2024-04-25T02:27:04.225 INFO:tasks.workunit.client.0.smithi114.stdout:9/133: truncate f2 7277042 0 2024-04-25T02:27:04.226 INFO:tasks.workunit.client.0.smithi114.stdout:2/170: unlink d5/d6/c13 0 2024-04-25T02:27:04.226 INFO:tasks.workunit.client.0.smithi114.stdout:2/171: chown d5/fd 217963 1 2024-04-25T02:27:04.227 INFO:tasks.workunit.client.0.smithi114.stdout:8/162: fsync da/f2f 0 2024-04-25T02:27:04.228 INFO:tasks.workunit.client.0.smithi114.stdout:6/196: write de/d25/f3c [318681,125095] 0 2024-04-25T02:27:04.229 INFO:tasks.workunit.client.0.smithi114.stdout:1/122: rename df/d11/d25/d2b to df/d11/d32 0 2024-04-25T02:27:04.231 INFO:tasks.workunit.client.0.smithi114.stdout:7/154: creat d5/d19/d1a/f38 x:0 0 0 2024-04-25T02:27:04.232 INFO:tasks.workunit.client.0.smithi114.stdout:7/155: truncate d5/f33 203582 0 2024-04-25T02:27:04.233 INFO:tasks.workunit.client.0.smithi114.stdout:8/163: unlink da/d14/f15 0 2024-04-25T02:27:04.254 INFO:tasks.workunit.client.0.smithi114.stdout:0/160: rename d1/d7/d18/c21 to d1/d4/da/c2b 0 2024-04-25T02:27:04.254 INFO:tasks.workunit.client.0.smithi114.stdout:8/164: truncate da/f27 388239 0 2024-04-25T02:27:04.254 INFO:tasks.workunit.client.0.smithi114.stdout:5/125: creat d1/d6/f2b x:0 0 0 2024-04-25T02:27:04.256 INFO:tasks.workunit.client.0.smithi114.stdout:0/161: stat d1/d7/d18/f1d 0 2024-04-25T02:27:04.256 INFO:tasks.workunit.client.0.smithi114.stdout:4/101: rmdir d3 39 2024-04-25T02:27:04.257 INFO:tasks.workunit.client.0.smithi114.stdout:7/156: dwrite d5/d19/f2c [0,4194304] 0 2024-04-25T02:27:04.257 INFO:tasks.workunit.client.0.smithi114.stdout:9/134: write d8/d16/f27 [588810,64554] 0 2024-04-25T02:27:04.258 INFO:tasks.workunit.client.0.smithi114.stdout:1/123: write fa [961482,10293] 0 2024-04-25T02:27:04.259 INFO:tasks.workunit.client.0.smithi114.stdout:3/110: getdents d0/d5 0 2024-04-25T02:27:04.259 INFO:tasks.workunit.client.0.smithi114.stdout:7/157: chown d5/d19/c20 51246 1 2024-04-25T02:27:04.259 INFO:tasks.workunit.client.0.smithi114.stdout:7/158: stat d5/f9 0 2024-04-25T02:27:04.259 INFO:tasks.workunit.client.0.smithi114.stdout:5/126: rename d1/l9 to d1/d6/de/l2c 0 2024-04-25T02:27:04.260 INFO:tasks.workunit.client.0.smithi114.stdout:3/111: write d0/d5/fc [1884425,96988] 0 2024-04-25T02:27:04.261 INFO:tasks.workunit.client.0.smithi114.stdout:1/124: dread df/f15 [0,4194304] 0 2024-04-25T02:27:04.261 INFO:tasks.workunit.client.0.smithi114.stdout:6/197: getdents de/d30 0 2024-04-25T02:27:04.295 INFO:tasks.workunit.client.0.smithi114.stdout:7/159: unlink d5/c35 0 2024-04-25T02:27:04.296 INFO:tasks.workunit.client.0.smithi114.stdout:6/198: fsync de/d2a/f3a 0 2024-04-25T02:27:04.296 INFO:tasks.workunit.client.0.smithi114.stdout:8/165: creat da/f31 x:0 0 0 2024-04-25T02:27:04.297 INFO:tasks.workunit.client.0.smithi114.stdout:7/160: fdatasync d5/f6 0 2024-04-25T02:27:04.297 INFO:tasks.workunit.client.0.smithi114.stdout:1/125: mkdir df/d11/d25/d33 0 2024-04-25T02:27:04.299 INFO:tasks.workunit.client.0.smithi114.stdout:8/166: truncate da/f28 471507 0 2024-04-25T02:27:04.299 INFO:tasks.workunit.client.0.smithi114.stdout:6/199: rename l9 to de/l4d 0 2024-04-25T02:27:04.300 INFO:tasks.workunit.client.0.smithi114.stdout:4/102: getdents d3/d8 0 2024-04-25T02:27:04.302 INFO:tasks.workunit.client.0.smithi114.stdout:0/162: dwrite d1/d4/ff [0,4194304] 0 2024-04-25T02:27:04.304 INFO:tasks.workunit.client.0.smithi114.stdout:4/103: read d3/d8/ff [1452999,56821] 0 2024-04-25T02:27:04.305 INFO:tasks.workunit.client.0.smithi114.stdout:5/127: dread d1/d6/f19 [0,4194304] 0 2024-04-25T02:27:04.305 INFO:tasks.workunit.client.0.smithi114.stdout:7/161: mknod d5/d19/d1a/c39 0 2024-04-25T02:27:04.306 INFO:tasks.workunit.client.0.smithi114.stdout:6/200: truncate de/f16 2031259 0 2024-04-25T02:27:04.310 INFO:tasks.workunit.client.0.smithi114.stdout:6/201: readlink de/l4d 0 2024-04-25T02:27:04.311 INFO:tasks.workunit.client.0.smithi114.stdout:2/172: sync 2024-04-25T02:27:04.311 INFO:tasks.workunit.client.0.smithi114.stdout:5/128: mknod d1/d6/d1a/c2d 0 2024-04-25T02:27:04.311 INFO:tasks.workunit.client.0.smithi114.stdout:1/126: dwrite fa [0,4194304] 0 2024-04-25T02:27:04.314 INFO:tasks.workunit.client.0.smithi114.stdout:8/167: dwrite da/d16/f2a [0,4194304] 0 2024-04-25T02:27:04.314 INFO:tasks.workunit.client.0.smithi114.stdout:6/202: read de/d2a/f3a [2917002,103878] 0 2024-04-25T02:27:04.316 INFO:tasks.workunit.client.0.smithi114.stdout:0/163: getdents d1/d4/da 0 2024-04-25T02:27:04.316 INFO:tasks.workunit.client.0.smithi114.stdout:8/168: fdatasync da/f28 0 2024-04-25T02:27:04.317 INFO:tasks.workunit.client.0.smithi114.stdout:2/173: mkdir d5/df/d3d 0 2024-04-25T02:27:04.317 INFO:tasks.workunit.client.0.smithi114.stdout:5/129: fsync d1/d6/f19 0 2024-04-25T02:27:04.318 INFO:tasks.workunit.client.0.smithi114.stdout:0/164: chown d1/l23 17 1 2024-04-25T02:27:04.319 INFO:tasks.workunit.client.0.smithi114.stdout:2/174: readlink d5/df/d2c/l2f 0 2024-04-25T02:27:04.334 INFO:tasks.workunit.client.0.smithi114.stdout:9/135: sync 2024-04-25T02:27:04.335 INFO:tasks.workunit.client.0.smithi114.stdout:3/112: dwrite d0/f21 [0,4194304] 0 2024-04-25T02:27:04.336 INFO:tasks.workunit.client.0.smithi114.stdout:7/162: link d5/d19/f1d d5/d19/d23/f3a 0 2024-04-25T02:27:04.336 INFO:tasks.workunit.client.0.smithi114.stdout:0/165: dread - d1/d7/f28 zero size 2024-04-25T02:27:04.342 INFO:tasks.workunit.client.0.smithi114.stdout:2/175: dwrite f2 [0,4194304] 0 2024-04-25T02:27:04.358 INFO:tasks.workunit.client.0.smithi114.stdout:4/104: sync 2024-04-25T02:27:04.481 INFO:tasks.workunit.client.0.smithi114.stdout:5/130: creat d1/d25/d24/f2e x:0 0 0 2024-04-25T02:27:04.482 INFO:tasks.workunit.client.0.smithi114.stdout:8/169: unlink da/c11 0 2024-04-25T02:27:04.482 INFO:tasks.workunit.client.0.smithi114.stdout:5/131: dread - d1/d25/d24/f27 zero size 2024-04-25T02:27:04.483 INFO:tasks.workunit.client.0.smithi114.stdout:9/136: symlink d8/d16/d21/l31 0 2024-04-25T02:27:04.485 INFO:tasks.workunit.client.0.smithi114.stdout:1/127: truncate df/d11/d25/f26 4689716 0 2024-04-25T02:27:04.486 INFO:tasks.workunit.client.0.smithi114.stdout:1/128: chown df/d11/l23 209 1 2024-04-25T02:27:04.488 INFO:tasks.workunit.client.0.smithi114.stdout:6/203: link de/d27/f2e de/d27/f4e 0 2024-04-25T02:27:04.488 INFO:tasks.workunit.client.0.smithi114.stdout:8/170: unlink c9 0 2024-04-25T02:27:04.489 INFO:tasks.workunit.client.0.smithi114.stdout:5/132: rmdir d1/d6/de 39 2024-04-25T02:27:04.489 INFO:tasks.workunit.client.0.smithi114.stdout:0/166: dwrite d1/d7/d18/f1d [0,4194304] 0 2024-04-25T02:27:04.492 INFO:tasks.workunit.client.0.smithi114.stdout:7/163: link d5/d19/d1a/f38 d5/d19/d1a/f3b 0 2024-04-25T02:27:04.493 INFO:tasks.workunit.client.0.smithi114.stdout:2/176: mkdir d5/d3c/d3e 0 2024-04-25T02:27:04.494 INFO:tasks.workunit.client.0.smithi114.stdout:2/177: write d5/f2e [844486,23709] 0 2024-04-25T02:27:04.494 INFO:tasks.workunit.client.0.smithi114.stdout:4/105: fdatasync d3/f16 0 2024-04-25T02:27:04.494 INFO:tasks.workunit.client.0.smithi114.stdout:2/178: chown d5/df/f11 1 1 2024-04-25T02:27:04.495 INFO:tasks.workunit.client.0.smithi114.stdout:1/129: mkdir df/d2a/d34 0 2024-04-25T02:27:04.496 INFO:tasks.workunit.client.0.smithi114.stdout:2/179: dread d5/df/f14 [0,4194304] 0 2024-04-25T02:27:04.496 INFO:tasks.workunit.client.0.smithi114.stdout:1/130: dread - df/d13/d1e/f21 zero size 2024-04-25T02:27:04.497 INFO:tasks.workunit.client.0.smithi114.stdout:1/131: dread - df/d13/d1e/f21 zero size 2024-04-25T02:27:04.497 INFO:tasks.workunit.client.0.smithi114.stdout:6/204: rmdir de/d27/d34/d38 39 2024-04-25T02:27:04.499 INFO:tasks.workunit.client.0.smithi114.stdout:5/133: creat d1/d6/d1a/f2f x:0 0 0 2024-04-25T02:27:04.500 INFO:tasks.workunit.client.0.smithi114.stdout:9/137: symlink d8/d16/d2f/l32 0 2024-04-25T02:27:04.501 INFO:tasks.workunit.client.0.smithi114.stdout:2/180: dwrite f2 [0,4194304] 0 2024-04-25T02:27:04.501 INFO:tasks.workunit.client.0.smithi114.stdout:5/134: chown d1/d6/c29 42601247 1 2024-04-25T02:27:04.502 INFO:tasks.workunit.client.0.smithi114.stdout:7/164: rename d5/d19/f1c to d5/d19/d23/f3c 0 2024-04-25T02:27:04.502 INFO:tasks.workunit.client.0.smithi114.stdout:5/135: truncate d1/d6/f2b 263062 0 2024-04-25T02:27:04.503 INFO:tasks.workunit.client.0.smithi114.stdout:5/136: fdatasync d1/d25/d24/f27 0 2024-04-25T02:27:04.503 INFO:tasks.workunit.client.0.smithi114.stdout:7/165: truncate d5/d32/f2f 992033 0 2024-04-25T02:27:04.505 INFO:tasks.workunit.client.0.smithi114.stdout:4/106: creat d3/d8/d12/f1d x:0 0 0 2024-04-25T02:27:04.507 INFO:tasks.workunit.client.0.smithi114.stdout:6/205: unlink de/d25/f3e 0 2024-04-25T02:27:04.509 INFO:tasks.workunit.client.0.smithi114.stdout:8/171: mkdir da/d32 0 2024-04-25T02:27:04.510 INFO:tasks.workunit.client.0.smithi114.stdout:9/138: fdatasync d8/d18/f23 0 2024-04-25T02:27:04.510 INFO:tasks.workunit.client.0.smithi114.stdout:8/172: dread - da/d1e/f2e zero size 2024-04-25T02:27:04.511 INFO:tasks.workunit.client.0.smithi114.stdout:4/107: dwrite d3/d8/d12/f18 [0,4194304] 0 2024-04-25T02:27:04.511 INFO:tasks.workunit.client.0.smithi114.stdout:2/181: symlink d5/d3c/l3f 0 2024-04-25T02:27:04.513 INFO:tasks.workunit.client.0.smithi114.stdout:9/139: read d8/f17 [69447,100102] 0 2024-04-25T02:27:04.513 INFO:tasks.workunit.client.0.smithi114.stdout:5/137: readlink d1/d6/de/l15 0 2024-04-25T02:27:04.514 INFO:tasks.workunit.client.0.smithi114.stdout:7/166: unlink d5/d32/c2e 0 2024-04-25T02:27:04.516 INFO:tasks.workunit.client.0.smithi114.stdout:6/206: rename de/c14 to de/d27/d34/d4b/c4f 0 2024-04-25T02:27:04.517 INFO:tasks.workunit.client.0.smithi114.stdout:8/173: symlink da/d1e/l33 0 2024-04-25T02:27:04.519 INFO:tasks.workunit.client.0.smithi114.stdout:4/108: creat d3/d8/d12/f1e x:0 0 0 2024-04-25T02:27:04.524 INFO:tasks.workunit.client.0.smithi114.stdout:6/207: chown de/d27/d34/d38/f42 1717981 1 2024-04-25T02:27:04.526 INFO:tasks.workunit.client.0.smithi114.stdout:2/182: creat d5/df/d3d/f40 x:0 0 0 2024-04-25T02:27:04.528 INFO:tasks.workunit.client.0.smithi114.stdout:9/140: unlink f2 0 2024-04-25T02:27:04.530 INFO:tasks.workunit.client.0.smithi114.stdout:4/109: mknod d3/d8/d12/d19/c1f 0 2024-04-25T02:27:04.531 INFO:tasks.workunit.client.0.smithi114.stdout:4/110: write d3/d8/d12/f1d [297747,100546] 0 2024-04-25T02:27:04.531 INFO:tasks.workunit.client.0.smithi114.stdout:9/141: creat d8/d16/f33 x:0 0 0 2024-04-25T02:27:04.532 INFO:tasks.workunit.client.0.smithi114.stdout:9/142: read d8/fa [173909,18508] 0 2024-04-25T02:27:04.535 INFO:tasks.workunit.client.0.smithi114.stdout:4/111: mknod d3/c20 0 2024-04-25T02:27:04.536 INFO:tasks.workunit.client.0.smithi114.stdout:2/183: getdents d5/d1c/d21 0 2024-04-25T02:27:04.537 INFO:tasks.workunit.client.0.smithi114.stdout:9/143: dwrite d8/d16/d21/f22 [0,4194304] 0 2024-04-25T02:27:04.538 INFO:tasks.workunit.client.0.smithi114.stdout:2/184: symlink d5/d6/l41 0 2024-04-25T02:27:04.542 INFO:tasks.workunit.client.0.smithi114.stdout:0/167: sync 2024-04-25T02:27:04.547 INFO:tasks.workunit.client.0.smithi114.stdout:2/185: dwrite d5/f1d [0,4194304] 0 2024-04-25T02:27:04.549 INFO:tasks.workunit.client.0.smithi114.stdout:2/186: write d5/df/d1e/f25 [742633,107959] 0 2024-04-25T02:27:04.549 INFO:tasks.workunit.client.0.smithi114.stdout:2/187: readlink d5/d6/lb 0 2024-04-25T02:27:04.551 INFO:tasks.workunit.client.0.smithi114.stdout:2/188: creat d5/df/d3d/f42 x:0 0 0 2024-04-25T02:27:04.553 INFO:tasks.workunit.client.0.smithi114.stdout:0/168: dwrite d1/d7/f14 [0,4194304] 0 2024-04-25T02:27:04.554 INFO:tasks.workunit.client.0.smithi114.stdout:0/169: stat d1/d4/d24/f25 0 2024-04-25T02:27:04.557 INFO:tasks.workunit.client.0.smithi114.stdout:0/170: truncate d1/d4/da/f12 39164 0 2024-04-25T02:27:04.585 INFO:tasks.workunit.client.0.smithi114.stdout:1/132: sync 2024-04-25T02:27:04.586 INFO:tasks.workunit.client.0.smithi114.stdout:1/133: truncate df/d11/f24 4941405 0 2024-04-25T02:27:04.587 INFO:tasks.workunit.client.0.smithi114.stdout:1/134: chown f4 38 1 2024-04-25T02:27:04.589 INFO:tasks.workunit.client.0.smithi114.stdout:1/135: creat df/d11/d25/f35 x:0 0 0 2024-04-25T02:27:04.590 INFO:tasks.workunit.client.0.smithi114.stdout:1/136: write df/f15 [478696,106808] 0 2024-04-25T02:27:04.617 INFO:tasks.workunit.client.0.smithi114.stdout:5/138: rmdir d1/d25/d24 39 2024-04-25T02:27:04.619 INFO:tasks.workunit.client.0.smithi114.stdout:5/139: write d1/d25/d24/f2e [18500,40033] 0 2024-04-25T02:27:04.622 INFO:tasks.workunit.client.0.smithi114.stdout:5/140: unlink d1/d6/c20 0 2024-04-25T02:27:04.623 INFO:tasks.workunit.client.0.smithi114.stdout:3/113: dwrite d0/d5/f1e [0,4194304] 0 2024-04-25T02:27:04.628 INFO:tasks.workunit.client.0.smithi114.stdout:3/114: dread d0/f1d [0,4194304] 0 2024-04-25T02:27:04.628 INFO:tasks.workunit.client.0.smithi114.stdout:5/141: rename d1/d6/d1a/c2a to d1/d25/d24/c30 0 2024-04-25T02:27:04.634 INFO:tasks.workunit.client.0.smithi114.stdout:4/112: sync 2024-04-25T02:27:04.635 INFO:tasks.workunit.client.0.smithi114.stdout:5/142: link d1/d6/f2b d1/d6/f31 0 2024-04-25T02:27:04.637 INFO:tasks.workunit.client.0.smithi114.stdout:4/113: unlink d3/f17 0 2024-04-25T02:27:04.638 INFO:tasks.workunit.client.0.smithi114.stdout:4/114: write d3/d8/d12/f10 [586624,13398] 0 2024-04-25T02:27:04.639 INFO:tasks.workunit.client.0.smithi114.stdout:5/143: unlink d1/cd 0 2024-04-25T02:27:04.643 INFO:tasks.workunit.client.0.smithi114.stdout:8/174: rmdir da 39 2024-04-25T02:27:04.645 INFO:tasks.workunit.client.0.smithi114.stdout:5/144: dwrite d1/d25/d24/f2e [0,4194304] 0 2024-04-25T02:27:04.645 INFO:tasks.workunit.client.0.smithi114.stdout:7/167: write d5/d19/f2b [498271,5089] 0 2024-04-25T02:27:04.646 INFO:tasks.workunit.client.0.smithi114.stdout:1/137: dread df/d11/d25/f26 [0,4194304] 0 2024-04-25T02:27:04.646 INFO:tasks.workunit.client.0.smithi114.stdout:5/145: readlink d1/l13 0 2024-04-25T02:27:04.648 INFO:tasks.workunit.client.0.smithi114.stdout:7/168: truncate d5/d19/d1a/f36 339164 0 2024-04-25T02:27:04.649 INFO:tasks.workunit.client.0.smithi114.stdout:8/175: rename da/f12 to da/d16/f34 0 2024-04-25T02:27:04.651 INFO:tasks.workunit.client.0.smithi114.stdout:8/176: write da/f28 [1065997,15409] 0 2024-04-25T02:27:04.652 INFO:tasks.workunit.client.0.smithi114.stdout:9/144: truncate d8/f20 546065 0 2024-04-25T02:27:04.652 INFO:tasks.workunit.client.0.smithi114.stdout:6/208: dwrite de/f16 [0,4194304] 0 2024-04-25T02:27:04.653 INFO:tasks.workunit.client.0.smithi114.stdout:9/145: write d8/fb [297378,105549] 0 2024-04-25T02:27:04.654 INFO:tasks.workunit.client.0.smithi114.stdout:7/169: mknod d5/d19/d23/c3d 0 2024-04-25T02:27:04.655 INFO:tasks.workunit.client.0.smithi114.stdout:7/170: read d5/d19/d23/f3c [63910,33248] 0 2024-04-25T02:27:04.657 INFO:tasks.workunit.client.0.smithi114.stdout:8/177: dread da/d16/f2a [0,4194304] 0 2024-04-25T02:27:04.657 INFO:tasks.workunit.client.0.smithi114.stdout:5/146: link d1/d25/f28 d1/d25/d24/f32 0 2024-04-25T02:27:04.660 INFO:tasks.workunit.client.0.smithi114.stdout:2/189: dwrite d5/df/d1e/f1f [0,4194304] 0 2024-04-25T02:27:04.662 INFO:tasks.workunit.client.0.smithi114.stdout:0/171: truncate d1/d7/f14 2171937 0 2024-04-25T02:27:04.663 INFO:tasks.workunit.client.0.smithi114.stdout:1/138: creat df/d11/d25/f36 x:0 0 0 2024-04-25T02:27:04.664 INFO:tasks.workunit.client.0.smithi114.stdout:9/146: rmdir d8/d16/d21/d24 39 2024-04-25T02:27:04.667 INFO:tasks.workunit.client.0.smithi114.stdout:8/178: write da/d16/f34 [3255345,110306] 0 2024-04-25T02:27:04.668 INFO:tasks.workunit.client.0.smithi114.stdout:5/147: mknod d1/d6/de/c33 0 2024-04-25T02:27:04.670 INFO:tasks.workunit.client.0.smithi114.stdout:2/190: creat d5/df/f43 x:0 0 0 2024-04-25T02:27:04.671 INFO:tasks.workunit.client.0.smithi114.stdout:3/115: truncate d0/d5/f1e 3807696 0 2024-04-25T02:27:04.671 INFO:tasks.workunit.client.0.smithi114.stdout:3/116: fdatasync d0/f12 0 2024-04-25T02:27:04.672 INFO:tasks.workunit.client.0.smithi114.stdout:0/172: creat d1/f2c x:0 0 0 2024-04-25T02:27:04.673 INFO:tasks.workunit.client.0.smithi114.stdout:1/139: fdatasync df/d11/d25/f26 0 2024-04-25T02:27:04.674 INFO:tasks.workunit.client.0.smithi114.stdout:3/117: read d0/d5/fc [1300171,9389] 0 2024-04-25T02:27:04.679 INFO:tasks.workunit.client.0.smithi114.stdout:4/115: write d3/d8/d12/d19/f1a [1725820,85332] 0 2024-04-25T02:27:04.683 INFO:tasks.workunit.client.0.smithi114.stdout:5/148: dwrite d1/d6/f17 [0,4194304] 0 2024-04-25T02:27:04.684 INFO:tasks.workunit.client.0.smithi114.stdout:9/147: rmdir d8 39 2024-04-25T02:27:04.686 INFO:tasks.workunit.client.0.smithi114.stdout:3/118: fdatasync d0/f16 0 2024-04-25T02:27:04.691 INFO:tasks.workunit.client.0.smithi114.stdout:6/209: dwrite de/f19 [4194304,4194304] 0 2024-04-25T02:27:04.693 INFO:tasks.workunit.client.0.smithi114.stdout:0/173: rename d1/d4/d24/f29 to d1/d4/d24/f2d 0 2024-04-25T02:27:04.693 INFO:tasks.workunit.client.0.smithi114.stdout:5/149: chown d1/d6/de/l2c 3 1 2024-04-25T02:27:04.701 INFO:tasks.workunit.client.0.smithi114.stdout:4/116: dread d3/fa [0,4194304] 0 2024-04-25T02:27:04.701 INFO:tasks.workunit.client.0.smithi114.stdout:6/210: creat de/d25/f50 x:0 0 0 2024-04-25T02:27:04.702 INFO:tasks.workunit.client.0.smithi114.stdout:4/117: read d3/fa [388884,59394] 0 2024-04-25T02:27:04.703 INFO:tasks.workunit.client.0.smithi114.stdout:9/148: mknod d8/c34 0 2024-04-25T02:27:04.704 INFO:tasks.workunit.client.0.smithi114.stdout:1/140: creat df/d11/d25/f37 x:0 0 0 2024-04-25T02:27:04.704 INFO:tasks.workunit.client.0.smithi114.stdout:0/174: truncate d1/d7/f14 2351950 0 2024-04-25T02:27:04.706 INFO:tasks.workunit.client.0.smithi114.stdout:2/191: getdents d5/df 0 2024-04-25T02:27:04.707 INFO:tasks.workunit.client.0.smithi114.stdout:0/175: chown d1/d4/d24/f25 725418 1 2024-04-25T02:27:04.708 INFO:tasks.workunit.client.0.smithi114.stdout:7/171: dwrite d5/d19/f1d [0,4194304] 0 2024-04-25T02:27:04.709 INFO:tasks.workunit.client.0.smithi114.stdout:3/119: creat d0/f24 x:0 0 0 2024-04-25T02:27:04.710 INFO:tasks.workunit.client.0.smithi114.stdout:5/150: link d1/c3 d1/d25/d24/c34 0 2024-04-25T02:27:04.711 INFO:tasks.workunit.client.0.smithi114.stdout:7/172: dread d5/d19/d1a/f36 [0,4194304] 0 2024-04-25T02:27:04.711 INFO:tasks.workunit.client.0.smithi114.stdout:2/192: mkdir d5/df/d3d/d44 0 2024-04-25T02:27:04.712 INFO:tasks.workunit.client.0.smithi114.stdout:2/193: fsync d5/df/d3d/f40 0 2024-04-25T02:27:04.713 INFO:tasks.workunit.client.0.smithi114.stdout:4/118: rename d3/d8/f9 to d3/d14/f21 0 2024-04-25T02:27:04.713 INFO:tasks.workunit.client.0.smithi114.stdout:8/179: write da/d1d/f1f [4091624,65932] 0 2024-04-25T02:27:04.714 INFO:tasks.workunit.client.0.smithi114.stdout:4/119: chown d3/d8/f1c 13 1 2024-04-25T02:27:04.714 INFO:tasks.workunit.client.0.smithi114.stdout:0/176: mkdir d1/d7/d18/d2e 0 2024-04-25T02:27:04.717 INFO:tasks.workunit.client.0.smithi114.stdout:1/141: mknod df/d11/d25/d33/c38 0 2024-04-25T02:27:04.719 INFO:tasks.workunit.client.0.smithi114.stdout:7/173: rmdir d5/d32 39 2024-04-25T02:27:04.720 INFO:tasks.workunit.client.0.smithi114.stdout:4/120: dwrite d3/d8/d12/f1d [0,4194304] 0 2024-04-25T02:27:04.722 INFO:tasks.workunit.client.0.smithi114.stdout:2/194: creat d5/df/f45 x:0 0 0 2024-04-25T02:27:04.724 INFO:tasks.workunit.client.0.smithi114.stdout:8/180: rename da/d14 to da/d16/d35 0 2024-04-25T02:27:04.724 INFO:tasks.workunit.client.0.smithi114.stdout:4/121: dread d3/d14/f21 [0,4194304] 0 2024-04-25T02:27:04.725 INFO:tasks.workunit.client.0.smithi114.stdout:4/122: write d3/d8/f11 [2772987,129265] 0 2024-04-25T02:27:04.729 INFO:tasks.workunit.client.0.smithi114.stdout:7/174: fdatasync d5/d19/d1a/f36 0 2024-04-25T02:27:04.730 INFO:tasks.workunit.client.0.smithi114.stdout:2/195: symlink d5/d1c/d21/l46 0 2024-04-25T02:27:04.730 INFO:tasks.workunit.client.0.smithi114.stdout:4/123: dread d3/d8/f11 [0,4194304] 0 2024-04-25T02:27:04.731 INFO:tasks.workunit.client.0.smithi114.stdout:8/181: creat da/d1d/f36 x:0 0 0 2024-04-25T02:27:04.731 INFO:tasks.workunit.client.0.smithi114.stdout:7/175: write d5/d19/f2c [681278,40725] 0 2024-04-25T02:27:04.731 INFO:tasks.workunit.client.0.smithi114.stdout:2/196: write d5/f2e [632076,83381] 0 2024-04-25T02:27:04.732 INFO:tasks.workunit.client.0.smithi114.stdout:0/177: getdents d1/d7/d18/d2e 0 2024-04-25T02:27:04.732 INFO:tasks.workunit.client.0.smithi114.stdout:9/149: truncate d8/d16/f27 666433 0 2024-04-25T02:27:04.732 INFO:tasks.workunit.client.0.smithi114.stdout:7/176: chown d5/c15 1 1 2024-04-25T02:27:04.733 INFO:tasks.workunit.client.0.smithi114.stdout:2/197: readlink d5/d1c/l23 0 2024-04-25T02:27:04.733 INFO:tasks.workunit.client.0.smithi114.stdout:5/151: creat d1/d25/f35 x:0 0 0 2024-04-25T02:27:04.735 INFO:tasks.workunit.client.0.smithi114.stdout:9/150: write d8/d16/d21/f22 [3694822,47848] 0 2024-04-25T02:27:04.738 INFO:tasks.workunit.client.0.smithi114.stdout:3/120: rmdir d0 39 2024-04-25T02:27:04.738 INFO:tasks.workunit.client.0.smithi114.stdout:9/151: read - d8/d16/f33 zero size 2024-04-25T02:27:04.739 INFO:tasks.workunit.client.0.smithi114.stdout:5/152: creat d1/f36 x:0 0 0 2024-04-25T02:27:04.741 INFO:tasks.workunit.client.0.smithi114.stdout:6/211: dread f8 [0,4194304] 0 2024-04-25T02:27:04.742 INFO:tasks.workunit.client.0.smithi114.stdout:4/124: dwrite d3/d8/d12/f10 [0,4194304] 0 2024-04-25T02:27:04.743 INFO:tasks.workunit.client.0.smithi114.stdout:7/177: mknod d5/d32/c3e 0 2024-04-25T02:27:04.746 INFO:tasks.workunit.client.0.smithi114.stdout:8/182: dwrite da/f27 [0,4194304] 0 2024-04-25T02:27:04.746 INFO:tasks.workunit.client.0.smithi114.stdout:4/125: chown d3/d14 187252438 1 2024-04-25T02:27:04.748 INFO:tasks.workunit.client.0.smithi114.stdout:7/178: dread d5/d19/d23/f3c [0,4194304] 0 2024-04-25T02:27:04.749 INFO:tasks.workunit.client.0.smithi114.stdout:7/179: stat d5/d19/d23/l25 0 2024-04-25T02:27:04.750 INFO:tasks.workunit.client.0.smithi114.stdout:9/152: rename d8/d16/f33 to d8/d18/f35 0 2024-04-25T02:27:04.751 INFO:tasks.workunit.client.0.smithi114.stdout:9/153: readlink d8/l1c 0 2024-04-25T02:27:04.753 INFO:tasks.workunit.client.0.smithi114.stdout:7/180: dread d5/d19/f2b [0,4194304] 0 2024-04-25T02:27:04.753 INFO:tasks.workunit.client.0.smithi114.stdout:5/153: dread d1/d25/f1f [0,4194304] 0 2024-04-25T02:27:04.754 INFO:tasks.workunit.client.0.smithi114.stdout:6/212: unlink de/d2a/l4c 0 2024-04-25T02:27:04.755 INFO:tasks.workunit.client.0.smithi114.stdout:3/121: dread - d0/d5/f17 zero size 2024-04-25T02:27:04.755 INFO:tasks.workunit.client.0.smithi114.stdout:4/126: readlink d3/le 0 2024-04-25T02:27:04.758 INFO:tasks.workunit.client.0.smithi114.stdout:9/154: chown d8/d16/d21/d24/c29 9651586 1 2024-04-25T02:27:04.758 INFO:tasks.workunit.client.0.smithi114.stdout:7/181: creat d5/d19/d23/f3f x:0 0 0 2024-04-25T02:27:04.759 INFO:tasks.workunit.client.0.smithi114.stdout:1/142: dwrite fe [0,4194304] 0 2024-04-25T02:27:04.759 INFO:tasks.workunit.client.0.smithi114.stdout:5/154: creat d1/d6/de/f37 x:0 0 0 2024-04-25T02:27:04.760 INFO:tasks.workunit.client.0.smithi114.stdout:7/182: chown d5/c30 0 1 2024-04-25T02:27:04.760 INFO:tasks.workunit.client.0.smithi114.stdout:8/183: creat da/d32/f37 x:0 0 0 2024-04-25T02:27:04.762 INFO:tasks.workunit.client.0.smithi114.stdout:4/127: mknod d3/d8/c22 0 2024-04-25T02:27:04.764 INFO:tasks.workunit.client.0.smithi114.stdout:2/198: dread d5/d1c/d22/f28 [0,4194304] 0 2024-04-25T02:27:04.765 INFO:tasks.workunit.client.0.smithi114.stdout:8/184: dread da/f27 [0,4194304] 0 2024-04-25T02:27:04.767 INFO:tasks.workunit.client.0.smithi114.stdout:5/155: mknod d1/d6/d1a/c38 0 2024-04-25T02:27:04.768 INFO:tasks.workunit.client.0.smithi114.stdout:5/156: readlink d1/l21 0 2024-04-25T02:27:04.769 INFO:tasks.workunit.client.0.smithi114.stdout:6/213: link de/f1f de/d25/d39/f51 0 2024-04-25T02:27:04.771 INFO:tasks.workunit.client.0.smithi114.stdout:3/122: mkdir d0/d25 0 2024-04-25T02:27:04.771 INFO:tasks.workunit.client.0.smithi114.stdout:0/178: dwrite d1/d4/f15 [0,4194304] 0 2024-04-25T02:27:04.772 INFO:tasks.workunit.client.0.smithi114.stdout:4/128: truncate d3/fa 1662200 0 2024-04-25T02:27:04.773 INFO:tasks.workunit.client.0.smithi114.stdout:5/157: read - d1/d6/de/f1e zero size 2024-04-25T02:27:04.774 INFO:tasks.workunit.client.0.smithi114.stdout:2/199: unlink d5/df/d1e/f1f 0 2024-04-25T02:27:04.774 INFO:tasks.workunit.client.0.smithi114.stdout:0/179: stat d1/d7/d18/f1d 0 2024-04-25T02:27:04.778 INFO:tasks.workunit.client.0.smithi114.stdout:9/155: getdents d8 0 2024-04-25T02:27:04.779 INFO:tasks.workunit.client.0.smithi114.stdout:5/158: read d1/d25/f28 [277893,9489] 0 2024-04-25T02:27:04.780 INFO:tasks.workunit.client.0.smithi114.stdout:2/200: mknod d5/df/c47 0 2024-04-25T02:27:04.782 INFO:tasks.workunit.client.0.smithi114.stdout:1/143: dwrite df/d11/f28 [0,4194304] 0 2024-04-25T02:27:04.784 INFO:tasks.workunit.client.0.smithi114.stdout:8/185: dwrite da/d16/f34 [4194304,4194304] 0 2024-04-25T02:27:04.785 INFO:tasks.workunit.client.0.smithi114.stdout:2/201: fsync d5/d1c/d22/f24 0 2024-04-25T02:27:04.788 INFO:tasks.workunit.client.0.smithi114.stdout:6/214: dwrite de/f18 [0,4194304] 0 2024-04-25T02:27:04.788 INFO:tasks.workunit.client.0.smithi114.stdout:2/202: readlink d5/d1c/d29/l30 0 2024-04-25T02:27:04.789 INFO:tasks.workunit.client.0.smithi114.stdout:9/156: dread d8/d16/f27 [0,4194304] 0 2024-04-25T02:27:04.790 INFO:tasks.workunit.client.0.smithi114.stdout:6/215: stat de/l10 0 2024-04-25T02:27:04.790 INFO:tasks.workunit.client.0.smithi114.stdout:2/203: fsync d5/fe 0 2024-04-25T02:27:04.790 INFO:tasks.workunit.client.0.smithi114.stdout:8/186: readlink l5 0 2024-04-25T02:27:04.790 INFO:tasks.workunit.client.0.smithi114.stdout:0/180: getdents d1/d4/d24 0 2024-04-25T02:27:04.791 INFO:tasks.workunit.client.0.smithi114.stdout:4/129: dwrite d3/d8/d12/d19/f1a [0,4194304] 0 2024-04-25T02:27:04.793 INFO:tasks.workunit.client.0.smithi114.stdout:6/216: truncate de/d27/d34/f40 707348 0 2024-04-25T02:27:04.794 INFO:tasks.workunit.client.0.smithi114.stdout:2/204: symlink d5/d1c/d29/l48 0 2024-04-25T02:27:04.795 INFO:tasks.workunit.client.0.smithi114.stdout:4/130: mkdir d3/d8/d23 0 2024-04-25T02:27:04.798 INFO:tasks.workunit.client.0.smithi114.stdout:2/205: fsync d5/d1c/d22/f28 0 2024-04-25T02:27:04.800 INFO:tasks.workunit.client.0.smithi114.stdout:9/157: read d8/d18/f23 [525901,57775] 0 2024-04-25T02:27:04.801 INFO:tasks.workunit.client.0.smithi114.stdout:0/181: link d1/d4/d24/f2d d1/d7/d18/f2f 0 2024-04-25T02:27:04.803 INFO:tasks.workunit.client.0.smithi114.stdout:8/187: rename da/d16 to da/d38 0 2024-04-25T02:27:04.805 INFO:tasks.workunit.client.0.smithi114.stdout:2/206: rename d5/f2e to d5/d3c/d3e/f49 0 2024-04-25T02:27:04.806 INFO:tasks.workunit.client.0.smithi114.stdout:9/158: creat d8/f36 x:0 0 0 2024-04-25T02:27:04.807 INFO:tasks.workunit.client.0.smithi114.stdout:0/182: dwrite d1/d4/ff [0,4194304] 0 2024-04-25T02:27:04.809 INFO:tasks.workunit.client.0.smithi114.stdout:2/207: mknod d5/d1c/c4a 0 2024-04-25T02:27:04.811 INFO:tasks.workunit.client.0.smithi114.stdout:0/183: mkdir d1/d30 0 2024-04-25T02:27:04.813 INFO:tasks.workunit.client.0.smithi114.stdout:9/159: dwrite d8/d16/d21/f22 [0,4194304] 0 2024-04-25T02:27:04.816 INFO:tasks.workunit.client.0.smithi114.stdout:0/184: mknod d1/d7/d18/d2e/c31 0 2024-04-25T02:27:04.816 INFO:tasks.workunit.client.0.smithi114.stdout:9/160: dread d8/d16/d21/f22 [0,4194304] 0 2024-04-25T02:27:04.817 INFO:tasks.workunit.client.0.smithi114.stdout:9/161: dread - d8/f36 zero size 2024-04-25T02:27:04.817 INFO:tasks.workunit.client.0.smithi114.stdout:9/162: chown d8/f10 13196529 1 2024-04-25T02:27:04.818 INFO:tasks.workunit.client.0.smithi114.stdout:9/163: fdatasync d8/d16/f2c 0 2024-04-25T02:27:04.818 INFO:tasks.workunit.client.0.smithi114.stdout:9/164: readlink d8/d16/d21/l25 0 2024-04-25T02:27:04.819 INFO:tasks.workunit.client.0.smithi114.stdout:4/131: dread d3/f16 [0,4194304] 0 2024-04-25T02:27:04.819 INFO:tasks.workunit.client.0.smithi114.stdout:9/165: chown d8/d16/d21/d24/c2b 954208 1 2024-04-25T02:27:04.820 INFO:tasks.workunit.client.0.smithi114.stdout:9/166: truncate d8/d16/d21/f30 128531 0 2024-04-25T02:27:04.822 INFO:tasks.workunit.client.0.smithi114.stdout:0/185: link d1/d7/d18/f1f d1/d30/f32 0 2024-04-25T02:27:04.823 INFO:tasks.workunit.client.0.smithi114.stdout:4/132: mkdir d3/d14/d24 0 2024-04-25T02:27:04.824 INFO:tasks.workunit.client.0.smithi114.stdout:7/183: truncate d5/d19/d23/f3a 2710824 0 2024-04-25T02:27:04.829 INFO:tasks.workunit.client.0.smithi114.stdout:9/167: getdents d8/d16/d21/d24 0 2024-04-25T02:27:04.830 INFO:tasks.workunit.client.0.smithi114.stdout:9/168: write d8/d18/f23 [4048845,10083] 0 2024-04-25T02:27:04.830 INFO:tasks.workunit.client.0.smithi114.stdout:7/184: getdents d5/d32 0 2024-04-25T02:27:04.833 INFO:tasks.workunit.client.0.smithi114.stdout:9/169: dread d8/f1d [0,4194304] 0 2024-04-25T02:27:04.835 INFO:tasks.workunit.client.0.smithi114.stdout:9/170: mkdir d8/d16/d21/d37 0 2024-04-25T02:27:04.837 INFO:tasks.workunit.client.0.smithi114.stdout:9/171: mkdir d8/d18/d38 0 2024-04-25T02:27:04.838 INFO:tasks.workunit.client.0.smithi114.stdout:3/123: dread d0/d5/fc [0,4194304] 0 2024-04-25T02:27:04.839 INFO:tasks.workunit.client.0.smithi114.stdout:5/159: write d1/d25/f1f [853871,44742] 0 2024-04-25T02:27:04.841 INFO:tasks.workunit.client.0.smithi114.stdout:3/124: mknod d0/c26 0 2024-04-25T02:27:04.842 INFO:tasks.workunit.client.0.smithi114.stdout:3/125: fdatasync d0/d5/f1e 0 2024-04-25T02:27:04.844 INFO:tasks.workunit.client.0.smithi114.stdout:3/126: fsync d0/f21 0 2024-04-25T02:27:04.845 INFO:tasks.workunit.client.0.smithi114.stdout:3/127: readlink d0/le 0 2024-04-25T02:27:04.851 INFO:tasks.workunit.client.0.smithi114.stdout:6/217: dwrite de/d27/f2e [0,4194304] 0 2024-04-25T02:27:04.852 INFO:tasks.workunit.client.0.smithi114.stdout:8/188: truncate da/f27 3179975 0 2024-04-25T02:27:04.852 INFO:tasks.workunit.client.0.smithi114.stdout:3/128: dread d0/d5/f1e [0,4194304] 0 2024-04-25T02:27:04.852 INFO:tasks.workunit.client.0.smithi114.stdout:0/186: dread d1/d4/f19 [0,4194304] 0 2024-04-25T02:27:04.853 INFO:tasks.workunit.client.0.smithi114.stdout:2/208: write d5/d6/fa [100748,34832] 0 2024-04-25T02:27:04.854 INFO:tasks.workunit.client.0.smithi114.stdout:0/187: chown d1/d7/d18/f1d 72 1 2024-04-25T02:27:04.854 INFO:tasks.workunit.client.0.smithi114.stdout:3/129: write d0/d5/f17 [17327,82054] 0 2024-04-25T02:27:04.854 INFO:tasks.workunit.client.0.smithi114.stdout:8/189: write da/d38/d35/f2c [970022,28841] 0 2024-04-25T02:27:04.855 INFO:tasks.workunit.client.0.smithi114.stdout:8/190: fdatasync da/d38/f34 0 2024-04-25T02:27:04.858 INFO:tasks.workunit.client.0.smithi114.stdout:0/188: mkdir d1/d4/da/d33 0 2024-04-25T02:27:04.859 INFO:tasks.workunit.client.0.smithi114.stdout:4/133: truncate d3/d8/d12/f1d 1623628 0 2024-04-25T02:27:04.862 INFO:tasks.workunit.client.0.smithi114.stdout:8/191: unlink da/f28 0 2024-04-25T02:27:04.864 INFO:tasks.workunit.client.0.smithi114.stdout:9/172: rename d8/d18 to d8/d16/d2f/d39 0 2024-04-25T02:27:04.865 INFO:tasks.workunit.client.0.smithi114.stdout:0/189: creat d1/d7/d18/d2e/f34 x:0 0 0 2024-04-25T02:27:04.865 INFO:tasks.workunit.client.0.smithi114.stdout:7/185: dwrite d5/d32/f31 [0,4194304] 0 2024-04-25T02:27:04.867 INFO:tasks.workunit.client.0.smithi114.stdout:3/130: creat d0/d25/f27 x:0 0 0 2024-04-25T02:27:04.867 INFO:tasks.workunit.client.0.smithi114.stdout:0/190: readlink d1/d4/d24/l26 0 2024-04-25T02:27:04.867 INFO:tasks.workunit.client.0.smithi114.stdout:7/186: dread - d5/d19/d23/f37 zero size 2024-04-25T02:27:04.868 INFO:tasks.workunit.client.0.smithi114.stdout:8/192: write da/d38/f2a [148262,109449] 0 2024-04-25T02:27:04.869 INFO:tasks.workunit.client.0.smithi114.stdout:6/218: link de/d1c/l3d de/d27/d34/l52 0 2024-04-25T02:27:04.873 INFO:tasks.workunit.client.0.smithi114.stdout:4/134: unlink d3/c15 0 2024-04-25T02:27:04.873 INFO:tasks.workunit.client.0.smithi114.stdout:7/187: dwrite d5/f9 [0,4194304] 0 2024-04-25T02:27:04.875 INFO:tasks.workunit.client.0.smithi114.stdout:6/219: dread de/d27/f2e [0,4194304] 0 2024-04-25T02:27:04.877 INFO:tasks.workunit.client.0.smithi114.stdout:8/193: creat da/d32/f39 x:0 0 0 2024-04-25T02:27:04.879 INFO:tasks.workunit.client.0.smithi114.stdout:9/173: symlink d8/d16/d2f/d39/d38/l3a 0 2024-04-25T02:27:04.883 INFO:tasks.workunit.client.0.smithi114.stdout:8/194: dwrite da/ff [0,4194304] 0 2024-04-25T02:27:04.884 INFO:tasks.workunit.client.0.smithi114.stdout:8/195: dread - da/d32/f39 zero size 2024-04-25T02:27:04.885 INFO:tasks.workunit.client.0.smithi114.stdout:6/220: creat de/d27/d34/d4b/f53 x:0 0 0 2024-04-25T02:27:04.886 INFO:tasks.workunit.client.0.smithi114.stdout:6/221: chown de/d27/l36 269 1 2024-04-25T02:27:04.889 INFO:tasks.workunit.client.0.smithi114.stdout:5/160: rename d1/d25/f26 to d1/d6/f39 0 2024-04-25T02:27:04.891 INFO:tasks.workunit.client.0.smithi114.stdout:4/135: mkdir d3/d8/d23/d25 0 2024-04-25T02:27:04.891 INFO:tasks.workunit.client.0.smithi114.stdout:4/136: stat d3 0 2024-04-25T02:27:04.893 INFO:tasks.workunit.client.0.smithi114.stdout:8/196: symlink da/d1d/l3a 0 2024-04-25T02:27:04.893 INFO:tasks.workunit.client.0.smithi114.stdout:6/222: mknod de/d25/c54 0 2024-04-25T02:27:04.894 INFO:tasks.workunit.client.0.smithi114.stdout:8/197: dread - da/d32/f39 zero size 2024-04-25T02:27:04.896 INFO:tasks.workunit.client.0.smithi114.stdout:2/209: rename f2 to d5/df/d3d/f4b 0 2024-04-25T02:27:04.896 INFO:tasks.workunit.client.0.smithi114.stdout:5/161: dwrite d1/d6/de/f37 [0,4194304] 0 2024-04-25T02:27:04.896 INFO:tasks.workunit.client.0.smithi114.stdout:9/174: creat d8/d16/d21/d37/f3b x:0 0 0 2024-04-25T02:27:04.897 INFO:tasks.workunit.client.0.smithi114.stdout:4/137: mkdir d3/d8/d12/d19/d26 0 2024-04-25T02:27:04.899 INFO:tasks.workunit.client.0.smithi114.stdout:0/191: dread d1/d4/da/f16 [0,4194304] 0 2024-04-25T02:27:04.900 INFO:tasks.workunit.client.0.smithi114.stdout:0/192: write d1/d4/ff [3178500,22545] 0 2024-04-25T02:27:04.901 INFO:tasks.workunit.client.0.smithi114.stdout:8/198: unlink da/fc 0 2024-04-25T02:27:04.901 INFO:tasks.workunit.client.0.smithi114.stdout:8/199: write da/f31 [437120,33277] 0 2024-04-25T02:27:04.902 INFO:tasks.workunit.client.0.smithi114.stdout:0/193: truncate d1/d4/d24/f25 400039 0 2024-04-25T02:27:04.905 INFO:tasks.workunit.client.0.smithi114.stdout:0/194: dread d1/d4/da/f16 [0,4194304] 0 2024-04-25T02:27:04.905 INFO:tasks.workunit.client.0.smithi114.stdout:0/195: rename d1 to d1/d4/da/d33/d35 22 2024-04-25T02:27:04.907 INFO:tasks.workunit.client.0.smithi114.stdout:6/223: creat de/d27/d34/d44/f55 x:0 0 0 2024-04-25T02:27:04.908 INFO:tasks.workunit.client.0.smithi114.stdout:8/200: unlink da/d38/c22 0 2024-04-25T02:27:04.909 INFO:tasks.workunit.client.0.smithi114.stdout:1/144: sync 2024-04-25T02:27:04.909 INFO:tasks.workunit.client.0.smithi114.stdout:8/201: truncate da/d1e/f29 780775 0 2024-04-25T02:27:04.910 INFO:tasks.workunit.client.0.smithi114.stdout:7/188: write d5/d19/d1a/f3b [595878,108047] 0 2024-04-25T02:27:04.911 INFO:tasks.workunit.client.0.smithi114.stdout:7/189: chown d5/d32/f2f 59067 1 2024-04-25T02:27:04.911 INFO:tasks.workunit.client.0.smithi114.stdout:4/138: creat d3/d8/d23/d25/f27 x:0 0 0 2024-04-25T02:27:04.912 INFO:tasks.workunit.client.0.smithi114.stdout:0/196: mknod d1/d4/d24/c36 0 2024-04-25T02:27:04.913 INFO:tasks.workunit.client.0.smithi114.stdout:8/202: mkdir da/d32/d3b 0 2024-04-25T02:27:04.915 INFO:tasks.workunit.client.0.smithi114.stdout:6/224: creat de/d25/d39/d47/f56 x:0 0 0 2024-04-25T02:27:04.916 INFO:tasks.workunit.client.0.smithi114.stdout:1/145: mknod df/d11/d25/c39 0 2024-04-25T02:27:04.917 INFO:tasks.workunit.client.0.smithi114.stdout:5/162: getdents d1/d6/d1a 0 2024-04-25T02:27:04.917 INFO:tasks.workunit.client.0.smithi114.stdout:5/163: read - d1/f36 zero size 2024-04-25T02:27:04.918 INFO:tasks.workunit.client.0.smithi114.stdout:8/203: rename da/d1d/l17 to da/d1e/l3c 0 2024-04-25T02:27:04.919 INFO:tasks.workunit.client.0.smithi114.stdout:8/204: chown da/l23 688 1 2024-04-25T02:27:04.920 INFO:tasks.workunit.client.0.smithi114.stdout:0/197: mkdir d1/d4/d37 0 2024-04-25T02:27:04.921 INFO:tasks.workunit.client.0.smithi114.stdout:5/164: dread d1/d6/de/f37 [0,4194304] 0 2024-04-25T02:27:04.922 INFO:tasks.workunit.client.0.smithi114.stdout:5/165: readlink d1/d6/d1a/l1c 0 2024-04-25T02:27:04.924 INFO:tasks.workunit.client.0.smithi114.stdout:6/225: rename de/d25/c54 to de/d27/d34/d38/c57 0 2024-04-25T02:27:04.925 INFO:tasks.workunit.client.0.smithi114.stdout:0/198: chown d1/l23 1 1 2024-04-25T02:27:04.925 INFO:tasks.workunit.client.0.smithi114.stdout:6/226: read de/d25/f3c [106044,107619] 0 2024-04-25T02:27:04.926 INFO:tasks.workunit.client.0.smithi114.stdout:0/199: write d1/d4/d24/f25 [949279,99961] 0 2024-04-25T02:27:04.927 INFO:tasks.workunit.client.0.smithi114.stdout:0/200: chown d1/d7/d18/l1e 19507 1 2024-04-25T02:27:04.928 INFO:tasks.workunit.client.0.smithi114.stdout:5/166: mknod d1/d6/de/c3a 0 2024-04-25T02:27:04.931 INFO:tasks.workunit.client.0.smithi114.stdout:6/227: unlink de/d27/f2e 0 2024-04-25T02:27:04.932 INFO:tasks.workunit.client.0.smithi114.stdout:2/210: write d5/df/f14 [297570,31329] 0 2024-04-25T02:27:04.934 INFO:tasks.workunit.client.0.smithi114.stdout:0/201: symlink d1/d4/da/l38 0 2024-04-25T02:27:04.935 INFO:tasks.workunit.client.0.smithi114.stdout:3/131: sync 2024-04-25T02:27:04.937 INFO:tasks.workunit.client.0.smithi114.stdout:6/228: symlink de/d27/d34/d38/l58 0 2024-04-25T02:27:04.937 INFO:tasks.workunit.client.0.smithi114.stdout:1/146: getdents df/d11/d25/d33 0 2024-04-25T02:27:04.938 INFO:tasks.workunit.client.0.smithi114.stdout:9/175: dwrite d8/f10 [0,4194304] 0 2024-04-25T02:27:04.939 INFO:tasks.workunit.client.0.smithi114.stdout:2/211: mknod d5/d1c/d22/c4c 0 2024-04-25T02:27:04.939 INFO:tasks.workunit.client.0.smithi114.stdout:4/139: rmdir d3/d8/d23/d25 39 2024-04-25T02:27:04.940 INFO:tasks.workunit.client.0.smithi114.stdout:0/202: rmdir d1/d30 39 2024-04-25T02:27:04.944 INFO:tasks.workunit.client.0.smithi114.stdout:3/132: rename d0/f24 to d0/d5/f28 0 2024-04-25T02:27:04.946 INFO:tasks.workunit.client.0.smithi114.stdout:7/190: write d5/d19/f1d [737665,64046] 0 2024-04-25T02:27:04.946 INFO:tasks.workunit.client.0.smithi114.stdout:7/191: write d5/d32/f31 [1229306,53334] 0 2024-04-25T02:27:04.947 INFO:tasks.workunit.client.0.smithi114.stdout:9/176: mkdir d8/d16/d21/d24/d3c 0 2024-04-25T02:27:04.949 INFO:tasks.workunit.client.0.smithi114.stdout:0/203: dread - d1/f27 zero size 2024-04-25T02:27:04.949 INFO:tasks.workunit.client.0.smithi114.stdout:0/204: stat d1/d4/da/c2b 0 2024-04-25T02:27:04.951 INFO:tasks.workunit.client.0.smithi114.stdout:6/229: rename de/d25/f3c to de/f59 0 2024-04-25T02:27:04.952 INFO:tasks.workunit.client.0.smithi114.stdout:3/133: mkdir d0/d25/d29 0 2024-04-25T02:27:04.952 INFO:tasks.workunit.client.0.smithi114.stdout:8/205: truncate da/d38/d35/f2c 610256 0 2024-04-25T02:27:04.953 INFO:tasks.workunit.client.0.smithi114.stdout:1/147: symlink df/d2a/d34/l3a 0 2024-04-25T02:27:04.956 INFO:tasks.workunit.client.0.smithi114.stdout:6/230: dread fa [0,4194304] 0 2024-04-25T02:27:04.957 INFO:tasks.workunit.client.0.smithi114.stdout:5/167: write d1/ff [2114123,22492] 0 2024-04-25T02:27:04.959 INFO:tasks.workunit.client.0.smithi114.stdout:9/177: creat d8/d16/d2f/d39/f3d x:0 0 0 2024-04-25T02:27:04.960 INFO:tasks.workunit.client.0.smithi114.stdout:1/148: dwrite df/d13/d1e/f30 [0,4194304] 0 2024-04-25T02:27:04.963 INFO:tasks.workunit.client.0.smithi114.stdout:2/212: rename d5/df/d1e/l33 to d5/d3c/d3e/l4d 0 2024-04-25T02:27:04.967 INFO:tasks.workunit.client.0.smithi114.stdout:9/178: dwrite d8/d16/f28 [0,4194304] 0 2024-04-25T02:27:04.967 INFO:tasks.workunit.client.0.smithi114.stdout:4/140: creat d3/f28 x:0 0 0 2024-04-25T02:27:04.968 INFO:tasks.workunit.client.0.smithi114.stdout:9/179: write d8/f1f [901656,51856] 0 2024-04-25T02:27:04.970 INFO:tasks.workunit.client.0.smithi114.stdout:3/134: dread d0/f12 [0,4194304] 0 2024-04-25T02:27:04.973 INFO:tasks.workunit.client.0.smithi114.stdout:4/141: dwrite d3/d8/d12/f10 [0,4194304] 0 2024-04-25T02:27:04.978 INFO:tasks.workunit.client.0.smithi114.stdout:6/231: creat de/d27/d34/d38/f5a x:0 0 0 2024-04-25T02:27:04.981 INFO:tasks.workunit.client.0.smithi114.stdout:1/149: symlink df/d13/l3b 0 2024-04-25T02:27:04.983 INFO:tasks.workunit.client.0.smithi114.stdout:5/168: rename d1/d6/f19 to d1/d25/d24/f3b 0 2024-04-25T02:27:04.986 INFO:tasks.workunit.client.0.smithi114.stdout:2/213: unlink d5/d6/fa 0 2024-04-25T02:27:04.986 INFO:tasks.workunit.client.0.smithi114.stdout:2/214: chown d5/d6/d31/f37 1465 1 2024-04-25T02:27:04.987 INFO:tasks.workunit.client.0.smithi114.stdout:2/215: chown d5/df/f18 13729 1 2024-04-25T02:27:04.988 INFO:tasks.workunit.client.0.smithi114.stdout:3/135: mkdir d0/d25/d2a 0 2024-04-25T02:27:04.990 INFO:tasks.workunit.client.0.smithi114.stdout:7/192: link d5/c14 d5/d32/c40 0 2024-04-25T02:27:04.990 INFO:tasks.workunit.client.0.smithi114.stdout:7/193: fdatasync d5/d19/d1a/f36 0 2024-04-25T02:27:04.993 INFO:tasks.workunit.client.0.smithi114.stdout:1/150: read df/f19 [410156,72779] 0 2024-04-25T02:27:04.993 INFO:tasks.workunit.client.0.smithi114.stdout:9/180: rename d8/f20 to d8/d16/d21/d37/f3e 0 2024-04-25T02:27:04.997 INFO:tasks.workunit.client.0.smithi114.stdout:2/216: creat d5/d3c/f4e x:0 0 0 2024-04-25T02:27:04.999 INFO:tasks.workunit.client.0.smithi114.stdout:4/142: rmdir d3/d8/d23/d25 39 2024-04-25T02:27:05.000 INFO:tasks.workunit.client.0.smithi114.stdout:0/205: getdents d1/d7 0 2024-04-25T02:27:05.001 INFO:tasks.workunit.client.0.smithi114.stdout:7/194: readlink d5/l2d 0 2024-04-25T02:27:05.001 INFO:tasks.workunit.client.0.smithi114.stdout:7/195: truncate d5/d19/f2a 259894 0 2024-04-25T02:27:05.002 INFO:tasks.workunit.client.0.smithi114.stdout:1/151: creat df/d11/d32/f3c x:0 0 0 2024-04-25T02:27:05.004 INFO:tasks.workunit.client.0.smithi114.stdout:8/206: getdents da/d38/d35 0 2024-04-25T02:27:05.006 INFO:tasks.workunit.client.0.smithi114.stdout:2/217: symlink d5/df/l4f 0 2024-04-25T02:27:05.006 INFO:tasks.workunit.client.0.smithi114.stdout:2/218: dread - d5/d3c/f4e zero size 2024-04-25T02:27:05.007 INFO:tasks.workunit.client.0.smithi114.stdout:2/219: fdatasync d5/df/f14 0 2024-04-25T02:27:05.008 INFO:tasks.workunit.client.0.smithi114.stdout:3/136: symlink d0/l2b 0 2024-04-25T02:27:05.009 INFO:tasks.workunit.client.0.smithi114.stdout:5/169: write d1/d25/f28 [392839,18718] 0 2024-04-25T02:27:05.010 INFO:tasks.workunit.client.0.smithi114.stdout:0/206: mkdir d1/d4/da/d39 0 2024-04-25T02:27:05.013 INFO:tasks.workunit.client.0.smithi114.stdout:2/220: dwrite d5/df/d1e/f25 [0,4194304] 0 2024-04-25T02:27:05.013 INFO:tasks.workunit.client.0.smithi114.stdout:8/207: rename da/f21 to da/d1e/f3d 0 2024-04-25T02:27:05.018 INFO:tasks.workunit.client.0.smithi114.stdout:9/181: write d8/d16/f27 [75840,892] 0 2024-04-25T02:27:05.020 INFO:tasks.workunit.client.0.smithi114.stdout:7/196: link d5/d19/f2a d5/d19/f41 0 2024-04-25T02:27:05.021 INFO:tasks.workunit.client.0.smithi114.stdout:1/152: mknod df/d11/d25/c3d 0 2024-04-25T02:27:05.022 INFO:tasks.workunit.client.0.smithi114.stdout:1/153: fdatasync df/f15 0 2024-04-25T02:27:05.023 INFO:tasks.workunit.client.0.smithi114.stdout:8/208: mknod da/d38/d35/c3e 0 2024-04-25T02:27:05.024 INFO:tasks.workunit.client.0.smithi114.stdout:3/137: dwrite d0/d5/f28 [0,4194304] 0 2024-04-25T02:27:05.024 INFO:tasks.workunit.client.0.smithi114.stdout:6/232: mknod de/d27/d34/c5b 0 2024-04-25T02:27:05.025 INFO:tasks.workunit.client.0.smithi114.stdout:7/197: symlink d5/d32/l42 0 2024-04-25T02:27:05.026 INFO:tasks.workunit.client.0.smithi114.stdout:9/182: write d8/d16/d2f/d39/f35 [832342,48494] 0 2024-04-25T02:27:05.027 INFO:tasks.workunit.client.0.smithi114.stdout:9/183: fdatasync d8/fa 0 2024-04-25T02:27:05.030 INFO:tasks.workunit.client.0.smithi114.stdout:6/233: mkdir de/d25/d39/d5c 0 2024-04-25T02:27:05.030 INFO:tasks.workunit.client.0.smithi114.stdout:1/154: dwrite df/d11/f24 [0,4194304] 0 2024-04-25T02:27:05.031 INFO:tasks.workunit.client.0.smithi114.stdout:1/155: write df/f29 [884707,56640] 0 2024-04-25T02:27:05.032 INFO:tasks.workunit.client.0.smithi114.stdout:5/170: rename d1/d25/f28 to d1/d6/f3c 0 2024-04-25T02:27:05.033 INFO:tasks.workunit.client.0.smithi114.stdout:9/184: creat d8/d16/f3f x:0 0 0 2024-04-25T02:27:05.036 INFO:tasks.workunit.client.0.smithi114.stdout:5/171: truncate d1/d25/d24/f32 1334156 0 2024-04-25T02:27:05.036 INFO:tasks.workunit.client.0.smithi114.stdout:7/198: mkdir d5/d43 0 2024-04-25T02:27:05.036 INFO:tasks.workunit.client.0.smithi114.stdout:4/143: truncate d3/d8/f11 1781374 0 2024-04-25T02:27:05.038 INFO:tasks.workunit.client.0.smithi114.stdout:6/234: dwrite de/f1b [4194304,4194304] 0 2024-04-25T02:27:05.039 INFO:tasks.workunit.client.0.smithi114.stdout:1/156: rmdir df/d13/d1e 39 2024-04-25T02:27:05.040 INFO:tasks.workunit.client.0.smithi114.stdout:1/157: readlink df/d13/l3b 0 2024-04-25T02:27:05.041 INFO:tasks.workunit.client.0.smithi114.stdout:0/207: write d1/d7/d18/f2f [278114,41255] 0 2024-04-25T02:27:05.041 INFO:tasks.workunit.client.0.smithi114.stdout:3/138: creat d0/f2c x:0 0 0 2024-04-25T02:27:05.042 INFO:tasks.workunit.client.0.smithi114.stdout:9/185: unlink d8/d16/d21/d24/c29 0 2024-04-25T02:27:05.045 INFO:tasks.workunit.client.0.smithi114.stdout:9/186: dread - d8/d16/d21/f26 zero size 2024-04-25T02:27:05.045 INFO:tasks.workunit.client.0.smithi114.stdout:0/208: truncate d1/d7/d18/f1d 4648263 0 2024-04-25T02:27:05.045 INFO:tasks.workunit.client.0.smithi114.stdout:5/172: unlink d1/d6/de/c3a 0 2024-04-25T02:27:05.047 INFO:tasks.workunit.client.0.smithi114.stdout:4/144: dwrite d3/d8/d12/f10 [0,4194304] 0 2024-04-25T02:27:05.049 INFO:tasks.workunit.client.0.smithi114.stdout:8/209: getdents da/d32 0 2024-04-25T02:27:05.049 INFO:tasks.workunit.client.0.smithi114.stdout:5/173: rename d1/d25 to d1/d25/d24/d3d 22 2024-04-25T02:27:05.050 INFO:tasks.workunit.client.0.smithi114.stdout:6/235: dread - de/d27/d34/d4b/f53 zero size 2024-04-25T02:27:05.050 INFO:tasks.workunit.client.0.smithi114.stdout:0/209: mknod d1/d30/c3a 0 2024-04-25T02:27:05.051 INFO:tasks.workunit.client.0.smithi114.stdout:2/221: dwrite d5/df/d1e/f25 [4194304,4194304] 0 2024-04-25T02:27:05.052 INFO:tasks.workunit.client.0.smithi114.stdout:9/187: mkdir d8/d16/d21/d24/d3c/d40 0 2024-04-25T02:27:05.052 INFO:tasks.workunit.client.0.smithi114.stdout:4/145: truncate d3/f28 265336 0 2024-04-25T02:27:05.053 INFO:tasks.workunit.client.0.smithi114.stdout:3/139: dread d0/d5/f23 [0,4194304] 0 2024-04-25T02:27:05.054 INFO:tasks.workunit.client.0.smithi114.stdout:1/158: mkdir df/d13/d1e/d3e 0 2024-04-25T02:27:05.055 INFO:tasks.workunit.client.0.smithi114.stdout:4/146: chown d3/d8/d12 1 1 2024-04-25T02:27:05.055 INFO:tasks.workunit.client.0.smithi114.stdout:9/188: write d8/f10 [3842920,111144] 0 2024-04-25T02:27:05.056 INFO:tasks.workunit.client.0.smithi114.stdout:0/210: creat d1/d7/d18/f3b x:0 0 0 2024-04-25T02:27:05.057 INFO:tasks.workunit.client.0.smithi114.stdout:4/147: readlink d3/le 0 2024-04-25T02:27:05.058 INFO:tasks.workunit.client.0.smithi114.stdout:1/159: rmdir df 39 2024-04-25T02:27:05.059 INFO:tasks.workunit.client.0.smithi114.stdout:9/189: write d8/fb [1346767,43482] 0 2024-04-25T02:27:05.060 INFO:tasks.workunit.client.0.smithi114.stdout:0/211: write d1/d7/d18/d2e/f34 [845777,40768] 0 2024-04-25T02:27:05.063 INFO:tasks.workunit.client.0.smithi114.stdout:6/236: link de/d27/d34/f40 de/d25/d39/d47/f5d 0 2024-04-25T02:27:05.064 INFO:tasks.workunit.client.0.smithi114.stdout:1/160: chown df/d11/d25/f36 4765455 1 2024-04-25T02:27:05.065 INFO:tasks.workunit.client.0.smithi114.stdout:8/210: dwrite da/d1d/f36 [0,4194304] 0 2024-04-25T02:27:05.065 INFO:tasks.workunit.client.0.smithi114.stdout:5/174: dread d1/d6/f39 [0,4194304] 0 2024-04-25T02:27:05.068 INFO:tasks.workunit.client.0.smithi114.stdout:9/190: getdents d8/d16/d21 0 2024-04-25T02:27:05.069 INFO:tasks.workunit.client.0.smithi114.stdout:1/161: write df/d11/f28 [2211791,70969] 0 2024-04-25T02:27:05.070 INFO:tasks.workunit.client.0.smithi114.stdout:6/237: creat de/d25/d39/f5e x:0 0 0 2024-04-25T02:27:05.071 INFO:tasks.workunit.client.0.smithi114.stdout:0/212: rename d1/l23 to d1/d7/d18/d2e/l3c 0 2024-04-25T02:27:05.071 INFO:tasks.workunit.client.0.smithi114.stdout:3/140: dwrite d0/f3 [0,4194304] 0 2024-04-25T02:27:05.072 INFO:tasks.workunit.client.0.smithi114.stdout:4/148: dwrite d3/f5 [0,4194304] 0 2024-04-25T02:27:05.075 INFO:tasks.workunit.client.0.smithi114.stdout:4/149: chown d3 6 1 2024-04-25T02:27:05.075 INFO:tasks.workunit.client.0.smithi114.stdout:0/213: fdatasync d1/d4/d24/f25 0 2024-04-25T02:27:05.075 INFO:tasks.workunit.client.0.smithi114.stdout:9/191: dread d8/f17 [0,4194304] 0 2024-04-25T02:27:05.075 INFO:tasks.workunit.client.0.smithi114.stdout:6/238: dread - de/d27/d34/d44/f55 zero size 2024-04-25T02:27:05.076 INFO:tasks.workunit.client.0.smithi114.stdout:3/141: creat d0/d25/f2d x:0 0 0 2024-04-25T02:27:05.078 INFO:tasks.workunit.client.0.smithi114.stdout:8/211: fdatasync da/d1d/f1f 0 2024-04-25T02:27:05.081 INFO:tasks.workunit.client.0.smithi114.stdout:5/175: dwrite d1/d25/f1f [0,4194304] 0 2024-04-25T02:27:05.082 INFO:tasks.workunit.client.0.smithi114.stdout:3/142: rename d0/d5/f1e to d0/d25/f2e 0 2024-04-25T02:27:05.085 INFO:tasks.workunit.client.0.smithi114.stdout:5/176: mkdir d1/d3e 0 2024-04-25T02:27:05.087 INFO:tasks.workunit.client.0.smithi114.stdout:0/214: getdents d1/d7 0 2024-04-25T02:27:05.088 INFO:tasks.workunit.client.0.smithi114.stdout:2/222: fsync d5/df/d1e/f25 0 2024-04-25T02:27:05.089 INFO:tasks.workunit.client.0.smithi114.stdout:6/239: rename de/d27/d34/f40 to de/d25/d39/f5f 0 2024-04-25T02:27:05.089 INFO:tasks.workunit.client.0.smithi114.stdout:9/192: dwrite d8/fe [0,4194304] 0 2024-04-25T02:27:05.089 INFO:tasks.workunit.client.0.smithi114.stdout:4/150: dwrite d3/d14/f21 [4194304,4194304] 0 2024-04-25T02:27:05.091 INFO:tasks.workunit.client.0.smithi114.stdout:5/177: creat d1/d25/d24/f3f x:0 0 0 2024-04-25T02:27:05.092 INFO:tasks.workunit.client.0.smithi114.stdout:5/178: chown d1/d25/f35 36 1 2024-04-25T02:27:05.093 INFO:tasks.workunit.client.0.smithi114.stdout:5/179: chown d1/d25/d24 0 1 2024-04-25T02:27:05.097 INFO:tasks.workunit.client.0.smithi114.stdout:2/223: symlink d5/d6/d31/l50 0 2024-04-25T02:27:05.099 INFO:tasks.workunit.client.0.smithi114.stdout:7/199: write d5/d19/f2a [851652,8466] 0 2024-04-25T02:27:05.100 INFO:tasks.workunit.client.0.smithi114.stdout:7/200: truncate d5/d19/d1a/f36 1029849 0 2024-04-25T02:27:05.101 INFO:tasks.workunit.client.0.smithi114.stdout:6/240: creat de/d25/d39/d47/f60 x:0 0 0 2024-04-25T02:27:05.102 INFO:tasks.workunit.client.0.smithi114.stdout:5/180: symlink d1/d6/d1a/l40 0 2024-04-25T02:27:05.102 INFO:tasks.workunit.client.0.smithi114.stdout:5/181: dread - d1/f36 zero size 2024-04-25T02:27:05.102 INFO:tasks.workunit.client.0.smithi114.stdout:5/182: read - d1/f36 zero size 2024-04-25T02:27:05.103 INFO:tasks.workunit.client.0.smithi114.stdout:5/183: readlink d1/d6/d1a/l40 0 2024-04-25T02:27:05.103 INFO:tasks.workunit.client.0.smithi114.stdout:5/184: chown d1/d3e 3 1 2024-04-25T02:27:05.103 INFO:tasks.workunit.client.0.smithi114.stdout:0/215: mknod d1/c3d 0 2024-04-25T02:27:05.104 INFO:tasks.workunit.client.0.smithi114.stdout:5/185: write d1/ff [580855,88530] 0 2024-04-25T02:27:05.105 INFO:tasks.workunit.client.0.smithi114.stdout:2/224: creat d5/d6/f51 x:0 0 0 2024-04-25T02:27:05.106 INFO:tasks.workunit.client.0.smithi114.stdout:1/162: getdents df/d13/d1e 0 2024-04-25T02:27:05.110 INFO:tasks.workunit.client.0.smithi114.stdout:2/225: mknod d5/d1c/c52 0 2024-04-25T02:27:05.110 INFO:tasks.workunit.client.0.smithi114.stdout:7/201: mkdir d5/d44 0 2024-04-25T02:27:05.111 INFO:tasks.workunit.client.0.smithi114.stdout:6/241: mknod de/d25/d39/d5c/c61 0 2024-04-25T02:27:05.112 INFO:tasks.workunit.client.0.smithi114.stdout:5/186: unlink d1/d25/d24/c34 0 2024-04-25T02:27:05.113 INFO:tasks.workunit.client.0.smithi114.stdout:7/202: creat d5/d19/f45 x:0 0 0 2024-04-25T02:27:05.115 INFO:tasks.workunit.client.0.smithi114.stdout:2/226: link d5/df/d1e/f38 d5/df/f53 0 2024-04-25T02:27:05.115 INFO:tasks.workunit.client.0.smithi114.stdout:5/187: symlink d1/d6/d1a/l41 0 2024-04-25T02:27:05.116 INFO:tasks.workunit.client.0.smithi114.stdout:6/242: truncate de/d27/f4e 2226991 0 2024-04-25T02:27:05.119 INFO:tasks.workunit.client.0.smithi114.stdout:1/163: getdents df/d11 0 2024-04-25T02:27:05.119 INFO:tasks.workunit.client.0.smithi114.stdout:1/164: fdatasync df/f29 0 2024-04-25T02:27:05.121 INFO:tasks.workunit.client.0.smithi114.stdout:6/243: unlink de/f1b 0 2024-04-25T02:27:05.123 INFO:tasks.workunit.client.0.smithi114.stdout:7/203: rmdir d5/d44 0 2024-04-25T02:27:05.124 INFO:tasks.workunit.client.0.smithi114.stdout:7/204: chown d5/c13 15 1 2024-04-25T02:27:05.124 INFO:tasks.workunit.client.0.smithi114.stdout:7/205: stat f1 0 2024-04-25T02:27:05.125 INFO:tasks.workunit.client.0.smithi114.stdout:9/193: fsync d8/fe 0 2024-04-25T02:27:05.126 INFO:tasks.workunit.client.0.smithi114.stdout:9/194: fdatasync d8/d16/d21/f30 0 2024-04-25T02:27:05.128 INFO:tasks.workunit.client.0.smithi114.stdout:1/165: rename df/c16 to df/d13/d1e/d3e/c3f 0 2024-04-25T02:27:05.128 INFO:tasks.workunit.client.0.smithi114.stdout:6/244: stat de/d27/c31 0 2024-04-25T02:27:05.129 INFO:tasks.workunit.client.0.smithi114.stdout:6/245: readlink de/d30/l3b 0 2024-04-25T02:27:05.134 INFO:tasks.workunit.client.0.smithi114.stdout:9/195: rename d8/f10 to d8/d16/d21/f41 0 2024-04-25T02:27:05.136 INFO:tasks.workunit.client.0.smithi114.stdout:1/166: mknod df/d2a/d34/c40 0 2024-04-25T02:27:05.136 INFO:tasks.workunit.client.0.smithi114.stdout:1/167: chown df/d11/f28 1530 1 2024-04-25T02:27:05.136 INFO:tasks.workunit.client.0.smithi114.stdout:4/151: dread d3/d8/ff [0,4194304] 0 2024-04-25T02:27:05.137 INFO:tasks.workunit.client.0.smithi114.stdout:6/246: creat de/d30/f62 x:0 0 0 2024-04-25T02:27:05.138 INFO:tasks.workunit.client.0.smithi114.stdout:3/143: getdents d0/d5 0 2024-04-25T02:27:05.139 INFO:tasks.workunit.client.0.smithi114.stdout:7/206: symlink d5/l46 0 2024-04-25T02:27:05.139 INFO:tasks.workunit.client.0.smithi114.stdout:5/188: link d1/d25/d24/c30 d1/d3e/c42 0 2024-04-25T02:27:05.141 INFO:tasks.workunit.client.0.smithi114.stdout:0/216: dread d1/d7/d18/f22 [0,4194304] 0 2024-04-25T02:27:05.142 INFO:tasks.workunit.client.0.smithi114.stdout:9/196: creat d8/f42 x:0 0 0 2024-04-25T02:27:05.143 INFO:tasks.workunit.client.0.smithi114.stdout:6/247: mknod de/d1c/c63 0 2024-04-25T02:27:05.145 INFO:tasks.workunit.client.0.smithi114.stdout:1/168: dwrite f4 [4194304,4194304] 0 2024-04-25T02:27:05.146 INFO:tasks.workunit.client.0.smithi114.stdout:3/144: symlink d0/d5/l2f 0 2024-04-25T02:27:05.147 INFO:tasks.workunit.client.0.smithi114.stdout:6/248: write de/f19 [6804807,112539] 0 2024-04-25T02:27:05.147 INFO:tasks.workunit.client.0.smithi114.stdout:8/212: dwrite da/f27 [0,4194304] 0 2024-04-25T02:27:05.147 INFO:tasks.workunit.client.0.smithi114.stdout:7/207: mknod d5/d19/d1a/c47 0 2024-04-25T02:27:05.149 INFO:tasks.workunit.client.0.smithi114.stdout:6/249: stat de/d27/c31 0 2024-04-25T02:27:05.149 INFO:tasks.workunit.client.0.smithi114.stdout:0/217: fdatasync d1/f10 0 2024-04-25T02:27:05.149 INFO:tasks.workunit.client.0.smithi114.stdout:8/213: write da/d1e/f30 [204109,6151] 0 2024-04-25T02:27:05.150 INFO:tasks.workunit.client.0.smithi114.stdout:8/214: write da/ff [2422311,21858] 0 2024-04-25T02:27:05.154 INFO:tasks.workunit.client.0.smithi114.stdout:4/152: rename d3/d8/d12/f1d to d3/d14/d24/f29 0 2024-04-25T02:27:05.154 INFO:tasks.workunit.client.0.smithi114.stdout:6/250: dread de/d25/d39/d47/f5d [0,4194304] 0 2024-04-25T02:27:05.156 INFO:tasks.workunit.client.0.smithi114.stdout:5/189: unlink d1/c12 0 2024-04-25T02:27:05.156 INFO:tasks.workunit.client.0.smithi114.stdout:5/190: chown d1/d6/f3c 340 1 2024-04-25T02:27:05.157 INFO:tasks.workunit.client.0.smithi114.stdout:5/191: write d1/d6/de/f1e [959700,10811] 0 2024-04-25T02:27:05.159 INFO:tasks.workunit.client.0.smithi114.stdout:1/169: symlink df/d13/d1e/l41 0 2024-04-25T02:27:05.160 INFO:tasks.workunit.client.0.smithi114.stdout:1/170: write f4 [610914,113398] 0 2024-04-25T02:27:05.161 INFO:tasks.workunit.client.0.smithi114.stdout:7/208: creat d5/d19/f48 x:0 0 0 2024-04-25T02:27:05.163 INFO:tasks.workunit.client.0.smithi114.stdout:1/171: chown df/d11/d25 54186029 1 2024-04-25T02:27:05.165 INFO:tasks.workunit.client.0.smithi114.stdout:3/145: dwrite d0/d25/f2e [0,4194304] 0 2024-04-25T02:27:05.166 INFO:tasks.workunit.client.0.smithi114.stdout:8/215: creat da/d1d/f3f x:0 0 0 2024-04-25T02:27:05.167 INFO:tasks.workunit.client.0.smithi114.stdout:5/192: dwrite d1/f36 [0,4194304] 0 2024-04-25T02:27:05.169 INFO:tasks.workunit.client.0.smithi114.stdout:6/251: symlink de/d25/l64 0 2024-04-25T02:27:05.174 INFO:tasks.workunit.client.0.smithi114.stdout:1/172: rmdir df/d11/d25 39 2024-04-25T02:27:05.174 INFO:tasks.workunit.client.0.smithi114.stdout:0/218: dwrite d1/d7/d18/f22 [0,4194304] 0 2024-04-25T02:27:05.176 INFO:tasks.workunit.client.0.smithi114.stdout:2/227: dwrite d5/fd [0,4194304] 0 2024-04-25T02:27:05.178 INFO:tasks.workunit.client.0.smithi114.stdout:3/146: write d0/f16 [4958003,15012] 0 2024-04-25T02:27:05.178 INFO:tasks.workunit.client.0.smithi114.stdout:8/216: dread da/ff [0,4194304] 0 2024-04-25T02:27:05.180 INFO:tasks.workunit.client.0.smithi114.stdout:6/252: dwrite de/f16 [0,4194304] 0 2024-04-25T02:27:05.183 INFO:tasks.workunit.client.0.smithi114.stdout:1/173: dread - df/d11/d25/f27 zero size 2024-04-25T02:27:05.186 INFO:tasks.workunit.client.0.smithi114.stdout:8/217: dwrite da/f31 [0,4194304] 0 2024-04-25T02:27:05.187 INFO:tasks.workunit.client.0.smithi114.stdout:8/218: truncate da/d32/f37 770289 0 2024-04-25T02:27:05.188 INFO:tasks.workunit.client.0.smithi114.stdout:8/219: truncate da/d1e/f30 1118512 0 2024-04-25T02:27:05.189 INFO:tasks.workunit.client.0.smithi114.stdout:0/219: mkdir d1/d4/da/d3e 0 2024-04-25T02:27:05.190 INFO:tasks.workunit.client.0.smithi114.stdout:0/220: write d1/d7/d18/d2e/f34 [1709643,125062] 0 2024-04-25T02:27:05.192 INFO:tasks.workunit.client.0.smithi114.stdout:2/228: mkdir d5/d3c/d3e/d54 0 2024-04-25T02:27:05.195 INFO:tasks.workunit.client.0.smithi114.stdout:3/147: symlink d0/d5/l30 0 2024-04-25T02:27:05.198 INFO:tasks.workunit.client.0.smithi114.stdout:7/209: creat d5/f49 x:0 0 0 2024-04-25T02:27:05.199 INFO:tasks.workunit.client.0.smithi114.stdout:2/229: dwrite d5/d1c/d22/f24 [0,4194304] 0 2024-04-25T02:27:05.199 INFO:tasks.workunit.client.0.smithi114.stdout:6/253: mknod de/d27/d34/d4b/c65 0 2024-04-25T02:27:05.201 INFO:tasks.workunit.client.0.smithi114.stdout:1/174: rename df/d11/c1c to df/c42 0 2024-04-25T02:27:05.202 INFO:tasks.workunit.client.0.smithi114.stdout:2/230: write d5/df/f43 [200953,92635] 0 2024-04-25T02:27:05.202 INFO:tasks.workunit.client.0.smithi114.stdout:9/197: mkdir d8/d16/d21/d37/d43 0 2024-04-25T02:27:05.204 INFO:tasks.workunit.client.0.smithi114.stdout:1/175: truncate df/f15 1087810 0 2024-04-25T02:27:05.204 INFO:tasks.workunit.client.0.smithi114.stdout:3/148: dwrite d0/f12 [0,4194304] 0 2024-04-25T02:27:05.205 INFO:tasks.workunit.client.0.smithi114.stdout:1/176: chown df/d11/d32/f3c 30189 1 2024-04-25T02:27:05.205 INFO:tasks.workunit.client.0.smithi114.stdout:3/149: chown d0/d25/f27 531225 1 2024-04-25T02:27:05.205 INFO:tasks.workunit.client.0.smithi114.stdout:5/193: creat d1/d6/f43 x:0 0 0 2024-04-25T02:27:05.206 INFO:tasks.workunit.client.0.smithi114.stdout:5/194: dread - d1/d25/f35 zero size 2024-04-25T02:27:05.206 INFO:tasks.workunit.client.0.smithi114.stdout:1/177: write df/d11/d25/f26 [2083982,96157] 0 2024-04-25T02:27:05.206 INFO:tasks.workunit.client.0.smithi114.stdout:5/195: readlink d1/l13 0 2024-04-25T02:27:05.207 INFO:tasks.workunit.client.0.smithi114.stdout:5/196: fsync d1/d25/f1f 0 2024-04-25T02:27:05.208 INFO:tasks.workunit.client.0.smithi114.stdout:7/210: mkdir d5/d32/d4a 0 2024-04-25T02:27:05.262 INFO:tasks.workunit.client.0.smithi114.stdout:6/254: mknod de/d25/d39/d5c/c66 0 2024-04-25T02:27:05.263 INFO:tasks.workunit.client.0.smithi114.stdout:8/220: fsync da/d1e/f3d 0 2024-04-25T02:27:05.263 INFO:tasks.workunit.client.0.smithi114.stdout:4/153: dread d3/d14/d24/f29 [0,4194304] 0 2024-04-25T02:27:05.264 INFO:tasks.workunit.client.0.smithi114.stdout:0/221: symlink d1/d4/da/d33/l3f 0 2024-04-25T02:27:05.264 INFO:tasks.workunit.client.0.smithi114.stdout:2/231: readlink d5/d3c/d3e/l4d 0 2024-04-25T02:27:05.265 INFO:tasks.workunit.client.0.smithi114.stdout:3/150: creat d0/d5/f31 x:0 0 0 2024-04-25T02:27:05.265 INFO:tasks.workunit.client.0.smithi114.stdout:5/197: creat d1/d6/de/f44 x:0 0 0 2024-04-25T02:27:05.267 INFO:tasks.workunit.client.0.smithi114.stdout:3/151: write d0/d25/f27 [125254,18568] 0 2024-04-25T02:27:05.269 INFO:tasks.workunit.client.0.smithi114.stdout:6/255: rmdir de/d27/d34 39 2024-04-25T02:27:05.269 INFO:tasks.workunit.client.0.smithi114.stdout:2/232: creat d5/d6/f55 x:0 0 0 2024-04-25T02:27:05.270 INFO:tasks.workunit.client.0.smithi114.stdout:1/178: chown df/c42 550374 1 2024-04-25T02:27:05.271 INFO:tasks.workunit.client.0.smithi114.stdout:3/152: creat d0/d25/f32 x:0 0 0 2024-04-25T02:27:05.271 INFO:tasks.workunit.client.0.smithi114.stdout:0/222: dread d1/d4/ff [0,4194304] 0 2024-04-25T02:27:05.273 INFO:tasks.workunit.client.0.smithi114.stdout:2/233: truncate d5/d6/f55 400784 0 2024-04-25T02:27:05.274 INFO:tasks.workunit.client.0.smithi114.stdout:6/256: mknod de/d2a/c67 0 2024-04-25T02:27:05.274 INFO:tasks.workunit.client.0.smithi114.stdout:2/234: stat d5/df/f12 0 2024-04-25T02:27:05.275 INFO:tasks.workunit.client.0.smithi114.stdout:3/153: mknod d0/d5/c33 0 2024-04-25T02:27:05.276 INFO:tasks.workunit.client.0.smithi114.stdout:0/223: mknod d1/d7/d18/d2e/c40 0 2024-04-25T02:27:05.277 INFO:tasks.workunit.client.0.smithi114.stdout:6/257: write de/d30/f43 [514461,21714] 0 2024-04-25T02:27:05.278 INFO:tasks.workunit.client.0.smithi114.stdout:7/211: truncate d5/f18 3744934 0 2024-04-25T02:27:05.279 INFO:tasks.workunit.client.0.smithi114.stdout:1/179: mkdir df/d11/d25/d43 0 2024-04-25T02:27:05.279 INFO:tasks.workunit.client.0.smithi114.stdout:4/154: dwrite d3/d14/d24/f29 [0,4194304] 0 2024-04-25T02:27:05.280 INFO:tasks.workunit.client.0.smithi114.stdout:5/198: link d1/d6/c8 d1/d6/d1a/c45 0 2024-04-25T02:27:05.281 INFO:tasks.workunit.client.0.smithi114.stdout:5/199: chown d1/d6/d1a/l1c 186155255 1 2024-04-25T02:27:05.282 INFO:tasks.workunit.client.0.smithi114.stdout:5/200: fdatasync d1/d6/f17 0 2024-04-25T02:27:05.282 INFO:tasks.workunit.client.0.smithi114.stdout:0/224: creat d1/d4/d24/f41 x:0 0 0 2024-04-25T02:27:05.284 INFO:tasks.workunit.client.0.smithi114.stdout:6/258: read de/d27/f3f [120417,78177] 0 2024-04-25T02:27:05.285 INFO:tasks.workunit.client.0.smithi114.stdout:8/221: dread da/d38/f34 [0,4194304] 0 2024-04-25T02:27:05.286 INFO:tasks.workunit.client.0.smithi114.stdout:8/222: stat da/d1e/l33 0 2024-04-25T02:27:05.288 INFO:tasks.workunit.client.0.smithi114.stdout:3/154: mkdir d0/d25/d2a/d34 0 2024-04-25T02:27:05.291 INFO:tasks.workunit.client.0.smithi114.stdout:6/259: readlink de/d1c/l3d 0 2024-04-25T02:27:05.291 INFO:tasks.workunit.client.0.smithi114.stdout:1/180: mkdir df/d13/d44 0 2024-04-25T02:27:05.292 INFO:tasks.workunit.client.0.smithi114.stdout:4/155: creat d3/d8/d12/d19/d26/f2a x:0 0 0 2024-04-25T02:27:05.292 INFO:tasks.workunit.client.0.smithi114.stdout:5/201: dread d1/d6/de/f37 [0,4194304] 0 2024-04-25T02:27:05.293 INFO:tasks.workunit.client.0.smithi114.stdout:0/225: mkdir d1/d4/d37/d42 0 2024-04-25T02:27:05.294 INFO:tasks.workunit.client.0.smithi114.stdout:7/212: creat d5/f4b x:0 0 0 2024-04-25T02:27:05.295 INFO:tasks.workunit.client.0.smithi114.stdout:7/213: chown d5/d19/d23/l25 60359 1 2024-04-25T02:27:05.295 INFO:tasks.workunit.client.0.smithi114.stdout:6/260: unlink de/d2a/c41 0 2024-04-25T02:27:05.295 INFO:tasks.workunit.client.0.smithi114.stdout:7/214: chown d5/f6 1083817923 1 2024-04-25T02:27:05.296 INFO:tasks.workunit.client.0.smithi114.stdout:8/223: mkdir da/d32/d3b/d40 0 2024-04-25T02:27:05.296 INFO:tasks.workunit.client.0.smithi114.stdout:7/215: stat d5/d19/f2b 0 2024-04-25T02:27:05.297 INFO:tasks.workunit.client.0.smithi114.stdout:7/216: chown d5/d19 3942704 1 2024-04-25T02:27:05.297 INFO:tasks.workunit.client.0.smithi114.stdout:1/181: unlink df/d11/d25/f36 0 2024-04-25T02:27:05.298 INFO:tasks.workunit.client.0.smithi114.stdout:7/217: write d5/f6 [1003343,119954] 0 2024-04-25T02:27:05.299 INFO:tasks.workunit.client.0.smithi114.stdout:4/156: fdatasync d3/f16 0 2024-04-25T02:27:05.300 INFO:tasks.workunit.client.0.smithi114.stdout:8/224: dread da/f27 [0,4194304] 0 2024-04-25T02:27:05.304 INFO:tasks.workunit.client.0.smithi114.stdout:5/202: unlink d1/c5 0 2024-04-25T02:27:05.307 INFO:tasks.workunit.client.0.smithi114.stdout:0/226: link d1/d4/d24/f41 d1/d30/f43 0 2024-04-25T02:27:05.310 INFO:tasks.workunit.client.0.smithi114.stdout:7/218: mknod d5/c4c 0 2024-04-25T02:27:05.310 INFO:tasks.workunit.client.0.smithi114.stdout:7/219: fdatasync d5/f6 0 2024-04-25T02:27:05.311 INFO:tasks.workunit.client.0.smithi114.stdout:7/220: write d5/d19/d1a/f36 [352271,124436] 0 2024-04-25T02:27:05.311 INFO:tasks.workunit.client.0.smithi114.stdout:5/203: rename d1/d6/de/c33 to d1/c46 0 2024-04-25T02:27:05.312 INFO:tasks.workunit.client.0.smithi114.stdout:7/221: write d5/d32/f2f [1015020,67971] 0 2024-04-25T02:27:05.313 INFO:tasks.workunit.client.0.smithi114.stdout:4/157: mknod d3/d8/d23/d25/c2b 0 2024-04-25T02:27:05.314 INFO:tasks.workunit.client.0.smithi114.stdout:0/227: mknod d1/d4/d24/c44 0 2024-04-25T02:27:05.314 INFO:tasks.workunit.client.0.smithi114.stdout:7/222: write d5/d19/d1a/f38 [1685154,112904] 0 2024-04-25T02:27:05.315 INFO:tasks.workunit.client.0.smithi114.stdout:4/158: write d3/d8/d12/f1e [716089,79799] 0 2024-04-25T02:27:05.315 INFO:tasks.workunit.client.0.smithi114.stdout:3/155: dread d0/f19 [0,4194304] 0 2024-04-25T02:27:05.316 INFO:tasks.workunit.client.0.smithi114.stdout:4/159: write d3/d8/d12/f1e [1131396,15252] 0 2024-04-25T02:27:05.316 INFO:tasks.workunit.client.0.smithi114.stdout:3/156: truncate d0/f3 5368031 0 2024-04-25T02:27:05.317 INFO:tasks.workunit.client.0.smithi114.stdout:6/261: write de/d25/d39/d47/f5d [1655321,130588] 0 2024-04-25T02:27:05.318 INFO:tasks.workunit.client.0.smithi114.stdout:5/204: symlink d1/d6/d1a/l47 0 2024-04-25T02:27:05.318 INFO:tasks.workunit.client.0.smithi114.stdout:5/205: fsync d1/ff 0 2024-04-25T02:27:05.319 INFO:tasks.workunit.client.0.smithi114.stdout:9/198: sync 2024-04-25T02:27:05.319 INFO:tasks.workunit.client.0.smithi114.stdout:5/206: write d1/d6/de/f1e [892382,38004] 0 2024-04-25T02:27:05.320 INFO:tasks.workunit.client.0.smithi114.stdout:1/182: getdents df/d2a 0 2024-04-25T02:27:05.320 INFO:tasks.workunit.client.0.smithi114.stdout:5/207: readlink d1/l13 0 2024-04-25T02:27:05.320 INFO:tasks.workunit.client.0.smithi114.stdout:9/199: rename d8/d16/d21 to d8/d16/d21/d37/d44 22 2024-04-25T02:27:05.321 INFO:tasks.workunit.client.0.smithi114.stdout:0/228: write d1/d4/da/f16 [3738972,114260] 0 2024-04-25T02:27:05.322 INFO:tasks.workunit.client.0.smithi114.stdout:7/223: creat d5/d19/d23/f4d x:0 0 0 2024-04-25T02:27:05.323 INFO:tasks.workunit.client.0.smithi114.stdout:0/229: write d1/d7/f28 [905511,37397] 0 2024-04-25T02:27:05.324 INFO:tasks.workunit.client.0.smithi114.stdout:0/230: fsync d1/d4/f15 0 2024-04-25T02:27:05.324 INFO:tasks.workunit.client.0.smithi114.stdout:4/160: unlink d3/d8/d12/f10 0 2024-04-25T02:27:05.325 INFO:tasks.workunit.client.0.smithi114.stdout:4/161: read d3/f5 [2850157,35249] 0 2024-04-25T02:27:05.326 INFO:tasks.workunit.client.0.smithi114.stdout:9/200: dread d8/d16/d2f/d39/f35 [0,4194304] 0 2024-04-25T02:27:05.328 INFO:tasks.workunit.client.0.smithi114.stdout:3/157: write d0/fb [550347,14381] 0 2024-04-25T02:27:05.330 INFO:tasks.workunit.client.0.smithi114.stdout:1/183: dread df/d11/d25/f26 [0,4194304] 0 2024-04-25T02:27:05.331 INFO:tasks.workunit.client.0.smithi114.stdout:4/162: creat d3/d8/f2c x:0 0 0 2024-04-25T02:27:05.352 INFO:tasks.workunit.client.0.smithi114.stdout:2/235: sync 2024-04-25T02:27:05.364 INFO:tasks.workunit.client.0.smithi114.stdout:3/158: rename d0/d5/l1b to d0/d5/l35 0 2024-04-25T02:27:05.365 INFO:tasks.workunit.client.0.smithi114.stdout:4/163: rmdir d3/d8/d23 39 2024-04-25T02:27:05.366 INFO:tasks.workunit.client.0.smithi114.stdout:1/184: rename df/d11/d25/c3d to df/d11/d25/d43/c45 0 2024-04-25T02:27:05.366 INFO:tasks.workunit.client.0.smithi114.stdout:9/201: creat d8/d16/d21/d24/d3c/f45 x:0 0 0 2024-04-25T02:27:05.367 INFO:tasks.workunit.client.0.smithi114.stdout:0/231: fsync d1/d7/fd 0 2024-04-25T02:27:05.425 INFO:tasks.workunit.client.0.smithi114.stdout:8/225: sync 2024-04-25T02:27:05.426 INFO:tasks.workunit.client.0.smithi114.stdout:8/226: write da/d32/f37 [447230,50901] 0 2024-04-25T02:27:05.426 INFO:tasks.workunit.client.0.smithi114.stdout:8/227: chown da/d1d/l3a 605121 1 2024-04-25T02:27:05.427 INFO:tasks.workunit.client.0.smithi114.stdout:8/228: stat da/d1d/c1c 0 2024-04-25T02:27:05.427 INFO:tasks.workunit.client.0.smithi114.stdout:8/229: chown da/d1e/c2d 8417488 1 2024-04-25T02:27:05.558 INFO:tasks.workunit.client.0.smithi114.stdout:6/262: link de/d27/d34/c5b de/c68 0 2024-04-25T02:27:05.559 INFO:tasks.workunit.client.0.smithi114.stdout:5/208: getdents d1/d6 0 2024-04-25T02:27:05.560 INFO:tasks.workunit.client.0.smithi114.stdout:3/159: mkdir d0/d25/d2a/d36 0 2024-04-25T02:27:05.563 INFO:tasks.workunit.client.0.smithi114.stdout:7/224: getdents d5/d19/d23 0 2024-04-25T02:27:05.563 INFO:tasks.workunit.client.0.smithi114.stdout:1/185: rmdir df/d13/d1e 39 2024-04-25T02:27:05.563 INFO:tasks.workunit.client.0.smithi114.stdout:7/225: chown d5/d19/d23/l25 13339193 1 2024-04-25T02:27:05.564 INFO:tasks.workunit.client.0.smithi114.stdout:9/202: mkdir d8/d16/d2f/d39/d38/d46 0 2024-04-25T02:27:05.567 INFO:tasks.workunit.client.0.smithi114.stdout:6/263: rename de/d25/l64 to de/d25/d39/d5c/l69 0 2024-04-25T02:27:05.568 INFO:tasks.workunit.client.0.smithi114.stdout:5/209: symlink d1/l48 0 2024-04-25T02:27:05.570 INFO:tasks.workunit.client.0.smithi114.stdout:8/230: dread da/d1e/f3d [0,4194304] 0 2024-04-25T02:27:05.570 INFO:tasks.workunit.client.0.smithi114.stdout:4/164: unlink d3/d8/f11 0 2024-04-25T02:27:05.571 INFO:tasks.workunit.client.0.smithi114.stdout:2/236: creat d5/df/d3d/d44/f56 x:0 0 0 2024-04-25T02:27:05.572 INFO:tasks.workunit.client.0.smithi114.stdout:1/186: dwrite df/d11/f24 [0,4194304] 0 2024-04-25T02:27:05.573 INFO:tasks.workunit.client.0.smithi114.stdout:1/187: stat f4 0 2024-04-25T02:27:05.574 INFO:tasks.workunit.client.0.smithi114.stdout:3/160: creat d0/d25/d2a/d36/f37 x:0 0 0 2024-04-25T02:27:05.575 INFO:tasks.workunit.client.0.smithi114.stdout:8/231: dread da/d1e/f3d [0,4194304] 0 2024-04-25T02:27:05.576 INFO:tasks.workunit.client.0.smithi114.stdout:5/210: fsync d1/d6/f2b 0 2024-04-25T02:27:05.576 INFO:tasks.workunit.client.0.smithi114.stdout:9/203: dwrite d8/fe [0,4194304] 0 2024-04-25T02:27:05.577 INFO:tasks.workunit.client.0.smithi114.stdout:7/226: fdatasync d5/f18 0 2024-04-25T02:27:05.577 INFO:tasks.workunit.client.0.smithi114.stdout:1/188: write df/d11/d25/f27 [895973,42852] 0 2024-04-25T02:27:05.579 INFO:tasks.workunit.client.0.smithi114.stdout:9/204: fdatasync d8/f17 0 2024-04-25T02:27:05.581 INFO:tasks.workunit.client.0.smithi114.stdout:7/227: write d5/d19/d23/f4d [496898,116819] 0 2024-04-25T02:27:05.583 INFO:tasks.workunit.client.0.smithi114.stdout:2/237: dread d5/df/d1e/f25 [4194304,4194304] 0 2024-04-25T02:27:05.583 INFO:tasks.workunit.client.0.smithi114.stdout:3/161: dread d0/d5/fc [0,4194304] 0 2024-04-25T02:27:05.584 INFO:tasks.workunit.client.0.smithi114.stdout:2/238: chown d5/d1c/c2a 62370 1 2024-04-25T02:27:05.585 INFO:tasks.workunit.client.0.smithi114.stdout:5/211: rmdir d1/d6/de 39 2024-04-25T02:27:05.587 INFO:tasks.workunit.client.0.smithi114.stdout:9/205: dwrite d8/d16/d21/d37/f3b [0,4194304] 0 2024-04-25T02:27:05.587 INFO:tasks.workunit.client.0.smithi114.stdout:1/189: creat df/d2a/f46 x:0 0 0 2024-04-25T02:27:05.588 INFO:tasks.workunit.client.0.smithi114.stdout:1/190: read - df/d2a/f2e zero size 2024-04-25T02:27:05.588 INFO:tasks.workunit.client.0.smithi114.stdout:0/232: link d1/d4/da/f12 d1/d4/d24/f45 0 2024-04-25T02:27:05.590 INFO:tasks.workunit.client.0.smithi114.stdout:0/233: write d1/d4/f15 [3680125,40195] 0 2024-04-25T02:27:05.592 INFO:tasks.workunit.client.0.smithi114.stdout:6/264: dread de/d30/f43 [0,4194304] 0 2024-04-25T02:27:05.592 INFO:tasks.workunit.client.0.smithi114.stdout:2/239: unlink c3 0 2024-04-25T02:27:05.596 INFO:tasks.workunit.client.0.smithi114.stdout:1/191: dwrite df/d2a/f46 [0,4194304] 0 2024-04-25T02:27:05.598 INFO:tasks.workunit.client.0.smithi114.stdout:9/206: creat d8/d16/d21/d24/f47 x:0 0 0 2024-04-25T02:27:05.598 INFO:tasks.workunit.client.0.smithi114.stdout:7/228: mkdir d5/d43/d4e 0 2024-04-25T02:27:05.599 INFO:tasks.workunit.client.0.smithi114.stdout:9/207: dread - d8/d16/d2f/d39/f3d zero size 2024-04-25T02:27:05.599 INFO:tasks.workunit.client.0.smithi114.stdout:6/265: symlink de/d2a/l6a 0 2024-04-25T02:27:05.601 INFO:tasks.workunit.client.0.smithi114.stdout:2/240: mknod d5/df/d1e/c57 0 2024-04-25T02:27:05.601 INFO:tasks.workunit.client.0.smithi114.stdout:2/241: read d5/d1c/d22/f24 [1421696,44907] 0 2024-04-25T02:27:05.603 INFO:tasks.workunit.client.0.smithi114.stdout:8/232: link da/d1d/l24 da/d38/l41 0 2024-04-25T02:27:05.604 INFO:tasks.workunit.client.0.smithi114.stdout:7/229: dwrite d5/f6 [0,4194304] 0 2024-04-25T02:27:05.606 INFO:tasks.workunit.client.0.smithi114.stdout:1/192: mkdir df/d11/d25/d33/d47 0 2024-04-25T02:27:05.607 INFO:tasks.workunit.client.0.smithi114.stdout:3/162: creat d0/f38 x:0 0 0 2024-04-25T02:27:05.607 INFO:tasks.workunit.client.0.smithi114.stdout:9/208: fsync d8/f1d 0 2024-04-25T02:27:05.607 INFO:tasks.workunit.client.0.smithi114.stdout:7/230: read d5/fa [2694268,57561] 0 2024-04-25T02:27:05.608 INFO:tasks.workunit.client.0.smithi114.stdout:7/231: readlink d5/l46 0 2024-04-25T02:27:05.609 INFO:tasks.workunit.client.0.smithi114.stdout:6/266: write de/d27/f2d [650927,98218] 0 2024-04-25T02:27:05.610 INFO:tasks.workunit.client.0.smithi114.stdout:7/232: write d5/d19/d1a/f3b [2676094,12619] 0 2024-04-25T02:27:05.611 INFO:tasks.workunit.client.0.smithi114.stdout:5/212: rename d1/d6/c29 to d1/d3e/c49 0 2024-04-25T02:27:05.612 INFO:tasks.workunit.client.0.smithi114.stdout:2/242: fsync d5/df/d1e/f38 0 2024-04-25T02:27:05.612 INFO:tasks.workunit.client.0.smithi114.stdout:2/243: dread - d5/d3c/f4e zero size 2024-04-25T02:27:05.614 INFO:tasks.workunit.client.0.smithi114.stdout:8/233: creat da/d38/d35/f42 x:0 0 0 2024-04-25T02:27:05.615 INFO:tasks.workunit.client.0.smithi114.stdout:1/193: unlink df/l31 0 2024-04-25T02:27:05.616 INFO:tasks.workunit.client.0.smithi114.stdout:0/234: dread d1/d7/f14 [0,4194304] 0 2024-04-25T02:27:05.616 INFO:tasks.workunit.client.0.smithi114.stdout:9/209: symlink d8/d16/d2f/d39/l48 0 2024-04-25T02:27:05.617 INFO:tasks.workunit.client.0.smithi114.stdout:9/210: fdatasync d8/f1f 0 2024-04-25T02:27:05.623 INFO:tasks.workunit.client.0.smithi114.stdout:9/211: dwrite d8/d16/f27 [0,4194304] 0 2024-04-25T02:27:05.624 INFO:tasks.workunit.client.0.smithi114.stdout:2/244: mkdir d5/d6/d58 0 2024-04-25T02:27:05.624 INFO:tasks.workunit.client.0.smithi114.stdout:7/233: fdatasync d5/f6 0 2024-04-25T02:27:05.625 INFO:tasks.workunit.client.0.smithi114.stdout:1/194: readlink df/d11/d32/l2f 0 2024-04-25T02:27:05.626 INFO:tasks.workunit.client.0.smithi114.stdout:0/235: mkdir d1/d7/d46 0 2024-04-25T02:27:05.627 INFO:tasks.workunit.client.0.smithi114.stdout:3/163: getdents d0/d25/d2a/d34 0 2024-04-25T02:27:05.629 INFO:tasks.workunit.client.0.smithi114.stdout:5/213: chown d1/d6/d1a/c45 0 1 2024-04-25T02:27:05.630 INFO:tasks.workunit.client.0.smithi114.stdout:8/234: mknod da/d32/d3b/d40/c43 0 2024-04-25T02:27:05.631 INFO:tasks.workunit.client.0.smithi114.stdout:8/235: write da/f31 [323397,15234] 0 2024-04-25T02:27:05.632 INFO:tasks.workunit.client.0.smithi114.stdout:9/212: creat d8/f49 x:0 0 0 2024-04-25T02:27:05.633 INFO:tasks.workunit.client.0.smithi114.stdout:2/245: dread d5/d6/f55 [0,4194304] 0 2024-04-25T02:27:05.637 INFO:tasks.workunit.client.0.smithi114.stdout:6/267: dread de/ff [0,4194304] 0 2024-04-25T02:27:05.638 INFO:tasks.workunit.client.0.smithi114.stdout:8/236: creat da/d32/d3b/f44 x:0 0 0 2024-04-25T02:27:05.639 INFO:tasks.workunit.client.0.smithi114.stdout:6/268: dread de/f1f [0,4194304] 0 2024-04-25T02:27:05.640 INFO:tasks.workunit.client.0.smithi114.stdout:7/234: creat d5/d43/d4e/f4f x:0 0 0 2024-04-25T02:27:05.641 INFO:tasks.workunit.client.0.smithi114.stdout:1/195: mknod df/d11/c48 0 2024-04-25T02:27:05.643 INFO:tasks.workunit.client.0.smithi114.stdout:1/196: write df/d11/d25/f37 [323968,57942] 0 2024-04-25T02:27:05.644 INFO:tasks.workunit.client.0.smithi114.stdout:3/164: link d0/d25/f2d d0/d25/d29/f39 0 2024-04-25T02:27:05.646 INFO:tasks.workunit.client.0.smithi114.stdout:7/235: dwrite d5/f9 [0,4194304] 0 2024-04-25T02:27:05.646 INFO:tasks.workunit.client.0.smithi114.stdout:5/214: creat d1/d6/de/f4a x:0 0 0 2024-04-25T02:27:05.647 INFO:tasks.workunit.client.0.smithi114.stdout:9/213: write d8/d16/d21/f22 [4225676,62538] 0 2024-04-25T02:27:05.648 INFO:tasks.workunit.client.0.smithi114.stdout:6/269: creat de/d30/f6b x:0 0 0 2024-04-25T02:27:05.651 INFO:tasks.workunit.client.0.smithi114.stdout:3/165: dwrite d0/f12 [0,4194304] 0 2024-04-25T02:27:05.657 INFO:tasks.workunit.client.0.smithi114.stdout:8/237: truncate da/f2f 5644479 0 2024-04-25T02:27:05.657 INFO:tasks.workunit.client.0.smithi114.stdout:8/238: write da/d1d/f3f [257843,11180] 0 2024-04-25T02:27:05.681 INFO:tasks.workunit.client.0.smithi114.stdout:5/215: creat d1/d6/de/f4b x:0 0 0 2024-04-25T02:27:05.682 INFO:tasks.workunit.client.0.smithi114.stdout:9/214: rename d8/d16/d2f/d39/l48 to d8/d16/d21/d37/l4a 0 2024-04-25T02:27:05.682 INFO:tasks.workunit.client.0.smithi114.stdout:1/197: getdents df/d11/d25/d33/d47 0 2024-04-25T02:27:05.683 INFO:tasks.workunit.client.0.smithi114.stdout:1/198: fdatasync df/d11/f24 0 2024-04-25T02:27:05.683 INFO:tasks.workunit.client.0.smithi114.stdout:9/215: stat d8/d16/d21/d24/d3c/f45 0 2024-04-25T02:27:05.686 INFO:tasks.workunit.client.0.smithi114.stdout:5/216: rmdir d1/d25/d24 39 2024-04-25T02:27:05.686 INFO:tasks.workunit.client.0.smithi114.stdout:8/239: truncate da/d1e/f3d 803106 0 2024-04-25T02:27:05.687 INFO:tasks.workunit.client.0.smithi114.stdout:5/217: chown d1/d6/d1a/c2d 116 1 2024-04-25T02:27:05.687 INFO:tasks.workunit.client.0.smithi114.stdout:8/240: chown da/d32/d3b/d40/c43 1544030 1 2024-04-25T02:27:05.688 INFO:tasks.workunit.client.0.smithi114.stdout:9/216: symlink d8/d16/d21/l4b 0 2024-04-25T02:27:05.689 INFO:tasks.workunit.client.0.smithi114.stdout:1/199: mknod df/d13/d44/c49 0 2024-04-25T02:27:05.690 INFO:tasks.workunit.client.0.smithi114.stdout:5/218: creat d1/d6/de/f4c x:0 0 0 2024-04-25T02:27:05.690 INFO:tasks.workunit.client.0.smithi114.stdout:6/270: link de/d30/c32 de/d27/d34/c6c 0 2024-04-25T02:27:05.692 INFO:tasks.workunit.client.0.smithi114.stdout:9/217: unlink l4 0 2024-04-25T02:27:05.693 INFO:tasks.workunit.client.0.smithi114.stdout:6/271: truncate de/d30/f6b 608635 0 2024-04-25T02:27:05.694 INFO:tasks.workunit.client.0.smithi114.stdout:8/241: dwrite da/d1e/f2e [0,4194304] 0 2024-04-25T02:27:05.695 INFO:tasks.workunit.client.0.smithi114.stdout:5/219: symlink d1/d3e/l4d 0 2024-04-25T02:27:05.696 INFO:tasks.workunit.client.0.smithi114.stdout:9/218: symlink d8/d16/d2f/d39/d38/d46/l4c 0 2024-04-25T02:27:05.700 INFO:tasks.workunit.client.0.smithi114.stdout:8/242: dwrite da/d38/f34 [0,4194304] 0 2024-04-25T02:27:05.701 INFO:tasks.workunit.client.0.smithi114.stdout:8/243: write da/d32/d3b/f44 [1008619,26568] 0 2024-04-25T02:27:05.703 INFO:tasks.workunit.client.0.smithi114.stdout:8/244: write da/d1e/f29 [934302,19605] 0 2024-04-25T02:27:05.707 INFO:tasks.workunit.client.0.smithi114.stdout:8/245: rename da/f27 to da/d32/d3b/d40/f45 0 2024-04-25T02:27:05.711 INFO:tasks.workunit.client.0.smithi114.stdout:8/246: dread da/d1e/f2e [0,4194304] 0 2024-04-25T02:27:05.711 INFO:tasks.workunit.client.0.smithi114.stdout:9/219: link d8/l1c d8/d16/d21/d37/d43/l4d 0 2024-04-25T02:27:05.712 INFO:tasks.workunit.client.0.smithi114.stdout:8/247: creat da/d38/d35/f46 x:0 0 0 2024-04-25T02:27:05.714 INFO:tasks.workunit.client.0.smithi114.stdout:8/248: rmdir da/d38 39 2024-04-25T02:27:05.715 INFO:tasks.workunit.client.0.smithi114.stdout:9/220: rename d8/f1d to d8/d16/d21/d24/f4e 0 2024-04-25T02:27:05.716 INFO:tasks.workunit.client.0.smithi114.stdout:8/249: read da/d1e/f29 [112126,78236] 0 2024-04-25T02:27:05.716 INFO:tasks.workunit.client.0.smithi114.stdout:9/221: write d8/f1f [205221,18686] 0 2024-04-25T02:27:05.721 INFO:tasks.workunit.client.0.smithi114.stdout:9/222: symlink d8/d16/d21/d24/d3c/d40/l4f 0 2024-04-25T02:27:05.721 INFO:tasks.workunit.client.0.smithi114.stdout:8/250: link l5 da/d1d/l47 0 2024-04-25T02:27:05.722 INFO:tasks.workunit.client.0.smithi114.stdout:8/251: stat da/l23 0 2024-04-25T02:27:05.722 INFO:tasks.workunit.client.0.smithi114.stdout:9/223: write d8/d16/d21/d37/f3b [4118258,61761] 0 2024-04-25T02:27:05.725 INFO:tasks.workunit.client.0.smithi114.stdout:8/252: unlink da/d1d/c1c 0 2024-04-25T02:27:05.726 INFO:tasks.workunit.client.0.smithi114.stdout:9/224: mknod d8/d16/d21/d24/c50 0 2024-04-25T02:27:05.727 INFO:tasks.workunit.client.0.smithi114.stdout:3/166: sync 2024-04-25T02:27:05.727 INFO:tasks.workunit.client.0.smithi114.stdout:7/236: sync 2024-04-25T02:27:05.728 INFO:tasks.workunit.client.0.smithi114.stdout:9/225: mknod d8/d16/d2f/d39/d38/c51 0 2024-04-25T02:27:05.728 INFO:tasks.workunit.client.0.smithi114.stdout:8/253: dread da/d1d/f36 [0,4194304] 0 2024-04-25T02:27:05.730 INFO:tasks.workunit.client.0.smithi114.stdout:3/167: creat d0/d25/d2a/f3a x:0 0 0 2024-04-25T02:27:05.731 INFO:tasks.workunit.client.0.smithi114.stdout:9/226: fdatasync d8/d16/d21/f26 0 2024-04-25T02:27:05.736 INFO:tasks.workunit.client.0.smithi114.stdout:7/237: dwrite d5/d32/f2f [0,4194304] 0 2024-04-25T02:27:05.738 INFO:tasks.workunit.client.0.smithi114.stdout:8/254: dwrite da/d32/f37 [0,4194304] 0 2024-04-25T02:27:05.738 INFO:tasks.workunit.client.0.smithi114.stdout:3/168: dread d0/f1d [4194304,4194304] 0 2024-04-25T02:27:05.739 INFO:tasks.workunit.client.0.smithi114.stdout:8/255: chown da/l23 106725432 1 2024-04-25T02:27:05.739 INFO:tasks.workunit.client.0.smithi114.stdout:7/238: mkdir d5/d43/d50 0 2024-04-25T02:27:05.740 INFO:tasks.workunit.client.0.smithi114.stdout:8/256: write da/d32/f39 [868387,96913] 0 2024-04-25T02:27:05.740 INFO:tasks.workunit.client.0.smithi114.stdout:7/239: write d5/d19/f2a [718307,79198] 0 2024-04-25T02:27:05.741 INFO:tasks.workunit.client.0.smithi114.stdout:7/240: chown d5/f9 108 1 2024-04-25T02:27:05.741 INFO:tasks.workunit.client.0.smithi114.stdout:7/241: stat d5/d32/f2f 0 2024-04-25T02:27:05.744 INFO:tasks.workunit.client.0.smithi114.stdout:8/257: unlink da/d1d/l3a 0 2024-04-25T02:27:05.746 INFO:tasks.workunit.client.0.smithi114.stdout:3/169: creat d0/f3b x:0 0 0 2024-04-25T02:27:05.749 INFO:tasks.workunit.client.0.smithi114.stdout:7/242: dread d5/d19/f41 [0,4194304] 0 2024-04-25T02:27:05.750 INFO:tasks.workunit.client.0.smithi114.stdout:7/243: write d5/f6 [324516,22021] 0 2024-04-25T02:27:05.750 INFO:tasks.workunit.client.0.smithi114.stdout:8/258: creat da/d1e/f48 x:0 0 0 2024-04-25T02:27:05.751 INFO:tasks.workunit.client.0.smithi114.stdout:8/259: stat da/d32/f39 0 2024-04-25T02:27:05.752 INFO:tasks.workunit.client.0.smithi114.stdout:3/170: rename d0/d25/f27 to d0/d25/d2a/d36/f3c 0 2024-04-25T02:27:05.752 INFO:tasks.workunit.client.0.smithi114.stdout:3/171: read - d0/f3b zero size 2024-04-25T02:27:05.753 INFO:tasks.workunit.client.0.smithi114.stdout:3/172: truncate d0/d25/d29/f39 603668 0 2024-04-25T02:27:05.755 INFO:tasks.workunit.client.0.smithi114.stdout:7/244: mkdir d5/d32/d4a/d51 0 2024-04-25T02:27:05.756 INFO:tasks.workunit.client.0.smithi114.stdout:3/173: mkdir d0/d5/d3d 0 2024-04-25T02:27:05.762 INFO:tasks.workunit.client.0.smithi114.stdout:3/174: creat d0/f3e x:0 0 0 2024-04-25T02:27:05.763 INFO:tasks.workunit.client.0.smithi114.stdout:3/175: fdatasync d0/d25/d2a/d36/f3c 0 2024-04-25T02:27:05.764 INFO:tasks.workunit.client.0.smithi114.stdout:3/176: chown d0/f3 2 1 2024-04-25T02:27:05.780 INFO:tasks.workunit.client.0.smithi114.stdout:4/165: dwrite d3/d8/d12/d19/f1a [0,4194304] 0 2024-04-25T02:27:05.807 INFO:tasks.workunit.client.0.smithi114.stdout:0/236: truncate d1/d7/d18/f2f 258887 0 2024-04-25T02:27:05.808 INFO:tasks.workunit.client.0.smithi114.stdout:2/246: truncate d5/f1d 1838895 0 2024-04-25T02:27:05.809 INFO:tasks.workunit.client.0.smithi114.stdout:6/272: truncate de/d25/d39/f5f 1591143 0 2024-04-25T02:27:05.809 INFO:tasks.workunit.client.0.smithi114.stdout:2/247: truncate d5/df/d3d/f42 287854 0 2024-04-25T02:27:05.810 INFO:tasks.workunit.client.0.smithi114.stdout:6/273: write de/f16 [7892860,3420] 0 2024-04-25T02:27:05.814 INFO:tasks.workunit.client.0.smithi114.stdout:7/245: rmdir d5 39 2024-04-25T02:27:05.815 INFO:tasks.workunit.client.0.smithi114.stdout:4/166: creat d3/d8/d23/d25/f2d x:0 0 0 2024-04-25T02:27:05.816 INFO:tasks.workunit.client.0.smithi114.stdout:1/200: dwrite df/f19 [0,4194304] 0 2024-04-25T02:27:05.816 INFO:tasks.workunit.client.0.smithi114.stdout:5/220: write d1/d6/f2b [581947,19205] 0 2024-04-25T02:27:05.819 INFO:tasks.workunit.client.0.smithi114.stdout:6/274: dread de/f59 [0,4194304] 0 2024-04-25T02:27:05.821 INFO:tasks.workunit.client.0.smithi114.stdout:4/167: write d3/d8/d12/f1e [275933,44769] 0 2024-04-25T02:27:05.823 INFO:tasks.workunit.client.0.smithi114.stdout:4/168: readlink d3/le 0 2024-04-25T02:27:05.823 INFO:tasks.workunit.client.0.smithi114.stdout:2/248: dwrite d5/fe [4194304,4194304] 0 2024-04-25T02:27:05.824 INFO:tasks.workunit.client.0.smithi114.stdout:8/260: dwrite da/d38/d35/f2c [0,4194304] 0 2024-04-25T02:27:05.824 INFO:tasks.workunit.client.0.smithi114.stdout:2/249: chown d5/df/f11 1750 1 2024-04-25T02:27:05.825 INFO:tasks.workunit.client.0.smithi114.stdout:7/246: symlink d5/d43/d50/l52 0 2024-04-25T02:27:05.826 INFO:tasks.workunit.client.0.smithi114.stdout:9/227: sync 2024-04-25T02:27:05.829 INFO:tasks.workunit.client.0.smithi114.stdout:2/250: fsync d5/d1c/d22/f24 0 2024-04-25T02:27:05.831 INFO:tasks.workunit.client.0.smithi114.stdout:7/247: symlink d5/d32/d4a/l53 0 2024-04-25T02:27:05.831 INFO:tasks.workunit.client.0.smithi114.stdout:2/251: write d5/fd [472419,81412] 0 2024-04-25T02:27:05.832 INFO:tasks.workunit.client.0.smithi114.stdout:9/228: mknod d8/d16/c52 0 2024-04-25T02:27:05.833 INFO:tasks.workunit.client.0.smithi114.stdout:6/275: dwrite de/d30/f49 [0,4194304] 0 2024-04-25T02:27:05.841 INFO:tasks.workunit.client.0.smithi114.stdout:7/248: fsync d5/d19/f27 0 2024-04-25T02:27:05.841 INFO:tasks.workunit.client.0.smithi114.stdout:7/249: stat d5/d32/d4a/l53 0 2024-04-25T02:27:05.842 INFO:tasks.workunit.client.0.smithi114.stdout:5/221: rename d1/d6/f39 to d1/d25/f4e 0 2024-04-25T02:27:05.842 INFO:tasks.workunit.client.0.smithi114.stdout:9/229: mkdir d8/d16/d2f/d39/d38/d46/d53 0 2024-04-25T02:27:05.843 INFO:tasks.workunit.client.0.smithi114.stdout:6/276: symlink de/d1c/l6d 0 2024-04-25T02:27:05.845 INFO:tasks.workunit.client.0.smithi114.stdout:9/230: symlink d8/d16/d2f/d39/l54 0 2024-04-25T02:27:05.846 INFO:tasks.workunit.client.0.smithi114.stdout:9/231: fsync d8/f42 0 2024-04-25T02:27:05.846 INFO:tasks.workunit.client.0.smithi114.stdout:6/277: mknod de/d25/d39/c6e 0 2024-04-25T02:27:05.846 INFO:tasks.workunit.client.0.smithi114.stdout:9/232: readlink d8/d16/d2f/d39/d38/d46/l4c 0 2024-04-25T02:27:05.847 INFO:tasks.workunit.client.0.smithi114.stdout:5/222: mkdir d1/d6/d4f 0 2024-04-25T02:27:05.847 INFO:tasks.workunit.client.0.smithi114.stdout:6/278: truncate de/d25/d39/f5e 790672 0 2024-04-25T02:27:05.847 INFO:tasks.workunit.client.0.smithi114.stdout:9/233: dread - d8/d16/d21/d24/f47 zero size 2024-04-25T02:27:05.848 INFO:tasks.workunit.client.0.smithi114.stdout:6/279: write de/d27/d34/d44/f55 [324551,59970] 0 2024-04-25T02:27:05.849 INFO:tasks.workunit.client.0.smithi114.stdout:6/280: dread - de/d27/d34/d4b/f53 zero size 2024-04-25T02:27:05.849 INFO:tasks.workunit.client.0.smithi114.stdout:6/281: chown de/d25/d39 3250390 1 2024-04-25T02:27:05.850 INFO:tasks.workunit.client.0.smithi114.stdout:6/282: write de/f1d [308754,39835] 0 2024-04-25T02:27:05.851 INFO:tasks.workunit.client.0.smithi114.stdout:3/177: sync 2024-04-25T02:27:05.851 INFO:tasks.workunit.client.0.smithi114.stdout:3/178: fsync d0/f16 0 2024-04-25T02:27:05.852 INFO:tasks.workunit.client.0.smithi114.stdout:3/179: write d0/f12 [1462854,36932] 0 2024-04-25T02:27:05.852 INFO:tasks.workunit.client.0.smithi114.stdout:3/180: readlink d0/l2b 0 2024-04-25T02:27:05.857 INFO:tasks.workunit.client.0.smithi114.stdout:6/283: creat de/d25/d39/d5c/f6f x:0 0 0 2024-04-25T02:27:05.860 INFO:tasks.workunit.client.0.smithi114.stdout:6/284: creat de/d27/d34/d38/f70 x:0 0 0 2024-04-25T02:27:05.863 INFO:tasks.workunit.client.0.smithi114.stdout:6/285: truncate de/f1f 1836212 0 2024-04-25T02:27:05.863 INFO:tasks.workunit.client.0.smithi114.stdout:3/181: dwrite d0/f2c [0,4194304] 0 2024-04-25T02:27:05.866 INFO:tasks.workunit.client.0.smithi114.stdout:6/286: creat de/d27/d34/d44/f71 x:0 0 0 2024-04-25T02:27:05.866 INFO:tasks.workunit.client.0.smithi114.stdout:7/250: getdents d5/d32/d4a 0 2024-04-25T02:27:05.867 INFO:tasks.workunit.client.0.smithi114.stdout:3/182: mkdir d0/d25/d2a/d36/d3f 0 2024-04-25T02:27:05.869 INFO:tasks.workunit.client.0.smithi114.stdout:1/201: truncate df/d2a/f46 2175943 0 2024-04-25T02:27:05.869 INFO:tasks.workunit.client.0.smithi114.stdout:1/202: readlink l3 0 2024-04-25T02:27:05.870 INFO:tasks.workunit.client.0.smithi114.stdout:4/169: truncate d3/f5 4073803 0 2024-04-25T02:27:05.871 INFO:tasks.workunit.client.0.smithi114.stdout:7/251: mkdir d5/d54 0 2024-04-25T02:27:05.872 INFO:tasks.workunit.client.0.smithi114.stdout:7/252: chown d5/f49 984323 1 2024-04-25T02:27:05.873 INFO:tasks.workunit.client.0.smithi114.stdout:2/252: truncate d5/d1c/d22/f24 1074708 0 2024-04-25T02:27:05.874 INFO:tasks.workunit.client.0.smithi114.stdout:1/203: mknod df/d2a/c4a 0 2024-04-25T02:27:05.875 INFO:tasks.workunit.client.0.smithi114.stdout:7/253: dread d5/f6 [0,4194304] 0 2024-04-25T02:27:05.876 INFO:tasks.workunit.client.0.smithi114.stdout:6/287: link de/d25/d39/d47/f60 de/d30/f72 0 2024-04-25T02:27:05.877 INFO:tasks.workunit.client.0.smithi114.stdout:6/288: write de/d2a/f2b [3509887,29015] 0 2024-04-25T02:27:05.877 INFO:tasks.workunit.client.0.smithi114.stdout:8/261: truncate da/d38/f34 1643672 0 2024-04-25T02:27:05.877 INFO:tasks.workunit.client.0.smithi114.stdout:6/289: readlink de/d1c/l6d 0 2024-04-25T02:27:05.878 INFO:tasks.workunit.client.0.smithi114.stdout:8/262: write da/d1e/f30 [2090130,56838] 0 2024-04-25T02:27:05.878 INFO:tasks.workunit.client.0.smithi114.stdout:3/183: creat d0/d5/d3d/f40 x:0 0 0 2024-04-25T02:27:05.880 INFO:tasks.workunit.client.0.smithi114.stdout:2/253: mkdir d5/d3c/d59 0 2024-04-25T02:27:05.882 INFO:tasks.workunit.client.0.smithi114.stdout:8/263: dread da/d38/d35/f2c [0,4194304] 0 2024-04-25T02:27:05.883 INFO:tasks.workunit.client.0.smithi114.stdout:7/254: creat d5/d19/d23/f55 x:0 0 0 2024-04-25T02:27:05.886 INFO:tasks.workunit.client.0.smithi114.stdout:9/234: getdents d8/d16/d2f/d39 0 2024-04-25T02:27:05.889 INFO:tasks.workunit.client.0.smithi114.stdout:3/184: rmdir d0/d25/d29 39 2024-04-25T02:27:05.893 INFO:tasks.workunit.client.0.smithi114.stdout:8/264: mkdir da/d38/d35/d49 0 2024-04-25T02:27:05.895 INFO:tasks.workunit.client.0.smithi114.stdout:9/235: symlink d8/d16/d21/d24/l55 0 2024-04-25T02:27:05.902 INFO:tasks.workunit.client.0.smithi114.stdout:1/204: creat df/d11/d25/f4b x:0 0 0 2024-04-25T02:27:05.903 INFO:tasks.workunit.client.0.smithi114.stdout:4/170: getdents d3/d8 0 2024-04-25T02:27:05.903 INFO:tasks.workunit.client.0.smithi114.stdout:1/205: dread - df/d11/f20 zero size 2024-04-25T02:27:05.903 INFO:tasks.workunit.client.0.smithi114.stdout:1/206: stat df/l12 0 2024-04-25T02:27:05.903 INFO:tasks.workunit.client.0.smithi114.stdout:4/171: fdatasync d3/d8/d12/f1e 0 2024-04-25T02:27:05.904 INFO:tasks.workunit.client.0.smithi114.stdout:8/265: symlink da/d32/d3b/d40/l4a 0 2024-04-25T02:27:05.904 INFO:tasks.workunit.client.0.smithi114.stdout:4/172: readlink d3/d8/l13 0 2024-04-25T02:27:05.907 INFO:tasks.workunit.client.0.smithi114.stdout:3/185: mkdir d0/d41 0 2024-04-25T02:27:05.909 INFO:tasks.workunit.client.0.smithi114.stdout:2/254: rename d5/d3c to d5/d6/d58/d5a 0 2024-04-25T02:27:05.911 INFO:tasks.workunit.client.0.smithi114.stdout:4/173: mknod d3/d14/c2e 0 2024-04-25T02:27:05.913 INFO:tasks.workunit.client.0.smithi114.stdout:3/186: dwrite d0/d5/f31 [0,4194304] 0 2024-04-25T02:27:05.913 INFO:tasks.workunit.client.0.smithi114.stdout:9/236: rename d8/d16/d2f/d39/l1a to d8/d16/d21/d37/l56 0 2024-04-25T02:27:05.916 INFO:tasks.workunit.client.0.smithi114.stdout:2/255: symlink d5/d1c/d21/l5b 0 2024-04-25T02:27:05.917 INFO:tasks.workunit.client.0.smithi114.stdout:1/207: creat df/d11/d25/f4c x:0 0 0 2024-04-25T02:27:05.918 INFO:tasks.workunit.client.0.smithi114.stdout:0/237: sync 2024-04-25T02:27:05.918 INFO:tasks.workunit.client.0.smithi114.stdout:4/174: mknod d3/d8/d12/d19/d26/c2f 0 2024-04-25T02:27:05.919 INFO:tasks.workunit.client.0.smithi114.stdout:6/290: write f5 [1849260,124502] 0 2024-04-25T02:27:05.921 INFO:tasks.workunit.client.0.smithi114.stdout:9/237: mknod d8/d16/d21/d37/c57 0 2024-04-25T02:27:05.922 INFO:tasks.workunit.client.0.smithi114.stdout:2/256: creat d5/d1c/d29/f5c x:0 0 0 2024-04-25T02:27:05.923 INFO:tasks.workunit.client.0.smithi114.stdout:2/257: truncate d5/d6/f51 955154 0 2024-04-25T02:27:05.924 INFO:tasks.workunit.client.0.smithi114.stdout:0/238: readlink d1/l13 0 2024-04-25T02:27:05.928 INFO:tasks.workunit.client.0.smithi114.stdout:0/239: read d1/d30/f32 [1634307,32089] 0 2024-04-25T02:27:05.929 INFO:tasks.workunit.client.0.smithi114.stdout:9/238: creat d8/d16/d21/d24/d3c/d40/f58 x:0 0 0 2024-04-25T02:27:05.930 INFO:tasks.workunit.client.0.smithi114.stdout:0/240: chown d1/d4/d37 1326 1 2024-04-25T02:27:05.932 INFO:tasks.workunit.client.0.smithi114.stdout:1/208: dwrite df/d13/d1e/f21 [0,4194304] 0 2024-04-25T02:27:05.934 INFO:tasks.workunit.client.0.smithi114.stdout:2/258: dwrite d5/df/d3d/d44/f56 [0,4194304] 0 2024-04-25T02:27:05.934 INFO:tasks.workunit.client.0.smithi114.stdout:6/291: dread de/d25/d39/f5f [0,4194304] 0 2024-04-25T02:27:05.934 INFO:tasks.workunit.client.0.smithi114.stdout:0/241: write d1/d4/d24/f25 [921943,46215] 0 2024-04-25T02:27:05.935 INFO:tasks.workunit.client.0.smithi114.stdout:3/187: link d0/f1d d0/d5/d3d/f42 0 2024-04-25T02:27:05.935 INFO:tasks.workunit.client.0.smithi114.stdout:5/223: sync 2024-04-25T02:27:05.936 INFO:tasks.workunit.client.0.smithi114.stdout:2/259: fdatasync d5/df/d1e/f25 0 2024-04-25T02:27:05.936 INFO:tasks.workunit.client.0.smithi114.stdout:5/224: chown d1 0 1 2024-04-25T02:27:05.937 INFO:tasks.workunit.client.0.smithi114.stdout:5/225: readlink d1/d6/d1a/l41 0 2024-04-25T02:27:05.940 INFO:tasks.workunit.client.0.smithi114.stdout:9/239: creat d8/f59 x:0 0 0 2024-04-25T02:27:05.941 INFO:tasks.workunit.client.0.smithi114.stdout:3/188: creat d0/d5/f43 x:0 0 0 2024-04-25T02:27:05.943 INFO:tasks.workunit.client.0.smithi114.stdout:3/189: write d0/d25/f2e [2377995,40981] 0 2024-04-25T02:27:05.944 INFO:tasks.workunit.client.0.smithi114.stdout:0/242: dwrite d1/d7/d18/f22 [0,4194304] 0 2024-04-25T02:27:05.945 INFO:tasks.workunit.client.0.smithi114.stdout:3/190: write d0/f12 [4372678,52777] 0 2024-04-25T02:27:05.946 INFO:tasks.workunit.client.0.smithi114.stdout:2/260: creat d5/d6/d58/d5a/f5d x:0 0 0 2024-04-25T02:27:05.949 INFO:tasks.workunit.client.0.smithi114.stdout:9/240: dwrite d8/d16/d21/f26 [0,4194304] 0 2024-04-25T02:27:05.949 INFO:tasks.workunit.client.0.smithi114.stdout:2/261: fdatasync d5/df/f43 0 2024-04-25T02:27:05.951 INFO:tasks.workunit.client.0.smithi114.stdout:6/292: link de/d30/f49 de/d2a/f73 0 2024-04-25T02:27:05.954 INFO:tasks.workunit.client.0.smithi114.stdout:0/243: dwrite d1/d7/fd [0,4194304] 0 2024-04-25T02:27:05.955 INFO:tasks.workunit.client.0.smithi114.stdout:5/226: mknod d1/d6/d4f/c50 0 2024-04-25T02:27:05.956 INFO:tasks.workunit.client.0.smithi114.stdout:8/266: dread da/d38/f34 [0,4194304] 0 2024-04-25T02:27:05.956 INFO:tasks.workunit.client.0.smithi114.stdout:8/267: chown da/d1e 13180 1 2024-04-25T02:27:05.957 INFO:tasks.workunit.client.0.smithi114.stdout:8/268: read da/f31 [29730,12254] 0 2024-04-25T02:27:05.958 INFO:tasks.workunit.client.0.smithi114.stdout:9/241: creat d8/d16/d2f/f5a x:0 0 0 2024-04-25T02:27:05.960 INFO:tasks.workunit.client.0.smithi114.stdout:2/262: unlink d5/d6/d31/l50 0 2024-04-25T02:27:05.961 INFO:tasks.workunit.client.0.smithi114.stdout:4/175: truncate d3/d8/d12/d19/f1a 2426319 0 2024-04-25T02:27:05.964 INFO:tasks.workunit.client.0.smithi114.stdout:5/227: mkdir d1/d51 0 2024-04-25T02:27:05.966 INFO:tasks.workunit.client.0.smithi114.stdout:9/242: mknod d8/d16/d21/d24/d3c/d40/c5b 0 2024-04-25T02:27:05.967 INFO:tasks.workunit.client.0.smithi114.stdout:8/269: stat l5 0 2024-04-25T02:27:05.967 INFO:tasks.workunit.client.0.smithi114.stdout:5/228: dread - d1/d6/de/f4a zero size 2024-04-25T02:27:05.968 INFO:tasks.workunit.client.0.smithi114.stdout:2/263: dwrite d5/d6/d31/f37 [0,4194304] 0 2024-04-25T02:27:05.970 INFO:tasks.workunit.client.0.smithi114.stdout:7/255: sync 2024-04-25T02:27:05.970 INFO:tasks.workunit.client.0.smithi114.stdout:4/176: dwrite d3/f28 [0,4194304] 0 2024-04-25T02:27:05.973 INFO:tasks.workunit.client.0.smithi114.stdout:4/177: write d3/d8/d23/d25/f27 [547844,26923] 0 2024-04-25T02:27:05.973 INFO:tasks.workunit.client.0.smithi114.stdout:5/229: creat d1/d6/d4f/f52 x:0 0 0 2024-04-25T02:27:05.975 INFO:tasks.workunit.client.0.smithi114.stdout:8/270: truncate da/d38/d35/f2c 3770813 0 2024-04-25T02:27:05.975 INFO:tasks.workunit.client.0.smithi114.stdout:7/256: creat d5/d32/d4a/f56 x:0 0 0 2024-04-25T02:27:05.976 INFO:tasks.workunit.client.0.smithi114.stdout:7/257: chown d5/d32/d4a 19 1 2024-04-25T02:27:05.977 INFO:tasks.workunit.client.0.smithi114.stdout:9/243: rename d8/d16/d21/d24/f4e to d8/d16/d2f/d39/d38/d46/d53/f5c 0 2024-04-25T02:27:05.979 INFO:tasks.workunit.client.0.smithi114.stdout:9/244: write d8/d16/d2f/f5a [506193,95762] 0 2024-04-25T02:27:05.981 INFO:tasks.workunit.client.0.smithi114.stdout:8/271: dwrite da/d38/d35/f46 [0,4194304] 0 2024-04-25T02:27:05.981 INFO:tasks.workunit.client.0.smithi114.stdout:5/230: unlink d1/d6/de/l2c 0 2024-04-25T02:27:05.982 INFO:tasks.workunit.client.0.smithi114.stdout:7/258: write d5/d19/d23/f3c [1143226,39789] 0 2024-04-25T02:27:05.983 INFO:tasks.workunit.client.0.smithi114.stdout:9/245: mkdir d8/d16/d2f/d39/d38/d5d 0 2024-04-25T02:27:05.984 INFO:tasks.workunit.client.0.smithi114.stdout:5/231: mkdir d1/d53 0 2024-04-25T02:27:05.986 INFO:tasks.workunit.client.0.smithi114.stdout:8/272: creat da/d38/d35/d49/f4b x:0 0 0 2024-04-25T02:27:05.987 INFO:tasks.workunit.client.0.smithi114.stdout:7/259: creat d5/d54/f57 x:0 0 0 2024-04-25T02:27:05.988 INFO:tasks.workunit.client.0.smithi114.stdout:5/232: creat d1/f54 x:0 0 0 2024-04-25T02:27:05.988 INFO:tasks.workunit.client.0.smithi114.stdout:5/233: chown d1/d6/d1a/l1c 1881556035 1 2024-04-25T02:27:05.989 INFO:tasks.workunit.client.0.smithi114.stdout:9/246: creat d8/d16/d2f/d39/d38/d46/d53/f5e x:0 0 0 2024-04-25T02:27:05.989 INFO:tasks.workunit.client.0.smithi114.stdout:5/234: chown d1/d6/de/f4b 6509456 1 2024-04-25T02:27:05.990 INFO:tasks.workunit.client.0.smithi114.stdout:5/235: chown d1/d6/d1a/c2d 0 1 2024-04-25T02:27:05.991 INFO:tasks.workunit.client.0.smithi114.stdout:7/260: creat d5/d19/d23/f58 x:0 0 0 2024-04-25T02:27:05.992 INFO:tasks.workunit.client.0.smithi114.stdout:9/247: unlink d8/d16/f2c 0 2024-04-25T02:27:05.994 INFO:tasks.workunit.client.0.smithi114.stdout:5/236: mkdir d1/d53/d55 0 2024-04-25T02:27:05.997 INFO:tasks.workunit.client.0.smithi114.stdout:5/237: symlink d1/d6/d1a/l56 0 2024-04-25T02:27:06.022 INFO:tasks.workunit.client.0.smithi114.stdout:0/244: dread d1/f10 [0,4194304] 0 2024-04-25T02:27:06.022 INFO:tasks.workunit.client.0.smithi114.stdout:2/264: dwrite d5/df/d3d/d44/f56 [4194304,4194304] 0 2024-04-25T02:27:06.024 INFO:tasks.workunit.client.0.smithi114.stdout:6/293: dread de/d27/f4e [0,4194304] 0 2024-04-25T02:27:06.025 INFO:tasks.workunit.client.0.smithi114.stdout:5/238: chown d1/d6/d1a/l41 462786765 1 2024-04-25T02:27:06.025 INFO:tasks.workunit.client.0.smithi114.stdout:9/248: dwrite d8/f17 [0,4194304] 0 2024-04-25T02:27:06.026 INFO:tasks.workunit.client.0.smithi114.stdout:3/191: write d0/f1d [2874964,72561] 0 2024-04-25T02:27:06.028 INFO:tasks.workunit.client.0.smithi114.stdout:2/265: creat d5/df/d3d/f5e x:0 0 0 2024-04-25T02:27:06.028 INFO:tasks.workunit.client.0.smithi114.stdout:9/249: write d8/f42 [658712,98968] 0 2024-04-25T02:27:06.030 INFO:tasks.workunit.client.0.smithi114.stdout:9/250: chown d8/fa 861 1 2024-04-25T02:27:06.031 INFO:tasks.workunit.client.0.smithi114.stdout:4/178: dread d3/d8/d12/d19/f1a [0,4194304] 0 2024-04-25T02:27:06.031 INFO:tasks.workunit.client.0.smithi114.stdout:5/239: chown d1/d25/d24/f3b 2 1 2024-04-25T02:27:06.032 INFO:tasks.workunit.client.0.smithi114.stdout:3/192: creat d0/d5/f44 x:0 0 0 2024-04-25T02:27:06.033 INFO:tasks.workunit.client.0.smithi114.stdout:5/240: fsync d1/d6/de/f1e 0 2024-04-25T02:27:06.033 INFO:tasks.workunit.client.0.smithi114.stdout:4/179: fsync d3/d8/d23/d25/f2d 0 2024-04-25T02:27:06.034 INFO:tasks.workunit.client.0.smithi114.stdout:6/294: dwrite de/d2a/f3a [0,4194304] 0 2024-04-25T02:27:06.035 INFO:tasks.workunit.client.0.smithi114.stdout:4/180: dread - d3/d8/d12/d19/d26/f2a zero size 2024-04-25T02:27:06.036 INFO:tasks.workunit.client.0.smithi114.stdout:2/266: truncate d5/d6/f55 470629 0 2024-04-25T02:27:06.037 INFO:tasks.workunit.client.0.smithi114.stdout:4/181: chown d3/d8/d23/d25 1899 1 2024-04-25T02:27:06.039 INFO:tasks.workunit.client.0.smithi114.stdout:9/251: creat d8/d16/d2f/f5f x:0 0 0 2024-04-25T02:27:06.040 INFO:tasks.workunit.client.0.smithi114.stdout:5/241: dwrite d1/d25/d24/f2e [0,4194304] 0 2024-04-25T02:27:06.042 INFO:tasks.workunit.client.0.smithi114.stdout:4/182: dread d3/d14/f21 [4194304,4194304] 0 2024-04-25T02:27:06.046 INFO:tasks.workunit.client.0.smithi114.stdout:6/295: symlink de/d25/l74 0 2024-04-25T02:27:06.047 INFO:tasks.workunit.client.0.smithi114.stdout:6/296: read de/d25/d39/d47/f5d [1340498,86111] 0 2024-04-25T02:27:06.049 INFO:tasks.workunit.client.0.smithi114.stdout:5/242: dread d1/d6/de/f1e [0,4194304] 0 2024-04-25T02:27:06.049 INFO:tasks.workunit.client.0.smithi114.stdout:3/193: symlink d0/l45 0 2024-04-25T02:27:06.050 INFO:tasks.workunit.client.0.smithi114.stdout:3/194: readlink d0/d5/l2f 0 2024-04-25T02:27:06.052 INFO:tasks.workunit.client.0.smithi114.stdout:9/252: fsync d8/d16/d2f/d39/d38/d46/d53/f5e 0 2024-04-25T02:27:06.052 INFO:tasks.workunit.client.0.smithi114.stdout:8/273: write da/d38/f34 [1932113,128680] 0 2024-04-25T02:27:06.053 INFO:tasks.workunit.client.0.smithi114.stdout:2/267: fdatasync d5/d6/f55 0 2024-04-25T02:27:06.054 INFO:tasks.workunit.client.0.smithi114.stdout:6/297: creat de/d27/d34/d4b/f75 x:0 0 0 2024-04-25T02:27:06.056 INFO:tasks.workunit.client.0.smithi114.stdout:5/243: fsync d1/d6/f43 0 2024-04-25T02:27:06.058 INFO:tasks.workunit.client.0.smithi114.stdout:5/244: read d1/f36 [753222,12723] 0 2024-04-25T02:27:06.058 INFO:tasks.workunit.client.0.smithi114.stdout:9/253: mkdir d8/d16/d21/d37/d60 0 2024-04-25T02:27:06.059 INFO:tasks.workunit.client.0.smithi114.stdout:6/298: dread de/d25/d39/d47/f5d [0,4194304] 0 2024-04-25T02:27:06.059 INFO:tasks.workunit.client.0.smithi114.stdout:8/274: symlink da/d38/d35/l4c 0 2024-04-25T02:27:06.060 INFO:tasks.workunit.client.0.smithi114.stdout:2/268: dwrite d5/df/d3d/f5e [0,4194304] 0 2024-04-25T02:27:06.061 INFO:tasks.workunit.client.0.smithi114.stdout:6/299: write de/d30/f62 [829960,83771] 0 2024-04-25T02:27:06.063 INFO:tasks.workunit.client.0.smithi114.stdout:3/195: creat d0/f46 x:0 0 0 2024-04-25T02:27:06.065 INFO:tasks.workunit.client.0.smithi114.stdout:4/183: getdents d3/d8/d23/d25 0 2024-04-25T02:27:06.067 INFO:tasks.workunit.client.0.smithi114.stdout:4/184: read d3/f16 [179722,68945] 0 2024-04-25T02:27:06.068 INFO:tasks.workunit.client.0.smithi114.stdout:2/269: creat d5/d6/d58/f5f x:0 0 0 2024-04-25T02:27:06.069 INFO:tasks.workunit.client.0.smithi114.stdout:5/245: dwrite d1/d6/f43 [0,4194304] 0 2024-04-25T02:27:06.070 INFO:tasks.workunit.client.0.smithi114.stdout:1/209: sync 2024-04-25T02:27:06.070 INFO:tasks.workunit.client.0.smithi114.stdout:8/275: dread da/d1e/f29 [0,4194304] 0 2024-04-25T02:27:06.071 INFO:tasks.workunit.client.0.smithi114.stdout:1/210: chown df/d11/f20 2 1 2024-04-25T02:27:06.071 INFO:tasks.workunit.client.0.smithi114.stdout:3/196: unlink d0/f46 0 2024-04-25T02:27:06.073 INFO:tasks.workunit.client.0.smithi114.stdout:6/300: mkdir de/d27/d76 0 2024-04-25T02:27:06.073 INFO:tasks.workunit.client.0.smithi114.stdout:1/211: dread - df/d2a/f2e zero size 2024-04-25T02:27:06.076 INFO:tasks.workunit.client.0.smithi114.stdout:0/245: write d1/d4/d24/f45 [8960,36405] 0 2024-04-25T02:27:06.077 INFO:tasks.workunit.client.0.smithi114.stdout:8/276: symlink da/d38/d35/l4d 0 2024-04-25T02:27:06.080 INFO:tasks.workunit.client.0.smithi114.stdout:1/212: mknod df/d2a/c4d 0 2024-04-25T02:27:06.081 INFO:tasks.workunit.client.0.smithi114.stdout:4/185: dwrite d3/d8/d12/f18 [0,4194304] 0 2024-04-25T02:27:06.082 INFO:tasks.workunit.client.0.smithi114.stdout:1/213: readlink l8 0 2024-04-25T02:27:06.083 INFO:tasks.workunit.client.0.smithi114.stdout:5/246: dwrite d1/d25/d24/f27 [0,4194304] 0 2024-04-25T02:27:06.083 INFO:tasks.workunit.client.0.smithi114.stdout:9/254: link d8/d16/d21/d37/l4a d8/d16/d21/d24/d3c/d40/l61 0 2024-04-25T02:27:06.086 INFO:tasks.workunit.client.0.smithi114.stdout:3/197: dread d0/f12 [0,4194304] 0 2024-04-25T02:27:06.086 INFO:tasks.workunit.client.0.smithi114.stdout:1/214: chown df/d11/l23 10600 1 2024-04-25T02:27:06.086 INFO:tasks.workunit.client.0.smithi114.stdout:8/277: write da/d1e/f2e [2502637,92665] 0 2024-04-25T02:27:06.087 INFO:tasks.workunit.client.0.smithi114.stdout:4/186: truncate d3/f16 989663 0 2024-04-25T02:27:06.088 INFO:tasks.workunit.client.0.smithi114.stdout:3/198: write d0/f3 [4771695,72919] 0 2024-04-25T02:27:06.088 INFO:tasks.workunit.client.0.smithi114.stdout:6/301: dwrite de/d30/f4a [0,4194304] 0 2024-04-25T02:27:06.092 INFO:tasks.workunit.client.0.smithi114.stdout:4/187: truncate d3/d8/d23/d25/f2d 783258 0 2024-04-25T02:27:06.093 INFO:tasks.workunit.client.0.smithi114.stdout:5/247: rename d1/f54 to d1/d6/d1a/f57 0 2024-04-25T02:27:06.095 INFO:tasks.workunit.client.0.smithi114.stdout:8/278: write da/ff [2015514,31917] 0 2024-04-25T02:27:06.095 INFO:tasks.workunit.client.0.smithi114.stdout:9/255: dwrite d8/d16/d21/d37/f3e [0,4194304] 0 2024-04-25T02:27:06.095 INFO:tasks.workunit.client.0.smithi114.stdout:1/215: dread df/d13/d1e/f21 [0,4194304] 0 2024-04-25T02:27:06.096 INFO:tasks.workunit.client.0.smithi114.stdout:7/261: sync 2024-04-25T02:27:06.096 INFO:tasks.workunit.client.0.smithi114.stdout:3/199: dread d0/d5/f17 [0,4194304] 0 2024-04-25T02:27:06.097 INFO:tasks.workunit.client.0.smithi114.stdout:9/256: chown d8/d16/d2f/d39/d38/d46/l4c 1 1 2024-04-25T02:27:06.099 INFO:tasks.workunit.client.0.smithi114.stdout:0/246: dread d1/d4/da/f12 [0,4194304] 0 2024-04-25T02:27:06.100 INFO:tasks.workunit.client.0.smithi114.stdout:0/247: readlink d1/l13 0 2024-04-25T02:27:06.102 INFO:tasks.workunit.client.0.smithi114.stdout:8/279: creat da/d1e/f4e x:0 0 0 2024-04-25T02:27:06.103 INFO:tasks.workunit.client.0.smithi114.stdout:7/262: symlink d5/d19/l59 0 2024-04-25T02:27:06.104 INFO:tasks.workunit.client.0.smithi114.stdout:8/280: truncate da/d38/d35/d49/f4b 253683 0 2024-04-25T02:27:06.104 INFO:tasks.workunit.client.0.smithi114.stdout:8/281: fdatasync da/d1e/f30 0 2024-04-25T02:27:06.105 INFO:tasks.workunit.client.0.smithi114.stdout:9/257: creat d8/d16/d2f/d39/f62 x:0 0 0 2024-04-25T02:27:06.108 INFO:tasks.workunit.client.0.smithi114.stdout:5/248: creat d1/d53/d55/f58 x:0 0 0 2024-04-25T02:27:06.110 INFO:tasks.workunit.client.0.smithi114.stdout:1/216: unlink df/d13/c22 0 2024-04-25T02:27:06.111 INFO:tasks.workunit.client.0.smithi114.stdout:7/263: creat d5/d43/f5a x:0 0 0 2024-04-25T02:27:06.112 INFO:tasks.workunit.client.0.smithi114.stdout:7/264: dread - d5/d19/f48 zero size 2024-04-25T02:27:06.113 INFO:tasks.workunit.client.0.smithi114.stdout:8/282: creat da/d32/d3b/d40/f4f x:0 0 0 2024-04-25T02:27:06.113 INFO:tasks.workunit.client.0.smithi114.stdout:9/258: symlink d8/d16/d21/d24/d3c/l63 0 2024-04-25T02:27:06.113 INFO:tasks.workunit.client.0.smithi114.stdout:2/270: dwrite d5/df/f53 [0,4194304] 0 2024-04-25T02:27:06.114 INFO:tasks.workunit.client.0.smithi114.stdout:7/265: chown d5/d19/f41 28410 1 2024-04-25T02:27:06.115 INFO:tasks.workunit.client.0.smithi114.stdout:8/283: truncate da/d1e/f48 476093 0 2024-04-25T02:27:06.118 INFO:tasks.workunit.client.0.smithi114.stdout:1/217: symlink df/l4e 0 2024-04-25T02:27:06.118 INFO:tasks.workunit.client.0.smithi114.stdout:6/302: link de/d27/d34/d4b/c4f de/d25/c77 0 2024-04-25T02:27:06.119 INFO:tasks.workunit.client.0.smithi114.stdout:1/218: truncate f4 8951194 0 2024-04-25T02:27:06.121 INFO:tasks.workunit.client.0.smithi114.stdout:1/219: write df/d11/d32/f3c [91924,68226] 0 2024-04-25T02:27:06.151 INFO:tasks.workunit.client.0.smithi114.stdout:9/259: rename d8/d16/d21/d24/d3c/d40/l4f to d8/d16/d2f/d39/d38/d5d/l64 0 2024-04-25T02:27:06.152 INFO:tasks.workunit.client.0.smithi114.stdout:2/271: dwrite d5/d6/f51 [0,4194304] 0 2024-04-25T02:27:06.152 INFO:tasks.workunit.client.0.smithi114.stdout:0/248: link d1/d4/d24/f2d d1/d4/d24/f47 0 2024-04-25T02:27:06.153 INFO:tasks.workunit.client.0.smithi114.stdout:2/272: chown d5/df/d3d 14323822 1 2024-04-25T02:27:06.155 INFO:tasks.workunit.client.0.smithi114.stdout:6/303: symlink de/d27/d34/d38/l78 0 2024-04-25T02:27:06.155 INFO:tasks.workunit.client.0.smithi114.stdout:9/260: chown d8/fb 1139729 1 2024-04-25T02:27:06.157 INFO:tasks.workunit.client.0.smithi114.stdout:3/200: write d0/d25/d29/f39 [508466,129830] 0 2024-04-25T02:27:06.159 INFO:tasks.workunit.client.0.smithi114.stdout:7/266: link d5/d19/f2a d5/d32/d4a/d51/f5b 0 2024-04-25T02:27:06.160 INFO:tasks.workunit.client.0.smithi114.stdout:0/249: creat d1/d30/f48 x:0 0 0 2024-04-25T02:27:06.161 INFO:tasks.workunit.client.0.smithi114.stdout:9/261: creat d8/d16/d21/d24/f65 x:0 0 0 2024-04-25T02:27:06.161 INFO:tasks.workunit.client.0.smithi114.stdout:4/188: dread d3/d14/f21 [0,4194304] 0 2024-04-25T02:27:06.161 INFO:tasks.workunit.client.0.smithi114.stdout:1/220: symlink df/d11/d25/d33/d47/l4f 0 2024-04-25T02:27:06.162 INFO:tasks.workunit.client.0.smithi114.stdout:2/273: dread d5/df/d1e/f38 [0,4194304] 0 2024-04-25T02:27:06.162 INFO:tasks.workunit.client.0.smithi114.stdout:3/201: dread d0/d25/d2a/d36/f3c [0,4194304] 0 2024-04-25T02:27:06.163 INFO:tasks.workunit.client.0.smithi114.stdout:7/267: mknod d5/d19/c5c 0 2024-04-25T02:27:06.163 INFO:tasks.workunit.client.0.smithi114.stdout:7/268: dread - d5/d54/f57 zero size 2024-04-25T02:27:06.165 INFO:tasks.workunit.client.0.smithi114.stdout:6/304: link de/c11 de/d25/c79 0 2024-04-25T02:27:06.166 INFO:tasks.workunit.client.0.smithi114.stdout:6/305: readlink de/l4d 0 2024-04-25T02:27:06.166 INFO:tasks.workunit.client.0.smithi114.stdout:2/274: creat d5/d6/d31/f60 x:0 0 0 2024-04-25T02:27:06.167 INFO:tasks.workunit.client.0.smithi114.stdout:5/249: dread d1/d25/d24/f3b [0,4194304] 0 2024-04-25T02:27:06.168 INFO:tasks.workunit.client.0.smithi114.stdout:3/202: dread d0/d5/fc [0,4194304] 0 2024-04-25T02:27:06.168 INFO:tasks.workunit.client.0.smithi114.stdout:7/269: rename d5/d19/f41 to d5/d19/d1a/f5d 0 2024-04-25T02:27:06.169 INFO:tasks.workunit.client.0.smithi114.stdout:9/262: dread d8/f1f [0,4194304] 0 2024-04-25T02:27:06.169 INFO:tasks.workunit.client.0.smithi114.stdout:5/250: write d1/d6/d1a/f2f [243268,128936] 0 2024-04-25T02:27:06.170 INFO:tasks.workunit.client.0.smithi114.stdout:0/250: creat d1/d4/f49 x:0 0 0 2024-04-25T02:27:06.172 INFO:tasks.workunit.client.0.smithi114.stdout:2/275: symlink d5/d6/d58/d5a/d3e/l61 0 2024-04-25T02:27:06.172 INFO:tasks.workunit.client.0.smithi114.stdout:0/251: write d1/d30/f48 [147079,96265] 0 2024-04-25T02:27:06.175 INFO:tasks.workunit.client.0.smithi114.stdout:5/251: creat d1/d53/f59 x:0 0 0 2024-04-25T02:27:06.175 INFO:tasks.workunit.client.0.smithi114.stdout:3/203: dwrite d0/f3 [0,4194304] 0 2024-04-25T02:27:06.176 INFO:tasks.workunit.client.0.smithi114.stdout:4/189: truncate d3/fa 1659202 0 2024-04-25T02:27:06.177 INFO:tasks.workunit.client.0.smithi114.stdout:7/270: mknod d5/c5e 0 2024-04-25T02:27:06.179 INFO:tasks.workunit.client.0.smithi114.stdout:0/252: creat d1/d4/da/d33/f4a x:0 0 0 2024-04-25T02:27:06.180 INFO:tasks.workunit.client.0.smithi114.stdout:2/276: symlink d5/df/d3d/d44/l62 0 2024-04-25T02:27:06.183 INFO:tasks.workunit.client.0.smithi114.stdout:2/277: dread d5/fe [4194304,4194304] 0 2024-04-25T02:27:06.183 INFO:tasks.workunit.client.0.smithi114.stdout:4/190: mkdir d3/d8/d30 0 2024-04-25T02:27:06.184 INFO:tasks.workunit.client.0.smithi114.stdout:5/252: truncate d1/d25/d24/f3b 4639461 0 2024-04-25T02:27:06.215 INFO:tasks.workunit.client.0.smithi114.stdout:8/284: sync 2024-04-25T02:27:06.215 INFO:tasks.workunit.client.0.smithi114.stdout:0/253: mknod d1/d30/c4b 0 2024-04-25T02:27:06.217 INFO:tasks.workunit.client.0.smithi114.stdout:0/254: write d1/d7/d18/f22 [4063636,46833] 0 2024-04-25T02:27:06.218 INFO:tasks.workunit.client.0.smithi114.stdout:3/204: symlink d0/l47 0 2024-04-25T02:27:06.219 INFO:tasks.workunit.client.0.smithi114.stdout:2/278: mkdir d5/df/d63 0 2024-04-25T02:27:06.219 INFO:tasks.workunit.client.0.smithi114.stdout:6/306: dwrite de/d25/d39/f51 [0,4194304] 0 2024-04-25T02:27:06.220 INFO:tasks.workunit.client.0.smithi114.stdout:2/279: stat d5/d1c/d29/l30 0 2024-04-25T02:27:06.222 INFO:tasks.workunit.client.0.smithi114.stdout:7/271: mknod d5/c5f 0 2024-04-25T02:27:06.225 INFO:tasks.workunit.client.0.smithi114.stdout:3/205: dwrite d0/f3e [0,4194304] 0 2024-04-25T02:27:06.226 INFO:tasks.workunit.client.0.smithi114.stdout:3/206: fdatasync d0/d5/f43 0 2024-04-25T02:27:06.226 INFO:tasks.workunit.client.0.smithi114.stdout:8/285: symlink da/d1e/l50 0 2024-04-25T02:27:06.233 INFO:tasks.workunit.client.0.smithi114.stdout:6/307: unlink de/c68 0 2024-04-25T02:27:06.235 INFO:tasks.workunit.client.0.smithi114.stdout:2/280: creat d5/df/d2c/f64 x:0 0 0 2024-04-25T02:27:06.237 INFO:tasks.workunit.client.0.smithi114.stdout:2/281: stat d5/df/c1b 0 2024-04-25T02:27:06.240 INFO:tasks.workunit.client.0.smithi114.stdout:5/253: dwrite d1/d6/f3c [0,4194304] 0 2024-04-25T02:27:06.240 INFO:tasks.workunit.client.0.smithi114.stdout:6/308: fsync de/f59 0 2024-04-25T02:27:06.241 INFO:tasks.workunit.client.0.smithi114.stdout:2/282: mknod d5/d1c/d29/c65 0 2024-04-25T02:27:06.244 INFO:tasks.workunit.client.0.smithi114.stdout:2/283: dread d5/d6/f51 [0,4194304] 0 2024-04-25T02:27:06.245 INFO:tasks.workunit.client.0.smithi114.stdout:2/284: chown d5/d1c/d21/l46 4377314 1 2024-04-25T02:27:06.245 INFO:tasks.workunit.client.0.smithi114.stdout:2/285: write d5/df/f12 [1460784,126399] 0 2024-04-25T02:27:06.247 INFO:tasks.workunit.client.0.smithi114.stdout:5/254: rmdir d1/d6/d1a 39 2024-04-25T02:27:06.249 INFO:tasks.workunit.client.0.smithi114.stdout:3/207: rename d0/f2c to d0/d25/f48 0 2024-04-25T02:27:06.250 INFO:tasks.workunit.client.0.smithi114.stdout:3/208: stat d0/d25/f32 0 2024-04-25T02:27:06.251 INFO:tasks.workunit.client.0.smithi114.stdout:0/255: getdents d1/d4/da/d33 0 2024-04-25T02:27:06.253 INFO:tasks.workunit.client.0.smithi114.stdout:3/209: dread d0/f1d [0,4194304] 0 2024-04-25T02:27:06.254 INFO:tasks.workunit.client.0.smithi114.stdout:3/210: dread - d0/d25/d2a/d36/f37 zero size 2024-04-25T02:27:06.255 INFO:tasks.workunit.client.0.smithi114.stdout:2/286: mkdir d5/df/d2c/d66 0 2024-04-25T02:27:06.255 INFO:tasks.workunit.client.0.smithi114.stdout:1/221: sync 2024-04-25T02:27:06.255 INFO:tasks.workunit.client.0.smithi114.stdout:3/211: write d0/d25/d2a/f3a [502842,44339] 0 2024-04-25T02:27:06.258 INFO:tasks.workunit.client.0.smithi114.stdout:8/286: rename da/d32/d3b/d40/f4f to da/d38/d35/f51 0 2024-04-25T02:27:06.263 INFO:tasks.workunit.client.0.smithi114.stdout:6/309: creat de/d27/d34/f7a x:0 0 0 2024-04-25T02:27:06.263 INFO:tasks.workunit.client.0.smithi114.stdout:6/310: fsync de/f1e 0 2024-04-25T02:27:06.263 INFO:tasks.workunit.client.0.smithi114.stdout:5/255: symlink d1/d25/l5a 0 2024-04-25T02:27:06.266 INFO:tasks.workunit.client.0.smithi114.stdout:1/222: creat df/d13/d1e/f50 x:0 0 0 2024-04-25T02:27:06.266 INFO:tasks.workunit.client.0.smithi114.stdout:1/223: dread - df/d11/d25/f4b zero size 2024-04-25T02:27:06.267 INFO:tasks.workunit.client.0.smithi114.stdout:2/287: dread d5/d6/f51 [0,4194304] 0 2024-04-25T02:27:06.271 INFO:tasks.workunit.client.0.smithi114.stdout:5/256: creat d1/d3e/f5b x:0 0 0 2024-04-25T02:27:06.275 INFO:tasks.workunit.client.0.smithi114.stdout:4/191: dwrite d3/d14/f21 [4194304,4194304] 0 2024-04-25T02:27:06.275 INFO:tasks.workunit.client.0.smithi114.stdout:8/287: fsync da/d1e/f3d 0 2024-04-25T02:27:06.278 INFO:tasks.workunit.client.0.smithi114.stdout:9/263: sync 2024-04-25T02:27:06.280 INFO:tasks.workunit.client.0.smithi114.stdout:3/212: creat d0/f49 x:0 0 0 2024-04-25T02:27:06.281 INFO:tasks.workunit.client.0.smithi114.stdout:3/213: read d0/d5/f31 [2823314,40468] 0 2024-04-25T02:27:06.285 INFO:tasks.workunit.client.0.smithi114.stdout:2/288: dread d5/fd [0,4194304] 0 2024-04-25T02:27:06.286 INFO:tasks.workunit.client.0.smithi114.stdout:8/288: mkdir da/d38/d35/d52 0 2024-04-25T02:27:06.287 INFO:tasks.workunit.client.0.smithi114.stdout:0/256: link d1/l20 d1/d7/d46/l4c 0 2024-04-25T02:27:06.288 INFO:tasks.workunit.client.0.smithi114.stdout:2/289: dread d5/fd [0,4194304] 0 2024-04-25T02:27:06.288 INFO:tasks.workunit.client.0.smithi114.stdout:9/264: mkdir d8/d16/d2f/d66 0 2024-04-25T02:27:06.289 INFO:tasks.workunit.client.0.smithi114.stdout:0/257: truncate d1/d4/da/d33/f4a 714381 0 2024-04-25T02:27:06.290 INFO:tasks.workunit.client.0.smithi114.stdout:5/257: rename d1/d6/d4f/c50 to d1/d6/d1a/c5c 0 2024-04-25T02:27:06.295 INFO:tasks.workunit.client.0.smithi114.stdout:2/290: mkdir d5/d1c/d22/d67 0 2024-04-25T02:27:06.296 INFO:tasks.workunit.client.0.smithi114.stdout:9/265: unlink d8/d16/d2f/f5a 0 2024-04-25T02:27:06.297 INFO:tasks.workunit.client.0.smithi114.stdout:9/266: write d8/fe [3360021,37964] 0 2024-04-25T02:27:06.299 INFO:tasks.workunit.client.0.smithi114.stdout:5/258: mknod d1/d6/de/c5d 0 2024-04-25T02:27:06.300 INFO:tasks.workunit.client.0.smithi114.stdout:3/214: creat d0/d25/d2a/d34/f4a x:0 0 0 2024-04-25T02:27:06.301 INFO:tasks.workunit.client.0.smithi114.stdout:4/192: mkdir d3/d8/d23/d25/d31 0 2024-04-25T02:27:06.302 INFO:tasks.workunit.client.0.smithi114.stdout:8/289: mknod da/c53 0 2024-04-25T02:27:06.304 INFO:tasks.workunit.client.0.smithi114.stdout:2/291: mknod d5/df/c68 0 2024-04-25T02:27:06.308 INFO:tasks.workunit.client.0.smithi114.stdout:8/290: dwrite da/d1e/f48 [0,4194304] 0 2024-04-25T02:27:06.308 INFO:tasks.workunit.client.0.smithi114.stdout:3/215: fdatasync d0/d5/f31 0 2024-04-25T02:27:06.309 INFO:tasks.workunit.client.0.smithi114.stdout:3/216: write d0/d25/d2a/d36/f37 [312608,93601] 0 2024-04-25T02:27:06.310 INFO:tasks.workunit.client.0.smithi114.stdout:3/217: write d0/d5/f44 [144546,47586] 0 2024-04-25T02:27:06.312 INFO:tasks.workunit.client.0.smithi114.stdout:9/267: unlink d8/d16/d21/c2a 0 2024-04-25T02:27:06.313 INFO:tasks.workunit.client.0.smithi114.stdout:9/268: dread - d8/f59 zero size 2024-04-25T02:27:06.316 INFO:tasks.workunit.client.0.smithi114.stdout:4/193: dwrite d3/d8/d12/d19/d26/f2a [0,4194304] 0 2024-04-25T02:27:06.318 INFO:tasks.workunit.client.0.smithi114.stdout:3/218: dwrite d0/d25/d2a/f3a [0,4194304] 0 2024-04-25T02:27:06.318 INFO:tasks.workunit.client.0.smithi114.stdout:8/291: unlink da/d1e/f30 0 2024-04-25T02:27:06.319 INFO:tasks.workunit.client.0.smithi114.stdout:7/272: sync 2024-04-25T02:27:06.320 INFO:tasks.workunit.client.0.smithi114.stdout:8/292: fsync da/d38/f34 0 2024-04-25T02:27:06.320 INFO:tasks.workunit.client.0.smithi114.stdout:2/292: link d5/df/d3d/d44/f56 d5/df/d3d/f69 0 2024-04-25T02:27:06.322 INFO:tasks.workunit.client.0.smithi114.stdout:7/273: chown d5/d32/f2f 6177150 1 2024-04-25T02:27:06.322 INFO:tasks.workunit.client.0.smithi114.stdout:9/269: rmdir d8/d16/d2f/d39/d38/d46 39 2024-04-25T02:27:06.324 INFO:tasks.workunit.client.0.smithi114.stdout:9/270: chown d8/d16/l1e 160298 1 2024-04-25T02:27:06.327 INFO:tasks.workunit.client.0.smithi114.stdout:1/224: truncate df/f19 3874828 0 2024-04-25T02:27:06.327 INFO:tasks.workunit.client.0.smithi114.stdout:6/311: dwrite de/d25/d39/f5f [0,4194304] 0 2024-04-25T02:27:06.329 INFO:tasks.workunit.client.0.smithi114.stdout:2/293: mkdir d5/d6/d31/d6a 0 2024-04-25T02:27:06.329 INFO:tasks.workunit.client.0.smithi114.stdout:6/312: readlink de/d25/l74 0 2024-04-25T02:27:06.330 INFO:tasks.workunit.client.0.smithi114.stdout:1/225: fdatasync df/d11/d25/f37 0 2024-04-25T02:27:06.331 INFO:tasks.workunit.client.0.smithi114.stdout:3/219: dwrite d0/f49 [0,4194304] 0 2024-04-25T02:27:06.331 INFO:tasks.workunit.client.0.smithi114.stdout:2/294: chown d5/d1c/d22/f28 1776 1 2024-04-25T02:27:06.332 INFO:tasks.workunit.client.0.smithi114.stdout:6/313: write de/d27/d34/d44/f71 [234018,60377] 0 2024-04-25T02:27:06.332 INFO:tasks.workunit.client.0.smithi114.stdout:7/274: mkdir d5/d60 0 2024-04-25T02:27:06.334 INFO:tasks.workunit.client.0.smithi114.stdout:4/194: dread d3/fa [0,4194304] 0 2024-04-25T02:27:06.336 INFO:tasks.workunit.client.0.smithi114.stdout:0/258: write d1/d30/f32 [1170936,31614] 0 2024-04-25T02:27:06.336 INFO:tasks.workunit.client.0.smithi114.stdout:2/295: dread d5/df/d3d/f69 [0,4194304] 0 2024-04-25T02:27:06.339 INFO:tasks.workunit.client.0.smithi114.stdout:1/226: dread df/d11/d25/f37 [0,4194304] 0 2024-04-25T02:27:06.339 INFO:tasks.workunit.client.0.smithi114.stdout:1/227: dread - df/d11/f20 zero size 2024-04-25T02:27:06.342 INFO:tasks.workunit.client.0.smithi114.stdout:4/195: rmdir d3/d8/d12 39 2024-04-25T02:27:06.342 INFO:tasks.workunit.client.0.smithi114.stdout:6/314: dwrite f8 [0,4194304] 0 2024-04-25T02:27:06.344 INFO:tasks.workunit.client.0.smithi114.stdout:0/259: mkdir d1/d30/d4d 0 2024-04-25T02:27:06.346 INFO:tasks.workunit.client.0.smithi114.stdout:1/228: symlink df/d11/d32/l51 0 2024-04-25T02:27:06.346 INFO:tasks.workunit.client.0.smithi114.stdout:5/259: write d1/d6/de/f37 [3330783,12059] 0 2024-04-25T02:27:06.346 INFO:tasks.workunit.client.0.smithi114.stdout:4/196: fdatasync d3/f5 0 2024-04-25T02:27:06.348 INFO:tasks.workunit.client.0.smithi114.stdout:5/260: dread - d1/d6/de/f4c zero size 2024-04-25T02:27:06.351 INFO:tasks.workunit.client.0.smithi114.stdout:2/296: dwrite d5/df/f18 [0,4194304] 0 2024-04-25T02:27:06.352 INFO:tasks.workunit.client.0.smithi114.stdout:3/220: rename d0/d25/f2d to d0/f4b 0 2024-04-25T02:27:06.356 INFO:tasks.workunit.client.0.smithi114.stdout:1/229: dwrite df/d11/d25/f4b [0,4194304] 0 2024-04-25T02:27:06.357 INFO:tasks.workunit.client.0.smithi114.stdout:0/260: write d1/fc [901126,128513] 0 2024-04-25T02:27:06.359 INFO:tasks.workunit.client.0.smithi114.stdout:0/261: fsync d1/f27 0 2024-04-25T02:27:06.360 INFO:tasks.workunit.client.0.smithi114.stdout:5/261: dwrite d1/ff [0,4194304] 0 2024-04-25T02:27:06.361 INFO:tasks.workunit.client.0.smithi114.stdout:4/197: write d3/d8/d12/f18 [4033463,14902] 0 2024-04-25T02:27:06.362 INFO:tasks.workunit.client.0.smithi114.stdout:2/297: rmdir d5/df/d1e 39 2024-04-25T02:27:06.382 INFO:tasks.workunit.client.0.smithi114.stdout:8/293: dwrite da/d1e/f48 [4194304,4194304] 0 2024-04-25T02:27:06.383 INFO:tasks.workunit.client.0.smithi114.stdout:2/298: mknod d5/d1c/c6b 0 2024-04-25T02:27:06.386 INFO:tasks.workunit.client.0.smithi114.stdout:9/271: truncate d8/fb 672151 0 2024-04-25T02:27:06.390 INFO:tasks.workunit.client.0.smithi114.stdout:8/294: dread da/d1e/f3d [0,4194304] 0 2024-04-25T02:27:06.391 INFO:tasks.workunit.client.0.smithi114.stdout:2/299: dwrite d5/df/d3d/f5e [0,4194304] 0 2024-04-25T02:27:06.394 INFO:tasks.workunit.client.0.smithi114.stdout:7/275: sync 2024-04-25T02:27:06.395 INFO:tasks.workunit.client.0.smithi114.stdout:7/276: write d5/d19/f45 [615230,118752] 0 2024-04-25T02:27:06.400 INFO:tasks.workunit.client.0.smithi114.stdout:3/221: dwrite d0/fa [0,4194304] 0 2024-04-25T02:27:06.409 INFO:tasks.workunit.client.0.smithi114.stdout:3/222: dwrite d0/fb [0,4194304] 0 2024-04-25T02:27:06.410 INFO:tasks.workunit.client.0.smithi114.stdout:3/223: chown d0 3190 1 2024-04-25T02:27:06.410 INFO:tasks.workunit.client.0.smithi114.stdout:6/315: dread de/f19 [0,4194304] 0 2024-04-25T02:27:06.436 INFO:tasks.workunit.client.0.smithi114.stdout:6/316: dread de/f1e [0,4194304] 0 2024-04-25T02:27:06.441 INFO:tasks.workunit.client.0.smithi114.stdout:6/317: dwrite de/d27/d34/d4b/f75 [0,4194304] 0 2024-04-25T02:27:06.454 INFO:tasks.workunit.client.0.smithi114.stdout:8/295: sync 2024-04-25T02:27:06.570 INFO:tasks.workunit.client.0.smithi114.stdout:0/262: getdents d1/d4/da/d33 0 2024-04-25T02:27:06.571 INFO:tasks.workunit.client.0.smithi114.stdout:4/198: mknod d3/d8/d30/c32 0 2024-04-25T02:27:06.571 INFO:tasks.workunit.client.0.smithi114.stdout:0/263: write d1/d4/f15 [4118074,45256] 0 2024-04-25T02:27:06.576 INFO:tasks.workunit.client.0.smithi114.stdout:7/277: unlink d5/f4b 0 2024-04-25T02:27:06.579 INFO:tasks.workunit.client.0.smithi114.stdout:2/300: dwrite d5/fd [0,4194304] 0 2024-04-25T02:27:06.579 INFO:tasks.workunit.client.0.smithi114.stdout:8/296: mknod da/d32/d3b/d40/c54 0 2024-04-25T02:27:06.580 INFO:tasks.workunit.client.0.smithi114.stdout:8/297: chown da/d38/d35/f42 12 1 2024-04-25T02:27:06.582 INFO:tasks.workunit.client.0.smithi114.stdout:4/199: rename d3/d14/d24 to d3/d8/d23/d25/d31/d33 0 2024-04-25T02:27:06.583 INFO:tasks.workunit.client.0.smithi114.stdout:4/200: write d3/d8/d23/d25/d31/d33/f29 [2574388,20517] 0 2024-04-25T02:27:06.588 INFO:tasks.workunit.client.0.smithi114.stdout:4/201: dread d3/d8/d23/d25/f27 [0,4194304] 0 2024-04-25T02:27:06.588 INFO:tasks.workunit.client.0.smithi114.stdout:7/278: creat d5/d19/d23/f61 x:0 0 0 2024-04-25T02:27:06.589 INFO:tasks.workunit.client.0.smithi114.stdout:7/279: fsync d5/f49 0 2024-04-25T02:27:06.590 INFO:tasks.workunit.client.0.smithi114.stdout:0/264: creat d1/d30/d4d/f4e x:0 0 0 2024-04-25T02:27:06.591 INFO:tasks.workunit.client.0.smithi114.stdout:0/265: truncate d1/d4/f49 805 0 2024-04-25T02:27:06.593 INFO:tasks.workunit.client.0.smithi114.stdout:5/262: link d1/d6/de/f1d d1/d53/d55/f5e 0 2024-04-25T02:27:06.594 INFO:tasks.workunit.client.0.smithi114.stdout:5/263: write d1/d6/d4f/f52 [21301,82079] 0 2024-04-25T02:27:06.596 INFO:tasks.workunit.client.0.smithi114.stdout:3/224: rmdir d0/d25/d2a/d36/d3f 0 2024-04-25T02:27:06.598 INFO:tasks.workunit.client.0.smithi114.stdout:4/202: creat d3/d8/d12/d19/d26/f34 x:0 0 0 2024-04-25T02:27:06.603 INFO:tasks.workunit.client.0.smithi114.stdout:3/225: mknod d0/d5/c4c 0 2024-04-25T02:27:06.604 INFO:tasks.workunit.client.0.smithi114.stdout:6/318: getdents de/d25/d39 0 2024-04-25T02:27:06.606 INFO:tasks.workunit.client.0.smithi114.stdout:7/280: link d5/d19/f2b d5/d19/d1a/f62 0 2024-04-25T02:27:06.608 INFO:tasks.workunit.client.0.smithi114.stdout:5/264: symlink d1/d51/l5f 0 2024-04-25T02:27:06.609 INFO:tasks.workunit.client.0.smithi114.stdout:5/265: write d1/d25/f35 [752312,117144] 0 2024-04-25T02:27:06.609 INFO:tasks.workunit.client.0.smithi114.stdout:3/226: mkdir d0/d25/d2a/d36/d4d 0 2024-04-25T02:27:06.610 INFO:tasks.workunit.client.0.smithi114.stdout:4/203: mkdir d3/d8/d23/d35 0 2024-04-25T02:27:06.611 INFO:tasks.workunit.client.0.smithi114.stdout:4/204: write d3/d8/d23/d25/d31/d33/f29 [3618865,114005] 0 2024-04-25T02:27:06.611 INFO:tasks.workunit.client.0.smithi114.stdout:6/319: creat de/d25/d39/f7b x:0 0 0 2024-04-25T02:27:06.611 INFO:tasks.workunit.client.0.smithi114.stdout:7/281: truncate d5/d19/f27 2436194 0 2024-04-25T02:27:06.612 INFO:tasks.workunit.client.0.smithi114.stdout:7/282: dread - d5/f49 zero size 2024-04-25T02:27:06.613 INFO:tasks.workunit.client.0.smithi114.stdout:5/266: mkdir d1/d3e/d60 0 2024-04-25T02:27:06.614 INFO:tasks.workunit.client.0.smithi114.stdout:7/283: chown d5/d19/d23/f61 1373214483 1 2024-04-25T02:27:06.614 INFO:tasks.workunit.client.0.smithi114.stdout:5/267: write d1/d25/f1f [3433461,78185] 0 2024-04-25T02:27:06.616 INFO:tasks.workunit.client.0.smithi114.stdout:4/205: dread d3/d14/f21 [4194304,4194304] 0 2024-04-25T02:27:06.616 INFO:tasks.workunit.client.0.smithi114.stdout:6/320: rename de/d1c/f23 to de/d27/d34/d4b/f7c 0 2024-04-25T02:27:06.618 INFO:tasks.workunit.client.0.smithi114.stdout:4/206: write d3/d8/d23/d25/d31/d33/f29 [3985223,70704] 0 2024-04-25T02:27:06.618 INFO:tasks.workunit.client.0.smithi114.stdout:6/321: chown de/d27/d34/d38/l58 2990535 1 2024-04-25T02:27:06.618 INFO:tasks.workunit.client.0.smithi114.stdout:5/268: dread d1/d25/d24/f2e [0,4194304] 0 2024-04-25T02:27:06.619 INFO:tasks.workunit.client.0.smithi114.stdout:7/284: mkdir d5/d43/d63 0 2024-04-25T02:27:06.619 INFO:tasks.workunit.client.0.smithi114.stdout:6/322: truncate de/d30/f37 61799 0 2024-04-25T02:27:06.620 INFO:tasks.workunit.client.0.smithi114.stdout:5/269: write d1/d25/f35 [179230,126307] 0 2024-04-25T02:27:06.620 INFO:tasks.workunit.client.0.smithi114.stdout:7/285: write d5/d19/f48 [398913,24695] 0 2024-04-25T02:27:06.621 INFO:tasks.workunit.client.0.smithi114.stdout:6/323: write de/f1d [586391,94150] 0 2024-04-25T02:27:06.621 INFO:tasks.workunit.client.0.smithi114.stdout:5/270: dread - d1/d6/d1a/f57 zero size 2024-04-25T02:27:06.623 INFO:tasks.workunit.client.0.smithi114.stdout:6/324: read de/d25/d39/d47/f5d [4109989,79804] 0 2024-04-25T02:27:06.623 INFO:tasks.workunit.client.0.smithi114.stdout:4/207: write d3/d8/ff [3803514,42906] 0 2024-04-25T02:27:06.624 INFO:tasks.workunit.client.0.smithi114.stdout:6/325: write de/d27/d34/d38/f42 [971080,46146] 0 2024-04-25T02:27:06.626 INFO:tasks.workunit.client.0.smithi114.stdout:7/286: mkdir d5/d32/d64 0 2024-04-25T02:27:06.629 INFO:tasks.workunit.client.0.smithi114.stdout:4/208: creat d3/d8/d23/d25/d31/f36 x:0 0 0 2024-04-25T02:27:06.629 INFO:tasks.workunit.client.0.smithi114.stdout:6/326: mknod de/d1c/c7d 0 2024-04-25T02:27:06.631 INFO:tasks.workunit.client.0.smithi114.stdout:7/287: unlink d5/d19/f48 0 2024-04-25T02:27:06.631 INFO:tasks.workunit.client.0.smithi114.stdout:7/288: chown d5/d19/l59 108 1 2024-04-25T02:27:06.632 INFO:tasks.workunit.client.0.smithi114.stdout:7/289: chown d5/d19/d1a/c47 1014 1 2024-04-25T02:27:06.633 INFO:tasks.workunit.client.0.smithi114.stdout:4/209: dread d3/d8/d23/d25/f27 [0,4194304] 0 2024-04-25T02:27:06.634 INFO:tasks.workunit.client.0.smithi114.stdout:6/327: readlink de/d25/d39/d5c/l69 0 2024-04-25T02:27:06.637 INFO:tasks.workunit.client.0.smithi114.stdout:6/328: mknod de/d25/d39/d47/c7e 0 2024-04-25T02:27:06.638 INFO:tasks.workunit.client.0.smithi114.stdout:5/271: truncate d1/d53/d55/f5e 875675 0 2024-04-25T02:27:06.639 INFO:tasks.workunit.client.0.smithi114.stdout:5/272: read - d1/d53/f59 zero size 2024-04-25T02:27:06.640 INFO:tasks.workunit.client.0.smithi114.stdout:4/210: link d3/d8/d23/d25/d31/d33/f29 d3/d14/f37 0 2024-04-25T02:27:06.641 INFO:tasks.workunit.client.0.smithi114.stdout:4/211: fdatasync d3/f28 0 2024-04-25T02:27:06.641 INFO:tasks.workunit.client.0.smithi114.stdout:6/329: fdatasync de/d27/f4e 0 2024-04-25T02:27:06.642 INFO:tasks.workunit.client.0.smithi114.stdout:4/212: read - d3/d8/d23/d25/d31/f36 zero size 2024-04-25T02:27:06.642 INFO:tasks.workunit.client.0.smithi114.stdout:6/330: chown de/d27/d34/d4b/f53 0 1 2024-04-25T02:27:06.642 INFO:tasks.workunit.client.0.smithi114.stdout:7/290: creat d5/f65 x:0 0 0 2024-04-25T02:27:06.643 INFO:tasks.workunit.client.0.smithi114.stdout:5/273: creat d1/d25/d24/f61 x:0 0 0 2024-04-25T02:27:06.646 INFO:tasks.workunit.client.0.smithi114.stdout:4/213: mkdir d3/d14/d38 0 2024-04-25T02:27:06.647 INFO:tasks.workunit.client.0.smithi114.stdout:7/291: symlink d5/d32/d4a/l66 0 2024-04-25T02:27:06.648 INFO:tasks.workunit.client.0.smithi114.stdout:4/214: dread d3/f5 [0,4194304] 0 2024-04-25T02:27:06.649 INFO:tasks.workunit.client.0.smithi114.stdout:5/274: unlink d1/c22 0 2024-04-25T02:27:06.649 INFO:tasks.workunit.client.0.smithi114.stdout:4/215: fsync d3/f28 0 2024-04-25T02:27:06.651 INFO:tasks.workunit.client.0.smithi114.stdout:7/292: unlink d5/d19/d1a/c1b 0 2024-04-25T02:27:06.653 INFO:tasks.workunit.client.0.smithi114.stdout:5/275: read d1/d6/f17 [3603792,66592] 0 2024-04-25T02:27:06.653 INFO:tasks.workunit.client.0.smithi114.stdout:6/331: link de/d2a/f73 de/d25/f7f 0 2024-04-25T02:27:06.654 INFO:tasks.workunit.client.0.smithi114.stdout:5/276: truncate d1/d25/f4e 4456607 0 2024-04-25T02:27:06.655 INFO:tasks.workunit.client.0.smithi114.stdout:7/293: link d5/d19/d23/f3f d5/d32/d64/f67 0 2024-04-25T02:27:06.656 INFO:tasks.workunit.client.0.smithi114.stdout:5/277: stat d1/d6/c8 0 2024-04-25T02:27:06.659 INFO:tasks.workunit.client.0.smithi114.stdout:5/278: chown d1/d25/f1f 0 1 2024-04-25T02:27:06.659 INFO:tasks.workunit.client.0.smithi114.stdout:4/216: dwrite d3/d14/f21 [0,4194304] 0 2024-04-25T02:27:06.663 INFO:tasks.workunit.client.0.smithi114.stdout:6/332: dwrite de/d25/d39/f7b [0,4194304] 0 2024-04-25T02:27:06.664 INFO:tasks.workunit.client.0.smithi114.stdout:6/333: chown de/f18 450637718 1 2024-04-25T02:27:06.665 INFO:tasks.workunit.client.0.smithi114.stdout:6/334: dread - de/d27/d34/f7a zero size 2024-04-25T02:27:06.668 INFO:tasks.workunit.client.0.smithi114.stdout:4/217: dwrite d3/d8/d12/d19/d26/f34 [0,4194304] 0 2024-04-25T02:27:06.670 INFO:tasks.workunit.client.0.smithi114.stdout:4/218: write d3/d8/d23/d25/d31/f36 [898939,34797] 0 2024-04-25T02:27:06.674 INFO:tasks.workunit.client.0.smithi114.stdout:5/279: link d1/d25/l23 d1/d25/d24/l62 0 2024-04-25T02:27:06.674 INFO:tasks.workunit.client.0.smithi114.stdout:6/335: creat de/d27/d34/d44/f80 x:0 0 0 2024-04-25T02:27:06.675 INFO:tasks.workunit.client.0.smithi114.stdout:4/219: dwrite d3/d8/d12/d19/d26/f34 [0,4194304] 0 2024-04-25T02:27:06.677 INFO:tasks.workunit.client.0.smithi114.stdout:7/294: dread d5/d19/f2c [0,4194304] 0 2024-04-25T02:27:06.677 INFO:tasks.workunit.client.0.smithi114.stdout:4/220: chown d3/d14/c2e 18184612 1 2024-04-25T02:27:06.679 INFO:tasks.workunit.client.0.smithi114.stdout:4/221: write d3/d8/d23/d25/d31/f36 [950284,50794] 0 2024-04-25T02:27:06.680 INFO:tasks.workunit.client.0.smithi114.stdout:7/295: symlink d5/d32/d4a/l68 0 2024-04-25T02:27:06.680 INFO:tasks.workunit.client.0.smithi114.stdout:4/222: chown d3/d8/d12/f1e 107883395 1 2024-04-25T02:27:06.681 INFO:tasks.workunit.client.0.smithi114.stdout:5/280: dread d1/d25/d24/f27 [0,4194304] 0 2024-04-25T02:27:06.681 INFO:tasks.workunit.client.0.smithi114.stdout:7/296: readlink d5/d32/d4a/l53 0 2024-04-25T02:27:06.681 INFO:tasks.workunit.client.0.smithi114.stdout:4/223: chown d3/d8/d23/d25/d31/f36 52 1 2024-04-25T02:27:06.682 INFO:tasks.workunit.client.0.smithi114.stdout:7/297: write d5/d19/d23/f37 [872615,43999] 0 2024-04-25T02:27:06.684 INFO:tasks.workunit.client.0.smithi114.stdout:7/298: mknod d5/d43/c69 0 2024-04-25T02:27:06.687 INFO:tasks.workunit.client.0.smithi114.stdout:4/224: rename d3/d8/c22 to d3/d8/d23/c39 0 2024-04-25T02:27:06.690 INFO:tasks.workunit.client.0.smithi114.stdout:7/299: getdents d5/d43/d4e 0 2024-04-25T02:27:06.706 INFO:tasks.workunit.client.0.smithi114.stdout:4/225: fdatasync d3/d8/d23/d25/d31/f36 0 2024-04-25T02:27:06.708 INFO:tasks.workunit.client.0.smithi114.stdout:7/300: write d5/d19/f2c [2562713,124746] 0 2024-04-25T02:27:06.709 INFO:tasks.workunit.client.0.smithi114.stdout:7/301: chown d5/d19/l59 926826251 1 2024-04-25T02:27:06.726 INFO:tasks.workunit.client.0.smithi114.stdout:1/230: truncate df/d11/d25/f26 3960269 0 2024-04-25T02:27:06.730 INFO:tasks.workunit.client.0.smithi114.stdout:9/272: write d8/fb [209122,123635] 0 2024-04-25T02:27:06.732 INFO:tasks.workunit.client.0.smithi114.stdout:8/298: write da/d1e/f29 [913466,90765] 0 2024-04-25T02:27:06.732 INFO:tasks.workunit.client.0.smithi114.stdout:1/231: dwrite df/d13/d1e/f50 [0,4194304] 0 2024-04-25T02:27:06.733 INFO:tasks.workunit.client.0.smithi114.stdout:9/273: read d8/d16/d21/d37/f3e [2857937,88628] 0 2024-04-25T02:27:06.734 INFO:tasks.workunit.client.0.smithi114.stdout:2/301: truncate d5/df/d3d/f4b 2562920 0 2024-04-25T02:27:06.735 INFO:tasks.workunit.client.0.smithi114.stdout:8/299: stat da/d32/d3b/d40/f45 0 2024-04-25T02:27:06.736 INFO:tasks.workunit.client.0.smithi114.stdout:8/300: read da/d1e/f3d [633962,71621] 0 2024-04-25T02:27:06.739 INFO:tasks.workunit.client.0.smithi114.stdout:2/302: rmdir d5/d6/d58/d5a 39 2024-04-25T02:27:06.740 INFO:tasks.workunit.client.0.smithi114.stdout:9/274: dread d8/d16/d21/d37/f3e [0,4194304] 0 2024-04-25T02:27:06.741 INFO:tasks.workunit.client.0.smithi114.stdout:0/266: truncate d1/d4/f15 2065918 0 2024-04-25T02:27:06.742 INFO:tasks.workunit.client.0.smithi114.stdout:8/301: mknod da/d32/c55 0 2024-04-25T02:27:06.743 INFO:tasks.workunit.client.0.smithi114.stdout:9/275: mknod d8/d16/d21/d24/d3c/c67 0 2024-04-25T02:27:06.745 INFO:tasks.workunit.client.0.smithi114.stdout:2/303: creat d5/d1c/d22/d67/f6c x:0 0 0 2024-04-25T02:27:06.745 INFO:tasks.workunit.client.0.smithi114.stdout:2/304: stat d5/d1c/c2a 0 2024-04-25T02:27:06.747 INFO:tasks.workunit.client.0.smithi114.stdout:0/267: mkdir d1/d4/d4f 0 2024-04-25T02:27:06.748 INFO:tasks.workunit.client.0.smithi114.stdout:0/268: stat d1/d7/d18/d2e/c31 0 2024-04-25T02:27:06.748 INFO:tasks.workunit.client.0.smithi114.stdout:0/269: stat d1/d4/f19 0 2024-04-25T02:27:06.750 INFO:tasks.workunit.client.0.smithi114.stdout:1/232: fsync df/d13/d1e/f50 0 2024-04-25T02:27:06.751 INFO:tasks.workunit.client.0.smithi114.stdout:3/227: truncate d0/d25/f48 264404 0 2024-04-25T02:27:06.751 INFO:tasks.workunit.client.0.smithi114.stdout:9/276: dread d8/fb [0,4194304] 0 2024-04-25T02:27:06.752 INFO:tasks.workunit.client.0.smithi114.stdout:0/270: fdatasync d1/d4/d24/f45 0 2024-04-25T02:27:06.753 INFO:tasks.workunit.client.0.smithi114.stdout:2/305: creat d5/df/d1e/f6d x:0 0 0 2024-04-25T02:27:06.754 INFO:tasks.workunit.client.0.smithi114.stdout:5/281: sync 2024-04-25T02:27:06.755 INFO:tasks.workunit.client.0.smithi114.stdout:3/228: fsync d0/d5/fc 0 2024-04-25T02:27:06.756 INFO:tasks.workunit.client.0.smithi114.stdout:9/277: rmdir d8/d16/d21/d24/d3c/d40 39 2024-04-25T02:27:06.757 INFO:tasks.workunit.client.0.smithi114.stdout:1/233: dwrite f4 [4194304,4194304] 0 2024-04-25T02:27:06.757 INFO:tasks.workunit.client.0.smithi114.stdout:0/271: fsync d1/d4/ff 0 2024-04-25T02:27:06.758 INFO:tasks.workunit.client.0.smithi114.stdout:8/302: link da/d38/d35/f2c da/d38/d35/f56 0 2024-04-25T02:27:06.758 INFO:tasks.workunit.client.0.smithi114.stdout:0/272: fdatasync d1/d4/f49 0 2024-04-25T02:27:06.759 INFO:tasks.workunit.client.0.smithi114.stdout:2/306: symlink d5/d1c/d22/l6e 0 2024-04-25T02:27:06.761 INFO:tasks.workunit.client.0.smithi114.stdout:0/273: write d1/d7/f14 [3618164,1739] 0 2024-04-25T02:27:06.762 INFO:tasks.workunit.client.0.smithi114.stdout:5/282: rmdir d1/d6/d4f 39 2024-04-25T02:27:06.762 INFO:tasks.workunit.client.0.smithi114.stdout:0/274: truncate d1/d4/f49 962348 0 2024-04-25T02:27:06.764 INFO:tasks.workunit.client.0.smithi114.stdout:1/234: dwrite df/d13/d1e/f50 [0,4194304] 0 2024-04-25T02:27:06.766 INFO:tasks.workunit.client.0.smithi114.stdout:6/336: getdents de/d25/d39/d47 0 2024-04-25T02:27:06.767 INFO:tasks.workunit.client.0.smithi114.stdout:9/278: write d8/d16/d21/f30 [668587,115677] 0 2024-04-25T02:27:06.768 INFO:tasks.workunit.client.0.smithi114.stdout:2/307: dwrite d5/d6/d31/f37 [0,4194304] 0 2024-04-25T02:27:06.768 INFO:tasks.workunit.client.0.smithi114.stdout:9/279: chown d8/d16/d2f/l32 730 1 2024-04-25T02:27:06.769 INFO:tasks.workunit.client.0.smithi114.stdout:2/308: dread - d5/df/d2c/f64 zero size 2024-04-25T02:27:06.775 INFO:tasks.workunit.client.0.smithi114.stdout:9/280: dwrite d8/d16/d21/d24/d3c/f45 [0,4194304] 0 2024-04-25T02:27:06.777 INFO:tasks.workunit.client.0.smithi114.stdout:6/337: mknod de/c81 0 2024-04-25T02:27:06.778 INFO:tasks.workunit.client.0.smithi114.stdout:6/338: fdatasync f5 0 2024-04-25T02:27:06.783 INFO:tasks.workunit.client.0.smithi114.stdout:0/275: getdents d1/d4/da/d3e 0 2024-04-25T02:27:06.788 INFO:tasks.workunit.client.0.smithi114.stdout:6/339: fdatasync de/ff 0 2024-04-25T02:27:06.788 INFO:tasks.workunit.client.0.smithi114.stdout:8/303: link da/d38/d35/l4d da/d32/d3b/d40/l57 0 2024-04-25T02:27:06.789 INFO:tasks.workunit.client.0.smithi114.stdout:6/340: dread - de/d25/d39/d5c/f6f zero size 2024-04-25T02:27:06.790 INFO:tasks.workunit.client.0.smithi114.stdout:2/309: truncate d5/d6/f55 317170 0 2024-04-25T02:27:06.791 INFO:tasks.workunit.client.0.smithi114.stdout:5/283: creat d1/d25/f63 x:0 0 0 2024-04-25T02:27:06.794 INFO:tasks.workunit.client.0.smithi114.stdout:0/276: dread d1/d7/d18/f2f [0,4194304] 0 2024-04-25T02:27:06.795 INFO:tasks.workunit.client.0.smithi114.stdout:0/277: dread d1/d7/d18/f2f [0,4194304] 0 2024-04-25T02:27:06.796 INFO:tasks.workunit.client.0.smithi114.stdout:8/304: mkdir da/d1e/d58 0 2024-04-25T02:27:06.797 INFO:tasks.workunit.client.0.smithi114.stdout:7/302: write d5/f6 [4943304,122327] 0 2024-04-25T02:27:06.798 INFO:tasks.workunit.client.0.smithi114.stdout:6/341: symlink de/d27/d34/d44/l82 0 2024-04-25T02:27:06.799 INFO:tasks.workunit.client.0.smithi114.stdout:6/342: fsync de/d25/f50 0 2024-04-25T02:27:06.800 INFO:tasks.workunit.client.0.smithi114.stdout:2/310: rename d5/df/f18 to d5/df/d3d/f6f 0 2024-04-25T02:27:06.800 INFO:tasks.workunit.client.0.smithi114.stdout:7/303: chown d5/d19/d1a/f38 18 1 2024-04-25T02:27:06.803 INFO:tasks.workunit.client.0.smithi114.stdout:1/235: getdents df/d11/d25 0 2024-04-25T02:27:06.803 INFO:tasks.workunit.client.0.smithi114.stdout:4/226: dwrite d3/f5 [0,4194304] 0 2024-04-25T02:27:06.806 INFO:tasks.workunit.client.0.smithi114.stdout:8/305: creat da/d1e/f59 x:0 0 0 2024-04-25T02:27:06.807 INFO:tasks.workunit.client.0.smithi114.stdout:8/306: dread da/d1e/f29 [0,4194304] 0 2024-04-25T02:27:06.811 INFO:tasks.workunit.client.0.smithi114.stdout:5/284: rename d1/d6/de/f4c to d1/d6/d1a/f64 0 2024-04-25T02:27:06.813 INFO:tasks.workunit.client.0.smithi114.stdout:5/285: truncate d1/d6/de/f1e 1712575 0 2024-04-25T02:27:06.813 INFO:tasks.workunit.client.0.smithi114.stdout:2/311: dread - d5/d6/d58/d5a/f4e zero size 2024-04-25T02:27:06.815 INFO:tasks.workunit.client.0.smithi114.stdout:9/281: dread d8/d16/f28 [0,4194304] 0 2024-04-25T02:27:06.816 INFO:tasks.workunit.client.0.smithi114.stdout:8/307: symlink da/d38/l5a 0 2024-04-25T02:27:06.818 INFO:tasks.workunit.client.0.smithi114.stdout:7/304: creat d5/d60/f6a x:0 0 0 2024-04-25T02:27:06.820 INFO:tasks.workunit.client.0.smithi114.stdout:4/227: rename l1 to d3/d8/d30/l3a 0 2024-04-25T02:27:06.822 INFO:tasks.workunit.client.0.smithi114.stdout:5/286: creat d1/f65 x:0 0 0 2024-04-25T02:27:06.824 INFO:tasks.workunit.client.0.smithi114.stdout:2/312: unlink d5/d6/f51 0 2024-04-25T02:27:06.826 INFO:tasks.workunit.client.0.smithi114.stdout:8/308: creat da/d38/f5b x:0 0 0 2024-04-25T02:27:06.827 INFO:tasks.workunit.client.0.smithi114.stdout:9/282: symlink d8/d16/d21/d24/l68 0 2024-04-25T02:27:06.829 INFO:tasks.workunit.client.0.smithi114.stdout:1/236: dread fa [0,4194304] 0 2024-04-25T02:27:06.829 INFO:tasks.workunit.client.0.smithi114.stdout:1/237: fdatasync fc 0 2024-04-25T02:27:06.830 INFO:tasks.workunit.client.0.smithi114.stdout:4/228: creat d3/d14/f3b x:0 0 0 2024-04-25T02:27:06.831 INFO:tasks.workunit.client.0.smithi114.stdout:5/287: readlink d1/d25/d24/l62 0 2024-04-25T02:27:06.831 INFO:tasks.workunit.client.0.smithi114.stdout:1/238: truncate df/d11/f24 5912187 0 2024-04-25T02:27:06.832 INFO:tasks.workunit.client.0.smithi114.stdout:2/313: creat d5/df/d2c/f70 x:0 0 0 2024-04-25T02:27:06.834 INFO:tasks.workunit.client.0.smithi114.stdout:7/305: creat d5/d32/d4a/d51/f6b x:0 0 0 2024-04-25T02:27:06.836 INFO:tasks.workunit.client.0.smithi114.stdout:9/283: dwrite d8/d16/d21/d37/f3b [0,4194304] 0 2024-04-25T02:27:06.837 INFO:tasks.workunit.client.0.smithi114.stdout:0/278: sync 2024-04-25T02:27:06.838 INFO:tasks.workunit.client.0.smithi114.stdout:9/284: fsync d8/d16/d2f/d39/f62 0 2024-04-25T02:27:06.838 INFO:tasks.workunit.client.0.smithi114.stdout:6/343: dwrite de/ff [4194304,4194304] 0 2024-04-25T02:27:06.838 INFO:tasks.workunit.client.0.smithi114.stdout:5/288: chown d1/d25/d24/f3b 29 1 2024-04-25T02:27:06.839 INFO:tasks.workunit.client.0.smithi114.stdout:6/344: chown de/d1c/c7d 1 1 2024-04-25T02:27:06.839 INFO:tasks.workunit.client.0.smithi114.stdout:5/289: chown d1/l48 809532 1 2024-04-25T02:27:06.840 INFO:tasks.workunit.client.0.smithi114.stdout:6/345: stat de/d27/d34/d38 0 2024-04-25T02:27:06.841 INFO:tasks.workunit.client.0.smithi114.stdout:1/239: symlink df/d13/d44/l52 0 2024-04-25T02:27:06.842 INFO:tasks.workunit.client.0.smithi114.stdout:1/240: fdatasync df/d11/d32/f3c 0 2024-04-25T02:27:06.843 INFO:tasks.workunit.client.0.smithi114.stdout:7/306: creat d5/d60/f6c x:0 0 0 2024-04-25T02:27:06.844 INFO:tasks.workunit.client.0.smithi114.stdout:1/241: dread - df/d11/f20 zero size 2024-04-25T02:27:06.845 INFO:tasks.workunit.client.0.smithi114.stdout:7/307: write d5/d19/f34 [753557,54025] 0 2024-04-25T02:27:06.847 INFO:tasks.workunit.client.0.smithi114.stdout:6/346: dwrite de/d27/d34/d44/f55 [0,4194304] 0 2024-04-25T02:27:06.849 INFO:tasks.workunit.client.0.smithi114.stdout:9/285: mkdir d8/d16/d21/d24/d69 0 2024-04-25T02:27:06.851 INFO:tasks.workunit.client.0.smithi114.stdout:5/290: rename d1/ff to d1/d6/d1a/f66 0 2024-04-25T02:27:06.854 INFO:tasks.workunit.client.0.smithi114.stdout:9/286: dwrite d8/d16/d21/d24/d3c/f45 [0,4194304] 0 2024-04-25T02:27:06.856 INFO:tasks.workunit.client.0.smithi114.stdout:1/242: creat df/d11/d25/d33/f53 x:0 0 0 2024-04-25T02:27:06.861 INFO:tasks.workunit.client.0.smithi114.stdout:9/287: dwrite d8/d16/d21/f30 [0,4194304] 0 2024-04-25T02:27:06.862 INFO:tasks.workunit.client.0.smithi114.stdout:3/229: dwrite d0/d25/f48 [0,4194304] 0 2024-04-25T02:27:06.863 INFO:tasks.workunit.client.0.smithi114.stdout:5/291: mkdir d1/d6/de/d67 0 2024-04-25T02:27:06.866 INFO:tasks.workunit.client.0.smithi114.stdout:1/243: creat df/d11/d25/d43/f54 x:0 0 0 2024-04-25T02:27:06.873 INFO:tasks.workunit.client.0.smithi114.stdout:3/230: rename d0/d5/f23 to d0/d25/d2a/f4e 0 2024-04-25T02:27:06.874 INFO:tasks.workunit.client.0.smithi114.stdout:5/292: mknod d1/d3e/d60/c68 0 2024-04-25T02:27:06.876 INFO:tasks.workunit.client.0.smithi114.stdout:9/288: read d8/d16/d2f/d39/d38/d46/d53/f5c [560739,98523] 0 2024-04-25T02:27:06.877 INFO:tasks.workunit.client.0.smithi114.stdout:1/244: rename df/d11/d25/f4b to df/d2a/d34/f55 0 2024-04-25T02:27:06.879 INFO:tasks.workunit.client.0.smithi114.stdout:4/229: write d3/d14/f37 [4248318,98444] 0 2024-04-25T02:27:06.879 INFO:tasks.workunit.client.0.smithi114.stdout:5/293: dwrite d1/d6/f43 [0,4194304] 0 2024-04-25T02:27:06.881 INFO:tasks.workunit.client.0.smithi114.stdout:4/230: write d3/d8/d23/d25/d31/d33/f29 [3020918,54363] 0 2024-04-25T02:27:06.882 INFO:tasks.workunit.client.0.smithi114.stdout:8/309: truncate da/d1d/f36 2498560 0 2024-04-25T02:27:06.882 INFO:tasks.workunit.client.0.smithi114.stdout:4/231: write d3/d8/d12/f18 [2098783,61893] 0 2024-04-25T02:27:06.883 INFO:tasks.workunit.client.0.smithi114.stdout:9/289: chown d8/d16/d21/d37/l4a 515026 1 2024-04-25T02:27:06.883 INFO:tasks.workunit.client.0.smithi114.stdout:8/310: chown da/d38/d35/l4c 538662 1 2024-04-25T02:27:06.883 INFO:tasks.workunit.client.0.smithi114.stdout:9/290: stat d8/c34 0 2024-04-25T02:27:06.884 INFO:tasks.workunit.client.0.smithi114.stdout:5/294: mkdir d1/d6/d1a/d69 0 2024-04-25T02:27:06.884 INFO:tasks.workunit.client.0.smithi114.stdout:4/232: write d3/d8/d12/f1e [2017804,122222] 0 2024-04-25T02:27:06.886 INFO:tasks.workunit.client.0.smithi114.stdout:8/311: dread da/d1e/f3d [0,4194304] 0 2024-04-25T02:27:06.888 INFO:tasks.workunit.client.0.smithi114.stdout:9/291: rmdir d8/d16/d21/d37 39 2024-04-25T02:27:06.888 INFO:tasks.workunit.client.0.smithi114.stdout:2/314: dwrite d5/fe [4194304,4194304] 0 2024-04-25T02:27:06.893 INFO:tasks.workunit.client.0.smithi114.stdout:1/245: getdents df/d13/d1e/d3e 0 2024-04-25T02:27:06.894 INFO:tasks.workunit.client.0.smithi114.stdout:1/246: write df/d2a/f2e [720260,124610] 0 2024-04-25T02:27:06.895 INFO:tasks.workunit.client.0.smithi114.stdout:4/233: link d3/d8/d12/d19/d26/c2f d3/d8/d23/d35/c3c 0 2024-04-25T02:27:06.896 INFO:tasks.workunit.client.0.smithi114.stdout:5/295: dread d1/d53/d55/f5e [0,4194304] 0 2024-04-25T02:27:06.902 INFO:tasks.workunit.client.0.smithi114.stdout:8/312: rename da/d1e/l3c to da/l5c 0 2024-04-25T02:27:06.902 INFO:tasks.workunit.client.0.smithi114.stdout:4/234: mknod d3/d8/d23/d25/d31/d33/c3d 0 2024-04-25T02:27:06.902 INFO:tasks.workunit.client.0.smithi114.stdout:8/313: stat da/d1e/f59 0 2024-04-25T02:27:06.902 INFO:tasks.workunit.client.0.smithi114.stdout:9/292: getdents d8/d16/d2f 0 2024-04-25T02:27:06.902 INFO:tasks.workunit.client.0.smithi114.stdout:5/296: write d1/d6/f31 [1161853,86756] 0 2024-04-25T02:27:06.902 INFO:tasks.workunit.client.0.smithi114.stdout:2/315: rename d5/d6/d58/d5a/l3f to d5/d1c/d22/d67/l71 0 2024-04-25T02:27:06.903 INFO:tasks.workunit.client.0.smithi114.stdout:5/297: dread - d1/d53/f59 zero size 2024-04-25T02:27:06.903 INFO:tasks.workunit.client.0.smithi114.stdout:8/314: unlink da/d1e/l33 0 2024-04-25T02:27:06.903 INFO:tasks.workunit.client.0.smithi114.stdout:2/316: fsync d5/df/d3d/f40 0 2024-04-25T02:27:06.904 INFO:tasks.workunit.client.0.smithi114.stdout:7/308: dread f1 [0,4194304] 0 2024-04-25T02:27:06.904 INFO:tasks.workunit.client.0.smithi114.stdout:4/235: mkdir d3/d8/d12/d19/d26/d3e 0 2024-04-25T02:27:06.905 INFO:tasks.workunit.client.0.smithi114.stdout:4/236: readlink d3/le 0 2024-04-25T02:27:06.905 INFO:tasks.workunit.client.0.smithi114.stdout:5/298: dread d1/d53/d55/f5e [0,4194304] 0 2024-04-25T02:27:06.905 INFO:tasks.workunit.client.0.smithi114.stdout:9/293: symlink d8/d16/d2f/d39/d38/d46/l6a 0 2024-04-25T02:27:06.906 INFO:tasks.workunit.client.0.smithi114.stdout:5/299: dread - d1/d3e/f5b zero size 2024-04-25T02:27:06.906 INFO:tasks.workunit.client.0.smithi114.stdout:5/300: fdatasync d1/f65 0 2024-04-25T02:27:06.908 INFO:tasks.workunit.client.0.smithi114.stdout:2/317: mkdir d5/d72 0 2024-04-25T02:27:06.909 INFO:tasks.workunit.client.0.smithi114.stdout:0/279: write d1/d7/d18/f2f [1008664,106130] 0 2024-04-25T02:27:06.912 INFO:tasks.workunit.client.0.smithi114.stdout:0/280: chown d1/d4/da/d33/f4a 455119 1 2024-04-25T02:27:06.913 INFO:tasks.workunit.client.0.smithi114.stdout:7/309: rename d5/d19/c20 to d5/c6d 0 2024-04-25T02:27:06.913 INFO:tasks.workunit.client.0.smithi114.stdout:8/315: link da/d1e/c20 da/d32/d3b/c5d 0 2024-04-25T02:27:06.915 INFO:tasks.workunit.client.0.smithi114.stdout:4/237: dwrite d3/d8/f2c [0,4194304] 0 2024-04-25T02:27:06.917 INFO:tasks.workunit.client.0.smithi114.stdout:4/238: write d3/d8/d23/d25/d31/d33/f29 [3193464,89583] 0 2024-04-25T02:27:06.917 INFO:tasks.workunit.client.0.smithi114.stdout:5/301: rename d1/d3e/d60/c68 to d1/d3e/c6a 0 2024-04-25T02:27:06.918 INFO:tasks.workunit.client.0.smithi114.stdout:5/302: chown d1/d25/d24/f61 519 1 2024-04-25T02:27:06.919 INFO:tasks.workunit.client.0.smithi114.stdout:9/294: creat d8/d16/d21/d24/d3c/f6b x:0 0 0 2024-04-25T02:27:06.919 INFO:tasks.workunit.client.0.smithi114.stdout:5/303: read - d1/d3e/f5b zero size 2024-04-25T02:27:06.921 INFO:tasks.workunit.client.0.smithi114.stdout:7/310: creat d5/d19/d1a/f6e x:0 0 0 2024-04-25T02:27:06.922 INFO:tasks.workunit.client.0.smithi114.stdout:8/316: rename da/d38/l5a to da/d38/l5e 0 2024-04-25T02:27:06.923 INFO:tasks.workunit.client.0.smithi114.stdout:6/347: truncate de/f19 6981243 0 2024-04-25T02:27:06.925 INFO:tasks.workunit.client.0.smithi114.stdout:7/311: dwrite d5/f9 [0,4194304] 0 2024-04-25T02:27:06.927 INFO:tasks.workunit.client.0.smithi114.stdout:7/312: write d5/d19/d1a/f36 [85456,53404] 0 2024-04-25T02:27:06.928 INFO:tasks.workunit.client.0.smithi114.stdout:7/313: write d5/d54/f57 [915538,54865] 0 2024-04-25T02:27:06.930 INFO:tasks.workunit.client.0.smithi114.stdout:3/231: write d0/d5/fc [2007091,98132] 0 2024-04-25T02:27:06.933 INFO:tasks.workunit.client.0.smithi114.stdout:2/318: getdents d5/d1c/d21 0 2024-04-25T02:27:06.934 INFO:tasks.workunit.client.0.smithi114.stdout:5/304: dwrite d1/d6/d1a/f64 [0,4194304] 0 2024-04-25T02:27:06.938 INFO:tasks.workunit.client.0.smithi114.stdout:7/314: write d5/f33 [142556,81683] 0 2024-04-25T02:27:06.940 INFO:tasks.workunit.client.0.smithi114.stdout:9/295: rename d8/d16/d21/d37/f3b to d8/d16/d21/d24/d69/f6c 0 2024-04-25T02:27:06.941 INFO:tasks.workunit.client.0.smithi114.stdout:3/232: creat d0/d25/d29/f4f x:0 0 0 2024-04-25T02:27:06.942 INFO:tasks.workunit.client.0.smithi114.stdout:7/315: dread d5/f9 [0,4194304] 0 2024-04-25T02:27:06.942 INFO:tasks.workunit.client.0.smithi114.stdout:8/317: creat da/d1e/d58/f5f x:0 0 0 2024-04-25T02:27:06.943 INFO:tasks.workunit.client.0.smithi114.stdout:7/316: readlink d5/d19/d23/l26 0 2024-04-25T02:27:06.944 INFO:tasks.workunit.client.0.smithi114.stdout:2/319: dread d5/d6/f55 [0,4194304] 0 2024-04-25T02:27:06.945 INFO:tasks.workunit.client.0.smithi114.stdout:6/348: mknod de/d27/c83 0 2024-04-25T02:27:06.946 INFO:tasks.workunit.client.0.smithi114.stdout:5/305: dread d1/d6/f31 [0,4194304] 0 2024-04-25T02:27:06.951 INFO:tasks.workunit.client.0.smithi114.stdout:9/296: write d8/d16/d21/f22 [1584620,80966] 0 2024-04-25T02:27:06.953 INFO:tasks.workunit.client.0.smithi114.stdout:8/318: creat da/d1d/f60 x:0 0 0 2024-04-25T02:27:06.959 INFO:tasks.workunit.client.0.smithi114.stdout:4/239: dread d3/d8/d23/d25/d31/d33/f29 [0,4194304] 0 2024-04-25T02:27:06.959 INFO:tasks.workunit.client.0.smithi114.stdout:2/320: dwrite d5/df/d1e/f38 [0,4194304] 0 2024-04-25T02:27:06.963 INFO:tasks.workunit.client.0.smithi114.stdout:9/297: symlink d8/d16/d21/d24/l6d 0 2024-04-25T02:27:06.966 INFO:tasks.workunit.client.0.smithi114.stdout:8/319: creat da/d32/f61 x:0 0 0 2024-04-25T02:27:06.966 INFO:tasks.workunit.client.0.smithi114.stdout:3/233: dread d0/f21 [0,4194304] 0 2024-04-25T02:27:06.969 INFO:tasks.workunit.client.0.smithi114.stdout:9/298: dwrite d8/ff [4194304,4194304] 0 2024-04-25T02:27:06.971 INFO:tasks.workunit.client.0.smithi114.stdout:0/281: truncate d1/d4/f49 520563 0 2024-04-25T02:27:06.973 INFO:tasks.workunit.client.0.smithi114.stdout:2/321: write d5/f15 [2875531,12796] 0 2024-04-25T02:27:06.974 INFO:tasks.workunit.client.0.smithi114.stdout:8/320: dwrite da/d38/d35/f42 [0,4194304] 0 2024-04-25T02:27:06.980 INFO:tasks.workunit.client.0.smithi114.stdout:4/240: symlink d3/l3f 0 2024-04-25T02:27:06.982 INFO:tasks.workunit.client.0.smithi114.stdout:2/322: dwrite d5/df/f53 [4194304,4194304] 0 2024-04-25T02:27:06.983 INFO:tasks.workunit.client.0.smithi114.stdout:8/321: dwrite da/d32/f61 [0,4194304] 0 2024-04-25T02:27:06.984 INFO:tasks.workunit.client.0.smithi114.stdout:0/282: mkdir d1/d7/d18/d2e/d50 0 2024-04-25T02:27:06.986 INFO:tasks.workunit.client.0.smithi114.stdout:1/247: rename df/d11/d25/f35 to df/d13/f56 0 2024-04-25T02:27:06.987 INFO:tasks.workunit.client.0.smithi114.stdout:3/234: dwrite d0/f12 [0,4194304] 0 2024-04-25T02:27:06.987 INFO:tasks.workunit.client.0.smithi114.stdout:2/323: truncate d5/d6/d58/d5a/f4e 951086 0 2024-04-25T02:27:06.992 INFO:tasks.workunit.client.0.smithi114.stdout:8/322: dwrite da/d38/f34 [0,4194304] 0 2024-04-25T02:27:06.993 INFO:tasks.workunit.client.0.smithi114.stdout:7/317: rename d5/d43/d50 to d5/d19/d23/d6f 0 2024-04-25T02:27:06.999 INFO:tasks.workunit.client.0.smithi114.stdout:6/349: write de/f16 [2072033,131050] 0 2024-04-25T02:27:07.000 INFO:tasks.workunit.client.0.smithi114.stdout:6/350: write de/d27/d34/d38/f70 [374441,48477] 0 2024-04-25T02:27:07.000 INFO:tasks.workunit.client.0.smithi114.stdout:4/241: creat d3/d8/d23/d35/f40 x:0 0 0 2024-04-25T02:27:07.001 INFO:tasks.workunit.client.0.smithi114.stdout:6/351: write de/d27/d34/d38/f70 [246116,120860] 0 2024-04-25T02:27:07.003 INFO:tasks.workunit.client.0.smithi114.stdout:0/283: link d1/d4/d24/f47 d1/d7/d18/f51 0 2024-04-25T02:27:07.004 INFO:tasks.workunit.client.0.smithi114.stdout:5/306: truncate d1/d6/f3c 270119 0 2024-04-25T02:27:07.007 INFO:tasks.workunit.client.0.smithi114.stdout:7/318: symlink d5/d43/l70 0 2024-04-25T02:27:07.007 INFO:tasks.workunit.client.0.smithi114.stdout:6/352: dwrite de/d25/d39/d5c/f6f [0,4194304] 0 2024-04-25T02:27:07.009 INFO:tasks.workunit.client.0.smithi114.stdout:2/324: link d5/df/f43 d5/df/d2c/f73 0 2024-04-25T02:27:07.010 INFO:tasks.workunit.client.0.smithi114.stdout:6/353: dread de/d25/d39/f5e [0,4194304] 0 2024-04-25T02:27:07.010 INFO:tasks.workunit.client.0.smithi114.stdout:2/325: write d5/df/f17 [420544,46457] 0 2024-04-25T02:27:07.011 INFO:tasks.workunit.client.0.smithi114.stdout:6/354: fsync de/d30/f62 0 2024-04-25T02:27:07.012 INFO:tasks.workunit.client.0.smithi114.stdout:6/355: write de/f16 [2758491,26923] 0 2024-04-25T02:27:07.018 INFO:tasks.workunit.client.0.smithi114.stdout:0/284: unlink d1/d30/f43 0 2024-04-25T02:27:07.020 INFO:tasks.workunit.client.0.smithi114.stdout:9/299: rename d8/d16/c2e to d8/c6e 0 2024-04-25T02:27:07.022 INFO:tasks.workunit.client.0.smithi114.stdout:4/242: symlink d3/d8/l41 0 2024-04-25T02:27:07.023 INFO:tasks.workunit.client.0.smithi114.stdout:4/243: write d3/d8/f2c [5203810,104791] 0 2024-04-25T02:27:07.024 INFO:tasks.workunit.client.0.smithi114.stdout:7/319: unlink d5/d32/l42 0 2024-04-25T02:27:07.025 INFO:tasks.workunit.client.0.smithi114.stdout:9/300: dread d8/d16/d21/d37/f3e [0,4194304] 0 2024-04-25T02:27:07.025 INFO:tasks.workunit.client.0.smithi114.stdout:7/320: write d5/fa [5877837,67992] 0 2024-04-25T02:27:07.027 INFO:tasks.workunit.client.0.smithi114.stdout:3/235: link d0/f1d d0/d41/f50 0 2024-04-25T02:27:07.027 INFO:tasks.workunit.client.0.smithi114.stdout:9/301: chown d8/d16/d2f/d39/f23 7 1 2024-04-25T02:27:07.028 INFO:tasks.workunit.client.0.smithi114.stdout:4/244: dread d3/d8/f2c [0,4194304] 0 2024-04-25T02:27:07.029 INFO:tasks.workunit.client.0.smithi114.stdout:6/356: unlink de/c15 0 2024-04-25T02:27:07.031 INFO:tasks.workunit.client.0.smithi114.stdout:6/357: chown de/d25/d39/d47 11910 1 2024-04-25T02:27:07.031 INFO:tasks.workunit.client.0.smithi114.stdout:5/307: rename d1/c3 to d1/d25/d24/c6b 0 2024-04-25T02:27:07.035 INFO:tasks.workunit.client.0.smithi114.stdout:9/302: dwrite d8/fe [0,4194304] 0 2024-04-25T02:27:07.036 INFO:tasks.workunit.client.0.smithi114.stdout:3/236: dwrite d0/f21 [0,4194304] 0 2024-04-25T02:27:07.037 INFO:tasks.workunit.client.0.smithi114.stdout:9/303: write d8/ff [1317019,105031] 0 2024-04-25T02:27:07.038 INFO:tasks.workunit.client.0.smithi114.stdout:3/237: write d0/d5/f28 [3596359,14756] 0 2024-04-25T02:27:07.039 INFO:tasks.workunit.client.0.smithi114.stdout:4/245: mkdir d3/d8/d12/d19/d42 0 2024-04-25T02:27:07.040 INFO:tasks.workunit.client.0.smithi114.stdout:6/358: symlink de/d27/d34/d38/l84 0 2024-04-25T02:27:07.048 INFO:tasks.workunit.client.0.smithi114.stdout:7/321: link d5/d60/f6a d5/d60/f71 0 2024-04-25T02:27:07.048 INFO:tasks.workunit.client.0.smithi114.stdout:7/322: chown d5/cc 1 1 2024-04-25T02:27:07.049 INFO:tasks.workunit.client.0.smithi114.stdout:3/238: rename d0/d25/d29/f4f to d0/d41/f51 0 2024-04-25T02:27:07.049 INFO:tasks.workunit.client.0.smithi114.stdout:7/323: write d5/d19/d1a/f3b [1593345,104672] 0 2024-04-25T02:27:07.051 INFO:tasks.workunit.client.0.smithi114.stdout:4/246: unlink d3/d8/ff 0 2024-04-25T02:27:07.053 INFO:tasks.workunit.client.0.smithi114.stdout:1/248: creat df/d11/d25/d33/f57 x:0 0 0 2024-04-25T02:27:07.057 INFO:tasks.workunit.client.0.smithi114.stdout:3/239: mknod d0/d5/c52 0 2024-04-25T02:27:07.057 INFO:tasks.workunit.client.0.smithi114.stdout:7/324: creat d5/d32/d4a/d51/f72 x:0 0 0 2024-04-25T02:27:07.058 INFO:tasks.workunit.client.0.smithi114.stdout:4/247: write d3/d8/f2c [2360286,106075] 0 2024-04-25T02:27:07.061 INFO:tasks.workunit.client.0.smithi114.stdout:3/240: creat d0/d5/f53 x:0 0 0 2024-04-25T02:27:07.063 INFO:tasks.workunit.client.0.smithi114.stdout:6/359: link cb de/d25/d39/d47/c85 0 2024-04-25T02:27:07.066 INFO:tasks.workunit.client.0.smithi114.stdout:4/248: mknod d3/c43 0 2024-04-25T02:27:07.068 INFO:tasks.workunit.client.0.smithi114.stdout:6/360: creat de/f86 x:0 0 0 2024-04-25T02:27:07.070 INFO:tasks.workunit.client.0.smithi114.stdout:3/241: dwrite d0/d25/d2a/f4e [0,4194304] 0 2024-04-25T02:27:07.071 INFO:tasks.workunit.client.0.smithi114.stdout:4/249: creat d3/d8/d30/f44 x:0 0 0 2024-04-25T02:27:07.072 INFO:tasks.workunit.client.0.smithi114.stdout:1/249: link df/d2a/f46 df/d11/d25/d33/f58 0 2024-04-25T02:27:07.072 INFO:tasks.workunit.client.0.smithi114.stdout:1/250: stat df/d11/d32/f3c 0 2024-04-25T02:27:07.073 INFO:tasks.workunit.client.0.smithi114.stdout:7/325: link d5/d19/f2a d5/d54/f73 0 2024-04-25T02:27:07.074 INFO:tasks.workunit.client.0.smithi114.stdout:3/242: creat d0/d5/d3d/f54 x:0 0 0 2024-04-25T02:27:07.075 INFO:tasks.workunit.client.0.smithi114.stdout:2/326: write d5/d6/f55 [117178,106402] 0 2024-04-25T02:27:07.075 INFO:tasks.workunit.client.0.smithi114.stdout:4/250: symlink d3/d14/l45 0 2024-04-25T02:27:07.075 INFO:tasks.workunit.client.0.smithi114.stdout:7/326: write d5/d19/d1a/f38 [70744,9827] 0 2024-04-25T02:27:07.080 INFO:tasks.workunit.client.0.smithi114.stdout:1/251: dwrite df/d2a/f2e [0,4194304] 0 2024-04-25T02:27:07.081 INFO:tasks.workunit.client.0.smithi114.stdout:7/327: creat d5/d19/d1a/f74 x:0 0 0 2024-04-25T02:27:07.082 INFO:tasks.workunit.client.0.smithi114.stdout:4/251: mknod d3/d8/d23/d25/d31/c46 0 2024-04-25T02:27:07.083 INFO:tasks.workunit.client.0.smithi114.stdout:7/328: fdatasync d5/d43/f5a 0 2024-04-25T02:27:07.083 INFO:tasks.workunit.client.0.smithi114.stdout:3/243: dwrite d0/f38 [0,4194304] 0 2024-04-25T02:27:07.084 INFO:tasks.workunit.client.0.smithi114.stdout:1/252: fdatasync df/d13/d1e/f21 0 2024-04-25T02:27:07.085 INFO:tasks.workunit.client.0.smithi114.stdout:1/253: chown df/d13/d1e 1971336 1 2024-04-25T02:27:07.085 INFO:tasks.workunit.client.0.smithi114.stdout:4/252: dread d3/d8/d23/d25/d31/d33/f29 [4194304,4194304] 0 2024-04-25T02:27:07.085 INFO:tasks.workunit.client.0.smithi114.stdout:3/244: truncate d0/d5/f44 1212572 0 2024-04-25T02:27:07.086 INFO:tasks.workunit.client.0.smithi114.stdout:8/323: sync 2024-04-25T02:27:07.086 INFO:tasks.workunit.client.0.smithi114.stdout:0/285: sync 2024-04-25T02:27:07.088 INFO:tasks.workunit.client.0.smithi114.stdout:2/327: link d5/d1c/d21/c27 d5/d1c/d22/c74 0 2024-04-25T02:27:07.091 INFO:tasks.workunit.client.0.smithi114.stdout:4/253: write d3/d14/f37 [3197675,19991] 0 2024-04-25T02:27:07.092 INFO:tasks.workunit.client.0.smithi114.stdout:3/245: creat d0/d25/d2a/d34/f55 x:0 0 0 2024-04-25T02:27:07.093 INFO:tasks.workunit.client.0.smithi114.stdout:8/324: mkdir da/d38/d62 0 2024-04-25T02:27:07.094 INFO:tasks.workunit.client.0.smithi114.stdout:5/308: dwrite d1/d6/de/f1d [0,4194304] 0 2024-04-25T02:27:07.095 INFO:tasks.workunit.client.0.smithi114.stdout:5/309: write d1/d25/d24/f61 [673037,4458] 0 2024-04-25T02:27:07.096 INFO:tasks.workunit.client.0.smithi114.stdout:1/254: dread df/d11/d25/f37 [0,4194304] 0 2024-04-25T02:27:07.098 INFO:tasks.workunit.client.0.smithi114.stdout:4/254: chown d3/d8/d23/c39 1249834 1 2024-04-25T02:27:07.098 INFO:tasks.workunit.client.0.smithi114.stdout:2/328: creat d5/df/d63/f75 x:0 0 0 2024-04-25T02:27:07.099 INFO:tasks.workunit.client.0.smithi114.stdout:8/325: mknod da/d32/d3b/c63 0 2024-04-25T02:27:07.100 INFO:tasks.workunit.client.0.smithi114.stdout:2/329: readlink d5/d6/l41 0 2024-04-25T02:27:07.102 INFO:tasks.workunit.client.0.smithi114.stdout:2/330: fdatasync d5/df/d3d/f42 0 2024-04-25T02:27:07.106 INFO:tasks.workunit.client.0.smithi114.stdout:5/310: dwrite d1/d53/d55/f58 [0,4194304] 0 2024-04-25T02:27:07.106 INFO:tasks.workunit.client.0.smithi114.stdout:1/255: read df/d11/f24 [90496,98872] 0 2024-04-25T02:27:07.111 INFO:tasks.workunit.client.0.smithi114.stdout:5/311: unlink d1/d3e/l4d 0 2024-04-25T02:27:07.113 INFO:tasks.workunit.client.0.smithi114.stdout:6/361: truncate de/d25/d39/f7b 1382053 0 2024-04-25T02:27:07.114 INFO:tasks.workunit.client.0.smithi114.stdout:7/329: dread d5/d19/f1d [0,4194304] 0 2024-04-25T02:27:07.116 INFO:tasks.workunit.client.0.smithi114.stdout:5/312: mkdir d1/d6/d4f/d6c 0 2024-04-25T02:27:07.116 INFO:tasks.workunit.client.0.smithi114.stdout:2/331: link d5/d6/l2d d5/df/d1e/l76 0 2024-04-25T02:27:07.118 INFO:tasks.workunit.client.0.smithi114.stdout:6/362: rename de/d30/f6b to de/d27/d34/d38/f87 0 2024-04-25T02:27:07.125 INFO:tasks.workunit.client.0.smithi114.stdout:8/326: getdents da/d38 0 2024-04-25T02:27:07.126 INFO:tasks.workunit.client.0.smithi114.stdout:6/363: dread de/d27/f2d [0,4194304] 0 2024-04-25T02:27:07.126 INFO:tasks.workunit.client.0.smithi114.stdout:8/327: write da/d38/d35/f46 [2612431,27684] 0 2024-04-25T02:27:07.128 INFO:tasks.workunit.client.0.smithi114.stdout:9/304: sync 2024-04-25T02:27:07.130 INFO:tasks.workunit.client.0.smithi114.stdout:3/246: truncate d0/d5/f44 822838 0 2024-04-25T02:27:07.133 INFO:tasks.workunit.client.0.smithi114.stdout:6/364: dwrite de/d30/f62 [0,4194304] 0 2024-04-25T02:27:07.134 INFO:tasks.workunit.client.0.smithi114.stdout:3/247: creat d0/d41/f56 x:0 0 0 2024-04-25T02:27:07.134 INFO:tasks.workunit.client.0.smithi114.stdout:4/255: dread d3/d8/d12/d19/d26/f2a [0,4194304] 0 2024-04-25T02:27:07.135 INFO:tasks.workunit.client.0.smithi114.stdout:6/365: chown de/l4d 4325 1 2024-04-25T02:27:07.135 INFO:tasks.workunit.client.0.smithi114.stdout:4/256: chown d3/f28 216 1 2024-04-25T02:27:07.138 INFO:tasks.workunit.client.0.smithi114.stdout:6/366: creat de/d27/d34/d44/f88 x:0 0 0 2024-04-25T02:27:07.163 INFO:tasks.workunit.client.0.smithi114.stdout:6/367: creat de/d27/d34/f89 x:0 0 0 2024-04-25T02:27:07.164 INFO:tasks.workunit.client.0.smithi114.stdout:7/330: dwrite d5/d19/f2b [0,4194304] 0 2024-04-25T02:27:07.167 INFO:tasks.workunit.client.0.smithi114.stdout:8/328: dread da/d38/d35/f56 [0,4194304] 0 2024-04-25T02:27:07.167 INFO:tasks.workunit.client.0.smithi114.stdout:2/332: dwrite d5/df/f11 [0,4194304] 0 2024-04-25T02:27:07.168 INFO:tasks.workunit.client.0.smithi114.stdout:6/368: read - de/d27/d34/d4b/f53 zero size 2024-04-25T02:27:07.172 INFO:tasks.workunit.client.0.smithi114.stdout:8/329: creat da/d32/d3b/f64 x:0 0 0 2024-04-25T02:27:07.174 INFO:tasks.workunit.client.0.smithi114.stdout:2/333: unlink d5/d6/d58/d5a/f5d 0 2024-04-25T02:27:07.174 INFO:tasks.workunit.client.0.smithi114.stdout:5/313: dwrite d1/d25/d24/f32 [0,4194304] 0 2024-04-25T02:27:07.175 INFO:tasks.workunit.client.0.smithi114.stdout:3/248: dwrite d0/d5/f17 [0,4194304] 0 2024-04-25T02:27:07.176 INFO:tasks.workunit.client.0.smithi114.stdout:5/314: stat d1/d6/d1a/l1c 0 2024-04-25T02:27:07.176 INFO:tasks.workunit.client.0.smithi114.stdout:2/334: write d5/df/d1e/f6d [211244,112728] 0 2024-04-25T02:27:07.177 INFO:tasks.workunit.client.0.smithi114.stdout:2/335: stat d5/d1c/d22/f28 0 2024-04-25T02:27:07.180 INFO:tasks.workunit.client.0.smithi114.stdout:6/369: unlink de/d27/d34/d38/c45 0 2024-04-25T02:27:07.181 INFO:tasks.workunit.client.0.smithi114.stdout:8/330: mkdir da/d38/d35/d49/d65 0 2024-04-25T02:27:07.182 INFO:tasks.workunit.client.0.smithi114.stdout:3/249: symlink d0/d25/d2a/l57 0 2024-04-25T02:27:07.182 INFO:tasks.workunit.client.0.smithi114.stdout:8/331: dread da/d1e/f3d [0,4194304] 0 2024-04-25T02:27:07.182 INFO:tasks.workunit.client.0.smithi114.stdout:5/315: mknod d1/d3e/d60/c6d 0 2024-04-25T02:27:07.183 INFO:tasks.workunit.client.0.smithi114.stdout:8/332: dread - da/d1e/f4e zero size 2024-04-25T02:27:07.184 INFO:tasks.workunit.client.0.smithi114.stdout:2/336: mknod d5/df/d1e/c77 0 2024-04-25T02:27:07.185 INFO:tasks.workunit.client.0.smithi114.stdout:3/250: mknod d0/d25/d2a/c58 0 2024-04-25T02:27:07.186 INFO:tasks.workunit.client.0.smithi114.stdout:3/251: readlink d0/d25/d2a/l57 0 2024-04-25T02:27:07.189 INFO:tasks.workunit.client.0.smithi114.stdout:3/252: unlink d0/l2b 0 2024-04-25T02:27:07.190 INFO:tasks.workunit.client.0.smithi114.stdout:6/370: dwrite de/d27/d34/d4b/f7c [0,4194304] 0 2024-04-25T02:27:07.191 INFO:tasks.workunit.client.0.smithi114.stdout:5/316: rmdir d1/d6/de/d67 0 2024-04-25T02:27:07.194 INFO:tasks.workunit.client.0.smithi114.stdout:2/337: getdents d5/df/d63 0 2024-04-25T02:27:07.194 INFO:tasks.workunit.client.0.smithi114.stdout:6/371: write de/d27/d34/d38/f87 [1487916,21502] 0 2024-04-25T02:27:07.195 INFO:tasks.workunit.client.0.smithi114.stdout:5/317: creat d1/d6/d4f/f6e x:0 0 0 2024-04-25T02:27:07.197 INFO:tasks.workunit.client.0.smithi114.stdout:3/253: dwrite d0/d5/fc [0,4194304] 0 2024-04-25T02:27:07.197 INFO:tasks.workunit.client.0.smithi114.stdout:5/318: dread - d1/d6/de/f44 zero size 2024-04-25T02:27:07.199 INFO:tasks.workunit.client.0.smithi114.stdout:6/372: fdatasync de/d2a/f73 0 2024-04-25T02:27:07.199 INFO:tasks.workunit.client.0.smithi114.stdout:0/286: sync 2024-04-25T02:27:07.199 INFO:tasks.workunit.client.0.smithi114.stdout:2/338: creat d5/d6/d58/d5a/d59/f78 x:0 0 0 2024-04-25T02:27:07.200 INFO:tasks.workunit.client.0.smithi114.stdout:2/339: write d5/d6/d31/f32 [356192,10288] 0 2024-04-25T02:27:07.201 INFO:tasks.workunit.client.0.smithi114.stdout:2/340: write d5/d6/d31/f32 [642522,75225] 0 2024-04-25T02:27:07.202 INFO:tasks.workunit.client.0.smithi114.stdout:2/341: chown d5/d1c/d29/l30 79519 1 2024-04-25T02:27:07.208 INFO:tasks.workunit.client.0.smithi114.stdout:2/342: dwrite d5/df/d2c/f64 [0,4194304] 0 2024-04-25T02:27:07.208 INFO:tasks.workunit.client.0.smithi114.stdout:0/287: mkdir d1/d4/d24/d52 0 2024-04-25T02:27:07.215 INFO:tasks.workunit.client.0.smithi114.stdout:6/373: rename fa to de/d27/d34/f8a 0 2024-04-25T02:27:07.216 INFO:tasks.workunit.client.0.smithi114.stdout:6/374: stat de/d2a/f2b 0 2024-04-25T02:27:07.216 INFO:tasks.workunit.client.0.smithi114.stdout:2/343: mkdir d5/d79 0 2024-04-25T02:27:07.217 INFO:tasks.workunit.client.0.smithi114.stdout:7/331: fsync d5/d19/f2b 0 2024-04-25T02:27:07.217 INFO:tasks.workunit.client.0.smithi114.stdout:7/332: dread - d5/d19/d23/f58 zero size 2024-04-25T02:27:07.218 INFO:tasks.workunit.client.0.smithi114.stdout:5/319: getdents d1/d53 0 2024-04-25T02:27:07.219 INFO:tasks.workunit.client.0.smithi114.stdout:7/333: truncate d5/d32/d4a/d51/f6b 570482 0 2024-04-25T02:27:07.219 INFO:tasks.workunit.client.0.smithi114.stdout:6/375: rmdir de/d2a 39 2024-04-25T02:27:07.220 INFO:tasks.workunit.client.0.smithi114.stdout:7/334: chown d5/d19/d23/f3c 1 1 2024-04-25T02:27:07.221 INFO:tasks.workunit.client.0.smithi114.stdout:5/320: fsync d1/d6/f2b 0 2024-04-25T02:27:07.222 INFO:tasks.workunit.client.0.smithi114.stdout:5/321: write d1/d25/d24/f3f [642659,88515] 0 2024-04-25T02:27:07.222 INFO:tasks.workunit.client.0.smithi114.stdout:5/322: chown d1/d6/f2b 67 1 2024-04-25T02:27:07.223 INFO:tasks.workunit.client.0.smithi114.stdout:7/335: unlink d5/cc 0 2024-04-25T02:27:07.223 INFO:tasks.workunit.client.0.smithi114.stdout:6/376: creat de/d27/d76/f8b x:0 0 0 2024-04-25T02:27:07.224 INFO:tasks.workunit.client.0.smithi114.stdout:8/333: dread da/d38/f2a [0,4194304] 0 2024-04-25T02:27:07.224 INFO:tasks.workunit.client.0.smithi114.stdout:6/377: dread - de/d25/d39/d47/f60 zero size 2024-04-25T02:27:07.226 INFO:tasks.workunit.client.0.smithi114.stdout:5/323: read d1/d25/f4e [1732196,38291] 0 2024-04-25T02:27:07.227 INFO:tasks.workunit.client.0.smithi114.stdout:8/334: creat da/d32/d3b/d40/f66 x:0 0 0 2024-04-25T02:27:07.227 INFO:tasks.workunit.client.0.smithi114.stdout:6/378: creat de/d25/d39/d5c/f8c x:0 0 0 2024-04-25T02:27:07.228 INFO:tasks.workunit.client.0.smithi114.stdout:6/379: readlink de/l26 0 2024-04-25T02:27:07.228 INFO:tasks.workunit.client.0.smithi114.stdout:5/324: mkdir d1/d51/d6f 0 2024-04-25T02:27:07.229 INFO:tasks.workunit.client.0.smithi114.stdout:9/305: sync 2024-04-25T02:27:07.229 INFO:tasks.workunit.client.0.smithi114.stdout:1/256: sync 2024-04-25T02:27:07.229 INFO:tasks.workunit.client.0.smithi114.stdout:7/336: dwrite d5/f6 [0,4194304] 0 2024-04-25T02:27:07.234 INFO:tasks.workunit.client.0.smithi114.stdout:6/380: creat de/d25/d39/d47/f8d x:0 0 0 2024-04-25T02:27:07.238 INFO:tasks.workunit.client.0.smithi114.stdout:5/325: mknod d1/d25/c70 0 2024-04-25T02:27:07.240 INFO:tasks.workunit.client.0.smithi114.stdout:9/306: dwrite d8/d16/d2f/d39/f62 [0,4194304] 0 2024-04-25T02:27:07.242 INFO:tasks.workunit.client.0.smithi114.stdout:3/254: rmdir d0 39 2024-04-25T02:27:07.243 INFO:tasks.workunit.client.0.smithi114.stdout:0/288: dread d1/d7/f14 [0,4194304] 0 2024-04-25T02:27:07.246 INFO:tasks.workunit.client.0.smithi114.stdout:5/326: dread d1/d6/d4f/f52 [0,4194304] 0 2024-04-25T02:27:07.247 INFO:tasks.workunit.client.0.smithi114.stdout:7/337: dwrite d5/d19/d23/f28 [4194304,4194304] 0 2024-04-25T02:27:07.249 INFO:tasks.workunit.client.0.smithi114.stdout:0/289: truncate d1/d30/d4d/f4e 560232 0 2024-04-25T02:27:07.249 INFO:tasks.workunit.client.0.smithi114.stdout:7/338: fdatasync d5/d19/f45 0 2024-04-25T02:27:07.251 INFO:tasks.workunit.client.0.smithi114.stdout:2/344: write d5/df/d3d/f4b [1402648,45673] 0 2024-04-25T02:27:07.252 INFO:tasks.workunit.client.0.smithi114.stdout:9/307: dread d8/d16/f27 [0,4194304] 0 2024-04-25T02:27:07.253 INFO:tasks.workunit.client.0.smithi114.stdout:0/290: symlink d1/d30/l53 0 2024-04-25T02:27:07.255 INFO:tasks.workunit.client.0.smithi114.stdout:7/339: creat d5/d32/d4a/d51/f75 x:0 0 0 2024-04-25T02:27:07.256 INFO:tasks.workunit.client.0.smithi114.stdout:3/255: dwrite d0/f38 [4194304,4194304] 0 2024-04-25T02:27:07.257 INFO:tasks.workunit.client.0.smithi114.stdout:2/345: creat d5/d1c/d21/f7a x:0 0 0 2024-04-25T02:27:07.258 INFO:tasks.workunit.client.0.smithi114.stdout:0/291: readlink d1/d7/d18/d2e/l3c 0 2024-04-25T02:27:07.258 INFO:tasks.workunit.client.0.smithi114.stdout:3/256: chown d0/f21 225515 1 2024-04-25T02:27:07.259 INFO:tasks.workunit.client.0.smithi114.stdout:7/340: mknod d5/d32/d4a/c76 0 2024-04-25T02:27:07.260 INFO:tasks.workunit.client.0.smithi114.stdout:7/341: stat d5/d19/d1a/c47 0 2024-04-25T02:27:07.260 INFO:tasks.workunit.client.0.smithi114.stdout:9/308: dread d8/d16/d21/d24/d69/f6c [0,4194304] 0 2024-04-25T02:27:07.260 INFO:tasks.workunit.client.0.smithi114.stdout:7/342: readlink d5/l7 0 2024-04-25T02:27:07.260 INFO:tasks.workunit.client.0.smithi114.stdout:0/292: creat d1/d7/d18/d2e/f54 x:0 0 0 2024-04-25T02:27:07.261 INFO:tasks.workunit.client.0.smithi114.stdout:3/257: symlink d0/l59 0 2024-04-25T02:27:07.261 INFO:tasks.workunit.client.0.smithi114.stdout:8/335: dread da/d1d/f36 [0,4194304] 0 2024-04-25T02:27:07.279 INFO:tasks.workunit.client.0.smithi114.stdout:7/343: mknod d5/d19/d1a/c77 0 2024-04-25T02:27:07.280 INFO:tasks.workunit.client.0.smithi114.stdout:1/257: dread df/d11/f28 [0,4194304] 0 2024-04-25T02:27:07.280 INFO:tasks.workunit.client.0.smithi114.stdout:0/293: mknod d1/d4/d24/c55 0 2024-04-25T02:27:07.281 INFO:tasks.workunit.client.0.smithi114.stdout:3/258: rmdir d0/d25/d29 39 2024-04-25T02:27:07.281 INFO:tasks.workunit.client.0.smithi114.stdout:7/344: stat d5/d60 0 2024-04-25T02:27:07.285 INFO:tasks.workunit.client.0.smithi114.stdout:9/309: creat d8/d16/d2f/d39/d38/f6f x:0 0 0 2024-04-25T02:27:07.285 INFO:tasks.workunit.client.0.smithi114.stdout:7/345: symlink d5/d43/d63/l78 0 2024-04-25T02:27:07.287 INFO:tasks.workunit.client.0.smithi114.stdout:6/381: dread de/d27/d34/f8a [0,4194304] 0 2024-04-25T02:27:07.288 INFO:tasks.workunit.client.0.smithi114.stdout:3/259: rename d0/d5/l30 to d0/d25/d2a/d36/d4d/l5a 0 2024-04-25T02:27:07.290 INFO:tasks.workunit.client.0.smithi114.stdout:5/327: dread d1/d25/f4e [0,4194304] 0 2024-04-25T02:27:07.291 INFO:tasks.workunit.client.0.smithi114.stdout:9/310: fdatasync d8/d16/d21/d37/f3e 0 2024-04-25T02:27:07.292 INFO:tasks.workunit.client.0.smithi114.stdout:7/346: symlink d5/d43/d4e/l79 0 2024-04-25T02:27:07.293 INFO:tasks.workunit.client.0.smithi114.stdout:6/382: mknod de/d27/d76/c8e 0 2024-04-25T02:27:07.294 INFO:tasks.workunit.client.0.smithi114.stdout:7/347: dread - d5/d19/d23/f3f zero size 2024-04-25T02:27:07.294 INFO:tasks.workunit.client.0.smithi114.stdout:3/260: dwrite d0/d5/fc [0,4194304] 0 2024-04-25T02:27:07.295 INFO:tasks.workunit.client.0.smithi114.stdout:5/328: symlink d1/d6/de/l71 0 2024-04-25T02:27:07.297 INFO:tasks.workunit.client.0.smithi114.stdout:8/336: truncate da/d38/f2a 411104 0 2024-04-25T02:27:07.299 INFO:tasks.workunit.client.0.smithi114.stdout:1/258: dread fa [0,4194304] 0 2024-04-25T02:27:07.299 INFO:tasks.workunit.client.0.smithi114.stdout:1/259: read - df/d13/f56 zero size 2024-04-25T02:27:07.302 INFO:tasks.workunit.client.0.smithi114.stdout:0/294: truncate d1/d4/da/d33/f4a 585651 0 2024-04-25T02:27:07.303 INFO:tasks.workunit.client.0.smithi114.stdout:4/257: sync 2024-04-25T02:27:07.303 INFO:tasks.workunit.client.0.smithi114.stdout:7/348: mkdir d5/d43/d63/d7a 0 2024-04-25T02:27:07.304 INFO:tasks.workunit.client.0.smithi114.stdout:3/261: mknod d0/d5/d3d/c5b 0 2024-04-25T02:27:07.305 INFO:tasks.workunit.client.0.smithi114.stdout:1/260: dwrite df/d13/d1e/f30 [0,4194304] 0 2024-04-25T02:27:07.306 INFO:tasks.workunit.client.0.smithi114.stdout:9/311: mkdir d8/d16/d21/d37/d60/d70 0 2024-04-25T02:27:07.310 INFO:tasks.workunit.client.0.smithi114.stdout:3/262: truncate d0/d5/d3d/f54 933252 0 2024-04-25T02:27:07.311 INFO:tasks.workunit.client.0.smithi114.stdout:4/258: dwrite d3/d8/f2c [4194304,4194304] 0 2024-04-25T02:27:07.311 INFO:tasks.workunit.client.0.smithi114.stdout:7/349: symlink d5/d32/l7b 0 2024-04-25T02:27:07.312 INFO:tasks.workunit.client.0.smithi114.stdout:7/350: fsync d5/fa 0 2024-04-25T02:27:07.312 INFO:tasks.workunit.client.0.smithi114.stdout:5/329: getdents d1/d51/d6f 0 2024-04-25T02:27:07.313 INFO:tasks.workunit.client.0.smithi114.stdout:5/330: fdatasync d1/d6/de/f37 0 2024-04-25T02:27:07.314 INFO:tasks.workunit.client.0.smithi114.stdout:9/312: creat d8/f71 x:0 0 0 2024-04-25T02:27:07.315 INFO:tasks.workunit.client.0.smithi114.stdout:6/383: creat de/d27/f8f x:0 0 0 2024-04-25T02:27:07.319 INFO:tasks.workunit.client.0.smithi114.stdout:7/351: stat d5/c6d 0 2024-04-25T02:27:07.320 INFO:tasks.workunit.client.0.smithi114.stdout:7/352: chown d5/d60/f6a 36116 1 2024-04-25T02:27:07.320 INFO:tasks.workunit.client.0.smithi114.stdout:7/353: readlink d5/d32/d4a/l68 0 2024-04-25T02:27:07.320 INFO:tasks.workunit.client.0.smithi114.stdout:5/331: symlink d1/l72 0 2024-04-25T02:27:07.321 INFO:tasks.workunit.client.0.smithi114.stdout:2/346: sync 2024-04-25T02:27:07.321 INFO:tasks.workunit.client.0.smithi114.stdout:2/347: dread - d5/d1c/d29/f5c zero size 2024-04-25T02:27:07.322 INFO:tasks.workunit.client.0.smithi114.stdout:6/384: mkdir de/d25/d39/d47/d90 0 2024-04-25T02:27:07.322 INFO:tasks.workunit.client.0.smithi114.stdout:2/348: write d5/d1c/d29/f5c [1033190,19474] 0 2024-04-25T02:27:07.323 INFO:tasks.workunit.client.0.smithi114.stdout:6/385: chown de/d27/c31 1 1 2024-04-25T02:27:07.323 INFO:tasks.workunit.client.0.smithi114.stdout:7/354: mknod d5/d43/d4e/c7c 0 2024-04-25T02:27:07.324 INFO:tasks.workunit.client.0.smithi114.stdout:5/332: mknod d1/c73 0 2024-04-25T02:27:07.324 INFO:tasks.workunit.client.0.smithi114.stdout:8/337: link da/d38/c18 da/d32/d3b/d40/c67 0 2024-04-25T02:27:07.326 INFO:tasks.workunit.client.0.smithi114.stdout:3/263: rename d0/d5/d3d/c5b to d0/d25/c5c 0 2024-04-25T02:27:07.327 INFO:tasks.workunit.client.0.smithi114.stdout:9/313: rename d8 to d8/d16/d2f/d39/d38/d5d/d72 22 2024-04-25T02:27:07.327 INFO:tasks.workunit.client.0.smithi114.stdout:4/259: rmdir d3/d14/d38 0 2024-04-25T02:27:07.329 INFO:tasks.workunit.client.0.smithi114.stdout:3/264: chown d0/d5/f53 2193 1 2024-04-25T02:27:07.330 INFO:tasks.workunit.client.0.smithi114.stdout:9/314: chown d8/f36 160376 1 2024-04-25T02:27:07.332 INFO:tasks.workunit.client.0.smithi114.stdout:5/333: mknod d1/d3e/d60/c74 0 2024-04-25T02:27:07.333 INFO:tasks.workunit.client.0.smithi114.stdout:3/265: chown d0/d5/c10 212265 1 2024-04-25T02:27:07.335 INFO:tasks.workunit.client.0.smithi114.stdout:9/315: write d8/d16/f3f [932635,89953] 0 2024-04-25T02:27:07.335 INFO:tasks.workunit.client.0.smithi114.stdout:6/386: dwrite de/d27/d34/d38/f42 [0,4194304] 0 2024-04-25T02:27:07.336 INFO:tasks.workunit.client.0.smithi114.stdout:4/260: unlink d3/d14/f21 0 2024-04-25T02:27:07.336 INFO:tasks.workunit.client.0.smithi114.stdout:2/349: dread d5/df/f12 [0,4194304] 0 2024-04-25T02:27:07.336 INFO:tasks.workunit.client.0.smithi114.stdout:7/355: dread d5/d19/d1a/f3b [0,4194304] 0 2024-04-25T02:27:07.338 INFO:tasks.workunit.client.0.smithi114.stdout:5/334: stat d1/d6/de/l71 0 2024-04-25T02:27:07.339 INFO:tasks.workunit.client.0.smithi114.stdout:8/338: dwrite da/d38/f34 [0,4194304] 0 2024-04-25T02:27:07.341 INFO:tasks.workunit.client.0.smithi114.stdout:0/295: truncate d1/d7/d18/f22 712565 0 2024-04-25T02:27:07.343 INFO:tasks.workunit.client.0.smithi114.stdout:4/261: creat d3/d14/f47 x:0 0 0 2024-04-25T02:27:07.346 INFO:tasks.workunit.client.0.smithi114.stdout:1/261: dread fe [0,4194304] 0 2024-04-25T02:27:07.347 INFO:tasks.workunit.client.0.smithi114.stdout:6/387: dwrite de/d27/d34/d44/f55 [0,4194304] 0 2024-04-25T02:27:07.353 INFO:tasks.workunit.client.0.smithi114.stdout:0/296: creat d1/d7/f56 x:0 0 0 2024-04-25T02:27:07.355 INFO:tasks.workunit.client.0.smithi114.stdout:5/335: dwrite d1/d25/d24/f27 [4194304,4194304] 0 2024-04-25T02:27:07.356 INFO:tasks.workunit.client.0.smithi114.stdout:1/262: fsync fe 0 2024-04-25T02:27:07.357 INFO:tasks.workunit.client.0.smithi114.stdout:1/263: dread - fc zero size 2024-04-25T02:27:07.358 INFO:tasks.workunit.client.0.smithi114.stdout:1/264: truncate df/f29 1040557 0 2024-04-25T02:27:07.362 INFO:tasks.workunit.client.0.smithi114.stdout:5/336: dwrite d1/d6/d4f/f6e [0,4194304] 0 2024-04-25T02:27:07.363 INFO:tasks.workunit.client.0.smithi114.stdout:0/297: getdents d1 0 2024-04-25T02:27:07.364 INFO:tasks.workunit.client.0.smithi114.stdout:0/298: readlink d1/d4/da/l38 0 2024-04-25T02:27:07.366 INFO:tasks.workunit.client.0.smithi114.stdout:0/299: creat d1/d4/d4f/f57 x:0 0 0 2024-04-25T02:27:07.370 INFO:tasks.workunit.client.0.smithi114.stdout:3/266: dread d0/d5/f28 [0,4194304] 0 2024-04-25T02:27:07.373 INFO:tasks.workunit.client.0.smithi114.stdout:0/300: dwrite d1/d30/d4d/f4e [0,4194304] 0 2024-04-25T02:27:07.373 INFO:tasks.workunit.client.0.smithi114.stdout:3/267: fdatasync d0/d25/d29/f39 0 2024-04-25T02:27:07.375 INFO:tasks.workunit.client.0.smithi114.stdout:3/268: truncate d0/d41/f51 536009 0 2024-04-25T02:27:07.375 INFO:tasks.workunit.client.0.smithi114.stdout:0/301: write d1/d7/f14 [398479,64608] 0 2024-04-25T02:27:07.376 INFO:tasks.workunit.client.0.smithi114.stdout:3/269: stat d0/d25/d2a/f3a 0 2024-04-25T02:27:07.376 INFO:tasks.workunit.client.0.smithi114.stdout:0/302: chown d1/d30/f48 2916060 1 2024-04-25T02:27:07.378 INFO:tasks.workunit.client.0.smithi114.stdout:7/356: dread d5/d19/d1a/f5d [0,4194304] 0 2024-04-25T02:27:07.379 INFO:tasks.workunit.client.0.smithi114.stdout:3/270: creat d0/d25/d2a/d34/f5d x:0 0 0 2024-04-25T02:27:07.381 INFO:tasks.workunit.client.0.smithi114.stdout:4/262: dread d3/d8/d12/d19/d26/f34 [0,4194304] 0 2024-04-25T02:27:07.392 INFO:tasks.workunit.client.0.smithi114.stdout:3/271: rename d0/f3e to d0/d25/d2a/d36/f5e 0 2024-04-25T02:27:07.392 INFO:tasks.workunit.client.0.smithi114.stdout:5/337: dread d1/d25/f35 [0,4194304] 0 2024-04-25T02:27:07.403 INFO:tasks.workunit.client.0.smithi114.stdout:9/316: dread d8/d16/d21/f30 [0,4194304] 0 2024-04-25T02:27:07.404 INFO:tasks.workunit.client.0.smithi114.stdout:8/339: dread da/d1e/f2e [0,4194304] 0 2024-04-25T02:27:07.405 INFO:tasks.workunit.client.0.smithi114.stdout:2/350: write d5/f1d [613956,102661] 0 2024-04-25T02:27:07.409 INFO:tasks.workunit.client.0.smithi114.stdout:6/388: write de/d2a/f73 [769008,111200] 0 2024-04-25T02:27:07.415 INFO:tasks.workunit.client.0.smithi114.stdout:0/303: write d1/d4/f49 [716302,19002] 0 2024-04-25T02:27:07.416 INFO:tasks.workunit.client.0.smithi114.stdout:0/304: read d1/d4/d24/f2d [1036176,62333] 0 2024-04-25T02:27:07.416 INFO:tasks.workunit.client.0.smithi114.stdout:1/265: sync 2024-04-25T02:27:07.417 INFO:tasks.workunit.client.0.smithi114.stdout:1/266: write df/d11/f20 [779512,128972] 0 2024-04-25T02:27:07.437 INFO:tasks.workunit.client.0.smithi114.stdout:7/357: link d5/c13 d5/d43/d63/c7d 0 2024-04-25T02:27:07.438 INFO:tasks.workunit.client.0.smithi114.stdout:4/263: symlink d3/d8/d23/d35/l48 0 2024-04-25T02:27:07.439 INFO:tasks.workunit.client.0.smithi114.stdout:5/338: mkdir d1/d6/de/d75 0 2024-04-25T02:27:07.439 INFO:tasks.workunit.client.0.smithi114.stdout:4/264: chown d3/d8/d23/d25/d31/f36 453372 1 2024-04-25T02:27:07.440 INFO:tasks.workunit.client.0.smithi114.stdout:4/265: write d3/f5 [1053515,82515] 0 2024-04-25T02:27:07.440 INFO:tasks.workunit.client.0.smithi114.stdout:8/340: creat da/d32/d3b/f68 x:0 0 0 2024-04-25T02:27:07.441 INFO:tasks.workunit.client.0.smithi114.stdout:2/351: creat d5/df/d63/f7b x:0 0 0 2024-04-25T02:27:07.442 INFO:tasks.workunit.client.0.smithi114.stdout:6/389: mkdir de/d27/d34/d44/d91 0 2024-04-25T02:27:07.446 INFO:tasks.workunit.client.0.smithi114.stdout:3/272: sync 2024-04-25T02:27:07.446 INFO:tasks.workunit.client.0.smithi114.stdout:2/352: dwrite d5/d6/d31/f37 [0,4194304] 0 2024-04-25T02:27:07.447 INFO:tasks.workunit.client.0.smithi114.stdout:7/358: creat d5/d43/d4e/f7e x:0 0 0 2024-04-25T02:27:07.449 INFO:tasks.workunit.client.0.smithi114.stdout:5/339: unlink d1/d25/l5a 0 2024-04-25T02:27:07.450 INFO:tasks.workunit.client.0.smithi114.stdout:3/273: dread d0/d5/fc [0,4194304] 0 2024-04-25T02:27:07.452 INFO:tasks.workunit.client.0.smithi114.stdout:4/266: mkdir d3/d8/d12/d19/d26/d49 0 2024-04-25T02:27:07.454 INFO:tasks.workunit.client.0.smithi114.stdout:6/390: rmdir de/d25/d39/d5c 39 2024-04-25T02:27:07.459 INFO:tasks.workunit.client.0.smithi114.stdout:7/359: rmdir d5/d19/d23/d6f 39 2024-04-25T02:27:07.461 INFO:tasks.workunit.client.0.smithi114.stdout:8/341: mkdir da/d69 0 2024-04-25T02:27:07.466 INFO:tasks.workunit.client.0.smithi114.stdout:9/317: getdents d8/d16/d21 0 2024-04-25T02:27:07.467 INFO:tasks.workunit.client.0.smithi114.stdout:9/318: write d8/f49 [114265,18035] 0 2024-04-25T02:27:07.467 INFO:tasks.workunit.client.0.smithi114.stdout:5/340: creat d1/d6/d4f/d6c/f76 x:0 0 0 2024-04-25T02:27:07.467 INFO:tasks.workunit.client.0.smithi114.stdout:7/360: rmdir d5/d43/d63 39 2024-04-25T02:27:07.468 INFO:tasks.workunit.client.0.smithi114.stdout:8/342: readlink da/d1d/l24 0 2024-04-25T02:27:07.468 INFO:tasks.workunit.client.0.smithi114.stdout:7/361: write d5/d19/d1a/f6e [870393,5043] 0 2024-04-25T02:27:07.471 INFO:tasks.workunit.client.0.smithi114.stdout:1/267: getdents df/d11 0 2024-04-25T02:27:07.471 INFO:tasks.workunit.client.0.smithi114.stdout:5/341: creat d1/d3e/f77 x:0 0 0 2024-04-25T02:27:07.473 INFO:tasks.workunit.client.0.smithi114.stdout:3/274: link d0/d25/d2a/f3a d0/d25/f5f 0 2024-04-25T02:27:07.475 INFO:tasks.workunit.client.0.smithi114.stdout:4/267: creat d3/f4a x:0 0 0 2024-04-25T02:27:07.477 INFO:tasks.workunit.client.0.smithi114.stdout:1/268: dwrite df/f29 [0,4194304] 0 2024-04-25T02:27:07.480 INFO:tasks.workunit.client.0.smithi114.stdout:4/268: symlink d3/d8/d23/d25/d31/d33/l4b 0 2024-04-25T02:27:07.481 INFO:tasks.workunit.client.0.smithi114.stdout:9/319: link d8/d16/d21/d37/c57 d8/d16/d2f/d66/c73 0 2024-04-25T02:27:07.481 INFO:tasks.workunit.client.0.smithi114.stdout:9/320: stat d8/d16/d2f/l32 0 2024-04-25T02:27:07.481 INFO:tasks.workunit.client.0.smithi114.stdout:4/269: read d3/d8/d12/d19/d26/f2a [1366001,77078] 0 2024-04-25T02:27:07.482 INFO:tasks.workunit.client.0.smithi114.stdout:5/342: link d1/d25/d24/f3f d1/d53/f78 0 2024-04-25T02:27:07.485 INFO:tasks.workunit.client.0.smithi114.stdout:6/391: getdents de/d25/d39/d5c 0 2024-04-25T02:27:07.486 INFO:tasks.workunit.client.0.smithi114.stdout:4/270: mkdir d3/d8/d30/d4c 0 2024-04-25T02:27:07.489 INFO:tasks.workunit.client.0.smithi114.stdout:7/362: getdents d5/d19/d23 0 2024-04-25T02:27:07.491 INFO:tasks.workunit.client.0.smithi114.stdout:4/271: creat d3/d8/d12/d19/f4d x:0 0 0 2024-04-25T02:27:07.493 INFO:tasks.workunit.client.0.smithi114.stdout:7/363: write d5/d32/f2f [3174624,14160] 0 2024-04-25T02:27:07.493 INFO:tasks.workunit.client.0.smithi114.stdout:0/305: dwrite d1/d7/d18/f51 [0,4194304] 0 2024-04-25T02:27:07.497 INFO:tasks.workunit.client.0.smithi114.stdout:1/269: dwrite df/d11/d25/f27 [0,4194304] 0 2024-04-25T02:27:07.499 INFO:tasks.workunit.client.0.smithi114.stdout:1/270: read fe [3522158,50257] 0 2024-04-25T02:27:07.499 INFO:tasks.workunit.client.0.smithi114.stdout:0/306: write d1/d4/d24/f25 [1532776,116108] 0 2024-04-25T02:27:07.500 INFO:tasks.workunit.client.0.smithi114.stdout:7/364: mkdir d5/d32/d7f 0 2024-04-25T02:27:07.500 INFO:tasks.workunit.client.0.smithi114.stdout:5/343: dwrite d1/d25/f35 [0,4194304] 0 2024-04-25T02:27:07.502 INFO:tasks.workunit.client.0.smithi114.stdout:5/344: stat d1/d25/l23 0 2024-04-25T02:27:07.502 INFO:tasks.workunit.client.0.smithi114.stdout:2/353: dwrite d5/df/d3d/f69 [4194304,4194304] 0 2024-04-25T02:27:07.502 INFO:tasks.workunit.client.0.smithi114.stdout:0/307: write d1/fc [1428680,42927] 0 2024-04-25T02:27:07.503 INFO:tasks.workunit.client.0.smithi114.stdout:7/365: write d5/d19/d23/f58 [658376,33254] 0 2024-04-25T02:27:07.505 INFO:tasks.workunit.client.0.smithi114.stdout:1/271: mknod df/d2a/d34/c59 0 2024-04-25T02:27:07.508 INFO:tasks.workunit.client.0.smithi114.stdout:0/308: mknod d1/d4/da/d3e/c58 0 2024-04-25T02:27:07.510 INFO:tasks.workunit.client.0.smithi114.stdout:1/272: write df/d2a/d34/f55 [264983,67799] 0 2024-04-25T02:27:07.514 INFO:tasks.workunit.client.0.smithi114.stdout:0/309: chown d1/d7/d18/l1e 0 1 2024-04-25T02:27:07.523 INFO:tasks.workunit.client.0.smithi114.stdout:8/343: sync 2024-04-25T02:27:07.527 INFO:tasks.workunit.client.0.smithi114.stdout:5/345: dwrite d1/d3e/f77 [0,4194304] 0 2024-04-25T02:27:07.527 INFO:tasks.workunit.client.0.smithi114.stdout:1/273: fdatasync df/d11/d25/f4c 0 2024-04-25T02:27:07.529 INFO:tasks.workunit.client.0.smithi114.stdout:2/354: dwrite d5/d6/d58/d5a/f4e [0,4194304] 0 2024-04-25T02:27:07.529 INFO:tasks.workunit.client.0.smithi114.stdout:7/366: dwrite d5/d32/f2f [4194304,4194304] 0 2024-04-25T02:27:07.529 INFO:tasks.workunit.client.0.smithi114.stdout:1/274: stat df/d13 0 2024-04-25T02:27:07.530 INFO:tasks.workunit.client.0.smithi114.stdout:0/310: rmdir d1/d4/da/d33 39 2024-04-25T02:27:07.531 INFO:tasks.workunit.client.0.smithi114.stdout:7/367: chown d5/d19/d1a/f6e 74270926 1 2024-04-25T02:27:07.533 INFO:tasks.workunit.client.0.smithi114.stdout:1/275: mkdir df/d13/d44/d5a 0 2024-04-25T02:27:07.535 INFO:tasks.workunit.client.0.smithi114.stdout:7/368: truncate d5/d19/d23/f4d 1121555 0 2024-04-25T02:27:07.535 INFO:tasks.workunit.client.0.smithi114.stdout:1/276: symlink df/l5b 0 2024-04-25T02:27:07.539 INFO:tasks.workunit.client.0.smithi114.stdout:8/344: dwrite da/d32/f39 [0,4194304] 0 2024-04-25T02:27:07.541 INFO:tasks.workunit.client.0.smithi114.stdout:2/355: dwrite d5/df/f53 [4194304,4194304] 0 2024-04-25T02:27:07.543 INFO:tasks.workunit.client.0.smithi114.stdout:8/345: creat da/d1e/f6a x:0 0 0 2024-04-25T02:27:07.544 INFO:tasks.workunit.client.0.smithi114.stdout:0/311: dwrite d1/d7/d18/f1d [4194304,4194304] 0 2024-04-25T02:27:07.546 INFO:tasks.workunit.client.0.smithi114.stdout:1/277: truncate df/d11/d25/f26 4754987 0 2024-04-25T02:27:07.547 INFO:tasks.workunit.client.0.smithi114.stdout:2/356: mknod d5/c7c 0 2024-04-25T02:27:07.553 INFO:tasks.workunit.client.0.smithi114.stdout:8/346: chown da/d32/d3b/d40/l57 0 1 2024-04-25T02:27:07.553 INFO:tasks.workunit.client.0.smithi114.stdout:0/312: readlink d1/d4/da/d33/l3f 0 2024-04-25T02:27:07.553 INFO:tasks.workunit.client.0.smithi114.stdout:2/357: symlink d5/df/d1e/l7d 0 2024-04-25T02:27:07.553 INFO:tasks.workunit.client.0.smithi114.stdout:1/278: dwrite fc [0,4194304] 0 2024-04-25T02:27:07.556 INFO:tasks.workunit.client.0.smithi114.stdout:8/347: mkdir da/d32/d3b/d6b 0 2024-04-25T02:27:07.557 INFO:tasks.workunit.client.0.smithi114.stdout:2/358: symlink d5/d1c/l7e 0 2024-04-25T02:27:07.559 INFO:tasks.workunit.client.0.smithi114.stdout:1/279: creat df/d2a/d34/f5c x:0 0 0 2024-04-25T02:27:07.559 INFO:tasks.workunit.client.0.smithi114.stdout:1/280: readlink l3 0 2024-04-25T02:27:07.559 INFO:tasks.workunit.client.0.smithi114.stdout:1/281: chown fa 18872 1 2024-04-25T02:27:07.561 INFO:tasks.workunit.client.0.smithi114.stdout:8/348: mkdir da/d38/d35/d52/d6c 0 2024-04-25T02:27:07.565 INFO:tasks.workunit.client.0.smithi114.stdout:1/282: creat df/d11/d25/f5d x:0 0 0 2024-04-25T02:27:07.566 INFO:tasks.workunit.client.0.smithi114.stdout:1/283: truncate df/d2a/d34/f5c 325287 0 2024-04-25T02:27:07.567 INFO:tasks.workunit.client.0.smithi114.stdout:1/284: write df/d2a/d34/f55 [3934640,97976] 0 2024-04-25T02:27:07.571 INFO:tasks.workunit.client.0.smithi114.stdout:3/275: sync 2024-04-25T02:27:07.571 INFO:tasks.workunit.client.0.smithi114.stdout:6/392: sync 2024-04-25T02:27:07.572 INFO:tasks.workunit.client.0.smithi114.stdout:9/321: sync 2024-04-25T02:27:07.572 INFO:tasks.workunit.client.0.smithi114.stdout:3/276: dread - d0/d25/d2a/d34/f55 zero size 2024-04-25T02:27:07.573 INFO:tasks.workunit.client.0.smithi114.stdout:9/322: creat d8/f74 x:0 0 0 2024-04-25T02:27:07.574 INFO:tasks.workunit.client.0.smithi114.stdout:6/393: creat de/f92 x:0 0 0 2024-04-25T02:27:07.575 INFO:tasks.workunit.client.0.smithi114.stdout:6/394: stat de/d27/c2c 0 2024-04-25T02:27:07.576 INFO:tasks.workunit.client.0.smithi114.stdout:9/323: mkdir d8/d16/d21/d37/d43/d75 0 2024-04-25T02:27:07.577 INFO:tasks.workunit.client.0.smithi114.stdout:6/395: fdatasync de/d27/f4e 0 2024-04-25T02:27:07.577 INFO:tasks.workunit.client.0.smithi114.stdout:6/396: chown de/d27/f8f 0 1 2024-04-25T02:27:07.578 INFO:tasks.workunit.client.0.smithi114.stdout:6/397: fdatasync de/d27/d34/d4b/f53 0 2024-04-25T02:27:07.581 INFO:tasks.workunit.client.0.smithi114.stdout:9/324: dwrite d8/d16/d2f/f5f [0,4194304] 0 2024-04-25T02:27:07.585 INFO:tasks.workunit.client.0.smithi114.stdout:6/398: read de/d27/d34/d44/f71 [256975,45764] 0 2024-04-25T02:27:07.588 INFO:tasks.workunit.client.0.smithi114.stdout:4/272: sync 2024-04-25T02:27:07.588 INFO:tasks.workunit.client.0.smithi114.stdout:5/346: sync 2024-04-25T02:27:07.589 INFO:tasks.workunit.client.0.smithi114.stdout:6/399: getdents de/d25 0 2024-04-25T02:27:07.595 INFO:tasks.workunit.client.0.smithi114.stdout:6/400: dwrite de/f1e [4194304,4194304] 0 2024-04-25T02:27:07.596 INFO:tasks.workunit.client.0.smithi114.stdout:7/369: dread d5/f18 [0,4194304] 0 2024-04-25T02:27:07.597 INFO:tasks.workunit.client.0.smithi114.stdout:7/370: chown d5/d19/f45 558 1 2024-04-25T02:27:07.597 INFO:tasks.workunit.client.0.smithi114.stdout:7/371: write d5/d19/d23/f55 [750713,126932] 0 2024-04-25T02:27:07.598 INFO:tasks.workunit.client.0.smithi114.stdout:6/401: mkdir de/d25/d39/d47/d90/d93 0 2024-04-25T02:27:07.600 INFO:tasks.workunit.client.0.smithi114.stdout:7/372: mkdir d5/d19/d1a/d80 0 2024-04-25T02:27:07.603 INFO:tasks.workunit.client.0.smithi114.stdout:7/373: symlink d5/d60/l81 0 2024-04-25T02:27:07.604 INFO:tasks.workunit.client.0.smithi114.stdout:7/374: chown d5/d32/d64/f67 663 1 2024-04-25T02:27:07.604 INFO:tasks.workunit.client.0.smithi114.stdout:0/313: dread d1/d30/f32 [0,4194304] 0 2024-04-25T02:27:07.604 INFO:tasks.workunit.client.0.smithi114.stdout:6/402: symlink de/d27/l94 0 2024-04-25T02:27:07.605 INFO:tasks.workunit.client.0.smithi114.stdout:0/314: write d1/d4/da/f12 [20607,96777] 0 2024-04-25T02:27:07.606 INFO:tasks.workunit.client.0.smithi114.stdout:7/375: dread d5/d32/d4a/d51/f5b [0,4194304] 0 2024-04-25T02:27:07.606 INFO:tasks.workunit.client.0.smithi114.stdout:6/403: mknod de/d25/d39/d47/c95 0 2024-04-25T02:27:07.609 INFO:tasks.workunit.client.0.smithi114.stdout:8/349: rename da/d38/d35 to da/d38/d62/d6d 0 2024-04-25T02:27:07.610 INFO:tasks.workunit.client.0.smithi114.stdout:6/404: readlink de/d27/l36 0 2024-04-25T02:27:07.610 INFO:tasks.workunit.client.0.smithi114.stdout:0/315: dread d1/d30/d4d/f4e [0,4194304] 0 2024-04-25T02:27:07.610 INFO:tasks.workunit.client.0.smithi114.stdout:2/359: truncate d5/df/d3d/f5e 1587502 0 2024-04-25T02:27:07.613 INFO:tasks.workunit.client.0.smithi114.stdout:3/277: rename d0/d25/d2a/d36/d4d to d0/d25/d29/d60 0 2024-04-25T02:27:07.615 INFO:tasks.workunit.client.0.smithi114.stdout:7/376: symlink d5/d19/d1a/d80/l82 0 2024-04-25T02:27:07.616 INFO:tasks.workunit.client.0.smithi114.stdout:8/350: mknod da/d69/c6e 0 2024-04-25T02:27:07.617 INFO:tasks.workunit.client.0.smithi114.stdout:7/377: stat d5/d19/d23/d6f 0 2024-04-25T02:27:07.617 INFO:tasks.workunit.client.0.smithi114.stdout:4/273: rename d3/d8/d12/d19/d26/d49 to d3/d8/d23/d25/d4e 0 2024-04-25T02:27:07.620 INFO:tasks.workunit.client.0.smithi114.stdout:2/360: creat d5/d6/d31/d6a/f7f x:0 0 0 2024-04-25T02:27:07.621 INFO:tasks.workunit.client.0.smithi114.stdout:9/325: truncate d8/d16/d21/f41 3995331 0 2024-04-25T02:27:07.621 INFO:tasks.workunit.client.0.smithi114.stdout:4/274: readlink d3/d8/d23/d35/l48 0 2024-04-25T02:27:07.622 INFO:tasks.workunit.client.0.smithi114.stdout:0/316: dwrite d1/d7/d18/f3b [0,4194304] 0 2024-04-25T02:27:07.623 INFO:tasks.workunit.client.0.smithi114.stdout:7/378: read d5/d19/d1a/f38 [1235183,129518] 0 2024-04-25T02:27:07.625 INFO:tasks.workunit.client.0.smithi114.stdout:1/285: dwrite df/d11/f24 [4194304,4194304] 0 2024-04-25T02:27:07.626 INFO:tasks.workunit.client.0.smithi114.stdout:4/275: chown d3/f5 2930 1 2024-04-25T02:27:07.626 INFO:tasks.workunit.client.0.smithi114.stdout:8/351: symlink da/d32/d3b/d40/l6f 0 2024-04-25T02:27:07.628 INFO:tasks.workunit.client.0.smithi114.stdout:9/326: read d8/f49 [105068,121223] 0 2024-04-25T02:27:07.628 INFO:tasks.workunit.client.0.smithi114.stdout:5/347: dread d1/d6/d1a/f64 [0,4194304] 0 2024-04-25T02:27:07.631 INFO:tasks.workunit.client.0.smithi114.stdout:8/352: truncate da/d1e/f59 738580 0 2024-04-25T02:27:07.633 INFO:tasks.workunit.client.0.smithi114.stdout:9/327: truncate d8/ff 9180523 0 2024-04-25T02:27:07.633 INFO:tasks.workunit.client.0.smithi114.stdout:0/317: dread d1/d4/d24/f45 [0,4194304] 0 2024-04-25T02:27:07.635 INFO:tasks.workunit.client.0.smithi114.stdout:6/405: rename de/d25/d39/d5c/f8c to de/d27/f96 0 2024-04-25T02:27:07.637 INFO:tasks.workunit.client.0.smithi114.stdout:2/361: dwrite d5/d1c/d21/f7a [0,4194304] 0 2024-04-25T02:27:07.637 INFO:tasks.workunit.client.0.smithi114.stdout:8/353: truncate da/d38/f34 5077469 0 2024-04-25T02:27:07.638 INFO:tasks.workunit.client.0.smithi114.stdout:7/379: dread d5/d19/d1a/f38 [0,4194304] 0 2024-04-25T02:27:07.638 INFO:tasks.workunit.client.0.smithi114.stdout:6/406: stat de/d25/f7f 0 2024-04-25T02:27:07.638 INFO:tasks.workunit.client.0.smithi114.stdout:0/318: write d1/d4/d4f/f57 [979605,27858] 0 2024-04-25T02:27:07.641 INFO:tasks.workunit.client.0.smithi114.stdout:1/286: creat df/d11/d25/d33/d47/f5e x:0 0 0 2024-04-25T02:27:07.641 INFO:tasks.workunit.client.0.smithi114.stdout:7/380: dread - d5/d60/f6a zero size 2024-04-25T02:27:07.642 INFO:tasks.workunit.client.0.smithi114.stdout:4/276: dwrite d3/d8/d12/d19/f1a [0,4194304] 0 2024-04-25T02:27:07.642 INFO:tasks.workunit.client.0.smithi114.stdout:0/319: chown d1/d7/f1c 20416 1 2024-04-25T02:27:07.644 INFO:tasks.workunit.client.0.smithi114.stdout:2/362: mknod d5/df/d3d/d44/c80 0 2024-04-25T02:27:07.644 INFO:tasks.workunit.client.0.smithi114.stdout:5/348: dread d1/d25/f35 [0,4194304] 0 2024-04-25T02:27:07.644 INFO:tasks.workunit.client.0.smithi114.stdout:1/287: fsync df/d2a/d34/f55 0 2024-04-25T02:27:07.645 INFO:tasks.workunit.client.0.smithi114.stdout:7/381: fsync d5/d19/d23/f61 0 2024-04-25T02:27:07.646 INFO:tasks.workunit.client.0.smithi114.stdout:6/407: truncate de/d27/d34/d38/f70 1189451 0 2024-04-25T02:27:07.646 INFO:tasks.workunit.client.0.smithi114.stdout:9/328: getdents d8 0 2024-04-25T02:27:07.647 INFO:tasks.workunit.client.0.smithi114.stdout:1/288: fsync fc 0 2024-04-25T02:27:07.648 INFO:tasks.workunit.client.0.smithi114.stdout:4/277: readlink d3/d8/d30/l3a 0 2024-04-25T02:27:07.649 INFO:tasks.workunit.client.0.smithi114.stdout:0/320: symlink d1/d30/l59 0 2024-04-25T02:27:07.650 INFO:tasks.workunit.client.0.smithi114.stdout:6/408: chown de/d2a/c67 52376054 1 2024-04-25T02:27:07.650 INFO:tasks.workunit.client.0.smithi114.stdout:3/278: dwrite d0/d5/f44 [0,4194304] 0 2024-04-25T02:27:07.651 INFO:tasks.workunit.client.0.smithi114.stdout:9/329: dread d8/fa [0,4194304] 0 2024-04-25T02:27:07.654 INFO:tasks.workunit.client.0.smithi114.stdout:4/278: mkdir d3/d8/d23/d25/d4f 0 2024-04-25T02:27:07.656 INFO:tasks.workunit.client.0.smithi114.stdout:2/363: dwrite d5/df/d63/f7b [0,4194304] 0 2024-04-25T02:27:07.656 INFO:tasks.workunit.client.0.smithi114.stdout:3/279: mknod d0/d25/d29/c61 0 2024-04-25T02:27:07.657 INFO:tasks.workunit.client.0.smithi114.stdout:6/409: mknod de/d27/d34/d38/c97 0 2024-04-25T02:27:07.657 INFO:tasks.workunit.client.0.smithi114.stdout:3/280: readlink d0/le 0 2024-04-25T02:27:07.657 INFO:tasks.workunit.client.0.smithi114.stdout:6/410: fsync de/f18 0 2024-04-25T02:27:07.658 INFO:tasks.workunit.client.0.smithi114.stdout:5/349: rmdir d1/d6/d1a/d69 0 2024-04-25T02:27:07.659 INFO:tasks.workunit.client.0.smithi114.stdout:2/364: write d5/d6/d31/d6a/f7f [223320,31998] 0 2024-04-25T02:27:07.659 INFO:tasks.workunit.client.0.smithi114.stdout:0/321: mknod d1/d7/d18/d2e/d50/c5a 0 2024-04-25T02:27:07.660 INFO:tasks.workunit.client.0.smithi114.stdout:2/365: dread - d5/df/d2c/f70 zero size 2024-04-25T02:27:07.661 INFO:tasks.workunit.client.0.smithi114.stdout:0/322: write d1/d7/d18/f51 [3929287,39030] 0 2024-04-25T02:27:07.661 INFO:tasks.workunit.client.0.smithi114.stdout:9/330: symlink d8/d16/d21/d24/d3c/l76 0 2024-04-25T02:27:07.664 INFO:tasks.workunit.client.0.smithi114.stdout:6/411: chown de/d30/c32 106721845 1 2024-04-25T02:27:07.665 INFO:tasks.workunit.client.0.smithi114.stdout:3/281: dwrite d0/d25/d2a/d34/f4a [0,4194304] 0 2024-04-25T02:27:07.666 INFO:tasks.workunit.client.0.smithi114.stdout:5/350: write d1/d6/d4f/f52 [1006511,63157] 0 2024-04-25T02:27:07.666 INFO:tasks.workunit.client.0.smithi114.stdout:3/282: chown d0/d5/c52 30254 1 2024-04-25T02:27:07.667 INFO:tasks.workunit.client.0.smithi114.stdout:3/283: write d0/d5/f44 [1636173,82443] 0 2024-04-25T02:27:07.667 INFO:tasks.workunit.client.0.smithi114.stdout:5/351: write d1/d6/f17 [3326742,127563] 0 2024-04-25T02:27:07.667 INFO:tasks.workunit.client.0.smithi114.stdout:1/289: link df/d13/c2d df/d13/c5f 0 2024-04-25T02:27:07.669 INFO:tasks.workunit.client.0.smithi114.stdout:0/323: creat d1/d30/d4d/f5b x:0 0 0 2024-04-25T02:27:07.673 INFO:tasks.workunit.client.0.smithi114.stdout:5/352: dwrite d1/d25/f63 [0,4194304] 0 2024-04-25T02:27:07.675 INFO:tasks.workunit.client.0.smithi114.stdout:9/331: creat d8/d16/d2f/d39/d38/f77 x:0 0 0 2024-04-25T02:27:07.675 INFO:tasks.workunit.client.0.smithi114.stdout:5/353: dread - d1/d3e/f5b zero size 2024-04-25T02:27:07.676 INFO:tasks.workunit.client.0.smithi114.stdout:1/290: creat df/d13/f60 x:0 0 0 2024-04-25T02:27:07.677 INFO:tasks.workunit.client.0.smithi114.stdout:0/324: dwrite d1/d7/f56 [0,4194304] 0 2024-04-25T02:27:07.678 INFO:tasks.workunit.client.0.smithi114.stdout:9/332: symlink d8/d16/d21/d24/d69/l78 0 2024-04-25T02:27:07.679 INFO:tasks.workunit.client.0.smithi114.stdout:1/291: creat df/d2a/d34/f61 x:0 0 0 2024-04-25T02:27:07.680 INFO:tasks.workunit.client.0.smithi114.stdout:1/292: chown df/f15 25 1 2024-04-25T02:27:07.682 INFO:tasks.workunit.client.0.smithi114.stdout:5/354: rename d1/d53/d55/f58 to d1/d6/de/f79 0 2024-04-25T02:27:07.687 INFO:tasks.workunit.client.0.smithi114.stdout:1/293: unlink df/f29 0 2024-04-25T02:27:07.688 INFO:tasks.workunit.client.0.smithi114.stdout:0/325: dwrite d1/d30/f32 [0,4194304] 0 2024-04-25T02:27:07.691 INFO:tasks.workunit.client.0.smithi114.stdout:0/326: readlink d1/l20 0 2024-04-25T02:27:07.697 INFO:tasks.workunit.client.0.smithi114.stdout:9/333: link d8/d16/d2f/d39/d38/d5d/l64 d8/d16/d21/l79 0 2024-04-25T02:27:07.698 INFO:tasks.workunit.client.0.smithi114.stdout:9/334: chown d8/d16/d2f/d66 9224118 1 2024-04-25T02:27:07.698 INFO:tasks.workunit.client.0.smithi114.stdout:5/355: getdents d1/d6/d4f 0 2024-04-25T02:27:07.699 INFO:tasks.workunit.client.0.smithi114.stdout:1/294: rename df/d2a/c2c to df/d11/d25/c62 0 2024-04-25T02:27:07.699 INFO:tasks.workunit.client.0.smithi114.stdout:1/295: chown df/l4e 10 1 2024-04-25T02:27:07.701 INFO:tasks.workunit.client.0.smithi114.stdout:0/327: rename d1/l20 to d1/d7/d46/l5c 0 2024-04-25T02:27:07.701 INFO:tasks.workunit.client.0.smithi114.stdout:5/356: dread d1/d6/d1a/f64 [0,4194304] 0 2024-04-25T02:27:07.704 INFO:tasks.workunit.client.0.smithi114.stdout:9/335: rename d8/l1c to d8/d16/d2f/d66/l7a 0 2024-04-25T02:27:07.705 INFO:tasks.workunit.client.0.smithi114.stdout:5/357: creat d1/d6/d4f/f7a x:0 0 0 2024-04-25T02:27:07.706 INFO:tasks.workunit.client.0.smithi114.stdout:1/296: dwrite df/d11/d25/f5d [0,4194304] 0 2024-04-25T02:27:07.707 INFO:tasks.workunit.client.0.smithi114.stdout:5/358: write d1/d6/f3c [3499562,63703] 0 2024-04-25T02:27:07.708 INFO:tasks.workunit.client.0.smithi114.stdout:0/328: rename d1/d4/d24/l26 to d1/d7/d18/l5d 0 2024-04-25T02:27:07.708 INFO:tasks.workunit.client.0.smithi114.stdout:5/359: read d1/d3e/f77 [3900103,50292] 0 2024-04-25T02:27:07.712 INFO:tasks.workunit.client.0.smithi114.stdout:8/354: sync 2024-04-25T02:27:07.714 INFO:tasks.workunit.client.0.smithi114.stdout:0/329: dwrite d1/d7/f28 [0,4194304] 0 2024-04-25T02:27:07.718 INFO:tasks.workunit.client.0.smithi114.stdout:8/355: mkdir da/d32/d3b/d70 0 2024-04-25T02:27:07.719 INFO:tasks.workunit.client.0.smithi114.stdout:5/360: creat d1/d6/f7b x:0 0 0 2024-04-25T02:27:07.720 INFO:tasks.workunit.client.0.smithi114.stdout:0/330: dwrite d1/d4/d24/f47 [0,4194304] 0 2024-04-25T02:27:07.722 INFO:tasks.workunit.client.0.smithi114.stdout:8/356: chown da/d32/d3b/d40/c67 476 1 2024-04-25T02:27:07.725 INFO:tasks.workunit.client.0.smithi114.stdout:0/331: unlink d1/d7/d18/f2f 0 2024-04-25T02:27:07.726 INFO:tasks.workunit.client.0.smithi114.stdout:0/332: stat d1/f2c 0 2024-04-25T02:27:07.726 INFO:tasks.workunit.client.0.smithi114.stdout:8/357: readlink da/l5c 0 2024-04-25T02:27:07.729 INFO:tasks.workunit.client.0.smithi114.stdout:5/361: dread d1/d6/de/f1e [0,4194304] 0 2024-04-25T02:27:07.729 INFO:tasks.workunit.client.0.smithi114.stdout:7/382: dwrite d5/d32/d4a/d51/f5b [0,4194304] 0 2024-04-25T02:27:07.729 INFO:tasks.workunit.client.0.smithi114.stdout:2/366: dread d5/df/d3d/f4b [0,4194304] 0 2024-04-25T02:27:07.732 INFO:tasks.workunit.client.0.smithi114.stdout:7/383: read - d5/d60/f6a zero size 2024-04-25T02:27:07.732 INFO:tasks.workunit.client.0.smithi114.stdout:5/362: chown d1/d25/l23 7 1 2024-04-25T02:27:07.733 INFO:tasks.workunit.client.0.smithi114.stdout:4/279: truncate d3/d14/f37 127319 0 2024-04-25T02:27:07.734 INFO:tasks.workunit.client.0.smithi114.stdout:3/284: sync 2024-04-25T02:27:07.734 INFO:tasks.workunit.client.0.smithi114.stdout:2/367: chown d5/d1c/d22/l6e 14 1 2024-04-25T02:27:07.735 INFO:tasks.workunit.client.0.smithi114.stdout:6/412: write de/d25/d39/d47/f5d [4987269,8756] 0 2024-04-25T02:27:07.736 INFO:tasks.workunit.client.0.smithi114.stdout:3/285: fdatasync d0/f49 0 2024-04-25T02:27:07.738 INFO:tasks.workunit.client.0.smithi114.stdout:1/297: getdents df/d13 0 2024-04-25T02:27:07.739 INFO:tasks.workunit.client.0.smithi114.stdout:8/358: dwrite da/d38/f5b [0,4194304] 0 2024-04-25T02:27:07.739 INFO:tasks.workunit.client.0.smithi114.stdout:0/333: dwrite d1/d7/fd [0,4194304] 0 2024-04-25T02:27:07.740 INFO:tasks.workunit.client.0.smithi114.stdout:2/368: mkdir d5/df/d3d/d81 0 2024-04-25T02:27:07.741 INFO:tasks.workunit.client.0.smithi114.stdout:3/286: chown d0/d25/d29/c61 1 1 2024-04-25T02:27:07.742 INFO:tasks.workunit.client.0.smithi114.stdout:4/280: mkdir d3/d8/d23/d25/d31/d33/d50 0 2024-04-25T02:27:07.743 INFO:tasks.workunit.client.0.smithi114.stdout:2/369: readlink d5/d1c/d29/l48 0 2024-04-25T02:27:07.746 INFO:tasks.workunit.client.0.smithi114.stdout:0/334: creat d1/d4/d24/f5e x:0 0 0 2024-04-25T02:27:07.750 INFO:tasks.workunit.client.0.smithi114.stdout:6/413: dread de/d25/d39/f5e [0,4194304] 0 2024-04-25T02:27:07.755 INFO:tasks.workunit.client.0.smithi114.stdout:7/384: rename d5/fa to d5/f83 0 2024-04-25T02:27:07.756 INFO:tasks.workunit.client.0.smithi114.stdout:2/370: rename d5/df/d3d/f40 to d5/df/d2c/f82 0 2024-04-25T02:27:07.757 INFO:tasks.workunit.client.0.smithi114.stdout:9/336: dread - d8/d16/d21/d24/f65 zero size 2024-04-25T02:27:07.759 INFO:tasks.workunit.client.0.smithi114.stdout:0/335: unlink d1/d4/d24/f25 0 2024-04-25T02:27:07.761 INFO:tasks.workunit.client.0.smithi114.stdout:8/359: truncate da/d1d/f1f 423919 0 2024-04-25T02:27:07.761 INFO:tasks.workunit.client.0.smithi114.stdout:0/336: dread - d1/f27 zero size 2024-04-25T02:27:07.762 INFO:tasks.workunit.client.0.smithi114.stdout:1/298: link df/d13/f60 df/d2a/d34/f63 0 2024-04-25T02:27:07.763 INFO:tasks.workunit.client.0.smithi114.stdout:6/414: rmdir de/d27/d34/d38 39 2024-04-25T02:27:07.764 INFO:tasks.workunit.client.0.smithi114.stdout:5/363: getdents d1/d6/d1a 0 2024-04-25T02:27:07.766 INFO:tasks.workunit.client.0.smithi114.stdout:3/287: creat d0/d25/f62 x:0 0 0 2024-04-25T02:27:07.766 INFO:tasks.workunit.client.0.smithi114.stdout:2/371: dwrite d5/df/d3d/f42 [0,4194304] 0 2024-04-25T02:27:07.767 INFO:tasks.workunit.client.0.smithi114.stdout:6/415: write de/d25/f7f [2646435,16791] 0 2024-04-25T02:27:07.768 INFO:tasks.workunit.client.0.smithi114.stdout:9/337: dwrite d8/d16/d2f/f5f [0,4194304] 0 2024-04-25T02:27:07.770 INFO:tasks.workunit.client.0.smithi114.stdout:8/360: symlink da/d38/d62/d6d/l71 0 2024-04-25T02:27:07.770 INFO:tasks.workunit.client.0.smithi114.stdout:1/299: symlink df/d13/d1e/l64 0 2024-04-25T02:27:07.770 INFO:tasks.workunit.client.0.smithi114.stdout:8/361: dread - da/d1e/f4e zero size 2024-04-25T02:27:07.771 INFO:tasks.workunit.client.0.smithi114.stdout:7/385: creat d5/d43/d63/f84 x:0 0 0 2024-04-25T02:27:07.772 INFO:tasks.workunit.client.0.smithi114.stdout:5/364: write d1/d25/f35 [855586,125032] 0 2024-04-25T02:27:07.773 INFO:tasks.workunit.client.0.smithi114.stdout:1/300: truncate df/d11/d32/f3c 986707 0 2024-04-25T02:27:07.773 INFO:tasks.workunit.client.0.smithi114.stdout:0/337: creat d1/d4/d24/d52/f5f x:0 0 0 2024-04-25T02:27:07.774 INFO:tasks.workunit.client.0.smithi114.stdout:5/365: write d1/d3e/f5b [800651,81041] 0 2024-04-25T02:27:07.774 INFO:tasks.workunit.client.0.smithi114.stdout:2/372: mkdir d5/df/d3d/d83 0 2024-04-25T02:27:07.775 INFO:tasks.workunit.client.0.smithi114.stdout:4/281: dread d3/f28 [0,4194304] 0 2024-04-25T02:27:07.776 INFO:tasks.workunit.client.0.smithi114.stdout:6/416: mknod de/d27/d34/d4b/c98 0 2024-04-25T02:27:07.776 INFO:tasks.workunit.client.0.smithi114.stdout:4/282: stat d3/f16 0 2024-04-25T02:27:07.777 INFO:tasks.workunit.client.0.smithi114.stdout:6/417: write de/d2a/f3a [932844,96460] 0 2024-04-25T02:27:07.777 INFO:tasks.workunit.client.0.smithi114.stdout:4/283: write d3/d8/d23/d25/d31/f36 [1076935,64742] 0 2024-04-25T02:27:07.778 INFO:tasks.workunit.client.0.smithi114.stdout:8/362: symlink da/d38/d62/d6d/l72 0 2024-04-25T02:27:07.782 INFO:tasks.workunit.client.0.smithi114.stdout:7/386: unlink d5/d32/d4a/d51/f75 0 2024-04-25T02:27:07.782 INFO:tasks.workunit.client.0.smithi114.stdout:1/301: rename df/d11/d32/l51 to df/l65 0 2024-04-25T02:27:07.783 INFO:tasks.workunit.client.0.smithi114.stdout:4/284: dwrite d3/f4a [0,4194304] 0 2024-04-25T02:27:07.784 INFO:tasks.workunit.client.0.smithi114.stdout:2/373: creat d5/df/d1e/f84 x:0 0 0 2024-04-25T02:27:07.785 INFO:tasks.workunit.client.0.smithi114.stdout:2/374: read - d5/d6/d58/f5f zero size 2024-04-25T02:27:07.785 INFO:tasks.workunit.client.0.smithi114.stdout:5/366: fsync d1/d25/d24/f3b 0 2024-04-25T02:27:07.789 INFO:tasks.workunit.client.0.smithi114.stdout:6/418: rmdir de/d27/d76 39 2024-04-25T02:27:07.795 INFO:tasks.workunit.client.0.smithi114.stdout:0/338: mkdir d1/d4/d60 0 2024-04-25T02:27:07.796 INFO:tasks.workunit.client.0.smithi114.stdout:7/387: write d5/f83 [5681127,80739] 0 2024-04-25T02:27:07.797 INFO:tasks.workunit.client.0.smithi114.stdout:9/338: rename d8/f36 to d8/d16/d21/d37/d43/f7b 0 2024-04-25T02:27:07.798 INFO:tasks.workunit.client.0.smithi114.stdout:1/302: symlink df/l66 0 2024-04-25T02:27:07.799 INFO:tasks.workunit.client.0.smithi114.stdout:4/285: dread - d3/d8/f1c zero size 2024-04-25T02:27:07.802 INFO:tasks.workunit.client.0.smithi114.stdout:0/339: unlink d1/fc 0 2024-04-25T02:27:07.803 INFO:tasks.workunit.client.0.smithi114.stdout:7/388: mknod d5/d32/d4a/d51/c85 0 2024-04-25T02:27:07.803 INFO:tasks.workunit.client.0.smithi114.stdout:9/339: readlink d8/d16/d21/l31 0 2024-04-25T02:27:07.806 INFO:tasks.workunit.client.0.smithi114.stdout:1/303: read df/d11/d25/d33/f58 [1242817,92909] 0 2024-04-25T02:27:07.806 INFO:tasks.workunit.client.0.smithi114.stdout:6/419: mkdir de/d25/d39/d47/d90/d93/d99 0 2024-04-25T02:27:07.808 INFO:tasks.workunit.client.0.smithi114.stdout:1/304: dread df/d2a/d34/f5c [0,4194304] 0 2024-04-25T02:27:07.811 INFO:tasks.workunit.client.0.smithi114.stdout:1/305: dread df/d11/d25/f5d [0,4194304] 0 2024-04-25T02:27:07.813 INFO:tasks.workunit.client.0.smithi114.stdout:9/340: rename d8/d16/d2f/d39/d38/f77 to d8/d16/d2f/f7c 0 2024-04-25T02:27:07.818 INFO:tasks.workunit.client.0.smithi114.stdout:6/420: mkdir de/d27/d34/d4b/d9a 0 2024-04-25T02:27:07.820 INFO:tasks.workunit.client.0.smithi114.stdout:0/340: truncate d1/f10 969211 0 2024-04-25T02:27:07.820 INFO:tasks.workunit.client.0.smithi114.stdout:0/341: chown d1/d7 528147 1 2024-04-25T02:27:07.823 INFO:tasks.workunit.client.0.smithi114.stdout:5/367: getdents d1/d53 0 2024-04-25T02:27:07.829 INFO:tasks.workunit.client.0.smithi114.stdout:1/306: mknod df/d11/d25/d43/c67 0 2024-04-25T02:27:07.829 INFO:tasks.workunit.client.0.smithi114.stdout:9/341: mknod d8/d16/d21/c7d 0 2024-04-25T02:27:07.830 INFO:tasks.workunit.client.0.smithi114.stdout:5/368: creat d1/d53/f7c x:0 0 0 2024-04-25T02:27:07.831 INFO:tasks.workunit.client.0.smithi114.stdout:3/288: truncate d0/d25/d2a/d34/f4a 1924184 0 2024-04-25T02:27:07.832 INFO:tasks.workunit.client.0.smithi114.stdout:6/421: mknod de/c9b 0 2024-04-25T02:27:07.833 INFO:tasks.workunit.client.0.smithi114.stdout:0/342: creat d1/d4/d60/f61 x:0 0 0 2024-04-25T02:27:07.834 INFO:tasks.workunit.client.0.smithi114.stdout:1/307: unlink df/d11/d32/l2f 0 2024-04-25T02:27:07.835 INFO:tasks.workunit.client.0.smithi114.stdout:6/422: write de/d2a/f2b [5469409,57069] 0 2024-04-25T02:27:07.835 INFO:tasks.workunit.client.0.smithi114.stdout:9/342: chown d8/d16/d21/d24/d3c 2251360 1 2024-04-25T02:27:07.839 INFO:tasks.workunit.client.0.smithi114.stdout:8/363: dwrite da/d1d/f36 [0,4194304] 0 2024-04-25T02:27:07.839 INFO:tasks.workunit.client.0.smithi114.stdout:5/369: dwrite d1/d25/f63 [0,4194304] 0 2024-04-25T02:27:07.843 INFO:tasks.workunit.client.0.smithi114.stdout:6/423: readlink de/d27/d34/d38/l78 0 2024-04-25T02:27:07.843 INFO:tasks.workunit.client.0.smithi114.stdout:2/375: truncate d5/d6/d58/d5a/d3e/f49 368850 0 2024-04-25T02:27:07.845 INFO:tasks.workunit.client.0.smithi114.stdout:8/364: dread da/d1d/f36 [0,4194304] 0 2024-04-25T02:27:07.845 INFO:tasks.workunit.client.0.smithi114.stdout:2/376: write d5/d6/d31/f32 [1341575,42931] 0 2024-04-25T02:27:07.845 INFO:tasks.workunit.client.0.smithi114.stdout:0/343: mkdir d1/d4/d62 0 2024-04-25T02:27:07.846 INFO:tasks.workunit.client.0.smithi114.stdout:7/389: write d5/d19/d23/f3f [696566,25929] 0 2024-04-25T02:27:07.847 INFO:tasks.workunit.client.0.smithi114.stdout:8/365: chown da/d32/d3b/d40/l57 7 1 2024-04-25T02:27:07.849 INFO:tasks.workunit.client.0.smithi114.stdout:1/308: creat df/d13/d44/d5a/f68 x:0 0 0 2024-04-25T02:27:07.852 INFO:tasks.workunit.client.0.smithi114.stdout:4/286: truncate d3/d8/d12/d19/f1a 4146637 0 2024-04-25T02:27:07.853 INFO:tasks.workunit.client.0.smithi114.stdout:4/287: stat d3/d8/d12/d19/d26 0 2024-04-25T02:27:07.853 INFO:tasks.workunit.client.0.smithi114.stdout:7/390: dread d5/d32/d4a/d51/f6b [0,4194304] 0 2024-04-25T02:27:07.856 INFO:tasks.workunit.client.0.smithi114.stdout:2/377: creat d5/d6/d31/f85 x:0 0 0 2024-04-25T02:27:07.857 INFO:tasks.workunit.client.0.smithi114.stdout:2/378: stat d5/df 0 2024-04-25T02:27:07.859 INFO:tasks.workunit.client.0.smithi114.stdout:8/366: creat da/d69/f73 x:0 0 0 2024-04-25T02:27:07.860 INFO:tasks.workunit.client.0.smithi114.stdout:6/424: symlink de/d27/l9c 0 2024-04-25T02:27:07.860 INFO:tasks.workunit.client.0.smithi114.stdout:8/367: read - da/d1e/f4e zero size 2024-04-25T02:27:07.862 INFO:tasks.workunit.client.0.smithi114.stdout:6/425: chown de/d1c/l6d 7 1 2024-04-25T02:27:07.863 INFO:tasks.workunit.client.0.smithi114.stdout:2/379: dwrite d5/df/d1e/f84 [0,4194304] 0 2024-04-25T02:27:07.867 INFO:tasks.workunit.client.0.smithi114.stdout:1/309: truncate df/d2a/d34/f55 1019451 0 2024-04-25T02:27:07.871 INFO:tasks.workunit.client.0.smithi114.stdout:5/370: write d1/d25/d24/f3b [2942009,48410] 0 2024-04-25T02:27:07.872 INFO:tasks.workunit.client.0.smithi114.stdout:7/391: creat d5/d32/d64/f86 x:0 0 0 2024-04-25T02:27:07.876 INFO:tasks.workunit.client.0.smithi114.stdout:0/344: link d1/d7/f28 d1/d4/f63 0 2024-04-25T02:27:07.877 INFO:tasks.workunit.client.0.smithi114.stdout:0/345: chown d1/d7/f1c 40661 1 2024-04-25T02:27:07.879 INFO:tasks.workunit.client.0.smithi114.stdout:5/371: dread d1/d6/f31 [0,4194304] 0 2024-04-25T02:27:07.879 INFO:tasks.workunit.client.0.smithi114.stdout:2/380: rmdir d5/d1c/d29 39 2024-04-25T02:27:07.880 INFO:tasks.workunit.client.0.smithi114.stdout:2/381: write d5/d6/d58/f5f [780903,12976] 0 2024-04-25T02:27:07.885 INFO:tasks.workunit.client.0.smithi114.stdout:6/426: rename de/d27/d76/f8b to de/d2a/f9d 0 2024-04-25T02:27:07.886 INFO:tasks.workunit.client.0.smithi114.stdout:0/346: rename d1/l17 to d1/l64 0 2024-04-25T02:27:07.887 INFO:tasks.workunit.client.0.smithi114.stdout:5/372: symlink d1/l7d 0 2024-04-25T02:27:07.888 INFO:tasks.workunit.client.0.smithi114.stdout:2/382: fsync d5/df/d2c/f82 0 2024-04-25T02:27:07.888 INFO:tasks.workunit.client.0.smithi114.stdout:3/289: dwrite d0/d25/d2a/d34/f4a [0,4194304] 0 2024-04-25T02:27:07.889 INFO:tasks.workunit.client.0.smithi114.stdout:5/373: fsync d1/d6/d4f/f52 0 2024-04-25T02:27:07.890 INFO:tasks.workunit.client.0.smithi114.stdout:4/288: getdents d3/d8/d12 0 2024-04-25T02:27:07.890 INFO:tasks.workunit.client.0.smithi114.stdout:2/383: dread - d5/d6/d31/f60 zero size 2024-04-25T02:27:07.890 INFO:tasks.workunit.client.0.smithi114.stdout:5/374: dread - d1/d53/f59 zero size 2024-04-25T02:27:07.893 INFO:tasks.workunit.client.0.smithi114.stdout:6/427: creat de/d30/f9e x:0 0 0 2024-04-25T02:27:07.893 INFO:tasks.workunit.client.0.smithi114.stdout:6/428: chown de/d25/d39/d47/f8d 13029243 1 2024-04-25T02:27:07.894 INFO:tasks.workunit.client.0.smithi114.stdout:0/347: creat d1/d30/d4d/f65 x:0 0 0 2024-04-25T02:27:07.895 INFO:tasks.workunit.client.0.smithi114.stdout:8/368: dwrite da/f31 [0,4194304] 0 2024-04-25T02:27:07.901 INFO:tasks.workunit.client.0.smithi114.stdout:1/310: write df/d11/d25/f5d [3783483,68295] 0 2024-04-25T02:27:07.902 INFO:tasks.workunit.client.0.smithi114.stdout:5/375: creat d1/d6/d1a/f7e x:0 0 0 2024-04-25T02:27:07.903 INFO:tasks.workunit.client.0.smithi114.stdout:8/369: chown da/d38/f2a 321270 1 2024-04-25T02:27:07.903 INFO:tasks.workunit.client.0.smithi114.stdout:6/429: dread de/d27/f3f [0,4194304] 0 2024-04-25T02:27:07.904 INFO:tasks.workunit.client.0.smithi114.stdout:0/348: mknod d1/d7/d18/d2e/c66 0 2024-04-25T02:27:07.904 INFO:tasks.workunit.client.0.smithi114.stdout:6/430: fsync de/d27/d34/d44/f88 0 2024-04-25T02:27:07.905 INFO:tasks.workunit.client.0.smithi114.stdout:0/349: fsync d1/d30/f48 0 2024-04-25T02:27:07.906 INFO:tasks.workunit.client.0.smithi114.stdout:7/392: truncate d5/d19/f1d 216669 0 2024-04-25T02:27:07.908 INFO:tasks.workunit.client.0.smithi114.stdout:7/393: chown d5/d19/d23/f55 206246 1 2024-04-25T02:27:07.908 INFO:tasks.workunit.client.0.smithi114.stdout:5/376: mkdir d1/d6/d1a/d7f 0 2024-04-25T02:27:07.910 INFO:tasks.workunit.client.0.smithi114.stdout:1/311: unlink df/d2a/d34/f61 0 2024-04-25T02:27:07.910 INFO:tasks.workunit.client.0.smithi114.stdout:8/370: dwrite da/d1d/f3f [0,4194304] 0 2024-04-25T02:27:07.910 INFO:tasks.workunit.client.0.smithi114.stdout:7/394: dread - d5/d43/d4e/f7e zero size 2024-04-25T02:27:07.911 INFO:tasks.workunit.client.0.smithi114.stdout:8/371: chown da/d32/d3b/d70 0 1 2024-04-25T02:27:07.912 INFO:tasks.workunit.client.0.smithi114.stdout:0/350: symlink d1/d7/d18/d2e/l67 0 2024-04-25T02:27:07.912 INFO:tasks.workunit.client.0.smithi114.stdout:7/395: chown d5/d19/d23/f3c 646907 1 2024-04-25T02:27:07.912 INFO:tasks.workunit.client.0.smithi114.stdout:6/431: mknod de/d25/d39/d47/c9f 0 2024-04-25T02:27:07.913 INFO:tasks.workunit.client.0.smithi114.stdout:0/351: read d1/d7/f14 [3633303,44048] 0 2024-04-25T02:27:07.915 INFO:tasks.workunit.client.0.smithi114.stdout:6/432: write de/d27/d34/d44/f55 [5085075,959] 0 2024-04-25T02:27:07.915 INFO:tasks.workunit.client.0.smithi114.stdout:5/377: rename d1/d6/d4f/d6c/f76 to d1/d6/d4f/d6c/f80 0 2024-04-25T02:27:07.916 INFO:tasks.workunit.client.0.smithi114.stdout:7/396: mkdir d5/d32/d4a/d87 0 2024-04-25T02:27:07.917 INFO:tasks.workunit.client.0.smithi114.stdout:7/397: stat d5/d32/f31 0 2024-04-25T02:27:07.918 INFO:tasks.workunit.client.0.smithi114.stdout:1/312: dwrite fc [0,4194304] 0 2024-04-25T02:27:07.919 INFO:tasks.workunit.client.0.smithi114.stdout:0/352: mkdir d1/d7/d68 0 2024-04-25T02:27:07.923 INFO:tasks.workunit.client.0.smithi114.stdout:1/313: creat df/d13/d1e/d3e/f69 x:0 0 0 2024-04-25T02:27:07.923 INFO:tasks.workunit.client.0.smithi114.stdout:1/314: truncate fc 5064288 0 2024-04-25T02:27:07.924 INFO:tasks.workunit.client.0.smithi114.stdout:3/290: write d0/d5/d3d/f42 [2018404,6395] 0 2024-04-25T02:27:07.925 INFO:tasks.workunit.client.0.smithi114.stdout:5/378: mkdir d1/d51/d6f/d81 0 2024-04-25T02:27:07.927 INFO:tasks.workunit.client.0.smithi114.stdout:4/289: chown d3/d8/d12/d19/f1a 464301427 1 2024-04-25T02:27:07.930 INFO:tasks.workunit.client.0.smithi114.stdout:9/343: sync 2024-04-25T02:27:07.930 INFO:tasks.workunit.client.0.smithi114.stdout:3/291: creat d0/d25/d29/f63 x:0 0 0 2024-04-25T02:27:07.931 INFO:tasks.workunit.client.0.smithi114.stdout:5/379: mkdir d1/d3e/d60/d82 0 2024-04-25T02:27:07.933 INFO:tasks.workunit.client.0.smithi114.stdout:7/398: rename d5/ce to d5/d43/c88 0 2024-04-25T02:27:07.934 INFO:tasks.workunit.client.0.smithi114.stdout:4/290: symlink d3/d8/d23/d25/d31/l51 0 2024-04-25T02:27:07.936 INFO:tasks.workunit.client.0.smithi114.stdout:5/380: fdatasync d1/d25/d24/f2e 0 2024-04-25T02:27:07.937 INFO:tasks.workunit.client.0.smithi114.stdout:8/372: write da/d1e/f29 [341694,117870] 0 2024-04-25T02:27:07.938 INFO:tasks.workunit.client.0.smithi114.stdout:1/315: rename df/d13/c17 to df/d11/c6a 0 2024-04-25T02:27:07.940 INFO:tasks.workunit.client.0.smithi114.stdout:8/373: dread - da/d1e/d58/f5f zero size 2024-04-25T02:27:07.942 INFO:tasks.workunit.client.0.smithi114.stdout:9/344: dwrite d8/d16/d2f/d39/d38/d46/d53/f5c [4194304,4194304] 0 2024-04-25T02:27:07.943 INFO:tasks.workunit.client.0.smithi114.stdout:4/291: symlink d3/d8/d12/d19/d42/l52 0 2024-04-25T02:27:07.946 INFO:tasks.workunit.client.0.smithi114.stdout:7/399: rename d5/d19/f27 to d5/d32/d64/f89 0 2024-04-25T02:27:07.947 INFO:tasks.workunit.client.0.smithi114.stdout:3/292: link d0/d5/c52 d0/d25/d29/d60/c64 0 2024-04-25T02:27:07.947 INFO:tasks.workunit.client.0.smithi114.stdout:1/316: dread df/f15 [0,4194304] 0 2024-04-25T02:27:07.949 INFO:tasks.workunit.client.0.smithi114.stdout:8/374: write da/d1e/f2e [5196100,74251] 0 2024-04-25T02:27:07.951 INFO:tasks.workunit.client.0.smithi114.stdout:8/375: fdatasync da/d69/f73 0 2024-04-25T02:27:07.951 INFO:tasks.workunit.client.0.smithi114.stdout:5/381: dwrite d1/d25/f4e [0,4194304] 0 2024-04-25T02:27:07.951 INFO:tasks.workunit.client.0.smithi114.stdout:6/433: dread de/ff [4194304,4194304] 0 2024-04-25T02:27:07.952 INFO:tasks.workunit.client.0.smithi114.stdout:9/345: chown d8/d16/d21/f22 0 1 2024-04-25T02:27:07.953 INFO:tasks.workunit.client.0.smithi114.stdout:0/353: dread d1/d4/da/f2a [0,4194304] 0 2024-04-25T02:27:07.954 INFO:tasks.workunit.client.0.smithi114.stdout:7/400: unlink d5/d19/d1a/f62 0 2024-04-25T02:27:07.954 INFO:tasks.workunit.client.0.smithi114.stdout:4/292: write d3/d8/d12/d19/d26/f2a [5202961,61695] 0 2024-04-25T02:27:07.954 INFO:tasks.workunit.client.0.smithi114.stdout:9/346: write d8/f74 [203090,124430] 0 2024-04-25T02:27:07.955 INFO:tasks.workunit.client.0.smithi114.stdout:7/401: fdatasync d5/d54/f73 0 2024-04-25T02:27:07.955 INFO:tasks.workunit.client.0.smithi114.stdout:9/347: dread - d8/d16/d2f/d39/f3d zero size 2024-04-25T02:27:07.958 INFO:tasks.workunit.client.0.smithi114.stdout:3/293: rename d0/d25/d2a/f3a to d0/d25/d29/d60/f65 0 2024-04-25T02:27:07.959 INFO:tasks.workunit.client.0.smithi114.stdout:3/294: write d0/d5/f44 [2526884,89919] 0 2024-04-25T02:27:07.959 INFO:tasks.workunit.client.0.smithi114.stdout:5/382: mkdir d1/d53/d83 0 2024-04-25T02:27:07.960 INFO:tasks.workunit.client.0.smithi114.stdout:8/376: creat da/d38/f74 x:0 0 0 2024-04-25T02:27:07.964 INFO:tasks.workunit.client.0.smithi114.stdout:2/384: sync 2024-04-25T02:27:07.964 INFO:tasks.workunit.client.0.smithi114.stdout:9/348: truncate d8/d16/d2f/d39/f35 41024 0 2024-04-25T02:27:07.965 INFO:tasks.workunit.client.0.smithi114.stdout:2/385: dread - d5/d6/d31/f85 zero size 2024-04-25T02:27:07.966 INFO:tasks.workunit.client.0.smithi114.stdout:6/434: rename de/d27/l9c to de/d27/d76/la0 0 2024-04-25T02:27:07.968 INFO:tasks.workunit.client.0.smithi114.stdout:0/354: dwrite d1/d4/d24/f45 [0,4194304] 0 2024-04-25T02:27:07.968 INFO:tasks.workunit.client.0.smithi114.stdout:6/435: chown de/d25/d39/d5c/f6f 3230 1 2024-04-25T02:27:07.969 INFO:tasks.workunit.client.0.smithi114.stdout:3/295: creat d0/d5/d3d/f66 x:0 0 0 2024-04-25T02:27:07.970 INFO:tasks.workunit.client.0.smithi114.stdout:3/296: write d0/d5/d3d/f42 [8453,64539] 0 2024-04-25T02:27:07.974 INFO:tasks.workunit.client.0.smithi114.stdout:7/402: creat d5/d32/d4a/d87/f8a x:0 0 0 2024-04-25T02:27:07.975 INFO:tasks.workunit.client.0.smithi114.stdout:7/403: chown d5/d32/d4a/d51/f6b 88 1 2024-04-25T02:27:07.975 INFO:tasks.workunit.client.0.smithi114.stdout:7/404: chown d5/d32/d64/f67 24 1 2024-04-25T02:27:07.977 INFO:tasks.workunit.client.0.smithi114.stdout:2/386: symlink d5/df/d63/l86 0 2024-04-25T02:27:07.978 INFO:tasks.workunit.client.0.smithi114.stdout:1/317: stat df/d13/d1e/l64 0 2024-04-25T02:27:07.979 INFO:tasks.workunit.client.0.smithi114.stdout:5/383: creat d1/d6/de/d75/f84 x:0 0 0 2024-04-25T02:27:07.980 INFO:tasks.workunit.client.0.smithi114.stdout:6/436: unlink de/d27/d34/d38/l58 0 2024-04-25T02:27:07.982 INFO:tasks.workunit.client.0.smithi114.stdout:0/355: read d1/d4/f15 [1058418,121439] 0 2024-04-25T02:27:07.983 INFO:tasks.workunit.client.0.smithi114.stdout:3/297: mknod d0/d25/d29/d60/c67 0 2024-04-25T02:27:07.983 INFO:tasks.workunit.client.0.smithi114.stdout:2/387: dwrite d5/f1d [0,4194304] 0 2024-04-25T02:27:07.984 INFO:tasks.workunit.client.0.smithi114.stdout:4/293: link d3/d8/d12/d19/f1a d3/d14/f53 0 2024-04-25T02:27:07.984 INFO:tasks.workunit.client.0.smithi114.stdout:3/298: stat d0/d5/l6 0 2024-04-25T02:27:07.985 INFO:tasks.workunit.client.0.smithi114.stdout:0/356: write d1/d7/d18/f1d [8412126,110439] 0 2024-04-25T02:27:07.985 INFO:tasks.workunit.client.0.smithi114.stdout:4/294: chown d3/d8/d23 2054101 1 2024-04-25T02:27:07.985 INFO:tasks.workunit.client.0.smithi114.stdout:3/299: fdatasync d0/fb 0 2024-04-25T02:27:07.987 INFO:tasks.workunit.client.0.smithi114.stdout:9/349: mknod d8/d16/d2f/d39/d38/c7e 0 2024-04-25T02:27:07.987 INFO:tasks.workunit.client.0.smithi114.stdout:3/300: write d0/d25/d2a/f4e [1831570,65960] 0 2024-04-25T02:27:07.990 INFO:tasks.workunit.client.0.smithi114.stdout:9/350: chown d8/d16/d2f/d39/d38/d46/d53 64 1 2024-04-25T02:27:07.991 INFO:tasks.workunit.client.0.smithi114.stdout:5/384: creat d1/d6/d4f/d6c/f85 x:0 0 0 2024-04-25T02:27:07.991 INFO:tasks.workunit.client.0.smithi114.stdout:3/301: write d0/d25/d2a/d34/f55 [982353,107071] 0 2024-04-25T02:27:07.994 INFO:tasks.workunit.client.0.smithi114.stdout:3/302: chown d0/d25/f32 1 1 2024-04-25T02:27:07.994 INFO:tasks.workunit.client.0.smithi114.stdout:7/405: dwrite d5/f9 [0,4194304] 0 2024-04-25T02:27:07.995 INFO:tasks.workunit.client.0.smithi114.stdout:7/406: readlink l2 0 2024-04-25T02:27:07.995 INFO:tasks.workunit.client.0.smithi114.stdout:4/295: dwrite d3/d8/d12/f18 [0,4194304] 0 2024-04-25T02:27:07.997 INFO:tasks.workunit.client.0.smithi114.stdout:2/388: unlink d5/d1c/d21/f7a 0 2024-04-25T02:27:08.001 INFO:tasks.workunit.client.0.smithi114.stdout:7/407: dread d5/f33 [0,4194304] 0 2024-04-25T02:27:08.006 INFO:tasks.workunit.client.0.smithi114.stdout:8/377: dwrite da/f2f [0,4194304] 0 2024-04-25T02:27:08.007 INFO:tasks.workunit.client.0.smithi114.stdout:8/378: truncate da/d1e/f59 1419834 0 2024-04-25T02:27:08.007 INFO:tasks.workunit.client.0.smithi114.stdout:3/303: symlink d0/d25/d29/d60/l68 0 2024-04-25T02:27:08.010 INFO:tasks.workunit.client.0.smithi114.stdout:4/296: rename d3/d8/d23/d25/d31/f36 to d3/d8/d23/d35/f54 0 2024-04-25T02:27:08.011 INFO:tasks.workunit.client.0.smithi114.stdout:3/304: read d0/f19 [2212448,63020] 0 2024-04-25T02:27:08.012 INFO:tasks.workunit.client.0.smithi114.stdout:2/389: creat d5/d6/d31/f87 x:0 0 0 2024-04-25T02:27:08.012 INFO:tasks.workunit.client.0.smithi114.stdout:8/379: read da/d32/f37 [3416298,128813] 0 2024-04-25T02:27:08.013 INFO:tasks.workunit.client.0.smithi114.stdout:2/390: readlink d5/d1c/l3a 0 2024-04-25T02:27:08.014 INFO:tasks.workunit.client.0.smithi114.stdout:6/437: rmdir de/d27/d34/d4b/d9a 0 2024-04-25T02:27:08.018 INFO:tasks.workunit.client.0.smithi114.stdout:2/391: dread d5/df/f17 [0,4194304] 0 2024-04-25T02:27:08.020 INFO:tasks.workunit.client.0.smithi114.stdout:8/380: creat da/d38/f75 x:0 0 0 2024-04-25T02:27:08.022 INFO:tasks.workunit.client.0.smithi114.stdout:7/408: mkdir d5/d8b 0 2024-04-25T02:27:08.031 INFO:tasks.workunit.client.0.smithi114.stdout:2/392: dread d5/df/d1e/f84 [0,4194304] 0 2024-04-25T02:27:08.031 INFO:tasks.workunit.client.0.smithi114.stdout:9/351: link d8/d16/d2f/d66/c73 d8/d16/d2f/d66/c7f 0 2024-04-25T02:27:08.032 INFO:tasks.workunit.client.0.smithi114.stdout:2/393: chown d5 15711 1 2024-04-25T02:27:08.032 INFO:tasks.workunit.client.0.smithi114.stdout:3/305: dwrite d0/d25/d2a/d36/f5e [0,4194304] 0 2024-04-25T02:27:08.032 INFO:tasks.workunit.client.0.smithi114.stdout:1/318: getdents df/d11/d25/d43 0 2024-04-25T02:27:08.035 INFO:tasks.workunit.client.0.smithi114.stdout:2/394: chown d5/d6/d31/d6a/f7f 42479447 1 2024-04-25T02:27:08.036 INFO:tasks.workunit.client.0.smithi114.stdout:8/381: dwrite da/d32/d3b/f64 [0,4194304] 0 2024-04-25T02:27:08.037 INFO:tasks.workunit.client.0.smithi114.stdout:9/352: write d8/d16/d21/d24/d3c/d40/f58 [772241,29556] 0 2024-04-25T02:27:08.040 INFO:tasks.workunit.client.0.smithi114.stdout:3/306: symlink d0/d25/d2a/d34/l69 0 2024-04-25T02:27:08.040 INFO:tasks.workunit.client.0.smithi114.stdout:2/395: creat d5/d6/d31/d6a/f88 x:0 0 0 2024-04-25T02:27:08.040 INFO:tasks.workunit.client.0.smithi114.stdout:7/409: link d5/l2d d5/d43/l8c 0 2024-04-25T02:27:08.041 INFO:tasks.workunit.client.0.smithi114.stdout:2/396: truncate d5/df/f45 553482 0 2024-04-25T02:27:08.042 INFO:tasks.workunit.client.0.smithi114.stdout:8/382: creat da/d38/d62/d6d/d52/f76 x:0 0 0 2024-04-25T02:27:08.042 INFO:tasks.workunit.client.0.smithi114.stdout:2/397: write d5/d6/d31/f32 [900062,104268] 0 2024-04-25T02:27:08.043 INFO:tasks.workunit.client.0.smithi114.stdout:3/307: mknod d0/d25/d2a/c6a 0 2024-04-25T02:27:08.043 INFO:tasks.workunit.client.0.smithi114.stdout:9/353: dread d8/fb [0,4194304] 0 2024-04-25T02:27:08.044 INFO:tasks.workunit.client.0.smithi114.stdout:2/398: chown d5/d6/d58/d5a/d3e 14762909 1 2024-04-25T02:27:08.044 INFO:tasks.workunit.client.0.smithi114.stdout:3/308: write d0/f16 [1347250,57158] 0 2024-04-25T02:27:08.044 INFO:tasks.workunit.client.0.smithi114.stdout:3/309: readlink d0/l47 0 2024-04-25T02:27:08.045 INFO:tasks.workunit.client.0.smithi114.stdout:7/410: creat d5/d32/d64/f8d x:0 0 0 2024-04-25T02:27:08.046 INFO:tasks.workunit.client.0.smithi114.stdout:8/383: rmdir da/d38/d62/d6d 39 2024-04-25T02:27:08.048 INFO:tasks.workunit.client.0.smithi114.stdout:7/411: dread d5/d19/f2a [0,4194304] 0 2024-04-25T02:27:08.048 INFO:tasks.workunit.client.0.smithi114.stdout:3/310: mknod d0/d25/c6b 0 2024-04-25T02:27:08.049 INFO:tasks.workunit.client.0.smithi114.stdout:9/354: creat d8/d16/d2f/d39/d38/f80 x:0 0 0 2024-04-25T02:27:08.057 INFO:tasks.workunit.client.0.smithi114.stdout:3/311: creat d0/d5/f6c x:0 0 0 2024-04-25T02:27:08.059 INFO:tasks.workunit.client.0.smithi114.stdout:3/312: symlink d0/d5/l6d 0 2024-04-25T02:27:08.060 INFO:tasks.workunit.client.0.smithi114.stdout:9/355: mknod d8/d16/d2f/d39/c81 0 2024-04-25T02:27:08.063 INFO:tasks.workunit.client.0.smithi114.stdout:3/313: rename d0/d25/d2a/d34/f5d to d0/d25/d29/f6e 0 2024-04-25T02:27:08.063 INFO:tasks.workunit.client.0.smithi114.stdout:3/314: fsync d0/f16 0 2024-04-25T02:27:08.064 INFO:tasks.workunit.client.0.smithi114.stdout:9/356: mknod d8/d16/d21/d37/d43/c82 0 2024-04-25T02:27:08.064 INFO:tasks.workunit.client.0.smithi114.stdout:3/315: truncate d0/d5/f43 753921 0 2024-04-25T02:27:08.066 INFO:tasks.workunit.client.0.smithi114.stdout:3/316: symlink d0/d25/d2a/l6f 0 2024-04-25T02:27:08.068 INFO:tasks.workunit.client.0.smithi114.stdout:9/357: unlink d8/d16/d2f/d39/d38/d46/d53/f5c 0 2024-04-25T02:27:08.069 INFO:tasks.workunit.client.0.smithi114.stdout:1/319: dread df/d2a/f46 [0,4194304] 0 2024-04-25T02:27:08.069 INFO:tasks.workunit.client.0.smithi114.stdout:0/357: write d1/d4/da/f16 [3390704,56665] 0 2024-04-25T02:27:08.070 INFO:tasks.workunit.client.0.smithi114.stdout:3/317: mknod d0/d25/d29/d60/c70 0 2024-04-25T02:27:08.073 INFO:tasks.workunit.client.0.smithi114.stdout:5/385: truncate d1/d6/d1a/f64 1368460 0 2024-04-25T02:27:08.074 INFO:tasks.workunit.client.0.smithi114.stdout:3/318: symlink d0/d25/d29/d60/l71 0 2024-04-25T02:27:08.074 INFO:tasks.workunit.client.0.smithi114.stdout:5/386: dread - d1/d6/de/f4b zero size 2024-04-25T02:27:08.076 INFO:tasks.workunit.client.0.smithi114.stdout:0/358: mkdir d1/d7/d68/d69 0 2024-04-25T02:27:08.076 INFO:tasks.workunit.client.0.smithi114.stdout:0/359: chown d1/d7 12977679 1 2024-04-25T02:27:08.076 INFO:tasks.workunit.client.0.smithi114.stdout:0/360: chown d1/d7/f1c 33771474 1 2024-04-25T02:27:08.078 INFO:tasks.workunit.client.0.smithi114.stdout:6/438: sync 2024-04-25T02:27:08.079 INFO:tasks.workunit.client.0.smithi114.stdout:1/320: link c6 df/d13/d1e/c6b 0 2024-04-25T02:27:08.080 INFO:tasks.workunit.client.0.smithi114.stdout:0/361: mkdir d1/d4/d37/d6a 0 2024-04-25T02:27:08.081 INFO:tasks.workunit.client.0.smithi114.stdout:0/362: chown d1/d30 7 1 2024-04-25T02:27:08.082 INFO:tasks.workunit.client.0.smithi114.stdout:4/297: write d3/d8/d12/d19/f1a [4246749,28096] 0 2024-04-25T02:27:08.085 INFO:tasks.workunit.client.0.smithi114.stdout:0/363: dread d1/d30/f32 [4194304,4194304] 0 2024-04-25T02:27:08.085 INFO:tasks.workunit.client.0.smithi114.stdout:1/321: mkdir df/d11/d6c 0 2024-04-25T02:27:08.086 INFO:tasks.workunit.client.0.smithi114.stdout:1/322: stat df/d11/d25/d43 0 2024-04-25T02:27:08.090 INFO:tasks.workunit.client.0.smithi114.stdout:4/298: getdents d3/d8/d23/d25/d31/d33/d50 0 2024-04-25T02:27:08.093 INFO:tasks.workunit.client.0.smithi114.stdout:8/384: truncate da/d38/f34 428427 0 2024-04-25T02:27:08.095 INFO:tasks.workunit.client.0.smithi114.stdout:4/299: creat d3/d8/d12/d19/d26/d3e/f55 x:0 0 0 2024-04-25T02:27:08.095 INFO:tasks.workunit.client.0.smithi114.stdout:7/412: truncate d5/d19/d23/f28 6612416 0 2024-04-25T02:27:08.097 INFO:tasks.workunit.client.0.smithi114.stdout:8/385: mknod da/d69/c77 0 2024-04-25T02:27:08.098 INFO:tasks.workunit.client.0.smithi114.stdout:4/300: mknod d3/d14/c56 0 2024-04-25T02:27:08.099 INFO:tasks.workunit.client.0.smithi114.stdout:1/323: getdents df/d13/d44/d5a 0 2024-04-25T02:27:08.100 INFO:tasks.workunit.client.0.smithi114.stdout:7/413: rmdir d5/d54 39 2024-04-25T02:27:08.101 INFO:tasks.workunit.client.0.smithi114.stdout:4/301: dread d3/f4a [0,4194304] 0 2024-04-25T02:27:08.104 INFO:tasks.workunit.client.0.smithi114.stdout:7/414: rmdir d5/d19/d23 39 2024-04-25T02:27:08.105 INFO:tasks.workunit.client.0.smithi114.stdout:9/358: rename d8/d16/d2f to d8/d16/d21/d83 0 2024-04-25T02:27:08.106 INFO:tasks.workunit.client.0.smithi114.stdout:2/399: sync 2024-04-25T02:27:08.108 INFO:tasks.workunit.client.0.smithi114.stdout:3/319: rmdir d0/d25 39 2024-04-25T02:27:08.111 INFO:tasks.workunit.client.0.smithi114.stdout:5/387: rename d1/d51/l5f to d1/d51/d6f/d81/l86 0 2024-04-25T02:27:08.112 INFO:tasks.workunit.client.0.smithi114.stdout:2/400: mkdir d5/d1c/d22/d89 0 2024-04-25T02:27:08.115 INFO:tasks.workunit.client.0.smithi114.stdout:7/415: creat d5/d19/d23/f8e x:0 0 0 2024-04-25T02:27:08.115 INFO:tasks.workunit.client.0.smithi114.stdout:1/324: dread df/d13/d1e/f21 [0,4194304] 0 2024-04-25T02:27:08.116 INFO:tasks.workunit.client.0.smithi114.stdout:0/364: truncate d1/d4/d24/f45 298226 0 2024-04-25T02:27:08.119 INFO:tasks.workunit.client.0.smithi114.stdout:2/401: symlink d5/df/d1e/l8a 0 2024-04-25T02:27:08.119 INFO:tasks.workunit.client.0.smithi114.stdout:1/325: chown df/d2a/d34/f63 139188 1 2024-04-25T02:27:08.120 INFO:tasks.workunit.client.0.smithi114.stdout:4/302: link d3/d8/d12/d19/f4d d3/d8/f57 0 2024-04-25T02:27:08.121 INFO:tasks.workunit.client.0.smithi114.stdout:6/439: dwrite de/d25/d39/f7b [0,4194304] 0 2024-04-25T02:27:08.121 INFO:tasks.workunit.client.0.smithi114.stdout:2/402: chown d5/d1c/c4a 994256 1 2024-04-25T02:27:08.123 INFO:tasks.workunit.client.0.smithi114.stdout:3/320: creat d0/d25/d2a/d34/f72 x:0 0 0 2024-04-25T02:27:08.125 INFO:tasks.workunit.client.0.smithi114.stdout:7/416: dwrite d5/d19/d1a/f5d [0,4194304] 0 2024-04-25T02:27:08.129 INFO:tasks.workunit.client.0.smithi114.stdout:9/359: rename d8/d16/d21/d83/d39/f3d to d8/d16/d21/d83/d39/d38/f84 0 2024-04-25T02:27:08.130 INFO:tasks.workunit.client.0.smithi114.stdout:8/386: dwrite da/d38/f2a [0,4194304] 0 2024-04-25T02:27:08.131 INFO:tasks.workunit.client.0.smithi114.stdout:4/303: mkdir d3/d8/d12/d19/d42/d58 0 2024-04-25T02:27:08.131 INFO:tasks.workunit.client.0.smithi114.stdout:4/304: read - d3/d14/f3b zero size 2024-04-25T02:27:08.132 INFO:tasks.workunit.client.0.smithi114.stdout:5/388: dread d1/d25/d24/f32 [0,4194304] 0 2024-04-25T02:27:08.133 INFO:tasks.workunit.client.0.smithi114.stdout:3/321: fdatasync d0/d41/f51 0 2024-04-25T02:27:08.137 INFO:tasks.workunit.client.0.smithi114.stdout:8/387: dwrite da/d69/f73 [0,4194304] 0 2024-04-25T02:27:08.141 INFO:tasks.workunit.client.0.smithi114.stdout:6/440: rename de/d25/d39/d47/c95 to de/d30/ca1 0 2024-04-25T02:27:08.141 INFO:tasks.workunit.client.0.smithi114.stdout:3/322: dwrite d0/d25/d29/f63 [0,4194304] 0 2024-04-25T02:27:08.143 INFO:tasks.workunit.client.0.smithi114.stdout:9/360: fsync d8/d16/f27 0 2024-04-25T02:27:08.143 INFO:tasks.workunit.client.0.smithi114.stdout:6/441: read de/f19 [3204356,19902] 0 2024-04-25T02:27:08.148 INFO:tasks.workunit.client.0.smithi114.stdout:7/417: mknod d5/d43/d63/d7a/c8f 0 2024-04-25T02:27:08.149 INFO:tasks.workunit.client.0.smithi114.stdout:7/418: fsync d5/d43/d4e/f7e 0 2024-04-25T02:27:08.153 INFO:tasks.workunit.client.0.smithi114.stdout:4/305: rename d3/f5 to d3/d8/d23/d25/d31/f59 0 2024-04-25T02:27:08.153 INFO:tasks.workunit.client.0.smithi114.stdout:1/326: write df/f15 [1840176,40954] 0 2024-04-25T02:27:08.154 INFO:tasks.workunit.client.0.smithi114.stdout:1/327: readlink df/l4e 0 2024-04-25T02:27:08.154 INFO:tasks.workunit.client.0.smithi114.stdout:4/306: dread - d3/d8/f1c zero size 2024-04-25T02:27:08.154 INFO:tasks.workunit.client.0.smithi114.stdout:3/323: unlink d0/d41/f56 0 2024-04-25T02:27:08.154 INFO:tasks.workunit.client.0.smithi114.stdout:1/328: chown df/d2a/d34/c59 3509 1 2024-04-25T02:27:08.155 INFO:tasks.workunit.client.0.smithi114.stdout:9/361: chown d8/d16/d21/l4b 0 1 2024-04-25T02:27:08.156 INFO:tasks.workunit.client.0.smithi114.stdout:5/389: creat d1/d6/d1a/d7f/f87 x:0 0 0 2024-04-25T02:27:08.157 INFO:tasks.workunit.client.0.smithi114.stdout:2/403: link d5/df/d3d/d44/l62 d5/d6/d58/d5a/d3e/d54/l8b 0 2024-04-25T02:27:08.157 INFO:tasks.workunit.client.0.smithi114.stdout:2/404: chown d5/df/d2c/f64 1 1 2024-04-25T02:27:08.162 INFO:tasks.workunit.client.0.smithi114.stdout:6/442: symlink de/d27/d34/d44/d91/la2 0 2024-04-25T02:27:08.164 INFO:tasks.workunit.client.0.smithi114.stdout:4/307: truncate d3/f28 3589075 0 2024-04-25T02:27:08.164 INFO:tasks.workunit.client.0.smithi114.stdout:4/308: read - d3/d14/f3b zero size 2024-04-25T02:27:08.165 INFO:tasks.workunit.client.0.smithi114.stdout:9/362: mknod d8/d16/d21/d37/d60/d70/c85 0 2024-04-25T02:27:08.165 INFO:tasks.workunit.client.0.smithi114.stdout:9/363: chown d8/fb 59 1 2024-04-25T02:27:08.166 INFO:tasks.workunit.client.0.smithi114.stdout:6/443: mknod de/d25/d39/d47/d90/d93/ca3 0 2024-04-25T02:27:08.167 INFO:tasks.workunit.client.0.smithi114.stdout:7/419: fsync d5/d32/d4a/d51/f5b 0 2024-04-25T02:27:08.168 INFO:tasks.workunit.client.0.smithi114.stdout:6/444: read de/d27/f4e [1901242,129979] 0 2024-04-25T02:27:08.168 INFO:tasks.workunit.client.0.smithi114.stdout:3/324: link d0/d25/f48 d0/d25/f73 0 2024-04-25T02:27:08.171 INFO:tasks.workunit.client.0.smithi114.stdout:6/445: write de/d2a/f73 [1323144,30493] 0 2024-04-25T02:27:08.171 INFO:tasks.workunit.client.0.smithi114.stdout:2/405: creat d5/df/f8c x:0 0 0 2024-04-25T02:27:08.172 INFO:tasks.workunit.client.0.smithi114.stdout:4/309: dwrite d3/d14/f3b [0,4194304] 0 2024-04-25T02:27:08.174 INFO:tasks.workunit.client.0.smithi114.stdout:1/329: getdents df/d13/d44 0 2024-04-25T02:27:08.174 INFO:tasks.workunit.client.0.smithi114.stdout:0/365: write d1/d4/d24/f45 [1115973,8015] 0 2024-04-25T02:27:08.176 INFO:tasks.workunit.client.0.smithi114.stdout:3/325: symlink d0/d41/l74 0 2024-04-25T02:27:08.177 INFO:tasks.workunit.client.0.smithi114.stdout:3/326: readlink d0/d25/d2a/l57 0 2024-04-25T02:27:08.177 INFO:tasks.workunit.client.0.smithi114.stdout:3/327: chown d0/f19 20287044 1 2024-04-25T02:27:08.179 INFO:tasks.workunit.client.0.smithi114.stdout:9/364: write d8/d16/d21/f30 [2058508,98899] 0 2024-04-25T02:27:08.182 INFO:tasks.workunit.client.0.smithi114.stdout:2/406: rmdir d5/df/d3d/d44 39 2024-04-25T02:27:08.184 INFO:tasks.workunit.client.0.smithi114.stdout:5/390: dread d1/d25/f1f [0,4194304] 0 2024-04-25T02:27:08.185 INFO:tasks.workunit.client.0.smithi114.stdout:3/328: creat d0/d5/d3d/f75 x:0 0 0 2024-04-25T02:27:08.186 INFO:tasks.workunit.client.0.smithi114.stdout:6/446: symlink de/la4 0 2024-04-25T02:27:08.188 INFO:tasks.workunit.client.0.smithi114.stdout:7/420: dwrite d5/d19/d23/f4d [0,4194304] 0 2024-04-25T02:27:08.188 INFO:tasks.workunit.client.0.smithi114.stdout:7/421: stat d5 0 2024-04-25T02:27:08.189 INFO:tasks.workunit.client.0.smithi114.stdout:7/422: write d5/d32/d4a/d51/f5b [4041953,113056] 0 2024-04-25T02:27:08.190 INFO:tasks.workunit.client.0.smithi114.stdout:2/407: stat d5/d1c/d29/l48 0 2024-04-25T02:27:08.190 INFO:tasks.workunit.client.0.smithi114.stdout:7/423: stat d5/d32/d4a/d51/f6b 0 2024-04-25T02:27:08.190 INFO:tasks.workunit.client.0.smithi114.stdout:2/408: chown d5/fe 6191071 1 2024-04-25T02:27:08.191 INFO:tasks.workunit.client.0.smithi114.stdout:1/330: unlink c6 0 2024-04-25T02:27:08.192 INFO:tasks.workunit.client.0.smithi114.stdout:0/366: symlink d1/d4/da/d33/l6b 0 2024-04-25T02:27:08.193 INFO:tasks.workunit.client.0.smithi114.stdout:8/388: truncate da/ff 3890736 0 2024-04-25T02:27:08.193 INFO:tasks.workunit.client.0.smithi114.stdout:8/389: chown da/d1e/c26 475 1 2024-04-25T02:27:08.194 INFO:tasks.workunit.client.0.smithi114.stdout:5/391: rename d1/d53/d83 to d1/d6/d4f/d6c/d88 0 2024-04-25T02:27:08.196 INFO:tasks.workunit.client.0.smithi114.stdout:3/329: creat d0/d25/d29/f76 x:0 0 0 2024-04-25T02:27:08.198 INFO:tasks.workunit.client.0.smithi114.stdout:9/365: unlink d8/d16/d21/d37/d43/l4d 0 2024-04-25T02:27:08.198 INFO:tasks.workunit.client.0.smithi114.stdout:9/366: chown d8/d16/d21/d37 388625447 1 2024-04-25T02:27:08.199 INFO:tasks.workunit.client.0.smithi114.stdout:2/409: mkdir d5/df/d63/d8d 0 2024-04-25T02:27:08.201 INFO:tasks.workunit.client.0.smithi114.stdout:1/331: rmdir df/d2a 39 2024-04-25T02:27:08.202 INFO:tasks.workunit.client.0.smithi114.stdout:0/367: mkdir d1/d7/d68/d6c 0 2024-04-25T02:27:08.204 INFO:tasks.workunit.client.0.smithi114.stdout:5/392: fsync d1/d25/d24/f2e 0 2024-04-25T02:27:08.205 INFO:tasks.workunit.client.0.smithi114.stdout:5/393: chown d1/d3e/d60/c6d 17481704 1 2024-04-25T02:27:08.206 INFO:tasks.workunit.client.0.smithi114.stdout:3/330: unlink d0/d25/d2a/d34/f4a 0 2024-04-25T02:27:08.208 INFO:tasks.workunit.client.0.smithi114.stdout:7/424: unlink d5/d19/d23/f55 0 2024-04-25T02:27:08.210 INFO:tasks.workunit.client.0.smithi114.stdout:9/367: creat d8/d16/d21/d83/f86 x:0 0 0 2024-04-25T02:27:08.211 INFO:tasks.workunit.client.0.smithi114.stdout:7/425: truncate d5/d19/d23/f8e 275090 0 2024-04-25T02:27:08.212 INFO:tasks.workunit.client.0.smithi114.stdout:0/368: creat d1/d30/d4d/f6d x:0 0 0 2024-04-25T02:27:08.213 INFO:tasks.workunit.client.0.smithi114.stdout:3/331: dwrite d0/d41/f51 [0,4194304] 0 2024-04-25T02:27:08.213 INFO:tasks.workunit.client.0.smithi114.stdout:9/368: dread - d8/d16/d21/d83/d39/d38/f6f zero size 2024-04-25T02:27:08.214 INFO:tasks.workunit.client.0.smithi114.stdout:7/426: write d5/d43/d63/f84 [899538,127757] 0 2024-04-25T02:27:08.215 INFO:tasks.workunit.client.0.smithi114.stdout:3/332: truncate d0/d25/d29/f63 5037924 0 2024-04-25T02:27:08.217 INFO:tasks.workunit.client.0.smithi114.stdout:5/394: creat d1/d6/d1a/d7f/f89 x:0 0 0 2024-04-25T02:27:08.219 INFO:tasks.workunit.client.0.smithi114.stdout:9/369: dwrite d8/d16/d21/d83/f5f [0,4194304] 0 2024-04-25T02:27:08.221 INFO:tasks.workunit.client.0.smithi114.stdout:6/447: sync 2024-04-25T02:27:08.221 INFO:tasks.workunit.client.0.smithi114.stdout:4/310: sync 2024-04-25T02:27:08.222 INFO:tasks.workunit.client.0.smithi114.stdout:6/448: stat de/f1f 0 2024-04-25T02:27:08.223 INFO:tasks.workunit.client.0.smithi114.stdout:2/410: mkdir d5/d79/d8e 0 2024-04-25T02:27:08.223 INFO:tasks.workunit.client.0.smithi114.stdout:1/332: getdents df/d11/d6c 0 2024-04-25T02:27:08.227 INFO:tasks.workunit.client.0.smithi114.stdout:1/333: readlink df/d11/d25/d33/d47/l4f 0 2024-04-25T02:27:08.227 INFO:tasks.workunit.client.0.smithi114.stdout:9/370: dwrite d8/d16/d21/d83/d39/d38/f6f [0,4194304] 0 2024-04-25T02:27:08.227 INFO:tasks.workunit.client.0.smithi114.stdout:1/334: write df/d11/d25/d33/d47/f5e [110710,82534] 0 2024-04-25T02:27:08.230 INFO:tasks.workunit.client.0.smithi114.stdout:7/427: mknod d5/d32/d4a/d51/c90 0 2024-04-25T02:27:08.235 INFO:tasks.workunit.client.0.smithi114.stdout:4/311: dread d3/d8/d23/d25/d31/d33/f29 [0,4194304] 0 2024-04-25T02:27:08.237 INFO:tasks.workunit.client.0.smithi114.stdout:9/371: mkdir d8/d16/d21/d83/d39/d38/d46/d87 0 2024-04-25T02:27:08.238 INFO:tasks.workunit.client.0.smithi114.stdout:0/369: rename d1/d7/d46/l5c to d1/d7/d18/d2e/d50/l6e 0 2024-04-25T02:27:08.240 INFO:tasks.workunit.client.0.smithi114.stdout:4/312: write d3/d8/d23/d25/d31/f59 [2543131,10748] 0 2024-04-25T02:27:08.243 INFO:tasks.workunit.client.0.smithi114.stdout:2/411: link d5/df/d1e/f26 d5/df/d3d/d44/f8f 0 2024-04-25T02:27:08.244 INFO:tasks.workunit.client.0.smithi114.stdout:2/412: write d5/df/d3d/f42 [3536832,2434] 0 2024-04-25T02:27:08.246 INFO:tasks.workunit.client.0.smithi114.stdout:7/428: rename d5/d54 to d5/d32/d4a/d91 0 2024-04-25T02:27:08.247 INFO:tasks.workunit.client.0.smithi114.stdout:5/395: sync 2024-04-25T02:27:08.247 INFO:tasks.workunit.client.0.smithi114.stdout:0/370: unlink d1/d4/da/d33/f4a 0 2024-04-25T02:27:08.252 INFO:tasks.workunit.client.0.smithi114.stdout:2/413: unlink d5/df/f43 0 2024-04-25T02:27:08.253 INFO:tasks.workunit.client.0.smithi114.stdout:2/414: dread - d5/d6/d31/f87 zero size 2024-04-25T02:27:08.254 INFO:tasks.workunit.client.0.smithi114.stdout:6/449: dread de/f18 [0,4194304] 0 2024-04-25T02:27:08.256 INFO:tasks.workunit.client.0.smithi114.stdout:9/372: getdents d8/d16 0 2024-04-25T02:27:08.256 INFO:tasks.workunit.client.0.smithi114.stdout:6/450: read - de/d25/f50 zero size 2024-04-25T02:27:08.258 INFO:tasks.workunit.client.0.smithi114.stdout:9/373: stat d8/f71 0 2024-04-25T02:27:08.260 INFO:tasks.workunit.client.0.smithi114.stdout:8/390: truncate da/d38/d62/d6d/f42 240568 0 2024-04-25T02:27:08.264 INFO:tasks.workunit.client.0.smithi114.stdout:5/396: dwrite d1/d6/f3c [0,4194304] 0 2024-04-25T02:27:08.265 INFO:tasks.workunit.client.0.smithi114.stdout:3/333: truncate d0/d5/f43 406981 0 2024-04-25T02:27:08.267 INFO:tasks.workunit.client.0.smithi114.stdout:4/313: dread d3/d8/f2c [4194304,4194304] 0 2024-04-25T02:27:08.267 INFO:tasks.workunit.client.0.smithi114.stdout:9/374: creat d8/d16/d21/d83/d39/d38/d46/f88 x:0 0 0 2024-04-25T02:27:08.267 INFO:tasks.workunit.client.0.smithi114.stdout:2/415: dwrite d5/d6/d31/f32 [0,4194304] 0 2024-04-25T02:27:08.269 INFO:tasks.workunit.client.0.smithi114.stdout:5/397: chown d1/d25/c70 4 1 2024-04-25T02:27:08.269 INFO:tasks.workunit.client.0.smithi114.stdout:6/451: dread de/d27/f2d [0,4194304] 0 2024-04-25T02:27:08.269 INFO:tasks.workunit.client.0.smithi114.stdout:8/391: rename da/d38/d62/d6d/l4d to da/d1e/l78 0 2024-04-25T02:27:08.270 INFO:tasks.workunit.client.0.smithi114.stdout:7/429: dread d5/f18 [0,4194304] 0 2024-04-25T02:27:08.271 INFO:tasks.workunit.client.0.smithi114.stdout:3/334: symlink d0/d25/d2a/l77 0 2024-04-25T02:27:08.271 INFO:tasks.workunit.client.0.smithi114.stdout:2/416: dread - d5/d1c/d22/d67/f6c zero size 2024-04-25T02:27:08.273 INFO:tasks.workunit.client.0.smithi114.stdout:5/398: mkdir d1/d51/d6f/d81/d8a 0 2024-04-25T02:27:08.274 INFO:tasks.workunit.client.0.smithi114.stdout:0/371: write d1/d7/d18/f22 [1017166,118078] 0 2024-04-25T02:27:08.275 INFO:tasks.workunit.client.0.smithi114.stdout:1/335: dread df/d13/d1e/f21 [0,4194304] 0 2024-04-25T02:27:08.276 INFO:tasks.workunit.client.0.smithi114.stdout:6/452: mkdir de/d27/d34/d38/da5 0 2024-04-25T02:27:08.276 INFO:tasks.workunit.client.0.smithi114.stdout:0/372: dread - d1/d30/d4d/f5b zero size 2024-04-25T02:27:08.277 INFO:tasks.workunit.client.0.smithi114.stdout:3/335: mkdir d0/d25/d29/d78 0 2024-04-25T02:27:08.277 INFO:tasks.workunit.client.0.smithi114.stdout:6/453: chown de/d2a/f2b 20 1 2024-04-25T02:27:08.277 INFO:tasks.workunit.client.0.smithi114.stdout:4/314: dread d3/d8/d12/f18 [0,4194304] 0 2024-04-25T02:27:08.279 INFO:tasks.workunit.client.0.smithi114.stdout:4/315: dread d3/d8/d23/d25/d31/f59 [4194304,4194304] 0 2024-04-25T02:27:08.280 INFO:tasks.workunit.client.0.smithi114.stdout:5/399: symlink d1/d53/d55/l8b 0 2024-04-25T02:27:08.283 INFO:tasks.workunit.client.0.smithi114.stdout:0/373: symlink d1/d7/d18/l6f 0 2024-04-25T02:27:08.285 INFO:tasks.workunit.client.0.smithi114.stdout:9/375: link d8/d16/d21/d83/d39/d38/f84 d8/d16/d21/d37/d60/f89 0 2024-04-25T02:27:08.286 INFO:tasks.workunit.client.0.smithi114.stdout:4/316: creat d3/d14/f5a x:0 0 0 2024-04-25T02:27:08.286 INFO:tasks.workunit.client.0.smithi114.stdout:9/376: chown d8 30739 1 2024-04-25T02:27:08.287 INFO:tasks.workunit.client.0.smithi114.stdout:3/336: dwrite d0/d25/d2a/d34/f72 [0,4194304] 0 2024-04-25T02:27:08.287 INFO:tasks.workunit.client.0.smithi114.stdout:2/417: rename d5/d1c/d22/c74 to d5/d79/d8e/c90 0 2024-04-25T02:27:08.287 INFO:tasks.workunit.client.0.smithi114.stdout:6/454: dwrite de/d27/d34/f48 [0,4194304] 0 2024-04-25T02:27:08.288 INFO:tasks.workunit.client.0.smithi114.stdout:3/337: stat d0/d25/f73 0 2024-04-25T02:27:08.289 INFO:tasks.workunit.client.0.smithi114.stdout:6/455: chown de/d27/d34/f8a 472985988 1 2024-04-25T02:27:08.290 INFO:tasks.workunit.client.0.smithi114.stdout:8/392: link da/d38/d62/d6d/l71 da/d1e/l79 0 2024-04-25T02:27:08.292 INFO:tasks.workunit.client.0.smithi114.stdout:8/393: fdatasync da/d1e/f2e 0 2024-04-25T02:27:08.292 INFO:tasks.workunit.client.0.smithi114.stdout:7/430: getdents d5/d19 0 2024-04-25T02:27:08.293 INFO:tasks.workunit.client.0.smithi114.stdout:5/400: dread d1/d6/de/f1e [0,4194304] 0 2024-04-25T02:27:08.296 INFO:tasks.workunit.client.0.smithi114.stdout:2/418: dwrite d5/d6/d31/f87 [0,4194304] 0 2024-04-25T02:27:08.297 INFO:tasks.workunit.client.0.smithi114.stdout:4/317: creat d3/d8/d30/f5b x:0 0 0 2024-04-25T02:27:08.304 INFO:tasks.workunit.client.0.smithi114.stdout:7/431: creat d5/d43/d63/f92 x:0 0 0 2024-04-25T02:27:08.306 INFO:tasks.workunit.client.0.smithi114.stdout:5/401: rmdir d1/d25/d24 39 2024-04-25T02:27:08.307 INFO:tasks.workunit.client.0.smithi114.stdout:4/318: dread d3/d8/d12/d19/d26/f34 [0,4194304] 0 2024-04-25T02:27:08.310 INFO:tasks.workunit.client.0.smithi114.stdout:1/336: creat df/d13/d1e/f6d x:0 0 0 2024-04-25T02:27:08.311 INFO:tasks.workunit.client.0.smithi114.stdout:2/419: mkdir d5/d1c/d21/d91 0 2024-04-25T02:27:08.312 INFO:tasks.workunit.client.0.smithi114.stdout:9/377: mkdir d8/d16/d21/d37/d43/d75/d8a 0 2024-04-25T02:27:08.314 INFO:tasks.workunit.client.0.smithi114.stdout:7/432: symlink d5/d43/d4e/l93 0 2024-04-25T02:27:08.315 INFO:tasks.workunit.client.0.smithi114.stdout:4/319: mknod d3/d8/d23/d35/c5c 0 2024-04-25T02:27:08.317 INFO:tasks.workunit.client.0.smithi114.stdout:9/378: symlink d8/d16/d21/d24/d3c/d40/l8b 0 2024-04-25T02:27:08.318 INFO:tasks.workunit.client.0.smithi114.stdout:7/433: write d5/d19/d23/f58 [502162,62435] 0 2024-04-25T02:27:08.320 INFO:tasks.workunit.client.0.smithi114.stdout:1/337: mkdir df/d13/d6e 0 2024-04-25T02:27:08.321 INFO:tasks.workunit.client.0.smithi114.stdout:4/320: symlink d3/d8/d23/d25/d31/l5d 0 2024-04-25T02:27:08.322 INFO:tasks.workunit.client.0.smithi114.stdout:3/338: getdents d0/d25/d29 0 2024-04-25T02:27:08.323 INFO:tasks.workunit.client.0.smithi114.stdout:5/402: link d1/d25/c70 d1/d51/c8c 0 2024-04-25T02:27:08.324 INFO:tasks.workunit.client.0.smithi114.stdout:3/339: stat d0/f16 0 2024-04-25T02:27:08.326 INFO:tasks.workunit.client.0.smithi114.stdout:4/321: unlink d3/d8/d23/d35/f40 0 2024-04-25T02:27:08.331 INFO:tasks.workunit.client.0.smithi114.stdout:9/379: dwrite d8/d16/d21/d24/d3c/f45 [4194304,4194304] 0 2024-04-25T02:27:08.331 INFO:tasks.workunit.client.0.smithi114.stdout:7/434: dread d5/f9 [0,4194304] 0 2024-04-25T02:27:08.331 INFO:tasks.workunit.client.0.smithi114.stdout:7/435: stat d5/d19/f2c 0 2024-04-25T02:27:08.332 INFO:tasks.workunit.client.0.smithi114.stdout:5/403: rename d1/d6/d4f/d6c/f85 to d1/d6/de/f8d 0 2024-04-25T02:27:08.333 INFO:tasks.workunit.client.0.smithi114.stdout:9/380: write d8/d16/d21/d83/f5f [108639,49502] 0 2024-04-25T02:27:08.334 INFO:tasks.workunit.client.0.smithi114.stdout:0/374: dwrite d1/d4/f15 [0,4194304] 0 2024-04-25T02:27:08.336 INFO:tasks.workunit.client.0.smithi114.stdout:9/381: dread - d8/d16/d21/d24/f47 zero size 2024-04-25T02:27:08.338 INFO:tasks.workunit.client.0.smithi114.stdout:3/340: dwrite d0/d5/f53 [0,4194304] 0 2024-04-25T02:27:08.338 INFO:tasks.workunit.client.0.smithi114.stdout:7/436: unlink d5/f6 0 2024-04-25T02:27:08.339 INFO:tasks.workunit.client.0.smithi114.stdout:3/341: chown d0/c26 4 1 2024-04-25T02:27:08.339 INFO:tasks.workunit.client.0.smithi114.stdout:7/437: readlink d5/d32/d4a/l53 0 2024-04-25T02:27:08.340 INFO:tasks.workunit.client.0.smithi114.stdout:6/456: dread de/d25/f7f [0,4194304] 0 2024-04-25T02:27:08.340 INFO:tasks.workunit.client.0.smithi114.stdout:3/342: write d0/d25/d2a/d36/f5e [1758878,80252] 0 2024-04-25T02:27:08.344 INFO:tasks.workunit.client.0.smithi114.stdout:5/404: mkdir d1/d3e/d8e 0 2024-04-25T02:27:08.347 INFO:tasks.workunit.client.0.smithi114.stdout:9/382: mknod d8/d16/d21/d83/d39/d38/d46/c8c 0 2024-04-25T02:27:08.349 INFO:tasks.workunit.client.0.smithi114.stdout:9/383: truncate d8/d16/d21/d37/d60/f89 171121 0 2024-04-25T02:27:08.350 INFO:tasks.workunit.client.0.smithi114.stdout:4/322: rmdir d3/d8/d23/d25/d31/d33/d50 0 2024-04-25T02:27:08.353 INFO:tasks.workunit.client.0.smithi114.stdout:7/438: read d5/d19/f1d [89624,86878] 0 2024-04-25T02:27:08.354 INFO:tasks.workunit.client.0.smithi114.stdout:1/338: dwrite df/d13/d1e/f50 [0,4194304] 0 2024-04-25T02:27:08.355 INFO:tasks.workunit.client.0.smithi114.stdout:6/457: unlink de/c81 0 2024-04-25T02:27:08.356 INFO:tasks.workunit.client.0.smithi114.stdout:3/343: rmdir d0/d25/d2a/d36 39 2024-04-25T02:27:08.358 INFO:tasks.workunit.client.0.smithi114.stdout:2/420: dwrite d5/df/d3d/f5e [0,4194304] 0 2024-04-25T02:27:08.358 INFO:tasks.workunit.client.0.smithi114.stdout:0/375: rename d1/d7/d18/d2e/d50/l6e to d1/d30/d4d/l70 0 2024-04-25T02:27:08.359 INFO:tasks.workunit.client.0.smithi114.stdout:2/421: dread - d5/d6/d58/d5a/d59/f78 zero size 2024-04-25T02:27:08.362 INFO:tasks.workunit.client.0.smithi114.stdout:4/323: truncate d3/f4a 3053091 0 2024-04-25T02:27:08.366 INFO:tasks.workunit.client.0.smithi114.stdout:1/339: rmdir df/d11/d25/d43 39 2024-04-25T02:27:08.367 INFO:tasks.workunit.client.0.smithi114.stdout:6/458: fdatasync de/d25/f7f 0 2024-04-25T02:27:08.369 INFO:tasks.workunit.client.0.smithi114.stdout:5/405: truncate d1/d6/d1a/f64 1524697 0 2024-04-25T02:27:08.370 INFO:tasks.workunit.client.0.smithi114.stdout:0/376: creat d1/d4/d37/f71 x:0 0 0 2024-04-25T02:27:08.370 INFO:tasks.workunit.client.0.smithi114.stdout:9/384: truncate d8/d16/d21/f41 4262399 0 2024-04-25T02:27:08.372 INFO:tasks.workunit.client.0.smithi114.stdout:7/439: symlink d5/d43/l94 0 2024-04-25T02:27:08.372 INFO:tasks.workunit.client.0.smithi114.stdout:1/340: readlink df/d13/l1a 0 2024-04-25T02:27:08.372 INFO:tasks.workunit.client.0.smithi114.stdout:8/394: sync 2024-04-25T02:27:08.376 INFO:tasks.workunit.client.0.smithi114.stdout:5/406: dwrite d1/d6/de/f37 [0,4194304] 0 2024-04-25T02:27:08.379 INFO:tasks.workunit.client.0.smithi114.stdout:4/324: mknod d3/d8/d30/d4c/c5e 0 2024-04-25T02:27:08.382 INFO:tasks.workunit.client.0.smithi114.stdout:3/344: rename d0/le to d0/l79 0 2024-04-25T02:27:08.382 INFO:tasks.workunit.client.0.smithi114.stdout:7/440: dread d5/d19/d1a/f5d [0,4194304] 0 2024-04-25T02:27:08.383 INFO:tasks.workunit.client.0.smithi114.stdout:9/385: dwrite d8/d16/d21/d83/d39/d38/f6f [0,4194304] 0 2024-04-25T02:27:08.384 INFO:tasks.workunit.client.0.smithi114.stdout:1/341: dwrite df/d11/d25/d33/f57 [0,4194304] 0 2024-04-25T02:27:08.385 INFO:tasks.workunit.client.0.smithi114.stdout:4/325: write d3/d8/d12/d19/d26/d3e/f55 [236521,88091] 0 2024-04-25T02:27:08.386 INFO:tasks.workunit.client.0.smithi114.stdout:8/395: getdents da/d38/d62/d6d/d52/d6c 0 2024-04-25T02:27:08.386 INFO:tasks.workunit.client.0.smithi114.stdout:7/441: truncate d5/d19/d1a/f6e 1835703 0 2024-04-25T02:27:08.387 INFO:tasks.workunit.client.0.smithi114.stdout:5/407: mkdir d1/d3e/d60/d82/d8f 0 2024-04-25T02:27:08.388 INFO:tasks.workunit.client.0.smithi114.stdout:6/459: rmdir de 39 2024-04-25T02:27:08.400 INFO:tasks.workunit.client.0.smithi114.stdout:1/342: fdatasync df/d13/d1e/d3e/f69 0 2024-04-25T02:27:08.401 INFO:tasks.workunit.client.0.smithi114.stdout:7/442: dwrite d5/d32/d64/f67 [0,4194304] 0 2024-04-25T02:27:08.402 INFO:tasks.workunit.client.0.smithi114.stdout:5/408: unlink d1/d6/d1a/l56 0 2024-04-25T02:27:08.402 INFO:tasks.workunit.client.0.smithi114.stdout:2/422: truncate d5/d1c/d29/f5c 401663 0 2024-04-25T02:27:08.403 INFO:tasks.workunit.client.0.smithi114.stdout:3/345: symlink d0/d25/d29/d78/l7a 0 2024-04-25T02:27:08.403 INFO:tasks.workunit.client.0.smithi114.stdout:0/377: write d1/d7/f1c [781065,104403] 0 2024-04-25T02:27:08.403 INFO:tasks.workunit.client.0.smithi114.stdout:7/443: chown d5/d32/c3e 10039 1 2024-04-25T02:27:08.405 INFO:tasks.workunit.client.0.smithi114.stdout:7/444: fdatasync d5/d32/d4a/f56 0 2024-04-25T02:27:08.405 INFO:tasks.workunit.client.0.smithi114.stdout:3/346: chown d0/d25/d2a/f4e 2 1 2024-04-25T02:27:08.406 INFO:tasks.workunit.client.0.smithi114.stdout:6/460: symlink de/d1c/la6 0 2024-04-25T02:27:08.407 INFO:tasks.workunit.client.0.smithi114.stdout:3/347: write d0/d5/d3d/f42 [148721,7999] 0 2024-04-25T02:27:08.408 INFO:tasks.workunit.client.0.smithi114.stdout:4/326: creat d3/d8/d23/f5f x:0 0 0 2024-04-25T02:27:08.412 INFO:tasks.workunit.client.0.smithi114.stdout:6/461: mkdir de/d27/d34/d44/da7 0 2024-04-25T02:27:08.413 INFO:tasks.workunit.client.0.smithi114.stdout:0/378: dwrite d1/d4/d37/f71 [0,4194304] 0 2024-04-25T02:27:08.415 INFO:tasks.workunit.client.0.smithi114.stdout:4/327: dread d3/fa [0,4194304] 0 2024-04-25T02:27:08.416 INFO:tasks.workunit.client.0.smithi114.stdout:7/445: link f1 d5/d32/d4a/d51/f95 0 2024-04-25T02:27:08.417 INFO:tasks.workunit.client.0.smithi114.stdout:8/396: link da/d38/d62/d6d/l71 da/l7a 0 2024-04-25T02:27:08.418 INFO:tasks.workunit.client.0.smithi114.stdout:3/348: dwrite d0/d25/d29/f39 [0,4194304] 0 2024-04-25T02:27:08.421 INFO:tasks.workunit.client.0.smithi114.stdout:0/379: rename d1/d7/d18/d2e/d50/c5a to d1/d7/d18/d2e/c72 0 2024-04-25T02:27:08.422 INFO:tasks.workunit.client.0.smithi114.stdout:6/462: dwrite de/d27/d34/d38/f70 [0,4194304] 0 2024-04-25T02:27:08.423 INFO:tasks.workunit.client.0.smithi114.stdout:3/349: chown d0/c1c 0 1 2024-04-25T02:27:08.424 INFO:tasks.workunit.client.0.smithi114.stdout:6/463: chown de/la4 2 1 2024-04-25T02:27:08.424 INFO:tasks.workunit.client.0.smithi114.stdout:4/328: mknod d3/d8/d23/c60 0 2024-04-25T02:27:08.426 INFO:tasks.workunit.client.0.smithi114.stdout:8/397: creat da/d32/d3b/d70/f7b x:0 0 0 2024-04-25T02:27:08.431 INFO:tasks.workunit.client.0.smithi114.stdout:3/350: readlink d0/l1a 0 2024-04-25T02:27:08.431 INFO:tasks.workunit.client.0.smithi114.stdout:4/329: dread d3/d8/d12/d19/d26/f2a [4194304,4194304] 0 2024-04-25T02:27:08.431 INFO:tasks.workunit.client.0.smithi114.stdout:6/464: symlink de/d25/d39/d5c/la8 0 2024-04-25T02:27:08.432 INFO:tasks.workunit.client.0.smithi114.stdout:3/351: write d0/d5/f31 [2130714,32510] 0 2024-04-25T02:27:08.433 INFO:tasks.workunit.client.0.smithi114.stdout:4/330: write d3/d8/d23/d25/f2d [200374,84889] 0 2024-04-25T02:27:08.433 INFO:tasks.workunit.client.0.smithi114.stdout:8/398: mknod da/d32/c7c 0 2024-04-25T02:27:08.435 INFO:tasks.workunit.client.0.smithi114.stdout:9/386: dread d8/d16/d21/f22 [0,4194304] 0 2024-04-25T02:27:08.437 INFO:tasks.workunit.client.0.smithi114.stdout:3/352: readlink d0/l79 0 2024-04-25T02:27:08.438 INFO:tasks.workunit.client.0.smithi114.stdout:3/353: write d0/f4b [799149,43856] 0 2024-04-25T02:27:08.439 INFO:tasks.workunit.client.0.smithi114.stdout:9/387: readlink d8/d16/d21/l31 0 2024-04-25T02:27:08.440 INFO:tasks.workunit.client.0.smithi114.stdout:6/465: creat de/d25/d39/d47/d90/d93/d99/fa9 x:0 0 0 2024-04-25T02:27:08.440 INFO:tasks.workunit.client.0.smithi114.stdout:1/343: dwrite df/d11/d25/f26 [0,4194304] 0 2024-04-25T02:27:08.441 INFO:tasks.workunit.client.0.smithi114.stdout:9/388: readlink d8/d16/d21/d24/l55 0 2024-04-25T02:27:08.441 INFO:tasks.workunit.client.0.smithi114.stdout:8/399: getdents da/d38/d62/d6d/d49/d65 0 2024-04-25T02:27:08.442 INFO:tasks.workunit.client.0.smithi114.stdout:9/389: chown d8/l12 175518 1 2024-04-25T02:27:08.443 INFO:tasks.workunit.client.0.smithi114.stdout:1/344: creat df/d11/d25/d33/d47/f6f x:0 0 0 2024-04-25T02:27:08.444 INFO:tasks.workunit.client.0.smithi114.stdout:6/466: creat de/d25/d39/d47/d90/d93/d99/faa x:0 0 0 2024-04-25T02:27:08.444 INFO:tasks.workunit.client.0.smithi114.stdout:3/354: mknod d0/d25/d2a/d36/c7b 0 2024-04-25T02:27:08.445 INFO:tasks.workunit.client.0.smithi114.stdout:9/390: dread d8/d16/d21/d83/d39/d38/f84 [0,4194304] 0 2024-04-25T02:27:08.445 INFO:tasks.workunit.client.0.smithi114.stdout:8/400: creat da/d38/d62/d6d/d49/f7d x:0 0 0 2024-04-25T02:27:08.446 INFO:tasks.workunit.client.0.smithi114.stdout:9/391: chown d8/d16/d21/d24/c2b 12377180 1 2024-04-25T02:27:08.447 INFO:tasks.workunit.client.0.smithi114.stdout:8/401: dread - da/d38/d62/d6d/f51 zero size 2024-04-25T02:27:08.448 INFO:tasks.workunit.client.0.smithi114.stdout:6/467: mknod de/d27/d76/cab 0 2024-04-25T02:27:08.450 INFO:tasks.workunit.client.0.smithi114.stdout:1/345: creat df/d2a/f70 x:0 0 0 2024-04-25T02:27:08.451 INFO:tasks.workunit.client.0.smithi114.stdout:8/402: write da/d1d/f36 [3820853,63052] 0 2024-04-25T02:27:08.451 INFO:tasks.workunit.client.0.smithi114.stdout:3/355: mknod d0/d25/c7c 0 2024-04-25T02:27:08.453 INFO:tasks.workunit.client.0.smithi114.stdout:3/356: truncate d0/f3 5416533 0 2024-04-25T02:27:08.454 INFO:tasks.workunit.client.0.smithi114.stdout:9/392: dwrite d8/d16/d21/d83/f86 [0,4194304] 0 2024-04-25T02:27:08.454 INFO:tasks.workunit.client.0.smithi114.stdout:1/346: stat df/d11/d25/f37 0 2024-04-25T02:27:08.456 INFO:tasks.workunit.client.0.smithi114.stdout:3/357: truncate d0/d25/d2a/d34/f55 2011526 0 2024-04-25T02:27:08.459 INFO:tasks.workunit.client.0.smithi114.stdout:9/393: unlink d8/f11 0 2024-04-25T02:27:08.460 INFO:tasks.workunit.client.0.smithi114.stdout:8/403: creat da/d32/d3b/d6b/f7e x:0 0 0 2024-04-25T02:27:08.461 INFO:tasks.workunit.client.0.smithi114.stdout:1/347: chown df/d2a/d34/f55 42 1 2024-04-25T02:27:08.461 INFO:tasks.workunit.client.0.smithi114.stdout:1/348: stat df/d13/l1a 0 2024-04-25T02:27:08.462 INFO:tasks.workunit.client.0.smithi114.stdout:6/468: getdents de/d27/d34/d44 0 2024-04-25T02:27:08.462 INFO:tasks.workunit.client.0.smithi114.stdout:2/423: write d5/d1c/d29/f5c [672220,127742] 0 2024-04-25T02:27:08.466 INFO:tasks.workunit.client.0.smithi114.stdout:9/394: mknod d8/d16/d21/d83/c8d 0 2024-04-25T02:27:08.467 INFO:tasks.workunit.client.0.smithi114.stdout:8/404: write da/d38/d62/d6d/f51 [770415,117904] 0 2024-04-25T02:27:08.469 INFO:tasks.workunit.client.0.smithi114.stdout:6/469: truncate de/d30/f72 291 0 2024-04-25T02:27:08.471 INFO:tasks.workunit.client.0.smithi114.stdout:0/380: rmdir d1/d7/d18/d2e/d50 0 2024-04-25T02:27:08.472 INFO:tasks.workunit.client.0.smithi114.stdout:9/395: fsync d8/d16/d21/d83/f7c 0 2024-04-25T02:27:08.473 INFO:tasks.workunit.client.0.smithi114.stdout:4/331: dwrite d3/d8/d23/d25/d31/d33/f29 [0,4194304] 0 2024-04-25T02:27:08.473 INFO:tasks.workunit.client.0.smithi114.stdout:1/349: symlink df/d11/d6c/l71 0 2024-04-25T02:27:08.473 INFO:tasks.workunit.client.0.smithi114.stdout:0/381: chown d1/d7/f1c 0 1 2024-04-25T02:27:08.475 INFO:tasks.workunit.client.0.smithi114.stdout:0/382: read - d1/d4/d24/d52/f5f zero size 2024-04-25T02:27:08.475 INFO:tasks.workunit.client.0.smithi114.stdout:8/405: chown da/d1d/f1f 8120567 1 2024-04-25T02:27:08.476 INFO:tasks.workunit.client.0.smithi114.stdout:2/424: dread - d5/df/d2c/f82 zero size 2024-04-25T02:27:08.476 INFO:tasks.workunit.client.0.smithi114.stdout:6/470: dread de/f18 [0,4194304] 0 2024-04-25T02:27:08.477 INFO:tasks.workunit.client.0.smithi114.stdout:1/350: dread - df/d11/d25/f4c zero size 2024-04-25T02:27:08.479 INFO:tasks.workunit.client.0.smithi114.stdout:6/471: fdatasync de/ff 0 2024-04-25T02:27:08.479 INFO:tasks.workunit.client.0.smithi114.stdout:0/383: read d1/d4/d24/f2d [2174644,48380] 0 2024-04-25T02:27:08.480 INFO:tasks.workunit.client.0.smithi114.stdout:0/384: chown d1/d7/d18/d2e/c31 57 1 2024-04-25T02:27:08.482 INFO:tasks.workunit.client.0.smithi114.stdout:1/351: rmdir df/d11/d25/d33 39 2024-04-25T02:27:08.482 INFO:tasks.workunit.client.0.smithi114.stdout:0/385: truncate d1/d7/d18/d2e/f54 272456 0 2024-04-25T02:27:08.483 INFO:tasks.workunit.client.0.smithi114.stdout:3/358: write d0/d25/f48 [4289750,15828] 0 2024-04-25T02:27:08.483 INFO:tasks.workunit.client.0.smithi114.stdout:2/425: symlink d5/d72/l92 0 2024-04-25T02:27:08.487 INFO:tasks.workunit.client.0.smithi114.stdout:0/386: creat d1/d4/da/f73 x:0 0 0 2024-04-25T02:27:08.488 INFO:tasks.workunit.client.0.smithi114.stdout:6/472: dwrite de/d25/d39/d47/d90/d93/d99/fa9 [0,4194304] 0 2024-04-25T02:27:08.489 INFO:tasks.workunit.client.0.smithi114.stdout:2/426: creat d5/d1c/d22/d89/f93 x:0 0 0 2024-04-25T02:27:08.489 INFO:tasks.workunit.client.0.smithi114.stdout:7/446: sync 2024-04-25T02:27:08.489 INFO:tasks.workunit.client.0.smithi114.stdout:5/409: sync 2024-04-25T02:27:08.490 INFO:tasks.workunit.client.0.smithi114.stdout:6/473: dread - de/d27/d34/d44/f80 zero size 2024-04-25T02:27:08.499 INFO:tasks.workunit.client.0.smithi114.stdout:6/474: creat de/d27/d34/d38/fac x:0 0 0 2024-04-25T02:27:08.499 INFO:tasks.workunit.client.0.smithi114.stdout:1/352: write df/d2a/f2e [4133855,112123] 0 2024-04-25T02:27:08.500 INFO:tasks.workunit.client.0.smithi114.stdout:9/396: dread d8/d16/d21/d37/f3e [0,4194304] 0 2024-04-25T02:27:08.502 INFO:tasks.workunit.client.0.smithi114.stdout:6/475: mkdir de/d25/dad 0 2024-04-25T02:27:08.503 INFO:tasks.workunit.client.0.smithi114.stdout:6/476: fsync de/f92 0 2024-04-25T02:27:08.504 INFO:tasks.workunit.client.0.smithi114.stdout:0/387: rename d1/d7/d18/d2e/l3c to d1/d4/da/l74 0 2024-04-25T02:27:08.504 INFO:tasks.workunit.client.0.smithi114.stdout:6/477: stat de/d27/d34/d4b 0 2024-04-25T02:27:08.504 INFO:tasks.workunit.client.0.smithi114.stdout:8/406: dwrite da/ff [0,4194304] 0 2024-04-25T02:27:08.505 INFO:tasks.workunit.client.0.smithi114.stdout:9/397: fsync d8/d16/d21/d24/d69/f6c 0 2024-04-25T02:27:08.506 INFO:tasks.workunit.client.0.smithi114.stdout:8/407: stat da/d38/l5e 0 2024-04-25T02:27:08.508 INFO:tasks.workunit.client.0.smithi114.stdout:1/353: link df/d2a/f2e df/d13/d1e/f72 0 2024-04-25T02:27:08.508 INFO:tasks.workunit.client.0.smithi114.stdout:4/332: dread d3/d8/f2c [0,4194304] 0 2024-04-25T02:27:08.509 INFO:tasks.workunit.client.0.smithi114.stdout:9/398: symlink d8/d16/l8e 0 2024-04-25T02:27:08.510 INFO:tasks.workunit.client.0.smithi114.stdout:8/408: write da/d32/d3b/f64 [3398375,14617] 0 2024-04-25T02:27:08.512 INFO:tasks.workunit.client.0.smithi114.stdout:3/359: truncate d0/d5/f17 2082888 0 2024-04-25T02:27:08.512 INFO:tasks.workunit.client.0.smithi114.stdout:8/409: chown da/d32/d3b/d70 1 1 2024-04-25T02:27:08.515 INFO:tasks.workunit.client.0.smithi114.stdout:6/478: rename de/d27/d34/d44/f88 to de/d25/d39/d47/d90/fae 0 2024-04-25T02:27:08.515 INFO:tasks.workunit.client.0.smithi114.stdout:0/388: dwrite d1/d7/d18/f22 [0,4194304] 0 2024-04-25T02:27:08.516 INFO:tasks.workunit.client.0.smithi114.stdout:3/360: truncate d0/d25/f2e 5227379 0 2024-04-25T02:27:08.517 INFO:tasks.workunit.client.0.smithi114.stdout:4/333: chown d3/f28 0 1 2024-04-25T02:27:08.519 INFO:tasks.workunit.client.0.smithi114.stdout:5/410: dread d1/d6/f17 [0,4194304] 0 2024-04-25T02:27:08.520 INFO:tasks.workunit.client.0.smithi114.stdout:1/354: mknod df/d11/d25/d33/c73 0 2024-04-25T02:27:08.521 INFO:tasks.workunit.client.0.smithi114.stdout:8/410: truncate da/d32/d3b/d6b/f7e 408230 0 2024-04-25T02:27:08.522 INFO:tasks.workunit.client.0.smithi114.stdout:0/389: write d1/d7/f56 [4253713,89706] 0 2024-04-25T02:27:08.525 INFO:tasks.workunit.client.0.smithi114.stdout:5/411: chown d1/d3e/c49 267393863 1 2024-04-25T02:27:08.526 INFO:tasks.workunit.client.0.smithi114.stdout:7/447: dwrite d5/f18 [0,4194304] 0 2024-04-25T02:27:08.527 INFO:tasks.workunit.client.0.smithi114.stdout:1/355: mkdir df/d11/d25/d33/d47/d74 0 2024-04-25T02:27:08.527 INFO:tasks.workunit.client.0.smithi114.stdout:9/399: dwrite d8/d16/d21/d24/d3c/f45 [8388608,4194304] 0 2024-04-25T02:27:08.528 INFO:tasks.workunit.client.0.smithi114.stdout:8/411: creat da/d38/d62/d6d/f7f x:0 0 0 2024-04-25T02:27:08.530 INFO:tasks.workunit.client.0.smithi114.stdout:7/448: chown d5/d32/d4a/l68 69696269 1 2024-04-25T02:27:08.531 INFO:tasks.workunit.client.0.smithi114.stdout:0/390: write d1/d7/d18/f51 [444191,109571] 0 2024-04-25T02:27:08.531 INFO:tasks.workunit.client.0.smithi114.stdout:2/427: dwrite d5/d1c/d22/f24 [0,4194304] 0 2024-04-25T02:27:08.535 INFO:tasks.workunit.client.0.smithi114.stdout:5/412: rmdir d1/d3e/d60 39 2024-04-25T02:27:08.535 INFO:tasks.workunit.client.0.smithi114.stdout:8/412: write da/d32/d3b/d6b/f7e [457787,11486] 0 2024-04-25T02:27:08.535 INFO:tasks.workunit.client.0.smithi114.stdout:2/428: chown d5/df/d3d/f5e 168357539 1 2024-04-25T02:27:08.535 INFO:tasks.workunit.client.0.smithi114.stdout:7/449: write d5/d19/d1a/f6e [458123,128099] 0 2024-04-25T02:27:08.536 INFO:tasks.workunit.client.0.smithi114.stdout:1/356: mkdir df/d13/d75 0 2024-04-25T02:27:08.536 INFO:tasks.workunit.client.0.smithi114.stdout:4/334: link d3/d8/l41 d3/d8/d23/d25/d31/d33/l61 0 2024-04-25T02:27:08.536 INFO:tasks.workunit.client.0.smithi114.stdout:1/357: chown fa 81501 1 2024-04-25T02:27:08.536 INFO:tasks.workunit.client.0.smithi114.stdout:7/450: write d5/d32/d4a/f56 [749411,48497] 0 2024-04-25T02:27:08.537 INFO:tasks.workunit.client.0.smithi114.stdout:5/413: creat d1/d6/de/f90 x:0 0 0 2024-04-25T02:27:08.539 INFO:tasks.workunit.client.0.smithi114.stdout:1/358: dread df/d11/d25/d33/f57 [0,4194304] 0 2024-04-25T02:27:08.539 INFO:tasks.workunit.client.0.smithi114.stdout:9/400: mknod d8/d16/d21/d37/d43/d75/d8a/c8f 0 2024-04-25T02:27:08.540 INFO:tasks.workunit.client.0.smithi114.stdout:1/359: dread - df/d13/d1e/f6d zero size 2024-04-25T02:27:08.544 INFO:tasks.workunit.client.0.smithi114.stdout:4/335: truncate d3/d8/d23/d25/d31/f59 3646419 0 2024-04-25T02:27:08.544 INFO:tasks.workunit.client.0.smithi114.stdout:2/429: read d5/df/d2c/f64 [3170668,59116] 0 2024-04-25T02:27:08.545 INFO:tasks.workunit.client.0.smithi114.stdout:0/391: unlink d1/d4/d24/f41 0 2024-04-25T02:27:08.547 INFO:tasks.workunit.client.0.smithi114.stdout:5/414: write d1/d25/f1f [3311462,6547] 0 2024-04-25T02:27:08.548 INFO:tasks.workunit.client.0.smithi114.stdout:5/415: chown d1/d53/d55/l8b 0 1 2024-04-25T02:27:08.548 INFO:tasks.workunit.client.0.smithi114.stdout:7/451: dwrite d5/d19/f2a [0,4194304] 0 2024-04-25T02:27:08.550 INFO:tasks.workunit.client.0.smithi114.stdout:5/416: write d1/d6/de/f44 [838522,125238] 0 2024-04-25T02:27:08.550 INFO:tasks.workunit.client.0.smithi114.stdout:7/452: chown d5/d32/d4a/d91/f73 377 1 2024-04-25T02:27:08.554 INFO:tasks.workunit.client.0.smithi114.stdout:4/336: mkdir d3/d8/d12/d19/d26/d3e/d62 0 2024-04-25T02:27:08.556 INFO:tasks.workunit.client.0.smithi114.stdout:2/430: rmdir d5/d6/d31 39 2024-04-25T02:27:08.558 INFO:tasks.workunit.client.0.smithi114.stdout:8/413: link da/d1d/f1f da/d32/d3b/d70/f80 0 2024-04-25T02:27:08.560 INFO:tasks.workunit.client.0.smithi114.stdout:4/337: dwrite d3/d8/f1c [0,4194304] 0 2024-04-25T02:27:08.575 INFO:tasks.workunit.client.0.smithi114.stdout:6/479: truncate de/d30/f43 2776592 0 2024-04-25T02:27:08.575 INFO:tasks.workunit.client.0.smithi114.stdout:0/392: fdatasync d1/d7/d18/f51 0 2024-04-25T02:27:08.577 INFO:tasks.workunit.client.0.smithi114.stdout:9/401: rename d8/c34 to d8/d16/d21/d83/d39/d38/c90 0 2024-04-25T02:27:08.577 INFO:tasks.workunit.client.0.smithi114.stdout:2/431: fsync d5/d6/d31/f37 0 2024-04-25T02:27:08.579 INFO:tasks.workunit.client.0.smithi114.stdout:2/432: readlink d5/d72/l92 0 2024-04-25T02:27:08.579 INFO:tasks.workunit.client.0.smithi114.stdout:0/393: write d1/d4/da/f16 [3747849,19722] 0 2024-04-25T02:27:08.580 INFO:tasks.workunit.client.0.smithi114.stdout:0/394: readlink d1/d4/da/d33/l3f 0 2024-04-25T02:27:08.581 INFO:tasks.workunit.client.0.smithi114.stdout:8/414: write da/d32/d3b/d40/f45 [3008350,2734] 0 2024-04-25T02:27:08.581 INFO:tasks.workunit.client.0.smithi114.stdout:7/453: rename f1 to d5/d32/d4a/d51/f96 0 2024-04-25T02:27:08.582 INFO:tasks.workunit.client.0.smithi114.stdout:6/480: chown de/d27/d34/d38/c57 11254 1 2024-04-25T02:27:08.582 INFO:tasks.workunit.client.0.smithi114.stdout:4/338: symlink d3/d8/d23/l63 0 2024-04-25T02:27:08.584 INFO:tasks.workunit.client.0.smithi114.stdout:7/454: chown d5/d19/d1a/c39 167215 1 2024-04-25T02:27:08.584 INFO:tasks.workunit.client.0.smithi114.stdout:9/402: rename d8/d16/d21/d24/f65 to d8/f91 0 2024-04-25T02:27:08.588 INFO:tasks.workunit.client.0.smithi114.stdout:4/339: creat d3/d14/f64 x:0 0 0 2024-04-25T02:27:08.591 INFO:tasks.workunit.client.0.smithi114.stdout:3/361: dread d0/f3 [0,4194304] 0 2024-04-25T02:27:08.592 INFO:tasks.workunit.client.0.smithi114.stdout:7/455: symlink d5/d19/d23/l97 0 2024-04-25T02:27:08.593 INFO:tasks.workunit.client.0.smithi114.stdout:2/433: dwrite d5/d1c/d29/f2b [0,4194304] 0 2024-04-25T02:27:08.594 INFO:tasks.workunit.client.0.smithi114.stdout:4/340: rmdir d3/d8/d23/d25/d31 39 2024-04-25T02:27:08.595 INFO:tasks.workunit.client.0.smithi114.stdout:8/415: dwrite da/d32/f39 [0,4194304] 0 2024-04-25T02:27:08.597 INFO:tasks.workunit.client.0.smithi114.stdout:1/360: dread df/d11/d25/f5d [0,4194304] 0 2024-04-25T02:27:08.598 INFO:tasks.workunit.client.0.smithi114.stdout:1/361: chown l8 4756470 1 2024-04-25T02:27:08.599 INFO:tasks.workunit.client.0.smithi114.stdout:8/416: chown da/d32/d3b/d40/c43 15723 1 2024-04-25T02:27:08.599 INFO:tasks.workunit.client.0.smithi114.stdout:6/481: dwrite de/d25/d39/d5c/f6f [0,4194304] 0 2024-04-25T02:27:08.600 INFO:tasks.workunit.client.0.smithi114.stdout:8/417: fdatasync da/d32/d3b/d6b/f7e 0 2024-04-25T02:27:08.601 INFO:tasks.workunit.client.0.smithi114.stdout:0/395: dread d1/d4/d24/f45 [0,4194304] 0 2024-04-25T02:27:08.603 INFO:tasks.workunit.client.0.smithi114.stdout:7/456: dread d5/d32/d4a/d91/f57 [0,4194304] 0 2024-04-25T02:27:08.603 INFO:tasks.workunit.client.0.smithi114.stdout:2/434: dread d5/d1c/d22/f24 [0,4194304] 0 2024-04-25T02:27:08.604 INFO:tasks.workunit.client.0.smithi114.stdout:1/362: write df/d11/d32/f3c [1983265,106132] 0 2024-04-25T02:27:08.607 INFO:tasks.workunit.client.0.smithi114.stdout:0/396: creat d1/d30/f75 x:0 0 0 2024-04-25T02:27:08.609 INFO:tasks.workunit.client.0.smithi114.stdout:2/435: dwrite d5/df/f14 [0,4194304] 0 2024-04-25T02:27:08.610 INFO:tasks.workunit.client.0.smithi114.stdout:8/418: read da/d38/f2a [1514086,105138] 0 2024-04-25T02:27:08.612 INFO:tasks.workunit.client.0.smithi114.stdout:8/419: write da/d38/d62/d6d/d49/f4b [824135,115556] 0 2024-04-25T02:27:08.613 INFO:tasks.workunit.client.0.smithi114.stdout:1/363: unlink df/d2a/d34/l3a 0 2024-04-25T02:27:08.616 INFO:tasks.workunit.client.0.smithi114.stdout:7/457: truncate d5/d19/d23/f3a 663894 0 2024-04-25T02:27:08.618 INFO:tasks.workunit.client.0.smithi114.stdout:8/420: dwrite da/d1e/f29 [0,4194304] 0 2024-04-25T02:27:08.619 INFO:tasks.workunit.client.0.smithi114.stdout:8/421: dread - da/d38/f74 zero size 2024-04-25T02:27:08.619 INFO:tasks.workunit.client.0.smithi114.stdout:2/436: mknod d5/d1c/d21/d91/c94 0 2024-04-25T02:27:08.620 INFO:tasks.workunit.client.0.smithi114.stdout:6/482: rename de/d27/d34/c5b to de/d25/d39/caf 0 2024-04-25T02:27:08.620 INFO:tasks.workunit.client.0.smithi114.stdout:1/364: mknod df/d13/d75/c76 0 2024-04-25T02:27:08.621 INFO:tasks.workunit.client.0.smithi114.stdout:8/422: readlink da/l7a 0 2024-04-25T02:27:08.631 INFO:tasks.workunit.client.0.smithi114.stdout:5/417: sync 2024-04-25T02:27:08.644 INFO:tasks.workunit.client.0.smithi114.stdout:6/483: mknod de/d30/cb0 0 2024-04-25T02:27:08.645 INFO:tasks.workunit.client.0.smithi114.stdout:1/365: mkdir df/d2a/d34/d77 0 2024-04-25T02:27:08.645 INFO:tasks.workunit.client.0.smithi114.stdout:2/437: write d5/df/d1e/f84 [3728351,59934] 0 2024-04-25T02:27:08.645 INFO:tasks.workunit.client.0.smithi114.stdout:8/423: write da/d1d/f36 [2349745,3498] 0 2024-04-25T02:27:08.646 INFO:tasks.workunit.client.0.smithi114.stdout:5/418: dread - d1/d6/de/f4b zero size 2024-04-25T02:27:08.647 INFO:tasks.workunit.client.0.smithi114.stdout:4/341: write d3/d8/d12/d19/f1a [3874558,10436] 0 2024-04-25T02:27:08.647 INFO:tasks.workunit.client.0.smithi114.stdout:6/484: write de/f86 [204571,105990] 0 2024-04-25T02:27:08.647 INFO:tasks.workunit.client.0.smithi114.stdout:7/458: link d5/d19/c5c d5/d8b/c98 0 2024-04-25T02:27:08.650 INFO:tasks.workunit.client.0.smithi114.stdout:0/397: dread d1/d4/f19 [0,4194304] 0 2024-04-25T02:27:08.654 INFO:tasks.workunit.client.0.smithi114.stdout:6/485: creat de/d27/d34/d44/fb1 x:0 0 0 2024-04-25T02:27:08.655 INFO:tasks.workunit.client.0.smithi114.stdout:7/459: mkdir d5/d8b/d99 0 2024-04-25T02:27:08.656 INFO:tasks.workunit.client.0.smithi114.stdout:5/419: dread d1/d6/f3c [0,4194304] 0 2024-04-25T02:27:08.659 INFO:tasks.workunit.client.0.smithi114.stdout:1/366: dwrite df/d13/d44/d5a/f68 [0,4194304] 0 2024-04-25T02:27:08.659 INFO:tasks.workunit.client.0.smithi114.stdout:5/420: stat d1/d6/f43 0 2024-04-25T02:27:08.660 INFO:tasks.workunit.client.0.smithi114.stdout:6/486: creat de/d25/dad/fb2 x:0 0 0 2024-04-25T02:27:08.661 INFO:tasks.workunit.client.0.smithi114.stdout:7/460: mknod d5/d19/d23/c9a 0 2024-04-25T02:27:08.662 INFO:tasks.workunit.client.0.smithi114.stdout:6/487: dread - de/d27/f8f zero size 2024-04-25T02:27:08.664 INFO:tasks.workunit.client.0.smithi114.stdout:5/421: mknod d1/d6/d1a/d7f/c91 0 2024-04-25T02:27:08.665 INFO:tasks.workunit.client.0.smithi114.stdout:1/367: symlink df/d13/d1e/l78 0 2024-04-25T02:27:08.665 INFO:tasks.workunit.client.0.smithi114.stdout:0/398: dwrite d1/d30/d4d/f65 [0,4194304] 0 2024-04-25T02:27:08.666 INFO:tasks.workunit.client.0.smithi114.stdout:6/488: read - de/d25/f50 zero size 2024-04-25T02:27:08.668 INFO:tasks.workunit.client.0.smithi114.stdout:7/461: chown d5/d19/d23/f61 124391027 1 2024-04-25T02:27:08.668 INFO:tasks.workunit.client.0.smithi114.stdout:8/424: dread da/d38/d62/d6d/f46 [0,4194304] 0 2024-04-25T02:27:08.669 INFO:tasks.workunit.client.0.smithi114.stdout:5/422: mknod d1/d3e/d60/d82/c92 0 2024-04-25T02:27:08.670 INFO:tasks.workunit.client.0.smithi114.stdout:0/399: mknod d1/d4/d62/c76 0 2024-04-25T02:27:08.670 INFO:tasks.workunit.client.0.smithi114.stdout:8/425: readlink da/l5c 0 2024-04-25T02:27:08.671 INFO:tasks.workunit.client.0.smithi114.stdout:4/342: dwrite d3/f4a [0,4194304] 0 2024-04-25T02:27:08.672 INFO:tasks.workunit.client.0.smithi114.stdout:5/423: chown d1/d53/d55 9 1 2024-04-25T02:27:08.676 INFO:tasks.workunit.client.0.smithi114.stdout:1/368: link df/d11/d25/d43/f54 df/d2a/f79 0 2024-04-25T02:27:08.676 INFO:tasks.workunit.client.0.smithi114.stdout:4/343: readlink d3/d8/d30/l3a 0 2024-04-25T02:27:08.680 INFO:tasks.workunit.client.0.smithi114.stdout:9/403: sync 2024-04-25T02:27:08.682 INFO:tasks.workunit.client.0.smithi114.stdout:7/462: dwrite d5/f83 [0,4194304] 0 2024-04-25T02:27:08.684 INFO:tasks.workunit.client.0.smithi114.stdout:6/489: dwrite de/d25/d39/d47/f56 [0,4194304] 0 2024-04-25T02:27:08.684 INFO:tasks.workunit.client.0.smithi114.stdout:1/369: rename df/d2a/f79 to df/d11/d25/d43/f7a 0 2024-04-25T02:27:08.685 INFO:tasks.workunit.client.0.smithi114.stdout:0/400: dwrite d1/f27 [0,4194304] 0 2024-04-25T02:27:08.686 INFO:tasks.workunit.client.0.smithi114.stdout:8/426: dread da/d38/d62/d6d/d49/f4b [0,4194304] 0 2024-04-25T02:27:08.690 INFO:tasks.workunit.client.0.smithi114.stdout:0/401: truncate d1/d4/f49 1159771 0 2024-04-25T02:27:08.692 INFO:tasks.workunit.client.0.smithi114.stdout:6/490: rename l2 to de/d25/d39/d47/lb3 0 2024-04-25T02:27:08.692 INFO:tasks.workunit.client.0.smithi114.stdout:4/344: dread d3/d8/d12/d19/d26/d3e/f55 [0,4194304] 0 2024-04-25T02:27:08.693 INFO:tasks.workunit.client.0.smithi114.stdout:8/427: creat da/d32/d3b/d6b/f81 x:0 0 0 2024-04-25T02:27:08.694 INFO:tasks.workunit.client.0.smithi114.stdout:6/491: chown de/d27/f3f 15 1 2024-04-25T02:27:08.694 INFO:tasks.workunit.client.0.smithi114.stdout:7/463: dwrite d5/f49 [0,4194304] 0 2024-04-25T02:27:08.694 INFO:tasks.workunit.client.0.smithi114.stdout:1/370: mkdir df/d13/d1e/d3e/d7b 0 2024-04-25T02:27:08.697 INFO:tasks.workunit.client.0.smithi114.stdout:9/404: getdents d8/d16/d21/d37 0 2024-04-25T02:27:08.697 INFO:tasks.workunit.client.0.smithi114.stdout:8/428: mknod da/d1e/d58/c82 0 2024-04-25T02:27:08.699 INFO:tasks.workunit.client.0.smithi114.stdout:7/464: read d5/d19/d23/f3a [536377,125819] 0 2024-04-25T02:27:08.700 INFO:tasks.workunit.client.0.smithi114.stdout:1/371: creat df/d11/d32/f7c x:0 0 0 2024-04-25T02:27:08.701 INFO:tasks.workunit.client.0.smithi114.stdout:1/372: write df/d13/d44/d5a/f68 [3977200,30280] 0 2024-04-25T02:27:08.702 INFO:tasks.workunit.client.0.smithi114.stdout:6/492: rename de/f19 to de/d27/d34/d44/fb4 0 2024-04-25T02:27:08.703 INFO:tasks.workunit.client.0.smithi114.stdout:7/465: dread d5/d32/d64/f67 [0,4194304] 0 2024-04-25T02:27:08.708 INFO:tasks.workunit.client.0.smithi114.stdout:5/424: write d1/d53/f78 [1418418,109828] 0 2024-04-25T02:27:08.710 INFO:tasks.workunit.client.0.smithi114.stdout:9/405: rename d8/d16/d21/d83/d39/c81 to d8/d16/d21/d83/d39/d38/d46/d87/c92 0 2024-04-25T02:27:08.711 INFO:tasks.workunit.client.0.smithi114.stdout:9/406: dread - d8/d16/d21/d83/f7c zero size 2024-04-25T02:27:08.712 INFO:tasks.workunit.client.0.smithi114.stdout:9/407: write d8/ff [6409966,129651] 0 2024-04-25T02:27:08.712 INFO:tasks.workunit.client.0.smithi114.stdout:4/345: link d3/d8/f1b d3/d14/f65 0 2024-04-25T02:27:08.713 INFO:tasks.workunit.client.0.smithi114.stdout:8/429: fdatasync da/d38/d62/d6d/f42 0 2024-04-25T02:27:08.718 INFO:tasks.workunit.client.0.smithi114.stdout:7/466: creat d5/d19/d23/d6f/f9b x:0 0 0 2024-04-25T02:27:08.720 INFO:tasks.workunit.client.0.smithi114.stdout:5/425: link d1/d53/f7c d1/d3e/d8e/f93 0 2024-04-25T02:27:08.722 INFO:tasks.workunit.client.0.smithi114.stdout:9/408: dwrite d8/d16/d21/f26 [0,4194304] 0 2024-04-25T02:27:08.722 INFO:tasks.workunit.client.0.smithi114.stdout:5/426: truncate d1/d6/de/f4b 528714 0 2024-04-25T02:27:08.724 INFO:tasks.workunit.client.0.smithi114.stdout:5/427: write d1/d6/f7b [844632,86845] 0 2024-04-25T02:27:08.726 INFO:tasks.workunit.client.0.smithi114.stdout:4/346: creat d3/d8/d23/d25/f66 x:0 0 0 2024-04-25T02:27:08.730 INFO:tasks.workunit.client.0.smithi114.stdout:3/362: sync 2024-04-25T02:27:08.732 INFO:tasks.workunit.client.0.smithi114.stdout:8/430: getdents da/d1e/d58 0 2024-04-25T02:27:08.735 INFO:tasks.workunit.client.0.smithi114.stdout:5/428: truncate d1/d6/d1a/f64 1738524 0 2024-04-25T02:27:08.739 INFO:tasks.workunit.client.0.smithi114.stdout:3/363: creat d0/d25/d2a/d34/f7d x:0 0 0 2024-04-25T02:27:08.739 INFO:tasks.workunit.client.0.smithi114.stdout:1/373: dwrite df/d2a/d34/f55 [0,4194304] 0 2024-04-25T02:27:08.739 INFO:tasks.workunit.client.0.smithi114.stdout:8/431: symlink da/d38/d62/d6d/d52/l83 0 2024-04-25T02:27:08.740 INFO:tasks.workunit.client.0.smithi114.stdout:1/374: stat df/d13/d1e/d3e/c3f 0 2024-04-25T02:27:08.740 INFO:tasks.workunit.client.0.smithi114.stdout:8/432: write da/d32/d3b/f44 [596158,66170] 0 2024-04-25T02:27:08.741 INFO:tasks.workunit.client.0.smithi114.stdout:5/429: unlink d1/d6/f2b 0 2024-04-25T02:27:08.744 INFO:tasks.workunit.client.0.smithi114.stdout:4/347: dread d3/f28 [0,4194304] 0 2024-04-25T02:27:08.744 INFO:tasks.workunit.client.0.smithi114.stdout:1/375: stat ld 0 2024-04-25T02:27:08.747 INFO:tasks.workunit.client.0.smithi114.stdout:6/493: dwrite de/f16 [4194304,4194304] 0 2024-04-25T02:27:08.747 INFO:tasks.workunit.client.0.smithi114.stdout:7/467: write d5/d32/d4a/d51/f6b [918761,49907] 0 2024-04-25T02:27:08.749 INFO:tasks.workunit.client.0.smithi114.stdout:9/409: truncate d8/fe 3576363 0 2024-04-25T02:27:08.749 INFO:tasks.workunit.client.0.smithi114.stdout:8/433: dwrite da/d1d/f3f [0,4194304] 0 2024-04-25T02:27:08.754 INFO:tasks.workunit.client.0.smithi114.stdout:3/364: getdents d0/d25/d29 0 2024-04-25T02:27:08.755 INFO:tasks.workunit.client.0.smithi114.stdout:6/494: dread - de/d25/d39/d47/d90/fae zero size 2024-04-25T02:27:08.755 INFO:tasks.workunit.client.0.smithi114.stdout:1/376: mkdir df/d11/d7d 0 2024-04-25T02:27:08.756 INFO:tasks.workunit.client.0.smithi114.stdout:1/377: readlink l8 0 2024-04-25T02:27:08.757 INFO:tasks.workunit.client.0.smithi114.stdout:3/365: readlink d0/d25/d2a/l6f 0 2024-04-25T02:27:08.757 INFO:tasks.workunit.client.0.smithi114.stdout:7/468: write d5/d32/d4a/d91/f57 [1108267,96286] 0 2024-04-25T02:27:08.759 INFO:tasks.workunit.client.0.smithi114.stdout:6/495: creat de/d27/d34/d44/fb5 x:0 0 0 2024-04-25T02:27:08.761 INFO:tasks.workunit.client.0.smithi114.stdout:9/410: mknod d8/d16/d21/d83/d39/d38/d46/c93 0 2024-04-25T02:27:08.762 INFO:tasks.workunit.client.0.smithi114.stdout:8/434: rmdir da/d38/d62/d6d/d52 39 2024-04-25T02:27:08.764 INFO:tasks.workunit.client.0.smithi114.stdout:3/366: mkdir d0/d41/d7e 0 2024-04-25T02:27:08.765 INFO:tasks.workunit.client.0.smithi114.stdout:3/367: fsync d0/f12 0 2024-04-25T02:27:08.766 INFO:tasks.workunit.client.0.smithi114.stdout:7/469: dwrite d5/d19/d23/f8e [0,4194304] 0 2024-04-25T02:27:08.767 INFO:tasks.workunit.client.0.smithi114.stdout:1/378: symlink df/d13/d1e/l7e 0 2024-04-25T02:27:08.770 INFO:tasks.workunit.client.0.smithi114.stdout:6/496: dread de/d27/d34/d44/fb4 [4194304,4194304] 0 2024-04-25T02:27:08.771 INFO:tasks.workunit.client.0.smithi114.stdout:1/379: dread - df/d2a/d34/f63 zero size 2024-04-25T02:27:08.771 INFO:tasks.workunit.client.0.smithi114.stdout:5/430: dread d1/d25/f4e [0,4194304] 0 2024-04-25T02:27:08.773 INFO:tasks.workunit.client.0.smithi114.stdout:7/470: truncate d5/d19/d1a/f74 1020379 0 2024-04-25T02:27:08.775 INFO:tasks.workunit.client.0.smithi114.stdout:9/411: dwrite d8/d16/d21/d24/d3c/f45 [0,4194304] 0 2024-04-25T02:27:08.775 INFO:tasks.workunit.client.0.smithi114.stdout:8/435: dwrite da/d1e/f29 [0,4194304] 0 2024-04-25T02:27:08.776 INFO:tasks.workunit.client.0.smithi114.stdout:6/497: chown de/d25/d39/d47/d90/d93/d99/fa9 141952216 1 2024-04-25T02:27:08.777 INFO:tasks.workunit.client.0.smithi114.stdout:5/431: write d1/d25/d24/f3f [812930,65022] 0 2024-04-25T02:27:08.778 INFO:tasks.workunit.client.0.smithi114.stdout:8/436: readlink da/d32/d3b/d40/l6f 0 2024-04-25T02:27:08.779 INFO:tasks.workunit.client.0.smithi114.stdout:7/471: creat d5/d43/d4e/f9c x:0 0 0 2024-04-25T02:27:08.780 INFO:tasks.workunit.client.0.smithi114.stdout:1/380: dread df/d2a/d34/f55 [0,4194304] 0 2024-04-25T02:27:08.782 INFO:tasks.workunit.client.0.smithi114.stdout:2/438: sync 2024-04-25T02:27:08.783 INFO:tasks.workunit.client.0.smithi114.stdout:6/498: symlink de/d25/d39/d47/d90/d93/d99/lb6 0 2024-04-25T02:27:08.783 INFO:tasks.workunit.client.0.smithi114.stdout:6/499: fsync de/d27/d34/f7a 0 2024-04-25T02:27:08.785 INFO:tasks.workunit.client.0.smithi114.stdout:7/472: creat d5/d43/d63/d7a/f9d x:0 0 0 2024-04-25T02:27:08.787 INFO:tasks.workunit.client.0.smithi114.stdout:9/412: rename d8/d16/d21/d24/d3c/f45 to d8/d16/d21/d37/d60/d70/f94 0 2024-04-25T02:27:08.788 INFO:tasks.workunit.client.0.smithi114.stdout:8/437: write da/d38/d62/d6d/d49/f4b [709284,71884] 0 2024-04-25T02:27:08.790 INFO:tasks.workunit.client.0.smithi114.stdout:1/381: creat df/d11/d25/d33/d47/f7f x:0 0 0 2024-04-25T02:27:08.791 INFO:tasks.workunit.client.0.smithi114.stdout:5/432: unlink d1/d25/c70 0 2024-04-25T02:27:08.792 INFO:tasks.workunit.client.0.smithi114.stdout:3/368: getdents d0/d25/d2a/d36 0 2024-04-25T02:27:08.793 INFO:tasks.workunit.client.0.smithi114.stdout:6/500: creat de/d25/d39/d47/fb7 x:0 0 0 2024-04-25T02:27:08.797 INFO:tasks.workunit.client.0.smithi114.stdout:2/439: rename d5/d72 to d5/df/d3d/d83/d95 0 2024-04-25T02:27:08.798 INFO:tasks.workunit.client.0.smithi114.stdout:8/438: creat da/d1e/d58/f84 x:0 0 0 2024-04-25T02:27:08.800 INFO:tasks.workunit.client.0.smithi114.stdout:6/501: write de/f1f [2131810,97047] 0 2024-04-25T02:27:08.801 INFO:tasks.workunit.client.0.smithi114.stdout:6/502: write de/d30/f4a [4282079,118513] 0 2024-04-25T02:27:08.802 INFO:tasks.workunit.client.0.smithi114.stdout:2/440: creat d5/df/d1e/f96 x:0 0 0 2024-04-25T02:27:08.804 INFO:tasks.workunit.client.0.smithi114.stdout:2/441: fsync d5/df/d2c/f82 0 2024-04-25T02:27:08.805 INFO:tasks.workunit.client.0.smithi114.stdout:5/433: mkdir d1/d3e/d8e/d94 0 2024-04-25T02:27:08.807 INFO:tasks.workunit.client.0.smithi114.stdout:6/503: rename de/c9b to de/d27/d76/cb8 0 2024-04-25T02:27:08.809 INFO:tasks.workunit.client.0.smithi114.stdout:2/442: dread d5/d6/d58/f5f [0,4194304] 0 2024-04-25T02:27:08.810 INFO:tasks.workunit.client.0.smithi114.stdout:5/434: mkdir d1/d51/d6f/d95 0 2024-04-25T02:27:08.811 INFO:tasks.workunit.client.0.smithi114.stdout:7/473: link d5/c15 d5/d43/d63/d7a/c9e 0 2024-04-25T02:27:08.812 INFO:tasks.workunit.client.0.smithi114.stdout:6/504: mkdir de/d2a/db9 0 2024-04-25T02:27:08.816 INFO:tasks.workunit.client.0.smithi114.stdout:2/443: rename d5/d1c/d29/l48 to d5/df/d1e/l97 0 2024-04-25T02:27:08.817 INFO:tasks.workunit.client.0.smithi114.stdout:6/505: dwrite de/d25/f50 [0,4194304] 0 2024-04-25T02:27:08.818 INFO:tasks.workunit.client.0.smithi114.stdout:5/435: read d1/f36 [375136,20702] 0 2024-04-25T02:27:08.818 INFO:tasks.workunit.client.0.smithi114.stdout:7/474: creat d5/d19/d1a/d80/f9f x:0 0 0 2024-04-25T02:27:08.819 INFO:tasks.workunit.client.0.smithi114.stdout:9/413: truncate d8/f42 180148 0 2024-04-25T02:27:08.819 INFO:tasks.workunit.client.0.smithi114.stdout:8/439: link c2 da/d69/c85 0 2024-04-25T02:27:08.821 INFO:tasks.workunit.client.0.smithi114.stdout:1/382: write df/d13/f60 [616816,74326] 0 2024-04-25T02:27:08.825 INFO:tasks.workunit.client.0.smithi114.stdout:8/440: dwrite da/d1e/f59 [0,4194304] 0 2024-04-25T02:27:08.830 INFO:tasks.workunit.client.0.smithi114.stdout:9/414: mkdir d8/d16/d21/d95 0 2024-04-25T02:27:08.831 INFO:tasks.workunit.client.0.smithi114.stdout:0/402: sync 2024-04-25T02:27:08.831 INFO:tasks.workunit.client.0.smithi114.stdout:9/415: dread - d8/f91 zero size 2024-04-25T02:27:08.832 INFO:tasks.workunit.client.0.smithi114.stdout:1/383: creat df/d11/d25/d33/d47/d74/f80 x:0 0 0 2024-04-25T02:27:08.834 INFO:tasks.workunit.client.0.smithi114.stdout:1/384: read df/d11/d25/d33/f58 [567060,76668] 0 2024-04-25T02:27:08.836 INFO:tasks.workunit.client.0.smithi114.stdout:6/506: rename de/d27/c31 to de/cba 0 2024-04-25T02:27:08.836 INFO:tasks.workunit.client.0.smithi114.stdout:6/507: read - de/d27/d34/d44/fb5 zero size 2024-04-25T02:27:08.837 INFO:tasks.workunit.client.0.smithi114.stdout:6/508: fdatasync de/d27/d34/d4b/f7c 0 2024-04-25T02:27:08.840 INFO:tasks.workunit.client.0.smithi114.stdout:0/403: mkdir d1/d4/d4f/d77 0 2024-04-25T02:27:08.842 INFO:tasks.workunit.client.0.smithi114.stdout:9/416: rename d8/d16/d21/d83/d39/d38/d46/d87 to d8/d16/d21/d83/d39/d38/d46/d96 0 2024-04-25T02:27:08.843 INFO:tasks.workunit.client.0.smithi114.stdout:8/441: getdents da/d38/d62/d6d/d49/d65 0 2024-04-25T02:27:08.843 INFO:tasks.workunit.client.0.smithi114.stdout:8/442: stat da/d38/l41 0 2024-04-25T02:27:08.845 INFO:tasks.workunit.client.0.smithi114.stdout:7/475: getdents d5/d43/d4e 0 2024-04-25T02:27:08.847 INFO:tasks.workunit.client.0.smithi114.stdout:5/436: link d1/d3e/d60/d82/c92 d1/d25/c96 0 2024-04-25T02:27:08.848 INFO:tasks.workunit.client.0.smithi114.stdout:2/444: dread d5/df/d3d/f6f [0,4194304] 0 2024-04-25T02:27:08.849 INFO:tasks.workunit.client.0.smithi114.stdout:9/417: mknod d8/d16/d21/d37/c97 0 2024-04-25T02:27:08.851 INFO:tasks.workunit.client.0.smithi114.stdout:1/385: unlink df/d11/d25/c62 0 2024-04-25T02:27:08.854 INFO:tasks.workunit.client.0.smithi114.stdout:5/437: dwrite d1/d53/f78 [0,4194304] 0 2024-04-25T02:27:08.856 INFO:tasks.workunit.client.0.smithi114.stdout:6/509: truncate de/f86 38574 0 2024-04-25T02:27:08.856 INFO:tasks.workunit.client.0.smithi114.stdout:9/418: unlink d8/l12 0 2024-04-25T02:27:08.858 INFO:tasks.workunit.client.0.smithi114.stdout:1/386: mkdir df/d11/d25/d33/d81 0 2024-04-25T02:27:08.858 INFO:tasks.workunit.client.0.smithi114.stdout:2/445: fdatasync d5/df/d2c/f73 0 2024-04-25T02:27:08.860 INFO:tasks.workunit.client.0.smithi114.stdout:0/404: dwrite d1/d4/da/f2a [0,4194304] 0 2024-04-25T02:27:08.861 INFO:tasks.workunit.client.0.smithi114.stdout:6/510: creat de/d30/fbb x:0 0 0 2024-04-25T02:27:08.862 INFO:tasks.workunit.client.0.smithi114.stdout:9/419: creat d8/f98 x:0 0 0 2024-04-25T02:27:08.865 INFO:tasks.workunit.client.0.smithi114.stdout:1/387: dwrite fe [4194304,4194304] 0 2024-04-25T02:27:08.868 INFO:tasks.workunit.client.0.smithi114.stdout:8/443: truncate da/d32/d3b/d40/f45 2800281 0 2024-04-25T02:27:08.871 INFO:tasks.workunit.client.0.smithi114.stdout:6/511: creat de/d25/fbc x:0 0 0 2024-04-25T02:27:08.871 INFO:tasks.workunit.client.0.smithi114.stdout:2/446: write d5/df/d2c/f73 [632753,120426] 0 2024-04-25T02:27:08.872 INFO:tasks.workunit.client.0.smithi114.stdout:2/447: fdatasync d5/fe 0 2024-04-25T02:27:08.872 INFO:tasks.workunit.client.0.smithi114.stdout:6/512: dread - de/d27/d34/d44/fb1 zero size 2024-04-25T02:27:08.873 INFO:tasks.workunit.client.0.smithi114.stdout:1/388: fsync df/d2a/f2e 0 2024-04-25T02:27:08.876 INFO:tasks.workunit.client.0.smithi114.stdout:9/420: link d8/d16/d21/d83/d39/f62 d8/d16/d21/d24/d3c/d40/f99 0 2024-04-25T02:27:08.877 INFO:tasks.workunit.client.0.smithi114.stdout:6/513: symlink de/d25/d39/d47/d90/lbd 0 2024-04-25T02:27:08.877 INFO:tasks.workunit.client.0.smithi114.stdout:6/514: stat de/d27/d34/d4b/c98 0 2024-04-25T02:27:08.878 INFO:tasks.workunit.client.0.smithi114.stdout:1/389: mkdir df/d11/d6c/d82 0 2024-04-25T02:27:08.878 INFO:tasks.workunit.client.0.smithi114.stdout:1/390: readlink df/l66 0 2024-04-25T02:27:08.880 INFO:tasks.workunit.client.0.smithi114.stdout:8/444: rename da/d32/d3b/d70/f7b to da/f86 0 2024-04-25T02:27:08.881 INFO:tasks.workunit.client.0.smithi114.stdout:4/348: sync 2024-04-25T02:27:08.881 INFO:tasks.workunit.client.0.smithi114.stdout:6/515: creat de/d2a/fbe x:0 0 0 2024-04-25T02:27:08.881 INFO:tasks.workunit.client.0.smithi114.stdout:4/349: fdatasync d3/d8/f1c 0 2024-04-25T02:27:08.883 INFO:tasks.workunit.client.0.smithi114.stdout:2/448: getdents d5/d1c/d22/d89 0 2024-04-25T02:27:08.884 INFO:tasks.workunit.client.0.smithi114.stdout:2/449: chown d5/d1c/d22/d89/f93 379606 1 2024-04-25T02:27:08.886 INFO:tasks.workunit.client.0.smithi114.stdout:6/516: truncate f5 3041606 0 2024-04-25T02:27:08.886 INFO:tasks.workunit.client.0.smithi114.stdout:9/421: link d8/d16/d21/d83/d39/c2d d8/d16/d21/d83/d39/d38/d5d/c9a 0 2024-04-25T02:27:08.889 INFO:tasks.workunit.client.0.smithi114.stdout:1/391: rename df/d13/d1e/f21 to df/d13/f83 0 2024-04-25T02:27:08.889 INFO:tasks.workunit.client.0.smithi114.stdout:5/438: write d1/d3e/d8e/f93 [543217,16124] 0 2024-04-25T02:27:08.890 INFO:tasks.workunit.client.0.smithi114.stdout:2/450: mknod d5/df/c98 0 2024-04-25T02:27:08.890 INFO:tasks.workunit.client.0.smithi114.stdout:2/451: dread - d5/df/f8c zero size 2024-04-25T02:27:08.891 INFO:tasks.workunit.client.0.smithi114.stdout:6/517: mknod de/d1c/cbf 0 2024-04-25T02:27:08.892 INFO:tasks.workunit.client.0.smithi114.stdout:9/422: mknod d8/d16/d21/d24/d3c/d40/c9b 0 2024-04-25T02:27:08.892 INFO:tasks.workunit.client.0.smithi114.stdout:6/518: read de/d27/d34/d38/f87 [1413661,63396] 0 2024-04-25T02:27:08.894 INFO:tasks.workunit.client.0.smithi114.stdout:1/392: creat df/d2a/d34/f84 x:0 0 0 2024-04-25T02:27:08.897 INFO:tasks.workunit.client.0.smithi114.stdout:1/393: write df/d11/d25/d33/d47/f5e [616789,102540] 0 2024-04-25T02:27:08.899 INFO:tasks.workunit.client.0.smithi114.stdout:2/452: dwrite d5/df/d1e/f96 [0,4194304] 0 2024-04-25T02:27:08.899 INFO:tasks.workunit.client.0.smithi114.stdout:1/394: readlink df/d13/d1e/l78 0 2024-04-25T02:27:08.899 INFO:tasks.workunit.client.0.smithi114.stdout:6/519: unlink de/d25/c2f 0 2024-04-25T02:27:08.901 INFO:tasks.workunit.client.0.smithi114.stdout:6/520: fsync de/d30/f62 0 2024-04-25T02:27:08.903 INFO:tasks.workunit.client.0.smithi114.stdout:9/423: dwrite d8/d16/d21/d83/d39/f23 [0,4194304] 0 2024-04-25T02:27:08.904 INFO:tasks.workunit.client.0.smithi114.stdout:0/405: truncate d1/d4/da/f12 14520 0 2024-04-25T02:27:08.904 INFO:tasks.workunit.client.0.smithi114.stdout:0/406: chown d1/d7/cb 22051 1 2024-04-25T02:27:08.905 INFO:tasks.workunit.client.0.smithi114.stdout:0/407: write d1/d30/d4d/f65 [4977869,59320] 0 2024-04-25T02:27:08.911 INFO:tasks.workunit.client.0.smithi114.stdout:6/521: fdatasync de/d25/d39/f5e 0 2024-04-25T02:27:08.915 INFO:tasks.workunit.client.0.smithi114.stdout:4/350: rename d3/d8/l13 to d3/l67 0 2024-04-25T02:27:08.920 INFO:tasks.workunit.client.0.smithi114.stdout:0/408: dwrite d1/d7/d18/f1f [4194304,4194304] 0 2024-04-25T02:27:08.922 INFO:tasks.workunit.client.0.smithi114.stdout:2/453: creat d5/d6/d58/f99 x:0 0 0 2024-04-25T02:27:08.924 INFO:tasks.workunit.client.0.smithi114.stdout:5/439: link d1/l13 d1/d6/d4f/d6c/l97 0 2024-04-25T02:27:08.924 INFO:tasks.workunit.client.0.smithi114.stdout:5/440: readlink d1/l7d 0 2024-04-25T02:27:08.928 INFO:tasks.workunit.client.0.smithi114.stdout:1/395: getdents df/d11/d25 0 2024-04-25T02:27:08.929 INFO:tasks.workunit.client.0.smithi114.stdout:4/351: dwrite d3/d8/f2c [0,4194304] 0 2024-04-25T02:27:08.930 INFO:tasks.workunit.client.0.smithi114.stdout:4/352: dread - d3/d8/f1b zero size 2024-04-25T02:27:08.932 INFO:tasks.workunit.client.0.smithi114.stdout:1/396: rmdir df/d11/d25/d33 39 2024-04-25T02:27:08.932 INFO:tasks.workunit.client.0.smithi114.stdout:2/454: dwrite d5/f15 [0,4194304] 0 2024-04-25T02:27:08.935 INFO:tasks.workunit.client.0.smithi114.stdout:5/441: creat d1/d3e/d60/d82/d8f/f98 x:0 0 0 2024-04-25T02:27:08.939 INFO:tasks.workunit.client.0.smithi114.stdout:2/455: dwrite d5/df/d1e/f38 [0,4194304] 0 2024-04-25T02:27:08.943 INFO:tasks.workunit.client.0.smithi114.stdout:1/397: mknod df/d11/c85 0 2024-04-25T02:27:08.943 INFO:tasks.workunit.client.0.smithi114.stdout:4/353: link d3/d8/d12/d19/d26/f34 d3/d14/f68 0 2024-04-25T02:27:08.945 INFO:tasks.workunit.client.0.smithi114.stdout:2/456: fsync d5/d1c/d22/f24 0 2024-04-25T02:27:08.946 INFO:tasks.workunit.client.0.smithi114.stdout:2/457: fdatasync d5/d1c/d29/f5c 0 2024-04-25T02:27:08.947 INFO:tasks.workunit.client.0.smithi114.stdout:2/458: dread - d5/df/d2c/f82 zero size 2024-04-25T02:27:08.947 INFO:tasks.workunit.client.0.smithi114.stdout:5/442: dread d1/d6/de/f1e [0,4194304] 0 2024-04-25T02:27:08.948 INFO:tasks.workunit.client.0.smithi114.stdout:5/443: write d1/d3e/d8e/f93 [711199,67366] 0 2024-04-25T02:27:08.949 INFO:tasks.workunit.client.0.smithi114.stdout:3/369: sync 2024-04-25T02:27:08.949 INFO:tasks.workunit.client.0.smithi114.stdout:7/476: sync 2024-04-25T02:27:08.950 INFO:tasks.workunit.client.0.smithi114.stdout:7/477: fsync d5/d32/d4a/d87/f8a 0 2024-04-25T02:27:08.950 INFO:tasks.workunit.client.0.smithi114.stdout:4/354: rename d3/d8/d30/f5b to d3/d8/d30/d4c/f69 0 2024-04-25T02:27:08.952 INFO:tasks.workunit.client.0.smithi114.stdout:7/478: dread - d5/d43/d4e/f7e zero size 2024-04-25T02:27:08.953 INFO:tasks.workunit.client.0.smithi114.stdout:6/522: dread de/d27/d34/d38/f42 [0,4194304] 0 2024-04-25T02:27:08.953 INFO:tasks.workunit.client.0.smithi114.stdout:2/459: symlink d5/d1c/d21/l9a 0 2024-04-25T02:27:08.954 INFO:tasks.workunit.client.0.smithi114.stdout:7/479: read d5/d19/d23/f8e [3614926,104224] 0 2024-04-25T02:27:08.954 INFO:tasks.workunit.client.0.smithi114.stdout:9/424: dread d8/d16/d21/d83/d39/f62 [0,4194304] 0 2024-04-25T02:27:08.957 INFO:tasks.workunit.client.0.smithi114.stdout:6/523: dread de/f59 [0,4194304] 0 2024-04-25T02:27:08.958 INFO:tasks.workunit.client.0.smithi114.stdout:2/460: readlink d5/d6/l2d 0 2024-04-25T02:27:08.960 INFO:tasks.workunit.client.0.smithi114.stdout:3/370: mknod d0/c7f 0 2024-04-25T02:27:08.960 INFO:tasks.workunit.client.0.smithi114.stdout:9/425: symlink d8/d16/d21/d37/d43/d75/d8a/l9c 0 2024-04-25T02:27:08.961 INFO:tasks.workunit.client.0.smithi114.stdout:3/371: write d0/d25/d2a/d34/f55 [85931,128361] 0 2024-04-25T02:27:08.962 INFO:tasks.workunit.client.0.smithi114.stdout:1/398: getdents df/d13/d1e 0 2024-04-25T02:27:08.962 INFO:tasks.workunit.client.0.smithi114.stdout:9/426: write d8/d16/d21/d83/d39/d38/f80 [785712,47429] 0 2024-04-25T02:27:08.963 INFO:tasks.workunit.client.0.smithi114.stdout:1/399: chown df/d11/d32/f7c 15214 1 2024-04-25T02:27:08.963 INFO:tasks.workunit.client.0.smithi114.stdout:9/427: readlink d8/d16/d21/d83/l32 0 2024-04-25T02:27:08.964 INFO:tasks.workunit.client.0.smithi114.stdout:6/524: creat de/d27/d34/d4b/fc0 x:0 0 0 2024-04-25T02:27:08.965 INFO:tasks.workunit.client.0.smithi114.stdout:6/525: dread - de/d30/f9e zero size 2024-04-25T02:27:08.966 INFO:tasks.workunit.client.0.smithi114.stdout:6/526: read de/d27/d34/f8a [3932996,36806] 0 2024-04-25T02:27:08.967 INFO:tasks.workunit.client.0.smithi114.stdout:2/461: rename d5/df/d3d/f42 to d5/d1c/d21/d91/f9b 0 2024-04-25T02:27:08.969 INFO:tasks.workunit.client.0.smithi114.stdout:2/462: write d5/d6/d58/f99 [781566,75310] 0 2024-04-25T02:27:08.969 INFO:tasks.workunit.client.0.smithi114.stdout:1/400: symlink df/d13/d1e/d3e/l86 0 2024-04-25T02:27:08.969 INFO:tasks.workunit.client.0.smithi114.stdout:4/355: dread d3/d8/d12/f1e [0,4194304] 0 2024-04-25T02:27:08.971 INFO:tasks.workunit.client.0.smithi114.stdout:7/480: creat d5/fa0 x:0 0 0 2024-04-25T02:27:08.971 INFO:tasks.workunit.client.0.smithi114.stdout:5/444: symlink d1/d51/d6f/d81/d8a/l99 0 2024-04-25T02:27:08.972 INFO:tasks.workunit.client.0.smithi114.stdout:0/409: dread d1/d4/f15 [0,4194304] 0 2024-04-25T02:27:08.973 INFO:tasks.workunit.client.0.smithi114.stdout:7/481: readlink d5/d19/d1a/d80/l82 0 2024-04-25T02:27:08.975 INFO:tasks.workunit.client.0.smithi114.stdout:2/463: symlink d5/d1c/d21/l9c 0 2024-04-25T02:27:08.977 INFO:tasks.workunit.client.0.smithi114.stdout:6/527: dwrite de/d25/d39/d5c/f6f [0,4194304] 0 2024-04-25T02:27:08.978 INFO:tasks.workunit.client.0.smithi114.stdout:5/445: stat d1/d6/d1a/c5c 0 2024-04-25T02:27:08.979 INFO:tasks.workunit.client.0.smithi114.stdout:0/410: creat d1/d30/f78 x:0 0 0 2024-04-25T02:27:08.980 INFO:tasks.workunit.client.0.smithi114.stdout:9/428: truncate d8/d16/d21/d83/d39/f35 536415 0 2024-04-25T02:27:08.981 INFO:tasks.workunit.client.0.smithi114.stdout:0/411: chown d1/d4/d24 29721 1 2024-04-25T02:27:08.981 INFO:tasks.workunit.client.0.smithi114.stdout:7/482: symlink d5/d19/d23/d6f/la1 0 2024-04-25T02:27:08.983 INFO:tasks.workunit.client.0.smithi114.stdout:5/446: truncate d1/d6/d4f/d6c/f80 258004 0 2024-04-25T02:27:08.985 INFO:tasks.workunit.client.0.smithi114.stdout:2/464: dwrite d5/d6/d31/f32 [0,4194304] 0 2024-04-25T02:27:08.985 INFO:tasks.workunit.client.0.smithi114.stdout:5/447: chown d1/d25/f35 5145410 1 2024-04-25T02:27:08.986 INFO:tasks.workunit.client.0.smithi114.stdout:7/483: stat d5/l2d 0 2024-04-25T02:27:08.988 INFO:tasks.workunit.client.0.smithi114.stdout:1/401: dread df/d11/d25/d33/d47/f5e [0,4194304] 0 2024-04-25T02:27:08.989 INFO:tasks.workunit.client.0.smithi114.stdout:5/448: write d1/d6/de/f90 [1006703,66229] 0 2024-04-25T02:27:08.989 INFO:tasks.workunit.client.0.smithi114.stdout:6/528: dwrite de/d27/d34/d44/f55 [0,4194304] 0 2024-04-25T02:27:08.989 INFO:tasks.workunit.client.0.smithi114.stdout:4/356: getdents d3/d8/d12/d19/d26/d3e 0 2024-04-25T02:27:08.989 INFO:tasks.workunit.client.0.smithi114.stdout:7/484: chown d5/d43/l94 69 1 2024-04-25T02:27:08.989 INFO:tasks.workunit.client.0.smithi114.stdout:8/445: sync 2024-04-25T02:27:08.991 INFO:tasks.workunit.client.0.smithi114.stdout:3/372: dread d0/d25/f73 [0,4194304] 0 2024-04-25T02:27:08.993 INFO:tasks.workunit.client.0.smithi114.stdout:2/465: creat d5/d79/d8e/f9d x:0 0 0 2024-04-25T02:27:08.995 INFO:tasks.workunit.client.0.smithi114.stdout:0/412: mknod d1/d4/d37/d6a/c79 0 2024-04-25T02:27:08.998 INFO:tasks.workunit.client.0.smithi114.stdout:7/485: dwrite d5/d19/d1a/d80/f9f [0,4194304] 0 2024-04-25T02:27:08.999 INFO:tasks.workunit.client.0.smithi114.stdout:6/529: rename de/d27/d34/d44/l82 to de/d2a/lc1 0 2024-04-25T02:27:09.000 INFO:tasks.workunit.client.0.smithi114.stdout:2/466: creat d5/d1c/d22/f9e x:0 0 0 2024-04-25T02:27:09.002 INFO:tasks.workunit.client.0.smithi114.stdout:1/402: fdatasync df/f19 0 2024-04-25T02:27:09.003 INFO:tasks.workunit.client.0.smithi114.stdout:0/413: mkdir d1/d7/d46/d7a 0 2024-04-25T02:27:09.003 INFO:tasks.workunit.client.0.smithi114.stdout:0/414: chown d1/d4/da 1917224 1 2024-04-25T02:27:09.003 INFO:tasks.workunit.client.0.smithi114.stdout:5/449: mkdir d1/d51/d9a 0 2024-04-25T02:27:09.006 INFO:tasks.workunit.client.0.smithi114.stdout:4/357: mknod d3/d8/d23/d25/c6a 0 2024-04-25T02:27:09.007 INFO:tasks.workunit.client.0.smithi114.stdout:3/373: mkdir d0/d25/d2a/d80 0 2024-04-25T02:27:09.007 INFO:tasks.workunit.client.0.smithi114.stdout:1/403: dwrite df/f15 [0,4194304] 0 2024-04-25T02:27:09.008 INFO:tasks.workunit.client.0.smithi114.stdout:7/486: creat d5/d19/d1a/d80/fa2 x:0 0 0 2024-04-25T02:27:09.009 INFO:tasks.workunit.client.0.smithi114.stdout:7/487: chown d5/c4c 82698 1 2024-04-25T02:27:09.010 INFO:tasks.workunit.client.0.smithi114.stdout:6/530: unlink de/d30/f4a 0 2024-04-25T02:27:09.010 INFO:tasks.workunit.client.0.smithi114.stdout:7/488: fsync d5/d32/d64/f8d 0 2024-04-25T02:27:09.013 INFO:tasks.workunit.client.0.smithi114.stdout:7/489: write d5/d19/f34 [1476637,74739] 0 2024-04-25T02:27:09.014 INFO:tasks.workunit.client.0.smithi114.stdout:4/358: dwrite d3/d8/d23/d25/f2d [0,4194304] 0 2024-04-25T02:27:09.014 INFO:tasks.workunit.client.0.smithi114.stdout:9/429: dread d8/f17 [0,4194304] 0 2024-04-25T02:27:09.014 INFO:tasks.workunit.client.0.smithi114.stdout:4/359: stat d3/f4a 0 2024-04-25T02:27:09.015 INFO:tasks.workunit.client.0.smithi114.stdout:5/450: rmdir d1/d53/d55 39 2024-04-25T02:27:09.016 INFO:tasks.workunit.client.0.smithi114.stdout:5/451: dread - d1/d3e/d60/d82/d8f/f98 zero size 2024-04-25T02:27:09.017 INFO:tasks.workunit.client.0.smithi114.stdout:5/452: dread - d1/d6/de/d75/f84 zero size 2024-04-25T02:27:09.018 INFO:tasks.workunit.client.0.smithi114.stdout:1/404: mknod df/d13/d75/c87 0 2024-04-25T02:27:09.019 INFO:tasks.workunit.client.0.smithi114.stdout:2/467: getdents d5/df/d63/d8d 0 2024-04-25T02:27:09.019 INFO:tasks.workunit.client.0.smithi114.stdout:2/468: dread - d5/d1c/d22/d89/f93 zero size 2024-04-25T02:27:09.044 INFO:tasks.workunit.client.0.smithi114.stdout:2/469: creat d5/d79/f9f x:0 0 0 2024-04-25T02:27:09.045 INFO:tasks.workunit.client.0.smithi114.stdout:8/446: write da/d1d/f1f [987818,67250] 0 2024-04-25T02:27:09.046 INFO:tasks.workunit.client.0.smithi114.stdout:4/360: creat d3/d8/d12/d19/d42/d58/f6b x:0 0 0 2024-04-25T02:27:09.046 INFO:tasks.workunit.client.0.smithi114.stdout:7/490: truncate d5/d32/d4a/d51/f96 8283310 0 2024-04-25T02:27:09.047 INFO:tasks.workunit.client.0.smithi114.stdout:8/447: chown da/d32/c55 65544060 1 2024-04-25T02:27:09.047 INFO:tasks.workunit.client.0.smithi114.stdout:3/374: creat d0/f81 x:0 0 0 2024-04-25T02:27:09.048 INFO:tasks.workunit.client.0.smithi114.stdout:7/491: write d5/d32/d4a/d91/f73 [524253,4603] 0 2024-04-25T02:27:09.048 INFO:tasks.workunit.client.0.smithi114.stdout:3/375: truncate d0/f81 343718 0 2024-04-25T02:27:09.049 INFO:tasks.workunit.client.0.smithi114.stdout:1/405: symlink df/d11/d25/l88 0 2024-04-25T02:27:09.050 INFO:tasks.workunit.client.0.smithi114.stdout:3/376: read d0/d25/d29/f63 [4936949,21471] 0 2024-04-25T02:27:09.050 INFO:tasks.workunit.client.0.smithi114.stdout:2/470: rmdir d5/d1c 39 2024-04-25T02:27:09.051 INFO:tasks.workunit.client.0.smithi114.stdout:0/415: getdents d1/d30 0 2024-04-25T02:27:09.052 INFO:tasks.workunit.client.0.smithi114.stdout:0/416: truncate d1/d4/da/f73 345673 0 2024-04-25T02:27:09.055 INFO:tasks.workunit.client.0.smithi114.stdout:8/448: unlink da/d1e/l79 0 2024-04-25T02:27:09.055 INFO:tasks.workunit.client.0.smithi114.stdout:5/453: truncate d1/d25/d24/f27 6785768 0 2024-04-25T02:27:09.055 INFO:tasks.workunit.client.0.smithi114.stdout:5/454: stat d1/c10 0 2024-04-25T02:27:09.060 INFO:tasks.workunit.client.0.smithi114.stdout:3/377: creat d0/d25/d29/d78/f82 x:0 0 0 2024-04-25T02:27:09.061 INFO:tasks.workunit.client.0.smithi114.stdout:3/378: fdatasync d0/d25/d29/f39 0 2024-04-25T02:27:09.061 INFO:tasks.workunit.client.0.smithi114.stdout:2/471: symlink d5/d6/d58/d5a/la0 0 2024-04-25T02:27:09.062 INFO:tasks.workunit.client.0.smithi114.stdout:6/531: link de/d25/c77 de/d27/d34/d44/d91/cc2 0 2024-04-25T02:27:09.065 INFO:tasks.workunit.client.0.smithi114.stdout:8/449: mkdir da/d69/d87 0 2024-04-25T02:27:09.067 INFO:tasks.workunit.client.0.smithi114.stdout:8/450: write da/d38/d62/d6d/f7f [231883,29419] 0 2024-04-25T02:27:09.069 INFO:tasks.workunit.client.0.smithi114.stdout:7/492: dwrite d5/d32/d64/f67 [0,4194304] 0 2024-04-25T02:27:09.071 INFO:tasks.workunit.client.0.smithi114.stdout:7/493: dread - d5/d32/d64/f86 zero size 2024-04-25T02:27:09.071 INFO:tasks.workunit.client.0.smithi114.stdout:5/455: creat d1/d51/d9a/f9b x:0 0 0 2024-04-25T02:27:09.073 INFO:tasks.workunit.client.0.smithi114.stdout:1/406: link df/d11/d25/f5d df/d11/d32/f89 0 2024-04-25T02:27:09.073 INFO:tasks.workunit.client.0.smithi114.stdout:0/417: getdents d1/d30 0 2024-04-25T02:27:09.076 INFO:tasks.workunit.client.0.smithi114.stdout:4/361: getdents d3/d8/d12/d19/d42 0 2024-04-25T02:27:09.076 INFO:tasks.workunit.client.0.smithi114.stdout:4/362: readlink d3/d8/d23/d35/l48 0 2024-04-25T02:27:09.076 INFO:tasks.workunit.client.0.smithi114.stdout:7/494: stat d5/d19/d23/f3f 0 2024-04-25T02:27:09.077 INFO:tasks.workunit.client.0.smithi114.stdout:5/456: chown d1/d25/d24/c6b 2 1 2024-04-25T02:27:09.080 INFO:tasks.workunit.client.0.smithi114.stdout:1/407: symlink df/d13/d44/l8a 0 2024-04-25T02:27:09.082 INFO:tasks.workunit.client.0.smithi114.stdout:4/363: unlink d3/d14/c2e 0 2024-04-25T02:27:09.086 INFO:tasks.workunit.client.0.smithi114.stdout:5/457: creat d1/d6/de/f9c x:0 0 0 2024-04-25T02:27:09.087 INFO:tasks.workunit.client.0.smithi114.stdout:2/472: getdents d5/d6 0 2024-04-25T02:27:09.089 INFO:tasks.workunit.client.0.smithi114.stdout:8/451: getdents da/d38/d62 0 2024-04-25T02:27:09.089 INFO:tasks.workunit.client.0.smithi114.stdout:5/458: truncate d1/d53/f78 4884805 0 2024-04-25T02:27:09.090 INFO:tasks.workunit.client.0.smithi114.stdout:0/418: creat d1/d4/da/f7b x:0 0 0 2024-04-25T02:27:09.093 INFO:tasks.workunit.client.0.smithi114.stdout:1/408: getdents df 0 2024-04-25T02:27:09.094 INFO:tasks.workunit.client.0.smithi114.stdout:5/459: dread - d1/d3e/d60/d82/d8f/f98 zero size 2024-04-25T02:27:09.095 INFO:tasks.workunit.client.0.smithi114.stdout:0/419: mknod d1/d7/d68/c7c 0 2024-04-25T02:27:09.096 INFO:tasks.workunit.client.0.smithi114.stdout:6/532: dwrite de/d30/f72 [0,4194304] 0 2024-04-25T02:27:09.098 INFO:tasks.workunit.client.0.smithi114.stdout:9/430: sync 2024-04-25T02:27:09.098 INFO:tasks.workunit.client.0.smithi114.stdout:8/452: dread da/d32/d3b/d6b/f7e [0,4194304] 0 2024-04-25T02:27:09.099 INFO:tasks.workunit.client.0.smithi114.stdout:0/420: rmdir d1/d30 39 2024-04-25T02:27:09.101 INFO:tasks.workunit.client.0.smithi114.stdout:4/364: dwrite d3/d8/d23/d35/f54 [0,4194304] 0 2024-04-25T02:27:09.102 INFO:tasks.workunit.client.0.smithi114.stdout:1/409: write df/d13/f56 [386987,10615] 0 2024-04-25T02:27:09.103 INFO:tasks.workunit.client.0.smithi114.stdout:6/533: unlink de/d25/d39/d47/d90/fae 0 2024-04-25T02:27:09.103 INFO:tasks.workunit.client.0.smithi114.stdout:5/460: write d1/d6/de/f8d [220735,114429] 0 2024-04-25T02:27:09.104 INFO:tasks.workunit.client.0.smithi114.stdout:8/453: rmdir da/d38/d62 39 2024-04-25T02:27:09.107 INFO:tasks.workunit.client.0.smithi114.stdout:4/365: mkdir d3/d14/d6c 0 2024-04-25T02:27:09.107 INFO:tasks.workunit.client.0.smithi114.stdout:0/421: chown d1/d30/d4d/f4e 725408 1 2024-04-25T02:27:09.107 INFO:tasks.workunit.client.0.smithi114.stdout:6/534: dread - de/d27/d34/f89 zero size 2024-04-25T02:27:09.108 INFO:tasks.workunit.client.0.smithi114.stdout:7/495: dread d5/d32/f31 [0,4194304] 0 2024-04-25T02:27:09.109 INFO:tasks.workunit.client.0.smithi114.stdout:2/473: dwrite d5/df/f17 [0,4194304] 0 2024-04-25T02:27:09.110 INFO:tasks.workunit.client.0.smithi114.stdout:9/431: truncate d8/d16/d21/d83/d39/d38/d46/d53/f5e 561154 0 2024-04-25T02:27:09.113 INFO:tasks.workunit.client.0.smithi114.stdout:5/461: rename d1/d6/f17 to d1/d25/f9d 0 2024-04-25T02:27:09.114 INFO:tasks.workunit.client.0.smithi114.stdout:6/535: read de/d25/d39/d47/d90/d93/d99/fa9 [1812446,124739] 0 2024-04-25T02:27:09.116 INFO:tasks.workunit.client.0.smithi114.stdout:9/432: creat d8/d16/d21/d24/f9d x:0 0 0 2024-04-25T02:27:09.117 INFO:tasks.workunit.client.0.smithi114.stdout:9/433: read d8/d16/d21/d37/d60/d70/f94 [4060740,20877] 0 2024-04-25T02:27:09.118 INFO:tasks.workunit.client.0.smithi114.stdout:2/474: rename d5/df/f11 to d5/df/d2c/d66/fa1 0 2024-04-25T02:27:09.118 INFO:tasks.workunit.client.0.smithi114.stdout:5/462: mknod d1/d51/d6f/d81/c9e 0 2024-04-25T02:27:09.119 INFO:tasks.workunit.client.0.smithi114.stdout:0/422: link d1/d4/d24/c44 d1/d4/d24/c7d 0 2024-04-25T02:27:09.119 INFO:tasks.workunit.client.0.smithi114.stdout:0/423: write d1/d30/d4d/f65 [1586147,125251] 0 2024-04-25T02:27:09.121 INFO:tasks.workunit.client.0.smithi114.stdout:5/463: fdatasync d1/d6/d1a/f66 0 2024-04-25T02:27:09.124 INFO:tasks.workunit.client.0.smithi114.stdout:2/475: creat d5/df/d63/d8d/fa2 x:0 0 0 2024-04-25T02:27:09.124 INFO:tasks.workunit.client.0.smithi114.stdout:0/424: mkdir d1/d7/d18/d2e/d7e 0 2024-04-25T02:27:09.126 INFO:tasks.workunit.client.0.smithi114.stdout:6/536: rmdir de/d27/d34/d38/da5 0 2024-04-25T02:27:09.127 INFO:tasks.workunit.client.0.smithi114.stdout:6/537: fdatasync de/d30/fbb 0 2024-04-25T02:27:09.128 INFO:tasks.workunit.client.0.smithi114.stdout:4/366: write d3/d8/f1b [166358,107599] 0 2024-04-25T02:27:09.140 INFO:tasks.workunit.client.0.smithi114.stdout:3/379: sync 2024-04-25T02:27:09.142 INFO:tasks.workunit.client.0.smithi114.stdout:0/425: creat d1/d4/d4f/f7f x:0 0 0 2024-04-25T02:27:09.144 INFO:tasks.workunit.client.0.smithi114.stdout:9/434: write d8/d16/d21/d83/d39/f35 [380428,46464] 0 2024-04-25T02:27:09.144 INFO:tasks.workunit.client.0.smithi114.stdout:0/426: write d1/d7/d18/f1d [3686732,1616] 0 2024-04-25T02:27:09.145 INFO:tasks.workunit.client.0.smithi114.stdout:5/464: truncate d1/d6/f43 2707755 0 2024-04-25T02:27:09.146 INFO:tasks.workunit.client.0.smithi114.stdout:1/410: dread df/f19 [0,4194304] 0 2024-04-25T02:27:09.147 INFO:tasks.workunit.client.0.smithi114.stdout:9/435: fsync d8/d16/d21/d83/d39/f23 0 2024-04-25T02:27:09.147 INFO:tasks.workunit.client.0.smithi114.stdout:6/538: creat de/fc3 x:0 0 0 2024-04-25T02:27:09.149 INFO:tasks.workunit.client.0.smithi114.stdout:5/465: write d1/d6/de/f44 [37632,103864] 0 2024-04-25T02:27:09.149 INFO:tasks.workunit.client.0.smithi114.stdout:0/427: unlink d1/d4/d24/f2d 0 2024-04-25T02:27:09.152 INFO:tasks.workunit.client.0.smithi114.stdout:2/476: dwrite d5/d6/d58/d5a/d3e/f49 [0,4194304] 0 2024-04-25T02:27:09.154 INFO:tasks.workunit.client.0.smithi114.stdout:4/367: truncate d3/d8/d23/d35/f54 2344060 0 2024-04-25T02:27:09.157 INFO:tasks.workunit.client.0.smithi114.stdout:6/539: rmdir de/d25/d39/d47 39 2024-04-25T02:27:09.158 INFO:tasks.workunit.client.0.smithi114.stdout:0/428: dwrite d1/d30/d4d/f5b [0,4194304] 0 2024-04-25T02:27:09.160 INFO:tasks.workunit.client.0.smithi114.stdout:5/466: truncate d1/d6/de/f1e 262118 0 2024-04-25T02:27:09.162 INFO:tasks.workunit.client.0.smithi114.stdout:5/467: fsync d1/d6/d1a/f7e 0 2024-04-25T02:27:09.163 INFO:tasks.workunit.client.0.smithi114.stdout:2/477: dwrite d5/d6/d31/d6a/f88 [0,4194304] 0 2024-04-25T02:27:09.163 INFO:tasks.workunit.client.0.smithi114.stdout:9/436: rename d8/d16/d21/d83/d39/d38/d46/l4c to d8/d16/d21/d83/d39/d38/d5d/l9e 0 2024-04-25T02:27:09.165 INFO:tasks.workunit.client.0.smithi114.stdout:5/468: fdatasync d1/d6/de/f37 0 2024-04-25T02:27:09.167 INFO:tasks.workunit.client.0.smithi114.stdout:5/469: fsync d1/d6/de/f4b 0 2024-04-25T02:27:09.167 INFO:tasks.workunit.client.0.smithi114.stdout:4/368: creat d3/d8/d12/f6d x:0 0 0 2024-04-25T02:27:09.168 INFO:tasks.workunit.client.0.smithi114.stdout:6/540: dread de/d27/f4e [0,4194304] 0 2024-04-25T02:27:09.168 INFO:tasks.workunit.client.0.smithi114.stdout:0/429: dwrite d1/f27 [0,4194304] 0 2024-04-25T02:27:09.169 INFO:tasks.workunit.client.0.smithi114.stdout:2/478: dread d5/df/f45 [0,4194304] 0 2024-04-25T02:27:09.170 INFO:tasks.workunit.client.0.smithi114.stdout:1/411: link df/f15 df/d11/d32/f8b 0 2024-04-25T02:27:09.176 INFO:tasks.workunit.client.0.smithi114.stdout:2/479: dwrite d5/df/d63/f7b [4194304,4194304] 0 2024-04-25T02:27:09.177 INFO:tasks.workunit.client.0.smithi114.stdout:4/369: readlink d3/d8/d23/d25/d31/l51 0 2024-04-25T02:27:09.177 INFO:tasks.workunit.client.0.smithi114.stdout:0/430: read d1/d4/f1b [698239,102567] 0 2024-04-25T02:27:09.178 INFO:tasks.workunit.client.0.smithi114.stdout:8/454: sync 2024-04-25T02:27:09.180 INFO:tasks.workunit.client.0.smithi114.stdout:1/412: mknod df/d11/d25/d33/d47/d74/c8c 0 2024-04-25T02:27:09.188 INFO:tasks.workunit.client.0.smithi114.stdout:1/413: mknod df/d13/d44/c8d 0 2024-04-25T02:27:09.189 INFO:tasks.workunit.client.0.smithi114.stdout:9/437: creat d8/d16/d21/f9f x:0 0 0 2024-04-25T02:27:09.191 INFO:tasks.workunit.client.0.smithi114.stdout:2/480: rename d5/d6/d31/l3b to d5/df/d1e/la3 0 2024-04-25T02:27:09.193 INFO:tasks.workunit.client.0.smithi114.stdout:8/455: creat da/d38/d62/f88 x:0 0 0 2024-04-25T02:27:09.194 INFO:tasks.workunit.client.0.smithi114.stdout:1/414: mkdir df/d13/d75/d8e 0 2024-04-25T02:27:09.195 INFO:tasks.workunit.client.0.smithi114.stdout:6/541: dread de/d27/d34/d44/fb4 [0,4194304] 0 2024-04-25T02:27:09.195 INFO:tasks.workunit.client.0.smithi114.stdout:1/415: chown df/c42 45128 1 2024-04-25T02:27:09.195 INFO:tasks.workunit.client.0.smithi114.stdout:9/438: creat d8/d16/d21/d83/d39/d38/d46/d53/fa0 x:0 0 0 2024-04-25T02:27:09.198 INFO:tasks.workunit.client.0.smithi114.stdout:2/481: write d5/d1c/d29/f2b [2386583,32572] 0 2024-04-25T02:27:09.199 INFO:tasks.workunit.client.0.smithi114.stdout:0/431: rename d1/d4/f15 to d1/d7/f80 0 2024-04-25T02:27:09.201 INFO:tasks.workunit.client.0.smithi114.stdout:9/439: dread d8/d16/d21/d83/d39/d38/f80 [0,4194304] 0 2024-04-25T02:27:09.201 INFO:tasks.workunit.client.0.smithi114.stdout:9/440: dread - d8/d16/d21/d24/f47 zero size 2024-04-25T02:27:09.202 INFO:tasks.workunit.client.0.smithi114.stdout:6/542: creat de/d27/d34/d4b/fc4 x:0 0 0 2024-04-25T02:27:09.202 INFO:tasks.workunit.client.0.smithi114.stdout:6/543: dread - de/d2a/f9d zero size 2024-04-25T02:27:09.203 INFO:tasks.workunit.client.0.smithi114.stdout:9/441: dread d8/d16/d21/d83/d39/d38/f80 [0,4194304] 0 2024-04-25T02:27:09.205 INFO:tasks.workunit.client.0.smithi114.stdout:4/370: dread d3/d14/f53 [0,4194304] 0 2024-04-25T02:27:09.211 INFO:tasks.workunit.client.0.smithi114.stdout:4/371: fsync d3/d8/d12/f6d 0 2024-04-25T02:27:09.212 INFO:tasks.workunit.client.0.smithi114.stdout:9/442: unlink d8/d16/d21/f30 0 2024-04-25T02:27:09.212 INFO:tasks.workunit.client.0.smithi114.stdout:5/470: truncate d1/d53/f78 1228553 0 2024-04-25T02:27:09.213 INFO:tasks.workunit.client.0.smithi114.stdout:6/544: dread de/d27/d34/d44/f55 [4194304,4194304] 0 2024-04-25T02:27:09.213 INFO:tasks.workunit.client.0.smithi114.stdout:1/416: link df/d11/c85 df/d11/d25/d33/d47/d74/c8f 0 2024-04-25T02:27:09.216 INFO:tasks.workunit.client.0.smithi114.stdout:4/372: write d3/d8/d12/f18 [4256455,5496] 0 2024-04-25T02:27:09.217 INFO:tasks.workunit.client.0.smithi114.stdout:8/456: read - da/d38/d62/d6d/d49/f7d zero size 2024-04-25T02:27:09.218 INFO:tasks.workunit.client.0.smithi114.stdout:8/457: read da/d38/d62/d6d/d49/f4b [868502,67357] 0 2024-04-25T02:27:09.218 INFO:tasks.workunit.client.0.smithi114.stdout:5/471: unlink d1/d3e/d8e/f93 0 2024-04-25T02:27:09.219 INFO:tasks.workunit.client.0.smithi114.stdout:0/432: write d1/d7/fd [3194536,7709] 0 2024-04-25T02:27:09.219 INFO:tasks.workunit.client.0.smithi114.stdout:0/433: stat d1/d7/cb 0 2024-04-25T02:27:09.220 INFO:tasks.workunit.client.0.smithi114.stdout:6/545: unlink de/d2a/c67 0 2024-04-25T02:27:09.222 INFO:tasks.workunit.client.0.smithi114.stdout:4/373: chown d3/d8/d23/d25/d31/d33/l61 180307 1 2024-04-25T02:27:09.223 INFO:tasks.workunit.client.0.smithi114.stdout:5/472: creat d1/d6/d1a/f9f x:0 0 0 2024-04-25T02:27:09.224 INFO:tasks.workunit.client.0.smithi114.stdout:6/546: symlink de/d1c/lc5 0 2024-04-25T02:27:09.226 INFO:tasks.workunit.client.0.smithi114.stdout:0/434: fdatasync d1/d7/d18/f51 0 2024-04-25T02:27:09.226 INFO:tasks.workunit.client.0.smithi114.stdout:5/473: symlink d1/d51/d6f/d81/d8a/la0 0 2024-04-25T02:27:09.227 INFO:tasks.workunit.client.0.smithi114.stdout:0/435: read d1/d30/f32 [7782886,71874] 0 2024-04-25T02:27:09.228 INFO:tasks.workunit.client.0.smithi114.stdout:1/417: dread fc [0,4194304] 0 2024-04-25T02:27:09.229 INFO:tasks.workunit.client.0.smithi114.stdout:5/474: write d1/d25/d24/f3b [2926540,64012] 0 2024-04-25T02:27:09.229 INFO:tasks.workunit.client.0.smithi114.stdout:1/418: chown df/d2a/c4a 2 1 2024-04-25T02:27:09.230 INFO:tasks.workunit.client.0.smithi114.stdout:1/419: chown df/d11/d25/d33/d47/f6f 67609398 1 2024-04-25T02:27:09.230 INFO:tasks.workunit.client.0.smithi114.stdout:1/420: chown df/d13/d1e/l64 292234097 1 2024-04-25T02:27:09.231 INFO:tasks.workunit.client.0.smithi114.stdout:9/443: rename d8/d16/d21/d83/d39/c2d to d8/d16/d21/d83/d39/d38/ca1 0 2024-04-25T02:27:09.231 INFO:tasks.workunit.client.0.smithi114.stdout:9/444: readlink d8/d16/d21/l4b 0 2024-04-25T02:27:09.231 INFO:tasks.workunit.client.0.smithi114.stdout:3/380: sync 2024-04-25T02:27:09.231 INFO:tasks.workunit.client.0.smithi114.stdout:7/496: sync 2024-04-25T02:27:09.236 INFO:tasks.workunit.client.0.smithi114.stdout:0/436: creat d1/d4/d37/d6a/f81 x:0 0 0 2024-04-25T02:27:09.240 INFO:tasks.workunit.client.0.smithi114.stdout:1/421: unlink df/d13/d1e/f30 0 2024-04-25T02:27:09.241 INFO:tasks.workunit.client.0.smithi114.stdout:1/422: write df/d13/f60 [936986,106686] 0 2024-04-25T02:27:09.242 INFO:tasks.workunit.client.0.smithi114.stdout:7/497: symlink d5/d43/d63/d7a/la3 0 2024-04-25T02:27:09.244 INFO:tasks.workunit.client.0.smithi114.stdout:9/445: mkdir d8/d16/d21/d83/d39/d38/d46/d53/da2 0 2024-04-25T02:27:09.244 INFO:tasks.workunit.client.0.smithi114.stdout:9/446: write d8/d16/d21/d24/f9d [310044,119183] 0 2024-04-25T02:27:09.245 INFO:tasks.workunit.client.0.smithi114.stdout:5/475: fdatasync d1/d6/de/f1e 0 2024-04-25T02:27:09.245 INFO:tasks.workunit.client.0.smithi114.stdout:9/447: readlink d8/d16/d21/d83/l32 0 2024-04-25T02:27:09.255 INFO:tasks.workunit.client.0.smithi114.stdout:3/381: symlink d0/d41/d7e/l83 0 2024-04-25T02:27:09.255 INFO:tasks.workunit.client.0.smithi114.stdout:1/423: rename df/d11/d25/d33/c38 to df/d13/d44/d5a/c90 0 2024-04-25T02:27:09.256 INFO:tasks.workunit.client.0.smithi114.stdout:7/498: mkdir d5/d19/d1a/da4 0 2024-04-25T02:27:09.256 INFO:tasks.workunit.client.0.smithi114.stdout:9/448: write d8/f71 [1032284,69703] 0 2024-04-25T02:27:09.258 INFO:tasks.workunit.client.0.smithi114.stdout:3/382: truncate d0/d5/f44 5036399 0 2024-04-25T02:27:09.258 INFO:tasks.workunit.client.0.smithi114.stdout:7/499: readlink d5/d19/d23/d6f/la1 0 2024-04-25T02:27:09.259 INFO:tasks.workunit.client.0.smithi114.stdout:1/424: write df/d11/f20 [440882,106159] 0 2024-04-25T02:27:09.260 INFO:tasks.workunit.client.0.smithi114.stdout:9/449: read d8/f42 [125114,53685] 0 2024-04-25T02:27:09.261 INFO:tasks.workunit.client.0.smithi114.stdout:5/476: rename d1/d51/d6f/d81 to d1/d25/da1 0 2024-04-25T02:27:09.262 INFO:tasks.workunit.client.0.smithi114.stdout:7/500: creat d5/d8b/fa5 x:0 0 0 2024-04-25T02:27:09.264 INFO:tasks.workunit.client.0.smithi114.stdout:9/450: fdatasync d8/f42 0 2024-04-25T02:27:09.264 INFO:tasks.workunit.client.0.smithi114.stdout:6/547: dwrite de/f86 [0,4194304] 0 2024-04-25T02:27:09.267 INFO:tasks.workunit.client.0.smithi114.stdout:6/548: chown de/d1c/la6 137 1 2024-04-25T02:27:09.267 INFO:tasks.workunit.client.0.smithi114.stdout:7/501: mkdir d5/d32/da6 0 2024-04-25T02:27:09.268 INFO:tasks.workunit.client.0.smithi114.stdout:9/451: write d8/d16/d21/d24/d3c/f6b [55905,124187] 0 2024-04-25T02:27:09.270 INFO:tasks.workunit.client.0.smithi114.stdout:1/425: dwrite f4 [0,4194304] 0 2024-04-25T02:27:09.270 INFO:tasks.workunit.client.0.smithi114.stdout:3/383: link d0/c26 d0/d25/d2a/d36/c84 0 2024-04-25T02:27:09.272 INFO:tasks.workunit.client.0.smithi114.stdout:9/452: write d8/f74 [508273,79876] 0 2024-04-25T02:27:09.272 INFO:tasks.workunit.client.0.smithi114.stdout:7/502: truncate d5/d43/d4e/f9c 843935 0 2024-04-25T02:27:09.272 INFO:tasks.workunit.client.0.smithi114.stdout:6/549: dread de/d27/f3f [0,4194304] 0 2024-04-25T02:27:09.273 INFO:tasks.workunit.client.0.smithi114.stdout:2/482: sync 2024-04-25T02:27:09.274 INFO:tasks.workunit.client.0.smithi114.stdout:3/384: write d0/d25/d29/f76 [75359,23287] 0 2024-04-25T02:27:09.275 INFO:tasks.workunit.client.0.smithi114.stdout:7/503: write d5/d19/f34 [358505,114024] 0 2024-04-25T02:27:09.275 INFO:tasks.workunit.client.0.smithi114.stdout:1/426: mknod df/d13/d44/c91 0 2024-04-25T02:27:09.276 INFO:tasks.workunit.client.0.smithi114.stdout:3/385: readlink d0/d25/d29/d60/l71 0 2024-04-25T02:27:09.277 INFO:tasks.workunit.client.0.smithi114.stdout:6/550: mknod de/d25/cc6 0 2024-04-25T02:27:09.279 INFO:tasks.workunit.client.0.smithi114.stdout:2/483: chown d5/d1c/d21/c27 353 1 2024-04-25T02:27:09.280 INFO:tasks.workunit.client.0.smithi114.stdout:7/504: dread d5/d19/f1d [0,4194304] 0 2024-04-25T02:27:09.280 INFO:tasks.workunit.client.0.smithi114.stdout:1/427: mkdir df/d11/d7d/d92 0 2024-04-25T02:27:09.282 INFO:tasks.workunit.client.0.smithi114.stdout:6/551: mkdir de/d2a/db9/dc7 0 2024-04-25T02:27:09.284 INFO:tasks.workunit.client.0.smithi114.stdout:1/428: mkdir df/d13/d93 0 2024-04-25T02:27:09.284 INFO:tasks.workunit.client.0.smithi114.stdout:9/453: dwrite d8/d16/d21/d24/f47 [0,4194304] 0 2024-04-25T02:27:09.286 INFO:tasks.workunit.client.0.smithi114.stdout:7/505: mknod d5/d19/d1a/da4/ca7 0 2024-04-25T02:27:09.287 INFO:tasks.workunit.client.0.smithi114.stdout:3/386: dwrite d0/d25/f62 [0,4194304] 0 2024-04-25T02:27:09.287 INFO:tasks.workunit.client.0.smithi114.stdout:2/484: read d5/d6/fc [2099511,95251] 0 2024-04-25T02:27:09.288 INFO:tasks.workunit.client.0.smithi114.stdout:9/454: write d8/d16/d21/d24/d69/f6c [1581233,32707] 0 2024-04-25T02:27:09.288 INFO:tasks.workunit.client.0.smithi114.stdout:5/477: dread d1/d6/d4f/f6e [0,4194304] 0 2024-04-25T02:27:09.291 INFO:tasks.workunit.client.0.smithi114.stdout:2/485: write d5/d1c/d22/d67/f6c [58022,65484] 0 2024-04-25T02:27:09.292 INFO:tasks.workunit.client.0.smithi114.stdout:1/429: mknod df/d13/d1e/d3e/c94 0 2024-04-25T02:27:09.292 INFO:tasks.workunit.client.0.smithi114.stdout:2/486: write d5/d6/d31/f60 [768212,82718] 0 2024-04-25T02:27:09.293 INFO:tasks.workunit.client.0.smithi114.stdout:2/487: fdatasync d5/d1c/d29/f5c 0 2024-04-25T02:27:09.294 INFO:tasks.workunit.client.0.smithi114.stdout:2/488: fsync d5/df/d2c/f73 0 2024-04-25T02:27:09.296 INFO:tasks.workunit.client.0.smithi114.stdout:3/387: rename d0/d41 to d0/d25/d29/d85 0 2024-04-25T02:27:09.299 INFO:tasks.workunit.client.0.smithi114.stdout:9/455: unlink d8/d16/d21/d83/d39/d38/d46/c8c 0 2024-04-25T02:27:09.299 INFO:tasks.workunit.client.0.smithi114.stdout:2/489: dwrite d5/df/d1e/f25 [4194304,4194304] 0 2024-04-25T02:27:09.299 INFO:tasks.workunit.client.0.smithi114.stdout:2/490: stat d5/l10 0 2024-04-25T02:27:09.300 INFO:tasks.workunit.client.0.smithi114.stdout:4/374: sync 2024-04-25T02:27:09.301 INFO:tasks.workunit.client.0.smithi114.stdout:8/458: sync 2024-04-25T02:27:09.301 INFO:tasks.workunit.client.0.smithi114.stdout:1/430: creat df/d11/d6c/f95 x:0 0 0 2024-04-25T02:27:09.301 INFO:tasks.workunit.client.0.smithi114.stdout:2/491: dread - d5/df/d63/f75 zero size 2024-04-25T02:27:09.301 INFO:tasks.workunit.client.0.smithi114.stdout:5/478: symlink d1/d3e/la2 0 2024-04-25T02:27:09.303 INFO:tasks.workunit.client.0.smithi114.stdout:7/506: getdents d5/d19/d1a 0 2024-04-25T02:27:09.304 INFO:tasks.workunit.client.0.smithi114.stdout:3/388: symlink d0/d25/d29/d60/l86 0 2024-04-25T02:27:09.305 INFO:tasks.workunit.client.0.smithi114.stdout:4/375: mkdir d3/d8/d30/d6e 0 2024-04-25T02:27:09.308 INFO:tasks.workunit.client.0.smithi114.stdout:4/376: write d3/d14/f47 [64758,113495] 0 2024-04-25T02:27:09.308 INFO:tasks.workunit.client.0.smithi114.stdout:7/507: mknod d5/d32/d64/ca8 0 2024-04-25T02:27:09.309 INFO:tasks.workunit.client.0.smithi114.stdout:9/456: dwrite d8/d16/d21/d83/d39/f23 [0,4194304] 0 2024-04-25T02:27:09.310 INFO:tasks.workunit.client.0.smithi114.stdout:5/479: unlink d1/d6/d1a/d7f/c91 0 2024-04-25T02:27:09.311 INFO:tasks.workunit.client.0.smithi114.stdout:3/389: mknod d0/d25/d29/c87 0 2024-04-25T02:27:09.311 INFO:tasks.workunit.client.0.smithi114.stdout:7/508: readlink d5/d43/d4e/l79 0 2024-04-25T02:27:09.312 INFO:tasks.workunit.client.0.smithi114.stdout:1/431: symlink df/d11/d7d/d92/l96 0 2024-04-25T02:27:09.313 INFO:tasks.workunit.client.0.smithi114.stdout:8/459: symlink da/d38/d62/d6d/l89 0 2024-04-25T02:27:09.313 INFO:tasks.workunit.client.0.smithi114.stdout:2/492: dwrite d5/d1c/d22/d67/f6c [0,4194304] 0 2024-04-25T02:27:09.314 INFO:tasks.workunit.client.0.smithi114.stdout:4/377: write d3/d8/d23/d25/f66 [613940,27457] 0 2024-04-25T02:27:09.314 INFO:tasks.workunit.client.0.smithi114.stdout:9/457: mkdir d8/d16/d21/d37/d43/d75/da3 0 2024-04-25T02:27:09.315 INFO:tasks.workunit.client.0.smithi114.stdout:1/432: fsync df/d11/d25/d33/f53 0 2024-04-25T02:27:09.315 INFO:tasks.workunit.client.0.smithi114.stdout:9/458: stat d8/d16 0 2024-04-25T02:27:09.316 INFO:tasks.workunit.client.0.smithi114.stdout:5/480: mknod d1/d51/d6f/ca3 0 2024-04-25T02:27:09.317 INFO:tasks.workunit.client.0.smithi114.stdout:9/459: read d8/d16/d21/d24/f47 [1974174,27075] 0 2024-04-25T02:27:09.317 INFO:tasks.workunit.client.0.smithi114.stdout:5/481: chown d1/d6/de/d75/f84 34 1 2024-04-25T02:27:09.319 INFO:tasks.workunit.client.0.smithi114.stdout:3/390: rename d0/l79 to d0/d25/d29/l88 0 2024-04-25T02:27:09.321 INFO:tasks.workunit.client.0.smithi114.stdout:9/460: dread d8/f17 [0,4194304] 0 2024-04-25T02:27:09.321 INFO:tasks.workunit.client.0.smithi114.stdout:1/433: chown df/d11/d25/f26 33408 1 2024-04-25T02:27:09.322 INFO:tasks.workunit.client.0.smithi114.stdout:9/461: truncate d8/f49 450602 0 2024-04-25T02:27:09.323 INFO:tasks.workunit.client.0.smithi114.stdout:5/482: creat d1/d6/d1a/d7f/fa4 x:0 0 0 2024-04-25T02:27:09.324 INFO:tasks.workunit.client.0.smithi114.stdout:8/460: dread da/d1e/f3d [0,4194304] 0 2024-04-25T02:27:09.325 INFO:tasks.workunit.client.0.smithi114.stdout:2/493: rename d5/df/d1e/f96 to d5/d1c/d21/d91/fa4 0 2024-04-25T02:27:09.326 INFO:tasks.workunit.client.0.smithi114.stdout:3/391: creat d0/d25/d29/d78/f89 x:0 0 0 2024-04-25T02:27:09.327 INFO:tasks.workunit.client.0.smithi114.stdout:3/392: stat d0/d25/d2a/d34/f55 0 2024-04-25T02:27:09.327 INFO:tasks.workunit.client.0.smithi114.stdout:7/509: rmdir d5/d32/d7f 0 2024-04-25T02:27:09.328 INFO:tasks.workunit.client.0.smithi114.stdout:3/393: stat d0/d5/l6 0 2024-04-25T02:27:09.330 INFO:tasks.workunit.client.0.smithi114.stdout:7/510: chown d5/d19/d1a/c39 51149098 1 2024-04-25T02:27:09.330 INFO:tasks.workunit.client.0.smithi114.stdout:5/483: fsync d1/d6/d4f/f6e 0 2024-04-25T02:27:09.331 INFO:tasks.workunit.client.0.smithi114.stdout:8/461: symlink da/d32/d3b/d6b/l8a 0 2024-04-25T02:27:09.331 INFO:tasks.workunit.client.0.smithi114.stdout:2/494: dwrite d5/f15 [4194304,4194304] 0 2024-04-25T02:27:09.333 INFO:tasks.workunit.client.0.smithi114.stdout:9/462: mknod d8/d16/d21/d95/ca4 0 2024-04-25T02:27:09.333 INFO:tasks.workunit.client.0.smithi114.stdout:8/462: chown da/d1e/c2d 107791637 1 2024-04-25T02:27:09.334 INFO:tasks.workunit.client.0.smithi114.stdout:1/434: fsync df/d13/f83 0 2024-04-25T02:27:09.335 INFO:tasks.workunit.client.0.smithi114.stdout:4/378: getdents d3/d14 0 2024-04-25T02:27:09.336 INFO:tasks.workunit.client.0.smithi114.stdout:3/394: symlink d0/d25/d29/d78/l8a 0 2024-04-25T02:27:09.336 INFO:tasks.workunit.client.0.smithi114.stdout:8/463: write da/d1e/f2e [6083979,101609] 0 2024-04-25T02:27:09.340 INFO:tasks.workunit.client.0.smithi114.stdout:0/437: sync 2024-04-25T02:27:09.344 INFO:tasks.workunit.client.0.smithi114.stdout:7/511: dread d5/d19/d23/f3f [0,4194304] 0 2024-04-25T02:27:09.346 INFO:tasks.workunit.client.0.smithi114.stdout:3/395: mkdir d0/d25/d29/d60/d8b 0 2024-04-25T02:27:09.349 INFO:tasks.workunit.client.0.smithi114.stdout:5/484: dwrite d1/d6/de/f44 [0,4194304] 0 2024-04-25T02:27:09.350 INFO:tasks.workunit.client.0.smithi114.stdout:2/495: dwrite d5/d1c/d22/f9e [0,4194304] 0 2024-04-25T02:27:09.352 INFO:tasks.workunit.client.0.smithi114.stdout:0/438: unlink d1/d4/da/d33/l3f 0 2024-04-25T02:27:09.352 INFO:tasks.workunit.client.0.smithi114.stdout:7/512: chown d5/d60/f6c 19156 1 2024-04-25T02:27:09.353 INFO:tasks.workunit.client.0.smithi114.stdout:5/485: chown d1/d25/da1 358 1 2024-04-25T02:27:09.356 INFO:tasks.workunit.client.0.smithi114.stdout:8/464: creat da/d38/d62/d6d/d52/d6c/f8b x:0 0 0 2024-04-25T02:27:09.357 INFO:tasks.workunit.client.0.smithi114.stdout:0/439: stat d1/d4/d37/d42 0 2024-04-25T02:27:09.357 INFO:tasks.workunit.client.0.smithi114.stdout:9/463: dwrite d8/d16/d21/d83/d39/f23 [4194304,4194304] 0 2024-04-25T02:27:09.358 INFO:tasks.workunit.client.0.smithi114.stdout:6/552: dread de/d25/d39/d47/d90/d93/d99/fa9 [0,4194304] 0 2024-04-25T02:27:09.359 INFO:tasks.workunit.client.0.smithi114.stdout:7/513: mknod d5/d19/ca9 0 2024-04-25T02:27:09.359 INFO:tasks.workunit.client.0.smithi114.stdout:1/435: dwrite df/d11/d25/f4c [0,4194304] 0 2024-04-25T02:27:09.360 INFO:tasks.workunit.client.0.smithi114.stdout:3/396: rename d0/d25/d29/d60/d8b to d0/d25/d29/d8c 0 2024-04-25T02:27:09.362 INFO:tasks.workunit.client.0.smithi114.stdout:0/440: dread - d1/d4/d60/f61 zero size 2024-04-25T02:27:09.362 INFO:tasks.workunit.client.0.smithi114.stdout:5/486: symlink d1/d6/d4f/d6c/d88/la5 0 2024-04-25T02:27:09.363 INFO:tasks.workunit.client.0.smithi114.stdout:4/379: dwrite d3/d8/d23/d25/d31/f59 [0,4194304] 0 2024-04-25T02:27:09.364 INFO:tasks.workunit.client.0.smithi114.stdout:7/514: write d5/d19/d1a/f36 [1242707,1347] 0 2024-04-25T02:27:09.365 INFO:tasks.workunit.client.0.smithi114.stdout:5/487: fsync d1/d6/d4f/f7a 0 2024-04-25T02:27:09.367 INFO:tasks.workunit.client.0.smithi114.stdout:1/436: rmdir df/d2a 39 2024-04-25T02:27:09.368 INFO:tasks.workunit.client.0.smithi114.stdout:2/496: dwrite d5/d6/d58/d5a/d59/f78 [0,4194304] 0 2024-04-25T02:27:09.371 INFO:tasks.workunit.client.0.smithi114.stdout:8/465: rename da/l5c to da/d1d/l8c 0 2024-04-25T02:27:09.372 INFO:tasks.workunit.client.0.smithi114.stdout:3/397: mknod d0/d25/d29/d8c/c8d 0 2024-04-25T02:27:09.373 INFO:tasks.workunit.client.0.smithi114.stdout:4/380: dwrite d3/d8/d12/f6d [0,4194304] 0 2024-04-25T02:27:09.374 INFO:tasks.workunit.client.0.smithi114.stdout:7/515: chown d5/d19/c5c 693456 1 2024-04-25T02:27:09.380 INFO:tasks.workunit.client.0.smithi114.stdout:0/441: mkdir d1/d4/d4f/d77/d82 0 2024-04-25T02:27:09.380 INFO:tasks.workunit.client.0.smithi114.stdout:3/398: mknod d0/d5/c8e 0 2024-04-25T02:27:09.381 INFO:tasks.workunit.client.0.smithi114.stdout:0/442: readlink d1/d30/l53 0 2024-04-25T02:27:09.381 INFO:tasks.workunit.client.0.smithi114.stdout:0/443: readlink d1/d30/l53 0 2024-04-25T02:27:09.383 INFO:tasks.workunit.client.0.smithi114.stdout:7/516: rmdir d5/d8b 39 2024-04-25T02:27:09.383 INFO:tasks.workunit.client.0.smithi114.stdout:2/497: link d5/d1c/d22/d67/f6c d5/df/d2c/d66/fa5 0 2024-04-25T02:27:09.384 INFO:tasks.workunit.client.0.smithi114.stdout:8/466: mkdir da/d69/d87/d8d 0 2024-04-25T02:27:09.386 INFO:tasks.workunit.client.0.smithi114.stdout:8/467: chown da/d38/d62/d6d/l89 113862 1 2024-04-25T02:27:09.386 INFO:tasks.workunit.client.0.smithi114.stdout:6/553: getdents de/d25/dad 0 2024-04-25T02:27:09.388 INFO:tasks.workunit.client.0.smithi114.stdout:5/488: getdents d1/d25 0 2024-04-25T02:27:09.389 INFO:tasks.workunit.client.0.smithi114.stdout:4/381: rename d3/d8/d23/d25/c6a to d3/c6f 0 2024-04-25T02:27:09.390 INFO:tasks.workunit.client.0.smithi114.stdout:1/437: write df/d11/f28 [921320,96201] 0 2024-04-25T02:27:09.390 INFO:tasks.workunit.client.0.smithi114.stdout:6/554: fsync de/d2a/f9d 0 2024-04-25T02:27:09.391 INFO:tasks.workunit.client.0.smithi114.stdout:2/498: dwrite d5/d1c/d22/f28 [0,4194304] 0 2024-04-25T02:27:09.392 INFO:tasks.workunit.client.0.smithi114.stdout:0/444: rename d1/d7/d68/d6c to d1/d4/d62/d83 0 2024-04-25T02:27:09.392 INFO:tasks.workunit.client.0.smithi114.stdout:2/499: stat d5/df/d2c/f73 0 2024-04-25T02:27:09.393 INFO:tasks.workunit.client.0.smithi114.stdout:8/468: truncate da/d38/d62/d6d/d49/f4b 1285667 0 2024-04-25T02:27:09.394 INFO:tasks.workunit.client.0.smithi114.stdout:5/489: write d1/d6/f3c [4130644,112010] 0 2024-04-25T02:27:09.395 INFO:tasks.workunit.client.0.smithi114.stdout:4/382: creat d3/d8/d12/d19/d26/f70 x:0 0 0 2024-04-25T02:27:09.395 INFO:tasks.workunit.client.0.smithi114.stdout:8/469: truncate da/d38/d62/d6d/d52/f76 1045058 0 2024-04-25T02:27:09.396 INFO:tasks.workunit.client.0.smithi114.stdout:6/555: unlink de/d30/cb0 0 2024-04-25T02:27:09.397 INFO:tasks.workunit.client.0.smithi114.stdout:0/445: readlink d1/d4/da/l38 0 2024-04-25T02:27:09.397 INFO:tasks.workunit.client.0.smithi114.stdout:3/399: read d0/d25/d29/d60/f65 [2722460,92315] 0 2024-04-25T02:27:09.398 INFO:tasks.workunit.client.0.smithi114.stdout:2/500: symlink d5/df/d3d/d44/la6 0 2024-04-25T02:27:09.404 INFO:tasks.workunit.client.0.smithi114.stdout:5/490: unlink d1/d25/da1/c9e 0 2024-04-25T02:27:09.405 INFO:tasks.workunit.client.0.smithi114.stdout:0/446: mkdir d1/d4/d62/d83/d84 0 2024-04-25T02:27:09.406 INFO:tasks.workunit.client.0.smithi114.stdout:3/400: fdatasync d0/d25/f73 0 2024-04-25T02:27:09.406 INFO:tasks.workunit.client.0.smithi114.stdout:1/438: dread df/d2a/f46 [0,4194304] 0 2024-04-25T02:27:09.406 INFO:tasks.workunit.client.0.smithi114.stdout:2/501: creat d5/d1c/d21/fa7 x:0 0 0 2024-04-25T02:27:09.407 INFO:tasks.workunit.client.0.smithi114.stdout:6/556: mknod de/d27/cc8 0 2024-04-25T02:27:09.409 INFO:tasks.workunit.client.0.smithi114.stdout:6/557: dread - de/d27/d34/d44/fb1 zero size 2024-04-25T02:27:09.409 INFO:tasks.workunit.client.0.smithi114.stdout:4/383: rename d3/d8/d12/d19/f4d to d3/d8/f71 0 2024-04-25T02:27:09.411 INFO:tasks.workunit.client.0.smithi114.stdout:1/439: unlink l2 0 2024-04-25T02:27:09.413 INFO:tasks.workunit.client.0.smithi114.stdout:6/558: unlink de/d30/fbb 0 2024-04-25T02:27:09.414 INFO:tasks.workunit.client.0.smithi114.stdout:3/401: dwrite d0/f21 [4194304,4194304] 0 2024-04-25T02:27:09.416 INFO:tasks.workunit.client.0.smithi114.stdout:6/559: truncate de/d27/d34/d44/fb1 765152 0 2024-04-25T02:27:09.416 INFO:tasks.workunit.client.0.smithi114.stdout:9/464: sync 2024-04-25T02:27:09.417 INFO:tasks.workunit.client.0.smithi114.stdout:2/502: link d5/d6/d31/f87 d5/df/d63/fa8 0 2024-04-25T02:27:09.422 INFO:tasks.workunit.client.0.smithi114.stdout:3/402: creat d0/d25/d29/d85/f8f x:0 0 0 2024-04-25T02:27:09.423 INFO:tasks.workunit.client.0.smithi114.stdout:3/403: write d0/d5/d3d/f75 [531353,52088] 0 2024-04-25T02:27:09.427 INFO:tasks.workunit.client.0.smithi114.stdout:1/440: mkdir df/d13/d6e/d97 0 2024-04-25T02:27:09.428 INFO:tasks.workunit.client.0.smithi114.stdout:6/560: symlink de/d27/lc9 0 2024-04-25T02:27:09.430 INFO:tasks.workunit.client.0.smithi114.stdout:1/441: write df/d13/d1e/f50 [1538312,26348] 0 2024-04-25T02:27:09.431 INFO:tasks.workunit.client.0.smithi114.stdout:5/491: dread d1/d25/f63 [0,4194304] 0 2024-04-25T02:27:09.431 INFO:tasks.workunit.client.0.smithi114.stdout:1/442: chown df/d11 12 1 2024-04-25T02:27:09.432 INFO:tasks.workunit.client.0.smithi114.stdout:8/470: getdents da/d69/d87 0 2024-04-25T02:27:09.433 INFO:tasks.workunit.client.0.smithi114.stdout:6/561: truncate de/d25/d39/f51 5187101 0 2024-04-25T02:27:09.433 INFO:tasks.workunit.client.0.smithi114.stdout:9/465: dwrite d8/d16/d21/d83/d39/f62 [0,4194304] 0 2024-04-25T02:27:09.434 INFO:tasks.workunit.client.0.smithi114.stdout:8/471: dread - da/d38/f75 zero size 2024-04-25T02:27:09.434 INFO:tasks.workunit.client.0.smithi114.stdout:7/517: truncate d5/d19/d1a/f74 511008 0 2024-04-25T02:27:09.437 INFO:tasks.workunit.client.0.smithi114.stdout:6/562: read de/d30/f37 [44479,4873] 0 2024-04-25T02:27:09.438 INFO:tasks.workunit.client.0.smithi114.stdout:6/563: readlink de/l29 0 2024-04-25T02:27:09.438 INFO:tasks.workunit.client.0.smithi114.stdout:8/472: write da/d38/d62/d6d/f7f [650687,64541] 0 2024-04-25T02:27:09.439 INFO:tasks.workunit.client.0.smithi114.stdout:6/564: stat de/d27/d34/d4b/f75 0 2024-04-25T02:27:09.441 INFO:tasks.workunit.client.0.smithi114.stdout:5/492: rename d1/d6/d4f/f6e to d1/d6/de/d75/fa6 0 2024-04-25T02:27:09.443 INFO:tasks.workunit.client.0.smithi114.stdout:9/466: dwrite d8/d16/d21/d83/d39/d38/f6f [0,4194304] 0 2024-04-25T02:27:09.444 INFO:tasks.workunit.client.0.smithi114.stdout:0/447: dread d1/d4/ff [0,4194304] 0 2024-04-25T02:27:09.444 INFO:tasks.workunit.client.0.smithi114.stdout:7/518: truncate d5/d19/f1d 698186 0 2024-04-25T02:27:09.445 INFO:tasks.workunit.client.0.smithi114.stdout:3/404: dread d0/fb [0,4194304] 0 2024-04-25T02:27:09.445 INFO:tasks.workunit.client.0.smithi114.stdout:3/405: fdatasync d0/d25/d29/d85/f8f 0 2024-04-25T02:27:09.446 INFO:tasks.workunit.client.0.smithi114.stdout:8/473: creat da/d38/d62/d6d/d52/d6c/f8e x:0 0 0 2024-04-25T02:27:09.449 INFO:tasks.workunit.client.0.smithi114.stdout:5/493: chown d1/d6/d1a/f64 4693 1 2024-04-25T02:27:09.454 INFO:tasks.workunit.client.0.smithi114.stdout:8/474: dwrite da/d38/d62/d6d/d52/f76 [0,4194304] 0 2024-04-25T02:27:09.457 INFO:tasks.workunit.client.0.smithi114.stdout:5/494: dwrite d1/d6/de/f4a [0,4194304] 0 2024-04-25T02:27:09.459 INFO:tasks.workunit.client.0.smithi114.stdout:3/406: dread d0/f19 [0,4194304] 0 2024-04-25T02:27:09.459 INFO:tasks.workunit.client.0.smithi114.stdout:5/495: write d1/d25/f35 [2631770,46402] 0 2024-04-25T02:27:09.459 INFO:tasks.workunit.client.0.smithi114.stdout:4/384: truncate d3/d14/f37 3010105 0 2024-04-25T02:27:09.460 INFO:tasks.workunit.client.0.smithi114.stdout:3/407: chown d0/d25/d29/d78/l7a 3911407 1 2024-04-25T02:27:09.460 INFO:tasks.workunit.client.0.smithi114.stdout:9/467: truncate d8/d16/d21/f41 3871750 0 2024-04-25T02:27:09.465 INFO:tasks.workunit.client.0.smithi114.stdout:8/475: chown c2 48 1 2024-04-25T02:27:09.469 INFO:tasks.workunit.client.0.smithi114.stdout:6/565: rename de/d27/d34/f8a to de/d25/dad/fca 0 2024-04-25T02:27:09.470 INFO:tasks.workunit.client.0.smithi114.stdout:8/476: dwrite da/d1e/f2e [0,4194304] 0 2024-04-25T02:27:09.470 INFO:tasks.workunit.client.0.smithi114.stdout:6/566: dread - de/d25/fbc zero size 2024-04-25T02:27:09.472 INFO:tasks.workunit.client.0.smithi114.stdout:5/496: mkdir d1/d6/de/da7 0 2024-04-25T02:27:09.473 INFO:tasks.workunit.client.0.smithi114.stdout:1/443: write df/d11/d32/f89 [302369,15180] 0 2024-04-25T02:27:09.474 INFO:tasks.workunit.client.0.smithi114.stdout:4/385: unlink d3/d8/f71 0 2024-04-25T02:27:09.475 INFO:tasks.workunit.client.0.smithi114.stdout:4/386: rename d3/d8/d23/d25/d31 to d3/d8/d23/d25/d31/d72 22 2024-04-25T02:27:09.476 INFO:tasks.workunit.client.0.smithi114.stdout:3/408: unlink d0/d25/d29/d78/f89 0 2024-04-25T02:27:09.477 INFO:tasks.workunit.client.0.smithi114.stdout:3/409: read - d0/d25/d29/d78/f82 zero size 2024-04-25T02:27:09.480 INFO:tasks.workunit.client.0.smithi114.stdout:7/519: dread d5/d19/d1a/f74 [0,4194304] 0 2024-04-25T02:27:09.480 INFO:tasks.workunit.client.0.smithi114.stdout:7/520: dread - d5/fa0 zero size 2024-04-25T02:27:09.481 INFO:tasks.workunit.client.0.smithi114.stdout:0/448: symlink d1/d4/d24/d52/l85 0 2024-04-25T02:27:09.481 INFO:tasks.workunit.client.0.smithi114.stdout:7/521: read d5/d19/f2b [189663,8329] 0 2024-04-25T02:27:09.486 INFO:tasks.workunit.client.0.smithi114.stdout:5/497: mkdir d1/d25/da1/d8a/da8 0 2024-04-25T02:27:09.486 INFO:tasks.workunit.client.0.smithi114.stdout:5/498: fdatasync d1/d25/f1f 0 2024-04-25T02:27:09.488 INFO:tasks.workunit.client.0.smithi114.stdout:4/387: mknod d3/d8/d12/d19/d42/c73 0 2024-04-25T02:27:09.493 INFO:tasks.workunit.client.0.smithi114.stdout:0/449: readlink d1/d4/da/l74 0 2024-04-25T02:27:09.496 INFO:tasks.workunit.client.0.smithi114.stdout:7/522: rename d5/d43/d4e/l93 to d5/d32/d4a/d91/laa 0 2024-04-25T02:27:09.497 INFO:tasks.workunit.client.0.smithi114.stdout:7/523: write d5/d19/d1a/d80/fa2 [821208,105633] 0 2024-04-25T02:27:09.499 INFO:tasks.workunit.client.0.smithi114.stdout:1/444: write df/d11/d25/f27 [3436172,60052] 0 2024-04-25T02:27:09.500 INFO:tasks.workunit.client.0.smithi114.stdout:1/445: stat df/d2a/c4a 0 2024-04-25T02:27:09.503 INFO:tasks.workunit.client.0.smithi114.stdout:4/388: fdatasync d3/d14/f68 0 2024-04-25T02:27:09.504 INFO:tasks.workunit.client.0.smithi114.stdout:4/389: stat d3/d14/l45 0 2024-04-25T02:27:09.507 INFO:tasks.workunit.client.0.smithi114.stdout:7/524: symlink d5/d32/d4a/lab 0 2024-04-25T02:27:09.508 INFO:tasks.workunit.client.0.smithi114.stdout:6/567: dwrite de/f59 [0,4194304] 0 2024-04-25T02:27:09.509 INFO:tasks.workunit.client.0.smithi114.stdout:7/525: read d5/f18 [2901295,56367] 0 2024-04-25T02:27:09.511 INFO:tasks.workunit.client.0.smithi114.stdout:6/568: read de/d25/d39/f7b [3520511,63981] 0 2024-04-25T02:27:09.515 INFO:tasks.workunit.client.0.smithi114.stdout:5/499: write d1/d6/d1a/f64 [372235,11883] 0 2024-04-25T02:27:09.516 INFO:tasks.workunit.client.0.smithi114.stdout:5/500: write d1/d25/d24/f32 [3640456,108092] 0 2024-04-25T02:27:09.516 INFO:tasks.workunit.client.0.smithi114.stdout:3/410: write d0/d5/f43 [1233268,110340] 0 2024-04-25T02:27:09.517 INFO:tasks.workunit.client.0.smithi114.stdout:3/411: chown d0/d25/d29/f63 624401357 1 2024-04-25T02:27:09.519 INFO:tasks.workunit.client.0.smithi114.stdout:9/468: link d8/d16/d21/d83/d39/d38/d5d/c9a d8/d16/d21/d37/d60/ca5 0 2024-04-25T02:27:09.521 INFO:tasks.workunit.client.0.smithi114.stdout:4/390: dread - d3/d8/d30/f44 zero size 2024-04-25T02:27:09.522 INFO:tasks.workunit.client.0.smithi114.stdout:1/446: mkdir df/d13/d75/d8e/d98 0 2024-04-25T02:27:09.523 INFO:tasks.workunit.client.0.smithi114.stdout:5/501: dwrite d1/d6/d4f/f52 [0,4194304] 0 2024-04-25T02:27:09.523 INFO:tasks.workunit.client.0.smithi114.stdout:1/447: dread - df/d2a/d34/f84 zero size 2024-04-25T02:27:09.524 INFO:tasks.workunit.client.0.smithi114.stdout:0/450: creat d1/d4/f86 x:0 0 0 2024-04-25T02:27:09.525 INFO:tasks.workunit.client.0.smithi114.stdout:2/503: sync 2024-04-25T02:27:09.526 INFO:tasks.workunit.client.0.smithi114.stdout:0/451: write d1/d7/d18/f3b [3768334,88708] 0 2024-04-25T02:27:09.526 INFO:tasks.workunit.client.0.smithi114.stdout:2/504: readlink d5/d1c/l23 0 2024-04-25T02:27:09.527 INFO:tasks.workunit.client.0.smithi114.stdout:9/469: write d8/d16/d21/f22 [4168224,10826] 0 2024-04-25T02:27:09.527 INFO:tasks.workunit.client.0.smithi114.stdout:2/505: write d5/df/d1e/f6d [942864,124558] 0 2024-04-25T02:27:09.528 INFO:tasks.workunit.client.0.smithi114.stdout:9/470: stat d8/d16/d21/d37/d60 0 2024-04-25T02:27:09.528 INFO:tasks.workunit.client.0.smithi114.stdout:2/506: chown d5/df/l19 186067 1 2024-04-25T02:27:09.529 INFO:tasks.workunit.client.0.smithi114.stdout:2/507: fdatasync d5/d1c/d29/f5c 0 2024-04-25T02:27:09.534 INFO:tasks.workunit.client.0.smithi114.stdout:9/471: dwrite d8/d16/d21/d83/f5f [4194304,4194304] 0 2024-04-25T02:27:09.535 INFO:tasks.workunit.client.0.smithi114.stdout:1/448: symlink df/d13/d6e/l99 0 2024-04-25T02:27:09.535 INFO:tasks.workunit.client.0.smithi114.stdout:5/502: stat d1/c46 0 2024-04-25T02:27:09.538 INFO:tasks.workunit.client.0.smithi114.stdout:5/503: write d1/d6/d1a/d7f/f89 [830339,61099] 0 2024-04-25T02:27:09.539 INFO:tasks.workunit.client.0.smithi114.stdout:6/569: getdents de/d2a 0 2024-04-25T02:27:09.539 INFO:tasks.workunit.client.0.smithi114.stdout:2/508: creat d5/df/fa9 x:0 0 0 2024-04-25T02:27:09.541 INFO:tasks.workunit.client.0.smithi114.stdout:2/509: write d5/df/f8c [794706,120917] 0 2024-04-25T02:27:09.542 INFO:tasks.workunit.client.0.smithi114.stdout:2/510: truncate d5/df/f8c 1203090 0 2024-04-25T02:27:09.543 INFO:tasks.workunit.client.0.smithi114.stdout:6/570: mknod de/d25/d39/d47/d90/ccb 0 2024-04-25T02:27:09.545 INFO:tasks.workunit.client.0.smithi114.stdout:6/571: stat de/d27/f8f 0 2024-04-25T02:27:09.545 INFO:tasks.workunit.client.0.smithi114.stdout:9/472: rename d8/d16/d21/d83/d39/d38/d46/c93 to d8/d16/d21/d83/d39/d38/ca6 0 2024-04-25T02:27:09.546 INFO:tasks.workunit.client.0.smithi114.stdout:2/511: mknod d5/d6/d58/d5a/d3e/caa 0 2024-04-25T02:27:09.546 INFO:tasks.workunit.client.0.smithi114.stdout:1/449: link df/c42 df/d13/c9a 0 2024-04-25T02:27:09.549 INFO:tasks.workunit.client.0.smithi114.stdout:9/473: unlink d8/d16/d21/f22 0 2024-04-25T02:27:09.550 INFO:tasks.workunit.client.0.smithi114.stdout:8/477: sync 2024-04-25T02:27:09.550 INFO:tasks.workunit.client.0.smithi114.stdout:5/504: dwrite d1/d6/d4f/d6c/f80 [0,4194304] 0 2024-04-25T02:27:09.555 INFO:tasks.workunit.client.0.smithi114.stdout:2/512: rename d5/d6/d31/f87 to d5/d6/fab 0 2024-04-25T02:27:09.555 INFO:tasks.workunit.client.0.smithi114.stdout:3/412: dread d0/d25/f5f [0,4194304] 0 2024-04-25T02:27:09.555 INFO:tasks.workunit.client.0.smithi114.stdout:5/505: symlink d1/d6/d4f/d6c/la9 0 2024-04-25T02:27:09.558 INFO:tasks.workunit.client.0.smithi114.stdout:8/478: link da/d1e/f2e da/d1e/f8f 0 2024-04-25T02:27:09.558 INFO:tasks.workunit.client.0.smithi114.stdout:6/572: dwrite de/d25/d39/d47/f5d [0,4194304] 0 2024-04-25T02:27:09.558 INFO:tasks.workunit.client.0.smithi114.stdout:3/413: chown d0/d25/d29/d60/c70 188956 1 2024-04-25T02:27:09.559 INFO:tasks.workunit.client.0.smithi114.stdout:5/506: mkdir d1/d25/da1/daa 0 2024-04-25T02:27:09.560 INFO:tasks.workunit.client.0.smithi114.stdout:1/450: dwrite df/d11/d32/f89 [0,4194304] 0 2024-04-25T02:27:09.563 INFO:tasks.workunit.client.0.smithi114.stdout:8/479: write da/d1d/f3f [3678020,48664] 0 2024-04-25T02:27:09.564 INFO:tasks.workunit.client.0.smithi114.stdout:2/513: dread d5/df/d63/f7b [4194304,4194304] 0 2024-04-25T02:27:09.568 INFO:tasks.workunit.client.0.smithi114.stdout:1/451: getdents df/d2a/d34/d77 0 2024-04-25T02:27:09.569 INFO:tasks.workunit.client.0.smithi114.stdout:5/507: dwrite d1/d6/d4f/f52 [0,4194304] 0 2024-04-25T02:27:09.570 INFO:tasks.workunit.client.0.smithi114.stdout:2/514: symlink d5/lac 0 2024-04-25T02:27:09.571 INFO:tasks.workunit.client.0.smithi114.stdout:2/515: chown d5/df/d63 1903873524 1 2024-04-25T02:27:09.572 INFO:tasks.workunit.client.0.smithi114.stdout:3/414: creat d0/d25/d2a/d80/f90 x:0 0 0 2024-04-25T02:27:09.573 INFO:tasks.workunit.client.0.smithi114.stdout:6/573: getdents de/d25 0 2024-04-25T02:27:09.576 INFO:tasks.workunit.client.0.smithi114.stdout:1/452: dwrite df/d2a/f2e [0,4194304] 0 2024-04-25T02:27:09.578 INFO:tasks.workunit.client.0.smithi114.stdout:1/453: truncate df/d11/d32/f7c 801648 0 2024-04-25T02:27:09.578 INFO:tasks.workunit.client.0.smithi114.stdout:6/574: creat de/d27/d34/d44/fcc x:0 0 0 2024-04-25T02:27:09.581 INFO:tasks.workunit.client.0.smithi114.stdout:1/454: mkdir df/d13/d44/d9b 0 2024-04-25T02:27:09.583 INFO:tasks.workunit.client.0.smithi114.stdout:3/415: getdents d0/d25/d2a/d36 0 2024-04-25T02:27:09.584 INFO:tasks.workunit.client.0.smithi114.stdout:0/452: dread d1/d30/f32 [0,4194304] 0 2024-04-25T02:27:09.584 INFO:tasks.workunit.client.0.smithi114.stdout:6/575: dread de/d27/d34/d44/fb4 [4194304,4194304] 0 2024-04-25T02:27:09.585 INFO:tasks.workunit.client.0.smithi114.stdout:7/526: dwrite d5/d32/d4a/d51/f95 [0,4194304] 0 2024-04-25T02:27:09.586 INFO:tasks.workunit.client.0.smithi114.stdout:4/391: truncate d3/d8/d12/d19/f1a 3421277 0 2024-04-25T02:27:09.589 INFO:tasks.workunit.client.0.smithi114.stdout:0/453: rename d1/d4/d37/f71 to d1/d7/d46/f87 0 2024-04-25T02:27:09.591 INFO:tasks.workunit.client.0.smithi114.stdout:7/527: dread d5/d19/d23/f3f [0,4194304] 0 2024-04-25T02:27:09.592 INFO:tasks.workunit.client.0.smithi114.stdout:7/528: dread - d5/d60/f6a zero size 2024-04-25T02:27:09.592 INFO:tasks.workunit.client.0.smithi114.stdout:0/454: unlink d1/d4/f49 0 2024-04-25T02:27:09.593 INFO:tasks.workunit.client.0.smithi114.stdout:4/392: dwrite d3/d8/d12/d19/d26/f70 [0,4194304] 0 2024-04-25T02:27:09.594 INFO:tasks.workunit.client.0.smithi114.stdout:7/529: write d5/d43/f5a [186641,130529] 0 2024-04-25T02:27:09.594 INFO:tasks.workunit.client.0.smithi114.stdout:7/530: chown d5/d19/d1a/f74 48 1 2024-04-25T02:27:09.597 INFO:tasks.workunit.client.0.smithi114.stdout:0/455: read d1/d4/f63 [1364694,22495] 0 2024-04-25T02:27:09.597 INFO:tasks.workunit.client.0.smithi114.stdout:7/531: creat d5/d32/d64/fac x:0 0 0 2024-04-25T02:27:09.598 INFO:tasks.workunit.client.0.smithi114.stdout:7/532: fsync d5/d43/d4e/f4f 0 2024-04-25T02:27:09.599 INFO:tasks.workunit.client.0.smithi114.stdout:4/393: unlink d3/d8/d23/d25/d31/d33/l4b 0 2024-04-25T02:27:09.601 INFO:tasks.workunit.client.0.smithi114.stdout:0/456: mknod d1/d4/d62/c88 0 2024-04-25T02:27:09.604 INFO:tasks.workunit.client.0.smithi114.stdout:4/394: creat d3/d8/d12/d19/f74 x:0 0 0 2024-04-25T02:27:09.605 INFO:tasks.workunit.client.0.smithi114.stdout:0/457: creat d1/d7/d18/d2e/d7e/f89 x:0 0 0 2024-04-25T02:27:09.605 INFO:tasks.workunit.client.0.smithi114.stdout:4/395: fdatasync d3/d8/d23/d25/f27 0 2024-04-25T02:27:09.624 INFO:tasks.workunit.client.0.smithi114.stdout:9/474: truncate d8/d16/d21/d83/d39/f35 111343 0 2024-04-25T02:27:09.628 INFO:tasks.workunit.client.0.smithi114.stdout:9/475: write d8/d16/d21/d24/d3c/f6b [282475,97679] 0 2024-04-25T02:27:09.628 INFO:tasks.workunit.client.0.smithi114.stdout:5/508: dread d1/d25/f9d [0,4194304] 0 2024-04-25T02:27:09.632 INFO:tasks.workunit.client.0.smithi114.stdout:7/533: rmdir d5/d32 39 2024-04-25T02:27:09.634 INFO:tasks.workunit.client.0.smithi114.stdout:5/509: rmdir d1/d3e/d60 39 2024-04-25T02:27:09.635 INFO:tasks.workunit.client.0.smithi114.stdout:8/480: dwrite da/d32/d3b/d40/f45 [0,4194304] 0 2024-04-25T02:27:09.637 INFO:tasks.workunit.client.0.smithi114.stdout:2/516: dwrite d5/df/d1e/f26 [0,4194304] 0 2024-04-25T02:27:09.637 INFO:tasks.workunit.client.0.smithi114.stdout:1/455: dwrite df/d2a/f46 [0,4194304] 0 2024-04-25T02:27:09.639 INFO:tasks.workunit.client.0.smithi114.stdout:7/534: chown d5/d32/d4a/d87 0 1 2024-04-25T02:27:09.641 INFO:tasks.workunit.client.0.smithi114.stdout:3/416: dwrite d0/d5/f17 [0,4194304] 0 2024-04-25T02:27:09.641 INFO:tasks.workunit.client.0.smithi114.stdout:9/476: unlink d8/d16/d21/d83/d66/l7a 0 2024-04-25T02:27:09.641 INFO:tasks.workunit.client.0.smithi114.stdout:6/576: sync 2024-04-25T02:27:09.641 INFO:tasks.workunit.client.0.smithi114.stdout:0/458: sync 2024-04-25T02:27:09.641 INFO:tasks.workunit.client.0.smithi114.stdout:7/535: chown d5/d43/d63/d7a/la3 213035119 1 2024-04-25T02:27:09.643 INFO:tasks.workunit.client.0.smithi114.stdout:8/481: mkdir da/d69/d90 0 2024-04-25T02:27:09.644 INFO:tasks.workunit.client.0.smithi114.stdout:5/510: write d1/d6/d1a/f57 [300404,71684] 0 2024-04-25T02:27:09.645 INFO:tasks.workunit.client.0.smithi114.stdout:4/396: dwrite d3/d8/d12/d19/d26/f34 [0,4194304] 0 2024-04-25T02:27:09.645 INFO:tasks.workunit.client.0.smithi114.stdout:6/577: dread - de/d25/d39/d47/d90/d93/d99/faa zero size 2024-04-25T02:27:09.647 INFO:tasks.workunit.client.0.smithi114.stdout:4/397: dread - d3/d14/f5a zero size 2024-04-25T02:27:09.648 INFO:tasks.workunit.client.0.smithi114.stdout:3/417: rename d0/d5/c10 to d0/d25/d2a/d36/c91 0 2024-04-25T02:27:09.649 INFO:tasks.workunit.client.0.smithi114.stdout:4/398: read - d3/d8/d12/d19/f74 zero size 2024-04-25T02:27:09.649 INFO:tasks.workunit.client.0.smithi114.stdout:5/511: stat d1/d25/c96 0 2024-04-25T02:27:09.650 INFO:tasks.workunit.client.0.smithi114.stdout:8/482: creat da/d1e/d58/f91 x:0 0 0 2024-04-25T02:27:09.650 INFO:tasks.workunit.client.0.smithi114.stdout:6/578: rmdir de/d27/d34 39 2024-04-25T02:27:09.651 INFO:tasks.workunit.client.0.smithi114.stdout:6/579: chown de/d27 10 1 2024-04-25T02:27:09.651 INFO:tasks.workunit.client.0.smithi114.stdout:1/456: unlink df/d11/d25/c39 0 2024-04-25T02:27:09.653 INFO:tasks.workunit.client.0.smithi114.stdout:1/457: readlink df/d13/l1a 0 2024-04-25T02:27:09.654 INFO:tasks.workunit.client.0.smithi114.stdout:8/483: creat da/d1d/f92 x:0 0 0 2024-04-25T02:27:09.654 INFO:tasks.workunit.client.0.smithi114.stdout:9/477: dwrite d8/fb [0,4194304] 0 2024-04-25T02:27:09.655 INFO:tasks.workunit.client.0.smithi114.stdout:0/459: creat d1/d4/f8a x:0 0 0 2024-04-25T02:27:09.656 INFO:tasks.workunit.client.0.smithi114.stdout:5/512: read d1/d53/f78 [790449,33214] 0 2024-04-25T02:27:09.656 INFO:tasks.workunit.client.0.smithi114.stdout:5/513: chown d1 13353 1 2024-04-25T02:27:09.657 INFO:tasks.workunit.client.0.smithi114.stdout:5/514: write d1/d6/d1a/f7e [841935,73204] 0 2024-04-25T02:27:09.658 INFO:tasks.workunit.client.0.smithi114.stdout:6/580: write de/d25/d39/f7b [5012668,48805] 0 2024-04-25T02:27:09.659 INFO:tasks.workunit.client.0.smithi114.stdout:3/418: mknod d0/d25/c92 0 2024-04-25T02:27:09.663 INFO:tasks.workunit.client.0.smithi114.stdout:8/484: rename da/d32/d3b to da/d69/d93 0 2024-04-25T02:27:09.664 INFO:tasks.workunit.client.0.smithi114.stdout:9/478: symlink d8/d16/d21/d37/d60/d70/la7 0 2024-04-25T02:27:09.666 INFO:tasks.workunit.client.0.smithi114.stdout:4/399: creat d3/d8/d12/d19/d26/d3e/d62/f75 x:0 0 0 2024-04-25T02:27:09.666 INFO:tasks.workunit.client.0.smithi114.stdout:5/515: symlink d1/d25/da1/d8a/lab 0 2024-04-25T02:27:09.667 INFO:tasks.workunit.client.0.smithi114.stdout:5/516: chown d1/d25/f63 192195920 1 2024-04-25T02:27:09.667 INFO:tasks.workunit.client.0.smithi114.stdout:3/419: creat d0/d25/d29/d85/d7e/f93 x:0 0 0 2024-04-25T02:27:09.669 INFO:tasks.workunit.client.0.smithi114.stdout:8/485: fdatasync da/d38/d62/d6d/f2c 0 2024-04-25T02:27:09.670 INFO:tasks.workunit.client.0.smithi114.stdout:9/479: mkdir d8/da8 0 2024-04-25T02:27:09.672 INFO:tasks.workunit.client.0.smithi114.stdout:3/420: rename d0/d25/d29/f76 to d0/d25/d29/f94 0 2024-04-25T02:27:09.673 INFO:tasks.workunit.client.0.smithi114.stdout:9/480: write d8/f17 [1318438,50203] 0 2024-04-25T02:27:09.675 INFO:tasks.workunit.client.0.smithi114.stdout:6/581: link cb de/d2a/db9/ccd 0 2024-04-25T02:27:09.679 INFO:tasks.workunit.client.0.smithi114.stdout:3/421: link d0/d25/d29/d78/l8a d0/d25/d2a/d34/l95 0 2024-04-25T02:27:09.682 INFO:tasks.workunit.client.0.smithi114.stdout:3/422: rename d0/d5/f31 to d0/d25/d29/d85/d7e/f96 0 2024-04-25T02:27:09.691 INFO:tasks.workunit.client.0.smithi114.stdout:2/517: sync 2024-04-25T02:27:09.691 INFO:tasks.workunit.client.0.smithi114.stdout:7/536: truncate d5/d19/d23/f4d 1622239 0 2024-04-25T02:27:09.692 INFO:tasks.workunit.client.0.smithi114.stdout:7/537: write d5/fa0 [837983,16264] 0 2024-04-25T02:27:09.692 INFO:tasks.workunit.client.0.smithi114.stdout:8/486: getdents da/d69 0 2024-04-25T02:27:09.693 INFO:tasks.workunit.client.0.smithi114.stdout:2/518: readlink d5/d1c/d22/d67/l71 0 2024-04-25T02:27:09.693 INFO:tasks.workunit.client.0.smithi114.stdout:7/538: dread - d5/d19/d23/f61 zero size 2024-04-25T02:27:09.697 INFO:tasks.workunit.client.0.smithi114.stdout:3/423: dread d0/d25/d29/d85/f50 [0,4194304] 0 2024-04-25T02:27:09.697 INFO:tasks.workunit.client.0.smithi114.stdout:1/458: write df/f19 [1206272,100136] 0 2024-04-25T02:27:09.698 INFO:tasks.workunit.client.0.smithi114.stdout:7/539: read d5/f33 [105539,54837] 0 2024-04-25T02:27:09.698 INFO:tasks.workunit.client.0.smithi114.stdout:1/459: stat df/d13/d6e/d97 0 2024-04-25T02:27:09.699 INFO:tasks.workunit.client.0.smithi114.stdout:0/460: write d1/f10 [1408797,15752] 0 2024-04-25T02:27:09.700 INFO:tasks.workunit.client.0.smithi114.stdout:0/461: chown d1/d7/d18/d2e/c66 13473802 1 2024-04-25T02:27:09.700 INFO:tasks.workunit.client.0.smithi114.stdout:2/519: mkdir d5/d6/d58/d5a/d59/dad 0 2024-04-25T02:27:09.701 INFO:tasks.workunit.client.0.smithi114.stdout:3/424: creat d0/d25/d29/d85/d7e/f97 x:0 0 0 2024-04-25T02:27:09.702 INFO:tasks.workunit.client.0.smithi114.stdout:7/540: symlink d5/d32/lad 0 2024-04-25T02:27:09.703 INFO:tasks.workunit.client.0.smithi114.stdout:9/481: write d8/f42 [1114274,62500] 0 2024-04-25T02:27:09.706 INFO:tasks.workunit.client.0.smithi114.stdout:1/460: dwrite df/d2a/d34/f63 [0,4194304] 0 2024-04-25T02:27:09.707 INFO:tasks.workunit.client.0.smithi114.stdout:3/425: mknod d0/d25/d29/d78/c98 0 2024-04-25T02:27:09.709 INFO:tasks.workunit.client.0.smithi114.stdout:7/541: write d5/d19/d23/f3c [2112049,18869] 0 2024-04-25T02:27:09.710 INFO:tasks.workunit.client.0.smithi114.stdout:3/426: truncate d0/d5/d3d/f54 1131278 0 2024-04-25T02:27:09.711 INFO:tasks.workunit.client.0.smithi114.stdout:9/482: unlink d8/d16/d21/d37/c97 0 2024-04-25T02:27:09.713 INFO:tasks.workunit.client.0.smithi114.stdout:8/487: write da/d1e/f8f [4765586,10984] 0 2024-04-25T02:27:09.715 INFO:tasks.workunit.client.0.smithi114.stdout:4/400: dwrite d3/d8/d23/d25/d31/f59 [0,4194304] 0 2024-04-25T02:27:09.715 INFO:tasks.workunit.client.0.smithi114.stdout:1/461: readlink df/d13/d1e/l7e 0 2024-04-25T02:27:09.717 INFO:tasks.workunit.client.0.smithi114.stdout:5/517: sync 2024-04-25T02:27:09.718 INFO:tasks.workunit.client.0.smithi114.stdout:3/427: unlink d0/d25/d29/d85/d7e/f96 0 2024-04-25T02:27:09.719 INFO:tasks.workunit.client.0.smithi114.stdout:9/483: dwrite d8/d16/d21/d83/f86 [0,4194304] 0 2024-04-25T02:27:09.721 INFO:tasks.workunit.client.0.smithi114.stdout:8/488: rename da/c53 to da/d32/c94 0 2024-04-25T02:27:09.723 INFO:tasks.workunit.client.0.smithi114.stdout:2/520: truncate d5/f15 3155604 0 2024-04-25T02:27:09.723 INFO:tasks.workunit.client.0.smithi114.stdout:1/462: dread - df/d11/d25/d43/f54 zero size 2024-04-25T02:27:09.724 INFO:tasks.workunit.client.0.smithi114.stdout:0/462: dwrite d1/d4/f63 [4194304,4194304] 0 2024-04-25T02:27:09.726 INFO:tasks.workunit.client.0.smithi114.stdout:4/401: symlink d3/d8/d12/d19/d26/d3e/d62/l76 0 2024-04-25T02:27:09.727 INFO:tasks.workunit.client.0.smithi114.stdout:0/463: dread - d1/d7/d18/d2e/d7e/f89 zero size 2024-04-25T02:27:09.729 INFO:tasks.workunit.client.0.smithi114.stdout:4/402: write d3/d8/d23/d25/d31/f59 [3121610,23415] 0 2024-04-25T02:27:09.729 INFO:tasks.workunit.client.0.smithi114.stdout:3/428: rmdir d0/d25/d29/d85/d7e 39 2024-04-25T02:27:09.730 INFO:tasks.workunit.client.0.smithi114.stdout:8/489: dwrite da/d38/d62/d6d/f51 [0,4194304] 0 2024-04-25T02:27:09.732 INFO:tasks.workunit.client.0.smithi114.stdout:9/484: chown d8/d16/d21/d83/d39/d38/ca6 7 1 2024-04-25T02:27:09.732 INFO:tasks.workunit.client.0.smithi114.stdout:3/429: write d0/d25/f73 [2649802,35526] 0 2024-04-25T02:27:09.735 INFO:tasks.workunit.client.0.smithi114.stdout:9/485: readlink d8/d16/d21/d83/d39/l54 0 2024-04-25T02:27:09.736 INFO:tasks.workunit.client.0.smithi114.stdout:7/542: mkdir d5/d8b/d99/dae 0 2024-04-25T02:27:09.738 INFO:tasks.workunit.client.0.smithi114.stdout:1/463: creat df/d13/d75/f9c x:0 0 0 2024-04-25T02:27:09.739 INFO:tasks.workunit.client.0.smithi114.stdout:0/464: dwrite d1/d4/f19 [0,4194304] 0 2024-04-25T02:27:09.739 INFO:tasks.workunit.client.0.smithi114.stdout:4/403: dwrite d3/f4a [0,4194304] 0 2024-04-25T02:27:09.741 INFO:tasks.workunit.client.0.smithi114.stdout:6/582: sync 2024-04-25T02:27:09.743 INFO:tasks.workunit.client.0.smithi114.stdout:2/521: mknod d5/cae 0 2024-04-25T02:27:09.744 INFO:tasks.workunit.client.0.smithi114.stdout:8/490: dread da/d1e/f2e [4194304,4194304] 0 2024-04-25T02:27:09.744 INFO:tasks.workunit.client.0.smithi114.stdout:9/486: creat d8/d16/d21/d83/d39/d38/d46/d53/fa9 x:0 0 0 2024-04-25T02:27:09.745 INFO:tasks.workunit.client.0.smithi114.stdout:1/464: mkdir df/d11/d25/d33/d47/d9d 0 2024-04-25T02:27:09.749 INFO:tasks.workunit.client.0.smithi114.stdout:4/404: rename d3/d8/d23/d35/c5c to d3/d8/d12/d19/d26/d3e/d62/c77 0 2024-04-25T02:27:09.749 INFO:tasks.workunit.client.0.smithi114.stdout:7/543: dwrite d5/d32/d64/f86 [0,4194304] 0 2024-04-25T02:27:09.752 INFO:tasks.workunit.client.0.smithi114.stdout:4/405: write d3/d8/d23/d25/f2d [1165790,125255] 0 2024-04-25T02:27:09.752 INFO:tasks.workunit.client.0.smithi114.stdout:0/465: dwrite d1/d4/da/f2a [0,4194304] 0 2024-04-25T02:27:09.753 INFO:tasks.workunit.client.0.smithi114.stdout:2/522: write d5/d1c/d21/d91/fa4 [1391210,124024] 0 2024-04-25T02:27:09.753 INFO:tasks.workunit.client.0.smithi114.stdout:6/583: unlink de/d27/d34/d38/f70 0 2024-04-25T02:27:09.754 INFO:tasks.workunit.client.0.smithi114.stdout:0/466: fsync d1/d7/d18/f22 0 2024-04-25T02:27:09.755 INFO:tasks.workunit.client.0.smithi114.stdout:4/406: read - d3/d8/d12/d19/d26/d3e/d62/f75 zero size 2024-04-25T02:27:09.755 INFO:tasks.workunit.client.0.smithi114.stdout:2/523: chown d5/d79/d8e/c90 3222 1 2024-04-25T02:27:09.756 INFO:tasks.workunit.client.0.smithi114.stdout:7/544: mkdir d5/d19/d1a/daf 0 2024-04-25T02:27:09.758 INFO:tasks.workunit.client.0.smithi114.stdout:8/491: symlink da/d38/d62/d6d/d49/d65/l95 0 2024-04-25T02:27:09.760 INFO:tasks.workunit.client.0.smithi114.stdout:6/584: symlink de/d25/d39/d47/d90/d93/d99/lce 0 2024-04-25T02:27:09.764 INFO:tasks.workunit.client.0.smithi114.stdout:8/492: rename da/d1e/f2e to da/d1e/f96 0 2024-04-25T02:27:09.764 INFO:tasks.workunit.client.0.smithi114.stdout:7/545: dwrite d5/d43/d4e/f4f [0,4194304] 0 2024-04-25T02:27:09.766 INFO:tasks.workunit.client.0.smithi114.stdout:7/546: write d5/d32/d4a/d51/f96 [900315,53180] 0 2024-04-25T02:27:09.767 INFO:tasks.workunit.client.0.smithi114.stdout:0/467: rename d1/d7/cb to d1/d4/da/d3e/c8b 0 2024-04-25T02:27:09.768 INFO:tasks.workunit.client.0.smithi114.stdout:1/465: dread df/d11/d25/d33/d47/f5e [0,4194304] 0 2024-04-25T02:27:09.770 INFO:tasks.workunit.client.0.smithi114.stdout:7/547: symlink d5/d43/d63/d7a/lb0 0 2024-04-25T02:27:09.771 INFO:tasks.workunit.client.0.smithi114.stdout:6/585: rename de/d25/d39/d5c/la8 to de/d2a/db9/lcf 0 2024-04-25T02:27:09.773 INFO:tasks.workunit.client.0.smithi114.stdout:1/466: write df/d11/f24 [6810274,126588] 0 2024-04-25T02:27:09.774 INFO:tasks.workunit.client.0.smithi114.stdout:1/467: dread - df/d11/d25/d43/f7a zero size 2024-04-25T02:27:09.774 INFO:tasks.workunit.client.0.smithi114.stdout:6/586: rmdir de/d25/d39/d47/d90 39 2024-04-25T02:27:09.777 INFO:tasks.workunit.client.0.smithi114.stdout:1/468: creat df/d11/d25/d33/d47/f9e x:0 0 0 2024-04-25T02:27:09.777 INFO:tasks.workunit.client.0.smithi114.stdout:6/587: rmdir de/d25/d39/d47/d90 39 2024-04-25T02:27:09.778 INFO:tasks.workunit.client.0.smithi114.stdout:6/588: creat de/d27/d76/fd0 x:0 0 0 2024-04-25T02:27:09.780 INFO:tasks.workunit.client.0.smithi114.stdout:1/469: link df/d11/d25/d33/d47/f6f df/d11/d7d/f9f 0 2024-04-25T02:27:09.781 INFO:tasks.workunit.client.0.smithi114.stdout:6/589: rmdir de/d27/d34 39 2024-04-25T02:27:09.783 INFO:tasks.workunit.client.0.smithi114.stdout:0/468: read d1/d7/fd [2868155,113189] 0 2024-04-25T02:27:09.784 INFO:tasks.workunit.client.0.smithi114.stdout:0/469: chown d1/d4/d24/f47 693719599 1 2024-04-25T02:27:09.785 INFO:tasks.workunit.client.0.smithi114.stdout:0/470: dread - d1/d30/f78 zero size 2024-04-25T02:27:09.785 INFO:tasks.workunit.client.0.smithi114.stdout:6/590: creat de/d25/d39/fd1 x:0 0 0 2024-04-25T02:27:09.787 INFO:tasks.workunit.client.0.smithi114.stdout:6/591: mknod de/d27/d34/d44/da7/cd2 0 2024-04-25T02:27:09.789 INFO:tasks.workunit.client.0.smithi114.stdout:3/430: dread d0/d25/d2a/d34/f72 [0,4194304] 0 2024-04-25T02:27:09.790 INFO:tasks.workunit.client.0.smithi114.stdout:7/548: dread d5/d43/d63/f84 [0,4194304] 0 2024-04-25T02:27:09.802 INFO:tasks.workunit.client.0.smithi114.stdout:7/549: rename d5/d19/d1a/f74 to d5/d32/d64/fb1 0 2024-04-25T02:27:09.804 INFO:tasks.workunit.client.0.smithi114.stdout:3/431: dwrite d0/d5/d3d/f54 [0,4194304] 0 2024-04-25T02:27:09.804 INFO:tasks.workunit.client.0.smithi114.stdout:5/518: write d1/d6/f31 [2168650,1718] 0 2024-04-25T02:27:09.806 INFO:tasks.workunit.client.0.smithi114.stdout:5/519: read - d1/d6/d1a/d7f/fa4 zero size 2024-04-25T02:27:09.807 INFO:tasks.workunit.client.0.smithi114.stdout:3/432: symlink d0/d5/l99 0 2024-04-25T02:27:09.809 INFO:tasks.workunit.client.0.smithi114.stdout:7/550: dwrite d5/f9 [0,4194304] 0 2024-04-25T02:27:09.810 INFO:tasks.workunit.client.0.smithi114.stdout:5/520: creat d1/d3e/d60/fac x:0 0 0 2024-04-25T02:27:09.811 INFO:tasks.workunit.client.0.smithi114.stdout:7/551: write d5/d19/d1a/f36 [1529602,37643] 0 2024-04-25T02:27:09.812 INFO:tasks.workunit.client.0.smithi114.stdout:5/521: write d1/d25/d24/f61 [623854,121294] 0 2024-04-25T02:27:09.816 INFO:tasks.workunit.client.0.smithi114.stdout:2/524: sync 2024-04-25T02:27:09.817 INFO:tasks.workunit.client.0.smithi114.stdout:3/433: rename d0/d25/d29/d78/l8a to d0/l9a 0 2024-04-25T02:27:09.817 INFO:tasks.workunit.client.0.smithi114.stdout:5/522: dwrite d1/d6/de/f9c [0,4194304] 0 2024-04-25T02:27:09.818 INFO:tasks.workunit.client.0.smithi114.stdout:3/434: write d0/d25/f62 [4106356,1493] 0 2024-04-25T02:27:09.819 INFO:tasks.workunit.client.0.smithi114.stdout:9/487: write d8/d16/f27 [4706948,10679] 0 2024-04-25T02:27:09.821 INFO:tasks.workunit.client.0.smithi114.stdout:9/488: fsync d8/d16/d21/d83/d39/d38/d46/d53/fa9 0 2024-04-25T02:27:09.822 INFO:tasks.workunit.client.0.smithi114.stdout:7/552: rename d5/d32/d64/f8d to d5/d19/d1a/fb2 0 2024-04-25T02:27:09.823 INFO:tasks.workunit.client.0.smithi114.stdout:7/553: fdatasync d5/d43/d4e/f4f 0 2024-04-25T02:27:09.824 INFO:tasks.workunit.client.0.smithi114.stdout:5/523: symlink d1/d6/d4f/lad 0 2024-04-25T02:27:09.826 INFO:tasks.workunit.client.0.smithi114.stdout:2/525: dread d5/d6/d31/f60 [0,4194304] 0 2024-04-25T02:27:09.829 INFO:tasks.workunit.client.0.smithi114.stdout:2/526: read d5/d6/d31/d6a/f88 [668131,54425] 0 2024-04-25T02:27:09.829 INFO:tasks.workunit.client.0.smithi114.stdout:4/407: write d3/d8/d12/d19/d26/f2a [667405,8940] 0 2024-04-25T02:27:09.830 INFO:tasks.workunit.client.0.smithi114.stdout:7/554: mkdir d5/d19/d1a/da4/db3 0 2024-04-25T02:27:09.830 INFO:tasks.workunit.client.0.smithi114.stdout:7/555: fdatasync d5/d43/d63/d7a/f9d 0 2024-04-25T02:27:09.832 INFO:tasks.workunit.client.0.smithi114.stdout:7/556: write d5/d19/d1a/f36 [135200,83186] 0 2024-04-25T02:27:09.838 INFO:tasks.workunit.client.0.smithi114.stdout:5/524: mkdir d1/d53/d55/dae 0 2024-04-25T02:27:09.838 INFO:tasks.workunit.client.0.smithi114.stdout:8/493: dwrite da/d38/d62/d6d/f2c [0,4194304] 0 2024-04-25T02:27:09.840 INFO:tasks.workunit.client.0.smithi114.stdout:7/557: dwrite d5/f65 [0,4194304] 0 2024-04-25T02:27:09.840 INFO:tasks.workunit.client.0.smithi114.stdout:3/435: link d0/d25/d2a/d34/f7d d0/d25/d2a/f9b 0 2024-04-25T02:27:09.842 INFO:tasks.workunit.client.0.smithi114.stdout:2/527: mkdir d5/daf 0 2024-04-25T02:27:09.842 INFO:tasks.workunit.client.0.smithi114.stdout:4/408: mknod d3/d8/d23/d25/c78 0 2024-04-25T02:27:09.843 INFO:tasks.workunit.client.0.smithi114.stdout:4/409: read - d3/d8/d30/d4c/f69 zero size 2024-04-25T02:27:09.845 INFO:tasks.workunit.client.0.smithi114.stdout:4/410: stat d3/d8/d23/d25/d31/l5d 0 2024-04-25T02:27:09.848 INFO:tasks.workunit.client.0.smithi114.stdout:3/436: creat d0/d25/d29/d8c/f9c x:0 0 0 2024-04-25T02:27:09.849 INFO:tasks.workunit.client.0.smithi114.stdout:0/471: sync 2024-04-25T02:27:09.850 INFO:tasks.workunit.client.0.smithi114.stdout:7/558: creat d5/d32/d4a/d87/fb4 x:0 0 0 2024-04-25T02:27:09.851 INFO:tasks.workunit.client.0.smithi114.stdout:6/592: write de/d30/f43 [3755472,81322] 0 2024-04-25T02:27:09.852 INFO:tasks.workunit.client.0.smithi114.stdout:2/528: dwrite d5/fd [4194304,4194304] 0 2024-04-25T02:27:09.854 INFO:tasks.workunit.client.0.smithi114.stdout:1/470: dwrite df/d11/d25/d43/f54 [0,4194304] 0 2024-04-25T02:27:09.854 INFO:tasks.workunit.client.0.smithi114.stdout:6/593: read - de/d2a/fbe zero size 2024-04-25T02:27:09.854 INFO:tasks.workunit.client.0.smithi114.stdout:4/411: write d3/d8/f2c [7334167,27074] 0 2024-04-25T02:27:09.856 INFO:tasks.workunit.client.0.smithi114.stdout:3/437: rename d0/d5/c33 to d0/d25/d2a/d80/c9d 0 2024-04-25T02:27:09.859 INFO:tasks.workunit.client.0.smithi114.stdout:7/559: unlink d5/d19/d23/f8e 0 2024-04-25T02:27:09.859 INFO:tasks.workunit.client.0.smithi114.stdout:4/412: truncate d3/d14/f47 692833 0 2024-04-25T02:27:09.860 INFO:tasks.workunit.client.0.smithi114.stdout:7/560: readlink d5/d32/d4a/l66 0 2024-04-25T02:27:09.860 INFO:tasks.workunit.client.0.smithi114.stdout:2/529: mkdir d5/d1c/d21/db0 0 2024-04-25T02:27:09.865 INFO:tasks.workunit.client.0.smithi114.stdout:1/471: mknod df/d11/d7d/d92/ca0 0 2024-04-25T02:27:09.865 INFO:tasks.workunit.client.0.smithi114.stdout:7/561: dwrite d5/d43/f5a [0,4194304] 0 2024-04-25T02:27:09.868 INFO:tasks.workunit.client.0.smithi114.stdout:3/438: mkdir d0/d25/d2a/d34/d9e 0 2024-04-25T02:27:09.870 INFO:tasks.workunit.client.0.smithi114.stdout:4/413: rename d3/d8/d30/f44 to d3/d8/d23/d25/d4e/f79 0 2024-04-25T02:27:09.870 INFO:tasks.workunit.client.0.smithi114.stdout:8/494: dread da/d32/f39 [0,4194304] 0 2024-04-25T02:27:09.871 INFO:tasks.workunit.client.0.smithi114.stdout:2/530: mknod d5/d1c/d22/cb1 0 2024-04-25T02:27:09.872 INFO:tasks.workunit.client.0.smithi114.stdout:2/531: chown d5/df/d2c/f82 495728 1 2024-04-25T02:27:09.875 INFO:tasks.workunit.client.0.smithi114.stdout:9/489: sync 2024-04-25T02:27:09.875 INFO:tasks.workunit.client.0.smithi114.stdout:8/495: read da/d38/f5b [1455562,122941] 0 2024-04-25T02:27:09.876 INFO:tasks.workunit.client.0.smithi114.stdout:8/496: fsync da/d1d/f92 0 2024-04-25T02:27:09.878 INFO:tasks.workunit.client.0.smithi114.stdout:7/562: mkdir d5/d32/da6/db5 0 2024-04-25T02:27:09.879 INFO:tasks.workunit.client.0.smithi114.stdout:2/532: mkdir d5/d1c/d22/d67/db2 0 2024-04-25T02:27:09.879 INFO:tasks.workunit.client.0.smithi114.stdout:7/563: chown d5/d43/d63/d7a 2541810 1 2024-04-25T02:27:09.881 INFO:tasks.workunit.client.0.smithi114.stdout:1/472: creat df/d11/d25/d33/d47/d9d/fa1 x:0 0 0 2024-04-25T02:27:09.881 INFO:tasks.workunit.client.0.smithi114.stdout:9/490: creat d8/d16/d21/d24/d69/faa x:0 0 0 2024-04-25T02:27:09.883 INFO:tasks.workunit.client.0.smithi114.stdout:3/439: dwrite d0/d25/d29/d85/d7e/f97 [0,4194304] 0 2024-04-25T02:27:09.883 INFO:tasks.workunit.client.0.smithi114.stdout:1/473: dread - df/d11/d7d/f9f zero size 2024-04-25T02:27:09.886 INFO:tasks.workunit.client.0.smithi114.stdout:1/474: fsync df/d11/d25/f26 0 2024-04-25T02:27:09.886 INFO:tasks.workunit.client.0.smithi114.stdout:2/533: unlink d5/d6/d58/d5a/d59/f78 0 2024-04-25T02:27:09.889 INFO:tasks.workunit.client.0.smithi114.stdout:7/564: dwrite d5/d43/d4e/f4f [0,4194304] 0 2024-04-25T02:27:09.890 INFO:tasks.workunit.client.0.smithi114.stdout:3/440: unlink d0/d25/d2a/l6f 0 2024-04-25T02:27:09.891 INFO:tasks.workunit.client.0.smithi114.stdout:5/525: dread d1/d3e/f77 [0,4194304] 0 2024-04-25T02:27:09.892 INFO:tasks.workunit.client.0.smithi114.stdout:2/534: mkdir d5/df/d2c/d66/db3 0 2024-04-25T02:27:09.894 INFO:tasks.workunit.client.0.smithi114.stdout:0/472: dread d1/d4/da/f16 [0,4194304] 0 2024-04-25T02:27:09.895 INFO:tasks.workunit.client.0.smithi114.stdout:0/473: dread - d1/d4/d60/f61 zero size 2024-04-25T02:27:09.895 INFO:tasks.workunit.client.0.smithi114.stdout:5/526: mkdir d1/d3e/d60/daf 0 2024-04-25T02:27:09.897 INFO:tasks.workunit.client.0.smithi114.stdout:9/491: getdents d8/d16/d21/d83 0 2024-04-25T02:27:09.898 INFO:tasks.workunit.client.0.smithi114.stdout:2/535: dread d5/df/d3d/d44/f8f [0,4194304] 0 2024-04-25T02:27:09.899 INFO:tasks.workunit.client.0.smithi114.stdout:9/492: chown d8/d16/d21/d83/d39/d38/ca1 5488 1 2024-04-25T02:27:09.899 INFO:tasks.workunit.client.0.smithi114.stdout:1/475: rename df/d11/d25/d33/d81 to df/d13/d1e/da2 0 2024-04-25T02:27:09.900 INFO:tasks.workunit.client.0.smithi114.stdout:5/527: mknod d1/d51/d6f/cb0 0 2024-04-25T02:27:09.900 INFO:tasks.workunit.client.0.smithi114.stdout:9/493: fsync d8/d16/d21/d83/d39/d38/d46/d53/fa0 0 2024-04-25T02:27:09.901 INFO:tasks.workunit.client.0.smithi114.stdout:1/476: chown fa 40668 1 2024-04-25T02:27:09.904 INFO:tasks.workunit.client.0.smithi114.stdout:7/565: rename d5/d32/d4a/f56 to d5/d32/d4a/d87/fb6 0 2024-04-25T02:27:09.904 INFO:tasks.workunit.client.0.smithi114.stdout:7/566: fsync d5/d19/d23/f3c 0 2024-04-25T02:27:09.905 INFO:tasks.workunit.client.0.smithi114.stdout:6/594: dread de/d25/d39/f7b [0,4194304] 0 2024-04-25T02:27:09.906 INFO:tasks.workunit.client.0.smithi114.stdout:0/474: link d1/d7/f80 d1/d4/d62/d83/f8c 0 2024-04-25T02:27:09.906 INFO:tasks.workunit.client.0.smithi114.stdout:6/595: read de/d25/d39/f5f [4079889,57841] 0 2024-04-25T02:27:09.907 INFO:tasks.workunit.client.0.smithi114.stdout:8/497: dread da/d38/d62/d6d/f7f [0,4194304] 0 2024-04-25T02:27:09.908 INFO:tasks.workunit.client.0.smithi114.stdout:9/494: mkdir d8/d16/d21/d83/d39/dab 0 2024-04-25T02:27:09.908 INFO:tasks.workunit.client.0.smithi114.stdout:3/441: link d0/d5/c52 d0/c9f 0 2024-04-25T02:27:09.909 INFO:tasks.workunit.client.0.smithi114.stdout:9/495: write d8/d16/d21/d83/f7c [678193,96589] 0 2024-04-25T02:27:09.910 INFO:tasks.workunit.client.0.smithi114.stdout:9/496: write d8/f42 [1294012,45973] 0 2024-04-25T02:27:09.911 INFO:tasks.workunit.client.0.smithi114.stdout:2/536: symlink d5/d6/d58/d5a/d3e/d54/lb4 0 2024-04-25T02:27:09.913 INFO:tasks.workunit.client.0.smithi114.stdout:7/567: mkdir d5/d32/d4a/d91/db7 0 2024-04-25T02:27:09.916 INFO:tasks.workunit.client.0.smithi114.stdout:9/497: dwrite d8/f42 [0,4194304] 0 2024-04-25T02:27:09.917 INFO:tasks.workunit.client.0.smithi114.stdout:9/498: write d8/d16/d21/d37/f3e [2151982,69460] 0 2024-04-25T02:27:09.917 INFO:tasks.workunit.client.0.smithi114.stdout:0/475: creat d1/d7/d68/f8d x:0 0 0 2024-04-25T02:27:09.918 INFO:tasks.workunit.client.0.smithi114.stdout:0/476: chown d1/d4/d24/d52 21810626 1 2024-04-25T02:27:09.921 INFO:tasks.workunit.client.0.smithi114.stdout:1/477: creat df/d11/d6c/d82/fa3 x:0 0 0 2024-04-25T02:27:09.921 INFO:tasks.workunit.client.0.smithi114.stdout:9/499: dread d8/d16/d21/d83/d39/d38/f84 [0,4194304] 0 2024-04-25T02:27:09.922 INFO:tasks.workunit.client.0.smithi114.stdout:9/500: truncate d8/d16/d21/d83/d39/d38/d46/d53/fa0 289433 0 2024-04-25T02:27:09.924 INFO:tasks.workunit.client.0.smithi114.stdout:2/537: mknod d5/df/d1e/cb5 0 2024-04-25T02:27:09.926 INFO:tasks.workunit.client.0.smithi114.stdout:7/568: creat d5/d43/d63/d7a/fb8 x:0 0 0 2024-04-25T02:27:09.927 INFO:tasks.workunit.client.0.smithi114.stdout:8/498: mknod da/c97 0 2024-04-25T02:27:09.927 INFO:tasks.workunit.client.0.smithi114.stdout:3/442: dread d0/f4b [0,4194304] 0 2024-04-25T02:27:09.929 INFO:tasks.workunit.client.0.smithi114.stdout:6/596: symlink de/d25/d39/d47/d90/d93/ld3 0 2024-04-25T02:27:09.933 INFO:tasks.workunit.client.0.smithi114.stdout:8/499: mknod da/d1e/c98 0 2024-04-25T02:27:09.933 INFO:tasks.workunit.client.0.smithi114.stdout:9/501: dread d8/f74 [0,4194304] 0 2024-04-25T02:27:09.934 INFO:tasks.workunit.client.0.smithi114.stdout:4/414: dwrite d3/f28 [0,4194304] 0 2024-04-25T02:27:09.935 INFO:tasks.workunit.client.0.smithi114.stdout:7/569: dwrite d5/d32/d4a/d51/f6b [0,4194304] 0 2024-04-25T02:27:09.937 INFO:tasks.workunit.client.0.smithi114.stdout:0/477: link d1/d7/d68/f8d d1/d30/f8e 0 2024-04-25T02:27:09.938 INFO:tasks.workunit.client.0.smithi114.stdout:3/443: mkdir d0/d25/da0 0 2024-04-25T02:27:09.939 INFO:tasks.workunit.client.0.smithi114.stdout:7/570: read d5/f9 [2747073,51200] 0 2024-04-25T02:27:09.940 INFO:tasks.workunit.client.0.smithi114.stdout:4/415: unlink d3/f4a 0 2024-04-25T02:27:09.940 INFO:tasks.workunit.client.0.smithi114.stdout:7/571: dread - d5/d8b/fa5 zero size 2024-04-25T02:27:09.941 INFO:tasks.workunit.client.0.smithi114.stdout:8/500: creat da/d38/d62/d6d/d49/f99 x:0 0 0 2024-04-25T02:27:09.943 INFO:tasks.workunit.client.0.smithi114.stdout:3/444: dread d0/f4b [0,4194304] 0 2024-04-25T02:27:09.943 INFO:tasks.workunit.client.0.smithi114.stdout:3/445: stat d0/d5/l99 0 2024-04-25T02:27:09.947 INFO:tasks.workunit.client.0.smithi114.stdout:9/502: mknod d8/d16/d21/d83/d39/d38/cac 0 2024-04-25T02:27:09.948 INFO:tasks.workunit.client.0.smithi114.stdout:9/503: chown d8/d16/d21/d37/d43/d75/da3 19050 1 2024-04-25T02:27:09.949 INFO:tasks.workunit.client.0.smithi114.stdout:8/501: chown da/d38/d62/d6d/d49/f4b 820 1 2024-04-25T02:27:09.949 INFO:tasks.workunit.client.0.smithi114.stdout:9/504: write d8/d16/d21/d24/d3c/d40/f99 [1519551,123741] 0 2024-04-25T02:27:09.952 INFO:tasks.workunit.client.0.smithi114.stdout:6/597: rename de/d27/d34/d44/f55 to de/fd4 0 2024-04-25T02:27:09.953 INFO:tasks.workunit.client.0.smithi114.stdout:7/572: mkdir d5/d32/da6/db5/db9 0 2024-04-25T02:27:09.954 INFO:tasks.workunit.client.0.smithi114.stdout:6/598: stat de/d27/d34/f7a 0 2024-04-25T02:27:09.955 INFO:tasks.workunit.client.0.smithi114.stdout:8/502: creat da/d38/d62/d6d/d52/d6c/f9a x:0 0 0 2024-04-25T02:27:09.958 INFO:tasks.workunit.client.0.smithi114.stdout:0/478: rename d1/d4/d60 to d1/d7/d18/d2e/d8f 0 2024-04-25T02:27:09.963 INFO:tasks.workunit.client.0.smithi114.stdout:9/505: read d8/d16/d21/d24/f47 [2941204,21635] 0 2024-04-25T02:27:09.963 INFO:tasks.workunit.client.0.smithi114.stdout:5/528: dwrite d1/d53/f78 [0,4194304] 0 2024-04-25T02:27:09.963 INFO:tasks.workunit.client.0.smithi114.stdout:2/538: dread d5/df/f17 [0,4194304] 0 2024-04-25T02:27:09.963 INFO:tasks.workunit.client.0.smithi114.stdout:3/446: dwrite d0/d25/d29/d85/f50 [4194304,4194304] 0 2024-04-25T02:27:09.964 INFO:tasks.workunit.client.0.smithi114.stdout:5/529: write d1/d53/f59 [38137,81386] 0 2024-04-25T02:27:09.964 INFO:tasks.workunit.client.0.smithi114.stdout:7/573: mknod d5/d32/d4a/d91/db7/cba 0 2024-04-25T02:27:09.965 INFO:tasks.workunit.client.0.smithi114.stdout:0/479: write d1/d7/d18/d2e/d7e/f89 [960007,37259] 0 2024-04-25T02:27:09.965 INFO:tasks.workunit.client.0.smithi114.stdout:9/506: truncate d8/d16/d21/f26 4855491 0 2024-04-25T02:27:09.965 INFO:tasks.workunit.client.0.smithi114.stdout:8/503: symlink da/d69/d93/d40/l9b 0 2024-04-25T02:27:09.966 INFO:tasks.workunit.client.0.smithi114.stdout:0/480: stat d1/d7/d18/l1e 0 2024-04-25T02:27:09.967 INFO:tasks.workunit.client.0.smithi114.stdout:8/504: chown da/d38/d62/d6d/l89 76929 1 2024-04-25T02:27:09.967 INFO:tasks.workunit.client.0.smithi114.stdout:8/505: read - da/d38/f75 zero size 2024-04-25T02:27:09.968 INFO:tasks.workunit.client.0.smithi114.stdout:0/481: read d1/d4/d4f/f57 [8141,90385] 0 2024-04-25T02:27:09.969 INFO:tasks.workunit.client.0.smithi114.stdout:8/506: fdatasync da/d1e/f4e 0 2024-04-25T02:27:09.969 INFO:tasks.workunit.client.0.smithi114.stdout:6/599: rename de/d27/d34/d44/da7 to de/d2a/dd5 0 2024-04-25T02:27:09.973 INFO:tasks.workunit.client.0.smithi114.stdout:5/530: chown d1/d53/f7c 6672608 1 2024-04-25T02:27:09.974 INFO:tasks.workunit.client.0.smithi114.stdout:5/531: write d1/d25/f1f [902253,107024] 0 2024-04-25T02:27:09.974 INFO:tasks.workunit.client.0.smithi114.stdout:7/574: rmdir d5/d32/d4a/d87 39 2024-04-25T02:27:09.975 INFO:tasks.workunit.client.0.smithi114.stdout:5/532: readlink d1/d25/da1/d8a/l99 0 2024-04-25T02:27:09.975 INFO:tasks.workunit.client.0.smithi114.stdout:7/575: chown d5/c4c 0 1 2024-04-25T02:27:09.979 INFO:tasks.workunit.client.0.smithi114.stdout:6/600: creat de/d2a/db9/fd6 x:0 0 0 2024-04-25T02:27:09.979 INFO:tasks.workunit.client.0.smithi114.stdout:6/601: chown de/d25/d39/c6e 13 1 2024-04-25T02:27:09.986 INFO:tasks.workunit.client.0.smithi114.stdout:0/482: rename d1/d4/d24/c44 to d1/d7/d46/c90 0 2024-04-25T02:27:09.987 INFO:tasks.workunit.client.0.smithi114.stdout:3/447: creat d0/d25/fa1 x:0 0 0 2024-04-25T02:27:09.987 INFO:tasks.workunit.client.0.smithi114.stdout:0/483: write d1/d4/f86 [405510,72573] 0 2024-04-25T02:27:09.991 INFO:tasks.workunit.client.0.smithi114.stdout:8/507: rename da/d1e/c2d to da/d1d/c9c 0 2024-04-25T02:27:09.991 INFO:tasks.workunit.client.0.smithi114.stdout:1/478: sync 2024-04-25T02:27:09.992 INFO:tasks.workunit.client.0.smithi114.stdout:3/448: dwrite d0/fa [0,4194304] 0 2024-04-25T02:27:09.993 INFO:tasks.workunit.client.0.smithi114.stdout:8/508: read - da/d38/d62/d6d/d52/d6c/f9a zero size 2024-04-25T02:27:09.995 INFO:tasks.workunit.client.0.smithi114.stdout:0/484: write d1/d30/d4d/f4e [2773619,100906] 0 2024-04-25T02:27:09.995 INFO:tasks.workunit.client.0.smithi114.stdout:5/533: getdents d1/d25 0 2024-04-25T02:27:09.997 INFO:tasks.workunit.client.0.smithi114.stdout:3/449: unlink d0/d25/d29/d85/f8f 0 2024-04-25T02:27:09.997 INFO:tasks.workunit.client.0.smithi114.stdout:2/539: dread d5/df/d1e/f38 [4194304,4194304] 0 2024-04-25T02:27:09.998 INFO:tasks.workunit.client.0.smithi114.stdout:9/507: truncate d8/d16/d21/d83/d39/f62 906569 0 2024-04-25T02:27:10.000 INFO:tasks.workunit.client.0.smithi114.stdout:2/540: truncate d5/df/d63/d8d/fa2 793444 0 2024-04-25T02:27:10.003 INFO:tasks.workunit.client.0.smithi114.stdout:7/576: truncate d5/d19/f34 205392 0 2024-04-25T02:27:10.004 INFO:tasks.workunit.client.0.smithi114.stdout:0/485: creat d1/d4/da/d33/f91 x:0 0 0 2024-04-25T02:27:10.007 INFO:tasks.workunit.client.0.smithi114.stdout:3/450: dwrite d0/d25/f32 [0,4194304] 0 2024-04-25T02:27:10.008 INFO:tasks.workunit.client.0.smithi114.stdout:8/509: dwrite da/d32/f39 [0,4194304] 0 2024-04-25T02:27:10.008 INFO:tasks.workunit.client.0.smithi114.stdout:2/541: write d5/df/d3d/f6f [683301,50820] 0 2024-04-25T02:27:10.009 INFO:tasks.workunit.client.0.smithi114.stdout:0/486: write d1/d7/fd [112834,72517] 0 2024-04-25T02:27:10.010 INFO:tasks.workunit.client.0.smithi114.stdout:3/451: stat d0/d25/d29/d8c/c8d 0 2024-04-25T02:27:10.010 INFO:tasks.workunit.client.0.smithi114.stdout:8/510: dread - da/d38/d62/d6d/d52/d6c/f8e zero size 2024-04-25T02:27:10.014 INFO:tasks.workunit.client.0.smithi114.stdout:3/452: dread d0/d25/d29/d85/d7e/f97 [0,4194304] 0 2024-04-25T02:27:10.016 INFO:tasks.workunit.client.0.smithi114.stdout:5/534: dread d1/d25/f1f [0,4194304] 0 2024-04-25T02:27:10.017 INFO:tasks.workunit.client.0.smithi114.stdout:5/535: chown d1/d6/d4f/f52 0 1 2024-04-25T02:27:10.019 INFO:tasks.workunit.client.0.smithi114.stdout:3/453: getdents d0/d25/d2a/d34/d9e 0 2024-04-25T02:27:10.020 INFO:tasks.workunit.client.0.smithi114.stdout:5/536: mkdir d1/d53/d55/db1 0 2024-04-25T02:27:10.020 INFO:tasks.workunit.client.0.smithi114.stdout:0/487: link d1/d4/d24/c55 d1/d4/da/d33/c92 0 2024-04-25T02:27:10.024 INFO:tasks.workunit.client.0.smithi114.stdout:5/537: chown d1/l13 0 1 2024-04-25T02:27:10.025 INFO:tasks.workunit.client.0.smithi114.stdout:0/488: mknod d1/d7/d18/d2e/d8f/c93 0 2024-04-25T02:27:10.025 INFO:tasks.workunit.client.0.smithi114.stdout:3/454: dwrite d0/d25/fa1 [0,4194304] 0 2024-04-25T02:27:10.027 INFO:tasks.workunit.client.0.smithi114.stdout:4/416: sync 2024-04-25T02:27:10.027 INFO:tasks.workunit.client.0.smithi114.stdout:1/479: dread df/d11/d25/f27 [0,4194304] 0 2024-04-25T02:27:10.030 INFO:tasks.workunit.client.0.smithi114.stdout:1/480: readlink df/l65 0 2024-04-25T02:27:10.031 INFO:tasks.workunit.client.0.smithi114.stdout:1/481: write df/d11/d6c/f95 [763989,59014] 0 2024-04-25T02:27:10.032 INFO:tasks.workunit.client.0.smithi114.stdout:5/538: mkdir d1/d3e/db2 0 2024-04-25T02:27:10.032 INFO:tasks.workunit.client.0.smithi114.stdout:0/489: dread d1/d30/f48 [0,4194304] 0 2024-04-25T02:27:10.037 INFO:tasks.workunit.client.0.smithi114.stdout:9/508: dread d8/d16/d21/d83/d39/d38/f6f [0,4194304] 0 2024-04-25T02:27:10.037 INFO:tasks.workunit.client.0.smithi114.stdout:0/490: creat d1/d4/d62/f94 x:0 0 0 2024-04-25T02:27:10.038 INFO:tasks.workunit.client.0.smithi114.stdout:1/482: rename df/d13/d1e/d3e/c94 to df/d13/d1e/d3e/d7b/ca4 0 2024-04-25T02:27:10.038 INFO:tasks.workunit.client.0.smithi114.stdout:4/417: dread d3/d8/d12/d19/d26/d3e/f55 [0,4194304] 0 2024-04-25T02:27:10.039 INFO:tasks.workunit.client.0.smithi114.stdout:1/483: fsync df/d11/d25/f4c 0 2024-04-25T02:27:10.041 INFO:tasks.workunit.client.0.smithi114.stdout:9/509: unlink d8/d16/d21/d24/d3c/c67 0 2024-04-25T02:27:10.044 INFO:tasks.workunit.client.0.smithi114.stdout:7/577: truncate d5/d32/d4a/d91/f73 2093253 0 2024-04-25T02:27:10.045 INFO:tasks.workunit.client.0.smithi114.stdout:1/484: mknod df/d11/d32/ca5 0 2024-04-25T02:27:10.046 INFO:tasks.workunit.client.0.smithi114.stdout:1/485: stat df/d11/d25/d33/d47/f9e 0 2024-04-25T02:27:10.047 INFO:tasks.workunit.client.0.smithi114.stdout:4/418: rename d3/d8/d23/d25/d31/d33/c3d to d3/d8/d12/d19/d42/c7a 0 2024-04-25T02:27:10.048 INFO:tasks.workunit.client.0.smithi114.stdout:5/539: getdents d1/d53 0 2024-04-25T02:27:10.049 INFO:tasks.workunit.client.0.smithi114.stdout:5/540: dread - d1/d6/d1a/d7f/f87 zero size 2024-04-25T02:27:10.049 INFO:tasks.workunit.client.0.smithi114.stdout:7/578: write d5/d19/d23/f37 [531666,19779] 0 2024-04-25T02:27:10.050 INFO:tasks.workunit.client.0.smithi114.stdout:4/419: creat d3/d8/d12/d19/d26/f7b x:0 0 0 2024-04-25T02:27:10.050 INFO:tasks.workunit.client.0.smithi114.stdout:1/486: read df/d13/d1e/f72 [2347803,99729] 0 2024-04-25T02:27:10.051 INFO:tasks.workunit.client.0.smithi114.stdout:1/487: fdatasync df/d13/d44/d5a/f68 0 2024-04-25T02:27:10.055 INFO:tasks.workunit.client.0.smithi114.stdout:4/420: fdatasync d3/d8/d23/d25/d4e/f79 0 2024-04-25T02:27:10.056 INFO:tasks.workunit.client.0.smithi114.stdout:2/542: dread d5/df/d63/fa8 [0,4194304] 0 2024-04-25T02:27:10.057 INFO:tasks.workunit.client.0.smithi114.stdout:5/541: rename d1/d3e/d60/d82/d8f/f98 to d1/d25/da1/d8a/da8/fb3 0 2024-04-25T02:27:10.059 INFO:tasks.workunit.client.0.smithi114.stdout:1/488: mkdir df/d11/d6c/d82/da6 0 2024-04-25T02:27:10.062 INFO:tasks.workunit.client.0.smithi114.stdout:8/511: dread da/d38/f5b [0,4194304] 0 2024-04-25T02:27:10.063 INFO:tasks.workunit.client.0.smithi114.stdout:8/512: chown da/d38/f2a 446330086 1 2024-04-25T02:27:10.063 INFO:tasks.workunit.client.0.smithi114.stdout:8/513: stat da/d38/d62/d6d/l72 0 2024-04-25T02:27:10.065 INFO:tasks.workunit.client.0.smithi114.stdout:5/542: rename d1/d53/f59 to d1/d53/fb4 0 2024-04-25T02:27:10.067 INFO:tasks.workunit.client.0.smithi114.stdout:4/421: symlink d3/d8/l7c 0 2024-04-25T02:27:10.068 INFO:tasks.workunit.client.0.smithi114.stdout:1/489: creat df/d13/d1e/d3e/fa7 x:0 0 0 2024-04-25T02:27:10.069 INFO:tasks.workunit.client.0.smithi114.stdout:4/422: readlink d3/d8/d23/d35/l48 0 2024-04-25T02:27:10.069 INFO:tasks.workunit.client.0.smithi114.stdout:7/579: link d5/c15 d5/d8b/d99/cbb 0 2024-04-25T02:27:10.070 INFO:tasks.workunit.client.0.smithi114.stdout:5/543: dread d1/d25/d24/f61 [0,4194304] 0 2024-04-25T02:27:10.073 INFO:tasks.workunit.client.0.smithi114.stdout:3/455: dread d0/d25/d29/d85/f51 [0,4194304] 0 2024-04-25T02:27:10.073 INFO:tasks.workunit.client.0.smithi114.stdout:8/514: mknod da/d38/d62/d6d/d52/d6c/c9d 0 2024-04-25T02:27:10.074 INFO:tasks.workunit.client.0.smithi114.stdout:0/491: dwrite d1/d4/d24/f47 [0,4194304] 0 2024-04-25T02:27:10.075 INFO:tasks.workunit.client.0.smithi114.stdout:2/543: dread d5/d6/d58/d5a/d3e/f49 [0,4194304] 0 2024-04-25T02:27:10.077 INFO:tasks.workunit.client.0.smithi114.stdout:5/544: creat d1/d6/d4f/d6c/d88/fb5 x:0 0 0 2024-04-25T02:27:10.077 INFO:tasks.workunit.client.0.smithi114.stdout:0/492: write d1/d4/ff [4387267,68609] 0 2024-04-25T02:27:10.078 INFO:tasks.workunit.client.0.smithi114.stdout:5/545: readlink d1/d6/d4f/lad 0 2024-04-25T02:27:10.078 INFO:tasks.workunit.client.0.smithi114.stdout:8/515: truncate da/d38/d62/d6d/d52/d6c/f8b 927056 0 2024-04-25T02:27:10.078 INFO:tasks.workunit.client.0.smithi114.stdout:3/456: symlink d0/d25/d29/la2 0 2024-04-25T02:27:10.079 INFO:tasks.workunit.client.0.smithi114.stdout:4/423: symlink d3/d8/l7d 0 2024-04-25T02:27:10.080 INFO:tasks.workunit.client.0.smithi114.stdout:7/580: mkdir d5/d32/d4a/dbc 0 2024-04-25T02:27:10.081 INFO:tasks.workunit.client.0.smithi114.stdout:7/581: chown d5/d43/l94 3508 1 2024-04-25T02:27:10.081 INFO:tasks.workunit.client.0.smithi114.stdout:7/582: stat d5/d19/c5c 0 2024-04-25T02:27:10.083 INFO:tasks.workunit.client.0.smithi114.stdout:2/544: fdatasync d5/d6/d31/d6a/f88 0 2024-04-25T02:27:10.084 INFO:tasks.workunit.client.0.smithi114.stdout:2/545: write d5/d6/d31/f37 [3103769,33316] 0 2024-04-25T02:27:10.086 INFO:tasks.workunit.client.0.smithi114.stdout:5/546: rmdir d1/d6/d1a 39 2024-04-25T02:27:10.087 INFO:tasks.workunit.client.0.smithi114.stdout:3/457: mknod d0/d25/d29/d78/ca3 0 2024-04-25T02:27:10.090 INFO:tasks.workunit.client.0.smithi114.stdout:1/490: rename df/d11/d25/d33/c73 to df/d13/d1e/ca8 0 2024-04-25T02:27:10.092 INFO:tasks.workunit.client.0.smithi114.stdout:0/493: dwrite d1/d4/d24/f5e [0,4194304] 0 2024-04-25T02:27:10.096 INFO:tasks.workunit.client.0.smithi114.stdout:5/547: dwrite d1/d6/f3c [4194304,4194304] 0 2024-04-25T02:27:10.097 INFO:tasks.workunit.client.0.smithi114.stdout:3/458: symlink d0/d25/d29/d8c/la4 0 2024-04-25T02:27:10.099 INFO:tasks.workunit.client.0.smithi114.stdout:4/424: rmdir d3/d8/d23/d25/d4f 0 2024-04-25T02:27:10.099 INFO:tasks.workunit.client.0.smithi114.stdout:7/583: dread d5/d32/d64/fb1 [0,4194304] 0 2024-04-25T02:27:10.100 INFO:tasks.workunit.client.0.smithi114.stdout:6/602: sync 2024-04-25T02:27:10.101 INFO:tasks.workunit.client.0.smithi114.stdout:0/494: rename d1/d30/f78 to d1/d4/d4f/d77/f95 0 2024-04-25T02:27:10.102 INFO:tasks.workunit.client.0.smithi114.stdout:7/584: readlink d5/d43/l8c 0 2024-04-25T02:27:10.102 INFO:tasks.workunit.client.0.smithi114.stdout:8/516: dread da/d38/f2a [0,4194304] 0 2024-04-25T02:27:10.103 INFO:tasks.workunit.client.0.smithi114.stdout:6/603: chown de/d25/d39/f5e 468 1 2024-04-25T02:27:10.103 INFO:tasks.workunit.client.0.smithi114.stdout:2/546: dwrite d5/df/f17 [0,4194304] 0 2024-04-25T02:27:10.106 INFO:tasks.workunit.client.0.smithi114.stdout:5/548: mkdir d1/d6/d4f/d6c/d88/db6 0 2024-04-25T02:27:10.106 INFO:tasks.workunit.client.0.smithi114.stdout:1/491: dwrite df/d13/d1e/d3e/f69 [0,4194304] 0 2024-04-25T02:27:10.106 INFO:tasks.workunit.client.0.smithi114.stdout:4/425: truncate d3/d8/d12/d19/f74 576590 0 2024-04-25T02:27:10.107 INFO:tasks.workunit.client.0.smithi114.stdout:6/604: write de/fc3 [992928,25242] 0 2024-04-25T02:27:10.108 INFO:tasks.workunit.client.0.smithi114.stdout:1/492: chown ld 898 1 2024-04-25T02:27:10.109 INFO:tasks.workunit.client.0.smithi114.stdout:2/547: symlink d5/d1c/d22/lb6 0 2024-04-25T02:27:10.114 INFO:tasks.workunit.client.0.smithi114.stdout:4/426: mkdir d3/d8/d12/d19/d26/d3e/d7e 0 2024-04-25T02:27:10.114 INFO:tasks.workunit.client.0.smithi114.stdout:8/517: dwrite da/d38/d62/d6d/f46 [0,4194304] 0 2024-04-25T02:27:10.116 INFO:tasks.workunit.client.0.smithi114.stdout:1/493: dwrite df/f19 [4194304,4194304] 0 2024-04-25T02:27:10.118 INFO:tasks.workunit.client.0.smithi114.stdout:2/548: unlink d5/df/d2c/d66/fa1 0 2024-04-25T02:27:10.119 INFO:tasks.workunit.client.0.smithi114.stdout:5/549: symlink d1/d6/lb7 0 2024-04-25T02:27:10.119 INFO:tasks.workunit.client.0.smithi114.stdout:0/495: mknod d1/d4/da/d39/c96 0 2024-04-25T02:27:10.120 INFO:tasks.workunit.client.0.smithi114.stdout:4/427: mkdir d3/d8/d30/d4c/d7f 0 2024-04-25T02:27:10.120 INFO:tasks.workunit.client.0.smithi114.stdout:2/549: read d5/df/d63/d8d/fa2 [36427,75239] 0 2024-04-25T02:27:10.122 INFO:tasks.workunit.client.0.smithi114.stdout:8/518: truncate da/d38/d62/d6d/d49/f4b 656173 0 2024-04-25T02:27:10.123 INFO:tasks.workunit.client.0.smithi114.stdout:4/428: chown d3/d8/d23/d25/d31/c46 258 1 2024-04-25T02:27:10.124 INFO:tasks.workunit.client.0.smithi114.stdout:5/550: dread d1/d6/de/f4b [0,4194304] 0 2024-04-25T02:27:10.126 INFO:tasks.workunit.client.0.smithi114.stdout:4/429: chown d3/d14/c56 746 1 2024-04-25T02:27:10.128 INFO:tasks.workunit.client.0.smithi114.stdout:8/519: creat da/d38/d62/d6d/f9e x:0 0 0 2024-04-25T02:27:10.129 INFO:tasks.workunit.client.0.smithi114.stdout:4/430: dread - d3/d14/f64 zero size 2024-04-25T02:27:10.130 INFO:tasks.workunit.client.0.smithi114.stdout:5/551: creat d1/d3e/d8e/d94/fb8 x:0 0 0 2024-04-25T02:27:10.131 INFO:tasks.workunit.client.0.smithi114.stdout:0/496: dwrite d1/d7/d18/d2e/d7e/f89 [0,4194304] 0 2024-04-25T02:27:10.132 INFO:tasks.workunit.client.0.smithi114.stdout:8/520: fsync da/d69/d93/f68 0 2024-04-25T02:27:10.133 INFO:tasks.workunit.client.0.smithi114.stdout:1/494: dwrite fa [0,4194304] 0 2024-04-25T02:27:10.133 INFO:tasks.workunit.client.0.smithi114.stdout:2/550: dwrite d5/df/d3d/f6f [0,4194304] 0 2024-04-25T02:27:10.134 INFO:tasks.workunit.client.0.smithi114.stdout:4/431: write d3/d14/f3b [1575763,117644] 0 2024-04-25T02:27:10.135 INFO:tasks.workunit.client.0.smithi114.stdout:2/551: fdatasync d5/d1c/d22/f24 0 2024-04-25T02:27:10.135 INFO:tasks.workunit.client.0.smithi114.stdout:2/552: stat d5/d79/f9f 0 2024-04-25T02:27:10.138 INFO:tasks.workunit.client.0.smithi114.stdout:0/497: rmdir d1/d4/d37 39 2024-04-25T02:27:10.139 INFO:tasks.workunit.client.0.smithi114.stdout:4/432: dread d3/d8/d23/d25/d31/f59 [0,4194304] 0 2024-04-25T02:27:10.139 INFO:tasks.workunit.client.0.smithi114.stdout:1/495: mkdir df/d11/d7d/d92/da9 0 2024-04-25T02:27:10.140 INFO:tasks.workunit.client.0.smithi114.stdout:1/496: chown df/d11/d6c/d82 825 1 2024-04-25T02:27:10.140 INFO:tasks.workunit.client.0.smithi114.stdout:4/433: fdatasync d3/d8/d12/d19/d26/f2a 0 2024-04-25T02:27:10.143 INFO:tasks.workunit.client.0.smithi114.stdout:2/553: rename d5/df/d2c/f82 to d5/d1c/d22/d67/db2/fb7 0 2024-04-25T02:27:10.147 INFO:tasks.workunit.client.0.smithi114.stdout:2/554: creat d5/d6/d58/d5a/fb8 x:0 0 0 2024-04-25T02:27:10.148 INFO:tasks.workunit.client.0.smithi114.stdout:2/555: write d5/df/d3d/f5e [3248173,96816] 0 2024-04-25T02:27:10.150 INFO:tasks.workunit.client.0.smithi114.stdout:2/556: mknod d5/df/d63/cb9 0 2024-04-25T02:27:10.151 INFO:tasks.workunit.client.0.smithi114.stdout:2/557: chown d5/df/c1b 106746029 1 2024-04-25T02:27:10.152 INFO:tasks.workunit.client.0.smithi114.stdout:2/558: write d5/fd [3976641,60241] 0 2024-04-25T02:27:10.152 INFO:tasks.workunit.client.0.smithi114.stdout:7/585: dread d5/f83 [0,4194304] 0 2024-04-25T02:27:10.153 INFO:tasks.workunit.client.0.smithi114.stdout:2/559: write d5/df/d1e/f25 [4161102,112977] 0 2024-04-25T02:27:10.155 INFO:tasks.workunit.client.0.smithi114.stdout:2/560: chown d5/d6/l2d 3630 1 2024-04-25T02:27:10.155 INFO:tasks.workunit.client.0.smithi114.stdout:2/561: fdatasync d5/f1d 0 2024-04-25T02:27:10.155 INFO:tasks.workunit.client.0.smithi114.stdout:2/562: chown c1 3301281 1 2024-04-25T02:27:10.156 INFO:tasks.workunit.client.0.smithi114.stdout:2/563: chown d5/df/d63/d8d 9485153 1 2024-04-25T02:27:10.157 INFO:tasks.workunit.client.0.smithi114.stdout:9/510: sync 2024-04-25T02:27:10.159 INFO:tasks.workunit.client.0.smithi114.stdout:9/511: creat d8/d16/d21/d83/d39/d38/d46/d53/da2/fad x:0 0 0 2024-04-25T02:27:10.161 INFO:tasks.workunit.client.0.smithi114.stdout:9/512: rmdir d8/d16/d21/d24/d69 39 2024-04-25T02:27:10.166 INFO:tasks.workunit.client.0.smithi114.stdout:9/513: truncate d8/d16/d21/d83/d39/d38/d46/d53/fa0 442108 0 2024-04-25T02:27:10.177 INFO:tasks.workunit.client.0.smithi114.stdout:5/552: dread d1/d6/de/f37 [0,4194304] 0 2024-04-25T02:27:10.177 INFO:tasks.workunit.client.0.smithi114.stdout:4/434: getdents d3/d8/d23/d25 0 2024-04-25T02:27:10.182 INFO:tasks.workunit.client.0.smithi114.stdout:9/514: dread d8/d16/d21/d83/d39/f62 [0,4194304] 0 2024-04-25T02:27:10.182 INFO:tasks.workunit.client.0.smithi114.stdout:3/459: truncate d0/d5/d3d/f54 880839 0 2024-04-25T02:27:10.183 INFO:tasks.workunit.client.0.smithi114.stdout:6/605: write de/d27/f3f [1598659,96110] 0 2024-04-25T02:27:10.184 INFO:tasks.workunit.client.0.smithi114.stdout:6/606: readlink de/d27/d34/d38/l84 0 2024-04-25T02:27:10.185 INFO:tasks.workunit.client.0.smithi114.stdout:0/498: rmdir d1/d4/da 39 2024-04-25T02:27:10.185 INFO:tasks.workunit.client.0.smithi114.stdout:3/460: write d0/d25/d29/d85/f51 [4521927,112203] 0 2024-04-25T02:27:10.186 INFO:tasks.workunit.client.0.smithi114.stdout:6/607: stat de/d27/d34/d38/l78 0 2024-04-25T02:27:10.187 INFO:tasks.workunit.client.0.smithi114.stdout:0/499: truncate d1/d7/d18/d2e/d7e/f89 5089466 0 2024-04-25T02:27:10.189 INFO:tasks.workunit.client.0.smithi114.stdout:3/461: creat d0/d5/d3d/fa5 x:0 0 0 2024-04-25T02:27:10.189 INFO:tasks.workunit.client.0.smithi114.stdout:6/608: mknod de/d30/cd7 0 2024-04-25T02:27:10.192 INFO:tasks.workunit.client.0.smithi114.stdout:0/500: dread d1/f10 [0,4194304] 0 2024-04-25T02:27:10.193 INFO:tasks.workunit.client.0.smithi114.stdout:9/515: rename d8/d16/d21/d83/d39/d38/d46/l6a to d8/d16/d21/d24/d3c/lae 0 2024-04-25T02:27:10.194 INFO:tasks.workunit.client.0.smithi114.stdout:0/501: chown d1/d30/l59 3122 1 2024-04-25T02:27:10.194 INFO:tasks.workunit.client.0.smithi114.stdout:3/462: mkdir d0/d5/d3d/da6 0 2024-04-25T02:27:10.196 INFO:tasks.workunit.client.0.smithi114.stdout:5/553: dread d1/d6/d1a/f66 [0,4194304] 0 2024-04-25T02:27:10.196 INFO:tasks.workunit.client.0.smithi114.stdout:9/516: unlink d8/d16/d21/d83/l32 0 2024-04-25T02:27:10.196 INFO:tasks.workunit.client.0.smithi114.stdout:0/502: mkdir d1/d7/d97 0 2024-04-25T02:27:10.197 INFO:tasks.workunit.client.0.smithi114.stdout:5/554: readlink d1/d6/d1a/l41 0 2024-04-25T02:27:10.198 INFO:tasks.workunit.client.0.smithi114.stdout:3/463: creat d0/d25/d2a/d34/fa7 x:0 0 0 2024-04-25T02:27:10.198 INFO:tasks.workunit.client.0.smithi114.stdout:0/503: readlink d1/d7/d18/l1e 0 2024-04-25T02:27:10.199 INFO:tasks.workunit.client.0.smithi114.stdout:9/517: fsync d8/d16/d21/d37/d43/f7b 0 2024-04-25T02:27:10.201 INFO:tasks.workunit.client.0.smithi114.stdout:0/504: write d1/d7/d18/f51 [549752,110200] 0 2024-04-25T02:27:10.201 INFO:tasks.workunit.client.0.smithi114.stdout:5/555: creat d1/d6/de/d75/fb9 x:0 0 0 2024-04-25T02:27:10.202 INFO:tasks.workunit.client.0.smithi114.stdout:6/609: dwrite de/d27/f96 [0,4194304] 0 2024-04-25T02:27:10.203 INFO:tasks.workunit.client.0.smithi114.stdout:6/610: fdatasync de/d27/d34/d44/f80 0 2024-04-25T02:27:10.203 INFO:tasks.workunit.client.0.smithi114.stdout:3/464: mkdir d0/d25/d29/d60/da8 0 2024-04-25T02:27:10.204 INFO:tasks.workunit.client.0.smithi114.stdout:7/586: truncate d5/d19/f2c 487447 0 2024-04-25T02:27:10.204 INFO:tasks.workunit.client.0.smithi114.stdout:9/518: rmdir d8/d16/d21/d37/d43 39 2024-04-25T02:27:10.205 INFO:tasks.workunit.client.0.smithi114.stdout:9/519: chown d8/d16/d21/d24/d3c/d40 2656293 1 2024-04-25T02:27:10.205 INFO:tasks.workunit.client.0.smithi114.stdout:0/505: mkdir d1/d30/d98 0 2024-04-25T02:27:10.206 INFO:tasks.workunit.client.0.smithi114.stdout:7/587: truncate d5/d8b/fa5 399813 0 2024-04-25T02:27:10.206 INFO:tasks.workunit.client.0.smithi114.stdout:5/556: mknod d1/d6/d1a/d7f/cba 0 2024-04-25T02:27:10.207 INFO:tasks.workunit.client.0.smithi114.stdout:4/435: write d3/d8/d23/d35/f54 [2439769,22550] 0 2024-04-25T02:27:10.207 INFO:tasks.workunit.client.0.smithi114.stdout:6/611: rmdir de/d27/d34/d44/d91 39 2024-04-25T02:27:10.209 INFO:tasks.workunit.client.0.smithi114.stdout:3/465: mkdir d0/d25/d29/d85/d7e/da9 0 2024-04-25T02:27:10.209 INFO:tasks.workunit.client.0.smithi114.stdout:4/436: dread d3/d8/d12/d19/f74 [0,4194304] 0 2024-04-25T02:27:10.210 INFO:tasks.workunit.client.0.smithi114.stdout:3/466: write d0/d25/d2a/d36/f37 [125796,80464] 0 2024-04-25T02:27:10.214 INFO:tasks.workunit.client.0.smithi114.stdout:6/612: symlink de/d1c/ld8 0 2024-04-25T02:27:10.216 INFO:tasks.workunit.client.0.smithi114.stdout:4/437: dread d3/d8/d12/f1e [0,4194304] 0 2024-04-25T02:27:10.217 INFO:tasks.workunit.client.0.smithi114.stdout:1/497: sync 2024-04-25T02:27:10.217 INFO:tasks.workunit.client.0.smithi114.stdout:8/521: sync 2024-04-25T02:27:10.218 INFO:tasks.workunit.client.0.smithi114.stdout:2/564: sync 2024-04-25T02:27:10.218 INFO:tasks.workunit.client.0.smithi114.stdout:4/438: truncate d3/d8/d12/d19/d26/d3e/d62/f75 590628 0 2024-04-25T02:27:10.219 INFO:tasks.workunit.client.0.smithi114.stdout:0/506: creat d1/d4/da/d39/f99 x:0 0 0 2024-04-25T02:27:10.219 INFO:tasks.workunit.client.0.smithi114.stdout:8/522: read da/d1d/f36 [2673258,81795] 0 2024-04-25T02:27:10.220 INFO:tasks.workunit.client.0.smithi114.stdout:9/520: mknod d8/d16/d21/d83/d39/dab/caf 0 2024-04-25T02:27:10.221 INFO:tasks.workunit.client.0.smithi114.stdout:8/523: write da/d69/d93/f64 [3272998,49920] 0 2024-04-25T02:27:10.221 INFO:tasks.workunit.client.0.smithi114.stdout:7/588: getdents d5/d19/d1a/da4/db3 0 2024-04-25T02:27:10.221 INFO:tasks.workunit.client.0.smithi114.stdout:7/589: chown d5/d19/d1a/d80/fa2 621994 1 2024-04-25T02:27:10.225 INFO:tasks.workunit.client.0.smithi114.stdout:3/467: symlink d0/d5/d3d/da6/laa 0 2024-04-25T02:27:10.232 INFO:tasks.workunit.client.0.smithi114.stdout:8/524: creat da/d1d/f9f x:0 0 0 2024-04-25T02:27:10.233 INFO:tasks.workunit.client.0.smithi114.stdout:7/590: creat d5/d32/da6/fbd x:0 0 0 2024-04-25T02:27:10.235 INFO:tasks.workunit.client.0.smithi114.stdout:6/613: link de/d27/d34/d38/f42 de/d27/d76/fd9 0 2024-04-25T02:27:10.235 INFO:tasks.workunit.client.0.smithi114.stdout:5/557: link d1/d25/d24/l62 d1/d6/d4f/d6c/d88/db6/lbb 0 2024-04-25T02:27:10.236 INFO:tasks.workunit.client.0.smithi114.stdout:2/565: symlink d5/d6/d58/lba 0 2024-04-25T02:27:10.238 INFO:tasks.workunit.client.0.smithi114.stdout:2/566: chown d5/df/f17 3495478 1 2024-04-25T02:27:10.238 INFO:tasks.workunit.client.0.smithi114.stdout:3/468: rename d0/d5/d3d/f42 to d0/d25/da0/fab 0 2024-04-25T02:27:10.239 INFO:tasks.workunit.client.0.smithi114.stdout:9/521: rmdir d8 39 2024-04-25T02:27:10.240 INFO:tasks.workunit.client.0.smithi114.stdout:7/591: dwrite d5/d32/d4a/d91/f57 [0,4194304] 0 2024-04-25T02:27:10.241 INFO:tasks.workunit.client.0.smithi114.stdout:4/439: symlink d3/d8/d30/d6e/l80 0 2024-04-25T02:27:10.242 INFO:tasks.workunit.client.0.smithi114.stdout:4/440: write d3/d8/d12/f6d [3267640,18171] 0 2024-04-25T02:27:10.243 INFO:tasks.workunit.client.0.smithi114.stdout:8/525: symlink da/d69/d93/d6b/la0 0 2024-04-25T02:27:10.246 INFO:tasks.workunit.client.0.smithi114.stdout:6/614: creat de/d1c/fda x:0 0 0 2024-04-25T02:27:10.250 INFO:tasks.workunit.client.0.smithi114.stdout:5/558: rename d1/d51/d9a to d1/d6/de/dbc 0 2024-04-25T02:27:10.251 INFO:tasks.workunit.client.0.smithi114.stdout:9/522: write d8/d16/d21/d83/d39/d38/d46/d53/da2/fad [65297,17173] 0 2024-04-25T02:27:10.251 INFO:tasks.workunit.client.0.smithi114.stdout:3/469: mknod d0/d25/d29/d78/cac 0 2024-04-25T02:27:10.253 INFO:tasks.workunit.client.0.smithi114.stdout:4/441: chown d3/l67 2 1 2024-04-25T02:27:10.255 INFO:tasks.workunit.client.0.smithi114.stdout:6/615: write de/d27/d34/d44/f71 [188883,21783] 0 2024-04-25T02:27:10.257 INFO:tasks.workunit.client.0.smithi114.stdout:5/559: fdatasync d1/d53/f7c 0 2024-04-25T02:27:10.257 INFO:tasks.workunit.client.0.smithi114.stdout:7/592: dwrite d5/d32/d64/f89 [0,4194304] 0 2024-04-25T02:27:10.258 INFO:tasks.workunit.client.0.smithi114.stdout:3/470: mkdir d0/d25/d29/d85/d7e/da9/dad 0 2024-04-25T02:27:10.259 INFO:tasks.workunit.client.0.smithi114.stdout:7/593: dread - d5/d43/d63/d7a/fb8 zero size 2024-04-25T02:27:10.259 INFO:tasks.workunit.client.0.smithi114.stdout:3/471: chown d0/d5/f43 1743 1 2024-04-25T02:27:10.261 INFO:tasks.workunit.client.0.smithi114.stdout:4/442: rename d3/d8/d30/d4c/c5e to d3/d8/d23/d25/d31/d33/c81 0 2024-04-25T02:27:10.265 INFO:tasks.workunit.client.0.smithi114.stdout:5/560: creat d1/d6/d4f/fbd x:0 0 0 2024-04-25T02:27:10.265 INFO:tasks.workunit.client.0.smithi114.stdout:8/526: link da/d38/c18 da/d38/d62/ca1 0 2024-04-25T02:27:10.269 INFO:tasks.workunit.client.0.smithi114.stdout:9/523: mkdir d8/d16/d21/d37/d43/d75/da3/db0 0 2024-04-25T02:27:10.271 INFO:tasks.workunit.client.0.smithi114.stdout:6/616: truncate de/f18 1324482 0 2024-04-25T02:27:10.272 INFO:tasks.workunit.client.0.smithi114.stdout:3/472: dwrite d0/f1d [4194304,4194304] 0 2024-04-25T02:27:10.275 INFO:tasks.workunit.client.0.smithi114.stdout:5/561: dread d1/d6/d1a/f7e [0,4194304] 0 2024-04-25T02:27:10.275 INFO:tasks.workunit.client.0.smithi114.stdout:3/473: chown d0/d5/fc 2 1 2024-04-25T02:27:10.276 INFO:tasks.workunit.client.0.smithi114.stdout:3/474: stat d0/d25/d2a/d80 0 2024-04-25T02:27:10.278 INFO:tasks.workunit.client.0.smithi114.stdout:3/475: stat d0/d25/d2a/d34/fa7 0 2024-04-25T02:27:10.278 INFO:tasks.workunit.client.0.smithi114.stdout:2/567: dwrite d5/df/f45 [0,4194304] 0 2024-04-25T02:27:10.279 INFO:tasks.workunit.client.0.smithi114.stdout:8/527: link da/d1d/f60 da/d1d/fa2 0 2024-04-25T02:27:10.281 INFO:tasks.workunit.client.0.smithi114.stdout:7/594: rename d5/d43/l70 to d5/d43/lbe 0 2024-04-25T02:27:10.285 INFO:tasks.workunit.client.0.smithi114.stdout:5/562: mkdir d1/d25/dbe 0 2024-04-25T02:27:10.289 INFO:tasks.workunit.client.0.smithi114.stdout:9/524: write d8/d16/d21/d83/d39/f62 [1708280,29960] 0 2024-04-25T02:27:10.291 INFO:tasks.workunit.client.0.smithi114.stdout:7/595: mkdir d5/dbf 0 2024-04-25T02:27:10.292 INFO:tasks.workunit.client.0.smithi114.stdout:5/563: dwrite d1/d25/d24/f3b [0,4194304] 0 2024-04-25T02:27:10.292 INFO:tasks.workunit.client.0.smithi114.stdout:6/617: dread de/d25/f50 [0,4194304] 0 2024-04-25T02:27:10.292 INFO:tasks.workunit.client.0.smithi114.stdout:2/568: dread d5/df/f12 [0,4194304] 0 2024-04-25T02:27:10.294 INFO:tasks.workunit.client.0.smithi114.stdout:7/596: fdatasync d5/d19/d23/f37 0 2024-04-25T02:27:10.294 INFO:tasks.workunit.client.0.smithi114.stdout:3/476: rename d0/c26 to d0/d25/d29/d85/cae 0 2024-04-25T02:27:10.296 INFO:tasks.workunit.client.0.smithi114.stdout:7/597: stat d5/d19/f45 0 2024-04-25T02:27:10.297 INFO:tasks.workunit.client.0.smithi114.stdout:7/598: chown d5/d32/c3e 16 1 2024-04-25T02:27:10.299 INFO:tasks.workunit.client.0.smithi114.stdout:2/569: rename d5/d1c/l23 to d5/d6/d58/d5a/lbb 0 2024-04-25T02:27:10.300 INFO:tasks.workunit.client.0.smithi114.stdout:1/498: sync 2024-04-25T02:27:10.301 INFO:tasks.workunit.client.0.smithi114.stdout:3/477: creat d0/d25/d29/d78/faf x:0 0 0 2024-04-25T02:27:10.301 INFO:tasks.workunit.client.0.smithi114.stdout:5/564: dread d1/d6/de/f90 [0,4194304] 0 2024-04-25T02:27:10.302 INFO:tasks.workunit.client.0.smithi114.stdout:6/618: creat de/d27/d34/d44/d91/fdb x:0 0 0 2024-04-25T02:27:10.303 INFO:tasks.workunit.client.0.smithi114.stdout:6/619: chown de/d2a/dd5 20 1 2024-04-25T02:27:10.304 INFO:tasks.workunit.client.0.smithi114.stdout:3/478: write d0/d25/d29/d85/f51 [4143231,16496] 0 2024-04-25T02:27:10.304 INFO:tasks.workunit.client.0.smithi114.stdout:7/599: dwrite d5/f65 [0,4194304] 0 2024-04-25T02:27:10.307 INFO:tasks.workunit.client.0.smithi114.stdout:3/479: write d0/f3 [5789436,88350] 0 2024-04-25T02:27:10.307 INFO:tasks.workunit.client.0.smithi114.stdout:1/499: readlink df/l4e 0 2024-04-25T02:27:10.310 INFO:tasks.workunit.client.0.smithi114.stdout:6/620: mknod de/d25/d39/d47/d90/cdc 0 2024-04-25T02:27:10.311 INFO:tasks.workunit.client.0.smithi114.stdout:2/570: dwrite d5/df/d3d/f69 [4194304,4194304] 0 2024-04-25T02:27:10.313 INFO:tasks.workunit.client.0.smithi114.stdout:6/621: stat de/d1c/la6 0 2024-04-25T02:27:10.313 INFO:tasks.workunit.client.0.smithi114.stdout:5/565: mknod d1/d51/cbf 0 2024-04-25T02:27:10.315 INFO:tasks.workunit.client.0.smithi114.stdout:2/571: chown d5/df/d3d/f4b 10156 1 2024-04-25T02:27:10.317 INFO:tasks.workunit.client.0.smithi114.stdout:9/525: link d8/d16/d21/d37/d60/d70/la7 d8/d16/d21/d83/d39/d38/lb1 0 2024-04-25T02:27:10.317 INFO:tasks.workunit.client.0.smithi114.stdout:8/528: dwrite da/d1e/f3d [0,4194304] 0 2024-04-25T02:27:10.318 INFO:tasks.workunit.client.0.smithi114.stdout:5/566: chown d1/d6/d1a/l47 1 1 2024-04-25T02:27:10.320 INFO:tasks.workunit.client.0.smithi114.stdout:7/600: dread d5/d32/d4a/d91/f57 [0,4194304] 0 2024-04-25T02:27:10.321 INFO:tasks.workunit.client.0.smithi114.stdout:3/480: dwrite d0/fb [0,4194304] 0 2024-04-25T02:27:10.321 INFO:tasks.workunit.client.0.smithi114.stdout:2/572: write d5/d1c/d22/f24 [4264182,78615] 0 2024-04-25T02:27:10.322 INFO:tasks.workunit.client.0.smithi114.stdout:8/529: mknod da/d1e/ca3 0 2024-04-25T02:27:10.324 INFO:tasks.workunit.client.0.smithi114.stdout:1/500: dwrite df/d13/f56 [0,4194304] 0 2024-04-25T02:27:10.326 INFO:tasks.workunit.client.0.smithi114.stdout:6/622: mknod de/d25/d39/cdd 0 2024-04-25T02:27:10.326 INFO:tasks.workunit.client.0.smithi114.stdout:3/481: fsync d0/d25/d2a/d36/f5e 0 2024-04-25T02:27:10.326 INFO:tasks.workunit.client.0.smithi114.stdout:0/507: sync 2024-04-25T02:27:10.327 INFO:tasks.workunit.client.0.smithi114.stdout:9/526: write d8/d16/d21/d83/d39/d38/d46/d53/da2/fad [947561,40503] 0 2024-04-25T02:27:10.328 INFO:tasks.workunit.client.0.smithi114.stdout:8/530: write da/d1e/f3d [2531193,95321] 0 2024-04-25T02:27:10.329 INFO:tasks.workunit.client.0.smithi114.stdout:2/573: write d5/df/d3d/f69 [6925073,126702] 0 2024-04-25T02:27:10.330 INFO:tasks.workunit.client.0.smithi114.stdout:9/527: truncate d8/f1f 1374571 0 2024-04-25T02:27:10.335 INFO:tasks.workunit.client.0.smithi114.stdout:5/567: rename d1/d51/d6f/ca3 to d1/d6/de/dbc/cc0 0 2024-04-25T02:27:10.336 INFO:tasks.workunit.client.0.smithi114.stdout:6/623: mkdir de/d25/dad/dde 0 2024-04-25T02:27:10.337 INFO:tasks.workunit.client.0.smithi114.stdout:0/508: dread d1/d4/da/f12 [0,4194304] 0 2024-04-25T02:27:10.337 INFO:tasks.workunit.client.0.smithi114.stdout:8/531: stat da/l7a 0 2024-04-25T02:27:10.337 INFO:tasks.workunit.client.0.smithi114.stdout:3/482: symlink d0/d25/d29/d85/d7e/lb0 0 2024-04-25T02:27:10.338 INFO:tasks.workunit.client.0.smithi114.stdout:7/601: creat d5/d43/fc0 x:0 0 0 2024-04-25T02:27:10.339 INFO:tasks.workunit.client.0.smithi114.stdout:3/483: chown d0/d25/d29/d60 60683289 1 2024-04-25T02:27:10.341 INFO:tasks.workunit.client.0.smithi114.stdout:0/509: creat d1/d4/d24/d52/f9a x:0 0 0 2024-04-25T02:27:10.341 INFO:tasks.workunit.client.0.smithi114.stdout:2/574: mknod d5/d1c/cbc 0 2024-04-25T02:27:10.342 INFO:tasks.workunit.client.0.smithi114.stdout:0/510: read d1/d7/d18/d2e/f34 [786550,5769] 0 2024-04-25T02:27:10.343 INFO:tasks.workunit.client.0.smithi114.stdout:5/568: unlink d1/d53/f78 0 2024-04-25T02:27:10.343 INFO:tasks.workunit.client.0.smithi114.stdout:2/575: truncate d5/df/d1e/f6d 1639023 0 2024-04-25T02:27:10.344 INFO:tasks.workunit.client.0.smithi114.stdout:3/484: creat d0/d25/d2a/d36/fb1 x:0 0 0 2024-04-25T02:27:10.349 INFO:tasks.workunit.client.0.smithi114.stdout:5/569: unlink d1/d25/d24/f2e 0 2024-04-25T02:27:10.350 INFO:tasks.workunit.client.0.smithi114.stdout:5/570: chown d1/d6/d4f 2209 1 2024-04-25T02:27:10.350 INFO:tasks.workunit.client.0.smithi114.stdout:5/571: dread - d1/d6/d4f/d6c/d88/fb5 zero size 2024-04-25T02:27:10.351 INFO:tasks.workunit.client.0.smithi114.stdout:7/602: rename d5/d19/d23/l25 to d5/d19/d1a/d80/lc1 0 2024-04-25T02:27:10.352 INFO:tasks.workunit.client.0.smithi114.stdout:8/532: creat da/d38/fa4 x:0 0 0 2024-04-25T02:27:10.353 INFO:tasks.workunit.client.0.smithi114.stdout:3/485: creat d0/d25/d29/d85/d7e/da9/fb2 x:0 0 0 2024-04-25T02:27:10.353 INFO:tasks.workunit.client.0.smithi114.stdout:9/528: link d8/d16/d21/d37/l56 d8/d16/d21/d24/lb2 0 2024-04-25T02:27:10.355 INFO:tasks.workunit.client.0.smithi114.stdout:3/486: fsync d0/d25/d29/d85/f51 0 2024-04-25T02:27:10.357 INFO:tasks.workunit.client.0.smithi114.stdout:3/487: write d0/fb [4006836,106430] 0 2024-04-25T02:27:10.359 INFO:tasks.workunit.client.0.smithi114.stdout:4/443: sync 2024-04-25T02:27:10.359 INFO:tasks.workunit.client.0.smithi114.stdout:2/576: creat d5/df/d2c/fbd x:0 0 0 2024-04-25T02:27:10.360 INFO:tasks.workunit.client.0.smithi114.stdout:8/533: dwrite da/d1e/f29 [0,4194304] 0 2024-04-25T02:27:10.361 INFO:tasks.workunit.client.0.smithi114.stdout:1/501: write df/d13/f56 [4576485,111528] 0 2024-04-25T02:27:10.362 INFO:tasks.workunit.client.0.smithi114.stdout:0/511: link d1/d7/d18/d2e/c31 d1/d4/d4f/d77/d82/c9b 0 2024-04-25T02:27:10.362 INFO:tasks.workunit.client.0.smithi114.stdout:1/502: chown df/d13/d1e/da2 1091 1 2024-04-25T02:27:10.364 INFO:tasks.workunit.client.0.smithi114.stdout:9/529: symlink d8/d16/d21/d24/lb3 0 2024-04-25T02:27:10.365 INFO:tasks.workunit.client.0.smithi114.stdout:4/444: dread - d3/d8/f57 zero size 2024-04-25T02:27:10.365 INFO:tasks.workunit.client.0.smithi114.stdout:2/577: mknod d5/d1c/d22/cbe 0 2024-04-25T02:27:10.366 INFO:tasks.workunit.client.0.smithi114.stdout:3/488: dwrite d0/d25/f73 [0,4194304] 0 2024-04-25T02:27:10.366 INFO:tasks.workunit.client.0.smithi114.stdout:6/624: dread de/d25/d39/d5c/f6f [0,4194304] 0 2024-04-25T02:27:10.366 INFO:tasks.workunit.client.0.smithi114.stdout:8/534: mkdir da/d69/d93/d70/da5 0 2024-04-25T02:27:10.368 INFO:tasks.workunit.client.0.smithi114.stdout:5/572: mkdir d1/d53/d55/dae/dc1 0 2024-04-25T02:27:10.368 INFO:tasks.workunit.client.0.smithi114.stdout:6/625: stat de/d1c/cbf 0 2024-04-25T02:27:10.369 INFO:tasks.workunit.client.0.smithi114.stdout:0/512: mkdir d1/d30/d4d/d9c 0 2024-04-25T02:27:10.370 INFO:tasks.workunit.client.0.smithi114.stdout:5/573: chown d1/d6/d1a/f2f 51321613 1 2024-04-25T02:27:10.370 INFO:tasks.workunit.client.0.smithi114.stdout:2/578: truncate d5/d6/d58/d5a/fb8 330256 0 2024-04-25T02:27:10.371 INFO:tasks.workunit.client.0.smithi114.stdout:4/445: mkdir d3/d8/d12/d82 0 2024-04-25T02:27:10.371 INFO:tasks.workunit.client.0.smithi114.stdout:7/603: getdents d5/d32/d4a/d91/db7 0 2024-04-25T02:27:10.373 INFO:tasks.workunit.client.0.smithi114.stdout:9/530: creat d8/d16/d21/d83/d39/d38/d5d/fb4 x:0 0 0 2024-04-25T02:27:10.374 INFO:tasks.workunit.client.0.smithi114.stdout:1/503: getdents df/d13/d44/d9b 0 2024-04-25T02:27:10.376 INFO:tasks.workunit.client.0.smithi114.stdout:0/513: mknod d1/d4/d24/d52/c9d 0 2024-04-25T02:27:10.377 INFO:tasks.workunit.client.0.smithi114.stdout:5/574: write d1/d25/da1/d8a/da8/fb3 [442271,100428] 0 2024-04-25T02:27:10.378 INFO:tasks.workunit.client.0.smithi114.stdout:4/446: creat d3/d8/d23/d35/f83 x:0 0 0 2024-04-25T02:27:10.379 INFO:tasks.workunit.client.0.smithi114.stdout:5/575: write d1/d6/de/dbc/f9b [932433,9366] 0 2024-04-25T02:27:10.379 INFO:tasks.workunit.client.0.smithi114.stdout:3/489: mknod d0/d25/d29/d85/d7e/da9/dad/cb3 0 2024-04-25T02:27:10.380 INFO:tasks.workunit.client.0.smithi114.stdout:5/576: write d1/d6/de/f37 [4598993,106292] 0 2024-04-25T02:27:10.380 INFO:tasks.workunit.client.0.smithi114.stdout:6/626: rename de/d2a/db9/ccd to de/d2a/db9/dc7/cdf 0 2024-04-25T02:27:10.381 INFO:tasks.workunit.client.0.smithi114.stdout:9/531: creat d8/da8/fb5 x:0 0 0 2024-04-25T02:27:10.382 INFO:tasks.workunit.client.0.smithi114.stdout:8/535: rmdir da/d69/d93/d70/da5 0 2024-04-25T02:27:10.385 INFO:tasks.workunit.client.0.smithi114.stdout:7/604: rename d5/d60/f6c to d5/d19/d1a/daf/fc2 0 2024-04-25T02:27:10.387 INFO:tasks.workunit.client.0.smithi114.stdout:9/532: mknod d8/d16/d21/d37/d43/d75/da3/cb6 0 2024-04-25T02:27:10.389 INFO:tasks.workunit.client.0.smithi114.stdout:0/514: creat d1/d4/f9e x:0 0 0 2024-04-25T02:27:10.389 INFO:tasks.workunit.client.0.smithi114.stdout:5/577: dwrite d1/d6/d1a/f2f [0,4194304] 0 2024-04-25T02:27:10.390 INFO:tasks.workunit.client.0.smithi114.stdout:9/533: chown d8/d16/d21/d83 348 1 2024-04-25T02:27:10.391 INFO:tasks.workunit.client.0.smithi114.stdout:5/578: chown d1/d6/d1a/l1c 5450656 1 2024-04-25T02:27:10.393 INFO:tasks.workunit.client.0.smithi114.stdout:3/490: rename d0/f12 to d0/d25/da0/fb4 0 2024-04-25T02:27:10.394 INFO:tasks.workunit.client.0.smithi114.stdout:5/579: read d1/d6/de/f1d [836633,115386] 0 2024-04-25T02:27:10.394 INFO:tasks.workunit.client.0.smithi114.stdout:9/534: rename d8/da8 to d8/da8/db7 22 2024-04-25T02:27:10.395 INFO:tasks.workunit.client.0.smithi114.stdout:3/491: write d0/d25/f62 [4369601,78723] 0 2024-04-25T02:27:10.395 INFO:tasks.workunit.client.0.smithi114.stdout:9/535: truncate d8/f59 825102 0 2024-04-25T02:27:10.396 INFO:tasks.workunit.client.0.smithi114.stdout:7/605: unlink d5/d19/d1a/c77 0 2024-04-25T02:27:10.396 INFO:tasks.workunit.client.0.smithi114.stdout:3/492: fdatasync d0/fa 0 2024-04-25T02:27:10.397 INFO:tasks.workunit.client.0.smithi114.stdout:7/606: readlink d5/d32/lad 0 2024-04-25T02:27:10.398 INFO:tasks.workunit.client.0.smithi114.stdout:3/493: chown d0/d5/d3d/da6 0 1 2024-04-25T02:27:10.399 INFO:tasks.workunit.client.0.smithi114.stdout:1/504: dread df/d13/d44/d5a/f68 [0,4194304] 0 2024-04-25T02:27:10.400 INFO:tasks.workunit.client.0.smithi114.stdout:7/607: chown d5/d19/d1a/d80/fa2 0 1 2024-04-25T02:27:10.400 INFO:tasks.workunit.client.0.smithi114.stdout:9/536: write d8/d16/d21/d83/d39/d38/d46/d53/da2/fad [454035,83736] 0 2024-04-25T02:27:10.400 INFO:tasks.workunit.client.0.smithi114.stdout:2/579: dread d5/d1c/d22/d67/f6c [0,4194304] 0 2024-04-25T02:27:10.412 INFO:tasks.workunit.client.0.smithi114.stdout:4/447: dread d3/d14/f37 [0,4194304] 0 2024-04-25T02:27:10.413 INFO:tasks.workunit.client.0.smithi114.stdout:2/580: fsync d5/df/f12 0 2024-04-25T02:27:10.413 INFO:tasks.workunit.client.0.smithi114.stdout:1/505: write f4 [6082914,125840] 0 2024-04-25T02:27:10.413 INFO:tasks.workunit.client.0.smithi114.stdout:9/537: unlink d8/d16/l8e 0 2024-04-25T02:27:10.415 INFO:tasks.workunit.client.0.smithi114.stdout:5/580: creat d1/d25/dbe/fc2 x:0 0 0 2024-04-25T02:27:10.416 INFO:tasks.workunit.client.0.smithi114.stdout:8/536: getdents da/d38 0 2024-04-25T02:27:10.418 INFO:tasks.workunit.client.0.smithi114.stdout:3/494: dwrite d0/d25/d29/d8c/f9c [0,4194304] 0 2024-04-25T02:27:10.419 INFO:tasks.workunit.client.0.smithi114.stdout:7/608: dwrite d5/d19/d23/f37 [0,4194304] 0 2024-04-25T02:27:10.419 INFO:tasks.workunit.client.0.smithi114.stdout:2/581: chown d5/d1c/d29/f5c 1847264 1 2024-04-25T02:27:10.419 INFO:tasks.workunit.client.0.smithi114.stdout:5/581: stat d1/d6/d1a/f57 0 2024-04-25T02:27:10.421 INFO:tasks.workunit.client.0.smithi114.stdout:3/495: readlink d0/l22 0 2024-04-25T02:27:10.421 INFO:tasks.workunit.client.0.smithi114.stdout:0/515: dread d1/d4/ff [0,4194304] 0 2024-04-25T02:27:10.425 INFO:tasks.workunit.client.0.smithi114.stdout:2/582: mknod d5/d1c/d22/d67/cbf 0 2024-04-25T02:27:10.427 INFO:tasks.workunit.client.0.smithi114.stdout:5/582: creat d1/d6/de/dbc/fc3 x:0 0 0 2024-04-25T02:27:10.428 INFO:tasks.workunit.client.0.smithi114.stdout:8/537: dwrite da/d1d/f1f [0,4194304] 0 2024-04-25T02:27:10.430 INFO:tasks.workunit.client.0.smithi114.stdout:1/506: link df/d11/d32/f7c df/d13/d75/faa 0 2024-04-25T02:27:10.431 INFO:tasks.workunit.client.0.smithi114.stdout:3/496: mkdir d0/d25/d29/d85/d7e/da9/dad/db5 0 2024-04-25T02:27:10.431 INFO:tasks.workunit.client.0.smithi114.stdout:6/627: dwrite de/d27/d76/fd9 [0,4194304] 0 2024-04-25T02:27:10.433 INFO:tasks.workunit.client.0.smithi114.stdout:6/628: readlink de/d27/lc9 0 2024-04-25T02:27:10.434 INFO:tasks.workunit.client.0.smithi114.stdout:3/497: truncate d0/d25/d2a/d34/fa7 70378 0 2024-04-25T02:27:10.434 INFO:tasks.workunit.client.0.smithi114.stdout:4/448: link d3/d14/f64 d3/d8/d30/f84 0 2024-04-25T02:27:10.435 INFO:tasks.workunit.client.0.smithi114.stdout:2/583: mkdir d5/df/d3d/d44/dc0 0 2024-04-25T02:27:10.436 INFO:tasks.workunit.client.0.smithi114.stdout:5/583: creat d1/d6/de/d75/fc4 x:0 0 0 2024-04-25T02:27:10.437 INFO:tasks.workunit.client.0.smithi114.stdout:5/584: write d1/d6/de/d75/fb9 [883635,18812] 0 2024-04-25T02:27:10.437 INFO:tasks.workunit.client.0.smithi114.stdout:8/538: rename da/d38/d62/f88 to da/d69/d93/d40/fa6 0 2024-04-25T02:27:10.438 INFO:tasks.workunit.client.0.smithi114.stdout:1/507: creat df/d11/d25/d33/fab x:0 0 0 2024-04-25T02:27:10.443 INFO:tasks.workunit.client.0.smithi114.stdout:3/498: mkdir d0/d25/d2a/d34/db6 0 2024-04-25T02:27:10.444 INFO:tasks.workunit.client.0.smithi114.stdout:4/449: write d3/d8/f1b [616357,63176] 0 2024-04-25T02:27:10.444 INFO:tasks.workunit.client.0.smithi114.stdout:3/499: stat d0/d25/d2a/d34/l69 0 2024-04-25T02:27:10.444 INFO:tasks.workunit.client.0.smithi114.stdout:2/584: rename d5/df/f8c to d5/d6/d58/d5a/fc1 0 2024-04-25T02:27:10.448 INFO:tasks.workunit.client.0.smithi114.stdout:1/508: creat df/d11/d25/d33/fac x:0 0 0 2024-04-25T02:27:10.450 INFO:tasks.workunit.client.0.smithi114.stdout:4/450: dwrite d3/d8/d23/d35/f54 [0,4194304] 0 2024-04-25T02:27:10.452 INFO:tasks.workunit.client.0.smithi114.stdout:2/585: unlink d5/df/fa9 0 2024-04-25T02:27:10.453 INFO:tasks.workunit.client.0.smithi114.stdout:4/451: rmdir d3/d8/d30/d4c 39 2024-04-25T02:27:10.454 INFO:tasks.workunit.client.0.smithi114.stdout:2/586: chown d5/df/d1e/l97 1329 1 2024-04-25T02:27:10.455 INFO:tasks.workunit.client.0.smithi114.stdout:8/539: mknod da/d38/d62/d6d/ca7 0 2024-04-25T02:27:10.456 INFO:tasks.workunit.client.0.smithi114.stdout:6/629: getdents de/d25/d39/d47/d90/d93/d99 0 2024-04-25T02:27:10.456 INFO:tasks.workunit.client.0.smithi114.stdout:2/587: write d5/d1c/d21/d91/fa4 [1121071,904] 0 2024-04-25T02:27:10.456 INFO:tasks.workunit.client.0.smithi114.stdout:8/540: fdatasync da/d69/d93/f64 0 2024-04-25T02:27:10.456 INFO:tasks.workunit.client.0.smithi114.stdout:1/509: mknod df/d13/cad 0 2024-04-25T02:27:10.457 INFO:tasks.workunit.client.0.smithi114.stdout:8/541: dread - da/d38/f75 zero size 2024-04-25T02:27:10.458 INFO:tasks.workunit.client.0.smithi114.stdout:3/500: rename d0/d25/d29/f94 to d0/d25/fb7 0 2024-04-25T02:27:10.461 INFO:tasks.workunit.client.0.smithi114.stdout:2/588: write d5/d1c/d21/d91/f9b [1679557,39836] 0 2024-04-25T02:27:10.462 INFO:tasks.workunit.client.0.smithi114.stdout:8/542: mkdir da/d38/d62/d6d/d52/da8 0 2024-04-25T02:27:10.463 INFO:tasks.workunit.client.0.smithi114.stdout:1/510: dwrite df/d11/d25/d33/d47/d9d/fa1 [0,4194304] 0 2024-04-25T02:27:10.463 INFO:tasks.workunit.client.0.smithi114.stdout:4/452: rename d3/d8/d12/d19/d26/f34 to d3/d8/d12/d19/f85 0 2024-04-25T02:27:10.464 INFO:tasks.workunit.client.0.smithi114.stdout:8/543: dread - da/d38/d62/d6d/f9e zero size 2024-04-25T02:27:10.466 INFO:tasks.workunit.client.0.smithi114.stdout:2/589: mkdir d5/df/d2c/d66/dc2 0 2024-04-25T02:27:10.468 INFO:tasks.workunit.client.0.smithi114.stdout:1/511: creat df/d11/d25/d33/d47/d74/fae x:0 0 0 2024-04-25T02:27:10.471 INFO:tasks.workunit.client.0.smithi114.stdout:8/544: dwrite da/d1e/f96 [0,4194304] 0 2024-04-25T02:27:10.473 INFO:tasks.workunit.client.0.smithi114.stdout:3/501: rename d0/f3 to d0/d25/d2a/fb8 0 2024-04-25T02:27:10.474 INFO:tasks.workunit.client.0.smithi114.stdout:1/512: write df/d13/d75/faa [193679,89675] 0 2024-04-25T02:27:10.475 INFO:tasks.workunit.client.0.smithi114.stdout:4/453: link d3/fa d3/d8/d23/d35/f86 0 2024-04-25T02:27:10.477 INFO:tasks.workunit.client.0.smithi114.stdout:8/545: fdatasync da/d69/d93/d40/fa6 0 2024-04-25T02:27:10.478 INFO:tasks.workunit.client.0.smithi114.stdout:8/546: truncate da/d1e/d58/f91 320221 0 2024-04-25T02:27:10.479 INFO:tasks.workunit.client.0.smithi114.stdout:3/502: fsync d0/d25/d29/f63 0 2024-04-25T02:27:10.480 INFO:tasks.workunit.client.0.smithi114.stdout:4/454: rmdir d3/d14 39 2024-04-25T02:27:10.482 INFO:tasks.workunit.client.0.smithi114.stdout:1/513: creat df/d11/d25/d33/d47/d9d/faf x:0 0 0 2024-04-25T02:27:10.482 INFO:tasks.workunit.client.0.smithi114.stdout:1/514: chown df/d11/f20 45376937 1 2024-04-25T02:27:10.484 INFO:tasks.workunit.client.0.smithi114.stdout:9/538: dread d8/fe [0,4194304] 0 2024-04-25T02:27:10.484 INFO:tasks.workunit.client.0.smithi114.stdout:3/503: mknod d0/d25/d29/cb9 0 2024-04-25T02:27:10.486 INFO:tasks.workunit.client.0.smithi114.stdout:4/455: creat d3/d8/d23/d25/f87 x:0 0 0 2024-04-25T02:27:10.491 INFO:tasks.workunit.client.0.smithi114.stdout:1/515: rename df/d13/d1e/l41 to df/d11/d25/d33/d47/lb0 0 2024-04-25T02:27:10.493 INFO:tasks.workunit.client.0.smithi114.stdout:4/456: symlink d3/d8/d12/d19/d26/l88 0 2024-04-25T02:27:10.494 INFO:tasks.workunit.client.0.smithi114.stdout:5/585: dwrite d1/d53/f7c [0,4194304] 0 2024-04-25T02:27:10.495 INFO:tasks.workunit.client.0.smithi114.stdout:4/457: dread - d3/d8/d30/f84 zero size 2024-04-25T02:27:10.497 INFO:tasks.workunit.client.0.smithi114.stdout:5/586: fdatasync d1/d6/d1a/d7f/f87 0 2024-04-25T02:27:10.499 INFO:tasks.workunit.client.0.smithi114.stdout:5/587: dread - d1/d3e/d8e/d94/fb8 zero size 2024-04-25T02:27:10.500 INFO:tasks.workunit.client.0.smithi114.stdout:1/516: dwrite df/d11/d25/d33/d47/f9e [0,4194304] 0 2024-04-25T02:27:10.500 INFO:tasks.workunit.client.0.smithi114.stdout:5/588: fdatasync d1/d6/f3c 0 2024-04-25T02:27:10.501 INFO:tasks.workunit.client.0.smithi114.stdout:2/590: dread d5/d6/d31/f32 [0,4194304] 0 2024-04-25T02:27:10.501 INFO:tasks.workunit.client.0.smithi114.stdout:3/504: rename d0/l9a to d0/d25/d29/d85/d7e/da9/lba 0 2024-04-25T02:27:10.501 INFO:tasks.workunit.client.0.smithi114.stdout:7/609: sync 2024-04-25T02:27:10.502 INFO:tasks.workunit.client.0.smithi114.stdout:5/589: readlink d1/l13 0 2024-04-25T02:27:10.503 INFO:tasks.workunit.client.0.smithi114.stdout:4/458: stat d3/d8/l41 0 2024-04-25T02:27:10.504 INFO:tasks.workunit.client.0.smithi114.stdout:1/517: truncate df/d2a/d34/f63 4983797 0 2024-04-25T02:27:10.505 INFO:tasks.workunit.client.0.smithi114.stdout:8/547: dread da/d38/d62/d6d/f2c [0,4194304] 0 2024-04-25T02:27:10.508 INFO:tasks.workunit.client.0.smithi114.stdout:7/610: truncate d5/d32/d4a/d87/fb6 1353163 0 2024-04-25T02:27:10.509 INFO:tasks.workunit.client.0.smithi114.stdout:6/630: truncate de/f59 3303813 0 2024-04-25T02:27:10.509 INFO:tasks.workunit.client.0.smithi114.stdout:6/631: chown de/d2a/db9/dc7 119 1 2024-04-25T02:27:10.510 INFO:tasks.workunit.client.0.smithi114.stdout:5/590: mkdir d1/d25/dbe/dc5 0 2024-04-25T02:27:10.510 INFO:tasks.workunit.client.0.smithi114.stdout:5/591: stat d1/d25/dbe 0 2024-04-25T02:27:10.511 INFO:tasks.workunit.client.0.smithi114.stdout:5/592: dread - d1/d6/d1a/d7f/f87 zero size 2024-04-25T02:27:10.511 INFO:tasks.workunit.client.0.smithi114.stdout:4/459: write d3/d14/f3b [3053028,66620] 0 2024-04-25T02:27:10.515 INFO:tasks.workunit.client.0.smithi114.stdout:6/632: unlink de/d27/c2c 0 2024-04-25T02:27:10.517 INFO:tasks.workunit.client.0.smithi114.stdout:1/518: creat df/d2a/d34/d77/fb1 x:0 0 0 2024-04-25T02:27:10.517 INFO:tasks.workunit.client.0.smithi114.stdout:4/460: dwrite d3/d14/f3b [0,4194304] 0 2024-04-25T02:27:10.518 INFO:tasks.workunit.client.0.smithi114.stdout:8/548: mkdir da/d38/d62/d6d/d52/da8/da9 0 2024-04-25T02:27:10.519 INFO:tasks.workunit.client.0.smithi114.stdout:8/549: readlink da/l23 0 2024-04-25T02:27:10.520 INFO:tasks.workunit.client.0.smithi114.stdout:7/611: symlink d5/d32/d4a/dbc/lc3 0 2024-04-25T02:27:10.521 INFO:tasks.workunit.client.0.smithi114.stdout:1/519: read - df/d11/d25/d33/d47/d9d/faf zero size 2024-04-25T02:27:10.523 INFO:tasks.workunit.client.0.smithi114.stdout:1/520: dread - df/d11/d6c/d82/fa3 zero size 2024-04-25T02:27:10.523 INFO:tasks.workunit.client.0.smithi114.stdout:6/633: dwrite de/d30/f43 [4194304,4194304] 0 2024-04-25T02:27:10.524 INFO:tasks.workunit.client.0.smithi114.stdout:1/521: fsync df/d13/d75/faa 0 2024-04-25T02:27:10.526 INFO:tasks.workunit.client.0.smithi114.stdout:5/593: link d1/d6/d4f/d6c/d88/fb5 d1/d3e/d60/fc6 0 2024-04-25T02:27:10.528 INFO:tasks.workunit.client.0.smithi114.stdout:8/550: rmdir da/d38/d62/d6d/d52 39 2024-04-25T02:27:10.531 INFO:tasks.workunit.client.0.smithi114.stdout:7/612: creat d5/d8b/d99/fc4 x:0 0 0 2024-04-25T02:27:10.532 INFO:tasks.workunit.client.0.smithi114.stdout:9/539: write d8/d16/d21/d83/d39/f35 [659521,51862] 0 2024-04-25T02:27:10.533 INFO:tasks.workunit.client.0.smithi114.stdout:9/540: fdatasync d8/f42 0 2024-04-25T02:27:10.534 INFO:tasks.workunit.client.0.smithi114.stdout:0/516: sync 2024-04-25T02:27:10.535 INFO:tasks.workunit.client.0.smithi114.stdout:5/594: dwrite d1/d6/d1a/f9f [0,4194304] 0 2024-04-25T02:27:10.537 INFO:tasks.workunit.client.0.smithi114.stdout:1/522: truncate df/d11/d25/f37 923614 0 2024-04-25T02:27:10.537 INFO:tasks.workunit.client.0.smithi114.stdout:3/505: dread d0/d5/f53 [0,4194304] 0 2024-04-25T02:27:10.537 INFO:tasks.workunit.client.0.smithi114.stdout:9/541: stat d8/d16/d21/d37/d43/d75/d8a/c8f 0 2024-04-25T02:27:10.537 INFO:tasks.workunit.client.0.smithi114.stdout:5/595: chown d1/d6/d1a/f7e 0 1 2024-04-25T02:27:10.540 INFO:tasks.workunit.client.0.smithi114.stdout:0/517: creat d1/d7/d18/f9f x:0 0 0 2024-04-25T02:27:10.540 INFO:tasks.workunit.client.0.smithi114.stdout:5/596: stat d1/d3e/d60/d82 0 2024-04-25T02:27:10.540 INFO:tasks.workunit.client.0.smithi114.stdout:9/542: read - d8/d16/d21/f9f zero size 2024-04-25T02:27:10.543 INFO:tasks.workunit.client.0.smithi114.stdout:0/518: dread - d1/d30/f75 zero size 2024-04-25T02:27:10.543 INFO:tasks.workunit.client.0.smithi114.stdout:7/613: getdents d5/d19/d1a/da4/db3 0 2024-04-25T02:27:10.544 INFO:tasks.workunit.client.0.smithi114.stdout:2/591: dread d5/df/d63/f7b [4194304,4194304] 0 2024-04-25T02:27:10.544 INFO:tasks.workunit.client.0.smithi114.stdout:5/597: chown d1/d53/d55/l8b 1 1 2024-04-25T02:27:10.547 INFO:tasks.workunit.client.0.smithi114.stdout:7/614: chown d5/d32/f2f 1688 1 2024-04-25T02:27:10.547 INFO:tasks.workunit.client.0.smithi114.stdout:4/461: write d3/d14/f37 [2573610,65898] 0 2024-04-25T02:27:10.548 INFO:tasks.workunit.client.0.smithi114.stdout:0/519: mkdir d1/d4/d62/d83/da0 0 2024-04-25T02:27:10.548 INFO:tasks.workunit.client.0.smithi114.stdout:8/551: dwrite da/d38/d62/d6d/d52/d6c/f9a [0,4194304] 0 2024-04-25T02:27:10.548 INFO:tasks.workunit.client.0.smithi114.stdout:3/506: dread d0/d25/fb7 [0,4194304] 0 2024-04-25T02:27:10.552 INFO:tasks.workunit.client.0.smithi114.stdout:3/507: fdatasync d0/f3b 0 2024-04-25T02:27:10.553 INFO:tasks.workunit.client.0.smithi114.stdout:1/523: dwrite df/d11/d6c/f95 [0,4194304] 0 2024-04-25T02:27:10.554 INFO:tasks.workunit.client.0.smithi114.stdout:8/552: unlink da/f86 0 2024-04-25T02:27:10.555 INFO:tasks.workunit.client.0.smithi114.stdout:7/615: write d5/d32/d4a/d51/f95 [1105511,64115] 0 2024-04-25T02:27:10.555 INFO:tasks.workunit.client.0.smithi114.stdout:2/592: truncate d5/f1d 1776532 0 2024-04-25T02:27:10.557 INFO:tasks.workunit.client.0.smithi114.stdout:0/520: mkdir d1/d4/d4f/d77/da1 0 2024-04-25T02:27:10.557 INFO:tasks.workunit.client.0.smithi114.stdout:9/543: dwrite d8/d16/d21/f26 [0,4194304] 0 2024-04-25T02:27:10.558 INFO:tasks.workunit.client.0.smithi114.stdout:2/593: fsync d5/df/d3d/d44/f56 0 2024-04-25T02:27:10.559 INFO:tasks.workunit.client.0.smithi114.stdout:0/521: fsync d1/d4/da/f7b 0 2024-04-25T02:27:10.560 INFO:tasks.workunit.client.0.smithi114.stdout:9/544: chown d8/d16/d21/d83/d39/f62 8597 1 2024-04-25T02:27:10.561 INFO:tasks.workunit.client.0.smithi114.stdout:0/522: dread - d1/d4/f8a zero size 2024-04-25T02:27:10.562 INFO:tasks.workunit.client.0.smithi114.stdout:0/523: stat d1/f2c 0 2024-04-25T02:27:10.562 INFO:tasks.workunit.client.0.smithi114.stdout:6/634: dread de/d30/f62 [0,4194304] 0 2024-04-25T02:27:10.563 INFO:tasks.workunit.client.0.smithi114.stdout:4/462: rename d3/d8/d12/d19/d26/d3e/d7e to d3/d8/d23/d35/d89 0 2024-04-25T02:27:10.563 INFO:tasks.workunit.client.0.smithi114.stdout:1/524: dread df/d11/d25/d33/d47/f9e [0,4194304] 0 2024-04-25T02:27:10.564 INFO:tasks.workunit.client.0.smithi114.stdout:7/616: write d5/d19/d1a/f38 [1124126,32866] 0 2024-04-25T02:27:10.565 INFO:tasks.workunit.client.0.smithi114.stdout:7/617: write d5/d43/d63/d7a/fb8 [168903,14800] 0 2024-04-25T02:27:10.570 INFO:tasks.workunit.client.0.smithi114.stdout:2/594: mkdir d5/d1c/d21/dc3 0 2024-04-25T02:27:10.572 INFO:tasks.workunit.client.0.smithi114.stdout:9/545: mknod d8/d16/d21/d95/cb8 0 2024-04-25T02:27:10.574 INFO:tasks.workunit.client.0.smithi114.stdout:9/546: chown d8/d16/d21/d24/d3c/f6b 27044 1 2024-04-25T02:27:10.575 INFO:tasks.workunit.client.0.smithi114.stdout:1/525: fdatasync df/d13/f83 0 2024-04-25T02:27:10.575 INFO:tasks.workunit.client.0.smithi114.stdout:1/526: chown df/d2a/f46 13918 1 2024-04-25T02:27:10.576 INFO:tasks.workunit.client.0.smithi114.stdout:5/598: link d1/d6/d1a/c38 d1/d53/d55/db1/cc7 0 2024-04-25T02:27:10.576 INFO:tasks.workunit.client.0.smithi114.stdout:7/618: write d5/d19/d1a/fb2 [209495,69986] 0 2024-04-25T02:27:10.577 INFO:tasks.workunit.client.0.smithi114.stdout:1/527: truncate df/d2a/f70 206806 0 2024-04-25T02:27:10.581 INFO:tasks.workunit.client.0.smithi114.stdout:0/524: rename d1/d4/d37/d42 to d1/d4/d24/d52/da2 0 2024-04-25T02:27:10.582 INFO:tasks.workunit.client.0.smithi114.stdout:0/525: stat d1/d7/d68 0 2024-04-25T02:27:10.582 INFO:tasks.workunit.client.0.smithi114.stdout:2/595: dwrite d5/df/f53 [0,4194304] 0 2024-04-25T02:27:10.583 INFO:tasks.workunit.client.0.smithi114.stdout:2/596: stat d5/daf 0 2024-04-25T02:27:10.583 INFO:tasks.workunit.client.0.smithi114.stdout:5/599: unlink d1/d6/d1a/d7f/fa4 0 2024-04-25T02:27:10.583 INFO:tasks.workunit.client.0.smithi114.stdout:0/526: write d1/d4/d24/f5e [3371021,118503] 0 2024-04-25T02:27:10.583 INFO:tasks.workunit.client.0.smithi114.stdout:4/463: dread d3/d8/d23/d25/f66 [0,4194304] 0 2024-04-25T02:27:10.584 INFO:tasks.workunit.client.0.smithi114.stdout:3/508: getdents d0/d25/d29/d85 0 2024-04-25T02:27:10.586 INFO:tasks.workunit.client.0.smithi114.stdout:7/619: write d5/d32/d4a/d87/fb6 [2273928,64042] 0 2024-04-25T02:27:10.587 INFO:tasks.workunit.client.0.smithi114.stdout:0/527: write d1/d7/d18/d2e/d8f/f61 [524226,56204] 0 2024-04-25T02:27:10.588 INFO:tasks.workunit.client.0.smithi114.stdout:8/553: getdents da/d1e 0 2024-04-25T02:27:10.588 INFO:tasks.workunit.client.0.smithi114.stdout:3/509: write d0/d25/d2a/d36/f5e [2645513,118285] 0 2024-04-25T02:27:10.589 INFO:tasks.workunit.client.0.smithi114.stdout:7/620: write d5/d19/d1a/f36 [1162872,64622] 0 2024-04-25T02:27:10.590 INFO:tasks.workunit.client.0.smithi114.stdout:0/528: stat d1/d4/d37/d6a/f81 0 2024-04-25T02:27:10.590 INFO:tasks.workunit.client.0.smithi114.stdout:3/510: dread - d0/d25/d29/d78/f82 zero size 2024-04-25T02:27:10.591 INFO:tasks.workunit.client.0.smithi114.stdout:7/621: chown d5/d32/d64/f67 441677 1 2024-04-25T02:27:10.592 INFO:tasks.workunit.client.0.smithi114.stdout:7/622: chown d5/d19/d23/d6f/f9b 492242407 1 2024-04-25T02:27:10.594 INFO:tasks.workunit.client.0.smithi114.stdout:7/623: write d5/d19/f45 [559848,60278] 0 2024-04-25T02:27:10.595 INFO:tasks.workunit.client.0.smithi114.stdout:8/554: dwrite da/ff [0,4194304] 0 2024-04-25T02:27:10.602 INFO:tasks.workunit.client.0.smithi114.stdout:3/511: mkdir d0/d25/d2a/d36/dbb 0 2024-04-25T02:27:10.604 INFO:tasks.workunit.client.0.smithi114.stdout:5/600: mkdir d1/d6/d4f/d6c/d88/db6/dc8 0 2024-04-25T02:27:10.604 INFO:tasks.workunit.client.0.smithi114.stdout:6/635: dwrite de/d25/dad/fca [4194304,4194304] 0 2024-04-25T02:27:10.605 INFO:tasks.workunit.client.0.smithi114.stdout:8/555: rmdir da/d38/d62/d6d/d49/d65 39 2024-04-25T02:27:10.607 INFO:tasks.workunit.client.0.smithi114.stdout:8/556: readlink da/d69/d93/d40/l4a 0 2024-04-25T02:27:10.608 INFO:tasks.workunit.client.0.smithi114.stdout:3/512: stat d0/d5/d3d/f54 0 2024-04-25T02:27:10.608 INFO:tasks.workunit.client.0.smithi114.stdout:8/557: readlink da/d1e/l50 0 2024-04-25T02:27:10.609 INFO:tasks.workunit.client.0.smithi114.stdout:1/528: dread df/d11/d25/d33/f58 [0,4194304] 0 2024-04-25T02:27:10.610 INFO:tasks.workunit.client.0.smithi114.stdout:1/529: chown df/d2a/d34/c40 0 1 2024-04-25T02:27:10.610 INFO:tasks.workunit.client.0.smithi114.stdout:3/513: chown d0/d25/d29/d85/d7e/da9/dad/db5 6100711 1 2024-04-25T02:27:10.611 INFO:tasks.workunit.client.0.smithi114.stdout:6/636: dwrite de/d30/f72 [0,4194304] 0 2024-04-25T02:27:10.611 INFO:tasks.workunit.client.0.smithi114.stdout:2/597: link d5/d1c/d22/cb1 d5/d1c/d22/cc4 0 2024-04-25T02:27:10.613 INFO:tasks.workunit.client.0.smithi114.stdout:4/464: rename d3/l67 to d3/d8/d23/l8a 0 2024-04-25T02:27:10.614 INFO:tasks.workunit.client.0.smithi114.stdout:3/514: fdatasync d0/f1d 0 2024-04-25T02:27:10.614 INFO:tasks.workunit.client.0.smithi114.stdout:1/530: creat df/d11/d6c/d82/fb2 x:0 0 0 2024-04-25T02:27:10.615 INFO:tasks.workunit.client.0.smithi114.stdout:6/637: mknod de/d27/d34/d44/d91/ce0 0 2024-04-25T02:27:10.615 INFO:tasks.workunit.client.0.smithi114.stdout:3/515: readlink d0/d25/d2a/d34/l69 0 2024-04-25T02:27:10.616 INFO:tasks.workunit.client.0.smithi114.stdout:8/558: symlink da/d38/d62/d6d/laa 0 2024-04-25T02:27:10.616 INFO:tasks.workunit.client.0.smithi114.stdout:2/598: mknod d5/d1c/d21/db0/cc5 0 2024-04-25T02:27:10.616 INFO:tasks.workunit.client.0.smithi114.stdout:4/465: truncate d3/d14/f64 93655 0 2024-04-25T02:27:10.617 INFO:tasks.workunit.client.0.smithi114.stdout:2/599: chown d5/d1c/d22/d67 448 1 2024-04-25T02:27:10.617 INFO:tasks.workunit.client.0.smithi114.stdout:4/466: fdatasync d3/d8/f1b 0 2024-04-25T02:27:10.618 INFO:tasks.workunit.client.0.smithi114.stdout:1/531: rename df/d11/f20 to df/d11/d6c/fb3 0 2024-04-25T02:27:10.618 INFO:tasks.workunit.client.0.smithi114.stdout:3/516: mknod d0/d25/d29/d8c/cbc 0 2024-04-25T02:27:10.638 INFO:tasks.workunit.client.0.smithi114.stdout:1/532: stat df/d11/d25/d43/f54 0 2024-04-25T02:27:10.640 INFO:tasks.workunit.client.0.smithi114.stdout:7/624: write d5/f9 [2655862,53350] 0 2024-04-25T02:27:10.642 INFO:tasks.workunit.client.0.smithi114.stdout:3/517: mkdir d0/d25/d2a/d80/dbd 0 2024-04-25T02:27:10.643 INFO:tasks.workunit.client.0.smithi114.stdout:0/529: dread d1/d7/f28 [4194304,4194304] 0 2024-04-25T02:27:10.644 INFO:tasks.workunit.client.0.smithi114.stdout:8/559: dwrite da/d1d/f9f [0,4194304] 0 2024-04-25T02:27:10.645 INFO:tasks.workunit.client.0.smithi114.stdout:1/533: write df/d13/d1e/d3e/fa7 [222983,130266] 0 2024-04-25T02:27:10.646 INFO:tasks.workunit.client.0.smithi114.stdout:7/625: symlink d5/d19/d1a/da4/lc5 0 2024-04-25T02:27:10.647 INFO:tasks.workunit.client.0.smithi114.stdout:8/560: chown da/d32/f61 726 1 2024-04-25T02:27:10.648 INFO:tasks.workunit.client.0.smithi114.stdout:2/600: dread d5/df/d63/fa8 [0,4194304] 0 2024-04-25T02:27:10.649 INFO:tasks.workunit.client.0.smithi114.stdout:4/467: dwrite d3/d8/d12/d19/f85 [4194304,4194304] 0 2024-04-25T02:27:10.649 INFO:tasks.workunit.client.0.smithi114.stdout:3/518: fsync d0/d25/d2a/d34/f7d 0 2024-04-25T02:27:10.650 INFO:tasks.workunit.client.0.smithi114.stdout:0/530: creat d1/d4/d62/d83/fa3 x:0 0 0 2024-04-25T02:27:10.651 INFO:tasks.workunit.client.0.smithi114.stdout:8/561: chown da/d1e/f96 30011286 1 2024-04-25T02:27:10.652 INFO:tasks.workunit.client.0.smithi114.stdout:2/601: write d5/df/d1e/f25 [5868316,89599] 0 2024-04-25T02:27:10.652 INFO:tasks.workunit.client.0.smithi114.stdout:5/601: dread d1/d6/de/f1d [0,4194304] 0 2024-04-25T02:27:10.652 INFO:tasks.workunit.client.0.smithi114.stdout:2/602: readlink d5/lac 0 2024-04-25T02:27:10.653 INFO:tasks.workunit.client.0.smithi114.stdout:0/531: write d1/d4/da/f73 [162814,54337] 0 2024-04-25T02:27:10.653 INFO:tasks.workunit.client.0.smithi114.stdout:1/534: mknod df/d11/d7d/d92/da9/cb4 0 2024-04-25T02:27:10.656 INFO:tasks.workunit.client.0.smithi114.stdout:7/626: rename d5/d32/d64/fb1 to d5/d8b/fc6 0 2024-04-25T02:27:10.656 INFO:tasks.workunit.client.0.smithi114.stdout:0/532: dread - d1/d4/da/d39/f99 zero size 2024-04-25T02:27:10.656 INFO:tasks.workunit.client.0.smithi114.stdout:4/468: mknod d3/d8/d30/d6e/c8b 0 2024-04-25T02:27:10.660 INFO:tasks.workunit.client.0.smithi114.stdout:3/519: dwrite d0/d25/d2a/fb8 [0,4194304] 0 2024-04-25T02:27:10.661 INFO:tasks.workunit.client.0.smithi114.stdout:7/627: getdents d5/dbf 0 2024-04-25T02:27:10.664 INFO:tasks.workunit.client.0.smithi114.stdout:9/547: sync 2024-04-25T02:27:10.664 INFO:tasks.workunit.client.0.smithi114.stdout:7/628: chown d5/c13 581470 1 2024-04-25T02:27:10.664 INFO:tasks.workunit.client.0.smithi114.stdout:3/520: chown d0/d25/d29/c87 2382 1 2024-04-25T02:27:10.664 INFO:tasks.workunit.client.0.smithi114.stdout:2/603: dread d5/df/d2c/f73 [0,4194304] 0 2024-04-25T02:27:10.667 INFO:tasks.workunit.client.0.smithi114.stdout:1/535: dwrite df/d11/d25/d33/d47/d9d/fa1 [4194304,4194304] 0 2024-04-25T02:27:10.669 INFO:tasks.workunit.client.0.smithi114.stdout:2/604: chown d5/d1c/d21/l9c 15405308 1 2024-04-25T02:27:10.669 INFO:tasks.workunit.client.0.smithi114.stdout:3/521: dread d0/f81 [0,4194304] 0 2024-04-25T02:27:10.671 INFO:tasks.workunit.client.0.smithi114.stdout:0/533: dwrite d1/d4/d37/d6a/f81 [0,4194304] 0 2024-04-25T02:27:10.671 INFO:tasks.workunit.client.0.smithi114.stdout:9/548: creat d8/d16/d21/d83/d39/d38/d5d/fb9 x:0 0 0 2024-04-25T02:27:10.672 INFO:tasks.workunit.client.0.smithi114.stdout:7/629: fsync d5/d19/f2c 0 2024-04-25T02:27:10.672 INFO:tasks.workunit.client.0.smithi114.stdout:3/522: readlink d0/d25/d29/d60/l71 0 2024-04-25T02:27:10.673 INFO:tasks.workunit.client.0.smithi114.stdout:2/605: write d5/df/f12 [414644,79747] 0 2024-04-25T02:27:10.673 INFO:tasks.workunit.client.0.smithi114.stdout:1/536: rmdir df/d13/d1e/d3e/d7b 39 2024-04-25T02:27:10.675 INFO:tasks.workunit.client.0.smithi114.stdout:0/534: write d1/d4/d24/f47 [3919349,3259] 0 2024-04-25T02:27:10.675 INFO:tasks.workunit.client.0.smithi114.stdout:3/523: read - d0/d5/d3d/fa5 zero size 2024-04-25T02:27:10.676 INFO:tasks.workunit.client.0.smithi114.stdout:1/537: stat df/d11/d25/f37 0 2024-04-25T02:27:10.676 INFO:tasks.workunit.client.0.smithi114.stdout:5/602: dread d1/d25/f1f [0,4194304] 0 2024-04-25T02:27:10.677 INFO:tasks.workunit.client.0.smithi114.stdout:5/603: stat d1/d25/dbe 0 2024-04-25T02:27:10.677 INFO:tasks.workunit.client.0.smithi114.stdout:5/604: fdatasync d1/d6/f3c 0 2024-04-25T02:27:10.678 INFO:tasks.workunit.client.0.smithi114.stdout:9/549: read d8/d16/d21/d83/d39/d38/d46/d53/da2/fad [443523,31903] 0 2024-04-25T02:27:10.679 INFO:tasks.workunit.client.0.smithi114.stdout:9/550: truncate d8/d16/d21/d83/d39/d38/d5d/fb9 478454 0 2024-04-25T02:27:10.685 INFO:tasks.workunit.client.0.smithi114.stdout:5/605: unlink d1/d6/de/d75/fa6 0 2024-04-25T02:27:10.690 INFO:tasks.workunit.client.0.smithi114.stdout:2/606: rename d5/d1c/d29/c65 to d5/d1c/cc6 0 2024-04-25T02:27:10.691 INFO:tasks.workunit.client.0.smithi114.stdout:9/551: link d8/d16/c19 d8/d16/d21/d24/d69/cba 0 2024-04-25T02:27:10.693 INFO:tasks.workunit.client.0.smithi114.stdout:9/552: symlink d8/d16/lbb 0 2024-04-25T02:27:10.694 INFO:tasks.workunit.client.0.smithi114.stdout:5/606: dwrite d1/d6/d1a/f7e [0,4194304] 0 2024-04-25T02:27:10.694 INFO:tasks.workunit.client.0.smithi114.stdout:9/553: stat d8/f74 0 2024-04-25T02:27:10.696 INFO:tasks.workunit.client.0.smithi114.stdout:2/607: dread d5/df/d2c/d66/fa5 [0,4194304] 0 2024-04-25T02:27:10.696 INFO:tasks.workunit.client.0.smithi114.stdout:5/607: readlink d1/d25/d24/l62 0 2024-04-25T02:27:10.697 INFO:tasks.workunit.client.0.smithi114.stdout:9/554: mkdir d8/da8/dbc 0 2024-04-25T02:27:10.697 INFO:tasks.workunit.client.0.smithi114.stdout:2/608: write d5/d1c/d22/f28 [1757911,10577] 0 2024-04-25T02:27:10.704 INFO:tasks.workunit.client.0.smithi114.stdout:5/608: creat d1/d6/d4f/d6c/d88/db6/dc8/fc9 x:0 0 0 2024-04-25T02:27:10.704 INFO:tasks.workunit.client.0.smithi114.stdout:2/609: dwrite d5/d6/d31/d6a/f7f [0,4194304] 0 2024-04-25T02:27:10.706 INFO:tasks.workunit.client.0.smithi114.stdout:4/469: truncate d3/d8/d23/d25/f2d 1048994 0 2024-04-25T02:27:10.709 INFO:tasks.workunit.client.0.smithi114.stdout:9/555: dread d8/d16/d21/d83/d39/d38/f80 [0,4194304] 0 2024-04-25T02:27:10.709 INFO:tasks.workunit.client.0.smithi114.stdout:5/609: rename d1/d3e/f5b to d1/d53/d55/dae/dc1/fca 0 2024-04-25T02:27:10.711 INFO:tasks.workunit.client.0.smithi114.stdout:2/610: truncate d5/f1d 2045166 0 2024-04-25T02:27:10.712 INFO:tasks.workunit.client.0.smithi114.stdout:4/470: mknod d3/d8/d12/d19/d42/d58/c8c 0 2024-04-25T02:27:10.713 INFO:tasks.workunit.client.0.smithi114.stdout:2/611: chown d5/df/d1e/l8a 0 1 2024-04-25T02:27:10.714 INFO:tasks.workunit.client.0.smithi114.stdout:2/612: readlink d5/d1c/d21/l9c 0 2024-04-25T02:27:10.715 INFO:tasks.workunit.client.0.smithi114.stdout:7/630: dread d5/d32/d4a/d51/f6b [0,4194304] 0 2024-04-25T02:27:10.717 INFO:tasks.workunit.client.0.smithi114.stdout:2/613: write d5/fe [4698484,117881] 0 2024-04-25T02:27:10.717 INFO:tasks.workunit.client.0.smithi114.stdout:3/524: dread d0/f38 [0,4194304] 0 2024-04-25T02:27:10.718 INFO:tasks.workunit.client.0.smithi114.stdout:7/631: unlink d5/d32/c3e 0 2024-04-25T02:27:10.719 INFO:tasks.workunit.client.0.smithi114.stdout:9/556: dwrite d8/d16/d21/d83/d39/f35 [0,4194304] 0 2024-04-25T02:27:10.719 INFO:tasks.workunit.client.0.smithi114.stdout:6/638: sync 2024-04-25T02:27:10.720 INFO:tasks.workunit.client.0.smithi114.stdout:6/639: fdatasync f8 0 2024-04-25T02:27:10.721 INFO:tasks.workunit.client.0.smithi114.stdout:1/538: truncate df/d11/d25/f5d 1036775 0 2024-04-25T02:27:10.722 INFO:tasks.workunit.client.0.smithi114.stdout:3/525: chown d0/d25/d29/d60/l68 248587 1 2024-04-25T02:27:10.723 INFO:tasks.workunit.client.0.smithi114.stdout:7/632: symlink d5/d19/d1a/daf/lc7 0 2024-04-25T02:27:10.723 INFO:tasks.workunit.client.0.smithi114.stdout:9/557: write d8/d16/d21/f26 [2470072,63635] 0 2024-04-25T02:27:10.723 INFO:tasks.workunit.client.0.smithi114.stdout:1/539: fdatasync df/d2a/d34/d77/fb1 0 2024-04-25T02:27:10.725 INFO:tasks.workunit.client.0.smithi114.stdout:0/535: dwrite d1/d7/d18/d2e/f34 [0,4194304] 0 2024-04-25T02:27:10.727 INFO:tasks.workunit.client.0.smithi114.stdout:3/526: creat d0/d25/d29/fbe x:0 0 0 2024-04-25T02:27:10.731 INFO:tasks.workunit.client.0.smithi114.stdout:7/633: creat d5/d32/d4a/d51/fc8 x:0 0 0 2024-04-25T02:27:10.732 INFO:tasks.workunit.client.0.smithi114.stdout:9/558: rmdir d8/d16/d21/d24 39 2024-04-25T02:27:10.732 INFO:tasks.workunit.client.0.smithi114.stdout:7/634: read d5/d43/d4e/f9c [625105,20058] 0 2024-04-25T02:27:10.736 INFO:tasks.workunit.client.0.smithi114.stdout:1/540: rename df/d11/d6c/d82/fb2 to df/d13/d75/d8e/fb5 0 2024-04-25T02:27:10.736 INFO:tasks.workunit.client.0.smithi114.stdout:0/536: dread d1/d7/f1c [0,4194304] 0 2024-04-25T02:27:10.737 INFO:tasks.workunit.client.0.smithi114.stdout:0/537: readlink d1/d30/l53 0 2024-04-25T02:27:10.739 INFO:tasks.workunit.client.0.smithi114.stdout:6/640: link de/d27/d34/d38/fac de/d1c/fe1 0 2024-04-25T02:27:10.740 INFO:tasks.workunit.client.0.smithi114.stdout:9/559: readlink d8/d16/d21/d24/d3c/l63 0 2024-04-25T02:27:10.741 INFO:tasks.workunit.client.0.smithi114.stdout:1/541: dwrite df/d11/f24 [0,4194304] 0 2024-04-25T02:27:10.742 INFO:tasks.workunit.client.0.smithi114.stdout:7/635: rmdir d5/d32/d4a/d87 39 2024-04-25T02:27:10.743 INFO:tasks.workunit.client.0.smithi114.stdout:1/542: truncate df/d11/d6c/d82/fa3 201292 0 2024-04-25T02:27:10.746 INFO:tasks.workunit.client.0.smithi114.stdout:0/538: symlink d1/d4/d24/d52/la4 0 2024-04-25T02:27:10.748 INFO:tasks.workunit.client.0.smithi114.stdout:4/471: write d3/d8/d12/d19/f1a [349354,37655] 0 2024-04-25T02:27:10.748 INFO:tasks.workunit.client.0.smithi114.stdout:0/539: chown d1/f27 1564500 1 2024-04-25T02:27:10.749 INFO:tasks.workunit.client.0.smithi114.stdout:6/641: creat de/d30/fe2 x:0 0 0 2024-04-25T02:27:10.750 INFO:tasks.workunit.client.0.smithi114.stdout:7/636: dwrite d5/d19/d1a/d80/fa2 [0,4194304] 0 2024-04-25T02:27:10.751 INFO:tasks.workunit.client.0.smithi114.stdout:9/560: creat d8/d16/d21/d83/d39/d38/d46/d96/fbd x:0 0 0 2024-04-25T02:27:10.751 INFO:tasks.workunit.client.0.smithi114.stdout:4/472: write d3/d14/f53 [783007,84551] 0 2024-04-25T02:27:10.753 INFO:tasks.workunit.client.0.smithi114.stdout:5/610: dwrite d1/d6/de/f44 [4194304,4194304] 0 2024-04-25T02:27:10.755 INFO:tasks.workunit.client.0.smithi114.stdout:1/543: creat df/d11/d25/d33/d47/d9d/fb6 x:0 0 0 2024-04-25T02:27:10.758 INFO:tasks.workunit.client.0.smithi114.stdout:0/540: mknod d1/d4/d24/d52/ca5 0 2024-04-25T02:27:10.758 INFO:tasks.workunit.client.0.smithi114.stdout:4/473: read d3/d8/f2c [3159771,45249] 0 2024-04-25T02:27:10.759 INFO:tasks.workunit.client.0.smithi114.stdout:8/562: sync 2024-04-25T02:27:10.760 INFO:tasks.workunit.client.0.smithi114.stdout:0/541: write d1/d30/f75 [1013869,89934] 0 2024-04-25T02:27:10.762 INFO:tasks.workunit.client.0.smithi114.stdout:6/642: dwrite de/d25/d39/d47/d90/d93/d99/faa [0,4194304] 0 2024-04-25T02:27:10.763 INFO:tasks.workunit.client.0.smithi114.stdout:1/544: dread df/d11/d6c/f95 [0,4194304] 0 2024-04-25T02:27:10.764 INFO:tasks.workunit.client.0.smithi114.stdout:1/545: write df/d13/f56 [5520902,92111] 0 2024-04-25T02:27:10.765 INFO:tasks.workunit.client.0.smithi114.stdout:1/546: stat df/d13/d1e/d3e/f69 0 2024-04-25T02:27:10.767 INFO:tasks.workunit.client.0.smithi114.stdout:5/611: rename d1/d6/f3c to d1/d6/d4f/d6c/fcb 0 2024-04-25T02:27:10.770 INFO:tasks.workunit.client.0.smithi114.stdout:5/612: readlink d1/d6/d4f/d6c/d88/db6/lbb 0 2024-04-25T02:27:10.771 INFO:tasks.workunit.client.0.smithi114.stdout:2/614: dread d5/df/f14 [0,4194304] 0 2024-04-25T02:27:10.772 INFO:tasks.workunit.client.0.smithi114.stdout:8/563: symlink da/d69/lab 0 2024-04-25T02:27:10.773 INFO:tasks.workunit.client.0.smithi114.stdout:1/547: dwrite df/f19 [4194304,4194304] 0 2024-04-25T02:27:10.774 INFO:tasks.workunit.client.0.smithi114.stdout:2/615: readlink d5/d6/d58/lba 0 2024-04-25T02:27:10.777 INFO:tasks.workunit.client.0.smithi114.stdout:6/643: fsync de/d25/d39/f7b 0 2024-04-25T02:27:10.777 INFO:tasks.workunit.client.0.smithi114.stdout:9/561: mkdir d8/d16/d21/dbe 0 2024-04-25T02:27:10.778 INFO:tasks.workunit.client.0.smithi114.stdout:3/527: dwrite d0/f19 [4194304,4194304] 0 2024-04-25T02:27:10.780 INFO:tasks.workunit.client.0.smithi114.stdout:3/528: chown d0/d25/f73 755605 1 2024-04-25T02:27:10.781 INFO:tasks.workunit.client.0.smithi114.stdout:0/542: rename d1/d7/f14 to d1/d4/d4f/d77/fa6 0 2024-04-25T02:27:10.782 INFO:tasks.workunit.client.0.smithi114.stdout:5/613: dwrite d1/d53/f7c [0,4194304] 0 2024-04-25T02:27:10.782 INFO:tasks.workunit.client.0.smithi114.stdout:0/543: fdatasync d1/d4/f86 0 2024-04-25T02:27:10.784 INFO:tasks.workunit.client.0.smithi114.stdout:8/564: creat da/d38/d62/d6d/d52/d6c/fac x:0 0 0 2024-04-25T02:27:10.785 INFO:tasks.workunit.client.0.smithi114.stdout:2/616: creat d5/df/d3d/d44/fc7 x:0 0 0 2024-04-25T02:27:10.786 INFO:tasks.workunit.client.0.smithi114.stdout:9/562: creat d8/da8/fbf x:0 0 0 2024-04-25T02:27:10.788 INFO:tasks.workunit.client.0.smithi114.stdout:6/644: creat de/d25/d39/d5c/fe3 x:0 0 0 2024-04-25T02:27:10.789 INFO:tasks.workunit.client.0.smithi114.stdout:3/529: mknod d0/d5/cbf 0 2024-04-25T02:27:10.790 INFO:tasks.workunit.client.0.smithi114.stdout:4/474: mkdir d3/d8/d30/d4c/d7f/d8d 0 2024-04-25T02:27:10.790 INFO:tasks.workunit.client.0.smithi114.stdout:3/530: dread d0/d25/fb7 [0,4194304] 0 2024-04-25T02:27:10.793 INFO:tasks.workunit.client.0.smithi114.stdout:1/548: rename df/d11/d25/f27 to df/d11/d25/d33/d47/fb7 0 2024-04-25T02:27:10.797 INFO:tasks.workunit.client.0.smithi114.stdout:2/617: write d5/d6/d58/d5a/d3e/f49 [4356677,70641] 0 2024-04-25T02:27:10.801 INFO:tasks.workunit.client.0.smithi114.stdout:1/549: rmdir df/d11/d7d/d92/da9 39 2024-04-25T02:27:10.804 INFO:tasks.workunit.client.0.smithi114.stdout:9/563: unlink d8/d16/d21/d37/d60/d70/la7 0 2024-04-25T02:27:10.805 INFO:tasks.workunit.client.0.smithi114.stdout:9/564: stat d8/d16/d21/d83/d39/f23 0 2024-04-25T02:27:10.805 INFO:tasks.workunit.client.0.smithi114.stdout:9/565: fdatasync d8/fb 0 2024-04-25T02:27:10.806 INFO:tasks.workunit.client.0.smithi114.stdout:9/566: chown d8/d16/d21/d24/f47 22901 1 2024-04-25T02:27:10.811 INFO:tasks.workunit.client.0.smithi114.stdout:4/475: rename d3/d8/d23/f5f to d3/f8e 0 2024-04-25T02:27:10.812 INFO:tasks.workunit.client.0.smithi114.stdout:1/550: dread df/d11/d25/d33/d47/f9e [0,4194304] 0 2024-04-25T02:27:10.812 INFO:tasks.workunit.client.0.smithi114.stdout:8/565: getdents da/d1e/d58 0 2024-04-25T02:27:10.814 INFO:tasks.workunit.client.0.smithi114.stdout:9/567: dwrite d8/da8/fbf [0,4194304] 0 2024-04-25T02:27:10.819 INFO:tasks.workunit.client.0.smithi114.stdout:4/476: chown d3/d8/d12/d19/d26/d3e/d62/f75 475887 1 2024-04-25T02:27:10.819 INFO:tasks.workunit.client.0.smithi114.stdout:8/566: dread da/d1e/d58/f91 [0,4194304] 0 2024-04-25T02:27:10.819 INFO:tasks.workunit.client.0.smithi114.stdout:7/637: dwrite d5/d32/d4a/d91/f73 [0,4194304] 0 2024-04-25T02:27:10.821 INFO:tasks.workunit.client.0.smithi114.stdout:9/568: symlink d8/d16/d21/d37/d60/d70/lc0 0 2024-04-25T02:27:10.826 INFO:tasks.workunit.client.0.smithi114.stdout:5/614: write d1/d25/d24/f61 [760102,1290] 0 2024-04-25T02:27:10.827 INFO:tasks.workunit.client.0.smithi114.stdout:0/544: truncate d1/d7/d46/f87 3014587 0 2024-04-25T02:27:10.827 INFO:tasks.workunit.client.0.smithi114.stdout:3/531: write d0/d25/d2a/d34/f7d [271047,52262] 0 2024-04-25T02:27:10.827 INFO:tasks.workunit.client.0.smithi114.stdout:3/532: fsync d0/f49 0 2024-04-25T02:27:10.828 INFO:tasks.workunit.client.0.smithi114.stdout:5/615: read - d1/d6/d4f/f7a zero size 2024-04-25T02:27:10.829 INFO:tasks.workunit.client.0.smithi114.stdout:5/616: dread - d1/d3e/d60/fac zero size 2024-04-25T02:27:10.829 INFO:tasks.workunit.client.0.smithi114.stdout:6/645: truncate de/d27/f96 765354 0 2024-04-25T02:27:10.831 INFO:tasks.workunit.client.0.smithi114.stdout:8/567: symlink da/d38/d62/d6d/d49/lad 0 2024-04-25T02:27:10.832 INFO:tasks.workunit.client.0.smithi114.stdout:2/618: truncate d5/d1c/d22/f24 1800136 0 2024-04-25T02:27:10.832 INFO:tasks.workunit.client.0.smithi114.stdout:8/568: dread - da/d38/d62/d6d/d52/d6c/f8e zero size 2024-04-25T02:27:10.833 INFO:tasks.workunit.client.0.smithi114.stdout:0/545: mkdir d1/d4/da/d39/da7 0 2024-04-25T02:27:10.835 INFO:tasks.workunit.client.0.smithi114.stdout:3/533: unlink d0/d25/d29/la2 0 2024-04-25T02:27:10.836 INFO:tasks.workunit.client.0.smithi114.stdout:6/646: symlink de/d1c/le4 0 2024-04-25T02:27:10.840 INFO:tasks.workunit.client.0.smithi114.stdout:1/551: dwrite df/d11/d25/d43/f7a [4194304,4194304] 0 2024-04-25T02:27:10.841 INFO:tasks.workunit.client.0.smithi114.stdout:3/534: symlink d0/d5/d3d/lc0 0 2024-04-25T02:27:10.847 INFO:tasks.workunit.client.0.smithi114.stdout:0/546: mknod d1/d30/d98/ca8 0 2024-04-25T02:27:10.847 INFO:tasks.workunit.client.0.smithi114.stdout:4/477: write d3/d8/d23/d25/f2d [594010,21978] 0 2024-04-25T02:27:10.848 INFO:tasks.workunit.client.0.smithi114.stdout:0/547: write d1/d30/d4d/f4e [1422078,121021] 0 2024-04-25T02:27:10.851 INFO:tasks.workunit.client.0.smithi114.stdout:0/548: read d1/d4/ff [483219,72346] 0 2024-04-25T02:27:10.852 INFO:tasks.workunit.client.0.smithi114.stdout:1/552: chown df/c42 99970 1 2024-04-25T02:27:10.852 INFO:tasks.workunit.client.0.smithi114.stdout:0/549: stat d1/d4/da/d39 0 2024-04-25T02:27:10.852 INFO:tasks.workunit.client.0.smithi114.stdout:7/638: dread d5/d32/d64/f86 [0,4194304] 0 2024-04-25T02:27:10.852 INFO:tasks.workunit.client.0.smithi114.stdout:2/619: rmdir d5/d1c/d22 39 2024-04-25T02:27:10.853 INFO:tasks.workunit.client.0.smithi114.stdout:0/550: fdatasync d1/d4/f9e 0 2024-04-25T02:27:10.857 INFO:tasks.workunit.client.0.smithi114.stdout:9/569: dread d8/d16/d21/d24/f47 [0,4194304] 0 2024-04-25T02:27:10.858 INFO:tasks.workunit.client.0.smithi114.stdout:4/478: rmdir d3/d8/d30 39 2024-04-25T02:27:10.861 INFO:tasks.workunit.client.0.smithi114.stdout:5/617: truncate d1/d6/d1a/d7f/f89 446209 0 2024-04-25T02:27:10.863 INFO:tasks.workunit.client.0.smithi114.stdout:6/647: rename de/d27/d34/d38/c57 to de/d27/d34/d44/ce5 0 2024-04-25T02:27:10.864 INFO:tasks.workunit.client.0.smithi114.stdout:0/551: write d1/d7/fd [3542248,28369] 0 2024-04-25T02:27:10.864 INFO:tasks.workunit.client.0.smithi114.stdout:2/620: truncate d5/df/d2c/d66/fa5 3611419 0 2024-04-25T02:27:10.864 INFO:tasks.workunit.client.0.smithi114.stdout:0/552: chown d1/d7/f1c 2 1 2024-04-25T02:27:10.865 INFO:tasks.workunit.client.0.smithi114.stdout:2/621: stat d5/df/d3d/d44/dc0 0 2024-04-25T02:27:10.865 INFO:tasks.workunit.client.0.smithi114.stdout:8/569: getdents da/d38/d62 0 2024-04-25T02:27:10.865 INFO:tasks.workunit.client.0.smithi114.stdout:8/570: fdatasync da/d38/f75 0 2024-04-25T02:27:10.867 INFO:tasks.workunit.client.0.smithi114.stdout:0/553: truncate d1/d7/d18/d2e/f34 5238019 0 2024-04-25T02:27:10.867 INFO:tasks.workunit.client.0.smithi114.stdout:3/535: rmdir d0/d25/d29/d85/d7e/da9/dad/db5 0 2024-04-25T02:27:10.868 INFO:tasks.workunit.client.0.smithi114.stdout:5/618: creat d1/d53/d55/dae/dc1/fcc x:0 0 0 2024-04-25T02:27:10.870 INFO:tasks.workunit.client.0.smithi114.stdout:1/553: rename df/d13/d1e/d3e to df/d13/d75/db8 0 2024-04-25T02:27:10.871 INFO:tasks.workunit.client.0.smithi114.stdout:6/648: symlink de/d25/le6 0 2024-04-25T02:27:10.876 INFO:tasks.workunit.client.0.smithi114.stdout:6/649: dwrite de/d27/d34/d4b/f53 [0,4194304] 0 2024-04-25T02:27:10.878 INFO:tasks.workunit.client.0.smithi114.stdout:8/571: unlink da/d69/d93/f44 0 2024-04-25T02:27:10.879 INFO:tasks.workunit.client.0.smithi114.stdout:8/572: write da/d32/f61 [3455670,81434] 0 2024-04-25T02:27:10.879 INFO:tasks.workunit.client.0.smithi114.stdout:0/554: fsync d1/d7/f80 0 2024-04-25T02:27:10.883 INFO:tasks.workunit.client.0.smithi114.stdout:5/619: creat d1/d25/d24/fcd x:0 0 0 2024-04-25T02:27:10.886 INFO:tasks.workunit.client.0.smithi114.stdout:1/554: creat df/d13/d75/d8e/fb9 x:0 0 0 2024-04-25T02:27:10.890 INFO:tasks.workunit.client.0.smithi114.stdout:9/570: creat d8/d16/d21/d83/d39/d38/d46/d96/fc1 x:0 0 0 2024-04-25T02:27:10.892 INFO:tasks.workunit.client.0.smithi114.stdout:1/555: dwrite df/d2a/d34/f84 [0,4194304] 0 2024-04-25T02:27:10.894 INFO:tasks.workunit.client.0.smithi114.stdout:1/556: write df/d11/d25/d33/d47/d9d/fa1 [5346166,98775] 0 2024-04-25T02:27:10.894 INFO:tasks.workunit.client.0.smithi114.stdout:8/573: symlink da/d69/d93/d40/lae 0 2024-04-25T02:27:10.895 INFO:tasks.workunit.client.0.smithi114.stdout:1/557: readlink df/d11/d25/d33/d47/l4f 0 2024-04-25T02:27:10.897 INFO:tasks.workunit.client.0.smithi114.stdout:7/639: getdents d5/d19/d1a 0 2024-04-25T02:27:10.898 INFO:tasks.workunit.client.0.smithi114.stdout:3/536: mkdir d0/d25/d2a/dc1 0 2024-04-25T02:27:10.901 INFO:tasks.workunit.client.0.smithi114.stdout:0/555: dread d1/d4/d4f/d77/fa6 [0,4194304] 0 2024-04-25T02:27:10.902 INFO:tasks.workunit.client.0.smithi114.stdout:6/650: mkdir de/d25/d39/d47/de7 0 2024-04-25T02:27:10.905 INFO:tasks.workunit.client.0.smithi114.stdout:5/620: mkdir d1/d6/de/da7/dce 0 2024-04-25T02:27:10.907 INFO:tasks.workunit.client.0.smithi114.stdout:0/556: dwrite d1/d7/f56 [0,4194304] 0 2024-04-25T02:27:10.908 INFO:tasks.workunit.client.0.smithi114.stdout:0/557: write d1/f27 [2221540,94604] 0 2024-04-25T02:27:10.909 INFO:tasks.workunit.client.0.smithi114.stdout:7/640: rmdir d5/d32/d4a/d87 39 2024-04-25T02:27:10.910 INFO:tasks.workunit.client.0.smithi114.stdout:7/641: write d5/d32/d64/fac [354169,97764] 0 2024-04-25T02:27:10.911 INFO:tasks.workunit.client.0.smithi114.stdout:3/537: link d0/d5/d3d/f75 d0/d25/d2a/d80/dbd/fc2 0 2024-04-25T02:27:10.915 INFO:tasks.workunit.client.0.smithi114.stdout:4/479: rename d3/d8/d23/d35/f86 to d3/d8/d23/f8f 0 2024-04-25T02:27:10.918 INFO:tasks.workunit.client.0.smithi114.stdout:8/574: dread da/d1e/f3d [0,4194304] 0 2024-04-25T02:27:10.919 INFO:tasks.workunit.client.0.smithi114.stdout:6/651: link de/d2a/f73 de/d25/d39/d5c/fe8 0 2024-04-25T02:27:10.920 INFO:tasks.workunit.client.0.smithi114.stdout:0/558: mkdir d1/d4/d4f/da9 0 2024-04-25T02:27:10.920 INFO:tasks.workunit.client.0.smithi114.stdout:6/652: write de/d27/d34/d4b/f53 [1014086,84765] 0 2024-04-25T02:27:10.922 INFO:tasks.workunit.client.0.smithi114.stdout:7/642: symlink d5/d43/d63/lc9 0 2024-04-25T02:27:10.922 INFO:tasks.workunit.client.0.smithi114.stdout:7/643: readlink d5/d19/d23/l97 0 2024-04-25T02:27:10.923 INFO:tasks.workunit.client.0.smithi114.stdout:3/538: mkdir d0/d5/d3d/dc3 0 2024-04-25T02:27:10.924 INFO:tasks.workunit.client.0.smithi114.stdout:5/621: mkdir d1/d6/dcf 0 2024-04-25T02:27:10.925 INFO:tasks.workunit.client.0.smithi114.stdout:9/571: dwrite d8/d16/d21/d24/f47 [0,4194304] 0 2024-04-25T02:27:10.926 INFO:tasks.workunit.client.0.smithi114.stdout:3/539: truncate d0/d25/d2a/d80/f90 596582 0 2024-04-25T02:27:10.928 INFO:tasks.workunit.client.0.smithi114.stdout:1/558: write fc [4629052,31854] 0 2024-04-25T02:27:10.929 INFO:tasks.workunit.client.0.smithi114.stdout:0/559: creat d1/d7/d18/d2e/d8f/faa x:0 0 0 2024-04-25T02:27:10.931 INFO:tasks.workunit.client.0.smithi114.stdout:0/560: truncate d1/d4/d4f/f7f 694332 0 2024-04-25T02:27:10.936 INFO:tasks.workunit.client.0.smithi114.stdout:9/572: creat d8/d16/d21/d37/d43/d75/fc2 x:0 0 0 2024-04-25T02:27:10.938 INFO:tasks.workunit.client.0.smithi114.stdout:8/575: dread da/d38/d62/d6d/f51 [0,4194304] 0 2024-04-25T02:27:10.940 INFO:tasks.workunit.client.0.smithi114.stdout:5/622: truncate d1/d6/d1a/d7f/f89 112832 0 2024-04-25T02:27:10.942 INFO:tasks.workunit.client.0.smithi114.stdout:2/622: write d5/d1c/d22/d67/f6c [1620180,119648] 0 2024-04-25T02:27:10.942 INFO:tasks.workunit.client.0.smithi114.stdout:5/623: write d1/d6/de/f4b [1506043,113478] 0 2024-04-25T02:27:10.942 INFO:tasks.workunit.client.0.smithi114.stdout:6/653: creat de/d27/d34/fe9 x:0 0 0 2024-04-25T02:27:10.943 INFO:tasks.workunit.client.0.smithi114.stdout:9/573: rmdir d8/d16/d21 39 2024-04-25T02:27:10.945 INFO:tasks.workunit.client.0.smithi114.stdout:1/559: creat df/d13/d6e/d97/fba x:0 0 0 2024-04-25T02:27:10.946 INFO:tasks.workunit.client.0.smithi114.stdout:8/576: creat da/d69/faf x:0 0 0 2024-04-25T02:27:10.947 INFO:tasks.workunit.client.0.smithi114.stdout:0/561: symlink d1/d30/d4d/d9c/lab 0 2024-04-25T02:27:10.947 INFO:tasks.workunit.client.0.smithi114.stdout:3/540: write d0/d25/f5f [937599,88778] 0 2024-04-25T02:27:10.948 INFO:tasks.workunit.client.0.smithi114.stdout:0/562: stat d1/d4/d62/d83/f8c 0 2024-04-25T02:27:10.949 INFO:tasks.workunit.client.0.smithi114.stdout:7/644: write d5/d19/f34 [598568,12751] 0 2024-04-25T02:27:10.949 INFO:tasks.workunit.client.0.smithi114.stdout:3/541: truncate d0/d25/d29/d78/f82 366145 0 2024-04-25T02:27:10.950 INFO:tasks.workunit.client.0.smithi114.stdout:6/654: rename de/d1c/le4 to de/d25/dad/dde/lea 0 2024-04-25T02:27:10.954 INFO:tasks.workunit.client.0.smithi114.stdout:8/577: creat da/d69/fb0 x:0 0 0 2024-04-25T02:27:10.955 INFO:tasks.workunit.client.0.smithi114.stdout:0/563: dwrite d1/d4/d24/f47 [0,4194304] 0 2024-04-25T02:27:10.957 INFO:tasks.workunit.client.0.smithi114.stdout:9/574: truncate d8/d16/d21/d83/d39/d38/d46/f88 797089 0 2024-04-25T02:27:10.957 INFO:tasks.workunit.client.0.smithi114.stdout:3/542: write d0/d5/f53 [717739,105665] 0 2024-04-25T02:27:10.958 INFO:tasks.workunit.client.0.smithi114.stdout:7/645: rename d5/d19/l29 to d5/d43/d4e/lca 0 2024-04-25T02:27:10.959 INFO:tasks.workunit.client.0.smithi114.stdout:1/560: mkdir df/d13/dbb 0 2024-04-25T02:27:10.959 INFO:tasks.workunit.client.0.smithi114.stdout:1/561: chown df/d13/d44/l8a 949 1 2024-04-25T02:27:10.961 INFO:tasks.workunit.client.0.smithi114.stdout:2/623: creat d5/d6/fc8 x:0 0 0 2024-04-25T02:27:10.962 INFO:tasks.workunit.client.0.smithi114.stdout:5/624: dread d1/d6/de/f9c [0,4194304] 0 2024-04-25T02:27:10.963 INFO:tasks.workunit.client.0.smithi114.stdout:8/578: mkdir da/d38/d62/d6d/d52/da8/db1 0 2024-04-25T02:27:10.968 INFO:tasks.workunit.client.0.smithi114.stdout:6/655: rename de/d25/d39/d47/d90/d93/d99/lce to de/d2a/leb 0 2024-04-25T02:27:10.970 INFO:tasks.workunit.client.0.smithi114.stdout:3/543: dwrite d0/f38 [4194304,4194304] 0 2024-04-25T02:27:10.970 INFO:tasks.workunit.client.0.smithi114.stdout:5/625: dread d1/d25/d24/f61 [0,4194304] 0 2024-04-25T02:27:10.971 INFO:tasks.workunit.client.0.smithi114.stdout:5/626: chown d1/c73 10128 1 2024-04-25T02:27:10.972 INFO:tasks.workunit.client.0.smithi114.stdout:1/562: getdents df/d13/d93 0 2024-04-25T02:27:10.973 INFO:tasks.workunit.client.0.smithi114.stdout:1/563: fdatasync df/d11/d32/f3c 0 2024-04-25T02:27:10.974 INFO:tasks.workunit.client.0.smithi114.stdout:2/624: mkdir d5/df/dc9 0 2024-04-25T02:27:10.977 INFO:tasks.workunit.client.0.smithi114.stdout:6/656: mkdir de/d25/d39/dec 0 2024-04-25T02:27:10.978 INFO:tasks.workunit.client.0.smithi114.stdout:6/657: write de/d27/d34/d44/fb1 [1478388,100075] 0 2024-04-25T02:27:10.978 INFO:tasks.workunit.client.0.smithi114.stdout:1/564: stat df/d13/d1e/f50 0 2024-04-25T02:27:10.979 INFO:tasks.workunit.client.0.smithi114.stdout:3/544: mkdir d0/d25/d2a/dc4 0 2024-04-25T02:27:10.980 INFO:tasks.workunit.client.0.smithi114.stdout:9/575: dread d8/d16/f27 [0,4194304] 0 2024-04-25T02:27:10.980 INFO:tasks.workunit.client.0.smithi114.stdout:3/545: stat d0/d25/d2a/f4e 0 2024-04-25T02:27:10.981 INFO:tasks.workunit.client.0.smithi114.stdout:2/625: rmdir d5/d6/d58/d5a/d3e 39 2024-04-25T02:27:10.982 INFO:tasks.workunit.client.0.smithi114.stdout:3/546: write d0/d25/f32 [4269060,13401] 0 2024-04-25T02:27:10.982 INFO:tasks.workunit.client.0.smithi114.stdout:0/564: getdents d1/d4/d24 0 2024-04-25T02:27:10.983 INFO:tasks.workunit.client.0.smithi114.stdout:5/627: mknod d1/d3e/cd0 0 2024-04-25T02:27:10.985 INFO:tasks.workunit.client.0.smithi114.stdout:6/658: creat de/d27/d34/d38/fed x:0 0 0 2024-04-25T02:27:10.990 INFO:tasks.workunit.client.0.smithi114.stdout:9/576: dwrite d8/f71 [0,4194304] 0 2024-04-25T02:27:10.991 INFO:tasks.workunit.client.0.smithi114.stdout:6/659: truncate de/d25/f50 4997756 0 2024-04-25T02:27:10.991 INFO:tasks.workunit.client.0.smithi114.stdout:9/577: write d8/fa [550139,66569] 0 2024-04-25T02:27:10.991 INFO:tasks.workunit.client.0.smithi114.stdout:2/626: chown d5/d1c/d22/cb1 30 1 2024-04-25T02:27:10.991 INFO:tasks.workunit.client.0.smithi114.stdout:2/627: write d5/df/f17 [4703144,47202] 0 2024-04-25T02:27:10.996 INFO:tasks.workunit.client.0.smithi114.stdout:3/547: symlink d0/d25/d2a/dc4/lc5 0 2024-04-25T02:27:10.998 INFO:tasks.workunit.client.0.smithi114.stdout:0/565: mkdir d1/d4/d4f/da9/dac 0 2024-04-25T02:27:11.001 INFO:tasks.workunit.client.0.smithi114.stdout:6/660: dread de/d27/d34/d44/fb1 [0,4194304] 0 2024-04-25T02:27:11.001 INFO:tasks.workunit.client.0.smithi114.stdout:2/628: rmdir d5/df/d1e 39 2024-04-25T02:27:11.002 INFO:tasks.workunit.client.0.smithi114.stdout:5/628: mknod d1/d3e/db2/cd1 0 2024-04-25T02:27:11.003 INFO:tasks.workunit.client.0.smithi114.stdout:3/548: dwrite d0/d25/d29/d85/f50 [4194304,4194304] 0 2024-04-25T02:27:11.005 INFO:tasks.workunit.client.0.smithi114.stdout:3/549: write d0/d25/d2a/d36/f5e [4587214,55387] 0 2024-04-25T02:27:11.005 INFO:tasks.workunit.client.0.smithi114.stdout:0/566: rename d1/d7/d18/d2e/f54 to d1/d4/d4f/d77/da1/fad 0 2024-04-25T02:27:11.006 INFO:tasks.workunit.client.0.smithi114.stdout:1/565: getdents df/d11/d25/d33/d47/d74 0 2024-04-25T02:27:11.007 INFO:tasks.workunit.client.0.smithi114.stdout:3/550: dread - d0/d5/d3d/f66 zero size 2024-04-25T02:27:11.009 INFO:tasks.workunit.client.0.smithi114.stdout:6/661: dwrite de/d27/d34/d4b/f75 [0,4194304] 0 2024-04-25T02:27:11.014 INFO:tasks.workunit.client.0.smithi114.stdout:1/566: symlink df/d13/d6e/lbc 0 2024-04-25T02:27:11.015 INFO:tasks.workunit.client.0.smithi114.stdout:2/629: dwrite d5/d6/d31/f32 [4194304,4194304] 0 2024-04-25T02:27:11.016 INFO:tasks.workunit.client.0.smithi114.stdout:1/567: fsync df/d13/d75/faa 0 2024-04-25T02:27:11.017 INFO:tasks.workunit.client.0.smithi114.stdout:1/568: chown df/d11/d7d/d92 133941770 1 2024-04-25T02:27:11.018 INFO:tasks.workunit.client.0.smithi114.stdout:1/569: dread - df/d11/d25/d33/d47/f6f zero size 2024-04-25T02:27:11.020 INFO:tasks.workunit.client.0.smithi114.stdout:5/629: rename d1/d3e/c42 to d1/d6/d4f/d6c/cd2 0 2024-04-25T02:27:11.023 INFO:tasks.workunit.client.0.smithi114.stdout:6/662: mkdir de/d25/d39/dec/dee 0 2024-04-25T02:27:11.024 INFO:tasks.workunit.client.0.smithi114.stdout:9/578: dread d8/d16/d21/d37/d60/d70/f94 [0,4194304] 0 2024-04-25T02:27:11.025 INFO:tasks.workunit.client.0.smithi114.stdout:6/663: dread - de/f92 zero size 2024-04-25T02:27:11.025 INFO:tasks.workunit.client.0.smithi114.stdout:2/630: symlink d5/d6/d58/d5a/d3e/d54/lca 0 2024-04-25T02:27:11.027 INFO:tasks.workunit.client.0.smithi114.stdout:6/664: dread - de/d27/d76/fd0 zero size 2024-04-25T02:27:11.027 INFO:tasks.workunit.client.0.smithi114.stdout:5/630: dwrite d1/d6/de/f8d [0,4194304] 0 2024-04-25T02:27:11.027 INFO:tasks.workunit.client.0.smithi114.stdout:8/579: sync 2024-04-25T02:27:11.027 INFO:tasks.workunit.client.0.smithi114.stdout:7/646: sync 2024-04-25T02:27:11.027 INFO:tasks.workunit.client.0.smithi114.stdout:4/480: sync 2024-04-25T02:27:11.031 INFO:tasks.workunit.client.0.smithi114.stdout:9/579: truncate d8/d16/d21/d37/d43/d75/fc2 37622 0 2024-04-25T02:27:11.032 INFO:tasks.workunit.client.0.smithi114.stdout:2/631: readlink d5/d6/d58/d5a/d3e/d54/l8b 0 2024-04-25T02:27:11.032 INFO:tasks.workunit.client.0.smithi114.stdout:5/631: mknod d1/d25/d24/cd3 0 2024-04-25T02:27:11.033 INFO:tasks.workunit.client.0.smithi114.stdout:7/647: symlink d5/d19/d1a/da4/db3/lcb 0 2024-04-25T02:27:11.035 INFO:tasks.workunit.client.0.smithi114.stdout:8/580: truncate da/d69/d93/f64 4091366 0 2024-04-25T02:27:11.036 INFO:tasks.workunit.client.0.smithi114.stdout:2/632: symlink d5/d1c/d22/d89/lcb 0 2024-04-25T02:27:11.037 INFO:tasks.workunit.client.0.smithi114.stdout:5/632: mkdir d1/d3e/db2/dd4 0 2024-04-25T02:27:11.038 INFO:tasks.workunit.client.0.smithi114.stdout:6/665: dwrite de/d25/d39/d47/f60 [0,4194304] 0 2024-04-25T02:27:11.039 INFO:tasks.workunit.client.0.smithi114.stdout:5/633: chown d1/d6/de/d75/fb9 257534 1 2024-04-25T02:27:11.039 INFO:tasks.workunit.client.0.smithi114.stdout:4/481: rename d3/d8/d12/d19/d26/d3e/d62/f75 to d3/d8/d12/d19/d42/d58/f90 0 2024-04-25T02:27:11.040 INFO:tasks.workunit.client.0.smithi114.stdout:7/648: mknod d5/d19/d1a/da4/ccc 0 2024-04-25T02:27:11.041 INFO:tasks.workunit.client.0.smithi114.stdout:4/482: chown d3/d14/f37 416 1 2024-04-25T02:27:11.042 INFO:tasks.workunit.client.0.smithi114.stdout:2/633: unlink d5/df/c1b 0 2024-04-25T02:27:11.046 INFO:tasks.workunit.client.0.smithi114.stdout:9/580: rename d8/d16/d21/d83/d39/f23 to d8/d16/d21/d83/d39/d38/d46/d53/da2/fc3 0 2024-04-25T02:27:11.048 INFO:tasks.workunit.client.0.smithi114.stdout:4/483: creat d3/d8/d23/d35/f91 x:0 0 0 2024-04-25T02:27:11.049 INFO:tasks.workunit.client.0.smithi114.stdout:4/484: fsync d3/d14/f37 0 2024-04-25T02:27:11.052 INFO:tasks.workunit.client.0.smithi114.stdout:5/634: link d1/d6/d1a/f64 d1/d3e/d60/daf/fd5 0 2024-04-25T02:27:11.053 INFO:tasks.workunit.client.0.smithi114.stdout:9/581: mkdir d8/d16/d21/d24/d3c/d40/dc4 0 2024-04-25T02:27:11.055 INFO:tasks.workunit.client.0.smithi114.stdout:0/567: dwrite d1/d4/f1b [0,4194304] 0 2024-04-25T02:27:11.058 INFO:tasks.workunit.client.0.smithi114.stdout:3/551: truncate d0/d25/d2a/d34/f55 1671135 0 2024-04-25T02:27:11.059 INFO:tasks.workunit.client.0.smithi114.stdout:1/570: dread df/d13/d75/db8/f69 [0,4194304] 0 2024-04-25T02:27:11.060 INFO:tasks.workunit.client.0.smithi114.stdout:5/635: symlink d1/d3e/d8e/ld6 0 2024-04-25T02:27:11.061 INFO:tasks.workunit.client.0.smithi114.stdout:7/649: link d5/d19/d23/d6f/l52 d5/d32/d4a/d51/lcd 0 2024-04-25T02:27:11.061 INFO:tasks.workunit.client.0.smithi114.stdout:5/636: write d1/d6/de/f8d [1560311,121009] 0 2024-04-25T02:27:11.062 INFO:tasks.workunit.client.0.smithi114.stdout:5/637: chown d1/d3e/db2/dd4 3882 1 2024-04-25T02:27:11.062 INFO:tasks.workunit.client.0.smithi114.stdout:9/582: dread d8/d16/d21/d83/d39/d38/d46/d53/fa0 [0,4194304] 0 2024-04-25T02:27:11.064 INFO:tasks.workunit.client.0.smithi114.stdout:6/666: getdents de/d25/d39/d47 0 2024-04-25T02:27:11.065 INFO:tasks.workunit.client.0.smithi114.stdout:6/667: write de/d27/d76/fd0 [795658,80753] 0 2024-04-25T02:27:11.065 INFO:tasks.workunit.client.0.smithi114.stdout:3/552: creat d0/d25/d29/fc6 x:0 0 0 2024-04-25T02:27:11.070 INFO:tasks.workunit.client.0.smithi114.stdout:7/650: rename d5/d32/d4a/d51/f72 to d5/d32/d4a/d91/fce 0 2024-04-25T02:27:11.073 INFO:tasks.workunit.client.0.smithi114.stdout:5/638: fsync d1/d6/de/f8d 0 2024-04-25T02:27:11.074 INFO:tasks.workunit.client.0.smithi114.stdout:9/583: stat d8/d16/d21/d83/d39/d38/lb1 0 2024-04-25T02:27:11.074 INFO:tasks.workunit.client.0.smithi114.stdout:4/485: getdents d3/d14 0 2024-04-25T02:27:11.076 INFO:tasks.workunit.client.0.smithi114.stdout:6/668: creat de/d25/fef x:0 0 0 2024-04-25T02:27:11.077 INFO:tasks.workunit.client.0.smithi114.stdout:3/553: mknod d0/d25/d29/d8c/cc7 0 2024-04-25T02:27:11.077 INFO:tasks.workunit.client.0.smithi114.stdout:1/571: mkdir df/d13/d44/d9b/dbd 0 2024-04-25T02:27:11.079 INFO:tasks.workunit.client.0.smithi114.stdout:4/486: write d3/d8/d12/d19/f1a [1803436,4950] 0 2024-04-25T02:27:11.079 INFO:tasks.workunit.client.0.smithi114.stdout:0/568: creat d1/d4/da/fae x:0 0 0 2024-04-25T02:27:11.080 INFO:tasks.workunit.client.0.smithi114.stdout:8/581: dwrite da/d1d/f36 [0,4194304] 0 2024-04-25T02:27:11.080 INFO:tasks.workunit.client.0.smithi114.stdout:3/554: chown d0/d25/d29/d60 526942 1 2024-04-25T02:27:11.081 INFO:tasks.workunit.client.0.smithi114.stdout:7/651: dwrite d5/d32/d64/fac [0,4194304] 0 2024-04-25T02:27:11.083 INFO:tasks.workunit.client.0.smithi114.stdout:3/555: read - d0/d25/d29/f6e zero size 2024-04-25T02:27:11.085 INFO:tasks.workunit.client.0.smithi114.stdout:9/584: mknod d8/d16/d21/d37/d60/d70/cc5 0 2024-04-25T02:27:11.085 INFO:tasks.workunit.client.0.smithi114.stdout:5/639: mknod d1/d6/d4f/d6c/d88/db6/dc8/cd7 0 2024-04-25T02:27:11.086 INFO:tasks.workunit.client.0.smithi114.stdout:1/572: fsync df/d13/f83 0 2024-04-25T02:27:11.089 INFO:tasks.workunit.client.0.smithi114.stdout:5/640: write d1/d6/de/dbc/f9b [693355,24076] 0 2024-04-25T02:27:11.089 INFO:tasks.workunit.client.0.smithi114.stdout:6/669: mknod de/d27/d34/d44/d91/cf0 0 2024-04-25T02:27:11.091 INFO:tasks.workunit.client.0.smithi114.stdout:0/569: rename d1/c3d to d1/d4/d4f/caf 0 2024-04-25T02:27:11.092 INFO:tasks.workunit.client.0.smithi114.stdout:8/582: dwrite da/d38/d62/d6d/d52/d6c/f8b [0,4194304] 0 2024-04-25T02:27:11.097 INFO:tasks.workunit.client.0.smithi114.stdout:7/652: dread d5/d19/d1a/f38 [0,4194304] 0 2024-04-25T02:27:11.098 INFO:tasks.workunit.client.0.smithi114.stdout:9/585: creat d8/d16/d21/d37/d60/d70/fc6 x:0 0 0 2024-04-25T02:27:11.100 INFO:tasks.workunit.client.0.smithi114.stdout:6/670: dwrite de/d2a/f9d [0,4194304] 0 2024-04-25T02:27:11.103 INFO:tasks.workunit.client.0.smithi114.stdout:2/634: sync 2024-04-25T02:27:11.103 INFO:tasks.workunit.client.0.smithi114.stdout:8/583: rename da/d69/lab to da/d69/d93/d40/lb2 0 2024-04-25T02:27:11.105 INFO:tasks.workunit.client.0.smithi114.stdout:3/556: mkdir d0/d25/d29/d60/da8/dc8 0 2024-04-25T02:27:11.107 INFO:tasks.workunit.client.0.smithi114.stdout:0/570: dread d1/d4/ff [0,4194304] 0 2024-04-25T02:27:11.107 INFO:tasks.workunit.client.0.smithi114.stdout:4/487: creat d3/f92 x:0 0 0 2024-04-25T02:27:11.108 INFO:tasks.workunit.client.0.smithi114.stdout:9/586: dwrite d8/d16/d21/d83/d39/d38/d46/d53/fa9 [0,4194304] 0 2024-04-25T02:27:11.109 INFO:tasks.workunit.client.0.smithi114.stdout:9/587: fdatasync d8/d16/d21/d24/d3c/d40/f99 0 2024-04-25T02:27:11.109 INFO:tasks.workunit.client.0.smithi114.stdout:1/573: unlink df/d13/d1e/l78 0 2024-04-25T02:27:11.110 INFO:tasks.workunit.client.0.smithi114.stdout:9/588: write d8/fb [990560,27215] 0 2024-04-25T02:27:11.111 INFO:tasks.workunit.client.0.smithi114.stdout:7/653: symlink d5/d32/d4a/d91/lcf 0 2024-04-25T02:27:11.112 INFO:tasks.workunit.client.0.smithi114.stdout:5/641: symlink d1/d6/ld8 0 2024-04-25T02:27:11.113 INFO:tasks.workunit.client.0.smithi114.stdout:8/584: mkdir da/d69/d93/d6b/db3 0 2024-04-25T02:27:11.113 INFO:tasks.workunit.client.0.smithi114.stdout:8/585: chown da/d38 25394 1 2024-04-25T02:27:11.114 INFO:tasks.workunit.client.0.smithi114.stdout:9/589: dread d8/d16/d21/d83/d39/f35 [0,4194304] 0 2024-04-25T02:27:11.115 INFO:tasks.workunit.client.0.smithi114.stdout:3/557: rename d0/fb to d0/d5/d3d/dc3/fc9 0 2024-04-25T02:27:11.116 INFO:tasks.workunit.client.0.smithi114.stdout:0/571: mkdir d1/d4/d62/db0 0 2024-04-25T02:27:11.118 INFO:tasks.workunit.client.0.smithi114.stdout:1/574: creat df/d13/d44/d9b/fbe x:0 0 0 2024-04-25T02:27:11.120 INFO:tasks.workunit.client.0.smithi114.stdout:5/642: mkdir d1/d6/d1a/d7f/dd9 0 2024-04-25T02:27:11.120 INFO:tasks.workunit.client.0.smithi114.stdout:1/575: dread - df/d11/d25/d33/d47/f6f zero size 2024-04-25T02:27:11.122 INFO:tasks.workunit.client.0.smithi114.stdout:8/586: rename da/d69/d93/d70 to da/d69/d87/db4 0 2024-04-25T02:27:11.123 INFO:tasks.workunit.client.0.smithi114.stdout:3/558: symlink d0/d25/d29/d85/d7e/lca 0 2024-04-25T02:27:11.124 INFO:tasks.workunit.client.0.smithi114.stdout:0/572: dwrite d1/d4/d62/f94 [0,4194304] 0 2024-04-25T02:27:11.124 INFO:tasks.workunit.client.0.smithi114.stdout:7/654: symlink d5/d32/d4a/ld0 0 2024-04-25T02:27:11.126 INFO:tasks.workunit.client.0.smithi114.stdout:5/643: symlink d1/d25/dbe/lda 0 2024-04-25T02:27:11.126 INFO:tasks.workunit.client.0.smithi114.stdout:3/559: chown d0/d5/d3d/lc0 716 1 2024-04-25T02:27:11.128 INFO:tasks.workunit.client.0.smithi114.stdout:1/576: creat df/d2a/fbf x:0 0 0 2024-04-25T02:27:11.128 INFO:tasks.workunit.client.0.smithi114.stdout:0/573: write d1/d30/d4d/f6d [182655,115359] 0 2024-04-25T02:27:11.128 INFO:tasks.workunit.client.0.smithi114.stdout:4/488: mkdir d3/d8/d30/d93 0 2024-04-25T02:27:11.128 INFO:tasks.workunit.client.0.smithi114.stdout:8/587: rename da/d32/c55 to da/d69/d87/d8d/cb5 0 2024-04-25T02:27:11.129 INFO:tasks.workunit.client.0.smithi114.stdout:9/590: dwrite d8/d16/f27 [0,4194304] 0 2024-04-25T02:27:11.130 INFO:tasks.workunit.client.0.smithi114.stdout:7/655: symlink d5/d19/d23/d6f/ld1 0 2024-04-25T02:27:11.131 INFO:tasks.workunit.client.0.smithi114.stdout:3/560: mkdir d0/d25/d29/dcb 0 2024-04-25T02:27:11.133 INFO:tasks.workunit.client.0.smithi114.stdout:0/574: read d1/d7/d18/f3b [3906832,108306] 0 2024-04-25T02:27:11.134 INFO:tasks.workunit.client.0.smithi114.stdout:8/588: mkdir da/d38/db6 0 2024-04-25T02:27:11.136 INFO:tasks.workunit.client.0.smithi114.stdout:9/591: read d8/d16/d21/d83/d39/d38/f6f [4128775,58553] 0 2024-04-25T02:27:11.136 INFO:tasks.workunit.client.0.smithi114.stdout:9/592: chown d8/d16/d21/d95 20036 1 2024-04-25T02:27:11.138 INFO:tasks.workunit.client.0.smithi114.stdout:3/561: mkdir d0/d25/d2a/dc4/dcc 0 2024-04-25T02:27:11.139 INFO:tasks.workunit.client.0.smithi114.stdout:3/562: truncate d0/d25/d29/fc6 742906 0 2024-04-25T02:27:11.155 INFO:tasks.workunit.client.0.smithi114.stdout:9/593: write d8/d16/d21/d37/d60/d70/f94 [1273742,82081] 0 2024-04-25T02:27:11.156 INFO:tasks.workunit.client.0.smithi114.stdout:0/575: rename d1/d7/d18/d2e/c31 to d1/d7/d97/cb1 0 2024-04-25T02:27:11.159 INFO:tasks.workunit.client.0.smithi114.stdout:5/644: getdents d1/d25/d24 0 2024-04-25T02:27:11.159 INFO:tasks.workunit.client.0.smithi114.stdout:0/576: dread - d1/d7/d18/d2e/d8f/faa zero size 2024-04-25T02:27:11.161 INFO:tasks.workunit.client.0.smithi114.stdout:6/671: dwrite f5 [0,4194304] 0 2024-04-25T02:27:11.163 INFO:tasks.workunit.client.0.smithi114.stdout:8/589: rename da/d38/d62/d6d/laa to da/d69/d93/d6b/lb7 0 2024-04-25T02:27:11.163 INFO:tasks.workunit.client.0.smithi114.stdout:0/577: read d1/d7/d18/f1f [5680190,125249] 0 2024-04-25T02:27:11.163 INFO:tasks.workunit.client.0.smithi114.stdout:6/672: truncate de/d25/dad/fb2 978334 0 2024-04-25T02:27:11.164 INFO:tasks.workunit.client.0.smithi114.stdout:9/594: dread d8/d16/d21/d83/d39/d38/d46/d53/fa9 [0,4194304] 0 2024-04-25T02:27:11.165 INFO:tasks.workunit.client.0.smithi114.stdout:6/673: stat de/d27/d34/d44 0 2024-04-25T02:27:11.166 INFO:tasks.workunit.client.0.smithi114.stdout:9/595: dread - d8/d16/d21/d83/d39/d38/d46/d96/fc1 zero size 2024-04-25T02:27:11.167 INFO:tasks.workunit.client.0.smithi114.stdout:4/489: getdents d3/d8/d23/d25/d31 0 2024-04-25T02:27:11.170 INFO:tasks.workunit.client.0.smithi114.stdout:8/590: creat da/d38/d62/d6d/d52/fb8 x:0 0 0 2024-04-25T02:27:11.171 INFO:tasks.workunit.client.0.smithi114.stdout:3/563: link d0/c1c d0/d25/d2a/d34/ccd 0 2024-04-25T02:27:11.171 INFO:tasks.workunit.client.0.smithi114.stdout:9/596: dread d8/f59 [0,4194304] 0 2024-04-25T02:27:11.173 INFO:tasks.workunit.client.0.smithi114.stdout:7/656: truncate d5/d19/d1a/f36 1385355 0 2024-04-25T02:27:11.174 INFO:tasks.workunit.client.0.smithi114.stdout:0/578: dwrite d1/d4/da/f73 [0,4194304] 0 2024-04-25T02:27:11.174 INFO:tasks.workunit.client.0.smithi114.stdout:4/490: rename d3/d8/d12/f18 to d3/d8/d30/d4c/d7f/f94 0 2024-04-25T02:27:11.175 INFO:tasks.workunit.client.0.smithi114.stdout:3/564: chown d0/d25/d2a/d34/l69 343552 1 2024-04-25T02:27:11.176 INFO:tasks.workunit.client.0.smithi114.stdout:8/591: write da/d69/d87/db4/f80 [3981695,16019] 0 2024-04-25T02:27:11.177 INFO:tasks.workunit.client.0.smithi114.stdout:5/645: dwrite d1/d6/de/f79 [0,4194304] 0 2024-04-25T02:27:11.177 INFO:tasks.workunit.client.0.smithi114.stdout:9/597: write d8/f74 [402319,65946] 0 2024-04-25T02:27:11.178 INFO:tasks.workunit.client.0.smithi114.stdout:4/491: chown d3/d8/d12/d19/f1a 0 1 2024-04-25T02:27:11.178 INFO:tasks.workunit.client.0.smithi114.stdout:5/646: stat d1/d6/d1a/f64 0 2024-04-25T02:27:11.181 INFO:tasks.workunit.client.0.smithi114.stdout:3/565: mkdir d0/d5/d3d/da6/dce 0 2024-04-25T02:27:11.181 INFO:tasks.workunit.client.0.smithi114.stdout:3/566: readlink d0/l22 0 2024-04-25T02:27:11.181 INFO:tasks.workunit.client.0.smithi114.stdout:0/579: dread d1/d4/f1b [0,4194304] 0 2024-04-25T02:27:11.182 INFO:tasks.workunit.client.0.smithi114.stdout:8/592: symlink da/d69/d93/d6b/lb9 0 2024-04-25T02:27:11.184 INFO:tasks.workunit.client.0.smithi114.stdout:7/657: dread d5/d19/f2c [0,4194304] 0 2024-04-25T02:27:11.184 INFO:tasks.workunit.client.0.smithi114.stdout:0/580: write d1/d30/d4d/f65 [5265371,17336] 0 2024-04-25T02:27:11.185 INFO:tasks.workunit.client.0.smithi114.stdout:3/567: read d0/fa [4040062,77317] 0 2024-04-25T02:27:11.190 INFO:tasks.workunit.client.0.smithi114.stdout:7/658: chown d5/d43/d4e/f4f 1970309 1 2024-04-25T02:27:11.191 INFO:tasks.workunit.client.0.smithi114.stdout:5/647: dwrite d1/d3e/d60/fac [0,4194304] 0 2024-04-25T02:27:11.191 INFO:tasks.workunit.client.0.smithi114.stdout:3/568: read d0/d5/d3d/f75 [395083,72166] 0 2024-04-25T02:27:11.192 INFO:tasks.workunit.client.0.smithi114.stdout:4/492: dread d3/fa [0,4194304] 0 2024-04-25T02:27:11.195 INFO:tasks.workunit.client.0.smithi114.stdout:7/659: dwrite d5/d32/f2f [0,4194304] 0 2024-04-25T02:27:11.196 INFO:tasks.workunit.client.0.smithi114.stdout:5/648: dwrite d1/d6/de/d75/fb9 [0,4194304] 0 2024-04-25T02:27:11.198 INFO:tasks.workunit.client.0.smithi114.stdout:8/593: read da/d1d/f1f [433840,37074] 0 2024-04-25T02:27:11.202 INFO:tasks.workunit.client.0.smithi114.stdout:2/635: sync 2024-04-25T02:27:11.210 INFO:tasks.workunit.client.0.smithi114.stdout:8/594: dread da/d38/f2a [0,4194304] 0 2024-04-25T02:27:11.214 INFO:tasks.workunit.client.0.smithi114.stdout:8/595: dread da/d1d/f36 [0,4194304] 0 2024-04-25T02:27:11.243 INFO:tasks.workunit.client.0.smithi114.stdout:6/674: dwrite de/d30/f49 [0,4194304] 0 2024-04-25T02:27:11.244 INFO:tasks.workunit.client.0.smithi114.stdout:3/569: creat d0/d25/d2a/d80/fcf x:0 0 0 2024-04-25T02:27:11.245 INFO:tasks.workunit.client.0.smithi114.stdout:3/570: dread - d0/d5/d3d/f66 zero size 2024-04-25T02:27:11.246 INFO:tasks.workunit.client.0.smithi114.stdout:4/493: mknod d3/d8/d23/d25/d31/c95 0 2024-04-25T02:27:11.247 INFO:tasks.workunit.client.0.smithi114.stdout:7/660: mknod d5/d32/d64/cd2 0 2024-04-25T02:27:11.251 INFO:tasks.workunit.client.0.smithi114.stdout:8/596: creat da/d38/d62/d6d/d52/d6c/fba x:0 0 0 2024-04-25T02:27:11.251 INFO:tasks.workunit.client.0.smithi114.stdout:1/577: sync 2024-04-25T02:27:11.253 INFO:tasks.workunit.client.0.smithi114.stdout:9/598: rmdir d8/d16/d21/d24/d3c/d40/dc4 0 2024-04-25T02:27:11.255 INFO:tasks.workunit.client.0.smithi114.stdout:0/581: creat d1/d7/d68/d69/fb2 x:0 0 0 2024-04-25T02:27:11.256 INFO:tasks.workunit.client.0.smithi114.stdout:0/582: truncate d1/d4/f8a 40482 0 2024-04-25T02:27:11.256 INFO:tasks.workunit.client.0.smithi114.stdout:9/599: truncate d8/d16/d21/d83/d39/d38/d46/d53/f5e 1119449 0 2024-04-25T02:27:11.257 INFO:tasks.workunit.client.0.smithi114.stdout:0/583: write d1/d4/f19 [1039779,109140] 0 2024-04-25T02:27:11.258 INFO:tasks.workunit.client.0.smithi114.stdout:6/675: rename de/d25/d39/d47/f8d to de/d2a/dd5/ff1 0 2024-04-25T02:27:11.261 INFO:tasks.workunit.client.0.smithi114.stdout:3/571: read d0/d25/d29/d85/d7e/f97 [3443494,44410] 0 2024-04-25T02:27:11.263 INFO:tasks.workunit.client.0.smithi114.stdout:9/600: dwrite d8/da8/fb5 [0,4194304] 0 2024-04-25T02:27:11.265 INFO:tasks.workunit.client.0.smithi114.stdout:2/636: dread d5/df/d1e/f84 [0,4194304] 0 2024-04-25T02:27:11.265 INFO:tasks.workunit.client.0.smithi114.stdout:8/597: stat da/d1d/l8c 0 2024-04-25T02:27:11.267 INFO:tasks.workunit.client.0.smithi114.stdout:1/578: mkdir df/d2a/d34/d77/dc0 0 2024-04-25T02:27:11.270 INFO:tasks.workunit.client.0.smithi114.stdout:6/676: symlink de/d27/d76/lf2 0 2024-04-25T02:27:11.276 INFO:tasks.workunit.client.0.smithi114.stdout:9/601: mkdir d8/d16/d21/d83/d39/dab/dc7 0 2024-04-25T02:27:11.277 INFO:tasks.workunit.client.0.smithi114.stdout:8/598: mkdir da/d69/d93/d6b/dbb 0 2024-04-25T02:27:11.278 INFO:tasks.workunit.client.0.smithi114.stdout:5/649: sync 2024-04-25T02:27:11.279 INFO:tasks.workunit.client.0.smithi114.stdout:2/637: rename d5/df/d3d/d44/la6 to d5/df/d63/d8d/lcc 0 2024-04-25T02:27:11.280 INFO:tasks.workunit.client.0.smithi114.stdout:2/638: chown d5/d1c/d21/c27 7 1 2024-04-25T02:27:11.283 INFO:tasks.workunit.client.0.smithi114.stdout:6/677: read de/d27/d34/d44/fb1 [624133,52682] 0 2024-04-25T02:27:11.285 INFO:tasks.workunit.client.0.smithi114.stdout:0/584: dread d1/d7/d18/d2e/f34 [0,4194304] 0 2024-04-25T02:27:11.285 INFO:tasks.workunit.client.0.smithi114.stdout:6/678: chown de/d30/f62 0 1 2024-04-25T02:27:11.287 INFO:tasks.workunit.client.0.smithi114.stdout:1/579: dwrite df/d13/d75/db8/f69 [4194304,4194304] 0 2024-04-25T02:27:11.287 INFO:tasks.workunit.client.0.smithi114.stdout:6/679: dread - de/d27/d34/d38/fac zero size 2024-04-25T02:27:11.288 INFO:tasks.workunit.client.0.smithi114.stdout:1/580: write df/d13/d75/d8e/fb9 [3862,38714] 0 2024-04-25T02:27:11.290 INFO:tasks.workunit.client.0.smithi114.stdout:8/599: mknod da/d38/d62/d6d/d52/da8/db1/cbc 0 2024-04-25T02:27:11.291 INFO:tasks.workunit.client.0.smithi114.stdout:3/572: dread d0/d25/f48 [0,4194304] 0 2024-04-25T02:27:11.316 INFO:tasks.workunit.client.0.smithi114.stdout:5/650: link d1/d25/f63 d1/d53/d55/db1/fdb 0 2024-04-25T02:27:11.316 INFO:tasks.workunit.client.0.smithi114.stdout:6/680: creat de/d2a/db9/dc7/ff3 x:0 0 0 2024-04-25T02:27:11.322 INFO:tasks.workunit.client.0.smithi114.stdout:5/651: fsync d1/d3e/d60/daf/fd5 0 2024-04-25T02:27:11.323 INFO:tasks.workunit.client.0.smithi114.stdout:2/639: dread d5/df/f17 [0,4194304] 0 2024-04-25T02:27:11.324 INFO:tasks.workunit.client.0.smithi114.stdout:3/573: rmdir d0/d25/d2a/dc4/dcc 0 2024-04-25T02:27:11.325 INFO:tasks.workunit.client.0.smithi114.stdout:8/600: getdents da 0 2024-04-25T02:27:11.328 INFO:tasks.workunit.client.0.smithi114.stdout:2/640: rename d5/df/d3d/d83/d95 to d5/df/d3d/d44/dc0/dcd 0 2024-04-25T02:27:11.329 INFO:tasks.workunit.client.0.smithi114.stdout:8/601: symlink da/d32/lbd 0 2024-04-25T02:27:11.334 INFO:tasks.workunit.client.0.smithi114.stdout:5/652: dread d1/d6/f7b [0,4194304] 0 2024-04-25T02:27:11.334 INFO:tasks.workunit.client.0.smithi114.stdout:2/641: dwrite d5/df/f12 [0,4194304] 0 2024-04-25T02:27:11.339 INFO:tasks.workunit.client.0.smithi114.stdout:2/642: write d5/df/d1e/f26 [3467137,19198] 0 2024-04-25T02:27:11.343 INFO:tasks.workunit.client.0.smithi114.stdout:2/643: read d5/d1c/d22/f24 [791368,79948] 0 2024-04-25T02:27:11.344 INFO:tasks.workunit.client.0.smithi114.stdout:2/644: fsync d5/d1c/d29/f5c 0 2024-04-25T02:27:11.350 INFO:tasks.workunit.client.0.smithi114.stdout:6/681: mknod de/d25/d39/d47/d90/cf4 0 2024-04-25T02:27:11.353 INFO:tasks.workunit.client.0.smithi114.stdout:1/581: rmdir df/d13/d6e 39 2024-04-25T02:27:11.355 INFO:tasks.workunit.client.0.smithi114.stdout:8/602: dread da/f31 [0,4194304] 0 2024-04-25T02:27:11.356 INFO:tasks.workunit.client.0.smithi114.stdout:2/645: dread d5/df/f53 [4194304,4194304] 0 2024-04-25T02:27:11.357 INFO:tasks.workunit.client.0.smithi114.stdout:8/603: write da/d38/d62/d6d/d52/f76 [1706242,122941] 0 2024-04-25T02:27:11.358 INFO:tasks.workunit.client.0.smithi114.stdout:2/646: read d5/d6/d31/f32 [584385,46894] 0 2024-04-25T02:27:11.358 INFO:tasks.workunit.client.0.smithi114.stdout:8/604: read - da/d38/d62/d6d/d52/d6c/fba zero size 2024-04-25T02:27:11.359 INFO:tasks.workunit.client.0.smithi114.stdout:7/661: sync 2024-04-25T02:27:11.359 INFO:tasks.workunit.client.0.smithi114.stdout:5/653: dread d1/f36 [0,4194304] 0 2024-04-25T02:27:11.361 INFO:tasks.workunit.client.0.smithi114.stdout:8/605: write da/d38/d62/d6d/f9e [483764,129218] 0 2024-04-25T02:27:11.361 INFO:tasks.workunit.client.0.smithi114.stdout:2/647: write d5/df/d1e/f38 [2913847,68800] 0 2024-04-25T02:27:11.363 INFO:tasks.workunit.client.0.smithi114.stdout:7/662: creat d5/d32/d4a/dbc/fd3 x:0 0 0 2024-04-25T02:27:11.364 INFO:tasks.workunit.client.0.smithi114.stdout:1/582: link df/d13/d1e/ca8 df/d11/d25/d33/d47/d74/cc1 0 2024-04-25T02:27:11.365 INFO:tasks.workunit.client.0.smithi114.stdout:9/602: dwrite d8/d16/d21/d83/d39/f35 [0,4194304] 0 2024-04-25T02:27:11.365 INFO:tasks.workunit.client.0.smithi114.stdout:8/606: mknod da/d32/cbe 0 2024-04-25T02:27:11.366 INFO:tasks.workunit.client.0.smithi114.stdout:9/603: truncate d8/f91 162035 0 2024-04-25T02:27:11.367 INFO:tasks.workunit.client.0.smithi114.stdout:1/583: write df/d11/d25/d33/d47/d9d/fa1 [8369703,102328] 0 2024-04-25T02:27:11.368 INFO:tasks.workunit.client.0.smithi114.stdout:9/604: write d8/d16/f27 [731694,101057] 0 2024-04-25T02:27:11.368 INFO:tasks.workunit.client.0.smithi114.stdout:7/663: creat d5/d43/d4e/fd4 x:0 0 0 2024-04-25T02:27:11.369 INFO:tasks.workunit.client.0.smithi114.stdout:5/654: creat d1/d3e/fdc x:0 0 0 2024-04-25T02:27:11.371 INFO:tasks.workunit.client.0.smithi114.stdout:7/664: truncate d5/d32/d64/f89 4992692 0 2024-04-25T02:27:11.371 INFO:tasks.workunit.client.0.smithi114.stdout:5/655: read - d1/d6/d4f/d6c/d88/db6/dc8/fc9 zero size 2024-04-25T02:27:11.373 INFO:tasks.workunit.client.0.smithi114.stdout:8/607: mknod da/d38/d62/cbf 0 2024-04-25T02:27:11.374 INFO:tasks.workunit.client.0.smithi114.stdout:8/608: dread - da/d1d/f92 zero size 2024-04-25T02:27:11.375 INFO:tasks.workunit.client.0.smithi114.stdout:1/584: dwrite df/d11/d25/d33/f53 [0,4194304] 0 2024-04-25T02:27:11.377 INFO:tasks.workunit.client.0.smithi114.stdout:7/665: mknod d5/d32/d4a/dbc/cd5 0 2024-04-25T02:27:11.378 INFO:tasks.workunit.client.0.smithi114.stdout:7/666: fdatasync d5/d19/d1a/fb2 0 2024-04-25T02:27:11.378 INFO:tasks.workunit.client.0.smithi114.stdout:5/656: mknod d1/d53/d55/dae/dc1/cdd 0 2024-04-25T02:27:11.383 INFO:tasks.workunit.client.0.smithi114.stdout:7/667: creat d5/d8b/d99/fd6 x:0 0 0 2024-04-25T02:27:11.387 INFO:tasks.workunit.client.0.smithi114.stdout:0/585: sync 2024-04-25T02:27:11.387 INFO:tasks.workunit.client.0.smithi114.stdout:1/585: truncate df/d11/d25/f4c 428128 0 2024-04-25T02:27:11.388 INFO:tasks.workunit.client.0.smithi114.stdout:7/668: symlink d5/d19/d1a/da4/db3/ld7 0 2024-04-25T02:27:11.388 INFO:tasks.workunit.client.0.smithi114.stdout:1/586: stat df/d11/d25/f4c 0 2024-04-25T02:27:11.388 INFO:tasks.workunit.client.0.smithi114.stdout:1/587: dread - df/d11/d25/d33/fac zero size 2024-04-25T02:27:11.389 INFO:tasks.workunit.client.0.smithi114.stdout:3/574: rename d0/d25/d29/d60/l5a to d0/d5/ld0 0 2024-04-25T02:27:11.390 INFO:tasks.workunit.client.0.smithi114.stdout:3/575: write d0/d25/d29/d60/f65 [1049915,63954] 0 2024-04-25T02:27:11.391 INFO:tasks.workunit.client.0.smithi114.stdout:0/586: unlink d1/d4/da/fae 0 2024-04-25T02:27:11.394 INFO:tasks.workunit.client.0.smithi114.stdout:3/576: read - d0/d5/f6c zero size 2024-04-25T02:27:11.394 INFO:tasks.workunit.client.0.smithi114.stdout:1/588: symlink df/d13/d75/d8e/lc2 0 2024-04-25T02:27:11.397 INFO:tasks.workunit.client.0.smithi114.stdout:0/587: unlink d1/d7/d18/d2e/d8f/faa 0 2024-04-25T02:27:11.398 INFO:tasks.workunit.client.0.smithi114.stdout:0/588: fsync d1/d4/d24/d52/f5f 0 2024-04-25T02:27:11.398 INFO:tasks.workunit.client.0.smithi114.stdout:3/577: mkdir d0/d25/d2a/d34/dd1 0 2024-04-25T02:27:11.399 INFO:tasks.workunit.client.0.smithi114.stdout:1/589: rmdir df 39 2024-04-25T02:27:11.401 INFO:tasks.workunit.client.0.smithi114.stdout:0/589: mknod d1/d4/d37/cb3 0 2024-04-25T02:27:11.403 INFO:tasks.workunit.client.0.smithi114.stdout:6/682: rename de/f86 to de/d27/d34/ff5 0 2024-04-25T02:27:11.404 INFO:tasks.workunit.client.0.smithi114.stdout:4/494: mkdir d3/d8/d96 0 2024-04-25T02:27:11.404 INFO:tasks.workunit.client.0.smithi114.stdout:0/590: fdatasync d1/d4/da/f16 0 2024-04-25T02:27:11.406 INFO:tasks.workunit.client.0.smithi114.stdout:1/590: creat df/d11/d25/d33/d47/d74/fc3 x:0 0 0 2024-04-25T02:27:11.407 INFO:tasks.workunit.client.0.smithi114.stdout:1/591: chown df/d13/f56 11 1 2024-04-25T02:27:11.408 INFO:tasks.workunit.client.0.smithi114.stdout:3/578: rename d0/d25/d29/f6e to d0/d25/d2a/d34/db6/fd2 0 2024-04-25T02:27:11.416 INFO:tasks.workunit.client.0.smithi114.stdout:0/591: mkdir d1/d4/db4 0 2024-04-25T02:27:11.416 INFO:tasks.workunit.client.0.smithi114.stdout:3/579: mknod d0/d25/d29/d60/cd3 0 2024-04-25T02:27:11.416 INFO:tasks.workunit.client.0.smithi114.stdout:4/495: truncate d3/d8/d12/d19/d26/f2a 1043612 0 2024-04-25T02:27:11.417 INFO:tasks.workunit.client.0.smithi114.stdout:6/683: creat de/d27/d34/d44/ff6 x:0 0 0 2024-04-25T02:27:11.419 INFO:tasks.workunit.client.0.smithi114.stdout:2/648: truncate d5/df/d3d/d44/f8f 532858 0 2024-04-25T02:27:11.419 INFO:tasks.workunit.client.0.smithi114.stdout:1/592: dwrite df/d13/d44/d5a/f68 [0,4194304] 0 2024-04-25T02:27:11.420 INFO:tasks.workunit.client.0.smithi114.stdout:0/592: mkdir d1/d4/d37/d6a/db5 0 2024-04-25T02:27:11.420 INFO:tasks.workunit.client.0.smithi114.stdout:2/649: stat d5/df/f12 0 2024-04-25T02:27:11.420 INFO:tasks.workunit.client.0.smithi114.stdout:1/593: fdatasync df/d2a/fbf 0 2024-04-25T02:27:11.421 INFO:tasks.workunit.client.0.smithi114.stdout:4/496: unlink d3/d8/d23/d35/f91 0 2024-04-25T02:27:11.422 INFO:tasks.workunit.client.0.smithi114.stdout:6/684: truncate de/f59 1744402 0 2024-04-25T02:27:11.424 INFO:tasks.workunit.client.0.smithi114.stdout:9/605: truncate d8/d16/d21/d83/f5f 5879846 0 2024-04-25T02:27:11.425 INFO:tasks.workunit.client.0.smithi114.stdout:1/594: creat df/d2a/d34/d77/fc4 x:0 0 0 2024-04-25T02:27:11.425 INFO:tasks.workunit.client.0.smithi114.stdout:6/685: fdatasync de/d25/dad/fb2 0 2024-04-25T02:27:11.426 INFO:tasks.workunit.client.0.smithi114.stdout:2/650: symlink d5/d1c/d22/d67/lce 0 2024-04-25T02:27:11.427 INFO:tasks.workunit.client.0.smithi114.stdout:0/593: truncate d1/d7/d18/d2e/d8f/f61 1290316 0 2024-04-25T02:27:11.427 INFO:tasks.workunit.client.0.smithi114.stdout:5/657: write d1/d3e/d60/fc6 [716009,96030] 0 2024-04-25T02:27:11.428 INFO:tasks.workunit.client.0.smithi114.stdout:8/609: truncate da/d1d/f1f 4010108 0 2024-04-25T02:27:11.429 INFO:tasks.workunit.client.0.smithi114.stdout:2/651: fdatasync d5/d1c/d29/f5c 0 2024-04-25T02:27:11.429 INFO:tasks.workunit.client.0.smithi114.stdout:1/595: chown df/d11/d25/d33/f53 219908478 1 2024-04-25T02:27:11.430 INFO:tasks.workunit.client.0.smithi114.stdout:3/580: dwrite d0/d25/d29/d85/d7e/da9/fb2 [0,4194304] 0 2024-04-25T02:27:11.431 INFO:tasks.workunit.client.0.smithi114.stdout:6/686: chown de/d27/d34/d44/d91/cf0 252 1 2024-04-25T02:27:11.433 INFO:tasks.workunit.client.0.smithi114.stdout:7/669: truncate d5/d32/d4a/d51/f95 8000916 0 2024-04-25T02:27:11.436 INFO:tasks.workunit.client.0.smithi114.stdout:3/581: write d0/d5/f43 [176315,122886] 0 2024-04-25T02:27:11.437 INFO:tasks.workunit.client.0.smithi114.stdout:1/596: write df/d13/d75/d8e/fb9 [659149,49688] 0 2024-04-25T02:27:11.437 INFO:tasks.workunit.client.0.smithi114.stdout:6/687: mkdir de/d1c/df7 0 2024-04-25T02:27:11.439 INFO:tasks.workunit.client.0.smithi114.stdout:3/582: stat d0/f81 0 2024-04-25T02:27:11.439 INFO:tasks.workunit.client.0.smithi114.stdout:4/497: dread d3/d8/d12/f1e [0,4194304] 0 2024-04-25T02:27:11.441 INFO:tasks.workunit.client.0.smithi114.stdout:8/610: creat da/d69/d87/d8d/fc0 x:0 0 0 2024-04-25T02:27:11.443 INFO:tasks.workunit.client.0.smithi114.stdout:3/583: chown d0/d25/d2a/d34/d9e 16687 1 2024-04-25T02:27:11.444 INFO:tasks.workunit.client.0.smithi114.stdout:8/611: stat da/d1e/f59 0 2024-04-25T02:27:11.445 INFO:tasks.workunit.client.0.smithi114.stdout:2/652: rename d5/df/d3d/d44/l62 to d5/df/d3d/d44/lcf 0 2024-04-25T02:27:11.445 INFO:tasks.workunit.client.0.smithi114.stdout:5/658: dwrite d1/d25/dbe/fc2 [0,4194304] 0 2024-04-25T02:27:11.446 INFO:tasks.workunit.client.0.smithi114.stdout:0/594: dwrite d1/d4/d24/d52/f9a [0,4194304] 0 2024-04-25T02:27:11.448 INFO:tasks.workunit.client.0.smithi114.stdout:7/670: dwrite d5/d19/f2a [0,4194304] 0 2024-04-25T02:27:11.464 INFO:tasks.workunit.client.0.smithi114.stdout:0/595: chown d1/d30/l53 2935 1 2024-04-25T02:27:11.465 INFO:tasks.workunit.client.0.smithi114.stdout:6/688: unlink de/d27/d34/d44/d91/cf0 0 2024-04-25T02:27:11.469 INFO:tasks.workunit.client.0.smithi114.stdout:4/498: dwrite d3/d8/d12/d19/d42/d58/f6b [0,4194304] 0 2024-04-25T02:27:11.471 INFO:tasks.workunit.client.0.smithi114.stdout:8/612: rename da/d69/d93/d40/f66 to da/d69/d93/fc1 0 2024-04-25T02:27:11.473 INFO:tasks.workunit.client.0.smithi114.stdout:9/606: link d8/d16/d21/d37/d43/d75/da3/cb6 d8/d16/d21/d83/d39/d38/d46/d96/cc8 0 2024-04-25T02:27:11.473 INFO:tasks.workunit.client.0.smithi114.stdout:6/689: symlink de/d25/dad/lf8 0 2024-04-25T02:27:11.474 INFO:tasks.workunit.client.0.smithi114.stdout:2/653: symlink d5/d6/ld0 0 2024-04-25T02:27:11.475 INFO:tasks.workunit.client.0.smithi114.stdout:5/659: dwrite d1/d6/de/dbc/f9b [0,4194304] 0 2024-04-25T02:27:11.475 INFO:tasks.workunit.client.0.smithi114.stdout:4/499: creat d3/d8/d30/d6e/f97 x:0 0 0 2024-04-25T02:27:11.477 INFO:tasks.workunit.client.0.smithi114.stdout:2/654: dread - d5/d1c/d21/fa7 zero size 2024-04-25T02:27:11.481 INFO:tasks.workunit.client.0.smithi114.stdout:7/671: dread d5/d32/d4a/d51/f6b [0,4194304] 0 2024-04-25T02:27:11.482 INFO:tasks.workunit.client.0.smithi114.stdout:5/660: fdatasync d1/d6/de/f90 0 2024-04-25T02:27:11.483 INFO:tasks.workunit.client.0.smithi114.stdout:5/661: write d1/d25/f35 [1007626,35799] 0 2024-04-25T02:27:11.487 INFO:tasks.workunit.client.0.smithi114.stdout:8/613: write da/d38/d62/d6d/f9e [1301359,40438] 0 2024-04-25T02:27:11.488 INFO:tasks.workunit.client.0.smithi114.stdout:8/614: chown da/d38/d62/d6d/l4c 64254 1 2024-04-25T02:27:11.489 INFO:tasks.workunit.client.0.smithi114.stdout:7/672: creat d5/d19/d1a/da4/db3/fd8 x:0 0 0 2024-04-25T02:27:11.490 INFO:tasks.workunit.client.0.smithi114.stdout:7/673: fdatasync d5/d43/fc0 0 2024-04-25T02:27:11.491 INFO:tasks.workunit.client.0.smithi114.stdout:8/615: write da/d38/d62/d6d/d49/f7d [246221,95604] 0 2024-04-25T02:27:11.493 INFO:tasks.workunit.client.0.smithi114.stdout:1/597: dwrite df/d11/d32/f89 [0,4194304] 0 2024-04-25T02:27:11.494 INFO:tasks.workunit.client.0.smithi114.stdout:5/662: mkdir d1/d3e/d60/dde 0 2024-04-25T02:27:11.496 INFO:tasks.workunit.client.0.smithi114.stdout:0/596: rename d1/d4/d4f/f57 to d1/d4/fb6 0 2024-04-25T02:27:11.496 INFO:tasks.workunit.client.0.smithi114.stdout:5/663: chown d1/d25/da1/daa 8703750 1 2024-04-25T02:27:11.499 INFO:tasks.workunit.client.0.smithi114.stdout:7/674: dwrite d5/fa0 [0,4194304] 0 2024-04-25T02:27:11.502 INFO:tasks.workunit.client.0.smithi114.stdout:9/607: write d8/d16/d21/d83/d39/d38/d46/d53/da2/fad [193036,115882] 0 2024-04-25T02:27:11.506 INFO:tasks.workunit.client.0.smithi114.stdout:6/690: rename de/d1c/c63 to de/d25/dad/dde/cf9 0 2024-04-25T02:27:11.506 INFO:tasks.workunit.client.0.smithi114.stdout:2/655: write d5/d6/d31/f60 [1609030,60327] 0 2024-04-25T02:27:11.507 INFO:tasks.workunit.client.0.smithi114.stdout:2/656: stat d5/c1a 0 2024-04-25T02:27:11.508 INFO:tasks.workunit.client.0.smithi114.stdout:9/608: symlink d8/d16/d21/d83/d39/d38/d46/d53/da2/lc9 0 2024-04-25T02:27:11.509 INFO:tasks.workunit.client.0.smithi114.stdout:9/609: write d8/d16/d21/d37/d60/d70/fc6 [411108,72620] 0 2024-04-25T02:27:11.511 INFO:tasks.workunit.client.0.smithi114.stdout:5/664: rename d1/d25/dbe to d1/d6/de/da7/ddf 0 2024-04-25T02:27:11.511 INFO:tasks.workunit.client.0.smithi114.stdout:3/584: sync 2024-04-25T02:27:11.513 INFO:tasks.workunit.client.0.smithi114.stdout:2/657: mkdir d5/d79/dd1 0 2024-04-25T02:27:11.513 INFO:tasks.workunit.client.0.smithi114.stdout:3/585: chown d0/c7f 1443 1 2024-04-25T02:27:11.514 INFO:tasks.workunit.client.0.smithi114.stdout:9/610: creat d8/d16/d21/d37/d43/fca x:0 0 0 2024-04-25T02:27:11.515 INFO:tasks.workunit.client.0.smithi114.stdout:0/597: creat d1/d4/da/fb7 x:0 0 0 2024-04-25T02:27:11.516 INFO:tasks.workunit.client.0.smithi114.stdout:6/691: read de/d27/f96 [581423,63313] 0 2024-04-25T02:27:11.518 INFO:tasks.workunit.client.0.smithi114.stdout:7/675: rename d5/d32/d4a/dbc/cd5 to d5/d43/cd9 0 2024-04-25T02:27:11.520 INFO:tasks.workunit.client.0.smithi114.stdout:4/500: dwrite d3/d8/d12/d19/d26/f2a [0,4194304] 0 2024-04-25T02:27:11.520 INFO:tasks.workunit.client.0.smithi114.stdout:6/692: stat de/d27/d34/f7a 0 2024-04-25T02:27:11.522 INFO:tasks.workunit.client.0.smithi114.stdout:9/611: unlink d8/f17 0 2024-04-25T02:27:11.523 INFO:tasks.workunit.client.0.smithi114.stdout:5/665: dwrite d1/d6/f31 [0,4194304] 0 2024-04-25T02:27:11.523 INFO:tasks.workunit.client.0.smithi114.stdout:9/612: chown d8/d16/d21/d83/d66 2517 1 2024-04-25T02:27:11.523 INFO:tasks.workunit.client.0.smithi114.stdout:3/586: creat d0/d25/d29/d8c/fd4 x:0 0 0 2024-04-25T02:27:11.524 INFO:tasks.workunit.client.0.smithi114.stdout:3/587: fsync d0/d25/d2a/d36/f37 0 2024-04-25T02:27:11.525 INFO:tasks.workunit.client.0.smithi114.stdout:7/676: symlink d5/d32/da6/db5/lda 0 2024-04-25T02:27:11.527 INFO:tasks.workunit.client.0.smithi114.stdout:6/693: creat de/d25/dad/dde/ffa x:0 0 0 2024-04-25T02:27:11.527 INFO:tasks.workunit.client.0.smithi114.stdout:8/616: write da/d1d/f36 [4355668,59698] 0 2024-04-25T02:27:11.531 INFO:tasks.workunit.client.0.smithi114.stdout:1/598: dwrite df/d13/f83 [0,4194304] 0 2024-04-25T02:27:11.535 INFO:tasks.workunit.client.0.smithi114.stdout:3/588: mkdir d0/d25/d2a/d34/dd5 0 2024-04-25T02:27:11.536 INFO:tasks.workunit.client.0.smithi114.stdout:3/589: fsync d0/d5/f6c 0 2024-04-25T02:27:11.537 INFO:tasks.workunit.client.0.smithi114.stdout:4/501: symlink d3/d8/d12/d82/l98 0 2024-04-25T02:27:11.538 INFO:tasks.workunit.client.0.smithi114.stdout:7/677: dread - d5/d32/d4a/d87/fb4 zero size 2024-04-25T02:27:11.540 INFO:tasks.workunit.client.0.smithi114.stdout:6/694: mknod de/d27/d34/d4b/cfb 0 2024-04-25T02:27:11.541 INFO:tasks.workunit.client.0.smithi114.stdout:5/666: mkdir d1/d53/de0 0 2024-04-25T02:27:11.543 INFO:tasks.workunit.client.0.smithi114.stdout:2/658: write d5/df/d63/d8d/fa2 [320087,72333] 0 2024-04-25T02:27:11.543 INFO:tasks.workunit.client.0.smithi114.stdout:1/599: mkdir df/d11/d25/d33/d47/d74/dc5 0 2024-04-25T02:27:11.544 INFO:tasks.workunit.client.0.smithi114.stdout:0/598: dread d1/d4/da/f16 [0,4194304] 0 2024-04-25T02:27:11.547 INFO:tasks.workunit.client.0.smithi114.stdout:6/695: mkdir de/d27/d34/d38/dfc 0 2024-04-25T02:27:11.548 INFO:tasks.workunit.client.0.smithi114.stdout:5/667: unlink d1/l7d 0 2024-04-25T02:27:11.550 INFO:tasks.workunit.client.0.smithi114.stdout:8/617: rename da/d69/d93/d40/l57 to da/d69/d93/d6b/lc2 0 2024-04-25T02:27:11.550 INFO:tasks.workunit.client.0.smithi114.stdout:1/600: dwrite df/d11/d25/d33/d47/f7f [0,4194304] 0 2024-04-25T02:27:11.550 INFO:tasks.workunit.client.0.smithi114.stdout:2/659: symlink d5/df/d3d/d44/dc0/ld2 0 2024-04-25T02:27:11.552 INFO:tasks.workunit.client.0.smithi114.stdout:5/668: write d1/d6/d4f/d6c/d88/db6/dc8/fc9 [640234,12048] 0 2024-04-25T02:27:11.552 INFO:tasks.workunit.client.0.smithi114.stdout:0/599: creat d1/d4/da/d33/fb8 x:0 0 0 2024-04-25T02:27:11.553 INFO:tasks.workunit.client.0.smithi114.stdout:8/618: fdatasync da/d38/d62/d6d/d52/d6c/fba 0 2024-04-25T02:27:11.554 INFO:tasks.workunit.client.0.smithi114.stdout:5/669: truncate d1/d6/f31 4989644 0 2024-04-25T02:27:11.555 INFO:tasks.workunit.client.0.smithi114.stdout:8/619: dread - da/d38/d62/d6d/d52/d6c/fac zero size 2024-04-25T02:27:11.555 INFO:tasks.workunit.client.0.smithi114.stdout:5/670: stat d1/d51/cbf 0 2024-04-25T02:27:11.556 INFO:tasks.workunit.client.0.smithi114.stdout:1/601: dread - df/d13/d6e/d97/fba zero size 2024-04-25T02:27:11.556 INFO:tasks.workunit.client.0.smithi114.stdout:4/502: creat d3/d8/d23/f99 x:0 0 0 2024-04-25T02:27:11.562 INFO:tasks.workunit.client.0.smithi114.stdout:7/678: getdents d5/d19/d1a/d80 0 2024-04-25T02:27:11.562 INFO:tasks.workunit.client.0.smithi114.stdout:1/602: dread df/d13/d44/d5a/f68 [0,4194304] 0 2024-04-25T02:27:11.563 INFO:tasks.workunit.client.0.smithi114.stdout:9/613: write d8/d16/d21/d83/d39/d38/d46/d53/fa0 [410803,41880] 0 2024-04-25T02:27:11.564 INFO:tasks.workunit.client.0.smithi114.stdout:0/600: mkdir d1/d4/da/d39/da7/db9 0 2024-04-25T02:27:11.565 INFO:tasks.workunit.client.0.smithi114.stdout:3/590: dread d0/d25/d29/d85/f50 [0,4194304] 0 2024-04-25T02:27:11.566 INFO:tasks.workunit.client.0.smithi114.stdout:4/503: dwrite d3/d14/f53 [0,4194304] 0 2024-04-25T02:27:11.566 INFO:tasks.workunit.client.0.smithi114.stdout:7/679: chown d5/d19/d1a/da4/lc5 107 1 2024-04-25T02:27:11.567 INFO:tasks.workunit.client.0.smithi114.stdout:2/660: link d5/d6/d58/d5a/d3e/d54/lca d5/d6/d58/d5a/d3e/ld3 0 2024-04-25T02:27:11.568 INFO:tasks.workunit.client.0.smithi114.stdout:0/601: fsync d1/d4/d62/f94 0 2024-04-25T02:27:11.570 INFO:tasks.workunit.client.0.smithi114.stdout:4/504: read d3/d8/f1b [28454,56389] 0 2024-04-25T02:27:11.571 INFO:tasks.workunit.client.0.smithi114.stdout:1/603: symlink df/d11/d7d/d92/lc6 0 2024-04-25T02:27:11.572 INFO:tasks.workunit.client.0.smithi114.stdout:5/671: dwrite d1/d6/f7b [0,4194304] 0 2024-04-25T02:27:11.572 INFO:tasks.workunit.client.0.smithi114.stdout:7/680: truncate d5/d8b/d99/fd6 51556 0 2024-04-25T02:27:11.574 INFO:tasks.workunit.client.0.smithi114.stdout:4/505: write d3/d14/f47 [187552,44514] 0 2024-04-25T02:27:11.575 INFO:tasks.workunit.client.0.smithi114.stdout:2/661: stat d5/d6/d58/d5a/d3e/d54/lca 0 2024-04-25T02:27:11.576 INFO:tasks.workunit.client.0.smithi114.stdout:5/672: stat d1/d6/de/f9c 0 2024-04-25T02:27:11.577 INFO:tasks.workunit.client.0.smithi114.stdout:9/614: link d8/f98 d8/d16/d21/d24/fcb 0 2024-04-25T02:27:11.577 INFO:tasks.workunit.client.0.smithi114.stdout:1/604: mknod df/d13/d44/d9b/cc7 0 2024-04-25T02:27:11.579 INFO:tasks.workunit.client.0.smithi114.stdout:7/681: mkdir d5/d8b/d99/ddb 0 2024-04-25T02:27:11.580 INFO:tasks.workunit.client.0.smithi114.stdout:6/696: rmdir de/d27/d34/d38 39 2024-04-25T02:27:11.582 INFO:tasks.workunit.client.0.smithi114.stdout:1/605: write df/d13/d75/f9c [310945,70805] 0 2024-04-25T02:27:11.583 INFO:tasks.workunit.client.0.smithi114.stdout:0/602: dwrite d1/d4/d24/d52/f5f [0,4194304] 0 2024-04-25T02:27:11.583 INFO:tasks.workunit.client.0.smithi114.stdout:3/591: dread d0/d25/d2a/fb8 [4194304,4194304] 0 2024-04-25T02:27:11.585 INFO:tasks.workunit.client.0.smithi114.stdout:4/506: rename d3/d14/f68 to d3/d14/d6c/f9a 0 2024-04-25T02:27:11.587 INFO:tasks.workunit.client.0.smithi114.stdout:9/615: write d8/f1f [436214,109238] 0 2024-04-25T02:27:11.588 INFO:tasks.workunit.client.0.smithi114.stdout:8/620: write da/d38/f5b [4176593,86424] 0 2024-04-25T02:27:11.589 INFO:tasks.workunit.client.0.smithi114.stdout:5/673: dread d1/d6/f31 [0,4194304] 0 2024-04-25T02:27:11.589 INFO:tasks.workunit.client.0.smithi114.stdout:1/606: dread df/d11/d6c/d82/fa3 [0,4194304] 0 2024-04-25T02:27:11.589 INFO:tasks.workunit.client.0.smithi114.stdout:6/697: chown de/d25/d39/caf 148064986 1 2024-04-25T02:27:11.589 INFO:tasks.workunit.client.0.smithi114.stdout:2/662: dwrite d5/df/d1e/f38 [4194304,4194304] 0 2024-04-25T02:27:11.591 INFO:tasks.workunit.client.0.smithi114.stdout:2/663: fsync d5/df/d63/f75 0 2024-04-25T02:27:11.592 INFO:tasks.workunit.client.0.smithi114.stdout:4/507: read d3/d8/d23/d35/f54 [2902310,81216] 0 2024-04-25T02:27:11.594 INFO:tasks.workunit.client.0.smithi114.stdout:0/603: creat d1/d7/d18/d2e/fba x:0 0 0 2024-04-25T02:27:11.598 INFO:tasks.workunit.client.0.smithi114.stdout:5/674: dwrite d1/d6/de/dbc/fc3 [0,4194304] 0 2024-04-25T02:27:11.598 INFO:tasks.workunit.client.0.smithi114.stdout:9/616: mknod d8/d16/d21/d24/d3c/d40/ccc 0 2024-04-25T02:27:11.599 INFO:tasks.workunit.client.0.smithi114.stdout:1/607: symlink df/d11/d6c/lc8 0 2024-04-25T02:27:11.601 INFO:tasks.workunit.client.0.smithi114.stdout:8/621: creat da/d69/d93/d6b/fc3 x:0 0 0 2024-04-25T02:27:11.601 INFO:tasks.workunit.client.0.smithi114.stdout:6/698: creat de/d2a/db9/dc7/ffd x:0 0 0 2024-04-25T02:27:11.604 INFO:tasks.workunit.client.0.smithi114.stdout:6/699: write de/d25/d39/d5c/fe3 [718142,55803] 0 2024-04-25T02:27:11.604 INFO:tasks.workunit.client.0.smithi114.stdout:2/664: creat d5/d6/d58/d5a/d3e/fd4 x:0 0 0 2024-04-25T02:27:11.606 INFO:tasks.workunit.client.0.smithi114.stdout:1/608: dwrite df/d13/d75/faa [0,4194304] 0 2024-04-25T02:27:11.608 INFO:tasks.workunit.client.0.smithi114.stdout:6/700: truncate de/d25/d39/d47/d90/d93/d99/fa9 5132904 0 2024-04-25T02:27:11.608 INFO:tasks.workunit.client.0.smithi114.stdout:3/592: unlink d0/d25/d2a/d80/c9d 0 2024-04-25T02:27:11.609 INFO:tasks.workunit.client.0.smithi114.stdout:0/604: write d1/d7/d18/f3b [829903,114981] 0 2024-04-25T02:27:11.610 INFO:tasks.workunit.client.0.smithi114.stdout:5/675: symlink d1/d25/da1/d8a/da8/le1 0 2024-04-25T02:27:11.611 INFO:tasks.workunit.client.0.smithi114.stdout:0/605: write d1/d30/d4d/f4e [1349557,43288] 0 2024-04-25T02:27:11.612 INFO:tasks.workunit.client.0.smithi114.stdout:7/682: link d5/d32/d4a/l68 d5/d32/da6/db5/ldc 0 2024-04-25T02:27:11.614 INFO:tasks.workunit.client.0.smithi114.stdout:7/683: write d5/d19/f2a [2339383,131039] 0 2024-04-25T02:27:11.616 INFO:tasks.workunit.client.0.smithi114.stdout:0/606: dwrite d1/d7/d18/f51 [0,4194304] 0 2024-04-25T02:27:11.618 INFO:tasks.workunit.client.0.smithi114.stdout:1/609: rename df/d11/d25 to df/d13/d44/d5a/dc9 0 2024-04-25T02:27:11.618 INFO:tasks.workunit.client.0.smithi114.stdout:3/593: rmdir d0/d25 39 2024-04-25T02:27:11.621 INFO:tasks.workunit.client.0.smithi114.stdout:5/676: rmdir d1/d6 39 2024-04-25T02:27:11.623 INFO:tasks.workunit.client.0.smithi114.stdout:0/607: dwrite d1/d4/d62/d83/fa3 [0,4194304] 0 2024-04-25T02:27:11.627 INFO:tasks.workunit.client.0.smithi114.stdout:2/665: link d5/df/d3d/d44/f56 d5/d1c/d21/d91/fd5 0 2024-04-25T02:27:11.627 INFO:tasks.workunit.client.0.smithi114.stdout:2/666: fdatasync d5/df/d1e/f6d 0 2024-04-25T02:27:11.628 INFO:tasks.workunit.client.0.smithi114.stdout:7/684: mknod d5/d60/cdd 0 2024-04-25T02:27:11.628 INFO:tasks.workunit.client.0.smithi114.stdout:2/667: chown d5/df/d63/cb9 1169 1 2024-04-25T02:27:11.629 INFO:tasks.workunit.client.0.smithi114.stdout:2/668: read d5/df/f12 [3038893,73089] 0 2024-04-25T02:27:11.629 INFO:tasks.workunit.client.0.smithi114.stdout:6/701: rename de/d1c/la6 to de/d25/d39/d47/d90/d93/lfe 0 2024-04-25T02:27:11.630 INFO:tasks.workunit.client.0.smithi114.stdout:6/702: fsync de/d25/d39/fd1 0 2024-04-25T02:27:11.633 INFO:tasks.workunit.client.0.smithi114.stdout:7/685: mknod d5/d32/d4a/dbc/cde 0 2024-04-25T02:27:11.634 INFO:tasks.workunit.client.0.smithi114.stdout:2/669: dread d5/d6/d58/f99 [0,4194304] 0 2024-04-25T02:27:11.634 INFO:tasks.workunit.client.0.smithi114.stdout:3/594: mkdir d0/d5/d3d/da6/dce/dd6 0 2024-04-25T02:27:11.635 INFO:tasks.workunit.client.0.smithi114.stdout:9/617: getdents d8/d16/d21/d24/d69 0 2024-04-25T02:27:11.638 INFO:tasks.workunit.client.0.smithi114.stdout:9/618: dread d8/f74 [0,4194304] 0 2024-04-25T02:27:11.639 INFO:tasks.workunit.client.0.smithi114.stdout:6/703: mkdir de/d27/d34/dff 0 2024-04-25T02:27:11.640 INFO:tasks.workunit.client.0.smithi114.stdout:3/595: truncate d0/d25/d29/d85/d7e/f93 536389 0 2024-04-25T02:27:11.640 INFO:tasks.workunit.client.0.smithi114.stdout:3/596: read - d0/d25/d2a/d80/fcf zero size 2024-04-25T02:27:11.641 INFO:tasks.workunit.client.0.smithi114.stdout:7/686: symlink d5/d32/da6/db5/db9/ldf 0 2024-04-25T02:27:11.642 INFO:tasks.workunit.client.0.smithi114.stdout:5/677: link d1/d25/c96 d1/d6/d4f/d6c/d88/ce2 0 2024-04-25T02:27:11.643 INFO:tasks.workunit.client.0.smithi114.stdout:3/597: mkdir d0/d5/d3d/dd7 0 2024-04-25T02:27:11.647 INFO:tasks.workunit.client.0.smithi114.stdout:7/687: rename d5/d19/d1a/f36 to d5/d19/d23/fe0 0 2024-04-25T02:27:11.648 INFO:tasks.workunit.client.0.smithi114.stdout:5/678: dwrite d1/d6/d1a/f2f [0,4194304] 0 2024-04-25T02:27:11.650 INFO:tasks.workunit.client.0.smithi114.stdout:3/598: dwrite d0/d25/d29/d78/f82 [0,4194304] 0 2024-04-25T02:27:11.652 INFO:tasks.workunit.client.0.smithi114.stdout:3/599: truncate d0/d25/d2a/d80/fcf 242743 0 2024-04-25T02:27:11.656 INFO:tasks.workunit.client.0.smithi114.stdout:3/600: mknod d0/d25/d2a/d36/dbb/cd8 0 2024-04-25T02:27:11.656 INFO:tasks.workunit.client.0.smithi114.stdout:5/679: dwrite d1/d6/de/f79 [0,4194304] 0 2024-04-25T02:27:11.656 INFO:tasks.workunit.client.0.smithi114.stdout:7/688: link d5/d32/d4a/d51/f96 d5/d32/d4a/fe1 0 2024-04-25T02:27:11.660 INFO:tasks.workunit.client.0.smithi114.stdout:7/689: dread d5/d8b/d99/fd6 [0,4194304] 0 2024-04-25T02:27:11.661 INFO:tasks.workunit.client.0.smithi114.stdout:3/601: read d0/d25/d2a/d36/f37 [104905,72608] 0 2024-04-25T02:27:11.662 INFO:tasks.workunit.client.0.smithi114.stdout:5/680: dwrite d1/d6/d1a/f2f [0,4194304] 0 2024-04-25T02:27:11.665 INFO:tasks.workunit.client.0.smithi114.stdout:3/602: truncate d0/d5/fc 4961154 0 2024-04-25T02:27:11.666 INFO:tasks.workunit.client.0.smithi114.stdout:7/690: dread d5/fa0 [0,4194304] 0 2024-04-25T02:27:11.667 INFO:tasks.workunit.client.0.smithi114.stdout:5/681: rename d1/d25/da1/d8a/lab to d1/d51/d6f/le3 0 2024-04-25T02:27:11.667 INFO:tasks.workunit.client.0.smithi114.stdout:3/603: fdatasync d0/d25/f48 0 2024-04-25T02:27:11.668 INFO:tasks.workunit.client.0.smithi114.stdout:5/682: chown d1/d25/f1f 431936737 1 2024-04-25T02:27:11.668 INFO:tasks.workunit.client.0.smithi114.stdout:7/691: creat d5/d60/fe2 x:0 0 0 2024-04-25T02:27:11.669 INFO:tasks.workunit.client.0.smithi114.stdout:3/604: write d0/d25/f73 [3441388,16302] 0 2024-04-25T02:27:11.670 INFO:tasks.workunit.client.0.smithi114.stdout:3/605: fsync d0/d25/d2a/d36/f37 0 2024-04-25T02:27:11.671 INFO:tasks.workunit.client.0.smithi114.stdout:5/683: rename d1/d6/de/f79 to d1/d51/d6f/fe4 0 2024-04-25T02:27:11.672 INFO:tasks.workunit.client.0.smithi114.stdout:3/606: rmdir d0/d25/d29/d85/d7e/da9/dad 39 2024-04-25T02:27:11.672 INFO:tasks.workunit.client.0.smithi114.stdout:7/692: dread d5/d32/f2f [0,4194304] 0 2024-04-25T02:27:11.672 INFO:tasks.workunit.client.0.smithi114.stdout:5/684: write d1/d6/d1a/f2f [3103402,51987] 0 2024-04-25T02:27:11.674 INFO:tasks.workunit.client.0.smithi114.stdout:5/685: truncate d1/d6/d4f/d6c/d88/fb5 1669439 0 2024-04-25T02:27:11.675 INFO:tasks.workunit.client.0.smithi114.stdout:7/693: symlink d5/d19/d23/le3 0 2024-04-25T02:27:11.676 INFO:tasks.workunit.client.0.smithi114.stdout:7/694: chown d5/d19/d1a/daf/fc2 144543186 1 2024-04-25T02:27:11.678 INFO:tasks.workunit.client.0.smithi114.stdout:3/607: getdents d0/d25/d29/d85/d7e/da9/dad 0 2024-04-25T02:27:11.679 INFO:tasks.workunit.client.0.smithi114.stdout:3/608: readlink d0/d25/d29/d60/l71 0 2024-04-25T02:27:11.681 INFO:tasks.workunit.client.0.smithi114.stdout:7/695: dwrite d5/d19/f34 [0,4194304] 0 2024-04-25T02:27:11.682 INFO:tasks.workunit.client.0.smithi114.stdout:3/609: rmdir d0/d5/d3d/da6/dce 39 2024-04-25T02:27:11.682 INFO:tasks.workunit.client.0.smithi114.stdout:7/696: readlink d5/d32/d4a/lab 0 2024-04-25T02:27:11.686 INFO:tasks.workunit.client.0.smithi114.stdout:7/697: dread d5/d19/f1d [0,4194304] 0 2024-04-25T02:27:11.688 INFO:tasks.workunit.client.0.smithi114.stdout:7/698: mkdir d5/d43/d63/d7a/de4 0 2024-04-25T02:27:11.691 INFO:tasks.workunit.client.0.smithi114.stdout:7/699: link d5/c30 d5/d19/d1a/da4/db3/ce5 0 2024-04-25T02:27:11.693 INFO:tasks.workunit.client.0.smithi114.stdout:7/700: read d5/d32/d64/f89 [258026,121076] 0 2024-04-25T02:27:11.693 INFO:tasks.workunit.client.0.smithi114.stdout:7/701: chown d5/d19/l59 229707257 1 2024-04-25T02:27:11.694 INFO:tasks.workunit.client.0.smithi114.stdout:7/702: dread - d5/d60/fe2 zero size 2024-04-25T02:27:11.709 INFO:tasks.workunit.client.0.smithi114.stdout:4/508: dwrite d3/f16 [0,4194304] 0 2024-04-25T02:27:11.712 INFO:tasks.workunit.client.0.smithi114.stdout:8/622: dwrite da/d1d/fa2 [0,4194304] 0 2024-04-25T02:27:11.714 INFO:tasks.workunit.client.0.smithi114.stdout:4/509: dread d3/d8/d23/f8f [0,4194304] 0 2024-04-25T02:27:11.715 INFO:tasks.workunit.client.0.smithi114.stdout:8/623: symlink da/d38/d62/d6d/d52/da8/db1/lc4 0 2024-04-25T02:27:11.716 INFO:tasks.workunit.client.0.smithi114.stdout:4/510: write d3/d8/d23/d25/d31/d33/f29 [3179035,120675] 0 2024-04-25T02:27:11.727 INFO:tasks.workunit.client.0.smithi114.stdout:2/670: sync 2024-04-25T02:27:11.729 INFO:tasks.workunit.client.0.smithi114.stdout:7/703: dread d5/d19/d1a/d80/f9f [0,4194304] 0 2024-04-25T02:27:11.729 INFO:tasks.workunit.client.0.smithi114.stdout:7/704: stat d5/d19/d23/f3f 0 2024-04-25T02:27:11.730 INFO:tasks.workunit.client.0.smithi114.stdout:2/671: creat d5/d1c/d21/db0/fd6 x:0 0 0 2024-04-25T02:27:11.731 INFO:tasks.workunit.client.0.smithi114.stdout:7/705: creat d5/d19/d1a/da4/fe6 x:0 0 0 2024-04-25T02:27:11.737 INFO:tasks.workunit.client.0.smithi114.stdout:7/706: dread d5/d19/d1a/fb2 [0,4194304] 0 2024-04-25T02:27:11.741 INFO:tasks.workunit.client.0.smithi114.stdout:0/608: write d1/d7/d18/d2e/f34 [4448183,66723] 0 2024-04-25T02:27:11.743 INFO:tasks.workunit.client.0.smithi114.stdout:0/609: link d1/d4/f9e d1/d4/da/d3e/fbb 0 2024-04-25T02:27:11.745 INFO:tasks.workunit.client.0.smithi114.stdout:0/610: creat d1/d4/d4f/d77/fbc x:0 0 0 2024-04-25T02:27:11.751 INFO:tasks.workunit.client.0.smithi114.stdout:1/610: truncate df/d13/d44/d5a/dc9/d33/d47/d9d/fa1 1331978 0 2024-04-25T02:27:11.754 INFO:tasks.workunit.client.0.smithi114.stdout:5/686: rename d1/d3e/d60 to d1/d3e/d8e/de5 0 2024-04-25T02:27:11.756 INFO:tasks.workunit.client.0.smithi114.stdout:9/619: write d8/d16/d21/d83/d39/d38/f84 [200019,72412] 0 2024-04-25T02:27:11.757 INFO:tasks.workunit.client.0.smithi114.stdout:5/687: mknod d1/d3e/ce6 0 2024-04-25T02:27:11.759 INFO:tasks.workunit.client.0.smithi114.stdout:1/611: rename df/d13/d75/db8/d7b to df/d13/d93/dca 0 2024-04-25T02:27:11.760 INFO:tasks.workunit.client.0.smithi114.stdout:6/704: dread de/f16 [4194304,4194304] 0 2024-04-25T02:27:11.761 INFO:tasks.workunit.client.0.smithi114.stdout:6/705: chown de/d1c/c46 112276065 1 2024-04-25T02:27:11.761 INFO:tasks.workunit.client.0.smithi114.stdout:5/688: symlink d1/d6/d1a/le7 0 2024-04-25T02:27:11.762 INFO:tasks.workunit.client.0.smithi114.stdout:4/511: dread d3/d14/f37 [0,4194304] 0 2024-04-25T02:27:11.763 INFO:tasks.workunit.client.0.smithi114.stdout:2/672: dread d5/d6/fc [0,4194304] 0 2024-04-25T02:27:11.764 INFO:tasks.workunit.client.0.smithi114.stdout:6/706: dread - de/d27/d34/d38/fed zero size 2024-04-25T02:27:11.765 INFO:tasks.workunit.client.0.smithi114.stdout:5/689: unlink d1/d51/d6f/cb0 0 2024-04-25T02:27:11.767 INFO:tasks.workunit.client.0.smithi114.stdout:4/512: write d3/d8/d30/d4c/f69 [972961,82630] 0 2024-04-25T02:27:11.768 INFO:tasks.workunit.client.0.smithi114.stdout:6/707: mkdir de/d2a/db9/dc7/d100 0 2024-04-25T02:27:11.770 INFO:tasks.workunit.client.0.smithi114.stdout:3/610: sync 2024-04-25T02:27:11.771 INFO:tasks.workunit.client.0.smithi114.stdout:2/673: dwrite d5/d6/fc8 [0,4194304] 0 2024-04-25T02:27:11.771 INFO:tasks.workunit.client.0.smithi114.stdout:1/612: link fe df/d13/d75/fcb 0 2024-04-25T02:27:11.773 INFO:tasks.workunit.client.0.smithi114.stdout:5/690: fdatasync d1/d6/f31 0 2024-04-25T02:27:11.775 INFO:tasks.workunit.client.0.smithi114.stdout:4/513: dread d3/f16 [0,4194304] 0 2024-04-25T02:27:11.776 INFO:tasks.workunit.client.0.smithi114.stdout:6/708: rename de/d25/d39/d5c/f6f to de/d1c/df7/f101 0 2024-04-25T02:27:11.778 INFO:tasks.workunit.client.0.smithi114.stdout:3/611: dwrite d0/d25/fa1 [0,4194304] 0 2024-04-25T02:27:11.783 INFO:tasks.workunit.client.0.smithi114.stdout:6/709: mkdir de/d27/d34/d4b/d102 0 2024-04-25T02:27:11.786 INFO:tasks.workunit.client.0.smithi114.stdout:1/613: creat df/d13/d75/d8e/d98/fcc x:0 0 0 2024-04-25T02:27:11.786 INFO:tasks.workunit.client.0.smithi114.stdout:1/614: readlink df/d13/d6e/l99 0 2024-04-25T02:27:11.789 INFO:tasks.workunit.client.0.smithi114.stdout:1/615: dread - df/d13/d44/d5a/dc9/d33/d47/d9d/fb6 zero size 2024-04-25T02:27:11.789 INFO:tasks.workunit.client.0.smithi114.stdout:7/707: truncate d5/d32/d4a/d51/f5b 4176535 0 2024-04-25T02:27:11.791 INFO:tasks.workunit.client.0.smithi114.stdout:8/624: dwrite da/d69/d93/f64 [4194304,4194304] 0 2024-04-25T02:27:11.793 INFO:tasks.workunit.client.0.smithi114.stdout:8/625: read - da/d69/d93/fc1 zero size 2024-04-25T02:27:11.795 INFO:tasks.workunit.client.0.smithi114.stdout:1/616: readlink df/d13/d1e/l64 0 2024-04-25T02:27:11.795 INFO:tasks.workunit.client.0.smithi114.stdout:7/708: rmdir d5/d43 39 2024-04-25T02:27:11.796 INFO:tasks.workunit.client.0.smithi114.stdout:0/611: dwrite d1/d4/fb6 [0,4194304] 0 2024-04-25T02:27:11.797 INFO:tasks.workunit.client.0.smithi114.stdout:6/710: rmdir de/d25/d39/dec/dee 0 2024-04-25T02:27:11.799 INFO:tasks.workunit.client.0.smithi114.stdout:3/612: getdents d0/d25/d2a/d36 0 2024-04-25T02:27:11.799 INFO:tasks.workunit.client.0.smithi114.stdout:6/711: fdatasync de/d30/f9e 0 2024-04-25T02:27:11.800 INFO:tasks.workunit.client.0.smithi114.stdout:9/620: write d8/d16/d21/d83/f5f [3373039,34654] 0 2024-04-25T02:27:11.801 INFO:tasks.workunit.client.0.smithi114.stdout:0/612: creat d1/d7/d46/fbd x:0 0 0 2024-04-25T02:27:11.803 INFO:tasks.workunit.client.0.smithi114.stdout:6/712: creat de/d2a/f103 x:0 0 0 2024-04-25T02:27:11.804 INFO:tasks.workunit.client.0.smithi114.stdout:8/626: dwrite da/d1e/f6a [0,4194304] 0 2024-04-25T02:27:11.805 INFO:tasks.workunit.client.0.smithi114.stdout:6/713: dread - de/d27/d34/d44/fcc zero size 2024-04-25T02:27:11.806 INFO:tasks.workunit.client.0.smithi114.stdout:3/613: symlink d0/d25/d2a/d80/dbd/ld9 0 2024-04-25T02:27:11.808 INFO:tasks.workunit.client.0.smithi114.stdout:9/621: rename d8/f49 to d8/d16/d21/d37/fcd 0 2024-04-25T02:27:11.809 INFO:tasks.workunit.client.0.smithi114.stdout:3/614: creat d0/d25/d2a/d36/fda x:0 0 0 2024-04-25T02:27:11.812 INFO:tasks.workunit.client.0.smithi114.stdout:9/622: truncate d8/fe 3280445 0 2024-04-25T02:27:11.812 INFO:tasks.workunit.client.0.smithi114.stdout:8/627: dwrite da/d69/faf [0,4194304] 0 2024-04-25T02:27:11.815 INFO:tasks.workunit.client.0.smithi114.stdout:6/714: dwrite de/d25/fbc [0,4194304] 0 2024-04-25T02:27:11.815 INFO:tasks.workunit.client.0.smithi114.stdout:9/623: dread - d8/d16/d21/d24/fcb zero size 2024-04-25T02:27:11.816 INFO:tasks.workunit.client.0.smithi114.stdout:8/628: creat da/d38/fc5 x:0 0 0 2024-04-25T02:27:11.817 INFO:tasks.workunit.client.0.smithi114.stdout:9/624: dread - d8/d16/d21/f9f zero size 2024-04-25T02:27:11.817 INFO:tasks.workunit.client.0.smithi114.stdout:3/615: dwrite d0/fa [0,4194304] 0 2024-04-25T02:27:11.819 INFO:tasks.workunit.client.0.smithi114.stdout:6/715: fdatasync de/d27/d34/d38/f87 0 2024-04-25T02:27:11.821 INFO:tasks.workunit.client.0.smithi114.stdout:6/716: chown de/d27/d34/d44/fb4 19193 1 2024-04-25T02:27:11.823 INFO:tasks.workunit.client.0.smithi114.stdout:6/717: creat de/d2a/f104 x:0 0 0 2024-04-25T02:27:11.824 INFO:tasks.workunit.client.0.smithi114.stdout:8/629: getdents da/d69/d87/db4 0 2024-04-25T02:27:11.824 INFO:tasks.workunit.client.0.smithi114.stdout:6/718: read - de/d27/d34/d44/fcc zero size 2024-04-25T02:27:11.825 INFO:tasks.workunit.client.0.smithi114.stdout:6/719: fsync de/f92 0 2024-04-25T02:27:11.827 INFO:tasks.workunit.client.0.smithi114.stdout:6/720: symlink de/d27/d34/d38/l105 0 2024-04-25T02:27:11.829 INFO:tasks.workunit.client.0.smithi114.stdout:6/721: creat de/d27/d34/d4b/d102/f106 x:0 0 0 2024-04-25T02:27:11.830 INFO:tasks.workunit.client.0.smithi114.stdout:6/722: symlink de/d27/d34/d38/l107 0 2024-04-25T02:27:11.832 INFO:tasks.workunit.client.0.smithi114.stdout:6/723: unlink de/d27/d34/d38/c97 0 2024-04-25T02:27:11.832 INFO:tasks.workunit.client.0.smithi114.stdout:6/724: chown de/d2a/db9/dc7/ffd 1797 1 2024-04-25T02:27:11.833 INFO:tasks.workunit.client.0.smithi114.stdout:6/725: write de/f1f [2439442,79861] 0 2024-04-25T02:27:11.835 INFO:tasks.workunit.client.0.smithi114.stdout:6/726: symlink de/d25/d39/d47/d90/d93/d99/l108 0 2024-04-25T02:27:11.836 INFO:tasks.workunit.client.0.smithi114.stdout:6/727: fdatasync de/d1c/fe1 0 2024-04-25T02:27:11.836 INFO:tasks.workunit.client.0.smithi114.stdout:5/691: sync 2024-04-25T02:27:11.837 INFO:tasks.workunit.client.0.smithi114.stdout:6/728: chown de/d2a/db9/dc7 25526625 1 2024-04-25T02:27:11.837 INFO:tasks.workunit.client.0.smithi114.stdout:6/729: read - de/d27/d34/d4b/d102/f106 zero size 2024-04-25T02:27:11.839 INFO:tasks.workunit.client.0.smithi114.stdout:6/730: creat de/d25/dad/f109 x:0 0 0 2024-04-25T02:27:11.840 INFO:tasks.workunit.client.0.smithi114.stdout:6/731: readlink de/d2a/l6a 0 2024-04-25T02:27:11.842 INFO:tasks.workunit.client.0.smithi114.stdout:5/692: dwrite d1/d25/d24/fcd [0,4194304] 0 2024-04-25T02:27:11.843 INFO:tasks.workunit.client.0.smithi114.stdout:5/693: fsync d1/d53/f7c 0 2024-04-25T02:27:11.843 INFO:tasks.workunit.client.0.smithi114.stdout:6/732: dread de/d27/d34/d44/fb1 [0,4194304] 0 2024-04-25T02:27:11.847 INFO:tasks.workunit.client.0.smithi114.stdout:6/733: getdents de 0 2024-04-25T02:27:11.847 INFO:tasks.workunit.client.0.smithi114.stdout:6/734: chown de/d27/d34/l52 685 1 2024-04-25T02:27:11.848 INFO:tasks.workunit.client.0.smithi114.stdout:6/735: chown de/d25/d39/d47/d90/d93/d99/faa 27 1 2024-04-25T02:27:11.850 INFO:tasks.workunit.client.0.smithi114.stdout:6/736: getdents de/d25/d39/d5c 0 2024-04-25T02:27:11.851 INFO:tasks.workunit.client.0.smithi114.stdout:6/737: chown de/d25/d39/d47/d90/d93/d99/l108 5835138 1 2024-04-25T02:27:11.854 INFO:tasks.workunit.client.0.smithi114.stdout:6/738: rename de/f16 to de/d25/d39/d47/d90/d93/d99/f10a 0 2024-04-25T02:27:11.867 INFO:tasks.workunit.client.0.smithi114.stdout:2/674: dread d5/d6/d58/d5a/f4e [0,4194304] 0 2024-04-25T02:27:11.868 INFO:tasks.workunit.client.0.smithi114.stdout:9/625: dread d8/d16/d21/d83/d39/d38/f80 [0,4194304] 0 2024-04-25T02:27:11.870 INFO:tasks.workunit.client.0.smithi114.stdout:3/616: read d0/d25/f2e [3154935,88153] 0 2024-04-25T02:27:11.873 INFO:tasks.workunit.client.0.smithi114.stdout:2/675: rename d5/df/d2c/d66/fa5 to d5/df/d2c/d66/dc2/fd7 0 2024-04-25T02:27:11.873 INFO:tasks.workunit.client.0.smithi114.stdout:9/626: rename d8 to d8/d16/d21/d83/d39/d38/d46/dce 22 2024-04-25T02:27:11.878 INFO:tasks.workunit.client.0.smithi114.stdout:2/676: dwrite d5/df/f53 [0,4194304] 0 2024-04-25T02:27:11.883 INFO:tasks.workunit.client.0.smithi114.stdout:2/677: rename d5/f1d to d5/df/d3d/d81/fd8 0 2024-04-25T02:27:11.885 INFO:tasks.workunit.client.0.smithi114.stdout:2/678: symlink d5/d1c/d21/d91/ld9 0 2024-04-25T02:27:11.885 INFO:tasks.workunit.client.0.smithi114.stdout:2/679: read - d5/d1c/d22/d67/db2/fb7 zero size 2024-04-25T02:27:11.887 INFO:tasks.workunit.client.0.smithi114.stdout:2/680: fsync d5/d6/fab 0 2024-04-25T02:27:11.924 INFO:tasks.workunit.client.0.smithi114.stdout:1/617: fsync df/d13/d75/d8e/d98/fcc 0 2024-04-25T02:27:11.925 INFO:tasks.workunit.client.0.smithi114.stdout:4/514: truncate d3/d8/d12/d19/d42/d58/f6b 3348532 0 2024-04-25T02:27:11.927 INFO:tasks.workunit.client.0.smithi114.stdout:4/515: write d3/d8/d12/d19/f85 [5134050,30250] 0 2024-04-25T02:27:11.928 INFO:tasks.workunit.client.0.smithi114.stdout:1/618: truncate df/d13/d44/d5a/dc9/d33/d47/f9e 3893907 0 2024-04-25T02:27:11.931 INFO:tasks.workunit.client.0.smithi114.stdout:0/613: dread d1/d4/f1b [0,4194304] 0 2024-04-25T02:27:11.932 INFO:tasks.workunit.client.0.smithi114.stdout:4/516: rename d3/d14/f3b to d3/d8/d12/d19/d42/d58/f9b 0 2024-04-25T02:27:11.933 INFO:tasks.workunit.client.0.smithi114.stdout:1/619: creat df/d2a/d34/fcd x:0 0 0 2024-04-25T02:27:11.933 INFO:tasks.workunit.client.0.smithi114.stdout:7/709: write d5/d32/d64/fac [4880729,101998] 0 2024-04-25T02:27:11.934 INFO:tasks.workunit.client.0.smithi114.stdout:3/617: sync 2024-04-25T02:27:11.936 INFO:tasks.workunit.client.0.smithi114.stdout:0/614: creat d1/d4/db4/fbe x:0 0 0 2024-04-25T02:27:11.939 INFO:tasks.workunit.client.0.smithi114.stdout:4/517: creat d3/d8/d30/d4c/d7f/d8d/f9c x:0 0 0 2024-04-25T02:27:11.939 INFO:tasks.workunit.client.0.smithi114.stdout:4/518: chown d3/d8/d23/c60 1046 1 2024-04-25T02:27:11.942 INFO:tasks.workunit.client.0.smithi114.stdout:3/618: mknod d0/d25/d2a/dc1/cdb 0 2024-04-25T02:27:11.945 INFO:tasks.workunit.client.0.smithi114.stdout:1/620: rmdir df/d13/d44/d9b/dbd 0 2024-04-25T02:27:11.946 INFO:tasks.workunit.client.0.smithi114.stdout:3/619: read d0/d5/d3d/f54 [183444,35329] 0 2024-04-25T02:27:11.946 INFO:tasks.workunit.client.0.smithi114.stdout:1/621: fsync f4 0 2024-04-25T02:27:11.946 INFO:tasks.workunit.client.0.smithi114.stdout:0/615: dwrite d1/f10 [0,4194304] 0 2024-04-25T02:27:11.948 INFO:tasks.workunit.client.0.smithi114.stdout:7/710: getdents d5/d60 0 2024-04-25T02:27:11.949 INFO:tasks.workunit.client.0.smithi114.stdout:4/519: symlink d3/d8/l9d 0 2024-04-25T02:27:11.952 INFO:tasks.workunit.client.0.smithi114.stdout:8/630: dwrite da/d69/d87/db4/f80 [0,4194304] 0 2024-04-25T02:27:11.955 INFO:tasks.workunit.client.0.smithi114.stdout:7/711: symlink d5/d8b/le7 0 2024-04-25T02:27:11.958 INFO:tasks.workunit.client.0.smithi114.stdout:5/694: truncate d1/d6/f7b 413512 0 2024-04-25T02:27:11.963 INFO:tasks.workunit.client.0.smithi114.stdout:3/620: dwrite d0/d25/d2a/d34/db6/fd2 [0,4194304] 0 2024-04-25T02:27:11.963 INFO:tasks.workunit.client.0.smithi114.stdout:1/622: getdents df/d13/d93/dca 0 2024-04-25T02:27:11.965 INFO:tasks.workunit.client.0.smithi114.stdout:8/631: dwrite da/d38/d62/d6d/d52/d6c/f8b [4194304,4194304] 0 2024-04-25T02:27:11.965 INFO:tasks.workunit.client.0.smithi114.stdout:0/616: dwrite d1/d4/ff [0,4194304] 0 2024-04-25T02:27:11.965 INFO:tasks.workunit.client.0.smithi114.stdout:4/520: rename d3/d8/d23/d25/d4e/f79 to d3/d8/d23/d25/d31/f9e 0 2024-04-25T02:27:11.966 INFO:tasks.workunit.client.0.smithi114.stdout:6/739: write de/d2a/f9d [5068290,99650] 0 2024-04-25T02:27:11.967 INFO:tasks.workunit.client.0.smithi114.stdout:9/627: write d8/f71 [4279468,114460] 0 2024-04-25T02:27:11.967 INFO:tasks.workunit.client.0.smithi114.stdout:5/695: creat d1/d25/fe8 x:0 0 0 2024-04-25T02:27:11.968 INFO:tasks.workunit.client.0.smithi114.stdout:1/623: dread df/d2a/f70 [0,4194304] 0 2024-04-25T02:27:11.968 INFO:tasks.workunit.client.0.smithi114.stdout:0/617: dread - d1/d7/d68/f8d zero size 2024-04-25T02:27:11.971 INFO:tasks.workunit.client.0.smithi114.stdout:1/624: stat df/d11/d32/f8b 0 2024-04-25T02:27:11.971 INFO:tasks.workunit.client.0.smithi114.stdout:2/681: write d5/d6/d58/f99 [573483,2080] 0 2024-04-25T02:27:11.974 INFO:tasks.workunit.client.0.smithi114.stdout:6/740: fdatasync de/d27/d34/d44/f80 0 2024-04-25T02:27:11.976 INFO:tasks.workunit.client.0.smithi114.stdout:0/618: dwrite d1/d7/d46/fbd [0,4194304] 0 2024-04-25T02:27:11.978 INFO:tasks.workunit.client.0.smithi114.stdout:9/628: mkdir d8/d16/d21/d83/dcf 0 2024-04-25T02:27:11.983 INFO:tasks.workunit.client.0.smithi114.stdout:8/632: symlink da/d38/d62/d6d/d52/da8/db1/lc6 0 2024-04-25T02:27:11.987 INFO:tasks.workunit.client.0.smithi114.stdout:4/521: rename d3/d8/d12/d19/d42/c73 to d3/d8/d12/d19/d26/d3e/c9f 0 2024-04-25T02:27:11.990 INFO:tasks.workunit.client.0.smithi114.stdout:4/522: dread d3/fa [0,4194304] 0 2024-04-25T02:27:11.994 INFO:tasks.workunit.client.0.smithi114.stdout:9/629: creat d8/d16/d21/d83/d39/d38/d46/d53/da2/fd0 x:0 0 0 2024-04-25T02:27:11.995 INFO:tasks.workunit.client.0.smithi114.stdout:9/630: write d8/d16/d21/d37/d60/d70/f94 [6004138,127031] 0 2024-04-25T02:27:11.995 INFO:tasks.workunit.client.0.smithi114.stdout:9/631: readlink d8/d16/d21/d24/l55 0 2024-04-25T02:27:11.997 INFO:tasks.workunit.client.0.smithi114.stdout:9/632: write d8/d16/d21/d37/d43/f7b [583857,103984] 0 2024-04-25T02:27:11.997 INFO:tasks.workunit.client.0.smithi114.stdout:8/633: symlink da/d38/d62/d6d/d52/lc7 0 2024-04-25T02:27:11.998 INFO:tasks.workunit.client.0.smithi114.stdout:8/634: chown da/d38/d62/d6d/f7f 122292040 1 2024-04-25T02:27:11.998 INFO:tasks.workunit.client.0.smithi114.stdout:5/696: link d1/d6/de/f4b d1/d6/d1a/d7f/fe9 0 2024-04-25T02:27:11.998 INFO:tasks.workunit.client.0.smithi114.stdout:8/635: stat da/d69/d93/d6b/f7e 0 2024-04-25T02:27:12.004 INFO:tasks.workunit.client.0.smithi114.stdout:6/741: mknod de/d27/c10b 0 2024-04-25T02:27:12.004 INFO:tasks.workunit.client.0.smithi114.stdout:9/633: dwrite d8/d16/d21/d83/d39/d38/d46/d96/fc1 [0,4194304] 0 2024-04-25T02:27:12.006 INFO:tasks.workunit.client.0.smithi114.stdout:8/636: dwrite da/d1e/f6a [0,4194304] 0 2024-04-25T02:27:12.011 INFO:tasks.workunit.client.0.smithi114.stdout:8/637: dread da/d69/d87/db4/f80 [0,4194304] 0 2024-04-25T02:27:12.014 INFO:tasks.workunit.client.0.smithi114.stdout:6/742: symlink de/d2a/db9/l10c 0 2024-04-25T02:27:12.020 INFO:tasks.workunit.client.0.smithi114.stdout:1/625: getdents df/d13/d44/d5a/dc9/d33/d47 0 2024-04-25T02:27:12.021 INFO:tasks.workunit.client.0.smithi114.stdout:5/697: mkdir d1/d6/de/da7/dce/dea 0 2024-04-25T02:27:12.024 INFO:tasks.workunit.client.0.smithi114.stdout:1/626: dread df/d13/d44/d5a/dc9/f5d [0,4194304] 0 2024-04-25T02:27:12.025 INFO:tasks.workunit.client.0.smithi114.stdout:3/621: truncate d0/d25/d2a/d80/f90 403198 0 2024-04-25T02:27:12.025 INFO:tasks.workunit.client.0.smithi114.stdout:1/627: dread - df/d13/d44/d5a/dc9/d33/d47/d74/fae zero size 2024-04-25T02:27:12.027 INFO:tasks.workunit.client.0.smithi114.stdout:0/619: getdents d1 0 2024-04-25T02:27:12.027 INFO:tasks.workunit.client.0.smithi114.stdout:1/628: readlink df/d13/d44/d5a/dc9/d33/d47/lb0 0 2024-04-25T02:27:12.029 INFO:tasks.workunit.client.0.smithi114.stdout:5/698: write d1/d53/fb4 [152116,31621] 0 2024-04-25T02:27:12.031 INFO:tasks.workunit.client.0.smithi114.stdout:2/682: truncate d5/d1c/d22/f9e 1485163 0 2024-04-25T02:27:12.032 INFO:tasks.workunit.client.0.smithi114.stdout:3/622: dwrite d0/d25/d29/d78/f82 [0,4194304] 0 2024-04-25T02:27:12.034 INFO:tasks.workunit.client.0.smithi114.stdout:9/634: dread d8/d16/d21/d83/d39/f35 [0,4194304] 0 2024-04-25T02:27:12.035 INFO:tasks.workunit.client.0.smithi114.stdout:9/635: stat d8/d16/d21/d24/d3c/d40/l8b 0 2024-04-25T02:27:12.035 INFO:tasks.workunit.client.0.smithi114.stdout:0/620: mknod d1/d4/da/d39/da7/cbf 0 2024-04-25T02:27:12.036 INFO:tasks.workunit.client.0.smithi114.stdout:7/712: sync 2024-04-25T02:27:12.043 INFO:tasks.workunit.client.0.smithi114.stdout:4/523: dwrite d3/d8/d12/d19/f74 [0,4194304] 0 2024-04-25T02:27:12.046 INFO:tasks.workunit.client.0.smithi114.stdout:3/623: rename d0/d25/d2a/dc1 to d0/d5/d3d/ddc 0 2024-04-25T02:27:12.048 INFO:tasks.workunit.client.0.smithi114.stdout:3/624: write d0/d25/d2a/d36/fb1 [17843,89876] 0 2024-04-25T02:27:12.048 INFO:tasks.workunit.client.0.smithi114.stdout:9/636: truncate d8/d16/d21/d83/d39/d38/d5d/fb9 1173768 0 2024-04-25T02:27:12.049 INFO:tasks.workunit.client.0.smithi114.stdout:3/625: write d0/d25/d29/d78/faf [177529,65499] 0 2024-04-25T02:27:12.050 INFO:tasks.workunit.client.0.smithi114.stdout:7/713: symlink d5/d19/d1a/da4/le8 0 2024-04-25T02:27:12.052 INFO:tasks.workunit.client.0.smithi114.stdout:1/629: link df/d13/d1e/f50 df/d13/d44/d5a/dc9/d33/fce 0 2024-04-25T02:27:12.054 INFO:tasks.workunit.client.0.smithi114.stdout:4/524: mkdir d3/d8/d23/d35/d89/da0 0 2024-04-25T02:27:12.056 INFO:tasks.workunit.client.0.smithi114.stdout:4/525: truncate d3/d8/d23/d25/f87 778160 0 2024-04-25T02:27:12.056 INFO:tasks.workunit.client.0.smithi114.stdout:0/621: rename d1/d4/f9e to d1/d7/d18/d2e/fc0 0 2024-04-25T02:27:12.056 INFO:tasks.workunit.client.0.smithi114.stdout:4/526: chown d3/d8/d12/f1e 85092 1 2024-04-25T02:27:12.058 INFO:tasks.workunit.client.0.smithi114.stdout:0/622: read d1/d4/d62/d83/f8c [3132313,55244] 0 2024-04-25T02:27:12.059 INFO:tasks.workunit.client.0.smithi114.stdout:7/714: readlink d5/d43/l94 0 2024-04-25T02:27:12.059 INFO:tasks.workunit.client.0.smithi114.stdout:5/699: creat d1/d3e/feb x:0 0 0 2024-04-25T02:27:12.060 INFO:tasks.workunit.client.0.smithi114.stdout:0/623: fdatasync d1/d30/d4d/f5b 0 2024-04-25T02:27:12.062 INFO:tasks.workunit.client.0.smithi114.stdout:8/638: sync 2024-04-25T02:27:12.063 INFO:tasks.workunit.client.0.smithi114.stdout:2/683: getdents d5/df/d3d/d81 0 2024-04-25T02:27:12.063 INFO:tasks.workunit.client.0.smithi114.stdout:5/700: write d1/d25/d24/fcd [4621654,51032] 0 2024-04-25T02:27:12.063 INFO:tasks.workunit.client.0.smithi114.stdout:7/715: mkdir d5/d32/d4a/d91/de9 0 2024-04-25T02:27:12.066 INFO:tasks.workunit.client.0.smithi114.stdout:2/684: dread - d5/d1c/d21/fa7 zero size 2024-04-25T02:27:12.067 INFO:tasks.workunit.client.0.smithi114.stdout:1/630: creat df/d11/fcf x:0 0 0 2024-04-25T02:27:12.067 INFO:tasks.workunit.client.0.smithi114.stdout:4/527: dwrite d3/f92 [0,4194304] 0 2024-04-25T02:27:12.070 INFO:tasks.workunit.client.0.smithi114.stdout:1/631: readlink df/d13/d44/l52 0 2024-04-25T02:27:12.070 INFO:tasks.workunit.client.0.smithi114.stdout:9/637: getdents d8/d16/d21/d83 0 2024-04-25T02:27:12.072 INFO:tasks.workunit.client.0.smithi114.stdout:7/716: creat d5/d32/da6/db5/fea x:0 0 0 2024-04-25T02:27:12.074 INFO:tasks.workunit.client.0.smithi114.stdout:8/639: write da/d38/d62/d6d/f2c [3304224,130372] 0 2024-04-25T02:27:12.075 INFO:tasks.workunit.client.0.smithi114.stdout:4/528: fsync d3/d8/d23/d25/f66 0 2024-04-25T02:27:12.076 INFO:tasks.workunit.client.0.smithi114.stdout:6/743: dread de/d30/f43 [4194304,4194304] 0 2024-04-25T02:27:12.076 INFO:tasks.workunit.client.0.smithi114.stdout:0/624: dwrite d1/d30/f48 [0,4194304] 0 2024-04-25T02:27:12.077 INFO:tasks.workunit.client.0.smithi114.stdout:1/632: creat df/d13/d6e/d97/fd0 x:0 0 0 2024-04-25T02:27:12.080 INFO:tasks.workunit.client.0.smithi114.stdout:8/640: creat da/d32/fc8 x:0 0 0 2024-04-25T02:27:12.081 INFO:tasks.workunit.client.0.smithi114.stdout:1/633: dread - df/d13/d1e/f6d zero size 2024-04-25T02:27:12.081 INFO:tasks.workunit.client.0.smithi114.stdout:5/701: dwrite d1/d6/d4f/f7a [0,4194304] 0 2024-04-25T02:27:12.083 INFO:tasks.workunit.client.0.smithi114.stdout:5/702: chown d1/d53/f7c 243557074 1 2024-04-25T02:27:12.084 INFO:tasks.workunit.client.0.smithi114.stdout:3/626: dread d0/d5/f17 [0,4194304] 0 2024-04-25T02:27:12.084 INFO:tasks.workunit.client.0.smithi114.stdout:8/641: chown da/d1e/f3d 50516293 1 2024-04-25T02:27:12.085 INFO:tasks.workunit.client.0.smithi114.stdout:8/642: chown da/d32 61 1 2024-04-25T02:27:12.085 INFO:tasks.workunit.client.0.smithi114.stdout:0/625: truncate d1/d4/d24/f45 286179 0 2024-04-25T02:27:12.086 INFO:tasks.workunit.client.0.smithi114.stdout:7/717: getdents d5/d32/d4a/d91/db7 0 2024-04-25T02:27:12.086 INFO:tasks.workunit.client.0.smithi114.stdout:0/626: write d1/d4/f19 [3136676,81280] 0 2024-04-25T02:27:12.087 INFO:tasks.workunit.client.0.smithi114.stdout:6/744: chown de/d25/d39/d47/f5d 1 1 2024-04-25T02:27:12.088 INFO:tasks.workunit.client.0.smithi114.stdout:6/745: write de/d27/d34/d38/f42 [1516463,117191] 0 2024-04-25T02:27:12.088 INFO:tasks.workunit.client.0.smithi114.stdout:1/634: mkdir df/d13/d75/d8e/dd1 0 2024-04-25T02:27:12.090 INFO:tasks.workunit.client.0.smithi114.stdout:5/703: creat d1/d6/d4f/fec x:0 0 0 2024-04-25T02:27:12.091 INFO:tasks.workunit.client.0.smithi114.stdout:8/643: symlink da/d69/d87/d8d/lc9 0 2024-04-25T02:27:12.094 INFO:tasks.workunit.client.0.smithi114.stdout:2/685: dread d5/df/d3d/d44/f8f [0,4194304] 0 2024-04-25T02:27:12.095 INFO:tasks.workunit.client.0.smithi114.stdout:2/686: chown d5/df/d3d/f69 46729 1 2024-04-25T02:27:12.096 INFO:tasks.workunit.client.0.smithi114.stdout:6/746: rmdir de/d25/d39/d47 39 2024-04-25T02:27:12.098 INFO:tasks.workunit.client.0.smithi114.stdout:8/644: dwrite da/d1d/f9f [4194304,4194304] 0 2024-04-25T02:27:12.098 INFO:tasks.workunit.client.0.smithi114.stdout:5/704: creat d1/d25/da1/d8a/da8/fed x:0 0 0 2024-04-25T02:27:12.100 INFO:tasks.workunit.client.0.smithi114.stdout:6/747: chown de/d1c/c46 4939209 1 2024-04-25T02:27:12.102 INFO:tasks.workunit.client.0.smithi114.stdout:3/627: creat d0/d5/d3d/da6/fdd x:0 0 0 2024-04-25T02:27:12.105 INFO:tasks.workunit.client.0.smithi114.stdout:8/645: rename da/d1e/d58/f84 to da/d38/d62/d6d/d52/da8/db1/fca 0 2024-04-25T02:27:12.105 INFO:tasks.workunit.client.0.smithi114.stdout:1/635: link df/d2a/f70 df/d13/d6e/d97/fd2 0 2024-04-25T02:27:12.106 INFO:tasks.workunit.client.0.smithi114.stdout:8/646: write da/d38/d62/d6d/f56 [239406,122015] 0 2024-04-25T02:27:12.107 INFO:tasks.workunit.client.0.smithi114.stdout:2/687: mkdir d5/daf/dda 0 2024-04-25T02:27:12.108 INFO:tasks.workunit.client.0.smithi114.stdout:6/748: dread de/d27/d76/fd0 [0,4194304] 0 2024-04-25T02:27:12.108 INFO:tasks.workunit.client.0.smithi114.stdout:5/705: mkdir d1/d6/de/da7/ddf/dc5/dee 0 2024-04-25T02:27:12.108 INFO:tasks.workunit.client.0.smithi114.stdout:0/627: fsync d1/d4/da/f2a 0 2024-04-25T02:27:12.109 INFO:tasks.workunit.client.0.smithi114.stdout:3/628: truncate d0/d25/d2a/f4e 6267085 0 2024-04-25T02:27:12.111 INFO:tasks.workunit.client.0.smithi114.stdout:9/638: write d8/d16/d21/d24/fcb [619293,121774] 0 2024-04-25T02:27:12.111 INFO:tasks.workunit.client.0.smithi114.stdout:1/636: creat df/d13/d1e/da2/fd3 x:0 0 0 2024-04-25T02:27:12.114 INFO:tasks.workunit.client.0.smithi114.stdout:1/637: fsync df/d13/d6e/d97/fd0 0 2024-04-25T02:27:12.116 INFO:tasks.workunit.client.0.smithi114.stdout:0/628: rmdir d1/d4/d24 39 2024-04-25T02:27:12.117 INFO:tasks.workunit.client.0.smithi114.stdout:8/647: dwrite da/d69/f73 [0,4194304] 0 2024-04-25T02:27:12.119 INFO:tasks.workunit.client.0.smithi114.stdout:0/629: dread - d1/d4/da/d33/fb8 zero size 2024-04-25T02:27:12.120 INFO:tasks.workunit.client.0.smithi114.stdout:8/648: chown da/d38/d62/d6d/l4c 6 1 2024-04-25T02:27:12.120 INFO:tasks.workunit.client.0.smithi114.stdout:3/629: dwrite d0/d25/f62 [0,4194304] 0 2024-04-25T02:27:12.122 INFO:tasks.workunit.client.0.smithi114.stdout:4/529: dread d3/d8/f1c [0,4194304] 0 2024-04-25T02:27:12.123 INFO:tasks.workunit.client.0.smithi114.stdout:3/630: chown d0/d25/d29/c87 6 1 2024-04-25T02:27:12.126 INFO:tasks.workunit.client.0.smithi114.stdout:2/688: dread d5/d6/f55 [0,4194304] 0 2024-04-25T02:27:12.127 INFO:tasks.workunit.client.0.smithi114.stdout:7/718: dwrite d5/d19/f2c [0,4194304] 0 2024-04-25T02:27:12.127 INFO:tasks.workunit.client.0.smithi114.stdout:2/689: fdatasync d5/df/d63/d8d/fa2 0 2024-04-25T02:27:12.128 INFO:tasks.workunit.client.0.smithi114.stdout:7/719: readlink d5/d32/d4a/lab 0 2024-04-25T02:27:12.129 INFO:tasks.workunit.client.0.smithi114.stdout:0/630: creat d1/d7/d18/d2e/d8f/fc1 x:0 0 0 2024-04-25T02:27:12.129 INFO:tasks.workunit.client.0.smithi114.stdout:2/690: chown d5/df/d1e/l7d 13922859 1 2024-04-25T02:27:12.130 INFO:tasks.workunit.client.0.smithi114.stdout:7/720: chown d5/d32/d4a/d51/f6b 454623073 1 2024-04-25T02:27:12.131 INFO:tasks.workunit.client.0.smithi114.stdout:4/530: mknod d3/d8/d30/d4c/d7f/ca1 0 2024-04-25T02:27:12.134 INFO:tasks.workunit.client.0.smithi114.stdout:8/649: creat da/d69/d93/d6b/dbb/fcb x:0 0 0 2024-04-25T02:27:12.135 INFO:tasks.workunit.client.0.smithi114.stdout:6/749: getdents de/d25/d39/d47/d90/d93 0 2024-04-25T02:27:12.138 INFO:tasks.workunit.client.0.smithi114.stdout:7/721: dread d5/d43/d63/f84 [0,4194304] 0 2024-04-25T02:27:12.139 INFO:tasks.workunit.client.0.smithi114.stdout:3/631: dread d0/d25/f73 [0,4194304] 0 2024-04-25T02:27:12.140 INFO:tasks.workunit.client.0.smithi114.stdout:2/691: rename d5/df/f14 to d5/d1c/d29/fdb 0 2024-04-25T02:27:12.145 INFO:tasks.workunit.client.0.smithi114.stdout:8/650: creat da/d38/d62/d6d/d49/d65/fcc x:0 0 0 2024-04-25T02:27:12.146 INFO:tasks.workunit.client.0.smithi114.stdout:6/750: creat de/d27/d34/dff/f10d x:0 0 0 2024-04-25T02:27:12.147 INFO:tasks.workunit.client.0.smithi114.stdout:3/632: unlink d0/d25/c5c 0 2024-04-25T02:27:12.147 INFO:tasks.workunit.client.0.smithi114.stdout:2/692: symlink d5/df/ldc 0 2024-04-25T02:27:12.149 INFO:tasks.workunit.client.0.smithi114.stdout:7/722: getdents d5/d19/d1a/daf 0 2024-04-25T02:27:12.150 INFO:tasks.workunit.client.0.smithi114.stdout:4/531: dwrite d3/d8/d12/f1e [0,4194304] 0 2024-04-25T02:27:12.150 INFO:tasks.workunit.client.0.smithi114.stdout:5/706: dwrite d1/d6/f31 [0,4194304] 0 2024-04-25T02:27:12.151 INFO:tasks.workunit.client.0.smithi114.stdout:6/751: mknod de/d27/d34/d4b/d102/c10e 0 2024-04-25T02:27:12.151 INFO:tasks.workunit.client.0.smithi114.stdout:3/633: readlink d0/d25/d29/d85/d7e/lb0 0 2024-04-25T02:27:12.152 INFO:tasks.workunit.client.0.smithi114.stdout:9/639: dread d8/fb [0,4194304] 0 2024-04-25T02:27:12.153 INFO:tasks.workunit.client.0.smithi114.stdout:8/651: truncate da/d38/d62/d6d/d52/d6c/fba 494582 0 2024-04-25T02:27:12.153 INFO:tasks.workunit.client.0.smithi114.stdout:7/723: symlink d5/d19/d1a/da4/leb 0 2024-04-25T02:27:12.154 INFO:tasks.workunit.client.0.smithi114.stdout:6/752: fdatasync de/d27/f2d 0 2024-04-25T02:27:12.154 INFO:tasks.workunit.client.0.smithi114.stdout:4/532: truncate d3/d14/f5a 636357 0 2024-04-25T02:27:12.155 INFO:tasks.workunit.client.0.smithi114.stdout:7/724: chown d5/d60/fe2 1 1 2024-04-25T02:27:12.155 INFO:tasks.workunit.client.0.smithi114.stdout:8/652: fsync da/d38/d62/d6d/d52/f76 0 2024-04-25T02:27:12.157 INFO:tasks.workunit.client.0.smithi114.stdout:8/653: dread - da/d69/d93/fc1 zero size 2024-04-25T02:27:12.157 INFO:tasks.workunit.client.0.smithi114.stdout:5/707: creat d1/d53/d55/db1/fef x:0 0 0 2024-04-25T02:27:12.158 INFO:tasks.workunit.client.0.smithi114.stdout:1/638: write df/d13/d75/fcb [7359656,122552] 0 2024-04-25T02:27:12.159 INFO:tasks.workunit.client.0.smithi114.stdout:1/639: chown df/d13/d44/d5a/dc9/d43/f54 42 1 2024-04-25T02:27:12.161 INFO:tasks.workunit.client.0.smithi114.stdout:4/533: unlink d3/d8/l9d 0 2024-04-25T02:27:12.163 INFO:tasks.workunit.client.0.smithi114.stdout:8/654: dread da/d69/d93/d6b/f7e [0,4194304] 0 2024-04-25T02:27:12.163 INFO:tasks.workunit.client.0.smithi114.stdout:9/640: mknod d8/d16/d21/d83/d39/d38/d46/d96/cd1 0 2024-04-25T02:27:12.165 INFO:tasks.workunit.client.0.smithi114.stdout:6/753: rename de/d27/d34/d44/fb4 to de/d27/d34/d38/dfc/f10f 0 2024-04-25T02:27:12.166 INFO:tasks.workunit.client.0.smithi114.stdout:0/631: write d1/d30/f32 [4072766,32919] 0 2024-04-25T02:27:12.168 INFO:tasks.workunit.client.0.smithi114.stdout:4/534: dwrite d3/d8/d23/d25/f66 [0,4194304] 0 2024-04-25T02:27:12.168 INFO:tasks.workunit.client.0.smithi114.stdout:8/655: mkdir da/d1e/dcd 0 2024-04-25T02:27:12.171 INFO:tasks.workunit.client.0.smithi114.stdout:1/640: dread df/d13/d44/d5a/dc9/f5d [0,4194304] 0 2024-04-25T02:27:12.172 INFO:tasks.workunit.client.0.smithi114.stdout:8/656: read da/d1e/f59 [1497170,95565] 0 2024-04-25T02:27:12.173 INFO:tasks.workunit.client.0.smithi114.stdout:3/634: creat d0/d25/d29/d85/d7e/da9/fde x:0 0 0 2024-04-25T02:27:12.174 INFO:tasks.workunit.client.0.smithi114.stdout:3/635: chown d0/d25/f5f 556320 1 2024-04-25T02:27:12.176 INFO:tasks.workunit.client.0.smithi114.stdout:6/754: rmdir de/d30 39 2024-04-25T02:27:12.176 INFO:tasks.workunit.client.0.smithi114.stdout:2/693: dwrite d5/d1c/d22/f24 [0,4194304] 0 2024-04-25T02:27:12.179 INFO:tasks.workunit.client.0.smithi114.stdout:4/535: mkdir d3/d8/d30/d6e/da2 0 2024-04-25T02:27:12.185 INFO:tasks.workunit.client.0.smithi114.stdout:7/725: write d5/d8b/d99/fd6 [282915,91129] 0 2024-04-25T02:27:12.188 INFO:tasks.workunit.client.0.smithi114.stdout:9/641: rmdir d8/da8/dbc 0 2024-04-25T02:27:12.189 INFO:tasks.workunit.client.0.smithi114.stdout:9/642: chown d8/d16/d21/d83/d39/d38/d46/d53/da2 1 1 2024-04-25T02:27:12.190 INFO:tasks.workunit.client.0.smithi114.stdout:1/641: mkdir df/d11/d7d/d92/dd4 0 2024-04-25T02:27:12.190 INFO:tasks.workunit.client.0.smithi114.stdout:5/708: getdents d1/d25/da1/d8a/da8 0 2024-04-25T02:27:12.191 INFO:tasks.workunit.client.0.smithi114.stdout:3/636: mknod d0/d25/cdf 0 2024-04-25T02:27:12.191 INFO:tasks.workunit.client.0.smithi114.stdout:1/642: dread - df/d13/d75/d8e/fb5 zero size 2024-04-25T02:27:12.192 INFO:tasks.workunit.client.0.smithi114.stdout:7/726: fdatasync d5/d32/d4a/d91/fce 0 2024-04-25T02:27:12.194 INFO:tasks.workunit.client.0.smithi114.stdout:4/536: link d3/d8/d30/d4c/d7f/d8d/f9c d3/d8/d23/d35/fa3 0 2024-04-25T02:27:12.195 INFO:tasks.workunit.client.0.smithi114.stdout:3/637: dread d0/d25/d29/d85/d7e/f93 [0,4194304] 0 2024-04-25T02:27:12.197 INFO:tasks.workunit.client.0.smithi114.stdout:1/643: unlink fa 0 2024-04-25T02:27:12.198 INFO:tasks.workunit.client.0.smithi114.stdout:0/632: link d1/d4/d4f/caf d1/d7/d46/cc2 0 2024-04-25T02:27:12.198 INFO:tasks.workunit.client.0.smithi114.stdout:5/709: dwrite d1/d6/f31 [0,4194304] 0 2024-04-25T02:27:12.198 INFO:tasks.workunit.client.0.smithi114.stdout:1/644: read fc [1631897,27495] 0 2024-04-25T02:27:12.199 INFO:tasks.workunit.client.0.smithi114.stdout:9/643: creat d8/d16/d21/d37/d43/d75/da3/db0/fd2 x:0 0 0 2024-04-25T02:27:12.200 INFO:tasks.workunit.client.0.smithi114.stdout:1/645: stat df/d13/d75 0 2024-04-25T02:27:12.200 INFO:tasks.workunit.client.0.smithi114.stdout:7/727: rename d5/d32/d4a/d91/db7 to d5/d43/d4e/dec 0 2024-04-25T02:27:12.202 INFO:tasks.workunit.client.0.smithi114.stdout:7/728: dread - d5/d43/d4e/fd4 zero size 2024-04-25T02:27:12.202 INFO:tasks.workunit.client.0.smithi114.stdout:3/638: unlink d0/d25/d2a/d34/f72 0 2024-04-25T02:27:12.203 INFO:tasks.workunit.client.0.smithi114.stdout:2/694: getdents d5/d1c 0 2024-04-25T02:27:12.207 INFO:tasks.workunit.client.0.smithi114.stdout:4/537: unlink d3/d8/d30/f84 0 2024-04-25T02:27:12.208 INFO:tasks.workunit.client.0.smithi114.stdout:3/639: dwrite d0/d25/d29/f39 [4194304,4194304] 0 2024-04-25T02:27:12.209 INFO:tasks.workunit.client.0.smithi114.stdout:9/644: mkdir d8/d16/d21/d83/d39/d38/d5d/dd3 0 2024-04-25T02:27:12.210 INFO:tasks.workunit.client.0.smithi114.stdout:7/729: symlink d5/d32/led 0 2024-04-25T02:27:12.212 INFO:tasks.workunit.client.0.smithi114.stdout:2/695: read - d5/df/d2c/f70 zero size 2024-04-25T02:27:12.213 INFO:tasks.workunit.client.0.smithi114.stdout:5/710: symlink d1/d6/lf0 0 2024-04-25T02:27:12.215 INFO:tasks.workunit.client.0.smithi114.stdout:0/633: creat d1/d4/d4f/da9/dac/fc3 x:0 0 0 2024-04-25T02:27:12.218 INFO:tasks.workunit.client.0.smithi114.stdout:4/538: symlink d3/d8/d30/d6e/la4 0 2024-04-25T02:27:12.219 INFO:tasks.workunit.client.0.smithi114.stdout:9/645: unlink d8/f42 0 2024-04-25T02:27:12.221 INFO:tasks.workunit.client.0.smithi114.stdout:2/696: stat d5/d6/d58/d5a/d3e/ld3 0 2024-04-25T02:27:12.222 INFO:tasks.workunit.client.0.smithi114.stdout:2/697: write d5/df/d63/fa8 [4224331,102298] 0 2024-04-25T02:27:12.225 INFO:tasks.workunit.client.0.smithi114.stdout:4/539: unlink d3/fa 0 2024-04-25T02:27:12.227 INFO:tasks.workunit.client.0.smithi114.stdout:6/755: truncate de/d27/d76/fd9 1533194 0 2024-04-25T02:27:12.228 INFO:tasks.workunit.client.0.smithi114.stdout:5/711: mknod d1/d51/cf1 0 2024-04-25T02:27:12.230 INFO:tasks.workunit.client.0.smithi114.stdout:2/698: mkdir d5/d1c/d22/ddd 0 2024-04-25T02:27:12.231 INFO:tasks.workunit.client.0.smithi114.stdout:4/540: mknod d3/d8/d30/d4c/ca5 0 2024-04-25T02:27:12.237 INFO:tasks.workunit.client.0.smithi114.stdout:3/640: link d0/d5/l20 d0/d5/d3d/da6/dce/le0 0 2024-04-25T02:27:12.237 INFO:tasks.workunit.client.0.smithi114.stdout:6/756: mknod de/d25/dad/dde/c110 0 2024-04-25T02:27:12.238 INFO:tasks.workunit.client.0.smithi114.stdout:4/541: dwrite d3/d8/d30/d4c/f69 [0,4194304] 0 2024-04-25T02:27:12.240 INFO:tasks.workunit.client.0.smithi114.stdout:9/646: dread d8/d16/d21/d83/d39/d38/d46/d53/fa9 [0,4194304] 0 2024-04-25T02:27:12.240 INFO:tasks.workunit.client.0.smithi114.stdout:4/542: fdatasync d3/d14/d6c/f9a 0 2024-04-25T02:27:12.240 INFO:tasks.workunit.client.0.smithi114.stdout:3/641: creat d0/d25/da0/fe1 x:0 0 0 2024-04-25T02:27:12.244 INFO:tasks.workunit.client.0.smithi114.stdout:9/647: unlink d8/f59 0 2024-04-25T02:27:12.247 INFO:tasks.workunit.client.0.smithi114.stdout:6/757: dwrite de/d27/d34/d4b/f7c [0,4194304] 0 2024-04-25T02:27:12.250 INFO:tasks.workunit.client.0.smithi114.stdout:3/642: dwrite d0/d5/f43 [0,4194304] 0 2024-04-25T02:27:12.251 INFO:tasks.workunit.client.0.smithi114.stdout:4/543: dwrite d3/d14/f47 [0,4194304] 0 2024-04-25T02:27:12.252 INFO:tasks.workunit.client.0.smithi114.stdout:5/712: write d1/d6/de/f1e [921199,49131] 0 2024-04-25T02:27:12.253 INFO:tasks.workunit.client.0.smithi114.stdout:0/634: write d1/d4/d24/f45 [1191896,89749] 0 2024-04-25T02:27:12.253 INFO:tasks.workunit.client.0.smithi114.stdout:9/648: creat d8/d16/d21/dbe/fd4 x:0 0 0 2024-04-25T02:27:12.254 INFO:tasks.workunit.client.0.smithi114.stdout:5/713: fsync d1/d6/d4f/f7a 0 2024-04-25T02:27:12.255 INFO:tasks.workunit.client.0.smithi114.stdout:6/758: creat de/d2a/f111 x:0 0 0 2024-04-25T02:27:12.256 INFO:tasks.workunit.client.0.smithi114.stdout:6/759: dread - de/d27/f8f zero size 2024-04-25T02:27:12.258 INFO:tasks.workunit.client.0.smithi114.stdout:3/643: rename d0/d25/d29/f39 to d0/d25/d29/d60/da8/dc8/fe2 0 2024-04-25T02:27:12.260 INFO:tasks.workunit.client.0.smithi114.stdout:9/649: write d8/d16/d21/d83/d39/d38/f6f [4069720,57253] 0 2024-04-25T02:27:12.265 INFO:tasks.workunit.client.0.smithi114.stdout:3/644: dwrite d0/d5/f43 [0,4194304] 0 2024-04-25T02:27:12.265 INFO:tasks.workunit.client.0.smithi114.stdout:0/635: creat d1/d4/d37/d6a/db5/fc4 x:0 0 0 2024-04-25T02:27:12.268 INFO:tasks.workunit.client.0.smithi114.stdout:5/714: truncate d1/d25/d24/f3f 5198904 0 2024-04-25T02:27:12.270 INFO:tasks.workunit.client.0.smithi114.stdout:3/645: write d0/d25/f73 [4446157,86796] 0 2024-04-25T02:27:12.271 INFO:tasks.workunit.client.0.smithi114.stdout:2/699: dwrite d5/d1c/d22/f9e [0,4194304] 0 2024-04-25T02:27:12.272 INFO:tasks.workunit.client.0.smithi114.stdout:9/650: dwrite d8/d16/d21/d37/d43/fca [0,4194304] 0 2024-04-25T02:27:12.272 INFO:tasks.workunit.client.0.smithi114.stdout:2/700: readlink d5/lac 0 2024-04-25T02:27:12.273 INFO:tasks.workunit.client.0.smithi114.stdout:9/651: chown d8/d16/d21/d83/d39/d38/d5d/fb9 22006171 1 2024-04-25T02:27:12.274 INFO:tasks.workunit.client.0.smithi114.stdout:6/760: rename de/d25/d39/caf to de/c112 0 2024-04-25T02:27:12.278 INFO:tasks.workunit.client.0.smithi114.stdout:8/657: sync 2024-04-25T02:27:12.278 INFO:tasks.workunit.client.0.smithi114.stdout:5/715: rename d1/d25/l23 to d1/d25/d24/lf2 0 2024-04-25T02:27:12.278 INFO:tasks.workunit.client.0.smithi114.stdout:9/652: mknod d8/d16/d21/d83/dcf/cd5 0 2024-04-25T02:27:12.282 INFO:tasks.workunit.client.0.smithi114.stdout:3/646: rename d0/f3b to d0/d25/d29/d8c/fe3 0 2024-04-25T02:27:12.284 INFO:tasks.workunit.client.0.smithi114.stdout:6/761: creat de/d2a/db9/dc7/d100/f113 x:0 0 0 2024-04-25T02:27:12.285 INFO:tasks.workunit.client.0.smithi114.stdout:6/762: stat de/d2a/f3a 0 2024-04-25T02:27:12.286 INFO:tasks.workunit.client.0.smithi114.stdout:6/763: write de/d2a/f73 [4356045,9192] 0 2024-04-25T02:27:12.286 INFO:tasks.workunit.client.0.smithi114.stdout:8/658: creat da/d38/d62/d6d/d52/fce x:0 0 0 2024-04-25T02:27:12.289 INFO:tasks.workunit.client.0.smithi114.stdout:2/701: rename d5/df/d3d/d44/dc0/ld2 to d5/d1c/d22/lde 0 2024-04-25T02:27:12.290 INFO:tasks.workunit.client.0.smithi114.stdout:2/702: fdatasync d5/d6/d31/f60 0 2024-04-25T02:27:12.292 INFO:tasks.workunit.client.0.smithi114.stdout:4/544: readlink d3/d8/d30/d6e/la4 0 2024-04-25T02:27:12.292 INFO:tasks.workunit.client.0.smithi114.stdout:8/659: dwrite da/d38/d62/d6d/f2c [0,4194304] 0 2024-04-25T02:27:12.294 INFO:tasks.workunit.client.0.smithi114.stdout:7/730: sync 2024-04-25T02:27:12.294 INFO:tasks.workunit.client.0.smithi114.stdout:1/646: sync 2024-04-25T02:27:12.295 INFO:tasks.workunit.client.0.smithi114.stdout:3/647: rename d0/d25/d2a/d36 to d0/d25/d29/d85/d7e/da9/dad/de4 0 2024-04-25T02:27:12.296 INFO:tasks.workunit.client.0.smithi114.stdout:1/647: write df/d13/d6e/d97/fd0 [273948,10532] 0 2024-04-25T02:27:12.296 INFO:tasks.workunit.client.0.smithi114.stdout:6/764: mkdir de/d25/d39/d114 0 2024-04-25T02:27:12.299 INFO:tasks.workunit.client.0.smithi114.stdout:7/731: mknod d5/d43/d4e/dec/cee 0 2024-04-25T02:27:12.300 INFO:tasks.workunit.client.0.smithi114.stdout:3/648: write d0/d25/d29/d85/f50 [4303953,109543] 0 2024-04-25T02:27:12.303 INFO:tasks.workunit.client.0.smithi114.stdout:1/648: mknod df/d13/d1e/da2/cd5 0 2024-04-25T02:27:12.303 INFO:tasks.workunit.client.0.smithi114.stdout:3/649: chown d0/d25/d29/d78/cac 6023161 1 2024-04-25T02:27:12.304 INFO:tasks.workunit.client.0.smithi114.stdout:4/545: readlink d3/l3f 0 2024-04-25T02:27:12.304 INFO:tasks.workunit.client.0.smithi114.stdout:2/703: mknod d5/d6/d58/d5a/d59/dad/cdf 0 2024-04-25T02:27:12.307 INFO:tasks.workunit.client.0.smithi114.stdout:6/765: write de/d30/f43 [4923204,21451] 0 2024-04-25T02:27:12.307 INFO:tasks.workunit.client.0.smithi114.stdout:3/650: unlink d0/d25/c6b 0 2024-04-25T02:27:12.308 INFO:tasks.workunit.client.0.smithi114.stdout:5/716: dread d1/d6/de/f1e [0,4194304] 0 2024-04-25T02:27:12.310 INFO:tasks.workunit.client.0.smithi114.stdout:7/732: dwrite d5/d8b/d99/fd6 [0,4194304] 0 2024-04-25T02:27:12.310 INFO:tasks.workunit.client.0.smithi114.stdout:1/649: rename df/d11/d6c to df/d13/d6e/d97/dd6 0 2024-04-25T02:27:12.311 INFO:tasks.workunit.client.0.smithi114.stdout:5/717: fsync d1/d6/d1a/f57 0 2024-04-25T02:27:12.315 INFO:tasks.workunit.client.0.smithi114.stdout:6/766: symlink de/d2a/db9/dc7/l115 0 2024-04-25T02:27:12.315 INFO:tasks.workunit.client.0.smithi114.stdout:2/704: dwrite d5/df/d63/fa8 [0,4194304] 0 2024-04-25T02:27:12.318 INFO:tasks.workunit.client.0.smithi114.stdout:0/636: dread d1/d7/f56 [0,4194304] 0 2024-04-25T02:27:12.318 INFO:tasks.workunit.client.0.smithi114.stdout:4/546: rename d3/d8/d30/d6e/f97 to d3/d8/d12/d19/d42/d58/fa6 0 2024-04-25T02:27:12.319 INFO:tasks.workunit.client.0.smithi114.stdout:0/637: read - d1/d4/da/f7b zero size 2024-04-25T02:27:12.320 INFO:tasks.workunit.client.0.smithi114.stdout:5/718: symlink d1/d3e/d8e/de5/d82/lf3 0 2024-04-25T02:27:12.322 INFO:tasks.workunit.client.0.smithi114.stdout:1/650: unlink df/d13/d44/d5a/dc9/d33/d47/f6f 0 2024-04-25T02:27:12.324 INFO:tasks.workunit.client.0.smithi114.stdout:6/767: creat de/d2a/db9/dc7/d100/f116 x:0 0 0 2024-04-25T02:27:12.326 INFO:tasks.workunit.client.0.smithi114.stdout:3/651: rename d0/d25/d29/d8c/la4 to d0/d25/d29/d78/le5 0 2024-04-25T02:27:12.327 INFO:tasks.workunit.client.0.smithi114.stdout:7/733: symlink d5/d43/d63/d7a/de4/lef 0 2024-04-25T02:27:12.328 INFO:tasks.workunit.client.0.smithi114.stdout:3/652: chown d0/d25/d2a/d80/fcf 4022 1 2024-04-25T02:27:12.328 INFO:tasks.workunit.client.0.smithi114.stdout:3/653: fsync d0/d5/d3d/f66 0 2024-04-25T02:27:12.329 INFO:tasks.workunit.client.0.smithi114.stdout:4/547: creat d3/d8/d12/d19/d26/fa7 x:0 0 0 2024-04-25T02:27:12.329 INFO:tasks.workunit.client.0.smithi114.stdout:5/719: symlink d1/d25/lf4 0 2024-04-25T02:27:12.330 INFO:tasks.workunit.client.0.smithi114.stdout:3/654: write d0/d25/d2a/d34/db6/fd2 [2797761,79163] 0 2024-04-25T02:27:12.330 INFO:tasks.workunit.client.0.smithi114.stdout:4/548: write d3/d8/d23/d25/f87 [1284323,78420] 0 2024-04-25T02:27:12.331 INFO:tasks.workunit.client.0.smithi114.stdout:1/651: creat df/d13/d44/d5a/fd7 x:0 0 0 2024-04-25T02:27:12.332 INFO:tasks.workunit.client.0.smithi114.stdout:6/768: creat de/d27/d34/d44/d91/f117 x:0 0 0 2024-04-25T02:27:12.332 INFO:tasks.workunit.client.0.smithi114.stdout:3/655: chown d0/d5/d3d/da6/laa 629 1 2024-04-25T02:27:12.332 INFO:tasks.workunit.client.0.smithi114.stdout:5/720: read d1/d6/de/f1d [1368733,120643] 0 2024-04-25T02:27:12.333 INFO:tasks.workunit.client.0.smithi114.stdout:5/721: chown d1/d6 399 1 2024-04-25T02:27:12.334 INFO:tasks.workunit.client.0.smithi114.stdout:2/705: rename d5/df/d2c/d66/dc2 to d5/d1c/d29/de0 0 2024-04-25T02:27:12.335 INFO:tasks.workunit.client.0.smithi114.stdout:7/734: mknod d5/d60/cf0 0 2024-04-25T02:27:12.336 INFO:tasks.workunit.client.0.smithi114.stdout:2/706: fdatasync d5/df/d2c/fbd 0 2024-04-25T02:27:12.340 INFO:tasks.workunit.client.0.smithi114.stdout:4/549: chown d3/c43 69157 1 2024-04-25T02:27:12.340 INFO:tasks.workunit.client.0.smithi114.stdout:9/653: dwrite d8/fe [0,4194304] 0 2024-04-25T02:27:12.342 INFO:tasks.workunit.client.0.smithi114.stdout:5/722: symlink d1/d53/d55/dae/lf5 0 2024-04-25T02:27:12.343 INFO:tasks.workunit.client.0.smithi114.stdout:3/656: rename d0/f1d to d0/d25/d29/d85/d7e/fe6 0 2024-04-25T02:27:12.343 INFO:tasks.workunit.client.0.smithi114.stdout:9/654: chown d8/d16/d21/d83/d39/d38/d46/d96 547 1 2024-04-25T02:27:12.344 INFO:tasks.workunit.client.0.smithi114.stdout:5/723: chown d1/f36 240347291 1 2024-04-25T02:27:12.344 INFO:tasks.workunit.client.0.smithi114.stdout:8/660: sync 2024-04-25T02:27:12.345 INFO:tasks.workunit.client.0.smithi114.stdout:7/735: dwrite d5/d32/d4a/d87/fb6 [0,4194304] 0 2024-04-25T02:27:12.346 INFO:tasks.workunit.client.0.smithi114.stdout:1/652: creat df/d13/d75/d8e/dd1/fd8 x:0 0 0 2024-04-25T02:27:12.351 INFO:tasks.workunit.client.0.smithi114.stdout:4/550: creat d3/d8/d12/d19/d26/d3e/fa8 x:0 0 0 2024-04-25T02:27:12.353 INFO:tasks.workunit.client.0.smithi114.stdout:7/736: dwrite d5/d43/d63/d7a/f9d [0,4194304] 0 2024-04-25T02:27:12.354 INFO:tasks.workunit.client.0.smithi114.stdout:4/551: write d3/d8/d30/d4c/f69 [50015,106256] 0 2024-04-25T02:27:12.354 INFO:tasks.workunit.client.0.smithi114.stdout:5/724: creat d1/d6/d4f/d6c/d88/ff6 x:0 0 0 2024-04-25T02:27:12.355 INFO:tasks.workunit.client.0.smithi114.stdout:5/725: readlink d1/d6/d4f/lad 0 2024-04-25T02:27:12.356 INFO:tasks.workunit.client.0.smithi114.stdout:0/638: dread d1/d4/da/f2a [0,4194304] 0 2024-04-25T02:27:12.361 INFO:tasks.workunit.client.0.smithi114.stdout:2/707: dread d5/fd [0,4194304] 0 2024-04-25T02:27:12.361 INFO:tasks.workunit.client.0.smithi114.stdout:5/726: dwrite d1/d6/de/d75/fb9 [0,4194304] 0 2024-04-25T02:27:12.364 INFO:tasks.workunit.client.0.smithi114.stdout:7/737: symlink d5/d32/da6/db5/lf1 0 2024-04-25T02:27:12.368 INFO:tasks.workunit.client.0.smithi114.stdout:4/552: dwrite d3/f28 [0,4194304] 0 2024-04-25T02:27:12.369 INFO:tasks.workunit.client.0.smithi114.stdout:4/553: write d3/d8/d12/d19/f85 [20107,52719] 0 2024-04-25T02:27:12.369 INFO:tasks.workunit.client.0.smithi114.stdout:0/639: mknod d1/cc5 0 2024-04-25T02:27:12.372 INFO:tasks.workunit.client.0.smithi114.stdout:6/769: getdents de/d25/d39 0 2024-04-25T02:27:12.377 INFO:tasks.workunit.client.0.smithi114.stdout:6/770: dwrite de/d2a/f111 [0,4194304] 0 2024-04-25T02:27:12.380 INFO:tasks.workunit.client.0.smithi114.stdout:7/738: mkdir d5/d43/d4e/df2 0 2024-04-25T02:27:12.381 INFO:tasks.workunit.client.0.smithi114.stdout:8/661: link da/d1d/f1f da/d69/d93/d6b/db3/fcf 0 2024-04-25T02:27:12.381 INFO:tasks.workunit.client.0.smithi114.stdout:4/554: rmdir d3 39 2024-04-25T02:27:12.383 INFO:tasks.workunit.client.0.smithi114.stdout:2/708: mkdir d5/daf/dda/de1 0 2024-04-25T02:27:12.384 INFO:tasks.workunit.client.0.smithi114.stdout:6/771: readlink de/l26 0 2024-04-25T02:27:12.384 INFO:tasks.workunit.client.0.smithi114.stdout:2/709: read d5/d1c/d22/d67/f6c [566956,24571] 0 2024-04-25T02:27:12.385 INFO:tasks.workunit.client.0.smithi114.stdout:2/710: dread - d5/df/d2c/fbd zero size 2024-04-25T02:27:12.387 INFO:tasks.workunit.client.0.smithi114.stdout:4/555: read d3/d8/f2c [6105240,63070] 0 2024-04-25T02:27:12.387 INFO:tasks.workunit.client.0.smithi114.stdout:2/711: mkdir d5/df/d3d/d44/de2 0 2024-04-25T02:27:12.393 INFO:tasks.workunit.client.0.smithi114.stdout:2/712: dwrite d5/df/d2c/fbd [0,4194304] 0 2024-04-25T02:27:12.398 INFO:tasks.workunit.client.0.smithi114.stdout:2/713: link d5/df/d3d/d44/fc7 d5/df/d2c/d66/db3/fe3 0 2024-04-25T02:27:12.399 INFO:tasks.workunit.client.0.smithi114.stdout:2/714: creat d5/df/d3d/d44/fe4 x:0 0 0 2024-04-25T02:27:12.400 INFO:tasks.workunit.client.0.smithi114.stdout:9/655: dread d8/d16/d21/d24/f47 [0,4194304] 0 2024-04-25T02:27:12.402 INFO:tasks.workunit.client.0.smithi114.stdout:2/715: creat d5/df/d2c/d66/fe5 x:0 0 0 2024-04-25T02:27:12.403 INFO:tasks.workunit.client.0.smithi114.stdout:9/656: chown d8/d16/d21/d83/d39/d38/c51 3 1 2024-04-25T02:27:12.404 INFO:tasks.workunit.client.0.smithi114.stdout:2/716: creat d5/df/d63/d8d/fe6 x:0 0 0 2024-04-25T02:27:12.404 INFO:tasks.workunit.client.0.smithi114.stdout:2/717: stat d5/df/d1e/l7d 0 2024-04-25T02:27:12.406 INFO:tasks.workunit.client.0.smithi114.stdout:9/657: rmdir d8/d16/d21/d83/d39/dab/dc7 0 2024-04-25T02:27:12.407 INFO:tasks.workunit.client.0.smithi114.stdout:2/718: read d5/df/d3d/d44/f56 [6574939,2992] 0 2024-04-25T02:27:12.408 INFO:tasks.workunit.client.0.smithi114.stdout:2/719: write d5/df/d63/f75 [523684,58346] 0 2024-04-25T02:27:12.408 INFO:tasks.workunit.client.0.smithi114.stdout:9/658: rmdir d8/d16/d21/d83/d39/d38/d46/d53/da2 39 2024-04-25T02:27:12.408 INFO:tasks.workunit.client.0.smithi114.stdout:2/720: chown d5/l10 7 1 2024-04-25T02:27:12.409 INFO:tasks.workunit.client.0.smithi114.stdout:2/721: dread - d5/d79/f9f zero size 2024-04-25T02:27:12.411 INFO:tasks.workunit.client.0.smithi114.stdout:2/722: creat d5/df/d63/fe7 x:0 0 0 2024-04-25T02:27:12.411 INFO:tasks.workunit.client.0.smithi114.stdout:3/657: sync 2024-04-25T02:27:12.411 INFO:tasks.workunit.client.0.smithi114.stdout:9/659: creat d8/d16/d21/d83/d39/d38/d46/d53/fd6 x:0 0 0 2024-04-25T02:27:12.413 INFO:tasks.workunit.client.0.smithi114.stdout:2/723: symlink d5/d1c/d21/dc3/le8 0 2024-04-25T02:27:12.413 INFO:tasks.workunit.client.0.smithi114.stdout:9/660: creat d8/d16/d21/d37/d43/d75/fd7 x:0 0 0 2024-04-25T02:27:12.414 INFO:tasks.workunit.client.0.smithi114.stdout:2/724: symlink d5/df/d63/d8d/le9 0 2024-04-25T02:27:12.427 INFO:tasks.workunit.client.0.smithi114.stdout:5/727: write d1/d6/d1a/d7f/fe9 [1467522,103414] 0 2024-04-25T02:27:12.427 INFO:tasks.workunit.client.0.smithi114.stdout:7/739: dread d5/d32/d4a/d91/f73 [0,4194304] 0 2024-04-25T02:27:12.428 INFO:tasks.workunit.client.0.smithi114.stdout:6/772: write de/d25/d39/f5f [5961084,97486] 0 2024-04-25T02:27:12.428 INFO:tasks.workunit.client.0.smithi114.stdout:4/556: truncate d3/d8/d12/d19/f85 473392 0 2024-04-25T02:27:12.428 INFO:tasks.workunit.client.0.smithi114.stdout:2/725: mknod d5/df/d2c/cea 0 2024-04-25T02:27:12.431 INFO:tasks.workunit.client.0.smithi114.stdout:5/728: truncate d1/d3e/feb 99325 0 2024-04-25T02:27:12.431 INFO:tasks.workunit.client.0.smithi114.stdout:9/661: dwrite d8/d16/d21/d37/d43/f7b [0,4194304] 0 2024-04-25T02:27:12.432 INFO:tasks.workunit.client.0.smithi114.stdout:0/640: truncate d1/d4/f8a 580136 0 2024-04-25T02:27:12.433 INFO:tasks.workunit.client.0.smithi114.stdout:2/726: fsync d5/df/d3d/d44/fc7 0 2024-04-25T02:27:12.435 INFO:tasks.workunit.client.0.smithi114.stdout:4/557: symlink d3/d8/d23/d25/d31/la9 0 2024-04-25T02:27:12.435 INFO:tasks.workunit.client.0.smithi114.stdout:6/773: mknod de/d25/d39/d47/d90/c118 0 2024-04-25T02:27:12.437 INFO:tasks.workunit.client.0.smithi114.stdout:6/774: readlink de/d27/l94 0 2024-04-25T02:27:12.438 INFO:tasks.workunit.client.0.smithi114.stdout:7/740: rename d5/d43/d4e/fd4 to d5/d32/d4a/d51/ff3 0 2024-04-25T02:27:12.439 INFO:tasks.workunit.client.0.smithi114.stdout:6/775: read - de/d27/d34/d44/fcc zero size 2024-04-25T02:27:12.439 INFO:tasks.workunit.client.0.smithi114.stdout:5/729: mkdir d1/d25/da1/df7 0 2024-04-25T02:27:12.440 INFO:tasks.workunit.client.0.smithi114.stdout:0/641: dwrite d1/d4/d4f/d77/fbc [0,4194304] 0 2024-04-25T02:27:12.442 INFO:tasks.workunit.client.0.smithi114.stdout:2/727: creat d5/d1c/d21/feb x:0 0 0 2024-04-25T02:27:12.443 INFO:tasks.workunit.client.0.smithi114.stdout:2/728: fsync d5/df/f45 0 2024-04-25T02:27:12.445 INFO:tasks.workunit.client.0.smithi114.stdout:1/653: sync 2024-04-25T02:27:12.445 INFO:tasks.workunit.client.0.smithi114.stdout:8/662: sync 2024-04-25T02:27:12.445 INFO:tasks.workunit.client.0.smithi114.stdout:4/558: write d3/d8/d23/d25/d31/d33/f29 [190787,39630] 0 2024-04-25T02:27:12.447 INFO:tasks.workunit.client.0.smithi114.stdout:9/662: dread d8/d16/d21/d83/d39/d38/f6f [0,4194304] 0 2024-04-25T02:27:12.447 INFO:tasks.workunit.client.0.smithi114.stdout:6/776: creat de/d25/dad/f119 x:0 0 0 2024-04-25T02:27:12.448 INFO:tasks.workunit.client.0.smithi114.stdout:6/777: write de/d2a/f9d [4828107,80845] 0 2024-04-25T02:27:12.448 INFO:tasks.workunit.client.0.smithi114.stdout:6/778: chown de/d27 579552503 1 2024-04-25T02:27:12.449 INFO:tasks.workunit.client.0.smithi114.stdout:2/729: read d5/df/d3d/f69 [3005620,109973] 0 2024-04-25T02:27:12.453 INFO:tasks.workunit.client.0.smithi114.stdout:0/642: symlink d1/d4/da/d39/da7/lc6 0 2024-04-25T02:27:12.455 INFO:tasks.workunit.client.0.smithi114.stdout:1/654: symlink df/d13/d93/ld9 0 2024-04-25T02:27:12.457 INFO:tasks.workunit.client.0.smithi114.stdout:8/663: rename da/d1e/d58 to da/d38/d62/d6d/d49/d65/dd0 0 2024-04-25T02:27:12.459 INFO:tasks.workunit.client.0.smithi114.stdout:5/730: symlink d1/d6/de/da7/dce/dea/lf8 0 2024-04-25T02:27:12.460 INFO:tasks.workunit.client.0.smithi114.stdout:6/779: symlink de/d25/d39/l11a 0 2024-04-25T02:27:12.460 INFO:tasks.workunit.client.0.smithi114.stdout:5/731: read d1/d25/f63 [3630089,26751] 0 2024-04-25T02:27:12.461 INFO:tasks.workunit.client.0.smithi114.stdout:2/730: symlink d5/d6/d31/lec 0 2024-04-25T02:27:12.462 INFO:tasks.workunit.client.0.smithi114.stdout:0/643: rmdir d1/d4/da/d3e 39 2024-04-25T02:27:12.462 INFO:tasks.workunit.client.0.smithi114.stdout:3/658: sync 2024-04-25T02:27:12.463 INFO:tasks.workunit.client.0.smithi114.stdout:1/655: mknod df/d13/d75/d8e/d98/cda 0 2024-04-25T02:27:12.463 INFO:tasks.workunit.client.0.smithi114.stdout:7/741: write d5/d19/d23/f4d [1588330,55139] 0 2024-04-25T02:27:12.464 INFO:tasks.workunit.client.0.smithi114.stdout:4/559: getdents d3/d8/d23/d35/d89/da0 0 2024-04-25T02:27:12.464 INFO:tasks.workunit.client.0.smithi114.stdout:9/663: mknod d8/d16/cd8 0 2024-04-25T02:27:12.465 INFO:tasks.workunit.client.0.smithi114.stdout:8/664: mknod da/d69/d87/db4/cd1 0 2024-04-25T02:27:12.467 INFO:tasks.workunit.client.0.smithi114.stdout:7/742: truncate d5/d32/d4a/dbc/fd3 198722 0 2024-04-25T02:27:12.468 INFO:tasks.workunit.client.0.smithi114.stdout:2/731: mknod d5/daf/ced 0 2024-04-25T02:27:12.469 INFO:tasks.workunit.client.0.smithi114.stdout:3/659: chown d0/d25/d29/d85/d7e/da9/dad/de4/c84 25943158 1 2024-04-25T02:27:12.471 INFO:tasks.workunit.client.0.smithi114.stdout:3/660: stat d0/d25/d29/d60/da8/dc8/fe2 0 2024-04-25T02:27:12.471 INFO:tasks.workunit.client.0.smithi114.stdout:1/656: dwrite df/d13/d75/db8/f69 [0,4194304] 0 2024-04-25T02:27:12.473 INFO:tasks.workunit.client.0.smithi114.stdout:5/732: creat d1/d6/d1a/d7f/dd9/ff9 x:0 0 0 2024-04-25T02:27:12.473 INFO:tasks.workunit.client.0.smithi114.stdout:3/661: dread - d0/d5/d3d/da6/fdd zero size 2024-04-25T02:27:12.475 INFO:tasks.workunit.client.0.smithi114.stdout:0/644: dread d1/d4/f1b [0,4194304] 0 2024-04-25T02:27:12.476 INFO:tasks.workunit.client.0.smithi114.stdout:7/743: chown d5/d19/d23/f28 69073952 1 2024-04-25T02:27:12.476 INFO:tasks.workunit.client.0.smithi114.stdout:2/732: mkdir d5/d1c/dee 0 2024-04-25T02:27:12.478 INFO:tasks.workunit.client.0.smithi114.stdout:8/665: mkdir da/d38/d62/d6d/d52/da8/da9/dd2 0 2024-04-25T02:27:12.478 INFO:tasks.workunit.client.0.smithi114.stdout:9/664: dwrite d8/d16/d21/d24/f47 [0,4194304] 0 2024-04-25T02:27:12.479 INFO:tasks.workunit.client.0.smithi114.stdout:8/666: stat da/d69/d93/d6b 0 2024-04-25T02:27:12.480 INFO:tasks.workunit.client.0.smithi114.stdout:9/665: chown d8/d16/d21/dbe 269 1 2024-04-25T02:27:12.481 INFO:tasks.workunit.client.0.smithi114.stdout:8/667: write da/d38/d62/d6d/d49/d65/fcc [7269,18393] 0 2024-04-25T02:27:12.481 INFO:tasks.workunit.client.0.smithi114.stdout:9/666: chown d8/d16/d21/d83/f5f 1666 1 2024-04-25T02:27:12.482 INFO:tasks.workunit.client.0.smithi114.stdout:0/645: rmdir d1/d4/d24 39 2024-04-25T02:27:12.482 INFO:tasks.workunit.client.0.smithi114.stdout:8/668: stat da/d69/d93/d40 0 2024-04-25T02:27:12.483 INFO:tasks.workunit.client.0.smithi114.stdout:4/560: write d3/d8/d30/d4c/d7f/d8d/f9c [119363,83442] 0 2024-04-25T02:27:12.483 INFO:tasks.workunit.client.0.smithi114.stdout:2/733: write d5/fd [7324498,73749] 0 2024-04-25T02:27:12.483 INFO:tasks.workunit.client.0.smithi114.stdout:7/744: mkdir d5/d19/d1a/da4/db3/df4 0 2024-04-25T02:27:12.484 INFO:tasks.workunit.client.0.smithi114.stdout:4/561: write d3/f28 [3218488,97561] 0 2024-04-25T02:27:12.485 INFO:tasks.workunit.client.0.smithi114.stdout:7/745: fdatasync d5/d19/d23/f58 0 2024-04-25T02:27:12.485 INFO:tasks.workunit.client.0.smithi114.stdout:6/780: creat de/d25/d39/d47/d90/f11b x:0 0 0 2024-04-25T02:27:12.486 INFO:tasks.workunit.client.0.smithi114.stdout:5/733: symlink d1/d3e/lfa 0 2024-04-25T02:27:12.489 INFO:tasks.workunit.client.0.smithi114.stdout:1/657: truncate df/d13/d44/d5a/dc9/d33/fce 645464 0 2024-04-25T02:27:12.491 INFO:tasks.workunit.client.0.smithi114.stdout:2/734: fsync d5/df/d2c/d66/db3/fe3 0 2024-04-25T02:27:12.500 INFO:tasks.workunit.client.0.smithi114.stdout:6/781: mkdir de/d27/d76/d11c 0 2024-04-25T02:27:12.500 INFO:tasks.workunit.client.0.smithi114.stdout:5/734: creat d1/d25/da1/d8a/ffb x:0 0 0 2024-04-25T02:27:12.500 INFO:tasks.workunit.client.0.smithi114.stdout:0/646: fdatasync d1/d7/fd 0 2024-04-25T02:27:12.501 INFO:tasks.workunit.client.0.smithi114.stdout:1/658: mknod df/d13/d44/d5a/dc9/d33/d47/cdb 0 2024-04-25T02:27:12.504 INFO:tasks.workunit.client.0.smithi114.stdout:2/735: dread d5/df/d3d/d44/f8f [0,4194304] 0 2024-04-25T02:27:12.504 INFO:tasks.workunit.client.0.smithi114.stdout:8/669: dwrite da/d38/d62/d6d/d52/da8/db1/fca [0,4194304] 0 2024-04-25T02:27:12.507 INFO:tasks.workunit.client.0.smithi114.stdout:1/659: creat df/d13/d93/dca/fdc x:0 0 0 2024-04-25T02:27:12.507 INFO:tasks.workunit.client.0.smithi114.stdout:8/670: dread - da/d32/fc8 zero size 2024-04-25T02:27:12.508 INFO:tasks.workunit.client.0.smithi114.stdout:4/562: getdents d3/d8/d30/d4c/d7f 0 2024-04-25T02:27:12.509 INFO:tasks.workunit.client.0.smithi114.stdout:0/647: symlink d1/d4/da/d39/lc7 0 2024-04-25T02:27:12.513 INFO:tasks.workunit.client.0.smithi114.stdout:9/667: dwrite d8/d16/d21/d83/d39/d38/d46/d53/da2/fc3 [0,4194304] 0 2024-04-25T02:27:12.513 INFO:tasks.workunit.client.0.smithi114.stdout:2/736: getdents d5/d79/dd1 0 2024-04-25T02:27:12.514 INFO:tasks.workunit.client.0.smithi114.stdout:3/662: dwrite d0/d25/d2a/d34/f55 [0,4194304] 0 2024-04-25T02:27:12.518 INFO:tasks.workunit.client.0.smithi114.stdout:4/563: rename d3/d8/d23/d35 to d3/d8/d12/d19/d26/d3e/daa 0 2024-04-25T02:27:12.519 INFO:tasks.workunit.client.0.smithi114.stdout:0/648: dread d1/d4/f1b [0,4194304] 0 2024-04-25T02:27:12.520 INFO:tasks.workunit.client.0.smithi114.stdout:9/668: unlink d8/f1f 0 2024-04-25T02:27:12.521 INFO:tasks.workunit.client.0.smithi114.stdout:3/663: rmdir d0/d25/d29/d60/da8 39 2024-04-25T02:27:12.521 INFO:tasks.workunit.client.0.smithi114.stdout:1/660: dwrite df/d13/d44/d5a/dc9/d33/d47/fb7 [4194304,4194304] 0 2024-04-25T02:27:12.523 INFO:tasks.workunit.client.0.smithi114.stdout:3/664: write d0/d25/d29/d8c/fd4 [225300,27380] 0 2024-04-25T02:27:12.524 INFO:tasks.workunit.client.0.smithi114.stdout:2/737: mkdir d5/df/dc9/def 0 2024-04-25T02:27:12.524 INFO:tasks.workunit.client.0.smithi114.stdout:4/564: write d3/d14/f37 [2773355,47921] 0 2024-04-25T02:27:12.526 INFO:tasks.workunit.client.0.smithi114.stdout:9/669: mkdir d8/d16/d21/d83/d39/d38/d46/d53/da2/dd9 0 2024-04-25T02:27:12.527 INFO:tasks.workunit.client.0.smithi114.stdout:1/661: creat df/d13/d6e/d97/dd6/fdd x:0 0 0 2024-04-25T02:27:12.528 INFO:tasks.workunit.client.0.smithi114.stdout:6/782: dread de/d25/fbc [0,4194304] 0 2024-04-25T02:27:12.528 INFO:tasks.workunit.client.0.smithi114.stdout:6/783: stat de/d2a/l6a 0 2024-04-25T02:27:12.529 INFO:tasks.workunit.client.0.smithi114.stdout:9/670: chown d8/d16/d21/d83/d39/d38/ca1 3883 1 2024-04-25T02:27:12.529 INFO:tasks.workunit.client.0.smithi114.stdout:6/784: readlink de/d2a/db9/dc7/l115 0 2024-04-25T02:27:12.530 INFO:tasks.workunit.client.0.smithi114.stdout:5/735: truncate d1/d6/d1a/f7e 1734049 0 2024-04-25T02:27:12.530 INFO:tasks.workunit.client.0.smithi114.stdout:6/785: dread - de/d25/fef zero size 2024-04-25T02:27:12.531 INFO:tasks.workunit.client.0.smithi114.stdout:5/736: chown d1/c73 8089853 1 2024-04-25T02:27:12.532 INFO:tasks.workunit.client.0.smithi114.stdout:2/738: read d5/df/d3d/d81/fd8 [982755,40205] 0 2024-04-25T02:27:12.532 INFO:tasks.workunit.client.0.smithi114.stdout:6/786: chown de/c11 641019 1 2024-04-25T02:27:12.534 INFO:tasks.workunit.client.0.smithi114.stdout:1/662: dwrite df/d13/d44/d5a/dc9/d43/f7a [4194304,4194304] 0 2024-04-25T02:27:12.538 INFO:tasks.workunit.client.0.smithi114.stdout:1/663: rename df/d13/d93/ld9 to df/d2a/d34/lde 0 2024-04-25T02:27:12.540 INFO:tasks.workunit.client.0.smithi114.stdout:2/739: dwrite d5/d6/d31/f60 [0,4194304] 0 2024-04-25T02:27:12.542 INFO:tasks.workunit.client.0.smithi114.stdout:1/664: creat df/d13/fdf x:0 0 0 2024-04-25T02:27:12.548 INFO:tasks.workunit.client.0.smithi114.stdout:2/740: rename d5/d1c/d22/cb1 to d5/d6/d31/d6a/cf0 0 2024-04-25T02:27:12.550 INFO:tasks.workunit.client.0.smithi114.stdout:1/665: mkdir df/d11/d7d/d92/da9/de0 0 2024-04-25T02:27:12.553 INFO:tasks.workunit.client.0.smithi114.stdout:1/666: symlink df/d13/le1 0 2024-04-25T02:27:12.554 INFO:tasks.workunit.client.0.smithi114.stdout:1/667: creat df/d13/d75/d8e/dd1/fe2 x:0 0 0 2024-04-25T02:27:12.555 INFO:tasks.workunit.client.0.smithi114.stdout:1/668: write df/d13/d75/d8e/d98/fcc [357946,39267] 0 2024-04-25T02:27:12.556 INFO:tasks.workunit.client.0.smithi114.stdout:1/669: write df/d13/d75/db8/fa7 [194292,103961] 0 2024-04-25T02:27:12.560 INFO:tasks.workunit.client.0.smithi114.stdout:1/670: getdents df/d13/d1e 0 2024-04-25T02:27:12.565 INFO:tasks.workunit.client.0.smithi114.stdout:3/665: dread d0/d25/da0/fb4 [0,4194304] 0 2024-04-25T02:27:12.565 INFO:tasks.workunit.client.0.smithi114.stdout:1/671: link df/d13/d44/d5a/dc9/f4c df/d13/d75/fe3 0 2024-04-25T02:27:12.566 INFO:tasks.workunit.client.0.smithi114.stdout:1/672: read df/d13/d44/d5a/dc9/d43/f7a [7992295,82580] 0 2024-04-25T02:27:12.568 INFO:tasks.workunit.client.0.smithi114.stdout:4/565: dread d3/d8/d12/d19/d42/d58/f9b [0,4194304] 0 2024-04-25T02:27:12.569 INFO:tasks.workunit.client.0.smithi114.stdout:4/566: write d3/d14/f47 [320991,100508] 0 2024-04-25T02:27:12.570 INFO:tasks.workunit.client.0.smithi114.stdout:3/666: rename d0/d25/d2a/d34/ccd to d0/d25/d2a/d34/ce7 0 2024-04-25T02:27:12.570 INFO:tasks.workunit.client.0.smithi114.stdout:4/567: write d3/d8/f1b [1644191,125292] 0 2024-04-25T02:27:12.572 INFO:tasks.workunit.client.0.smithi114.stdout:4/568: write d3/d14/f5a [974486,112236] 0 2024-04-25T02:27:12.573 INFO:tasks.workunit.client.0.smithi114.stdout:5/737: dread d1/d6/de/dbc/fc3 [0,4194304] 0 2024-04-25T02:27:12.577 INFO:tasks.workunit.client.0.smithi114.stdout:3/667: rmdir d0/d25/d29 39 2024-04-25T02:27:12.580 INFO:tasks.workunit.client.0.smithi114.stdout:4/569: write d3/d8/d23/d25/d31/f9e [988829,76151] 0 2024-04-25T02:27:12.581 INFO:tasks.workunit.client.0.smithi114.stdout:6/787: dread de/d25/d39/d47/d90/d93/d99/faa [0,4194304] 0 2024-04-25T02:27:12.582 INFO:tasks.workunit.client.0.smithi114.stdout:1/673: link df/d13/d44/l8a df/d13/d75/le4 0 2024-04-25T02:27:12.583 INFO:tasks.workunit.client.0.smithi114.stdout:4/570: write d3/d8/d30/d4c/d7f/d8d/f9c [317876,121145] 0 2024-04-25T02:27:12.585 INFO:tasks.workunit.client.0.smithi114.stdout:6/788: mkdir de/d25/dad/d11d 0 2024-04-25T02:27:12.586 INFO:tasks.workunit.client.0.smithi114.stdout:5/738: dread d1/d6/f7b [0,4194304] 0 2024-04-25T02:27:12.586 INFO:tasks.workunit.client.0.smithi114.stdout:2/741: dread d5/df/d3d/f69 [0,4194304] 0 2024-04-25T02:27:12.587 INFO:tasks.workunit.client.0.smithi114.stdout:5/739: stat d1/d6/de/da7/dce 0 2024-04-25T02:27:12.587 INFO:tasks.workunit.client.0.smithi114.stdout:5/740: readlink d1/d6/d1a/l40 0 2024-04-25T02:27:12.590 INFO:tasks.workunit.client.0.smithi114.stdout:4/571: creat d3/d8/d30/d4c/fab x:0 0 0 2024-04-25T02:27:12.593 INFO:tasks.workunit.client.0.smithi114.stdout:6/789: dwrite de/d2a/db9/fd6 [0,4194304] 0 2024-04-25T02:27:12.595 INFO:tasks.workunit.client.0.smithi114.stdout:7/746: sync 2024-04-25T02:27:12.596 INFO:tasks.workunit.client.0.smithi114.stdout:2/742: rmdir d5/d1c/d29 39 2024-04-25T02:27:12.596 INFO:tasks.workunit.client.0.smithi114.stdout:2/743: read d5/d6/fab [1978345,10066] 0 2024-04-25T02:27:12.598 INFO:tasks.workunit.client.0.smithi114.stdout:2/744: truncate d5/d1c/d22/f24 4395295 0 2024-04-25T02:27:12.598 INFO:tasks.workunit.client.0.smithi114.stdout:3/668: link d0/d25/d29/d78/le5 d0/d25/d29/d85/d7e/da9/dad/le8 0 2024-04-25T02:27:12.601 INFO:tasks.workunit.client.0.smithi114.stdout:7/747: fsync d5/d19/d23/f28 0 2024-04-25T02:27:12.604 INFO:tasks.workunit.client.0.smithi114.stdout:6/790: dwrite de/d25/d39/d47/d90/d93/d99/faa [0,4194304] 0 2024-04-25T02:27:12.609 INFO:tasks.workunit.client.0.smithi114.stdout:7/748: fdatasync d5/d32/d4a/d91/f57 0 2024-04-25T02:27:12.613 INFO:tasks.workunit.client.0.smithi114.stdout:5/741: dread d1/d25/d24/f3f [0,4194304] 0 2024-04-25T02:27:12.613 INFO:tasks.workunit.client.0.smithi114.stdout:3/669: creat d0/d5/d3d/da6/dce/dd6/fe9 x:0 0 0 2024-04-25T02:27:12.614 INFO:tasks.workunit.client.0.smithi114.stdout:2/745: mkdir d5/d1c/d29/de0/df1 0 2024-04-25T02:27:12.616 INFO:tasks.workunit.client.0.smithi114.stdout:6/791: link de/d30/f43 de/d27/d34/d4b/d102/f11e 0 2024-04-25T02:27:12.618 INFO:tasks.workunit.client.0.smithi114.stdout:7/749: creat d5/d43/d4e/df2/ff5 x:0 0 0 2024-04-25T02:27:12.619 INFO:tasks.workunit.client.0.smithi114.stdout:2/746: unlink d5/d6/d58/d5a/d3e/caa 0 2024-04-25T02:27:12.620 INFO:tasks.workunit.client.0.smithi114.stdout:4/572: truncate d3/d8/d30/d4c/f69 3757096 0 2024-04-25T02:27:12.621 INFO:tasks.workunit.client.0.smithi114.stdout:1/674: dwrite df/d13/d6e/d97/dd6/f95 [0,4194304] 0 2024-04-25T02:27:12.622 INFO:tasks.workunit.client.0.smithi114.stdout:6/792: truncate de/d27/d34/d44/fcc 941857 0 2024-04-25T02:27:12.626 INFO:tasks.workunit.client.0.smithi114.stdout:5/742: dwrite d1/d6/de/f8d [0,4194304] 0 2024-04-25T02:27:12.627 INFO:tasks.workunit.client.0.smithi114.stdout:4/573: mknod d3/d8/d30/d4c/cac 0 2024-04-25T02:27:12.628 INFO:tasks.workunit.client.0.smithi114.stdout:2/747: getdents d5/df/d3d/d81 0 2024-04-25T02:27:12.629 INFO:tasks.workunit.client.0.smithi114.stdout:3/670: dwrite d0/d25/d29/d85/d7e/da9/dad/de4/fda [0,4194304] 0 2024-04-25T02:27:12.629 INFO:tasks.workunit.client.0.smithi114.stdout:7/750: rename d5/d32/d64/f89 to d5/d32/d4a/ff6 0 2024-04-25T02:27:12.629 INFO:tasks.workunit.client.0.smithi114.stdout:4/574: truncate d3/d8/d12/d19/f85 1200061 0 2024-04-25T02:27:12.632 INFO:tasks.workunit.client.0.smithi114.stdout:1/675: unlink df/d13/d6e/d97/dd6/d82/fa3 0 2024-04-25T02:27:12.648 INFO:tasks.workunit.client.0.smithi114.stdout:7/751: dwrite d5/d19/d1a/f6e [0,4194304] 0 2024-04-25T02:27:12.651 INFO:tasks.workunit.client.0.smithi114.stdout:1/676: unlink df/l12 0 2024-04-25T02:27:12.655 INFO:tasks.workunit.client.0.smithi114.stdout:1/677: read df/d11/f24 [4519037,72206] 0 2024-04-25T02:27:12.655 INFO:tasks.workunit.client.0.smithi114.stdout:7/752: rename d5/d43/f5a to d5/d19/d1a/daf/ff7 0 2024-04-25T02:27:12.656 INFO:tasks.workunit.client.0.smithi114.stdout:4/575: dwrite d3/d14/d6c/f9a [0,4194304] 0 2024-04-25T02:27:12.658 INFO:tasks.workunit.client.0.smithi114.stdout:6/793: getdents de/d2a 0 2024-04-25T02:27:12.659 INFO:tasks.workunit.client.0.smithi114.stdout:5/743: getdents d1/d51/d6f 0 2024-04-25T02:27:12.660 INFO:tasks.workunit.client.0.smithi114.stdout:3/671: dwrite d0/d25/d29/d60/da8/dc8/fe2 [8388608,4194304] 0 2024-04-25T02:27:12.663 INFO:tasks.workunit.client.0.smithi114.stdout:1/678: creat df/d13/d6e/fe5 x:0 0 0 2024-04-25T02:27:12.666 INFO:tasks.workunit.client.0.smithi114.stdout:4/576: creat d3/d8/d23/d25/d31/d33/fad x:0 0 0 2024-04-25T02:27:12.668 INFO:tasks.workunit.client.0.smithi114.stdout:6/794: mknod de/d27/d34/d44/d91/c11f 0 2024-04-25T02:27:12.668 INFO:tasks.workunit.client.0.smithi114.stdout:6/795: readlink de/d25/d39/d47/d90/lbd 0 2024-04-25T02:27:12.669 INFO:tasks.workunit.client.0.smithi114.stdout:3/672: creat d0/d25/d29/d78/fea x:0 0 0 2024-04-25T02:27:12.670 INFO:tasks.workunit.client.0.smithi114.stdout:5/744: rename d1/c10 to d1/d3e/db2/dd4/cfc 0 2024-04-25T02:27:12.671 INFO:tasks.workunit.client.0.smithi114.stdout:8/671: sync 2024-04-25T02:27:12.672 INFO:tasks.workunit.client.0.smithi114.stdout:8/672: write da/d38/d62/d6d/f56 [149038,48661] 0 2024-04-25T02:27:12.672 INFO:tasks.workunit.client.0.smithi114.stdout:3/673: read d0/f38 [5697822,25856] 0 2024-04-25T02:27:12.673 INFO:tasks.workunit.client.0.smithi114.stdout:8/673: chown da/cb 233280 1 2024-04-25T02:27:12.673 INFO:tasks.workunit.client.0.smithi114.stdout:3/674: dread - d0/d5/f6c zero size 2024-04-25T02:27:12.674 INFO:tasks.workunit.client.0.smithi114.stdout:4/577: creat d3/d8/d12/d19/d42/d58/fae x:0 0 0 2024-04-25T02:27:12.677 INFO:tasks.workunit.client.0.smithi114.stdout:4/578: mkdir d3/d8/d23/d25/d4e/daf 0 2024-04-25T02:27:12.678 INFO:tasks.workunit.client.0.smithi114.stdout:4/579: write d3/d8/d12/f6d [4181255,40887] 0 2024-04-25T02:27:12.679 INFO:tasks.workunit.client.0.smithi114.stdout:6/796: rename de/d25/d39/d5c to de/d27/d34/d4b/d102/d120 0 2024-04-25T02:27:12.680 INFO:tasks.workunit.client.0.smithi114.stdout:4/580: stat d3/d8/d12/d19/d42/d58/fa6 0 2024-04-25T02:27:12.683 INFO:tasks.workunit.client.0.smithi114.stdout:8/674: rename da/d69/d93/d6b/db3 to da/d1e/dcd/dd3 0 2024-04-25T02:27:12.684 INFO:tasks.workunit.client.0.smithi114.stdout:5/745: getdents d1/d6/d4f/d6c/d88/db6 0 2024-04-25T02:27:12.685 INFO:tasks.workunit.client.0.smithi114.stdout:3/675: getdents d0/d5/d3d/dc3 0 2024-04-25T02:27:12.685 INFO:tasks.workunit.client.0.smithi114.stdout:5/746: chown d1/d25/f4e 1 1 2024-04-25T02:27:12.686 INFO:tasks.workunit.client.0.smithi114.stdout:7/753: dread d5/fa0 [0,4194304] 0 2024-04-25T02:27:12.688 INFO:tasks.workunit.client.0.smithi114.stdout:7/754: write d5/d32/d64/fac [4822449,1110] 0 2024-04-25T02:27:12.689 INFO:tasks.workunit.client.0.smithi114.stdout:8/675: link da/d1e/f29 da/d38/db6/fd4 0 2024-04-25T02:27:12.691 INFO:tasks.workunit.client.0.smithi114.stdout:7/755: read d5/d19/d23/f58 [607879,4306] 0 2024-04-25T02:27:12.693 INFO:tasks.workunit.client.0.smithi114.stdout:3/676: rename d0/d25/d29/d85/d7e/da9/dad/de4/c91 to d0/d25/d29/dcb/ceb 0 2024-04-25T02:27:12.693 INFO:tasks.workunit.client.0.smithi114.stdout:4/581: dwrite d3/d8/d12/d19/d42/d58/f90 [0,4194304] 0 2024-04-25T02:27:12.698 INFO:tasks.workunit.client.0.smithi114.stdout:8/676: dwrite da/d1e/f6a [0,4194304] 0 2024-04-25T02:27:12.699 INFO:tasks.workunit.client.0.smithi114.stdout:7/756: dread d5/d19/d1a/f5d [0,4194304] 0 2024-04-25T02:27:12.700 INFO:tasks.workunit.client.0.smithi114.stdout:3/677: creat d0/d25/d29/dcb/fec x:0 0 0 2024-04-25T02:27:12.700 INFO:tasks.workunit.client.0.smithi114.stdout:1/679: dwrite df/d13/d1e/f72 [0,4194304] 0 2024-04-25T02:27:12.703 INFO:tasks.workunit.client.0.smithi114.stdout:7/757: dread - d5/d60/f6a zero size 2024-04-25T02:27:12.703 INFO:tasks.workunit.client.0.smithi114.stdout:8/677: creat da/d69/d87/db4/fd5 x:0 0 0 2024-04-25T02:27:12.703 INFO:tasks.workunit.client.0.smithi114.stdout:4/582: mkdir d3/d8/d23/d25/d4e/daf/db0 0 2024-04-25T02:27:12.704 INFO:tasks.workunit.client.0.smithi114.stdout:8/678: stat da/d38/l5e 0 2024-04-25T02:27:12.704 INFO:tasks.workunit.client.0.smithi114.stdout:0/649: sync 2024-04-25T02:27:12.705 INFO:tasks.workunit.client.0.smithi114.stdout:9/671: sync 2024-04-25T02:27:12.705 INFO:tasks.workunit.client.0.smithi114.stdout:4/583: write d3/d8/d23/d25/d31/f59 [2177278,20379] 0 2024-04-25T02:27:12.705 INFO:tasks.workunit.client.0.smithi114.stdout:8/679: chown da/d69/d93/d40/lae 88870030 1 2024-04-25T02:27:12.706 INFO:tasks.workunit.client.0.smithi114.stdout:3/678: creat d0/d5/fed x:0 0 0 2024-04-25T02:27:12.707 INFO:tasks.workunit.client.0.smithi114.stdout:7/758: mknod d5/d19/d1a/cf8 0 2024-04-25T02:27:12.708 INFO:tasks.workunit.client.0.smithi114.stdout:7/759: chown d5/d32/da6/db5/fea 1106801 1 2024-04-25T02:27:12.712 INFO:tasks.workunit.client.0.smithi114.stdout:0/650: symlink d1/d4/d62/lc8 0 2024-04-25T02:27:12.714 INFO:tasks.workunit.client.0.smithi114.stdout:4/584: creat d3/d8/d12/fb1 x:0 0 0 2024-04-25T02:27:12.714 INFO:tasks.workunit.client.0.smithi114.stdout:5/747: truncate d1/d6/de/f9c 1569957 0 2024-04-25T02:27:12.715 INFO:tasks.workunit.client.0.smithi114.stdout:9/672: unlink d8/d16/d21/d83/d39/d38/d46/d96/cd1 0 2024-04-25T02:27:12.716 INFO:tasks.workunit.client.0.smithi114.stdout:8/680: mknod da/d38/d62/d6d/d52/da8/da9/cd6 0 2024-04-25T02:27:12.717 INFO:tasks.workunit.client.0.smithi114.stdout:3/679: mknod d0/d25/d29/d85/d7e/da9/dad/cee 0 2024-04-25T02:27:12.718 INFO:tasks.workunit.client.0.smithi114.stdout:3/680: truncate d0/d25/d2a/d34/f7d 793428 0 2024-04-25T02:27:12.720 INFO:tasks.workunit.client.0.smithi114.stdout:0/651: write d1/d4/f1b [2544805,114499] 0 2024-04-25T02:27:12.720 INFO:tasks.workunit.client.0.smithi114.stdout:4/585: creat d3/d14/d6c/fb2 x:0 0 0 2024-04-25T02:27:12.721 INFO:tasks.workunit.client.0.smithi114.stdout:3/681: stat d0/d25/d2a/d34/fa7 0 2024-04-25T02:27:12.721 INFO:tasks.workunit.client.0.smithi114.stdout:9/673: mkdir d8/d16/d21/d83/dcf/dda 0 2024-04-25T02:27:12.722 INFO:tasks.workunit.client.0.smithi114.stdout:3/682: fdatasync d0/d25/d29/dcb/fec 0 2024-04-25T02:27:12.722 INFO:tasks.workunit.client.0.smithi114.stdout:8/681: rmdir da/d69/d93/d6b/dbb 39 2024-04-25T02:27:12.724 INFO:tasks.workunit.client.0.smithi114.stdout:1/680: mknod df/d11/d7d/d92/ce6 0 2024-04-25T02:27:12.725 INFO:tasks.workunit.client.0.smithi114.stdout:6/797: creat de/d25/d39/d47/de7/f121 x:0 0 0 2024-04-25T02:27:12.726 INFO:tasks.workunit.client.0.smithi114.stdout:5/748: unlink d1/d6/d1a/f7e 0 2024-04-25T02:27:12.726 INFO:tasks.workunit.client.0.smithi114.stdout:0/652: fsync d1/d4/f63 0 2024-04-25T02:27:12.727 INFO:tasks.workunit.client.0.smithi114.stdout:5/749: write d1/d25/d24/f3b [1172935,129219] 0 2024-04-25T02:27:12.729 INFO:tasks.workunit.client.0.smithi114.stdout:8/682: truncate da/d1e/f59 3160066 0 2024-04-25T02:27:12.748 INFO:tasks.workunit.client.0.smithi114.stdout:9/674: mknod d8/d16/cdb 0 2024-04-25T02:27:12.749 INFO:tasks.workunit.client.0.smithi114.stdout:5/750: rename d1/d53/d55/dae to d1/d6/de/da7/ddf/dc5/dfd 0 2024-04-25T02:27:12.750 INFO:tasks.workunit.client.0.smithi114.stdout:0/653: dwrite d1/d4/f19 [4194304,4194304] 0 2024-04-25T02:27:12.752 INFO:tasks.workunit.client.0.smithi114.stdout:7/760: write d5/d19/d23/fe0 [1827260,22706] 0 2024-04-25T02:27:12.754 INFO:tasks.workunit.client.0.smithi114.stdout:4/586: write d3/d8/d23/d25/f27 [490414,22373] 0 2024-04-25T02:27:12.754 INFO:tasks.workunit.client.0.smithi114.stdout:1/681: dread df/d13/d1e/f50 [0,4194304] 0 2024-04-25T02:27:12.754 INFO:tasks.workunit.client.0.smithi114.stdout:0/654: write d1/d4/d37/d6a/f81 [1251263,8259] 0 2024-04-25T02:27:12.754 INFO:tasks.workunit.client.0.smithi114.stdout:3/683: link d0/d25/d29/d85/d7e/da9/dad/de4/c84 d0/d25/d29/d60/da8/cef 0 2024-04-25T02:27:12.754 INFO:tasks.workunit.client.0.smithi114.stdout:9/675: write d8/d16/d21/d83/d39/d38/d46/d53/fa0 [1067526,109220] 0 2024-04-25T02:27:12.755 INFO:tasks.workunit.client.0.smithi114.stdout:5/751: mknod d1/d6/d1a/d7f/dd9/cfe 0 2024-04-25T02:27:12.759 INFO:tasks.workunit.client.0.smithi114.stdout:8/683: link da/d38/d62/d6d/d52/da8/db1/fca da/d1e/dcd/fd7 0 2024-04-25T02:27:12.760 INFO:tasks.workunit.client.0.smithi114.stdout:8/684: fdatasync da/d38/fc5 0 2024-04-25T02:27:12.761 INFO:tasks.workunit.client.0.smithi114.stdout:9/676: symlink d8/d16/d21/d24/d3c/d40/ldc 0 2024-04-25T02:27:12.763 INFO:tasks.workunit.client.0.smithi114.stdout:5/752: truncate d1/d25/d24/f61 192081 0 2024-04-25T02:27:12.764 INFO:tasks.workunit.client.0.smithi114.stdout:3/684: read d0/d25/f2e [1015028,13410] 0 2024-04-25T02:27:12.764 INFO:tasks.workunit.client.0.smithi114.stdout:9/677: mknod d8/d16/d21/d37/d43/d75/d8a/cdd 0 2024-04-25T02:27:12.766 INFO:tasks.workunit.client.0.smithi114.stdout:4/587: link d3/d8/d30/d4c/d7f/f94 d3/d8/d23/fb3 0 2024-04-25T02:27:12.766 INFO:tasks.workunit.client.0.smithi114.stdout:8/685: creat da/d38/d62/d6d/d52/da8/da9/dd2/fd8 x:0 0 0 2024-04-25T02:27:12.767 INFO:tasks.workunit.client.0.smithi114.stdout:0/655: dwrite d1/d30/d4d/f65 [0,4194304] 0 2024-04-25T02:27:12.769 INFO:tasks.workunit.client.0.smithi114.stdout:5/753: write d1/d25/f1f [3345050,81410] 0 2024-04-25T02:27:12.771 INFO:tasks.workunit.client.0.smithi114.stdout:4/588: creat d3/d8/d12/d19/fb4 x:0 0 0 2024-04-25T02:27:12.771 INFO:tasks.workunit.client.0.smithi114.stdout:0/656: write d1/d4/f8a [1072355,60021] 0 2024-04-25T02:27:12.776 INFO:tasks.workunit.client.0.smithi114.stdout:9/678: dwrite d8/d16/d21/d37/d60/f89 [0,4194304] 0 2024-04-25T02:27:12.777 INFO:tasks.workunit.client.0.smithi114.stdout:4/589: mkdir d3/d8/d30/d4c/db5 0 2024-04-25T02:27:12.779 INFO:tasks.workunit.client.0.smithi114.stdout:2/748: sync 2024-04-25T02:27:12.783 INFO:tasks.workunit.client.0.smithi114.stdout:2/749: write d5/df/d2c/f73 [1321388,123261] 0 2024-04-25T02:27:12.783 INFO:tasks.workunit.client.0.smithi114.stdout:1/682: dwrite df/d13/d44/d5a/dc9/d33/fce [0,4194304] 0 2024-04-25T02:27:12.783 INFO:tasks.workunit.client.0.smithi114.stdout:3/685: write d0/f38 [6988155,112066] 0 2024-04-25T02:27:12.785 INFO:tasks.workunit.client.0.smithi114.stdout:0/657: dwrite d1/d30/d4d/f6d [0,4194304] 0 2024-04-25T02:27:12.785 INFO:tasks.workunit.client.0.smithi114.stdout:2/750: readlink d5/df/d1e/l97 0 2024-04-25T02:27:12.788 INFO:tasks.workunit.client.0.smithi114.stdout:9/679: getdents d8 0 2024-04-25T02:27:12.789 INFO:tasks.workunit.client.0.smithi114.stdout:0/658: creat d1/d4/d24/fc9 x:0 0 0 2024-04-25T02:27:12.790 INFO:tasks.workunit.client.0.smithi114.stdout:0/659: fsync d1/d4/da/d33/fb8 0 2024-04-25T02:27:12.790 INFO:tasks.workunit.client.0.smithi114.stdout:2/751: mknod d5/df/d3d/cf2 0 2024-04-25T02:27:12.792 INFO:tasks.workunit.client.0.smithi114.stdout:3/686: truncate d0/d25/d29/d85/d7e/f93 348122 0 2024-04-25T02:27:12.792 INFO:tasks.workunit.client.0.smithi114.stdout:0/660: readlink d1/d4/da/d39/lc7 0 2024-04-25T02:27:12.794 INFO:tasks.workunit.client.0.smithi114.stdout:1/683: link l3 df/d13/dbb/le7 0 2024-04-25T02:27:12.796 INFO:tasks.workunit.client.0.smithi114.stdout:0/661: creat d1/d4/d37/d6a/db5/fca x:0 0 0 2024-04-25T02:27:12.796 INFO:tasks.workunit.client.0.smithi114.stdout:9/680: dwrite d8/d16/d21/d83/d39/d38/d46/d53/fa0 [0,4194304] 0 2024-04-25T02:27:12.797 INFO:tasks.workunit.client.0.smithi114.stdout:0/662: write d1/d30/d4d/f4e [1093371,52576] 0 2024-04-25T02:27:12.798 INFO:tasks.workunit.client.0.smithi114.stdout:2/752: creat d5/d1c/ff3 x:0 0 0 2024-04-25T02:27:12.798 INFO:tasks.workunit.client.0.smithi114.stdout:5/754: dread d1/d6/d1a/d7f/fe9 [0,4194304] 0 2024-04-25T02:27:12.798 INFO:tasks.workunit.client.0.smithi114.stdout:0/663: readlink d1/d7/d18/d2e/l67 0 2024-04-25T02:27:12.800 INFO:tasks.workunit.client.0.smithi114.stdout:5/755: chown d1/d25/da1/daa 567590 1 2024-04-25T02:27:12.800 INFO:tasks.workunit.client.0.smithi114.stdout:3/687: getdents d0/d25/d29/d85/d7e/da9/dad/de4/dbb 0 2024-04-25T02:27:12.804 INFO:tasks.workunit.client.0.smithi114.stdout:6/798: sync 2024-04-25T02:27:12.810 INFO:tasks.workunit.client.0.smithi114.stdout:2/753: rename d5/d6/fc8 to d5/d1c/d29/ff4 0 2024-04-25T02:27:12.810 INFO:tasks.workunit.client.0.smithi114.stdout:0/664: chown d1/d7/d18/d2e/d8f/f61 65060913 1 2024-04-25T02:27:12.811 INFO:tasks.workunit.client.0.smithi114.stdout:6/799: stat de/l10 0 2024-04-25T02:27:12.813 INFO:tasks.workunit.client.0.smithi114.stdout:3/688: write d0/d25/da0/fe1 [664122,26739] 0 2024-04-25T02:27:12.813 INFO:tasks.workunit.client.0.smithi114.stdout:5/756: creat d1/d3e/d8e/fff x:0 0 0 2024-04-25T02:27:12.813 INFO:tasks.workunit.client.0.smithi114.stdout:1/684: dwrite df/d13/d6e/d97/dd6/f95 [0,4194304] 0 2024-04-25T02:27:12.816 INFO:tasks.workunit.client.0.smithi114.stdout:6/800: creat de/d27/d76/d11c/f122 x:0 0 0 2024-04-25T02:27:12.818 INFO:tasks.workunit.client.0.smithi114.stdout:6/801: chown de/d27/f8f 96499588 1 2024-04-25T02:27:12.818 INFO:tasks.workunit.client.0.smithi114.stdout:1/685: truncate df/d2a/f70 740507 0 2024-04-25T02:27:12.821 INFO:tasks.workunit.client.0.smithi114.stdout:8/686: dread da/d38/d62/d6d/f46 [0,4194304] 0 2024-04-25T02:27:12.821 INFO:tasks.workunit.client.0.smithi114.stdout:6/802: write de/d27/d34/d4b/fc0 [61512,71291] 0 2024-04-25T02:27:12.821 INFO:tasks.workunit.client.0.smithi114.stdout:5/757: dwrite d1/d3e/fdc [0,4194304] 0 2024-04-25T02:27:12.823 INFO:tasks.workunit.client.0.smithi114.stdout:1/686: mkdir df/d13/d6e/d97/dd6/d82/de8 0 2024-04-25T02:27:12.823 INFO:tasks.workunit.client.0.smithi114.stdout:5/758: chown d1/d51/d6f/fe4 25951 1 2024-04-25T02:27:12.824 INFO:tasks.workunit.client.0.smithi114.stdout:1/687: chown df/d13/d44/d5a/dc9/d33/f58 9707 1 2024-04-25T02:27:12.825 INFO:tasks.workunit.client.0.smithi114.stdout:8/687: unlink da/d38/f74 0 2024-04-25T02:27:12.826 INFO:tasks.workunit.client.0.smithi114.stdout:0/665: dread d1/d4/da/f12 [0,4194304] 0 2024-04-25T02:27:12.826 INFO:tasks.workunit.client.0.smithi114.stdout:6/803: symlink de/d27/d34/d4b/l123 0 2024-04-25T02:27:12.831 INFO:tasks.workunit.client.0.smithi114.stdout:5/759: mknod d1/d25/d24/c100 0 2024-04-25T02:27:12.831 INFO:tasks.workunit.client.0.smithi114.stdout:5/760: chown d1/d6/de/dbc 145 1 2024-04-25T02:27:12.831 INFO:tasks.workunit.client.0.smithi114.stdout:1/688: dwrite df/d13/d44/d5a/dc9/f37 [0,4194304] 0 2024-04-25T02:27:12.833 INFO:tasks.workunit.client.0.smithi114.stdout:1/689: read - df/d13/d44/d5a/dc9/d33/d47/d74/f80 zero size 2024-04-25T02:27:12.834 INFO:tasks.workunit.client.0.smithi114.stdout:6/804: creat de/d2a/dd5/f124 x:0 0 0 2024-04-25T02:27:12.834 INFO:tasks.workunit.client.0.smithi114.stdout:6/805: chown de/d27/l94 9 1 2024-04-25T02:27:12.838 INFO:tasks.workunit.client.0.smithi114.stdout:1/690: write df/d13/d75/d8e/fb5 [231146,7631] 0 2024-04-25T02:27:12.839 INFO:tasks.workunit.client.0.smithi114.stdout:4/590: dwrite d3/d8/d12/d19/d26/d3e/daa/f54 [0,4194304] 0 2024-04-25T02:27:12.840 INFO:tasks.workunit.client.0.smithi114.stdout:4/591: chown d3/d8/d30/l3a 191971606 1 2024-04-25T02:27:12.840 INFO:tasks.workunit.client.0.smithi114.stdout:6/806: symlink de/d30/l125 0 2024-04-25T02:27:12.842 INFO:tasks.workunit.client.0.smithi114.stdout:5/761: symlink d1/d3e/d8e/de5/daf/l101 0 2024-04-25T02:27:12.844 INFO:tasks.workunit.client.0.smithi114.stdout:1/691: mkdir df/d2a/de9 0 2024-04-25T02:27:12.845 INFO:tasks.workunit.client.0.smithi114.stdout:2/754: dread d5/df/f45 [0,4194304] 0 2024-04-25T02:27:12.845 INFO:tasks.workunit.client.0.smithi114.stdout:5/762: write d1/d6/de/d75/fb9 [3016696,25648] 0 2024-04-25T02:27:12.849 INFO:tasks.workunit.client.0.smithi114.stdout:4/592: dwrite d3/d8/d12/d19/d26/d3e/daa/f54 [0,4194304] 0 2024-04-25T02:27:12.850 INFO:tasks.workunit.client.0.smithi114.stdout:5/763: write d1/d53/d55/db1/fef [18417,23979] 0 2024-04-25T02:27:12.851 INFO:tasks.workunit.client.0.smithi114.stdout:2/755: dread d5/df/d1e/f26 [0,4194304] 0 2024-04-25T02:27:12.852 INFO:tasks.workunit.client.0.smithi114.stdout:1/692: mknod df/d13/d44/d5a/dc9/d33/d47/cea 0 2024-04-25T02:27:12.852 INFO:tasks.workunit.client.0.smithi114.stdout:3/689: write d0/d25/d29/d85/d7e/f97 [734631,94176] 0 2024-04-25T02:27:12.853 INFO:tasks.workunit.client.0.smithi114.stdout:5/764: chown d1/d25/d24/f27 2992 1 2024-04-25T02:27:12.856 INFO:tasks.workunit.client.0.smithi114.stdout:7/761: sync 2024-04-25T02:27:12.857 INFO:tasks.workunit.client.0.smithi114.stdout:6/807: dwrite de/f92 [0,4194304] 0 2024-04-25T02:27:12.862 INFO:tasks.workunit.client.0.smithi114.stdout:3/690: rmdir d0/d25/d2a/d34/dd1 0 2024-04-25T02:27:12.868 INFO:tasks.workunit.client.0.smithi114.stdout:4/593: dwrite d3/d14/f65 [0,4194304] 0 2024-04-25T02:27:12.869 INFO:tasks.workunit.client.0.smithi114.stdout:1/693: link df/l4e df/d2a/d34/d77/dc0/leb 0 2024-04-25T02:27:12.870 INFO:tasks.workunit.client.0.smithi114.stdout:1/694: chown df 11238 1 2024-04-25T02:27:12.871 INFO:tasks.workunit.client.0.smithi114.stdout:6/808: truncate de/d27/d34/d4b/d102/f106 201156 0 2024-04-25T02:27:12.871 INFO:tasks.workunit.client.0.smithi114.stdout:2/756: dwrite d5/df/d3d/f4b [0,4194304] 0 2024-04-25T02:27:12.872 INFO:tasks.workunit.client.0.smithi114.stdout:4/594: stat d3/le 0 2024-04-25T02:27:12.873 INFO:tasks.workunit.client.0.smithi114.stdout:5/765: dwrite d1/d6/de/d75/f84 [0,4194304] 0 2024-04-25T02:27:12.874 INFO:tasks.workunit.client.0.smithi114.stdout:0/666: dread d1/f27 [0,4194304] 0 2024-04-25T02:27:12.875 INFO:tasks.workunit.client.0.smithi114.stdout:5/766: readlink d1/d6/lf0 0 2024-04-25T02:27:12.875 INFO:tasks.workunit.client.0.smithi114.stdout:7/762: dwrite d5/d19/d23/f4d [0,4194304] 0 2024-04-25T02:27:12.875 INFO:tasks.workunit.client.0.smithi114.stdout:8/688: dread da/d1e/dcd/dd3/fcf [0,4194304] 0 2024-04-25T02:27:12.898 INFO:tasks.workunit.client.0.smithi114.stdout:5/767: fsync d1/d25/fe8 0 2024-04-25T02:27:12.899 INFO:tasks.workunit.client.0.smithi114.stdout:2/757: rmdir d5/d6/d58/d5a 39 2024-04-25T02:27:12.899 INFO:tasks.workunit.client.0.smithi114.stdout:0/667: chown d1/d4/d62/d83/f8c 257571859 1 2024-04-25T02:27:12.900 INFO:tasks.workunit.client.0.smithi114.stdout:4/595: rmdir d3/d8/d12/d19/d26/d3e/d62 39 2024-04-25T02:27:12.901 INFO:tasks.workunit.client.0.smithi114.stdout:2/758: read d5/d6/d31/f60 [2237662,4319] 0 2024-04-25T02:27:12.901 INFO:tasks.workunit.client.0.smithi114.stdout:5/768: read d1/d6/de/f90 [382216,48199] 0 2024-04-25T02:27:12.901 INFO:tasks.workunit.client.0.smithi114.stdout:7/763: mknod d5/d32/da6/db5/cf9 0 2024-04-25T02:27:12.902 INFO:tasks.workunit.client.0.smithi114.stdout:7/764: readlink l2 0 2024-04-25T02:27:12.903 INFO:tasks.workunit.client.0.smithi114.stdout:4/596: truncate d3/d8/d12/fb1 836183 0 2024-04-25T02:27:12.903 INFO:tasks.workunit.client.0.smithi114.stdout:4/597: chown d3/le 1215744 1 2024-04-25T02:27:12.905 INFO:tasks.workunit.client.0.smithi114.stdout:8/689: symlink da/d38/d62/d6d/ld9 0 2024-04-25T02:27:12.906 INFO:tasks.workunit.client.0.smithi114.stdout:8/690: stat da/d38/f5b 0 2024-04-25T02:27:12.906 INFO:tasks.workunit.client.0.smithi114.stdout:2/759: mknod d5/df/d2c/d66/cf5 0 2024-04-25T02:27:12.907 INFO:tasks.workunit.client.0.smithi114.stdout:2/760: chown d5/df/dc9 972013 1 2024-04-25T02:27:12.907 INFO:tasks.workunit.client.0.smithi114.stdout:5/769: rmdir d1/d3e/d8e/de5/daf 39 2024-04-25T02:27:12.907 INFO:tasks.workunit.client.0.smithi114.stdout:8/691: readlink da/d38/d62/d6d/d49/d65/l95 0 2024-04-25T02:27:12.909 INFO:tasks.workunit.client.0.smithi114.stdout:6/809: link de/d25/d39/d47/fb7 de/d27/d34/d38/f126 0 2024-04-25T02:27:12.910 INFO:tasks.workunit.client.0.smithi114.stdout:4/598: mkdir d3/d8/d30/d4c/d7f/db6 0 2024-04-25T02:27:12.910 INFO:tasks.workunit.client.0.smithi114.stdout:0/668: dwrite d1/d4/d4f/d77/da1/fad [0,4194304] 0 2024-04-25T02:27:12.913 INFO:tasks.workunit.client.0.smithi114.stdout:4/599: mknod d3/d8/d30/d4c/d7f/cb7 0 2024-04-25T02:27:12.914 INFO:tasks.workunit.client.0.smithi114.stdout:4/600: dread - d3/d8/d12/d19/fb4 zero size 2024-04-25T02:27:12.917 INFO:tasks.workunit.client.0.smithi114.stdout:8/692: getdents da 0 2024-04-25T02:27:12.918 INFO:tasks.workunit.client.0.smithi114.stdout:8/693: read - da/d38/d62/d6d/d52/d6c/f8e zero size 2024-04-25T02:27:12.918 INFO:tasks.workunit.client.0.smithi114.stdout:4/601: read d3/d8/d12/d19/d26/f2a [1355127,55677] 0 2024-04-25T02:27:12.920 INFO:tasks.workunit.client.0.smithi114.stdout:9/681: sync 2024-04-25T02:27:12.921 INFO:tasks.workunit.client.0.smithi114.stdout:8/694: symlink da/d69/d93/d6b/dbb/lda 0 2024-04-25T02:27:12.922 INFO:tasks.workunit.client.0.smithi114.stdout:8/695: readlink da/d1d/l47 0 2024-04-25T02:27:12.924 INFO:tasks.workunit.client.0.smithi114.stdout:4/602: dwrite d3/d8/d12/d19/d26/f70 [0,4194304] 0 2024-04-25T02:27:12.926 INFO:tasks.workunit.client.0.smithi114.stdout:5/770: dread d1/d6/de/f90 [0,4194304] 0 2024-04-25T02:27:12.929 INFO:tasks.workunit.client.0.smithi114.stdout:9/682: link d8/d16/d21/d24/d3c/d40/l8b d8/d16/d21/d83/d39/dab/lde 0 2024-04-25T02:27:12.929 INFO:tasks.workunit.client.0.smithi114.stdout:5/771: dread - d1/d6/d4f/fbd zero size 2024-04-25T02:27:12.931 INFO:tasks.workunit.client.0.smithi114.stdout:8/696: dread da/d38/d62/d6d/d52/da8/db1/fca [0,4194304] 0 2024-04-25T02:27:12.933 INFO:tasks.workunit.client.0.smithi114.stdout:4/603: dwrite d3/d8/d12/d19/d26/f70 [0,4194304] 0 2024-04-25T02:27:12.934 INFO:tasks.workunit.client.0.smithi114.stdout:4/604: fsync d3/d8/d12/f1e 0 2024-04-25T02:27:12.936 INFO:tasks.workunit.client.0.smithi114.stdout:9/683: rename d8/d16/d21/d83/dcf to d8/d16/d21/d83/d39/ddf 0 2024-04-25T02:27:12.939 INFO:tasks.workunit.client.0.smithi114.stdout:1/695: sync 2024-04-25T02:27:12.939 INFO:tasks.workunit.client.0.smithi114.stdout:9/684: chown d8/d16/f3f 266588 1 2024-04-25T02:27:12.939 INFO:tasks.workunit.client.0.smithi114.stdout:8/697: write da/d38/d62/d6d/f46 [4379515,9559] 0 2024-04-25T02:27:12.942 INFO:tasks.workunit.client.0.smithi114.stdout:8/698: dread - da/d38/d62/d6d/d52/d6c/fac zero size 2024-04-25T02:27:12.942 INFO:tasks.workunit.client.0.smithi114.stdout:4/605: dwrite d3/f28 [0,4194304] 0 2024-04-25T02:27:12.944 INFO:tasks.workunit.client.0.smithi114.stdout:4/606: fdatasync d3/d8/d12/d19/f74 0 2024-04-25T02:27:12.947 INFO:tasks.workunit.client.0.smithi114.stdout:8/699: truncate da/d1e/f48 8748054 0 2024-04-25T02:27:12.947 INFO:tasks.workunit.client.0.smithi114.stdout:1/696: dread df/d13/d6e/d97/dd6/f95 [0,4194304] 0 2024-04-25T02:27:12.949 INFO:tasks.workunit.client.0.smithi114.stdout:4/607: dread - d3/d8/d12/d19/d42/d58/fae zero size 2024-04-25T02:27:12.949 INFO:tasks.workunit.client.0.smithi114.stdout:6/810: dread de/ff [0,4194304] 0 2024-04-25T02:27:12.950 INFO:tasks.workunit.client.0.smithi114.stdout:8/700: fdatasync da/d38/d62/d6d/d52/da8/da9/dd2/fd8 0 2024-04-25T02:27:12.950 INFO:tasks.workunit.client.0.smithi114.stdout:6/811: dread - de/d27/d76/d11c/f122 zero size 2024-04-25T02:27:12.951 INFO:tasks.workunit.client.0.smithi114.stdout:8/701: chown da/d38/d62/d6d/d52/d6c/f9a 668587 1 2024-04-25T02:27:12.953 INFO:tasks.workunit.client.0.smithi114.stdout:8/702: truncate da/d38/d62/d6d/d49/f99 612363 0 2024-04-25T02:27:12.953 INFO:tasks.workunit.client.0.smithi114.stdout:1/697: creat df/d13/d1e/da2/fec x:0 0 0 2024-04-25T02:27:12.954 INFO:tasks.workunit.client.0.smithi114.stdout:6/812: rmdir de/d27/d34 39 2024-04-25T02:27:12.954 INFO:tasks.workunit.client.0.smithi114.stdout:8/703: fsync da/d38/d62/d6d/d52/d6c/fac 0 2024-04-25T02:27:12.955 INFO:tasks.workunit.client.0.smithi114.stdout:1/698: truncate df/d13/d6e/fe5 229789 0 2024-04-25T02:27:12.955 INFO:tasks.workunit.client.0.smithi114.stdout:8/704: fdatasync da/d1e/f8f 0 2024-04-25T02:27:12.955 INFO:tasks.workunit.client.0.smithi114.stdout:4/608: mknod d3/d8/d30/cb8 0 2024-04-25T02:27:12.956 INFO:tasks.workunit.client.0.smithi114.stdout:4/609: stat d3/d8/d30/d4c/d7f 0 2024-04-25T02:27:12.959 INFO:tasks.workunit.client.0.smithi114.stdout:1/699: fsync df/d11/d32/f89 0 2024-04-25T02:27:12.961 INFO:tasks.workunit.client.0.smithi114.stdout:3/691: dread d0/f38 [4194304,4194304] 0 2024-04-25T02:27:12.962 INFO:tasks.workunit.client.0.smithi114.stdout:8/705: creat da/d69/d93/d6b/fdb x:0 0 0 2024-04-25T02:27:12.963 INFO:tasks.workunit.client.0.smithi114.stdout:6/813: dwrite de/d2a/f103 [0,4194304] 0 2024-04-25T02:27:12.965 INFO:tasks.workunit.client.0.smithi114.stdout:1/700: mknod df/d13/d93/ced 0 2024-04-25T02:27:12.967 INFO:tasks.workunit.client.0.smithi114.stdout:7/765: dread d5/f9 [0,4194304] 0 2024-04-25T02:27:12.967 INFO:tasks.workunit.client.0.smithi114.stdout:2/761: dwrite d5/d6/d31/d6a/f88 [0,4194304] 0 2024-04-25T02:27:12.969 INFO:tasks.workunit.client.0.smithi114.stdout:6/814: truncate de/d25/f50 6018027 0 2024-04-25T02:27:12.969 INFO:tasks.workunit.client.0.smithi114.stdout:3/692: dread d0/d25/d29/d78/faf [0,4194304] 0 2024-04-25T02:27:12.971 INFO:tasks.workunit.client.0.smithi114.stdout:0/669: dwrite d1/d7/d46/f87 [0,4194304] 0 2024-04-25T02:27:12.972 INFO:tasks.workunit.client.0.smithi114.stdout:8/706: link da/d1d/fa2 da/d1d/fdc 0 2024-04-25T02:27:12.972 INFO:tasks.workunit.client.0.smithi114.stdout:6/815: dread - de/d2a/dd5/ff1 zero size 2024-04-25T02:27:12.974 INFO:tasks.workunit.client.0.smithi114.stdout:0/670: fdatasync d1/d7/d18/f3b 0 2024-04-25T02:27:12.976 INFO:tasks.workunit.client.0.smithi114.stdout:7/766: truncate d5/d60/f71 607447 0 2024-04-25T02:27:12.977 INFO:tasks.workunit.client.0.smithi114.stdout:8/707: write da/d38/d62/d6d/d52/fce [335402,22262] 0 2024-04-25T02:27:12.979 INFO:tasks.workunit.client.0.smithi114.stdout:0/671: read d1/d7/d18/f22 [1108997,13008] 0 2024-04-25T02:27:12.980 INFO:tasks.workunit.client.0.smithi114.stdout:5/772: dwrite d1/d25/d24/f61 [0,4194304] 0 2024-04-25T02:27:12.984 INFO:tasks.workunit.client.0.smithi114.stdout:3/693: read d0/d5/f53 [3059224,87954] 0 2024-04-25T02:27:12.984 INFO:tasks.workunit.client.0.smithi114.stdout:5/773: read - d1/d6/d4f/fec zero size 2024-04-25T02:27:12.985 INFO:tasks.workunit.client.0.smithi114.stdout:9/685: dwrite d8/f74 [0,4194304] 0 2024-04-25T02:27:12.987 INFO:tasks.workunit.client.0.smithi114.stdout:3/694: stat d0/d25/d29/d85/f51 0 2024-04-25T02:27:12.987 INFO:tasks.workunit.client.0.smithi114.stdout:6/816: dwrite de/d30/f49 [0,4194304] 0 2024-04-25T02:27:12.990 INFO:tasks.workunit.client.0.smithi114.stdout:3/695: chown d0/d5/d3d/f66 20686714 1 2024-04-25T02:27:12.993 INFO:tasks.workunit.client.0.smithi114.stdout:3/696: symlink d0/d25/d2a/d80/dbd/lf0 0 2024-04-25T02:27:12.995 INFO:tasks.workunit.client.0.smithi114.stdout:6/817: creat de/d27/d34/d4b/d102/f127 x:0 0 0 2024-04-25T02:27:12.996 INFO:tasks.workunit.client.0.smithi114.stdout:5/774: dwrite d1/d6/de/f90 [0,4194304] 0 2024-04-25T02:27:12.996 INFO:tasks.workunit.client.0.smithi114.stdout:6/818: dread - de/d2a/dd5/f124 zero size 2024-04-25T02:27:12.998 INFO:tasks.workunit.client.0.smithi114.stdout:3/697: symlink d0/d25/d29/d85/lf1 0 2024-04-25T02:27:12.998 INFO:tasks.workunit.client.0.smithi114.stdout:3/698: dread - d0/d5/d3d/da6/fdd zero size 2024-04-25T02:27:13.001 INFO:tasks.workunit.client.0.smithi114.stdout:3/699: creat d0/d25/d29/d60/da8/dc8/ff2 x:0 0 0 2024-04-25T02:27:13.002 INFO:tasks.workunit.client.0.smithi114.stdout:3/700: chown d0/d5/d3d/ddc/cdb 3224520 1 2024-04-25T02:27:13.003 INFO:tasks.workunit.client.0.smithi114.stdout:6/819: symlink de/d25/d39/d114/l128 0 2024-04-25T02:27:13.004 INFO:tasks.workunit.client.0.smithi114.stdout:8/708: dread da/f31 [0,4194304] 0 2024-04-25T02:27:13.005 INFO:tasks.workunit.client.0.smithi114.stdout:5/775: getdents d1 0 2024-04-25T02:27:13.005 INFO:tasks.workunit.client.0.smithi114.stdout:3/701: unlink d0/d5/c4c 0 2024-04-25T02:27:13.006 INFO:tasks.workunit.client.0.smithi114.stdout:6/820: rmdir de/d2a/db9/dc7/d100 39 2024-04-25T02:27:13.007 INFO:tasks.workunit.client.0.smithi114.stdout:8/709: symlink da/d1e/ldd 0 2024-04-25T02:27:13.010 INFO:tasks.workunit.client.0.smithi114.stdout:5/776: dwrite d1/d6/de/d75/fb9 [4194304,4194304] 0 2024-04-25T02:27:13.011 INFO:tasks.workunit.client.0.smithi114.stdout:8/710: rename da/c97 to da/d1e/dcd/dd3/cde 0 2024-04-25T02:27:13.013 INFO:tasks.workunit.client.0.smithi114.stdout:4/610: sync 2024-04-25T02:27:13.013 INFO:tasks.workunit.client.0.smithi114.stdout:4/611: readlink d3/l3f 0 2024-04-25T02:27:13.018 INFO:tasks.workunit.client.0.smithi114.stdout:5/777: creat d1/d6/d4f/d6c/d88/f102 x:0 0 0 2024-04-25T02:27:13.018 INFO:tasks.workunit.client.0.smithi114.stdout:8/711: creat da/d38/db6/fdf x:0 0 0 2024-04-25T02:27:13.019 INFO:tasks.workunit.client.0.smithi114.stdout:5/778: stat d1/d6/de/c5d 0 2024-04-25T02:27:13.019 INFO:tasks.workunit.client.0.smithi114.stdout:8/712: dread - da/d69/d87/db4/fd5 zero size 2024-04-25T02:27:13.022 INFO:tasks.workunit.client.0.smithi114.stdout:5/779: creat d1/d6/de/da7/ddf/f103 x:0 0 0 2024-04-25T02:27:13.022 INFO:tasks.workunit.client.0.smithi114.stdout:2/762: write d5/d6/fc [3244659,100695] 0 2024-04-25T02:27:13.023 INFO:tasks.workunit.client.0.smithi114.stdout:8/713: unlink da/d69/d87/db4/fd5 0 2024-04-25T02:27:13.024 INFO:tasks.workunit.client.0.smithi114.stdout:2/763: write d5/df/d3d/f5e [281884,30452] 0 2024-04-25T02:27:13.025 INFO:tasks.workunit.client.0.smithi114.stdout:4/612: dwrite d3/d8/d23/d25/d31/f9e [0,4194304] 0 2024-04-25T02:27:13.026 INFO:tasks.workunit.client.0.smithi114.stdout:5/780: creat d1/d6/de/da7/ddf/dc5/f104 x:0 0 0 2024-04-25T02:27:13.026 INFO:tasks.workunit.client.0.smithi114.stdout:8/714: write da/d38/d62/d6d/d52/d6c/fba [1201983,25516] 0 2024-04-25T02:27:13.029 INFO:tasks.workunit.client.0.smithi114.stdout:4/613: stat d3/d8/d30/d6e/da2 0 2024-04-25T02:27:13.029 INFO:tasks.workunit.client.0.smithi114.stdout:4/614: readlink d3/le 0 2024-04-25T02:27:13.029 INFO:tasks.workunit.client.0.smithi114.stdout:5/781: unlink d1/l13 0 2024-04-25T02:27:13.030 INFO:tasks.workunit.client.0.smithi114.stdout:8/715: rename da/d69/d93/f68 to da/d69/d90/fe0 0 2024-04-25T02:27:13.031 INFO:tasks.workunit.client.0.smithi114.stdout:4/615: chown d3/d8/d23/d25/c2b 15120 1 2024-04-25T02:27:13.034 INFO:tasks.workunit.client.0.smithi114.stdout:4/616: read d3/d8/d23/d25/f66 [1037777,75605] 0 2024-04-25T02:27:13.034 INFO:tasks.workunit.client.0.smithi114.stdout:9/686: fsync d8/f74 0 2024-04-25T02:27:13.039 INFO:tasks.workunit.client.0.smithi114.stdout:8/716: write da/d38/d62/d6d/f51 [4562405,121230] 0 2024-04-25T02:27:13.039 INFO:tasks.workunit.client.0.smithi114.stdout:9/687: dread d8/d16/d21/d83/d39/d38/d5d/fb9 [0,4194304] 0 2024-04-25T02:27:13.039 INFO:tasks.workunit.client.0.smithi114.stdout:4/617: write d3/d8/d12/d19/d26/d3e/f55 [152666,113936] 0 2024-04-25T02:27:13.041 INFO:tasks.workunit.client.0.smithi114.stdout:1/701: truncate df/d13/d44/d5a/dc9/d33/d47/fb7 3097995 0 2024-04-25T02:27:13.042 INFO:tasks.workunit.client.0.smithi114.stdout:0/672: write d1/d4/d62/d83/f8c [4594546,7861] 0 2024-04-25T02:27:13.043 INFO:tasks.workunit.client.0.smithi114.stdout:7/767: truncate d5/d43/d63/d7a/f9d 1313227 0 2024-04-25T02:27:13.045 INFO:tasks.workunit.client.0.smithi114.stdout:8/717: dwrite da/d38/d62/d6d/d52/fce [0,4194304] 0 2024-04-25T02:27:13.049 INFO:tasks.workunit.client.0.smithi114.stdout:1/702: creat df/d11/fee x:0 0 0 2024-04-25T02:27:13.050 INFO:tasks.workunit.client.0.smithi114.stdout:7/768: truncate d5/d43/d63/f92 267160 0 2024-04-25T02:27:13.050 INFO:tasks.workunit.client.0.smithi114.stdout:8/718: chown da/d1e/c26 6 1 2024-04-25T02:27:13.050 INFO:tasks.workunit.client.0.smithi114.stdout:0/673: chown d1/d7/d46/cc2 2893212 1 2024-04-25T02:27:13.050 INFO:tasks.workunit.client.0.smithi114.stdout:9/688: dwrite d8/d16/d21/d83/f5f [0,4194304] 0 2024-04-25T02:27:13.052 INFO:tasks.workunit.client.0.smithi114.stdout:3/702: chown d0/d25/d29/d85/d7e/fe6 2951 1 2024-04-25T02:27:13.052 INFO:tasks.workunit.client.0.smithi114.stdout:7/769: dread - d5/d19/d1a/daf/fc2 zero size 2024-04-25T02:27:13.054 INFO:tasks.workunit.client.0.smithi114.stdout:0/674: write d1/d4/d37/d6a/db5/fca [1020676,27769] 0 2024-04-25T02:27:13.054 INFO:tasks.workunit.client.0.smithi114.stdout:9/689: rmdir d8/d16/d21/d83/d39/ddf 39 2024-04-25T02:27:13.055 INFO:tasks.workunit.client.0.smithi114.stdout:0/675: chown d1/d4/da/f2a 669152 1 2024-04-25T02:27:13.055 INFO:tasks.workunit.client.0.smithi114.stdout:1/703: creat df/d13/d6e/d97/dd6/d82/de8/fef x:0 0 0 2024-04-25T02:27:13.057 INFO:tasks.workunit.client.0.smithi114.stdout:8/719: creat da/d69/d93/d40/fe1 x:0 0 0 2024-04-25T02:27:13.060 INFO:tasks.workunit.client.0.smithi114.stdout:7/770: rmdir d5/d19/d1a/daf 39 2024-04-25T02:27:13.061 INFO:tasks.workunit.client.0.smithi114.stdout:9/690: unlink d8/d16/d21/d37/d43/d75/fd7 0 2024-04-25T02:27:13.062 INFO:tasks.workunit.client.0.smithi114.stdout:9/691: dread - d8/d16/d21/d37/d43/d75/da3/db0/fd2 zero size 2024-04-25T02:27:13.071 INFO:tasks.workunit.client.0.smithi114.stdout:6/821: sync 2024-04-25T02:27:13.074 INFO:tasks.workunit.client.0.smithi114.stdout:7/771: symlink d5/d19/d1a/d80/lfa 0 2024-04-25T02:27:13.075 INFO:tasks.workunit.client.0.smithi114.stdout:9/692: mknod d8/d16/d21/d83/d39/d38/d46/ce0 0 2024-04-25T02:27:13.081 INFO:tasks.workunit.client.0.smithi114.stdout:2/764: dwrite d5/df/d2c/f64 [0,4194304] 0 2024-04-25T02:27:13.081 INFO:tasks.workunit.client.0.smithi114.stdout:1/704: dwrite df/d11/f28 [0,4194304] 0 2024-04-25T02:27:13.081 INFO:tasks.workunit.client.0.smithi114.stdout:6/822: symlink de/d2a/l129 0 2024-04-25T02:27:13.084 INFO:tasks.workunit.client.0.smithi114.stdout:7/772: dread d5/d19/f2a [0,4194304] 0 2024-04-25T02:27:13.085 INFO:tasks.workunit.client.0.smithi114.stdout:3/703: write d0/d5/d3d/f75 [1111924,42477] 0 2024-04-25T02:27:13.085 INFO:tasks.workunit.client.0.smithi114.stdout:6/823: stat de/d27/d34/d44/d91/f117 0 2024-04-25T02:27:13.086 INFO:tasks.workunit.client.0.smithi114.stdout:1/705: symlink df/d13/d1e/lf0 0 2024-04-25T02:27:13.087 INFO:tasks.workunit.client.0.smithi114.stdout:8/720: truncate da/d38/d62/d6d/f51 2672699 0 2024-04-25T02:27:13.087 INFO:tasks.workunit.client.0.smithi114.stdout:6/824: read - de/d2a/dd5/ff1 zero size 2024-04-25T02:27:13.089 INFO:tasks.workunit.client.0.smithi114.stdout:1/706: write df/d2a/d34/f63 [433353,104732] 0 2024-04-25T02:27:13.093 INFO:tasks.workunit.client.0.smithi114.stdout:3/704: dwrite d0/fa [0,4194304] 0 2024-04-25T02:27:13.098 INFO:tasks.workunit.client.0.smithi114.stdout:4/618: sync 2024-04-25T02:27:13.098 INFO:tasks.workunit.client.0.smithi114.stdout:7/773: rename d5/d19/d1a/da4/db3/df4 to d5/d32/d4a/d91/dfb 0 2024-04-25T02:27:13.101 INFO:tasks.workunit.client.0.smithi114.stdout:2/765: link d5/d1c/d21/d91/f9b d5/ff6 0 2024-04-25T02:27:13.102 INFO:tasks.workunit.client.0.smithi114.stdout:5/782: chown d1/d6/d4f/d6c/f80 0 1 2024-04-25T02:27:13.103 INFO:tasks.workunit.client.0.smithi114.stdout:3/705: creat d0/d25/d29/d78/ff3 x:0 0 0 2024-04-25T02:27:13.108 INFO:tasks.workunit.client.0.smithi114.stdout:8/721: link da/d38/d62/d6d/l4c da/d38/d62/d6d/d52/da8/db1/le2 0 2024-04-25T02:27:13.109 INFO:tasks.workunit.client.0.smithi114.stdout:4/619: rename d3/d8/d23/d25/d4e/daf/db0 to d3/db9 0 2024-04-25T02:27:13.110 INFO:tasks.workunit.client.0.smithi114.stdout:3/706: creat d0/d25/d29/d85/ff4 x:0 0 0 2024-04-25T02:27:13.112 INFO:tasks.workunit.client.0.smithi114.stdout:2/766: rename d5/df/d1e/f6d to d5/d1c/d21/ff7 0 2024-04-25T02:27:13.115 INFO:tasks.workunit.client.0.smithi114.stdout:2/767: chown d5/d6/d58/d5a/d3e/l4d 215 1 2024-04-25T02:27:13.116 INFO:tasks.workunit.client.0.smithi114.stdout:8/722: creat da/d38/d62/d6d/fe3 x:0 0 0 2024-04-25T02:27:13.116 INFO:tasks.workunit.client.0.smithi114.stdout:3/707: creat d0/d25/d2a/d34/d9e/ff5 x:0 0 0 2024-04-25T02:27:13.117 INFO:tasks.workunit.client.0.smithi114.stdout:2/768: readlink d5/df/d1e/la3 0 2024-04-25T02:27:13.118 INFO:tasks.workunit.client.0.smithi114.stdout:2/769: readlink d5/d6/d58/lba 0 2024-04-25T02:27:13.119 INFO:tasks.workunit.client.0.smithi114.stdout:9/693: dread d8/d16/d21/f26 [0,4194304] 0 2024-04-25T02:27:13.120 INFO:tasks.workunit.client.0.smithi114.stdout:2/770: write d5/d1c/d29/f2b [4940411,8332] 0 2024-04-25T02:27:13.120 INFO:tasks.workunit.client.0.smithi114.stdout:9/694: chown d8/d16/d21/d83/d39/f62 36325 1 2024-04-25T02:27:13.120 INFO:tasks.workunit.client.0.smithi114.stdout:8/723: read da/d69/d93/d40/f45 [3999440,64484] 0 2024-04-25T02:27:13.122 INFO:tasks.workunit.client.0.smithi114.stdout:9/695: write d8/d16/d21/d24/d69/f6c [838400,9643] 0 2024-04-25T02:27:13.122 INFO:tasks.workunit.client.0.smithi114.stdout:3/708: rename d0/d5/d3d/f54 to d0/d25/d2a/dc4/ff6 0 2024-04-25T02:27:13.124 INFO:tasks.workunit.client.0.smithi114.stdout:8/724: creat da/d38/fe4 x:0 0 0 2024-04-25T02:27:13.125 INFO:tasks.workunit.client.0.smithi114.stdout:8/725: chown da/d1e/ca3 943138 1 2024-04-25T02:27:13.128 INFO:tasks.workunit.client.0.smithi114.stdout:2/771: creat d5/df/d2c/d66/db3/ff8 x:0 0 0 2024-04-25T02:27:13.132 INFO:tasks.workunit.client.0.smithi114.stdout:3/709: symlink d0/d25/d29/d85/d7e/lf7 0 2024-04-25T02:27:13.132 INFO:tasks.workunit.client.0.smithi114.stdout:6/825: dwrite de/d30/f37 [0,4194304] 0 2024-04-25T02:27:13.134 INFO:tasks.workunit.client.0.smithi114.stdout:8/726: dwrite da/d1d/f9f [0,4194304] 0 2024-04-25T02:27:13.135 INFO:tasks.workunit.client.0.smithi114.stdout:8/727: chown da/d69/d87/db4 30934513 1 2024-04-25T02:27:13.136 INFO:tasks.workunit.client.0.smithi114.stdout:9/696: rename d8/d16/d21/d37/l56 to d8/d16/d21/d83/d39/dab/le1 0 2024-04-25T02:27:13.137 INFO:tasks.workunit.client.0.smithi114.stdout:8/728: write da/d38/d62/d6d/d52/d6c/f8b [8834946,80716] 0 2024-04-25T02:27:13.137 INFO:tasks.workunit.client.0.smithi114.stdout:5/783: write d1/d6/f7b [957597,32923] 0 2024-04-25T02:27:13.138 INFO:tasks.workunit.client.0.smithi114.stdout:0/676: sync 2024-04-25T02:27:13.138 INFO:tasks.workunit.client.0.smithi114.stdout:7/774: truncate d5/d19/d1a/d80/f9f 2673693 0 2024-04-25T02:27:13.140 INFO:tasks.workunit.client.0.smithi114.stdout:8/729: chown da/d1d/f60 1069276315 1 2024-04-25T02:27:13.140 INFO:tasks.workunit.client.0.smithi114.stdout:1/707: dread df/d2a/d34/f63 [0,4194304] 0 2024-04-25T02:27:13.140 INFO:tasks.workunit.client.0.smithi114.stdout:4/620: rmdir d3/d8/d23 39 2024-04-25T02:27:13.141 INFO:tasks.workunit.client.0.smithi114.stdout:7/775: chown d5/d19/d1a/d80/lfa 643802 1 2024-04-25T02:27:13.142 INFO:tasks.workunit.client.0.smithi114.stdout:2/772: mkdir d5/daf/dda/de1/df9 0 2024-04-25T02:27:13.145 INFO:tasks.workunit.client.0.smithi114.stdout:6/826: symlink de/d2a/db9/dc7/l12a 0 2024-04-25T02:27:13.145 INFO:tasks.workunit.client.0.smithi114.stdout:9/697: dwrite d8/d16/d21/d83/d39/d38/d46/d53/da2/fc3 [4194304,4194304] 0 2024-04-25T02:27:13.147 INFO:tasks.workunit.client.0.smithi114.stdout:3/710: link d0/d25/fa1 d0/d5/d3d/ddc/ff8 0 2024-04-25T02:27:13.151 INFO:tasks.workunit.client.0.smithi114.stdout:4/621: write d3/d8/d23/d25/f2d [1093111,123585] 0 2024-04-25T02:27:13.152 INFO:tasks.workunit.client.0.smithi114.stdout:5/784: dwrite d1/d25/d24/f3b [0,4194304] 0 2024-04-25T02:27:13.155 INFO:tasks.workunit.client.0.smithi114.stdout:0/677: dread d1/d30/f75 [0,4194304] 0 2024-04-25T02:27:13.155 INFO:tasks.workunit.client.0.smithi114.stdout:2/773: fdatasync d5/df/d3d/d44/f56 0 2024-04-25T02:27:13.156 INFO:tasks.workunit.client.0.smithi114.stdout:9/698: creat d8/d16/d21/d83/d39/dab/fe2 x:0 0 0 2024-04-25T02:27:13.158 INFO:tasks.workunit.client.0.smithi114.stdout:4/622: dwrite d3/d14/f37 [0,4194304] 0 2024-04-25T02:27:13.163 INFO:tasks.workunit.client.0.smithi114.stdout:1/708: creat df/d2a/de9/ff1 x:0 0 0 2024-04-25T02:27:13.164 INFO:tasks.workunit.client.0.smithi114.stdout:0/678: mknod d1/d4/d37/d6a/db5/ccb 0 2024-04-25T02:27:13.166 INFO:tasks.workunit.client.0.smithi114.stdout:5/785: write d1/d3e/feb [169145,67283] 0 2024-04-25T02:27:13.166 INFO:tasks.workunit.client.0.smithi114.stdout:7/776: creat d5/ffc x:0 0 0 2024-04-25T02:27:13.169 INFO:tasks.workunit.client.0.smithi114.stdout:1/709: unlink df/d2a/de9/ff1 0 2024-04-25T02:27:13.171 INFO:tasks.workunit.client.0.smithi114.stdout:5/786: read d1/d6/de/d75/f84 [4067936,82374] 0 2024-04-25T02:27:13.172 INFO:tasks.workunit.client.0.smithi114.stdout:9/699: dwrite d8/d16/d21/d83/d39/f62 [0,4194304] 0 2024-04-25T02:27:13.175 INFO:tasks.workunit.client.0.smithi114.stdout:3/711: dwrite d0/d25/fa1 [0,4194304] 0 2024-04-25T02:27:13.175 INFO:tasks.workunit.client.0.smithi114.stdout:4/623: dwrite d3/d8/f1c [0,4194304] 0 2024-04-25T02:27:13.175 INFO:tasks.workunit.client.0.smithi114.stdout:1/710: creat df/d2a/ff2 x:0 0 0 2024-04-25T02:27:13.180 INFO:tasks.workunit.client.0.smithi114.stdout:5/787: mknod d1/d3e/d8e/de5/d82/c105 0 2024-04-25T02:27:13.181 INFO:tasks.workunit.client.0.smithi114.stdout:0/679: dwrite d1/d4/f19 [0,4194304] 0 2024-04-25T02:27:13.182 INFO:tasks.workunit.client.0.smithi114.stdout:8/730: dread da/d1d/fdc [0,4194304] 0 2024-04-25T02:27:13.185 INFO:tasks.workunit.client.0.smithi114.stdout:3/712: write d0/d25/d29/d85/d7e/da9/dad/de4/f37 [713336,1102] 0 2024-04-25T02:27:13.185 INFO:tasks.workunit.client.0.smithi114.stdout:7/777: dwrite d5/d32/d64/f86 [0,4194304] 0 2024-04-25T02:27:13.189 INFO:tasks.workunit.client.0.smithi114.stdout:1/711: dwrite df/d13/d44/d5a/dc9/d33/d47/d9d/fb6 [0,4194304] 0 2024-04-25T02:27:13.190 INFO:tasks.workunit.client.0.smithi114.stdout:5/788: rename d1/d6/de/l71 to d1/d6/d4f/l106 0 2024-04-25T02:27:13.193 INFO:tasks.workunit.client.0.smithi114.stdout:1/712: write df/d13/f60 [1922707,41251] 0 2024-04-25T02:27:13.195 INFO:tasks.workunit.client.0.smithi114.stdout:8/731: rename da/d32/lbd to da/d38/d62/d6d/d49/d65/dd0/le5 0 2024-04-25T02:27:13.196 INFO:tasks.workunit.client.0.smithi114.stdout:5/789: mknod d1/d25/d24/c107 0 2024-04-25T02:27:13.197 INFO:tasks.workunit.client.0.smithi114.stdout:4/624: link d3/d8/d30/d4c/d7f/cb7 d3/d8/d30/d93/cba 0 2024-04-25T02:27:13.199 INFO:tasks.workunit.client.0.smithi114.stdout:1/713: creat df/d2a/d34/d77/dc0/ff3 x:0 0 0 2024-04-25T02:27:13.200 INFO:tasks.workunit.client.0.smithi114.stdout:7/778: dwrite d5/d19/d23/f3f [4194304,4194304] 0 2024-04-25T02:27:13.201 INFO:tasks.workunit.client.0.smithi114.stdout:8/732: mknod da/d38/d62/d6d/d52/da8/db1/ce6 0 2024-04-25T02:27:13.205 INFO:tasks.workunit.client.0.smithi114.stdout:1/714: rename df/d13/d93/ced to df/d11/d7d/d92/da9/cf4 0 2024-04-25T02:27:13.207 INFO:tasks.workunit.client.0.smithi114.stdout:4/625: creat d3/d8/d12/d19/d26/d3e/d62/fbb x:0 0 0 2024-04-25T02:27:13.215 INFO:tasks.workunit.client.0.smithi114.stdout:1/715: dwrite df/f19 [8388608,4194304] 0 2024-04-25T02:27:13.215 INFO:tasks.workunit.client.0.smithi114.stdout:4/626: getdents d3/d8/d23/d25/d31/d33 0 2024-04-25T02:27:13.215 INFO:tasks.workunit.client.0.smithi114.stdout:8/733: dwrite da/d69/d93/d40/f45 [4194304,4194304] 0 2024-04-25T02:27:13.217 INFO:tasks.workunit.client.0.smithi114.stdout:4/627: dread - d3/d8/d23/f99 zero size 2024-04-25T02:27:13.219 INFO:tasks.workunit.client.0.smithi114.stdout:3/713: dread d0/d25/d29/d60/f65 [0,4194304] 0 2024-04-25T02:27:13.223 INFO:tasks.workunit.client.0.smithi114.stdout:4/628: creat d3/fbc x:0 0 0 2024-04-25T02:27:13.227 INFO:tasks.workunit.client.0.smithi114.stdout:5/790: read d1/d3e/feb [97540,19734] 0 2024-04-25T02:27:13.228 INFO:tasks.workunit.client.0.smithi114.stdout:5/791: chown d1/d25/da1/df7 11626 1 2024-04-25T02:27:13.230 INFO:tasks.workunit.client.0.smithi114.stdout:4/629: dwrite d3/d8/d12/d19/d26/d3e/daa/fa3 [0,4194304] 0 2024-04-25T02:27:13.232 INFO:tasks.workunit.client.0.smithi114.stdout:4/630: write d3/d8/d12/d19/d42/d58/f90 [1814256,117540] 0 2024-04-25T02:27:13.232 INFO:tasks.workunit.client.0.smithi114.stdout:3/714: fsync d0/d25/d29/d85/d7e/da9/dad/de4/f37 0 2024-04-25T02:27:13.233 INFO:tasks.workunit.client.0.smithi114.stdout:5/792: unlink d1/c46 0 2024-04-25T02:27:13.233 INFO:tasks.workunit.client.0.smithi114.stdout:4/631: write d3/d14/d6c/fb2 [705555,46020] 0 2024-04-25T02:27:13.239 INFO:tasks.workunit.client.0.smithi114.stdout:9/700: dread d8/d16/d21/d37/d43/f7b [0,4194304] 0 2024-04-25T02:27:13.239 INFO:tasks.workunit.client.0.smithi114.stdout:9/701: write d8/d16/d21/d37/d60/d70/fc6 [1270609,101691] 0 2024-04-25T02:27:13.240 INFO:tasks.workunit.client.0.smithi114.stdout:9/702: truncate d8/d16/d21/d83/d39/d38/d46/d53/da2/fd0 386567 0 2024-04-25T02:27:13.241 INFO:tasks.workunit.client.0.smithi114.stdout:5/793: symlink d1/d3e/d8e/de5/d82/l108 0 2024-04-25T02:27:13.243 INFO:tasks.workunit.client.0.smithi114.stdout:8/734: read da/d38/d62/d6d/f51 [2104812,127779] 0 2024-04-25T02:27:13.245 INFO:tasks.workunit.client.0.smithi114.stdout:3/715: getdents d0/d5/d3d/da6 0 2024-04-25T02:27:13.245 INFO:tasks.workunit.client.0.smithi114.stdout:5/794: fsync d1/d6/de/f44 0 2024-04-25T02:27:13.246 INFO:tasks.workunit.client.0.smithi114.stdout:8/735: rmdir da/d38/d62/d6d/d52/da8 39 2024-04-25T02:27:13.247 INFO:tasks.workunit.client.0.smithi114.stdout:3/716: mkdir d0/d25/da0/df9 0 2024-04-25T02:27:13.248 INFO:tasks.workunit.client.0.smithi114.stdout:5/795: symlink d1/d3e/d8e/de5/dde/l109 0 2024-04-25T02:27:13.250 INFO:tasks.workunit.client.0.smithi114.stdout:9/703: dread d8/d16/f3f [0,4194304] 0 2024-04-25T02:27:13.250 INFO:tasks.workunit.client.0.smithi114.stdout:5/796: creat d1/d6/de/da7/ddf/f10a x:0 0 0 2024-04-25T02:27:13.252 INFO:tasks.workunit.client.0.smithi114.stdout:9/704: read d8/fb [1637942,60794] 0 2024-04-25T02:27:13.253 INFO:tasks.workunit.client.0.smithi114.stdout:3/717: dwrite d0/d25/d29/d60/da8/dc8/fe2 [4194304,4194304] 0 2024-04-25T02:27:13.254 INFO:tasks.workunit.client.0.smithi114.stdout:7/779: fsync d5/d32/d64/f86 0 2024-04-25T02:27:13.254 INFO:tasks.workunit.client.0.smithi114.stdout:5/797: mkdir d1/d25/da1/d10b 0 2024-04-25T02:27:13.256 INFO:tasks.workunit.client.0.smithi114.stdout:3/718: write d0/d5/fed [119328,37357] 0 2024-04-25T02:27:13.256 INFO:tasks.workunit.client.0.smithi114.stdout:9/705: mknod d8/d16/d21/d83/d66/ce3 0 2024-04-25T02:27:13.257 INFO:tasks.workunit.client.0.smithi114.stdout:7/780: chown d5/d32/d4a/lab 184 1 2024-04-25T02:27:13.259 INFO:tasks.workunit.client.0.smithi114.stdout:5/798: read d1/d6/d4f/f52 [2484041,70074] 0 2024-04-25T02:27:13.259 INFO:tasks.workunit.client.0.smithi114.stdout:3/719: dread d0/d25/fb7 [0,4194304] 0 2024-04-25T02:27:13.260 INFO:tasks.workunit.client.0.smithi114.stdout:9/706: chown d8/d16/d21/f41 1058034 1 2024-04-25T02:27:13.261 INFO:tasks.workunit.client.0.smithi114.stdout:9/707: chown d8/d16/d21/d37/d60 609 1 2024-04-25T02:27:13.262 INFO:tasks.workunit.client.0.smithi114.stdout:5/799: mkdir d1/d3e/d8e/d94/d10c 0 2024-04-25T02:27:13.265 INFO:tasks.workunit.client.0.smithi114.stdout:3/720: mkdir d0/d5/d3d/dd7/dfa 0 2024-04-25T02:27:13.266 INFO:tasks.workunit.client.0.smithi114.stdout:5/800: creat d1/d6/d1a/d7f/dd9/f10d x:0 0 0 2024-04-25T02:27:13.267 INFO:tasks.workunit.client.0.smithi114.stdout:3/721: write d0/d5/d3d/f66 [1033311,81752] 0 2024-04-25T02:27:13.268 INFO:tasks.workunit.client.0.smithi114.stdout:9/708: creat d8/d16/d21/d83/d39/d38/fe4 x:0 0 0 2024-04-25T02:27:13.270 INFO:tasks.workunit.client.0.smithi114.stdout:3/722: unlink d0/d5/l6d 0 2024-04-25T02:27:13.271 INFO:tasks.workunit.client.0.smithi114.stdout:9/709: symlink d8/d16/d21/dbe/le5 0 2024-04-25T02:27:13.273 INFO:tasks.workunit.client.0.smithi114.stdout:6/827: sync 2024-04-25T02:27:13.273 INFO:tasks.workunit.client.0.smithi114.stdout:2/774: sync 2024-04-25T02:27:13.274 INFO:tasks.workunit.client.0.smithi114.stdout:5/801: dwrite d1/d6/d1a/f2f [0,4194304] 0 2024-04-25T02:27:13.274 INFO:tasks.workunit.client.0.smithi114.stdout:4/632: truncate d3/d8/d12/d19/d26/d3e/daa/fa3 3571772 0 2024-04-25T02:27:13.275 INFO:tasks.workunit.client.0.smithi114.stdout:7/781: dread d5/d19/d23/f3c [0,4194304] 0 2024-04-25T02:27:13.277 INFO:tasks.workunit.client.0.smithi114.stdout:6/828: write de/d25/dad/f109 [1032137,47253] 0 2024-04-25T02:27:13.279 INFO:tasks.workunit.client.0.smithi114.stdout:3/723: rename d0/d25/d29/d60/da8/cef to d0/d25/d29/d78/cfb 0 2024-04-25T02:27:13.279 INFO:tasks.workunit.client.0.smithi114.stdout:9/710: rmdir d8/d16/d21/d83/d39/d38/d46/d53/da2 39 2024-04-25T02:27:13.280 INFO:tasks.workunit.client.0.smithi114.stdout:8/736: dread da/d32/f39 [0,4194304] 0 2024-04-25T02:27:13.281 INFO:tasks.workunit.client.0.smithi114.stdout:5/802: unlink d1/d25/da1/d8a/da8/fb3 0 2024-04-25T02:27:13.282 INFO:tasks.workunit.client.0.smithi114.stdout:1/716: dwrite df/d11/f24 [0,4194304] 0 2024-04-25T02:27:13.283 INFO:tasks.workunit.client.0.smithi114.stdout:8/737: truncate da/ff 5110262 0 2024-04-25T02:27:13.285 INFO:tasks.workunit.client.0.smithi114.stdout:9/711: symlink d8/le6 0 2024-04-25T02:27:13.286 INFO:tasks.workunit.client.0.smithi114.stdout:6/829: symlink de/d27/d34/d4b/d102/l12b 0 2024-04-25T02:27:13.286 INFO:tasks.workunit.client.0.smithi114.stdout:3/724: truncate d0/d5/d3d/f40 588263 0 2024-04-25T02:27:13.287 INFO:tasks.workunit.client.0.smithi114.stdout:7/782: dread d5/d43/d4e/f9c [0,4194304] 0 2024-04-25T02:27:13.287 INFO:tasks.workunit.client.0.smithi114.stdout:1/717: rmdir df/d11/d7d/d92/da9 39 2024-04-25T02:27:13.328 INFO:tasks.workunit.client.0.smithi114.stdout:8/738: symlink da/d38/d62/d6d/d49/d65/dd0/le7 0 2024-04-25T02:27:13.328 INFO:tasks.workunit.client.0.smithi114.stdout:6/830: mkdir de/d25/d39/d47/de7/d12c 0 2024-04-25T02:27:13.329 INFO:tasks.workunit.client.0.smithi114.stdout:1/718: symlink df/d13/d75/d8e/lf5 0 2024-04-25T02:27:13.329 INFO:tasks.workunit.client.0.smithi114.stdout:2/775: link d5/df/d3d/d44/c80 d5/df/d3d/d81/cfa 0 2024-04-25T02:27:13.330 INFO:tasks.workunit.client.0.smithi114.stdout:7/783: symlink d5/d8b/d99/ddb/lfd 0 2024-04-25T02:27:13.331 INFO:tasks.workunit.client.0.smithi114.stdout:6/831: dread - de/d27/d34/d38/fac zero size 2024-04-25T02:27:13.334 INFO:tasks.workunit.client.0.smithi114.stdout:7/784: write d5/d19/d1a/da4/fe6 [145508,117146] 0 2024-04-25T02:27:13.334 INFO:tasks.workunit.client.0.smithi114.stdout:1/719: dread - df/d13/d44/d5a/dc9/d33/d47/d74/fc3 zero size 2024-04-25T02:27:13.335 INFO:tasks.workunit.client.0.smithi114.stdout:2/776: truncate d5/d1c/d22/d67/db2/fb7 10206 0 2024-04-25T02:27:13.338 INFO:tasks.workunit.client.0.smithi114.stdout:9/712: dwrite d8/fb [0,4194304] 0 2024-04-25T02:27:13.339 INFO:tasks.workunit.client.0.smithi114.stdout:2/777: mkdir d5/df/dc9/dfb 0 2024-04-25T02:27:13.343 INFO:tasks.workunit.client.0.smithi114.stdout:1/720: dread df/d13/d75/db8/fa7 [0,4194304] 0 2024-04-25T02:27:13.343 INFO:tasks.workunit.client.0.smithi114.stdout:9/713: write d8/d16/d21/d83/d39/f62 [4783062,98877] 0 2024-04-25T02:27:13.343 INFO:tasks.workunit.client.0.smithi114.stdout:8/739: dread da/d1d/f1f [0,4194304] 0 2024-04-25T02:27:13.345 INFO:tasks.workunit.client.0.smithi114.stdout:4/633: dread d3/d8/d30/d4c/f69 [0,4194304] 0 2024-04-25T02:27:13.345 INFO:tasks.workunit.client.0.smithi114.stdout:2/778: write d5/d6/f55 [1242559,112979] 0 2024-04-25T02:27:13.346 INFO:tasks.workunit.client.0.smithi114.stdout:6/832: dwrite de/d25/d39/d47/f60 [0,4194304] 0 2024-04-25T02:27:13.346 INFO:tasks.workunit.client.0.smithi114.stdout:0/680: sync 2024-04-25T02:27:13.348 INFO:tasks.workunit.client.0.smithi114.stdout:8/740: dread - da/d38/d62/d6d/d49/d65/dd0/f5f zero size 2024-04-25T02:27:13.349 INFO:tasks.workunit.client.0.smithi114.stdout:0/681: stat d1/d4/d24/d52/f5f 0 2024-04-25T02:27:13.352 INFO:tasks.workunit.client.0.smithi114.stdout:6/833: mknod de/d27/d34/d4b/d102/c12d 0 2024-04-25T02:27:13.355 INFO:tasks.workunit.client.0.smithi114.stdout:8/741: rename da/d1d to da/d38/db6/de8 0 2024-04-25T02:27:13.356 INFO:tasks.workunit.client.0.smithi114.stdout:8/742: chown da/d38/d62/d6d/d52/d6c/f9a 7495 1 2024-04-25T02:27:13.357 INFO:tasks.workunit.client.0.smithi114.stdout:8/743: stat da/d38/d62/d6d/f51 0 2024-04-25T02:27:13.359 INFO:tasks.workunit.client.0.smithi114.stdout:6/834: write de/d25/d39/d47/d90/d93/d99/f10a [9257638,100440] 0 2024-04-25T02:27:13.360 INFO:tasks.workunit.client.0.smithi114.stdout:4/634: creat d3/d8/d23/d25/fbd x:0 0 0 2024-04-25T02:27:13.361 INFO:tasks.workunit.client.0.smithi114.stdout:7/785: dread d5/d32/d4a/d51/f96 [0,4194304] 0 2024-04-25T02:27:13.362 INFO:tasks.workunit.client.0.smithi114.stdout:4/635: fsync d3/d8/d12/d19/f1a 0 2024-04-25T02:27:13.365 INFO:tasks.workunit.client.0.smithi114.stdout:0/682: getdents d1/d7/d97 0 2024-04-25T02:27:13.368 INFO:tasks.workunit.client.0.smithi114.stdout:7/786: dread d5/d19/f45 [0,4194304] 0 2024-04-25T02:27:13.368 INFO:tasks.workunit.client.0.smithi114.stdout:4/636: creat d3/d8/d23/d25/d31/d33/fbe x:0 0 0 2024-04-25T02:27:13.369 INFO:tasks.workunit.client.0.smithi114.stdout:4/637: fsync d3/d8/d12/d19/d26/f7b 0 2024-04-25T02:27:13.370 INFO:tasks.workunit.client.0.smithi114.stdout:4/638: chown d3/d8/d12/d19/fb4 932 1 2024-04-25T02:27:13.371 INFO:tasks.workunit.client.0.smithi114.stdout:8/744: rename da/d38/db6/de8/f36 to da/d38/d62/d6d/d52/fe9 0 2024-04-25T02:27:13.373 INFO:tasks.workunit.client.0.smithi114.stdout:5/803: sync 2024-04-25T02:27:13.373 INFO:tasks.workunit.client.0.smithi114.stdout:3/725: sync 2024-04-25T02:27:13.374 INFO:tasks.workunit.client.0.smithi114.stdout:8/745: read da/d38/d62/d6d/d49/f7d [79292,3654] 0 2024-04-25T02:27:13.377 INFO:tasks.workunit.client.0.smithi114.stdout:1/721: dread fc [0,4194304] 0 2024-04-25T02:27:13.377 INFO:tasks.workunit.client.0.smithi114.stdout:6/835: rename de/d30 to de/d27/d34/d4b/d12e 0 2024-04-25T02:27:13.377 INFO:tasks.workunit.client.0.smithi114.stdout:2/779: dread d5/f15 [0,4194304] 0 2024-04-25T02:27:13.379 INFO:tasks.workunit.client.0.smithi114.stdout:4/639: dwrite d3/d8/d12/d19/d42/d58/f90 [0,4194304] 0 2024-04-25T02:27:13.379 INFO:tasks.workunit.client.0.smithi114.stdout:6/836: chown de/d25/dad/dde/c110 435 1 2024-04-25T02:27:13.380 INFO:tasks.workunit.client.0.smithi114.stdout:2/780: dread - d5/d1c/d22/d89/f93 zero size 2024-04-25T02:27:13.381 INFO:tasks.workunit.client.0.smithi114.stdout:4/640: stat d3/d8/d12/d19/d26/d3e/d62/l76 0 2024-04-25T02:27:13.382 INFO:tasks.workunit.client.0.smithi114.stdout:8/746: chown da/d38/d62/d6d/d49/d65/dd0/le5 26428616 1 2024-04-25T02:27:13.382 INFO:tasks.workunit.client.0.smithi114.stdout:9/714: write d8/d16/d21/d83/d39/d38/d5d/fb9 [541134,93755] 0 2024-04-25T02:27:13.384 INFO:tasks.workunit.client.0.smithi114.stdout:3/726: fdatasync d0/d5/d3d/f40 0 2024-04-25T02:27:13.385 INFO:tasks.workunit.client.0.smithi114.stdout:8/747: truncate da/d69/d93/d40/fa6 133920 0 2024-04-25T02:27:13.387 INFO:tasks.workunit.client.0.smithi114.stdout:0/683: rename d1/l64 to d1/d7/d68/d69/lcc 0 2024-04-25T02:27:13.391 INFO:tasks.workunit.client.0.smithi114.stdout:1/722: dwrite df/d11/fcf [0,4194304] 0 2024-04-25T02:27:13.391 INFO:tasks.workunit.client.0.smithi114.stdout:2/781: creat d5/d1c/d22/d89/ffc x:0 0 0 2024-04-25T02:27:13.392 INFO:tasks.workunit.client.0.smithi114.stdout:5/804: dread d1/f36 [0,4194304] 0 2024-04-25T02:27:13.394 INFO:tasks.workunit.client.0.smithi114.stdout:1/723: truncate df/d13/d44/d5a/dc9/d33/d47/d74/fae 714522 0 2024-04-25T02:27:13.394 INFO:tasks.workunit.client.0.smithi114.stdout:3/727: fsync d0/d25/d29/d85/f51 0 2024-04-25T02:27:13.395 INFO:tasks.workunit.client.0.smithi114.stdout:3/728: fdatasync d0/d25/d29/d85/d7e/da9/fb2 0 2024-04-25T02:27:13.396 INFO:tasks.workunit.client.0.smithi114.stdout:6/837: truncate de/d27/d34/d38/f42 1613605 0 2024-04-25T02:27:13.400 INFO:tasks.workunit.client.0.smithi114.stdout:7/787: rename d5/d32/d4a/d51/c85 to d5/d43/d4e/cfe 0 2024-04-25T02:27:13.401 INFO:tasks.workunit.client.0.smithi114.stdout:8/748: truncate da/d38/db6/de8/fa2 1647686 0 2024-04-25T02:27:13.403 INFO:tasks.workunit.client.0.smithi114.stdout:5/805: readlink d1/l48 0 2024-04-25T02:27:13.403 INFO:tasks.workunit.client.0.smithi114.stdout:7/788: read d5/d19/f2b [750390,16082] 0 2024-04-25T02:27:13.405 INFO:tasks.workunit.client.0.smithi114.stdout:1/724: readlink df/l5b 0 2024-04-25T02:27:13.406 INFO:tasks.workunit.client.0.smithi114.stdout:1/725: read - df/d13/d75/d8e/dd1/fe2 zero size 2024-04-25T02:27:13.407 INFO:tasks.workunit.client.0.smithi114.stdout:6/838: chown de/d25/d39/cdd 60263375 1 2024-04-25T02:27:13.408 INFO:tasks.workunit.client.0.smithi114.stdout:4/641: link d3/d8/l7c d3/d14/d6c/lbf 0 2024-04-25T02:27:13.408 INFO:tasks.workunit.client.0.smithi114.stdout:4/642: chown d3/d8/d30/d4c/d7f/db6 1333797442 1 2024-04-25T02:27:13.409 INFO:tasks.workunit.client.0.smithi114.stdout:2/782: mkdir d5/df/d2c/dfd 0 2024-04-25T02:27:13.411 INFO:tasks.workunit.client.0.smithi114.stdout:9/715: dread d8/d16/d21/d37/d60/d70/f94 [8388608,4194304] 0 2024-04-25T02:27:13.412 INFO:tasks.workunit.client.0.smithi114.stdout:7/789: write d5/d32/d4a/d51/ff3 [141668,84909] 0 2024-04-25T02:27:13.413 INFO:tasks.workunit.client.0.smithi114.stdout:1/726: creat df/d2a/de9/ff6 x:0 0 0 2024-04-25T02:27:13.413 INFO:tasks.workunit.client.0.smithi114.stdout:7/790: write d5/d32/d4a/d87/fb4 [283733,112481] 0 2024-04-25T02:27:13.416 INFO:tasks.workunit.client.0.smithi114.stdout:4/643: symlink d3/d14/lc0 0 2024-04-25T02:27:13.418 INFO:tasks.workunit.client.0.smithi114.stdout:0/684: chown d1/d4/da/d33/c92 9 1 2024-04-25T02:27:13.418 INFO:tasks.workunit.client.0.smithi114.stdout:1/727: unlink df/d13/f83 0 2024-04-25T02:27:13.419 INFO:tasks.workunit.client.0.smithi114.stdout:7/791: mkdir d5/d32/d64/dff 0 2024-04-25T02:27:13.421 INFO:tasks.workunit.client.0.smithi114.stdout:3/729: rename d0/d25/d29/fbe to d0/d25/d29/d85/ffc 0 2024-04-25T02:27:13.422 INFO:tasks.workunit.client.0.smithi114.stdout:9/716: creat d8/d16/d21/d83/d39/d38/d5d/dd3/fe7 x:0 0 0 2024-04-25T02:27:13.422 INFO:tasks.workunit.client.0.smithi114.stdout:6/839: dwrite de/d25/d39/f51 [4194304,4194304] 0 2024-04-25T02:27:13.423 INFO:tasks.workunit.client.0.smithi114.stdout:4/644: symlink d3/d8/d12/d19/d42/lc1 0 2024-04-25T02:27:13.430 INFO:tasks.workunit.client.0.smithi114.stdout:3/730: stat d0/d5/c11 0 2024-04-25T02:27:13.431 INFO:tasks.workunit.client.0.smithi114.stdout:8/749: rename da/d38/d62/d6d/f56 to da/d1e/dcd/fea 0 2024-04-25T02:27:13.432 INFO:tasks.workunit.client.0.smithi114.stdout:2/783: dwrite d5/d1c/d21/ff7 [0,4194304] 0 2024-04-25T02:27:13.432 INFO:tasks.workunit.client.0.smithi114.stdout:1/728: truncate df/d13/d1e/da2/fd3 306785 0 2024-04-25T02:27:13.433 INFO:tasks.workunit.client.0.smithi114.stdout:6/840: chown de/d27/d34/d4b/f7c 124 1 2024-04-25T02:27:13.437 INFO:tasks.workunit.client.0.smithi114.stdout:7/792: link d5/d43/d63/f84 d5/dbf/f100 0 2024-04-25T02:27:13.437 INFO:tasks.workunit.client.0.smithi114.stdout:6/841: stat de/d2a/f3a 0 2024-04-25T02:27:13.438 INFO:tasks.workunit.client.0.smithi114.stdout:0/685: dwrite d1/d4/f19 [8388608,4194304] 0 2024-04-25T02:27:13.443 INFO:tasks.workunit.client.0.smithi114.stdout:9/717: unlink d8/d16/d21/d83/d39/d38/d46/d53/f5e 0 2024-04-25T02:27:13.443 INFO:tasks.workunit.client.0.smithi114.stdout:1/729: write df/d13/d75/d8e/dd1/fd8 [454274,104347] 0 2024-04-25T02:27:13.443 INFO:tasks.workunit.client.0.smithi114.stdout:2/784: mknod d5/daf/dda/de1/cfe 0 2024-04-25T02:27:13.443 INFO:tasks.workunit.client.0.smithi114.stdout:8/750: truncate da/d38/db6/de8/f92 819952 0 2024-04-25T02:27:13.443 INFO:tasks.workunit.client.0.smithi114.stdout:8/751: read da/d1e/f96 [4508752,105040] 0 2024-04-25T02:27:13.444 INFO:tasks.workunit.client.0.smithi114.stdout:5/806: rename d1/d6/lb7 to d1/d3e/d8e/de5/l10e 0 2024-04-25T02:27:13.448 INFO:tasks.workunit.client.0.smithi114.stdout:0/686: read d1/d30/d4d/f4e [883546,114290] 0 2024-04-25T02:27:13.451 INFO:tasks.workunit.client.0.smithi114.stdout:6/842: dwrite de/d2a/f2b [0,4194304] 0 2024-04-25T02:27:13.453 INFO:tasks.workunit.client.0.smithi114.stdout:8/752: dwrite da/d69/d87/d8d/fc0 [0,4194304] 0 2024-04-25T02:27:13.453 INFO:tasks.workunit.client.0.smithi114.stdout:9/718: creat d8/d16/d21/d83/d39/fe8 x:0 0 0 2024-04-25T02:27:13.457 INFO:tasks.workunit.client.0.smithi114.stdout:5/807: dwrite d1/d6/d1a/d7f/f87 [0,4194304] 0 2024-04-25T02:27:13.459 INFO:tasks.workunit.client.0.smithi114.stdout:8/753: mkdir da/d69/d93/deb 0 2024-04-25T02:27:13.460 INFO:tasks.workunit.client.0.smithi114.stdout:8/754: write da/d1e/f96 [267984,62224] 0 2024-04-25T02:27:13.460 INFO:tasks.workunit.client.0.smithi114.stdout:9/719: mknod d8/d16/d21/d24/d69/ce9 0 2024-04-25T02:27:13.461 INFO:tasks.workunit.client.0.smithi114.stdout:9/720: truncate d8/fb 4765702 0 2024-04-25T02:27:13.463 INFO:tasks.workunit.client.0.smithi114.stdout:8/755: read da/d38/db6/de8/fdc [118008,64904] 0 2024-04-25T02:27:13.465 INFO:tasks.workunit.client.0.smithi114.stdout:0/687: getdents d1/d30 0 2024-04-25T02:27:13.466 INFO:tasks.workunit.client.0.smithi114.stdout:5/808: getdents d1/d25/da1/daa 0 2024-04-25T02:27:13.467 INFO:tasks.workunit.client.0.smithi114.stdout:5/809: write d1/d6/de/d75/fc4 [380257,48529] 0 2024-04-25T02:27:13.469 INFO:tasks.workunit.client.0.smithi114.stdout:8/756: stat da/d69/d93/c5d 0 2024-04-25T02:27:13.470 INFO:tasks.workunit.client.0.smithi114.stdout:0/688: symlink d1/d4/d4f/da9/lcd 0 2024-04-25T02:27:13.473 INFO:tasks.workunit.client.0.smithi114.stdout:5/810: rename d1/d6/de/c5d to d1/d3e/d8e/de5/d82/d8f/c10f 0 2024-04-25T02:27:13.474 INFO:tasks.workunit.client.0.smithi114.stdout:5/811: stat d1/d6/d1a/d7f/fe9 0 2024-04-25T02:27:13.476 INFO:tasks.workunit.client.0.smithi114.stdout:4/645: dread d3/d8/d23/d25/f66 [0,4194304] 0 2024-04-25T02:27:13.476 INFO:tasks.workunit.client.0.smithi114.stdout:9/721: link d8/d16/d21/f9f d8/d16/d21/d83/d39/d38/fea 0 2024-04-25T02:27:13.477 INFO:tasks.workunit.client.0.smithi114.stdout:0/689: dwrite d1/d30/d4d/f65 [0,4194304] 0 2024-04-25T02:27:13.477 INFO:tasks.workunit.client.0.smithi114.stdout:6/843: dread de/f1e [0,4194304] 0 2024-04-25T02:27:13.479 INFO:tasks.workunit.client.0.smithi114.stdout:8/757: creat da/d38/d62/d6d/d52/fec x:0 0 0 2024-04-25T02:27:13.480 INFO:tasks.workunit.client.0.smithi114.stdout:9/722: dread - d8/d16/d21/d37/d43/d75/da3/db0/fd2 zero size 2024-04-25T02:27:13.480 INFO:tasks.workunit.client.0.smithi114.stdout:5/812: fsync d1/d6/d4f/d6c/d88/f102 0 2024-04-25T02:27:13.480 INFO:tasks.workunit.client.0.smithi114.stdout:8/758: readlink da/d38/d62/d6d/d49/lad 0 2024-04-25T02:27:13.480 INFO:tasks.workunit.client.0.smithi114.stdout:3/731: truncate d0/d25/d29/fc6 242844 0 2024-04-25T02:27:13.481 INFO:tasks.workunit.client.0.smithi114.stdout:9/723: fdatasync d8/d16/d21/d83/f86 0 2024-04-25T02:27:13.483 INFO:tasks.workunit.client.0.smithi114.stdout:2/785: write d5/df/d3d/f69 [2036593,33520] 0 2024-04-25T02:27:13.484 INFO:tasks.workunit.client.0.smithi114.stdout:6/844: creat de/d27/d34/d38/dfc/f12f x:0 0 0 2024-04-25T02:27:13.485 INFO:tasks.workunit.client.0.smithi114.stdout:7/793: write d5/d19/d1a/d80/f9f [3103907,104645] 0 2024-04-25T02:27:13.486 INFO:tasks.workunit.client.0.smithi114.stdout:9/724: fdatasync d8/d16/d21/d83/d39/d38/d46/d53/fd6 0 2024-04-25T02:27:13.487 INFO:tasks.workunit.client.0.smithi114.stdout:2/786: write d5/d1c/d29/f5c [1472606,64103] 0 2024-04-25T02:27:13.489 INFO:tasks.workunit.client.0.smithi114.stdout:9/725: chown d8/d16/d21/dbe 73044753 1 2024-04-25T02:27:13.490 INFO:tasks.workunit.client.0.smithi114.stdout:1/730: dwrite fc [0,4194304] 0 2024-04-25T02:27:13.492 INFO:tasks.workunit.client.0.smithi114.stdout:7/794: mkdir d5/d8b/d99/d101 0 2024-04-25T02:27:13.492 INFO:tasks.workunit.client.0.smithi114.stdout:8/759: dwrite da/d69/faf [0,4194304] 0 2024-04-25T02:27:13.493 INFO:tasks.workunit.client.0.smithi114.stdout:3/732: mknod d0/cfd 0 2024-04-25T02:27:13.494 INFO:tasks.workunit.client.0.smithi114.stdout:9/726: write d8/fa [1347672,78055] 0 2024-04-25T02:27:13.496 INFO:tasks.workunit.client.0.smithi114.stdout:5/813: link d1/d6/de/f4a d1/d6/d4f/d6c/d88/db6/dc8/f110 0 2024-04-25T02:27:13.498 INFO:tasks.workunit.client.0.smithi114.stdout:1/731: mkdir df/d13/d93/df7 0 2024-04-25T02:27:13.498 INFO:tasks.workunit.client.0.smithi114.stdout:6/845: dwrite de/d2a/f104 [0,4194304] 0 2024-04-25T02:27:13.500 INFO:tasks.workunit.client.0.smithi114.stdout:7/795: mknod d5/d8b/c102 0 2024-04-25T02:27:13.502 INFO:tasks.workunit.client.0.smithi114.stdout:9/727: rmdir d8/d16/d21/d37/d43/d75 39 2024-04-25T02:27:13.503 INFO:tasks.workunit.client.0.smithi114.stdout:9/728: chown d8/d16/d21/d83 228823228 1 2024-04-25T02:27:13.503 INFO:tasks.workunit.client.0.smithi114.stdout:2/787: dread d5/d1c/d22/d67/db2/fb7 [0,4194304] 0 2024-04-25T02:27:13.506 INFO:tasks.workunit.client.0.smithi114.stdout:8/760: creat da/d38/d62/d6d/d49/d65/dd0/fed x:0 0 0 2024-04-25T02:27:13.511 INFO:tasks.workunit.client.0.smithi114.stdout:6/846: symlink de/d27/d34/d4b/l130 0 2024-04-25T02:27:13.511 INFO:tasks.workunit.client.0.smithi114.stdout:7/796: dread d5/d19/d1a/d80/f9f [0,4194304] 0 2024-04-25T02:27:13.512 INFO:tasks.workunit.client.0.smithi114.stdout:7/797: fdatasync d5/f65 0 2024-04-25T02:27:13.513 INFO:tasks.workunit.client.0.smithi114.stdout:6/847: truncate de/d25/d39/d47/fb7 155827 0 2024-04-25T02:27:13.515 INFO:tasks.workunit.client.0.smithi114.stdout:9/729: rename d8/le6 to d8/d16/d21/d83/d39/d38/d5d/leb 0 2024-04-25T02:27:13.540 INFO:tasks.workunit.client.0.smithi114.stdout:5/814: symlink d1/d25/da1/daa/l111 0 2024-04-25T02:27:13.541 INFO:tasks.workunit.client.0.smithi114.stdout:7/798: unlink d5/d19/d1a/da4/db3/lcb 0 2024-04-25T02:27:13.541 INFO:tasks.workunit.client.0.smithi114.stdout:4/646: dread d3/d8/d12/d19/d42/d58/f6b [0,4194304] 0 2024-04-25T02:27:13.542 INFO:tasks.workunit.client.0.smithi114.stdout:0/690: write d1/d30/f8e [611909,17689] 0 2024-04-25T02:27:13.544 INFO:tasks.workunit.client.0.smithi114.stdout:8/761: rename da/d32/f37 to da/d38/fee 0 2024-04-25T02:27:13.545 INFO:tasks.workunit.client.0.smithi114.stdout:6/848: symlink de/d27/d34/l131 0 2024-04-25T02:27:13.547 INFO:tasks.workunit.client.0.smithi114.stdout:8/762: readlink da/d69/d93/d6b/l8a 0 2024-04-25T02:27:13.547 INFO:tasks.workunit.client.0.smithi114.stdout:7/799: unlink d5/d32/d4a/d91/fce 0 2024-04-25T02:27:13.547 INFO:tasks.workunit.client.0.smithi114.stdout:0/691: write d1/f10 [4484061,53108] 0 2024-04-25T02:27:13.548 INFO:tasks.workunit.client.0.smithi114.stdout:4/647: unlink d3/d8/d12/d19/f74 0 2024-04-25T02:27:13.549 INFO:tasks.workunit.client.0.smithi114.stdout:3/733: dread d0/d25/d2a/f4e [0,4194304] 0 2024-04-25T02:27:13.549 INFO:tasks.workunit.client.0.smithi114.stdout:8/763: write da/d1e/f96 [3626220,3264] 0 2024-04-25T02:27:13.550 INFO:tasks.workunit.client.0.smithi114.stdout:1/732: rename df/d11/d7d/d92/da9/cb4 to df/d13/d6e/d97/dd6/cf8 0 2024-04-25T02:27:13.551 INFO:tasks.workunit.client.0.smithi114.stdout:3/734: write d0/d5/d3d/f75 [1775402,90686] 0 2024-04-25T02:27:13.557 INFO:tasks.workunit.client.0.smithi114.stdout:6/849: dwrite de/f1f [0,4194304] 0 2024-04-25T02:27:13.560 INFO:tasks.workunit.client.0.smithi114.stdout:8/764: creat da/d69/d93/d40/fef x:0 0 0 2024-04-25T02:27:13.561 INFO:tasks.workunit.client.0.smithi114.stdout:8/765: fsync da/d69/d93/d6b/fdb 0 2024-04-25T02:27:13.562 INFO:tasks.workunit.client.0.smithi114.stdout:9/730: dread d8/ff [4194304,4194304] 0 2024-04-25T02:27:13.562 INFO:tasks.workunit.client.0.smithi114.stdout:8/766: dread - da/d1e/f4e zero size 2024-04-25T02:27:13.563 INFO:tasks.workunit.client.0.smithi114.stdout:0/692: rename d1/d30/l53 to d1/d4/da/d39/da7/db9/lce 0 2024-04-25T02:27:13.569 INFO:tasks.workunit.client.0.smithi114.stdout:9/731: dwrite d8/d16/d21/d83/d39/d38/d46/d53/fd6 [0,4194304] 0 2024-04-25T02:27:13.570 INFO:tasks.workunit.client.0.smithi114.stdout:7/800: write d5/d19/d23/f3a [804742,56517] 0 2024-04-25T02:27:13.570 INFO:tasks.workunit.client.0.smithi114.stdout:1/733: mkdir df/d11/d7d/df9 0 2024-04-25T02:27:13.571 INFO:tasks.workunit.client.0.smithi114.stdout:2/788: sync 2024-04-25T02:27:13.572 INFO:tasks.workunit.client.0.smithi114.stdout:0/693: chown d1/d7/d68/f8d 0 1 2024-04-25T02:27:13.573 INFO:tasks.workunit.client.0.smithi114.stdout:2/789: write d5/df/f53 [7358855,24428] 0 2024-04-25T02:27:13.573 INFO:tasks.workunit.client.0.smithi114.stdout:5/815: link d1/d53/d55/l8b d1/d6/d4f/d6c/d88/db6/l112 0 2024-04-25T02:27:13.574 INFO:tasks.workunit.client.0.smithi114.stdout:2/790: dread - d5/df/d3d/d44/fe4 zero size 2024-04-25T02:27:13.574 INFO:tasks.workunit.client.0.smithi114.stdout:6/850: write de/d1c/df7/f101 [1275222,117333] 0 2024-04-25T02:27:13.575 INFO:tasks.workunit.client.0.smithi114.stdout:1/734: creat df/d2a/de9/ffa x:0 0 0 2024-04-25T02:27:13.577 INFO:tasks.workunit.client.0.smithi114.stdout:7/801: mkdir d5/d19/d1a/da4/db3/d103 0 2024-04-25T02:27:13.577 INFO:tasks.workunit.client.0.smithi114.stdout:4/648: dread d3/d8/d12/d19/d26/d3e/daa/f54 [0,4194304] 0 2024-04-25T02:27:13.579 INFO:tasks.workunit.client.0.smithi114.stdout:0/694: symlink d1/d7/lcf 0 2024-04-25T02:27:13.579 INFO:tasks.workunit.client.0.smithi114.stdout:5/816: truncate d1/d53/d55/f5e 2352715 0 2024-04-25T02:27:13.580 INFO:tasks.workunit.client.0.smithi114.stdout:0/695: write d1/d7/f28 [4422652,51451] 0 2024-04-25T02:27:13.580 INFO:tasks.workunit.client.0.smithi114.stdout:2/791: mknod d5/daf/dda/de1/cff 0 2024-04-25T02:27:13.581 INFO:tasks.workunit.client.0.smithi114.stdout:6/851: truncate de/d27/f4e 1619017 0 2024-04-25T02:27:13.581 INFO:tasks.workunit.client.0.smithi114.stdout:2/792: fsync d5/d6/d58/d5a/d3e/fd4 0 2024-04-25T02:27:13.582 INFO:tasks.workunit.client.0.smithi114.stdout:6/852: fdatasync de/d27/d34/d44/f80 0 2024-04-25T02:27:13.582 INFO:tasks.workunit.client.0.smithi114.stdout:2/793: chown d5/d1c/d21/dc3 16683 1 2024-04-25T02:27:13.582 INFO:tasks.workunit.client.0.smithi114.stdout:7/802: rmdir d5/d8b 39 2024-04-25T02:27:13.584 INFO:tasks.workunit.client.0.smithi114.stdout:7/803: readlink d5/d19/d1a/d80/lc1 0 2024-04-25T02:27:13.585 INFO:tasks.workunit.client.0.smithi114.stdout:3/735: getdents d0/d25/d29/d85/d7e/da9/dad 0 2024-04-25T02:27:13.586 INFO:tasks.workunit.client.0.smithi114.stdout:7/804: readlink d5/d32/d4a/d91/lcf 0 2024-04-25T02:27:13.588 INFO:tasks.workunit.client.0.smithi114.stdout:0/696: dwrite d1/d7/fd [0,4194304] 0 2024-04-25T02:27:13.588 INFO:tasks.workunit.client.0.smithi114.stdout:7/805: chown d5/c4c 2193925 1 2024-04-25T02:27:13.592 INFO:tasks.workunit.client.0.smithi114.stdout:6/853: dwrite de/ff [0,4194304] 0 2024-04-25T02:27:13.593 INFO:tasks.workunit.client.0.smithi114.stdout:8/767: write da/d38/d62/d6d/d52/da8/db1/fca [1508639,119174] 0 2024-04-25T02:27:13.596 INFO:tasks.workunit.client.0.smithi114.stdout:8/768: write da/d38/f75 [37407,63038] 0 2024-04-25T02:27:13.596 INFO:tasks.workunit.client.0.smithi114.stdout:3/736: creat d0/d25/d29/d85/d7e/da9/dad/de4/ffe x:0 0 0 2024-04-25T02:27:13.596 INFO:tasks.workunit.client.0.smithi114.stdout:3/737: chown d0/d25/d29/d78/ca3 2830 1 2024-04-25T02:27:13.597 INFO:tasks.workunit.client.0.smithi114.stdout:0/697: rename d1/d30/d4d/f5b to d1/d4/d24/d52/fd0 0 2024-04-25T02:27:13.601 INFO:tasks.workunit.client.0.smithi114.stdout:5/817: rmdir d1 39 2024-04-25T02:27:13.602 INFO:tasks.workunit.client.0.smithi114.stdout:0/698: dwrite d1/f10 [0,4194304] 0 2024-04-25T02:27:13.605 INFO:tasks.workunit.client.0.smithi114.stdout:0/699: write d1/d4/d37/d6a/db5/fc4 [223725,76309] 0 2024-04-25T02:27:13.605 INFO:tasks.workunit.client.0.smithi114.stdout:0/700: chown d1/d7/d18/d2e/d8f/f61 41 1 2024-04-25T02:27:13.607 INFO:tasks.workunit.client.0.smithi114.stdout:8/769: symlink da/d38/db6/lf0 0 2024-04-25T02:27:13.607 INFO:tasks.workunit.client.0.smithi114.stdout:4/649: write d3/d8/d12/d19/d42/d58/f6b [2391216,30641] 0 2024-04-25T02:27:13.608 INFO:tasks.workunit.client.0.smithi114.stdout:2/794: link d5/df/d1e/f38 d5/f100 0 2024-04-25T02:27:13.608 INFO:tasks.workunit.client.0.smithi114.stdout:8/770: write da/d38/d62/d6d/d52/da8/da9/dd2/fd8 [52096,25515] 0 2024-04-25T02:27:13.609 INFO:tasks.workunit.client.0.smithi114.stdout:5/818: stat d1/d6/de/d75/fb9 0 2024-04-25T02:27:13.609 INFO:tasks.workunit.client.0.smithi114.stdout:1/735: link df/d13/d44/d5a/dc9/d33/d47/d74/c8f df/d13/d6e/d97/dd6/d82/de8/cfb 0 2024-04-25T02:27:13.610 INFO:tasks.workunit.client.0.smithi114.stdout:0/701: symlink d1/d7/d68/ld1 0 2024-04-25T02:27:13.611 INFO:tasks.workunit.client.0.smithi114.stdout:0/702: chown d1/d4/da/d33/l6b 242257960 1 2024-04-25T02:27:13.611 INFO:tasks.workunit.client.0.smithi114.stdout:4/650: stat d3/d8/d23/d25/c78 0 2024-04-25T02:27:13.612 INFO:tasks.workunit.client.0.smithi114.stdout:4/651: readlink d3/d8/d12/d19/d42/lc1 0 2024-04-25T02:27:13.613 INFO:tasks.workunit.client.0.smithi114.stdout:1/736: unlink df/d13/d44/d5a/dc9/d33/fce 0 2024-04-25T02:27:13.616 INFO:tasks.workunit.client.0.smithi114.stdout:8/771: read da/d38/fee [1541954,112850] 0 2024-04-25T02:27:13.616 INFO:tasks.workunit.client.0.smithi114.stdout:3/738: rename d0/d25/fa1 to d0/d25/d2a/fff 0 2024-04-25T02:27:13.630 INFO:tasks.workunit.client.0.smithi114.stdout:9/732: sync 2024-04-25T02:27:13.633 INFO:tasks.workunit.client.0.smithi114.stdout:2/795: mknod d5/c101 0 2024-04-25T02:27:13.633 INFO:tasks.workunit.client.0.smithi114.stdout:4/652: truncate d3/d8/f57 327678 0 2024-04-25T02:27:13.634 INFO:tasks.workunit.client.0.smithi114.stdout:3/739: write d0/d25/d2a/d34/f7d [1725537,104716] 0 2024-04-25T02:27:13.635 INFO:tasks.workunit.client.0.smithi114.stdout:1/737: mknod df/d11/d7d/d92/dd4/cfc 0 2024-04-25T02:27:13.637 INFO:tasks.workunit.client.0.smithi114.stdout:9/733: chown d8/d16/d21/d83/f86 1 1 2024-04-25T02:27:13.638 INFO:tasks.workunit.client.0.smithi114.stdout:4/653: write d3/f92 [3761643,50645] 0 2024-04-25T02:27:13.640 INFO:tasks.workunit.client.0.smithi114.stdout:3/740: mknod d0/d25/da0/c100 0 2024-04-25T02:27:13.647 INFO:tasks.workunit.client.0.smithi114.stdout:3/741: rmdir d0 39 2024-04-25T02:27:13.647 INFO:tasks.workunit.client.0.smithi114.stdout:6/854: dwrite de/d27/d34/d4b/d12e/f43 [4194304,4194304] 0 2024-04-25T02:27:13.647 INFO:tasks.workunit.client.0.smithi114.stdout:8/772: dwrite da/d38/d62/d6d/d52/d6c/fba [0,4194304] 0 2024-04-25T02:27:13.648 INFO:tasks.workunit.client.0.smithi114.stdout:1/738: dread df/d11/fcf [0,4194304] 0 2024-04-25T02:27:13.652 INFO:tasks.workunit.client.0.smithi114.stdout:9/734: creat d8/d16/d21/d37/fec x:0 0 0 2024-04-25T02:27:13.652 INFO:tasks.workunit.client.0.smithi114.stdout:8/773: symlink da/d69/d87/d8d/lf1 0 2024-04-25T02:27:13.654 INFO:tasks.workunit.client.0.smithi114.stdout:0/703: dread d1/d4/d24/f5e [0,4194304] 0 2024-04-25T02:27:13.655 INFO:tasks.workunit.client.0.smithi114.stdout:3/742: creat d0/d25/d29/d85/d7e/f101 x:0 0 0 2024-04-25T02:27:13.657 INFO:tasks.workunit.client.0.smithi114.stdout:7/806: sync 2024-04-25T02:27:13.659 INFO:tasks.workunit.client.0.smithi114.stdout:6/855: dwrite de/d27/d34/d44/fcc [0,4194304] 0 2024-04-25T02:27:13.659 INFO:tasks.workunit.client.0.smithi114.stdout:2/796: dread d5/d6/d31/d6a/f7f [0,4194304] 0 2024-04-25T02:27:13.660 INFO:tasks.workunit.client.0.smithi114.stdout:0/704: mkdir d1/d4/d62/d83/da0/dd2 0 2024-04-25T02:27:13.661 INFO:tasks.workunit.client.0.smithi114.stdout:3/743: write d0/d25/d2a/f9b [1553760,121794] 0 2024-04-25T02:27:13.663 INFO:tasks.workunit.client.0.smithi114.stdout:7/807: creat d5/d43/d4e/dec/f104 x:0 0 0 2024-04-25T02:27:13.664 INFO:tasks.workunit.client.0.smithi114.stdout:8/774: rename da/d38/d62/d6d/d52/da8/da9/dd2 to da/d38/d62/d6d/d52/da8/da9/df2 0 2024-04-25T02:27:13.665 INFO:tasks.workunit.client.0.smithi114.stdout:1/739: dwrite df/d13/d44/d5a/dc9/d33/f58 [0,4194304] 0 2024-04-25T02:27:13.666 INFO:tasks.workunit.client.0.smithi114.stdout:1/740: read - df/d2a/fbf zero size 2024-04-25T02:27:13.668 INFO:tasks.workunit.client.0.smithi114.stdout:9/735: rename d8/d16/d21/dbe/fd4 to d8/d16/d21/d37/d43/d75/da3/db0/fed 0 2024-04-25T02:27:13.668 INFO:tasks.workunit.client.0.smithi114.stdout:6/856: symlink de/d27/d34/dff/l132 0 2024-04-25T02:27:13.670 INFO:tasks.workunit.client.0.smithi114.stdout:0/705: dread - d1/d4/da/d3e/fbb zero size 2024-04-25T02:27:13.670 INFO:tasks.workunit.client.0.smithi114.stdout:2/797: mknod d5/d1c/d21/dc3/c102 0 2024-04-25T02:27:13.671 INFO:tasks.workunit.client.0.smithi114.stdout:3/744: dread d0/d25/d29/d85/d7e/da9/dad/de4/f37 [0,4194304] 0 2024-04-25T02:27:13.671 INFO:tasks.workunit.client.0.smithi114.stdout:7/808: mknod d5/d19/d1a/d80/c105 0 2024-04-25T02:27:13.672 INFO:tasks.workunit.client.0.smithi114.stdout:8/775: write da/d1e/f3d [3584486,9172] 0 2024-04-25T02:27:13.672 INFO:tasks.workunit.client.0.smithi114.stdout:1/741: mknod df/d11/d7d/d92/dd4/cfd 0 2024-04-25T02:27:13.675 INFO:tasks.workunit.client.0.smithi114.stdout:6/857: rmdir de/d25/d39/d47/d90/d93/d99 39 2024-04-25T02:27:13.677 INFO:tasks.workunit.client.0.smithi114.stdout:2/798: write d5/df/d1e/f84 [345732,13562] 0 2024-04-25T02:27:13.678 INFO:tasks.workunit.client.0.smithi114.stdout:7/809: dwrite d5/d32/d64/fac [4194304,4194304] 0 2024-04-25T02:27:13.678 INFO:tasks.workunit.client.0.smithi114.stdout:3/745: creat d0/d25/d2a/d80/f102 x:0 0 0 2024-04-25T02:27:13.678 INFO:tasks.workunit.client.0.smithi114.stdout:6/858: read de/d25/d39/d47/fb7 [126000,121452] 0 2024-04-25T02:27:13.679 INFO:tasks.workunit.client.0.smithi114.stdout:1/742: truncate df/d2a/d34/f5c 1196716 0 2024-04-25T02:27:13.679 INFO:tasks.workunit.client.0.smithi114.stdout:2/799: stat d5/d1c/d22/cbe 0 2024-04-25T02:27:13.680 INFO:tasks.workunit.client.0.smithi114.stdout:6/859: chown de/d25/le6 77 1 2024-04-25T02:27:13.680 INFO:tasks.workunit.client.0.smithi114.stdout:0/706: mknod d1/cd3 0 2024-04-25T02:27:13.681 INFO:tasks.workunit.client.0.smithi114.stdout:8/776: mknod da/d38/d62/d6d/cf3 0 2024-04-25T02:27:13.682 INFO:tasks.workunit.client.0.smithi114.stdout:7/810: mkdir d5/d19/d1a/da4/db3/d106 0 2024-04-25T02:27:13.684 INFO:tasks.workunit.client.0.smithi114.stdout:2/800: creat d5/daf/dda/f103 x:0 0 0 2024-04-25T02:27:13.685 INFO:tasks.workunit.client.0.smithi114.stdout:4/654: write d3/d14/f65 [4896054,3265] 0 2024-04-25T02:27:13.688 INFO:tasks.workunit.client.0.smithi114.stdout:6/860: mkdir de/d27/d34/dff/d133 0 2024-04-25T02:27:13.688 INFO:tasks.workunit.client.0.smithi114.stdout:5/819: sync 2024-04-25T02:27:13.689 INFO:tasks.workunit.client.0.smithi114.stdout:8/777: creat da/d38/d62/d6d/d49/d65/dd0/ff4 x:0 0 0 2024-04-25T02:27:13.689 INFO:tasks.workunit.client.0.smithi114.stdout:6/861: read - de/d25/dad/f119 zero size 2024-04-25T02:27:13.691 INFO:tasks.workunit.client.0.smithi114.stdout:2/801: write d5/d1c/d22/d67/f6c [3665689,35769] 0 2024-04-25T02:27:13.691 INFO:tasks.workunit.client.0.smithi114.stdout:0/707: rmdir d1/d7/d68 39 2024-04-25T02:27:13.693 INFO:tasks.workunit.client.0.smithi114.stdout:1/743: dwrite df/d13/d6e/d97/dd6/f95 [0,4194304] 0 2024-04-25T02:27:13.694 INFO:tasks.workunit.client.0.smithi114.stdout:1/744: write df/d13/d75/d8e/fb9 [95593,88425] 0 2024-04-25T02:27:13.697 INFO:tasks.workunit.client.0.smithi114.stdout:8/778: creat da/d1e/ff5 x:0 0 0 2024-04-25T02:27:13.697 INFO:tasks.workunit.client.0.smithi114.stdout:8/779: chown da/d38/d62 3 1 2024-04-25T02:27:13.703 INFO:tasks.workunit.client.0.smithi114.stdout:2/802: mknod d5/d1c/d22/d89/c104 0 2024-04-25T02:27:13.704 INFO:tasks.workunit.client.0.smithi114.stdout:9/736: dread d8/d16/d21/d37/f3e [0,4194304] 0 2024-04-25T02:27:13.706 INFO:tasks.workunit.client.0.smithi114.stdout:8/780: rmdir da/d69/d87/d8d 39 2024-04-25T02:27:13.708 INFO:tasks.workunit.client.0.smithi114.stdout:6/862: mknod de/d25/d39/d47/d90/d93/c134 0 2024-04-25T02:27:13.709 INFO:tasks.workunit.client.0.smithi114.stdout:0/708: mkdir d1/d4/d24/d52/da2/dd4 0 2024-04-25T02:27:13.709 INFO:tasks.workunit.client.0.smithi114.stdout:0/709: truncate d1/d4/f86 869962 0 2024-04-25T02:27:13.710 INFO:tasks.workunit.client.0.smithi114.stdout:1/745: rename df/d2a/d34 to df/d13/d6e/d97/dd6/d82/de8/dfe 0 2024-04-25T02:27:13.710 INFO:tasks.workunit.client.0.smithi114.stdout:0/710: chown d1/d4/d4f/d77/fa6 7617655 1 2024-04-25T02:27:13.711 INFO:tasks.workunit.client.0.smithi114.stdout:3/746: getdents d0/d5/d3d/da6/dce/dd6 0 2024-04-25T02:27:13.724 INFO:tasks.workunit.client.0.smithi114.stdout:2/803: mkdir d5/d1c/d29/d105 0 2024-04-25T02:27:13.724 INFO:tasks.workunit.client.0.smithi114.stdout:4/655: getdents d3/d14/d6c 0 2024-04-25T02:27:13.726 INFO:tasks.workunit.client.0.smithi114.stdout:7/811: truncate d5/d32/d4a/d51/ff3 29321 0 2024-04-25T02:27:13.727 INFO:tasks.workunit.client.0.smithi114.stdout:3/747: write d0/d25/f2e [4865761,32700] 0 2024-04-25T02:27:13.727 INFO:tasks.workunit.client.0.smithi114.stdout:6/863: link de/d27/d34/dff/f10d de/d25/d39/d47/d90/f135 0 2024-04-25T02:27:13.727 INFO:tasks.workunit.client.0.smithi114.stdout:1/746: mknod df/d13/d6e/d97/dd6/d82/da6/cff 0 2024-04-25T02:27:13.729 INFO:tasks.workunit.client.0.smithi114.stdout:7/812: unlink d5/f65 0 2024-04-25T02:27:13.732 INFO:tasks.workunit.client.0.smithi114.stdout:3/748: creat d0/d25/d29/d78/f103 x:0 0 0 2024-04-25T02:27:13.737 INFO:tasks.workunit.client.0.smithi114.stdout:8/781: dread da/d32/f61 [0,4194304] 0 2024-04-25T02:27:13.738 INFO:tasks.workunit.client.0.smithi114.stdout:6/864: dwrite de/d27/d34/d4b/d102/f106 [0,4194304] 0 2024-04-25T02:27:13.738 INFO:tasks.workunit.client.0.smithi114.stdout:5/820: sync 2024-04-25T02:27:13.739 INFO:tasks.workunit.client.0.smithi114.stdout:8/782: dread - da/d38/fe4 zero size 2024-04-25T02:27:13.739 INFO:tasks.workunit.client.0.smithi114.stdout:0/711: truncate d1/d4/d62/d83/fa3 623778 0 2024-04-25T02:27:13.740 INFO:tasks.workunit.client.0.smithi114.stdout:2/804: dread d5/d6/d58/d5a/f4e [0,4194304] 0 2024-04-25T02:27:13.741 INFO:tasks.workunit.client.0.smithi114.stdout:3/749: creat d0/d25/d2a/d34/db6/f104 x:0 0 0 2024-04-25T02:27:13.741 INFO:tasks.workunit.client.0.smithi114.stdout:8/783: chown da/d38/db6/de8 741 1 2024-04-25T02:27:13.741 INFO:tasks.workunit.client.0.smithi114.stdout:7/813: link d5/d32/d64/ca8 d5/d32/da6/c107 0 2024-04-25T02:27:13.743 INFO:tasks.workunit.client.0.smithi114.stdout:0/712: creat d1/d4/d4f/d77/fd5 x:0 0 0 2024-04-25T02:27:13.744 INFO:tasks.workunit.client.0.smithi114.stdout:1/747: truncate df/d11/f28 2944786 0 2024-04-25T02:27:13.748 INFO:tasks.workunit.client.0.smithi114.stdout:3/750: symlink d0/d25/d29/d85/d7e/da9/dad/de4/l105 0 2024-04-25T02:27:13.748 INFO:tasks.workunit.client.0.smithi114.stdout:4/656: dread d3/d8/d12/d19/d26/f70 [0,4194304] 0 2024-04-25T02:27:13.749 INFO:tasks.workunit.client.0.smithi114.stdout:0/713: chown d1/d4/d37/d6a/db5/fca 1371 1 2024-04-25T02:27:13.749 INFO:tasks.workunit.client.0.smithi114.stdout:1/748: stat df/d13/d6e/d97/dd6/d82/da6 0 2024-04-25T02:27:13.751 INFO:tasks.workunit.client.0.smithi114.stdout:2/805: rename d5/d1c/d22/f28 to d5/daf/dda/de1/f106 0 2024-04-25T02:27:13.751 INFO:tasks.workunit.client.0.smithi114.stdout:6/865: dwrite de/d25/d39/d47/de7/f121 [0,4194304] 0 2024-04-25T02:27:13.753 INFO:tasks.workunit.client.0.smithi114.stdout:2/806: chown d5/d6/ld0 17 1 2024-04-25T02:27:13.754 INFO:tasks.workunit.client.0.smithi114.stdout:4/657: mknod d3/d14/cc2 0 2024-04-25T02:27:13.756 INFO:tasks.workunit.client.0.smithi114.stdout:7/814: getdents d5/d32/d4a/d51 0 2024-04-25T02:27:13.757 INFO:tasks.workunit.client.0.smithi114.stdout:8/784: dwrite da/d38/d62/d6d/d52/d6c/f8e [0,4194304] 0 2024-04-25T02:27:13.759 INFO:tasks.workunit.client.0.smithi114.stdout:4/658: fdatasync d3/d8/d12/d19/d26/d3e/d62/fbb 0 2024-04-25T02:27:13.761 INFO:tasks.workunit.client.0.smithi114.stdout:8/785: chown da/d38/d62/d6d/d49/d65/dd0/f5f 106076022 1 2024-04-25T02:27:13.762 INFO:tasks.workunit.client.0.smithi114.stdout:2/807: mknod d5/d1c/d22/d67/c107 0 2024-04-25T02:27:13.762 INFO:tasks.workunit.client.0.smithi114.stdout:1/749: dwrite df/d13/d44/d5a/dc9/d33/f53 [4194304,4194304] 0 2024-04-25T02:27:13.765 INFO:tasks.workunit.client.0.smithi114.stdout:7/815: creat d5/d43/d4e/dec/f108 x:0 0 0 2024-04-25T02:27:13.765 INFO:tasks.workunit.client.0.smithi114.stdout:8/786: truncate da/d32/fc8 916218 0 2024-04-25T02:27:13.768 INFO:tasks.workunit.client.0.smithi114.stdout:6/866: dread de/d27/d34/d4b/d102/d120/fe3 [0,4194304] 0 2024-04-25T02:27:13.768 INFO:tasks.workunit.client.0.smithi114.stdout:4/659: rename d3/d8/d23/c60 to d3/d8/d30/d4c/cc3 0 2024-04-25T02:27:13.769 INFO:tasks.workunit.client.0.smithi114.stdout:2/808: read d5/d6/d31/d6a/f88 [3682060,110913] 0 2024-04-25T02:27:13.770 INFO:tasks.workunit.client.0.smithi114.stdout:5/821: dwrite d1/d6/d4f/d6c/d88/db6/dc8/f110 [0,4194304] 0 2024-04-25T02:27:13.772 INFO:tasks.workunit.client.0.smithi114.stdout:3/751: link d0/d25/d2a/dc4/ff6 d0/d25/d29/d85/d7e/f106 0 2024-04-25T02:27:13.772 INFO:tasks.workunit.client.0.smithi114.stdout:1/750: dwrite fe [0,4194304] 0 2024-04-25T02:27:13.773 INFO:tasks.workunit.client.0.smithi114.stdout:7/816: truncate d5/d19/f2a 1600791 0 2024-04-25T02:27:13.781 INFO:tasks.workunit.client.0.smithi114.stdout:9/737: sync 2024-04-25T02:27:13.783 INFO:tasks.workunit.client.0.smithi114.stdout:6/867: rmdir de/d2a/db9 39 2024-04-25T02:27:13.784 INFO:tasks.workunit.client.0.smithi114.stdout:8/787: symlink da/d38/d62/d6d/d49/d65/dd0/lf6 0 2024-04-25T02:27:13.784 INFO:tasks.workunit.client.0.smithi114.stdout:5/822: mknod d1/d6/d4f/c113 0 2024-04-25T02:27:13.785 INFO:tasks.workunit.client.0.smithi114.stdout:3/752: read d0/d25/da0/fe1 [53284,46205] 0 2024-04-25T02:27:13.788 INFO:tasks.workunit.client.0.smithi114.stdout:1/751: dread fe [0,4194304] 0 2024-04-25T02:27:13.788 INFO:tasks.workunit.client.0.smithi114.stdout:2/809: rename d5/d1c/d29/f5c to d5/df/d2c/f108 0 2024-04-25T02:27:13.788 INFO:tasks.workunit.client.0.smithi114.stdout:1/752: dread - df/d2a/fbf zero size 2024-04-25T02:27:13.789 INFO:tasks.workunit.client.0.smithi114.stdout:8/788: mknod da/d69/d93/cf7 0 2024-04-25T02:27:13.789 INFO:tasks.workunit.client.0.smithi114.stdout:2/810: readlink d5/d6/d58/d5a/d3e/l4d 0 2024-04-25T02:27:13.790 INFO:tasks.workunit.client.0.smithi114.stdout:7/817: creat d5/d32/d64/dff/f109 x:0 0 0 2024-04-25T02:27:13.790 INFO:tasks.workunit.client.0.smithi114.stdout:2/811: write d5/d6/f55 [1191994,5760] 0 2024-04-25T02:27:13.791 INFO:tasks.workunit.client.0.smithi114.stdout:5/823: dread d1/d6/de/d75/fc4 [0,4194304] 0 2024-04-25T02:27:13.793 INFO:tasks.workunit.client.0.smithi114.stdout:9/738: mknod d8/d16/d21/d37/d43/d75/d8a/cee 0 2024-04-25T02:27:13.796 INFO:tasks.workunit.client.0.smithi114.stdout:1/753: rmdir df/d2a 39 2024-04-25T02:27:13.796 INFO:tasks.workunit.client.0.smithi114.stdout:1/754: dread - df/d13/d44/d5a/fd7 zero size 2024-04-25T02:27:13.797 INFO:tasks.workunit.client.0.smithi114.stdout:8/789: symlink da/d38/d62/d6d/d49/d65/lf8 0 2024-04-25T02:27:13.798 INFO:tasks.workunit.client.0.smithi114.stdout:7/818: mknod d5/d32/da6/db5/db9/c10a 0 2024-04-25T02:27:13.799 INFO:tasks.workunit.client.0.smithi114.stdout:9/739: dwrite d8/d16/d21/d83/d39/f62 [0,4194304] 0 2024-04-25T02:27:13.800 INFO:tasks.workunit.client.0.smithi114.stdout:5/824: fsync d1/d6/d1a/f64 0 2024-04-25T02:27:13.801 INFO:tasks.workunit.client.0.smithi114.stdout:9/740: write d8/d16/d21/d24/d69/faa [429033,101324] 0 2024-04-25T02:27:13.802 INFO:tasks.workunit.client.0.smithi114.stdout:3/753: rename d0/d25/d29/d60/c64 to d0/d25/da0/c107 0 2024-04-25T02:27:13.804 INFO:tasks.workunit.client.0.smithi114.stdout:1/755: mkdir df/d13/d6e/d97/d100 0 2024-04-25T02:27:13.804 INFO:tasks.workunit.client.0.smithi114.stdout:8/790: read da/d69/d93/f64 [6320029,18988] 0 2024-04-25T02:27:13.805 INFO:tasks.workunit.client.0.smithi114.stdout:0/714: sync 2024-04-25T02:27:13.806 INFO:tasks.workunit.client.0.smithi114.stdout:0/715: chown d1/d4/da 70450455 1 2024-04-25T02:27:13.806 INFO:tasks.workunit.client.0.smithi114.stdout:9/741: dwrite d8/d16/d21/d83/f86 [0,4194304] 0 2024-04-25T02:27:13.808 INFO:tasks.workunit.client.0.smithi114.stdout:7/819: symlink d5/d43/d63/d7a/l10b 0 2024-04-25T02:27:13.808 INFO:tasks.workunit.client.0.smithi114.stdout:7/820: chown d5/d60/cdd 435343644 1 2024-04-25T02:27:13.810 INFO:tasks.workunit.client.0.smithi114.stdout:5/825: mknod d1/d6/d4f/d6c/d88/db6/c114 0 2024-04-25T02:27:13.812 INFO:tasks.workunit.client.0.smithi114.stdout:3/754: symlink d0/d25/d29/d85/d7e/da9/dad/de4/dbb/l108 0 2024-04-25T02:27:13.814 INFO:tasks.workunit.client.0.smithi114.stdout:3/755: chown d0/d5/d3d/f75 1998 1 2024-04-25T02:27:13.816 INFO:tasks.workunit.client.0.smithi114.stdout:7/821: dwrite d5/d32/d4a/d87/f8a [0,4194304] 0 2024-04-25T02:27:13.819 INFO:tasks.workunit.client.0.smithi114.stdout:5/826: read d1/d6/f31 [3281650,92901] 0 2024-04-25T02:27:13.820 INFO:tasks.workunit.client.0.smithi114.stdout:2/812: getdents d5/d1c/d21/d91 0 2024-04-25T02:27:13.821 INFO:tasks.workunit.client.0.smithi114.stdout:2/813: stat d5/d6/d58/d5a/fc1 0 2024-04-25T02:27:13.824 INFO:tasks.workunit.client.0.smithi114.stdout:0/716: readlink d1/d30/d4d/l70 0 2024-04-25T02:27:13.825 INFO:tasks.workunit.client.0.smithi114.stdout:5/827: dread d1/d6/de/f4a [0,4194304] 0 2024-04-25T02:27:13.826 INFO:tasks.workunit.client.0.smithi114.stdout:5/828: fsync d1/d6/d4f/d6c/f80 0 2024-04-25T02:27:13.826 INFO:tasks.workunit.client.0.smithi114.stdout:9/742: symlink d8/d16/d21/d24/lef 0 2024-04-25T02:27:13.827 INFO:tasks.workunit.client.0.smithi114.stdout:5/829: stat d1/d3e/d8e/de5/dde 0 2024-04-25T02:27:13.828 INFO:tasks.workunit.client.0.smithi114.stdout:9/743: write d8/d16/d21/d37/d60/d70/fc6 [1150220,5362] 0 2024-04-25T02:27:13.829 INFO:tasks.workunit.client.0.smithi114.stdout:7/822: dread d5/f9 [0,4194304] 0 2024-04-25T02:27:13.829 INFO:tasks.workunit.client.0.smithi114.stdout:9/744: chown d8/d16/d21/d83/d39/d38/d46/ce0 28623 1 2024-04-25T02:27:13.830 INFO:tasks.workunit.client.0.smithi114.stdout:2/814: rename d5/d6/d58/d5a/d3e/l61 to d5/df/d3d/d81/l109 0 2024-04-25T02:27:13.831 INFO:tasks.workunit.client.0.smithi114.stdout:9/745: chown d8/d16/d21/d24/d3c/d40/c5b 455477586 1 2024-04-25T02:27:13.831 INFO:tasks.workunit.client.0.smithi114.stdout:2/815: chown d5/d1c/d22/f9e 525228816 1 2024-04-25T02:27:13.833 INFO:tasks.workunit.client.0.smithi114.stdout:6/868: dread de/d27/d34/d4b/f75 [0,4194304] 0 2024-04-25T02:27:13.833 INFO:tasks.workunit.client.0.smithi114.stdout:7/823: read d5/f83 [3440398,87055] 0 2024-04-25T02:27:13.835 INFO:tasks.workunit.client.0.smithi114.stdout:6/869: write de/d25/f7f [464407,62763] 0 2024-04-25T02:27:13.839 INFO:tasks.workunit.client.0.smithi114.stdout:9/746: dwrite d8/d16/d21/d24/f9d [0,4194304] 0 2024-04-25T02:27:13.841 INFO:tasks.workunit.client.0.smithi114.stdout:3/756: link d0/d5/d3d/f40 d0/d25/d29/d85/d7e/da9/f109 0 2024-04-25T02:27:13.844 INFO:tasks.workunit.client.0.smithi114.stdout:6/870: rename de/d27/c83 to de/d27/d34/d4b/d102/d120/c136 0 2024-04-25T02:27:13.846 INFO:tasks.workunit.client.0.smithi114.stdout:7/824: dread d5/d32/f2f [4194304,4194304] 0 2024-04-25T02:27:13.848 INFO:tasks.workunit.client.0.smithi114.stdout:0/717: getdents d1/d30/d4d/d9c 0 2024-04-25T02:27:13.849 INFO:tasks.workunit.client.0.smithi114.stdout:0/718: fsync d1/d30/d4d/f65 0 2024-04-25T02:27:13.853 INFO:tasks.workunit.client.0.smithi114.stdout:1/756: dwrite df/d13/d44/d5a/dc9/d33/f57 [0,4194304] 0 2024-04-25T02:27:13.853 INFO:tasks.workunit.client.0.smithi114.stdout:0/719: creat d1/d7/d18/d2e/d7e/fd6 x:0 0 0 2024-04-25T02:27:13.855 INFO:tasks.workunit.client.0.smithi114.stdout:0/720: readlink d1/d7/d18/d2e/l67 0 2024-04-25T02:27:13.856 INFO:tasks.workunit.client.0.smithi114.stdout:3/757: creat d0/d25/d29/d85/d7e/da9/f10a x:0 0 0 2024-04-25T02:27:13.860 INFO:tasks.workunit.client.0.smithi114.stdout:7/825: rename d5/c14 to d5/d8b/d99/ddb/c10c 0 2024-04-25T02:27:13.860 INFO:tasks.workunit.client.0.smithi114.stdout:7/826: fdatasync d5/d19/d23/d6f/f9b 0 2024-04-25T02:27:13.861 INFO:tasks.workunit.client.0.smithi114.stdout:1/757: creat df/d13/d6e/d97/dd6/d82/de8/f101 x:0 0 0 2024-04-25T02:27:13.862 INFO:tasks.workunit.client.0.smithi114.stdout:7/827: truncate d5/d60/fe2 928366 0 2024-04-25T02:27:13.863 INFO:tasks.workunit.client.0.smithi114.stdout:7/828: chown d5/d43/d4e/f4f 442272407 1 2024-04-25T02:27:13.863 INFO:tasks.workunit.client.0.smithi114.stdout:9/747: dread d8/da8/fbf [0,4194304] 0 2024-04-25T02:27:13.864 INFO:tasks.workunit.client.0.smithi114.stdout:3/758: chown d0/d25/d29/d78/le5 258264516 1 2024-04-25T02:27:13.865 INFO:tasks.workunit.client.0.smithi114.stdout:9/748: dread d8/d16/d21/d37/d43/d75/fc2 [0,4194304] 0 2024-04-25T02:27:13.867 INFO:tasks.workunit.client.0.smithi114.stdout:7/829: rmdir d5/d43/d4e/dec 39 2024-04-25T02:27:13.886 INFO:tasks.workunit.client.0.smithi114.stdout:4/660: sync 2024-04-25T02:27:13.891 INFO:tasks.workunit.client.0.smithi114.stdout:7/830: write d5/d32/d64/fac [6453578,129240] 0 2024-04-25T02:27:13.891 INFO:tasks.workunit.client.0.smithi114.stdout:3/759: creat d0/d5/d3d/ddc/f10b x:0 0 0 2024-04-25T02:27:13.891 INFO:tasks.workunit.client.0.smithi114.stdout:5/830: truncate d1/d6/de/d75/fb9 6229706 0 2024-04-25T02:27:13.891 INFO:tasks.workunit.client.0.smithi114.stdout:1/758: rename df/d13/d6e/d97/dd6/d82/de8/dfe/f5c to df/d13/d44/f102 0 2024-04-25T02:27:13.893 INFO:tasks.workunit.client.0.smithi114.stdout:7/831: stat d5/d32/d4a/lab 0 2024-04-25T02:27:13.894 INFO:tasks.workunit.client.0.smithi114.stdout:9/749: dwrite d8/fa [0,4194304] 0 2024-04-25T02:27:13.895 INFO:tasks.workunit.client.0.smithi114.stdout:0/721: getdents d1/d4/d24/d52 0 2024-04-25T02:27:13.897 INFO:tasks.workunit.client.0.smithi114.stdout:7/832: stat d5/d32/d4a/ff6 0 2024-04-25T02:27:13.898 INFO:tasks.workunit.client.0.smithi114.stdout:0/722: dread - d1/f2c zero size 2024-04-25T02:27:13.900 INFO:tasks.workunit.client.0.smithi114.stdout:5/831: mknod d1/d3e/d8e/de5/c115 0 2024-04-25T02:27:13.901 INFO:tasks.workunit.client.0.smithi114.stdout:5/832: fsync d1/d6/de/dbc/f9b 0 2024-04-25T02:27:13.902 INFO:tasks.workunit.client.0.smithi114.stdout:4/661: dwrite d3/d8/d30/d4c/d7f/d8d/f9c [0,4194304] 0 2024-04-25T02:27:13.904 INFO:tasks.workunit.client.0.smithi114.stdout:7/833: creat d5/d19/d1a/daf/f10d x:0 0 0 2024-04-25T02:27:13.907 INFO:tasks.workunit.client.0.smithi114.stdout:9/750: link d8/d16/d21/d37/f3e d8/d16/d21/d83/d39/d38/d46/d53/ff0 0 2024-04-25T02:27:13.908 INFO:tasks.workunit.client.0.smithi114.stdout:5/833: read d1/d25/f4e [3253084,37304] 0 2024-04-25T02:27:13.909 INFO:tasks.workunit.client.0.smithi114.stdout:9/751: dread - d8/d16/d21/d83/d39/d38/fea zero size 2024-04-25T02:27:13.909 INFO:tasks.workunit.client.0.smithi114.stdout:4/662: dwrite d3/d8/d12/f1e [0,4194304] 0 2024-04-25T02:27:13.913 INFO:tasks.workunit.client.0.smithi114.stdout:5/834: creat d1/d6/f116 x:0 0 0 2024-04-25T02:27:13.914 INFO:tasks.workunit.client.0.smithi114.stdout:7/834: dwrite d5/d19/d23/fe0 [0,4194304] 0 2024-04-25T02:27:13.915 INFO:tasks.workunit.client.0.smithi114.stdout:4/663: creat d3/d8/d23/fc4 x:0 0 0 2024-04-25T02:27:13.916 INFO:tasks.workunit.client.0.smithi114.stdout:5/835: write d1/d6/de/da7/ddf/fc2 [4565438,109920] 0 2024-04-25T02:27:13.917 INFO:tasks.workunit.client.0.smithi114.stdout:3/760: dread d0/d25/d2a/d34/f55 [0,4194304] 0 2024-04-25T02:27:13.917 INFO:tasks.workunit.client.0.smithi114.stdout:9/752: link d8/d16/d21/d37/d60/f89 d8/d16/d21/d37/d60/d70/ff1 0 2024-04-25T02:27:13.919 INFO:tasks.workunit.client.0.smithi114.stdout:4/664: unlink d3/d14/f37 0 2024-04-25T02:27:13.919 INFO:tasks.workunit.client.0.smithi114.stdout:4/665: chown d3/d8/d23/d25/d31 25 1 2024-04-25T02:27:13.922 INFO:tasks.workunit.client.0.smithi114.stdout:5/836: truncate d1/d6/d4f/f52 3825958 0 2024-04-25T02:27:13.925 INFO:tasks.workunit.client.0.smithi114.stdout:7/835: rename d5/d32/c40 to d5/d32/da6/db5/db9/c10e 0 2024-04-25T02:27:13.925 INFO:tasks.workunit.client.0.smithi114.stdout:3/761: dwrite d0/d25/d2a/d34/f55 [0,4194304] 0 2024-04-25T02:27:13.926 INFO:tasks.workunit.client.0.smithi114.stdout:9/753: mkdir d8/d16/d21/d24/df2 0 2024-04-25T02:27:13.927 INFO:tasks.workunit.client.0.smithi114.stdout:9/754: write d8/fb [2258047,107263] 0 2024-04-25T02:27:13.927 INFO:tasks.workunit.client.0.smithi114.stdout:4/666: symlink d3/d8/d12/d19/d26/d3e/daa/lc5 0 2024-04-25T02:27:13.928 INFO:tasks.workunit.client.0.smithi114.stdout:9/755: truncate d8/d16/d21/d24/f9d 4848819 0 2024-04-25T02:27:13.930 INFO:tasks.workunit.client.0.smithi114.stdout:7/836: chown d5/d43/d63/d7a/f9d 2 1 2024-04-25T02:27:13.930 INFO:tasks.workunit.client.0.smithi114.stdout:2/816: sync 2024-04-25T02:27:13.930 INFO:tasks.workunit.client.0.smithi114.stdout:8/791: sync 2024-04-25T02:27:13.931 INFO:tasks.workunit.client.0.smithi114.stdout:3/762: symlink d0/d5/d3d/da6/dce/l10c 0 2024-04-25T02:27:13.931 INFO:tasks.workunit.client.0.smithi114.stdout:1/759: dread df/f15 [0,4194304] 0 2024-04-25T02:27:13.932 INFO:tasks.workunit.client.0.smithi114.stdout:2/817: chown d5/d6/d58/d5a/d59/dad 10776925 1 2024-04-25T02:27:13.933 INFO:tasks.workunit.client.0.smithi114.stdout:4/667: getdents d3/d8/d30/d6e/da2 0 2024-04-25T02:27:13.934 INFO:tasks.workunit.client.0.smithi114.stdout:8/792: truncate da/d69/d93/d40/fa6 570931 0 2024-04-25T02:27:13.934 INFO:tasks.workunit.client.0.smithi114.stdout:9/756: read d8/da8/fb5 [133007,72711] 0 2024-04-25T02:27:13.934 INFO:tasks.workunit.client.0.smithi114.stdout:7/837: creat d5/d43/d4e/df2/f10f x:0 0 0 2024-04-25T02:27:13.935 INFO:tasks.workunit.client.0.smithi114.stdout:1/760: mknod df/d13/d6e/d97/dd6/d82/de8/c103 0 2024-04-25T02:27:13.937 INFO:tasks.workunit.client.0.smithi114.stdout:2/818: rename d5/c1a to d5/d1c/d22/d67/c10a 0 2024-04-25T02:27:13.938 INFO:tasks.workunit.client.0.smithi114.stdout:8/793: rmdir da/d69/d93/d6b/dbb 39 2024-04-25T02:27:13.938 INFO:tasks.workunit.client.0.smithi114.stdout:2/819: chown d5/d1c/d21/dc3 404924977 1 2024-04-25T02:27:13.939 INFO:tasks.workunit.client.0.smithi114.stdout:1/761: truncate df/d13/d6e/d97/dd6/fdd 491347 0 2024-04-25T02:27:13.941 INFO:tasks.workunit.client.0.smithi114.stdout:1/762: readlink l7 0 2024-04-25T02:27:13.942 INFO:tasks.workunit.client.0.smithi114.stdout:2/820: fdatasync d5/d1c/d21/db0/fd6 0 2024-04-25T02:27:13.942 INFO:tasks.workunit.client.0.smithi114.stdout:9/757: rename d8/d16/d21/d83/d39/d38/d46/d53/da2 to d8/d16/d21/d24/d69/df3 0 2024-04-25T02:27:13.943 INFO:tasks.workunit.client.0.smithi114.stdout:4/668: dwrite d3/d8/d12/d19/d42/d58/f6b [0,4194304] 0 2024-04-25T02:27:13.945 INFO:tasks.workunit.client.0.smithi114.stdout:8/794: dread - da/d69/d93/d6b/dbb/fcb zero size 2024-04-25T02:27:13.945 INFO:tasks.workunit.client.0.smithi114.stdout:7/838: dread d5/d19/d1a/d80/f9f [0,4194304] 0 2024-04-25T02:27:13.945 INFO:tasks.workunit.client.0.smithi114.stdout:2/821: fdatasync d5/d6/d58/d5a/d3e/f49 0 2024-04-25T02:27:13.947 INFO:tasks.workunit.client.0.smithi114.stdout:4/669: write d3/d8/d23/d25/d31/f59 [1897725,79219] 0 2024-04-25T02:27:13.949 INFO:tasks.workunit.client.0.smithi114.stdout:9/758: rename d8/fa to d8/d16/d21/d83/ff4 0 2024-04-25T02:27:13.950 INFO:tasks.workunit.client.0.smithi114.stdout:9/759: chown d8/d16/d21/d24/c50 310175152 1 2024-04-25T02:27:13.951 INFO:tasks.workunit.client.0.smithi114.stdout:9/760: stat d8/d16/d21/d83/d39/fe8 0 2024-04-25T02:27:13.956 INFO:tasks.workunit.client.0.smithi114.stdout:8/795: mkdir da/d38/d62/d6d/d52/da8/da9/df2/df9 0 2024-04-25T02:27:13.958 INFO:tasks.workunit.client.0.smithi114.stdout:9/761: creat d8/d16/d21/d37/d60/d70/ff5 x:0 0 0 2024-04-25T02:27:13.958 INFO:tasks.workunit.client.0.smithi114.stdout:5/837: write d1/d25/d24/f3f [5733218,30508] 0 2024-04-25T02:27:13.961 INFO:tasks.workunit.client.0.smithi114.stdout:4/670: fdatasync d3/f8e 0 2024-04-25T02:27:13.964 INFO:tasks.workunit.client.0.smithi114.stdout:3/763: dread d0/d5/d3d/ddc/ff8 [0,4194304] 0 2024-04-25T02:27:13.964 INFO:tasks.workunit.client.0.smithi114.stdout:4/671: truncate d3/d8/d12/d19/d26/fa7 859979 0 2024-04-25T02:27:13.964 INFO:tasks.workunit.client.0.smithi114.stdout:8/796: rename da/d38/d62/d6d/d52/da8/da9/df2/fd8 to da/d1e/ffa 0 2024-04-25T02:27:13.965 INFO:tasks.workunit.client.0.smithi114.stdout:9/762: fsync d8/d16/d21/d83/d39/d38/f80 0 2024-04-25T02:27:13.965 INFO:tasks.workunit.client.0.smithi114.stdout:7/839: link d5/d19/d23/d6f/l52 d5/d8b/d99/l110 0 2024-04-25T02:27:13.969 INFO:tasks.workunit.client.0.smithi114.stdout:3/764: creat d0/d5/d3d/da6/f10d x:0 0 0 2024-04-25T02:27:13.971 INFO:tasks.workunit.client.0.smithi114.stdout:4/672: mknod d3/d8/d23/d25/d4e/cc6 0 2024-04-25T02:27:13.971 INFO:tasks.workunit.client.0.smithi114.stdout:4/673: fdatasync d3/d8/d23/f99 0 2024-04-25T02:27:13.973 INFO:tasks.workunit.client.0.smithi114.stdout:6/871: sync 2024-04-25T02:27:13.973 INFO:tasks.workunit.client.0.smithi114.stdout:7/840: rename d5/d43/l8c to d5/d19/d1a/da4/l111 0 2024-04-25T02:27:13.975 INFO:tasks.workunit.client.0.smithi114.stdout:9/763: creat d8/d16/d21/d24/d69/df3/dd9/ff6 x:0 0 0 2024-04-25T02:27:13.975 INFO:tasks.workunit.client.0.smithi114.stdout:9/764: write d8/d16/d21/d83/f86 [736537,19294] 0 2024-04-25T02:27:13.979 INFO:tasks.workunit.client.0.smithi114.stdout:5/838: dread d1/d6/de/d75/f84 [0,4194304] 0 2024-04-25T02:27:13.980 INFO:tasks.workunit.client.0.smithi114.stdout:5/839: fsync d1/d3e/fdc 0 2024-04-25T02:27:13.980 INFO:tasks.workunit.client.0.smithi114.stdout:3/765: rename d0/d5/d3d/dc3 to d0/d25/d2a/d80/d10e 0 2024-04-25T02:27:13.981 INFO:tasks.workunit.client.0.smithi114.stdout:7/841: creat d5/d32/f112 x:0 0 0 2024-04-25T02:27:13.982 INFO:tasks.workunit.client.0.smithi114.stdout:1/763: truncate df/d13/d6e/d97/dd6/f95 2980599 0 2024-04-25T02:27:13.984 INFO:tasks.workunit.client.0.smithi114.stdout:8/797: rmdir da/d1e 39 2024-04-25T02:27:13.985 INFO:tasks.workunit.client.0.smithi114.stdout:6/872: dwrite de/d2a/db9/dc7/ffd [0,4194304] 0 2024-04-25T02:27:13.986 INFO:tasks.workunit.client.0.smithi114.stdout:6/873: chown de/d27/d34/l131 2244232 1 2024-04-25T02:27:13.989 INFO:tasks.workunit.client.0.smithi114.stdout:5/840: creat d1/d53/d55/db1/f117 x:0 0 0 2024-04-25T02:27:13.990 INFO:tasks.workunit.client.0.smithi114.stdout:4/674: dread d3/f92 [0,4194304] 0 2024-04-25T02:27:13.990 INFO:tasks.workunit.client.0.smithi114.stdout:3/766: mknod d0/d25/d29/d85/d7e/da9/dad/de4/dbb/c10f 0 2024-04-25T02:27:13.991 INFO:tasks.workunit.client.0.smithi114.stdout:1/764: mkdir df/d13/d75/d8e/d104 0 2024-04-25T02:27:13.995 INFO:tasks.workunit.client.0.smithi114.stdout:6/874: mknod de/d2a/db9/c137 0 2024-04-25T02:27:13.995 INFO:tasks.workunit.client.0.smithi114.stdout:6/875: chown de/d27/d34/d4b/d12e/l3b 203480320 1 2024-04-25T02:27:13.996 INFO:tasks.workunit.client.0.smithi114.stdout:5/841: stat d1/d3e/d8e/de5/l10e 0 2024-04-25T02:27:13.999 INFO:tasks.workunit.client.0.smithi114.stdout:0/723: sync 2024-04-25T02:27:14.000 INFO:tasks.workunit.client.0.smithi114.stdout:3/767: symlink d0/d5/d3d/l110 0 2024-04-25T02:27:14.004 INFO:tasks.workunit.client.0.smithi114.stdout:7/842: creat d5/d19/d23/f113 x:0 0 0 2024-04-25T02:27:14.007 INFO:tasks.workunit.client.0.smithi114.stdout:5/842: rename d1/d25/da1/d8a/la0 to d1/d6/d1a/l118 0 2024-04-25T02:27:14.008 INFO:tasks.workunit.client.0.smithi114.stdout:0/724: mkdir d1/d4/d4f/dd7 0 2024-04-25T02:27:14.010 INFO:tasks.workunit.client.0.smithi114.stdout:7/843: dwrite d5/d43/fc0 [0,4194304] 0 2024-04-25T02:27:14.012 INFO:tasks.workunit.client.0.smithi114.stdout:1/765: truncate f4 4820268 0 2024-04-25T02:27:14.014 INFO:tasks.workunit.client.0.smithi114.stdout:8/798: creat da/d69/d87/ffb x:0 0 0 2024-04-25T02:27:14.014 INFO:tasks.workunit.client.0.smithi114.stdout:6/876: fdatasync de/d27/d76/fd9 0 2024-04-25T02:27:14.018 INFO:tasks.workunit.client.0.smithi114.stdout:0/725: rename d1/d4/d4f/d77/fa6 to d1/d7/d97/fd8 0 2024-04-25T02:27:14.020 INFO:tasks.workunit.client.0.smithi114.stdout:7/844: unlink d5/d32/l7b 0 2024-04-25T02:27:14.022 INFO:tasks.workunit.client.0.smithi114.stdout:8/799: dread - da/d1e/f4e zero size 2024-04-25T02:27:14.023 INFO:tasks.workunit.client.0.smithi114.stdout:8/800: stat da/d69/d87/db4/cd1 0 2024-04-25T02:27:14.024 INFO:tasks.workunit.client.0.smithi114.stdout:7/845: dread d5/d32/f2f [4194304,4194304] 0 2024-04-25T02:27:14.025 INFO:tasks.workunit.client.0.smithi114.stdout:9/765: truncate d8/d16/d21/d24/f47 3241332 0 2024-04-25T02:27:14.028 INFO:tasks.workunit.client.0.smithi114.stdout:6/877: mkdir de/d27/d34/d138 0 2024-04-25T02:27:14.031 INFO:tasks.workunit.client.0.smithi114.stdout:6/878: write de/d2a/f104 [3293919,64216] 0 2024-04-25T02:27:14.032 INFO:tasks.workunit.client.0.smithi114.stdout:7/846: dwrite d5/d19/d1a/fb2 [0,4194304] 0 2024-04-25T02:27:14.035 INFO:tasks.workunit.client.0.smithi114.stdout:0/726: dwrite d1/d4/d24/f45 [0,4194304] 0 2024-04-25T02:27:14.037 INFO:tasks.workunit.client.0.smithi114.stdout:1/766: getdents df/d13/d44/d9b 0 2024-04-25T02:27:14.037 INFO:tasks.workunit.client.0.smithi114.stdout:4/675: truncate d3/d8/d23/d25/f2d 1083351 0 2024-04-25T02:27:14.038 INFO:tasks.workunit.client.0.smithi114.stdout:0/727: chown d1/d30/f8e 2 1 2024-04-25T02:27:14.039 INFO:tasks.workunit.client.0.smithi114.stdout:6/879: dread - de/d25/d39/fd1 zero size 2024-04-25T02:27:14.039 INFO:tasks.workunit.client.0.smithi114.stdout:6/880: stat de/d27/d34/d38/l84 0 2024-04-25T02:27:14.043 INFO:tasks.workunit.client.0.smithi114.stdout:9/766: getdents d8/d16/d21/d37/d60 0 2024-04-25T02:27:14.048 INFO:tasks.workunit.client.0.smithi114.stdout:3/768: truncate d0/d25/d29/d85/f50 1785834 0 2024-04-25T02:27:14.049 INFO:tasks.workunit.client.0.smithi114.stdout:2/822: sync 2024-04-25T02:27:14.049 INFO:tasks.workunit.client.0.smithi114.stdout:7/847: creat d5/d8b/d99/dae/f114 x:0 0 0 2024-04-25T02:27:14.050 INFO:tasks.workunit.client.0.smithi114.stdout:2/823: write d5/df/d3d/f5e [5035293,54706] 0 2024-04-25T02:27:14.055 INFO:tasks.workunit.client.0.smithi114.stdout:6/881: symlink de/d27/d34/d44/l139 0 2024-04-25T02:27:14.056 INFO:tasks.workunit.client.0.smithi114.stdout:3/769: creat d0/d25/d29/d85/d7e/da9/dad/f111 x:0 0 0 2024-04-25T02:27:14.057 INFO:tasks.workunit.client.0.smithi114.stdout:6/882: chown de/d2a/f104 555321 1 2024-04-25T02:27:14.057 INFO:tasks.workunit.client.0.smithi114.stdout:7/848: creat d5/d32/d4a/dbc/f115 x:0 0 0 2024-04-25T02:27:14.058 INFO:tasks.workunit.client.0.smithi114.stdout:2/824: creat d5/d6/d58/d5a/d3e/d54/f10b x:0 0 0 2024-04-25T02:27:14.059 INFO:tasks.workunit.client.0.smithi114.stdout:8/801: dwrite da/d69/d87/db4/f80 [4194304,4194304] 0 2024-04-25T02:27:14.060 INFO:tasks.workunit.client.0.smithi114.stdout:0/728: getdents d1/d30/d98 0 2024-04-25T02:27:14.060 INFO:tasks.workunit.client.0.smithi114.stdout:7/849: stat d5/d32/d4a/d87/fb4 0 2024-04-25T02:27:14.065 INFO:tasks.workunit.client.0.smithi114.stdout:0/729: mkdir d1/d4/d4f/d77/da1/dd9 0 2024-04-25T02:27:14.066 INFO:tasks.workunit.client.0.smithi114.stdout:6/883: dread de/d27/d34/d4b/f75 [0,4194304] 0 2024-04-25T02:27:14.069 INFO:tasks.workunit.client.0.smithi114.stdout:8/802: truncate da/d38/db6/de8/fa2 390198 0 2024-04-25T02:27:14.069 INFO:tasks.workunit.client.0.smithi114.stdout:7/850: dwrite d5/d19/d23/f113 [0,4194304] 0 2024-04-25T02:27:14.071 INFO:tasks.workunit.client.0.smithi114.stdout:2/825: mknod d5/d1c/d29/de0/df1/c10c 0 2024-04-25T02:27:14.071 INFO:tasks.workunit.client.0.smithi114.stdout:4/676: dread d3/d8/d23/d25/d31/f9e [0,4194304] 0 2024-04-25T02:27:14.074 INFO:tasks.workunit.client.0.smithi114.stdout:5/843: sync 2024-04-25T02:27:14.074 INFO:tasks.workunit.client.0.smithi114.stdout:2/826: write d5/df/d2c/fbd [4205342,93661] 0 2024-04-25T02:27:14.077 INFO:tasks.workunit.client.0.smithi114.stdout:9/767: dread d8/d16/d21/d37/d60/d70/ff1 [0,4194304] 0 2024-04-25T02:27:14.080 INFO:tasks.workunit.client.0.smithi114.stdout:0/730: mknod d1/d4/d62/d83/d84/cda 0 2024-04-25T02:27:14.080 INFO:tasks.workunit.client.0.smithi114.stdout:8/803: dwrite da/d69/d93/d6b/fc3 [0,4194304] 0 2024-04-25T02:27:14.082 INFO:tasks.workunit.client.0.smithi114.stdout:7/851: unlink d5/d43/d4e/dec/f108 0 2024-04-25T02:27:14.083 INFO:tasks.workunit.client.0.smithi114.stdout:1/767: dwrite df/d13/d44/d5a/dc9/f4c [0,4194304] 0 2024-04-25T02:27:14.084 INFO:tasks.workunit.client.0.smithi114.stdout:7/852: fdatasync d5/d60/fe2 0 2024-04-25T02:27:14.085 INFO:tasks.workunit.client.0.smithi114.stdout:7/853: fdatasync d5/d19/f34 0 2024-04-25T02:27:14.085 INFO:tasks.workunit.client.0.smithi114.stdout:4/677: write d3/d8/d12/d19/d26/f2a [4766975,97251] 0 2024-04-25T02:27:14.088 INFO:tasks.workunit.client.0.smithi114.stdout:9/768: rmdir d8/d16/d21/d37/d43/d75/d8a 39 2024-04-25T02:27:14.089 INFO:tasks.workunit.client.0.smithi114.stdout:3/770: write d0/d25/d29/d85/d7e/da9/f109 [404425,45513] 0 2024-04-25T02:27:14.091 INFO:tasks.workunit.client.0.smithi114.stdout:3/771: write d0/d25/d29/d85/d7e/da9/dad/f111 [295405,103499] 0 2024-04-25T02:27:14.091 INFO:tasks.workunit.client.0.smithi114.stdout:2/827: rename d5/d1c/d21/fa7 to d5/df/d3d/d44/dc0/dcd/f10d 0 2024-04-25T02:27:14.094 INFO:tasks.workunit.client.0.smithi114.stdout:0/731: mknod d1/d7/d18/cdb 0 2024-04-25T02:27:14.095 INFO:tasks.workunit.client.0.smithi114.stdout:0/732: dread - d1/d4/da/d33/f91 zero size 2024-04-25T02:27:14.095 INFO:tasks.workunit.client.0.smithi114.stdout:8/804: mkdir da/d38/db6/de8/dfc 0 2024-04-25T02:27:14.097 INFO:tasks.workunit.client.0.smithi114.stdout:5/844: symlink d1/l119 0 2024-04-25T02:27:14.098 INFO:tasks.workunit.client.0.smithi114.stdout:1/768: mkdir df/d13/d6e/d97/dd6/d105 0 2024-04-25T02:27:14.101 INFO:tasks.workunit.client.0.smithi114.stdout:4/678: mknod d3/d8/d12/d19/d42/d58/cc7 0 2024-04-25T02:27:14.103 INFO:tasks.workunit.client.0.smithi114.stdout:9/769: readlink d8/d16/d21/d24/d3c/lae 0 2024-04-25T02:27:14.104 INFO:tasks.workunit.client.0.smithi114.stdout:3/772: dread d0/d25/d29/d60/f65 [0,4194304] 0 2024-04-25T02:27:14.104 INFO:tasks.workunit.client.0.smithi114.stdout:8/805: truncate da/d38/f34 176420 0 2024-04-25T02:27:14.109 INFO:tasks.workunit.client.0.smithi114.stdout:6/884: dwrite de/f18 [0,4194304] 0 2024-04-25T02:27:14.110 INFO:tasks.workunit.client.0.smithi114.stdout:1/769: dwrite df/d13/d75/d8e/dd1/fe2 [0,4194304] 0 2024-04-25T02:27:14.111 INFO:tasks.workunit.client.0.smithi114.stdout:5/845: creat d1/d51/d6f/f11a x:0 0 0 2024-04-25T02:27:14.112 INFO:tasks.workunit.client.0.smithi114.stdout:6/885: read de/d2a/db9/dc7/ffd [2892113,91020] 0 2024-04-25T02:27:14.113 INFO:tasks.workunit.client.0.smithi114.stdout:0/733: getdents d1/d4/da/d39 0 2024-04-25T02:27:14.114 INFO:tasks.workunit.client.0.smithi114.stdout:8/806: mknod da/d69/d93/d40/cfd 0 2024-04-25T02:27:14.117 INFO:tasks.workunit.client.0.smithi114.stdout:1/770: truncate df/d13/d6e/d97/dd6/d82/de8/fef 517883 0 2024-04-25T02:27:14.117 INFO:tasks.workunit.client.0.smithi114.stdout:6/886: truncate de/d25/dad/fca 9254651 0 2024-04-25T02:27:14.119 INFO:tasks.workunit.client.0.smithi114.stdout:0/734: dread d1/d4/d24/f45 [0,4194304] 0 2024-04-25T02:27:14.132 INFO:tasks.workunit.client.0.smithi114.stdout:8/807: mkdir da/d38/db6/dfe 0 2024-04-25T02:27:14.133 INFO:tasks.workunit.client.0.smithi114.stdout:3/773: rename d0/d5/d3d/da6/dce/dd6/fe9 to d0/d5/d3d/ddc/f112 0 2024-04-25T02:27:14.133 INFO:tasks.workunit.client.0.smithi114.stdout:0/735: dwrite d1/d4/d37/d6a/db5/fca [0,4194304] 0 2024-04-25T02:27:14.134 INFO:tasks.workunit.client.0.smithi114.stdout:2/828: write d5/df/d3d/d44/f8f [1042307,92643] 0 2024-04-25T02:27:14.135 INFO:tasks.workunit.client.0.smithi114.stdout:6/887: truncate de/d27/f2d 733216 0 2024-04-25T02:27:14.135 INFO:tasks.workunit.client.0.smithi114.stdout:0/736: fdatasync d1/d7/d18/f51 0 2024-04-25T02:27:14.138 INFO:tasks.workunit.client.0.smithi114.stdout:3/774: mknod d0/d25/d2a/d80/c113 0 2024-04-25T02:27:14.140 INFO:tasks.workunit.client.0.smithi114.stdout:4/679: dread d3/d8/d12/d19/d26/d3e/daa/f54 [0,4194304] 0 2024-04-25T02:27:14.140 INFO:tasks.workunit.client.0.smithi114.stdout:8/808: mkdir da/d38/d62/d6d/dff 0 2024-04-25T02:27:14.141 INFO:tasks.workunit.client.0.smithi114.stdout:2/829: rmdir d5/df/d3d/d44/dc0 39 2024-04-25T02:27:14.142 INFO:tasks.workunit.client.0.smithi114.stdout:3/775: dread - d0/d25/d29/d85/d7e/f101 zero size 2024-04-25T02:27:14.142 INFO:tasks.workunit.client.0.smithi114.stdout:7/854: dwrite d5/f33 [0,4194304] 0 2024-04-25T02:27:14.142 INFO:tasks.workunit.client.0.smithi114.stdout:8/809: fsync da/d32/fc8 0 2024-04-25T02:27:14.145 INFO:tasks.workunit.client.0.smithi114.stdout:8/810: dread - da/d69/fb0 zero size 2024-04-25T02:27:14.145 INFO:tasks.workunit.client.0.smithi114.stdout:5/846: write d1/d6/de/f4a [3050020,33227] 0 2024-04-25T02:27:14.145 INFO:tasks.workunit.client.0.smithi114.stdout:4/680: dread - d3/d8/d30/d4c/fab zero size 2024-04-25T02:27:14.147 INFO:tasks.workunit.client.0.smithi114.stdout:3/776: dread - d0/d25/d29/d8c/fe3 zero size 2024-04-25T02:27:14.147 INFO:tasks.workunit.client.0.smithi114.stdout:0/737: creat d1/fdc x:0 0 0 2024-04-25T02:27:14.148 INFO:tasks.workunit.client.0.smithi114.stdout:2/830: rmdir d5/d1c/d21 39 2024-04-25T02:27:14.148 INFO:tasks.workunit.client.0.smithi114.stdout:7/855: chown d5/d32/da6/db5/fea 134603539 1 2024-04-25T02:27:14.149 INFO:tasks.workunit.client.0.smithi114.stdout:9/770: dwrite d8/d16/d21/d24/d3c/d40/f58 [0,4194304] 0 2024-04-25T02:27:14.150 INFO:tasks.workunit.client.0.smithi114.stdout:5/847: write d1/d6/d4f/d6c/d88/f102 [83551,57574] 0 2024-04-25T02:27:14.151 INFO:tasks.workunit.client.0.smithi114.stdout:3/777: write d0/d25/d29/d78/f103 [559707,89468] 0 2024-04-25T02:27:14.152 INFO:tasks.workunit.client.0.smithi114.stdout:8/811: unlink da/d1e/c20 0 2024-04-25T02:27:14.152 INFO:tasks.workunit.client.0.smithi114.stdout:7/856: write d5/d19/d23/f58 [1626476,21134] 0 2024-04-25T02:27:14.156 INFO:tasks.workunit.client.0.smithi114.stdout:8/812: read da/d69/f73 [3170703,78215] 0 2024-04-25T02:27:14.157 INFO:tasks.workunit.client.0.smithi114.stdout:4/681: creat d3/d8/d30/d93/fc8 x:0 0 0 2024-04-25T02:27:14.157 INFO:tasks.workunit.client.0.smithi114.stdout:9/771: dread d8/d16/d21/d24/d3c/d40/f58 [0,4194304] 0 2024-04-25T02:27:14.158 INFO:tasks.workunit.client.0.smithi114.stdout:8/813: read - da/d38/d62/d6d/d52/fec zero size 2024-04-25T02:27:14.160 INFO:tasks.workunit.client.0.smithi114.stdout:2/831: mknod d5/df/d3d/d44/dc0/dcd/c10e 0 2024-04-25T02:27:14.161 INFO:tasks.workunit.client.0.smithi114.stdout:5/848: dread d1/d6/de/da7/ddf/dc5/dfd/dc1/fca [0,4194304] 0 2024-04-25T02:27:14.162 INFO:tasks.workunit.client.0.smithi114.stdout:2/832: write d5/df/d3d/d44/fe4 [32623,43527] 0 2024-04-25T02:27:14.164 INFO:tasks.workunit.client.0.smithi114.stdout:7/857: unlink d5/d43/d4e/lca 0 2024-04-25T02:27:14.168 INFO:tasks.workunit.client.0.smithi114.stdout:9/772: symlink d8/d16/d21/d83/d39/d38/d46/d53/lf7 0 2024-04-25T02:27:14.169 INFO:tasks.workunit.client.0.smithi114.stdout:2/833: mknod d5/daf/c10f 0 2024-04-25T02:27:14.170 INFO:tasks.workunit.client.0.smithi114.stdout:5/849: mkdir d1/d6/d1a/d7f/d11b 0 2024-04-25T02:27:14.171 INFO:tasks.workunit.client.0.smithi114.stdout:9/773: read d8/fb [3941403,26322] 0 2024-04-25T02:27:14.172 INFO:tasks.workunit.client.0.smithi114.stdout:3/778: rename d0/d25/d2a/d80/dbd/ld9 to d0/d25/d29/d85/d7e/da9/l114 0 2024-04-25T02:27:14.173 INFO:tasks.workunit.client.0.smithi114.stdout:6/888: dread de/d27/d34/ff5 [0,4194304] 0 2024-04-25T02:27:14.174 INFO:tasks.workunit.client.0.smithi114.stdout:3/779: truncate d0/fa 5005308 0 2024-04-25T02:27:14.174 INFO:tasks.workunit.client.0.smithi114.stdout:0/738: write d1/d7/d18/d2e/d7e/f89 [5978873,105098] 0 2024-04-25T02:27:14.174 INFO:tasks.workunit.client.0.smithi114.stdout:1/771: sync 2024-04-25T02:27:14.175 INFO:tasks.workunit.client.0.smithi114.stdout:1/772: fdatasync df/d13/d75/f9c 0 2024-04-25T02:27:14.176 INFO:tasks.workunit.client.0.smithi114.stdout:5/850: dread d1/d6/d4f/d6c/d88/db6/dc8/f110 [0,4194304] 0 2024-04-25T02:27:14.176 INFO:tasks.workunit.client.0.smithi114.stdout:2/834: mknod d5/df/d3d/d83/c110 0 2024-04-25T02:27:14.176 INFO:tasks.workunit.client.0.smithi114.stdout:1/773: read df/f15 [2496118,63697] 0 2024-04-25T02:27:14.176 INFO:tasks.workunit.client.0.smithi114.stdout:2/835: readlink d5/df/d1e/l7d 0 2024-04-25T02:27:14.178 INFO:tasks.workunit.client.0.smithi114.stdout:9/774: chown d8/d16/d21/l25 87984 1 2024-04-25T02:27:14.180 INFO:tasks.workunit.client.0.smithi114.stdout:2/836: dread d5/df/d63/d8d/fa2 [0,4194304] 0 2024-04-25T02:27:14.182 INFO:tasks.workunit.client.0.smithi114.stdout:2/837: read - d5/df/d3d/d44/dc0/dcd/f10d zero size 2024-04-25T02:27:14.183 INFO:tasks.workunit.client.0.smithi114.stdout:2/838: truncate d5/d1c/d29/ff4 5207532 0 2024-04-25T02:27:14.184 INFO:tasks.workunit.client.0.smithi114.stdout:8/814: dwrite da/d1e/f29 [0,4194304] 0 2024-04-25T02:27:14.185 INFO:tasks.workunit.client.0.smithi114.stdout:5/851: dread d1/d6/f31 [4194304,4194304] 0 2024-04-25T02:27:14.186 INFO:tasks.workunit.client.0.smithi114.stdout:1/774: mkdir df/d13/d44/d5a/dc9/d43/d106 0 2024-04-25T02:27:14.187 INFO:tasks.workunit.client.0.smithi114.stdout:5/852: chown d1/d6/de/da7/ddf/dc5/dfd/dc1/fca 1101801973 1 2024-04-25T02:27:14.188 INFO:tasks.workunit.client.0.smithi114.stdout:4/682: rename d3/d8/d12/d19/d42/c7a to d3/d8/d12/d19/d26/d3e/daa/d89/da0/cc9 0 2024-04-25T02:27:14.191 INFO:tasks.workunit.client.0.smithi114.stdout:2/839: dwrite d5/daf/dda/f103 [0,4194304] 0 2024-04-25T02:27:14.192 INFO:tasks.workunit.client.0.smithi114.stdout:2/840: fdatasync d5/d6/d58/d5a/d3e/d54/f10b 0 2024-04-25T02:27:14.193 INFO:tasks.workunit.client.0.smithi114.stdout:8/815: stat da/d1e/f48 0 2024-04-25T02:27:14.193 INFO:tasks.workunit.client.0.smithi114.stdout:2/841: fdatasync d5/df/d3d/f5e 0 2024-04-25T02:27:14.194 INFO:tasks.workunit.client.0.smithi114.stdout:0/739: mknod d1/d4/d4f/dd7/cdd 0 2024-04-25T02:27:14.195 INFO:tasks.workunit.client.0.smithi114.stdout:8/816: truncate da/d38/d62/d6d/f7f 808603 0 2024-04-25T02:27:14.195 INFO:tasks.workunit.client.0.smithi114.stdout:0/740: fdatasync d1/d4/da/f73 0 2024-04-25T02:27:14.199 INFO:tasks.workunit.client.0.smithi114.stdout:7/858: rename d5/d19/d1a/da4/ca7 to d5/d19/d1a/d80/c116 0 2024-04-25T02:27:14.200 INFO:tasks.workunit.client.0.smithi114.stdout:5/853: dwrite d1/d51/d6f/fe4 [0,4194304] 0 2024-04-25T02:27:14.203 INFO:tasks.workunit.client.0.smithi114.stdout:1/775: mkdir df/d11/d7d/df9/d107 0 2024-04-25T02:27:14.203 INFO:tasks.workunit.client.0.smithi114.stdout:2/842: truncate d5/d6/d31/d6a/f88 3033977 0 2024-04-25T02:27:14.203 INFO:tasks.workunit.client.0.smithi114.stdout:8/817: dwrite da/d38/d62/d6d/d52/fec [0,4194304] 0 2024-04-25T02:27:14.204 INFO:tasks.workunit.client.0.smithi114.stdout:5/854: chown d1/d6/de/da7/ddf/dc5/dfd/lf5 2976 1 2024-04-25T02:27:14.205 INFO:tasks.workunit.client.0.smithi114.stdout:8/818: read - da/d69/d90/fe0 zero size 2024-04-25T02:27:14.205 INFO:tasks.workunit.client.0.smithi114.stdout:2/843: write d5/df/d63/fe7 [933263,66515] 0 2024-04-25T02:27:14.206 INFO:tasks.workunit.client.0.smithi114.stdout:0/741: symlink d1/d4/d62/lde 0 2024-04-25T02:27:14.206 INFO:tasks.workunit.client.0.smithi114.stdout:3/780: write d0/d25/d29/d85/f50 [2708933,41485] 0 2024-04-25T02:27:14.206 INFO:tasks.workunit.client.0.smithi114.stdout:5/855: fdatasync d1/d25/f1f 0 2024-04-25T02:27:14.207 INFO:tasks.workunit.client.0.smithi114.stdout:4/683: link d3/d8/d12/fb1 d3/d8/d30/d4c/d7f/fca 0 2024-04-25T02:27:14.208 INFO:tasks.workunit.client.0.smithi114.stdout:7/859: creat d5/d32/d4a/dbc/f117 x:0 0 0 2024-04-25T02:27:14.210 INFO:tasks.workunit.client.0.smithi114.stdout:7/860: dread - d5/d43/d4e/df2/ff5 zero size 2024-04-25T02:27:14.214 INFO:tasks.workunit.client.0.smithi114.stdout:0/742: write d1/d7/d68/f8d [534077,121281] 0 2024-04-25T02:27:14.216 INFO:tasks.workunit.client.0.smithi114.stdout:1/776: mkdir df/d11/d108 0 2024-04-25T02:27:14.216 INFO:tasks.workunit.client.0.smithi114.stdout:5/856: dwrite d1/d6/d1a/f57 [0,4194304] 0 2024-04-25T02:27:14.219 INFO:tasks.workunit.client.0.smithi114.stdout:4/684: dwrite d3/d8/d12/d19/d42/d58/f6b [0,4194304] 0 2024-04-25T02:27:14.223 INFO:tasks.workunit.client.0.smithi114.stdout:3/781: rename d0/d5/l35 to d0/d25/d2a/d34/l115 0 2024-04-25T02:27:14.224 INFO:tasks.workunit.client.0.smithi114.stdout:5/857: dwrite d1/d6/d4f/fbd [0,4194304] 0 2024-04-25T02:27:14.224 INFO:tasks.workunit.client.0.smithi114.stdout:0/743: mknod d1/d7/d18/d2e/d7e/cdf 0 2024-04-25T02:27:14.225 INFO:tasks.workunit.client.0.smithi114.stdout:1/777: mknod df/d13/d6e/c109 0 2024-04-25T02:27:14.226 INFO:tasks.workunit.client.0.smithi114.stdout:8/819: readlink da/d69/d93/d40/lb2 0 2024-04-25T02:27:14.227 INFO:tasks.workunit.client.0.smithi114.stdout:4/685: symlink d3/d8/d12/d19/d26/d3e/daa/d89/da0/lcb 0 2024-04-25T02:27:14.229 INFO:tasks.workunit.client.0.smithi114.stdout:5/858: mkdir d1/d25/da1/d8a/d11c 0 2024-04-25T02:27:14.229 INFO:tasks.workunit.client.0.smithi114.stdout:5/859: chown d1/d25/d24/c107 5066557 1 2024-04-25T02:27:14.230 INFO:tasks.workunit.client.0.smithi114.stdout:3/782: mknod d0/d25/d2a/dc4/c116 0 2024-04-25T02:27:14.230 INFO:tasks.workunit.client.0.smithi114.stdout:3/783: write d0/d25/da0/fab [3249375,24735] 0 2024-04-25T02:27:14.232 INFO:tasks.workunit.client.0.smithi114.stdout:8/820: creat da/d38/db6/de8/f100 x:0 0 0 2024-04-25T02:27:14.233 INFO:tasks.workunit.client.0.smithi114.stdout:8/821: write da/d38/db6/fd4 [2627456,127869] 0 2024-04-25T02:27:14.233 INFO:tasks.workunit.client.0.smithi114.stdout:4/686: fsync d3/f92 0 2024-04-25T02:27:14.234 INFO:tasks.workunit.client.0.smithi114.stdout:4/687: read - d3/d8/d12/d19/d26/d3e/daa/f83 zero size 2024-04-25T02:27:14.235 INFO:tasks.workunit.client.0.smithi114.stdout:1/778: symlink df/d13/d75/d8e/d104/l10a 0 2024-04-25T02:27:14.240 INFO:tasks.workunit.client.0.smithi114.stdout:6/889: sync 2024-04-25T02:27:14.240 INFO:tasks.workunit.client.0.smithi114.stdout:9/775: sync 2024-04-25T02:27:14.246 INFO:tasks.workunit.client.0.smithi114.stdout:7/861: rename d5/d19/d1a/da4/db3/fd8 to d5/d32/d4a/f118 0 2024-04-25T02:27:14.247 INFO:tasks.workunit.client.0.smithi114.stdout:0/744: creat d1/d4/da/fe0 x:0 0 0 2024-04-25T02:27:14.248 INFO:tasks.workunit.client.0.smithi114.stdout:4/688: write d3/d8/d12/d19/d42/d58/fa6 [65160,117766] 0 2024-04-25T02:27:14.249 INFO:tasks.workunit.client.0.smithi114.stdout:1/779: write df/d13/d44/d5a/dc9/d33/d47/d74/fc3 [374410,85063] 0 2024-04-25T02:27:14.251 INFO:tasks.workunit.client.0.smithi114.stdout:6/890: rename de/d27/d76/c8e to de/d25/dad/dde/c13a 0 2024-04-25T02:27:14.251 INFO:tasks.workunit.client.0.smithi114.stdout:7/862: dread d5/d60/f71 [0,4194304] 0 2024-04-25T02:27:14.253 INFO:tasks.workunit.client.0.smithi114.stdout:9/776: mkdir d8/d16/d21/d83/d39/d38/d46/d53/df8 0 2024-04-25T02:27:14.254 INFO:tasks.workunit.client.0.smithi114.stdout:6/891: fdatasync de/d27/d34/d4b/d12e/fe2 0 2024-04-25T02:27:14.255 INFO:tasks.workunit.client.0.smithi114.stdout:4/689: creat d3/d8/d96/fcc x:0 0 0 2024-04-25T02:27:14.257 INFO:tasks.workunit.client.0.smithi114.stdout:9/777: readlink d8/d16/d21/d24/d3c/d40/l61 0 2024-04-25T02:27:14.258 INFO:tasks.workunit.client.0.smithi114.stdout:0/745: dwrite d1/fdc [0,4194304] 0 2024-04-25T02:27:14.258 INFO:tasks.workunit.client.0.smithi114.stdout:1/780: mknod df/d13/d44/d5a/dc9/d43/d106/c10b 0 2024-04-25T02:27:14.263 INFO:tasks.workunit.client.0.smithi114.stdout:7/863: rename d5/d19/d1a/da4/lc5 to d5/d19/l119 0 2024-04-25T02:27:14.263 INFO:tasks.workunit.client.0.smithi114.stdout:7/864: chown d5/cd 8968 1 2024-04-25T02:27:14.263 INFO:tasks.workunit.client.0.smithi114.stdout:6/892: mknod de/d2a/dd5/c13b 0 2024-04-25T02:27:14.263 INFO:tasks.workunit.client.0.smithi114.stdout:6/893: write de/d25/d39/d47/f5d [3869897,4712] 0 2024-04-25T02:27:14.263 INFO:tasks.workunit.client.0.smithi114.stdout:4/690: rmdir d3/d8/d12/d19/d26/d3e/daa/d89 39 2024-04-25T02:27:14.265 INFO:tasks.workunit.client.0.smithi114.stdout:0/746: mknod d1/d4/d24/d52/ce1 0 2024-04-25T02:27:14.266 INFO:tasks.workunit.client.0.smithi114.stdout:2/844: dread d5/df/d63/fa8 [0,4194304] 0 2024-04-25T02:27:14.267 INFO:tasks.workunit.client.0.smithi114.stdout:6/894: dwrite de/d25/dad/f109 [0,4194304] 0 2024-04-25T02:27:14.268 INFO:tasks.workunit.client.0.smithi114.stdout:9/778: mknod d8/d16/d21/d83/d39/cf9 0 2024-04-25T02:27:14.273 INFO:tasks.workunit.client.0.smithi114.stdout:4/691: unlink d3/d8/d23/d25/f66 0 2024-04-25T02:27:14.273 INFO:tasks.workunit.client.0.smithi114.stdout:6/895: dwrite de/d1c/fda [0,4194304] 0 2024-04-25T02:27:14.274 INFO:tasks.workunit.client.0.smithi114.stdout:4/692: read d3/f92 [3571619,50058] 0 2024-04-25T02:27:14.275 INFO:tasks.workunit.client.0.smithi114.stdout:0/747: creat d1/d7/d97/fe2 x:0 0 0 2024-04-25T02:27:14.276 INFO:tasks.workunit.client.0.smithi114.stdout:1/781: mknod df/d11/d7d/d92/da9/de0/c10c 0 2024-04-25T02:27:14.280 INFO:tasks.workunit.client.0.smithi114.stdout:3/784: write d0/d25/d2a/dc4/ff6 [177295,95408] 0 2024-04-25T02:27:14.282 INFO:tasks.workunit.client.0.smithi114.stdout:4/693: creat d3/db9/fcd x:0 0 0 2024-04-25T02:27:14.285 INFO:tasks.workunit.client.0.smithi114.stdout:0/748: creat d1/d4/da/d39/da7/fe3 x:0 0 0 2024-04-25T02:27:14.285 INFO:tasks.workunit.client.0.smithi114.stdout:6/896: dwrite de/d27/d34/d38/dfc/f10f [0,4194304] 0 2024-04-25T02:27:14.285 INFO:tasks.workunit.client.0.smithi114.stdout:1/782: symlink df/d13/d44/d5a/dc9/d43/l10d 0 2024-04-25T02:27:14.287 INFO:tasks.workunit.client.0.smithi114.stdout:8/822: dwrite da/d38/d62/d6d/d49/d65/dd0/f91 [0,4194304] 0 2024-04-25T02:27:14.287 INFO:tasks.workunit.client.0.smithi114.stdout:4/694: write d3/d14/d6c/fb2 [664829,126918] 0 2024-04-25T02:27:14.288 INFO:tasks.workunit.client.0.smithi114.stdout:9/779: dwrite d8/d16/d21/d83/ff4 [0,4194304] 0 2024-04-25T02:27:14.289 INFO:tasks.workunit.client.0.smithi114.stdout:3/785: symlink d0/d25/d29/d85/d7e/da9/l117 0 2024-04-25T02:27:14.289 INFO:tasks.workunit.client.0.smithi114.stdout:9/780: stat d8/d16/d21/d37 0 2024-04-25T02:27:14.291 INFO:tasks.workunit.client.0.smithi114.stdout:6/897: creat de/d25/f13c x:0 0 0 2024-04-25T02:27:14.291 INFO:tasks.workunit.client.0.smithi114.stdout:3/786: fdatasync d0/d25/d29/d85/d7e/fe6 0 2024-04-25T02:27:14.292 INFO:tasks.workunit.client.0.smithi114.stdout:9/781: readlink d8/d16/d21/d24/d69/df3/lc9 0 2024-04-25T02:27:14.294 INFO:tasks.workunit.client.0.smithi114.stdout:8/823: unlink da/d38/d62/d6d/d52/da8/db1/fca 0 2024-04-25T02:27:14.294 INFO:tasks.workunit.client.0.smithi114.stdout:1/783: symlink df/d13/dbb/l10e 0 2024-04-25T02:27:14.295 INFO:tasks.workunit.client.0.smithi114.stdout:9/782: write d8/d16/d21/d24/fcb [1340873,120421] 0 2024-04-25T02:27:14.298 INFO:tasks.workunit.client.0.smithi114.stdout:1/784: creat df/d13/d1e/f10f x:0 0 0 2024-04-25T02:27:14.299 INFO:tasks.workunit.client.0.smithi114.stdout:4/695: dwrite d3/d8/d30/d4c/d7f/d8d/f9c [0,4194304] 0 2024-04-25T02:27:14.301 INFO:tasks.workunit.client.0.smithi114.stdout:1/785: chown df/d13/d1e/l64 3 1 2024-04-25T02:27:14.301 INFO:tasks.workunit.client.0.smithi114.stdout:0/749: dread d1/d30/f75 [0,4194304] 0 2024-04-25T02:27:14.303 INFO:tasks.workunit.client.0.smithi114.stdout:3/787: dwrite d0/d25/d2a/d34/f55 [0,4194304] 0 2024-04-25T02:27:14.304 INFO:tasks.workunit.client.0.smithi114.stdout:8/824: symlink da/d38/d62/d6d/l101 0 2024-04-25T02:27:14.307 INFO:tasks.workunit.client.0.smithi114.stdout:9/783: symlink d8/d16/d21/d37/d43/lfa 0 2024-04-25T02:27:14.308 INFO:tasks.workunit.client.0.smithi114.stdout:1/786: dread - df/d2a/de9/ffa zero size 2024-04-25T02:27:14.309 INFO:tasks.workunit.client.0.smithi114.stdout:0/750: fdatasync d1/d4/d4f/d77/f95 0 2024-04-25T02:27:14.312 INFO:tasks.workunit.client.0.smithi114.stdout:3/788: unlink d0/d25/d29/d85/lf1 0 2024-04-25T02:27:14.315 INFO:tasks.workunit.client.0.smithi114.stdout:5/860: sync 2024-04-25T02:27:14.315 INFO:tasks.workunit.client.0.smithi114.stdout:1/787: mkdir df/d13/d6e/d97/dd6/d82/de8/d110 0 2024-04-25T02:27:14.316 INFO:tasks.workunit.client.0.smithi114.stdout:0/751: rmdir d1/d7/d68/d69 39 2024-04-25T02:27:14.318 INFO:tasks.workunit.client.0.smithi114.stdout:7/865: truncate d5/d19/d23/f3f 3858337 0 2024-04-25T02:27:14.320 INFO:tasks.workunit.client.0.smithi114.stdout:5/861: creat d1/d25/da1/d8a/da8/f11d x:0 0 0 2024-04-25T02:27:14.321 INFO:tasks.workunit.client.0.smithi114.stdout:1/788: mkdir df/d13/d6e/d97/dd6/d82/de8/dfe/d111 0 2024-04-25T02:27:14.321 INFO:tasks.workunit.client.0.smithi114.stdout:5/862: read - d1/d53/d55/db1/f117 zero size 2024-04-25T02:27:14.322 INFO:tasks.workunit.client.0.smithi114.stdout:5/863: write d1/d25/da1/d8a/da8/f11d [401633,29583] 0 2024-04-25T02:27:14.322 INFO:tasks.workunit.client.0.smithi114.stdout:3/789: rename d0/d25/da0/c107 to d0/d25/d2a/d34/d9e/c118 0 2024-04-25T02:27:14.323 INFO:tasks.workunit.client.0.smithi114.stdout:8/825: creat da/d38/d62/d6d/d52/f102 x:0 0 0 2024-04-25T02:27:14.324 INFO:tasks.workunit.client.0.smithi114.stdout:1/789: write df/f15 [3964302,103494] 0 2024-04-25T02:27:14.326 INFO:tasks.workunit.client.0.smithi114.stdout:8/826: unlink da/d1e/ffa 0 2024-04-25T02:27:14.326 INFO:tasks.workunit.client.0.smithi114.stdout:8/827: fdatasync da/d38/d62/d6d/f9e 0 2024-04-25T02:27:14.327 INFO:tasks.workunit.client.0.smithi114.stdout:3/790: symlink d0/d25/d29/d85/d7e/da9/l119 0 2024-04-25T02:27:14.328 INFO:tasks.workunit.client.0.smithi114.stdout:1/790: mknod df/d13/d6e/d97/dd6/d82/de8/d110/c112 0 2024-04-25T02:27:14.328 INFO:tasks.workunit.client.0.smithi114.stdout:8/828: readlink da/d38/d62/d6d/l4c 0 2024-04-25T02:27:14.331 INFO:tasks.workunit.client.0.smithi114.stdout:8/829: truncate da/d38/db6/fdf 439840 0 2024-04-25T02:27:14.331 INFO:tasks.workunit.client.0.smithi114.stdout:1/791: mknod df/d13/d6e/d97/dd6/d82/de8/d110/c113 0 2024-04-25T02:27:14.333 INFO:tasks.workunit.client.0.smithi114.stdout:3/791: dwrite d0/d25/d29/d85/ff4 [0,4194304] 0 2024-04-25T02:27:14.335 INFO:tasks.workunit.client.0.smithi114.stdout:8/830: getdents da/d38/db6/dfe 0 2024-04-25T02:27:14.335 INFO:tasks.workunit.client.0.smithi114.stdout:3/792: readlink d0/d25/d29/d85/d7e/da9/l119 0 2024-04-25T02:27:14.336 INFO:tasks.workunit.client.0.smithi114.stdout:3/793: stat d0/d25/d29/d60/c67 0 2024-04-25T02:27:14.337 INFO:tasks.workunit.client.0.smithi114.stdout:5/864: read d1/d53/d55/db1/fdb [3592382,72866] 0 2024-04-25T02:27:14.340 INFO:tasks.workunit.client.0.smithi114.stdout:8/831: mknod da/d38/db6/c103 0 2024-04-25T02:27:14.340 INFO:tasks.workunit.client.0.smithi114.stdout:3/794: mkdir d0/d25/d2a/d80/dbd/d11a 0 2024-04-25T02:27:14.341 INFO:tasks.workunit.client.0.smithi114.stdout:2/845: sync 2024-04-25T02:27:14.342 INFO:tasks.workunit.client.0.smithi114.stdout:1/792: dwrite df/d13/d75/db8/f69 [0,4194304] 0 2024-04-25T02:27:14.343 INFO:tasks.workunit.client.0.smithi114.stdout:2/846: read d5/d6/fab [3566003,86839] 0 2024-04-25T02:27:14.345 INFO:tasks.workunit.client.0.smithi114.stdout:2/847: fsync d5/df/d2c/d66/fe5 0 2024-04-25T02:27:14.348 INFO:tasks.workunit.client.0.smithi114.stdout:1/793: mkdir df/d13/d6e/d97/dd6/d82/de8/dfe/d77/dc0/d114 0 2024-04-25T02:27:14.350 INFO:tasks.workunit.client.0.smithi114.stdout:1/794: write df/d2a/f2e [2219036,109] 0 2024-04-25T02:27:14.351 INFO:tasks.workunit.client.0.smithi114.stdout:3/795: dwrite d0/d5/d3d/fa5 [0,4194304] 0 2024-04-25T02:27:14.353 INFO:tasks.workunit.client.0.smithi114.stdout:1/795: readlink df/d13/d44/d5a/dc9/d33/d47/l4f 0 2024-04-25T02:27:14.355 INFO:tasks.workunit.client.0.smithi114.stdout:2/848: dread d5/df/d3d/f5e [4194304,4194304] 0 2024-04-25T02:27:14.356 INFO:tasks.workunit.client.0.smithi114.stdout:4/696: write d3/d8/d12/fb1 [980769,41462] 0 2024-04-25T02:27:14.356 INFO:tasks.workunit.client.0.smithi114.stdout:3/796: mknod d0/d25/da0/c11b 0 2024-04-25T02:27:14.358 INFO:tasks.workunit.client.0.smithi114.stdout:0/752: dread d1/d7/d18/f1f [4194304,4194304] 0 2024-04-25T02:27:14.359 INFO:tasks.workunit.client.0.smithi114.stdout:8/832: dread da/d38/d62/d6d/f9e [0,4194304] 0 2024-04-25T02:27:14.362 INFO:tasks.workunit.client.0.smithi114.stdout:1/796: symlink df/d13/l115 0 2024-04-25T02:27:14.363 INFO:tasks.workunit.client.0.smithi114.stdout:1/797: fdatasync df/d13/d75/d8e/d98/fcc 0 2024-04-25T02:27:14.364 INFO:tasks.workunit.client.0.smithi114.stdout:3/797: mknod d0/d5/d3d/ddc/c11c 0 2024-04-25T02:27:14.366 INFO:tasks.workunit.client.0.smithi114.stdout:6/898: dread de/d25/d39/f51 [4194304,4194304] 0 2024-04-25T02:27:14.366 INFO:tasks.workunit.client.0.smithi114.stdout:0/753: creat d1/d7/d46/fe4 x:0 0 0 2024-04-25T02:27:14.366 INFO:tasks.workunit.client.0.smithi114.stdout:5/865: link d1/d6/d4f/d6c/d88/ce2 d1/d6/de/da7/dce/dea/c11e 0 2024-04-25T02:27:14.367 INFO:tasks.workunit.client.0.smithi114.stdout:2/849: dwrite d5/daf/dda/de1/f106 [0,4194304] 0 2024-04-25T02:27:14.368 INFO:tasks.workunit.client.0.smithi114.stdout:7/866: write d5/d32/d4a/d51/f95 [1313986,48094] 0 2024-04-25T02:27:14.369 INFO:tasks.workunit.client.0.smithi114.stdout:2/850: fdatasync d5/d6/d58/d5a/fb8 0 2024-04-25T02:27:14.370 INFO:tasks.workunit.client.0.smithi114.stdout:1/798: dread df/d13/d75/f9c [0,4194304] 0 2024-04-25T02:27:14.371 INFO:tasks.workunit.client.0.smithi114.stdout:3/798: mknod d0/d25/da0/c11d 0 2024-04-25T02:27:14.371 INFO:tasks.workunit.client.0.smithi114.stdout:0/754: symlink d1/d4/d4f/d77/le5 0 2024-04-25T02:27:14.373 INFO:tasks.workunit.client.0.smithi114.stdout:9/784: dread d8/fb [0,4194304] 0 2024-04-25T02:27:14.374 INFO:tasks.workunit.client.0.smithi114.stdout:9/785: stat d8/d16/d21/d24/l55 0 2024-04-25T02:27:14.376 INFO:tasks.workunit.client.0.smithi114.stdout:4/697: rename d3/d8/d23/d25/d31 to d3/d8/d12/d19/d26/d3e/daa/dce 0 2024-04-25T02:27:14.377 INFO:tasks.workunit.client.0.smithi114.stdout:6/899: dread de/fc3 [0,4194304] 0 2024-04-25T02:27:14.378 INFO:tasks.workunit.client.0.smithi114.stdout:7/867: mkdir d5/d43/d4e/dec/d11a 0 2024-04-25T02:27:14.381 INFO:tasks.workunit.client.0.smithi114.stdout:6/900: dread de/d27/d34/d4b/f75 [0,4194304] 0 2024-04-25T02:27:14.382 INFO:tasks.workunit.client.0.smithi114.stdout:6/901: chown de/d27/d34/d4b/d102/d120/c66 542104 1 2024-04-25T02:27:14.382 INFO:tasks.workunit.client.0.smithi114.stdout:2/851: rename d5/df/d3d/cf2 to d5/df/d3d/d81/c111 0 2024-04-25T02:27:14.383 INFO:tasks.workunit.client.0.smithi114.stdout:4/698: mkdir d3/d8/d30/d6e/dcf 0 2024-04-25T02:27:14.384 INFO:tasks.workunit.client.0.smithi114.stdout:6/902: truncate de/d27/d34/d44/d91/f117 656132 0 2024-04-25T02:27:14.384 INFO:tasks.workunit.client.0.smithi114.stdout:7/868: truncate d5/d60/f71 1226896 0 2024-04-25T02:27:14.387 INFO:tasks.workunit.client.0.smithi114.stdout:3/799: mkdir d0/d11e 0 2024-04-25T02:27:14.390 INFO:tasks.workunit.client.0.smithi114.stdout:1/799: rename df/d13/f56 to df/d13/d6e/d97/dd6/d82/de8/dfe/f116 0 2024-04-25T02:27:14.392 INFO:tasks.workunit.client.0.smithi114.stdout:1/800: write df/d13/d75/d8e/fb9 [578586,17914] 0 2024-04-25T02:27:14.392 INFO:tasks.workunit.client.0.smithi114.stdout:2/852: unlink d5/d1c/d22/d67/cbf 0 2024-04-25T02:27:14.393 INFO:tasks.workunit.client.0.smithi114.stdout:4/699: creat d3/d8/d12/d19/fd0 x:0 0 0 2024-04-25T02:27:14.394 INFO:tasks.workunit.client.0.smithi114.stdout:4/700: dread - d3/db9/fcd zero size 2024-04-25T02:27:14.394 INFO:tasks.workunit.client.0.smithi114.stdout:6/903: symlink de/d2a/db9/l13d 0 2024-04-25T02:27:14.395 INFO:tasks.workunit.client.0.smithi114.stdout:7/869: creat d5/d43/d63/f11b x:0 0 0 2024-04-25T02:27:14.400 INFO:tasks.workunit.client.0.smithi114.stdout:9/786: rename d8/d16/d21/d83 to d8/d16/d21/dfb 0 2024-04-25T02:27:14.404 INFO:tasks.workunit.client.0.smithi114.stdout:2/853: mknod d5/d6/d31/d6a/c112 0 2024-04-25T02:27:14.404 INFO:tasks.workunit.client.0.smithi114.stdout:4/701: mknod d3/db9/cd1 0 2024-04-25T02:27:14.406 INFO:tasks.workunit.client.0.smithi114.stdout:8/833: symlink da/d1e/dcd/dd3/l104 0 2024-04-25T02:27:14.407 INFO:tasks.workunit.client.0.smithi114.stdout:7/870: creat d5/d32/d4a/d91/f11c x:0 0 0 2024-04-25T02:27:14.408 INFO:tasks.workunit.client.0.smithi114.stdout:3/800: symlink d0/l11f 0 2024-04-25T02:27:14.409 INFO:tasks.workunit.client.0.smithi114.stdout:5/866: link d1/d3e/d8e/de5/d82/d8f/c10f d1/d6/c11f 0 2024-04-25T02:27:14.410 INFO:tasks.workunit.client.0.smithi114.stdout:1/801: mknod df/d11/d7d/df9/d107/c117 0 2024-04-25T02:27:14.412 INFO:tasks.workunit.client.0.smithi114.stdout:1/802: chown df/d13/d44/d5a/dc9/f5d 23836 1 2024-04-25T02:27:14.413 INFO:tasks.workunit.client.0.smithi114.stdout:4/702: mkdir d3/d8/d30/d4c/d7f/dd2 0 2024-04-25T02:27:14.414 INFO:tasks.workunit.client.0.smithi114.stdout:8/834: mknod da/d38/c105 0 2024-04-25T02:27:14.415 INFO:tasks.workunit.client.0.smithi114.stdout:7/871: mknod d5/d8b/d99/dae/c11d 0 2024-04-25T02:27:14.416 INFO:tasks.workunit.client.0.smithi114.stdout:9/787: dwrite d8/da8/fb5 [4194304,4194304] 0 2024-04-25T02:27:14.417 INFO:tasks.workunit.client.0.smithi114.stdout:4/703: chown d3/d8/d30/d4c/fab 17811550 1 2024-04-25T02:27:14.418 INFO:tasks.workunit.client.0.smithi114.stdout:3/801: creat d0/d25/d29/d85/d7e/f120 x:0 0 0 2024-04-25T02:27:14.419 INFO:tasks.workunit.client.0.smithi114.stdout:5/867: mknod d1/d6/d4f/d6c/d88/db6/c120 0 2024-04-25T02:27:14.419 INFO:tasks.workunit.client.0.smithi114.stdout:9/788: read d8/fe [2943658,30539] 0 2024-04-25T02:27:14.420 INFO:tasks.workunit.client.0.smithi114.stdout:3/802: chown d0/l1a 228 1 2024-04-25T02:27:14.420 INFO:tasks.workunit.client.0.smithi114.stdout:6/904: rename de/d1c/df7/f101 to de/f13e 0 2024-04-25T02:27:14.421 INFO:tasks.workunit.client.0.smithi114.stdout:2/854: dread d5/df/d1e/f38 [4194304,4194304] 0 2024-04-25T02:27:14.423 INFO:tasks.workunit.client.0.smithi114.stdout:1/803: dwrite df/d13/d75/db8/f69 [0,4194304] 0 2024-04-25T02:27:14.457 INFO:tasks.workunit.client.0.smithi114.stdout:7/872: mkdir d5/d8b/d99/d101/d11e 0 2024-04-25T02:27:14.458 INFO:tasks.workunit.client.0.smithi114.stdout:4/704: mkdir d3/d8/d23/d25/dd3 0 2024-04-25T02:27:14.458 INFO:tasks.workunit.client.0.smithi114.stdout:8/835: creat da/d38/d62/f106 x:0 0 0 2024-04-25T02:27:14.459 INFO:tasks.workunit.client.0.smithi114.stdout:3/803: symlink d0/d5/d3d/dd7/dfa/l121 0 2024-04-25T02:27:14.460 INFO:tasks.workunit.client.0.smithi114.stdout:3/804: fdatasync d0/d25/d2a/d80/f102 0 2024-04-25T02:27:14.461 INFO:tasks.workunit.client.0.smithi114.stdout:8/836: chown da/d38/d62/d6d/d49/d65/dd0/f91 120178 1 2024-04-25T02:27:14.461 INFO:tasks.workunit.client.0.smithi114.stdout:9/789: link d8/d16/d21/dfb/d39/d38/f80 d8/d16/d21/dfb/ffc 0 2024-04-25T02:27:14.461 INFO:tasks.workunit.client.0.smithi114.stdout:3/805: fsync d0/d5/d3d/f75 0 2024-04-25T02:27:14.462 INFO:tasks.workunit.client.0.smithi114.stdout:6/905: link l3 de/d25/d39/dec/l13f 0 2024-04-25T02:27:14.463 INFO:tasks.workunit.client.0.smithi114.stdout:5/868: dread d1/d6/de/f9c [0,4194304] 0 2024-04-25T02:27:14.465 INFO:tasks.workunit.client.0.smithi114.stdout:1/804: getdents df/d13/d6e/d97/dd6/d82/de8/dfe/d77/dc0 0 2024-04-25T02:27:14.470 INFO:tasks.workunit.client.0.smithi114.stdout:6/906: creat de/d25/d39/dec/f140 x:0 0 0 2024-04-25T02:27:14.471 INFO:tasks.workunit.client.0.smithi114.stdout:5/869: creat d1/d3e/db2/dd4/f121 x:0 0 0 2024-04-25T02:27:14.472 INFO:tasks.workunit.client.0.smithi114.stdout:1/805: symlink df/d13/d1e/l118 0 2024-04-25T02:27:14.473 INFO:tasks.workunit.client.0.smithi114.stdout:7/873: getdents d5/d32/da6 0 2024-04-25T02:27:14.475 INFO:tasks.workunit.client.0.smithi114.stdout:6/907: mknod de/d25/d39/d47/d90/c141 0 2024-04-25T02:27:14.478 INFO:tasks.workunit.client.0.smithi114.stdout:1/806: dread df/d13/d6e/d97/fd0 [0,4194304] 0 2024-04-25T02:27:14.478 INFO:tasks.workunit.client.0.smithi114.stdout:5/870: dwrite d1/d6/de/f37 [0,4194304] 0 2024-04-25T02:27:14.479 INFO:tasks.workunit.client.0.smithi114.stdout:7/874: unlink d5/d43/d63/l78 0 2024-04-25T02:27:14.480 INFO:tasks.workunit.client.0.smithi114.stdout:8/837: dread da/d1e/f6a [0,4194304] 0 2024-04-25T02:27:14.480 INFO:tasks.workunit.client.0.smithi114.stdout:5/871: dread - d1/d6/d1a/d7f/dd9/f10d zero size 2024-04-25T02:27:14.481 INFO:tasks.workunit.client.0.smithi114.stdout:1/807: read df/d13/d75/d8e/fb5 [118994,34073] 0 2024-04-25T02:27:14.482 INFO:tasks.workunit.client.0.smithi114.stdout:5/872: stat d1/d6/de/da7/ddf/dc5/dfd/dc1/cdd 0 2024-04-25T02:27:14.484 INFO:tasks.workunit.client.0.smithi114.stdout:0/755: sync 2024-04-25T02:27:14.484 INFO:tasks.workunit.client.0.smithi114.stdout:4/705: write d3/d8/d23/fb3 [1820773,81369] 0 2024-04-25T02:27:14.485 INFO:tasks.workunit.client.0.smithi114.stdout:5/873: write d1/d25/fe8 [148797,3817] 0 2024-04-25T02:27:14.486 INFO:tasks.workunit.client.0.smithi114.stdout:7/875: unlink d5/d32/f112 0 2024-04-25T02:27:14.486 INFO:tasks.workunit.client.0.smithi114.stdout:9/790: dread d8/d16/d21/dfb/f86 [0,4194304] 0 2024-04-25T02:27:14.488 INFO:tasks.workunit.client.0.smithi114.stdout:3/806: dread d0/d25/f62 [0,4194304] 0 2024-04-25T02:27:14.489 INFO:tasks.workunit.client.0.smithi114.stdout:1/808: rmdir df/d13/d6e/d97/dd6 39 2024-04-25T02:27:14.491 INFO:tasks.workunit.client.0.smithi114.stdout:8/838: dwrite da/d38/db6/de8/f9f [0,4194304] 0 2024-04-25T02:27:14.491 INFO:tasks.workunit.client.0.smithi114.stdout:9/791: dread - d8/d16/d21/d24/d69/df3/dd9/ff6 zero size 2024-04-25T02:27:14.492 INFO:tasks.workunit.client.0.smithi114.stdout:0/756: creat d1/d4/da/d39/fe6 x:0 0 0 2024-04-25T02:27:14.493 INFO:tasks.workunit.client.0.smithi114.stdout:7/876: creat d5/d32/da6/f11f x:0 0 0 2024-04-25T02:27:14.495 INFO:tasks.workunit.client.0.smithi114.stdout:5/874: rename d1/d3e/d8e/de5/fc6 to d1/d6/d4f/d6c/d88/db6/dc8/f122 0 2024-04-25T02:27:14.496 INFO:tasks.workunit.client.0.smithi114.stdout:3/807: mknod d0/d25/d29/d85/d7e/da9/dad/de4/dbb/c122 0 2024-04-25T02:27:14.497 INFO:tasks.workunit.client.0.smithi114.stdout:9/792: rmdir d8/d16/d21/d24/d69 39 2024-04-25T02:27:14.498 INFO:tasks.workunit.client.0.smithi114.stdout:9/793: stat d8/d16/d21/d24/d3c/l63 0 2024-04-25T02:27:14.500 INFO:tasks.workunit.client.0.smithi114.stdout:4/706: dread d3/d8/d30/d4c/f69 [0,4194304] 0 2024-04-25T02:27:14.500 INFO:tasks.workunit.client.0.smithi114.stdout:0/757: dwrite d1/d7/d18/d2e/d7e/f89 [0,4194304] 0 2024-04-25T02:27:14.504 INFO:tasks.workunit.client.0.smithi114.stdout:1/809: rename df/d13/d6e/d97 to df/d13/d44/d9b/d119 0 2024-04-25T02:27:14.504 INFO:tasks.workunit.client.0.smithi114.stdout:8/839: read da/d38/db6/de8/fdc [130461,22226] 0 2024-04-25T02:27:14.505 INFO:tasks.workunit.client.0.smithi114.stdout:3/808: mknod d0/d25/d2a/d80/c123 0 2024-04-25T02:27:14.507 INFO:tasks.workunit.client.0.smithi114.stdout:7/877: mknod d5/d8b/d99/d101/d11e/c120 0 2024-04-25T02:27:14.508 INFO:tasks.workunit.client.0.smithi114.stdout:9/794: chown d8/d16/d21/dfb/ffc 134 1 2024-04-25T02:27:14.510 INFO:tasks.workunit.client.0.smithi114.stdout:0/758: rename d1/d4/da/d39/lc7 to d1/d4/d4f/le7 0 2024-04-25T02:27:14.510 INFO:tasks.workunit.client.0.smithi114.stdout:4/707: dwrite d3/d8/d23/d25/f87 [0,4194304] 0 2024-04-25T02:27:14.512 INFO:tasks.workunit.client.0.smithi114.stdout:8/840: symlink da/d38/d62/d6d/d49/d65/dd0/l107 0 2024-04-25T02:27:14.513 INFO:tasks.workunit.client.0.smithi114.stdout:7/878: mkdir d5/d43/d63/d7a/d121 0 2024-04-25T02:27:14.513 INFO:tasks.workunit.client.0.smithi114.stdout:6/908: dwrite de/d27/f4e [0,4194304] 0 2024-04-25T02:27:14.514 INFO:tasks.workunit.client.0.smithi114.stdout:0/759: write d1/d4/f8a [615442,56323] 0 2024-04-25T02:27:14.515 INFO:tasks.workunit.client.0.smithi114.stdout:4/708: dread - d3/d8/d12/d19/d26/f7b zero size 2024-04-25T02:27:14.516 INFO:tasks.workunit.client.0.smithi114.stdout:3/809: mkdir d0/d25/d2a/d80/dbd/d124 0 2024-04-25T02:27:14.516 INFO:tasks.workunit.client.0.smithi114.stdout:6/909: chown de/d25/dad/dde 1 1 2024-04-25T02:27:14.516 INFO:tasks.workunit.client.0.smithi114.stdout:1/810: dread df/d11/d32/f8b [0,4194304] 0 2024-04-25T02:27:14.517 INFO:tasks.workunit.client.0.smithi114.stdout:2/855: sync 2024-04-25T02:27:14.523 INFO:tasks.workunit.client.0.smithi114.stdout:0/760: creat d1/d30/d4d/fe8 x:0 0 0 2024-04-25T02:27:14.523 INFO:tasks.workunit.client.0.smithi114.stdout:1/811: dwrite df/d13/d75/fe3 [4194304,4194304] 0 2024-04-25T02:27:14.524 INFO:tasks.workunit.client.0.smithi114.stdout:6/910: symlink de/d25/d39/dec/l142 0 2024-04-25T02:27:14.526 INFO:tasks.workunit.client.0.smithi114.stdout:2/856: mknod d5/df/d2c/d66/c113 0 2024-04-25T02:27:14.528 INFO:tasks.workunit.client.0.smithi114.stdout:4/709: rename d3/d8/d30/d6e/c8b to d3/d8/d30/d93/cd4 0 2024-04-25T02:27:14.529 INFO:tasks.workunit.client.0.smithi114.stdout:5/875: dwrite d1/d6/de/f4a [4194304,4194304] 0 2024-04-25T02:27:14.531 INFO:tasks.workunit.client.0.smithi114.stdout:5/876: write d1/d6/d4f/d6c/d88/ff6 [80549,112585] 0 2024-04-25T02:27:14.532 INFO:tasks.workunit.client.0.smithi114.stdout:0/761: mknod d1/d4/da/d33/ce9 0 2024-04-25T02:27:14.532 INFO:tasks.workunit.client.0.smithi114.stdout:0/762: dread - d1/d4/da/d3e/fbb zero size 2024-04-25T02:27:14.533 INFO:tasks.workunit.client.0.smithi114.stdout:0/763: chown d1/d7/d18/f51 17604 1 2024-04-25T02:27:14.536 INFO:tasks.workunit.client.0.smithi114.stdout:2/857: unlink d5/df/d1e/c77 0 2024-04-25T02:27:14.538 INFO:tasks.workunit.client.0.smithi114.stdout:4/710: mknod d3/d8/d12/d19/d42/d58/cd5 0 2024-04-25T02:27:14.539 INFO:tasks.workunit.client.0.smithi114.stdout:2/858: write d5/df/d1e/f26 [1207822,59239] 0 2024-04-25T02:27:14.540 INFO:tasks.workunit.client.0.smithi114.stdout:8/841: link da/d69/fb0 da/d69/d93/f108 0 2024-04-25T02:27:14.541 INFO:tasks.workunit.client.0.smithi114.stdout:1/812: dwrite df/d13/d44/d9b/d119/dd6/d82/de8/dfe/fcd [0,4194304] 0 2024-04-25T02:27:14.541 INFO:tasks.workunit.client.0.smithi114.stdout:0/764: dwrite d1/d4/d4f/d77/da1/fad [0,4194304] 0 2024-04-25T02:27:14.542 INFO:tasks.workunit.client.0.smithi114.stdout:5/877: mkdir d1/d6/d4f/d6c/d88/d123 0 2024-04-25T02:27:14.543 INFO:tasks.workunit.client.0.smithi114.stdout:6/911: mkdir de/d25/d39/d47/d90/d93/d143 0 2024-04-25T02:27:14.544 INFO:tasks.workunit.client.0.smithi114.stdout:9/795: link d8/d16/d21/d24/l68 d8/d16/d21/lfd 0 2024-04-25T02:27:14.544 INFO:tasks.workunit.client.0.smithi114.stdout:0/765: write d1/d4/fb6 [3203344,112492] 0 2024-04-25T02:27:14.545 INFO:tasks.workunit.client.0.smithi114.stdout:5/878: read d1/d6/f31 [4692739,30711] 0 2024-04-25T02:27:14.560 INFO:tasks.workunit.client.0.smithi114.stdout:2/859: chown d5/d1c/l34 721188 1 2024-04-25T02:27:14.561 INFO:tasks.workunit.client.0.smithi114.stdout:6/912: rmdir de/d27/d34/d44 39 2024-04-25T02:27:14.563 INFO:tasks.workunit.client.0.smithi114.stdout:0/766: readlink d1/d4/da/d39/da7/lc6 0 2024-04-25T02:27:14.563 INFO:tasks.workunit.client.0.smithi114.stdout:6/913: chown de/d25 22 1 2024-04-25T02:27:14.564 INFO:tasks.workunit.client.0.smithi114.stdout:1/813: link df/d13/d6e/fe5 df/f11a 0 2024-04-25T02:27:14.564 INFO:tasks.workunit.client.0.smithi114.stdout:4/711: dwrite d3/d8/d23/fc4 [0,4194304] 0 2024-04-25T02:27:14.565 INFO:tasks.workunit.client.0.smithi114.stdout:9/796: symlink d8/d16/d21/d37/d43/d75/lfe 0 2024-04-25T02:27:14.568 INFO:tasks.workunit.client.0.smithi114.stdout:1/814: creat df/d13/d75/d8e/f11b x:0 0 0 2024-04-25T02:27:14.570 INFO:tasks.workunit.client.0.smithi114.stdout:4/712: readlink d3/d8/d23/l8a 0 2024-04-25T02:27:14.570 INFO:tasks.workunit.client.0.smithi114.stdout:0/767: symlink d1/d4/d24/d52/da2/lea 0 2024-04-25T02:27:14.571 INFO:tasks.workunit.client.0.smithi114.stdout:7/879: dwrite d5/d19/d1a/f24 [0,4194304] 0 2024-04-25T02:27:14.573 INFO:tasks.workunit.client.0.smithi114.stdout:5/879: dread d1/d25/d24/f3f [4194304,4194304] 0 2024-04-25T02:27:14.573 INFO:tasks.workunit.client.0.smithi114.stdout:9/797: symlink d8/d16/d21/d24/df2/lff 0 2024-04-25T02:27:14.577 INFO:tasks.workunit.client.0.smithi114.stdout:2/860: dwrite d5/d6/d31/d6a/f7f [0,4194304] 0 2024-04-25T02:27:14.577 INFO:tasks.workunit.client.0.smithi114.stdout:9/798: write d8/d16/d21/dfb/d39/fe8 [590575,19811] 0 2024-04-25T02:27:14.593 INFO:tasks.workunit.client.0.smithi114.stdout:7/880: rmdir d5/d32/d4a/d91 39 2024-04-25T02:27:14.596 INFO:tasks.workunit.client.0.smithi114.stdout:2/861: write d5/df/d2c/f64 [387085,31797] 0 2024-04-25T02:27:14.596 INFO:tasks.workunit.client.0.smithi114.stdout:6/914: dwrite de/d27/d34/d4b/d102/d120/fe3 [0,4194304] 0 2024-04-25T02:27:14.596 INFO:tasks.workunit.client.0.smithi114.stdout:3/810: truncate d0/d25/d29/d60/da8/dc8/fe2 9860446 0 2024-04-25T02:27:14.598 INFO:tasks.workunit.client.0.smithi114.stdout:1/815: rmdir df/d13/d44/d9b/d119/d100 0 2024-04-25T02:27:14.598 INFO:tasks.workunit.client.0.smithi114.stdout:9/799: dread - d8/d16/d21/d24/d69/df3/dd9/ff6 zero size 2024-04-25T02:27:14.599 INFO:tasks.workunit.client.0.smithi114.stdout:0/768: dwrite d1/d4/f63 [0,4194304] 0 2024-04-25T02:27:14.599 INFO:tasks.workunit.client.0.smithi114.stdout:7/881: stat d5/d32/d4a/l68 0 2024-04-25T02:27:14.601 INFO:tasks.workunit.client.0.smithi114.stdout:3/811: write d0/d25/d29/d60/f65 [5169654,47135] 0 2024-04-25T02:27:14.603 INFO:tasks.workunit.client.0.smithi114.stdout:6/915: creat de/d27/d34/d4b/d102/f144 x:0 0 0 2024-04-25T02:27:14.604 INFO:tasks.workunit.client.0.smithi114.stdout:7/882: mknod d5/d8b/d99/dae/c122 0 2024-04-25T02:27:14.606 INFO:tasks.workunit.client.0.smithi114.stdout:7/883: write d5/d19/f34 [5127232,86658] 0 2024-04-25T02:27:14.607 INFO:tasks.workunit.client.0.smithi114.stdout:1/816: rename df/d13/d44/d5a/dc9/d33/f58 to df/d13/d93/df7/f11c 0 2024-04-25T02:27:14.608 INFO:tasks.workunit.client.0.smithi114.stdout:9/800: dwrite d8/d16/d21/dfb/d39/d38/d5d/fb4 [0,4194304] 0 2024-04-25T02:27:14.608 INFO:tasks.workunit.client.0.smithi114.stdout:3/812: mkdir d0/d25/d2a/d34/d125 0 2024-04-25T02:27:14.609 INFO:tasks.workunit.client.0.smithi114.stdout:8/842: sync 2024-04-25T02:27:14.609 INFO:tasks.workunit.client.0.smithi114.stdout:3/813: stat d0/d5/c11 0 2024-04-25T02:27:14.610 INFO:tasks.workunit.client.0.smithi114.stdout:8/843: truncate da/d38/fa4 147800 0 2024-04-25T02:27:14.610 INFO:tasks.workunit.client.0.smithi114.stdout:3/814: fsync d0/d5/d3d/f75 0 2024-04-25T02:27:14.610 INFO:tasks.workunit.client.0.smithi114.stdout:6/916: unlink de/d27/l94 0 2024-04-25T02:27:14.614 INFO:tasks.workunit.client.0.smithi114.stdout:8/844: unlink c8 0 2024-04-25T02:27:14.614 INFO:tasks.workunit.client.0.smithi114.stdout:9/801: read d8/d16/d21/d24/f47 [79890,36512] 0 2024-04-25T02:27:14.617 INFO:tasks.workunit.client.0.smithi114.stdout:3/815: rmdir d0/d25/d29/d85/d7e/da9 39 2024-04-25T02:27:14.620 INFO:tasks.workunit.client.0.smithi114.stdout:8/845: symlink da/d1e/l109 0 2024-04-25T02:27:14.622 INFO:tasks.workunit.client.0.smithi114.stdout:0/769: getdents d1/d7/d68/d69 0 2024-04-25T02:27:14.624 INFO:tasks.workunit.client.0.smithi114.stdout:4/713: write d3/d8/d30/d4c/f69 [3412822,52777] 0 2024-04-25T02:27:14.625 INFO:tasks.workunit.client.0.smithi114.stdout:6/917: creat de/f145 x:0 0 0 2024-04-25T02:27:14.626 INFO:tasks.workunit.client.0.smithi114.stdout:1/817: getdents df/d13/d75/d8e/d98 0 2024-04-25T02:27:14.626 INFO:tasks.workunit.client.0.smithi114.stdout:9/802: creat d8/d16/d21/dfb/d39/f100 x:0 0 0 2024-04-25T02:27:14.627 INFO:tasks.workunit.client.0.smithi114.stdout:8/846: creat da/d38/d62/d6d/d52/da8/da9/df2/df9/f10a x:0 0 0 2024-04-25T02:27:14.628 INFO:tasks.workunit.client.0.smithi114.stdout:0/770: rename d1/d4/da/d39/f99 to d1/d7/d18/d2e/feb 0 2024-04-25T02:27:14.629 INFO:tasks.workunit.client.0.smithi114.stdout:4/714: creat d3/d8/d30/d93/fd6 x:0 0 0 2024-04-25T02:27:14.630 INFO:tasks.workunit.client.0.smithi114.stdout:3/816: dwrite d0/d5/d3d/ddc/f112 [0,4194304] 0 2024-04-25T02:27:14.633 INFO:tasks.workunit.client.0.smithi114.stdout:1/818: creat df/d13/d44/d5a/dc9/d33/d47/f11d x:0 0 0 2024-04-25T02:27:14.633 INFO:tasks.workunit.client.0.smithi114.stdout:0/771: unlink d1/d7/d18/f1f 0 2024-04-25T02:27:14.634 INFO:tasks.workunit.client.0.smithi114.stdout:3/817: fsync d0/d25/d2a/d34/db6/f104 0 2024-04-25T02:27:14.635 INFO:tasks.workunit.client.0.smithi114.stdout:6/918: dread de/d25/d39/f51 [4194304,4194304] 0 2024-04-25T02:27:14.635 INFO:tasks.workunit.client.0.smithi114.stdout:9/803: creat d8/d16/d21/dfb/d39/d38/d46/d53/df8/f101 x:0 0 0 2024-04-25T02:27:14.636 INFO:tasks.workunit.client.0.smithi114.stdout:1/819: write df/d13/d44/d9b/d119/dd6/d82/de8/dfe/f84 [778590,51120] 0 2024-04-25T02:27:14.637 INFO:tasks.workunit.client.0.smithi114.stdout:1/820: readlink df/d13/d44/l52 0 2024-04-25T02:27:14.649 INFO:tasks.workunit.client.0.smithi114.stdout:5/880: sync 2024-04-25T02:27:14.651 INFO:tasks.workunit.client.0.smithi114.stdout:4/715: mkdir d3/d8/d12/d19/d26/d3e/daa/d89/dd7 0 2024-04-25T02:27:14.655 INFO:tasks.workunit.client.0.smithi114.stdout:6/919: dwrite de/f18 [0,4194304] 0 2024-04-25T02:27:14.655 INFO:tasks.workunit.client.0.smithi114.stdout:3/818: write d0/d25/d29/d85/d7e/da9/dad/de4/fb1 [299762,43284] 0 2024-04-25T02:27:14.659 INFO:tasks.workunit.client.0.smithi114.stdout:9/804: symlink d8/d16/d21/d37/l102 0 2024-04-25T02:27:14.660 INFO:tasks.workunit.client.0.smithi114.stdout:4/716: creat d3/d8/d12/d82/fd8 x:0 0 0 2024-04-25T02:27:14.660 INFO:tasks.workunit.client.0.smithi114.stdout:8/847: truncate da/d69/d93/d6b/fc3 416586 0 2024-04-25T02:27:14.661 INFO:tasks.workunit.client.0.smithi114.stdout:6/920: truncate de/d2a/db9/dc7/ff3 641436 0 2024-04-25T02:27:14.661 INFO:tasks.workunit.client.0.smithi114.stdout:9/805: chown d8/d16/d21/d24/c50 421808 1 2024-04-25T02:27:14.662 INFO:tasks.workunit.client.0.smithi114.stdout:8/848: readlink da/d38/d62/d6d/d52/l83 0 2024-04-25T02:27:14.662 INFO:tasks.workunit.client.0.smithi114.stdout:1/821: truncate df/d13/d44/d5a/dc9/d33/d47/d9d/fa1 1580856 0 2024-04-25T02:27:14.665 INFO:tasks.workunit.client.0.smithi114.stdout:3/819: dread d0/d25/d2a/d34/f7d [0,4194304] 0 2024-04-25T02:27:14.665 INFO:tasks.workunit.client.0.smithi114.stdout:9/806: read d8/d16/d21/d24/d69/df3/fc3 [6575494,56589] 0 2024-04-25T02:27:14.665 INFO:tasks.workunit.client.0.smithi114.stdout:6/921: read - de/d27/d34/d4b/fc4 zero size 2024-04-25T02:27:14.666 INFO:tasks.workunit.client.0.smithi114.stdout:3/820: write d0/d25/f5f [5317168,15866] 0 2024-04-25T02:27:14.668 INFO:tasks.workunit.client.0.smithi114.stdout:1/822: fdatasync df/d13/d44/d9b/d119/dd6/fb3 0 2024-04-25T02:27:14.674 INFO:tasks.workunit.client.0.smithi114.stdout:9/807: rmdir d8/d16/d21/dfb/d39/d38/d5d/dd3 39 2024-04-25T02:27:14.676 INFO:tasks.workunit.client.0.smithi114.stdout:5/881: truncate d1/d3e/d8e/de5/fac 2469391 0 2024-04-25T02:27:14.679 INFO:tasks.workunit.client.0.smithi114.stdout:3/821: link d0/d25/d2a/d80/f102 d0/d25/d2a/d34/d9e/f126 0 2024-04-25T02:27:14.680 INFO:tasks.workunit.client.0.smithi114.stdout:8/849: dwrite da/d69/d93/f108 [0,4194304] 0 2024-04-25T02:27:14.681 INFO:tasks.workunit.client.0.smithi114.stdout:5/882: unlink d1/d3e/d8e/fff 0 2024-04-25T02:27:14.683 INFO:tasks.workunit.client.0.smithi114.stdout:6/922: truncate de/d2a/f2b 4264263 0 2024-04-25T02:27:14.686 INFO:tasks.workunit.client.0.smithi114.stdout:1/823: creat df/d11/d7d/d92/f11e x:0 0 0 2024-04-25T02:27:14.694 INFO:tasks.workunit.client.0.smithi114.stdout:5/883: creat d1/d3e/d8e/d94/d10c/f124 x:0 0 0 2024-04-25T02:27:14.696 INFO:tasks.workunit.client.0.smithi114.stdout:6/923: fdatasync de/fd4 0 2024-04-25T02:27:14.697 INFO:tasks.workunit.client.0.smithi114.stdout:6/924: write de/d27/d34/d4b/f7c [2850597,71254] 0 2024-04-25T02:27:14.697 INFO:tasks.workunit.client.0.smithi114.stdout:1/824: mkdir df/d11/d7d/d92/d11f 0 2024-04-25T02:27:14.698 INFO:tasks.workunit.client.0.smithi114.stdout:6/925: chown de/d25/d39/d47/d90 111289 1 2024-04-25T02:27:14.699 INFO:tasks.workunit.client.0.smithi114.stdout:5/884: creat d1/d53/d55/f125 x:0 0 0 2024-04-25T02:27:14.699 INFO:tasks.workunit.client.0.smithi114.stdout:8/850: link da/d69/d93/d6b/lb9 da/d1e/l10b 0 2024-04-25T02:27:14.700 INFO:tasks.workunit.client.0.smithi114.stdout:8/851: dread - da/d38/fc5 zero size 2024-04-25T02:27:14.701 INFO:tasks.workunit.client.0.smithi114.stdout:8/852: fsync da/d38/d62/d6d/d49/d65/dd0/f91 0 2024-04-25T02:27:14.702 INFO:tasks.workunit.client.0.smithi114.stdout:1/825: readlink df/l4e 0 2024-04-25T02:27:14.702 INFO:tasks.workunit.client.0.smithi114.stdout:6/926: rmdir de/d25/d39/d47/d90/d93 39 2024-04-25T02:27:14.703 INFO:tasks.workunit.client.0.smithi114.stdout:3/822: write d0/d25/d29/d60/da8/dc8/fe2 [6771169,102218] 0 2024-04-25T02:27:14.705 INFO:tasks.workunit.client.0.smithi114.stdout:2/862: sync 2024-04-25T02:27:14.705 INFO:tasks.workunit.client.0.smithi114.stdout:7/884: sync 2024-04-25T02:27:14.706 INFO:tasks.workunit.client.0.smithi114.stdout:2/863: fdatasync d5/df/d1e/f26 0 2024-04-25T02:27:14.706 INFO:tasks.workunit.client.0.smithi114.stdout:8/853: rmdir da/d69/d93/d40 39 2024-04-25T02:27:14.709 INFO:tasks.workunit.client.0.smithi114.stdout:1/826: unlink df/d13/d44/d5a/dc9/d33/d47/d74/fae 0 2024-04-25T02:27:14.711 INFO:tasks.workunit.client.0.smithi114.stdout:5/885: mknod d1/d51/c126 0 2024-04-25T02:27:14.713 INFO:tasks.workunit.client.0.smithi114.stdout:3/823: truncate d0/f81 143024 0 2024-04-25T02:27:14.713 INFO:tasks.workunit.client.0.smithi114.stdout:6/927: dread de/d27/f2d [0,4194304] 0 2024-04-25T02:27:14.716 INFO:tasks.workunit.client.0.smithi114.stdout:2/864: rename d5/d6/d31/d6a to d5/d1c/d29/de0/d114 0 2024-04-25T02:27:14.717 INFO:tasks.workunit.client.0.smithi114.stdout:1/827: mkdir df/d13/d44/d9b/d119/dd6/d82/de8/dfe/d120 0 2024-04-25T02:27:14.719 INFO:tasks.workunit.client.0.smithi114.stdout:3/824: mkdir d0/d25/d2a/d34/d127 0 2024-04-25T02:27:14.720 INFO:tasks.workunit.client.0.smithi114.stdout:7/885: symlink d5/d19/d1a/da4/db3/d103/l123 0 2024-04-25T02:27:14.720 INFO:tasks.workunit.client.0.smithi114.stdout:8/854: dwrite da/d38/d62/d6d/f7f [0,4194304] 0 2024-04-25T02:27:14.722 INFO:tasks.workunit.client.0.smithi114.stdout:2/865: symlink d5/d6/d31/l115 0 2024-04-25T02:27:14.727 INFO:tasks.workunit.client.0.smithi114.stdout:1/828: write df/d13/d44/d5a/dc9/d43/f54 [2000988,49576] 0 2024-04-25T02:27:14.727 INFO:tasks.workunit.client.0.smithi114.stdout:2/866: dwrite d5/d6/f55 [0,4194304] 0 2024-04-25T02:27:14.732 INFO:tasks.workunit.client.0.smithi114.stdout:7/886: rename d5/d19/d1a/f38 to d5/d19/d1a/da4/db3/d103/f124 0 2024-04-25T02:27:14.734 INFO:tasks.workunit.client.0.smithi114.stdout:0/772: sync 2024-04-25T02:27:14.735 INFO:tasks.workunit.client.0.smithi114.stdout:5/886: creat d1/d6/f127 x:0 0 0 2024-04-25T02:27:14.736 INFO:tasks.workunit.client.0.smithi114.stdout:0/773: stat d1/d4/d37/cb3 0 2024-04-25T02:27:14.738 INFO:tasks.workunit.client.0.smithi114.stdout:0/774: chown d1/d4/d24/d52/l85 55 1 2024-04-25T02:27:14.738 INFO:tasks.workunit.client.0.smithi114.stdout:3/825: creat d0/d25/d29/d60/f128 x:0 0 0 2024-04-25T02:27:14.739 INFO:tasks.workunit.client.0.smithi114.stdout:1/829: symlink df/d13/d44/d9b/d119/l121 0 2024-04-25T02:27:14.739 INFO:tasks.workunit.client.0.smithi114.stdout:7/887: dwrite d5/d32/d4a/d87/f8a [0,4194304] 0 2024-04-25T02:27:14.741 INFO:tasks.workunit.client.0.smithi114.stdout:3/826: readlink d0/d25/d2a/l77 0 2024-04-25T02:27:14.741 INFO:tasks.workunit.client.0.smithi114.stdout:5/887: read d1/d6/de/f1d [1619902,2379] 0 2024-04-25T02:27:14.743 INFO:tasks.workunit.client.0.smithi114.stdout:1/830: stat df/d13/d44/d5a/c90 0 2024-04-25T02:27:14.744 INFO:tasks.workunit.client.0.smithi114.stdout:6/928: truncate de/d27/d34/d4b/d102/d120/fe8 2676875 0 2024-04-25T02:27:14.745 INFO:tasks.workunit.client.0.smithi114.stdout:5/888: mknod d1/d3e/d8e/de5/d82/d8f/c128 0 2024-04-25T02:27:14.749 INFO:tasks.workunit.client.0.smithi114.stdout:0/775: dwrite d1/d30/d4d/f6d [0,4194304] 0 2024-04-25T02:27:14.751 INFO:tasks.workunit.client.0.smithi114.stdout:3/827: rename d0/d25/d2a/f4e to d0/d5/d3d/dd7/dfa/f129 0 2024-04-25T02:27:14.754 INFO:tasks.workunit.client.0.smithi114.stdout:3/828: read d0/d5/d3d/dd7/dfa/f129 [5983654,8621] 0 2024-04-25T02:27:14.756 INFO:tasks.workunit.client.0.smithi114.stdout:0/776: dwrite d1/d7/d18/f3b [0,4194304] 0 2024-04-25T02:27:14.760 INFO:tasks.workunit.client.0.smithi114.stdout:7/888: link d5/d19/d1a/d80/c105 d5/d43/d4e/df2/c125 0 2024-04-25T02:27:14.761 INFO:tasks.workunit.client.0.smithi114.stdout:3/829: creat d0/d25/d29/d60/da8/f12a x:0 0 0 2024-04-25T02:27:14.761 INFO:tasks.workunit.client.0.smithi114.stdout:6/929: creat de/d25/d39/d47/d90/d93/d143/f146 x:0 0 0 2024-04-25T02:27:14.762 INFO:tasks.workunit.client.0.smithi114.stdout:5/889: creat d1/d3e/d8e/de5/f129 x:0 0 0 2024-04-25T02:27:14.763 INFO:tasks.workunit.client.0.smithi114.stdout:3/830: fsync d0/d25/d29/d85/d7e/da9/fde 0 2024-04-25T02:27:14.764 INFO:tasks.workunit.client.0.smithi114.stdout:8/855: dread da/d1e/dcd/fea [0,4194304] 0 2024-04-25T02:27:14.765 INFO:tasks.workunit.client.0.smithi114.stdout:5/890: write d1/d25/d24/fcd [1366009,10356] 0 2024-04-25T02:27:14.766 INFO:tasks.workunit.client.0.smithi114.stdout:6/930: mkdir de/d25/d39/d47/d90/d93/d147 0 2024-04-25T02:27:14.766 INFO:tasks.workunit.client.0.smithi114.stdout:3/831: rmdir d0/d5/d3d/dd7 39 2024-04-25T02:27:14.767 INFO:tasks.workunit.client.0.smithi114.stdout:2/867: dread d5/d1c/d21/ff7 [0,4194304] 0 2024-04-25T02:27:14.767 INFO:tasks.workunit.client.0.smithi114.stdout:5/891: readlink d1/d6/d1a/l40 0 2024-04-25T02:27:14.770 INFO:tasks.workunit.client.0.smithi114.stdout:6/931: creat de/d27/d34/d4b/d102/f148 x:0 0 0 2024-04-25T02:27:14.771 INFO:tasks.workunit.client.0.smithi114.stdout:8/856: truncate da/d32/fc8 824242 0 2024-04-25T02:27:14.772 INFO:tasks.workunit.client.0.smithi114.stdout:7/889: dwrite d5/d19/d1a/daf/f10d [0,4194304] 0 2024-04-25T02:27:14.774 INFO:tasks.workunit.client.0.smithi114.stdout:5/892: truncate d1/d6/d4f/f7a 3153036 0 2024-04-25T02:27:14.774 INFO:tasks.workunit.client.0.smithi114.stdout:8/857: stat da/d38/d62/d6d/fe3 0 2024-04-25T02:27:14.775 INFO:tasks.workunit.client.0.smithi114.stdout:7/890: read - d5/d32/d4a/dbc/f117 zero size 2024-04-25T02:27:14.777 INFO:tasks.workunit.client.0.smithi114.stdout:3/832: dread d0/d25/d29/d85/ff4 [0,4194304] 0 2024-04-25T02:27:14.777 INFO:tasks.workunit.client.0.smithi114.stdout:5/893: chown d1/d3e/db2/cd1 957205 1 2024-04-25T02:27:14.779 INFO:tasks.workunit.client.0.smithi114.stdout:2/868: dwrite d5/df/d63/d8d/fe6 [0,4194304] 0 2024-04-25T02:27:14.780 INFO:tasks.workunit.client.0.smithi114.stdout:5/894: write d1/d6/d4f/fbd [3681662,81120] 0 2024-04-25T02:27:14.781 INFO:tasks.workunit.client.0.smithi114.stdout:8/858: unlink da/d38/db6/de8/fdc 0 2024-04-25T02:27:14.786 INFO:tasks.workunit.client.0.smithi114.stdout:7/891: mknod d5/d43/c126 0 2024-04-25T02:27:14.787 INFO:tasks.workunit.client.0.smithi114.stdout:7/892: truncate d5/d32/d4a/dbc/f115 452294 0 2024-04-25T02:27:14.788 INFO:tasks.workunit.client.0.smithi114.stdout:1/831: truncate df/d13/d75/db8/f69 3766832 0 2024-04-25T02:27:14.791 INFO:tasks.workunit.client.0.smithi114.stdout:4/717: sync 2024-04-25T02:27:14.791 INFO:tasks.workunit.client.0.smithi114.stdout:9/808: sync 2024-04-25T02:27:14.795 INFO:tasks.workunit.client.0.smithi114.stdout:1/832: dwrite df/d13/d1e/f72 [0,4194304] 0 2024-04-25T02:27:14.795 INFO:tasks.workunit.client.0.smithi114.stdout:6/932: link de/d27/d34/d4b/d102/l12b de/d25/d39/d47/d90/l149 0 2024-04-25T02:27:14.800 INFO:tasks.workunit.client.0.smithi114.stdout:8/859: rename da/d38/d62/d6d/d52/f76 to da/d69/d93/f10c 0 2024-04-25T02:27:14.800 INFO:tasks.workunit.client.0.smithi114.stdout:8/860: stat da/f2f 0 2024-04-25T02:27:14.802 INFO:tasks.workunit.client.0.smithi114.stdout:3/833: getdents d0/d25/d29/d85/d7e/da9 0 2024-04-25T02:27:14.805 INFO:tasks.workunit.client.0.smithi114.stdout:4/718: creat d3/d8/d30/d6e/da2/fd9 x:0 0 0 2024-04-25T02:27:14.807 INFO:tasks.workunit.client.0.smithi114.stdout:1/833: creat df/d13/d44/d9b/d119/dd6/d82/de8/dfe/d77/f122 x:0 0 0 2024-04-25T02:27:14.807 INFO:tasks.workunit.client.0.smithi114.stdout:5/895: link d1/d6/d4f/d6c/l97 d1/d25/da1/d10b/l12a 0 2024-04-25T02:27:14.808 INFO:tasks.workunit.client.0.smithi114.stdout:5/896: chown d1/d25/f35 4704 1 2024-04-25T02:27:14.808 INFO:tasks.workunit.client.0.smithi114.stdout:2/869: dread d5/df/f53 [0,4194304] 0 2024-04-25T02:27:14.809 INFO:tasks.workunit.client.0.smithi114.stdout:0/777: sync 2024-04-25T02:27:14.809 INFO:tasks.workunit.client.0.smithi114.stdout:8/861: unlink da/d32/cbe 0 2024-04-25T02:27:14.810 INFO:tasks.workunit.client.0.smithi114.stdout:0/778: write d1/d7/d46/fbd [2680499,39649] 0 2024-04-25T02:27:14.811 INFO:tasks.workunit.client.0.smithi114.stdout:6/933: mknod de/d25/d39/d47/d90/c14a 0 2024-04-25T02:27:14.812 INFO:tasks.workunit.client.0.smithi114.stdout:5/897: mkdir d1/d51/d6f/d12b 0 2024-04-25T02:27:14.814 INFO:tasks.workunit.client.0.smithi114.stdout:3/834: link d0/d25/d29/d85/f51 d0/d25/d2a/d80/dbd/f12b 0 2024-04-25T02:27:14.817 INFO:tasks.workunit.client.0.smithi114.stdout:2/870: symlink d5/df/d3d/d83/l116 0 2024-04-25T02:27:14.818 INFO:tasks.workunit.client.0.smithi114.stdout:5/898: symlink d1/d6/de/da7/ddf/dc5/dfd/dc1/l12c 0 2024-04-25T02:27:14.819 INFO:tasks.workunit.client.0.smithi114.stdout:1/834: dread df/d11/d32/f3c [0,4194304] 0 2024-04-25T02:27:14.819 INFO:tasks.workunit.client.0.smithi114.stdout:7/893: dread d5/d19/d23/f3f [0,4194304] 0 2024-04-25T02:27:14.820 INFO:tasks.workunit.client.0.smithi114.stdout:5/899: write d1/d53/f7c [3066008,22138] 0 2024-04-25T02:27:14.821 INFO:tasks.workunit.client.0.smithi114.stdout:9/809: dread d8/d16/d21/f41 [0,4194304] 0 2024-04-25T02:27:14.821 INFO:tasks.workunit.client.0.smithi114.stdout:7/894: truncate d5/d32/da6/f11f 466507 0 2024-04-25T02:27:14.823 INFO:tasks.workunit.client.0.smithi114.stdout:4/719: rename d3/d8/d12/d19/d26/d3e/daa/dce/l5d to d3/d8/d30/lda 0 2024-04-25T02:27:14.826 INFO:tasks.workunit.client.0.smithi114.stdout:3/835: link d0/d25/d2a/d34/d9e/ff5 d0/d25/d2a/d80/f12c 0 2024-04-25T02:27:14.827 INFO:tasks.workunit.client.0.smithi114.stdout:3/836: readlink d0/d25/d29/d85/d7e/lca 0 2024-04-25T02:27:14.828 INFO:tasks.workunit.client.0.smithi114.stdout:4/720: dwrite d3/d8/d12/f6d [0,4194304] 0 2024-04-25T02:27:14.828 INFO:tasks.workunit.client.0.smithi114.stdout:5/900: creat d1/d3e/d8e/de5/d82/d8f/f12d x:0 0 0 2024-04-25T02:27:14.832 INFO:tasks.workunit.client.0.smithi114.stdout:6/934: creat de/d25/d39/d47/f14b x:0 0 0 2024-04-25T02:27:14.836 INFO:tasks.workunit.client.0.smithi114.stdout:8/862: getdents da/d38/d62/d6d/d49/d65 0 2024-04-25T02:27:14.837 INFO:tasks.workunit.client.0.smithi114.stdout:3/837: mknod d0/d25/d2a/d80/c12d 0 2024-04-25T02:27:14.838 INFO:tasks.workunit.client.0.smithi114.stdout:3/838: dread - d0/d25/d29/dcb/fec zero size 2024-04-25T02:27:14.840 INFO:tasks.workunit.client.0.smithi114.stdout:7/895: mkdir d5/d19/d1a/da4/db3/d106/d127 0 2024-04-25T02:27:14.841 INFO:tasks.workunit.client.0.smithi114.stdout:4/721: readlink d3/d8/d30/lda 0 2024-04-25T02:27:14.841 INFO:tasks.workunit.client.0.smithi114.stdout:4/722: read - d3/fbc zero size 2024-04-25T02:27:14.842 INFO:tasks.workunit.client.0.smithi114.stdout:9/810: mknod d8/d16/d21/d37/d43/d75/d8a/c103 0 2024-04-25T02:27:14.842 INFO:tasks.workunit.client.0.smithi114.stdout:4/723: fdatasync d3/d8/d30/d4c/d7f/d8d/f9c 0 2024-04-25T02:27:14.844 INFO:tasks.workunit.client.0.smithi114.stdout:2/871: creat d5/d6/d58/f117 x:0 0 0 2024-04-25T02:27:14.846 INFO:tasks.workunit.client.0.smithi114.stdout:8/863: rmdir da/d38/d62/d6d/d52 39 2024-04-25T02:27:14.848 INFO:tasks.workunit.client.0.smithi114.stdout:5/901: creat d1/d25/da1/d8a/d11c/f12e x:0 0 0 2024-04-25T02:27:14.848 INFO:tasks.workunit.client.0.smithi114.stdout:3/839: mknod d0/d25/d2a/d80/d10e/c12e 0 2024-04-25T02:27:14.849 INFO:tasks.workunit.client.0.smithi114.stdout:4/724: dwrite d3/d8/d12/d19/d26/f2a [0,4194304] 0 2024-04-25T02:27:14.851 INFO:tasks.workunit.client.0.smithi114.stdout:4/725: readlink d3/d8/d12/d19/d26/l88 0 2024-04-25T02:27:14.851 INFO:tasks.workunit.client.0.smithi114.stdout:4/726: fsync d3/db9/fcd 0 2024-04-25T02:27:14.852 INFO:tasks.workunit.client.0.smithi114.stdout:0/779: rename d1/d4/d37/cb3 to d1/cec 0 2024-04-25T02:27:14.853 INFO:tasks.workunit.client.0.smithi114.stdout:0/780: fsync d1/d7/d46/fe4 0 2024-04-25T02:27:14.853 INFO:tasks.workunit.client.0.smithi114.stdout:4/727: write d3/d8/d12/d19/d26/d3e/daa/f83 [658228,73148] 0 2024-04-25T02:27:14.854 INFO:tasks.workunit.client.0.smithi114.stdout:9/811: creat d8/d16/d21/d37/d43/d75/d8a/f104 x:0 0 0 2024-04-25T02:27:14.857 INFO:tasks.workunit.client.0.smithi114.stdout:2/872: readlink d5/df/d63/d8d/lcc 0 2024-04-25T02:27:14.859 INFO:tasks.workunit.client.0.smithi114.stdout:2/873: readlink d5/df/l4f 0 2024-04-25T02:27:14.859 INFO:tasks.workunit.client.0.smithi114.stdout:8/864: unlink da/d1e/f8f 0 2024-04-25T02:27:14.859 INFO:tasks.workunit.client.0.smithi114.stdout:7/896: dread d5/d19/d1a/daf/ff7 [0,4194304] 0 2024-04-25T02:27:14.860 INFO:tasks.workunit.client.0.smithi114.stdout:1/835: write df/d13/d75/db8/f69 [2409768,38053] 0 2024-04-25T02:27:14.860 INFO:tasks.workunit.client.0.smithi114.stdout:6/935: dwrite de/d27/d34/d4b/fc4 [0,4194304] 0 2024-04-25T02:27:14.862 INFO:tasks.workunit.client.0.smithi114.stdout:0/781: fsync d1/f2c 0 2024-04-25T02:27:14.863 INFO:tasks.workunit.client.0.smithi114.stdout:6/936: truncate de/d25/fef 584284 0 2024-04-25T02:27:14.877 INFO:tasks.workunit.client.0.smithi114.stdout:8/865: creat da/d69/d93/d6b/dbb/f10d x:0 0 0 2024-04-25T02:27:14.881 INFO:tasks.workunit.client.0.smithi114.stdout:2/874: dwrite d5/df/f45 [0,4194304] 0 2024-04-25T02:27:14.881 INFO:tasks.workunit.client.0.smithi114.stdout:3/840: rename d0/d25/d29/d60/da8/dc8/ff2 to d0/d25/d29/d60/f12f 0 2024-04-25T02:27:14.884 INFO:tasks.workunit.client.0.smithi114.stdout:9/812: creat d8/d16/d21/d37/d43/d75/f105 x:0 0 0 2024-04-25T02:27:14.885 INFO:tasks.workunit.client.0.smithi114.stdout:4/728: getdents d3/d8/d12/d19/d26/d3e/daa/d89 0 2024-04-25T02:27:14.885 INFO:tasks.workunit.client.0.smithi114.stdout:8/866: mknod da/c10e 0 2024-04-25T02:27:14.885 INFO:tasks.workunit.client.0.smithi114.stdout:1/836: link df/d13/d75/d8e/lf5 df/d13/d44/d9b/d119/dd6/d82/l123 0 2024-04-25T02:27:14.888 INFO:tasks.workunit.client.0.smithi114.stdout:4/729: readlink d3/d8/l41 0 2024-04-25T02:27:14.889 INFO:tasks.workunit.client.0.smithi114.stdout:8/867: dread - da/d1e/ff5 zero size 2024-04-25T02:27:14.890 INFO:tasks.workunit.client.0.smithi114.stdout:0/782: dwrite d1/d4/da/f16 [0,4194304] 0 2024-04-25T02:27:14.893 INFO:tasks.workunit.client.0.smithi114.stdout:6/937: dwrite de/d27/d34/d4b/d102/f144 [0,4194304] 0 2024-04-25T02:27:14.893 INFO:tasks.workunit.client.0.smithi114.stdout:5/902: dwrite d1/d53/d55/db1/fdb [0,4194304] 0 2024-04-25T02:27:14.894 INFO:tasks.workunit.client.0.smithi114.stdout:8/868: write da/d1e/ff5 [624827,109341] 0 2024-04-25T02:27:14.896 INFO:tasks.workunit.client.0.smithi114.stdout:3/841: getdents d0/d25/d29/d60 0 2024-04-25T02:27:14.898 INFO:tasks.workunit.client.0.smithi114.stdout:1/837: fdatasync df/d13/d44/d5a/dc9/d33/d47/f5e 0 2024-04-25T02:27:14.898 INFO:tasks.workunit.client.0.smithi114.stdout:2/875: dwrite d5/df/d2c/f64 [0,4194304] 0 2024-04-25T02:27:14.900 INFO:tasks.workunit.client.0.smithi114.stdout:9/813: unlink d8/d16/d21/dfb/d39/ddf/cd5 0 2024-04-25T02:27:14.904 INFO:tasks.workunit.client.0.smithi114.stdout:8/869: rename da/l7a to da/d32/l10f 0 2024-04-25T02:27:14.906 INFO:tasks.workunit.client.0.smithi114.stdout:3/842: fdatasync d0/f16 0 2024-04-25T02:27:14.906 INFO:tasks.workunit.client.0.smithi114.stdout:1/838: stat df/d11/f28 0 2024-04-25T02:27:14.907 INFO:tasks.workunit.client.0.smithi114.stdout:9/814: dwrite d8/d16/d21/d37/fec [0,4194304] 0 2024-04-25T02:27:14.907 INFO:tasks.workunit.client.0.smithi114.stdout:4/730: creat d3/d8/d30/d6e/dcf/fdb x:0 0 0 2024-04-25T02:27:14.909 INFO:tasks.workunit.client.0.smithi114.stdout:9/815: dread - d8/d16/d21/dfb/d39/f100 zero size 2024-04-25T02:27:14.910 INFO:tasks.workunit.client.0.smithi114.stdout:2/876: rename d5/d1c/d21/d91 to d5/d1c/d22/d89/d118 0 2024-04-25T02:27:14.912 INFO:tasks.workunit.client.0.smithi114.stdout:3/843: fsync d0/d25/d2a/d80/f12c 0 2024-04-25T02:27:14.913 INFO:tasks.workunit.client.0.smithi114.stdout:1/839: mkdir df/d11/d7d/df9/d107/d124 0 2024-04-25T02:27:14.915 INFO:tasks.workunit.client.0.smithi114.stdout:9/816: creat d8/d16/d21/dfb/d39/dab/f106 x:0 0 0 2024-04-25T02:27:14.916 INFO:tasks.workunit.client.0.smithi114.stdout:2/877: mkdir d5/daf/dda/de1/d119 0 2024-04-25T02:27:14.916 INFO:tasks.workunit.client.0.smithi114.stdout:7/897: sync 2024-04-25T02:27:14.918 INFO:tasks.workunit.client.0.smithi114.stdout:8/870: creat da/f110 x:0 0 0 2024-04-25T02:27:14.919 INFO:tasks.workunit.client.0.smithi114.stdout:3/844: dread d0/d25/d29/d85/d7e/da9/f109 [0,4194304] 0 2024-04-25T02:27:14.920 INFO:tasks.workunit.client.0.smithi114.stdout:9/817: creat d8/d16/d21/d95/f107 x:0 0 0 2024-04-25T02:27:14.920 INFO:tasks.workunit.client.0.smithi114.stdout:2/878: creat d5/df/d1e/f11a x:0 0 0 2024-04-25T02:27:14.921 INFO:tasks.workunit.client.0.smithi114.stdout:2/879: chown d5/d1c/d21 0 1 2024-04-25T02:27:14.921 INFO:tasks.workunit.client.0.smithi114.stdout:9/818: chown d8/d16/d21/d37/d43/d75/d8a/l9c 3240977 1 2024-04-25T02:27:14.921 INFO:tasks.workunit.client.0.smithi114.stdout:7/898: rmdir d5/d8b/d99/dae 39 2024-04-25T02:27:14.924 INFO:tasks.workunit.client.0.smithi114.stdout:3/845: chown d0/d25/d2a/d34/d9e/c118 25007 1 2024-04-25T02:27:14.924 INFO:tasks.workunit.client.0.smithi114.stdout:9/819: rmdir d8 39 2024-04-25T02:27:14.925 INFO:tasks.workunit.client.0.smithi114.stdout:4/731: getdents d3/d8/d23/d25/d4e 0 2024-04-25T02:27:14.925 INFO:tasks.workunit.client.0.smithi114.stdout:3/846: chown d0/d25/d29/d85/d7e/lca 1036266726 1 2024-04-25T02:27:14.927 INFO:tasks.workunit.client.0.smithi114.stdout:3/847: truncate d0/d25/d2a/d80/fcf 442806 0 2024-04-25T02:27:14.928 INFO:tasks.workunit.client.0.smithi114.stdout:2/880: link d5/df/d63/fe7 d5/d6/d58/d5a/d59/f11b 0 2024-04-25T02:27:14.928 INFO:tasks.workunit.client.0.smithi114.stdout:3/848: write d0/d25/d29/d78/f82 [2085806,9491] 0 2024-04-25T02:27:14.931 INFO:tasks.workunit.client.0.smithi114.stdout:4/732: link d3/d8/d30/d93/fc8 d3/d8/d12/d19/d42/d58/fdc 0 2024-04-25T02:27:14.933 INFO:tasks.workunit.client.0.smithi114.stdout:2/881: creat d5/d1c/d21/db0/f11c x:0 0 0 2024-04-25T02:27:14.933 INFO:tasks.workunit.client.0.smithi114.stdout:9/820: dwrite d8/d16/d21/d24/d3c/f6b [0,4194304] 0 2024-04-25T02:27:14.937 INFO:tasks.workunit.client.0.smithi114.stdout:2/882: unlink d5/d6/d31/f32 0 2024-04-25T02:27:14.942 INFO:tasks.workunit.client.0.smithi114.stdout:9/821: rename d8/d16/d21/d37/d60/d70/ff1 to d8/d16/d21/d37/f108 0 2024-04-25T02:27:14.942 INFO:tasks.workunit.client.0.smithi114.stdout:6/938: write de/d25/d39/d47/d90/f135 [800876,90790] 0 2024-04-25T02:27:14.943 INFO:tasks.workunit.client.0.smithi114.stdout:6/939: fsync de/d25/fef 0 2024-04-25T02:27:14.943 INFO:tasks.workunit.client.0.smithi114.stdout:2/883: rmdir d5/df/d63/d8d 39 2024-04-25T02:27:14.946 INFO:tasks.workunit.client.0.smithi114.stdout:6/940: rmdir de/d25/d39/d47/d90/d93 39 2024-04-25T02:27:14.947 INFO:tasks.workunit.client.0.smithi114.stdout:5/903: dread d1/d6/de/f44 [0,4194304] 0 2024-04-25T02:27:14.947 INFO:tasks.workunit.client.0.smithi114.stdout:6/941: write de/d27/d34/d4b/fc4 [1636807,81631] 0 2024-04-25T02:27:14.948 INFO:tasks.workunit.client.0.smithi114.stdout:2/884: mkdir d5/d6/d11d 0 2024-04-25T02:27:14.950 INFO:tasks.workunit.client.0.smithi114.stdout:6/942: mkdir de/d1c/df7/d14c 0 2024-04-25T02:27:14.952 INFO:tasks.workunit.client.0.smithi114.stdout:5/904: mkdir d1/d3e/d8e/de5/d82/d12f 0 2024-04-25T02:27:14.956 INFO:tasks.workunit.client.0.smithi114.stdout:6/943: creat de/d27/d34/dff/d133/f14d x:0 0 0 2024-04-25T02:27:14.958 INFO:tasks.workunit.client.0.smithi114.stdout:0/783: sync 2024-04-25T02:27:14.961 INFO:tasks.workunit.client.0.smithi114.stdout:5/905: link d1/d6/de/da7/ddf/fc2 d1/d3e/d8e/de5/d82/f130 0 2024-04-25T02:27:14.961 INFO:tasks.workunit.client.0.smithi114.stdout:1/840: truncate df/d2a/f2e 2223732 0 2024-04-25T02:27:14.962 INFO:tasks.workunit.client.0.smithi114.stdout:5/906: stat d1/d51/d6f/d12b 0 2024-04-25T02:27:14.962 INFO:tasks.workunit.client.0.smithi114.stdout:6/944: fdatasync de/d25/d39/f51 0 2024-04-25T02:27:14.962 INFO:tasks.workunit.client.0.smithi114.stdout:7/899: write d5/d32/d64/f67 [3022591,123059] 0 2024-04-25T02:27:14.963 INFO:tasks.workunit.client.0.smithi114.stdout:6/945: dread - de/d27/f8f zero size 2024-04-25T02:27:14.964 INFO:tasks.workunit.client.0.smithi114.stdout:5/907: readlink d1/d6/de/da7/ddf/lda 0 2024-04-25T02:27:14.964 INFO:tasks.workunit.client.0.smithi114.stdout:2/885: rename d5/d6/d58 to d5/df/d3d/d44/d11e 0 2024-04-25T02:27:14.965 INFO:tasks.workunit.client.0.smithi114.stdout:1/841: mknod df/d13/d93/df7/c125 0 2024-04-25T02:27:14.966 INFO:tasks.workunit.client.0.smithi114.stdout:2/886: readlink d5/d6/l2d 0 2024-04-25T02:27:14.966 INFO:tasks.workunit.client.0.smithi114.stdout:6/946: chown de/d27/d34/l52 10 1 2024-04-25T02:27:14.967 INFO:tasks.workunit.client.0.smithi114.stdout:0/784: rename d1/d7/f56 to d1/d7/d18/fed 0 2024-04-25T02:27:14.969 INFO:tasks.workunit.client.0.smithi114.stdout:8/871: dwrite da/d1e/f96 [0,4194304] 0 2024-04-25T02:27:14.969 INFO:tasks.workunit.client.0.smithi114.stdout:7/900: dread d5/d8b/fc6 [0,4194304] 0 2024-04-25T02:27:14.970 INFO:tasks.workunit.client.0.smithi114.stdout:3/849: write d0/d5/f44 [132372,963] 0 2024-04-25T02:27:14.970 INFO:tasks.workunit.client.0.smithi114.stdout:0/785: chown d1/d4/da/l38 341 1 2024-04-25T02:27:14.971 INFO:tasks.workunit.client.0.smithi114.stdout:1/842: symlink df/d13/d44/d5a/dc9/d33/d47/l126 0 2024-04-25T02:27:14.971 INFO:tasks.workunit.client.0.smithi114.stdout:7/901: chown d5/d8b/d99/ddb 78 1 2024-04-25T02:27:14.972 INFO:tasks.workunit.client.0.smithi114.stdout:8/872: write da/d38/d62/d6d/fe3 [437398,125755] 0 2024-04-25T02:27:14.978 INFO:tasks.workunit.client.0.smithi114.stdout:0/786: dwrite d1/d4/db4/fbe [0,4194304] 0 2024-04-25T02:27:14.978 INFO:tasks.workunit.client.0.smithi114.stdout:1/843: unlink df/d11/d7d/df9/d107/c117 0 2024-04-25T02:27:14.982 INFO:tasks.workunit.client.0.smithi114.stdout:7/902: creat d5/d32/da6/db5/db9/f128 x:0 0 0 2024-04-25T02:27:14.984 INFO:tasks.workunit.client.0.smithi114.stdout:3/850: creat d0/d25/d2a/d34/d125/f130 x:0 0 0 2024-04-25T02:27:14.985 INFO:tasks.workunit.client.0.smithi114.stdout:3/851: stat d0/f21 0 2024-04-25T02:27:14.988 INFO:tasks.workunit.client.0.smithi114.stdout:0/787: mknod d1/d4/da/d39/da7/cee 0 2024-04-25T02:27:14.990 INFO:tasks.workunit.client.0.smithi114.stdout:1/844: mkdir df/d13/d44/d5a/dc9/d43/d106/d127 0 2024-04-25T02:27:14.993 INFO:tasks.workunit.client.0.smithi114.stdout:5/908: rename d1/d3e/db2/dd4 to d1/d51/d131 0 2024-04-25T02:27:14.994 INFO:tasks.workunit.client.0.smithi114.stdout:7/903: mkdir d5/d32/d129 0 2024-04-25T02:27:14.997 INFO:tasks.workunit.client.0.smithi114.stdout:1/845: dwrite df/d11/d32/f7c [4194304,4194304] 0 2024-04-25T02:27:14.997 INFO:tasks.workunit.client.0.smithi114.stdout:0/788: mkdir d1/d4/d37/def 0 2024-04-25T02:27:15.004 INFO:tasks.workunit.client.0.smithi114.stdout:8/873: getdents da/d38/db6 0 2024-04-25T02:27:15.005 INFO:tasks.workunit.client.0.smithi114.stdout:3/852: creat d0/d25/d2a/f131 x:0 0 0 2024-04-25T02:27:15.009 INFO:tasks.workunit.client.0.smithi114.stdout:2/887: dwrite d5/df/d3d/d44/d11e/f5f [0,4194304] 0 2024-04-25T02:27:15.009 INFO:tasks.workunit.client.0.smithi114.stdout:4/733: sync 2024-04-25T02:27:15.010 INFO:tasks.workunit.client.0.smithi114.stdout:5/909: dwrite d1/d6/d1a/d7f/dd9/ff9 [0,4194304] 0 2024-04-25T02:27:15.011 INFO:tasks.workunit.client.0.smithi114.stdout:0/789: mknod d1/d4/da/cf0 0 2024-04-25T02:27:15.011 INFO:tasks.workunit.client.0.smithi114.stdout:6/947: dwrite de/d25/d39/f5e [0,4194304] 0 2024-04-25T02:27:15.012 INFO:tasks.workunit.client.0.smithi114.stdout:5/910: read d1/d25/f63 [4147982,32642] 0 2024-04-25T02:27:15.013 INFO:tasks.workunit.client.0.smithi114.stdout:4/734: write d3/d8/d12/f6d [2011999,118523] 0 2024-04-25T02:27:15.015 INFO:tasks.workunit.client.0.smithi114.stdout:4/735: chown d3/d8/d12/d19/d26/d3e/daa/l48 46 1 2024-04-25T02:27:15.017 INFO:tasks.workunit.client.0.smithi114.stdout:8/874: creat da/d38/db6/f111 x:0 0 0 2024-04-25T02:27:15.017 INFO:tasks.workunit.client.0.smithi114.stdout:7/904: getdents d5/d32/d64/dff 0 2024-04-25T02:27:15.022 INFO:tasks.workunit.client.0.smithi114.stdout:1/846: rename df/d11/c48 to df/d13/d44/d5a/dc9/d43/d106/d127/c128 0 2024-04-25T02:27:15.025 INFO:tasks.workunit.client.0.smithi114.stdout:0/790: read d1/d7/d46/f87 [668252,111562] 0 2024-04-25T02:27:15.026 INFO:tasks.workunit.client.0.smithi114.stdout:5/911: dwrite d1/d6/f127 [0,4194304] 0 2024-04-25T02:27:15.027 INFO:tasks.workunit.client.0.smithi114.stdout:7/905: creat d5/d19/d1a/da4/db3/d106/f12a x:0 0 0 2024-04-25T02:27:15.028 INFO:tasks.workunit.client.0.smithi114.stdout:2/888: dwrite d5/df/d3d/d44/d11e/d5a/d3e/d54/f10b [0,4194304] 0 2024-04-25T02:27:15.030 INFO:tasks.workunit.client.0.smithi114.stdout:4/736: dwrite d3/d8/f1b [0,4194304] 0 2024-04-25T02:27:15.030 INFO:tasks.workunit.client.0.smithi114.stdout:0/791: dread - d1/d4/da/d39/fe6 zero size 2024-04-25T02:27:15.033 INFO:tasks.workunit.client.0.smithi114.stdout:8/875: read da/d38/d62/d6d/d52/d6c/f8b [4825426,56588] 0 2024-04-25T02:27:15.034 INFO:tasks.workunit.client.0.smithi114.stdout:5/912: symlink d1/d6/d1a/d7f/l132 0 2024-04-25T02:27:15.034 INFO:tasks.workunit.client.0.smithi114.stdout:8/876: fdatasync da/d38/d62/d6d/d49/f99 0 2024-04-25T02:27:15.036 INFO:tasks.workunit.client.0.smithi114.stdout:2/889: write d5/df/d3d/d44/d11e/d5a/fc1 [1774195,5929] 0 2024-04-25T02:27:15.038 INFO:tasks.workunit.client.0.smithi114.stdout:0/792: mknod d1/d4/d4f/da9/cf1 0 2024-04-25T02:27:15.041 INFO:tasks.workunit.client.0.smithi114.stdout:4/737: unlink d3/d8/d12/d19/d26/d3e/daa/lc5 0 2024-04-25T02:27:15.041 INFO:tasks.workunit.client.0.smithi114.stdout:2/890: read d5/df/d3d/d44/fe4 [58950,46561] 0 2024-04-25T02:27:15.042 INFO:tasks.workunit.client.0.smithi114.stdout:1/847: getdents df/d13/d44/d9b/d119/dd6/d82/de8/dfe/d77/dc0/d114 0 2024-04-25T02:27:15.043 INFO:tasks.workunit.client.0.smithi114.stdout:9/822: sync 2024-04-25T02:27:15.044 INFO:tasks.workunit.client.0.smithi114.stdout:8/877: symlink da/d1e/dcd/dd3/l112 0 2024-04-25T02:27:15.045 INFO:tasks.workunit.client.0.smithi114.stdout:6/948: dread de/d25/f50 [0,4194304] 0 2024-04-25T02:27:15.045 INFO:tasks.workunit.client.0.smithi114.stdout:0/793: rmdir d1/d4/db4 39 2024-04-25T02:27:15.046 INFO:tasks.workunit.client.0.smithi114.stdout:6/949: chown de/d1c 4563 1 2024-04-25T02:27:15.046 INFO:tasks.workunit.client.0.smithi114.stdout:0/794: fdatasync d1/d7/d18/f22 0 2024-04-25T02:27:15.047 INFO:tasks.workunit.client.0.smithi114.stdout:2/891: creat d5/d1c/d29/de0/d114/f11f x:0 0 0 2024-04-25T02:27:15.051 INFO:tasks.workunit.client.0.smithi114.stdout:6/950: fsync de/d27/d34/d44/d91/f117 0 2024-04-25T02:27:15.051 INFO:tasks.workunit.client.0.smithi114.stdout:0/795: mknod d1/d4/d4f/d77/da1/cf2 0 2024-04-25T02:27:15.053 INFO:tasks.workunit.client.0.smithi114.stdout:0/796: read d1/d30/d4d/f6d [302315,88400] 0 2024-04-25T02:27:15.053 INFO:tasks.workunit.client.0.smithi114.stdout:8/878: creat da/d38/db6/de8/dfc/f113 x:0 0 0 2024-04-25T02:27:15.054 INFO:tasks.workunit.client.0.smithi114.stdout:3/853: dwrite d0/d5/f28 [0,4194304] 0 2024-04-25T02:27:15.058 INFO:tasks.workunit.client.0.smithi114.stdout:9/823: link d8/d16/d21/d95/f107 d8/d16/d21/d37/d43/f109 0 2024-04-25T02:27:15.058 INFO:tasks.workunit.client.0.smithi114.stdout:6/951: mknod de/d27/d34/c14e 0 2024-04-25T02:27:15.060 INFO:tasks.workunit.client.0.smithi114.stdout:8/879: symlink da/d38/db6/de8/l114 0 2024-04-25T02:27:15.063 INFO:tasks.workunit.client.0.smithi114.stdout:9/824: unlink d8/d16/f28 0 2024-04-25T02:27:15.065 INFO:tasks.workunit.client.0.smithi114.stdout:3/854: creat d0/d25/d2a/d80/dbd/d124/f132 x:0 0 0 2024-04-25T02:27:15.065 INFO:tasks.workunit.client.0.smithi114.stdout:0/797: dwrite d1/f27 [0,4194304] 0 2024-04-25T02:27:15.067 INFO:tasks.workunit.client.0.smithi114.stdout:0/798: stat d1/d7/d68/d69/fb2 0 2024-04-25T02:27:15.069 INFO:tasks.workunit.client.0.smithi114.stdout:3/855: creat d0/d25/d2a/d80/dbd/f133 x:0 0 0 2024-04-25T02:27:15.069 INFO:tasks.workunit.client.0.smithi114.stdout:6/952: link de/d27/d34/d44/d91/cc2 de/d1c/df7/d14c/c14f 0 2024-04-25T02:27:15.071 INFO:tasks.workunit.client.0.smithi114.stdout:9/825: mknod d8/d16/d21/d24/d3c/c10a 0 2024-04-25T02:27:15.071 INFO:tasks.workunit.client.0.smithi114.stdout:6/953: read de/d27/d34/d44/d91/f117 [584199,9335] 0 2024-04-25T02:27:15.074 INFO:tasks.workunit.client.0.smithi114.stdout:0/799: mkdir d1/d4/d24/d52/da2/dd4/df3 0 2024-04-25T02:27:15.076 INFO:tasks.workunit.client.0.smithi114.stdout:3/856: dwrite d0/d25/d29/d78/f103 [0,4194304] 0 2024-04-25T02:27:15.076 INFO:tasks.workunit.client.0.smithi114.stdout:9/826: mkdir d8/d16/d21/dfb/d39/d38/d46/d10b 0 2024-04-25T02:27:15.078 INFO:tasks.workunit.client.0.smithi114.stdout:9/827: write d8/d16/d21/d24/d69/faa [457311,117732] 0 2024-04-25T02:27:15.078 INFO:tasks.workunit.client.0.smithi114.stdout:6/954: mkdir de/d2a/db9/dc7/d150 0 2024-04-25T02:27:15.079 INFO:tasks.workunit.client.0.smithi114.stdout:0/800: creat d1/d4/d37/d6a/ff4 x:0 0 0 2024-04-25T02:27:15.081 INFO:tasks.workunit.client.0.smithi114.stdout:6/955: symlink de/d27/d76/l151 0 2024-04-25T02:27:15.082 INFO:tasks.workunit.client.0.smithi114.stdout:9/828: rmdir d8/d16/d21/d24/df2 39 2024-04-25T02:27:15.082 INFO:tasks.workunit.client.0.smithi114.stdout:7/906: write d5/d19/d1a/d80/f9f [85494,125274] 0 2024-04-25T02:27:15.086 INFO:tasks.workunit.client.0.smithi114.stdout:3/857: mkdir d0/d25/d2a/d134 0 2024-04-25T02:27:15.088 INFO:tasks.workunit.client.0.smithi114.stdout:7/907: rename d5/d32/d4a/d51 to d5/d32/d64/dff/d12b 0 2024-04-25T02:27:15.090 INFO:tasks.workunit.client.0.smithi114.stdout:6/956: truncate de/d2a/f2b 4209767 0 2024-04-25T02:27:15.091 INFO:tasks.workunit.client.0.smithi114.stdout:7/908: mkdir d5/d32/d4a/d87/d12c 0 2024-04-25T02:27:15.092 INFO:tasks.workunit.client.0.smithi114.stdout:1/848: write df/d13/d44/d9b/d119/dd6/d82/de8/dfe/f55 [4363389,75889] 0 2024-04-25T02:27:15.092 INFO:tasks.workunit.client.0.smithi114.stdout:6/957: rmdir de/d2a/db9/dc7 39 2024-04-25T02:27:15.093 INFO:tasks.workunit.client.0.smithi114.stdout:9/829: dread d8/da8/fbf [0,4194304] 0 2024-04-25T02:27:15.093 INFO:tasks.workunit.client.0.smithi114.stdout:4/738: truncate d3/d8/d12/d19/d26/f2a 3703189 0 2024-04-25T02:27:15.095 INFO:tasks.workunit.client.0.smithi114.stdout:7/909: dread - d5/d19/d23/d6f/f9b zero size 2024-04-25T02:27:15.098 INFO:tasks.workunit.client.0.smithi114.stdout:4/739: fsync d3/d8/d30/d6e/dcf/fdb 0 2024-04-25T02:27:15.099 INFO:tasks.workunit.client.0.smithi114.stdout:3/858: dwrite d0/d25/f62 [4194304,4194304] 0 2024-04-25T02:27:15.101 INFO:tasks.workunit.client.0.smithi114.stdout:8/880: truncate da/d38/db6/de8/f3f 3639458 0 2024-04-25T02:27:15.104 INFO:tasks.workunit.client.0.smithi114.stdout:3/859: chown d0/d5/d3d/fa5 255386 1 2024-04-25T02:27:15.104 INFO:tasks.workunit.client.0.smithi114.stdout:2/892: dwrite d5/d6/fab [0,4194304] 0 2024-04-25T02:27:15.104 INFO:tasks.workunit.client.0.smithi114.stdout:1/849: link df/d11/c85 df/d11/d7d/df9/c129 0 2024-04-25T02:27:15.105 INFO:tasks.workunit.client.0.smithi114.stdout:1/850: chown fe 3834 1 2024-04-25T02:27:15.106 INFO:tasks.workunit.client.0.smithi114.stdout:8/881: chown da/d69/d93/d6b/lb7 0 1 2024-04-25T02:27:15.108 INFO:tasks.workunit.client.0.smithi114.stdout:5/913: sync 2024-04-25T02:27:15.109 INFO:tasks.workunit.client.0.smithi114.stdout:0/801: write d1/d4/da/d3e/fbb [188834,28709] 0 2024-04-25T02:27:15.120 INFO:tasks.workunit.client.0.smithi114.stdout:8/882: fsync da/d38/db6/de8/fa2 0 2024-04-25T02:27:15.121 INFO:tasks.workunit.client.0.smithi114.stdout:3/860: rename d0/d5/d3d/dd7/dfa/f129 to d0/d25/d29/d8c/f135 0 2024-04-25T02:27:15.123 INFO:tasks.workunit.client.0.smithi114.stdout:4/740: dwrite d3/d8/d12/d19/d26/d3e/daa/f83 [0,4194304] 0 2024-04-25T02:27:15.123 INFO:tasks.workunit.client.0.smithi114.stdout:9/830: dread d8/d16/d21/f26 [0,4194304] 0 2024-04-25T02:27:15.125 INFO:tasks.workunit.client.0.smithi114.stdout:6/958: dread de/ff [0,4194304] 0 2024-04-25T02:27:15.127 INFO:tasks.workunit.client.0.smithi114.stdout:8/883: write da/d38/db6/de8/f92 [49265,2401] 0 2024-04-25T02:27:15.128 INFO:tasks.workunit.client.0.smithi114.stdout:4/741: symlink d3/db9/ldd 0 2024-04-25T02:27:15.129 INFO:tasks.workunit.client.0.smithi114.stdout:1/851: dwrite df/d13/d44/d5a/dc9/d33/d47/f5e [0,4194304] 0 2024-04-25T02:27:15.129 INFO:tasks.workunit.client.0.smithi114.stdout:5/914: getdents d1/d6/d4f/d6c/d88/db6 0 2024-04-25T02:27:15.130 INFO:tasks.workunit.client.0.smithi114.stdout:9/831: symlink d8/d16/d21/d24/d3c/d40/l10c 0 2024-04-25T02:27:15.132 INFO:tasks.workunit.client.0.smithi114.stdout:4/742: mkdir d3/d8/d12/d82/dde 0 2024-04-25T02:27:15.134 INFO:tasks.workunit.client.0.smithi114.stdout:5/915: mkdir d1/d3e/d8e/de5/d82/d8f/d133 0 2024-04-25T02:27:15.134 INFO:tasks.workunit.client.0.smithi114.stdout:3/861: read d0/d5/d3d/f75 [1020830,87254] 0 2024-04-25T02:27:15.134 INFO:tasks.workunit.client.0.smithi114.stdout:4/743: write d3/d8/d30/d4c/fab [167821,71922] 0 2024-04-25T02:27:15.136 INFO:tasks.workunit.client.0.smithi114.stdout:1/852: mkdir df/d11/d7d/d12a 0 2024-04-25T02:27:15.137 INFO:tasks.workunit.client.0.smithi114.stdout:9/832: mknod d8/d16/d21/dfb/d39/d38/c10d 0 2024-04-25T02:27:15.137 INFO:tasks.workunit.client.0.smithi114.stdout:1/853: chown df/d13/d44 826901 1 2024-04-25T02:27:15.138 INFO:tasks.workunit.client.0.smithi114.stdout:6/959: read de/d27/d34/d44/f71 [182338,29964] 0 2024-04-25T02:27:15.139 INFO:tasks.workunit.client.0.smithi114.stdout:7/910: dread d5/d32/d4a/d91/f57 [0,4194304] 0 2024-04-25T02:27:15.140 INFO:tasks.workunit.client.0.smithi114.stdout:5/916: rmdir d1/d25/da1/d8a/d11c 39 2024-04-25T02:27:15.140 INFO:tasks.workunit.client.0.smithi114.stdout:1/854: write df/d11/d32/f3c [865279,73283] 0 2024-04-25T02:27:15.142 INFO:tasks.workunit.client.0.smithi114.stdout:7/911: stat d5/d32/d64/dff/d12b/f6b 0 2024-04-25T02:27:15.143 INFO:tasks.workunit.client.0.smithi114.stdout:3/862: dwrite d0/f4b [4194304,4194304] 0 2024-04-25T02:27:15.143 INFO:tasks.workunit.client.0.smithi114.stdout:1/855: write df/d13/d44/d5a/dc9/f26 [1972306,2569] 0 2024-04-25T02:27:15.143 INFO:tasks.workunit.client.0.smithi114.stdout:7/912: dread - d5/d19/d23/f61 zero size 2024-04-25T02:27:15.144 INFO:tasks.workunit.client.0.smithi114.stdout:4/744: rename d3/d8/l41 to d3/d8/d12/d19/d26/d3e/daa/d89/ldf 0 2024-04-25T02:27:15.145 INFO:tasks.workunit.client.0.smithi114.stdout:7/913: fdatasync d5/d32/da6/f11f 0 2024-04-25T02:27:15.145 INFO:tasks.workunit.client.0.smithi114.stdout:6/960: fsync de/d2a/dd5/ff1 0 2024-04-25T02:27:15.146 INFO:tasks.workunit.client.0.smithi114.stdout:4/745: chown d3/d8/d12/d19/d26/d3e/daa/l48 102577229 1 2024-04-25T02:27:15.149 INFO:tasks.workunit.client.0.smithi114.stdout:7/914: dread d5/d32/da6/f11f [0,4194304] 0 2024-04-25T02:27:15.150 INFO:tasks.workunit.client.0.smithi114.stdout:5/917: creat d1/d6/de/f134 x:0 0 0 2024-04-25T02:27:15.151 INFO:tasks.workunit.client.0.smithi114.stdout:7/915: chown d5/c5f 5729 1 2024-04-25T02:27:15.154 INFO:tasks.workunit.client.0.smithi114.stdout:3/863: creat d0/d25/d29/d60/da8/dc8/f136 x:0 0 0 2024-04-25T02:27:15.154 INFO:tasks.workunit.client.0.smithi114.stdout:6/961: dwrite de/d25/d39/d47/d90/f11b [0,4194304] 0 2024-04-25T02:27:15.155 INFO:tasks.workunit.client.0.smithi114.stdout:9/833: dwrite d8/d16/d21/d37/d60/f89 [0,4194304] 0 2024-04-25T02:27:15.155 INFO:tasks.workunit.client.0.smithi114.stdout:4/746: mkdir d3/d8/d23/d25/d4e/daf/de0 0 2024-04-25T02:27:15.156 INFO:tasks.workunit.client.0.smithi114.stdout:3/864: chown d0/d25/d29/d78/ff3 50 1 2024-04-25T02:27:15.156 INFO:tasks.workunit.client.0.smithi114.stdout:4/747: stat d3/d8/d23/d25/d4e/daf 0 2024-04-25T02:27:15.157 INFO:tasks.workunit.client.0.smithi114.stdout:0/802: write d1/d4/da/f12 [3870492,106964] 0 2024-04-25T02:27:15.158 INFO:tasks.workunit.client.0.smithi114.stdout:6/962: write de/d27/d34/d4b/d102/f148 [199848,121953] 0 2024-04-25T02:27:15.159 INFO:tasks.workunit.client.0.smithi114.stdout:5/918: chown d1/d6/d1a/d7f/f89 139633101 1 2024-04-25T02:27:15.159 INFO:tasks.workunit.client.0.smithi114.stdout:6/963: readlink de/l26 0 2024-04-25T02:27:15.160 INFO:tasks.workunit.client.0.smithi114.stdout:2/893: sync 2024-04-25T02:27:15.160 INFO:tasks.workunit.client.0.smithi114.stdout:4/748: truncate d3/d8/d96/fcc 1010805 0 2024-04-25T02:27:15.161 INFO:tasks.workunit.client.0.smithi114.stdout:1/856: creat df/d13/d44/d9b/d119/f12b x:0 0 0 2024-04-25T02:27:15.164 INFO:tasks.workunit.client.0.smithi114.stdout:3/865: mkdir d0/d25/da0/d137 0 2024-04-25T02:27:15.165 INFO:tasks.workunit.client.0.smithi114.stdout:0/803: mkdir d1/d4/d62/d83/df5 0 2024-04-25T02:27:15.166 INFO:tasks.workunit.client.0.smithi114.stdout:0/804: fdatasync d1/d7/d18/d2e/d7e/fd6 0 2024-04-25T02:27:15.167 INFO:tasks.workunit.client.0.smithi114.stdout:2/894: dwrite d5/d6/fab [0,4194304] 0 2024-04-25T02:27:15.168 INFO:tasks.workunit.client.0.smithi114.stdout:0/805: fdatasync d1/d4/d4f/d77/fd5 0 2024-04-25T02:27:15.169 INFO:tasks.workunit.client.0.smithi114.stdout:0/806: chown d1/d4/d62/d83/d84 1 1 2024-04-25T02:27:15.171 INFO:tasks.workunit.client.0.smithi114.stdout:4/749: rename d3/d14/f65 to d3/d8/d12/d19/d42/d58/fe1 0 2024-04-25T02:27:15.172 INFO:tasks.workunit.client.0.smithi114.stdout:1/857: rmdir df/d13/d44/d9b/d119/dd6/d82/da6 39 2024-04-25T02:27:15.173 INFO:tasks.workunit.client.0.smithi114.stdout:8/884: dwrite da/d38/d62/d6d/d49/f4b [0,4194304] 0 2024-04-25T02:27:15.174 INFO:tasks.workunit.client.0.smithi114.stdout:1/858: write df/d13/d44/d9b/fbe [382579,33742] 0 2024-04-25T02:27:15.175 INFO:tasks.workunit.client.0.smithi114.stdout:1/859: stat df/d13/d44/d9b/d119/dd6/fdd 0 2024-04-25T02:27:15.179 INFO:tasks.workunit.client.0.smithi114.stdout:2/895: rmdir d5/d79/d8e 39 2024-04-25T02:27:15.181 INFO:tasks.workunit.client.0.smithi114.stdout:3/866: dwrite d0/d25/d29/d85/ff4 [0,4194304] 0 2024-04-25T02:27:15.181 INFO:tasks.workunit.client.0.smithi114.stdout:0/807: symlink d1/d4/d24/lf6 0 2024-04-25T02:27:15.182 INFO:tasks.workunit.client.0.smithi114.stdout:3/867: fsync d0/d5/d3d/da6/f10d 0 2024-04-25T02:27:15.187 INFO:tasks.workunit.client.0.smithi114.stdout:2/896: dwrite d5/df/d2c/f73 [0,4194304] 0 2024-04-25T02:27:15.189 INFO:tasks.workunit.client.0.smithi114.stdout:7/916: link d5/d8b/d99/ddb/c10c d5/d43/d4e/dec/c12d 0 2024-04-25T02:27:15.191 INFO:tasks.workunit.client.0.smithi114.stdout:9/834: dread d8/fe [0,4194304] 0 2024-04-25T02:27:15.193 INFO:tasks.workunit.client.0.smithi114.stdout:2/897: chown d5/d1c/c6b 4 1 2024-04-25T02:27:15.194 INFO:tasks.workunit.client.0.smithi114.stdout:0/808: chown d1/cec 22525742 1 2024-04-25T02:27:15.194 INFO:tasks.workunit.client.0.smithi114.stdout:8/885: symlink da/d38/d62/d6d/d52/l115 0 2024-04-25T02:27:15.197 INFO:tasks.workunit.client.0.smithi114.stdout:8/886: dread da/d38/fa4 [0,4194304] 0 2024-04-25T02:27:15.198 INFO:tasks.workunit.client.0.smithi114.stdout:3/868: link d0/d5/d3d/fa5 d0/d5/f138 0 2024-04-25T02:27:15.199 INFO:tasks.workunit.client.0.smithi114.stdout:7/917: creat d5/dbf/f12e x:0 0 0 2024-04-25T02:27:15.201 INFO:tasks.workunit.client.0.smithi114.stdout:2/898: dwrite d5/df/d2c/f70 [0,4194304] 0 2024-04-25T02:27:15.201 INFO:tasks.workunit.client.0.smithi114.stdout:0/809: creat d1/d4/ff7 x:0 0 0 2024-04-25T02:27:15.202 INFO:tasks.workunit.client.0.smithi114.stdout:3/869: creat d0/d25/d2a/d34/db6/f139 x:0 0 0 2024-04-25T02:27:15.204 INFO:tasks.workunit.client.0.smithi114.stdout:8/887: dread da/d1e/dcd/fea [0,4194304] 0 2024-04-25T02:27:15.206 INFO:tasks.workunit.client.0.smithi114.stdout:0/810: rename d1/d30 to d1/d4/d4f/da9/dac/df8 0 2024-04-25T02:27:15.208 INFO:tasks.workunit.client.0.smithi114.stdout:0/811: chown d1/d4/da/d39/da7/cbf 5444203 1 2024-04-25T02:27:15.210 INFO:tasks.workunit.client.0.smithi114.stdout:8/888: dwrite da/d38/db6/fdf [0,4194304] 0 2024-04-25T02:27:15.211 INFO:tasks.workunit.client.0.smithi114.stdout:0/812: mknod d1/d4/d24/cf9 0 2024-04-25T02:27:15.211 INFO:tasks.workunit.client.0.smithi114.stdout:0/813: stat d1/d4/d62/c88 0 2024-04-25T02:27:15.213 INFO:tasks.workunit.client.0.smithi114.stdout:0/814: chown d1/d4/d4f/da9/dac/df8/c4b 294108 1 2024-04-25T02:27:15.214 INFO:tasks.workunit.client.0.smithi114.stdout:8/889: rmdir da/d38/d62/d6d/dff 0 2024-04-25T02:27:15.214 INFO:tasks.workunit.client.0.smithi114.stdout:3/870: dread d0/d25/d2a/d80/fcf [0,4194304] 0 2024-04-25T02:27:15.215 INFO:tasks.workunit.client.0.smithi114.stdout:0/815: write d1/d7/d97/fd8 [1173480,56122] 0 2024-04-25T02:27:15.215 INFO:tasks.workunit.client.0.smithi114.stdout:8/890: chown da/d38/d62/d6d/ld9 40981 1 2024-04-25T02:27:15.216 INFO:tasks.workunit.client.0.smithi114.stdout:3/871: rmdir d0/d25/d2a/d80/d10e 39 2024-04-25T02:27:15.217 INFO:tasks.workunit.client.0.smithi114.stdout:8/891: readlink da/d69/d93/d6b/lc2 0 2024-04-25T02:27:15.218 INFO:tasks.workunit.client.0.smithi114.stdout:8/892: chown da/d38/d62/d6d/l101 7 1 2024-04-25T02:27:15.219 INFO:tasks.workunit.client.0.smithi114.stdout:0/816: mkdir d1/d7/d18/d2e/d8f/dfa 0 2024-04-25T02:27:15.219 INFO:tasks.workunit.client.0.smithi114.stdout:0/817: write d1/d4/da/f12 [3472376,123919] 0 2024-04-25T02:27:15.224 INFO:tasks.workunit.client.0.smithi114.stdout:0/818: unlink d1/d4/d62/d83/f8c 0 2024-04-25T02:27:15.224 INFO:tasks.workunit.client.0.smithi114.stdout:3/872: link d0/d25/d29/d60/c67 d0/d25/d29/d60/da8/c13a 0 2024-04-25T02:27:15.226 INFO:tasks.workunit.client.0.smithi114.stdout:0/819: stat d1/d4/d62/d83/fa3 0 2024-04-25T02:27:15.228 INFO:tasks.workunit.client.0.smithi114.stdout:3/873: link d0/d25/d29/d78/fea d0/d25/d29/d85/d7e/da9/dad/de4/f13b 0 2024-04-25T02:27:15.233 INFO:tasks.workunit.client.0.smithi114.stdout:3/874: mkdir d0/d5/d3d/da6/dce/d13c 0 2024-04-25T02:27:15.235 INFO:tasks.workunit.client.0.smithi114.stdout:3/875: symlink d0/d25/d29/l13d 0 2024-04-25T02:27:15.235 INFO:tasks.workunit.client.0.smithi114.stdout:1/860: fsync df/d13/d44/d9b/d119/f12b 0 2024-04-25T02:27:15.237 INFO:tasks.workunit.client.0.smithi114.stdout:3/876: mkdir d0/d25/d29/d85/d7e/da9/d13e 0 2024-04-25T02:27:15.238 INFO:tasks.workunit.client.0.smithi114.stdout:1/861: creat df/d13/d93/dca/f12c x:0 0 0 2024-04-25T02:27:15.238 INFO:tasks.workunit.client.0.smithi114.stdout:4/750: rmdir d3 39 2024-04-25T02:27:15.241 INFO:tasks.workunit.client.0.smithi114.stdout:5/919: dwrite d1/d6/f31 [4194304,4194304] 0 2024-04-25T02:27:15.241 INFO:tasks.workunit.client.0.smithi114.stdout:2/899: dread d5/fe [0,4194304] 0 2024-04-25T02:27:15.242 INFO:tasks.workunit.client.0.smithi114.stdout:3/877: creat d0/d25/d2a/d80/f13f x:0 0 0 2024-04-25T02:27:15.244 INFO:tasks.workunit.client.0.smithi114.stdout:4/751: write d3/d8/d30/d4c/d7f/d8d/f9c [4794713,16007] 0 2024-04-25T02:27:15.244 INFO:tasks.workunit.client.0.smithi114.stdout:5/920: write d1/d6/d1a/f9f [564284,110810] 0 2024-04-25T02:27:15.248 INFO:tasks.workunit.client.0.smithi114.stdout:5/921: chown d1/d6/lf0 3712 1 2024-04-25T02:27:15.249 INFO:tasks.workunit.client.0.smithi114.stdout:4/752: mkdir d3/d8/d30/d93/de2 0 2024-04-25T02:27:15.252 INFO:tasks.workunit.client.0.smithi114.stdout:9/835: dwrite d8/d16/d21/f41 [0,4194304] 0 2024-04-25T02:27:15.252 INFO:tasks.workunit.client.0.smithi114.stdout:4/753: dread - d3/db9/fcd zero size 2024-04-25T02:27:15.253 INFO:tasks.workunit.client.0.smithi114.stdout:5/922: symlink d1/d3e/d8e/l135 0 2024-04-25T02:27:15.254 INFO:tasks.workunit.client.0.smithi114.stdout:3/878: dwrite d0/d25/d29/d85/ff4 [0,4194304] 0 2024-04-25T02:27:15.256 INFO:tasks.workunit.client.0.smithi114.stdout:0/820: rename d1/d7/d18/d2e to d1/d7/dfb 0 2024-04-25T02:27:15.258 INFO:tasks.workunit.client.0.smithi114.stdout:9/836: creat d8/d16/d21/dfb/d66/f10e x:0 0 0 2024-04-25T02:27:15.258 INFO:tasks.workunit.client.0.smithi114.stdout:7/918: dwrite d5/d19/f2b [0,4194304] 0 2024-04-25T02:27:15.261 INFO:tasks.workunit.client.0.smithi114.stdout:3/879: truncate d0/d25/d29/d8c/fd4 864902 0 2024-04-25T02:27:15.261 INFO:tasks.workunit.client.0.smithi114.stdout:8/893: write da/d69/d93/d6b/fc3 [547884,18474] 0 2024-04-25T02:27:15.261 INFO:tasks.workunit.client.0.smithi114.stdout:3/880: chown d0/d25/d2a/d80/dbd/d11a 98855444 1 2024-04-25T02:27:15.262 INFO:tasks.workunit.client.0.smithi114.stdout:2/900: rename d5/d6/d31/l115 to d5/df/d3d/d81/l120 0 2024-04-25T02:27:15.264 INFO:tasks.workunit.client.0.smithi114.stdout:5/923: mknod d1/d6/d4f/d6c/d88/d123/c136 0 2024-04-25T02:27:15.267 INFO:tasks.workunit.client.0.smithi114.stdout:8/894: dwrite da/d69/d93/d6b/dbb/fcb [0,4194304] 0 2024-04-25T02:27:15.273 INFO:tasks.workunit.client.0.smithi114.stdout:6/964: dread de/d2a/f2b [0,4194304] 0 2024-04-25T02:27:15.274 INFO:tasks.workunit.client.0.smithi114.stdout:3/881: rename d0/d25/d29/d85/d7e to d0/d25/d2a/d80/dbd/d140 0 2024-04-25T02:27:15.276 INFO:tasks.workunit.client.0.smithi114.stdout:2/901: creat d5/d1c/d22/d67/f121 x:0 0 0 2024-04-25T02:27:15.279 INFO:tasks.workunit.client.0.smithi114.stdout:7/919: mknod d5/d19/d23/c12f 0 2024-04-25T02:27:15.279 INFO:tasks.workunit.client.0.smithi114.stdout:4/754: link d3/d14/c56 d3/d8/d12/d19/ce3 0 2024-04-25T02:27:15.281 INFO:tasks.workunit.client.0.smithi114.stdout:7/920: write d5/d19/d23/f3c [1375036,111226] 0 2024-04-25T02:27:15.281 INFO:tasks.workunit.client.0.smithi114.stdout:3/882: creat d0/d25/d29/d8c/f141 x:0 0 0 2024-04-25T02:27:15.284 INFO:tasks.workunit.client.0.smithi114.stdout:4/755: creat d3/d8/d12/d19/d26/d3e/daa/d89/fe4 x:0 0 0 2024-04-25T02:27:15.284 INFO:tasks.workunit.client.0.smithi114.stdout:5/924: dwrite d1/d25/d24/f32 [0,4194304] 0 2024-04-25T02:27:15.284 INFO:tasks.workunit.client.0.smithi114.stdout:7/921: dread - d5/d32/d64/dff/d12b/fc8 zero size 2024-04-25T02:27:15.285 INFO:tasks.workunit.client.0.smithi114.stdout:9/837: getdents d8/d16/d21/d24 0 2024-04-25T02:27:15.291 INFO:tasks.workunit.client.0.smithi114.stdout:6/965: symlink de/d25/d39/d47/d90/d93/l152 0 2024-04-25T02:27:15.291 INFO:tasks.workunit.client.0.smithi114.stdout:4/756: truncate d3/d8/d12/d82/fd8 800420 0 2024-04-25T02:27:15.291 INFO:tasks.workunit.client.0.smithi114.stdout:7/922: fdatasync d5/d19/d1a/da4/db3/d106/f12a 0 2024-04-25T02:27:15.291 INFO:tasks.workunit.client.0.smithi114.stdout:9/838: creat d8/d16/f10f x:0 0 0 2024-04-25T02:27:15.291 INFO:tasks.workunit.client.0.smithi114.stdout:7/923: truncate d5/d32/d4a/dbc/f117 424199 0 2024-04-25T02:27:15.292 INFO:tasks.workunit.client.0.smithi114.stdout:6/966: truncate de/d2a/f3a 1445004 0 2024-04-25T02:27:15.292 INFO:tasks.workunit.client.0.smithi114.stdout:7/924: fsync d5/d19/d23/f3a 0 2024-04-25T02:27:15.292 INFO:tasks.workunit.client.0.smithi114.stdout:4/757: symlink d3/d8/d12/d19/d26/d3e/daa/d89/le5 0 2024-04-25T02:27:15.294 INFO:tasks.workunit.client.0.smithi114.stdout:4/758: truncate d3/db9/fcd 593187 0 2024-04-25T02:27:15.295 INFO:tasks.workunit.client.0.smithi114.stdout:4/759: fsync d3/d8/d12/fb1 0 2024-04-25T02:27:15.296 INFO:tasks.workunit.client.0.smithi114.stdout:7/925: rename d5/d19/d23/d6f to d5/d19/d1a/da4/db3/d106/d127/d130 0 2024-04-25T02:27:15.297 INFO:tasks.workunit.client.0.smithi114.stdout:9/839: dwrite d8/d16/d21/dfb/d39/fe8 [0,4194304] 0 2024-04-25T02:27:15.298 INFO:tasks.workunit.client.0.smithi114.stdout:7/926: chown d5/d32/da6/db5/fea 102963 1 2024-04-25T02:27:15.301 INFO:tasks.workunit.client.0.smithi114.stdout:7/927: unlink d5/d32/da6/db5/fea 0 2024-04-25T02:27:15.303 INFO:tasks.workunit.client.0.smithi114.stdout:7/928: rmdir d5/d8b 39 2024-04-25T02:27:15.305 INFO:tasks.workunit.client.0.smithi114.stdout:9/840: dwrite d8/d16/d21/dfb/d39/d38/d5d/dd3/fe7 [0,4194304] 0 2024-04-25T02:27:15.305 INFO:tasks.workunit.client.0.smithi114.stdout:7/929: mkdir d5/d32/d129/d131 0 2024-04-25T02:27:15.307 INFO:tasks.workunit.client.0.smithi114.stdout:7/930: write d5/d43/fc0 [3678685,86991] 0 2024-04-25T02:27:15.308 INFO:tasks.workunit.client.0.smithi114.stdout:9/841: symlink d8/l110 0 2024-04-25T02:27:15.309 INFO:tasks.workunit.client.0.smithi114.stdout:8/895: dread da/d38/d62/d6d/d52/d6c/f9a [0,4194304] 0 2024-04-25T02:27:15.310 INFO:tasks.workunit.client.0.smithi114.stdout:9/842: rmdir d8/d16/d21/dfb/d39/dab 39 2024-04-25T02:27:15.313 INFO:tasks.workunit.client.0.smithi114.stdout:8/896: mkdir da/d38/d62/d6d/d52/da8/da9/df2/d116 0 2024-04-25T02:27:15.314 INFO:tasks.workunit.client.0.smithi114.stdout:8/897: fdatasync da/d38/d62/d6d/d49/d65/dd0/fed 0 2024-04-25T02:27:15.314 INFO:tasks.workunit.client.0.smithi114.stdout:7/931: unlink d5/d8b/d99/l110 0 2024-04-25T02:27:15.316 INFO:tasks.workunit.client.0.smithi114.stdout:8/898: truncate da/d69/d93/d40/fa6 815425 0 2024-04-25T02:27:15.317 INFO:tasks.workunit.client.0.smithi114.stdout:9/843: rename d8/da8 to d8/d16/d21/dfb/d39/d38/d5d/d111 0 2024-04-25T02:27:15.318 INFO:tasks.workunit.client.0.smithi114.stdout:7/932: stat d5/d43/d4e/cfe 0 2024-04-25T02:27:15.318 INFO:tasks.workunit.client.0.smithi114.stdout:8/899: truncate da/d69/f73 2320167 0 2024-04-25T02:27:15.322 INFO:tasks.workunit.client.0.smithi114.stdout:7/933: link d5/d60/fe2 d5/d8b/d99/f132 0 2024-04-25T02:27:15.322 INFO:tasks.workunit.client.0.smithi114.stdout:7/934: chown d5/d43 91652505 1 2024-04-25T02:27:15.327 INFO:tasks.workunit.client.0.smithi114.stdout:7/935: dwrite d5/d43/d4e/df2/ff5 [0,4194304] 0 2024-04-25T02:27:15.330 INFO:tasks.workunit.client.0.smithi114.stdout:4/760: dread d3/d14/d6c/f9a [0,4194304] 0 2024-04-25T02:27:15.332 INFO:tasks.workunit.client.0.smithi114.stdout:4/761: creat d3/d8/d30/d93/fe6 x:0 0 0 2024-04-25T02:27:15.333 INFO:tasks.workunit.client.0.smithi114.stdout:4/762: dread - d3/d8/d12/d19/d26/f7b zero size 2024-04-25T02:27:15.335 INFO:tasks.workunit.client.0.smithi114.stdout:4/763: creat d3/d8/d30/d4c/d7f/fe7 x:0 0 0 2024-04-25T02:27:15.337 INFO:tasks.workunit.client.0.smithi114.stdout:4/764: truncate d3/d8/d12/d19/d26/f2a 1665873 0 2024-04-25T02:27:15.338 INFO:tasks.workunit.client.0.smithi114.stdout:4/765: fsync d3/d8/d30/d4c/d7f/fca 0 2024-04-25T02:27:15.338 INFO:tasks.workunit.client.0.smithi114.stdout:4/766: chown d3/d8/d30/d4c 436330 1 2024-04-25T02:27:15.339 INFO:tasks.workunit.client.0.smithi114.stdout:4/767: read d3/d8/d12/d19/d26/d3e/daa/f83 [3427191,123381] 0 2024-04-25T02:27:15.340 INFO:tasks.workunit.client.0.smithi114.stdout:4/768: write d3/d8/d12/d19/d26/f7b [1030265,18514] 0 2024-04-25T02:27:15.341 INFO:tasks.workunit.client.0.smithi114.stdout:4/769: chown d3/d8/d23 0 1 2024-04-25T02:27:15.342 INFO:tasks.workunit.client.0.smithi114.stdout:4/770: rmdir d3/d8 39 2024-04-25T02:27:15.345 INFO:tasks.workunit.client.0.smithi114.stdout:4/771: rename d3/d8/d12/d19/d26/d3e/daa/dce/c46 to d3/d8/d23/d25/dd3/ce8 0 2024-04-25T02:27:15.351 INFO:tasks.workunit.client.0.smithi114.stdout:6/967: sync 2024-04-25T02:27:15.355 INFO:tasks.workunit.client.0.smithi114.stdout:6/968: link de/d1c/df7/d14c/c14f de/d2a/c153 0 2024-04-25T02:27:15.359 INFO:tasks.workunit.client.0.smithi114.stdout:6/969: read de/d25/d39/d47/f56 [2192295,5062] 0 2024-04-25T02:27:15.361 INFO:tasks.workunit.client.0.smithi114.stdout:6/970: creat de/d25/d39/d47/de7/f154 x:0 0 0 2024-04-25T02:27:15.362 INFO:tasks.workunit.client.0.smithi114.stdout:1/862: truncate df/d13/d44/d9b/d119/dd6/d82/de8/dfe/f84 296426 0 2024-04-25T02:27:15.362 INFO:tasks.workunit.client.0.smithi114.stdout:6/971: write de/d27/d34/d4b/d102/f148 [174481,121330] 0 2024-04-25T02:27:15.366 INFO:tasks.workunit.client.0.smithi114.stdout:0/821: rmdir d1/d7/d18 39 2024-04-25T02:27:15.368 INFO:tasks.workunit.client.0.smithi114.stdout:6/972: mkdir de/d155 0 2024-04-25T02:27:15.369 INFO:tasks.workunit.client.0.smithi114.stdout:6/973: read - de/d1c/fe1 zero size 2024-04-25T02:27:15.371 INFO:tasks.workunit.client.0.smithi114.stdout:2/902: write d5/d1c/d22/d89/d118/f9b [3448845,112881] 0 2024-04-25T02:27:15.373 INFO:tasks.workunit.client.0.smithi114.stdout:6/974: write de/d27/d34/fe9 [953141,25506] 0 2024-04-25T02:27:15.375 INFO:tasks.workunit.client.0.smithi114.stdout:0/822: dwrite d1/d4/f1b [0,4194304] 0 2024-04-25T02:27:15.379 INFO:tasks.workunit.client.0.smithi114.stdout:1/863: dread df/d13/d44/d9b/d119/dd6/d82/de8/dfe/f63 [0,4194304] 0 2024-04-25T02:27:15.379 INFO:tasks.workunit.client.0.smithi114.stdout:2/903: rename d5/d1c/c4a to d5/df/d1e/c122 0 2024-04-25T02:27:15.380 INFO:tasks.workunit.client.0.smithi114.stdout:3/883: dwrite d0/f21 [0,4194304] 0 2024-04-25T02:27:15.382 INFO:tasks.workunit.client.0.smithi114.stdout:5/925: dread d1/d25/f35 [0,4194304] 0 2024-04-25T02:27:15.386 INFO:tasks.workunit.client.0.smithi114.stdout:3/884: unlink d0/d25/f62 0 2024-04-25T02:27:15.386 INFO:tasks.workunit.client.0.smithi114.stdout:3/885: write d0/f19 [5502128,17861] 0 2024-04-25T02:27:15.389 INFO:tasks.workunit.client.0.smithi114.stdout:2/904: creat d5/df/d3d/d44/d11e/d5a/d3e/f123 x:0 0 0 2024-04-25T02:27:15.390 INFO:tasks.workunit.client.0.smithi114.stdout:0/823: rmdir d1/d4/d62/d83/df5 0 2024-04-25T02:27:15.390 INFO:tasks.workunit.client.0.smithi114.stdout:8/900: write da/d38/fa4 [393422,49998] 0 2024-04-25T02:27:15.394 INFO:tasks.workunit.client.0.smithi114.stdout:9/844: dwrite d8/d16/f27 [0,4194304] 0 2024-04-25T02:27:15.396 INFO:tasks.workunit.client.0.smithi114.stdout:3/886: mkdir d0/d25/d2a/d34/db6/d142 0 2024-04-25T02:27:15.398 INFO:tasks.workunit.client.0.smithi114.stdout:2/905: unlink d5/df/d63/f7b 0 2024-04-25T02:27:15.399 INFO:tasks.workunit.client.0.smithi114.stdout:0/824: mkdir d1/d7/dfb/d7e/dfc 0 2024-04-25T02:27:15.400 INFO:tasks.workunit.client.0.smithi114.stdout:5/926: dwrite d1/d25/f35 [4194304,4194304] 0 2024-04-25T02:27:15.401 INFO:tasks.workunit.client.0.smithi114.stdout:2/906: stat d5/df/d3d/d44/dc0/dcd/l92 0 2024-04-25T02:27:15.402 INFO:tasks.workunit.client.0.smithi114.stdout:7/936: dwrite d5/f18 [0,4194304] 0 2024-04-25T02:27:15.402 INFO:tasks.workunit.client.0.smithi114.stdout:3/887: truncate d0/d25/d2a/d34/db6/f139 951698 0 2024-04-25T02:27:15.403 INFO:tasks.workunit.client.0.smithi114.stdout:9/845: rmdir d8/d16/d21/d37/d43/d75/da3 39 2024-04-25T02:27:15.404 INFO:tasks.workunit.client.0.smithi114.stdout:5/927: read d1/d6/d1a/d7f/dd9/ff9 [3319693,91604] 0 2024-04-25T02:27:15.405 INFO:tasks.workunit.client.0.smithi114.stdout:7/937: chown d5/d32/d64/dff/f109 1858 1 2024-04-25T02:27:15.405 INFO:tasks.workunit.client.0.smithi114.stdout:4/772: truncate d3/d8/f1c 2163227 0 2024-04-25T02:27:15.406 INFO:tasks.workunit.client.0.smithi114.stdout:0/825: stat d1/d7/dfb/c72 0 2024-04-25T02:27:15.408 INFO:tasks.workunit.client.0.smithi114.stdout:8/901: mkdir da/d38/d62/d6d/d49/d117 0 2024-04-25T02:27:15.408 INFO:tasks.workunit.client.0.smithi114.stdout:6/975: dread de/d2a/db9/fd6 [0,4194304] 0 2024-04-25T02:27:15.409 INFO:tasks.workunit.client.0.smithi114.stdout:8/902: write da/d38/d62/d6d/d49/d65/dd0/f91 [1379736,104686] 0 2024-04-25T02:27:15.414 INFO:tasks.workunit.client.0.smithi114.stdout:3/888: symlink d0/d25/d2a/d34/d9e/l143 0 2024-04-25T02:27:15.416 INFO:tasks.workunit.client.0.smithi114.stdout:7/938: symlink d5/d32/d129/l133 0 2024-04-25T02:27:15.419 INFO:tasks.workunit.client.0.smithi114.stdout:4/773: creat d3/d8/d12/d19/fe9 x:0 0 0 2024-04-25T02:27:15.419 INFO:tasks.workunit.client.0.smithi114.stdout:9/846: dread d8/d16/d21/d37/d43/d75/fc2 [0,4194304] 0 2024-04-25T02:27:15.420 INFO:tasks.workunit.client.0.smithi114.stdout:0/826: unlink d1/d7/dfb/feb 0 2024-04-25T02:27:15.420 INFO:tasks.workunit.client.0.smithi114.stdout:3/889: dwrite d0/d5/d3d/da6/f10d [0,4194304] 0 2024-04-25T02:27:15.421 INFO:tasks.workunit.client.0.smithi114.stdout:4/774: dread - d3/d8/d12/d19/fd0 zero size 2024-04-25T02:27:15.423 INFO:tasks.workunit.client.0.smithi114.stdout:0/827: write d1/d4/d37/d6a/f81 [3578588,5058] 0 2024-04-25T02:27:15.425 INFO:tasks.workunit.client.0.smithi114.stdout:7/939: rmdir d5/d43/d4e/df2 39 2024-04-25T02:27:15.429 INFO:tasks.workunit.client.0.smithi114.stdout:3/890: dwrite d0/d5/d3d/ddc/f10b [0,4194304] 0 2024-04-25T02:27:15.431 INFO:tasks.workunit.client.0.smithi114.stdout:6/976: creat de/d155/f156 x:0 0 0 2024-04-25T02:27:15.432 INFO:tasks.workunit.client.0.smithi114.stdout:8/903: creat da/d38/d62/d6d/d52/da8/da9/df2/d116/f118 x:0 0 0 2024-04-25T02:27:15.433 INFO:tasks.workunit.client.0.smithi114.stdout:0/828: dwrite d1/d4/da/d39/da7/fe3 [0,4194304] 0 2024-04-25T02:27:15.433 INFO:tasks.workunit.client.0.smithi114.stdout:2/907: link d5/df/d3d/d44/dc0/dcd/l92 d5/daf/dda/de1/df9/l124 0 2024-04-25T02:27:15.437 INFO:tasks.workunit.client.0.smithi114.stdout:8/904: read da/d69/d93/f10c [4084478,37969] 0 2024-04-25T02:27:15.437 INFO:tasks.workunit.client.0.smithi114.stdout:7/940: rmdir d5/d19/d1a/d80 39 2024-04-25T02:27:15.438 INFO:tasks.workunit.client.0.smithi114.stdout:8/905: chown da/d32/f39 499712170 1 2024-04-25T02:27:15.440 INFO:tasks.workunit.client.0.smithi114.stdout:0/829: dwrite d1/d4/f86 [0,4194304] 0 2024-04-25T02:27:15.440 INFO:tasks.workunit.client.0.smithi114.stdout:0/830: chown d1/d4/d4f 5 1 2024-04-25T02:27:15.441 INFO:tasks.workunit.client.0.smithi114.stdout:0/831: readlink d1/d7/d68/ld1 0 2024-04-25T02:27:15.441 INFO:tasks.workunit.client.0.smithi114.stdout:0/832: readlink d1/d7/d68/ld1 0 2024-04-25T02:27:15.442 INFO:tasks.workunit.client.0.smithi114.stdout:1/864: truncate df/d13/d44/d5a/dc9/d33/d47/f5e 1242008 0 2024-04-25T02:27:15.444 INFO:tasks.workunit.client.0.smithi114.stdout:1/865: truncate df/d13/d44/d5a/dc9/d33/d47/d74/f80 673080 0 2024-04-25T02:27:15.448 INFO:tasks.workunit.client.0.smithi114.stdout:4/775: truncate d3/d8/f57 554638 0 2024-04-25T02:27:15.451 INFO:tasks.workunit.client.0.smithi114.stdout:3/891: creat d0/d11e/f144 x:0 0 0 2024-04-25T02:27:15.452 INFO:tasks.workunit.client.0.smithi114.stdout:0/833: mknod d1/d4/d4f/cfd 0 2024-04-25T02:27:15.453 INFO:tasks.workunit.client.0.smithi114.stdout:1/866: dwrite df/d13/fdf [0,4194304] 0 2024-04-25T02:27:15.453 INFO:tasks.workunit.client.0.smithi114.stdout:6/977: dwrite de/d27/d34/d44/f71 [0,4194304] 0 2024-04-25T02:27:15.455 INFO:tasks.workunit.client.0.smithi114.stdout:9/847: rmdir d8/d16/d21/dfb/d39/ddf/dda 0 2024-04-25T02:27:15.465 INFO:tasks.workunit.client.0.smithi114.stdout:2/908: rename d5/d6/d31/f60 to d5/d6/f125 0 2024-04-25T02:27:15.466 INFO:tasks.workunit.client.0.smithi114.stdout:5/928: dwrite d1/d3e/f77 [0,4194304] 0 2024-04-25T02:27:15.473 INFO:tasks.workunit.client.0.smithi114.stdout:0/834: dwrite d1/d4/da/f73 [0,4194304] 0 2024-04-25T02:27:15.473 INFO:tasks.workunit.client.0.smithi114.stdout:3/892: dread d0/d25/d29/d8c/f135 [4194304,4194304] 0 2024-04-25T02:27:15.475 INFO:tasks.workunit.client.0.smithi114.stdout:6/978: dwrite de/d25/dad/dde/ffa [0,4194304] 0 2024-04-25T02:27:15.477 INFO:tasks.workunit.client.0.smithi114.stdout:4/776: mkdir d3/d8/d23/dea 0 2024-04-25T02:27:15.478 INFO:tasks.workunit.client.0.smithi114.stdout:8/906: rename da/d38/d62/d6d/d49/d65/lf8 to da/d38/db6/l119 0 2024-04-25T02:27:15.479 INFO:tasks.workunit.client.0.smithi114.stdout:2/909: dwrite d5/df/d3d/d44/d11e/d5a/fc1 [0,4194304] 0 2024-04-25T02:27:15.480 INFO:tasks.workunit.client.0.smithi114.stdout:9/848: symlink d8/d16/d21/dfb/d39/d38/d5d/dd3/l112 0 2024-04-25T02:27:15.481 INFO:tasks.workunit.client.0.smithi114.stdout:2/910: write d5/df/d3d/d44/d11e/f5f [5139881,1915] 0 2024-04-25T02:27:15.492 INFO:tasks.workunit.client.0.smithi114.stdout:7/941: getdents d5/d43 0 2024-04-25T02:27:15.493 INFO:tasks.workunit.client.0.smithi114.stdout:0/835: mkdir d1/d4/d24/dfe 0 2024-04-25T02:27:15.498 INFO:tasks.workunit.client.0.smithi114.stdout:2/911: rename d5/f15 to d5/d1c/dee/f126 0 2024-04-25T02:27:15.499 INFO:tasks.workunit.client.0.smithi114.stdout:5/929: mkdir d1/d3e/d8e/de5/d82/d8f/d133/d137 0 2024-04-25T02:27:15.499 INFO:tasks.workunit.client.0.smithi114.stdout:0/836: dwrite d1/d4/d4f/f7f [0,4194304] 0 2024-04-25T02:27:15.502 INFO:tasks.workunit.client.0.smithi114.stdout:7/942: fsync d5/d32/d4a/d91/f73 0 2024-04-25T02:27:15.504 INFO:tasks.workunit.client.0.smithi114.stdout:9/849: dwrite d8/d16/d21/dfb/d39/d38/f6f [0,4194304] 0 2024-04-25T02:27:15.504 INFO:tasks.workunit.client.0.smithi114.stdout:3/893: rename d0/d25/d29/d8c/cc7 to d0/d25/d2a/d80/dbd/d140/da9/d13e/c145 0 2024-04-25T02:27:15.505 INFO:tasks.workunit.client.0.smithi114.stdout:3/894: chown d0/d5/d3d 0 1 2024-04-25T02:27:15.506 INFO:tasks.workunit.client.0.smithi114.stdout:1/867: dread df/d11/fcf [0,4194304] 0 2024-04-25T02:27:15.507 INFO:tasks.workunit.client.0.smithi114.stdout:9/850: readlink d8/d16/d21/dfb/d39/d38/d5d/dd3/l112 0 2024-04-25T02:27:15.507 INFO:tasks.workunit.client.0.smithi114.stdout:3/895: write d0/d25/d2a/dc4/ff6 [1776188,16733] 0 2024-04-25T02:27:15.508 INFO:tasks.workunit.client.0.smithi114.stdout:1/868: fdatasync df/d13/d75/d8e/dd1/fe2 0 2024-04-25T02:27:15.508 INFO:tasks.workunit.client.0.smithi114.stdout:0/837: mknod d1/d4/d4f/da9/dac/df8/d4d/d9c/cff 0 2024-04-25T02:27:15.511 INFO:tasks.workunit.client.0.smithi114.stdout:7/943: rename d5/ffc to d5/d32/d64/f134 0 2024-04-25T02:27:15.513 INFO:tasks.workunit.client.0.smithi114.stdout:3/896: write d0/f38 [6971008,117186] 0 2024-04-25T02:27:15.517 INFO:tasks.workunit.client.0.smithi114.stdout:1/869: symlink df/d13/d44/d5a/dc9/d33/d47/l12d 0 2024-04-25T02:27:15.517 INFO:tasks.workunit.client.0.smithi114.stdout:9/851: dwrite d8/d16/d21/d37/d60/d70/f94 [8388608,4194304] 0 2024-04-25T02:27:15.518 INFO:tasks.workunit.client.0.smithi114.stdout:3/897: chown d0/d25/d2a/d80/dbd/d140/da9/fde 40 1 2024-04-25T02:27:15.519 INFO:tasks.workunit.client.0.smithi114.stdout:3/898: fsync d0/d25/d2a/d80/dbd/d140/f97 0 2024-04-25T02:27:15.525 INFO:tasks.workunit.client.0.smithi114.stdout:3/899: creat d0/d25/d2a/d80/dbd/d140/da9/d13e/f146 x:0 0 0 2024-04-25T02:27:15.525 INFO:tasks.workunit.client.0.smithi114.stdout:3/900: chown d0/d25/d2a/d80/dbd/d140/da9/fde 133 1 2024-04-25T02:27:15.529 INFO:tasks.workunit.client.0.smithi114.stdout:3/901: dread d0/d25/d2a/d80/dbd/d140/f93 [0,4194304] 0 2024-04-25T02:27:15.532 INFO:tasks.workunit.client.0.smithi114.stdout:3/902: creat d0/d25/d2a/d80/d10e/f147 x:0 0 0 2024-04-25T02:27:15.533 INFO:tasks.workunit.client.0.smithi114.stdout:3/903: fsync d0/d25/d2a/f131 0 2024-04-25T02:27:15.534 INFO:tasks.workunit.client.0.smithi114.stdout:8/907: write da/d69/d93/d6b/f81 [380345,17184] 0 2024-04-25T02:27:15.537 INFO:tasks.workunit.client.0.smithi114.stdout:8/908: write da/d69/d93/d40/f45 [7125824,49155] 0 2024-04-25T02:27:15.538 INFO:tasks.workunit.client.0.smithi114.stdout:5/930: dread d1/d6/d4f/fbd [0,4194304] 0 2024-04-25T02:27:15.540 INFO:tasks.workunit.client.0.smithi114.stdout:6/979: dwrite de/d27/d34/f48 [0,4194304] 0 2024-04-25T02:27:15.543 INFO:tasks.workunit.client.0.smithi114.stdout:5/931: symlink d1/d25/da1/df7/l138 0 2024-04-25T02:27:15.545 INFO:tasks.workunit.client.0.smithi114.stdout:2/912: dwrite d5/df/d3d/d44/fc7 [0,4194304] 0 2024-04-25T02:27:15.546 INFO:tasks.workunit.client.0.smithi114.stdout:2/913: chown d5/df/d3d/d44/fc7 415621333 1 2024-04-25T02:27:15.546 INFO:tasks.workunit.client.0.smithi114.stdout:0/838: dread d1/d4/d24/d52/f9a [0,4194304] 0 2024-04-25T02:27:15.547 INFO:tasks.workunit.client.0.smithi114.stdout:2/914: dread - d5/d79/f9f zero size 2024-04-25T02:27:15.547 INFO:tasks.workunit.client.0.smithi114.stdout:1/870: dread df/d13/d44/d5a/dc9/d33/d47/f9e [0,4194304] 0 2024-04-25T02:27:15.549 INFO:tasks.workunit.client.0.smithi114.stdout:6/980: unlink de/d27/d34/d44/ce5 0 2024-04-25T02:27:15.549 INFO:tasks.workunit.client.0.smithi114.stdout:5/932: chown d1/l21 9964 1 2024-04-25T02:27:15.550 INFO:tasks.workunit.client.0.smithi114.stdout:0/839: mknod d1/d4/d62/d83/c100 0 2024-04-25T02:27:15.550 INFO:tasks.workunit.client.0.smithi114.stdout:6/981: readlink de/d27/d34/l131 0 2024-04-25T02:27:15.550 INFO:tasks.workunit.client.0.smithi114.stdout:3/904: write d0/d25/d29/d85/f51 [4619027,65436] 0 2024-04-25T02:27:15.551 INFO:tasks.workunit.client.0.smithi114.stdout:5/933: chown d1/d6/de/d75/fc4 13989897 1 2024-04-25T02:27:15.555 INFO:tasks.workunit.client.0.smithi114.stdout:6/982: write de/d2a/f111 [4343183,98147] 0 2024-04-25T02:27:15.555 INFO:tasks.workunit.client.0.smithi114.stdout:9/852: dwrite d8/fe [4194304,4194304] 0 2024-04-25T02:27:15.556 INFO:tasks.workunit.client.0.smithi114.stdout:3/905: stat d0/d5/d3d/da6/dce/l10c 0 2024-04-25T02:27:15.558 INFO:tasks.workunit.client.0.smithi114.stdout:0/840: getdents d1/d4/d62/d83/da0/dd2 0 2024-04-25T02:27:15.560 INFO:tasks.workunit.client.0.smithi114.stdout:0/841: chown d1/d7/d68 257 1 2024-04-25T02:27:15.560 INFO:tasks.workunit.client.0.smithi114.stdout:5/934: unlink d1/d25/da1/df7/l138 0 2024-04-25T02:27:15.561 INFO:tasks.workunit.client.0.smithi114.stdout:6/983: mkdir de/d25/dad/dde/d157 0 2024-04-25T02:27:15.562 INFO:tasks.workunit.client.0.smithi114.stdout:3/906: fdatasync d0/d5/d3d/ddc/ff8 0 2024-04-25T02:27:15.563 INFO:tasks.workunit.client.0.smithi114.stdout:8/909: dwrite da/d1e/f48 [8388608,4194304] 0 2024-04-25T02:27:15.565 INFO:tasks.workunit.client.0.smithi114.stdout:0/842: unlink d1/d7/d68/f8d 0 2024-04-25T02:27:15.566 INFO:tasks.workunit.client.0.smithi114.stdout:1/871: link df/d13/d44/d9b/d119/dd6/f95 df/d11/d7d/df9/d107/d124/f12e 0 2024-04-25T02:27:15.566 INFO:tasks.workunit.client.0.smithi114.stdout:8/910: write da/d38/db6/de8/f9f [131760,52206] 0 2024-04-25T02:27:15.568 INFO:tasks.workunit.client.0.smithi114.stdout:9/853: dwrite d8/d16/d21/d37/d60/d70/f94 [4194304,4194304] 0 2024-04-25T02:27:15.568 INFO:tasks.workunit.client.0.smithi114.stdout:3/907: write d0/d25/d29/d8c/f135 [4897037,104532] 0 2024-04-25T02:27:15.571 INFO:tasks.workunit.client.0.smithi114.stdout:8/911: chown da/d69/d93/fc1 1 1 2024-04-25T02:27:15.572 INFO:tasks.workunit.client.0.smithi114.stdout:3/908: truncate d0/d25/d29/d85/f51 4878444 0 2024-04-25T02:27:15.573 INFO:tasks.workunit.client.0.smithi114.stdout:6/984: truncate de/d27/d34/d4b/d102/d120/fe8 2672757 0 2024-04-25T02:27:15.573 INFO:tasks.workunit.client.0.smithi114.stdout:0/843: dread d1/d4/da/d39/da7/fe3 [0,4194304] 0 2024-04-25T02:27:15.574 INFO:tasks.workunit.client.0.smithi114.stdout:3/909: dread - d0/d25/d2a/d80/f13f zero size 2024-04-25T02:27:15.574 INFO:tasks.workunit.client.0.smithi114.stdout:8/912: unlink c2 0 2024-04-25T02:27:15.574 INFO:tasks.workunit.client.0.smithi114.stdout:6/985: write de/d27/d34/d4b/f7c [4275095,79209] 0 2024-04-25T02:27:15.576 INFO:tasks.workunit.client.0.smithi114.stdout:4/777: sync 2024-04-25T02:27:15.579 INFO:tasks.workunit.client.0.smithi114.stdout:8/913: creat da/d38/db6/f11a x:0 0 0 2024-04-25T02:27:15.580 INFO:tasks.workunit.client.0.smithi114.stdout:8/914: write da/d1e/f3d [4157940,6153] 0 2024-04-25T02:27:15.580 INFO:tasks.workunit.client.0.smithi114.stdout:3/910: rmdir d0/d25/d2a/d80/d10e 39 2024-04-25T02:27:15.586 INFO:tasks.workunit.client.0.smithi114.stdout:0/844: link d1/d4/d24/d52/c9d d1/d4/da/d39/da7/c101 0 2024-04-25T02:27:15.587 INFO:tasks.workunit.client.0.smithi114.stdout:4/778: read d3/d8/d12/d19/d26/f2a [449151,88035] 0 2024-04-25T02:27:15.588 INFO:tasks.workunit.client.0.smithi114.stdout:0/845: creat d1/d4/d37/f102 x:0 0 0 2024-04-25T02:27:15.589 INFO:tasks.workunit.client.0.smithi114.stdout:8/915: dwrite da/d38/f2a [0,4194304] 0 2024-04-25T02:27:15.590 INFO:tasks.workunit.client.0.smithi114.stdout:4/779: mknod d3/d8/d12/d82/ceb 0 2024-04-25T02:27:15.590 INFO:tasks.workunit.client.0.smithi114.stdout:0/846: write d1/d7/d46/fbd [1353399,78493] 0 2024-04-25T02:27:15.591 INFO:tasks.workunit.client.0.smithi114.stdout:3/911: dread d0/d25/d2a/d80/dbd/d140/da9/dad/de4/f37 [0,4194304] 0 2024-04-25T02:27:15.592 INFO:tasks.workunit.client.0.smithi114.stdout:6/986: rmdir de/d25/dad/dde 39 2024-04-25T02:27:15.593 INFO:tasks.workunit.client.0.smithi114.stdout:4/780: stat d3/d8/d12/d19/d26/d3e/d62/c77 0 2024-04-25T02:27:15.600 INFO:tasks.workunit.client.0.smithi114.stdout:4/781: unlink d3/d8/d12/d19/d26/fa7 0 2024-04-25T02:27:15.602 INFO:tasks.workunit.client.0.smithi114.stdout:5/935: dwrite d1/d6/f43 [0,4194304] 0 2024-04-25T02:27:15.603 INFO:tasks.workunit.client.0.smithi114.stdout:0/847: mkdir d1/d7/dfb/d7e/dfc/d103 0 2024-04-25T02:27:15.605 INFO:tasks.workunit.client.0.smithi114.stdout:6/987: write de/d2a/db9/dc7/d100/f116 [98005,19114] 0 2024-04-25T02:27:15.607 INFO:tasks.workunit.client.0.smithi114.stdout:7/944: sync 2024-04-25T02:27:15.609 INFO:tasks.workunit.client.0.smithi114.stdout:9/854: truncate d8/d16/d21/dfb/ff4 2770878 0 2024-04-25T02:27:15.609 INFO:tasks.workunit.client.0.smithi114.stdout:1/872: dwrite df/d13/d44/d5a/dc9/d33/d47/d9d/fa1 [0,4194304] 0 2024-04-25T02:27:15.610 INFO:tasks.workunit.client.0.smithi114.stdout:9/855: fdatasync d8/f71 0 2024-04-25T02:27:15.611 INFO:tasks.workunit.client.0.smithi114.stdout:3/912: creat d0/d5/d3d/f148 x:0 0 0 2024-04-25T02:27:15.613 INFO:tasks.workunit.client.0.smithi114.stdout:3/913: fdatasync d0/d25/d29/d8c/f141 0 2024-04-25T02:27:15.614 INFO:tasks.workunit.client.0.smithi114.stdout:8/916: rename da/d38/d62/d6d/d52/l83 to da/d69/d93/d6b/l11b 0 2024-04-25T02:27:15.615 INFO:tasks.workunit.client.0.smithi114.stdout:7/945: dwrite d5/d19/d23/f113 [0,4194304] 0 2024-04-25T02:27:15.621 INFO:tasks.workunit.client.0.smithi114.stdout:6/988: unlink de/d25/d39/d47/d90/c141 0 2024-04-25T02:27:15.629 INFO:tasks.workunit.client.0.smithi114.stdout:1/873: chown df/d11/d7d/df9/d107/d124/f12e 531 1 2024-04-25T02:27:15.630 INFO:tasks.workunit.client.0.smithi114.stdout:7/946: dread d5/d32/d4a/fe1 [0,4194304] 0 2024-04-25T02:27:15.631 INFO:tasks.workunit.client.0.smithi114.stdout:9/856: dread d8/d16/d21/dfb/f86 [0,4194304] 0 2024-04-25T02:27:15.631 INFO:tasks.workunit.client.0.smithi114.stdout:7/947: chown d5/d19/f2a 2636338 1 2024-04-25T02:27:15.632 INFO:tasks.workunit.client.0.smithi114.stdout:3/914: rmdir d0/d25/d2a/d80/dbd/d140/da9/dad 39 2024-04-25T02:27:15.633 INFO:tasks.workunit.client.0.smithi114.stdout:0/848: mknod d1/d4/d4f/d77/da1/dd9/c104 0 2024-04-25T02:27:15.634 INFO:tasks.workunit.client.0.smithi114.stdout:0/849: write d1/d7/d46/fbd [2620442,11020] 0 2024-04-25T02:27:15.635 INFO:tasks.workunit.client.0.smithi114.stdout:0/850: write d1/d4/da/f2a [11616350,8337] 0 2024-04-25T02:27:15.635 INFO:tasks.workunit.client.0.smithi114.stdout:6/989: rename de/d27/d34/d4b/d102/f144 to de/d27/d34/d138/f158 0 2024-04-25T02:27:15.636 INFO:tasks.workunit.client.0.smithi114.stdout:0/851: truncate d1/d7/dfb/fc0 835163 0 2024-04-25T02:27:15.636 INFO:tasks.workunit.client.0.smithi114.stdout:7/948: creat d5/d19/d1a/da4/f135 x:0 0 0 2024-04-25T02:27:15.637 INFO:tasks.workunit.client.0.smithi114.stdout:4/782: link d3/d8/d12/d19/d26/d3e/daa/f83 d3/d8/d30/d6e/dcf/fec 0 2024-04-25T02:27:15.637 INFO:tasks.workunit.client.0.smithi114.stdout:0/852: write d1/d4/d37/d6a/db5/fc4 [1186634,33541] 0 2024-04-25T02:27:15.638 INFO:tasks.workunit.client.0.smithi114.stdout:0/853: truncate d1/d4/d24/fc9 757443 0 2024-04-25T02:27:15.640 INFO:tasks.workunit.client.0.smithi114.stdout:9/857: creat d8/d16/d21/d37/d60/f113 x:0 0 0 2024-04-25T02:27:15.641 INFO:tasks.workunit.client.0.smithi114.stdout:9/858: chown d8/d16/d21/d24/d3c/c10a 107661 1 2024-04-25T02:27:15.647 INFO:tasks.workunit.client.0.smithi114.stdout:1/874: mknod df/d13/d44/d9b/d119/dd6/d105/c12f 0 2024-04-25T02:27:15.648 INFO:tasks.workunit.client.0.smithi114.stdout:6/990: fdatasync de/d27/f96 0 2024-04-25T02:27:15.648 INFO:tasks.workunit.client.0.smithi114.stdout:1/875: chown df/d13/d44/d9b/d119/dd6/d82/de8/c103 50860 1 2024-04-25T02:27:15.650 INFO:tasks.workunit.client.0.smithi114.stdout:4/783: chown d3/d8/d23/d25/dd3/ce8 124963818 1 2024-04-25T02:27:15.652 INFO:tasks.workunit.client.0.smithi114.stdout:3/915: link d0/d25/d29/d60/f65 d0/d25/d2a/d34/d127/f149 0 2024-04-25T02:27:15.653 INFO:tasks.workunit.client.0.smithi114.stdout:9/859: dread - d8/d16/d21/dfb/d39/dab/f106 zero size 2024-04-25T02:27:15.654 INFO:tasks.workunit.client.0.smithi114.stdout:8/917: stat da/d38/fee 0 2024-04-25T02:27:15.655 INFO:tasks.workunit.client.0.smithi114.stdout:9/860: write d8/d16/d21/d37/d60/d70/ff5 [374397,94125] 0 2024-04-25T02:27:15.658 INFO:tasks.workunit.client.0.smithi114.stdout:1/876: unlink df/d2a/c4d 0 2024-04-25T02:27:15.660 INFO:tasks.workunit.client.0.smithi114.stdout:3/916: dread d0/f4b [8388608,4194304] 0 2024-04-25T02:27:15.664 INFO:tasks.workunit.client.0.smithi114.stdout:1/877: symlink df/d11/d32/l130 0 2024-04-25T02:27:15.666 INFO:tasks.workunit.client.0.smithi114.stdout:0/854: link d1/d7/d18/f9f d1/d4/d37/f105 0 2024-04-25T02:27:15.666 INFO:tasks.workunit.client.0.smithi114.stdout:6/991: write de/d27/d76/fd9 [613731,76728] 0 2024-04-25T02:27:15.667 INFO:tasks.workunit.client.0.smithi114.stdout:4/784: write d3/d8/d12/d19/d42/d58/fdc [906132,14208] 0 2024-04-25T02:27:15.667 INFO:tasks.workunit.client.0.smithi114.stdout:6/992: chown de/d27/d34/d4b/l130 13234 1 2024-04-25T02:27:15.668 INFO:tasks.workunit.client.0.smithi114.stdout:3/917: unlink d0/d25/d2a/d80/dbd/d140/f101 0 2024-04-25T02:27:15.669 INFO:tasks.workunit.client.0.smithi114.stdout:9/861: symlink d8/d16/d21/l114 0 2024-04-25T02:27:15.671 INFO:tasks.workunit.client.0.smithi114.stdout:7/949: getdents d5 0 2024-04-25T02:27:15.672 INFO:tasks.workunit.client.0.smithi114.stdout:1/878: mkdir df/d11/d32/d131 0 2024-04-25T02:27:15.673 INFO:tasks.workunit.client.0.smithi114.stdout:1/879: write df/d13/d1e/da2/fd3 [67733,94787] 0 2024-04-25T02:27:15.673 INFO:tasks.workunit.client.0.smithi114.stdout:7/950: read d5/d19/f2a [363734,43554] 0 2024-04-25T02:27:15.675 INFO:tasks.workunit.client.0.smithi114.stdout:4/785: creat d3/d8/d12/d82/dde/fed x:0 0 0 2024-04-25T02:27:15.676 INFO:tasks.workunit.client.0.smithi114.stdout:9/862: fsync d8/d16/d21/dfb/ff4 0 2024-04-25T02:27:15.677 INFO:tasks.workunit.client.0.smithi114.stdout:4/786: stat d3/d14/d6c 0 2024-04-25T02:27:15.679 INFO:tasks.workunit.client.0.smithi114.stdout:1/880: creat df/d11/d7d/df9/f132 x:0 0 0 2024-04-25T02:27:15.684 INFO:tasks.workunit.client.0.smithi114.stdout:3/918: dwrite d0/d25/d2a/d80/dbd/d140/da9/dad/de4/f5e [0,4194304] 0 2024-04-25T02:27:15.685 INFO:tasks.workunit.client.0.smithi114.stdout:0/855: dwrite d1/d4/d4f/da9/dac/df8/d4d/fe8 [0,4194304] 0 2024-04-25T02:27:15.687 INFO:tasks.workunit.client.0.smithi114.stdout:8/918: link da/d38/d62/d6d/d52/lc7 da/d69/d87/l11c 0 2024-04-25T02:27:15.688 INFO:tasks.workunit.client.0.smithi114.stdout:4/787: dwrite d3/d14/f53 [0,4194304] 0 2024-04-25T02:27:15.689 INFO:tasks.workunit.client.0.smithi114.stdout:3/919: readlink d0/d25/d29/l88 0 2024-04-25T02:27:15.689 INFO:tasks.workunit.client.0.smithi114.stdout:9/863: mkdir d8/d16/d21/dfb/d39/d38/d46/d53/d115 0 2024-04-25T02:27:15.693 INFO:tasks.workunit.client.0.smithi114.stdout:9/864: truncate d8/d16/d21/dfb/d39/d38/d46/d53/ff0 5379216 0 2024-04-25T02:27:15.693 INFO:tasks.workunit.client.0.smithi114.stdout:1/881: symlink df/d13/d44/d9b/d119/dd6/d82/de8/dfe/d77/dc0/d114/l133 0 2024-04-25T02:27:15.693 INFO:tasks.workunit.client.0.smithi114.stdout:2/915: sync 2024-04-25T02:27:15.694 INFO:tasks.workunit.client.0.smithi114.stdout:1/882: write df/d13/d75/fe3 [8484512,73825] 0 2024-04-25T02:27:15.697 INFO:tasks.workunit.client.0.smithi114.stdout:9/865: dwrite d8/f71 [0,4194304] 0 2024-04-25T02:27:15.698 INFO:tasks.workunit.client.0.smithi114.stdout:9/866: readlink d8/ld 0 2024-04-25T02:27:15.699 INFO:tasks.workunit.client.0.smithi114.stdout:8/919: getdents da/d38/db6/dfe 0 2024-04-25T02:27:15.701 INFO:tasks.workunit.client.0.smithi114.stdout:8/920: write da/d69/d93/d6b/f7e [602204,115913] 0 2024-04-25T02:27:15.702 INFO:tasks.workunit.client.0.smithi114.stdout:9/867: write d8/d16/d21/dfb/d39/d38/d46/d96/fc1 [3133241,8882] 0 2024-04-25T02:27:15.704 INFO:tasks.workunit.client.0.smithi114.stdout:7/951: dwrite d5/d60/f6a [0,4194304] 0 2024-04-25T02:27:15.704 INFO:tasks.workunit.client.0.smithi114.stdout:9/868: fdatasync d8/d16/d21/dfb/d39/d38/fe4 0 2024-04-25T02:27:15.706 INFO:tasks.workunit.client.0.smithi114.stdout:2/916: rmdir d5/d6/d11d 0 2024-04-25T02:27:15.708 INFO:tasks.workunit.client.0.smithi114.stdout:1/883: getdents df/d13/d75/d8e/d104 0 2024-04-25T02:27:15.712 INFO:tasks.workunit.client.0.smithi114.stdout:2/917: creat d5/df/f127 x:0 0 0 2024-04-25T02:27:15.712 INFO:tasks.workunit.client.0.smithi114.stdout:8/921: dwrite da/d38/d62/d6d/f9e [0,4194304] 0 2024-04-25T02:27:15.713 INFO:tasks.workunit.client.0.smithi114.stdout:7/952: dread d5/d32/d64/dff/d12b/f5b [0,4194304] 0 2024-04-25T02:27:15.716 INFO:tasks.workunit.client.0.smithi114.stdout:2/918: fsync d5/df/d3d/d44/d11e/f5f 0 2024-04-25T02:27:15.716 INFO:tasks.workunit.client.0.smithi114.stdout:9/869: dwrite d8/d16/d21/d37/f108 [0,4194304] 0 2024-04-25T02:27:15.718 INFO:tasks.workunit.client.0.smithi114.stdout:9/870: fdatasync d8/d16/d21/dfb/d39/f62 0 2024-04-25T02:27:15.719 INFO:tasks.workunit.client.0.smithi114.stdout:2/919: readlink d5/df/d3d/d44/d11e/d5a/d3e/d54/lb4 0 2024-04-25T02:27:15.719 INFO:tasks.workunit.client.0.smithi114.stdout:1/884: dwrite df/d11/f24 [4194304,4194304] 0 2024-04-25T02:27:15.719 INFO:tasks.workunit.client.0.smithi114.stdout:8/922: mknod da/d38/d62/d6d/d49/d65/c11d 0 2024-04-25T02:27:15.720 INFO:tasks.workunit.client.0.smithi114.stdout:9/871: fsync d8/d16/d21/d24/f9d 0 2024-04-25T02:27:15.721 INFO:tasks.workunit.client.0.smithi114.stdout:9/872: stat d8/d16/d21/dfb/c8d 0 2024-04-25T02:27:15.722 INFO:tasks.workunit.client.0.smithi114.stdout:2/920: write d5/fe [1434549,64527] 0 2024-04-25T02:27:15.723 INFO:tasks.workunit.client.0.smithi114.stdout:7/953: rmdir d5/d43/d63/d7a/d121 0 2024-04-25T02:27:15.728 INFO:tasks.workunit.client.0.smithi114.stdout:8/923: mkdir da/d38/d62/d11e 0 2024-04-25T02:27:15.728 INFO:tasks.workunit.client.0.smithi114.stdout:2/921: dwrite d5/df/d1e/f11a [0,4194304] 0 2024-04-25T02:27:15.729 INFO:tasks.workunit.client.0.smithi114.stdout:7/954: creat d5/d19/d1a/da4/db3/f136 x:0 0 0 2024-04-25T02:27:15.732 INFO:tasks.workunit.client.0.smithi114.stdout:9/873: rmdir d8/d16/d21/dfb/d39/d38/d46/d53/d115 0 2024-04-25T02:27:15.733 INFO:tasks.workunit.client.0.smithi114.stdout:2/922: symlink d5/df/d3d/l128 0 2024-04-25T02:27:15.733 INFO:tasks.workunit.client.0.smithi114.stdout:9/874: chown d8/d16/d21/d37/d43/d75/f105 25257658 1 2024-04-25T02:27:15.734 INFO:tasks.workunit.client.0.smithi114.stdout:9/875: readlink d8/d16/d21/dfb/d39/l54 0 2024-04-25T02:27:15.734 INFO:tasks.workunit.client.0.smithi114.stdout:7/955: mknod d5/d8b/d99/c137 0 2024-04-25T02:27:15.735 INFO:tasks.workunit.client.0.smithi114.stdout:2/923: mkdir d5/df/d3d/d44/d11e/d5a/d59/d129 0 2024-04-25T02:27:15.737 INFO:tasks.workunit.client.0.smithi114.stdout:9/876: creat d8/f116 x:0 0 0 2024-04-25T02:27:15.738 INFO:tasks.workunit.client.0.smithi114.stdout:2/924: creat d5/df/dc9/def/f12a x:0 0 0 2024-04-25T02:27:15.739 INFO:tasks.workunit.client.0.smithi114.stdout:7/956: mknod d5/d32/d4a/c138 0 2024-04-25T02:27:15.740 INFO:tasks.workunit.client.0.smithi114.stdout:7/957: fsync d5/d19/d23/f3a 0 2024-04-25T02:27:15.740 INFO:tasks.workunit.client.0.smithi114.stdout:7/958: stat d5/d19/d1a/da4/db3/d103/l123 0 2024-04-25T02:27:15.746 INFO:tasks.workunit.client.0.smithi114.stdout:7/959: dwrite d5/d19/f2b [4194304,4194304] 0 2024-04-25T02:27:15.748 INFO:tasks.workunit.client.0.smithi114.stdout:2/925: dread d5/df/f53 [0,4194304] 0 2024-04-25T02:27:15.749 INFO:tasks.workunit.client.0.smithi114.stdout:7/960: symlink d5/d8b/d99/ddb/l139 0 2024-04-25T02:27:15.750 INFO:tasks.workunit.client.0.smithi114.stdout:2/926: symlink d5/df/d3d/d44/d11e/d5a/d3e/l12b 0 2024-04-25T02:27:15.753 INFO:tasks.workunit.client.0.smithi114.stdout:2/927: mknod d5/df/d3d/d44/d11e/d5a/c12c 0 2024-04-25T02:27:15.757 INFO:tasks.workunit.client.0.smithi114.stdout:2/928: creat d5/df/d3d/d81/f12d x:0 0 0 2024-04-25T02:27:15.757 INFO:tasks.workunit.client.0.smithi114.stdout:7/961: dwrite d5/d32/d4a/f118 [0,4194304] 0 2024-04-25T02:27:15.760 INFO:tasks.workunit.client.0.smithi114.stdout:5/936: sync 2024-04-25T02:27:15.760 INFO:tasks.workunit.client.0.smithi114.stdout:2/929: chown d5/df/d3d/d44/d11e/d5a/lbb 185092 1 2024-04-25T02:27:15.761 INFO:tasks.workunit.client.0.smithi114.stdout:5/937: mkdir d1/d25/d139 0 2024-04-25T02:27:15.763 INFO:tasks.workunit.client.0.smithi114.stdout:2/930: getdents d5/d1c/d22/d89/d118 0 2024-04-25T02:27:15.763 INFO:tasks.workunit.client.0.smithi114.stdout:7/962: dwrite d5/d19/d23/f3c [0,4194304] 0 2024-04-25T02:27:15.767 INFO:tasks.workunit.client.0.smithi114.stdout:7/963: dread d5/d32/d4a/d91/f73 [0,4194304] 0 2024-04-25T02:27:15.767 INFO:tasks.workunit.client.0.smithi114.stdout:2/931: dread d5/df/d3d/d44/d11e/d5a/fb8 [0,4194304] 0 2024-04-25T02:27:15.768 INFO:tasks.workunit.client.0.smithi114.stdout:2/932: write d5/d79/f9f [159036,122158] 0 2024-04-25T02:27:15.768 INFO:tasks.workunit.client.0.smithi114.stdout:5/938: link d1/d6/d1a/l47 d1/d6/d4f/d6c/d88/db6/dc8/l13a 0 2024-04-25T02:27:15.769 INFO:tasks.workunit.client.0.smithi114.stdout:7/964: symlink d5/d19/d1a/da4/db3/d103/l13a 0 2024-04-25T02:27:15.770 INFO:tasks.workunit.client.0.smithi114.stdout:5/939: creat d1/d25/da1/d8a/da8/f13b x:0 0 0 2024-04-25T02:27:15.771 INFO:tasks.workunit.client.0.smithi114.stdout:2/933: truncate d5/df/d3d/d81/fd8 1615780 0 2024-04-25T02:27:15.772 INFO:tasks.workunit.client.0.smithi114.stdout:7/965: creat d5/d19/d1a/da4/db3/f13b x:0 0 0 2024-04-25T02:27:15.773 INFO:tasks.workunit.client.0.smithi114.stdout:7/966: read d5/d32/d4a/d91/f73 [359117,84982] 0 2024-04-25T02:27:15.773 INFO:tasks.workunit.client.0.smithi114.stdout:5/940: creat d1/d6/de/dbc/f13c x:0 0 0 2024-04-25T02:27:15.774 INFO:tasks.workunit.client.0.smithi114.stdout:5/941: chown d1/d6/de/f1d 16 1 2024-04-25T02:27:15.774 INFO:tasks.workunit.client.0.smithi114.stdout:2/934: symlink d5/d1c/d29/d105/l12e 0 2024-04-25T02:27:15.775 INFO:tasks.workunit.client.0.smithi114.stdout:9/877: dread d8/d16/d21/d24/d3c/d40/f58 [0,4194304] 0 2024-04-25T02:27:15.776 INFO:tasks.workunit.client.0.smithi114.stdout:6/993: sync 2024-04-25T02:27:15.776 INFO:tasks.workunit.client.0.smithi114.stdout:0/856: sync 2024-04-25T02:27:15.777 INFO:tasks.workunit.client.0.smithi114.stdout:7/967: creat d5/d43/d4e/dec/d11a/f13c x:0 0 0 2024-04-25T02:27:15.777 INFO:tasks.workunit.client.0.smithi114.stdout:2/935: symlink d5/df/d3d/d44/d11e/d5a/d3e/l12f 0 2024-04-25T02:27:15.779 INFO:tasks.workunit.client.0.smithi114.stdout:9/878: read d8/d16/d21/dfb/d39/d38/f80 [385250,36482] 0 2024-04-25T02:27:15.779 INFO:tasks.workunit.client.0.smithi114.stdout:0/857: readlink d1/d4/d4f/da9/dac/df8/d4d/l70 0 2024-04-25T02:27:15.780 INFO:tasks.workunit.client.0.smithi114.stdout:6/994: mkdir de/d25/d39/d47/d90/d93/d143/d159 0 2024-04-25T02:27:15.781 INFO:tasks.workunit.client.0.smithi114.stdout:0/858: write d1/d4/da/f73 [4661741,114029] 0 2024-04-25T02:27:15.790 INFO:tasks.workunit.client.0.smithi114.stdout:5/942: dwrite d1/d51/d6f/f11a [0,4194304] 0 2024-04-25T02:27:15.791 INFO:tasks.workunit.client.0.smithi114.stdout:4/788: truncate d3/d8/d23/fb3 1195696 0 2024-04-25T02:27:15.791 INFO:tasks.workunit.client.0.smithi114.stdout:3/920: truncate d0/d5/f44 1381686 0 2024-04-25T02:27:15.793 INFO:tasks.workunit.client.0.smithi114.stdout:0/859: write d1/d7/d46/fe4 [468021,16293] 0 2024-04-25T02:27:15.794 INFO:tasks.workunit.client.0.smithi114.stdout:1/885: write df/d13/d44/d5a/dc9/d33/fab [902313,93488] 0 2024-04-25T02:27:15.795 INFO:tasks.workunit.client.0.smithi114.stdout:8/924: truncate da/d69/d93/f10c 424823 0 2024-04-25T02:27:15.798 INFO:tasks.workunit.client.0.smithi114.stdout:3/921: unlink d0/c1f 0 2024-04-25T02:27:15.799 INFO:tasks.workunit.client.0.smithi114.stdout:0/860: write d1/d4/da/d39/da7/fe3 [414316,36235] 0 2024-04-25T02:27:15.801 INFO:tasks.workunit.client.0.smithi114.stdout:8/925: unlink da/d38/l5e 0 2024-04-25T02:27:15.804 INFO:tasks.workunit.client.0.smithi114.stdout:3/922: creat d0/d25/d29/d8c/f14a x:0 0 0 2024-04-25T02:27:15.804 INFO:tasks.workunit.client.0.smithi114.stdout:3/923: chown d0/d25/d29 50 1 2024-04-25T02:27:15.804 INFO:tasks.workunit.client.0.smithi114.stdout:0/861: mknod d1/d4/d37/d6a/db5/c106 0 2024-04-25T02:27:15.808 INFO:tasks.workunit.client.0.smithi114.stdout:8/926: creat da/d1e/f11f x:0 0 0 2024-04-25T02:27:15.808 INFO:tasks.workunit.client.0.smithi114.stdout:4/789: dread d3/d8/d12/d19/d26/f2a [0,4194304] 0 2024-04-25T02:27:15.813 INFO:tasks.workunit.client.0.smithi114.stdout:4/790: dread d3/d8/d30/d4c/d7f/fca [0,4194304] 0 2024-04-25T02:27:15.813 INFO:tasks.workunit.client.0.smithi114.stdout:4/791: chown d3/d8/d12/d19/d26/d3e/f55 738671706 1 2024-04-25T02:27:15.814 INFO:tasks.workunit.client.0.smithi114.stdout:0/862: link d1/d7/d97/fe2 d1/d4/d62/d83/da0/f107 0 2024-04-25T02:27:15.815 INFO:tasks.workunit.client.0.smithi114.stdout:8/927: mkdir da/d38/d62/d6d/d120 0 2024-04-25T02:27:15.817 INFO:tasks.workunit.client.0.smithi114.stdout:4/792: mknod d3/d8/d12/d19/d42/cee 0 2024-04-25T02:27:15.817 INFO:tasks.workunit.client.0.smithi114.stdout:6/995: dread de/d27/d34/d4b/d102/d120/fe3 [0,4194304] 0 2024-04-25T02:27:15.817 INFO:tasks.workunit.client.0.smithi114.stdout:4/793: readlink d3/d8/d30/l3a 0 2024-04-25T02:27:15.817 INFO:tasks.workunit.client.0.smithi114.stdout:6/996: stat de/d2a/db9/dc7/d100 0 2024-04-25T02:27:15.819 INFO:tasks.workunit.client.0.smithi114.stdout:4/794: read d3/d8/d12/d19/d42/d58/f9b [1361363,128572] 0 2024-04-25T02:27:15.820 INFO:tasks.workunit.client.0.smithi114.stdout:4/795: truncate d3/d8/d12/d19/fb4 93685 0 2024-04-25T02:27:15.822 INFO:tasks.workunit.client.0.smithi114.stdout:6/997: rmdir de/d27 39 2024-04-25T02:27:15.823 INFO:tasks.workunit.client.0.smithi114.stdout:6/998: write de/d25/d39/dec/f140 [436425,45763] 0 2024-04-25T02:27:15.823 INFO:tasks.workunit.client.0.smithi114.stdout:0/863: link d1/d4/d37/d6a/c79 d1/d4/d62/d83/da0/c108 0 2024-04-25T02:27:15.824 INFO:tasks.workunit.client.0.smithi114.stdout:7/968: truncate d5/d19/d1a/f24 4105359 0 2024-04-25T02:27:15.825 INFO:tasks.workunit.client.0.smithi114.stdout:4/796: symlink d3/d8/d12/d19/d26/d3e/daa/dce/d33/lef 0 2024-04-25T02:27:15.831 INFO:tasks.workunit.client.0.smithi114.stdout:7/969: rename d5/d32/d64/dff to d5/d19/d1a/da4/d13d 0 2024-04-25T02:27:15.833 INFO:tasks.workunit.client.0.smithi114.stdout:4/797: truncate d3/f16 4372181 0 2024-04-25T02:27:15.834 INFO:tasks.workunit.client.0.smithi114.stdout:4/798: dread - d3/d8/d30/d4c/d7f/fe7 zero size 2024-04-25T02:27:15.834 INFO:tasks.workunit.client.0.smithi114.stdout:6/999: write de/d27/d76/fd0 [1294932,100734] 0 2024-04-25T02:27:15.835 INFO:tasks.workunit.client.0.smithi114.stdout:0/864: rename d1/d4/d4f/da9/dac/df8/d4d/f6d to d1/d4/d4f/da9/dac/df8/d98/f109 0 2024-04-25T02:27:15.836 INFO:tasks.workunit.client.0.smithi114.stdout:1/886: write df/d13/d44/d5a/dc9/f5d [1950543,49672] 0 2024-04-25T02:27:15.836 INFO:tasks.workunit.client.0.smithi114.stdout:7/970: mknod d5/d32/d64/c13e 0 2024-04-25T02:27:15.840 INFO:tasks.workunit.client.0.smithi114.stdout:3/924: truncate d0/d25/d2a/d34/f7d 18102 0 2024-04-25T02:27:15.845 INFO:tasks.workunit.client.0.smithi114.stdout:7/971: getdents d5/d19/d1a/da4/d13d/d12b 0 2024-04-25T02:27:15.845 INFO:tasks.workunit.client.0.smithi114.stdout:8/928: write da/d38/d62/d6d/f42 [1023243,17943] 0 2024-04-25T02:27:15.846 INFO:tasks.workunit.client.0.smithi114.stdout:3/925: symlink d0/d25/d29/dcb/l14b 0 2024-04-25T02:27:15.847 INFO:tasks.workunit.client.0.smithi114.stdout:8/929: stat da/d38/d62/d6d/d49/d65/dd0/c82 0 2024-04-25T02:27:15.848 INFO:tasks.workunit.client.0.smithi114.stdout:1/887: getdents df/d13/d44/d9b/d119/dd6 0 2024-04-25T02:27:15.849 INFO:tasks.workunit.client.0.smithi114.stdout:3/926: dread d0/d25/d29/d78/faf [0,4194304] 0 2024-04-25T02:27:15.849 INFO:tasks.workunit.client.0.smithi114.stdout:7/972: rename d5/d19/d1a/da4/d13d/d12b/f95 to d5/d19/d1a/da4/db3/d106/d127/f13f 0 2024-04-25T02:27:15.850 INFO:tasks.workunit.client.0.smithi114.stdout:7/973: readlink d5/d32/d4a/l53 0 2024-04-25T02:27:15.851 INFO:tasks.workunit.client.0.smithi114.stdout:3/927: dread d0/d25/d29/d78/faf [0,4194304] 0 2024-04-25T02:27:15.855 INFO:tasks.workunit.client.0.smithi114.stdout:7/974: rename d5/d19/d1a/da4/fe6 to d5/d19/d1a/da4/f140 0 2024-04-25T02:27:15.858 INFO:tasks.workunit.client.0.smithi114.stdout:1/888: rename df/d13/d44/d9b/d119/dd6/d82/l123 to df/d13/d44/d9b/d119/dd6/d105/l134 0 2024-04-25T02:27:15.859 INFO:tasks.workunit.client.0.smithi114.stdout:3/928: dwrite d0/d25/fb7 [0,4194304] 0 2024-04-25T02:27:15.860 INFO:tasks.workunit.client.0.smithi114.stdout:3/929: chown d0/d5/f43 1113340 1 2024-04-25T02:27:15.861 INFO:tasks.workunit.client.0.smithi114.stdout:8/930: symlink da/d69/d93/deb/l121 0 2024-04-25T02:27:15.864 INFO:tasks.workunit.client.0.smithi114.stdout:4/799: truncate d3/d8/d12/d19/d42/d58/f6b 3805265 0 2024-04-25T02:27:15.867 INFO:tasks.workunit.client.0.smithi114.stdout:0/865: write d1/d4/d4f/da9/dac/df8/f8e [1653542,72798] 0 2024-04-25T02:27:15.870 INFO:tasks.workunit.client.0.smithi114.stdout:3/930: truncate d0/d25/d2a/d80/dbd/d140/da9/dad/de4/f3c 101264 0 2024-04-25T02:27:15.871 INFO:tasks.workunit.client.0.smithi114.stdout:3/931: write d0/d25/d2a/d34/d125/f130 [528467,76319] 0 2024-04-25T02:27:15.872 INFO:tasks.workunit.client.0.smithi114.stdout:7/975: creat d5/d8b/d99/dae/f141 x:0 0 0 2024-04-25T02:27:15.872 INFO:tasks.workunit.client.0.smithi114.stdout:3/932: write d0/d5/f28 [1559558,63564] 0 2024-04-25T02:27:15.873 INFO:tasks.workunit.client.0.smithi114.stdout:0/866: mknod d1/d7/d97/c10a 0 2024-04-25T02:27:15.873 INFO:tasks.workunit.client.0.smithi114.stdout:0/867: chown d1/d7/d18/f3b 433 1 2024-04-25T02:27:15.873 INFO:tasks.workunit.client.0.smithi114.stdout:1/889: mkdir df/d11/d108/d135 0 2024-04-25T02:27:15.875 INFO:tasks.workunit.client.0.smithi114.stdout:4/800: mkdir d3/d8/d23/d25/df0 0 2024-04-25T02:27:15.877 INFO:tasks.workunit.client.0.smithi114.stdout:2/936: sync 2024-04-25T02:27:15.877 INFO:tasks.workunit.client.0.smithi114.stdout:7/976: symlink d5/d43/d63/l142 0 2024-04-25T02:27:15.879 INFO:tasks.workunit.client.0.smithi114.stdout:3/933: fdatasync d0/d25/d29/d60/f12f 0 2024-04-25T02:27:15.881 INFO:tasks.workunit.client.0.smithi114.stdout:3/934: write d0/f19 [666715,75991] 0 2024-04-25T02:27:15.882 INFO:tasks.workunit.client.0.smithi114.stdout:4/801: dwrite d3/d8/d12/d19/d42/d58/fdc [0,4194304] 0 2024-04-25T02:27:15.882 INFO:tasks.workunit.client.0.smithi114.stdout:1/890: write fe [7119932,125182] 0 2024-04-25T02:27:15.883 INFO:tasks.workunit.client.0.smithi114.stdout:2/937: mkdir d5/d1c/d22/d89/d130 0 2024-04-25T02:27:15.886 INFO:tasks.workunit.client.0.smithi114.stdout:7/977: creat d5/d43/d63/d7a/de4/f143 x:0 0 0 2024-04-25T02:27:15.888 INFO:tasks.workunit.client.0.smithi114.stdout:7/978: write d5/d19/d23/fe0 [3413171,15506] 0 2024-04-25T02:27:15.889 INFO:tasks.workunit.client.0.smithi114.stdout:8/931: getdents da/d38/d62/d6d/d49/d65 0 2024-04-25T02:27:15.889 INFO:tasks.workunit.client.0.smithi114.stdout:0/868: dwrite d1/d4/db4/fbe [0,4194304] 0 2024-04-25T02:27:15.892 INFO:tasks.workunit.client.0.smithi114.stdout:2/938: mkdir d5/d1c/d29/de0/df1/d131 0 2024-04-25T02:27:15.893 INFO:tasks.workunit.client.0.smithi114.stdout:1/891: dwrite df/d13/d44/d9b/d119/dd6/d82/de8/dfe/d77/f122 [0,4194304] 0 2024-04-25T02:27:15.893 INFO:tasks.workunit.client.0.smithi114.stdout:9/879: sync 2024-04-25T02:27:15.893 INFO:tasks.workunit.client.0.smithi114.stdout:5/943: sync 2024-04-25T02:27:15.896 INFO:tasks.workunit.client.0.smithi114.stdout:5/944: read d1/d6/f127 [1330481,66366] 0 2024-04-25T02:27:15.897 INFO:tasks.workunit.client.0.smithi114.stdout:8/932: mknod da/d38/d62/d6d/d49/d65/c122 0 2024-04-25T02:27:15.903 INFO:tasks.workunit.client.0.smithi114.stdout:0/869: creat d1/d4/d62/d83/d84/f10b x:0 0 0 2024-04-25T02:27:15.903 INFO:tasks.workunit.client.0.smithi114.stdout:2/939: dwrite d5/df/d3d/f5e [0,4194304] 0 2024-04-25T02:27:15.903 INFO:tasks.workunit.client.0.smithi114.stdout:0/870: chown d1/d4/d62/d83/d84/cda 22 1 2024-04-25T02:27:15.905 INFO:tasks.workunit.client.0.smithi114.stdout:9/880: chown d8/d16/d21/dfb/d39/d38/d5d/l64 0 1 2024-04-25T02:27:15.909 INFO:tasks.workunit.client.0.smithi114.stdout:8/933: unlink da/d69/d93/d6b/dbb/f10d 0 2024-04-25T02:27:15.911 INFO:tasks.workunit.client.0.smithi114.stdout:2/940: rmdir d5/d1c/d22/d67 39 2024-04-25T02:27:15.912 INFO:tasks.workunit.client.0.smithi114.stdout:5/945: dwrite d1/d6/d4f/d6c/d88/db6/dc8/f122 [0,4194304] 0 2024-04-25T02:27:15.915 INFO:tasks.workunit.client.0.smithi114.stdout:0/871: mkdir d1/d7/dfb/d7e/d10c 0 2024-04-25T02:27:15.956 INFO:tasks.workunit.client.0.smithi114.stdout:0/872: creat d1/d7/d68/d69/f10d x:0 0 0 2024-04-25T02:27:15.956 INFO:tasks.workunit.client.0.smithi114.stdout:5/946: dwrite d1/d3e/d8e/d94/d10c/f124 [0,4194304] 0 2024-04-25T02:27:15.956 INFO:tasks.workunit.client.0.smithi114.stdout:7/979: link d5/d19/d1a/da4/db3/d106/d127/d130/l52 d5/d43/d63/l144 0 2024-04-25T02:27:15.958 INFO:tasks.workunit.client.0.smithi114.stdout:0/873: chown d1/d4/fb6 0 1 2024-04-25T02:27:15.961 INFO:tasks.workunit.client.0.smithi114.stdout:1/892: link df/l66 df/d13/d44/d9b/d119/dd6/d82/de8/l136 0 2024-04-25T02:27:15.962 INFO:tasks.workunit.client.0.smithi114.stdout:9/881: rename d8/d16/d21/dfb/d39/d38/d5d/dd3 to d8/d16/d21/d117 0 2024-04-25T02:27:15.962 INFO:tasks.workunit.client.0.smithi114.stdout:8/934: truncate da/d38/d62/d6d/d49/d65/dd0/f91 3258309 0 2024-04-25T02:27:15.965 INFO:tasks.workunit.client.0.smithi114.stdout:3/935: dwrite d0/d25/d2a/d80/dbd/d140/da9/dad/de4/f13b [0,4194304] 0 2024-04-25T02:27:15.966 INFO:tasks.workunit.client.0.smithi114.stdout:4/802: dwrite d3/d8/d30/d4c/d7f/f94 [0,4194304] 0 2024-04-25T02:27:15.970 INFO:tasks.workunit.client.0.smithi114.stdout:8/935: truncate da/d1e/dcd/fea 4874209 0 2024-04-25T02:27:15.970 INFO:tasks.workunit.client.0.smithi114.stdout:3/936: write d0/d5/f6c [486715,118104] 0 2024-04-25T02:27:15.971 INFO:tasks.workunit.client.0.smithi114.stdout:1/893: creat df/d13/d44/d9b/d119/dd6/d105/f137 x:0 0 0 2024-04-25T02:27:15.972 INFO:tasks.workunit.client.0.smithi114.stdout:3/937: stat d0/d25/d2a/d34/fa7 0 2024-04-25T02:27:15.973 INFO:tasks.workunit.client.0.smithi114.stdout:1/894: stat df/d13/d75/fe3 0 2024-04-25T02:27:15.973 INFO:tasks.workunit.client.0.smithi114.stdout:0/874: dwrite d1/d4/da/f12 [0,4194304] 0 2024-04-25T02:27:15.974 INFO:tasks.workunit.client.0.smithi114.stdout:4/803: rename d3/d8/d23/d25/df0 to d3/db9/df1 0 2024-04-25T02:27:15.975 INFO:tasks.workunit.client.0.smithi114.stdout:8/936: mkdir da/d69/d93/deb/d123 0 2024-04-25T02:27:15.975 INFO:tasks.workunit.client.0.smithi114.stdout:9/882: dwrite d8/d16/d21/dfb/f5f [0,4194304] 0 2024-04-25T02:27:15.977 INFO:tasks.workunit.client.0.smithi114.stdout:3/938: fsync d0/d25/d2a/d80/f12c 0 2024-04-25T02:27:15.977 INFO:tasks.workunit.client.0.smithi114.stdout:9/883: readlink d8/d16/d21/d24/l6d 0 2024-04-25T02:27:15.978 INFO:tasks.workunit.client.0.smithi114.stdout:8/937: write da/d38/db6/de8/dfc/f113 [329060,39154] 0 2024-04-25T02:27:15.980 INFO:tasks.workunit.client.0.smithi114.stdout:8/938: write da/d1e/f11f [393180,63508] 0 2024-04-25T02:27:15.980 INFO:tasks.workunit.client.0.smithi114.stdout:8/939: fsync da/d38/f2a 0 2024-04-25T02:27:15.980 INFO:tasks.workunit.client.0.smithi114.stdout:8/940: chown da/d38/db6/de8 14247205 1 2024-04-25T02:27:15.981 INFO:tasks.workunit.client.0.smithi114.stdout:8/941: stat da/d1e/f96 0 2024-04-25T02:27:15.983 INFO:tasks.workunit.client.0.smithi114.stdout:4/804: read d3/d8/d23/d25/f87 [3258753,28078] 0 2024-04-25T02:27:15.989 INFO:tasks.workunit.client.0.smithi114.stdout:0/875: creat d1/d7/dfb/d8f/dfa/f10e x:0 0 0 2024-04-25T02:27:15.990 INFO:tasks.workunit.client.0.smithi114.stdout:8/942: creat da/d69/d93/d6b/dbb/f124 x:0 0 0 2024-04-25T02:27:15.992 INFO:tasks.workunit.client.0.smithi114.stdout:1/895: link df/d13/d44/d9b/d119/dd6/d82/de8/fef df/d11/d32/d131/f138 0 2024-04-25T02:27:15.992 INFO:tasks.workunit.client.0.smithi114.stdout:7/980: dwrite d5/d43/d4e/f4f [0,4194304] 0 2024-04-25T02:27:15.993 INFO:tasks.workunit.client.0.smithi114.stdout:3/939: symlink d0/d25/d2a/d80/d10e/l14c 0 2024-04-25T02:27:15.994 INFO:tasks.workunit.client.0.smithi114.stdout:7/981: fdatasync d5/d32/d4a/d87/fb6 0 2024-04-25T02:27:15.994 INFO:tasks.workunit.client.0.smithi114.stdout:4/805: creat d3/d8/d30/d4c/d7f/dd2/ff2 x:0 0 0 2024-04-25T02:27:15.994 INFO:tasks.workunit.client.0.smithi114.stdout:2/941: sync 2024-04-25T02:27:15.995 INFO:tasks.workunit.client.0.smithi114.stdout:3/940: read d0/d25/d29/f63 [4603164,9193] 0 2024-04-25T02:27:15.996 INFO:tasks.workunit.client.0.smithi114.stdout:0/876: unlink d1/d4/da/l74 0 2024-04-25T02:27:15.997 INFO:tasks.workunit.client.0.smithi114.stdout:1/896: mkdir df/d11/d32/d139 0 2024-04-25T02:27:15.998 INFO:tasks.workunit.client.0.smithi114.stdout:0/877: chown d1/d4/d62/d83/da0/f107 476840 1 2024-04-25T02:27:16.000 INFO:tasks.workunit.client.0.smithi114.stdout:1/897: fsync df/d13/d44/d9b/d119/dd6/d82/de8/dfe/f55 0 2024-04-25T02:27:16.001 INFO:tasks.workunit.client.0.smithi114.stdout:8/943: dwrite da/ff [0,4194304] 0 2024-04-25T02:27:16.002 INFO:tasks.workunit.client.0.smithi114.stdout:3/941: rmdir d0/d25/d29 39 2024-04-25T02:27:16.002 INFO:tasks.workunit.client.0.smithi114.stdout:5/947: truncate d1/d6/d4f/d6c/d88/f102 3704 0 2024-04-25T02:27:16.004 INFO:tasks.workunit.client.0.smithi114.stdout:3/942: chown d0/f21 8837882 1 2024-04-25T02:27:16.004 INFO:tasks.workunit.client.0.smithi114.stdout:7/982: creat d5/d32/d4a/d87/d12c/f145 x:0 0 0 2024-04-25T02:27:16.005 INFO:tasks.workunit.client.0.smithi114.stdout:5/948: truncate d1/d6/f31 8566990 0 2024-04-25T02:27:16.007 INFO:tasks.workunit.client.0.smithi114.stdout:0/878: dwrite d1/d4/da/f73 [0,4194304] 0 2024-04-25T02:27:16.007 INFO:tasks.workunit.client.0.smithi114.stdout:8/944: readlink da/d69/d87/d8d/lc9 0 2024-04-25T02:27:16.012 INFO:tasks.workunit.client.0.smithi114.stdout:0/879: unlink d1/d4/d4f/dd7/cdd 0 2024-04-25T02:27:16.012 INFO:tasks.workunit.client.0.smithi114.stdout:2/942: link d5/d1c/d22/d89/c104 d5/d1c/d29/de0/df1/c132 0 2024-04-25T02:27:16.013 INFO:tasks.workunit.client.0.smithi114.stdout:1/898: mkdir df/d11/d7d/d92/d11f/d13a 0 2024-04-25T02:27:16.013 INFO:tasks.workunit.client.0.smithi114.stdout:0/880: write d1/d7/d46/fbd [537093,33427] 0 2024-04-25T02:27:16.017 INFO:tasks.workunit.client.0.smithi114.stdout:9/884: dread d8/d16/d21/d24/d69/faa [0,4194304] 0 2024-04-25T02:27:16.020 INFO:tasks.workunit.client.0.smithi114.stdout:7/983: rename d5/d19/d1a/da4/ccc to d5/d32/d4a/c146 0 2024-04-25T02:27:16.022 INFO:tasks.workunit.client.0.smithi114.stdout:3/943: getdents d0/d25/d2a/d80/dbd/d140/da9/dad/de4 0 2024-04-25T02:27:16.023 INFO:tasks.workunit.client.0.smithi114.stdout:2/943: dwrite d5/df/d2c/f108 [0,4194304] 0 2024-04-25T02:27:16.024 INFO:tasks.workunit.client.0.smithi114.stdout:7/984: truncate d5/d19/d23/f3a 1092201 0 2024-04-25T02:27:16.024 INFO:tasks.workunit.client.0.smithi114.stdout:2/944: write d5/df/d63/f75 [1576096,45450] 0 2024-04-25T02:27:16.029 INFO:tasks.workunit.client.0.smithi114.stdout:7/985: symlink d5/d32/d4a/d87/d12c/l147 0 2024-04-25T02:27:16.031 INFO:tasks.workunit.client.0.smithi114.stdout:2/945: mknod d5/df/d63/c133 0 2024-04-25T02:27:16.032 INFO:tasks.workunit.client.0.smithi114.stdout:2/946: dread - d5/d1c/d22/d89/f93 zero size 2024-04-25T02:27:16.032 INFO:tasks.workunit.client.0.smithi114.stdout:9/885: dread d8/d16/d21/d24/d69/df3/fad [0,4194304] 0 2024-04-25T02:27:16.034 INFO:tasks.workunit.client.0.smithi114.stdout:7/986: rename d5/d19/d1a/da4/f140 to d5/d32/da6/db5/db9/f148 0 2024-04-25T02:27:16.038 INFO:tasks.workunit.client.0.smithi114.stdout:7/987: creat d5/d19/d1a/da4/d13d/d12b/f149 x:0 0 0 2024-04-25T02:27:16.039 INFO:tasks.workunit.client.0.smithi114.stdout:2/947: rmdir d5/df/d3d/d44/d11e/d5a/d59/d129 0 2024-04-25T02:27:16.039 INFO:tasks.workunit.client.0.smithi114.stdout:2/948: chown d5/df/d3d/f4b 0 1 2024-04-25T02:27:16.041 INFO:tasks.workunit.client.0.smithi114.stdout:7/988: creat d5/d32/d4a/d91/f14a x:0 0 0 2024-04-25T02:27:16.045 INFO:tasks.workunit.client.0.smithi114.stdout:2/949: rmdir d5/d79/dd1 0 2024-04-25T02:27:16.048 INFO:tasks.workunit.client.0.smithi114.stdout:0/881: dread d1/d7/d18/f22 [0,4194304] 0 2024-04-25T02:27:16.048 INFO:tasks.workunit.client.0.smithi114.stdout:7/989: dwrite d5/d43/d63/f92 [0,4194304] 0 2024-04-25T02:27:16.051 INFO:tasks.workunit.client.0.smithi114.stdout:2/950: mkdir d5/daf/dda/de1/d134 0 2024-04-25T02:27:16.052 INFO:tasks.workunit.client.0.smithi114.stdout:0/882: creat d1/d4/d4f/f10f x:0 0 0 2024-04-25T02:27:16.055 INFO:tasks.workunit.client.0.smithi114.stdout:3/944: dread d0/d5/d3d/fa5 [0,4194304] 0 2024-04-25T02:27:16.058 INFO:tasks.workunit.client.0.smithi114.stdout:9/886: dread d8/d16/d21/dfb/d39/d38/d46/d53/fa9 [0,4194304] 0 2024-04-25T02:27:16.060 INFO:tasks.workunit.client.0.smithi114.stdout:4/806: dwrite d3/d8/d12/d19/d26/d3e/daa/f83 [0,4194304] 0 2024-04-25T02:27:16.060 INFO:tasks.workunit.client.0.smithi114.stdout:2/951: mkdir d5/d1c/d22/d67/db2/d135 0 2024-04-25T02:27:16.063 INFO:tasks.workunit.client.0.smithi114.stdout:8/945: truncate da/d38/d62/d6d/f7f 3172677 0 2024-04-25T02:27:16.063 INFO:tasks.workunit.client.0.smithi114.stdout:9/887: symlink d8/d16/d21/d24/d69/df3/l118 0 2024-04-25T02:27:16.064 INFO:tasks.workunit.client.0.smithi114.stdout:0/883: rmdir d1/d7/d46/d7a 0 2024-04-25T02:27:16.065 INFO:tasks.workunit.client.0.smithi114.stdout:2/952: mknod d5/d1c/d21/c136 0 2024-04-25T02:27:16.065 INFO:tasks.workunit.client.0.smithi114.stdout:1/899: write df/f11a [1121565,7029] 0 2024-04-25T02:27:16.066 INFO:tasks.workunit.client.0.smithi114.stdout:4/807: creat d3/d8/d12/ff3 x:0 0 0 2024-04-25T02:27:16.068 INFO:tasks.workunit.client.0.smithi114.stdout:8/946: dread da/d69/d93/d40/fa6 [0,4194304] 0 2024-04-25T02:27:16.068 INFO:tasks.workunit.client.0.smithi114.stdout:5/949: dwrite d1/d3e/d8e/de5/fac [0,4194304] 0 2024-04-25T02:27:16.069 INFO:tasks.workunit.client.0.smithi114.stdout:2/953: write d5/df/d3d/d44/d11e/d5a/d3e/fd4 [598743,70504] 0 2024-04-25T02:27:16.071 INFO:tasks.workunit.client.0.smithi114.stdout:3/945: rmdir d0/d5/d3d/da6/dce/dd6 0 2024-04-25T02:27:16.071 INFO:tasks.workunit.client.0.smithi114.stdout:9/888: creat d8/d16/d21/dfb/d39/d38/d46/d96/f119 x:0 0 0 2024-04-25T02:27:16.072 INFO:tasks.workunit.client.0.smithi114.stdout:1/900: write df/d2a/f46 [205712,99132] 0 2024-04-25T02:27:16.074 INFO:tasks.workunit.client.0.smithi114.stdout:4/808: mknod d3/d8/d12/d19/d42/d58/cf4 0 2024-04-25T02:27:16.075 INFO:tasks.workunit.client.0.smithi114.stdout:4/809: write d3/d8/d30/d93/fd6 [246788,75115] 0 2024-04-25T02:27:16.077 INFO:tasks.workunit.client.0.smithi114.stdout:4/810: truncate d3/d8/d12/d82/dde/fed 708949 0 2024-04-25T02:27:16.078 INFO:tasks.workunit.client.0.smithi114.stdout:4/811: readlink d3/d8/d30/d6e/l80 0 2024-04-25T02:27:16.078 INFO:tasks.workunit.client.0.smithi114.stdout:5/950: rename d1/d6/de/f8d to d1/d6/de/da7/ddf/dc5/dfd/dc1/f13d 0 2024-04-25T02:27:16.079 INFO:tasks.workunit.client.0.smithi114.stdout:9/889: readlink d8/d16/d21/d24/lb2 0 2024-04-25T02:27:16.079 INFO:tasks.workunit.client.0.smithi114.stdout:1/901: fsync df/d13/f60 0 2024-04-25T02:27:16.081 INFO:tasks.workunit.client.0.smithi114.stdout:3/946: dread d0/d25/d2a/d80/dbd/fc2 [0,4194304] 0 2024-04-25T02:27:16.081 INFO:tasks.workunit.client.0.smithi114.stdout:2/954: mkdir d5/daf/dda/de1/df9/d137 0 2024-04-25T02:27:16.081 INFO:tasks.workunit.client.0.smithi114.stdout:9/890: readlink d8/d16/d21/d24/d69/df3/l118 0 2024-04-25T02:27:16.083 INFO:tasks.workunit.client.0.smithi114.stdout:4/812: stat d3/d8/d12/d19/d26/d3e/daa/d89/da0/cc9 0 2024-04-25T02:27:16.083 INFO:tasks.workunit.client.0.smithi114.stdout:1/902: truncate df/d13/d44/d9b/d119/f12b 320256 0 2024-04-25T02:27:16.085 INFO:tasks.workunit.client.0.smithi114.stdout:5/951: dread d1/d6/d4f/d6c/d88/db6/dc8/fc9 [0,4194304] 0 2024-04-25T02:27:16.089 INFO:tasks.workunit.client.0.smithi114.stdout:3/947: creat d0/d25/d29/d60/da8/f14d x:0 0 0 2024-04-25T02:27:16.090 INFO:tasks.workunit.client.0.smithi114.stdout:4/813: rename d3/d8/d23/d25/d4e/daf to d3/d8/d12/d19/d26/d3e/daa/d89/df5 0 2024-04-25T02:27:16.091 INFO:tasks.workunit.client.0.smithi114.stdout:4/814: chown d3/d8/d12/d82/fd8 3604044 1 2024-04-25T02:27:16.093 INFO:tasks.workunit.client.0.smithi114.stdout:0/884: dread d1/d7/d18/f51 [0,4194304] 0 2024-04-25T02:27:16.093 INFO:tasks.workunit.client.0.smithi114.stdout:5/952: mknod d1/d25/da1/daa/c13e 0 2024-04-25T02:27:16.095 INFO:tasks.workunit.client.0.smithi114.stdout:8/947: dread da/d38/db6/de8/f9f [4194304,4194304] 0 2024-04-25T02:27:16.096 INFO:tasks.workunit.client.0.smithi114.stdout:3/948: mknod d0/d25/d2a/d80/dbd/c14e 0 2024-04-25T02:27:16.101 INFO:tasks.workunit.client.0.smithi114.stdout:0/885: dwrite d1/d7/d46/fe4 [0,4194304] 0 2024-04-25T02:27:16.102 INFO:tasks.workunit.client.0.smithi114.stdout:7/990: dwrite d5/d19/d1a/d80/fa2 [4194304,4194304] 0 2024-04-25T02:27:16.107 INFO:tasks.workunit.client.0.smithi114.stdout:7/991: dread - d5/d19/d1a/da4/db3/d106/f12a zero size 2024-04-25T02:27:16.107 INFO:tasks.workunit.client.0.smithi114.stdout:1/903: link df/d11/d7d/d92/lc6 df/d13/d44/d9b/d119/dd6/d82/de8/dfe/l13b 0 2024-04-25T02:27:16.107 INFO:tasks.workunit.client.0.smithi114.stdout:8/948: read da/d1e/dcd/fd7 [3447593,18058] 0 2024-04-25T02:27:16.107 INFO:tasks.workunit.client.0.smithi114.stdout:7/992: write d5/d32/d4a/dbc/f115 [1473203,70389] 0 2024-04-25T02:27:16.113 INFO:tasks.workunit.client.0.smithi114.stdout:0/886: truncate d1/f2c 928638 0 2024-04-25T02:27:16.115 INFO:tasks.workunit.client.0.smithi114.stdout:1/904: symlink df/d2a/l13c 0 2024-04-25T02:27:16.116 INFO:tasks.workunit.client.0.smithi114.stdout:1/905: write df/d13/d75/f9c [49480,64062] 0 2024-04-25T02:27:16.117 INFO:tasks.workunit.client.0.smithi114.stdout:7/993: truncate d5/d19/d1a/da4/d13d/d12b/f5b 2230659 0 2024-04-25T02:27:16.119 INFO:tasks.workunit.client.0.smithi114.stdout:7/994: read d5/d32/d4a/d91/f57 [1672841,129803] 0 2024-04-25T02:27:16.121 INFO:tasks.workunit.client.0.smithi114.stdout:0/887: dread d1/d4/d4f/da9/dac/df8/f8e [0,4194304] 0 2024-04-25T02:27:16.121 INFO:tasks.workunit.client.0.smithi114.stdout:1/906: symlink df/d13/d44/d5a/dc9/d33/d47/l13d 0 2024-04-25T02:27:16.123 INFO:tasks.workunit.client.0.smithi114.stdout:9/891: truncate d8/d16/d21/dfb/f5f 3019631 0 2024-04-25T02:27:16.124 INFO:tasks.workunit.client.0.smithi114.stdout:3/949: getdents d0/d25/d2a/d34/d127 0 2024-04-25T02:27:16.126 INFO:tasks.workunit.client.0.smithi114.stdout:0/888: stat d1/d7/d46/c90 0 2024-04-25T02:27:16.127 INFO:tasks.workunit.client.0.smithi114.stdout:7/995: mkdir d5/d19/d23/d14b 0 2024-04-25T02:27:16.127 INFO:tasks.workunit.client.0.smithi114.stdout:2/955: dwrite d5/d79/d8e/f9d [0,4194304] 0 2024-04-25T02:27:16.128 INFO:tasks.workunit.client.0.smithi114.stdout:5/953: write d1/d25/f63 [1692594,101963] 0 2024-04-25T02:27:16.131 INFO:tasks.workunit.client.0.smithi114.stdout:3/950: creat d0/d5/d3d/dd7/dfa/f14f x:0 0 0 2024-04-25T02:27:16.133 INFO:tasks.workunit.client.0.smithi114.stdout:5/954: truncate d1/d53/d55/db1/fef 399157 0 2024-04-25T02:27:16.134 INFO:tasks.workunit.client.0.smithi114.stdout:1/907: creat df/d13/d44/d9b/d119/dd6/d82/de8/dfe/d111/f13e x:0 0 0 2024-04-25T02:27:16.135 INFO:tasks.workunit.client.0.smithi114.stdout:7/996: dread d5/d43/d4e/f9c [0,4194304] 0 2024-04-25T02:27:16.136 INFO:tasks.workunit.client.0.smithi114.stdout:0/889: dread d1/d4/db4/fbe [0,4194304] 0 2024-04-25T02:27:16.138 INFO:tasks.workunit.client.0.smithi114.stdout:8/949: truncate da/d38/d62/d6d/d52/fe9 3222896 0 2024-04-25T02:27:16.138 INFO:tasks.workunit.client.0.smithi114.stdout:3/951: chown d0/d25/d29/dcb/ceb 142 1 2024-04-25T02:27:16.138 INFO:tasks.workunit.client.0.smithi114.stdout:4/815: dwrite d3/d14/f64 [0,4194304] 0 2024-04-25T02:27:16.139 INFO:tasks.workunit.client.0.smithi114.stdout:7/997: write d5/d19/d1a/d80/fa2 [5378581,93169] 0 2024-04-25T02:27:16.181 INFO:tasks.workunit.client.0.smithi114.stdout:5/955: fdatasync d1/d25/f9d 0 2024-04-25T02:27:16.181 INFO:tasks.workunit.client.0.smithi114.stdout:9/892: dread d8/d16/d21/dfb/d39/d38/d5d/d111/fbf [0,4194304] 0 2024-04-25T02:27:16.183 INFO:tasks.workunit.client.0.smithi114.stdout:2/956: write d5/df/d3d/d44/fe4 [1033483,111944] 0 2024-04-25T02:27:16.183 INFO:tasks.workunit.client.0.smithi114.stdout:5/956: chown d1/d6/d1a/d7f 36000038 1 2024-04-25T02:27:16.184 INFO:tasks.workunit.client.0.smithi114.stdout:8/950: mknod da/d69/d87/db4/c125 0 2024-04-25T02:27:16.184 INFO:tasks.workunit.client.0.smithi114.stdout:7/998: mkdir d5/dbf/d14c 0 2024-04-25T02:27:16.185 INFO:tasks.workunit.client.0.smithi114.stdout:3/952: mkdir d0/d25/d29/d8c/d150 0 2024-04-25T02:27:16.185 INFO:tasks.workunit.client.0.smithi114.stdout:9/893: chown d8/d16/d21/d37/d43/d75/d8a/l9c 30006 1 2024-04-25T02:27:16.185 INFO:tasks.workunit.client.0.smithi114.stdout:4/816: mkdir d3/d8/d30/d4c/d7f/d8d/df6 0 2024-04-25T02:27:16.187 INFO:tasks.workunit.client.0.smithi114.stdout:4/817: stat d3/d8/d12/d19/d26/f2a 0 2024-04-25T02:27:16.190 INFO:tasks.workunit.client.0.smithi114.stdout:2/957: dread d5/df/f53 [0,4194304] 0 2024-04-25T02:27:16.190 INFO:tasks.workunit.client.0.smithi114.stdout:4/818: fdatasync d3/d8/d12/d19/d26/d3e/daa/dce/d33/fbe 0 2024-04-25T02:27:16.192 INFO:tasks.workunit.client.0.smithi114.stdout:8/951: dwrite da/d69/d93/d6b/fdb [0,4194304] 0 2024-04-25T02:27:16.194 INFO:tasks.workunit.client.0.smithi114.stdout:4/819: dread d3/d8/d96/fcc [0,4194304] 0 2024-04-25T02:27:16.204 INFO:tasks.workunit.client.0.smithi114.stdout:8/952: dread da/d38/d62/d6d/f2c [0,4194304] 0 2024-04-25T02:27:16.247 INFO:tasks.workunit.client.0.smithi114.stdout:3/953: write d0/d5/d3d/f40 [1631692,5973] 0 2024-04-25T02:27:16.248 INFO:tasks.workunit.client.0.smithi114.stdout:7/999: symlink d5/d32/d4a/d91/dfb/l14d 0 2024-04-25T02:27:16.250 INFO:tasks.workunit.client.0.smithi114.stdout:9/894: mkdir d8/d16/d21/dfb/d39/d38/d46/d11a 0 2024-04-25T02:27:16.250 INFO:tasks.workunit.client.0.smithi114.stdout:9/895: chown d8/d16/d21/d24/d3c/lae 714 1 2024-04-25T02:27:16.252 INFO:tasks.workunit.client.0.smithi114.stdout:1/908: sync 2024-04-25T02:27:16.256 INFO:tasks.workunit.client.0.smithi114.stdout:4/820: creat d3/d8/d12/d19/d42/d58/ff7 x:0 0 0 2024-04-25T02:27:16.258 INFO:tasks.workunit.client.0.smithi114.stdout:8/953: unlink da/d38/d62/d6d/cf3 0 2024-04-25T02:27:16.260 INFO:tasks.workunit.client.0.smithi114.stdout:5/957: mkdir d1/d6/d1a/d7f/d11b/d13f 0 2024-04-25T02:27:16.260 INFO:tasks.workunit.client.0.smithi114.stdout:9/896: dread d8/fe [0,4194304] 0 2024-04-25T02:27:16.261 INFO:tasks.workunit.client.0.smithi114.stdout:9/897: truncate d8/d16/d21/d37/f108 4858308 0 2024-04-25T02:27:16.263 INFO:tasks.workunit.client.0.smithi114.stdout:1/909: mkdir df/d11/d7d/d92/da9/d13f 0 2024-04-25T02:27:16.263 INFO:tasks.workunit.client.0.smithi114.stdout:3/954: dread d0/d25/d2a/dc4/ff6 [0,4194304] 0 2024-04-25T02:27:16.264 INFO:tasks.workunit.client.0.smithi114.stdout:1/910: chown df/d13/d1e/l118 445 1 2024-04-25T02:27:16.265 INFO:tasks.workunit.client.0.smithi114.stdout:4/821: mknod d3/d14/cf8 0 2024-04-25T02:27:16.266 INFO:tasks.workunit.client.0.smithi114.stdout:3/955: truncate d0/d25/d2a/d80/f102 951250 0 2024-04-25T02:27:16.266 INFO:tasks.workunit.client.0.smithi114.stdout:4/822: chown d3/d8/d23/d25 4103151 1 2024-04-25T02:27:16.267 INFO:tasks.workunit.client.0.smithi114.stdout:9/898: dread d8/d16/d21/dfb/ffc [0,4194304] 0 2024-04-25T02:27:16.279 INFO:tasks.workunit.client.0.smithi114.stdout:2/958: dread d5/df/d3d/f6f [0,4194304] 0 2024-04-25T02:27:16.279 INFO:tasks.workunit.client.0.smithi114.stdout:4/823: dwrite d3/d14/d6c/f9a [0,4194304] 0 2024-04-25T02:27:16.281 INFO:tasks.workunit.client.0.smithi114.stdout:2/959: readlink d5/df/d3d/d44/d11e/d5a/d3e/d54/lb4 0 2024-04-25T02:27:16.287 INFO:tasks.workunit.client.0.smithi114.stdout:4/824: rename d3/d8/d12/d19/d26/d3e/daa/dce/d33/c81 to d3/d8/d30/d4c/db5/cf9 0 2024-04-25T02:27:16.287 INFO:tasks.workunit.client.0.smithi114.stdout:4/825: chown d3/d8/d23/fc4 0 1 2024-04-25T02:27:16.288 INFO:tasks.workunit.client.0.smithi114.stdout:2/960: creat d5/df/d2c/dfd/f138 x:0 0 0 2024-04-25T02:27:16.289 INFO:tasks.workunit.client.0.smithi114.stdout:2/961: write d5/d1c/d21/db0/f11c [655944,101595] 0 2024-04-25T02:27:16.293 INFO:tasks.workunit.client.0.smithi114.stdout:2/962: mknod d5/daf/dda/de1/df9/c139 0 2024-04-25T02:27:16.294 INFO:tasks.workunit.client.0.smithi114.stdout:2/963: rmdir d5/df/d3d/d44/d11e/d5a/d3e 39 2024-04-25T02:27:16.295 INFO:tasks.workunit.client.0.smithi114.stdout:2/964: stat d5/df/d1e/c57 0 2024-04-25T02:27:16.311 INFO:tasks.workunit.client.0.smithi114.stdout:8/954: sync 2024-04-25T02:27:16.311 INFO:tasks.workunit.client.0.smithi114.stdout:8/955: write da/d38/fc5 [921968,16283] 0 2024-04-25T02:27:16.314 INFO:tasks.workunit.client.0.smithi114.stdout:0/890: truncate d1/d4/f63 5365545 0 2024-04-25T02:27:16.318 INFO:tasks.workunit.client.0.smithi114.stdout:8/956: dread da/d38/d62/d6d/fe3 [0,4194304] 0 2024-04-25T02:27:16.319 INFO:tasks.workunit.client.0.smithi114.stdout:0/891: dwrite d1/d4/d24/d52/f5f [4194304,4194304] 0 2024-04-25T02:27:16.321 INFO:tasks.workunit.client.0.smithi114.stdout:0/892: read d1/d4/f1b [429643,53845] 0 2024-04-25T02:27:16.321 INFO:tasks.workunit.client.0.smithi114.stdout:0/893: stat d1/d7/dfb/c40 0 2024-04-25T02:27:16.329 INFO:tasks.workunit.client.0.smithi114.stdout:5/958: dwrite d1/d6/d1a/f64 [0,4194304] 0 2024-04-25T02:27:16.330 INFO:tasks.workunit.client.0.smithi114.stdout:1/911: truncate df/d11/d32/f8b 3668641 0 2024-04-25T02:27:16.331 INFO:tasks.workunit.client.0.smithi114.stdout:3/956: write d0/d25/d29/fc6 [393079,208] 0 2024-04-25T02:27:16.332 INFO:tasks.workunit.client.0.smithi114.stdout:5/959: write d1/d6/d4f/d6c/fcb [2591058,70056] 0 2024-04-25T02:27:16.334 INFO:tasks.workunit.client.0.smithi114.stdout:9/899: truncate d8/d16/d21/d24/d69/df3/fad 3550 0 2024-04-25T02:27:16.337 INFO:tasks.workunit.client.0.smithi114.stdout:4/826: rename d3/d8/d30/d4c to d3/d8/d23/d25/d4e/dfa 0 2024-04-25T02:27:16.341 INFO:tasks.workunit.client.0.smithi114.stdout:2/965: rename d5/df/d3d/d44/d11e/d5a/d59/dad to d5/d1c/d22/d67/db2/d135/d13a 0 2024-04-25T02:27:16.342 INFO:tasks.workunit.client.0.smithi114.stdout:2/966: dread - d5/df/d3d/d81/f12d zero size 2024-04-25T02:27:16.342 INFO:tasks.workunit.client.0.smithi114.stdout:1/912: getdents df/d13/d93/dca 0 2024-04-25T02:27:16.343 INFO:tasks.workunit.client.0.smithi114.stdout:1/913: stat df/d13/d44/d5a/dc9/d33/d47/lb0 0 2024-04-25T02:27:16.343 INFO:tasks.workunit.client.0.smithi114.stdout:1/914: chown df/d2a/f46 19432227 1 2024-04-25T02:27:16.345 INFO:tasks.workunit.client.0.smithi114.stdout:8/957: rename da/d38/db6 to da/d69/d90/d126 0 2024-04-25T02:27:16.350 INFO:tasks.workunit.client.0.smithi114.stdout:0/894: rename d1/d7/d68/ld1 to d1/d4/da/l110 0 2024-04-25T02:27:16.351 INFO:tasks.workunit.client.0.smithi114.stdout:8/958: creat da/d1e/dcd/f127 x:0 0 0 2024-04-25T02:27:16.354 INFO:tasks.workunit.client.0.smithi114.stdout:3/957: rename d0/d5 to d0/d25/d2a/d34/d151 0 2024-04-25T02:27:16.354 INFO:tasks.workunit.client.0.smithi114.stdout:4/827: dread d3/d8/d23/d25/f2d [0,4194304] 0 2024-04-25T02:27:16.355 INFO:tasks.workunit.client.0.smithi114.stdout:4/828: fsync d3/d14/f64 0 2024-04-25T02:27:16.356 INFO:tasks.workunit.client.0.smithi114.stdout:8/959: creat da/d38/d62/d6d/d52/d6c/f128 x:0 0 0 2024-04-25T02:27:16.357 INFO:tasks.workunit.client.0.smithi114.stdout:8/960: stat da/d38/d62/d6d/f51 0 2024-04-25T02:27:16.359 INFO:tasks.workunit.client.0.smithi114.stdout:4/829: truncate d3/d8/d12/d19/d26/d3e/daa/d89/fe4 312516 0 2024-04-25T02:27:16.359 INFO:tasks.workunit.client.0.smithi114.stdout:9/900: dread d8/d16/d21/d37/fec [0,4194304] 0 2024-04-25T02:27:16.362 INFO:tasks.workunit.client.0.smithi114.stdout:1/915: dread df/d13/d44/d9b/d119/dd6/d82/de8/dfe/f116 [0,4194304] 0 2024-04-25T02:27:16.366 INFO:tasks.workunit.client.0.smithi114.stdout:5/960: rename d1/d6/d4f/d6c/fcb to d1/d6/f140 0 2024-04-25T02:27:16.369 INFO:tasks.workunit.client.0.smithi114.stdout:1/916: creat df/d13/d44/d9b/d119/dd6/d82/de8/dfe/d120/f140 x:0 0 0 2024-04-25T02:27:16.370 INFO:tasks.workunit.client.0.smithi114.stdout:5/961: mknod d1/d3e/d8e/de5/d82/c141 0 2024-04-25T02:27:16.371 INFO:tasks.workunit.client.0.smithi114.stdout:1/917: rmdir df/d13/d75/d8e/dd1 39 2024-04-25T02:27:16.372 INFO:tasks.workunit.client.0.smithi114.stdout:1/918: fsync df/d13/d6e/fe5 0 2024-04-25T02:27:16.374 INFO:tasks.workunit.client.0.smithi114.stdout:1/919: stat df/d13/d93/df7/c125 0 2024-04-25T02:27:16.376 INFO:tasks.workunit.client.0.smithi114.stdout:4/830: dread d3/d8/f1c [0,4194304] 0 2024-04-25T02:27:16.377 INFO:tasks.workunit.client.0.smithi114.stdout:1/920: write df/d13/d44/d9b/d119/dd6/fb3 [257441,32776] 0 2024-04-25T02:27:16.377 INFO:tasks.workunit.client.0.smithi114.stdout:5/962: dwrite d1/d25/fe8 [0,4194304] 0 2024-04-25T02:27:16.378 INFO:tasks.workunit.client.0.smithi114.stdout:8/961: dread da/d38/d62/d6d/d52/d6c/fba [0,4194304] 0 2024-04-25T02:27:16.381 INFO:tasks.workunit.client.0.smithi114.stdout:5/963: dread d1/d6/d4f/d6c/d88/db6/dc8/fc9 [0,4194304] 0 2024-04-25T02:27:16.382 INFO:tasks.workunit.client.0.smithi114.stdout:0/895: truncate d1/d4/d24/d52/fd0 2445516 0 2024-04-25T02:27:16.383 INFO:tasks.workunit.client.0.smithi114.stdout:4/831: creat d3/d8/d12/d19/d26/d3e/daa/d89/df5/ffb x:0 0 0 2024-04-25T02:27:16.383 INFO:tasks.workunit.client.0.smithi114.stdout:3/958: write d0/d25/d2a/d34/d9e/f126 [852618,48270] 0 2024-04-25T02:27:16.388 INFO:tasks.workunit.client.0.smithi114.stdout:1/921: link df/d13/dbb/l10e df/d13/d1e/l141 0 2024-04-25T02:27:16.389 INFO:tasks.workunit.client.0.smithi114.stdout:1/922: write df/d13/d75/faa [904569,113050] 0 2024-04-25T02:27:16.389 INFO:tasks.workunit.client.0.smithi114.stdout:4/832: creat d3/d8/d23/d25/d4e/dfa/d7f/ffc x:0 0 0 2024-04-25T02:27:16.395 INFO:tasks.workunit.client.0.smithi114.stdout:3/959: unlink d0/d25/d2a/d34/l95 0 2024-04-25T02:27:16.396 INFO:tasks.workunit.client.0.smithi114.stdout:3/960: chown d0/d25/d2a/d80/dbd/d140/da9/dad/cee 9299 1 2024-04-25T02:27:16.397 INFO:tasks.workunit.client.0.smithi114.stdout:1/923: readlink df/d13/l3b 0 2024-04-25T02:27:16.397 INFO:tasks.workunit.client.0.smithi114.stdout:1/924: stat df/d11 0 2024-04-25T02:27:16.398 INFO:tasks.workunit.client.0.smithi114.stdout:8/962: link da/d69/d90/d126/de8/c9c da/d69/d90/d126/dfe/c129 0 2024-04-25T02:27:16.398 INFO:tasks.workunit.client.0.smithi114.stdout:0/896: link d1/d7/d18/f1d d1/d7/dfb/d7e/f111 0 2024-04-25T02:27:16.399 INFO:tasks.workunit.client.0.smithi114.stdout:0/897: fdatasync d1/d4/da/f16 0 2024-04-25T02:27:16.400 INFO:tasks.workunit.client.0.smithi114.stdout:4/833: truncate d3/d8/f57 1043999 0 2024-04-25T02:27:16.405 INFO:tasks.workunit.client.0.smithi114.stdout:8/963: dwrite da/d38/d62/f106 [0,4194304] 0 2024-04-25T02:27:16.410 INFO:tasks.workunit.client.0.smithi114.stdout:2/967: sync 2024-04-25T02:27:16.410 INFO:tasks.workunit.client.0.smithi114.stdout:2/968: dread - d5/df/d2c/d66/db3/ff8 zero size 2024-04-25T02:27:16.411 INFO:tasks.workunit.client.0.smithi114.stdout:4/834: link d3/d8/d12/d19/d26/d3e/daa/fa3 d3/d8/d12/d19/d26/d3e/daa/d89/df5/ffd 0 2024-04-25T02:27:16.413 INFO:tasks.workunit.client.0.smithi114.stdout:8/964: truncate da/d69/d90/d126/de8/f3f 2968022 0 2024-04-25T02:27:16.414 INFO:tasks.workunit.client.0.smithi114.stdout:5/964: truncate d1/d6/d4f/d6c/d88/fb5 2372510 0 2024-04-25T02:27:16.415 INFO:tasks.workunit.client.0.smithi114.stdout:4/835: creat d3/d8/d12/d19/d42/d58/ffe x:0 0 0 2024-04-25T02:27:16.416 INFO:tasks.workunit.client.0.smithi114.stdout:5/965: truncate d1/d53/d55/db1/f117 968116 0 2024-04-25T02:27:16.417 INFO:tasks.workunit.client.0.smithi114.stdout:2/969: mkdir d5/d1c/d22/d13b 0 2024-04-25T02:27:16.420 INFO:tasks.workunit.client.0.smithi114.stdout:2/970: stat d5/d1c/c52 0 2024-04-25T02:27:16.421 INFO:tasks.workunit.client.0.smithi114.stdout:8/965: creat da/d1e/dcd/f12a x:0 0 0 2024-04-25T02:27:16.422 INFO:tasks.workunit.client.0.smithi114.stdout:4/836: creat d3/d8/d30/d93/de2/fff x:0 0 0 2024-04-25T02:27:16.422 INFO:tasks.workunit.client.0.smithi114.stdout:1/925: dread df/d13/d44/d9b/d119/dd6/d82/de8/dfe/fcd [0,4194304] 0 2024-04-25T02:27:16.423 INFO:tasks.workunit.client.0.smithi114.stdout:5/966: fdatasync d1/d6/d4f/d6c/d88/fb5 0 2024-04-25T02:27:16.424 INFO:tasks.workunit.client.0.smithi114.stdout:5/967: read d1/d6/de/dbc/f9b [162469,41097] 0 2024-04-25T02:27:16.424 INFO:tasks.workunit.client.0.smithi114.stdout:2/971: unlink d5/d6/d31/lec 0 2024-04-25T02:27:16.425 INFO:tasks.workunit.client.0.smithi114.stdout:3/961: truncate d0/d25/d2a/d34/d151/f17 3206471 0 2024-04-25T02:27:16.426 INFO:tasks.workunit.client.0.smithi114.stdout:9/901: sync 2024-04-25T02:27:16.433 INFO:tasks.workunit.client.0.smithi114.stdout:2/972: unlink d5/df/d2c/d66/c113 0 2024-04-25T02:27:16.433 INFO:tasks.workunit.client.0.smithi114.stdout:3/962: dread d0/d25/d2a/d80/dbd/d140/f106 [0,4194304] 0 2024-04-25T02:27:16.433 INFO:tasks.workunit.client.0.smithi114.stdout:5/968: rename d1/d25/d24/f3f to d1/d6/de/dbc/f142 0 2024-04-25T02:27:16.435 INFO:tasks.workunit.client.0.smithi114.stdout:3/963: write d0/f19 [1252031,24761] 0 2024-04-25T02:27:16.436 INFO:tasks.workunit.client.0.smithi114.stdout:1/926: creat df/d11/d108/d135/f142 x:0 0 0 2024-04-25T02:27:16.437 INFO:tasks.workunit.client.0.smithi114.stdout:3/964: fdatasync d0/d25/d2a/d80/d10e/f147 0 2024-04-25T02:27:16.437 INFO:tasks.workunit.client.0.smithi114.stdout:0/898: dwrite d1/d7/f80 [0,4194304] 0 2024-04-25T02:27:16.438 INFO:tasks.workunit.client.0.smithi114.stdout:3/965: stat d0/d25/d29/l88 0 2024-04-25T02:27:16.438 INFO:tasks.workunit.client.0.smithi114.stdout:0/899: stat d1/d4/d4f/da9/dac/df8/d4d 0 2024-04-25T02:27:16.439 INFO:tasks.workunit.client.0.smithi114.stdout:1/927: creat df/d13/d44/f143 x:0 0 0 2024-04-25T02:27:16.441 INFO:tasks.workunit.client.0.smithi114.stdout:1/928: chown df/d13/d44/d5a/dc9/d33/d47/d74/c8c 2488221 1 2024-04-25T02:27:16.445 INFO:tasks.workunit.client.0.smithi114.stdout:0/900: creat d1/d4/d4f/da9/dac/df8/d98/f112 x:0 0 0 2024-04-25T02:27:16.446 INFO:tasks.workunit.client.0.smithi114.stdout:8/966: truncate da/d69/d90/d126/fd4 3301757 0 2024-04-25T02:27:16.446 INFO:tasks.workunit.client.0.smithi114.stdout:0/901: dread - d1/d4/da/f7b zero size 2024-04-25T02:27:16.447 INFO:tasks.workunit.client.0.smithi114.stdout:1/929: symlink df/d13/d44/d5a/l144 0 2024-04-25T02:27:16.448 INFO:tasks.workunit.client.0.smithi114.stdout:0/902: dread - d1/d4/d4f/da9/dac/df8/d98/f112 zero size 2024-04-25T02:27:16.448 INFO:tasks.workunit.client.0.smithi114.stdout:1/930: write df/d2a/f46 [4351925,11634] 0 2024-04-25T02:27:16.454 INFO:tasks.workunit.client.0.smithi114.stdout:1/931: creat df/d2a/f145 x:0 0 0 2024-04-25T02:27:16.455 INFO:tasks.workunit.client.0.smithi114.stdout:1/932: write df/d13/d44/d9b/d119/dd6/d105/f137 [443137,31888] 0 2024-04-25T02:27:16.455 INFO:tasks.workunit.client.0.smithi114.stdout:1/933: fdatasync fc 0 2024-04-25T02:27:16.456 INFO:tasks.workunit.client.0.smithi114.stdout:8/967: link da/d32/c94 da/d69/d87/db4/c12b 0 2024-04-25T02:27:16.457 INFO:tasks.workunit.client.0.smithi114.stdout:1/934: creat df/d11/d7d/d12a/f146 x:0 0 0 2024-04-25T02:27:16.459 INFO:tasks.workunit.client.0.smithi114.stdout:8/968: unlink da/d1e/dcd/fea 0 2024-04-25T02:27:16.460 INFO:tasks.workunit.client.0.smithi114.stdout:1/935: symlink df/d11/d7d/l147 0 2024-04-25T02:27:16.473 INFO:tasks.workunit.client.0.smithi114.stdout:2/973: dread d5/df/d1e/f25 [4194304,4194304] 0 2024-04-25T02:27:16.473 INFO:tasks.workunit.client.0.smithi114.stdout:8/969: dwrite da/d1e/f3d [0,4194304] 0 2024-04-25T02:27:16.473 INFO:tasks.workunit.client.0.smithi114.stdout:1/936: dread df/d13/d6e/fe5 [0,4194304] 0 2024-04-25T02:27:16.473 INFO:tasks.workunit.client.0.smithi114.stdout:5/969: dread d1/d25/f1f [0,4194304] 0 2024-04-25T02:27:16.473 INFO:tasks.workunit.client.0.smithi114.stdout:3/966: dread d0/d25/d2a/d80/dbd/d140/da9/dad/de4/fda [0,4194304] 0 2024-04-25T02:27:16.475 INFO:tasks.workunit.client.0.smithi114.stdout:5/970: write d1/d6/f7b [2019160,61849] 0 2024-04-25T02:27:16.478 INFO:tasks.workunit.client.0.smithi114.stdout:4/837: sync 2024-04-25T02:27:16.478 INFO:tasks.workunit.client.0.smithi114.stdout:9/902: sync 2024-04-25T02:27:16.479 INFO:tasks.workunit.client.0.smithi114.stdout:2/974: creat d5/d1c/d22/d67/f13c x:0 0 0 2024-04-25T02:27:16.479 INFO:tasks.workunit.client.0.smithi114.stdout:4/838: readlink d3/l3f 0 2024-04-25T02:27:16.479 INFO:tasks.workunit.client.0.smithi114.stdout:9/903: dread - d8/f116 zero size 2024-04-25T02:27:16.480 INFO:tasks.workunit.client.0.smithi114.stdout:3/967: creat d0/d25/d29/d78/f152 x:0 0 0 2024-04-25T02:27:16.482 INFO:tasks.workunit.client.0.smithi114.stdout:3/968: dread - d0/d25/d29/d8c/f14a zero size 2024-04-25T02:27:16.484 INFO:tasks.workunit.client.0.smithi114.stdout:0/903: write d1/d7/d18/f9f [253914,27886] 0 2024-04-25T02:27:16.485 INFO:tasks.workunit.client.0.smithi114.stdout:4/839: mkdir d3/d8/d12/d19/d26/d3e/daa/d89/df5/d100 0 2024-04-25T02:27:16.485 INFO:tasks.workunit.client.0.smithi114.stdout:2/975: dwrite d5/df/d3d/d44/f8f [0,4194304] 0 2024-04-25T02:27:16.486 INFO:tasks.workunit.client.0.smithi114.stdout:9/904: symlink d8/d16/d21/dfb/d39/d38/d46/d53/df8/l11b 0 2024-04-25T02:27:16.487 INFO:tasks.workunit.client.0.smithi114.stdout:8/970: mknod da/d38/d62/d6d/d49/d117/c12c 0 2024-04-25T02:27:16.490 INFO:tasks.workunit.client.0.smithi114.stdout:1/937: rename df/d13/d44/d5a/dc9/d43 to df/d13/d44/d9b/d119/dd6/d82/da6/d148 0 2024-04-25T02:27:16.494 INFO:tasks.workunit.client.0.smithi114.stdout:3/969: truncate d0/d25/d2a/d34/d151/d3d/da6/fdd 132476 0 2024-04-25T02:27:16.496 INFO:tasks.workunit.client.0.smithi114.stdout:2/976: mknod d5/d1c/d29/de0/df1/c13d 0 2024-04-25T02:27:16.496 INFO:tasks.workunit.client.0.smithi114.stdout:9/905: rmdir d8/d16/d21/dfb 39 2024-04-25T02:27:16.497 INFO:tasks.workunit.client.0.smithi114.stdout:9/906: stat d8/f98 0 2024-04-25T02:27:16.498 INFO:tasks.workunit.client.0.smithi114.stdout:1/938: creat df/d13/d75/d8e/d104/f149 x:0 0 0 2024-04-25T02:27:16.499 INFO:tasks.workunit.client.0.smithi114.stdout:5/971: rmdir d1/d3e/d8e/de5/d82/d8f/d133/d137 0 2024-04-25T02:27:16.500 INFO:tasks.workunit.client.0.smithi114.stdout:4/840: getdents d3/d8/d23/dea 0 2024-04-25T02:27:16.502 INFO:tasks.workunit.client.0.smithi114.stdout:0/904: truncate d1/d4/d24/f47 4088199 0 2024-04-25T02:27:16.503 INFO:tasks.workunit.client.0.smithi114.stdout:3/970: rename d0/d25/d2a/d80/d10e/l14c to d0/d25/d29/d60/l153 0 2024-04-25T02:27:16.506 INFO:tasks.workunit.client.0.smithi114.stdout:3/971: fsync d0/d25/d2a/d34/d151/d3d/f40 0 2024-04-25T02:27:16.506 INFO:tasks.workunit.client.0.smithi114.stdout:4/841: dwrite d3/d8/d12/d19/fe9 [0,4194304] 0 2024-04-25T02:27:16.508 INFO:tasks.workunit.client.0.smithi114.stdout:9/907: read d8/d16/d21/d24/d69/df3/fc3 [2193744,103488] 0 2024-04-25T02:27:16.508 INFO:tasks.workunit.client.0.smithi114.stdout:4/842: dread - d3/d8/d12/d19/d26/d3e/fa8 zero size 2024-04-25T02:27:16.510 INFO:tasks.workunit.client.0.smithi114.stdout:8/971: link da/d69/d93/d40/fa6 da/d38/d62/d11e/f12d 0 2024-04-25T02:27:16.514 INFO:tasks.workunit.client.0.smithi114.stdout:9/908: fdatasync d8/d16/d21/dfb/d39/d38/d5d/fb9 0 2024-04-25T02:27:16.515 INFO:tasks.workunit.client.0.smithi114.stdout:9/909: write d8/d16/d21/f41 [1960284,67842] 0 2024-04-25T02:27:16.515 INFO:tasks.workunit.client.0.smithi114.stdout:4/843: unlink d3/db9/ldd 0 2024-04-25T02:27:16.518 INFO:tasks.workunit.client.0.smithi114.stdout:5/972: creat d1/d3e/d8e/de5/f143 x:0 0 0 2024-04-25T02:27:16.522 INFO:tasks.workunit.client.0.smithi114.stdout:4/844: symlink d3/d8/d30/d93/de2/l101 0 2024-04-25T02:27:16.523 INFO:tasks.workunit.client.0.smithi114.stdout:5/973: dwrite d1/d25/f1f [0,4194304] 0 2024-04-25T02:27:16.524 INFO:tasks.workunit.client.0.smithi114.stdout:9/910: symlink d8/d16/d21/dfb/d39/d38/d46/d10b/l11c 0 2024-04-25T02:27:16.525 INFO:tasks.workunit.client.0.smithi114.stdout:4/845: mknod d3/d8/d23/d25/d4e/dfa/d7f/d8d/c102 0 2024-04-25T02:27:16.527 INFO:tasks.workunit.client.0.smithi114.stdout:5/974: symlink d1/d3e/d8e/de5/dde/l144 0 2024-04-25T02:27:16.529 INFO:tasks.workunit.client.0.smithi114.stdout:9/911: dread d8/d16/d21/d37/fec [0,4194304] 0 2024-04-25T02:27:16.531 INFO:tasks.workunit.client.0.smithi114.stdout:5/975: creat d1/d53/de0/f145 x:0 0 0 2024-04-25T02:27:16.533 INFO:tasks.workunit.client.0.smithi114.stdout:4/846: dwrite d3/d8/d30/d93/fe6 [0,4194304] 0 2024-04-25T02:27:16.537 INFO:tasks.workunit.client.0.smithi114.stdout:5/976: symlink d1/d53/d55/l146 0 2024-04-25T02:27:16.537 INFO:tasks.workunit.client.0.smithi114.stdout:2/977: dread d5/d6/f125 [0,4194304] 0 2024-04-25T02:27:16.539 INFO:tasks.workunit.client.0.smithi114.stdout:4/847: creat d3/d8/d12/d19/d42/d58/f103 x:0 0 0 2024-04-25T02:27:16.540 INFO:tasks.workunit.client.0.smithi114.stdout:9/912: symlink d8/d16/d21/dfb/d39/d38/d46/d11a/l11d 0 2024-04-25T02:27:16.540 INFO:tasks.workunit.client.0.smithi114.stdout:5/977: write d1/d6/d4f/d6c/d88/ff6 [1144560,89772] 0 2024-04-25T02:27:16.541 INFO:tasks.workunit.client.0.smithi114.stdout:3/972: mkdir d0/d25/d29/d60/da8/d154 0 2024-04-25T02:27:16.542 INFO:tasks.workunit.client.0.smithi114.stdout:1/939: dwrite df/d13/d44/d9b/d119/dd6/f95 [0,4194304] 0 2024-04-25T02:27:16.544 INFO:tasks.workunit.client.0.smithi114.stdout:2/978: getdents d5/d1c/d21/dc3 0 2024-04-25T02:27:16.545 INFO:tasks.workunit.client.0.smithi114.stdout:1/940: write df/d13/d93/dca/fdc [992868,24665] 0 2024-04-25T02:27:16.545 INFO:tasks.workunit.client.0.smithi114.stdout:3/973: truncate d0/d25/d29/d8c/f141 676586 0 2024-04-25T02:27:16.545 INFO:tasks.workunit.client.0.smithi114.stdout:5/978: creat d1/d6/de/da7/ddf/dc5/dfd/dc1/f147 x:0 0 0 2024-04-25T02:27:16.546 INFO:tasks.workunit.client.0.smithi114.stdout:4/848: symlink d3/d8/d12/d19/d26/d3e/daa/d89/dd7/l104 0 2024-04-25T02:27:16.547 INFO:tasks.workunit.client.0.smithi114.stdout:0/905: dread d1/f10 [0,4194304] 0 2024-04-25T02:27:16.547 INFO:tasks.workunit.client.0.smithi114.stdout:9/913: mknod d8/d16/d21/d37/d43/d75/c11e 0 2024-04-25T02:27:16.549 INFO:tasks.workunit.client.0.smithi114.stdout:4/849: symlink d3/db9/l105 0 2024-04-25T02:27:16.561 INFO:tasks.workunit.client.0.smithi114.stdout:1/941: read fe [4052975,85067] 0 2024-04-25T02:27:16.561 INFO:tasks.workunit.client.0.smithi114.stdout:0/906: fsync d1/d4/d24/f5e 0 2024-04-25T02:27:16.563 INFO:tasks.workunit.client.0.smithi114.stdout:4/850: write d3/d8/d23/d25/d4e/dfa/d7f/fca [173354,100487] 0 2024-04-25T02:27:16.564 INFO:tasks.workunit.client.0.smithi114.stdout:9/914: symlink d8/d16/d21/d37/d43/d75/l11f 0 2024-04-25T02:27:16.565 INFO:tasks.workunit.client.0.smithi114.stdout:5/979: creat d1/f148 x:0 0 0 2024-04-25T02:27:16.566 INFO:tasks.workunit.client.0.smithi114.stdout:4/851: truncate d3/d8/d12/d19/fd0 985176 0 2024-04-25T02:27:16.566 INFO:tasks.workunit.client.0.smithi114.stdout:3/974: rename d0/d25/da0/c11d to d0/d25/d2a/d80/dbd/d140/c155 0 2024-04-25T02:27:16.567 INFO:tasks.workunit.client.0.smithi114.stdout:3/975: chown d0/f4b 5418 1 2024-04-25T02:27:16.567 INFO:tasks.workunit.client.0.smithi114.stdout:0/907: write d1/d4/d4f/da9/dac/df8/f48 [3473617,37389] 0 2024-04-25T02:27:16.567 INFO:tasks.workunit.client.0.smithi114.stdout:5/980: mknod d1/d53/d55/db1/c149 0 2024-04-25T02:27:16.568 INFO:tasks.workunit.client.0.smithi114.stdout:4/852: fdatasync d3/d8/d23/d25/d4e/dfa/d7f/fca 0 2024-04-25T02:27:16.570 INFO:tasks.workunit.client.0.smithi114.stdout:3/976: readlink d0/d25/d2a/d34/l115 0 2024-04-25T02:27:16.571 INFO:tasks.workunit.client.0.smithi114.stdout:0/908: symlink d1/d4/da/d33/l113 0 2024-04-25T02:27:16.572 INFO:tasks.workunit.client.0.smithi114.stdout:1/942: link df/d13/d44/d9b/d119/dd6/d82/de8/dfe/d77/dc0/leb df/d13/d93/dca/l14a 0 2024-04-25T02:27:16.573 INFO:tasks.workunit.client.0.smithi114.stdout:4/853: creat d3/d14/d6c/f106 x:0 0 0 2024-04-25T02:27:16.575 INFO:tasks.workunit.client.0.smithi114.stdout:0/909: write d1/d4/d24/d52/f5f [8204401,100198] 0 2024-04-25T02:27:16.577 INFO:tasks.workunit.client.0.smithi114.stdout:9/915: dread d8/d16/d21/d24/d3c/d40/f58 [0,4194304] 0 2024-04-25T02:27:16.578 INFO:tasks.workunit.client.0.smithi114.stdout:0/910: chown d1/d4/da/fe0 5354 1 2024-04-25T02:27:16.579 INFO:tasks.workunit.client.0.smithi114.stdout:4/854: write d3/d8/d12/d19/d26/d3e/daa/dce/f59 [2221538,54036] 0 2024-04-25T02:27:16.580 INFO:tasks.workunit.client.0.smithi114.stdout:5/981: dwrite d1/d6/f140 [8388608,4194304] 0 2024-04-25T02:27:16.581 INFO:tasks.workunit.client.0.smithi114.stdout:9/916: chown d8/d16/d21/d37/d43/d75/d8a 417003 1 2024-04-25T02:27:16.581 INFO:tasks.workunit.client.0.smithi114.stdout:0/911: mkdir d1/d7/d97/d114 0 2024-04-25T02:27:16.583 INFO:tasks.workunit.client.0.smithi114.stdout:9/917: chown d8/d16/d21/d24/d3c/d40/l8b 15 1 2024-04-25T02:27:16.584 INFO:tasks.workunit.client.0.smithi114.stdout:5/982: creat d1/d51/d6f/d12b/f14a x:0 0 0 2024-04-25T02:27:16.588 INFO:tasks.workunit.client.0.smithi114.stdout:4/855: rename d3/d8/d12/d19/d26/d3e/daa/dce/f59 to d3/d8/d23/d25/dd3/f107 0 2024-04-25T02:27:16.592 INFO:tasks.workunit.client.0.smithi114.stdout:4/856: creat d3/d8/d12/f108 x:0 0 0 2024-04-25T02:27:16.592 INFO:tasks.workunit.client.0.smithi114.stdout:1/943: write df/d13/d44/d5a/dc9/d33/d47/fb7 [474982,104947] 0 2024-04-25T02:27:16.593 INFO:tasks.workunit.client.0.smithi114.stdout:1/944: write df/d2a/f46 [4903228,103597] 0 2024-04-25T02:27:16.595 INFO:tasks.workunit.client.0.smithi114.stdout:8/972: sync 2024-04-25T02:27:16.596 INFO:tasks.workunit.client.0.smithi114.stdout:1/945: fdatasync df/d13/d44/d9b/d119/dd6/d82/de8/dfe/d77/fb1 0 2024-04-25T02:27:16.598 INFO:tasks.workunit.client.0.smithi114.stdout:1/946: mkdir df/d11/d108/d135/d14b 0 2024-04-25T02:27:16.602 INFO:tasks.workunit.client.0.smithi114.stdout:1/947: creat df/d13/d44/d5a/dc9/f14c x:0 0 0 2024-04-25T02:27:16.602 INFO:tasks.workunit.client.0.smithi114.stdout:3/977: dread d0/d25/d2a/d34/f55 [0,4194304] 0 2024-04-25T02:27:16.603 INFO:tasks.workunit.client.0.smithi114.stdout:0/912: write d1/d4/d4f/da9/dac/df8/d4d/f4e [638318,13059] 0 2024-04-25T02:27:16.604 INFO:tasks.workunit.client.0.smithi114.stdout:9/918: write d8/d16/d21/dfb/f7c [1441409,17891] 0 2024-04-25T02:27:16.606 INFO:tasks.workunit.client.0.smithi114.stdout:9/919: write d8/d16/d21/d24/d69/df3/fd0 [1201175,95411] 0 2024-04-25T02:27:16.607 INFO:tasks.workunit.client.0.smithi114.stdout:0/913: unlink d1/d4/da/d39/da7/fe3 0 2024-04-25T02:27:16.637 INFO:tasks.workunit.client.0.smithi114.stdout:9/920: write d8/d16/d21/d24/d69/df3/fd0 [179715,61438] 0 2024-04-25T02:27:16.637 INFO:tasks.workunit.client.0.smithi114.stdout:5/983: dread d1/d6/d4f/f7a [0,4194304] 0 2024-04-25T02:27:16.639 INFO:tasks.workunit.client.0.smithi114.stdout:1/948: dwrite df/d13/d44/d9b/d119/dd6/fb3 [0,4194304] 0 2024-04-25T02:27:16.639 INFO:tasks.workunit.client.0.smithi114.stdout:5/984: stat d1/d25/da1 0 2024-04-25T02:27:16.640 INFO:tasks.workunit.client.0.smithi114.stdout:4/857: dread d3/d8/d23/d25/f87 [0,4194304] 0 2024-04-25T02:27:16.640 INFO:tasks.workunit.client.0.smithi114.stdout:0/914: getdents d1/d4/d62/d83/d84 0 2024-04-25T02:27:16.641 INFO:tasks.workunit.client.0.smithi114.stdout:5/985: stat d1/d25/c96 0 2024-04-25T02:27:16.643 INFO:tasks.workunit.client.0.smithi114.stdout:8/973: dread da/d69/d93/f108 [0,4194304] 0 2024-04-25T02:27:16.644 INFO:tasks.workunit.client.0.smithi114.stdout:1/949: mknod df/d13/d44/d9b/d119/dd6/d82/da6/d148/d106/c14d 0 2024-04-25T02:27:16.645 INFO:tasks.workunit.client.0.smithi114.stdout:1/950: write df/d13/d44/d9b/d119/dd6/f95 [1690837,2967] 0 2024-04-25T02:27:16.646 INFO:tasks.workunit.client.0.smithi114.stdout:0/915: creat d1/d4/d4f/f115 x:0 0 0 2024-04-25T02:27:16.647 INFO:tasks.workunit.client.0.smithi114.stdout:0/916: chown d1/d4/d62/d83/da0/f107 27512518 1 2024-04-25T02:27:16.647 INFO:tasks.workunit.client.0.smithi114.stdout:0/917: stat d1/d7/d46/f87 0 2024-04-25T02:27:16.648 INFO:tasks.workunit.client.0.smithi114.stdout:9/921: creat d8/d16/d21/d37/f120 x:0 0 0 2024-04-25T02:27:16.648 INFO:tasks.workunit.client.0.smithi114.stdout:9/922: chown d8/d16/d21/d37/d43/d75/l11f 394723188 1 2024-04-25T02:27:16.649 INFO:tasks.workunit.client.0.smithi114.stdout:5/986: creat d1/d25/da1/daa/f14b x:0 0 0 2024-04-25T02:27:16.650 INFO:tasks.workunit.client.0.smithi114.stdout:5/987: write d1/d25/f35 [9377866,52901] 0 2024-04-25T02:27:16.651 INFO:tasks.workunit.client.0.smithi114.stdout:4/858: rename d3/d14/d6c/f106 to d3/d8/d12/d19/d26/d3e/daa/dce/f109 0 2024-04-25T02:27:16.655 INFO:tasks.workunit.client.0.smithi114.stdout:1/951: rename df/d2a/c4a to df/d13/d44/d9b/d119/dd6/d105/c14e 0 2024-04-25T02:27:16.656 INFO:tasks.workunit.client.0.smithi114.stdout:8/974: creat da/d69/d93/f12e x:0 0 0 2024-04-25T02:27:16.657 INFO:tasks.workunit.client.0.smithi114.stdout:5/988: dread d1/d6/de/f1e [0,4194304] 0 2024-04-25T02:27:16.657 INFO:tasks.workunit.client.0.smithi114.stdout:4/859: rename d3/d8/d12/d19/d26/d3e/d62/c77 to d3/d8/d23/d25/d4e/dfa/d7f/dd2/c10a 0 2024-04-25T02:27:16.659 INFO:tasks.workunit.client.0.smithi114.stdout:8/975: mkdir da/d69/d93/deb/d12f 0 2024-04-25T02:27:16.659 INFO:tasks.workunit.client.0.smithi114.stdout:0/918: dwrite d1/d4/db4/fbe [0,4194304] 0 2024-04-25T02:27:16.662 INFO:tasks.workunit.client.0.smithi114.stdout:0/919: stat d1/d4/fb6 0 2024-04-25T02:27:16.662 INFO:tasks.workunit.client.0.smithi114.stdout:8/976: chown da/d69/d93/d6b/dbb/lda 4 1 2024-04-25T02:27:16.663 INFO:tasks.workunit.client.0.smithi114.stdout:4/860: write d3/d8/d23/d25/d4e/dfa/d7f/dd2/ff2 [922155,80348] 0 2024-04-25T02:27:16.666 INFO:tasks.workunit.client.0.smithi114.stdout:1/952: dwrite df/d13/d6e/fe5 [0,4194304] 0 2024-04-25T02:27:16.668 INFO:tasks.workunit.client.0.smithi114.stdout:2/979: sync 2024-04-25T02:27:16.670 INFO:tasks.workunit.client.0.smithi114.stdout:4/861: mkdir d3/d8/d23/d25/d4e/dfa/d7f/d10b 0 2024-04-25T02:27:16.671 INFO:tasks.workunit.client.0.smithi114.stdout:0/920: dwrite d1/d4/fb6 [4194304,4194304] 0 2024-04-25T02:27:16.673 INFO:tasks.workunit.client.0.smithi114.stdout:2/980: write d5/df/d3d/f5e [4223602,93354] 0 2024-04-25T02:27:16.676 INFO:tasks.workunit.client.0.smithi114.stdout:4/862: symlink d3/d14/l10c 0 2024-04-25T02:27:16.676 INFO:tasks.workunit.client.0.smithi114.stdout:5/989: dwrite d1/d6/de/f1d [0,4194304] 0 2024-04-25T02:27:16.677 INFO:tasks.workunit.client.0.smithi114.stdout:0/921: mkdir d1/d4/d4f/da9/dac/d116 0 2024-04-25T02:27:16.677 INFO:tasks.workunit.client.0.smithi114.stdout:9/923: dread d8/d16/d21/dfb/ff4 [0,4194304] 0 2024-04-25T02:27:16.679 INFO:tasks.workunit.client.0.smithi114.stdout:0/922: read d1/d7/d46/fe4 [2071977,112797] 0 2024-04-25T02:27:16.682 INFO:tasks.workunit.client.0.smithi114.stdout:4/863: rename d3/d8/d23/d25/c78 to d3/d8/d23/d25/dd3/c10d 0 2024-04-25T02:27:16.683 INFO:tasks.workunit.client.0.smithi114.stdout:9/924: creat d8/d16/d21/dfb/d39/d38/d46/d96/f121 x:0 0 0 2024-04-25T02:27:16.685 INFO:tasks.workunit.client.0.smithi114.stdout:9/925: write d8/d16/d21/dfb/d39/dab/f106 [886547,96729] 0 2024-04-25T02:27:16.686 INFO:tasks.workunit.client.0.smithi114.stdout:0/923: mknod d1/d7/dfb/d7e/dfc/d103/c117 0 2024-04-25T02:27:16.686 INFO:tasks.workunit.client.0.smithi114.stdout:9/926: write d8/d16/d21/dfb/d39/d38/d46/d53/fd6 [2959393,90295] 0 2024-04-25T02:27:16.687 INFO:tasks.workunit.client.0.smithi114.stdout:5/990: getdents d1/d53/d55/db1 0 2024-04-25T02:27:16.688 INFO:tasks.workunit.client.0.smithi114.stdout:5/991: write d1/d6/f31 [8993825,23460] 0 2024-04-25T02:27:16.689 INFO:tasks.workunit.client.0.smithi114.stdout:4/864: truncate d3/d8/d23/d25/d4e/dfa/d7f/fca 215241 0 2024-04-25T02:27:16.690 INFO:tasks.workunit.client.0.smithi114.stdout:9/927: fsync d8/fb 0 2024-04-25T02:27:16.692 INFO:tasks.workunit.client.0.smithi114.stdout:5/992: chown d1/d3e/d8e/de5/daf 803 1 2024-04-25T02:27:16.693 INFO:tasks.workunit.client.0.smithi114.stdout:3/978: sync 2024-04-25T02:27:16.705 INFO:tasks.workunit.client.0.smithi114.stdout:8/977: dread da/d1e/f48 [8388608,4194304] 0 2024-04-25T02:27:16.706 INFO:tasks.workunit.client.0.smithi114.stdout:5/993: mkdir d1/d6/de/da7/dce/d14c 0 2024-04-25T02:27:16.708 INFO:tasks.workunit.client.0.smithi114.stdout:4/865: dwrite d3/d8/d12/d19/d26/d3e/daa/dce/d33/fad [0,4194304] 0 2024-04-25T02:27:16.710 INFO:tasks.workunit.client.0.smithi114.stdout:2/981: truncate d5/df/d2c/d66/db3/fe3 2318517 0 2024-04-25T02:27:16.715 INFO:tasks.workunit.client.0.smithi114.stdout:9/928: dwrite d8/d16/d21/dfb/d39/f35 [0,4194304] 0 2024-04-25T02:27:16.723 INFO:tasks.workunit.client.0.smithi114.stdout:1/953: dwrite df/d13/d44/d9b/d119/dd6/d82/de8/dfe/f84 [0,4194304] 0 2024-04-25T02:27:16.723 INFO:tasks.workunit.client.0.smithi114.stdout:3/979: dwrite d0/d25/d2a/d80/dbd/d140/da9/dad/de4/fda [4194304,4194304] 0 2024-04-25T02:27:16.723 INFO:tasks.workunit.client.0.smithi114.stdout:4/866: rename d3/c6f to d3/d8/d12/d19/d26/c10e 0 2024-04-25T02:27:16.725 INFO:tasks.workunit.client.0.smithi114.stdout:8/978: dread da/d38/d62/d6d/f42 [0,4194304] 0 2024-04-25T02:27:16.728 INFO:tasks.workunit.client.0.smithi114.stdout:9/929: creat d8/d16/d21/dfb/d39/d38/d46/d53/f122 x:0 0 0 2024-04-25T02:27:16.728 INFO:tasks.workunit.client.0.smithi114.stdout:4/867: dwrite d3/d8/d12/f108 [0,4194304] 0 2024-04-25T02:27:16.729 INFO:tasks.workunit.client.0.smithi114.stdout:4/868: write d3/fbc [1022590,13457] 0 2024-04-25T02:27:16.736 INFO:tasks.workunit.client.0.smithi114.stdout:9/930: creat d8/d16/d21/d37/d43/d75/da3/db0/f123 x:0 0 0 2024-04-25T02:27:16.737 INFO:tasks.workunit.client.0.smithi114.stdout:8/979: link da/d38/d62/d6d/f51 da/d69/d93/d6b/dbb/f130 0 2024-04-25T02:27:16.738 INFO:tasks.workunit.client.0.smithi114.stdout:5/994: dwrite d1/d6/de/d75/fc4 [0,4194304] 0 2024-04-25T02:27:16.742 INFO:tasks.workunit.client.0.smithi114.stdout:8/980: rename da/d69/d93/d40/fe1 to da/d38/d62/d6d/d52/da8/da9/f131 0 2024-04-25T02:27:16.743 INFO:tasks.workunit.client.0.smithi114.stdout:0/924: sync 2024-04-25T02:27:16.744 INFO:tasks.workunit.client.0.smithi114.stdout:0/925: fdatasync d1/d4/da/f16 0 2024-04-25T02:27:16.744 INFO:tasks.workunit.client.0.smithi114.stdout:8/981: getdents da/d69/d90 0 2024-04-25T02:27:16.746 INFO:tasks.workunit.client.0.smithi114.stdout:0/926: creat d1/d4/d62/f118 x:0 0 0 2024-04-25T02:27:16.748 INFO:tasks.workunit.client.0.smithi114.stdout:0/927: write d1/d7/d68/d69/f10d [112648,55518] 0 2024-04-25T02:27:16.750 INFO:tasks.workunit.client.0.smithi114.stdout:0/928: creat d1/d7/dfb/d7e/f119 x:0 0 0 2024-04-25T02:27:16.750 INFO:tasks.workunit.client.0.smithi114.stdout:0/929: write d1/d4/d4f/d77/fbc [1883573,17752] 0 2024-04-25T02:27:16.751 INFO:tasks.workunit.client.0.smithi114.stdout:0/930: write d1/d4/da/f7b [187719,16473] 0 2024-04-25T02:27:16.757 INFO:tasks.workunit.client.0.smithi114.stdout:8/982: dread da/d69/d93/d6b/f81 [0,4194304] 0 2024-04-25T02:27:16.763 INFO:tasks.workunit.client.0.smithi114.stdout:2/982: dwrite d5/df/d3d/f6f [0,4194304] 0 2024-04-25T02:27:16.771 INFO:tasks.workunit.client.0.smithi114.stdout:3/980: dread d0/d25/da0/fab [0,4194304] 0 2024-04-25T02:27:16.771 INFO:tasks.workunit.client.0.smithi114.stdout:1/954: dread df/d13/d44/d9b/d119/dd6/d82/de8/dfe/d77/f122 [0,4194304] 0 2024-04-25T02:27:16.773 INFO:tasks.workunit.client.0.smithi114.stdout:4/869: truncate d3/d8/d12/d19/d42/d58/f9b 434471 0 2024-04-25T02:27:16.773 INFO:tasks.workunit.client.0.smithi114.stdout:4/870: chown d3/d8/d12/f108 0 1 2024-04-25T02:27:16.775 INFO:tasks.workunit.client.0.smithi114.stdout:3/981: symlink d0/d25/l156 0 2024-04-25T02:27:16.776 INFO:tasks.workunit.client.0.smithi114.stdout:3/982: chown d0/d25/d2a/d34/f55 31097 1 2024-04-25T02:27:16.778 INFO:tasks.workunit.client.0.smithi114.stdout:0/931: getdents d1/d4/d62 0 2024-04-25T02:27:16.779 INFO:tasks.workunit.client.0.smithi114.stdout:3/983: symlink d0/d25/d2a/d34/dd5/l157 0 2024-04-25T02:27:16.780 INFO:tasks.workunit.client.0.smithi114.stdout:9/931: dwrite d8/d16/d21/d24/d69/df3/fc3 [4194304,4194304] 0 2024-04-25T02:27:16.780 INFO:tasks.workunit.client.0.smithi114.stdout:0/932: fsync d1/d4/d4f/da9/dac/df8/f48 0 2024-04-25T02:27:16.781 INFO:tasks.workunit.client.0.smithi114.stdout:8/983: write da/d69/f73 [1576091,18004] 0 2024-04-25T02:27:16.781 INFO:tasks.workunit.client.0.smithi114.stdout:2/983: write d5/d1c/d22/d89/d118/fa4 [1073584,7873] 0 2024-04-25T02:27:16.785 INFO:tasks.workunit.client.0.smithi114.stdout:8/984: creat da/d69/f132 x:0 0 0 2024-04-25T02:27:16.786 INFO:tasks.workunit.client.0.smithi114.stdout:9/932: read d8/f91 [45661,120586] 0 2024-04-25T02:27:16.786 INFO:tasks.workunit.client.0.smithi114.stdout:0/933: mknod d1/d4/d62/c11a 0 2024-04-25T02:27:16.788 INFO:tasks.workunit.client.0.smithi114.stdout:8/985: fdatasync da/d69/d90/d126/de8/f92 0 2024-04-25T02:27:16.789 INFO:tasks.workunit.client.0.smithi114.stdout:8/986: chown da/d69/d93/d40 21 1 2024-04-25T02:27:16.791 INFO:tasks.workunit.client.0.smithi114.stdout:3/984: creat d0/d25/d2a/d34/d151/d3d/da6/dce/d13c/f158 x:0 0 0 2024-04-25T02:27:16.792 INFO:tasks.workunit.client.0.smithi114.stdout:4/871: dwrite d3/d8/d12/d19/d26/d3e/daa/fa3 [0,4194304] 0 2024-04-25T02:27:16.793 INFO:tasks.workunit.client.0.smithi114.stdout:1/955: dread df/d13/d44/d5a/dc9/f37 [0,4194304] 0 2024-04-25T02:27:16.794 INFO:tasks.workunit.client.0.smithi114.stdout:0/934: rename d1/d4/d24/lf6 to d1/d7/dfb/d7e/d10c/l11b 0 2024-04-25T02:27:16.794 INFO:tasks.workunit.client.0.smithi114.stdout:3/985: fsync d0/d25/d2a/d80/dbd/d140/da9/dad/de4/f5e 0 2024-04-25T02:27:16.796 INFO:tasks.workunit.client.0.smithi114.stdout:8/987: write da/d69/d93/f108 [4389989,25883] 0 2024-04-25T02:27:16.796 INFO:tasks.workunit.client.0.smithi114.stdout:3/986: readlink d0/d25/d2a/d34/d9e/l143 0 2024-04-25T02:27:16.798 INFO:tasks.workunit.client.0.smithi114.stdout:4/872: unlink d3/d8/d12/d19/d26/d3e/daa/dce/d33/fad 0 2024-04-25T02:27:16.802 INFO:tasks.workunit.client.0.smithi114.stdout:0/935: mknod d1/d4/d4f/d77/da1/c11c 0 2024-04-25T02:27:16.803 INFO:tasks.workunit.client.0.smithi114.stdout:8/988: write da/d69/d90/fe0 [797742,102668] 0 2024-04-25T02:27:16.805 INFO:tasks.workunit.client.0.smithi114.stdout:4/873: dwrite d3/d8/d12/ff3 [0,4194304] 0 2024-04-25T02:27:16.805 INFO:tasks.workunit.client.0.smithi114.stdout:3/987: mkdir d0/d25/d2a/d80/dbd/d140/da9/d159 0 2024-04-25T02:27:16.807 INFO:tasks.workunit.client.0.smithi114.stdout:8/989: mkdir da/d38/d62/d6d/d133 0 2024-04-25T02:27:16.809 INFO:tasks.workunit.client.0.smithi114.stdout:0/936: rename d1/d4/d37/d6a/db5/fca to d1/d4/da/d33/f11d 0 2024-04-25T02:27:16.810 INFO:tasks.workunit.client.0.smithi114.stdout:1/956: dwrite df/d13/d44/d5a/dc9/f37 [0,4194304] 0 2024-04-25T02:27:16.813 INFO:tasks.workunit.client.0.smithi114.stdout:4/874: creat d3/d8/d30/f10f x:0 0 0 2024-04-25T02:27:16.816 INFO:tasks.workunit.client.0.smithi114.stdout:3/988: getdents d0/d25/d2a/d80/dbd/d140/da9/d159 0 2024-04-25T02:27:16.818 INFO:tasks.workunit.client.0.smithi114.stdout:0/937: dwrite d1/d4/d62/f118 [0,4194304] 0 2024-04-25T02:27:16.820 INFO:tasks.workunit.client.0.smithi114.stdout:1/957: link df/d13/d75/faa df/d11/d7d/df9/f14f 0 2024-04-25T02:27:16.825 INFO:tasks.workunit.client.0.smithi114.stdout:4/875: link d3/d8/d30/l3a d3/d8/d12/d82/dde/l110 0 2024-04-25T02:27:16.826 INFO:tasks.workunit.client.0.smithi114.stdout:0/938: write d1/d7/d68/d69/f10d [997207,63622] 0 2024-04-25T02:27:16.828 INFO:tasks.workunit.client.0.smithi114.stdout:2/984: dwrite d5/d6/f125 [0,4194304] 0 2024-04-25T02:27:16.828 INFO:tasks.workunit.client.0.smithi114.stdout:1/958: unlink df/d11/c85 0 2024-04-25T02:27:16.828 INFO:tasks.workunit.client.0.smithi114.stdout:9/933: dwrite d8/d16/d21/dfb/ff4 [0,4194304] 0 2024-04-25T02:27:16.830 INFO:tasks.workunit.client.0.smithi114.stdout:8/990: dwrite da/d38/d62/d6d/d52/d6c/fba [4194304,4194304] 0 2024-04-25T02:27:16.833 INFO:tasks.workunit.client.0.smithi114.stdout:9/934: read d8/f98 [154836,26220] 0 2024-04-25T02:27:16.833 INFO:tasks.workunit.client.0.smithi114.stdout:5/995: sync 2024-04-25T02:27:16.833 INFO:tasks.workunit.client.0.smithi114.stdout:4/876: creat d3/d8/d12/d82/dde/f111 x:0 0 0 2024-04-25T02:27:16.834 INFO:tasks.workunit.client.0.smithi114.stdout:3/989: truncate d0/d25/d2a/d34/d151/f17 3195262 0 2024-04-25T02:27:16.835 INFO:tasks.workunit.client.0.smithi114.stdout:5/996: dread - d1/d6/d4f/fec zero size 2024-04-25T02:27:16.837 INFO:tasks.workunit.client.0.smithi114.stdout:9/935: write d8/d16/d21/d37/d60/d70/ff5 [609468,104083] 0 2024-04-25T02:27:16.837 INFO:tasks.workunit.client.0.smithi114.stdout:0/939: creat d1/d4/d4f/da9/dac/df8/d4d/f11e x:0 0 0 2024-04-25T02:27:16.838 INFO:tasks.workunit.client.0.smithi114.stdout:3/990: dread - d0/d25/d2a/d80/dbd/d140/da9/fde zero size 2024-04-25T02:27:16.839 INFO:tasks.workunit.client.0.smithi114.stdout:5/997: chown d1/d3e/d8e/de5/d82/lf3 56552 1 2024-04-25T02:27:16.839 INFO:tasks.workunit.client.0.smithi114.stdout:0/940: chown d1/d4/d4f/da9/dac/df8/d98/ca8 2186032 1 2024-04-25T02:27:16.840 INFO:tasks.workunit.client.0.smithi114.stdout:1/959: dwrite df/d13/d44/d5a/dc9/f4c [4194304,4194304] 0 2024-04-25T02:27:16.852 INFO:tasks.workunit.client.0.smithi114.stdout:8/991: rename da/l23 to da/d32/l134 0 2024-04-25T02:27:16.853 INFO:tasks.workunit.client.0.smithi114.stdout:0/941: write d1/d4/d4f/da9/dac/fc3 [93495,116055] 0 2024-04-25T02:27:16.855 INFO:tasks.workunit.client.0.smithi114.stdout:1/960: rmdir df/d13/d44/d9b/d119 39 2024-04-25T02:27:16.860 INFO:tasks.workunit.client.0.smithi114.stdout:4/877: creat d3/d8/d12/d19/d26/d3e/daa/f112 x:0 0 0 2024-04-25T02:27:16.861 INFO:tasks.workunit.client.0.smithi114.stdout:0/942: symlink d1/d4/d37/d6a/l11f 0 2024-04-25T02:27:16.861 INFO:tasks.workunit.client.0.smithi114.stdout:0/943: chown d1/d4/d24/f5e 144 1 2024-04-25T02:27:16.861 INFO:tasks.workunit.client.0.smithi114.stdout:8/992: symlink da/d38/d62/d6d/d52/da8/da9/df2/d116/l135 0 2024-04-25T02:27:16.862 INFO:tasks.workunit.client.0.smithi114.stdout:1/961: mkdir df/d2a/de9/d150 0 2024-04-25T02:27:16.863 INFO:tasks.workunit.client.0.smithi114.stdout:2/985: link d5/d1c/d21/l9c d5/df/d3d/d44/d11e/d5a/l13e 0 2024-04-25T02:27:16.864 INFO:tasks.workunit.client.0.smithi114.stdout:3/991: rename d0/d25/d29/d60/l68 to d0/d25/d2a/d80/dbd/d140/da9/dad/de4/l15a 0 2024-04-25T02:27:16.865 INFO:tasks.workunit.client.0.smithi114.stdout:1/962: write df/d11/d7d/d12a/f146 [154231,50820] 0 2024-04-25T02:27:16.865 INFO:tasks.workunit.client.0.smithi114.stdout:8/993: write da/d38/d62/d6d/d52/da8/da9/df2/df9/f10a [661582,1377] 0 2024-04-25T02:27:16.865 INFO:tasks.workunit.client.0.smithi114.stdout:2/986: write d5/d6/f55 [350558,125908] 0 2024-04-25T02:27:16.867 INFO:tasks.workunit.client.0.smithi114.stdout:5/998: getdents d1/d6/d4f/d6c/d88/db6/dc8 0 2024-04-25T02:27:16.868 INFO:tasks.workunit.client.0.smithi114.stdout:4/878: creat d3/d8/d12/d19/d26/d3e/daa/d89/df5/d100/f113 x:0 0 0 2024-04-25T02:27:16.869 INFO:tasks.workunit.client.0.smithi114.stdout:8/994: creat da/d69/f136 x:0 0 0 2024-04-25T02:27:16.870 INFO:tasks.workunit.client.0.smithi114.stdout:0/944: dread d1/d7/f80 [0,4194304] 0 2024-04-25T02:27:16.872 INFO:tasks.workunit.client.0.smithi114.stdout:5/999: mkdir d1/d6/d4f/d6c/d88/db6/d14d 0 2024-04-25T02:27:16.873 INFO:tasks.workunit.client.0.smithi114.stdout:0/945: chown d1/d4/ff 4196729 1 2024-04-25T02:27:16.873 INFO:tasks.workunit.client.0.smithi114.stdout:2/987: rename d5/d1c/d22/cbe to d5/d1c/d29/de0/df1/c13f 0 2024-04-25T02:27:16.875 INFO:tasks.workunit.client.0.smithi114.stdout:8/995: mkdir da/d1e/dcd/dd3/d137 0 2024-04-25T02:27:16.876 INFO:tasks.workunit.client.0.smithi114.stdout:3/992: dwrite d0/d11e/f144 [0,4194304] 0 2024-04-25T02:27:16.876 INFO:tasks.workunit.client.0.smithi114.stdout:4/879: unlink d3/d8/d12/d19/d26/f70 0 2024-04-25T02:27:16.879 INFO:tasks.workunit.client.0.smithi114.stdout:2/988: mknod d5/d1c/d21/c140 0 2024-04-25T02:27:16.880 INFO:tasks.workunit.client.0.smithi114.stdout:0/946: symlink d1/d7/dfb/d8f/dfa/l120 0 2024-04-25T02:27:16.881 INFO:tasks.workunit.client.0.smithi114.stdout:0/947: write d1/d4/d62/f94 [4466776,26645] 0 2024-04-25T02:27:16.881 INFO:tasks.workunit.client.0.smithi114.stdout:0/948: stat d1/d4/d62/d83/da0/f107 0 2024-04-25T02:27:16.883 INFO:tasks.workunit.client.0.smithi114.stdout:3/993: mkdir d0/d25/da0/d15b 0 2024-04-25T02:27:16.883 INFO:tasks.workunit.client.0.smithi114.stdout:0/949: read d1/d4/d62/d83/fa3 [531617,49061] 0 2024-04-25T02:27:16.883 INFO:tasks.workunit.client.0.smithi114.stdout:0/950: stat d1/d4/da/fb7 0 2024-04-25T02:27:16.886 INFO:tasks.workunit.client.0.smithi114.stdout:1/963: dread df/d13/d75/db8/f69 [0,4194304] 0 2024-04-25T02:27:16.889 INFO:tasks.workunit.client.0.smithi114.stdout:3/994: dwrite d0/d25/d2a/d80/dbd/d140/da9/dad/de4/f13b [0,4194304] 0 2024-04-25T02:27:16.891 INFO:tasks.workunit.client.0.smithi114.stdout:0/951: symlink d1/d7/d97/l121 0 2024-04-25T02:27:16.893 INFO:tasks.workunit.client.0.smithi114.stdout:8/996: rename da/d69/d90/d126/de8/c9c to da/d38/d62/d6d/d52/da8/c138 0 2024-04-25T02:27:16.896 INFO:tasks.workunit.client.0.smithi114.stdout:3/995: dwrite d0/d25/f73 [0,4194304] 0 2024-04-25T02:27:16.903 INFO:tasks.workunit.client.0.smithi114.stdout:4/880: rename d3/d14/l10c to d3/d8/d12/d19/d26/d3e/daa/d89/dd7/l114 0 2024-04-25T02:27:16.905 INFO:tasks.workunit.client.0.smithi114.stdout:4/881: read d3/d8/d12/d19/d26/d3e/daa/d89/fe4 [39710,15083] 0 2024-04-25T02:27:16.907 INFO:tasks.workunit.client.0.smithi114.stdout:3/996: symlink d0/d25/d2a/d80/d10e/l15c 0 2024-04-25T02:27:16.908 INFO:tasks.workunit.client.0.smithi114.stdout:2/989: link d5/df/d63/d8d/le9 d5/df/d3d/d44/de2/l141 0 2024-04-25T02:27:16.908 INFO:tasks.workunit.client.0.smithi114.stdout:3/997: write d0/f19 [1360655,116115] 0 2024-04-25T02:27:16.909 INFO:tasks.workunit.client.0.smithi114.stdout:4/882: dread d3/d8/d12/ff3 [0,4194304] 0 2024-04-25T02:27:16.910 INFO:tasks.workunit.client.0.smithi114.stdout:3/998: readlink d0/d25/d2a/d34/d151/l2f 0 2024-04-25T02:27:16.910 INFO:tasks.workunit.client.0.smithi114.stdout:8/997: unlink da/d32/l10f 0 2024-04-25T02:27:16.911 INFO:tasks.workunit.client.0.smithi114.stdout:4/883: chown d3/d8/d12/d19/f85 13161 1 2024-04-25T02:27:16.911 INFO:tasks.workunit.client.0.smithi114.stdout:9/936: sync 2024-04-25T02:27:16.912 INFO:tasks.workunit.client.0.smithi114.stdout:8/998: truncate da/d38/d62/d6d/f42 1810595 0 2024-04-25T02:27:16.916 INFO:tasks.workunit.client.0.smithi114.stdout:3/999: creat d0/d25/d2a/d34/f15d x:0 0 0 2024-04-25T02:27:16.918 INFO:tasks.workunit.client.0.smithi114.stdout:4/884: unlink d3/d8/d12/d19/d26/d3e/daa/dce/d33/lef 0 2024-04-25T02:27:16.920 INFO:tasks.workunit.client.0.smithi114.stdout:9/937: symlink d8/d16/d21/dfb/d39/dab/l124 0 2024-04-25T02:27:16.921 INFO:tasks.workunit.client.0.smithi114.stdout:0/952: rmdir d1/d7/d97 39 2024-04-25T02:27:16.924 INFO:tasks.workunit.client.0.smithi114.stdout:8/999: mknod da/d38/d62/d6d/d52/da8/da9/df2/d116/c139 0 2024-04-25T02:27:16.926 INFO:tasks.workunit.client.0.smithi114.stdout:1/964: truncate df/d13/d44/d5a/dc9/d33/d47/d9d/fb6 396547 0 2024-04-25T02:27:16.931 INFO:tasks.workunit.client.0.smithi114.stdout:9/938: rmdir d8/d16/d21/d37/d60/d70 39 2024-04-25T02:27:16.932 INFO:tasks.workunit.client.0.smithi114.stdout:4/885: mkdir d3/d8/d23/dea/d115 0 2024-04-25T02:27:16.932 INFO:tasks.workunit.client.0.smithi114.stdout:1/965: write df/d13/d44/d9b/d119/dd6/d82/da6/d148/f7a [9044854,59556] 0 2024-04-25T02:27:16.932 INFO:tasks.workunit.client.0.smithi114.stdout:9/939: rmdir d8/d16/d21/d37/d43/d75/da3/db0 39 2024-04-25T02:27:16.932 INFO:tasks.workunit.client.0.smithi114.stdout:1/966: fdatasync df/d11/d32/f3c 0 2024-04-25T02:27:16.932 INFO:tasks.workunit.client.0.smithi114.stdout:0/953: symlink d1/d7/l122 0 2024-04-25T02:27:16.933 INFO:tasks.workunit.client.0.smithi114.stdout:0/954: chown d1/d4/d24/dfe 330665670 1 2024-04-25T02:27:16.937 INFO:tasks.workunit.client.0.smithi114.stdout:9/940: write d8/d16/d21/d37/d60/d70/ff5 [464337,66600] 0 2024-04-25T02:27:16.937 INFO:tasks.workunit.client.0.smithi114.stdout:4/886: mkdir d3/d8/d12/d19/d26/d3e/d116 0 2024-04-25T02:27:16.938 INFO:tasks.workunit.client.0.smithi114.stdout:2/990: truncate d5/df/d3d/f5e 4455489 0 2024-04-25T02:27:16.938 INFO:tasks.workunit.client.0.smithi114.stdout:1/967: dwrite df/d13/d93/dca/f12c [0,4194304] 0 2024-04-25T02:27:16.944 INFO:tasks.workunit.client.0.smithi114.stdout:1/968: fsync df/d13/d75/fcb 0 2024-04-25T02:27:16.947 INFO:tasks.workunit.client.0.smithi114.stdout:2/991: rename d5/d1c/d22/d89/d118/fd5 to d5/d1c/d29/d105/f142 0 2024-04-25T02:27:16.947 INFO:tasks.workunit.client.0.smithi114.stdout:4/887: dread d3/d14/d6c/fb2 [0,4194304] 0 2024-04-25T02:27:16.949 INFO:tasks.workunit.client.0.smithi114.stdout:1/969: mkdir df/d13/d93/dca/d151 0 2024-04-25T02:27:16.950 INFO:tasks.workunit.client.0.smithi114.stdout:9/941: dwrite d8/d16/d21/d24/d3c/d40/f58 [4194304,4194304] 0 2024-04-25T02:27:16.952 INFO:tasks.workunit.client.0.smithi114.stdout:2/992: truncate d5/d1c/d22/d89/f93 172321 0 2024-04-25T02:27:16.952 INFO:tasks.workunit.client.0.smithi114.stdout:9/942: dread - d8/d16/d21/f9f zero size 2024-04-25T02:27:16.953 INFO:tasks.workunit.client.0.smithi114.stdout:4/888: rename d3/d8/d12/d19/d42/d58/cd5 to d3/d8/d12/d19/c117 0 2024-04-25T02:27:16.955 INFO:tasks.workunit.client.0.smithi114.stdout:9/943: write d8/d16/d21/dfb/d39/d38/d5d/fb9 [382763,117071] 0 2024-04-25T02:27:16.957 INFO:tasks.workunit.client.0.smithi114.stdout:1/970: rename df/d13/d44/d9b/d119/dd6/d82/de8/dfe/d120 to df/d13/d44/d9b/d119/dd6/d152 0 2024-04-25T02:27:16.958 INFO:tasks.workunit.client.0.smithi114.stdout:0/955: dread d1/d4/d4f/f7f [0,4194304] 0 2024-04-25T02:27:16.961 INFO:tasks.workunit.client.0.smithi114.stdout:2/993: dwrite d5/df/d3d/f4b [0,4194304] 0 2024-04-25T02:27:16.962 INFO:tasks.workunit.client.0.smithi114.stdout:1/971: dread - df/d13/d44/d9b/d119/dd6/d82/de8/dfe/d77/fb1 zero size 2024-04-25T02:27:16.963 INFO:tasks.workunit.client.0.smithi114.stdout:0/956: creat d1/d7/dfb/d7e/d10c/f123 x:0 0 0 2024-04-25T02:27:16.964 INFO:tasks.workunit.client.0.smithi114.stdout:9/944: getdents d8/d16/d21/dfb/d39/d38/d46 0 2024-04-25T02:27:16.966 INFO:tasks.workunit.client.0.smithi114.stdout:2/994: symlink d5/d6/l143 0 2024-04-25T02:27:16.967 INFO:tasks.workunit.client.0.smithi114.stdout:0/957: rmdir d1/d4/d24/d52/da2 39 2024-04-25T02:27:16.967 INFO:tasks.workunit.client.0.smithi114.stdout:4/889: dwrite d3/d14/f53 [0,4194304] 0 2024-04-25T02:27:16.969 INFO:tasks.workunit.client.0.smithi114.stdout:2/995: write d5/df/d3d/d44/fe4 [2011225,39449] 0 2024-04-25T02:27:16.973 INFO:tasks.workunit.client.0.smithi114.stdout:0/958: rename d1/d4/d62/d83 to d1/d4/d37/d6a/d124 0 2024-04-25T02:27:16.973 INFO:tasks.workunit.client.0.smithi114.stdout:0/959: dread - d1/d4/d4f/d77/fd5 zero size 2024-04-25T02:27:16.974 INFO:tasks.workunit.client.0.smithi114.stdout:4/890: creat d3/d8/d12/d19/d26/d3e/daa/d89/df5/f118 x:0 0 0 2024-04-25T02:27:16.975 INFO:tasks.workunit.client.0.smithi114.stdout:2/996: mkdir d5/d1c/d22/d67/db2/d135/d144 0 2024-04-25T02:27:16.975 INFO:tasks.workunit.client.0.smithi114.stdout:0/960: truncate d1/d7/dfb/d8f/dfa/f10e 118791 0 2024-04-25T02:27:16.976 INFO:tasks.workunit.client.0.smithi114.stdout:0/961: write d1/d4/da/fe0 [875789,76550] 0 2024-04-25T02:27:16.977 INFO:tasks.workunit.client.0.smithi114.stdout:4/891: unlink d3/d8/d12/d19/d42/d58/fdc 0 2024-04-25T02:27:16.979 INFO:tasks.workunit.client.0.smithi114.stdout:2/997: symlink d5/d1c/d21/db0/l145 0 2024-04-25T02:27:16.979 INFO:tasks.workunit.client.0.smithi114.stdout:0/962: creat d1/d4/d37/d6a/f125 x:0 0 0 2024-04-25T02:27:16.980 INFO:tasks.workunit.client.0.smithi114.stdout:4/892: truncate d3/d8/d12/ff3 2351225 0 2024-04-25T02:27:16.981 INFO:tasks.workunit.client.0.smithi114.stdout:0/963: chown d1/d4/d37/d6a/d124/d84/f10b 0 1 2024-04-25T02:27:16.981 INFO:tasks.workunit.client.0.smithi114.stdout:2/998: truncate d5/df/d3d/d44/d11e/d5a/fb8 501573 0 2024-04-25T02:27:16.982 INFO:tasks.workunit.client.0.smithi114.stdout:0/964: mkdir d1/d7/dfb/d8f/d126 0 2024-04-25T02:27:16.984 INFO:tasks.workunit.client.0.smithi114.stdout:2/999: mkdir d5/d6/d31/d146 0 2024-04-25T02:27:16.986 INFO:tasks.workunit.client.0.smithi114.stdout:4/893: dwrite d3/d8/d12/d19/fd0 [0,4194304] 0 2024-04-25T02:27:16.990 INFO:tasks.workunit.client.0.smithi114.stdout:4/894: rename d3/c43 to d3/d8/d23/d25/d4e/dfa/d7f/d8d/c119 0 2024-04-25T02:27:16.992 INFO:tasks.workunit.client.0.smithi114.stdout:4/895: creat d3/d8/d12/d19/d42/f11a x:0 0 0 2024-04-25T02:27:16.995 INFO:tasks.workunit.client.0.smithi114.stdout:9/945: truncate d8/d16/d21/dfb/f86 2144717 0 2024-04-25T02:27:16.998 INFO:tasks.workunit.client.0.smithi114.stdout:1/972: dwrite df/d13/d44/d5a/dc9/d33/d47/f5e [0,4194304] 0 2024-04-25T02:27:17.005 INFO:tasks.workunit.client.0.smithi114.stdout:1/973: dwrite df/d11/d7d/d12a/f146 [0,4194304] 0 2024-04-25T02:27:17.006 INFO:tasks.workunit.client.0.smithi114.stdout:9/946: rename d8/d16/d21/dfb/d39/d38/fea to d8/d16/d21/dfb/d39/d38/f125 0 2024-04-25T02:27:17.008 INFO:tasks.workunit.client.0.smithi114.stdout:1/974: rename df/d13/d44/d5a/dc9/d33/f57 to df/d13/d93/f153 0 2024-04-25T02:27:17.011 INFO:tasks.workunit.client.0.smithi114.stdout:0/965: dread d1/d4/da/f16 [0,4194304] 0 2024-04-25T02:27:17.016 INFO:tasks.workunit.client.0.smithi114.stdout:1/975: symlink df/d11/d7d/d92/l154 0 2024-04-25T02:27:17.017 INFO:tasks.workunit.client.0.smithi114.stdout:4/896: dwrite d3/d8/f1c [0,4194304] 0 2024-04-25T02:27:17.018 INFO:tasks.workunit.client.0.smithi114.stdout:1/976: chown df/d13/d44/d9b/d119/dd6/d82/de8/dfe/d111 401820 1 2024-04-25T02:27:17.020 INFO:tasks.workunit.client.0.smithi114.stdout:0/966: rename d1/d7/d18/f51 to d1/d4/d24/d52/da2/dd4/df3/f127 0 2024-04-25T02:27:17.023 INFO:tasks.workunit.client.0.smithi114.stdout:1/977: stat df/d11/d7d/df9/c129 0 2024-04-25T02:27:17.028 INFO:tasks.workunit.client.0.smithi114.stdout:1/978: dwrite df/d13/d93/dca/f12c [0,4194304] 0 2024-04-25T02:27:17.028 INFO:tasks.workunit.client.0.smithi114.stdout:1/979: chown df/d13/d44/f143 1302 1 2024-04-25T02:27:17.049 INFO:tasks.workunit.client.0.smithi114.stdout:1/980: readlink df/d13/d75/d8e/lf5 0 2024-04-25T02:27:17.049 INFO:tasks.workunit.client.0.smithi114.stdout:1/981: fdatasync fc 0 2024-04-25T02:27:17.049 INFO:tasks.workunit.client.0.smithi114.stdout:0/967: dread d1/d7/dfb/d8f/f61 [0,4194304] 0 2024-04-25T02:27:17.051 INFO:tasks.workunit.client.0.smithi114.stdout:1/982: truncate df/d2a/ff2 929321 0 2024-04-25T02:27:17.051 INFO:tasks.workunit.client.0.smithi114.stdout:0/968: mkdir d1/d4/d37/d128 0 2024-04-25T02:27:17.053 INFO:tasks.workunit.client.0.smithi114.stdout:1/983: creat df/d13/d44/d9b/d119/dd6/d82/de8/dfe/d111/f155 x:0 0 0 2024-04-25T02:27:17.054 INFO:tasks.workunit.client.0.smithi114.stdout:0/969: mknod d1/d7/dfb/d7e/c129 0 2024-04-25T02:27:17.056 INFO:tasks.workunit.client.0.smithi114.stdout:9/947: dread d8/d16/d21/d24/d69/df3/fc3 [0,4194304] 0 2024-04-25T02:27:17.057 INFO:tasks.workunit.client.0.smithi114.stdout:0/970: mknod d1/d4/d4f/d77/d82/c12a 0 2024-04-25T02:27:17.058 INFO:tasks.workunit.client.0.smithi114.stdout:9/948: stat d8/d16/d21/d37/d43/d75 0 2024-04-25T02:27:17.058 INFO:tasks.workunit.client.0.smithi114.stdout:0/971: read - d1/d4/ff7 zero size 2024-04-25T02:27:17.063 INFO:tasks.workunit.client.0.smithi114.stdout:0/972: dwrite d1/d4/da/d33/f91 [0,4194304] 0 2024-04-25T02:27:17.066 INFO:tasks.workunit.client.0.smithi114.stdout:0/973: mkdir d1/d4/d24/d52/da2/dd4/df3/d12b 0 2024-04-25T02:27:17.067 INFO:tasks.workunit.client.0.smithi114.stdout:1/984: write df/d13/d44/d9b/d119/dd6/d82/de8/dfe/d77/fc4 [243881,110398] 0 2024-04-25T02:27:17.068 INFO:tasks.workunit.client.0.smithi114.stdout:9/949: truncate d8/d16/d21/dfb/d39/f35 754506 0 2024-04-25T02:27:17.070 INFO:tasks.workunit.client.0.smithi114.stdout:0/974: rename d1/d4/d4f/f115 to d1/d7/d68/d69/f12c 0 2024-04-25T02:27:17.071 INFO:tasks.workunit.client.0.smithi114.stdout:0/975: write d1/d4/d24/fc9 [1147711,88063] 0 2024-04-25T02:27:17.072 INFO:tasks.workunit.client.0.smithi114.stdout:9/950: write d8/d16/d21/f26 [2248549,6145] 0 2024-04-25T02:27:17.073 INFO:tasks.workunit.client.0.smithi114.stdout:9/951: dread - d8/d16/d21/dfb/d39/d38/d46/d96/f119 zero size 2024-04-25T02:27:17.074 INFO:tasks.workunit.client.0.smithi114.stdout:1/985: creat df/d13/d44/d9b/f156 x:0 0 0 2024-04-25T02:27:17.075 INFO:tasks.workunit.client.0.smithi114.stdout:9/952: read d8/d16/d21/d37/d43/f7b [2442289,116170] 0 2024-04-25T02:27:17.077 INFO:tasks.workunit.client.0.smithi114.stdout:0/976: link d1/d7/d97/c10a d1/d4/d4f/d77/da1/c12d 0 2024-04-25T02:27:17.080 INFO:tasks.workunit.client.0.smithi114.stdout:0/977: rename d1/d4/d24/fc9 to d1/d4/da/d39/da7/db9/f12e 0 2024-04-25T02:27:17.082 INFO:tasks.workunit.client.0.smithi114.stdout:0/978: creat d1/d7/dfb/f12f x:0 0 0 2024-04-25T02:27:17.085 INFO:tasks.workunit.client.0.smithi114.stdout:0/979: creat d1/d4/d37/d6a/d124/f130 x:0 0 0 2024-04-25T02:27:17.086 INFO:tasks.workunit.client.0.smithi114.stdout:0/980: chown d1/d7/dfb/fc0 5117571 1 2024-04-25T02:27:17.087 INFO:tasks.workunit.client.0.smithi114.stdout:4/897: sync 2024-04-25T02:27:17.088 INFO:tasks.workunit.client.0.smithi114.stdout:0/981: symlink d1/d4/d4f/da9/l131 0 2024-04-25T02:27:17.088 INFO:tasks.workunit.client.0.smithi114.stdout:4/898: chown d3/d8/d12/d19/d42/d58/f90 621 1 2024-04-25T02:27:17.091 INFO:tasks.workunit.client.0.smithi114.stdout:0/982: creat d1/d4/d37/d6a/d124/f132 x:0 0 0 2024-04-25T02:27:17.093 INFO:tasks.workunit.client.0.smithi114.stdout:9/953: dwrite d8/fb [0,4194304] 0 2024-04-25T02:27:17.094 INFO:tasks.workunit.client.0.smithi114.stdout:0/983: mknod d1/d4/d4f/da9/dac/df8/d4d/d9c/c133 0 2024-04-25T02:27:17.095 INFO:tasks.workunit.client.0.smithi114.stdout:4/899: link d3/le d3/d8/d30/d6e/da2/l11b 0 2024-04-25T02:27:17.096 INFO:tasks.workunit.client.0.smithi114.stdout:9/954: dread - d8/d16/d21/dfb/d39/d38/d46/d96/fbd zero size 2024-04-25T02:27:17.097 INFO:tasks.workunit.client.0.smithi114.stdout:0/984: creat d1/d4/da/d3e/f134 x:0 0 0 2024-04-25T02:27:17.098 INFO:tasks.workunit.client.0.smithi114.stdout:1/986: dread df/d13/d75/fe3 [0,4194304] 0 2024-04-25T02:27:17.099 INFO:tasks.workunit.client.0.smithi114.stdout:9/955: mknod d8/d16/d21/d37/d43/d75/d8a/c126 0 2024-04-25T02:27:17.101 INFO:tasks.workunit.client.0.smithi114.stdout:9/956: creat d8/f127 x:0 0 0 2024-04-25T02:27:17.103 INFO:tasks.workunit.client.0.smithi114.stdout:0/985: creat d1/d4/d4f/da9/dac/df8/f135 x:0 0 0 2024-04-25T02:27:17.104 INFO:tasks.workunit.client.0.smithi114.stdout:9/957: creat d8/f128 x:0 0 0 2024-04-25T02:27:17.107 INFO:tasks.workunit.client.0.smithi114.stdout:1/987: getdents df/d13/d44/d9b/d119/dd6/d82/da6/d148/d106/d127 0 2024-04-25T02:27:17.107 INFO:tasks.workunit.client.0.smithi114.stdout:9/958: symlink d8/d16/d21/dfb/d39/d38/d46/d10b/l129 0 2024-04-25T02:27:17.109 INFO:tasks.workunit.client.0.smithi114.stdout:4/900: rename d3/d8/d30/d6e/da2 to d3/db9/df1/d11c 0 2024-04-25T02:27:17.110 INFO:tasks.workunit.client.0.smithi114.stdout:9/959: mkdir d8/d16/d21/dfb/d12a 0 2024-04-25T02:27:17.110 INFO:tasks.workunit.client.0.smithi114.stdout:0/986: rmdir d1/d4/d4f/da9/dac/df8/d4d 39 2024-04-25T02:27:17.113 INFO:tasks.workunit.client.0.smithi114.stdout:4/901: dread d3/fbc [0,4194304] 0 2024-04-25T02:27:17.115 INFO:tasks.workunit.client.0.smithi114.stdout:1/988: rename df/d11/d32/f8b to df/d13/d44/d5a/dc9/d33/d47/d9d/f157 0 2024-04-25T02:27:17.117 INFO:tasks.workunit.client.0.smithi114.stdout:9/960: symlink d8/d16/d21/l12b 0 2024-04-25T02:27:17.118 INFO:tasks.workunit.client.0.smithi114.stdout:0/987: link d1/d4/da/d33/fb8 d1/d4/d4f/da9/dac/df8/d98/f136 0 2024-04-25T02:27:17.119 INFO:tasks.workunit.client.0.smithi114.stdout:9/961: unlink d8/d16/d21/d24/l6d 0 2024-04-25T02:27:17.120 INFO:tasks.workunit.client.0.smithi114.stdout:0/988: creat d1/d4/d24/d52/da2/f137 x:0 0 0 2024-04-25T02:27:17.121 INFO:tasks.workunit.client.0.smithi114.stdout:1/989: rmdir df/d13/d93/dca/d151 0 2024-04-25T02:27:17.122 INFO:tasks.workunit.client.0.smithi114.stdout:0/989: truncate d1/d7/d18/f9f 373558 0 2024-04-25T02:27:17.122 INFO:tasks.workunit.client.0.smithi114.stdout:9/962: write d8/d16/d21/d37/d43/f7b [2862295,100017] 0 2024-04-25T02:27:17.124 INFO:tasks.workunit.client.0.smithi114.stdout:0/990: mknod d1/d4/d37/d6a/db5/c138 0 2024-04-25T02:27:17.125 INFO:tasks.workunit.client.0.smithi114.stdout:1/990: mknod df/d13/d44/d9b/d119/dd6/d82/de8/dfe/c158 0 2024-04-25T02:27:17.126 INFO:tasks.workunit.client.0.smithi114.stdout:1/991: chown df/d2a/de9/ff6 8724 1 2024-04-25T02:27:17.126 INFO:tasks.workunit.client.0.smithi114.stdout:9/963: mknod d8/d16/d21/d24/d69/c12c 0 2024-04-25T02:27:17.126 INFO:tasks.workunit.client.0.smithi114.stdout:0/991: mkdir d1/d4/d37/d6a/d124/da0/d139 0 2024-04-25T02:27:17.130 INFO:tasks.workunit.client.0.smithi114.stdout:1/992: rename df/d13/d44/d9b/d119/dd6/d82/da6/d148/f54 to df/d13/d6e/f159 0 2024-04-25T02:27:17.135 INFO:tasks.workunit.client.0.smithi114.stdout:1/993: write df/d13/d44/d9b/d119/f12b [842531,123082] 0 2024-04-25T02:27:17.135 INFO:tasks.workunit.client.0.smithi114.stdout:0/992: rmdir d1/d7/dfb/d8f/d126 0 2024-04-25T02:27:17.135 INFO:tasks.workunit.client.0.smithi114.stdout:1/994: mkdir df/d13/d44/d9b/d119/dd6/d82/de8/dfe/d77/d15a 0 2024-04-25T02:27:17.135 INFO:tasks.workunit.client.0.smithi114.stdout:0/993: mknod d1/d4/d4f/da9/c13a 0 2024-04-25T02:27:17.135 INFO:tasks.workunit.client.0.smithi114.stdout:1/995: write df/d13/d44/d9b/d119/f12b [285206,70607] 0 2024-04-25T02:27:17.136 INFO:tasks.workunit.client.0.smithi114.stdout:0/994: mkdir d1/d4/d4f/da9/d13b 0 2024-04-25T02:27:17.139 INFO:tasks.workunit.client.0.smithi114.stdout:0/995: rmdir d1/d7/d18 39 2024-04-25T02:27:17.139 INFO:tasks.workunit.client.0.smithi114.stdout:0/996: fsync d1/d4/f8a 0 2024-04-25T02:27:17.141 INFO:tasks.workunit.client.0.smithi114.stdout:1/996: link df/d13/d44/d5a/dc9/f4c df/d13/d44/d9b/d119/dd6/d82/de8/dfe/f15b 0 2024-04-25T02:27:17.143 INFO:tasks.workunit.client.0.smithi114.stdout:0/997: creat d1/d4/da/d39/da7/db9/f13c x:0 0 0 2024-04-25T02:27:17.145 INFO:tasks.workunit.client.0.smithi114.stdout:1/997: rename df/d13/d44/d5a/dc9/d33/d47 to df/d13/d44/d9b/d119/dd6/d82/de8/dfe/d77/d15a/d15c 0 2024-04-25T02:27:17.148 INFO:tasks.workunit.client.0.smithi114.stdout:1/998: mkdir df/d13/d93/dca/d15d 0 2024-04-25T02:27:17.148 INFO:tasks.workunit.client.0.smithi114.stdout:0/998: getdents d1/d4/d37/d128 0 2024-04-25T02:27:17.152 INFO:tasks.workunit.client.0.smithi114.stdout:0/999: rename d1/d4/d37/d6a/f81 to d1/d4/da/d39/da7/db9/f13d 0 2024-04-25T02:27:17.152 INFO:tasks.workunit.client.0.smithi114.stdout:4/902: sync 2024-04-25T02:27:17.153 INFO:tasks.workunit.client.0.smithi114.stdout:9/964: truncate d8/d16/d21/dfb/d39/d38/d5d/fb9 143136 0 2024-04-25T02:27:17.156 INFO:tasks.workunit.client.0.smithi114.stdout:4/903: creat d3/d8/f11d x:0 0 0 2024-04-25T02:27:17.159 INFO:tasks.workunit.client.0.smithi114.stdout:4/904: dread d3/d14/f53 [0,4194304] 0 2024-04-25T02:27:17.163 INFO:tasks.workunit.client.0.smithi114.stdout:4/905: creat d3/d8/d23/d25/d4e/dfa/d7f/dd2/f11e x:0 0 0 2024-04-25T02:27:17.164 INFO:tasks.workunit.client.0.smithi114.stdout:4/906: mkdir d3/d8/d12/d11f 0 2024-04-25T02:27:17.165 INFO:tasks.workunit.client.0.smithi114.stdout:4/907: dread - d3/f8e zero size 2024-04-25T02:27:17.167 INFO:tasks.workunit.client.0.smithi114.stdout:9/965: dwrite d8/d16/d21/dfb/d39/d38/f80 [0,4194304] 0 2024-04-25T02:27:17.172 INFO:tasks.workunit.client.0.smithi114.stdout:9/966: rename d8/d16/d21/d24/f9d to d8/d16/d21/dfb/d39/ddf/f12d 0 2024-04-25T02:27:17.174 INFO:tasks.workunit.client.0.smithi114.stdout:9/967: mkdir d8/d16/d21/dfb/d39/d38/d5d/d111/d12e 0 2024-04-25T02:27:17.175 INFO:tasks.workunit.client.0.smithi114.stdout:4/908: write d3/d8/f2c [1614311,94318] 0 2024-04-25T02:27:17.177 INFO:tasks.workunit.client.0.smithi114.stdout:9/968: creat d8/d16/d21/d117/f12f x:0 0 0 2024-04-25T02:27:17.179 INFO:tasks.workunit.client.0.smithi114.stdout:9/969: read d8/d16/d21/dfb/d39/d38/d5d/fb9 [64248,101886] 0 2024-04-25T02:27:17.182 INFO:tasks.workunit.client.0.smithi114.stdout:4/909: dwrite d3/d8/d12/d19/d26/d3e/daa/dce/f9e [4194304,4194304] 0 2024-04-25T02:27:17.184 INFO:tasks.workunit.client.0.smithi114.stdout:9/970: creat d8/d16/d21/d37/d60/d70/f130 x:0 0 0 2024-04-25T02:27:17.185 INFO:tasks.workunit.client.0.smithi114.stdout:4/910: dread d3/fbc [0,4194304] 0 2024-04-25T02:27:17.187 INFO:tasks.workunit.client.0.smithi114.stdout:1/999: sync 2024-04-25T02:27:17.187 INFO:tasks.workunit.client.0.smithi114.stdout:4/911: symlink d3/d8/d30/d6e/dcf/l120 0 2024-04-25T02:27:17.189 INFO:tasks.workunit.client.0.smithi114.stdout:4/912: mknod d3/db9/c121 0 2024-04-25T02:27:17.191 INFO:tasks.workunit.client.0.smithi114.stdout:4/913: unlink d3/d8/d12/d19/c1f 0 2024-04-25T02:27:17.192 INFO:tasks.workunit.client.0.smithi114.stdout:4/914: chown d3/d14/lc0 596 1 2024-04-25T02:27:17.206 INFO:tasks.workunit.client.0.smithi114.stdout:9/971: dread d8/d16/d21/f41 [0,4194304] 0 2024-04-25T02:27:17.209 INFO:tasks.workunit.client.0.smithi114.stdout:4/915: dread d3/d14/f47 [0,4194304] 0 2024-04-25T02:27:17.210 INFO:tasks.workunit.client.0.smithi114.stdout:9/972: rename d8/d16/d21/dfb/f7c to d8/d16/d21/dfb/d39/d38/d46/d96/f131 0 2024-04-25T02:27:17.212 INFO:tasks.workunit.client.0.smithi114.stdout:4/916: rmdir d3/d8/d12/d19/d42/d58 39 2024-04-25T02:27:17.213 INFO:tasks.workunit.client.0.smithi114.stdout:4/917: creat d3/d8/d23/d25/d4e/dfa/d7f/f122 x:0 0 0 2024-04-25T02:27:17.218 INFO:tasks.workunit.client.0.smithi114.stdout:4/918: link d3/d8/d96/fcc d3/d8/d12/d19/d26/d3e/daa/d89/df5/d100/f123 0 2024-04-25T02:27:17.219 INFO:tasks.workunit.client.0.smithi114.stdout:4/919: write d3/d8/d30/d6e/dcf/fec [1171629,95180] 0 2024-04-25T02:27:17.224 INFO:tasks.workunit.client.0.smithi114.stdout:9/973: dread d8/d16/d21/dfb/d39/f62 [0,4194304] 0 2024-04-25T02:27:17.226 INFO:tasks.workunit.client.0.smithi114.stdout:4/920: write d3/d8/d12/d19/d26/f2a [526057,43802] 0 2024-04-25T02:27:17.227 INFO:tasks.workunit.client.0.smithi114.stdout:9/974: creat d8/d16/d21/dfb/d39/f132 x:0 0 0 2024-04-25T02:27:17.230 INFO:tasks.workunit.client.0.smithi114.stdout:9/975: rename d8/d16/d21/dfb/d39/d38/ca1 to d8/d16/d21/d37/d43/d75/da3/c133 0 2024-04-25T02:27:17.234 INFO:tasks.workunit.client.0.smithi114.stdout:9/976: dread d8/d16/d21/d24/d3c/d40/f58 [4194304,4194304] 0 2024-04-25T02:27:17.237 INFO:tasks.workunit.client.0.smithi114.stdout:9/977: rename d8/fe to d8/d16/d21/d37/d43/d75/da3/f134 0 2024-04-25T02:27:17.238 INFO:tasks.workunit.client.0.smithi114.stdout:9/978: dread - d8/d16/d21/dfb/d66/f10e zero size 2024-04-25T02:27:17.242 INFO:tasks.workunit.client.0.smithi114.stdout:9/979: dwrite d8/d16/d21/dfb/d39/d38/d46/d53/fa0 [0,4194304] 0 2024-04-25T02:27:17.248 INFO:tasks.workunit.client.0.smithi114.stdout:9/980: dwrite d8/d16/d21/d37/d60/f89 [4194304,4194304] 0 2024-04-25T02:27:17.248 INFO:tasks.workunit.client.0.smithi114.stdout:9/981: read - d8/f127 zero size 2024-04-25T02:27:17.263 INFO:tasks.workunit.client.0.smithi114.stdout:4/921: sync 2024-04-25T02:27:17.268 INFO:tasks.workunit.client.0.smithi114.stdout:9/982: write d8/d16/d21/d37/d43/f109 [386381,14203] 0 2024-04-25T02:27:17.268 INFO:tasks.workunit.client.0.smithi114.stdout:4/922: dwrite d3/f28 [4194304,4194304] 0 2024-04-25T02:27:17.269 INFO:tasks.workunit.client.0.smithi114.stdout:9/983: write d8/d16/d21/d37/d60/f89 [7636884,58604] 0 2024-04-25T02:27:17.271 INFO:tasks.workunit.client.0.smithi114.stdout:4/923: mknod d3/d8/d30/d6e/dcf/c124 0 2024-04-25T02:27:17.272 INFO:tasks.workunit.client.0.smithi114.stdout:4/924: chown d3/d8/d23 223935 1 2024-04-25T02:27:17.273 INFO:tasks.workunit.client.0.smithi114.stdout:9/984: creat d8/d16/d21/d24/d69/f135 x:0 0 0 2024-04-25T02:27:17.276 INFO:tasks.workunit.client.0.smithi114.stdout:4/925: creat d3/d8/d23/d25/d4e/dfa/d7f/d8d/df6/f125 x:0 0 0 2024-04-25T02:27:17.280 INFO:tasks.workunit.client.0.smithi114.stdout:4/926: truncate d3/d8/d12/d19/d42/d58/f6b 2576309 0 2024-04-25T02:27:17.282 INFO:tasks.workunit.client.0.smithi114.stdout:4/927: mkdir d3/d8/d12/d19/d26/d3e/daa/dce/d33/d126 0 2024-04-25T02:27:17.283 INFO:tasks.workunit.client.0.smithi114.stdout:4/928: write d3/f16 [522043,4570] 0 2024-04-25T02:27:17.286 INFO:tasks.workunit.client.0.smithi114.stdout:4/929: getdents d3/d8/d12/d19/d26/d3e 0 2024-04-25T02:27:17.291 INFO:tasks.workunit.client.0.smithi114.stdout:4/930: dwrite d3/d8/d12/d82/fd8 [0,4194304] 0 2024-04-25T02:27:17.294 INFO:tasks.workunit.client.0.smithi114.stdout:4/931: unlink d3/d8/d30/f10f 0 2024-04-25T02:27:17.295 INFO:tasks.workunit.client.0.smithi114.stdout:4/932: stat d3/d8/d30/d6e/dcf/l120 0 2024-04-25T02:27:17.298 INFO:tasks.workunit.client.0.smithi114.stdout:4/933: symlink d3/l127 0 2024-04-25T02:27:17.318 INFO:tasks.workunit.client.0.smithi114.stdout:9/985: sync 2024-04-25T02:27:17.324 INFO:tasks.workunit.client.0.smithi114.stdout:9/986: write d8/d16/d21/dfb/d39/fe8 [5181169,50816] 0 2024-04-25T02:27:17.326 INFO:tasks.workunit.client.0.smithi114.stdout:9/987: creat d8/d16/d21/dfb/d39/d38/d46/d96/f136 x:0 0 0 2024-04-25T02:27:17.328 INFO:tasks.workunit.client.0.smithi114.stdout:9/988: dread d8/d16/d21/d37/d43/d75/fc2 [0,4194304] 0 2024-04-25T02:27:17.330 INFO:tasks.workunit.client.0.smithi114.stdout:9/989: truncate d8/d16/d21/d24/f47 1552681 0 2024-04-25T02:27:17.338 INFO:tasks.workunit.client.0.smithi114.stdout:9/990: dread d8/d16/d21/dfb/d39/d38/d46/d96/f131 [0,4194304] 0 2024-04-25T02:27:17.339 INFO:tasks.workunit.client.0.smithi114.stdout:4/934: sync 2024-04-25T02:27:17.339 INFO:tasks.workunit.client.0.smithi114.stdout:9/991: rename d8/d16/d21/d24/l68 to d8/d16/d21/d37/l137 0 2024-04-25T02:27:17.342 INFO:tasks.workunit.client.0.smithi114.stdout:9/992: rename d8/d16/d21/d37/d43/d75/d8a/l9c to d8/d16/d21/d24/d69/df3/l138 0 2024-04-25T02:27:17.343 INFO:tasks.workunit.client.0.smithi114.stdout:4/935: truncate d3/d8/d23/d25/d4e/dfa/d7f/fca 535421 0 2024-04-25T02:27:17.343 INFO:tasks.workunit.client.0.smithi114.stdout:4/936: truncate d3/d14/d6c/fb2 1018910 0 2024-04-25T02:27:17.344 INFO:tasks.workunit.client.0.smithi114.stdout:9/993: symlink d8/d16/d21/l139 0 2024-04-25T02:27:17.345 INFO:tasks.workunit.client.0.smithi114.stdout:4/937: write d3/d8/d23/d25/d4e/dfa/d7f/d8d/f9c [3249655,81475] 0 2024-04-25T02:27:17.346 INFO:tasks.workunit.client.0.smithi114.stdout:9/994: mknod d8/d16/d21/d24/df2/c13a 0 2024-04-25T02:27:17.346 INFO:tasks.workunit.client.0.smithi114.stdout:9/995: readlink d8/d16/d21/l79 0 2024-04-25T02:27:17.347 INFO:tasks.workunit.client.0.smithi114.stdout:4/938: mknod d3/c128 0 2024-04-25T02:27:17.348 INFO:tasks.workunit.client.0.smithi114.stdout:9/996: mkdir d8/d16/d21/d117/d13b 0 2024-04-25T02:27:17.350 INFO:tasks.workunit.client.0.smithi114.stdout:4/939: rename d3/d8/f1c to d3/d14/d6c/f129 0 2024-04-25T02:27:17.350 INFO:tasks.workunit.client.0.smithi114.stdout:4/940: dread - d3/d8/d12/d19/d42/d58/f103 zero size 2024-04-25T02:27:17.351 INFO:tasks.workunit.client.0.smithi114.stdout:4/941: fdatasync d3/d14/f5a 0 2024-04-25T02:27:17.351 INFO:tasks.workunit.client.0.smithi114.stdout:9/997: mknod d8/d16/c13c 0 2024-04-25T02:27:17.354 INFO:tasks.workunit.client.0.smithi114.stdout:9/998: write d8/d16/d21/d24/d69/df3/fc3 [506534,97322] 0 2024-04-25T02:27:17.354 INFO:tasks.workunit.client.0.smithi114.stdout:9/999: chown d8/d16/c52 315997955 1 2024-04-25T02:27:17.388 INFO:tasks.workunit.client.0.smithi114.stdout:4/942: sync 2024-04-25T02:27:17.390 INFO:tasks.workunit.client.0.smithi114.stdout:4/943: creat d3/d8/d23/d25/d4e/dfa/d7f/d8d/df6/f12a x:0 0 0 2024-04-25T02:27:17.391 INFO:tasks.workunit.client.0.smithi114.stdout:4/944: write d3/d8/d12/d19/d26/d3e/daa/d89/df5/ffd [593906,22173] 0 2024-04-25T02:27:17.396 INFO:tasks.workunit.client.0.smithi114.stdout:4/945: dwrite d3/f28 [4194304,4194304] 0 2024-04-25T02:27:17.399 INFO:tasks.workunit.client.0.smithi114.stdout:4/946: creat d3/d14/f12b x:0 0 0 2024-04-25T02:27:17.400 INFO:tasks.workunit.client.0.smithi114.stdout:4/947: creat d3/d8/d12/f12c x:0 0 0 2024-04-25T02:27:17.403 INFO:tasks.workunit.client.0.smithi114.stdout:4/948: creat d3/d8/d12/d19/d26/d3e/d62/f12d x:0 0 0 2024-04-25T02:27:17.404 INFO:tasks.workunit.client.0.smithi114.stdout:4/949: write d3/d8/d12/d19/d26/d3e/daa/dce/f9e [7944506,45183] 0 2024-04-25T02:27:17.405 INFO:tasks.workunit.client.0.smithi114.stdout:4/950: dread - d3/d8/d12/d19/d26/d3e/daa/dce/f109 zero size 2024-04-25T02:27:17.406 INFO:tasks.workunit.client.0.smithi114.stdout:4/951: write d3/d8/d23/fc4 [4715616,53191] 0 2024-04-25T02:27:17.408 INFO:tasks.workunit.client.0.smithi114.stdout:4/952: symlink d3/d8/d12/d19/d26/d3e/daa/d89/dd7/l12e 0 2024-04-25T02:27:17.414 INFO:tasks.workunit.client.0.smithi114.stdout:4/953: dwrite d3/d8/d23/d25/d4e/dfa/d7f/d8d/df6/f12a [0,4194304] 0 2024-04-25T02:27:17.416 INFO:tasks.workunit.client.0.smithi114.stdout:4/954: truncate d3/d8/d12/d19/d26/d3e/daa/d89/df5/ffb 122506 0 2024-04-25T02:27:17.419 INFO:tasks.workunit.client.0.smithi114.stdout:4/955: symlink d3/d8/d23/d25/d4e/dfa/d7f/l12f 0 2024-04-25T02:27:17.421 INFO:tasks.workunit.client.0.smithi114.stdout:4/956: mknod d3/d8/d12/d19/d26/d3e/daa/d89/df5/c130 0 2024-04-25T02:27:17.422 INFO:tasks.workunit.client.0.smithi114.stdout:4/957: read - d3/d8/d23/d25/d4e/dfa/d7f/f122 zero size 2024-04-25T02:27:17.423 INFO:tasks.workunit.client.0.smithi114.stdout:4/958: mknod d3/d8/d23/d25/d4e/dfa/c131 0 2024-04-25T02:27:17.426 INFO:tasks.workunit.client.0.smithi114.stdout:4/959: rename d3/d8/d12/d19/d42/d58/ff7 to d3/d8/d23/d25/d4e/dfa/d7f/d8d/f132 0 2024-04-25T02:27:17.428 INFO:tasks.workunit.client.0.smithi114.stdout:4/960: mknod d3/d8/d12/d19/d26/c133 0 2024-04-25T02:27:17.429 INFO:tasks.workunit.client.0.smithi114.stdout:4/961: fsync d3/d8/d12/d19/d26/d3e/daa/dce/f9e 0 2024-04-25T02:27:17.430 INFO:tasks.workunit.client.0.smithi114.stdout:4/962: creat d3/d8/d23/d25/d4e/dfa/d7f/dd2/f134 x:0 0 0 2024-04-25T02:27:17.434 INFO:tasks.workunit.client.0.smithi114.stdout:4/963: rename d3/d8/d12/d19/d42/d58/fe1 to d3/d8/d12/d82/f135 0 2024-04-25T02:27:17.436 INFO:tasks.workunit.client.0.smithi114.stdout:4/964: mkdir d3/d8/d12/d19/d42/d136 0 2024-04-25T02:27:17.438 INFO:tasks.workunit.client.0.smithi114.stdout:4/965: mknod d3/d8/d12/d19/d26/d3e/daa/d89/dd7/c137 0 2024-04-25T02:27:17.480 INFO:tasks.workunit.client.0.smithi114.stdout:4/966: sync 2024-04-25T02:27:17.500 INFO:tasks.workunit.client.0.smithi114.stdout:4/967: truncate d3/d8/d23/d25/dd3/f107 313364 0 2024-04-25T02:27:17.503 INFO:tasks.workunit.client.0.smithi114.stdout:4/968: truncate d3/f92 3000370 0 2024-04-25T02:27:17.538 INFO:tasks.workunit.client.0.smithi114.stdout:4/969: sync 2024-04-25T02:27:17.538 INFO:tasks.workunit.client.0.smithi114.stdout:4/970: dread - d3/d8/d12/d19/d26/d3e/daa/dce/f109 zero size 2024-04-25T02:27:17.553 INFO:tasks.workunit.client.0.smithi114.stdout:4/971: dread d3/f28 [0,4194304] 0 2024-04-25T02:27:17.553 INFO:tasks.workunit.client.0.smithi114.stdout:4/972: dread - d3/d8/d23/f99 zero size 2024-04-25T02:27:17.556 INFO:tasks.workunit.client.0.smithi114.stdout:4/973: rename d3/d8/d23/f99 to d3/d8/d23/f138 0 2024-04-25T02:27:17.564 INFO:tasks.workunit.client.0.smithi114.stdout:4/974: dwrite d3/d8/d23/d25/f2d [0,4194304] 0 2024-04-25T02:27:17.566 INFO:tasks.workunit.client.0.smithi114.stdout:4/975: write d3/d8/d23/fb3 [3028317,79117] 0 2024-04-25T02:27:17.567 INFO:tasks.workunit.client.0.smithi114.stdout:4/976: chown d3/d14/d6c/f129 7457 1 2024-04-25T02:27:17.569 INFO:tasks.workunit.client.0.smithi114.stdout:4/977: write d3/d8/d12/d19/d26/d3e/daa/dce/d33/fbe [219717,110503] 0 2024-04-25T02:27:17.575 INFO:tasks.workunit.client.0.smithi114.stdout:4/978: dwrite d3/d8/d23/d25/d4e/dfa/d7f/dd2/f134 [0,4194304] 0 2024-04-25T02:27:17.580 INFO:tasks.workunit.client.0.smithi114.stdout:4/979: rmdir d3/d8/d12 39 2024-04-25T02:27:17.581 INFO:tasks.workunit.client.0.smithi114.stdout:4/980: write d3/d8/d23/d25/d4e/dfa/d7f/fe7 [553930,10576] 0 2024-04-25T02:27:17.583 INFO:tasks.workunit.client.0.smithi114.stdout:4/981: mkdir d3/d8/d23/d25/d4e/d139 0 2024-04-25T02:27:17.593 INFO:tasks.workunit.client.0.smithi114.stdout:4/982: write d3/d8/d12/d19/d26/d3e/daa/d89/fe4 [1016602,108111] 0 2024-04-25T02:27:17.608 INFO:tasks.workunit.client.0.smithi114.stdout:4/983: dread d3/d8/d12/d19/d26/d3e/daa/f83 [0,4194304] 0 2024-04-25T02:27:17.609 INFO:tasks.workunit.client.0.smithi114.stdout:4/984: creat d3/d8/d12/f13a x:0 0 0 2024-04-25T02:27:17.613 INFO:tasks.workunit.client.0.smithi114.stdout:4/985: dread d3/d8/d12/d19/d26/d3e/daa/dce/f9e [4194304,4194304] 0 2024-04-25T02:27:17.614 INFO:tasks.workunit.client.0.smithi114.stdout:4/986: write d3/d8/d30/d93/de2/fff [432799,9436] 0 2024-04-25T02:27:17.616 INFO:tasks.workunit.client.0.smithi114.stdout:4/987: creat d3/db9/f13b x:0 0 0 2024-04-25T02:27:17.621 INFO:tasks.workunit.client.0.smithi114.stdout:4/988: dwrite d3/d8/d23/d25/fbd [0,4194304] 0 2024-04-25T02:27:17.624 INFO:tasks.workunit.client.0.smithi114.stdout:4/989: creat d3/d8/d12/d19/d26/f13c x:0 0 0 2024-04-25T02:27:17.627 INFO:tasks.workunit.client.0.smithi114.stdout:4/990: symlink d3/d8/d12/d19/d26/d3e/daa/d89/df5/de0/l13d 0 2024-04-25T02:27:17.633 INFO:tasks.workunit.client.0.smithi114.stdout:4/991: dwrite d3/d8/d23/f138 [0,4194304] 0 2024-04-25T02:27:17.635 INFO:tasks.workunit.client.0.smithi114.stdout:4/992: mkdir d3/d13e 0 2024-04-25T02:27:17.638 INFO:tasks.workunit.client.0.smithi114.stdout:4/993: link d3/d8/l7d d3/d8/d96/l13f 0 2024-04-25T02:27:17.644 INFO:tasks.workunit.client.0.smithi114.stdout:4/994: dwrite d3/d8/d12/d19/d42/d58/fae [0,4194304] 0 2024-04-25T02:27:17.646 INFO:tasks.workunit.client.0.smithi114.stdout:4/995: truncate d3/d8/d12/d19/d26/d3e/d62/fbb 68039 0 2024-04-25T02:27:17.650 INFO:tasks.workunit.client.0.smithi114.stdout:4/996: getdents d3/d8/d12/d82/dde 0 2024-04-25T02:27:17.651 INFO:tasks.workunit.client.0.smithi114.stdout:4/997: write d3/d8/d12/d82/dde/fed [163501,47943] 0 2024-04-25T02:27:17.654 INFO:tasks.workunit.client.0.smithi114.stdout:4/998: rmdir d3/d8/d12/d19/d26/d3e/daa 39 2024-04-25T02:27:17.657 INFO:tasks.workunit.client.0.smithi114.stdout:4/999: unlink d3/d14/d6c/fb2 0 2024-04-25T02:27:17.659 INFO:tasks.workunit.client.0.smithi114.stderr:+ rm -rf -- ./tmp.ptayTPa6nf 2024-04-25T02:27:28.536 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-25T02:27:28.537 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-25T02:28:08.084 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-04-25T02:28:08.085 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-25T02:28:08.363 DEBUG:teuthology.parallel:result is None 2024-04-25T02:28:08.364 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-25T02:28:08.398 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-25T02:28:08.398 INFO:teuthology.run_tasks:Running task print... 2024-04-25T02:28:08.410 INFO:teuthology.task.print:**** done fsstress 2024-04-25T02:28:08.411 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-25T02:28:08.422 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-25T02:28:08.423 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-25T02:28:08.423 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:28:08.456 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-25T02:28:08.456 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:28:08.515 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:28:08.654 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.651+0000 7fe420db1700 1 Processor -- start 2024-04-25T02:28:08.655 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.651+0000 7fe420db1700 1 -- start start 2024-04-25T02:28:08.657 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.652+0000 7fe420db1700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe41c0682a0 0x7fe41c0a3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:08.657 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.652+0000 7fe420db1700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe41c06eae0 0x7fe41c06eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:08.657 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.652+0000 7fe420db1700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fe41c06f410 0x7fe41c13c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:08.657 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.652+0000 7fe420db1700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe41c0a7090 con 0x7fe41c06f410 2024-04-25T02:28:08.657 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.652+0000 7fe420db1700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c0a7350 con 0x7fe41c06eae0 2024-04-25T02:28:08.657 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.652+0000 7fe420db1700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c0a5640 con 0x7fe41c0682a0 2024-04-25T02:28:08.657 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.652+0000 7fe419d9b700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe41c06eae0 0x7fe41c06eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:08.657 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.652+0000 7fe41a59c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe41c0682a0 0x7fe41c0a3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:08.657 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.652+0000 7fe41ad9d700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fe41c06f410 0x7fe41c13c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:08.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.652+0000 7fe41a59c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe41c0682a0 0x7fe41c0a3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:41404/0 (socket says 172.21.15.111:41404) 2024-04-25T02:28:08.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.652+0000 7fe419d9b700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe41c06eae0 0x7fe41c06eed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:48156/0 (socket says 172.21.15.111:48156) 2024-04-25T02:28:08.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.652+0000 7fe41a59c700 1 -- 172.21.15.111:0/4241246370 learned_addr learned my addr 172.21.15.111:0/4241246370 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:28:08.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.652+0000 7fe41a59c700 1 -- 172.21.15.111:0/4241246370 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe41c06eae0 msgr2=0x7fe41c06eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:08.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.652+0000 7fe41a59c700 1 --2- 172.21.15.111:0/4241246370 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe41c06eae0 0x7fe41c06eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:08.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.652+0000 7fe41a59c700 1 -- 172.21.15.111:0/4241246370 >> v2:172.21.15.111:3300/0 conn(0x7fe41c06f410 msgr2=0x7fe41c13c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:08.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.652+0000 7fe41a59c700 1 --2- 172.21.15.111:0/4241246370 >> v2:172.21.15.111:3300/0 conn(0x7fe41c06f410 0x7fe41c13c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:08.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.652+0000 7fe41a59c700 1 -- 172.21.15.111:0/4241246370 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe41c06f8b0 con 0x7fe41c0682a0 2024-04-25T02:28:08.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.652+0000 7fe41ad9d700 1 --2- 172.21.15.111:0/4241246370 >> v2:172.21.15.111:3300/0 conn(0x7fe41c06f410 0x7fe41c13c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:08.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.652+0000 7fe41a59c700 1 --2- 172.21.15.111:0/4241246370 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe41c0682a0 0x7fe41c0a3e20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe4100099e0 tx=0x7fe410009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=36f03c6b505d353a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:08.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.652+0000 7fe41959a700 1 -- 172.21.15.111:0/4241246370 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41000b6d0 con 0x7fe41c0682a0 2024-04-25T02:28:08.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.652+0000 7fe41959a700 1 -- 172.21.15.111:0/4241246370 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe41000b830 con 0x7fe41c0682a0 2024-04-25T02:28:08.658 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.652+0000 7fe41959a700 1 -- 172.21.15.111:0/4241246370 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe41000bbd0 con 0x7fe41c0682a0 2024-04-25T02:28:08.659 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.653+0000 7fe420db1700 1 -- 172.21.15.111:0/4241246370 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe41c0682a0 msgr2=0x7fe41c0a3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:08.659 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.653+0000 7fe420db1700 1 --2- 172.21.15.111:0/4241246370 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe41c0682a0 0x7fe41c0a3e20 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe4100099e0 tx=0x7fe410009250 comp rx=0 tx=0).stop 2024-04-25T02:28:08.659 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.653+0000 7fe420db1700 1 -- 172.21.15.111:0/4241246370 shutdown_connections 2024-04-25T02:28:08.659 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.653+0000 7fe420db1700 1 --2- 172.21.15.111:0/4241246370 >> v2:172.21.15.111:3300/0 conn(0x7fe41c06f410 0x7fe41c13c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:08.659 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.653+0000 7fe420db1700 1 --2- 172.21.15.111:0/4241246370 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe41c0682a0 0x7fe41c0a3e20 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:08.659 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.653+0000 7fe420db1700 1 --2- 172.21.15.111:0/4241246370 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe41c06eae0 0x7fe41c06eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:08.659 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.653+0000 7fe420db1700 1 -- 172.21.15.111:0/4241246370 >> 172.21.15.111:0/4241246370 conn(0x7fe41c06beb0 msgr2=0x7fe41c067940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:08.659 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.653+0000 7fe420db1700 1 -- 172.21.15.111:0/4241246370 shutdown_connections 2024-04-25T02:28:08.659 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.653+0000 7fe420db1700 1 -- 172.21.15.111:0/4241246370 wait complete. 2024-04-25T02:28:08.661 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.654+0000 7fe420db1700 1 Processor -- start 2024-04-25T02:28:08.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.654+0000 7fe420db1700 1 -- start start 2024-04-25T02:28:08.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.654+0000 7fe420db1700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe41c0682a0 0x7fe41c069510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:08.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.654+0000 7fe420db1700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe41c06eae0 0x7fe41c137d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:08.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.654+0000 7fe420db1700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe41c06f410 0x7fe41c1382b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:08.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.655+0000 7fe420db1700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c069a50 con 0x7fe41c06f410 2024-04-25T02:28:08.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.655+0000 7fe420db1700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c068a50 con 0x7fe41c0682a0 2024-04-25T02:28:08.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.655+0000 7fe420db1700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe41c068cd0 con 0x7fe41c06eae0 2024-04-25T02:28:08.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.655+0000 7fe41ad9d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe41c06f410 0x7fe41c1382b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:08.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.655+0000 7fe419d9b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe41c06eae0 0x7fe41c137d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:08.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.655+0000 7fe41a59c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe41c0682a0 0x7fe41c069510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:08.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.655+0000 7fe41ad9d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe41c06f410 0x7fe41c1382b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:50118/0 (socket says 172.21.15.111:50118) 2024-04-25T02:28:08.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.655+0000 7fe41ad9d700 1 -- 172.21.15.111:0/1241858179 learned_addr learned my addr 172.21.15.111:0/1241858179 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:28:08.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.655+0000 7fe419d9b700 1 -- 172.21.15.111:0/1241858179 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe41c0682a0 msgr2=0x7fe41c069510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:08.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.655+0000 7fe419d9b700 1 --2- 172.21.15.111:0/1241858179 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe41c0682a0 0x7fe41c069510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:08.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.655+0000 7fe419d9b700 1 -- 172.21.15.111:0/1241858179 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe41c06f410 msgr2=0x7fe41c1382b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:08.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.655+0000 7fe419d9b700 1 --2- 172.21.15.111:0/1241858179 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe41c06f410 0x7fe41c1382b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:08.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.655+0000 7fe419d9b700 1 -- 172.21.15.111:0/1241858179 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe414009a20 con 0x7fe41c06eae0 2024-04-25T02:28:08.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.655+0000 7fe41a59c700 1 --2- 172.21.15.111:0/1241858179 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe41c0682a0 0x7fe41c069510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:08.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.655+0000 7fe419d9b700 1 --2- 172.21.15.111:0/1241858179 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe41c06eae0 0x7fe41c137d70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe40c00ea80 tx=0x7fe40c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:08.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.655+0000 7fe40a7fc700 1 -- 172.21.15.111:0/1241858179 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c00eec0 con 0x7fe41c06eae0 2024-04-25T02:28:08.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.655+0000 7fe40a7fc700 1 -- 172.21.15.111:0/1241858179 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe40c00c7f0 con 0x7fe41c06eae0 2024-04-25T02:28:08.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.655+0000 7fe420db1700 1 -- 172.21.15.111:0/1241858179 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4100094f0 con 0x7fe41c06eae0 2024-04-25T02:28:08.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.655+0000 7fe40a7fc700 1 -- 172.21.15.111:0/1241858179 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe40c00cb70 con 0x7fe41c06eae0 2024-04-25T02:28:08.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.655+0000 7fe420db1700 1 -- 172.21.15.111:0/1241858179 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe41c13ce80 con 0x7fe41c06eae0 2024-04-25T02:28:08.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.656+0000 7fe420db1700 1 -- 172.21.15.111:0/1241858179 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe41c071790 con 0x7fe41c06eae0 2024-04-25T02:28:08.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.656+0000 7fe40a7fc700 1 -- 172.21.15.111:0/1241858179 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7fe40c013470 con 0x7fe41c06eae0 2024-04-25T02:28:08.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.656+0000 7fe40a7fc700 1 -- 172.21.15.111:0/1241858179 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4158+0+0 (secure 0 0 0) 0x7fe40c05b5e0 con 0x7fe41c06eae0 2024-04-25T02:28:08.664 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.660+0000 7fe40a7fc700 1 -- 172.21.15.111:0/1241858179 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fe40c039a20 con 0x7fe41c06eae0 2024-04-25T02:28:08.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.818+0000 7fe420db1700 1 -- 172.21.15.111:0/1241858179 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe41c1405c0 con 0x7fe41c06eae0 2024-04-25T02:28:08.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.819+0000 7fe40a7fc700 1 -- 172.21.15.111:0/1241858179 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+12106 (secure 0 0 0) 0x7fe40c03d000 con 0x7fe41c06eae0 2024-04-25T02:28:08.822 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:28:08.822 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":43,"fsid":"4643f974-f93a-4436-93b8-460ff320e62e","created":"2024-04-25T02:20:05.450475+0000","modified":"2024-04-25T02:25:10.060341+0000","last_up_change":"2024-04-25T02:23:12.818028+0000","last_in_change":"2024-04-25T02:20:10.439204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:20:07.471248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:20:14.420378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:20:22.251868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T02:20:23.128289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"df3f17ca-3b12-42c8-8cf7-8f1b7189e587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":41,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6800","nonce":48862}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6801","nonce":48862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6803","nonce":48862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6802","nonce":48862}]},"public_addr":"172.21.15.111:6800/48862","cluster_addr":"172.21.15.111:6801/48862","heartbeat_back_addr":"172.21.15.111:6803/48862","heartbeat_front_addr":"172.21.15.111:6802/48862","state":["exists","up"]},{"osd":1,"uuid":"93d54815-f215-4285-bba6-32f2d1cabf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":29,"up_thru":31,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6804","nonce":48960}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6805","nonce":48960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6807","nonce":48960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6806","nonce":48960}]},"public_addr":"172.21.15.111:6804/48960","cluster_addr":"172.21.15.111:6805/48960","heartbeat_back_addr":"172.21.15.111:6807/48960","heartbeat_front_addr":"172.21.15.111:6806/48960","state":["exists","up"]},{"osd":2,"uuid":"b26b2104-2a2e-408f-9ce7-3587a32a2ebe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":41,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6808","nonce":49070}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6809","nonce":49070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6811","nonce":49070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6810","nonce":49070}]},"public_addr":"172.21.15.111:6808/49070","cluster_addr":"172.21.15.111:6809/49070","heartbeat_back_addr":"172.21.15.111:6811/49070","heartbeat_front_addr":"172.21.15.111:6810/49070","state":["exists","up"]},{"osd":3,"uuid":"43c25820-1edc-4031-badf-72e87dd6bf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":31,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6812","nonce":49243}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6813","nonce":49243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6815","nonce":49243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6814","nonce":49243}]},"public_addr":"172.21.15.111:6812/49243","cluster_addr":"172.21.15.111:6813/49243","heartbeat_back_addr":"172.21.15.111:6815/49243","heartbeat_front_addr":"172.21.15.111:6814/49243","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.372427+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.411480+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.361508+0000","dead_epoch":25},{"osd":3,"down_stamp":"2024-04-25T02:23:06.771296+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.377212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.d","mappings":[{"from":3,"to":2}]},{"pgid":"4.13","mappings":[{"from":3,"to":0}]},{"pgid":"4.19","mappings":[{"from":3,"to":0}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.30","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.186:0/1473940677":"2024-04-25T03:25:09.063135+0000","172.21.15.111:6819/4003866251":"2024-04-26T02:23:16.839679+0000","172.21.15.111:0/2148931273":"2024-04-26T02:22:54.713254+0000","172.21.15.111:6816/39585":"2024-04-26T02:22:54.713254+0000","172.21.15.111:0/3911588907":"2024-04-26T02:22:54.713254+0000","172.21.15.111:0/1276843622":"2024-04-26T02:22:54.713254+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:28:08.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.820+0000 7fe420db1700 1 -- 172.21.15.111:0/1241858179 >> v1:172.21.15.111:6816/46482 conn(0x7fe3fc045ef0 legacy=0x7fe3fc0483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:08.825 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.820+0000 7fe420db1700 1 -- 172.21.15.111:0/1241858179 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe41c06eae0 msgr2=0x7fe41c137d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:08.825 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.820+0000 7fe420db1700 1 --2- 172.21.15.111:0/1241858179 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe41c06eae0 0x7fe41c137d70 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe40c00ea80 tx=0x7fe40c0091a0 comp rx=0 tx=0).stop 2024-04-25T02:28:08.825 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.821+0000 7fe420db1700 1 -- 172.21.15.111:0/1241858179 shutdown_connections 2024-04-25T02:28:08.825 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.821+0000 7fe420db1700 1 --2- 172.21.15.111:0/1241858179 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe41c06f410 0x7fe41c1382b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:08.825 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.821+0000 7fe420db1700 1 --2- 172.21.15.111:0/1241858179 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe41c0682a0 0x7fe41c069510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:08.825 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.821+0000 7fe420db1700 1 --2- 172.21.15.111:0/1241858179 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe41c06eae0 0x7fe41c137d70 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:08.825 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.821+0000 7fe420db1700 1 -- 172.21.15.111:0/1241858179 >> 172.21.15.111:0/1241858179 conn(0x7fe41c06beb0 msgr2=0x7fe41c0b34f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:08.825 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.821+0000 7fe420db1700 1 -- 172.21.15.111:0/1241858179 shutdown_connections 2024-04-25T02:28:08.825 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.821+0000 7fe420db1700 1 -- 172.21.15.111:0/1241858179 wait complete. 2024-04-25T02:28:08.836 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:20:07.471248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T02:20:14.420378+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:20:22.251868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:20:23.128289+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T02:28:08.836 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:28:08.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.952+0000 7f2c7cdbd700 1 Processor -- start 2024-04-25T02:28:08.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.952+0000 7f2c7cdbd700 1 -- start start 2024-04-25T02:28:08.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.953+0000 7f2c7cdbd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2c780a30f0 0x7f2c780b22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:08.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.953+0000 7f2c7cdbd700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2c78143850 0x7f2c78145c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:08.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.953+0000 7f2c7cdbd700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2c781388c0 con 0x7f2c7813baf0 2024-04-25T02:28:08.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.953+0000 7f2c7cdbd700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c780a3f40 con 0x7f2c780a30f0 2024-04-25T02:28:08.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.953+0000 7f2c7cdbd700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7813b1d0 con 0x7f2c78143850 2024-04-25T02:28:08.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.953+0000 7f2c75d9b700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2c780a30f0 0x7f2c780b22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:08.958 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.953+0000 7f2c76d9d700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2c78143850 0x7f2c78145c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:08.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.953+0000 7f2c7659c700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f2c7813baf0 0x7f2c780a45d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:40520/0 (socket says 172.21.15.111:40520) 2024-04-25T02:28:08.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.953+0000 7f2c7659c700 1 -- 172.21.15.111:0/1437031851 learned_addr learned my addr 172.21.15.111:0/1437031851 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:28:08.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.953+0000 7f2c75d9b700 1 -- 172.21.15.111:0/1437031851 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2c78143850 msgr2=0x7f2c78145c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:08.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.953+0000 7f2c75d9b700 1 --2- 172.21.15.111:0/1437031851 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2c78143850 0x7f2c78145c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:08.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.953+0000 7f2c75d9b700 1 -- 172.21.15.111:0/1437031851 >> v1:172.21.15.111:6789/0 conn(0x7f2c7813baf0 legacy=0x7f2c780a45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:08.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.953+0000 7f2c75d9b700 1 -- 172.21.15.111:0/1437031851 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c7813b470 con 0x7f2c780a30f0 2024-04-25T02:28:08.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.953+0000 7f2c7559a700 1 -- 172.21.15.111:0/1437031851 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1979470748 0 0) 0x7f2c6c001110 con 0x7f2c7813baf0 2024-04-25T02:28:08.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.953+0000 7f2c76d9d700 1 --2- 172.21.15.111:0/1437031851 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2c78143850 0x7f2c78145c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:08.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.954+0000 7f2c75d9b700 1 --2- 172.21.15.111:0/1437031851 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2c780a30f0 0x7f2c780b22f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2c68009910 tx=0x7f2c680091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=73f37c571d043554 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:08.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.954+0000 7f2c7559a700 1 -- 172.21.15.111:0/1437031851 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6800b680 con 0x7f2c780a30f0 2024-04-25T02:28:08.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.954+0000 7f2c7559a700 1 -- 172.21.15.111:0/1437031851 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6800b7e0 con 0x7f2c780a30f0 2024-04-25T02:28:08.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.954+0000 7f2c7559a700 1 -- 172.21.15.111:0/1437031851 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6800bba0 con 0x7f2c780a30f0 2024-04-25T02:28:08.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.954+0000 7f2c7cdbd700 1 -- 172.21.15.111:0/1437031851 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2c780a30f0 msgr2=0x7f2c780b22f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:08.959 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.954+0000 7f2c7cdbd700 1 --2- 172.21.15.111:0/1437031851 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2c780a30f0 0x7f2c780b22f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f2c68009910 tx=0x7f2c680091a0 comp rx=0 tx=0).stop 2024-04-25T02:28:08.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.954+0000 7f2c7cdbd700 1 -- 172.21.15.111:0/1437031851 shutdown_connections 2024-04-25T02:28:08.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.954+0000 7f2c7cdbd700 1 --2- 172.21.15.111:0/1437031851 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2c78143850 0x7f2c78145c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:08.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.954+0000 7f2c7cdbd700 1 --2- 172.21.15.111:0/1437031851 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2c780a30f0 0x7f2c780b22f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:08.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.954+0000 7f2c7cdbd700 1 -- 172.21.15.111:0/1437031851 >> 172.21.15.111:0/1437031851 conn(0x7f2c7806d200 msgr2=0x7f2c7806af90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:08.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.954+0000 7f2c7cdbd700 1 -- 172.21.15.111:0/1437031851 shutdown_connections 2024-04-25T02:28:08.960 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.954+0000 7f2c7cdbd700 1 -- 172.21.15.111:0/1437031851 wait complete. 2024-04-25T02:28:08.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.955+0000 7f2c7cdbd700 1 Processor -- start 2024-04-25T02:28:08.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.955+0000 7f2c7cdbd700 1 -- start start 2024-04-25T02:28:08.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.956+0000 7f2c7cdbd700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2c780a30f0 0x7f2c780a7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:08.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.956+0000 7f2c7cdbd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2c7813baf0 0x7f2c7813e860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:08.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.956+0000 7f2c7cdbd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2c78143850 0x7f2c7814f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:08.962 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.956+0000 7f2c7cdbd700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c7814beb0 con 0x7f2c78143850 2024-04-25T02:28:08.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.956+0000 7f2c7cdbd700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c780a6780 con 0x7f2c7813baf0 2024-04-25T02:28:08.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.956+0000 7f2c7cdbd700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2c780a57c0 con 0x7f2c780a30f0 2024-04-25T02:28:08.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.956+0000 7f2c7659c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2c780a30f0 0x7f2c780a7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:08.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.956+0000 7f2c7659c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2c780a30f0 0x7f2c780a7420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:41420/0 (socket says 172.21.15.111:41420) 2024-04-25T02:28:08.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.956+0000 7f2c76d9d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2c78143850 0x7f2c7814f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:08.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.956+0000 7f2c75d9b700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2c7813baf0 0x7f2c7813e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:08.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.956+0000 7f2c7659c700 1 -- 172.21.15.111:0/2716634488 learned_addr learned my addr 172.21.15.111:0/2716634488 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:28:08.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.956+0000 7f2c7659c700 1 -- 172.21.15.111:0/2716634488 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2c7813baf0 msgr2=0x7f2c7813e860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:08.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.956+0000 7f2c7659c700 1 --2- 172.21.15.111:0/2716634488 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2c7813baf0 0x7f2c7813e860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:08.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.956+0000 7f2c7659c700 1 -- 172.21.15.111:0/2716634488 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2c78143850 msgr2=0x7f2c7814f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:08.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.956+0000 7f2c7659c700 1 --2- 172.21.15.111:0/2716634488 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2c78143850 0x7f2c7814f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:08.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.956+0000 7f2c7659c700 1 -- 172.21.15.111:0/2716634488 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c70009a20 con 0x7f2c780a30f0 2024-04-25T02:28:08.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.956+0000 7f2c7659c700 1 --2- 172.21.15.111:0/2716634488 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2c780a30f0 0x7f2c780a7420 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c00c840 tx=0x7f2c6c007c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:08.963 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.956+0000 7f2c667fc700 1 -- 172.21.15.111:0/2716634488 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c005b30 con 0x7f2c780a30f0 2024-04-25T02:28:08.964 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.957+0000 7f2c667fc700 1 -- 172.21.15.111:0/2716634488 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6c005cb0 con 0x7f2c780a30f0 2024-04-25T02:28:08.964 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.957+0000 7f2c7cdbd700 1 -- 172.21.15.111:0/2716634488 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c68009420 con 0x7f2c780a30f0 2024-04-25T02:28:08.964 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.957+0000 7f2c667fc700 1 -- 172.21.15.111:0/2716634488 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c007320 con 0x7f2c780a30f0 2024-04-25T02:28:08.964 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.957+0000 7f2c7cdbd700 1 -- 172.21.15.111:0/2716634488 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c780a5d20 con 0x7f2c780a30f0 2024-04-25T02:28:08.964 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.957+0000 7f2c7cdbd700 1 -- 172.21.15.111:0/2716634488 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c780b2970 con 0x7f2c780a30f0 2024-04-25T02:28:08.964 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.958+0000 7f2c667fc700 1 -- 172.21.15.111:0/2716634488 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f2c6c01c440 con 0x7f2c780a30f0 2024-04-25T02:28:08.964 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.958+0000 7f2c667fc700 1 -- 172.21.15.111:0/2716634488 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4158+0+0 (secure 0 0 0) 0x7f2c6c05a550 con 0x7f2c780a30f0 2024-04-25T02:28:08.964 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:08.961+0000 7f2c667fc700 1 -- 172.21.15.111:0/2716634488 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f2c6c0388c0 con 0x7f2c780a30f0 2024-04-25T02:28:09.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.117+0000 7f2c7cdbd700 1 -- 172.21.15.111:0/2716634488 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2c781388c0 con 0x7f2c780a30f0 2024-04-25T02:28:09.121 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.118+0000 7f2c667fc700 1 -- 172.21.15.111:0/2716634488 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2c781388c0 con 0x7f2c780a30f0 2024-04-25T02:28:09.122 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 1 2024-04-25T02:28:09.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.119+0000 7f2c7cdbd700 1 -- 172.21.15.111:0/2716634488 >> v1:172.21.15.111:6816/46482 conn(0x7f2c58045ef0 legacy=0x7f2c580483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:09.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.119+0000 7f2c7cdbd700 1 -- 172.21.15.111:0/2716634488 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2c780a30f0 msgr2=0x7f2c780a7420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:09.123 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.119+0000 7f2c7cdbd700 1 --2- 172.21.15.111:0/2716634488 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2c780a30f0 0x7f2c780a7420 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c00c840 tx=0x7f2c6c007c10 comp rx=0 tx=0).stop 2024-04-25T02:28:09.124 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.119+0000 7f2c7cdbd700 1 -- 172.21.15.111:0/2716634488 shutdown_connections 2024-04-25T02:28:09.124 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.120+0000 7f2c7cdbd700 1 --2- 172.21.15.111:0/2716634488 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2c78143850 0x7f2c7814f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:09.124 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.120+0000 7f2c7cdbd700 1 --2- 172.21.15.111:0/2716634488 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2c780a30f0 0x7f2c780a7420 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:09.124 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.120+0000 7f2c7cdbd700 1 --2- 172.21.15.111:0/2716634488 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2c7813baf0 0x7f2c7813e860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:09.124 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.120+0000 7f2c7cdbd700 1 -- 172.21.15.111:0/2716634488 >> 172.21.15.111:0/2716634488 conn(0x7f2c7806d200 msgr2=0x7f2c78064900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:09.124 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.120+0000 7f2c7cdbd700 1 -- 172.21.15.111:0/2716634488 shutdown_connections 2024-04-25T02:28:09.124 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.120+0000 7f2c7cdbd700 1 -- 172.21.15.111:0/2716634488 wait complete. 2024-04-25T02:28:09.135 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T02:28:09.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.250+0000 7f8e3d103700 1 Processor -- start 2024-04-25T02:28:09.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.250+0000 7f8e3d103700 1 -- start start 2024-04-25T02:28:09.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.250+0000 7f8e3d103700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8e3806e570 0x7f8e380a5e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:09.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.250+0000 7f8e3d103700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f8e380af620 0x7f8e3813c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:09.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.250+0000 7f8e3d103700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e380a6370 con 0x7f8e3813ce20 2024-04-25T02:28:09.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.250+0000 7f8e3d103700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e3806fc20 con 0x7f8e380af620 2024-04-25T02:28:09.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.250+0000 7f8e3d103700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e38067940 con 0x7f8e3806e570 2024-04-25T02:28:09.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.250+0000 7f8e36d9d700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8e3806e570 0x7f8e380a5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:09.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.250+0000 7f8e3659c700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f8e380af620 0x7f8e3813c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:09.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.250+0000 7f8e36d9d700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8e3806e570 0x7f8e380a5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:41424/0 (socket says 172.21.15.111:41424) 2024-04-25T02:28:09.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.250+0000 7f8e3759e700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f8e3813ce20 0x7f8e3813f740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:40524/0 (socket says 172.21.15.111:40524) 2024-04-25T02:28:09.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.250+0000 7f8e36d9d700 1 -- 172.21.15.111:0/828939766 learned_addr learned my addr 172.21.15.111:0/828939766 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:28:09.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.251+0000 7f8e3659c700 1 -- 172.21.15.111:0/828939766 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8e3806e570 msgr2=0x7f8e380a5e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:09.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.251+0000 7f8e3659c700 1 --2- 172.21.15.111:0/828939766 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8e3806e570 0x7f8e380a5e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:09.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.251+0000 7f8e3659c700 1 -- 172.21.15.111:0/828939766 >> v1:172.21.15.111:6789/0 conn(0x7f8e3813ce20 legacy=0x7f8e3813f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:09.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.251+0000 7f8e3659c700 1 -- 172.21.15.111:0/828939766 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e380698c0 con 0x7f8e380af620 2024-04-25T02:28:09.256 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.251+0000 7f8e35d9b700 1 -- 172.21.15.111:0/828939766 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1077757608 0 0) 0x7f8e380a6370 con 0x7f8e3813ce20 2024-04-25T02:28:09.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.251+0000 7f8e36d9d700 1 --2- 172.21.15.111:0/828939766 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8e3806e570 0x7f8e380a5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:09.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.251+0000 7f8e3659c700 1 --2- 172.21.15.111:0/828939766 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8e380af620 0x7f8e3813c8e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c00dd10 tx=0x7f8e2c00d630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4827d7833ecda57a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:09.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.251+0000 7f8e35d9b700 1 -- 172.21.15.111:0/828939766 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c012070 con 0x7f8e380af620 2024-04-25T02:28:09.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.251+0000 7f8e35d9b700 1 -- 172.21.15.111:0/828939766 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2c00de70 con 0x7f8e380af620 2024-04-25T02:28:09.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.251+0000 7f8e35d9b700 1 -- 172.21.15.111:0/828939766 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2c00fb60 con 0x7f8e380af620 2024-04-25T02:28:09.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.251+0000 7f8e3d103700 1 -- 172.21.15.111:0/828939766 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8e380af620 msgr2=0x7f8e3813c8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:09.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.251+0000 7f8e3d103700 1 --2- 172.21.15.111:0/828939766 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8e380af620 0x7f8e3813c8e0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f8e2c00dd10 tx=0x7f8e2c00d630 comp rx=0 tx=0).stop 2024-04-25T02:28:09.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.251+0000 7f8e3d103700 1 -- 172.21.15.111:0/828939766 shutdown_connections 2024-04-25T02:28:09.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.251+0000 7f8e3d103700 1 --2- 172.21.15.111:0/828939766 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8e3806e570 0x7f8e380a5e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:09.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.251+0000 7f8e3d103700 1 --2- 172.21.15.111:0/828939766 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8e380af620 0x7f8e3813c8e0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:09.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.251+0000 7f8e3d103700 1 -- 172.21.15.111:0/828939766 >> 172.21.15.111:0/828939766 conn(0x7f8e3806ce40 msgr2=0x7f8e3806af80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:09.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.251+0000 7f8e3d103700 1 -- 172.21.15.111:0/828939766 shutdown_connections 2024-04-25T02:28:09.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.252+0000 7f8e3d103700 1 -- 172.21.15.111:0/828939766 wait complete. 2024-04-25T02:28:09.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.253+0000 7f8e3d103700 1 Processor -- start 2024-04-25T02:28:09.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.253+0000 7f8e3d103700 1 -- start start 2024-04-25T02:28:09.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.254+0000 7f8e3d103700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8e3806e570 0x7f8e380aba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:09.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.254+0000 7f8e3d103700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8e380af620 0x7f8e3814d110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:09.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.254+0000 7f8e3d103700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8e3813ce20 0x7f8e3814d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:09.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.254+0000 7f8e3d103700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e380a8e10 con 0x7f8e380af620 2024-04-25T02:28:09.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.254+0000 7f8e3d103700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e380aa5f0 con 0x7f8e3813ce20 2024-04-25T02:28:09.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.254+0000 7f8e3d103700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8e380ad5f0 con 0x7f8e3806e570 2024-04-25T02:28:09.260 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.254+0000 7f8e36d9d700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8e3806e570 0x7f8e380aba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:09.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.254+0000 7f8e36d9d700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8e3806e570 0x7f8e380aba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:41426/0 (socket says 172.21.15.111:41426) 2024-04-25T02:28:09.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.254+0000 7f8e36d9d700 1 -- 172.21.15.111:0/3129946270 learned_addr learned my addr 172.21.15.111:0/3129946270 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:28:09.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.254+0000 7f8e3759e700 1 --2- 172.21.15.111:0/3129946270 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8e3813ce20 0x7f8e3814d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:09.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.254+0000 7f8e3659c700 1 --2- 172.21.15.111:0/3129946270 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8e380af620 0x7f8e3814d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:09.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.254+0000 7f8e36d9d700 1 -- 172.21.15.111:0/3129946270 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8e3813ce20 msgr2=0x7f8e3814d650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:09.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.254+0000 7f8e36d9d700 1 --2- 172.21.15.111:0/3129946270 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8e3813ce20 0x7f8e3814d650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:09.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.254+0000 7f8e36d9d700 1 -- 172.21.15.111:0/3129946270 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8e380af620 msgr2=0x7f8e3814d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:09.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.254+0000 7f8e36d9d700 1 --2- 172.21.15.111:0/3129946270 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8e380af620 0x7f8e3814d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:09.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.254+0000 7f8e36d9d700 1 -- 172.21.15.111:0/3129946270 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e280094f0 con 0x7f8e3806e570 2024-04-25T02:28:09.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.254+0000 7f8e36d9d700 1 --2- 172.21.15.111:0/3129946270 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8e3806e570 0x7f8e380aba80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8e2800ec80 tx=0x7f8e28009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:09.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.254+0000 7f8e1effd700 1 -- 172.21.15.111:0/3129946270 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2800c850 con 0x7f8e3806e570 2024-04-25T02:28:09.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.254+0000 7f8e1effd700 1 -- 172.21.15.111:0/3129946270 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e2800c9b0 con 0x7f8e3806e570 2024-04-25T02:28:09.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.254+0000 7f8e3d103700 1 -- 172.21.15.111:0/3129946270 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e2c00d8d0 con 0x7f8e3806e570 2024-04-25T02:28:09.261 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.254+0000 7f8e1effd700 1 -- 172.21.15.111:0/3129946270 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e2800cd50 con 0x7f8e3806e570 2024-04-25T02:28:09.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.254+0000 7f8e3d103700 1 -- 172.21.15.111:0/3129946270 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e380ac4a0 con 0x7f8e3806e570 2024-04-25T02:28:09.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.255+0000 7f8e3d103700 1 -- 172.21.15.111:0/3129946270 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e380a1a50 con 0x7f8e3806e570 2024-04-25T02:28:09.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.255+0000 7f8e1effd700 1 -- 172.21.15.111:0/3129946270 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f8e28013680 con 0x7f8e3806e570 2024-04-25T02:28:09.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.256+0000 7f8e1effd700 1 -- 172.21.15.111:0/3129946270 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4158+0+0 (secure 0 0 0) 0x7f8e2805b1f0 con 0x7f8e3806e570 2024-04-25T02:28:09.262 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.259+0000 7f8e1effd700 1 -- 172.21.15.111:0/3129946270 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f8e28039420 con 0x7f8e3806e570 2024-04-25T02:28:09.417 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.413+0000 7f8e3d103700 1 -- 172.21.15.111:0/3129946270 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f8e38065190 con 0x7f8e3806e570 2024-04-25T02:28:09.417 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.414+0000 7f8e1effd700 1 -- 172.21.15.111:0/3129946270 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v43) v1 ==== 92+0+10 (secure 0 0 0) 0x7f8e28021020 con 0x7f8e3806e570 2024-04-25T02:28:09.417 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 8 2024-04-25T02:28:09.419 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.415+0000 7f8e3d103700 1 -- 172.21.15.111:0/3129946270 >> v1:172.21.15.111:6816/46482 conn(0x7f8e24045ef0 legacy=0x7f8e240483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:09.419 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.415+0000 7f8e3d103700 1 -- 172.21.15.111:0/3129946270 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8e3806e570 msgr2=0x7f8e380aba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:09.419 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.415+0000 7f8e3d103700 1 --2- 172.21.15.111:0/3129946270 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8e3806e570 0x7f8e380aba80 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8e2800ec80 tx=0x7f8e28009250 comp rx=0 tx=0).stop 2024-04-25T02:28:09.419 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.415+0000 7f8e3d103700 1 -- 172.21.15.111:0/3129946270 shutdown_connections 2024-04-25T02:28:09.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.415+0000 7f8e3d103700 1 --2- 172.21.15.111:0/3129946270 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8e3813ce20 0x7f8e3814d650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:09.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.415+0000 7f8e3d103700 1 --2- 172.21.15.111:0/3129946270 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8e3806e570 0x7f8e380aba80 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:09.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.415+0000 7f8e3d103700 1 --2- 172.21.15.111:0/3129946270 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8e380af620 0x7f8e3814d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:09.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.415+0000 7f8e3d103700 1 -- 172.21.15.111:0/3129946270 >> 172.21.15.111:0/3129946270 conn(0x7f8e3806ce40 msgr2=0x7f8e380a2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:09.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.415+0000 7f8e3d103700 1 -- 172.21.15.111:0/3129946270 shutdown_connections 2024-04-25T02:28:09.420 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.415+0000 7f8e3d103700 1 -- 172.21.15.111:0/3129946270 wait complete. 2024-04-25T02:28:09.430 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:28:09.597 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.593+0000 7f47e9b22700 1 Processor -- start 2024-04-25T02:28:09.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.593+0000 7f47e9b22700 1 -- start start 2024-04-25T02:28:09.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.594+0000 7f47e9b22700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f47e4069bb0 0x7f47e40a3d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:09.599 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.594+0000 7f47e9b22700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f47e40a7120 0x7f47e413eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:09.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.594+0000 7f47e9b22700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47e40a3520 con 0x7f47e413f050 2024-04-25T02:28:09.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.594+0000 7f47e9b22700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e40a6680 con 0x7f47e40a7120 2024-04-25T02:28:09.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.594+0000 7f47e9b22700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f47e413f4f0 con 0x7f47e4069bb0 2024-04-25T02:28:09.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.594+0000 7f47e3fff700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f47e413f050 0x7f47e40a5460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:40528/0 (socket says 172.21.15.111:40528) 2024-04-25T02:28:09.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.594+0000 7f47e37fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f47e4069bb0 0x7f47e40a3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:09.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.594+0000 7f47e2ffd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f47e40a7120 0x7f47e413eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:09.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.594+0000 7f47e3fff700 1 -- 172.21.15.111:0/1111002818 learned_addr learned my addr 172.21.15.111:0/1111002818 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:28:09.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.594+0000 7f47e2ffd700 1 -- 172.21.15.111:0/1111002818 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f47e4069bb0 msgr2=0x7f47e40a3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:09.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.594+0000 7f47e2ffd700 1 --2- 172.21.15.111:0/1111002818 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f47e4069bb0 0x7f47e40a3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:09.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.594+0000 7f47e2ffd700 1 -- 172.21.15.111:0/1111002818 >> v1:172.21.15.111:6789/0 conn(0x7f47e413f050 legacy=0x7f47e40a5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:09.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.594+0000 7f47e2ffd700 1 -- 172.21.15.111:0/1111002818 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e4141f00 con 0x7f47e40a7120 2024-04-25T02:28:09.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.594+0000 7f47e27fc700 1 -- 172.21.15.111:0/1111002818 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2331950798 0 0) 0x7f47e40a3520 con 0x7f47e413f050 2024-04-25T02:28:09.600 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.595+0000 7f47e2ffd700 1 --2- 172.21.15.111:0/1111002818 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f47e40a7120 0x7f47e413eb10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f47d4009910 tx=0x7f47d40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b76ffd81d51b96ee server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:09.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.595+0000 7f47e27fc700 1 -- 172.21.15.111:0/1111002818 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d400b680 con 0x7f47e40a7120 2024-04-25T02:28:09.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.595+0000 7f47e27fc700 1 -- 172.21.15.111:0/1111002818 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d400b7e0 con 0x7f47e40a7120 2024-04-25T02:28:09.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.595+0000 7f47e27fc700 1 -- 172.21.15.111:0/1111002818 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d400bba0 con 0x7f47e40a7120 2024-04-25T02:28:09.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.595+0000 7f47e9b22700 1 -- 172.21.15.111:0/1111002818 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f47e40a7120 msgr2=0x7f47e413eb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:09.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.595+0000 7f47e9b22700 1 --2- 172.21.15.111:0/1111002818 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f47e40a7120 0x7f47e413eb10 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f47d4009910 tx=0x7f47d40091a0 comp rx=0 tx=0).stop 2024-04-25T02:28:09.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.595+0000 7f47e9b22700 1 -- 172.21.15.111:0/1111002818 shutdown_connections 2024-04-25T02:28:09.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.595+0000 7f47e9b22700 1 --2- 172.21.15.111:0/1111002818 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f47e4069bb0 0x7f47e40a3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:09.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.595+0000 7f47e9b22700 1 --2- 172.21.15.111:0/1111002818 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f47e40a7120 0x7f47e413eb10 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:09.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.595+0000 7f47e9b22700 1 -- 172.21.15.111:0/1111002818 >> 172.21.15.111:0/1111002818 conn(0x7f47e4064000 msgr2=0x7f47e40b4eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:09.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.595+0000 7f47e9b22700 1 -- 172.21.15.111:0/1111002818 shutdown_connections 2024-04-25T02:28:09.601 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.595+0000 7f47e9b22700 1 -- 172.21.15.111:0/1111002818 wait complete. 2024-04-25T02:28:09.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.596+0000 7f47e9b22700 1 Processor -- start 2024-04-25T02:28:09.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.596+0000 7f47e9b22700 1 -- start start 2024-04-25T02:28:09.603 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.597+0000 7f47e9b22700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f47e4069bb0 0x7f47e40ab890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:09.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.597+0000 7f47e9b22700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f47e40a7120 0x7f47e41516e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:09.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.597+0000 7f47e9b22700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f47e413f050 0x7f47e4151c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:09.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.597+0000 7f47e9b22700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e40ab1d0 con 0x7f47e40a7120 2024-04-25T02:28:09.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.597+0000 7f47e9b22700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e40ac1c0 con 0x7f47e4069bb0 2024-04-25T02:28:09.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.597+0000 7f47e9b22700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f47e40ac480 con 0x7f47e413f050 2024-04-25T02:28:09.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.597+0000 7f47e3fff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f47e413f050 0x7f47e4151c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:09.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.597+0000 7f47e2ffd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f47e40a7120 0x7f47e41516e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:09.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.597+0000 7f47e37fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f47e4069bb0 0x7f47e40ab890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:09.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.597+0000 7f47e3fff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f47e413f050 0x7f47e4151c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:41444/0 (socket says 172.21.15.111:41444) 2024-04-25T02:28:09.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.597+0000 7f47e2ffd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f47e40a7120 0x7f47e41516e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:50158/0 (socket says 172.21.15.111:50158) 2024-04-25T02:28:09.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.597+0000 7f47e3fff700 1 -- 172.21.15.111:0/4268475717 learned_addr learned my addr 172.21.15.111:0/4268475717 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:28:09.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.597+0000 7f47e3fff700 1 -- 172.21.15.111:0/4268475717 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f47e4069bb0 msgr2=0x7f47e40ab890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:09.604 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.597+0000 7f47e3fff700 1 --2- 172.21.15.111:0/4268475717 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f47e4069bb0 0x7f47e40ab890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:09.605 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.597+0000 7f47e3fff700 1 -- 172.21.15.111:0/4268475717 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f47e40a7120 msgr2=0x7f47e41516e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:09.605 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.597+0000 7f47e3fff700 1 --2- 172.21.15.111:0/4268475717 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f47e40a7120 0x7f47e41516e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:09.605 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.597+0000 7f47e3fff700 1 -- 172.21.15.111:0/4268475717 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d4009420 con 0x7f47e413f050 2024-04-25T02:28:09.605 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.597+0000 7f47e37fe700 1 --2- 172.21.15.111:0/4268475717 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f47e4069bb0 0x7f47e40ab890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:09.605 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.597+0000 7f47e2ffd700 1 --2- 172.21.15.111:0/4268475717 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f47e40a7120 0x7f47e41516e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:09.605 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.598+0000 7f47e3fff700 1 --2- 172.21.15.111:0/4268475717 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f47e413f050 0x7f47e4151c20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f47dc00cbf0 tx=0x7f47dc0019b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:09.605 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.598+0000 7f47cb7fe700 1 -- 172.21.15.111:0/4268475717 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47dc00a8b0 con 0x7f47e413f050 2024-04-25T02:28:09.605 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.598+0000 7f47cb7fe700 1 -- 172.21.15.111:0/4268475717 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47dc00aa10 con 0x7f47e413f050 2024-04-25T02:28:09.605 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.598+0000 7f47e9b22700 1 -- 172.21.15.111:0/4268475717 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47e40ad760 con 0x7f47e413f050 2024-04-25T02:28:09.605 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.598+0000 7f47cb7fe700 1 -- 172.21.15.111:0/4268475717 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47dc00add0 con 0x7f47e413f050 2024-04-25T02:28:09.605 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.598+0000 7f47e9b22700 1 -- 172.21.15.111:0/4268475717 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47e40abdd0 con 0x7f47e413f050 2024-04-25T02:28:09.605 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.599+0000 7f47e9b22700 1 -- 172.21.15.111:0/4268475717 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47e40aa680 con 0x7f47e413f050 2024-04-25T02:28:09.605 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.599+0000 7f47cb7fe700 1 -- 172.21.15.111:0/4268475717 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f47dc007300 con 0x7f47e413f050 2024-04-25T02:28:09.605 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.599+0000 7f47cb7fe700 1 -- 172.21.15.111:0/4268475717 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4158+0+0 (secure 0 0 0) 0x7f47dc05b300 con 0x7f47e413f050 2024-04-25T02:28:09.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.602+0000 7f47cb7fe700 1 -- 172.21.15.111:0/4268475717 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f47dc0395b0 con 0x7f47e413f050 2024-04-25T02:28:09.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.756+0000 7f47e9b22700 1 -- 172.21.15.111:0/4268475717 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f47e4065190 con 0x7f47e413f050 2024-04-25T02:28:09.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.757+0000 7f47cb7fe700 1 -- 172.21.15.111:0/4268475717 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v43) v1 ==== 104+0+11 (secure 0 0 0) 0x7f47dc03cda0 con 0x7f47e413f050 2024-04-25T02:28:09.760 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 32 2024-04-25T02:28:09.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.758+0000 7f47e9b22700 1 -- 172.21.15.111:0/4268475717 >> v1:172.21.15.111:6816/46482 conn(0x7f47d0045ef0 legacy=0x7f47d00483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:09.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.758+0000 7f47e9b22700 1 -- 172.21.15.111:0/4268475717 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f47e413f050 msgr2=0x7f47e4151c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:09.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.758+0000 7f47e9b22700 1 --2- 172.21.15.111:0/4268475717 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f47e413f050 0x7f47e4151c20 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f47dc00cbf0 tx=0x7f47dc0019b0 comp rx=0 tx=0).stop 2024-04-25T02:28:09.763 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.758+0000 7f47e9b22700 1 -- 172.21.15.111:0/4268475717 shutdown_connections 2024-04-25T02:28:09.763 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.758+0000 7f47e9b22700 1 --2- 172.21.15.111:0/4268475717 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f47e413f050 0x7f47e4151c20 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:09.763 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.758+0000 7f47e9b22700 1 --2- 172.21.15.111:0/4268475717 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f47e4069bb0 0x7f47e40ab890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:09.763 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.758+0000 7f47e9b22700 1 --2- 172.21.15.111:0/4268475717 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f47e40a7120 0x7f47e41516e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:09.763 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.758+0000 7f47e9b22700 1 -- 172.21.15.111:0/4268475717 >> 172.21.15.111:0/4268475717 conn(0x7f47e4064000 msgr2=0x7f47e40b5790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:09.763 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.758+0000 7f47e9b22700 1 -- 172.21.15.111:0/4268475717 shutdown_connections 2024-04-25T02:28:09.763 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.758+0000 7f47e9b22700 1 -- 172.21.15.111:0/4268475717 wait complete. 2024-04-25T02:28:09.773 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:28:09.894 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.891+0000 7f0338add700 1 Processor -- start 2024-04-25T02:28:09.894 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.891+0000 7f0338add700 1 -- start start 2024-04-25T02:28:09.896 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.892+0000 7f0338add700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f033413baf0 0x7f03340a45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:09.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.892+0000 7f0338add700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f03340a30f0 0x7f03340b22f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:09.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.892+0000 7f0338add700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f033406dab0 0x7f033406df00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:09.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.892+0000 7f0338add700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03340a3f40 con 0x7f033413baf0 2024-04-25T02:28:09.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.892+0000 7f0338add700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03341388c0 con 0x7f033406dab0 2024-04-25T02:28:09.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.892+0000 7f0338add700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03340a4b10 con 0x7f03340a30f0 2024-04-25T02:28:09.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.892+0000 7f0331d9b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f03340a30f0 0x7f03340b22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:09.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.892+0000 7f033259c700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f033413baf0 0x7f03340a45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:09.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.892+0000 7f0332d9d700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f033406dab0 0x7f033406df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:09.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.892+0000 7f0332d9d700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f033406dab0 0x7f033406df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:48226/0 (socket says 172.21.15.111:48226) 2024-04-25T02:28:09.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.892+0000 7f033259c700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f033413baf0 0x7f03340a45d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:50174/0 (socket says 172.21.15.111:50174) 2024-04-25T02:28:09.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.892+0000 7f0332d9d700 1 -- 172.21.15.111:0/567294206 learned_addr learned my addr 172.21.15.111:0/567294206 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:28:09.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.892+0000 7f0331d9b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f03340a30f0 0x7f03340b22f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:41460/0 (socket says 172.21.15.111:41460) 2024-04-25T02:28:09.897 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.892+0000 7f0332d9d700 1 -- 172.21.15.111:0/567294206 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f03340a30f0 msgr2=0x7f03340b22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:09.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.892+0000 7f0332d9d700 1 --2- 172.21.15.111:0/567294206 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f03340a30f0 0x7f03340b22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:09.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.892+0000 7f0332d9d700 1 -- 172.21.15.111:0/567294206 >> v2:172.21.15.111:3300/0 conn(0x7f033413baf0 msgr2=0x7f03340a45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:09.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.892+0000 7f0332d9d700 1 --2- 172.21.15.111:0/567294206 >> v2:172.21.15.111:3300/0 conn(0x7f033413baf0 0x7f03340a45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:09.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.892+0000 7f0332d9d700 1 -- 172.21.15.111:0/567294206 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f033413b1d0 con 0x7f033406dab0 2024-04-25T02:28:09.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.892+0000 7f0331d9b700 1 --2- 172.21.15.111:0/567294206 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f03340a30f0 0x7f03340b22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:09.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.892+0000 7f033259c700 1 --2- 172.21.15.111:0/567294206 >> v2:172.21.15.111:3300/0 conn(0x7f033413baf0 0x7f03340a45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:09.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.892+0000 7f0332d9d700 1 --2- 172.21.15.111:0/567294206 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f033406dab0 0x7f033406df00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f032c00d1d0 tx=0x7f032c00ba50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f37baa32a9dad5fc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:09.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.892+0000 7f033159a700 1 -- 172.21.15.111:0/567294206 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032c010070 con 0x7f033406dab0 2024-04-25T02:28:09.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.892+0000 7f033159a700 1 -- 172.21.15.111:0/567294206 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f032c00dd50 con 0x7f033406dab0 2024-04-25T02:28:09.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.892+0000 7f033159a700 1 -- 172.21.15.111:0/567294206 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032c00b320 con 0x7f033406dab0 2024-04-25T02:28:09.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.893+0000 7f0338add700 1 -- 172.21.15.111:0/567294206 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f033406dab0 msgr2=0x7f033406df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:09.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.893+0000 7f0338add700 1 --2- 172.21.15.111:0/567294206 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f033406dab0 0x7f033406df00 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f032c00d1d0 tx=0x7f032c00ba50 comp rx=0 tx=0).stop 2024-04-25T02:28:09.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.893+0000 7f0338add700 1 -- 172.21.15.111:0/567294206 shutdown_connections 2024-04-25T02:28:09.898 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.893+0000 7f0338add700 1 --2- 172.21.15.111:0/567294206 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f033406dab0 0x7f033406df00 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:09.899 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.893+0000 7f0338add700 1 --2- 172.21.15.111:0/567294206 >> v2:172.21.15.111:3300/0 conn(0x7f033413baf0 0x7f03340a45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:09.899 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.893+0000 7f0338add700 1 --2- 172.21.15.111:0/567294206 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f03340a30f0 0x7f03340b22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:09.899 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.893+0000 7f0338add700 1 -- 172.21.15.111:0/567294206 >> 172.21.15.111:0/567294206 conn(0x7f033406d200 msgr2=0x7f033406af90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:09.899 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.893+0000 7f0338add700 1 -- 172.21.15.111:0/567294206 shutdown_connections 2024-04-25T02:28:09.899 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.893+0000 7f0338add700 1 -- 172.21.15.111:0/567294206 wait complete. 2024-04-25T02:28:09.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.894+0000 7f0338add700 1 Processor -- start 2024-04-25T02:28:09.901 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.894+0000 7f0338add700 1 -- start start 2024-04-25T02:28:09.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.895+0000 7f0338add700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f033406dab0 0x7f03340a7450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:09.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.895+0000 7f0338add700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f03340a30f0 0x7f03340a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:09.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.895+0000 7f0338add700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f033413baf0 0x7f03340a5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:09.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.895+0000 7f0338add700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03340af6d0 con 0x7f033406dab0 2024-04-25T02:28:09.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.895+0000 7f0338add700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03340a7990 con 0x7f033413baf0 2024-04-25T02:28:09.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.895+0000 7f0338add700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f03340a7bf0 con 0x7f03340a30f0 2024-04-25T02:28:09.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.895+0000 7f033259c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f033406dab0 0x7f03340a7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:09.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.895+0000 7f0332d9d700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f033413baf0 0x7f03340a5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:09.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.895+0000 7f033259c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f033406dab0 0x7f03340a7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:50188/0 (socket says 172.21.15.111:50188) 2024-04-25T02:28:09.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.895+0000 7f033259c700 1 -- 172.21.15.111:0/3228865477 learned_addr learned my addr 172.21.15.111:0/3228865477 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:28:09.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.895+0000 7f0331d9b700 1 --2- 172.21.15.111:0/3228865477 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f03340a30f0 0x7f03340a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:09.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.895+0000 7f033259c700 1 -- 172.21.15.111:0/3228865477 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f03340a30f0 msgr2=0x7f03340a57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:09.902 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.895+0000 7f033259c700 1 --2- 172.21.15.111:0/3228865477 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f03340a30f0 0x7f03340a57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:09.903 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.895+0000 7f033259c700 1 -- 172.21.15.111:0/3228865477 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f033413baf0 msgr2=0x7f03340a5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:09.903 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.895+0000 7f033259c700 1 --2- 172.21.15.111:0/3228865477 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f033413baf0 0x7f03340a5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:09.903 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.895+0000 7f033259c700 1 -- 172.21.15.111:0/3228865477 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0324009420 con 0x7f033406dab0 2024-04-25T02:28:09.903 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.895+0000 7f0332d9d700 1 --2- 172.21.15.111:0/3228865477 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f033413baf0 0x7f03340a5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:09.903 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.895+0000 7f033259c700 1 --2- 172.21.15.111:0/3228865477 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f033406dab0 0x7f03340a7450 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f032800ec80 tx=0x7f03280091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:09.903 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.895+0000 7f03227fc700 1 -- 172.21.15.111:0/3228865477 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032800c920 con 0x7f033406dab0 2024-04-25T02:28:09.903 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.895+0000 7f03227fc700 1 -- 172.21.15.111:0/3228865477 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f032800ca80 con 0x7f033406dab0 2024-04-25T02:28:09.903 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.895+0000 7f03227fc700 1 -- 172.21.15.111:0/3228865477 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032800ce00 con 0x7f033406dab0 2024-04-25T02:28:09.903 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.895+0000 7f0338add700 1 -- 172.21.15.111:0/3228865477 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0328009420 con 0x7f033406dab0 2024-04-25T02:28:09.903 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.895+0000 7f0338add700 1 -- 172.21.15.111:0/3228865477 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f032c00bcf0 con 0x7f033406dab0 2024-04-25T02:28:09.903 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.896+0000 7f0338add700 1 -- 172.21.15.111:0/3228865477 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03340a68d0 con 0x7f033406dab0 2024-04-25T02:28:09.903 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.896+0000 7f03227fc700 1 -- 172.21.15.111:0/3228865477 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f0328013680 con 0x7f033406dab0 2024-04-25T02:28:09.903 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.897+0000 7f03227fc700 1 -- 172.21.15.111:0/3228865477 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4158+0+0 (secure 0 0 0) 0x7f032805b4c0 con 0x7f033406dab0 2024-04-25T02:28:09.904 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:09.900+0000 7f03227fc700 1 -- 172.21.15.111:0/3228865477 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f03280396f0 con 0x7f033406dab0 2024-04-25T02:28:10.063 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.059+0000 7f0338add700 1 -- 172.21.15.111:0/3228865477 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f033406f760 con 0x7f033406dab0 2024-04-25T02:28:10.063 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.059+0000 7f03227fc700 1 -- 172.21.15.111:0/3228865477 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v43) v1 ==== 100+0+11 (secure 0 0 0) 0x7f032803cee0 con 0x7f033406dab0 2024-04-25T02:28:10.063 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 64 2024-04-25T02:28:10.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.061+0000 7f0338add700 1 -- 172.21.15.111:0/3228865477 >> v1:172.21.15.111:6816/46482 conn(0x7f0314045ef0 legacy=0x7f03140483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:10.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.061+0000 7f0338add700 1 -- 172.21.15.111:0/3228865477 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f033406dab0 msgr2=0x7f03340a7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:10.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.061+0000 7f0338add700 1 --2- 172.21.15.111:0/3228865477 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f033406dab0 0x7f03340a7450 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f032800ec80 tx=0x7f03280091a0 comp rx=0 tx=0).stop 2024-04-25T02:28:10.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.061+0000 7f0338add700 1 -- 172.21.15.111:0/3228865477 shutdown_connections 2024-04-25T02:28:10.065 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.061+0000 7f0338add700 1 --2- 172.21.15.111:0/3228865477 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f033413baf0 0x7f03340a5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:10.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.061+0000 7f0338add700 1 --2- 172.21.15.111:0/3228865477 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f033406dab0 0x7f03340a7450 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:10.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.061+0000 7f0338add700 1 --2- 172.21.15.111:0/3228865477 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f03340a30f0 0x7f03340a57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:10.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.061+0000 7f0338add700 1 -- 172.21.15.111:0/3228865477 >> 172.21.15.111:0/3228865477 conn(0x7f033406d200 msgr2=0x7f03340afaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:10.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.061+0000 7f0338add700 1 -- 172.21.15.111:0/3228865477 shutdown_connections 2024-04-25T02:28:10.066 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.061+0000 7f0338add700 1 -- 172.21.15.111:0/3228865477 wait complete. 2024-04-25T02:28:10.077 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T02:28:10.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.190+0000 7f80a759e700 1 Processor -- start 2024-04-25T02:28:10.194 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.190+0000 7f80a759e700 1 -- start start 2024-04-25T02:28:10.196 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.191+0000 7f80a759e700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f80a8068ca0 0x7f80a806df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:10.196 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.191+0000 7f80a759e700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f80a806f310 0x7f80a813b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:10.196 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.191+0000 7f80a759e700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f80a80a22a0 0x7f80a80a2740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:10.196 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.191+0000 7f80a759e700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80a813ac70 con 0x7f80a806f310 2024-04-25T02:28:10.196 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.191+0000 7f80a759e700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80a806ed30 con 0x7f80a8068ca0 2024-04-25T02:28:10.196 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.191+0000 7f80a759e700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80a813ae60 con 0x7f80a80a22a0 2024-04-25T02:28:10.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.191+0000 7f80a659c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f80a8068ca0 0x7f80a806df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:10.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.191+0000 7f80a6d9d700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f80a80a22a0 0x7f80a80a2740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:10.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.191+0000 7f80a6d9d700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f80a80a22a0 0x7f80a80a2740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:41480/0 (socket says 172.21.15.111:41480) 2024-04-25T02:28:10.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.191+0000 7f80a5d9b700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f80a806f310 0x7f80a813b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:10.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.191+0000 7f80a659c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f80a8068ca0 0x7f80a806df60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:48244/0 (socket says 172.21.15.111:48244) 2024-04-25T02:28:10.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.191+0000 7f80a6d9d700 1 -- 172.21.15.111:0/3757639147 learned_addr learned my addr 172.21.15.111:0/3757639147 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:28:10.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.191+0000 7f80a659c700 1 -- 172.21.15.111:0/3757639147 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f80a80a22a0 msgr2=0x7f80a80a2740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:10.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.191+0000 7f80a659c700 1 --2- 172.21.15.111:0/3757639147 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f80a80a22a0 0x7f80a80a2740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:10.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.191+0000 7f80a659c700 1 -- 172.21.15.111:0/3757639147 >> v2:172.21.15.111:3300/0 conn(0x7f80a806f310 msgr2=0x7f80a813b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:10.197 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.191+0000 7f80a659c700 1 --2- 172.21.15.111:0/3757639147 >> v2:172.21.15.111:3300/0 conn(0x7f80a806f310 0x7f80a813b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:10.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.191+0000 7f80a659c700 1 -- 172.21.15.111:0/3757639147 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80a813b100 con 0x7f80a8068ca0 2024-04-25T02:28:10.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.191+0000 7f80a6d9d700 1 --2- 172.21.15.111:0/3757639147 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f80a80a22a0 0x7f80a80a2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:10.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.191+0000 7f80a5d9b700 1 --2- 172.21.15.111:0/3757639147 >> v2:172.21.15.111:3300/0 conn(0x7f80a806f310 0x7f80a813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:10.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.191+0000 7f80a659c700 1 --2- 172.21.15.111:0/3757639147 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f80a8068ca0 0x7f80a806df60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f809c0098e0 tx=0x7f809c0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3b7e34b2c7739511 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:10.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.192+0000 7f80a559a700 1 -- 172.21.15.111:0/3757639147 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809c011630 con 0x7f80a8068ca0 2024-04-25T02:28:10.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.192+0000 7f80a559a700 1 -- 172.21.15.111:0/3757639147 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f809c011790 con 0x7f80a8068ca0 2024-04-25T02:28:10.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.192+0000 7f80a559a700 1 -- 172.21.15.111:0/3757639147 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809c011b30 con 0x7f80a8068ca0 2024-04-25T02:28:10.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.192+0000 7f80a759e700 1 -- 172.21.15.111:0/3757639147 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f80a8068ca0 msgr2=0x7f80a806df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:10.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.192+0000 7f80a759e700 1 --2- 172.21.15.111:0/3757639147 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f80a8068ca0 0x7f80a806df60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f809c0098e0 tx=0x7f809c0091a0 comp rx=0 tx=0).stop 2024-04-25T02:28:10.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.192+0000 7f80a759e700 1 -- 172.21.15.111:0/3757639147 shutdown_connections 2024-04-25T02:28:10.198 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.192+0000 7f80a759e700 1 --2- 172.21.15.111:0/3757639147 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f80a80a22a0 0x7f80a80a2740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:10.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.192+0000 7f80a759e700 1 --2- 172.21.15.111:0/3757639147 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f80a8068ca0 0x7f80a806df60 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:10.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.192+0000 7f80a759e700 1 --2- 172.21.15.111:0/3757639147 >> v2:172.21.15.111:3300/0 conn(0x7f80a806f310 0x7f80a813b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:10.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.192+0000 7f80a759e700 1 -- 172.21.15.111:0/3757639147 >> 172.21.15.111:0/3757639147 conn(0x7f80a806a960 msgr2=0x7f80a806ad60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:10.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.192+0000 7f80a759e700 1 -- 172.21.15.111:0/3757639147 shutdown_connections 2024-04-25T02:28:10.199 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.192+0000 7f80a759e700 1 -- 172.21.15.111:0/3757639147 wait complete. 2024-04-25T02:28:10.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.193+0000 7f80a759e700 1 Processor -- start 2024-04-25T02:28:10.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.193+0000 7f80a759e700 1 -- start start 2024-04-25T02:28:10.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.194+0000 7f80a759e700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f80a8068ca0 0x7f80a8149ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:10.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.194+0000 7f80a759e700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f80a806f310 0x7f80a814a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:10.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.194+0000 7f80a759e700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f80a80a22a0 0x7f80a80aa320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:10.201 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.194+0000 7f80a759e700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80a814a000 con 0x7f80a806f310 2024-04-25T02:28:10.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.194+0000 7f80a759e700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80a80a9b40 con 0x7f80a8068ca0 2024-04-25T02:28:10.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.194+0000 7f80a759e700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f80a814a980 con 0x7f80a80a22a0 2024-04-25T02:28:10.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.194+0000 7f80a5d9b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f80a806f310 0x7f80a814a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:10.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.194+0000 7f80a659c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f80a8068ca0 0x7f80a8149ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:10.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.194+0000 7f80a5d9b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f80a806f310 0x7f80a814a440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:50208/0 (socket says 172.21.15.111:50208) 2024-04-25T02:28:10.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.194+0000 7f80a6d9d700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f80a80a22a0 0x7f80a80aa320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:10.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.194+0000 7f80a659c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f80a8068ca0 0x7f80a8149ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:48252/0 (socket says 172.21.15.111:48252) 2024-04-25T02:28:10.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.194+0000 7f80a5d9b700 1 -- 172.21.15.111:0/59109477 learned_addr learned my addr 172.21.15.111:0/59109477 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:28:10.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.194+0000 7f80a5d9b700 1 -- 172.21.15.111:0/59109477 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f80a80a22a0 msgr2=0x7f80a80aa320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:10.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.194+0000 7f80a5d9b700 1 --2- 172.21.15.111:0/59109477 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f80a80a22a0 0x7f80a80aa320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:10.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.194+0000 7f80a5d9b700 1 -- 172.21.15.111:0/59109477 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f80a8068ca0 msgr2=0x7f80a8149ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:10.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.194+0000 7f80a5d9b700 1 --2- 172.21.15.111:0/59109477 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f80a8068ca0 0x7f80a8149ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:10.202 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.194+0000 7f80a5d9b700 1 -- 172.21.15.111:0/59109477 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8098009420 con 0x7f80a806f310 2024-04-25T02:28:10.203 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.194+0000 7f80a659c700 1 --2- 172.21.15.111:0/59109477 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f80a8068ca0 0x7f80a8149ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:10.203 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.194+0000 7f80a6d9d700 1 --2- 172.21.15.111:0/59109477 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f80a80a22a0 0x7f80a80aa320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:10.203 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.194+0000 7f80a5d9b700 1 --2- 172.21.15.111:0/59109477 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f80a806f310 0x7f80a814a440 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f809800ec50 tx=0x7f80980091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:10.203 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.194+0000 7f80967fc700 1 -- 172.21.15.111:0/59109477 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809800c850 con 0x7f80a806f310 2024-04-25T02:28:10.203 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.194+0000 7f80967fc700 1 -- 172.21.15.111:0/59109477 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f809800c9b0 con 0x7f80a806f310 2024-04-25T02:28:10.203 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.194+0000 7f80967fc700 1 -- 172.21.15.111:0/59109477 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f809800cd50 con 0x7f80a806f310 2024-04-25T02:28:10.203 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.194+0000 7f80a759e700 1 -- 172.21.15.111:0/59109477 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80a000bcf0 con 0x7f80a806f310 2024-04-25T02:28:10.203 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.194+0000 7f80a759e700 1 -- 172.21.15.111:0/59109477 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f809c009420 con 0x7f80a806f310 2024-04-25T02:28:10.203 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.195+0000 7f80a759e700 1 -- 172.21.15.111:0/59109477 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80a8065190 con 0x7f80a806f310 2024-04-25T02:28:10.203 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.195+0000 7f80967fc700 1 -- 172.21.15.111:0/59109477 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f8098013680 con 0x7f80a806f310 2024-04-25T02:28:10.203 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.196+0000 7f80967fc700 1 -- 172.21.15.111:0/59109477 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4158+0+0 (secure 0 0 0) 0x7f809805b360 con 0x7f80a806f310 2024-04-25T02:28:10.204 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.199+0000 7f80967fc700 1 -- 172.21.15.111:0/59109477 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f80980395f0 con 0x7f80a806f310 2024-04-25T02:28:10.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.368+0000 7f80a759e700 1 -- 172.21.15.111:0/59109477 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f80a813a7f0 con 0x7f80a806f310 2024-04-25T02:28:10.372 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.369+0000 7f80967fc700 1 -- 172.21.15.111:0/59109477 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 6 entries v43) v1 ==== 80+0+355 (secure 0 0 0) 0x7f809803cde0 con 0x7f80a806f310 2024-04-25T02:28:10.372 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.186:0/1473940677 2024-04-25T03:25:09.063135+0000 2024-04-25T02:28:10.373 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:6819/4003866251 2024-04-26T02:23:16.839679+0000 2024-04-25T02:28:10.373 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/2148931273 2024-04-26T02:22:54.713254+0000 2024-04-25T02:28:10.373 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:6816/39585 2024-04-26T02:22:54.713254+0000 2024-04-25T02:28:10.373 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/3911588907 2024-04-26T02:22:54.713254+0000 2024-04-25T02:28:10.373 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/1276843622 2024-04-26T02:22:54.713254+0000 2024-04-25T02:28:10.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.370+0000 7f80a759e700 1 -- 172.21.15.111:0/59109477 >> v1:172.21.15.111:6816/46482 conn(0x7f8088045ef0 legacy=0x7f80880483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:10.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.370+0000 7f80a759e700 1 -- 172.21.15.111:0/59109477 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f80a806f310 msgr2=0x7f80a814a440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:10.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.370+0000 7f80a759e700 1 --2- 172.21.15.111:0/59109477 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f80a806f310 0x7f80a814a440 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f809800ec50 tx=0x7f80980091a0 comp rx=0 tx=0).stop 2024-04-25T02:28:10.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.370+0000 7f80a759e700 1 -- 172.21.15.111:0/59109477 shutdown_connections 2024-04-25T02:28:10.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.370+0000 7f80a759e700 1 --2- 172.21.15.111:0/59109477 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f80a80a22a0 0x7f80a80aa320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:10.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.370+0000 7f80a759e700 1 --2- 172.21.15.111:0/59109477 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f80a8068ca0 0x7f80a8149ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:10.374 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.370+0000 7f80a759e700 1 --2- 172.21.15.111:0/59109477 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f80a806f310 0x7f80a814a440 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:10.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.370+0000 7f80a759e700 1 -- 172.21.15.111:0/59109477 >> 172.21.15.111:0/59109477 conn(0x7f80a806a960 msgr2=0x7f80a8068240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:10.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.370+0000 7f80a759e700 1 -- 172.21.15.111:0/59109477 shutdown_connections 2024-04-25T02:28:10.375 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.370+0000 7f80a759e700 1 -- 172.21.15.111:0/59109477 wait complete. 2024-04-25T02:28:10.375 INFO:teuthology.orchestra.run.smithi111.stderr:listed 6 entries 2024-04-25T02:28:10.385 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-25T02:28:10.386 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:28:10.407 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:28:10.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.538+0000 7ff5e7826700 1 Processor -- start 2024-04-25T02:28:10.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.538+0000 7ff5e7826700 1 -- start start 2024-04-25T02:28:10.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.538+0000 7ff5e7826700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff5e00ad900 0x7ff5e006eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:10.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.538+0000 7ff5e7826700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff5e006de30 0x7ff5e0148b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:10.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.538+0000 7ff5e7826700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5e0141ea0 con 0x7ff5e0063d10 2024-04-25T02:28:10.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.538+0000 7ff5e7826700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e0141cc0 con 0x7ff5e00ad900 2024-04-25T02:28:10.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.538+0000 7ff5e7826700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e0068f90 con 0x7ff5e006de30 2024-04-25T02:28:10.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.539+0000 7ff5e5dc3700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff5e006de30 0x7ff5e0148b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:10.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.539+0000 7ff5e55c2700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7ff5e0063d10 0x7ff5e00ad1f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:33306/0 (socket says 172.21.15.111:33306) 2024-04-25T02:28:10.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.539+0000 7ff5e55c2700 1 -- 172.21.15.111:0/99957788 learned_addr learned my addr 172.21.15.111:0/99957788 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:28:10.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.539+0000 7ff5e4dc1700 1 --2- 172.21.15.111:0/99957788 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff5e00ad900 0x7ff5e006eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:10.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.539+0000 7ff5e5dc3700 1 -- 172.21.15.111:0/99957788 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff5e00ad900 msgr2=0x7ff5e006eb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:10.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.539+0000 7ff5e5dc3700 1 --2- 172.21.15.111:0/99957788 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff5e00ad900 0x7ff5e006eb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:10.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.539+0000 7ff5e5dc3700 1 -- 172.21.15.111:0/99957788 >> v1:172.21.15.111:6789/0 conn(0x7ff5e0063d10 legacy=0x7ff5e00ad1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:10.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.539+0000 7ff5d7fff700 1 -- 172.21.15.111:0/99957788 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3283045018 0 0) 0x7ff5e0141ea0 con 0x7ff5e0063d10 2024-04-25T02:28:10.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.539+0000 7ff5e5dc3700 1 -- 172.21.15.111:0/99957788 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e00690d0 con 0x7ff5e006de30 2024-04-25T02:28:10.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.539+0000 7ff5e4dc1700 1 --2- 172.21.15.111:0/99957788 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff5e00ad900 0x7ff5e006eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:10.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.539+0000 7ff5e5dc3700 1 --2- 172.21.15.111:0/99957788 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff5e006de30 0x7ff5e0148b80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff5d8009e90 tx=0x7ff5d8009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5dbefee055a3f527 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:10.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.539+0000 7ff5d7fff700 1 -- 172.21.15.111:0/99957788 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d800e070 con 0x7ff5e006de30 2024-04-25T02:28:10.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.539+0000 7ff5d7fff700 1 -- 172.21.15.111:0/99957788 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d800bc30 con 0x7ff5e006de30 2024-04-25T02:28:10.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.539+0000 7ff5d7fff700 1 -- 172.21.15.111:0/99957788 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d8012430 con 0x7ff5e006de30 2024-04-25T02:28:10.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.540+0000 7ff5e7826700 1 -- 172.21.15.111:0/99957788 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff5e006de30 msgr2=0x7ff5e0148b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:10.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.540+0000 7ff5e7826700 1 --2- 172.21.15.111:0/99957788 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff5e006de30 0x7ff5e0148b80 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff5d8009e90 tx=0x7ff5d8009780 comp rx=0 tx=0).stop 2024-04-25T02:28:10.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.540+0000 7ff5e7826700 1 -- 172.21.15.111:0/99957788 shutdown_connections 2024-04-25T02:28:10.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.540+0000 7ff5e7826700 1 --2- 172.21.15.111:0/99957788 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff5e006de30 0x7ff5e0148b80 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:10.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.540+0000 7ff5e7826700 1 --2- 172.21.15.111:0/99957788 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff5e00ad900 0x7ff5e006eb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:10.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.540+0000 7ff5e7826700 1 -- 172.21.15.111:0/99957788 >> 172.21.15.111:0/99957788 conn(0x7ff5e00b1e10 msgr2=0x7ff5e00ade80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:10.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.540+0000 7ff5e7826700 1 -- 172.21.15.111:0/99957788 shutdown_connections 2024-04-25T02:28:10.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.540+0000 7ff5e7826700 1 -- 172.21.15.111:0/99957788 wait complete. 2024-04-25T02:28:10.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.541+0000 7ff5e7826700 1 Processor -- start 2024-04-25T02:28:10.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.541+0000 7ff5e7826700 1 -- start start 2024-04-25T02:28:10.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.541+0000 7ff5e7826700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff5e0063d10 0x7ff5e0148820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:10.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.541+0000 7ff5e7826700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff5e006de30 0x7ff5e0146b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:10.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.541+0000 7ff5e55c2700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff5e0063d10 0x7ff5e0148820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:10.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.541+0000 7ff5e4dc1700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff5e006de30 0x7ff5e0146b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:10.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.541+0000 7ff5e4dc1700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff5e006de30 0x7ff5e0146b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48398/0 (socket says 172.21.15.111:48398) 2024-04-25T02:28:10.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.542+0000 7ff5e7826700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff5e0147c10 0x7ff5e0151240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:10.548 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.542+0000 7ff5e4dc1700 1 -- 172.21.15.111:0/2669148036 learned_addr learned my addr 172.21.15.111:0/2669148036 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:28:10.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.542+0000 7ff5e7826700 1 -- 172.21.15.111:0/2669148036 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e0145560 con 0x7ff5e006de30 2024-04-25T02:28:10.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.542+0000 7ff5e7826700 1 -- 172.21.15.111:0/2669148036 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e0148360 con 0x7ff5e0063d10 2024-04-25T02:28:10.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.542+0000 7ff5e7826700 1 -- 172.21.15.111:0/2669148036 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e0147430 con 0x7ff5e0147c10 2024-04-25T02:28:10.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.542+0000 7ff5e5dc3700 1 --2- 172.21.15.111:0/2669148036 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff5e0147c10 0x7ff5e0151240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:10.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.542+0000 7ff5e4dc1700 1 -- 172.21.15.111:0/2669148036 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff5e0147c10 msgr2=0x7ff5e0151240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:10.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.542+0000 7ff5e4dc1700 1 --2- 172.21.15.111:0/2669148036 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff5e0147c10 0x7ff5e0151240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:10.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.542+0000 7ff5e4dc1700 1 -- 172.21.15.111:0/2669148036 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff5e0063d10 msgr2=0x7ff5e0148820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:10.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.542+0000 7ff5e4dc1700 1 --2- 172.21.15.111:0/2669148036 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff5e0063d10 0x7ff5e0148820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:10.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.542+0000 7ff5e4dc1700 1 -- 172.21.15.111:0/2669148036 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d0009420 con 0x7ff5e006de30 2024-04-25T02:28:10.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.542+0000 7ff5e4dc1700 1 --2- 172.21.15.111:0/2669148036 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff5e006de30 0x7ff5e0146b80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff5d000ec80 tx=0x7ff5d00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:10.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.542+0000 7ff5d57fa700 1 -- 172.21.15.111:0/2669148036 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d000c850 con 0x7ff5e006de30 2024-04-25T02:28:10.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.542+0000 7ff5d57fa700 1 -- 172.21.15.111:0/2669148036 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d000c9b0 con 0x7ff5e006de30 2024-04-25T02:28:10.549 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.542+0000 7ff5e7826700 1 -- 172.21.15.111:0/2669148036 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5d8009a20 con 0x7ff5e006de30 2024-04-25T02:28:10.550 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.542+0000 7ff5d57fa700 1 -- 172.21.15.111:0/2669148036 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d000cd30 con 0x7ff5e006de30 2024-04-25T02:28:10.550 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.542+0000 7ff5e7826700 1 -- 172.21.15.111:0/2669148036 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5e0148090 con 0x7ff5e006de30 2024-04-25T02:28:10.550 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.543+0000 7ff5e7826700 1 -- 172.21.15.111:0/2669148036 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5e01456a0 con 0x7ff5e006de30 2024-04-25T02:28:10.550 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.543+0000 7ff5d57fa700 1 -- 172.21.15.111:0/2669148036 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7ff5d0013680 con 0x7ff5e006de30 2024-04-25T02:28:10.550 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.543+0000 7ff5d57fa700 1 -- 172.21.15.111:0/2669148036 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4158+0+0 (secure 0 0 0) 0x7ff5d005b6b0 con 0x7ff5e006de30 2024-04-25T02:28:10.550 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.547+0000 7ff5d57fa700 1 -- 172.21.15.111:0/2669148036 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7ff5d00398e0 con 0x7ff5e006de30 2024-04-25T02:28:10.707 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.703+0000 7ff5e7826700 1 -- 172.21.15.111:0/2669148036 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5e0145a70 con 0x7ff5e006de30 2024-04-25T02:28:10.707 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.704+0000 7ff5d57fa700 1 -- 172.21.15.111:0/2669148036 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+12106 (secure 0 0 0) 0x7ff5d0014070 con 0x7ff5e006de30 2024-04-25T02:28:10.708 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:28:10.708 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":43,"fsid":"4643f974-f93a-4436-93b8-460ff320e62e","created":"2024-04-25T02:20:05.450475+0000","modified":"2024-04-25T02:25:10.060341+0000","last_up_change":"2024-04-25T02:23:12.818028+0000","last_in_change":"2024-04-25T02:20:10.439204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:20:07.471248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:20:14.420378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:20:22.251868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T02:20:23.128289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"df3f17ca-3b12-42c8-8cf7-8f1b7189e587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":41,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6800","nonce":48862}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6801","nonce":48862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6803","nonce":48862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6802","nonce":48862}]},"public_addr":"172.21.15.111:6800/48862","cluster_addr":"172.21.15.111:6801/48862","heartbeat_back_addr":"172.21.15.111:6803/48862","heartbeat_front_addr":"172.21.15.111:6802/48862","state":["exists","up"]},{"osd":1,"uuid":"93d54815-f215-4285-bba6-32f2d1cabf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":29,"up_thru":31,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6804","nonce":48960}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6805","nonce":48960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6807","nonce":48960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6806","nonce":48960}]},"public_addr":"172.21.15.111:6804/48960","cluster_addr":"172.21.15.111:6805/48960","heartbeat_back_addr":"172.21.15.111:6807/48960","heartbeat_front_addr":"172.21.15.111:6806/48960","state":["exists","up"]},{"osd":2,"uuid":"b26b2104-2a2e-408f-9ce7-3587a32a2ebe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":41,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6808","nonce":49070}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6809","nonce":49070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6811","nonce":49070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6810","nonce":49070}]},"public_addr":"172.21.15.111:6808/49070","cluster_addr":"172.21.15.111:6809/49070","heartbeat_back_addr":"172.21.15.111:6811/49070","heartbeat_front_addr":"172.21.15.111:6810/49070","state":["exists","up"]},{"osd":3,"uuid":"43c25820-1edc-4031-badf-72e87dd6bf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":31,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6812","nonce":49243}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6813","nonce":49243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6815","nonce":49243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6814","nonce":49243}]},"public_addr":"172.21.15.111:6812/49243","cluster_addr":"172.21.15.111:6813/49243","heartbeat_back_addr":"172.21.15.111:6815/49243","heartbeat_front_addr":"172.21.15.111:6814/49243","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.372427+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.411480+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.361508+0000","dead_epoch":25},{"osd":3,"down_stamp":"2024-04-25T02:23:06.771296+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.377212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.d","mappings":[{"from":3,"to":2}]},{"pgid":"4.13","mappings":[{"from":3,"to":0}]},{"pgid":"4.19","mappings":[{"from":3,"to":0}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.30","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.186:0/1473940677":"2024-04-25T03:25:09.063135+0000","172.21.15.111:6819/4003866251":"2024-04-26T02:23:16.839679+0000","172.21.15.111:0/2148931273":"2024-04-26T02:22:54.713254+0000","172.21.15.111:6816/39585":"2024-04-26T02:22:54.713254+0000","172.21.15.111:0/3911588907":"2024-04-26T02:22:54.713254+0000","172.21.15.111:0/1276843622":"2024-04-26T02:22:54.713254+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:28:10.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.706+0000 7ff5e7826700 1 -- 172.21.15.111:0/2669148036 >> v1:172.21.15.111:6816/46482 conn(0x7ff5c4045ef0 legacy=0x7ff5c40483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:10.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.706+0000 7ff5e7826700 1 -- 172.21.15.111:0/2669148036 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff5e006de30 msgr2=0x7ff5e0146b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:10.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.706+0000 7ff5e7826700 1 --2- 172.21.15.111:0/2669148036 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff5e006de30 0x7ff5e0146b80 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7ff5d000ec80 tx=0x7ff5d00091a0 comp rx=0 tx=0).stop 2024-04-25T02:28:10.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.706+0000 7ff5e7826700 1 -- 172.21.15.111:0/2669148036 shutdown_connections 2024-04-25T02:28:10.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.706+0000 7ff5e7826700 1 --2- 172.21.15.111:0/2669148036 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff5e0147c10 0x7ff5e0151240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:10.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.706+0000 7ff5e7826700 1 --2- 172.21.15.111:0/2669148036 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff5e0063d10 0x7ff5e0148820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:10.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.706+0000 7ff5e7826700 1 --2- 172.21.15.111:0/2669148036 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff5e006de30 0x7ff5e0146b80 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:10.710 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.706+0000 7ff5e7826700 1 -- 172.21.15.111:0/2669148036 >> 172.21.15.111:0/2669148036 conn(0x7ff5e00b1e10 msgr2=0x7ff5e00683e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:10.711 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.706+0000 7ff5e7826700 1 -- 172.21.15.111:0/2669148036 shutdown_connections 2024-04-25T02:28:10.711 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.706+0000 7ff5e7826700 1 -- 172.21.15.111:0/2669148036 wait complete. 2024-04-25T02:28:10.721 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:20:07.471248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T02:20:14.420378+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:20:22.251868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:20:23.128289+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T02:28:10.722 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:28:10.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.838+0000 7f7720e4d700 1 Processor -- start 2024-04-25T02:28:10.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.838+0000 7f7720e4d700 1 -- start start 2024-04-25T02:28:10.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.839+0000 7f7720e4d700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f771c0682a0 0x7f771c13c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:10.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.839+0000 7f7720e4d700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f771c0b0670 0x7f771c13ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:10.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.839+0000 7f7720e4d700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f771c0a3b30 con 0x7f771c0a3f60 2024-04-25T02:28:10.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.839+0000 7f7720e4d700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f771c0a56f0 con 0x7f771c0682a0 2024-04-25T02:28:10.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.839+0000 7f7720e4d700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f771c0a7290 con 0x7f771c0b0670 2024-04-25T02:28:10.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.839+0000 7f7719d9b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f771c0b0670 0x7f771c13ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:10.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.839+0000 7f771a59c700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f771c0682a0 0x7f771c13c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:10.844 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.839+0000 7f771ad9d700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f771c0a3f60 0x7f771c13f710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:33312/0 (socket says 172.21.15.111:33312) 2024-04-25T02:28:10.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.839+0000 7f771ad9d700 1 -- 172.21.15.111:0/1300008791 learned_addr learned my addr 172.21.15.111:0/1300008791 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:28:10.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.839+0000 7f7719d9b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f771c0b0670 0x7f771c13ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:51594/0 (socket says 172.21.15.111:51594) 2024-04-25T02:28:10.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.839+0000 7f771a59c700 1 -- 172.21.15.111:0/1300008791 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f771c0b0670 msgr2=0x7f771c13ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:10.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.839+0000 7f771a59c700 1 --2- 172.21.15.111:0/1300008791 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f771c0b0670 0x7f771c13ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:10.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.839+0000 7f771a59c700 1 -- 172.21.15.111:0/1300008791 >> v1:172.21.15.111:6789/0 conn(0x7f771c0a3f60 legacy=0x7f771c13f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:10.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.839+0000 7f771a59c700 1 -- 172.21.15.111:0/1300008791 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f771c06c700 con 0x7f771c0682a0 2024-04-25T02:28:10.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.839+0000 7f771959a700 1 -- 172.21.15.111:0/1300008791 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 632922663 0 0) 0x7f771c0a3b30 con 0x7f771c0a3f60 2024-04-25T02:28:10.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.839+0000 7f7719d9b700 1 --2- 172.21.15.111:0/1300008791 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f771c0b0670 0x7f771c13ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:10.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.839+0000 7f771a59c700 1 --2- 172.21.15.111:0/1300008791 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f771c0682a0 0x7f771c13c530 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f77100098e0 tx=0x7f77100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74aebebda61fdb35 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:10.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.840+0000 7f771959a700 1 -- 172.21.15.111:0/1300008791 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771000b640 con 0x7f771c0682a0 2024-04-25T02:28:10.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.840+0000 7f771959a700 1 -- 172.21.15.111:0/1300008791 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f771000b7a0 con 0x7f771c0682a0 2024-04-25T02:28:10.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.840+0000 7f771959a700 1 -- 172.21.15.111:0/1300008791 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771000bb40 con 0x7f771c0682a0 2024-04-25T02:28:10.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.840+0000 7f7720e4d700 1 -- 172.21.15.111:0/1300008791 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f771c0682a0 msgr2=0x7f771c13c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:10.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.840+0000 7f7720e4d700 1 --2- 172.21.15.111:0/1300008791 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f771c0682a0 0x7f771c13c530 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f77100098e0 tx=0x7f77100091a0 comp rx=0 tx=0).stop 2024-04-25T02:28:10.845 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.840+0000 7f7720e4d700 1 -- 172.21.15.111:0/1300008791 shutdown_connections 2024-04-25T02:28:10.846 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.840+0000 7f7720e4d700 1 --2- 172.21.15.111:0/1300008791 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f771c0682a0 0x7f771c13c530 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:10.846 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.840+0000 7f7720e4d700 1 --2- 172.21.15.111:0/1300008791 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f771c0b0670 0x7f771c13ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:10.846 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.840+0000 7f7720e4d700 1 -- 172.21.15.111:0/1300008791 >> 172.21.15.111:0/1300008791 conn(0x7f771c06bee0 msgr2=0x7f771c067940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:10.846 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.840+0000 7f7720e4d700 1 -- 172.21.15.111:0/1300008791 shutdown_connections 2024-04-25T02:28:10.846 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.840+0000 7f7720e4d700 1 -- 172.21.15.111:0/1300008791 wait complete. 2024-04-25T02:28:10.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.841+0000 7f7720e4d700 1 Processor -- start 2024-04-25T02:28:10.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.841+0000 7f7720e4d700 1 -- start start 2024-04-25T02:28:10.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.842+0000 7f7720e4d700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f771c0682a0 0x7f771c0ad1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:10.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.842+0000 7f7720e4d700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f771c0a3f60 0x7f771c1513c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:10.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.842+0000 7f7720e4d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f771c0b0670 0x7f771c151900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:10.848 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.842+0000 7f7720e4d700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f771c0adb70 con 0x7f771c0b0670 2024-04-25T02:28:10.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.842+0000 7f7720e4d700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f771c0aedc0 con 0x7f771c0682a0 2024-04-25T02:28:10.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.842+0000 7f7720e4d700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f771c096ca0 con 0x7f771c0a3f60 2024-04-25T02:28:10.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.842+0000 7f771a59c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f771c0682a0 0x7f771c0ad1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:10.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.842+0000 7f771ad9d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f771c0b0670 0x7f771c151900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:10.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.842+0000 7f771a59c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f771c0682a0 0x7f771c0ad1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:53624/0 (socket says 172.21.15.111:53624) 2024-04-25T02:28:10.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.842+0000 7f771a59c700 1 -- 172.21.15.111:0/194762510 learned_addr learned my addr 172.21.15.111:0/194762510 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:28:10.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.842+0000 7f7719d9b700 1 --2- 172.21.15.111:0/194762510 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f771c0a3f60 0x7f771c1513c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:10.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.842+0000 7f771ad9d700 1 -- 172.21.15.111:0/194762510 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f771c0a3f60 msgr2=0x7f771c1513c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:10.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.842+0000 7f771ad9d700 1 --2- 172.21.15.111:0/194762510 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f771c0a3f60 0x7f771c1513c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:10.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.842+0000 7f771ad9d700 1 -- 172.21.15.111:0/194762510 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f771c0682a0 msgr2=0x7f771c0ad1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:10.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.842+0000 7f771ad9d700 1 --2- 172.21.15.111:0/194762510 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f771c0682a0 0x7f771c0ad1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:10.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.842+0000 7f771ad9d700 1 -- 172.21.15.111:0/194762510 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f770c009420 con 0x7f771c0b0670 2024-04-25T02:28:10.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.842+0000 7f771a59c700 1 --2- 172.21.15.111:0/194762510 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f771c0682a0 0x7f771c0ad1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:10.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.842+0000 7f771ad9d700 1 --2- 172.21.15.111:0/194762510 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f771c0b0670 0x7f771c151900 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f771400cbe0 tx=0x7f77140019a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:10.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.842+0000 7f770a7fc700 1 -- 172.21.15.111:0/194762510 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771400a8b0 con 0x7f771c0b0670 2024-04-25T02:28:10.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.842+0000 7f770a7fc700 1 -- 172.21.15.111:0/194762510 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f771400aa30 con 0x7f771c0b0670 2024-04-25T02:28:10.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.842+0000 7f770a7fc700 1 -- 172.21.15.111:0/194762510 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f771400adf0 con 0x7f771c0b0670 2024-04-25T02:28:10.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.842+0000 7f7720e4d700 1 -- 172.21.15.111:0/194762510 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7710009420 con 0x7f771c0b0670 2024-04-25T02:28:10.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.843+0000 7f7720e4d700 1 -- 172.21.15.111:0/194762510 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f771c0aea60 con 0x7f771c0b0670 2024-04-25T02:28:10.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.843+0000 7f7720e4d700 1 -- 172.21.15.111:0/194762510 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f771c0ac340 con 0x7f771c0b0670 2024-04-25T02:28:10.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.843+0000 7f770a7fc700 1 -- 172.21.15.111:0/194762510 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f7714007300 con 0x7f771c0b0670 2024-04-25T02:28:10.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.844+0000 7f770a7fc700 1 -- 172.21.15.111:0/194762510 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4158+0+0 (secure 0 0 0) 0x7f771405b300 con 0x7f771c0b0670 2024-04-25T02:28:10.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:10.847+0000 7f770a7fc700 1 -- 172.21.15.111:0/194762510 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f77140395b0 con 0x7f771c0b0670 2024-04-25T02:28:11.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.003+0000 7f7720e4d700 1 -- 172.21.15.111:0/194762510 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f771c0aef30 con 0x7f771c0b0670 2024-04-25T02:28:11.007 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.004+0000 7f770a7fc700 1 -- 172.21.15.111:0/194762510 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7f771403cda0 con 0x7f771c0b0670 2024-04-25T02:28:11.008 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 1 2024-04-25T02:28:11.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.005+0000 7f7720e4d700 1 -- 172.21.15.111:0/194762510 >> v1:172.21.15.111:6816/46482 conn(0x7f76fc045f20 legacy=0x7f76fc0483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:11.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.005+0000 7f7720e4d700 1 -- 172.21.15.111:0/194762510 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f771c0b0670 msgr2=0x7f771c151900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:11.009 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.005+0000 7f7720e4d700 1 --2- 172.21.15.111:0/194762510 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f771c0b0670 0x7f771c151900 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f771400cbe0 tx=0x7f77140019a0 comp rx=0 tx=0).stop 2024-04-25T02:28:11.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.005+0000 7f7720e4d700 1 -- 172.21.15.111:0/194762510 shutdown_connections 2024-04-25T02:28:11.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.005+0000 7f7720e4d700 1 --2- 172.21.15.111:0/194762510 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f771c0b0670 0x7f771c151900 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:11.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.006+0000 7f7720e4d700 1 --2- 172.21.15.111:0/194762510 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f771c0682a0 0x7f771c0ad1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:11.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.006+0000 7f7720e4d700 1 --2- 172.21.15.111:0/194762510 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f771c0a3f60 0x7f771c1513c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:11.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.006+0000 7f7720e4d700 1 -- 172.21.15.111:0/194762510 >> 172.21.15.111:0/194762510 conn(0x7f771c06bee0 msgr2=0x7f771c067940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:11.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.006+0000 7f7720e4d700 1 -- 172.21.15.111:0/194762510 shutdown_connections 2024-04-25T02:28:11.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.006+0000 7f7720e4d700 1 -- 172.21.15.111:0/194762510 wait complete. 2024-04-25T02:28:11.021 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T02:28:11.141 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.137+0000 7f86f5d35700 1 Processor -- start 2024-04-25T02:28:11.141 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.137+0000 7f86f5d35700 1 -- start start 2024-04-25T02:28:11.143 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.138+0000 7f86f5d35700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f86f0068a50 0x7f86f006f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:11.143 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.138+0000 7f86f5d35700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f86f006dd20 0x7f86f013ec60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:11.143 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.138+0000 7f86f5d35700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86f006e6f0 con 0x7f86f013f1a0 2024-04-25T02:28:11.143 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.138+0000 7f86f5d35700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86f013e570 con 0x7f86f0068a50 2024-04-25T02:28:11.143 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.138+0000 7f86f5d35700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86f006fa00 con 0x7f86f006dd20 2024-04-25T02:28:11.143 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.138+0000 7f86eeffd700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f86f006dd20 0x7f86f013ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:11.143 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.138+0000 7f86ef7fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f86f0068a50 0x7f86f006f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:11.143 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.138+0000 7f86effff700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f86f013f1a0 0x7f86f00a23b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:33322/0 (socket says 172.21.15.111:33322) 2024-04-25T02:28:11.143 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.138+0000 7f86effff700 1 -- 172.21.15.111:0/3349315396 learned_addr learned my addr 172.21.15.111:0/3349315396 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:28:11.143 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.138+0000 7f86ee7fc700 1 -- 172.21.15.111:0/3349315396 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3063061490 0 0) 0x7f86f006e6f0 con 0x7f86f013f1a0 2024-04-25T02:28:11.143 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.138+0000 7f86ef7fe700 1 -- 172.21.15.111:0/3349315396 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f86f006dd20 msgr2=0x7f86f013ec60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:11.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.138+0000 7f86ef7fe700 1 --2- 172.21.15.111:0/3349315396 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f86f006dd20 0x7f86f013ec60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:11.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.138+0000 7f86ef7fe700 1 -- 172.21.15.111:0/3349315396 >> v1:172.21.15.111:6789/0 conn(0x7f86f013f1a0 legacy=0x7f86f00a23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:11.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.138+0000 7f86ef7fe700 1 -- 172.21.15.111:0/3349315396 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f006fb90 con 0x7f86f0068a50 2024-04-25T02:28:11.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.138+0000 7f86eeffd700 1 --2- 172.21.15.111:0/3349315396 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f86f006dd20 0x7f86f013ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:11.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.138+0000 7f86ef7fe700 1 --2- 172.21.15.111:0/3349315396 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f86f0068a50 0x7f86f006f4c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f86e4009910 tx=0x7f86e40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee059cc6acdcab2a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:11.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.138+0000 7f86ee7fc700 1 -- 172.21.15.111:0/3349315396 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e400b680 con 0x7f86f0068a50 2024-04-25T02:28:11.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.138+0000 7f86ee7fc700 1 -- 172.21.15.111:0/3349315396 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e400b7e0 con 0x7f86f0068a50 2024-04-25T02:28:11.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.138+0000 7f86ee7fc700 1 -- 172.21.15.111:0/3349315396 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e400bba0 con 0x7f86f0068a50 2024-04-25T02:28:11.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.139+0000 7f86f5d35700 1 -- 172.21.15.111:0/3349315396 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f86f0068a50 msgr2=0x7f86f006f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:11.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.139+0000 7f86f5d35700 1 --2- 172.21.15.111:0/3349315396 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f86f0068a50 0x7f86f006f4c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f86e4009910 tx=0x7f86e40091a0 comp rx=0 tx=0).stop 2024-04-25T02:28:11.144 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.139+0000 7f86f5d35700 1 -- 172.21.15.111:0/3349315396 shutdown_connections 2024-04-25T02:28:11.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.139+0000 7f86f5d35700 1 --2- 172.21.15.111:0/3349315396 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f86f0068a50 0x7f86f006f4c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:11.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.139+0000 7f86f5d35700 1 --2- 172.21.15.111:0/3349315396 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f86f006dd20 0x7f86f013ec60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:11.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.139+0000 7f86f5d35700 1 -- 172.21.15.111:0/3349315396 >> 172.21.15.111:0/3349315396 conn(0x7f86f006ce40 msgr2=0x7f86f006af80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:11.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.139+0000 7f86f5d35700 1 -- 172.21.15.111:0/3349315396 shutdown_connections 2024-04-25T02:28:11.145 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.139+0000 7f86f5d35700 1 -- 172.21.15.111:0/3349315396 wait complete. 2024-04-25T02:28:11.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.140+0000 7f86f5d35700 1 Processor -- start 2024-04-25T02:28:11.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.140+0000 7f86f5d35700 1 -- start start 2024-04-25T02:28:11.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.141+0000 7f86f5d35700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f86f0068a50 0x7f86f00a92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:11.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.141+0000 7f86f5d35700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f86f006dd20 0x7f86f013ad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:11.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.141+0000 7f86f5d35700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f86f013f1a0 0x7f86f00a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:11.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.141+0000 7f86f5d35700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86f00af6f0 con 0x7f86f006dd20 2024-04-25T02:28:11.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.141+0000 7f86f5d35700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86f00a8ac0 con 0x7f86f013f1a0 2024-04-25T02:28:11.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.141+0000 7f86f5d35700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f86f00a8850 con 0x7f86f0068a50 2024-04-25T02:28:11.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.141+0000 7f86ef7fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f86f0068a50 0x7f86f00a92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:11.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.141+0000 7f86effff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f86f013f1a0 0x7f86f00a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:11.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.141+0000 7f86eeffd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f86f006dd20 0x7f86f013ad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:11.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.141+0000 7f86ef7fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f86f0068a50 0x7f86f00a92c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:51624/0 (socket says 172.21.15.111:51624) 2024-04-25T02:28:11.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.141+0000 7f86ef7fe700 1 -- 172.21.15.111:0/1322220210 learned_addr learned my addr 172.21.15.111:0/1322220210 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:28:11.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.141+0000 7f86ef7fe700 1 -- 172.21.15.111:0/1322220210 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f86f013f1a0 msgr2=0x7f86f00a57c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:11.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.141+0000 7f86ef7fe700 1 --2- 172.21.15.111:0/1322220210 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f86f013f1a0 0x7f86f00a57c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:11.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.141+0000 7f86ef7fe700 1 -- 172.21.15.111:0/1322220210 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f86f006dd20 msgr2=0x7f86f013ad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:11.149 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.141+0000 7f86ef7fe700 1 --2- 172.21.15.111:0/1322220210 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f86f006dd20 0x7f86f013ad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:11.149 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.141+0000 7f86ef7fe700 1 -- 172.21.15.111:0/1322220210 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86e0009420 con 0x7f86f0068a50 2024-04-25T02:28:11.149 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.141+0000 7f86eeffd700 1 --2- 172.21.15.111:0/1322220210 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f86f006dd20 0x7f86f013ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:11.149 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.141+0000 7f86ef7fe700 1 --2- 172.21.15.111:0/1322220210 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f86f0068a50 0x7f86f00a92c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f86f00a3b20 tx=0x7f86e4017000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:11.149 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.141+0000 7f86d77fe700 1 -- 172.21.15.111:0/1322220210 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e400bb60 con 0x7f86f0068a50 2024-04-25T02:28:11.149 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.141+0000 7f86d77fe700 1 -- 172.21.15.111:0/1322220210 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86e4000c90 con 0x7f86f0068a50 2024-04-25T02:28:11.149 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.141+0000 7f86f5d35700 1 -- 172.21.15.111:0/1322220210 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86e4009420 con 0x7f86f0068a50 2024-04-25T02:28:11.149 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.141+0000 7f86d77fe700 1 -- 172.21.15.111:0/1322220210 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86e401a660 con 0x7f86f0068a50 2024-04-25T02:28:11.149 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.141+0000 7f86f5d35700 1 -- 172.21.15.111:0/1322220210 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86f00a75f0 con 0x7f86f0068a50 2024-04-25T02:28:11.149 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.142+0000 7f86d77fe700 1 -- 172.21.15.111:0/1322220210 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f86e401a9d0 con 0x7f86f0068a50 2024-04-25T02:28:11.149 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.142+0000 7f86f5d35700 1 -- 172.21.15.111:0/1322220210 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86f00a9110 con 0x7f86f0068a50 2024-04-25T02:28:11.149 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.143+0000 7f86d77fe700 1 -- 172.21.15.111:0/1322220210 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4158+0+0 (secure 0 0 0) 0x7f86e405cb50 con 0x7f86f0068a50 2024-04-25T02:28:11.150 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.146+0000 7f86d77fe700 1 -- 172.21.15.111:0/1322220210 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f86e4006fe0 con 0x7f86f0068a50 2024-04-25T02:28:11.327 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.324+0000 7f86f5d35700 1 -- 172.21.15.111:0/1322220210 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f86f0065190 con 0x7f86f0068a50 2024-04-25T02:28:11.327 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.324+0000 7f86d77fe700 1 -- 172.21.15.111:0/1322220210 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v43) v1 ==== 92+0+10 (secure 0 0 0) 0x7f86e4015070 con 0x7f86f0068a50 2024-04-25T02:28:11.328 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 8 2024-04-25T02:28:11.329 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.326+0000 7f86f5d35700 1 -- 172.21.15.111:0/1322220210 >> v1:172.21.15.111:6816/46482 conn(0x7f86dc045ef0 legacy=0x7f86dc0483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:11.330 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.326+0000 7f86f5d35700 1 -- 172.21.15.111:0/1322220210 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f86f0068a50 msgr2=0x7f86f00a92c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:11.330 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.326+0000 7f86f5d35700 1 --2- 172.21.15.111:0/1322220210 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f86f0068a50 0x7f86f00a92c0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f86f00a3b20 tx=0x7f86e4017000 comp rx=0 tx=0).stop 2024-04-25T02:28:11.330 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.326+0000 7f86f5d35700 1 -- 172.21.15.111:0/1322220210 shutdown_connections 2024-04-25T02:28:11.330 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.326+0000 7f86f5d35700 1 --2- 172.21.15.111:0/1322220210 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f86f013f1a0 0x7f86f00a57c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:11.330 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.326+0000 7f86f5d35700 1 --2- 172.21.15.111:0/1322220210 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f86f0068a50 0x7f86f00a92c0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:11.330 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.326+0000 7f86f5d35700 1 --2- 172.21.15.111:0/1322220210 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f86f006dd20 0x7f86f013ad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:11.330 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.326+0000 7f86f5d35700 1 -- 172.21.15.111:0/1322220210 >> 172.21.15.111:0/1322220210 conn(0x7f86f006ce40 msgr2=0x7f86f0137a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:11.330 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.326+0000 7f86f5d35700 1 -- 172.21.15.111:0/1322220210 shutdown_connections 2024-04-25T02:28:11.330 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.326+0000 7f86f5d35700 1 -- 172.21.15.111:0/1322220210 wait complete. 2024-04-25T02:28:11.341 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:28:11.459 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.456+0000 7fa080a5d700 1 Processor -- start 2024-04-25T02:28:11.459 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.456+0000 7fa080a5d700 1 -- start start 2024-04-25T02:28:11.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.456+0000 7fa080a5d700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa07c063a40 0x7fa07c0a5b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:11.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.456+0000 7fa080a5d700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa07c0abf80 0x7fa07c132180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:11.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.456+0000 7fa080a5d700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fa07c1326c0 0x7fa07c13f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:11.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.456+0000 7fa080a5d700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa07c0ae6d0 con 0x7fa07c1326c0 2024-04-25T02:28:11.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.456+0000 7fa080a5d700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa07c0ac950 con 0x7fa07c063a40 2024-04-25T02:28:11.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.456+0000 7fa080a5d700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa07c0acbf0 con 0x7fa07c0abf80 2024-04-25T02:28:11.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.457+0000 7fa079d9b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa07c0abf80 0x7fa07c132180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:11.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.457+0000 7fa07a59c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa07c063a40 0x7fa07c0a5b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:11.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.457+0000 7fa07ad9d700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fa07c1326c0 0x7fa07c13f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:11.462 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.457+0000 7fa079d9b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa07c0abf80 0x7fa07c132180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:51634/0 (socket says 172.21.15.111:51634) 2024-04-25T02:28:11.463 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.457+0000 7fa079d9b700 1 -- 172.21.15.111:0/569618682 learned_addr learned my addr 172.21.15.111:0/569618682 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:28:11.463 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.457+0000 7fa07a59c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa07c063a40 0x7fa07c0a5b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:53640/0 (socket says 172.21.15.111:53640) 2024-04-25T02:28:11.463 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.457+0000 7fa079d9b700 1 -- 172.21.15.111:0/569618682 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa07c063a40 msgr2=0x7fa07c0a5b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:11.463 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.457+0000 7fa079d9b700 1 --2- 172.21.15.111:0/569618682 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa07c063a40 0x7fa07c0a5b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:11.463 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.457+0000 7fa079d9b700 1 -- 172.21.15.111:0/569618682 >> v2:172.21.15.111:3300/0 conn(0x7fa07c1326c0 msgr2=0x7fa07c13f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:11.463 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.457+0000 7fa079d9b700 1 --2- 172.21.15.111:0/569618682 >> v2:172.21.15.111:3300/0 conn(0x7fa07c1326c0 0x7fa07c13f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:11.463 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.457+0000 7fa079d9b700 1 -- 172.21.15.111:0/569618682 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa07c0ad990 con 0x7fa07c0abf80 2024-04-25T02:28:11.463 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.457+0000 7fa07ad9d700 1 --2- 172.21.15.111:0/569618682 >> v2:172.21.15.111:3300/0 conn(0x7fa07c1326c0 0x7fa07c13f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:11.463 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.457+0000 7fa07a59c700 1 --2- 172.21.15.111:0/569618682 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa07c063a40 0x7fa07c0a5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:11.463 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.457+0000 7fa079d9b700 1 --2- 172.21.15.111:0/569618682 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa07c0abf80 0x7fa07c132180 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa0700099b0 tx=0x7fa070009250 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d184bf937e6b428a server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:11.463 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.457+0000 7fa07959a700 1 -- 172.21.15.111:0/569618682 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07000b680 con 0x7fa07c0abf80 2024-04-25T02:28:11.463 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.457+0000 7fa07959a700 1 -- 172.21.15.111:0/569618682 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa07000b7e0 con 0x7fa07c0abf80 2024-04-25T02:28:11.464 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.457+0000 7fa07959a700 1 -- 172.21.15.111:0/569618682 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa07000bb80 con 0x7fa07c0abf80 2024-04-25T02:28:11.464 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.458+0000 7fa080a5d700 1 -- 172.21.15.111:0/569618682 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa07c0abf80 msgr2=0x7fa07c132180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:11.464 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.458+0000 7fa080a5d700 1 --2- 172.21.15.111:0/569618682 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa07c0abf80 0x7fa07c132180 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa0700099b0 tx=0x7fa070009250 comp rx=0 tx=0).stop 2024-04-25T02:28:11.464 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.458+0000 7fa080a5d700 1 -- 172.21.15.111:0/569618682 shutdown_connections 2024-04-25T02:28:11.464 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.458+0000 7fa080a5d700 1 --2- 172.21.15.111:0/569618682 >> v2:172.21.15.111:3300/0 conn(0x7fa07c1326c0 0x7fa07c13f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:11.464 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.458+0000 7fa080a5d700 1 --2- 172.21.15.111:0/569618682 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa07c063a40 0x7fa07c0a5b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:11.464 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.458+0000 7fa080a5d700 1 --2- 172.21.15.111:0/569618682 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa07c0abf80 0x7fa07c132180 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:11.464 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.458+0000 7fa080a5d700 1 -- 172.21.15.111:0/569618682 >> 172.21.15.111:0/569618682 conn(0x7fa07c0b1e80 msgr2=0x7fa07c0adef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:11.464 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.458+0000 7fa080a5d700 1 -- 172.21.15.111:0/569618682 shutdown_connections 2024-04-25T02:28:11.464 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.458+0000 7fa080a5d700 1 -- 172.21.15.111:0/569618682 wait complete. 2024-04-25T02:28:11.467 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.459+0000 7fa080a5d700 1 Processor -- start 2024-04-25T02:28:11.467 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.459+0000 7fa080a5d700 1 -- start start 2024-04-25T02:28:11.467 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.459+0000 7fa080a5d700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa07c063a40 0x7fa07c1365b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:11.467 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.459+0000 7fa080a5d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa07c0abf80 0x7fa07c135190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:11.467 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.459+0000 7fa080a5d700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa07c1326c0 0x7fa07c14bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:11.467 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.459+0000 7fa080a5d700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa07c149670 con 0x7fa07c0abf80 2024-04-25T02:28:11.467 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.459+0000 7fa080a5d700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa07c134d00 con 0x7fa07c1326c0 2024-04-25T02:28:11.467 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.459+0000 7fa080a5d700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa07c1360b0 con 0x7fa07c063a40 2024-04-25T02:28:11.467 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.459+0000 7fa07a59c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa07c063a40 0x7fa07c1365b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:11.467 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.459+0000 7fa07a59c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa07c063a40 0x7fa07c1365b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:51650/0 (socket says 172.21.15.111:51650) 2024-04-25T02:28:11.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.459+0000 7fa07a59c700 1 -- 172.21.15.111:0/493297472 learned_addr learned my addr 172.21.15.111:0/493297472 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:28:11.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.459+0000 7fa07ad9d700 1 --2- 172.21.15.111:0/493297472 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa07c1326c0 0x7fa07c14bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:11.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.459+0000 7fa079d9b700 1 --2- 172.21.15.111:0/493297472 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa07c0abf80 0x7fa07c135190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:11.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.460+0000 7fa07a59c700 1 -- 172.21.15.111:0/493297472 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa07c1326c0 msgr2=0x7fa07c14bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:11.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.460+0000 7fa07a59c700 1 --2- 172.21.15.111:0/493297472 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa07c1326c0 0x7fa07c14bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:11.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.460+0000 7fa07a59c700 1 -- 172.21.15.111:0/493297472 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa07c0abf80 msgr2=0x7fa07c135190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:11.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.460+0000 7fa07a59c700 1 --2- 172.21.15.111:0/493297472 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa07c0abf80 0x7fa07c135190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:11.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.460+0000 7fa07a59c700 1 -- 172.21.15.111:0/493297472 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa06c009420 con 0x7fa07c063a40 2024-04-25T02:28:11.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.460+0000 7fa07ad9d700 1 --2- 172.21.15.111:0/493297472 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa07c1326c0 0x7fa07c14bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:11.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.460+0000 7fa07a59c700 1 --2- 172.21.15.111:0/493297472 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa07c063a40 0x7fa07c1365b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa06c00ec80 tx=0x7fa06c0091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:11.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.460+0000 7fa06a7fc700 1 -- 172.21.15.111:0/493297472 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06c00c8f0 con 0x7fa07c063a40 2024-04-25T02:28:11.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.460+0000 7fa06a7fc700 1 -- 172.21.15.111:0/493297472 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa06c00ca50 con 0x7fa07c063a40 2024-04-25T02:28:11.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.460+0000 7fa06a7fc700 1 -- 172.21.15.111:0/493297472 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06c00cdd0 con 0x7fa07c063a40 2024-04-25T02:28:11.468 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.460+0000 7fa080a5d700 1 -- 172.21.15.111:0/493297472 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa074009a20 con 0x7fa07c063a40 2024-04-25T02:28:11.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.460+0000 7fa080a5d700 1 -- 172.21.15.111:0/493297472 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa0700094f0 con 0x7fa07c063a40 2024-04-25T02:28:11.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.461+0000 7fa080a5d700 1 -- 172.21.15.111:0/493297472 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa07c065190 con 0x7fa07c063a40 2024-04-25T02:28:11.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.461+0000 7fa06a7fc700 1 -- 172.21.15.111:0/493297472 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7fa06c013680 con 0x7fa07c063a40 2024-04-25T02:28:11.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.461+0000 7fa06a7fc700 1 -- 172.21.15.111:0/493297472 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4158+0+0 (secure 0 0 0) 0x7fa06c05b3d0 con 0x7fa07c063a40 2024-04-25T02:28:11.469 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.465+0000 7fa06a7fc700 1 -- 172.21.15.111:0/493297472 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fa06c0396c0 con 0x7fa07c063a40 2024-04-25T02:28:11.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.617+0000 7fa080a5d700 1 -- 172.21.15.111:0/493297472 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa07c0aece0 con 0x7fa07c063a40 2024-04-25T02:28:11.621 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.618+0000 7fa06a7fc700 1 -- 172.21.15.111:0/493297472 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v43) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa06c03ceb0 con 0x7fa07c063a40 2024-04-25T02:28:11.621 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 32 2024-04-25T02:28:11.623 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.619+0000 7fa080a5d700 1 -- 172.21.15.111:0/493297472 >> v1:172.21.15.111:6816/46482 conn(0x7fa05c045ef0 legacy=0x7fa05c0483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:11.623 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.619+0000 7fa080a5d700 1 -- 172.21.15.111:0/493297472 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa07c063a40 msgr2=0x7fa07c1365b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:11.623 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.619+0000 7fa080a5d700 1 --2- 172.21.15.111:0/493297472 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa07c063a40 0x7fa07c1365b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fa06c00ec80 tx=0x7fa06c0091a0 comp rx=0 tx=0).stop 2024-04-25T02:28:11.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.620+0000 7fa080a5d700 1 -- 172.21.15.111:0/493297472 shutdown_connections 2024-04-25T02:28:11.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.620+0000 7fa080a5d700 1 --2- 172.21.15.111:0/493297472 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa07c1326c0 0x7fa07c14bde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:11.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.620+0000 7fa080a5d700 1 --2- 172.21.15.111:0/493297472 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa07c063a40 0x7fa07c1365b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:11.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.620+0000 7fa080a5d700 1 --2- 172.21.15.111:0/493297472 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa07c0abf80 0x7fa07c135190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:11.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.620+0000 7fa080a5d700 1 -- 172.21.15.111:0/493297472 >> 172.21.15.111:0/493297472 conn(0x7fa07c0b1e80 msgr2=0x7fa07c13f780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:11.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.620+0000 7fa080a5d700 1 -- 172.21.15.111:0/493297472 shutdown_connections 2024-04-25T02:28:11.624 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.620+0000 7fa080a5d700 1 -- 172.21.15.111:0/493297472 wait complete. 2024-04-25T02:28:11.635 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:28:11.753 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.750+0000 7fc663e25700 1 Processor -- start 2024-04-25T02:28:11.754 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.750+0000 7fc663e25700 1 -- start start 2024-04-25T02:28:11.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.751+0000 7fc663e25700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fc65c063c90 0x7fc65c06f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:11.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.751+0000 7fc663e25700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc65c0aad90 0x7fc65c13eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:11.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.751+0000 7fc663e25700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc65c13f000 0x7fc65c1418c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:11.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.751+0000 7fc663e25700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc65c0aa0d0 con 0x7fc65c063c90 2024-04-25T02:28:11.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.751+0000 7fc663e25700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc65c06f930 con 0x7fc65c0aad90 2024-04-25T02:28:11.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.751+0000 7fc663e25700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc65c06fb90 con 0x7fc65c13f000 2024-04-25T02:28:11.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.751+0000 7fc661bc1700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fc65c063c90 0x7fc65c06f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:11.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.751+0000 7fc6613c0700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc65c0aad90 0x7fc65c13eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:11.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.751+0000 7fc6623c2700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc65c13f000 0x7fc65c1418c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:11.756 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.751+0000 7fc6613c0700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc65c0aad90 0x7fc65c13eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:53660/0 (socket says 172.21.15.111:53660) 2024-04-25T02:28:11.757 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.751+0000 7fc6623c2700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc65c13f000 0x7fc65c1418c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:51666/0 (socket says 172.21.15.111:51666) 2024-04-25T02:28:11.757 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.751+0000 7fc6613c0700 1 -- 172.21.15.111:0/43340337 learned_addr learned my addr 172.21.15.111:0/43340337 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:28:11.757 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.751+0000 7fc661bc1700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fc65c063c90 0x7fc65c06f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48458/0 (socket says 172.21.15.111:48458) 2024-04-25T02:28:11.757 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.751+0000 7fc6613c0700 1 -- 172.21.15.111:0/43340337 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc65c13f000 msgr2=0x7fc65c1418c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:11.757 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.751+0000 7fc6613c0700 1 --2- 172.21.15.111:0/43340337 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc65c13f000 0x7fc65c1418c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:11.757 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.751+0000 7fc6613c0700 1 -- 172.21.15.111:0/43340337 >> v2:172.21.15.111:3300/0 conn(0x7fc65c063c90 msgr2=0x7fc65c06f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:11.757 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.751+0000 7fc6613c0700 1 --2- 172.21.15.111:0/43340337 >> v2:172.21.15.111:3300/0 conn(0x7fc65c063c90 0x7fc65c06f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:11.757 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.751+0000 7fc6613c0700 1 -- 172.21.15.111:0/43340337 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc65c0adc70 con 0x7fc65c0aad90 2024-04-25T02:28:11.757 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.751+0000 7fc661bc1700 1 --2- 172.21.15.111:0/43340337 >> v2:172.21.15.111:3300/0 conn(0x7fc65c063c90 0x7fc65c06f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:11.757 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.751+0000 7fc6613c0700 1 --2- 172.21.15.111:0/43340337 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc65c0aad90 0x7fc65c13eac0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc64c0099e0 tx=0x7fc64c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=42e7f8a08b494b1f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:11.757 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.751+0000 7fc660bbf700 1 -- 172.21.15.111:0/43340337 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64c00b640 con 0x7fc65c0aad90 2024-04-25T02:28:11.757 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.751+0000 7fc660bbf700 1 -- 172.21.15.111:0/43340337 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc64c00b7a0 con 0x7fc65c0aad90 2024-04-25T02:28:11.757 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.751+0000 7fc660bbf700 1 -- 172.21.15.111:0/43340337 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc64c00bb40 con 0x7fc65c0aad90 2024-04-25T02:28:11.758 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.752+0000 7fc663e25700 1 -- 172.21.15.111:0/43340337 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc65c0aad90 msgr2=0x7fc65c13eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:11.758 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.752+0000 7fc663e25700 1 --2- 172.21.15.111:0/43340337 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc65c0aad90 0x7fc65c13eac0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fc64c0099e0 tx=0x7fc64c009250 comp rx=0 tx=0).stop 2024-04-25T02:28:11.758 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.752+0000 7fc663e25700 1 -- 172.21.15.111:0/43340337 shutdown_connections 2024-04-25T02:28:11.758 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.752+0000 7fc663e25700 1 --2- 172.21.15.111:0/43340337 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc65c13f000 0x7fc65c1418c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:11.758 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.752+0000 7fc663e25700 1 --2- 172.21.15.111:0/43340337 >> v2:172.21.15.111:3300/0 conn(0x7fc65c063c90 0x7fc65c06f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:11.758 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.752+0000 7fc663e25700 1 --2- 172.21.15.111:0/43340337 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc65c0aad90 0x7fc65c13eac0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:11.758 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.752+0000 7fc663e25700 1 -- 172.21.15.111:0/43340337 >> 172.21.15.111:0/43340337 conn(0x7fc65c0b1e80 msgr2=0x7fc65c0adef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:11.758 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.752+0000 7fc663e25700 1 -- 172.21.15.111:0/43340337 shutdown_connections 2024-04-25T02:28:11.758 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.752+0000 7fc663e25700 1 -- 172.21.15.111:0/43340337 wait complete. 2024-04-25T02:28:11.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.753+0000 7fc663e25700 1 Processor -- start 2024-04-25T02:28:11.760 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.753+0000 7fc663e25700 1 -- start start 2024-04-25T02:28:11.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.753+0000 7fc663e25700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc65c063c90 0x7fc65c141540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:11.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.753+0000 7fc663e25700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc65c13f000 0x7fc65c13f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:11.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.753+0000 7fc663e25700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc65c0b0940 0x7fc65c13fc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:11.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.753+0000 7fc663e25700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc65c119360 con 0x7fc65c063c90 2024-04-25T02:28:11.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.753+0000 7fc663e25700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc65c11a5c0 con 0x7fc65c0b0940 2024-04-25T02:28:11.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.754+0000 7fc663e25700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fc65c11a880 con 0x7fc65c13f000 2024-04-25T02:28:11.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.754+0000 7fc6613c0700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc65c13f000 0x7fc65c13f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:11.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.754+0000 7fc6623c2700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc65c0b0940 0x7fc65c13fc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:11.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.754+0000 7fc661bc1700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc65c063c90 0x7fc65c141540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:11.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.754+0000 7fc6613c0700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc65c13f000 0x7fc65c13f6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:51682/0 (socket says 172.21.15.111:51682) 2024-04-25T02:28:11.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.754+0000 7fc6613c0700 1 -- 172.21.15.111:0/2476609360 learned_addr learned my addr 172.21.15.111:0/2476609360 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:28:11.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.754+0000 7fc661bc1700 1 -- 172.21.15.111:0/2476609360 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc65c13f000 msgr2=0x7fc65c13f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:11.761 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.754+0000 7fc661bc1700 1 --2- 172.21.15.111:0/2476609360 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc65c13f000 0x7fc65c13f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:11.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.754+0000 7fc661bc1700 1 -- 172.21.15.111:0/2476609360 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc65c0b0940 msgr2=0x7fc65c13fc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:11.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.754+0000 7fc661bc1700 1 --2- 172.21.15.111:0/2476609360 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc65c0b0940 0x7fc65c13fc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:11.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.754+0000 7fc661bc1700 1 -- 172.21.15.111:0/2476609360 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc658009420 con 0x7fc65c063c90 2024-04-25T02:28:11.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.754+0000 7fc6613c0700 1 --2- 172.21.15.111:0/2476609360 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc65c13f000 0x7fc65c13f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:11.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.754+0000 7fc661bc1700 1 --2- 172.21.15.111:0/2476609360 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc65c063c90 0x7fc65c141540 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc65800ec80 tx=0x7fc6580091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:11.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.754+0000 7fc651ffb700 1 -- 172.21.15.111:0/2476609360 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65800c850 con 0x7fc65c063c90 2024-04-25T02:28:11.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.754+0000 7fc651ffb700 1 -- 172.21.15.111:0/2476609360 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc65800c9b0 con 0x7fc65c063c90 2024-04-25T02:28:11.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.754+0000 7fc663e25700 1 -- 172.21.15.111:0/2476609360 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc64c0094f0 con 0x7fc65c063c90 2024-04-25T02:28:11.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.754+0000 7fc651ffb700 1 -- 172.21.15.111:0/2476609360 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65800cd70 con 0x7fc65c063c90 2024-04-25T02:28:11.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.754+0000 7fc663e25700 1 -- 172.21.15.111:0/2476609360 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc65c1196c0 con 0x7fc65c063c90 2024-04-25T02:28:11.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.755+0000 7fc663e25700 1 -- 172.21.15.111:0/2476609360 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc65c140850 con 0x7fc65c063c90 2024-04-25T02:28:11.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.755+0000 7fc651ffb700 1 -- 172.21.15.111:0/2476609360 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7fc658013680 con 0x7fc65c063c90 2024-04-25T02:28:11.762 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.756+0000 7fc651ffb700 1 -- 172.21.15.111:0/2476609360 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4158+0+0 (secure 0 0 0) 0x7fc65805b2b0 con 0x7fc65c063c90 2024-04-25T02:28:11.763 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.759+0000 7fc651ffb700 1 -- 172.21.15.111:0/2476609360 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fc658039540 con 0x7fc65c063c90 2024-04-25T02:28:11.918 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.914+0000 7fc663e25700 1 -- 172.21.15.111:0/2476609360 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc65c065190 con 0x7fc65c063c90 2024-04-25T02:28:11.918 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.914+0000 7fc651ffb700 1 -- 172.21.15.111:0/2476609360 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v43) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc65803cd30 con 0x7fc65c063c90 2024-04-25T02:28:11.918 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 64 2024-04-25T02:28:11.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.916+0000 7fc663e25700 1 -- 172.21.15.111:0/2476609360 >> v1:172.21.15.111:6816/46482 conn(0x7fc640045ef0 legacy=0x7fc6400483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:11.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.916+0000 7fc663e25700 1 -- 172.21.15.111:0/2476609360 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc65c063c90 msgr2=0x7fc65c141540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:11.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.916+0000 7fc663e25700 1 --2- 172.21.15.111:0/2476609360 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc65c063c90 0x7fc65c141540 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fc65800ec80 tx=0x7fc6580091a0 comp rx=0 tx=0).stop 2024-04-25T02:28:11.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.916+0000 7fc663e25700 1 -- 172.21.15.111:0/2476609360 shutdown_connections 2024-04-25T02:28:11.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.916+0000 7fc663e25700 1 --2- 172.21.15.111:0/2476609360 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fc65c0b0940 0x7fc65c13fc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:11.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.916+0000 7fc663e25700 1 --2- 172.21.15.111:0/2476609360 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fc65c063c90 0x7fc65c141540 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:11.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.916+0000 7fc663e25700 1 --2- 172.21.15.111:0/2476609360 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fc65c13f000 0x7fc65c13f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:11.920 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.916+0000 7fc663e25700 1 -- 172.21.15.111:0/2476609360 >> 172.21.15.111:0/2476609360 conn(0x7fc65c0b1e80 msgr2=0x7fc65c064900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:11.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.916+0000 7fc663e25700 1 -- 172.21.15.111:0/2476609360 shutdown_connections 2024-04-25T02:28:11.921 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:11.916+0000 7fc663e25700 1 -- 172.21.15.111:0/2476609360 wait complete. 2024-04-25T02:28:11.931 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T02:28:12.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.045+0000 7f79a8256700 1 Processor -- start 2024-04-25T02:28:12.049 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.045+0000 7f79a8256700 1 -- start start 2024-04-25T02:28:12.051 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.046+0000 7f79a8256700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f79a00b5090 0x7f79a00a7320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:12.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.046+0000 7f79a8256700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f79a013f140 0x7f79a0148e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:12.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.046+0000 7f79a8256700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f79a00a9da0 con 0x7f79a00a8bb0 2024-04-25T02:28:12.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.046+0000 7f79a8256700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79a00a9160 con 0x7f79a013f140 2024-04-25T02:28:12.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.046+0000 7f79a8256700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a00a9420 con 0x7f79a00b5090 2024-04-25T02:28:12.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.046+0000 7f79a5ff2700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f79a00b5090 0x7f79a00a7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:12.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.046+0000 7f79a67f3700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f79a013f140 0x7f79a0148e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:12.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.046+0000 7f79a5ff2700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f79a00b5090 0x7f79a00a7320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:53682/0 (socket says 172.21.15.111:53682) 2024-04-25T02:28:12.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.046+0000 7f79a5ff2700 1 -- 172.21.15.111:0/3795986909 learned_addr learned my addr 172.21.15.111:0/3795986909 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:28:12.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.046+0000 7f79a57f1700 1 --1- 172.21.15.111:0/3795986909 >> v1:172.21.15.111:6789/0 conn(0x7f79a00a8bb0 0x7f79a013ea30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:33338/0 (socket says 172.21.15.111:33338) 2024-04-25T02:28:12.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.046+0000 7f79a67f3700 1 -- 172.21.15.111:0/3795986909 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f79a00b5090 msgr2=0x7f79a00a7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:12.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.046+0000 7f79a67f3700 1 --2- 172.21.15.111:0/3795986909 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f79a00b5090 0x7f79a00a7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:12.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.046+0000 7f79a67f3700 1 -- 172.21.15.111:0/3795986909 >> v1:172.21.15.111:6789/0 conn(0x7f79a00a8bb0 legacy=0x7f79a013ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:12.052 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.046+0000 7f79a67f3700 1 -- 172.21.15.111:0/3795986909 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79a00a6ea0 con 0x7f79a013f140 2024-04-25T02:28:12.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.046+0000 7f79a4ff0700 1 -- 172.21.15.111:0/3795986909 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 817351282 0 0) 0x7f79a00a9da0 con 0x7f79a00a8bb0 2024-04-25T02:28:12.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.046+0000 7f79a5ff2700 1 --2- 172.21.15.111:0/3795986909 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f79a00b5090 0x7f79a00a7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:12.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.047+0000 7f79a67f3700 1 --2- 172.21.15.111:0/3795986909 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79a013f140 0x7f79a0148e20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7998009e60 tx=0x7f7998009780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=312e91830becce9d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:12.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.047+0000 7f79a4ff0700 1 -- 172.21.15.111:0/3795986909 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f799800e070 con 0x7f79a013f140 2024-04-25T02:28:12.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.047+0000 7f79a4ff0700 1 -- 172.21.15.111:0/3795986909 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f799800bbf0 con 0x7f79a013f140 2024-04-25T02:28:12.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.047+0000 7f79a4ff0700 1 -- 172.21.15.111:0/3795986909 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7998012430 con 0x7f79a013f140 2024-04-25T02:28:12.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.047+0000 7f79a8256700 1 -- 172.21.15.111:0/3795986909 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79a013f140 msgr2=0x7f79a0148e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:12.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.047+0000 7f79a8256700 1 --2- 172.21.15.111:0/3795986909 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79a013f140 0x7f79a0148e20 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f7998009e60 tx=0x7f7998009780 comp rx=0 tx=0).stop 2024-04-25T02:28:12.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.047+0000 7f79a8256700 1 -- 172.21.15.111:0/3795986909 shutdown_connections 2024-04-25T02:28:12.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.047+0000 7f79a8256700 1 --2- 172.21.15.111:0/3795986909 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79a013f140 0x7f79a0148e20 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:12.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.047+0000 7f79a8256700 1 --2- 172.21.15.111:0/3795986909 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f79a00b5090 0x7f79a00a7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:12.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.047+0000 7f79a8256700 1 -- 172.21.15.111:0/3795986909 >> 172.21.15.111:0/3795986909 conn(0x7f79a0068970 msgr2=0x7f79a0068d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:12.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.047+0000 7f79a8256700 1 -- 172.21.15.111:0/3795986909 shutdown_connections 2024-04-25T02:28:12.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.047+0000 7f79a8256700 1 -- 172.21.15.111:0/3795986909 wait complete. 2024-04-25T02:28:12.053 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.048+0000 7f79a8256700 1 Processor -- start 2024-04-25T02:28:12.054 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.048+0000 7f79a8256700 1 -- start start 2024-04-25T02:28:12.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.049+0000 7f79a8256700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f79a00a8bb0 0x7f79a0141b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:12.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.049+0000 7f79a8256700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79a00b5090 0x7f79a01385e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:12.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.049+0000 7f79a8256700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f79a013f140 0x7f79a0138b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:12.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.049+0000 7f79a8256700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79a00b1ff0 con 0x7f79a00b5090 2024-04-25T02:28:12.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.049+0000 7f79a8256700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79a00abf70 con 0x7f79a00a8bb0 2024-04-25T02:28:12.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.049+0000 7f79a8256700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f79a0142220 con 0x7f79a013f140 2024-04-25T02:28:12.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.049+0000 7f79a5ff2700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f79a00a8bb0 0x7f79a0141b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:12.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.049+0000 7f79a67f3700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f79a013f140 0x7f79a0138b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:12.056 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.049+0000 7f79a5ff2700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f79a00a8bb0 0x7f79a0141b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:53692/0 (socket says 172.21.15.111:53692) 2024-04-25T02:28:12.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.049+0000 7f79a57f1700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79a00b5090 0x7f79a01385e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:12.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.049+0000 7f79a5ff2700 1 -- 172.21.15.111:0/715945538 learned_addr learned my addr 172.21.15.111:0/715945538 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:28:12.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.049+0000 7f79a67f3700 1 --2- 172.21.15.111:0/715945538 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f79a013f140 0x7f79a0138b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:51692/0 (socket says 172.21.15.111:51692) 2024-04-25T02:28:12.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.049+0000 7f79a67f3700 1 -- 172.21.15.111:0/715945538 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f79a00a8bb0 msgr2=0x7f79a0141b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:12.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.049+0000 7f79a67f3700 1 --2- 172.21.15.111:0/715945538 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f79a00a8bb0 0x7f79a0141b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:12.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.049+0000 7f79a67f3700 1 -- 172.21.15.111:0/715945538 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79a00b5090 msgr2=0x7f79a01385e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:12.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.049+0000 7f79a67f3700 1 --2- 172.21.15.111:0/715945538 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79a00b5090 0x7f79a01385e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:12.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.049+0000 7f79a67f3700 1 -- 172.21.15.111:0/715945538 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79900094f0 con 0x7f79a013f140 2024-04-25T02:28:12.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.049+0000 7f79a57f1700 1 --2- 172.21.15.111:0/715945538 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79a00b5090 0x7f79a01385e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:12.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.049+0000 7f79a67f3700 1 --2- 172.21.15.111:0/715945538 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f79a013f140 0x7f79a0138b20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7998016000 tx=0x7f7998019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:12.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.050+0000 7f7995ffb700 1 -- 172.21.15.111:0/715945538 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7998027470 con 0x7f79a013f140 2024-04-25T02:28:12.057 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.050+0000 7f7995ffb700 1 -- 172.21.15.111:0/715945538 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f79980275f0 con 0x7f79a013f140 2024-04-25T02:28:12.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.050+0000 7f7995ffb700 1 -- 172.21.15.111:0/715945538 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79980279b0 con 0x7f79a013f140 2024-04-25T02:28:12.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.050+0000 7f79a8256700 1 -- 172.21.15.111:0/715945538 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7998009a20 con 0x7f79a013f140 2024-04-25T02:28:12.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.050+0000 7f79a8256700 1 -- 172.21.15.111:0/715945538 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f79a00a4a80 con 0x7f79a013f140 2024-04-25T02:28:12.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.051+0000 7f7995ffb700 1 -- 172.21.15.111:0/715945538 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f7998024070 con 0x7f79a013f140 2024-04-25T02:28:12.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.051+0000 7f79a8256700 1 -- 172.21.15.111:0/715945538 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79a0071790 con 0x7f79a013f140 2024-04-25T02:28:12.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.051+0000 7f7995ffb700 1 -- 172.21.15.111:0/715945538 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4158+0+0 (secure 0 0 0) 0x7f799805db00 con 0x7f79a013f140 2024-04-25T02:28:12.058 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.054+0000 7f7995ffb700 1 -- 172.21.15.111:0/715945538 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f7998006820 con 0x7f79a013f140 2024-04-25T02:28:12.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.228+0000 7f79a8256700 1 -- 172.21.15.111:0/715945538 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f79a00b49c0 con 0x7f79a013f140 2024-04-25T02:28:12.232 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.228+0000 7f7995ffb700 1 -- 172.21.15.111:0/715945538 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 6 entries v43) v1 ==== 80+0+355 (secure 0 0 0) 0x7f7998006820 con 0x7f79a013f140 2024-04-25T02:28:12.232 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.186:0/1473940677 2024-04-25T03:25:09.063135+0000 2024-04-25T02:28:12.232 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:6819/4003866251 2024-04-26T02:23:16.839679+0000 2024-04-25T02:28:12.232 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/2148931273 2024-04-26T02:22:54.713254+0000 2024-04-25T02:28:12.232 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:6816/39585 2024-04-26T02:22:54.713254+0000 2024-04-25T02:28:12.232 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/3911588907 2024-04-26T02:22:54.713254+0000 2024-04-25T02:28:12.232 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/1276843622 2024-04-26T02:22:54.713254+0000 2024-04-25T02:28:12.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.230+0000 7f79a8256700 1 -- 172.21.15.111:0/715945538 >> v1:172.21.15.111:6816/46482 conn(0x7f7984045f20 legacy=0x7f79840483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:12.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.230+0000 7f79a8256700 1 -- 172.21.15.111:0/715945538 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f79a013f140 msgr2=0x7f79a0138b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:12.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.230+0000 7f79a8256700 1 --2- 172.21.15.111:0/715945538 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f79a013f140 0x7f79a0138b20 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f7998016000 tx=0x7f7998019000 comp rx=0 tx=0).stop 2024-04-25T02:28:12.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.230+0000 7f79a8256700 1 -- 172.21.15.111:0/715945538 shutdown_connections 2024-04-25T02:28:12.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.230+0000 7f79a8256700 1 --2- 172.21.15.111:0/715945538 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f79a013f140 0x7f79a0138b20 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:12.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.230+0000 7f79a8256700 1 --2- 172.21.15.111:0/715945538 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f79a00a8bb0 0x7f79a0141b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:12.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.230+0000 7f79a8256700 1 --2- 172.21.15.111:0/715945538 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f79a00b5090 0x7f79a01385e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:12.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.230+0000 7f79a8256700 1 -- 172.21.15.111:0/715945538 >> 172.21.15.111:0/715945538 conn(0x7f79a0068970 msgr2=0x7f79a013e800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:12.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.230+0000 7f79a8256700 1 -- 172.21.15.111:0/715945538 shutdown_connections 2024-04-25T02:28:12.234 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:12.230+0000 7f79a8256700 1 -- 172.21.15.111:0/715945538 wait complete. 2024-04-25T02:28:12.235 INFO:teuthology.orchestra.run.smithi111.stderr:listed 6 entries 2024-04-25T02:28:12.245 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi114.front.sepia.ceph.com... 2024-04-25T02:28:12.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:12.246 DEBUG:teuthology.orchestra.run.smithi114:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-25T02:28:12.288 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi114.stderr:ceph-fuse[39056]: fuse finished with error 0 and tester_r 0 2024-04-25T02:28:12.289 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:28:12.330 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi114.front.sepia.ceph.com 2024-04-25T02:28:12.330 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:12.330 DEBUG:teuthology.orchestra.run.smithi114:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-25T02:28:12.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:12.390 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-04-25T02:28:12.449 INFO:teuthology.orchestra.run.smithi114.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-25T02:28:12.450 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:12.450 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-25T02:28:12.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:12.532 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link delete ceph-brx 2024-04-25T02:28:12.634 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:12.634 DEBUG:teuthology.orchestra.run.smithi186:> ip netns list 2024-04-25T02:28:12.658 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:12.658 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip link delete ceph-brx 2024-04-25T02:28:12.733 INFO:teuthology.orchestra.run.smithi186.stderr:Cannot find device "ceph-brx" 2024-04-25T02:28:12.734 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:28:12.735 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-25T02:28:12.749 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-25T02:28:12.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:12.749 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-04-25T02:28:12.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:12.768 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link delete ceph-brx 2024-04-25T02:28:12.836 INFO:teuthology.orchestra.run.smithi114.stderr:Cannot find device "ceph-brx" 2024-04-25T02:28:12.837 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:28:12.838 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:12.838 DEBUG:teuthology.orchestra.run.smithi186:> ip netns list 2024-04-25T02:28:12.859 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:12.859 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip link delete ceph-brx 2024-04-25T02:28:12.930 INFO:teuthology.orchestra.run.smithi186.stderr:Cannot find device "ceph-brx" 2024-04-25T02:28:12.931 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:28:12.931 DEBUG:teuthology.run_tasks:Unwinding manager install.upgrade 2024-04-25T02:28:12.944 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2024-04-25T02:28:12.997 DEBUG:teuthology.run_tasks:Unwinding manager ceph.stop 2024-04-25T02:28:13.008 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2024-04-25T02:28:13.020 DEBUG:teuthology.run_tasks:Unwinding manager ceph.restart 2024-04-25T02:28:13.033 DEBUG:teuthology.run_tasks:Unwinding manager install.upgrade 2024-04-25T02:28:13.055 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-25T02:28:13.108 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-25T02:28:13.108 DEBUG:teuthology.orchestra.run.smithi114:> set -ex 2024-04-25T02:28:13.109 DEBUG:teuthology.orchestra.run.smithi114:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:28:13.128 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=16251108k,nr_inodes=4062777,mode=755 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 tmpfs /sys/fs/cgroup tmpfs ro,seclabel,nosuid,nodev,noexec,mode=755 0 0 cgroup /sys/fs/cgroup/systemd cgroup rw,seclabel,nosuid,nodev,noexec,relatime,xattr,release_agent=/usr/lib/systemd/systemd-cgroups-agent,name=systemd 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 cgroup /sys/fs/cgroup/freezer cgroup rw,seclabel,nosuid,nodev,noexec,relatime,freezer 0 0 cgroup /sys/fs/cgroup/memory cgroup rw,seclabel,nosuid,nodev,noexec,relatime,memory 0 0 cgroup /sys/fs/cgroup/hugetlb cgroup rw,seclabel,nosuid,nodev,noexec,relatime,hugetlb 0 0 cgroup /sys/fs/cgroup/devices cgroup rw,seclabel,nosuid,nodev,noexec,relatime,devices 0 0 cgroup /sys/fs/cgroup/cpu,cpuacct cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpu,cpuacct 0 0 cgroup /sys/fs/cgroup/pids cgroup rw,seclabel,nosuid,nodev,noexec,relatime,pids 0 0 cgroup /sys/fs/cgroup/rdma cgroup rw,seclabel,nosuid,nodev,noexec,relatime,rdma 0 0 cgroup /sys/fs/cgroup/net_cls,net_prio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,net_cls,net_prio 0 0 cgroup /sys/fs/cgroup/cpuset cgroup rw,seclabel,nosuid,nodev,noexec,relatime,cpuset 0 0 cgroup /sys/fs/cgroup/blkio cgroup rw,seclabel,nosuid,nodev,noexec,relatime,blkio 0 0 cgroup /sys/fs/cgroup/perf_event cgroup rw,seclabel,nosuid,nodev,noexec,relatime,perf_event 0 0 none /sys/kernel/tracing tracefs rw,seclabel,relatime 0 0 configfs /sys/kernel/config configfs rw,relatime 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=39,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=19301 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,relatime 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3253756k,mode=700,uid=1000,gid=1285 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,mode=755 0 0 2024-04-25T02:28:13.128 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T02:28:13.128 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:28:13.150 DEBUG:teuthology.orchestra.run.smithi186:> set -ex 2024-04-25T02:28:13.151 DEBUG:teuthology.orchestra.run.smithi186:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-25T02:28:13.211 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:28:13.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.342+0000 7f9d28906700 1 Processor -- start 2024-04-25T02:28:13.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.342+0000 7f9d28906700 1 -- start start 2024-04-25T02:28:13.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.343+0000 7f9d28906700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9d240ae2c0 0x7f9d240a4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:13.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.343+0000 7f9d28906700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9d24143200 0x7f9d241455e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:13.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.343+0000 7f9d28906700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d2413b920 con 0x7f9d240a6410 2024-04-25T02:28:13.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.343+0000 7f9d28906700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2413a950 con 0x7f9d24143200 2024-04-25T02:28:13.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.343+0000 7f9d28906700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d240a57b0 con 0x7f9d240ae2c0 2024-04-25T02:28:13.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.343+0000 7f9d21d9b700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f9d240a6410 0x7f9d2413b210 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:33344/0 (socket says 172.21.15.111:33344) 2024-04-25T02:28:13.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.343+0000 7f9d22d9d700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9d24143200 0x7f9d241455e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:13.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.343+0000 7f9d21d9b700 1 -- 172.21.15.111:0/1826883807 learned_addr learned my addr 172.21.15.111:0/1826883807 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:28:13.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.343+0000 7f9d2259c700 1 --2- 172.21.15.111:0/1826883807 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9d240ae2c0 0x7f9d240a4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:13.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.343+0000 7f9d2159a700 1 -- 172.21.15.111:0/1826883807 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 468062443 0 0) 0x7f9d18001110 con 0x7f9d240a6410 2024-04-25T02:28:13.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.343+0000 7f9d2159a700 1 -- 172.21.15.111:0/1826883807 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d0c003570 con 0x7f9d240a6410 2024-04-25T02:28:13.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.343+0000 7f9d22d9d700 1 -- 172.21.15.111:0/1826883807 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9d240ae2c0 msgr2=0x7f9d240a4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:13.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.343+0000 7f9d22d9d700 1 --2- 172.21.15.111:0/1826883807 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9d240ae2c0 0x7f9d240a4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:13.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.343+0000 7f9d22d9d700 1 -- 172.21.15.111:0/1826883807 >> v1:172.21.15.111:6789/0 conn(0x7f9d240a6410 legacy=0x7f9d2413b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:13.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.343+0000 7f9d22d9d700 1 -- 172.21.15.111:0/1826883807 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d2413ab40 con 0x7f9d24143200 2024-04-25T02:28:13.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.343+0000 7f9d22d9d700 1 --2- 172.21.15.111:0/1826883807 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9d24143200 0x7f9d241455e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c009ec0 tx=0x7f9d1c009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e765ea5d8a675705 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:13.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.344+0000 7f9d2159a700 1 -- 172.21.15.111:0/1826883807 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c00bb40 con 0x7f9d24143200 2024-04-25T02:28:13.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.344+0000 7f9d2159a700 1 -- 172.21.15.111:0/1826883807 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1c00bca0 con 0x7f9d24143200 2024-04-25T02:28:13.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.344+0000 7f9d2159a700 1 -- 172.21.15.111:0/1826883807 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c011650 con 0x7f9d24143200 2024-04-25T02:28:13.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.344+0000 7f9d28906700 1 -- 172.21.15.111:0/1826883807 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9d24143200 msgr2=0x7f9d241455e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:13.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.344+0000 7f9d28906700 1 --2- 172.21.15.111:0/1826883807 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9d24143200 0x7f9d241455e0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c009ec0 tx=0x7f9d1c009780 comp rx=0 tx=0).stop 2024-04-25T02:28:13.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.344+0000 7f9d28906700 1 -- 172.21.15.111:0/1826883807 shutdown_connections 2024-04-25T02:28:13.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.344+0000 7f9d28906700 1 --2- 172.21.15.111:0/1826883807 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9d240ae2c0 0x7f9d240a4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:13.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.344+0000 7f9d28906700 1 --2- 172.21.15.111:0/1826883807 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9d24143200 0x7f9d241455e0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:13.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.344+0000 7f9d28906700 1 -- 172.21.15.111:0/1826883807 >> 172.21.15.111:0/1826883807 conn(0x7f9d24069bf0 msgr2=0x7f9d24067940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:13.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.344+0000 7f9d28906700 1 -- 172.21.15.111:0/1826883807 shutdown_connections 2024-04-25T02:28:13.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.344+0000 7f9d28906700 1 -- 172.21.15.111:0/1826883807 wait complete. 2024-04-25T02:28:13.352 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.345+0000 7f9d28906700 1 Processor -- start 2024-04-25T02:28:13.352 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.345+0000 7f9d28906700 1 -- start start 2024-04-25T02:28:13.352 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.346+0000 7f9d28906700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9d240a6410 0x7f9d24140640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:13.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.346+0000 7f9d28906700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d240ae2c0 0x7f9d241315f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:13.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.346+0000 7f9d28906700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9d24143200 0x7f9d240a2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:13.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.346+0000 7f9d28906700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d24140140 con 0x7f9d240ae2c0 2024-04-25T02:28:13.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.346+0000 7f9d28906700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d24140c40 con 0x7f9d24143200 2024-04-25T02:28:13.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.346+0000 7f9d28906700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2413fe60 con 0x7f9d240a6410 2024-04-25T02:28:13.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.346+0000 7f9d2259c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9d240a6410 0x7f9d24140640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:13.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.346+0000 7f9d21d9b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d240ae2c0 0x7f9d241315f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:13.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.346+0000 7f9d2259c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9d240a6410 0x7f9d24140640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:51700/0 (socket says 172.21.15.111:51700) 2024-04-25T02:28:13.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.346+0000 7f9d21d9b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d240ae2c0 0x7f9d241315f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48482/0 (socket says 172.21.15.111:48482) 2024-04-25T02:28:13.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.346+0000 7f9d2259c700 1 -- 172.21.15.111:0/2244272192 learned_addr learned my addr 172.21.15.111:0/2244272192 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:28:13.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.346+0000 7f9d22d9d700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9d24143200 0x7f9d240a2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:13.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.346+0000 7f9d2259c700 1 -- 172.21.15.111:0/2244272192 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9d24143200 msgr2=0x7f9d240a2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:13.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.346+0000 7f9d2259c700 1 --2- 172.21.15.111:0/2244272192 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9d24143200 0x7f9d240a2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:13.353 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.346+0000 7f9d2259c700 1 -- 172.21.15.111:0/2244272192 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d240ae2c0 msgr2=0x7f9d241315f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:13.354 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.346+0000 7f9d2259c700 1 --2- 172.21.15.111:0/2244272192 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d240ae2c0 0x7f9d241315f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:13.354 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.346+0000 7f9d2259c700 1 -- 172.21.15.111:0/2244272192 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d1c009a20 con 0x7f9d240a6410 2024-04-25T02:28:13.354 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.346+0000 7f9d21d9b700 1 --2- 172.21.15.111:0/2244272192 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d240ae2c0 0x7f9d241315f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:13.354 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.346+0000 7f9d2259c700 1 --2- 172.21.15.111:0/2244272192 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9d240a6410 0x7f9d24140640 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9d1400ec80 tx=0x7f9d140091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:13.354 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.347+0000 7f9d127fc700 1 -- 172.21.15.111:0/2244272192 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1400c850 con 0x7f9d240a6410 2024-04-25T02:28:13.354 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.347+0000 7f9d127fc700 1 -- 172.21.15.111:0/2244272192 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1400c9b0 con 0x7f9d240a6410 2024-04-25T02:28:13.354 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.347+0000 7f9d127fc700 1 -- 172.21.15.111:0/2244272192 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1400cd50 con 0x7f9d240a6410 2024-04-25T02:28:13.354 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.347+0000 7f9d28906700 1 -- 172.21.15.111:0/2244272192 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d241331c0 con 0x7f9d240a6410 2024-04-25T02:28:13.354 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.347+0000 7f9d28906700 1 -- 172.21.15.111:0/2244272192 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d24142070 con 0x7f9d240a6410 2024-04-25T02:28:13.354 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.348+0000 7f9d28906700 1 -- 172.21.15.111:0/2244272192 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d24141d00 con 0x7f9d240a6410 2024-04-25T02:28:13.354 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.348+0000 7f9d127fc700 1 -- 172.21.15.111:0/2244272192 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f9d14013680 con 0x7f9d240a6410 2024-04-25T02:28:13.354 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.348+0000 7f9d127fc700 1 -- 172.21.15.111:0/2244272192 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4158+0+0 (secure 0 0 0) 0x7f9d1405bad0 con 0x7f9d240a6410 2024-04-25T02:28:13.355 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.352+0000 7f9d127fc700 1 -- 172.21.15.111:0/2244272192 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f9d14039f50 con 0x7f9d240a6410 2024-04-25T02:28:13.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.511+0000 7f9d28906700 1 -- 172.21.15.111:0/2244272192 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9d24065190 con 0x7f9d240a6410 2024-04-25T02:28:13.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.512+0000 7f9d127fc700 1 -- 172.21.15.111:0/2244272192 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+12106 (secure 0 0 0) 0x7f9d14021070 con 0x7f9d240a6410 2024-04-25T02:28:13.516 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:28:13.516 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":43,"fsid":"4643f974-f93a-4436-93b8-460ff320e62e","created":"2024-04-25T02:20:05.450475+0000","modified":"2024-04-25T02:25:10.060341+0000","last_up_change":"2024-04-25T02:23:12.818028+0000","last_in_change":"2024-04-25T02:20:10.439204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:20:07.471248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:20:14.420378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:20:22.251868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T02:20:23.128289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"df3f17ca-3b12-42c8-8cf7-8f1b7189e587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":41,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6800","nonce":48862}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6801","nonce":48862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6803","nonce":48862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6802","nonce":48862}]},"public_addr":"172.21.15.111:6800/48862","cluster_addr":"172.21.15.111:6801/48862","heartbeat_back_addr":"172.21.15.111:6803/48862","heartbeat_front_addr":"172.21.15.111:6802/48862","state":["exists","up"]},{"osd":1,"uuid":"93d54815-f215-4285-bba6-32f2d1cabf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":29,"up_thru":31,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6804","nonce":48960}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6805","nonce":48960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6807","nonce":48960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6806","nonce":48960}]},"public_addr":"172.21.15.111:6804/48960","cluster_addr":"172.21.15.111:6805/48960","heartbeat_back_addr":"172.21.15.111:6807/48960","heartbeat_front_addr":"172.21.15.111:6806/48960","state":["exists","up"]},{"osd":2,"uuid":"b26b2104-2a2e-408f-9ce7-3587a32a2ebe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":41,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6808","nonce":49070}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6809","nonce":49070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6811","nonce":49070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6810","nonce":49070}]},"public_addr":"172.21.15.111:6808/49070","cluster_addr":"172.21.15.111:6809/49070","heartbeat_back_addr":"172.21.15.111:6811/49070","heartbeat_front_addr":"172.21.15.111:6810/49070","state":["exists","up"]},{"osd":3,"uuid":"43c25820-1edc-4031-badf-72e87dd6bf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":31,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6812","nonce":49243}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6813","nonce":49243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6815","nonce":49243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6814","nonce":49243}]},"public_addr":"172.21.15.111:6812/49243","cluster_addr":"172.21.15.111:6813/49243","heartbeat_back_addr":"172.21.15.111:6815/49243","heartbeat_front_addr":"172.21.15.111:6814/49243","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.372427+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.411480+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.361508+0000","dead_epoch":25},{"osd":3,"down_stamp":"2024-04-25T02:23:06.771296+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.377212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.d","mappings":[{"from":3,"to":2}]},{"pgid":"4.13","mappings":[{"from":3,"to":0}]},{"pgid":"4.19","mappings":[{"from":3,"to":0}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.30","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.186:0/1473940677":"2024-04-25T03:25:09.063135+0000","172.21.15.111:6819/4003866251":"2024-04-26T02:23:16.839679+0000","172.21.15.111:0/2148931273":"2024-04-26T02:22:54.713254+0000","172.21.15.111:6816/39585":"2024-04-26T02:22:54.713254+0000","172.21.15.111:0/3911588907":"2024-04-26T02:22:54.713254+0000","172.21.15.111:0/1276843622":"2024-04-26T02:22:54.713254+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:28:13.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.514+0000 7f9d28906700 1 -- 172.21.15.111:0/2244272192 >> v1:172.21.15.111:6816/46482 conn(0x7f9d04045ef0 legacy=0x7f9d040483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:13.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.514+0000 7f9d28906700 1 -- 172.21.15.111:0/2244272192 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9d240a6410 msgr2=0x7f9d24140640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:13.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.514+0000 7f9d28906700 1 --2- 172.21.15.111:0/2244272192 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9d240a6410 0x7f9d24140640 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f9d1400ec80 tx=0x7f9d140091a0 comp rx=0 tx=0).stop 2024-04-25T02:28:13.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.514+0000 7f9d28906700 1 -- 172.21.15.111:0/2244272192 shutdown_connections 2024-04-25T02:28:13.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.514+0000 7f9d28906700 1 --2- 172.21.15.111:0/2244272192 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9d24143200 0x7f9d240a2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:13.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.514+0000 7f9d28906700 1 --2- 172.21.15.111:0/2244272192 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9d240a6410 0x7f9d24140640 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:13.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.514+0000 7f9d28906700 1 --2- 172.21.15.111:0/2244272192 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9d240ae2c0 0x7f9d241315f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:13.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.514+0000 7f9d28906700 1 -- 172.21.15.111:0/2244272192 >> 172.21.15.111:0/2244272192 conn(0x7f9d24069bf0 msgr2=0x7f9d24071320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:13.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.514+0000 7f9d28906700 1 -- 172.21.15.111:0/2244272192 shutdown_connections 2024-04-25T02:28:13.518 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.514+0000 7f9d28906700 1 -- 172.21.15.111:0/2244272192 wait complete. 2024-04-25T02:28:13.529 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-25T02:20:07.471248+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '37', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-25T02:20:14.420378+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '38', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}}, {'pool': 3, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-25T02:20:22.251868+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '39', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 4, 'pool_name': 'cephfs_data', 'create_time': '2024-04-25T02:20:23.128289+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '40', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-25T02:28:13.529 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-25T02:28:13.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.644+0000 7fa564471700 1 Processor -- start 2024-04-25T02:28:13.648 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.644+0000 7fa564471700 1 -- start start 2024-04-25T02:28:13.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.645+0000 7fa564471700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fa55c06f5a0 0x7fa55c13d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:13.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.645+0000 7fa564471700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa55c13de40 0x7fa55c145880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:13.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.645+0000 7fa564471700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa55c06b600 con 0x7fa55c0b2650 2024-04-25T02:28:13.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.645+0000 7fa564471700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa55c13e2e0 con 0x7fa55c06f5a0 2024-04-25T02:28:13.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.645+0000 7fa564471700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c06e4b0 con 0x7fa55c13de40 2024-04-25T02:28:13.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.645+0000 7fa562a0e700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa55c13de40 0x7fa55c145880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:13.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.645+0000 7fa561a0c700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fa55c06f5a0 0x7fa55c13d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:13.650 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.645+0000 7fa562a0e700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa55c13de40 0x7fa55c145880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:53722/0 (socket says 172.21.15.111:53722) 2024-04-25T02:28:13.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.645+0000 7fa56220d700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7fa55c0b2650 0x7fa55c06dcd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:33346/0 (socket says 172.21.15.111:33346) 2024-04-25T02:28:13.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.645+0000 7fa562a0e700 1 -- 172.21.15.111:0/2324244127 learned_addr learned my addr 172.21.15.111:0/2324244127 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:28:13.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.645+0000 7fa562a0e700 1 -- 172.21.15.111:0/2324244127 >> v2:172.21.15.111:3300/0 conn(0x7fa55c06f5a0 msgr2=0x7fa55c13d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:13.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.645+0000 7fa562a0e700 1 --2- 172.21.15.111:0/2324244127 >> v2:172.21.15.111:3300/0 conn(0x7fa55c06f5a0 0x7fa55c13d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:13.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.645+0000 7fa562a0e700 1 -- 172.21.15.111:0/2324244127 >> v1:172.21.15.111:6789/0 conn(0x7fa55c0b2650 legacy=0x7fa55c06dcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:13.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.645+0000 7fa562a0e700 1 -- 172.21.15.111:0/2324244127 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa55c06e750 con 0x7fa55c13de40 2024-04-25T02:28:13.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.645+0000 7fa56120b700 1 -- 172.21.15.111:0/2324244127 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 890500654 0 0) 0x7fa55c06b600 con 0x7fa55c0b2650 2024-04-25T02:28:13.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.645+0000 7fa561a0c700 1 --2- 172.21.15.111:0/2324244127 >> v2:172.21.15.111:3300/0 conn(0x7fa55c06f5a0 0x7fa55c13d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:13.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.646+0000 7fa562a0e700 1 --2- 172.21.15.111:0/2324244127 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa55c13de40 0x7fa55c145880 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa554009f20 tx=0x7fa554009840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ba21bf7692bdc7de server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:13.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.646+0000 7fa56120b700 1 -- 172.21.15.111:0/2324244127 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa55400e070 con 0x7fa55c13de40 2024-04-25T02:28:13.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.646+0000 7fa56120b700 1 -- 172.21.15.111:0/2324244127 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa55400b9d0 con 0x7fa55c13de40 2024-04-25T02:28:13.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.646+0000 7fa56120b700 1 -- 172.21.15.111:0/2324244127 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa5540092e0 con 0x7fa55c13de40 2024-04-25T02:28:13.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.646+0000 7fa564471700 1 -- 172.21.15.111:0/2324244127 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa55c13de40 msgr2=0x7fa55c145880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:13.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.646+0000 7fa564471700 1 --2- 172.21.15.111:0/2324244127 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa55c13de40 0x7fa55c145880 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fa554009f20 tx=0x7fa554009840 comp rx=0 tx=0).stop 2024-04-25T02:28:13.652 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.646+0000 7fa564471700 1 -- 172.21.15.111:0/2324244127 shutdown_connections 2024-04-25T02:28:13.652 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.646+0000 7fa564471700 1 --2- 172.21.15.111:0/2324244127 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa55c13de40 0x7fa55c145880 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:13.652 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.646+0000 7fa564471700 1 --2- 172.21.15.111:0/2324244127 >> v2:172.21.15.111:3300/0 conn(0x7fa55c06f5a0 0x7fa55c13d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:13.652 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.646+0000 7fa564471700 1 -- 172.21.15.111:0/2324244127 >> 172.21.15.111:0/2324244127 conn(0x7fa55c06ad80 msgr2=0x7fa55c0b1cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:13.652 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.646+0000 7fa564471700 1 -- 172.21.15.111:0/2324244127 shutdown_connections 2024-04-25T02:28:13.652 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.646+0000 7fa564471700 1 -- 172.21.15.111:0/2324244127 wait complete. 2024-04-25T02:28:13.654 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.647+0000 7fa564471700 1 Processor -- start 2024-04-25T02:28:13.654 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.647+0000 7fa564471700 1 -- start start 2024-04-25T02:28:13.654 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.648+0000 7fa564471700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa55c06f5a0 0x7fa55c0a8900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:13.655 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.648+0000 7fa564471700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa55c0b2650 0x7fa55c1377a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:13.655 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.648+0000 7fa564471700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa55c13de40 0x7fa55c137ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:13.655 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.648+0000 7fa564471700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c0ab190 con 0x7fa55c0b2650 2024-04-25T02:28:13.655 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.648+0000 7fa564471700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c138550 con 0x7fa55c06f5a0 2024-04-25T02:28:13.655 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.648+0000 7fa564471700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fa55c0a5c60 con 0x7fa55c13de40 2024-04-25T02:28:13.655 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.648+0000 7fa56220d700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa55c06f5a0 0x7fa55c0a8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:13.655 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.648+0000 7fa56220d700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa55c06f5a0 0x7fa55c0a8900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:53724/0 (socket says 172.21.15.111:53724) 2024-04-25T02:28:13.655 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.648+0000 7fa562a0e700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa55c13de40 0x7fa55c137ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:13.655 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.648+0000 7fa56220d700 1 -- 172.21.15.111:0/2474999553 learned_addr learned my addr 172.21.15.111:0/2474999553 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:28:13.655 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.648+0000 7fa561a0c700 1 --2- 172.21.15.111:0/2474999553 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa55c0b2650 0x7fa55c1377a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:13.655 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.648+0000 7fa56220d700 1 -- 172.21.15.111:0/2474999553 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa55c13de40 msgr2=0x7fa55c137ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:13.655 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.648+0000 7fa56220d700 1 --2- 172.21.15.111:0/2474999553 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa55c13de40 0x7fa55c137ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:13.655 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.648+0000 7fa56220d700 1 -- 172.21.15.111:0/2474999553 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa55c0b2650 msgr2=0x7fa55c1377a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:13.656 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.648+0000 7fa56220d700 1 --2- 172.21.15.111:0/2474999553 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa55c0b2650 0x7fa55c1377a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:13.656 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.648+0000 7fa56220d700 1 -- 172.21.15.111:0/2474999553 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa54c00b6d0 con 0x7fa55c06f5a0 2024-04-25T02:28:13.656 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.648+0000 7fa56220d700 1 --2- 172.21.15.111:0/2474999553 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa55c06f5a0 0x7fa55c0a8900 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa55800c810 tx=0x7fa558007d90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:13.656 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.648+0000 7fa5527fc700 1 -- 172.21.15.111:0/2474999553 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa558005b40 con 0x7fa55c06f5a0 2024-04-25T02:28:13.656 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.649+0000 7fa5527fc700 1 -- 172.21.15.111:0/2474999553 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa558005ca0 con 0x7fa55c06f5a0 2024-04-25T02:28:13.656 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.649+0000 7fa5527fc700 1 -- 172.21.15.111:0/2474999553 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa558007320 con 0x7fa55c06f5a0 2024-04-25T02:28:13.656 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.649+0000 7fa564471700 1 -- 172.21.15.111:0/2474999553 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa554009ae0 con 0x7fa55c06f5a0 2024-04-25T02:28:13.656 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.649+0000 7fa564471700 1 -- 172.21.15.111:0/2474999553 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa55c0a7920 con 0x7fa55c06f5a0 2024-04-25T02:28:13.656 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.649+0000 7fa564471700 1 -- 172.21.15.111:0/2474999553 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa55c065190 con 0x7fa55c06f5a0 2024-04-25T02:28:13.656 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.650+0000 7fa5527fc700 1 -- 172.21.15.111:0/2474999553 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7fa55801b3b0 con 0x7fa55c06f5a0 2024-04-25T02:28:13.656 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.650+0000 7fa5527fc700 1 -- 172.21.15.111:0/2474999553 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4158+0+0 (secure 0 0 0) 0x7fa55805a610 con 0x7fa55c06f5a0 2024-04-25T02:28:13.657 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.653+0000 7fa5527fc700 1 -- 172.21.15.111:0/2474999553 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7fa558038840 con 0x7fa55c06f5a0 2024-04-25T02:28:13.811 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.808+0000 7fa564471700 1 -- 172.21.15.111:0/2474999553 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa55c0a3f00 con 0x7fa55c06f5a0 2024-04-25T02:28:13.812 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.808+0000 7fa5527fc700 1 -- 172.21.15.111:0/2474999553 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa558017020 con 0x7fa55c06f5a0 2024-04-25T02:28:13.812 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 1 2024-04-25T02:28:13.813 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.810+0000 7fa564471700 1 -- 172.21.15.111:0/2474999553 >> v1:172.21.15.111:6816/46482 conn(0x7fa540045ef0 legacy=0x7fa5400483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:13.813 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.810+0000 7fa564471700 1 -- 172.21.15.111:0/2474999553 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa55c06f5a0 msgr2=0x7fa55c0a8900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:13.814 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.810+0000 7fa564471700 1 --2- 172.21.15.111:0/2474999553 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa55c06f5a0 0x7fa55c0a8900 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fa55800c810 tx=0x7fa558007d90 comp rx=0 tx=0).stop 2024-04-25T02:28:13.814 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.810+0000 7fa564471700 1 -- 172.21.15.111:0/2474999553 shutdown_connections 2024-04-25T02:28:13.814 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.810+0000 7fa564471700 1 --2- 172.21.15.111:0/2474999553 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fa55c13de40 0x7fa55c137ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:13.814 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.810+0000 7fa564471700 1 --2- 172.21.15.111:0/2474999553 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fa55c06f5a0 0x7fa55c0a8900 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:13.814 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.810+0000 7fa564471700 1 --2- 172.21.15.111:0/2474999553 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fa55c0b2650 0x7fa55c1377a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:13.814 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.810+0000 7fa564471700 1 -- 172.21.15.111:0/2474999553 >> 172.21.15.111:0/2474999553 conn(0x7fa55c06ad80 msgr2=0x7fa55c064900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:13.814 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.810+0000 7fa564471700 1 -- 172.21.15.111:0/2474999553 shutdown_connections 2024-04-25T02:28:13.814 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.810+0000 7fa564471700 1 -- 172.21.15.111:0/2474999553 wait complete. 2024-04-25T02:28:13.825 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get rbd pg_num 2024-04-25T02:28:13.943 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.939+0000 7f07658e2700 1 Processor -- start 2024-04-25T02:28:13.943 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.939+0000 7f07658e2700 1 -- start start 2024-04-25T02:28:13.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.940+0000 7f07658e2700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0760132180 0x7f0760144a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:13.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.940+0000 7f07658e2700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f07601325d0 0x7f0760146f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:13.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.940+0000 7f07658e2700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07600ada70 con 0x7f0760063a40 2024-04-25T02:28:13.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.940+0000 7f07658e2700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07600ac500 con 0x7f07601325d0 2024-04-25T02:28:13.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.940+0000 7f07658e2700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07600abac0 con 0x7f0760132180 2024-04-25T02:28:13.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.940+0000 7f075e7fc700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0760132180 0x7f0760144a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:13.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.940+0000 7f075f7fe700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f07601325d0 0x7f0760146f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:13.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.940+0000 7f075effd700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f0760063a40 0x7f07600abdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:33358/0 (socket says 172.21.15.111:33358) 2024-04-25T02:28:13.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.940+0000 7f075e7fc700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0760132180 0x7f0760144a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:53730/0 (socket says 172.21.15.111:53730) 2024-04-25T02:28:13.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.940+0000 7f075effd700 1 -- 172.21.15.111:0/483928157 learned_addr learned my addr 172.21.15.111:0/483928157 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:28:13.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.940+0000 7f075f7fe700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f07601325d0 0x7f0760146f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48492/0 (socket says 172.21.15.111:48492) 2024-04-25T02:28:13.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.940+0000 7f075e7fc700 1 -- 172.21.15.111:0/483928157 >> v2:172.21.15.111:3300/0 conn(0x7f07601325d0 msgr2=0x7f0760146f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:13.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.940+0000 7f075e7fc700 1 --2- 172.21.15.111:0/483928157 >> v2:172.21.15.111:3300/0 conn(0x7f07601325d0 0x7f0760146f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:13.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.940+0000 7f075e7fc700 1 -- 172.21.15.111:0/483928157 >> v1:172.21.15.111:6789/0 conn(0x7f0760063a40 legacy=0x7f07600abdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:13.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.940+0000 7f075e7fc700 1 -- 172.21.15.111:0/483928157 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07600ae600 con 0x7f0760132180 2024-04-25T02:28:13.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.940+0000 7f075f7fe700 1 --2- 172.21.15.111:0/483928157 >> v2:172.21.15.111:3300/0 conn(0x7f07601325d0 0x7f0760146f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:13.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.940+0000 7f075dffb700 1 -- 172.21.15.111:0/483928157 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1959197494 0 0) 0x7f07600ada70 con 0x7f0760063a40 2024-04-25T02:28:13.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.940+0000 7f075e7fc700 1 --2- 172.21.15.111:0/483928157 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0760132180 0x7f0760144a10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f07500098e0 tx=0x7f07500091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=67cbe82c58c1536e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:13.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.940+0000 7f075dffb700 1 -- 172.21.15.111:0/483928157 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075000b640 con 0x7f0760132180 2024-04-25T02:28:13.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.941+0000 7f075dffb700 1 -- 172.21.15.111:0/483928157 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f075000b7a0 con 0x7f0760132180 2024-04-25T02:28:13.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.941+0000 7f075dffb700 1 -- 172.21.15.111:0/483928157 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075000bb40 con 0x7f0760132180 2024-04-25T02:28:13.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.941+0000 7f07658e2700 1 -- 172.21.15.111:0/483928157 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0760132180 msgr2=0x7f0760144a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:13.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.941+0000 7f07658e2700 1 --2- 172.21.15.111:0/483928157 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0760132180 0x7f0760144a10 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f07500098e0 tx=0x7f07500091a0 comp rx=0 tx=0).stop 2024-04-25T02:28:13.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.941+0000 7f07658e2700 1 -- 172.21.15.111:0/483928157 shutdown_connections 2024-04-25T02:28:13.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.941+0000 7f07658e2700 1 --2- 172.21.15.111:0/483928157 >> v2:172.21.15.111:3300/0 conn(0x7f07601325d0 0x7f0760146f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:13.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.941+0000 7f07658e2700 1 --2- 172.21.15.111:0/483928157 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0760132180 0x7f0760144a10 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:13.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.941+0000 7f07658e2700 1 -- 172.21.15.111:0/483928157 >> 172.21.15.111:0/483928157 conn(0x7f07600b1e80 msgr2=0x7f07600adef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:13.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.941+0000 7f07658e2700 1 -- 172.21.15.111:0/483928157 shutdown_connections 2024-04-25T02:28:13.947 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.941+0000 7f07658e2700 1 -- 172.21.15.111:0/483928157 wait complete. 2024-04-25T02:28:13.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.942+0000 7f07658e2700 1 Processor -- start 2024-04-25T02:28:13.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.942+0000 7f07658e2700 1 -- start start 2024-04-25T02:28:13.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.943+0000 7f07658e2700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0760063a40 0x7f0760137220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:13.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.943+0000 7f07658e2700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0760132180 0x7f0760134b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:13.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.943+0000 7f07658e2700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f07601325d0 0x7f076014be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:13.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.943+0000 7f07658e2700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0760136d20 con 0x7f07601325d0 2024-04-25T02:28:13.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.943+0000 7f07658e2700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0760136ab0 con 0x7f0760132180 2024-04-25T02:28:13.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.943+0000 7f07658e2700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0760135090 con 0x7f0760063a40 2024-04-25T02:28:13.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.943+0000 7f075effd700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0760063a40 0x7f0760137220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:13.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.943+0000 7f075e7fc700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0760132180 0x7f0760134b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:13.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.943+0000 7f075e7fc700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0760132180 0x7f0760134b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:53742/0 (socket says 172.21.15.111:53742) 2024-04-25T02:28:13.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.943+0000 7f075f7fe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f07601325d0 0x7f076014be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:13.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.943+0000 7f075e7fc700 1 -- 172.21.15.111:0/2552897905 learned_addr learned my addr 172.21.15.111:0/2552897905 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:28:13.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.943+0000 7f075effd700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0760063a40 0x7f0760137220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:51710/0 (socket says 172.21.15.111:51710) 2024-04-25T02:28:13.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.943+0000 7f075e7fc700 1 -- 172.21.15.111:0/2552897905 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0760063a40 msgr2=0x7f0760137220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:13.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.943+0000 7f075e7fc700 1 --2- 172.21.15.111:0/2552897905 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0760063a40 0x7f0760137220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:13.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.943+0000 7f075e7fc700 1 -- 172.21.15.111:0/2552897905 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f07601325d0 msgr2=0x7f076014be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:13.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.943+0000 7f075e7fc700 1 --2- 172.21.15.111:0/2552897905 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f07601325d0 0x7f076014be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:13.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.943+0000 7f075e7fc700 1 -- 172.21.15.111:0/2552897905 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0758009a20 con 0x7f0760132180 2024-04-25T02:28:13.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.943+0000 7f075f7fe700 1 --2- 172.21.15.111:0/2552897905 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f07601325d0 0x7f076014be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:13.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.943+0000 7f075effd700 1 --2- 172.21.15.111:0/2552897905 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0760063a40 0x7f0760137220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:13.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.943+0000 7f075e7fc700 1 --2- 172.21.15.111:0/2552897905 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0760132180 0x7f0760134b50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f07600abc00 tx=0x7f0750017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:13.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.943+0000 7f0756ffd700 1 -- 172.21.15.111:0/2552897905 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075000bb20 con 0x7f0760132180 2024-04-25T02:28:13.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.943+0000 7f0756ffd700 1 -- 172.21.15.111:0/2552897905 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0750000c90 con 0x7f0760132180 2024-04-25T02:28:13.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.943+0000 7f0756ffd700 1 -- 172.21.15.111:0/2552897905 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f075001b640 con 0x7f0760132180 2024-04-25T02:28:13.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.943+0000 7f07658e2700 1 -- 172.21.15.111:0/2552897905 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0750009420 con 0x7f0760132180 2024-04-25T02:28:13.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.944+0000 7f07658e2700 1 -- 172.21.15.111:0/2552897905 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0760137840 con 0x7f0760132180 2024-04-25T02:28:13.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.944+0000 7f07658e2700 1 -- 172.21.15.111:0/2552897905 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0760065190 con 0x7f0760132180 2024-04-25T02:28:13.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.944+0000 7f0756ffd700 1 -- 172.21.15.111:0/2552897905 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f075001b9b0 con 0x7f0760132180 2024-04-25T02:28:13.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.945+0000 7f0756ffd700 1 -- 172.21.15.111:0/2552897905 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4158+0+0 (secure 0 0 0) 0x7f075005ba10 con 0x7f0760132180 2024-04-25T02:28:13.952 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:13.948+0000 7f0756ffd700 1 -- 172.21.15.111:0/2552897905 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f075003d570 con 0x7f0760132180 2024-04-25T02:28:14.111 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.107+0000 7f07658e2700 1 -- 172.21.15.111:0/2552897905 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"} v 0) v1 -- 0x7f07600aeca0 con 0x7f0760132180 2024-04-25T02:28:14.111 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.107+0000 7f0756ffd700 1 -- 172.21.15.111:0/2552897905 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "rbd", "var": "pg_num"}]=0 v43) v1 ==== 92+0+10 (secure 0 0 0) 0x7f07500150a0 con 0x7f0760132180 2024-04-25T02:28:14.111 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 8 2024-04-25T02:28:14.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.109+0000 7f07658e2700 1 -- 172.21.15.111:0/2552897905 >> v1:172.21.15.111:6816/46482 conn(0x7f0740045ef0 legacy=0x7f07400483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:14.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.109+0000 7f07658e2700 1 -- 172.21.15.111:0/2552897905 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0760132180 msgr2=0x7f0760134b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:14.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.109+0000 7f07658e2700 1 --2- 172.21.15.111:0/2552897905 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0760132180 0x7f0760134b50 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f07600abc00 tx=0x7f0750017000 comp rx=0 tx=0).stop 2024-04-25T02:28:14.113 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.109+0000 7f07658e2700 1 -- 172.21.15.111:0/2552897905 shutdown_connections 2024-04-25T02:28:14.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.109+0000 7f07658e2700 1 --2- 172.21.15.111:0/2552897905 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f07601325d0 0x7f076014be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:14.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.109+0000 7f07658e2700 1 --2- 172.21.15.111:0/2552897905 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0760063a40 0x7f0760137220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:14.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.109+0000 7f07658e2700 1 --2- 172.21.15.111:0/2552897905 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0760132180 0x7f0760134b50 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:14.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.109+0000 7f07658e2700 1 -- 172.21.15.111:0/2552897905 >> 172.21.15.111:0/2552897905 conn(0x7f07600b1e80 msgr2=0x7f07600b0b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:14.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.109+0000 7f07658e2700 1 -- 172.21.15.111:0/2552897905 shutdown_connections 2024-04-25T02:28:14.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.109+0000 7f07658e2700 1 -- 172.21.15.111:0/2552897905 wait complete. 2024-04-25T02:28:14.124 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-25T02:28:14.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.240+0000 7f47dc943700 1 Processor -- start 2024-04-25T02:28:14.243 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.240+0000 7f47dc943700 1 -- start start 2024-04-25T02:28:14.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.240+0000 7f47dc943700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f47d8068ba0 0x7f47d806f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:14.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.240+0000 7f47dc943700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f47d80a5e70 0x7f47d81469f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:14.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.240+0000 7f47dc943700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47d8067c50 con 0x7f47d806e5b0 2024-04-25T02:28:14.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.240+0000 7f47dc943700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47d806fc60 con 0x7f47d80a5e70 2024-04-25T02:28:14.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.240+0000 7f47dc943700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f47d8067f10 con 0x7f47d8068ba0 2024-04-25T02:28:14.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.241+0000 7f47d5d9b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f47d8068ba0 0x7f47d806f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:14.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.241+0000 7f47d6d9d700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f47d80a5e70 0x7f47d81469f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:14.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.241+0000 7f47d659c700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f47d806e5b0 0x7f47d8068490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:33366/0 (socket says 172.21.15.111:33366) 2024-04-25T02:28:14.248 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.241+0000 7f47d5d9b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f47d8068ba0 0x7f47d806f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:51720/0 (socket says 172.21.15.111:51720) 2024-04-25T02:28:14.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.241+0000 7f47d659c700 1 -- 172.21.15.111:0/1179906759 learned_addr learned my addr 172.21.15.111:0/1179906759 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:28:14.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.241+0000 7f47d559a700 1 -- 172.21.15.111:0/1179906759 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4091757941 0 0) 0x7f47d8067c50 con 0x7f47d806e5b0 2024-04-25T02:28:14.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.241+0000 7f47d6d9d700 1 -- 172.21.15.111:0/1179906759 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f47d8068ba0 msgr2=0x7f47d806f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:14.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.241+0000 7f47d6d9d700 1 --2- 172.21.15.111:0/1179906759 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f47d8068ba0 0x7f47d806f3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:14.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.241+0000 7f47d6d9d700 1 -- 172.21.15.111:0/1179906759 >> v1:172.21.15.111:6789/0 conn(0x7f47d806e5b0 legacy=0x7f47d8068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:14.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.241+0000 7f47d6d9d700 1 -- 172.21.15.111:0/1179906759 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47d8069930 con 0x7f47d80a5e70 2024-04-25T02:28:14.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.241+0000 7f47d5d9b700 1 --2- 172.21.15.111:0/1179906759 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f47d8068ba0 0x7f47d806f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:14.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.241+0000 7f47d6d9d700 1 --2- 172.21.15.111:0/1179906759 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f47d80a5e70 0x7f47d81469f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f47d0009e90 tx=0x7f47d0009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=edf6d3ae17af0086 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:14.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.241+0000 7f47d559a700 1 -- 172.21.15.111:0/1179906759 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d000e070 con 0x7f47d80a5e70 2024-04-25T02:28:14.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.241+0000 7f47d559a700 1 -- 172.21.15.111:0/1179906759 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47d000bc30 con 0x7f47d80a5e70 2024-04-25T02:28:14.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.241+0000 7f47d559a700 1 -- 172.21.15.111:0/1179906759 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47d0012430 con 0x7f47d80a5e70 2024-04-25T02:28:14.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.242+0000 7f47dc943700 1 -- 172.21.15.111:0/1179906759 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f47d80a5e70 msgr2=0x7f47d81469f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:14.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.242+0000 7f47dc943700 1 --2- 172.21.15.111:0/1179906759 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f47d80a5e70 0x7f47d81469f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f47d0009e90 tx=0x7f47d0009780 comp rx=0 tx=0).stop 2024-04-25T02:28:14.249 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.242+0000 7f47dc943700 1 -- 172.21.15.111:0/1179906759 shutdown_connections 2024-04-25T02:28:14.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.242+0000 7f47dc943700 1 --2- 172.21.15.111:0/1179906759 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f47d80a5e70 0x7f47d81469f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:14.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.242+0000 7f47dc943700 1 --2- 172.21.15.111:0/1179906759 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f47d8068ba0 0x7f47d806f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:14.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.242+0000 7f47dc943700 1 -- 172.21.15.111:0/1179906759 >> 172.21.15.111:0/1179906759 conn(0x7f47d806ce40 msgr2=0x7f47d806af80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:14.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.242+0000 7f47dc943700 1 -- 172.21.15.111:0/1179906759 shutdown_connections 2024-04-25T02:28:14.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.242+0000 7f47dc943700 1 -- 172.21.15.111:0/1179906759 wait complete. 2024-04-25T02:28:14.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.243+0000 7f47dc943700 1 Processor -- start 2024-04-25T02:28:14.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.243+0000 7f47dc943700 1 -- start start 2024-04-25T02:28:14.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.243+0000 7f47dc943700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f47d8068ba0 0x7f47d814dc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:14.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.243+0000 7f47dc943700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f47d806e5b0 0x7f47d80a23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:14.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.243+0000 7f47dc943700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f47d80a5e70 0x7f47d80a28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:14.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.243+0000 7f47dc943700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47d80ac930 con 0x7f47d8068ba0 2024-04-25T02:28:14.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.243+0000 7f47dc943700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47d80ac0a0 con 0x7f47d80a5e70 2024-04-25T02:28:14.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.243+0000 7f47dc943700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f47d814e290 con 0x7f47d806e5b0 2024-04-25T02:28:14.250 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.243+0000 7f47d659c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f47d8068ba0 0x7f47d814dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:14.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.243+0000 7f47d6d9d700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f47d80a5e70 0x7f47d80a28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:14.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.243+0000 7f47d659c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f47d8068ba0 0x7f47d814dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48506/0 (socket says 172.21.15.111:48506) 2024-04-25T02:28:14.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.243+0000 7f47d6d9d700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f47d80a5e70 0x7f47d80a28f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:53762/0 (socket says 172.21.15.111:53762) 2024-04-25T02:28:14.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.243+0000 7f47d659c700 1 -- 172.21.15.111:0/1084597724 learned_addr learned my addr 172.21.15.111:0/1084597724 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:28:14.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.243+0000 7f47d5d9b700 1 --2- 172.21.15.111:0/1084597724 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f47d806e5b0 0x7f47d80a23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:14.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.244+0000 7f47d659c700 1 -- 172.21.15.111:0/1084597724 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f47d806e5b0 msgr2=0x7f47d80a23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:14.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.244+0000 7f47d659c700 1 --2- 172.21.15.111:0/1084597724 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f47d806e5b0 0x7f47d80a23b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:14.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.244+0000 7f47d659c700 1 -- 172.21.15.111:0/1084597724 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f47d80a5e70 msgr2=0x7f47d80a28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:14.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.244+0000 7f47d659c700 1 --2- 172.21.15.111:0/1084597724 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f47d80a5e70 0x7f47d80a28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:14.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.244+0000 7f47d659c700 1 -- 172.21.15.111:0/1084597724 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47cc009420 con 0x7f47d8068ba0 2024-04-25T02:28:14.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.244+0000 7f47d5d9b700 1 --2- 172.21.15.111:0/1084597724 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f47d806e5b0 0x7f47d80a23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:14.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.244+0000 7f47d659c700 1 --2- 172.21.15.111:0/1084597724 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f47d8068ba0 0x7f47d814dc00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f47c800c810 tx=0x7f47c8007d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:14.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.244+0000 7f47c67fc700 1 -- 172.21.15.111:0/1084597724 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c8005c00 con 0x7f47d8068ba0 2024-04-25T02:28:14.251 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.244+0000 7f47c67fc700 1 -- 172.21.15.111:0/1084597724 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47c8005d60 con 0x7f47d8068ba0 2024-04-25T02:28:14.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.244+0000 7f47dc943700 1 -- 172.21.15.111:0/1084597724 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47d0009a20 con 0x7f47d8068ba0 2024-04-25T02:28:14.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.244+0000 7f47c67fc700 1 -- 172.21.15.111:0/1084597724 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47c8007320 con 0x7f47d8068ba0 2024-04-25T02:28:14.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.244+0000 7f47dc943700 1 -- 172.21.15.111:0/1084597724 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47d80acdc0 con 0x7f47d8068ba0 2024-04-25T02:28:14.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.245+0000 7f47dc943700 1 -- 172.21.15.111:0/1084597724 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47d80acfe0 con 0x7f47d8068ba0 2024-04-25T02:28:14.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.245+0000 7f47c67fc700 1 -- 172.21.15.111:0/1084597724 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f47c801b3b0 con 0x7f47d8068ba0 2024-04-25T02:28:14.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.245+0000 7f47c67fc700 1 -- 172.21.15.111:0/1084597724 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4158+0+0 (secure 0 0 0) 0x7f47c805a5d0 con 0x7f47d8068ba0 2024-04-25T02:28:14.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.249+0000 7f47c67fc700 1 -- 172.21.15.111:0/1084597724 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f47c8038800 con 0x7f47d8068ba0 2024-04-25T02:28:14.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.401+0000 7f47dc943700 1 -- 172.21.15.111:0/1084597724 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f47d814e5b0 con 0x7f47d8068ba0 2024-04-25T02:28:14.405 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.401+0000 7f47c67fc700 1 -- 172.21.15.111:0/1084597724 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v43) v1 ==== 104+0+11 (secure 0 0 0) 0x7f47c80170a0 con 0x7f47d8068ba0 2024-04-25T02:28:14.405 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 32 2024-04-25T02:28:14.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.403+0000 7f47dc943700 1 -- 172.21.15.111:0/1084597724 >> v1:172.21.15.111:6816/46482 conn(0x7f47b8045ef0 legacy=0x7f47b80483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:14.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.403+0000 7f47dc943700 1 -- 172.21.15.111:0/1084597724 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f47d8068ba0 msgr2=0x7f47d814dc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:14.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.403+0000 7f47dc943700 1 --2- 172.21.15.111:0/1084597724 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f47d8068ba0 0x7f47d814dc00 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f47c800c810 tx=0x7f47c8007d90 comp rx=0 tx=0).stop 2024-04-25T02:28:14.407 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.403+0000 7f47dc943700 1 -- 172.21.15.111:0/1084597724 shutdown_connections 2024-04-25T02:28:14.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.403+0000 7f47dc943700 1 --2- 172.21.15.111:0/1084597724 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f47d80a5e70 0x7f47d80a28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:14.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.403+0000 7f47dc943700 1 --2- 172.21.15.111:0/1084597724 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f47d8068ba0 0x7f47d814dc00 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:14.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.403+0000 7f47dc943700 1 --2- 172.21.15.111:0/1084597724 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f47d806e5b0 0x7f47d80a23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:14.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.403+0000 7f47dc943700 1 -- 172.21.15.111:0/1084597724 >> 172.21.15.111:0/1084597724 conn(0x7f47d806ce40 msgr2=0x7f47d80b0e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:14.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.403+0000 7f47dc943700 1 -- 172.21.15.111:0/1084597724 shutdown_connections 2024-04-25T02:28:14.408 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.403+0000 7f47dc943700 1 -- 172.21.15.111:0/1084597724 wait complete. 2024-04-25T02:28:14.417 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-25T02:28:14.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.533+0000 7f46e705a700 1 Processor -- start 2024-04-25T02:28:14.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.533+0000 7f46e705a700 1 -- start start 2024-04-25T02:28:14.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.533+0000 7f46e705a700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f46e0069b50 0x7f46e00a3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:14.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.533+0000 7f46e705a700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f46e00a7010 0x7f46e00a53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:14.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.533+0000 7f46e705a700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f46e00a3130 con 0x7f46e00a5900 2024-04-25T02:28:14.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.533+0000 7f46e705a700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46e00a3f80 con 0x7f46e0069b50 2024-04-25T02:28:14.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.533+0000 7f46e705a700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f46e00a1d50 con 0x7f46e00a7010 2024-04-25T02:28:14.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.534+0000 7f46e4df6700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f46e0069b50 0x7f46e00a3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:14.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.534+0000 7f46e55f7700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f46e00a5900 0x7f46e013e5a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:33374/0 (socket says 172.21.15.111:33374) 2024-04-25T02:28:14.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.534+0000 7f46e55f7700 1 -- 172.21.15.111:0/1906084429 learned_addr learned my addr 172.21.15.111:0/1906084429 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:28:14.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.534+0000 7f46dffff700 1 --2- 172.21.15.111:0/1906084429 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f46e00a7010 0x7f46e00a53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:14.539 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.534+0000 7f46df7fe700 1 -- 172.21.15.111:0/1906084429 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3565039105 0 0) 0x7f46e00a3130 con 0x7f46e00a5900 2024-04-25T02:28:14.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.534+0000 7f46e4df6700 1 -- 172.21.15.111:0/1906084429 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f46e00a7010 msgr2=0x7f46e00a53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:14.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.534+0000 7f46e4df6700 1 --2- 172.21.15.111:0/1906084429 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f46e00a7010 0x7f46e00a53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:14.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.534+0000 7f46e4df6700 1 -- 172.21.15.111:0/1906084429 >> v1:172.21.15.111:6789/0 conn(0x7f46e00a5900 legacy=0x7f46e013e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:14.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.534+0000 7f46e4df6700 1 -- 172.21.15.111:0/1906084429 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e00a2ba0 con 0x7f46e0069b50 2024-04-25T02:28:14.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.534+0000 7f46dffff700 1 --2- 172.21.15.111:0/1906084429 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f46e00a7010 0x7f46e00a53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:14.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.534+0000 7f46e4df6700 1 --2- 172.21.15.111:0/1906084429 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f46e0069b50 0x7f46e00a3910 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f46d4009910 tx=0x7f46d40091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9c66ea605fb18d5e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:14.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.534+0000 7f46df7fe700 1 -- 172.21.15.111:0/1906084429 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d400b680 con 0x7f46e0069b50 2024-04-25T02:28:14.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.534+0000 7f46df7fe700 1 -- 172.21.15.111:0/1906084429 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d400b7e0 con 0x7f46e0069b50 2024-04-25T02:28:14.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.534+0000 7f46df7fe700 1 -- 172.21.15.111:0/1906084429 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d400bba0 con 0x7f46e0069b50 2024-04-25T02:28:14.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.535+0000 7f46e705a700 1 -- 172.21.15.111:0/1906084429 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f46e0069b50 msgr2=0x7f46e00a3910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:14.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.535+0000 7f46e705a700 1 --2- 172.21.15.111:0/1906084429 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f46e0069b50 0x7f46e00a3910 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f46d4009910 tx=0x7f46d40091a0 comp rx=0 tx=0).stop 2024-04-25T02:28:14.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.535+0000 7f46e705a700 1 -- 172.21.15.111:0/1906084429 shutdown_connections 2024-04-25T02:28:14.540 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.535+0000 7f46e705a700 1 --2- 172.21.15.111:0/1906084429 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f46e0069b50 0x7f46e00a3910 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:14.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.535+0000 7f46e705a700 1 --2- 172.21.15.111:0/1906084429 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f46e00a7010 0x7f46e00a53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:14.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.535+0000 7f46e705a700 1 -- 172.21.15.111:0/1906084429 >> 172.21.15.111:0/1906084429 conn(0x7f46e006faf0 msgr2=0x7f46e00b4e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:14.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.535+0000 7f46e705a700 1 -- 172.21.15.111:0/1906084429 shutdown_connections 2024-04-25T02:28:14.541 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.535+0000 7f46e705a700 1 -- 172.21.15.111:0/1906084429 wait complete. 2024-04-25T02:28:14.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.536+0000 7f46e705a700 1 Processor -- start 2024-04-25T02:28:14.543 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.536+0000 7f46e705a700 1 -- start start 2024-04-25T02:28:14.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.537+0000 7f46e705a700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f46e0069b50 0x7f46e0151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:14.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.537+0000 7f46e705a700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f46e00a5900 0x7f46e009e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:14.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.537+0000 7f46e705a700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f46e00a7010 0x7f46e014b1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:14.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.537+0000 7f46e705a700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e009ab30 con 0x7f46e00a7010 2024-04-25T02:28:14.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.537+0000 7f46e705a700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46e0151820 con 0x7f46e0069b50 2024-04-25T02:28:14.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.537+0000 7f46e705a700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f46e0151ae0 con 0x7f46e00a5900 2024-04-25T02:28:14.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.537+0000 7f46dffff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f46e00a5900 0x7f46e009e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:14.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.537+0000 7f46e55f7700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f46e00a7010 0x7f46e014b1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:14.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.537+0000 7f46dffff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f46e00a5900 0x7f46e009e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:51750/0 (socket says 172.21.15.111:51750) 2024-04-25T02:28:14.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.537+0000 7f46dffff700 1 -- 172.21.15.111:0/3423669390 learned_addr learned my addr 172.21.15.111:0/3423669390 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:28:14.544 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.537+0000 7f46e4df6700 1 --2- 172.21.15.111:0/3423669390 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f46e0069b50 0x7f46e0151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:14.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.537+0000 7f46e55f7700 1 -- 172.21.15.111:0/3423669390 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f46e00a5900 msgr2=0x7f46e009e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:14.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.537+0000 7f46e55f7700 1 --2- 172.21.15.111:0/3423669390 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f46e00a5900 0x7f46e009e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:14.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.537+0000 7f46e55f7700 1 -- 172.21.15.111:0/3423669390 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f46e0069b50 msgr2=0x7f46e0151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:14.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.537+0000 7f46e55f7700 1 --2- 172.21.15.111:0/3423669390 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f46e0069b50 0x7f46e0151200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:14.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.537+0000 7f46e55f7700 1 -- 172.21.15.111:0/3423669390 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46cc009420 con 0x7f46e00a7010 2024-04-25T02:28:14.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.537+0000 7f46dffff700 1 --2- 172.21.15.111:0/3423669390 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f46e00a5900 0x7f46e009e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:14.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.537+0000 7f46e4df6700 1 --2- 172.21.15.111:0/3423669390 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f46e0069b50 0x7f46e0151200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:14.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.538+0000 7f46e55f7700 1 --2- 172.21.15.111:0/3423669390 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f46e00a7010 0x7f46e014b1f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f46d800cbe0 tx=0x7f46d80019a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:14.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.538+0000 7f46dcff9700 1 -- 172.21.15.111:0/3423669390 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d800a8b0 con 0x7f46e00a7010 2024-04-25T02:28:14.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.538+0000 7f46dcff9700 1 -- 172.21.15.111:0/3423669390 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d800aa30 con 0x7f46e00a7010 2024-04-25T02:28:14.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.538+0000 7f46e705a700 1 -- 172.21.15.111:0/3423669390 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46d4009420 con 0x7f46e00a7010 2024-04-25T02:28:14.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.538+0000 7f46dcff9700 1 -- 172.21.15.111:0/3423669390 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d800adf0 con 0x7f46e00a7010 2024-04-25T02:28:14.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.538+0000 7f46e705a700 1 -- 172.21.15.111:0/3423669390 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46e009eaf0 con 0x7f46e00a7010 2024-04-25T02:28:14.545 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.539+0000 7f46e705a700 1 -- 172.21.15.111:0/3423669390 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46e0065190 con 0x7f46e00a7010 2024-04-25T02:28:14.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.539+0000 7f46dcff9700 1 -- 172.21.15.111:0/3423669390 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f46d8007300 con 0x7f46e00a7010 2024-04-25T02:28:14.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.539+0000 7f46dcff9700 1 -- 172.21.15.111:0/3423669390 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4158+0+0 (secure 0 0 0) 0x7f46d805b340 con 0x7f46e00a7010 2024-04-25T02:28:14.546 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.543+0000 7f46dcff9700 1 -- 172.21.15.111:0/3423669390 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f46d80395f0 con 0x7f46e00a7010 2024-04-25T02:28:14.701 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.697+0000 7f46e705a700 1 -- 172.21.15.111:0/3423669390 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f46e00a6df0 con 0x7f46e00a7010 2024-04-25T02:28:14.701 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.698+0000 7f46dcff9700 1 -- 172.21.15.111:0/3423669390 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v43) v1 ==== 100+0+11 (secure 0 0 0) 0x7f46d803cde0 con 0x7f46e00a7010 2024-04-25T02:28:14.702 INFO:teuthology.orchestra.run.smithi111.stdout:pg_num: 64 2024-04-25T02:28:14.704 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.700+0000 7f46e705a700 1 -- 172.21.15.111:0/3423669390 >> v1:172.21.15.111:6816/46482 conn(0x7f46c4045ef0 legacy=0x7f46c40483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:14.704 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.700+0000 7f46e705a700 1 -- 172.21.15.111:0/3423669390 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f46e00a7010 msgr2=0x7f46e014b1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:14.704 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.700+0000 7f46e705a700 1 --2- 172.21.15.111:0/3423669390 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f46e00a7010 0x7f46e014b1f0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f46d800cbe0 tx=0x7f46d80019a0 comp rx=0 tx=0).stop 2024-04-25T02:28:14.704 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.700+0000 7f46e705a700 1 -- 172.21.15.111:0/3423669390 shutdown_connections 2024-04-25T02:28:14.704 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.700+0000 7f46e705a700 1 --2- 172.21.15.111:0/3423669390 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f46e00a7010 0x7f46e014b1f0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:14.704 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.700+0000 7f46e705a700 1 --2- 172.21.15.111:0/3423669390 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f46e0069b50 0x7f46e0151200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:14.704 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.700+0000 7f46e705a700 1 --2- 172.21.15.111:0/3423669390 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f46e00a5900 0x7f46e009e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:14.704 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.700+0000 7f46e705a700 1 -- 172.21.15.111:0/3423669390 >> 172.21.15.111:0/3423669390 conn(0x7f46e006faf0 msgr2=0x7f46e00b5690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:14.704 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.700+0000 7f46e705a700 1 -- 172.21.15.111:0/3423669390 shutdown_connections 2024-04-25T02:28:14.705 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.700+0000 7f46e705a700 1 -- 172.21.15.111:0/3423669390 wait complete. 2024-04-25T02:28:14.715 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-25T02:28:14.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.828+0000 7f3af3474700 1 Processor -- start 2024-04-25T02:28:14.832 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.828+0000 7f3af3474700 1 -- start start 2024-04-25T02:28:14.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.829+0000 7f3af3474700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f3aec0a22a0 0x7f3aec13b480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:14.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.829+0000 7f3af3474700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3aec13b9c0 0x7f3aec13bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:14.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.829+0000 7f3af3474700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3aec06da60 con 0x7f3aec0a3410 2024-04-25T02:28:14.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.829+0000 7f3af3474700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3aec13c320 con 0x7f3aec0a22a0 2024-04-25T02:28:14.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.829+0000 7f3af3474700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3aec0a2a20 con 0x7f3aec13b9c0 2024-04-25T02:28:14.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.829+0000 7f3af1a11700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3aec13b9c0 0x7f3aec13bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:14.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.829+0000 7f3af0a0f700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f3aec0a22a0 0x7f3aec13b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:14.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.829+0000 7f3af1210700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f3aec0a3410 0x7f3aec0a4460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:33390/0 (socket says 172.21.15.111:33390) 2024-04-25T02:28:14.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.829+0000 7f3af1210700 1 -- 172.21.15.111:0/3462607079 learned_addr learned my addr 172.21.15.111:0/3462607079 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:28:14.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.829+0000 7f3af1a11700 1 -- 172.21.15.111:0/3462607079 >> v2:172.21.15.111:3300/0 conn(0x7f3aec0a22a0 msgr2=0x7f3aec13b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:14.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.829+0000 7f3af1a11700 1 --2- 172.21.15.111:0/3462607079 >> v2:172.21.15.111:3300/0 conn(0x7f3aec0a22a0 0x7f3aec13b480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:14.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.829+0000 7f3af1a11700 1 -- 172.21.15.111:0/3462607079 >> v1:172.21.15.111:6789/0 conn(0x7f3aec0a3410 legacy=0x7f3aec0a4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:14.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.829+0000 7f3af1a11700 1 -- 172.21.15.111:0/3462607079 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aec0a3c80 con 0x7f3aec13b9c0 2024-04-25T02:28:14.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.829+0000 7f3ae3fff700 1 -- 172.21.15.111:0/3462607079 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2541902586 0 0) 0x7f3aec06da60 con 0x7f3aec0a3410 2024-04-25T02:28:14.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.829+0000 7f3af0a0f700 1 --2- 172.21.15.111:0/3462607079 >> v2:172.21.15.111:3300/0 conn(0x7f3aec0a22a0 0x7f3aec13b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:14.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.829+0000 7f3af1a11700 1 --2- 172.21.15.111:0/3462607079 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3aec13b9c0 0x7f3aec13bde0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4009e60 tx=0x7f3ae4009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=111676286ef53463 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:14.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.830+0000 7f3ae3fff700 1 -- 172.21.15.111:0/3462607079 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae400e070 con 0x7f3aec13b9c0 2024-04-25T02:28:14.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.830+0000 7f3ae3fff700 1 -- 172.21.15.111:0/3462607079 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ae400bb60 con 0x7f3aec13b9c0 2024-04-25T02:28:14.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.830+0000 7f3ae3fff700 1 -- 172.21.15.111:0/3462607079 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ae4012430 con 0x7f3aec13b9c0 2024-04-25T02:28:14.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.830+0000 7f3af3474700 1 -- 172.21.15.111:0/3462607079 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3aec13b9c0 msgr2=0x7f3aec13bde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:14.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.830+0000 7f3af3474700 1 --2- 172.21.15.111:0/3462607079 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3aec13b9c0 0x7f3aec13bde0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f3ae4009e60 tx=0x7f3ae4009780 comp rx=0 tx=0).stop 2024-04-25T02:28:14.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.830+0000 7f3af3474700 1 -- 172.21.15.111:0/3462607079 shutdown_connections 2024-04-25T02:28:14.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.830+0000 7f3af3474700 1 --2- 172.21.15.111:0/3462607079 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3aec13b9c0 0x7f3aec13bde0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:14.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.830+0000 7f3af3474700 1 --2- 172.21.15.111:0/3462607079 >> v2:172.21.15.111:3300/0 conn(0x7f3aec0a22a0 0x7f3aec13b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:14.841 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.830+0000 7f3af3474700 1 -- 172.21.15.111:0/3462607079 >> 172.21.15.111:0/3462607079 conn(0x7f3aec0b1cf0 msgr2=0x7f3aec0b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:14.841 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.830+0000 7f3af3474700 1 -- 172.21.15.111:0/3462607079 shutdown_connections 2024-04-25T02:28:14.841 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.830+0000 7f3af3474700 1 -- 172.21.15.111:0/3462607079 wait complete. 2024-04-25T02:28:14.841 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.831+0000 7f3af3474700 1 Processor -- start 2024-04-25T02:28:14.841 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.831+0000 7f3af3474700 1 -- start start 2024-04-25T02:28:14.841 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.832+0000 7f3af3474700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3aec0a22a0 0x7f3aec0a8f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:14.841 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.832+0000 7f3af3474700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3aec0a3410 0x7f3aec14cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:14.841 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.832+0000 7f3af3474700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3aec13b9c0 0x7f3aec14d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:14.841 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.832+0000 7f3af3474700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3aec0a98f0 con 0x7f3aec0a22a0 2024-04-25T02:28:14.841 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.832+0000 7f3af3474700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3aec0aaab0 con 0x7f3aec13b9c0 2024-04-25T02:28:14.841 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.832+0000 7f3af3474700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3aec0ab770 con 0x7f3aec0a3410 2024-04-25T02:28:14.841 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.832+0000 7f3af0a0f700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3aec0a3410 0x7f3aec14cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:14.841 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.832+0000 7f3af1210700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3aec0a22a0 0x7f3aec0a8f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:14.841 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.832+0000 7f3af0a0f700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3aec0a3410 0x7f3aec14cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:51764/0 (socket says 172.21.15.111:51764) 2024-04-25T02:28:14.841 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.832+0000 7f3af1210700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3aec0a22a0 0x7f3aec0a8f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48526/0 (socket says 172.21.15.111:48526) 2024-04-25T02:28:14.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.832+0000 7f3af0a0f700 1 -- 172.21.15.111:0/3259354681 learned_addr learned my addr 172.21.15.111:0/3259354681 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:28:14.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.832+0000 7f3af1a11700 1 --2- 172.21.15.111:0/3259354681 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3aec13b9c0 0x7f3aec14d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:14.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.832+0000 7f3af1210700 1 -- 172.21.15.111:0/3259354681 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3aec0a3410 msgr2=0x7f3aec14cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:14.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.832+0000 7f3af1210700 1 --2- 172.21.15.111:0/3259354681 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3aec0a3410 0x7f3aec14cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:14.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.832+0000 7f3af1210700 1 -- 172.21.15.111:0/3259354681 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3aec13b9c0 msgr2=0x7f3aec14d050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:14.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.832+0000 7f3af1210700 1 --2- 172.21.15.111:0/3259354681 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3aec13b9c0 0x7f3aec14d050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:14.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.832+0000 7f3af1210700 1 -- 172.21.15.111:0/3259354681 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae800b6d0 con 0x7f3aec0a22a0 2024-04-25T02:28:14.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.832+0000 7f3af0a0f700 1 --2- 172.21.15.111:0/3259354681 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3aec0a3410 0x7f3aec14cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:14.842 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.832+0000 7f3af1a11700 1 --2- 172.21.15.111:0/3259354681 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3aec13b9c0 0x7f3aec14d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:14.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.833+0000 7f3af1210700 1 --2- 172.21.15.111:0/3259354681 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3aec0a22a0 0x7f3aec0a8f20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3adc0011e0 tx=0x7f3adc007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:14.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.833+0000 7f3ae17fa700 1 -- 172.21.15.111:0/3259354681 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3adc005b30 con 0x7f3aec0a22a0 2024-04-25T02:28:14.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.833+0000 7f3ae17fa700 1 -- 172.21.15.111:0/3259354681 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3adc005cb0 con 0x7f3aec0a22a0 2024-04-25T02:28:14.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.833+0000 7f3ae17fa700 1 -- 172.21.15.111:0/3259354681 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3adc007320 con 0x7f3aec0a22a0 2024-04-25T02:28:14.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.833+0000 7f3af3474700 1 -- 172.21.15.111:0/3259354681 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ae4009a20 con 0x7f3aec0a22a0 2024-04-25T02:28:14.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.833+0000 7f3af3474700 1 -- 172.21.15.111:0/3259354681 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3aec0a7f60 con 0x7f3aec0a22a0 2024-04-25T02:28:14.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.834+0000 7f3ae17fa700 1 -- 172.21.15.111:0/3259354681 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f3adc012400 con 0x7f3aec0a22a0 2024-04-25T02:28:14.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.834+0000 7f3af3474700 1 -- 172.21.15.111:0/3259354681 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3aec06ed40 con 0x7f3aec0a22a0 2024-04-25T02:28:14.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.834+0000 7f3ae17fa700 1 -- 172.21.15.111:0/3259354681 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4158+0+0 (secure 0 0 0) 0x7f3adc05a480 con 0x7f3aec0a22a0 2024-04-25T02:28:14.843 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:14.837+0000 7f3ae17fa700 1 -- 172.21.15.111:0/3259354681 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f3adc0386b0 con 0x7f3aec0a22a0 2024-04-25T02:28:15.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.009+0000 7f3af3474700 1 -- 172.21.15.111:0/3259354681 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f3aec068bb0 con 0x7f3aec0a22a0 2024-04-25T02:28:15.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.010+0000 7f3ae17fa700 1 -- 172.21.15.111:0/3259354681 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 6 entries v43) v1 ==== 80+0+355 (secure 0 0 0) 0x7f3adc017070 con 0x7f3aec0a22a0 2024-04-25T02:28:15.014 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.186:0/1473940677 2024-04-25T03:25:09.063135+0000 2024-04-25T02:28:15.014 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:6819/4003866251 2024-04-26T02:23:16.839679+0000 2024-04-25T02:28:15.014 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/2148931273 2024-04-26T02:22:54.713254+0000 2024-04-25T02:28:15.014 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:6816/39585 2024-04-26T02:22:54.713254+0000 2024-04-25T02:28:15.014 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/3911588907 2024-04-26T02:22:54.713254+0000 2024-04-25T02:28:15.014 INFO:teuthology.orchestra.run.smithi111.stdout:172.21.15.111:0/1276843622 2024-04-26T02:22:54.713254+0000 2024-04-25T02:28:15.015 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.012+0000 7f3af3474700 1 -- 172.21.15.111:0/3259354681 >> v1:172.21.15.111:6816/46482 conn(0x7f3ad0045ef0 legacy=0x7f3ad00483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:15.015 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.012+0000 7f3af3474700 1 -- 172.21.15.111:0/3259354681 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3aec0a22a0 msgr2=0x7f3aec0a8f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:15.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.012+0000 7f3af3474700 1 --2- 172.21.15.111:0/3259354681 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3aec0a22a0 0x7f3aec0a8f20 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f3adc0011e0 tx=0x7f3adc007d10 comp rx=0 tx=0).stop 2024-04-25T02:28:15.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.012+0000 7f3af3474700 1 -- 172.21.15.111:0/3259354681 shutdown_connections 2024-04-25T02:28:15.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.012+0000 7f3af3474700 1 --2- 172.21.15.111:0/3259354681 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3aec13b9c0 0x7f3aec14d050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:15.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.012+0000 7f3af3474700 1 --2- 172.21.15.111:0/3259354681 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3aec0a22a0 0x7f3aec0a8f20 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:15.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.012+0000 7f3af3474700 1 --2- 172.21.15.111:0/3259354681 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3aec0a3410 0x7f3aec14cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:15.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.012+0000 7f3af3474700 1 -- 172.21.15.111:0/3259354681 >> 172.21.15.111:0/3259354681 conn(0x7f3aec0b1cf0 msgr2=0x7f3aec0b1510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:15.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.012+0000 7f3af3474700 1 -- 172.21.15.111:0/3259354681 shutdown_connections 2024-04-25T02:28:15.016 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.012+0000 7f3af3474700 1 -- 172.21.15.111:0/3259354681 wait complete. 2024-04-25T02:28:15.016 INFO:teuthology.orchestra.run.smithi111.stderr:listed 6 entries 2024-04-25T02:28:15.027 DEBUG:tasks.cephfs.mount:Force/lazy unmounting on client.1 2024-04-25T02:28:15.027 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:15.027 DEBUG:teuthology.orchestra.run.smithi186:> sudo umount --lazy --force /home/ubuntu/cephtest/mnt.1 2024-04-25T02:28:15.059 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi186.stderr:ceph-fuse[37471]: fuse finished with error 0 and tester_r 0 2024-04-25T02:28:15.074 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi186.front.sepia.ceph.com 2024-04-25T02:28:15.074 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:15.074 DEBUG:teuthology.orchestra.run.smithi186:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2024-04-25T02:28:15.151 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:15.151 DEBUG:teuthology.orchestra.run.smithi114:> ip netns list 2024-04-25T02:28:15.173 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:15.173 DEBUG:teuthology.orchestra.run.smithi114:> sudo ip link delete ceph-brx 2024-04-25T02:28:15.248 INFO:teuthology.orchestra.run.smithi114.stderr:Cannot find device "ceph-brx" 2024-04-25T02:28:15.249 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:28:15.249 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:15.249 DEBUG:teuthology.orchestra.run.smithi186:> ip netns list 2024-04-25T02:28:15.270 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-25T02:28:15.271 DEBUG:teuthology.orchestra.run.smithi186:> sudo ip link delete ceph-brx 2024-04-25T02:28:15.343 INFO:teuthology.orchestra.run.smithi186.stderr:Cannot find device "ceph-brx" 2024-04-25T02:28:15.344 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:28:15.345 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-25T02:28:15.359 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-25T02:28:15.359 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:28:15.476 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.472+0000 7f8a228b5700 1 Processor -- start 2024-04-25T02:28:15.476 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.473+0000 7f8a228b5700 1 -- start start 2024-04-25T02:28:15.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.473+0000 7f8a228b5700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8a1c067940 0x7f8a1c146620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:15.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.473+0000 7f8a228b5700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8a1c146b60 0x7f8a1c148f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:15.479 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.473+0000 7f8a228b5700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a1c06f890 con 0x7f8a1c068c10 2024-04-25T02:28:15.479 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.473+0000 7f8a228b5700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1c06ed40 con 0x7f8a1c146b60 2024-04-25T02:28:15.479 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.473+0000 7f8a228b5700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1c0a23f0 con 0x7f8a1c067940 2024-04-25T02:28:15.479 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.473+0000 7f8a1b7fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8a1c067940 0x7f8a1c146620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:15.479 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.473+0000 7f8a20e52700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8a1c146b60 0x7f8a1c148f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:15.479 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.473+0000 7f8a1bfff700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f8a1c068c10 0x7f8a1c06e350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:33404/0 (socket says 172.21.15.111:33404) 2024-04-25T02:28:15.479 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.473+0000 7f8a1bfff700 1 -- 172.21.15.111:0/3001391713 learned_addr learned my addr 172.21.15.111:0/3001391713 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:28:15.479 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.473+0000 7f8a1affd700 1 -- 172.21.15.111:0/3001391713 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1882412092 0 0) 0x7f8a1c06f890 con 0x7f8a1c068c10 2024-04-25T02:28:15.479 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.473+0000 7f8a1b7fe700 1 -- 172.21.15.111:0/3001391713 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8a1c146b60 msgr2=0x7f8a1c148f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:15.479 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.473+0000 7f8a1b7fe700 1 --2- 172.21.15.111:0/3001391713 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8a1c146b60 0x7f8a1c148f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:15.479 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.473+0000 7f8a1b7fe700 1 -- 172.21.15.111:0/3001391713 >> v1:172.21.15.111:6789/0 conn(0x7f8a1c068c10 legacy=0x7f8a1c06e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:15.479 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.473+0000 7f8a1b7fe700 1 -- 172.21.15.111:0/3001391713 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a1c0680e0 con 0x7f8a1c067940 2024-04-25T02:28:15.479 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.473+0000 7f8a20e52700 1 --2- 172.21.15.111:0/3001391713 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8a1c146b60 0x7f8a1c148f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:15.480 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.474+0000 7f8a1b7fe700 1 --2- 172.21.15.111:0/3001391713 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8a1c067940 0x7f8a1c146620 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8a10009910 tx=0x7f8a100091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7aa6c40c4a88d72b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:15.480 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.474+0000 7f8a1affd700 1 -- 172.21.15.111:0/3001391713 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1000b680 con 0x7f8a1c067940 2024-04-25T02:28:15.480 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.474+0000 7f8a1affd700 1 -- 172.21.15.111:0/3001391713 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a1000b7e0 con 0x7f8a1c067940 2024-04-25T02:28:15.480 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.474+0000 7f8a1affd700 1 -- 172.21.15.111:0/3001391713 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a1000bba0 con 0x7f8a1c067940 2024-04-25T02:28:15.480 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.474+0000 7f8a228b5700 1 -- 172.21.15.111:0/3001391713 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8a1c067940 msgr2=0x7f8a1c146620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:15.480 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.474+0000 7f8a228b5700 1 --2- 172.21.15.111:0/3001391713 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8a1c067940 0x7f8a1c146620 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f8a10009910 tx=0x7f8a100091a0 comp rx=0 tx=0).stop 2024-04-25T02:28:15.480 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.474+0000 7f8a228b5700 1 -- 172.21.15.111:0/3001391713 shutdown_connections 2024-04-25T02:28:15.480 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.474+0000 7f8a228b5700 1 --2- 172.21.15.111:0/3001391713 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8a1c146b60 0x7f8a1c148f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:15.480 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.474+0000 7f8a228b5700 1 --2- 172.21.15.111:0/3001391713 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8a1c067940 0x7f8a1c146620 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:15.480 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.474+0000 7f8a228b5700 1 -- 172.21.15.111:0/3001391713 >> 172.21.15.111:0/3001391713 conn(0x7f8a1c06ce40 msgr2=0x7f8a1c06af80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:15.480 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.474+0000 7f8a228b5700 1 -- 172.21.15.111:0/3001391713 shutdown_connections 2024-04-25T02:28:15.480 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.474+0000 7f8a228b5700 1 -- 172.21.15.111:0/3001391713 wait complete. 2024-04-25T02:28:15.483 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.476+0000 7f8a228b5700 1 Processor -- start 2024-04-25T02:28:15.483 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.476+0000 7f8a228b5700 1 -- start start 2024-04-25T02:28:15.483 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.476+0000 7f8a228b5700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8a1c067940 0x7f8a1c096b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:15.483 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.476+0000 7f8a228b5700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8a1c068c10 0x7f8a1c1513c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:15.483 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.476+0000 7f8a228b5700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8a1c146b60 0x7f8a1c151900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:15.483 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.477+0000 7f8a228b5700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1c097820 con 0x7f8a1c068c10 2024-04-25T02:28:15.483 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.477+0000 7f8a228b5700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1c098790 con 0x7f8a1c146b60 2024-04-25T02:28:15.483 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.477+0000 7f8a228b5700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8a1c0ae880 con 0x7f8a1c067940 2024-04-25T02:28:15.483 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.477+0000 7f8a1bfff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8a1c067940 0x7f8a1c096b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:15.483 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.477+0000 7f8a20e52700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8a1c146b60 0x7f8a1c151900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:15.483 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.477+0000 7f8a1bfff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8a1c067940 0x7f8a1c096b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:51784/0 (socket says 172.21.15.111:51784) 2024-04-25T02:28:15.484 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.477+0000 7f8a1bfff700 1 -- 172.21.15.111:0/2293623634 learned_addr learned my addr 172.21.15.111:0/2293623634 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:28:15.484 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.477+0000 7f8a1b7fe700 1 --2- 172.21.15.111:0/2293623634 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8a1c068c10 0x7f8a1c1513c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:15.484 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.477+0000 7f8a1bfff700 1 -- 172.21.15.111:0/2293623634 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8a1c146b60 msgr2=0x7f8a1c151900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:15.484 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.477+0000 7f8a1bfff700 1 --2- 172.21.15.111:0/2293623634 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8a1c146b60 0x7f8a1c151900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:15.484 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.477+0000 7f8a1bfff700 1 -- 172.21.15.111:0/2293623634 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8a1c068c10 msgr2=0x7f8a1c1513c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:15.484 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.477+0000 7f8a1bfff700 1 --2- 172.21.15.111:0/2293623634 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8a1c068c10 0x7f8a1c1513c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:15.484 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.477+0000 7f8a1bfff700 1 -- 172.21.15.111:0/2293623634 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a14009a20 con 0x7f8a1c067940 2024-04-25T02:28:15.484 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.477+0000 7f8a20e52700 1 --2- 172.21.15.111:0/2293623634 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8a1c146b60 0x7f8a1c151900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:15.484 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.477+0000 7f8a1bfff700 1 --2- 172.21.15.111:0/2293623634 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8a1c067940 0x7f8a1c096b90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c00c840 tx=0x7f8a0c007d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:15.484 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.477+0000 7f8a03fff700 1 -- 172.21.15.111:0/2293623634 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c005c00 con 0x7f8a1c067940 2024-04-25T02:28:15.484 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.477+0000 7f8a03fff700 1 -- 172.21.15.111:0/2293623634 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a0c005d60 con 0x7f8a1c067940 2024-04-25T02:28:15.484 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.477+0000 7f8a228b5700 1 -- 172.21.15.111:0/2293623634 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a10009420 con 0x7f8a1c067940 2024-04-25T02:28:15.484 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.477+0000 7f8a03fff700 1 -- 172.21.15.111:0/2293623634 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0c007320 con 0x7f8a1c067940 2024-04-25T02:28:15.484 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.477+0000 7f8a228b5700 1 -- 172.21.15.111:0/2293623634 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a1c0adc20 con 0x7f8a1c067940 2024-04-25T02:28:15.485 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.478+0000 7f8a228b5700 1 -- 172.21.15.111:0/2293623634 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a1c0a25f0 con 0x7f8a1c067940 2024-04-25T02:28:15.485 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.478+0000 7f8a03fff700 1 -- 172.21.15.111:0/2293623634 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f8a0c01b3b0 con 0x7f8a1c067940 2024-04-25T02:28:15.485 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.479+0000 7f8a03fff700 1 -- 172.21.15.111:0/2293623634 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4158+0+0 (secure 0 0 0) 0x7f8a0c05a570 con 0x7f8a1c067940 2024-04-25T02:28:15.485 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.482+0000 7f8a03fff700 1 -- 172.21.15.111:0/2293623634 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f8a0c038860 con 0x7f8a1c067940 2024-04-25T02:28:15.637 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.634+0000 7f8a228b5700 1 -- 172.21.15.111:0/2293623634 --> v1:172.21.15.111:6816/46482 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8a1c099580 con 0x7f8a08045ef0 2024-04-25T02:28:15.645 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.641+0000 7f8a03fff700 1 -- 172.21.15.111:0/2293623634 <== mgr.14107 v1:172.21.15.111:6816/46482 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278423 (unknown 2965378022 0 1197470410) 0x7f8a10006c50 con 0x7f8a08045ef0 2024-04-25T02:28:15.648 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:28:15.651 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.644+0000 7f8a228b5700 1 -- 172.21.15.111:0/2293623634 >> v1:172.21.15.111:6816/46482 conn(0x7f8a08045ef0 legacy=0x7f8a080483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:15.652 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.644+0000 7f8a228b5700 1 -- 172.21.15.111:0/2293623634 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8a1c067940 msgr2=0x7f8a1c096b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:15.652 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.644+0000 7f8a228b5700 1 --2- 172.21.15.111:0/2293623634 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8a1c067940 0x7f8a1c096b90 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c00c840 tx=0x7f8a0c007d90 comp rx=0 tx=0).stop 2024-04-25T02:28:15.652 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.644+0000 7f8a228b5700 1 -- 172.21.15.111:0/2293623634 shutdown_connections 2024-04-25T02:28:15.652 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.644+0000 7f8a228b5700 1 --2- 172.21.15.111:0/2293623634 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8a1c146b60 0x7f8a1c151900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:15.652 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.644+0000 7f8a228b5700 1 --2- 172.21.15.111:0/2293623634 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8a1c067940 0x7f8a1c096b90 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:15.652 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.644+0000 7f8a228b5700 1 --2- 172.21.15.111:0/2293623634 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8a1c068c10 0x7f8a1c1513c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:15.652 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.644+0000 7f8a228b5700 1 -- 172.21.15.111:0/2293623634 >> 172.21.15.111:0/2293623634 conn(0x7f8a1c06ce40 msgr2=0x7f8a1c144240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:15.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.644+0000 7f8a228b5700 1 -- 172.21.15.111:0/2293623634 shutdown_connections 2024-04-25T02:28:15.653 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.644+0000 7f8a228b5700 1 -- 172.21.15.111:0/2293623634 wait complete. 2024-04-25T02:28:15.653 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2024-04-25T02:28:15.659 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":186,"stamp":"2024-04-25T02:28:14.801784+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":130042064,"num_objects":104,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":3127,"num_read_kb":1448109,"num_write":31155,"num_write_kb":4453495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34534,"ondisk_log_size":34534,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1472676,"kb_used_data":258884,"kb_used_omap":38,"kb_used_meta":1213721,"kb_avail":376014684,"statfs":{"total":386547056640,"available":385039036416,"internally_reserved":0,"allocated":265097216,"data_stored":263472521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39115,"internal_metadata":1242851125},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10028628,"num_objects":-2263,"num_object_clones":0,"num_object_copies":-4526,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2263,"num_whiteouts":0,"num_read":37,"num_read_kb":339,"num_write":2996,"num_write_kb":8699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002487"},"pg_stats":[{"pgid":"4.3f","version":"43'394","reported_seq":466,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.537907+0000","last_change":"2024-04-25T02:23:13.846111+0000","last_active":"2024-04-25T02:28:09.537907+0000","last_peered":"2024-04-25T02:28:09.537907+0000","last_clean":"2024-04-25T02:28:09.537907+0000","last_became_active":"2024-04-25T02:23:13.845848+0000","last_became_peered":"2024-04-25T02:23:13.845848+0000","last_unstale":"2024-04-25T02:28:09.537907+0000","last_undegraded":"2024-04-25T02:28:09.537907+0000","last_fullsized":"2024-04-25T02:28:09.537907+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:48:53.653719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":15113,"num_write":370,"num_write_kb":51033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"43'432","reported_seq":516,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.566159+0000","last_change":"2024-04-25T02:23:12.845761+0000","last_active":"2024-04-25T02:28:09.566159+0000","last_peered":"2024-04-25T02:28:09.566159+0000","last_clean":"2024-04-25T02:28:09.566159+0000","last_became_active":"2024-04-25T02:23:12.845429+0000","last_became_peered":"2024-04-25T02:23:12.845429+0000","last_unstale":"2024-04-25T02:28:09.566159+0000","last_undegraded":"2024-04-25T02:28:09.566159+0000","last_fullsized":"2024-04-25T02:28:09.566159+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:39:23.193473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22592,"num_write":405,"num_write_kb":75650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"43'370","reported_seq":430,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.365156+0000","last_change":"2024-04-25T02:23:11.838311+0000","last_active":"2024-04-25T02:28:12.365156+0000","last_peered":"2024-04-25T02:28:12.365156+0000","last_clean":"2024-04-25T02:28:12.365156+0000","last_became_active":"2024-04-25T02:23:11.838054+0000","last_became_peered":"2024-04-25T02:23:11.838054+0000","last_unstale":"2024-04-25T02:28:12.365156+0000","last_undegraded":"2024-04-25T02:28:12.365156+0000","last_fullsized":"2024-04-25T02:28:12.365156+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:55:20.837592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":15817,"num_write":338,"num_write_kb":46402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"43'393","reported_seq":474,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.365982+0000","last_change":"2024-04-25T02:23:11.837015+0000","last_active":"2024-04-25T02:28:12.365982+0000","last_peered":"2024-04-25T02:28:12.365982+0000","last_clean":"2024-04-25T02:28:12.365982+0000","last_became_active":"2024-04-25T02:23:11.836681+0000","last_became_peered":"2024-04-25T02:23:11.836681+0000","last_unstale":"2024-04-25T02:28:12.365982+0000","last_undegraded":"2024-04-25T02:28:12.365982+0000","last_fullsized":"2024-04-25T02:28:12.365982+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:57:52.130438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22923,"num_write":365,"num_write_kb":51318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"43'406","reported_seq":475,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.358191+0000","last_change":"2024-04-25T02:23:13.843174+0000","last_active":"2024-04-25T02:28:12.358191+0000","last_peered":"2024-04-25T02:28:12.358191+0000","last_clean":"2024-04-25T02:28:12.358191+0000","last_became_active":"2024-04-25T02:23:13.842918+0000","last_became_peered":"2024-04-25T02:23:13.842918+0000","last_unstale":"2024-04-25T02:28:12.358191+0000","last_undegraded":"2024-04-25T02:28:12.358191+0000","last_fullsized":"2024-04-25T02:28:12.358191+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:18:04.676996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14619,"num_write":384,"num_write_kb":71611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"43'360","reported_seq":421,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.512947+0000","last_change":"2024-04-25T02:23:13.848493+0000","last_active":"2024-04-25T02:28:09.512947+0000","last_peered":"2024-04-25T02:28:09.512947+0000","last_clean":"2024-04-25T02:28:09.512947+0000","last_became_active":"2024-04-25T02:23:13.848160+0000","last_became_peered":"2024-04-25T02:23:13.848160+0000","last_unstale":"2024-04-25T02:28:09.512947+0000","last_undegraded":"2024-04-25T02:28:09.512947+0000","last_fullsized":"2024-04-25T02:28:09.512947+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:40:38.221942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12472,"num_write":338,"num_write_kb":33864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"43'436","reported_seq":554,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.574046+0000","last_change":"2024-04-25T02:23:13.842324+0000","last_active":"2024-04-25T02:28:09.574046+0000","last_peered":"2024-04-25T02:28:09.574046+0000","last_clean":"2024-04-25T02:28:09.574046+0000","last_became_active":"2024-04-25T02:23:13.840374+0000","last_became_peered":"2024-04-25T02:23:13.840374+0000","last_unstale":"2024-04-25T02:28:09.574046+0000","last_undegraded":"2024-04-25T02:28:09.574046+0000","last_fullsized":"2024-04-25T02:28:09.574046+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:04:41.899219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":40192,"num_write":416,"num_write_kb":101787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"43'352","reported_seq":418,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.540107+0000","last_change":"2024-04-25T02:23:11.835781+0000","last_active":"2024-04-25T02:28:09.540107+0000","last_peered":"2024-04-25T02:28:09.540107+0000","last_clean":"2024-04-25T02:28:09.540107+0000","last_became_active":"2024-04-25T02:23:11.834759+0000","last_became_peered":"2024-04-25T02:23:11.834759+0000","last_unstale":"2024-04-25T02:28:09.540107+0000","last_undegraded":"2024-04-25T02:28:09.540107+0000","last_fullsized":"2024-04-25T02:28:09.540107+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:17:37.320529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19314,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":34,"num_read_kb":18431,"num_write":327,"num_write_kb":66835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"43'425","reported_seq":514,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.356933+0000","last_change":"2024-04-25T02:23:13.842786+0000","last_active":"2024-04-25T02:28:12.356933+0000","last_peered":"2024-04-25T02:28:12.356933+0000","last_clean":"2024-04-25T02:28:12.356933+0000","last_became_active":"2024-04-25T02:23:13.841883+0000","last_became_peered":"2024-04-25T02:23:13.841883+0000","last_unstale":"2024-04-25T02:28:12.356933+0000","last_undegraded":"2024-04-25T02:28:12.356933+0000","last_fullsized":"2024-04-25T02:28:12.356933+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:13:08.256311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":29378,"num_write":387,"num_write_kb":39136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"43'378","reported_seq":451,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.557173+0000","last_change":"2024-04-25T02:23:11.836289+0000","last_active":"2024-04-25T02:28:09.557173+0000","last_peered":"2024-04-25T02:28:09.557173+0000","last_clean":"2024-04-25T02:28:09.557173+0000","last_became_active":"2024-04-25T02:23:11.835958+0000","last_became_peered":"2024-04-25T02:23:11.835958+0000","last_unstale":"2024-04-25T02:28:09.557173+0000","last_undegraded":"2024-04-25T02:28:09.557173+0000","last_fullsized":"2024-04-25T02:28:09.557173+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:56:00.639964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18327,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":25799,"num_write":350,"num_write_kb":67037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"43'346","reported_seq":385,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.576223+0000","last_change":"2024-04-25T02:23:11.836468+0000","last_active":"2024-04-25T02:28:09.576223+0000","last_peered":"2024-04-25T02:28:09.576223+0000","last_clean":"2024-04-25T02:28:09.576223+0000","last_became_active":"2024-04-25T02:23:11.836214+0000","last_became_peered":"2024-04-25T02:23:11.836214+0000","last_unstale":"2024-04-25T02:28:09.576223+0000","last_undegraded":"2024-04-25T02:28:09.576223+0000","last_fullsized":"2024-04-25T02:28:09.576223+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:55:43.874015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2596,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7176,"num_write":334,"num_write_kb":37702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"43'328","reported_seq":369,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.577670+0000","last_change":"2024-04-25T02:23:13.847944+0000","last_active":"2024-04-25T02:28:09.577670+0000","last_peered":"2024-04-25T02:28:09.577670+0000","last_clean":"2024-04-25T02:28:09.577670+0000","last_became_active":"2024-04-25T02:23:13.847446+0000","last_became_peered":"2024-04-25T02:23:13.847446+0000","last_unstale":"2024-04-25T02:28:09.577670+0000","last_undegraded":"2024-04-25T02:28:09.577670+0000","last_fullsized":"2024-04-25T02:28:09.577670+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:18:53.324436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4160,"num_write":309,"num_write_kb":33908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"43'377","reported_seq":418,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.581321+0000","last_change":"2024-04-25T02:23:13.847825+0000","last_active":"2024-04-25T02:28:09.581321+0000","last_peered":"2024-04-25T02:28:09.581321+0000","last_clean":"2024-04-25T02:28:09.581321+0000","last_became_active":"2024-04-25T02:23:13.847009+0000","last_became_peered":"2024-04-25T02:23:13.847009+0000","last_unstale":"2024-04-25T02:28:09.581321+0000","last_undegraded":"2024-04-25T02:28:09.581321+0000","last_fullsized":"2024-04-25T02:28:09.581321+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:04:01.988527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4152,"num_write":352,"num_write_kb":42524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"43'442","reported_seq":520,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.566824+0000","last_change":"2024-04-25T02:23:12.841952+0000","last_active":"2024-04-25T02:28:09.566824+0000","last_peered":"2024-04-25T02:28:09.566824+0000","last_clean":"2024-04-25T02:28:09.566824+0000","last_became_active":"2024-04-25T02:23:12.841783+0000","last_became_peered":"2024-04-25T02:23:12.841783+0000","last_unstale":"2024-04-25T02:28:09.566824+0000","last_undegraded":"2024-04-25T02:28:09.566824+0000","last_fullsized":"2024-04-25T02:28:09.566824+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:42:53.655107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1192,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":46,"num_read_kb":25198,"num_write":420,"num_write_kb":88864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"43'430","reported_seq":521,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.351328+0000","last_change":"2024-04-25T02:23:11.836069+0000","last_active":"2024-04-25T02:28:12.351328+0000","last_peered":"2024-04-25T02:28:12.351328+0000","last_clean":"2024-04-25T02:28:12.351328+0000","last_became_active":"2024-04-25T02:23:11.835815+0000","last_became_peered":"2024-04-25T02:23:11.835815+0000","last_unstale":"2024-04-25T02:28:12.351328+0000","last_undegraded":"2024-04-25T02:28:12.351328+0000","last_fullsized":"2024-04-25T02:28:12.351328+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:07.444694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31947,"num_write":393,"num_write_kb":64059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"43'429","reported_seq":453,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.494254+0000","last_change":"2024-04-25T02:23:55.963552+0000","last_active":"2024-04-25T02:28:10.494254+0000","last_peered":"2024-04-25T02:28:10.494254+0000","last_clean":"2024-04-25T02:28:10.494254+0000","last_became_active":"2024-04-25T02:23:55.963259+0000","last_became_peered":"2024-04-25T02:23:55.963259+0000","last_unstale":"2024-04-25T02:28:10.494254+0000","last_undegraded":"2024-04-25T02:28:10.494254+0000","last_fullsized":"2024-04-25T02:28:10.494254+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:40:16.304418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":2639,"num_write":405,"num_write_kb":51451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"43'394","reported_seq":456,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.356439+0000","last_change":"2024-04-25T02:23:13.844591+0000","last_active":"2024-04-25T02:28:12.356439+0000","last_peered":"2024-04-25T02:28:12.356439+0000","last_clean":"2024-04-25T02:28:12.356439+0000","last_became_active":"2024-04-25T02:23:13.844343+0000","last_became_peered":"2024-04-25T02:23:13.844343+0000","last_unstale":"2024-04-25T02:28:12.356439+0000","last_undegraded":"2024-04-25T02:28:12.356439+0000","last_fullsized":"2024-04-25T02:28:12.356439+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:52:55.994134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9696,"num_write":367,"num_write_kb":33966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"43'391","reported_seq":470,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.347590+0000","last_change":"2024-04-25T02:23:12.848314+0000","last_active":"2024-04-25T02:28:12.347590+0000","last_peered":"2024-04-25T02:28:12.347590+0000","last_clean":"2024-04-25T02:28:12.347590+0000","last_became_active":"2024-04-25T02:23:12.848051+0000","last_became_peered":"2024-04-25T02:23:12.848051+0000","last_unstale":"2024-04-25T02:28:12.347590+0000","last_undegraded":"2024-04-25T02:28:12.347590+0000","last_fullsized":"2024-04-25T02:28:12.347590+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:53:59.236832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":13345,"num_write":357,"num_write_kb":38441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"43'422","reported_seq":532,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.565039+0000","last_change":"2024-04-25T02:23:13.848250+0000","last_active":"2024-04-25T02:28:09.565039+0000","last_peered":"2024-04-25T02:28:09.565039+0000","last_clean":"2024-04-25T02:28:09.565039+0000","last_became_active":"2024-04-25T02:23:13.847602+0000","last_became_peered":"2024-04-25T02:23:13.847602+0000","last_unstale":"2024-04-25T02:28:09.565039+0000","last_undegraded":"2024-04-25T02:28:09.565039+0000","last_fullsized":"2024-04-25T02:28:09.565039+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:36:05.652157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":37845,"num_write":400,"num_write_kb":88566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"43'428","reported_seq":503,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.528212+0000","last_change":"2024-04-25T02:23:13.846327+0000","last_active":"2024-04-25T02:28:09.528212+0000","last_peered":"2024-04-25T02:28:09.528212+0000","last_clean":"2024-04-25T02:28:09.528212+0000","last_became_active":"2024-04-25T02:23:13.845934+0000","last_became_peered":"2024-04-25T02:23:13.845934+0000","last_unstale":"2024-04-25T02:28:09.528212+0000","last_undegraded":"2024-04-25T02:28:09.528212+0000","last_fullsized":"2024-04-25T02:28:09.528212+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:01:47.261604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13003,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":40,"num_read_kb":22073,"num_write":411,"num_write_kb":67090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"43'402","reported_seq":494,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.563914+0000","last_change":"2024-04-25T02:23:13.847117+0000","last_active":"2024-04-25T02:28:09.563914+0000","last_peered":"2024-04-25T02:28:09.563914+0000","last_clean":"2024-04-25T02:28:09.563914+0000","last_became_active":"2024-04-25T02:23:13.846758+0000","last_became_peered":"2024-04-25T02:23:13.846758+0000","last_unstale":"2024-04-25T02:28:09.563914+0000","last_undegraded":"2024-04-25T02:28:09.563914+0000","last_fullsized":"2024-04-25T02:28:09.563914+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:53:10.872495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3856,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":57,"num_read_kb":24525,"num_write":377,"num_write_kb":100342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"43'445","reported_seq":518,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.366186+0000","last_change":"2024-04-25T02:23:11.835581+0000","last_active":"2024-04-25T02:28:12.366186+0000","last_peered":"2024-04-25T02:28:12.366186+0000","last_clean":"2024-04-25T02:28:12.366186+0000","last_became_active":"2024-04-25T02:23:11.835319+0000","last_became_peered":"2024-04-25T02:23:11.835319+0000","last_unstale":"2024-04-25T02:28:12.366186+0000","last_undegraded":"2024-04-25T02:28:12.366186+0000","last_fullsized":"2024-04-25T02:28:12.366186+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:19:02.978966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":18532,"num_write":411,"num_write_kb":84101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"43'400","reported_seq":507,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.567502+0000","last_change":"2024-04-25T02:23:13.840011+0000","last_active":"2024-04-25T02:28:09.567502+0000","last_peered":"2024-04-25T02:28:09.567502+0000","last_clean":"2024-04-25T02:28:09.567502+0000","last_became_active":"2024-04-25T02:23:13.838917+0000","last_became_peered":"2024-04-25T02:23:13.838917+0000","last_unstale":"2024-04-25T02:28:09.567502+0000","last_undegraded":"2024-04-25T02:28:09.567502+0000","last_fullsized":"2024-04-25T02:28:09.567502+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:53:06.476265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":25750,"num_write":380,"num_write_kb":75795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"43'442","reported_seq":507,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.549105+0000","last_change":"2024-04-25T02:23:13.846482+0000","last_active":"2024-04-25T02:28:09.549105+0000","last_peered":"2024-04-25T02:28:09.549105+0000","last_clean":"2024-04-25T02:28:09.549105+0000","last_became_active":"2024-04-25T02:23:13.845814+0000","last_became_peered":"2024-04-25T02:23:13.845814+0000","last_unstale":"2024-04-25T02:28:09.549105+0000","last_undegraded":"2024-04-25T02:28:09.549105+0000","last_fullsized":"2024-04-25T02:28:09.549105+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:33:00.487666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22530,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":30,"num_read_kb":13960,"num_write":425,"num_write_kb":96160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"43'393","reported_seq":445,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.534083+0000","last_change":"2024-04-25T02:23:13.852668+0000","last_active":"2024-04-25T02:28:09.534083+0000","last_peered":"2024-04-25T02:28:09.534083+0000","last_clean":"2024-04-25T02:28:09.534083+0000","last_became_active":"2024-04-25T02:23:13.852093+0000","last_became_peered":"2024-04-25T02:23:13.852093+0000","last_unstale":"2024-04-25T02:28:09.534083+0000","last_undegraded":"2024-04-25T02:28:09.534083+0000","last_fullsized":"2024-04-25T02:28:09.534083+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:57.422935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5787,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":3870,"num_write":381,"num_write_kb":17738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"43'468","reported_seq":549,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.576547+0000","last_change":"2024-04-25T02:23:12.841653+0000","last_active":"2024-04-25T02:28:09.576547+0000","last_peered":"2024-04-25T02:28:09.576547+0000","last_clean":"2024-04-25T02:28:09.576547+0000","last_became_active":"2024-04-25T02:23:12.841477+0000","last_became_peered":"2024-04-25T02:23:12.841477+0000","last_unstale":"2024-04-25T02:28:09.576547+0000","last_undegraded":"2024-04-25T02:28:09.576547+0000","last_fullsized":"2024-04-25T02:28:09.576547+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:16:17.108262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35897,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":49,"num_read_kb":24645,"num_write":443,"num_write_kb":96750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"43'378","reported_seq":451,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.565831+0000","last_change":"2024-04-25T02:23:13.842553+0000","last_active":"2024-04-25T02:28:09.565831+0000","last_peered":"2024-04-25T02:28:09.565831+0000","last_clean":"2024-04-25T02:28:09.565831+0000","last_became_active":"2024-04-25T02:23:13.840422+0000","last_became_peered":"2024-04-25T02:23:13.840422+0000","last_unstale":"2024-04-25T02:28:09.565831+0000","last_undegraded":"2024-04-25T02:28:09.565831+0000","last_fullsized":"2024-04-25T02:28:09.565831+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:44:38.010033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":6130,"num_write":356,"num_write_kb":25986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"43'565","reported_seq":598,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.506214+0000","last_change":"2024-04-25T02:23:12.846241+0000","last_active":"2024-04-25T02:28:08.506214+0000","last_peered":"2024-04-25T02:28:08.506214+0000","last_clean":"2024-04-25T02:28:08.506214+0000","last_became_active":"2024-04-25T02:23:12.845923+0000","last_became_peered":"2024-04-25T02:23:12.845923+0000","last_unstale":"2024-04-25T02:28:08.506214+0000","last_undegraded":"2024-04-25T02:28:08.506214+0000","last_fullsized":"2024-04-25T02:28:08.506214+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:59:31.094638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":494,"num_write_kb":12610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"43'405","reported_seq":520,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.494514+0000","last_change":"2024-04-25T02:23:13.850625+0000","last_active":"2024-04-25T02:28:10.494514+0000","last_peered":"2024-04-25T02:28:10.494514+0000","last_clean":"2024-04-25T02:28:10.494514+0000","last_became_active":"2024-04-25T02:23:13.848844+0000","last_became_peered":"2024-04-25T02:23:13.848844+0000","last_unstale":"2024-04-25T02:28:10.494514+0000","last_undegraded":"2024-04-25T02:28:10.494514+0000","last_fullsized":"2024-04-25T02:28:10.494514+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:32.796023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":41312,"num_write":376,"num_write_kb":112833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"43'382","reported_seq":417,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:07.523305+0000","last_change":"2024-04-25T02:23:13.850242+0000","last_active":"2024-04-25T02:28:07.523305+0000","last_peered":"2024-04-25T02:28:07.523305+0000","last_clean":"2024-04-25T02:28:07.523305+0000","last_became_active":"2024-04-25T02:23:13.846821+0000","last_became_peered":"2024-04-25T02:23:13.846821+0000","last_unstale":"2024-04-25T02:28:07.523305+0000","last_undegraded":"2024-04-25T02:28:07.523305+0000","last_fullsized":"2024-04-25T02:28:07.523305+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:16.733579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":334,"num_write_kb":4317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"43'428","reported_seq":521,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.365345+0000","last_change":"2024-04-25T02:23:11.840787+0000","last_active":"2024-04-25T02:28:12.365345+0000","last_peered":"2024-04-25T02:28:12.365345+0000","last_clean":"2024-04-25T02:28:12.365345+0000","last_became_active":"2024-04-25T02:23:11.840274+0000","last_became_peered":"2024-04-25T02:23:11.840274+0000","last_unstale":"2024-04-25T02:28:12.365345+0000","last_undegraded":"2024-04-25T02:28:12.365345+0000","last_fullsized":"2024-04-25T02:28:12.365345+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:26:15.381838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":28196,"num_write":410,"num_write_kb":104265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"43'875","reported_seq":921,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.487831+0000","last_change":"2024-04-25T02:23:13.839791+0000","last_active":"2024-04-25T02:28:10.487831+0000","last_peered":"2024-04-25T02:28:10.487831+0000","last_clean":"2024-04-25T02:28:10.487831+0000","last_became_active":"2024-04-25T02:23:13.839361+0000","last_became_peered":"2024-04-25T02:23:13.839361+0000","last_unstale":"2024-04-25T02:28:10.487831+0000","last_undegraded":"2024-04-25T02:28:10.487831+0000","last_fullsized":"2024-04-25T02:28:10.487831+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":875,"log_dups_size":0,"ondisk_log_size":875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:48:03.634232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":809,"num_write_kb":8568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"43'359","reported_seq":437,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.539747+0000","last_change":"2024-04-25T02:23:13.844099+0000","last_active":"2024-04-25T02:28:09.539747+0000","last_peered":"2024-04-25T02:28:09.539747+0000","last_clean":"2024-04-25T02:28:09.539747+0000","last_became_active":"2024-04-25T02:23:13.843656+0000","last_became_peered":"2024-04-25T02:23:13.843656+0000","last_unstale":"2024-04-25T02:28:09.539747+0000","last_undegraded":"2024-04-25T02:28:09.539747+0000","last_fullsized":"2024-04-25T02:28:09.539747+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:18:44.036616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":25136,"num_write":341,"num_write_kb":38831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"43'56","reported_seq":95,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:06.534335+0000","last_change":"2024-04-25T02:23:13.842946+0000","last_active":"2024-04-25T02:28:06.534335+0000","last_peered":"2024-04-25T02:28:06.534335+0000","last_clean":"2024-04-25T02:28:06.534335+0000","last_became_active":"2024-04-25T02:23:13.842598+0000","last_became_peered":"2024-04-25T02:23:13.842598+0000","last_unstale":"2024-04-25T02:28:06.534335+0000","last_undegraded":"2024-04-25T02:28:06.534335+0000","last_fullsized":"2024-04-25T02:28:06.534335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:27.597908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"43'461","reported_seq":536,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.561722+0000","last_change":"2024-04-25T02:23:13.849957+0000","last_active":"2024-04-25T02:28:09.561722+0000","last_peered":"2024-04-25T02:28:09.561722+0000","last_clean":"2024-04-25T02:28:09.561722+0000","last_became_active":"2024-04-25T02:23:13.848675+0000","last_became_peered":"2024-04-25T02:23:13.848675+0000","last_unstale":"2024-04-25T02:28:09.561722+0000","last_undegraded":"2024-04-25T02:28:09.561722+0000","last_fullsized":"2024-04-25T02:28:09.561722+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:09:49.581897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":13580,"num_write":443,"num_write_kb":92928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"43'340","reported_seq":374,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.479090+0000","last_change":"2024-04-25T02:23:13.847353+0000","last_active":"2024-04-25T02:28:08.479090+0000","last_peered":"2024-04-25T02:28:08.479090+0000","last_clean":"2024-04-25T02:28:08.479090+0000","last_became_active":"2024-04-25T02:23:13.846764+0000","last_became_peered":"2024-04-25T02:23:13.846764+0000","last_unstale":"2024-04-25T02:28:08.479090+0000","last_undegraded":"2024-04-25T02:28:08.479090+0000","last_fullsized":"2024-04-25T02:28:08.479090+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":340,"log_dups_size":0,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:38:36.095151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":281,"num_write_kb":4273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"43'471","reported_seq":570,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.509616+0000","last_change":"2024-04-25T02:23:13.844687+0000","last_active":"2024-04-25T02:28:10.509616+0000","last_peered":"2024-04-25T02:28:10.509616+0000","last_clean":"2024-04-25T02:28:10.509616+0000","last_became_active":"2024-04-25T02:23:13.839702+0000","last_became_peered":"2024-04-25T02:23:13.839702+0000","last_unstale":"2024-04-25T02:28:10.509616+0000","last_undegraded":"2024-04-25T02:28:10.509616+0000","last_fullsized":"2024-04-25T02:28:10.509616+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:10:23.178715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":30102,"num_write":452,"num_write_kb":97286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"43'136","reported_seq":178,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.515488+0000","last_change":"2024-04-25T02:23:13.844668+0000","last_active":"2024-04-25T02:28:10.515488+0000","last_peered":"2024-04-25T02:28:10.515488+0000","last_clean":"2024-04-25T02:28:10.515488+0000","last_became_active":"2024-04-25T02:23:13.843625+0000","last_became_peered":"2024-04-25T02:23:13.843625+0000","last_unstale":"2024-04-25T02:28:10.515488+0000","last_undegraded":"2024-04-25T02:28:10.515488+0000","last_fullsized":"2024-04-25T02:28:10.515488+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:19:41.521042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":72,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"43'409","reported_seq":482,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.540770+0000","last_change":"2024-04-25T02:23:13.851184+0000","last_active":"2024-04-25T02:28:09.540770+0000","last_peered":"2024-04-25T02:28:09.540770+0000","last_clean":"2024-04-25T02:28:09.540770+0000","last_became_active":"2024-04-25T02:23:13.850845+0000","last_became_peered":"2024-04-25T02:23:13.850845+0000","last_unstale":"2024-04-25T02:28:09.540770+0000","last_undegraded":"2024-04-25T02:28:09.540770+0000","last_fullsized":"2024-04-25T02:28:09.540770+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:07:20.048534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19125,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":38,"num_read_kb":24672,"num_write":387,"num_write_kb":75497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"43'341","reported_seq":385,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:11.203375+0000","last_change":"2024-04-25T02:23:13.849389+0000","last_active":"2024-04-25T02:28:11.203375+0000","last_peered":"2024-04-25T02:28:11.203375+0000","last_clean":"2024-04-25T02:28:11.203375+0000","last_became_active":"2024-04-25T02:23:13.845176+0000","last_became_peered":"2024-04-25T02:23:13.845176+0000","last_unstale":"2024-04-25T02:28:11.203375+0000","last_undegraded":"2024-04-25T02:28:11.203375+0000","last_fullsized":"2024-04-25T02:28:11.203375+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:50:14.041957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10355158,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":7,"num_read_kb":10,"num_write":287,"num_write_kb":10305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"43'390","reported_seq":457,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.576280+0000","last_change":"2024-04-25T02:23:55.964120+0000","last_active":"2024-04-25T02:28:09.576280+0000","last_peered":"2024-04-25T02:28:09.576280+0000","last_clean":"2024-04-25T02:28:09.576280+0000","last_became_active":"2024-04-25T02:23:55.963655+0000","last_became_peered":"2024-04-25T02:23:55.963655+0000","last_unstale":"2024-04-25T02:28:09.576280+0000","last_undegraded":"2024-04-25T02:28:09.576280+0000","last_fullsized":"2024-04-25T02:28:09.576280+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:04:44.724602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":11609,"num_write":365,"num_write_kb":76437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"43'493","reported_seq":541,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:06.537420+0000","last_change":"2024-04-25T02:23:13.839481+0000","last_active":"2024-04-25T02:28:06.537420+0000","last_peered":"2024-04-25T02:28:06.537420+0000","last_clean":"2024-04-25T02:28:06.537420+0000","last_became_active":"2024-04-25T02:23:13.839158+0000","last_became_peered":"2024-04-25T02:23:13.839158+0000","last_unstale":"2024-04-25T02:28:06.537420+0000","last_undegraded":"2024-04-25T02:28:06.537420+0000","last_fullsized":"2024-04-25T02:28:06.537420+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:07:04.590892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":7,"num_write":435,"num_write_kb":8384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"43'398","reported_seq":477,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.574056+0000","last_change":"2024-04-25T02:23:13.843740+0000","last_active":"2024-04-25T02:28:09.574056+0000","last_peered":"2024-04-25T02:28:09.574056+0000","last_clean":"2024-04-25T02:28:09.574056+0000","last_became_active":"2024-04-25T02:23:13.843441+0000","last_became_peered":"2024-04-25T02:23:13.843441+0000","last_unstale":"2024-04-25T02:28:09.574056+0000","last_undegraded":"2024-04-25T02:28:09.574056+0000","last_fullsized":"2024-04-25T02:28:09.574056+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:53:20.763788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":25550,"num_write":379,"num_write_kb":104949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"43'51","reported_seq":89,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.480443+0000","last_change":"2024-04-25T02:23:13.844290+0000","last_active":"2024-04-25T02:28:08.480443+0000","last_peered":"2024-04-25T02:28:08.480443+0000","last_clean":"2024-04-25T02:28:08.480443+0000","last_became_active":"2024-04-25T02:23:13.841976+0000","last_became_peered":"2024-04-25T02:23:13.841976+0000","last_unstale":"2024-04-25T02:28:08.480443+0000","last_undegraded":"2024-04-25T02:28:08.480443+0000","last_fullsized":"2024-04-25T02:28:08.480443+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:16:25.998330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"43'401","reported_seq":486,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.511676+0000","last_change":"2024-04-25T02:23:13.843455+0000","last_active":"2024-04-25T02:28:10.511676+0000","last_peered":"2024-04-25T02:28:10.511676+0000","last_clean":"2024-04-25T02:28:10.511676+0000","last_became_active":"2024-04-25T02:23:13.842163+0000","last_became_peered":"2024-04-25T02:23:13.842163+0000","last_unstale":"2024-04-25T02:28:10.511676+0000","last_undegraded":"2024-04-25T02:28:10.511676+0000","last_fullsized":"2024-04-25T02:28:10.511676+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:59:59.924648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":18209,"num_write":378,"num_write_kb":67140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"43'57","reported_seq":96,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:06.534681+0000","last_change":"2024-04-25T02:23:13.839221+0000","last_active":"2024-04-25T02:28:06.534681+0000","last_peered":"2024-04-25T02:28:06.534681+0000","last_clean":"2024-04-25T02:28:06.534681+0000","last_became_active":"2024-04-25T02:23:13.838616+0000","last_became_peered":"2024-04-25T02:23:13.838616+0000","last_unstale":"2024-04-25T02:28:06.534681+0000","last_undegraded":"2024-04-25T02:28:06.534681+0000","last_fullsized":"2024-04-25T02:28:06.534681+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:24:48.817920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"43'445","reported_seq":564,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.358374+0000","last_change":"2024-04-25T02:23:13.842908+0000","last_active":"2024-04-25T02:28:12.358374+0000","last_peered":"2024-04-25T02:28:12.358374+0000","last_clean":"2024-04-25T02:28:12.358374+0000","last_became_active":"2024-04-25T02:23:13.842649+0000","last_became_peered":"2024-04-25T02:23:13.842649+0000","last_unstale":"2024-04-25T02:28:12.358374+0000","last_undegraded":"2024-04-25T02:28:12.358374+0000","last_fullsized":"2024-04-25T02:28:12.358374+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:04:07.758366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":37870,"num_write":411,"num_write_kb":80233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"43'62","reported_seq":99,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:06.530408+0000","last_change":"2024-04-25T02:23:11.835951+0000","last_active":"2024-04-25T02:28:06.530408+0000","last_peered":"2024-04-25T02:28:06.530408+0000","last_clean":"2024-04-25T02:28:06.530408+0000","last_became_active":"2024-04-25T02:23:11.835077+0000","last_became_peered":"2024-04-25T02:23:11.835077+0000","last_unstale":"2024-04-25T02:28:06.530408+0000","last_undegraded":"2024-04-25T02:28:06.530408+0000","last_fullsized":"2024-04-25T02:28:06.530408+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:24:42.651723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"43'381","reported_seq":511,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.565366+0000","last_change":"2024-04-25T02:23:13.843899+0000","last_active":"2024-04-25T02:28:09.565366+0000","last_peered":"2024-04-25T02:28:09.565366+0000","last_clean":"2024-04-25T02:28:09.565366+0000","last_became_active":"2024-04-25T02:23:13.843347+0000","last_became_peered":"2024-04-25T02:23:13.843347+0000","last_unstale":"2024-04-25T02:28:09.565366+0000","last_undegraded":"2024-04-25T02:28:09.565366+0000","last_fullsized":"2024-04-25T02:28:09.565366+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:46:23.518991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":42863,"num_write":360,"num_write_kb":59443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"43'199","reported_seq":236,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.531368+0000","last_change":"2024-04-25T02:23:11.839659+0000","last_active":"2024-04-25T02:28:09.531368+0000","last_peered":"2024-04-25T02:28:09.531368+0000","last_clean":"2024-04-25T02:28:09.531368+0000","last_became_active":"2024-04-25T02:23:11.839157+0000","last_became_peered":"2024-04-25T02:23:11.839157+0000","last_unstale":"2024-04-25T02:28:09.531368+0000","last_undegraded":"2024-04-25T02:28:09.531368+0000","last_fullsized":"2024-04-25T02:28:09.531368+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:06:42.930490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":142,"num_write_kb":4183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"43'395","reported_seq":461,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.523641+0000","last_change":"2024-04-25T02:23:13.841226+0000","last_active":"2024-04-25T02:28:09.523641+0000","last_peered":"2024-04-25T02:28:09.523641+0000","last_clean":"2024-04-25T02:28:09.523641+0000","last_became_active":"2024-04-25T02:23:13.840951+0000","last_became_peered":"2024-04-25T02:23:13.840951+0000","last_unstale":"2024-04-25T02:28:09.523641+0000","last_undegraded":"2024-04-25T02:28:09.523641+0000","last_fullsized":"2024-04-25T02:28:09.523641+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:16:58.212703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12931,"num_write":370,"num_write_kb":42530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"43'366","reported_seq":410,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:06.537151+0000","last_change":"2024-04-25T02:23:12.848098+0000","last_active":"2024-04-25T02:28:06.537151+0000","last_peered":"2024-04-25T02:28:06.537151+0000","last_clean":"2024-04-25T02:28:06.537151+0000","last_became_active":"2024-04-25T02:23:12.847813+0000","last_became_peered":"2024-04-25T02:23:12.847813+0000","last_unstale":"2024-04-25T02:28:06.537151+0000","last_undegraded":"2024-04-25T02:28:06.537151+0000","last_fullsized":"2024-04-25T02:28:06.537151+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:31:10.538399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":311,"num_write_kb":4273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"43'440","reported_seq":489,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.513229+0000","last_change":"2024-04-25T02:23:55.963573+0000","last_active":"2024-04-25T02:28:10.513229+0000","last_peered":"2024-04-25T02:28:10.513229+0000","last_clean":"2024-04-25T02:28:10.513229+0000","last_became_active":"2024-04-25T02:23:55.963234+0000","last_became_peered":"2024-04-25T02:23:55.963234+0000","last_unstale":"2024-04-25T02:28:10.513229+0000","last_undegraded":"2024-04-25T02:28:10.513229+0000","last_fullsized":"2024-04-25T02:28:10.513229+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:52:59.926648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21039,"num_write":415,"num_write_kb":62968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"43'594","reported_seq":637,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.538648+0000","last_change":"2024-04-25T02:23:13.848143+0000","last_active":"2024-04-25T02:28:08.538648+0000","last_peered":"2024-04-25T02:28:08.538648+0000","last_clean":"2024-04-25T02:28:08.538648+0000","last_became_active":"2024-04-25T02:23:13.843704+0000","last_became_peered":"2024-04-25T02:23:13.843704+0000","last_unstale":"2024-04-25T02:28:08.538648+0000","last_undegraded":"2024-04-25T02:28:08.538648+0000","last_fullsized":"2024-04-25T02:28:08.538648+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:54:31.975503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":532,"num_write_kb":4350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"43'406","reported_seq":491,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.513466+0000","last_change":"2024-04-25T02:23:13.847842+0000","last_active":"2024-04-25T02:28:10.513466+0000","last_peered":"2024-04-25T02:28:10.513466+0000","last_clean":"2024-04-25T02:28:10.513466+0000","last_became_active":"2024-04-25T02:23:13.845782+0000","last_became_peered":"2024-04-25T02:23:13.845782+0000","last_unstale":"2024-04-25T02:28:10.513466+0000","last_undegraded":"2024-04-25T02:28:10.513466+0000","last_fullsized":"2024-04-25T02:28:10.513466+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:56:46.820624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":24562,"num_write":375,"num_write_kb":59351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"43'59","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.490375+0000","last_change":"2024-04-25T02:23:13.842426+0000","last_active":"2024-04-25T02:28:09.490375+0000","last_peered":"2024-04-25T02:28:09.490375+0000","last_clean":"2024-04-25T02:28:09.490375+0000","last_became_active":"2024-04-25T02:23:13.841815+0000","last_became_peered":"2024-04-25T02:23:13.841815+0000","last_unstale":"2024-04-25T02:28:09.490375+0000","last_undegraded":"2024-04-25T02:28:09.490375+0000","last_fullsized":"2024-04-25T02:28:09.490375+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:20:54.760986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"43'457","reported_seq":573,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.366271+0000","last_change":"2024-04-25T02:23:11.839840+0000","last_active":"2024-04-25T02:28:12.366271+0000","last_peered":"2024-04-25T02:28:12.366271+0000","last_clean":"2024-04-25T02:28:12.366271+0000","last_became_active":"2024-04-25T02:23:11.837258+0000","last_became_peered":"2024-04-25T02:23:11.837258+0000","last_unstale":"2024-04-25T02:28:12.366271+0000","last_undegraded":"2024-04-25T02:28:12.366271+0000","last_fullsized":"2024-04-25T02:28:12.366271+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:49:17.616748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":40530,"num_write":421,"num_write_kb":133096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"43'128","reported_seq":175,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.513945+0000","last_change":"2024-04-25T02:23:13.838948+0000","last_active":"2024-04-25T02:28:08.513945+0000","last_peered":"2024-04-25T02:28:08.513945+0000","last_clean":"2024-04-25T02:28:08.513945+0000","last_became_active":"2024-04-25T02:23:13.838665+0000","last_became_peered":"2024-04-25T02:23:13.838665+0000","last_unstale":"2024-04-25T02:28:08.513945+0000","last_undegraded":"2024-04-25T02:28:08.513945+0000","last_fullsized":"2024-04-25T02:28:08.513945+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:29:28.670027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":66,"num_write_kb":8229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"43'438","reported_seq":515,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.346657+0000","last_change":"2024-04-25T02:23:55.963989+0000","last_active":"2024-04-25T02:28:12.346657+0000","last_peered":"2024-04-25T02:28:12.346657+0000","last_clean":"2024-04-25T02:28:12.346657+0000","last_became_active":"2024-04-25T02:23:55.963557+0000","last_became_peered":"2024-04-25T02:23:55.963557+0000","last_unstale":"2024-04-25T02:28:12.346657+0000","last_undegraded":"2024-04-25T02:28:12.346657+0000","last_fullsized":"2024-04-25T02:28:12.346657+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:01:58.293756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":25759,"num_write":403,"num_write_kb":59138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"43'254","reported_seq":296,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.515045+0000","last_change":"2024-04-25T02:23:13.843937+0000","last_active":"2024-04-25T02:28:08.515045+0000","last_peered":"2024-04-25T02:28:08.515045+0000","last_clean":"2024-04-25T02:28:08.515045+0000","last_became_active":"2024-04-25T02:23:13.843652+0000","last_became_peered":"2024-04-25T02:23:13.843652+0000","last_unstale":"2024-04-25T02:28:08.515045+0000","last_undegraded":"2024-04-25T02:28:08.515045+0000","last_fullsized":"2024-04-25T02:28:08.515045+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:13:15.374851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":4213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"43'382","reported_seq":415,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.507975+0000","last_change":"2024-04-25T02:23:56.302316+0000","last_active":"2024-04-25T02:28:09.507975+0000","last_peered":"2024-04-25T02:28:09.507975+0000","last_clean":"2024-04-25T02:28:09.507975+0000","last_became_active":"2024-04-25T02:23:56.301997+0000","last_became_peered":"2024-04-25T02:23:56.301997+0000","last_unstale":"2024-04-25T02:28:09.507975+0000","last_undegraded":"2024-04-25T02:28:09.507975+0000","last_fullsized":"2024-04-25T02:28:09.507975+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:39:22.081330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13585,"num_write":362,"num_write_kb":34032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"43'63","reported_seq":102,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.513793+0000","last_change":"2024-04-25T02:23:13.842533+0000","last_active":"2024-04-25T02:28:08.513793+0000","last_peered":"2024-04-25T02:28:08.513793+0000","last_clean":"2024-04-25T02:28:08.513793+0000","last_became_active":"2024-04-25T02:23:13.841049+0000","last_became_peered":"2024-04-25T02:23:13.841049+0000","last_unstale":"2024-04-25T02:28:08.513793+0000","last_undegraded":"2024-04-25T02:28:08.513793+0000","last_fullsized":"2024-04-25T02:28:08.513793+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:26:00.892546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"43'355","reported_seq":417,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.577849+0000","last_change":"2024-04-25T02:23:13.847171+0000","last_active":"2024-04-25T02:28:09.577849+0000","last_peered":"2024-04-25T02:28:09.577849+0000","last_clean":"2024-04-25T02:28:09.577849+0000","last_became_active":"2024-04-25T02:23:13.846425+0000","last_became_peered":"2024-04-25T02:23:13.846425+0000","last_unstale":"2024-04-25T02:28:09.577849+0000","last_undegraded":"2024-04-25T02:28:09.577849+0000","last_fullsized":"2024-04-25T02:28:09.577849+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:40:12.956129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":12898,"num_write":328,"num_write_kb":42412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"43'565","reported_seq":607,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.489808+0000","last_change":"2024-04-25T02:23:13.841178+0000","last_active":"2024-04-25T02:28:08.489808+0000","last_peered":"2024-04-25T02:28:08.489808+0000","last_clean":"2024-04-25T02:28:08.489808+0000","last_became_active":"2024-04-25T02:23:13.840876+0000","last_became_peered":"2024-04-25T02:23:13.840876+0000","last_unstale":"2024-04-25T02:28:08.489808+0000","last_undegraded":"2024-04-25T02:28:08.489808+0000","last_fullsized":"2024-04-25T02:28:08.489808+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:29:47.026682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":506,"num_write_kb":4331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"43'376","reported_seq":453,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.567149+0000","last_change":"2024-04-25T02:23:13.852754+0000","last_active":"2024-04-25T02:28:09.567149+0000","last_peered":"2024-04-25T02:28:09.567149+0000","last_clean":"2024-04-25T02:28:09.567149+0000","last_became_active":"2024-04-25T02:23:13.852398+0000","last_became_peered":"2024-04-25T02:23:13.852398+0000","last_unstale":"2024-04-25T02:28:09.567149+0000","last_undegraded":"2024-04-25T02:28:09.567149+0000","last_fullsized":"2024-04-25T02:28:09.567149+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:48:40.857184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31433,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":42,"num_read_kb":28255,"num_write":352,"num_write_kb":58406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":32,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T02:23:56.300797+0000","last_change":"2024-04-25T02:23:11.834419+0000","last_active":"2024-04-25T02:23:56.300797+0000","last_peered":"2024-04-25T02:23:56.300797+0000","last_clean":"2024-04-25T02:23:56.300797+0000","last_became_active":"2024-04-25T02:23:11.834171+0000","last_became_peered":"2024-04-25T02:23:11.834171+0000","last_unstale":"2024-04-25T02:23:56.300797+0000","last_undegraded":"2024-04-25T02:23:56.300797+0000","last_fullsized":"2024-04-25T02:23:56.300797+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:13:40.419554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"43'431","reported_seq":466,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.550365+0000","last_change":"2024-04-25T02:23:13.848449+0000","last_active":"2024-04-25T02:28:09.550365+0000","last_peered":"2024-04-25T02:28:09.550365+0000","last_clean":"2024-04-25T02:28:09.550365+0000","last_became_active":"2024-04-25T02:23:13.847970+0000","last_became_peered":"2024-04-25T02:23:13.847970+0000","last_unstale":"2024-04-25T02:28:09.550365+0000","last_undegraded":"2024-04-25T02:28:09.550365+0000","last_fullsized":"2024-04-25T02:28:09.550365+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:00:21.733260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":371,"num_write_kb":4349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"43'348","reported_seq":400,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.546640+0000","last_change":"2024-04-25T02:23:13.850097+0000","last_active":"2024-04-25T02:28:09.546640+0000","last_peered":"2024-04-25T02:28:09.546640+0000","last_clean":"2024-04-25T02:28:09.546640+0000","last_became_active":"2024-04-25T02:23:13.849556+0000","last_became_peered":"2024-04-25T02:23:13.849556+0000","last_unstale":"2024-04-25T02:28:09.546640+0000","last_undegraded":"2024-04-25T02:28:09.546640+0000","last_fullsized":"2024-04-25T02:28:09.546640+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:25:42.876612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2833,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":8777,"num_write":322,"num_write_kb":25948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T02:23:55.954130+0000","last_change":"2024-04-25T02:23:13.848430+0000","last_active":"2024-04-25T02:23:55.954130+0000","last_peered":"2024-04-25T02:23:55.954130+0000","last_clean":"2024-04-25T02:23:55.954130+0000","last_became_active":"2024-04-25T02:23:13.847888+0000","last_became_peered":"2024-04-25T02:23:13.847888+0000","last_unstale":"2024-04-25T02:23:55.954130+0000","last_undegraded":"2024-04-25T02:23:55.954130+0000","last_fullsized":"2024-04-25T02:23:55.954130+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:57:11.831417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"43'70","reported_seq":111,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.500879+0000","last_change":"2024-04-25T02:23:12.848598+0000","last_active":"2024-04-25T02:28:10.500879+0000","last_peered":"2024-04-25T02:28:10.500879+0000","last_clean":"2024-04-25T02:28:10.500879+0000","last_became_active":"2024-04-25T02:23:12.848312+0000","last_became_peered":"2024-04-25T02:23:12.848312+0000","last_unstale":"2024-04-25T02:28:10.500879+0000","last_undegraded":"2024-04-25T02:28:10.500879+0000","last_fullsized":"2024-04-25T02:28:10.500879+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:58:41.830406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"43'374","reported_seq":455,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.527667+0000","last_change":"2024-04-25T02:23:12.842182+0000","last_active":"2024-04-25T02:28:09.527667+0000","last_peered":"2024-04-25T02:28:09.527667+0000","last_clean":"2024-04-25T02:28:09.527667+0000","last_became_active":"2024-04-25T02:23:12.841408+0000","last_became_peered":"2024-04-25T02:23:12.841408+0000","last_unstale":"2024-04-25T02:28:09.527667+0000","last_undegraded":"2024-04-25T02:28:09.527667+0000","last_fullsized":"2024-04-25T02:28:09.527667+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:06:31.558059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5875,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":49,"num_read_kb":27937,"num_write":346,"num_write_kb":51359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T02:23:55.955840+0000","last_change":"2024-04-25T02:23:13.848743+0000","last_active":"2024-04-25T02:23:55.955840+0000","last_peered":"2024-04-25T02:23:55.955840+0000","last_clean":"2024-04-25T02:23:55.955840+0000","last_became_active":"2024-04-25T02:23:13.848076+0000","last_became_peered":"2024-04-25T02:23:13.848076+0000","last_unstale":"2024-04-25T02:23:55.955840+0000","last_undegraded":"2024-04-25T02:23:55.955840+0000","last_fullsized":"2024-04-25T02:23:55.955840+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:08:43.341421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"43'394","reported_seq":428,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:07.507384+0000","last_change":"2024-04-25T02:23:12.848506+0000","last_active":"2024-04-25T02:28:07.507384+0000","last_peered":"2024-04-25T02:28:07.507384+0000","last_clean":"2024-04-25T02:28:07.507384+0000","last_became_active":"2024-04-25T02:23:12.848229+0000","last_became_peered":"2024-04-25T02:23:12.848229+0000","last_unstale":"2024-04-25T02:28:07.507384+0000","last_undegraded":"2024-04-25T02:28:07.507384+0000","last_fullsized":"2024-04-25T02:28:07.507384+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:24:34.129737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":337,"num_write_kb":8338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"43'343","reported_seq":393,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.527852+0000","last_change":"2024-04-25T02:23:11.835239+0000","last_active":"2024-04-25T02:28:09.527852+0000","last_peered":"2024-04-25T02:28:09.527852+0000","last_clean":"2024-04-25T02:28:09.527852+0000","last_became_active":"2024-04-25T02:23:11.834994+0000","last_became_peered":"2024-04-25T02:23:11.834994+0000","last_unstale":"2024-04-25T02:28:09.527852+0000","last_undegraded":"2024-04-25T02:28:09.527852+0000","last_fullsized":"2024-04-25T02:28:09.527852+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:51.196318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1068,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":11931,"num_write":324,"num_write_kb":25986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":42,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T02:23:55.951912+0000","last_change":"2024-04-25T02:23:13.849321+0000","last_active":"2024-04-25T02:23:55.951912+0000","last_peered":"2024-04-25T02:23:55.951912+0000","last_clean":"2024-04-25T02:23:55.951912+0000","last_became_active":"2024-04-25T02:23:13.848628+0000","last_became_peered":"2024-04-25T02:23:13.848628+0000","last_unstale":"2024-04-25T02:23:55.951912+0000","last_undegraded":"2024-04-25T02:23:55.951912+0000","last_fullsized":"2024-04-25T02:23:55.951912+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:46:12.919462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"22'115","reported_seq":192,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T02:23:56.300317+0000","last_change":"2024-04-25T02:23:11.836134+0000","last_active":"2024-04-25T02:23:56.300317+0000","last_peered":"2024-04-25T02:23:56.300317+0000","last_clean":"2024-04-25T02:23:56.300317+0000","last_became_active":"2024-04-25T02:23:11.835430+0000","last_became_peered":"2024-04-25T02:23:11.835430+0000","last_unstale":"2024-04-25T02:23:56.300317+0000","last_undegraded":"2024-04-25T02:23:56.300317+0000","last_fullsized":"2024-04-25T02:23:56.300317+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:08.432182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:08.432182+0000","last_clean_scrub_stamp":"2024-04-25T02:20:08.432182+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:45:18.572525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"43'573","reported_seq":612,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:06.518918+0000","last_change":"2024-04-25T02:23:13.848149+0000","last_active":"2024-04-25T02:28:06.518918+0000","last_peered":"2024-04-25T02:28:06.518918+0000","last_clean":"2024-04-25T02:28:06.518918+0000","last_became_active":"2024-04-25T02:23:13.845029+0000","last_became_peered":"2024-04-25T02:23:13.845029+0000","last_unstale":"2024-04-25T02:28:06.518918+0000","last_undegraded":"2024-04-25T02:28:06.518918+0000","last_fullsized":"2024-04-25T02:28:06.518918+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":573,"log_dups_size":0,"ondisk_log_size":573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:17.775866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":507,"num_write_kb":8447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"43'444","reported_seq":555,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.494479+0000","last_change":"2024-04-25T02:23:13.848481+0000","last_active":"2024-04-25T02:28:10.494479+0000","last_peered":"2024-04-25T02:28:10.494479+0000","last_clean":"2024-04-25T02:28:10.494479+0000","last_became_active":"2024-04-25T02:23:13.844018+0000","last_became_peered":"2024-04-25T02:23:13.844018+0000","last_unstale":"2024-04-25T02:28:10.494479+0000","last_undegraded":"2024-04-25T02:28:10.494479+0000","last_fullsized":"2024-04-25T02:28:10.494479+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:28:48.151869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":31679,"num_write":414,"num_write_kb":80533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T02:23:55.950509+0000","last_change":"2024-04-25T02:23:13.848526+0000","last_active":"2024-04-25T02:23:55.950509+0000","last_peered":"2024-04-25T02:23:55.950509+0000","last_clean":"2024-04-25T02:23:55.950509+0000","last_became_active":"2024-04-25T02:23:13.844753+0000","last_became_peered":"2024-04-25T02:23:13.844753+0000","last_unstale":"2024-04-25T02:23:55.950509+0000","last_undegraded":"2024-04-25T02:23:55.950509+0000","last_fullsized":"2024-04-25T02:23:55.950509+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:01:01.038928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"43'252","reported_seq":474,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.479947+0000","last_change":"2024-04-25T02:23:12.845945+0000","last_active":"2024-04-25T02:28:12.479947+0000","last_peered":"2024-04-25T02:28:12.479947+0000","last_clean":"2024-04-25T02:28:12.479947+0000","last_became_active":"2024-04-25T02:23:12.845638+0000","last_became_peered":"2024-04-25T02:23:12.845638+0000","last_unstale":"2024-04-25T02:28:12.479947+0000","last_undegraded":"2024-04-25T02:28:12.479947+0000","last_fullsized":"2024-04-25T02:28:12.479947+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:47:37.213557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1460763,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":182,"num_read_kb":1548,"num_write":182,"num_write_kb":1548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"43'454","reported_seq":572,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.366366+0000","last_change":"2024-04-25T02:23:11.840630+0000","last_active":"2024-04-25T02:28:12.366366+0000","last_peered":"2024-04-25T02:28:12.366366+0000","last_clean":"2024-04-25T02:28:12.366366+0000","last_became_active":"2024-04-25T02:23:11.840215+0000","last_became_peered":"2024-04-25T02:23:11.840215+0000","last_unstale":"2024-04-25T02:28:12.366366+0000","last_undegraded":"2024-04-25T02:28:12.366366+0000","last_fullsized":"2024-04-25T02:28:12.366366+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:18:40.221229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":42224,"num_write":426,"num_write_kb":96444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T02:23:55.953079+0000","last_change":"2024-04-25T02:23:13.845169+0000","last_active":"2024-04-25T02:23:55.953079+0000","last_peered":"2024-04-25T02:23:55.953079+0000","last_clean":"2024-04-25T02:23:55.953079+0000","last_became_active":"2024-04-25T02:23:13.841324+0000","last_became_peered":"2024-04-25T02:23:13.841324+0000","last_unstale":"2024-04-25T02:23:55.953079+0000","last_undegraded":"2024-04-25T02:23:55.953079+0000","last_fullsized":"2024-04-25T02:23:55.953079+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:23.490432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"43'52","reported_seq":84,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.493200+0000","last_change":"2024-04-25T02:23:12.842493+0000","last_active":"2024-04-25T02:28:09.493200+0000","last_peered":"2024-04-25T02:28:09.493200+0000","last_clean":"2024-04-25T02:28:09.493200+0000","last_became_active":"2024-04-25T02:23:12.841930+0000","last_became_peered":"2024-04-25T02:23:12.841930+0000","last_unstale":"2024-04-25T02:28:09.493200+0000","last_undegraded":"2024-04-25T02:28:09.493200+0000","last_fullsized":"2024-04-25T02:28:09.493200+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:36:52.589994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"43'427","reported_seq":585,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.347197+0000","last_change":"2024-04-25T02:23:12.848221+0000","last_active":"2024-04-25T02:28:12.347197+0000","last_peered":"2024-04-25T02:28:12.347197+0000","last_clean":"2024-04-25T02:28:12.347197+0000","last_became_active":"2024-04-25T02:23:12.847949+0000","last_became_peered":"2024-04-25T02:23:12.847949+0000","last_unstale":"2024-04-25T02:28:12.347197+0000","last_undegraded":"2024-04-25T02:28:12.347197+0000","last_fullsized":"2024-04-25T02:28:12.347197+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:17.728665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":62452,"num_write":394,"num_write_kb":105065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"43'65","reported_seq":108,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.539979+0000","last_change":"2024-04-25T02:23:13.844968+0000","last_active":"2024-04-25T02:28:09.539979+0000","last_peered":"2024-04-25T02:28:09.539979+0000","last_clean":"2024-04-25T02:28:09.539979+0000","last_became_active":"2024-04-25T02:23:13.844133+0000","last_became_peered":"2024-04-25T02:23:13.844133+0000","last_unstale":"2024-04-25T02:28:09.539979+0000","last_undegraded":"2024-04-25T02:28:09.539979+0000","last_fullsized":"2024-04-25T02:28:09.539979+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:02.533959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":32,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T02:23:56.301608+0000","last_change":"2024-04-25T02:23:11.837086+0000","last_active":"2024-04-25T02:23:56.301608+0000","last_peered":"2024-04-25T02:23:56.301608+0000","last_clean":"2024-04-25T02:23:56.301608+0000","last_became_active":"2024-04-25T02:23:11.836737+0000","last_became_peered":"2024-04-25T02:23:11.836737+0000","last_unstale":"2024-04-25T02:23:56.301608+0000","last_undegraded":"2024-04-25T02:23:56.301608+0000","last_fullsized":"2024-04-25T02:23:56.301608+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:10:23.058045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"43'426","reported_seq":558,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.498442+0000","last_change":"2024-04-25T02:23:13.848280+0000","last_active":"2024-04-25T02:28:09.498442+0000","last_peered":"2024-04-25T02:28:09.498442+0000","last_clean":"2024-04-25T02:28:09.498442+0000","last_became_active":"2024-04-25T02:23:13.843915+0000","last_became_peered":"2024-04-25T02:23:13.843915+0000","last_unstale":"2024-04-25T02:28:09.498442+0000","last_undegraded":"2024-04-25T02:28:09.498442+0000","last_fullsized":"2024-04-25T02:28:09.498442+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:25:56.800969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":48451,"num_write":406,"num_write_kb":112597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T02:23:55.954435+0000","last_change":"2024-04-25T02:23:13.839018+0000","last_active":"2024-04-25T02:23:55.954435+0000","last_peered":"2024-04-25T02:23:55.954435+0000","last_clean":"2024-04-25T02:23:55.954435+0000","last_became_active":"2024-04-25T02:23:13.838746+0000","last_became_peered":"2024-04-25T02:23:13.838746+0000","last_unstale":"2024-04-25T02:23:55.954435+0000","last_undegraded":"2024-04-25T02:23:55.954435+0000","last_fullsized":"2024-04-25T02:23:55.954435+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:33:00.283023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"43'85","reported_seq":124,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.494558+0000","last_change":"2024-04-25T02:23:11.840837+0000","last_active":"2024-04-25T02:28:10.494558+0000","last_peered":"2024-04-25T02:28:10.494558+0000","last_clean":"2024-04-25T02:28:10.494558+0000","last_became_active":"2024-04-25T02:23:11.840553+0000","last_became_peered":"2024-04-25T02:23:11.840553+0000","last_unstale":"2024-04-25T02:28:10.494558+0000","last_undegraded":"2024-04-25T02:28:10.494558+0000","last_fullsized":"2024-04-25T02:28:10.494558+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:56:05.056497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":72,"num_write_kb":962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"43'392","reported_seq":479,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.563733+0000","last_change":"2024-04-25T02:23:13.848907+0000","last_active":"2024-04-25T02:28:09.563733+0000","last_peered":"2024-04-25T02:28:09.563733+0000","last_clean":"2024-04-25T02:28:09.563733+0000","last_became_active":"2024-04-25T02:23:13.848374+0000","last_became_peered":"2024-04-25T02:23:13.848374+0000","last_unstale":"2024-04-25T02:28:09.563733+0000","last_undegraded":"2024-04-25T02:28:09.563733+0000","last_fullsized":"2024-04-25T02:28:09.563733+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:31:18.538296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":25341,"num_write":367,"num_write_kb":104771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"43'122","reported_seq":163,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:07.496913+0000","last_change":"2024-04-25T02:23:13.842766+0000","last_active":"2024-04-25T02:28:07.496913+0000","last_peered":"2024-04-25T02:28:07.496913+0000","last_clean":"2024-04-25T02:28:07.496913+0000","last_became_active":"2024-04-25T02:23:13.842438+0000","last_became_peered":"2024-04-25T02:23:13.842438+0000","last_unstale":"2024-04-25T02:28:07.496913+0000","last_undegraded":"2024-04-25T02:28:07.496913+0000","last_fullsized":"2024-04-25T02:28:07.496913+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:25:58.471982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4196548,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"43'364","reported_seq":446,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.565407+0000","last_change":"2024-04-25T02:23:12.844587+0000","last_active":"2024-04-25T02:28:09.565407+0000","last_peered":"2024-04-25T02:28:09.565407+0000","last_clean":"2024-04-25T02:28:09.565407+0000","last_became_active":"2024-04-25T02:23:12.844258+0000","last_became_peered":"2024-04-25T02:23:12.844258+0000","last_unstale":"2024-04-25T02:28:09.565407+0000","last_undegraded":"2024-04-25T02:28:09.565407+0000","last_fullsized":"2024-04-25T02:28:09.565407+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:32:01.305698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":25157,"num_write":340,"num_write_kb":59328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"43'316","reported_seq":349,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.539079+0000","last_change":"2024-04-25T02:23:11.833629+0000","last_active":"2024-04-25T02:28:08.539079+0000","last_peered":"2024-04-25T02:28:08.539079+0000","last_clean":"2024-04-25T02:28:08.539079+0000","last_became_active":"2024-04-25T02:23:11.833348+0000","last_became_peered":"2024-04-25T02:23:11.833348+0000","last_unstale":"2024-04-25T02:28:08.539079+0000","last_undegraded":"2024-04-25T02:28:08.539079+0000","last_fullsized":"2024-04-25T02:28:08.539079+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:10:06.587875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":262,"num_write_kb":4264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"43'363","reported_seq":452,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.576469+0000","last_change":"2024-04-25T02:23:55.963928+0000","last_active":"2024-04-25T02:28:09.576469+0000","last_peered":"2024-04-25T02:28:09.576469+0000","last_clean":"2024-04-25T02:28:09.576469+0000","last_became_active":"2024-04-25T02:23:55.963467+0000","last_became_peered":"2024-04-25T02:23:55.963467+0000","last_unstale":"2024-04-25T02:28:09.576469+0000","last_undegraded":"2024-04-25T02:28:09.576469+0000","last_fullsized":"2024-04-25T02:28:09.576469+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:16:59.986839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":32821,"num_write":343,"num_write_kb":62943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"43'323","reported_seq":370,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.542548+0000","last_change":"2024-04-25T02:23:13.842735+0000","last_active":"2024-04-25T02:28:08.542548+0000","last_peered":"2024-04-25T02:28:08.542548+0000","last_clean":"2024-04-25T02:28:08.542548+0000","last_became_active":"2024-04-25T02:23:13.840492+0000","last_became_peered":"2024-04-25T02:23:13.840492+0000","last_unstale":"2024-04-25T02:28:08.542548+0000","last_undegraded":"2024-04-25T02:28:08.542548+0000","last_fullsized":"2024-04-25T02:28:08.542548+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:25:52.486919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":257,"num_write_kb":12449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"43'377","reported_seq":436,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.550631+0000","last_change":"2024-04-25T02:23:13.848028+0000","last_active":"2024-04-25T02:28:09.550631+0000","last_peered":"2024-04-25T02:28:09.550631+0000","last_clean":"2024-04-25T02:28:09.550631+0000","last_became_active":"2024-04-25T02:23:13.847264+0000","last_became_peered":"2024-04-25T02:23:13.847264+0000","last_unstale":"2024-04-25T02:28:09.550631+0000","last_undegraded":"2024-04-25T02:28:09.550631+0000","last_fullsized":"2024-04-25T02:28:09.550631+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:16.329989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":15655,"num_write":352,"num_write_kb":42131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"43'93","reported_seq":132,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.520240+0000","last_change":"2024-04-25T02:23:13.848227+0000","last_active":"2024-04-25T02:28:09.520240+0000","last_peered":"2024-04-25T02:28:09.520240+0000","last_clean":"2024-04-25T02:28:09.520240+0000","last_became_active":"2024-04-25T02:23:13.845143+0000","last_became_peered":"2024-04-25T02:23:13.845143+0000","last_unstale":"2024-04-25T02:28:09.520240+0000","last_undegraded":"2024-04-25T02:28:09.520240+0000","last_fullsized":"2024-04-25T02:28:09.520240+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:54.494068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":4121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"43'427","reported_seq":461,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.348765+0000","last_change":"2024-04-25T02:23:55.957176+0000","last_active":"2024-04-25T02:28:12.348765+0000","last_peered":"2024-04-25T02:28:12.348765+0000","last_clean":"2024-04-25T02:28:12.348765+0000","last_became_active":"2024-04-25T02:23:55.956828+0000","last_became_peered":"2024-04-25T02:23:55.956828+0000","last_unstale":"2024-04-25T02:28:12.348765+0000","last_undegraded":"2024-04-25T02:28:12.348765+0000","last_fullsized":"2024-04-25T02:28:12.348765+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:36:31.942552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":14079,"num_write":394,"num_write_kb":87521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"43'111","reported_seq":146,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.475749+0000","last_change":"2024-04-25T02:23:11.839479+0000","last_active":"2024-04-25T02:28:09.475749+0000","last_peered":"2024-04-25T02:28:09.475749+0000","last_clean":"2024-04-25T02:28:09.475749+0000","last_became_active":"2024-04-25T02:23:11.838807+0000","last_became_peered":"2024-04-25T02:23:11.838807+0000","last_unstale":"2024-04-25T02:28:09.475749+0000","last_undegraded":"2024-04-25T02:28:09.475749+0000","last_fullsized":"2024-04-25T02:28:09.475749+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:08:41.334897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":59,"num_write_kb":4127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"43'439","reported_seq":512,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.539487+0000","last_change":"2024-04-25T02:23:12.845755+0000","last_active":"2024-04-25T02:28:09.539487+0000","last_peered":"2024-04-25T02:28:09.539487+0000","last_clean":"2024-04-25T02:28:09.539487+0000","last_became_active":"2024-04-25T02:23:12.845497+0000","last_became_peered":"2024-04-25T02:23:12.845497+0000","last_unstale":"2024-04-25T02:28:09.539487+0000","last_undegraded":"2024-04-25T02:28:09.539487+0000","last_fullsized":"2024-04-25T02:28:09.539487+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:04:37.689024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15742,"num_write":414,"num_write_kb":51315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"43'409","reported_seq":474,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.566592+0000","last_change":"2024-04-25T02:23:12.847086+0000","last_active":"2024-04-25T02:28:09.566592+0000","last_peered":"2024-04-25T02:28:09.566592+0000","last_clean":"2024-04-25T02:28:09.566592+0000","last_became_active":"2024-04-25T02:23:12.846719+0000","last_became_peered":"2024-04-25T02:23:12.846719+0000","last_unstale":"2024-04-25T02:28:09.566592+0000","last_undegraded":"2024-04-25T02:28:09.566592+0000","last_fullsized":"2024-04-25T02:28:09.566592+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:19.196820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6904,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":16944,"num_write":388,"num_write_kb":35957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"43'428","reported_seq":472,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.490081+0000","last_change":"2024-04-25T02:23:56.302118+0000","last_active":"2024-04-25T02:28:10.490081+0000","last_peered":"2024-04-25T02:28:10.490081+0000","last_clean":"2024-04-25T02:28:10.490081+0000","last_became_active":"2024-04-25T02:23:56.301745+0000","last_became_peered":"2024-04-25T02:23:56.301745+0000","last_unstale":"2024-04-25T02:28:10.490081+0000","last_undegraded":"2024-04-25T02:28:10.490081+0000","last_fullsized":"2024-04-25T02:28:10.490081+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:22:47.665187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":12557,"num_write":410,"num_write_kb":77332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"43'492","reported_seq":560,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.356441+0000","last_change":"2024-04-25T02:23:13.844518+0000","last_active":"2024-04-25T02:28:12.356441+0000","last_peered":"2024-04-25T02:28:12.356441+0000","last_clean":"2024-04-25T02:28:12.356441+0000","last_became_active":"2024-04-25T02:23:13.844235+0000","last_became_peered":"2024-04-25T02:23:13.844235+0000","last_unstale":"2024-04-25T02:28:12.356441+0000","last_undegraded":"2024-04-25T02:28:12.356441+0000","last_fullsized":"2024-04-25T02:28:12.356441+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:01:33.237637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14237,"num_write":458,"num_write_kb":116854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"43'385","reported_seq":464,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.522953+0000","last_change":"2024-04-25T02:23:13.849525+0000","last_active":"2024-04-25T02:28:09.522953+0000","last_peered":"2024-04-25T02:28:09.522953+0000","last_clean":"2024-04-25T02:28:09.522953+0000","last_became_active":"2024-04-25T02:23:13.845193+0000","last_became_peered":"2024-04-25T02:23:13.845193+0000","last_unstale":"2024-04-25T02:28:09.522953+0000","last_undegraded":"2024-04-25T02:28:09.522953+0000","last_fullsized":"2024-04-25T02:28:09.522953+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:17:33.318731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":36152,"num_write":360,"num_write_kb":54497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"43'396","reported_seq":497,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.509416+0000","last_change":"2024-04-25T02:23:12.842342+0000","last_active":"2024-04-25T02:28:09.509416+0000","last_peered":"2024-04-25T02:28:09.509416+0000","last_clean":"2024-04-25T02:28:09.509416+0000","last_became_active":"2024-04-25T02:23:12.841677+0000","last_became_peered":"2024-04-25T02:23:12.841677+0000","last_unstale":"2024-04-25T02:28:09.509416+0000","last_undegraded":"2024-04-25T02:28:09.509416+0000","last_fullsized":"2024-04-25T02:28:09.509416+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:27.480264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1755,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":69,"num_read_kb":32628,"num_write":373,"num_write_kb":79888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":191495,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":2779,"num_read_kb":1446401,"num_write":24360,"num_write_kb":4320360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":446464,"data_stored":307859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25946,"ondisk_log_size":25946,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":129260201,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":231,"num_read_kb":1603,"num_write":6638,"num_write_kb":130844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":258179072,"data_stored":258078095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39115,"internal_metadata":0},"log_size":8473,"ondisk_log_size":8473,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":31,"seq":133143986238,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":389720,"kb_used_data":88336,"kb_used_omap":9,"kb_used_meta":301366,"kb_avail":93982120,"statfs":{"total":96636764160,"available":96237690880,"internally_reserved":0,"allocated":90456064,"data_stored":90215784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9975,"internal_metadata":308599049},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:27:15 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.35799999999999998,"15min":0.34100000000000003},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":3.5409999999999999,"5min":3.5409999999999999,"15min":3.5409999999999999},"last":0.307},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.40899999999999997,"15min":0.36899999999999999},"min":{"1min":0.161,"5min":0.161,"15min":0.161},"max":{"1min":3.613,"5min":3.613,"15min":3.613},"last":0.29399999999999998}]},{"osd":1,"last update":"Thu Apr 25 02:27:15 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.38900000000000001,"15min":0.36499999999999999},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":3.0009999999999999,"5min":3.0009999999999999,"15min":3.0009999999999999},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.39800000000000002,"15min":0.373},"min":{"1min":0.157,"5min":0.157,"15min":0.157},"max":{"1min":4.9720000000000004,"5min":4.9720000000000004,"15min":4.9720000000000004},"last":0.34399999999999997}]},{"osd":2,"last update":"Thu Apr 25 02:27:15 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.43099999999999999,"15min":0.38},"min":{"1min":0.17599999999999999,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":4.883,"5min":4.883,"15min":4.883},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.40300000000000002,"15min":0.38500000000000001},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":3.0550000000000002,"5min":3.0550000000000002,"15min":3.0550000000000002},"last":0.32200000000000001}]}]},{"osd":2,"up_from":30,"seq":128849018942,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":362480,"kb_used_data":57064,"kb_used_omap":8,"kb_used_meta":305399,"kb_avail":94009360,"statfs":{"total":96636764160,"available":96265584640,"internally_reserved":0,"allocated":58433536,"data_stored":58118799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8387,"internal_metadata":312729405},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:27:18 2024","interfaces":[{"interface":"back","average":{"1min":0.248,"5min":0.313,"15min":0.32000000000000001},"min":{"1min":0.14199999999999999,"5min":0.14199999999999999,"15min":0.14199999999999999},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.251,"5min":0.32700000000000001,"15min":0.33000000000000002},"min":{"1min":0.16400000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.38800000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"last":0.29599999999999999}]},{"osd":1,"last update":"Thu Apr 25 02:27:18 2024","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.34499999999999997,"15min":0.34599999999999997},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.32500000000000001,"5min":0.35199999999999998,"15min":0.34999999999999998},"min":{"1min":0.17599999999999999,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.313}]},{"osd":3,"last update":"Thu Apr 25 02:27:18 2024","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.35299999999999998,"15min":0.35499999999999998},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.36799999999999999}]}]},{"osd":0,"up_from":28,"seq":120259084351,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369380,"kb_used_data":59740,"kb_used_omap":15,"kb_used_meta":309616,"kb_avail":94002460,"statfs":{"total":96636764160,"available":96258519040,"internally_reserved":0,"allocated":61173760,"data_stored":60940630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15790,"internal_metadata":317047378},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 25 02:27:16 2024","interfaces":[{"interface":"back","average":{"1min":0.23100000000000001,"5min":0.32500000000000001,"15min":0.33600000000000002},"min":{"1min":0.14799999999999999,"5min":0.14799999999999999,"15min":0.14799999999999999},"max":{"1min":0.375,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.307},{"interface":"front","average":{"1min":0.27500000000000002,"5min":0.34599999999999997,"15min":0.35799999999999998},"min":{"1min":0.17000000000000001,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.32500000000000001}]},{"osd":2,"last update":"Thu Apr 25 02:27:16 2024","interfaces":[{"interface":"back","average":{"1min":0.30099999999999999,"5min":0.36399999999999999,"15min":0.378},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.42699999999999999,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.28000000000000003,"5min":0.36499999999999999,"15min":0.38300000000000001},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.41399999999999998,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.378}]},{"osd":3,"last update":"Thu Apr 25 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.39000000000000001,"15min":0.38400000000000001},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":2.8069999999999999,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.30099999999999999,"5min":0.39900000000000002,"15min":0.42099999999999999},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.47499999999999998,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.40999999999999998}]}]},{"osd":1,"up_from":29,"seq":124554051646,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":351096,"kb_used_data":53744,"kb_used_omap":4,"kb_used_meta":297339,"kb_avail":94020744,"statfs":{"total":96636764160,"available":96277241856,"internally_reserved":0,"allocated":55033856,"data_stored":54197308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4963,"internal_metadata":304475293},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:27:13 2024","interfaces":[{"interface":"back","average":{"1min":0.248,"5min":0.313,"15min":0.32700000000000001},"min":{"1min":0.155,"5min":0.155,"15min":0.155},"max":{"1min":0.41799999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.219},{"interface":"front","average":{"1min":0.26000000000000001,"5min":0.33300000000000002,"15min":0.35099999999999998},"min":{"1min":0.17599999999999999,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.39600000000000002,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.245}]},{"osd":2,"last update":"Thu Apr 25 02:27:13 2024","interfaces":[{"interface":"back","average":{"1min":0.28599999999999998,"5min":0.34499999999999997,"15min":0.35199999999999998},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.437,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.35899999999999999,"15min":0.36299999999999999},"min":{"1min":0.17000000000000001,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.20399999999999999}]},{"osd":3,"last update":"Thu Apr 25 02:27:13 2024","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.38400000000000001,"15min":0.39800000000000002},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.46899999999999997,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.378,"15min":0.39000000000000001},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.23499999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":60215296,"data_stored":60184605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15790,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":50343936,"data_stored":50332293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4963,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57528320,"data_stored":57511070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8387,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90091520,"data_stored":90050127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9975,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":446464,"data_stored":307859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:28:15.665 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:28:15.816 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.812+0000 7ff2b968c700 1 Processor -- start 2024-04-25T02:28:15.816 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.812+0000 7ff2b968c700 1 -- start start 2024-04-25T02:28:15.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.813+0000 7ff2b968c700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7ff2b40b4fd0 0x7ff2b40a2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:15.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.813+0000 7ff2b968c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff2b40a3980 0x7ff2b40a3d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:15.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.813+0000 7ff2b968c700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2b40a46d0 con 0x7ff2b413ea00 2024-04-25T02:28:15.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.813+0000 7ff2b968c700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2b40a6710 con 0x7ff2b40b4fd0 2024-04-25T02:28:15.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.813+0000 7ff2b968c700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b40a4930 con 0x7ff2b40a3980 2024-04-25T02:28:15.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.813+0000 7ff2b27fc700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff2b40a3980 0x7ff2b40a3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:15.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.813+0000 7ff2b2ffd700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7ff2b40b4fd0 0x7ff2b40a2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:15.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.813+0000 7ff2b37fe700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7ff2b413ea00 0x7ff2b413eea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:33412/0 (socket says 172.21.15.111:33412) 2024-04-25T02:28:15.818 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.813+0000 7ff2b37fe700 1 -- 172.21.15.111:0/447178700 learned_addr learned my addr 172.21.15.111:0/447178700 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:28:15.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.813+0000 7ff2b2ffd700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7ff2b40b4fd0 0x7ff2b40a2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48542/0 (socket says 172.21.15.111:48542) 2024-04-25T02:28:15.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.813+0000 7ff2b27fc700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff2b40a3980 0x7ff2b40a3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:53822/0 (socket says 172.21.15.111:53822) 2024-04-25T02:28:15.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.813+0000 7ff2b2ffd700 1 -- 172.21.15.111:0/447178700 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff2b40a3980 msgr2=0x7ff2b40a3d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:15.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.813+0000 7ff2b2ffd700 1 --2- 172.21.15.111:0/447178700 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff2b40a3980 0x7ff2b40a3d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:15.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.813+0000 7ff2b2ffd700 1 -- 172.21.15.111:0/447178700 >> v1:172.21.15.111:6789/0 conn(0x7ff2b413ea00 legacy=0x7ff2b413eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:15.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.813+0000 7ff2b2ffd700 1 -- 172.21.15.111:0/447178700 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2b40a31a0 con 0x7ff2b40b4fd0 2024-04-25T02:28:15.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.813+0000 7ff2b1ffb700 1 -- 172.21.15.111:0/447178700 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2274872043 0 0) 0x7ff2b40a46d0 con 0x7ff2b413ea00 2024-04-25T02:28:15.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.813+0000 7ff2b27fc700 1 --2- 172.21.15.111:0/447178700 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff2b40a3980 0x7ff2b40a3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:15.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.813+0000 7ff2b2ffd700 1 --2- 172.21.15.111:0/447178700 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff2b40b4fd0 0x7ff2b40a2560 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff2a80098e0 tx=0x7ff2a80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aba107c083867c62 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:15.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.813+0000 7ff2b1ffb700 1 -- 172.21.15.111:0/447178700 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a800b640 con 0x7ff2b40b4fd0 2024-04-25T02:28:15.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.813+0000 7ff2b1ffb700 1 -- 172.21.15.111:0/447178700 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2a800b7a0 con 0x7ff2b40b4fd0 2024-04-25T02:28:15.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.813+0000 7ff2b1ffb700 1 -- 172.21.15.111:0/447178700 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2a800bb40 con 0x7ff2b40b4fd0 2024-04-25T02:28:15.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.814+0000 7ff2b968c700 1 -- 172.21.15.111:0/447178700 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff2b40b4fd0 msgr2=0x7ff2b40a2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:15.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.814+0000 7ff2b968c700 1 --2- 172.21.15.111:0/447178700 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff2b40b4fd0 0x7ff2b40a2560 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7ff2a80098e0 tx=0x7ff2a80091a0 comp rx=0 tx=0).stop 2024-04-25T02:28:15.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.814+0000 7ff2b968c700 1 -- 172.21.15.111:0/447178700 shutdown_connections 2024-04-25T02:28:15.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.814+0000 7ff2b968c700 1 --2- 172.21.15.111:0/447178700 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff2b40b4fd0 0x7ff2b40a2560 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:15.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.814+0000 7ff2b968c700 1 --2- 172.21.15.111:0/447178700 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff2b40a3980 0x7ff2b40a3d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:15.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.814+0000 7ff2b968c700 1 -- 172.21.15.111:0/447178700 >> 172.21.15.111:0/447178700 conn(0x7ff2b40883e0 msgr2=0x7ff2b4068b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:15.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.814+0000 7ff2b968c700 1 -- 172.21.15.111:0/447178700 shutdown_connections 2024-04-25T02:28:15.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.814+0000 7ff2b968c700 1 -- 172.21.15.111:0/447178700 wait complete. 2024-04-25T02:28:15.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.815+0000 7ff2b968c700 1 Processor -- start 2024-04-25T02:28:15.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.815+0000 7ff2b968c700 1 -- start start 2024-04-25T02:28:15.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.816+0000 7ff2b968c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff2b40a3980 0x7ff2b4151cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:15.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.816+0000 7ff2b968c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff2b40b4fd0 0x7ff2b4142d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:15.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.816+0000 7ff2b968c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff2b413ea00 0x7ff2b41436b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:15.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.816+0000 7ff2b968c700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b413d4b0 con 0x7ff2b40b4fd0 2024-04-25T02:28:15.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.816+0000 7ff2b968c700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b41433f0 con 0x7ff2b413ea00 2024-04-25T02:28:15.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.816+0000 7ff2b968c700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7ff2b413e0c0 con 0x7ff2b40a3980 2024-04-25T02:28:15.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.816+0000 7ff2b27fc700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff2b40b4fd0 0x7ff2b4142d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:15.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.816+0000 7ff2b37fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff2b413ea00 0x7ff2b41436b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:15.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.816+0000 7ff2b2ffd700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff2b40a3980 0x7ff2b4151cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:15.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.816+0000 7ff2b27fc700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff2b40b4fd0 0x7ff2b4142d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48544/0 (socket says 172.21.15.111:48544) 2024-04-25T02:28:15.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.816+0000 7ff2b27fc700 1 -- 172.21.15.111:0/2536275827 learned_addr learned my addr 172.21.15.111:0/2536275827 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:28:15.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.816+0000 7ff2b37fe700 1 -- 172.21.15.111:0/2536275827 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff2b40a3980 msgr2=0x7ff2b4151cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:15.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.816+0000 7ff2b37fe700 1 --2- 172.21.15.111:0/2536275827 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff2b40a3980 0x7ff2b4151cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:15.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.816+0000 7ff2b37fe700 1 -- 172.21.15.111:0/2536275827 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff2b40b4fd0 msgr2=0x7ff2b4142d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:15.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.816+0000 7ff2b37fe700 1 --2- 172.21.15.111:0/2536275827 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff2b40b4fd0 0x7ff2b4142d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:15.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.816+0000 7ff2b37fe700 1 -- 172.21.15.111:0/2536275827 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2a4009420 con 0x7ff2b413ea00 2024-04-25T02:28:15.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.816+0000 7ff2b27fc700 1 --2- 172.21.15.111:0/2536275827 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff2b40b4fd0 0x7ff2b4142d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:15.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.817+0000 7ff2b37fe700 1 --2- 172.21.15.111:0/2536275827 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff2b413ea00 0x7ff2b41436b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac00cb90 tx=0x7ff2ac0018f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:15.823 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.817+0000 7ff29affd700 1 -- 172.21.15.111:0/2536275827 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac00a780 con 0x7ff2b413ea00 2024-04-25T02:28:15.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.817+0000 7ff29affd700 1 -- 172.21.15.111:0/2536275827 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2ac00a8e0 con 0x7ff2b413ea00 2024-04-25T02:28:15.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.817+0000 7ff2b968c700 1 -- 172.21.15.111:0/2536275827 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2a8009420 con 0x7ff2b413ea00 2024-04-25T02:28:15.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.817+0000 7ff29affd700 1 -- 172.21.15.111:0/2536275827 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2ac00aca0 con 0x7ff2b413ea00 2024-04-25T02:28:15.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.817+0000 7ff2b968c700 1 -- 172.21.15.111:0/2536275827 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2b4142480 con 0x7ff2b413ea00 2024-04-25T02:28:15.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.818+0000 7ff2b968c700 1 -- 172.21.15.111:0/2536275827 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2b4152290 con 0x7ff2b413ea00 2024-04-25T02:28:15.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.818+0000 7ff29affd700 1 -- 172.21.15.111:0/2536275827 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7ff2ac007300 con 0x7ff2b413ea00 2024-04-25T02:28:15.824 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.818+0000 7ff29affd700 1 -- 172.21.15.111:0/2536275827 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4158+0+0 (secure 0 0 0) 0x7ff2ac05bb40 con 0x7ff2b413ea00 2024-04-25T02:28:15.825 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.822+0000 7ff29affd700 1 -- 172.21.15.111:0/2536275827 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7ff2ac039ed0 con 0x7ff2b413ea00 2024-04-25T02:28:15.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.974+0000 7ff2b968c700 1 -- 172.21.15.111:0/2536275827 --> v1:172.21.15.111:6816/46482 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff2b4152730 con 0x7ff2a0045ef0 2024-04-25T02:28:15.983 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.980+0000 7ff29affd700 1 -- 172.21.15.111:0/2536275827 <== mgr.14107 v1:172.21.15.111:6816/46482 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278423 (unknown 2965378022 0 1197470410) 0x7ff2a800beb0 con 0x7ff2a0045ef0 2024-04-25T02:28:15.987 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:28:15.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.983+0000 7ff2b968c700 1 -- 172.21.15.111:0/2536275827 >> v1:172.21.15.111:6816/46482 conn(0x7ff2a0045ef0 legacy=0x7ff2a00483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:15.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.983+0000 7ff2b968c700 1 -- 172.21.15.111:0/2536275827 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff2b413ea00 msgr2=0x7ff2b41436b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:15.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.983+0000 7ff2b968c700 1 --2- 172.21.15.111:0/2536275827 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff2b413ea00 0x7ff2b41436b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7ff2ac00cb90 tx=0x7ff2ac0018f0 comp rx=0 tx=0).stop 2024-04-25T02:28:15.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.983+0000 7ff2b968c700 1 -- 172.21.15.111:0/2536275827 shutdown_connections 2024-04-25T02:28:15.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.983+0000 7ff2b968c700 1 --2- 172.21.15.111:0/2536275827 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7ff2b413ea00 0x7ff2b41436b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:15.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.983+0000 7ff2b968c700 1 --2- 172.21.15.111:0/2536275827 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7ff2b40a3980 0x7ff2b4151cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:15.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.983+0000 7ff2b968c700 1 --2- 172.21.15.111:0/2536275827 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7ff2b40b4fd0 0x7ff2b4142d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:15.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.983+0000 7ff2b968c700 1 -- 172.21.15.111:0/2536275827 >> 172.21.15.111:0/2536275827 conn(0x7ff2b40883e0 msgr2=0x7ff2b4063d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:15.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.983+0000 7ff2b968c700 1 -- 172.21.15.111:0/2536275827 shutdown_connections 2024-04-25T02:28:15.989 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:15.983+0000 7ff2b968c700 1 -- 172.21.15.111:0/2536275827 wait complete. 2024-04-25T02:28:15.989 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2024-04-25T02:28:15.998 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":186,"stamp":"2024-04-25T02:28:14.801784+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":130042064,"num_objects":104,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":3127,"num_read_kb":1448109,"num_write":31155,"num_write_kb":4453495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34534,"ondisk_log_size":34534,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1472676,"kb_used_data":258884,"kb_used_omap":38,"kb_used_meta":1213721,"kb_avail":376014684,"statfs":{"total":386547056640,"available":385039036416,"internally_reserved":0,"allocated":265097216,"data_stored":263472521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39115,"internal_metadata":1242851125},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10028628,"num_objects":-2263,"num_object_clones":0,"num_object_copies":-4526,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2263,"num_whiteouts":0,"num_read":37,"num_read_kb":339,"num_write":2996,"num_write_kb":8699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002487"},"pg_stats":[{"pgid":"4.3f","version":"43'394","reported_seq":466,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.537907+0000","last_change":"2024-04-25T02:23:13.846111+0000","last_active":"2024-04-25T02:28:09.537907+0000","last_peered":"2024-04-25T02:28:09.537907+0000","last_clean":"2024-04-25T02:28:09.537907+0000","last_became_active":"2024-04-25T02:23:13.845848+0000","last_became_peered":"2024-04-25T02:23:13.845848+0000","last_unstale":"2024-04-25T02:28:09.537907+0000","last_undegraded":"2024-04-25T02:28:09.537907+0000","last_fullsized":"2024-04-25T02:28:09.537907+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:48:53.653719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":15113,"num_write":370,"num_write_kb":51033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"43'432","reported_seq":516,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.566159+0000","last_change":"2024-04-25T02:23:12.845761+0000","last_active":"2024-04-25T02:28:09.566159+0000","last_peered":"2024-04-25T02:28:09.566159+0000","last_clean":"2024-04-25T02:28:09.566159+0000","last_became_active":"2024-04-25T02:23:12.845429+0000","last_became_peered":"2024-04-25T02:23:12.845429+0000","last_unstale":"2024-04-25T02:28:09.566159+0000","last_undegraded":"2024-04-25T02:28:09.566159+0000","last_fullsized":"2024-04-25T02:28:09.566159+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:39:23.193473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22592,"num_write":405,"num_write_kb":75650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"43'370","reported_seq":430,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.365156+0000","last_change":"2024-04-25T02:23:11.838311+0000","last_active":"2024-04-25T02:28:12.365156+0000","last_peered":"2024-04-25T02:28:12.365156+0000","last_clean":"2024-04-25T02:28:12.365156+0000","last_became_active":"2024-04-25T02:23:11.838054+0000","last_became_peered":"2024-04-25T02:23:11.838054+0000","last_unstale":"2024-04-25T02:28:12.365156+0000","last_undegraded":"2024-04-25T02:28:12.365156+0000","last_fullsized":"2024-04-25T02:28:12.365156+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:55:20.837592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":15817,"num_write":338,"num_write_kb":46402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"43'393","reported_seq":474,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.365982+0000","last_change":"2024-04-25T02:23:11.837015+0000","last_active":"2024-04-25T02:28:12.365982+0000","last_peered":"2024-04-25T02:28:12.365982+0000","last_clean":"2024-04-25T02:28:12.365982+0000","last_became_active":"2024-04-25T02:23:11.836681+0000","last_became_peered":"2024-04-25T02:23:11.836681+0000","last_unstale":"2024-04-25T02:28:12.365982+0000","last_undegraded":"2024-04-25T02:28:12.365982+0000","last_fullsized":"2024-04-25T02:28:12.365982+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:57:52.130438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22923,"num_write":365,"num_write_kb":51318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"43'406","reported_seq":475,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.358191+0000","last_change":"2024-04-25T02:23:13.843174+0000","last_active":"2024-04-25T02:28:12.358191+0000","last_peered":"2024-04-25T02:28:12.358191+0000","last_clean":"2024-04-25T02:28:12.358191+0000","last_became_active":"2024-04-25T02:23:13.842918+0000","last_became_peered":"2024-04-25T02:23:13.842918+0000","last_unstale":"2024-04-25T02:28:12.358191+0000","last_undegraded":"2024-04-25T02:28:12.358191+0000","last_fullsized":"2024-04-25T02:28:12.358191+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:18:04.676996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14619,"num_write":384,"num_write_kb":71611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"43'360","reported_seq":421,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.512947+0000","last_change":"2024-04-25T02:23:13.848493+0000","last_active":"2024-04-25T02:28:09.512947+0000","last_peered":"2024-04-25T02:28:09.512947+0000","last_clean":"2024-04-25T02:28:09.512947+0000","last_became_active":"2024-04-25T02:23:13.848160+0000","last_became_peered":"2024-04-25T02:23:13.848160+0000","last_unstale":"2024-04-25T02:28:09.512947+0000","last_undegraded":"2024-04-25T02:28:09.512947+0000","last_fullsized":"2024-04-25T02:28:09.512947+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:40:38.221942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12472,"num_write":338,"num_write_kb":33864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"43'436","reported_seq":554,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.574046+0000","last_change":"2024-04-25T02:23:13.842324+0000","last_active":"2024-04-25T02:28:09.574046+0000","last_peered":"2024-04-25T02:28:09.574046+0000","last_clean":"2024-04-25T02:28:09.574046+0000","last_became_active":"2024-04-25T02:23:13.840374+0000","last_became_peered":"2024-04-25T02:23:13.840374+0000","last_unstale":"2024-04-25T02:28:09.574046+0000","last_undegraded":"2024-04-25T02:28:09.574046+0000","last_fullsized":"2024-04-25T02:28:09.574046+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:04:41.899219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":40192,"num_write":416,"num_write_kb":101787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"43'352","reported_seq":418,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.540107+0000","last_change":"2024-04-25T02:23:11.835781+0000","last_active":"2024-04-25T02:28:09.540107+0000","last_peered":"2024-04-25T02:28:09.540107+0000","last_clean":"2024-04-25T02:28:09.540107+0000","last_became_active":"2024-04-25T02:23:11.834759+0000","last_became_peered":"2024-04-25T02:23:11.834759+0000","last_unstale":"2024-04-25T02:28:09.540107+0000","last_undegraded":"2024-04-25T02:28:09.540107+0000","last_fullsized":"2024-04-25T02:28:09.540107+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:17:37.320529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19314,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":34,"num_read_kb":18431,"num_write":327,"num_write_kb":66835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"43'425","reported_seq":514,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.356933+0000","last_change":"2024-04-25T02:23:13.842786+0000","last_active":"2024-04-25T02:28:12.356933+0000","last_peered":"2024-04-25T02:28:12.356933+0000","last_clean":"2024-04-25T02:28:12.356933+0000","last_became_active":"2024-04-25T02:23:13.841883+0000","last_became_peered":"2024-04-25T02:23:13.841883+0000","last_unstale":"2024-04-25T02:28:12.356933+0000","last_undegraded":"2024-04-25T02:28:12.356933+0000","last_fullsized":"2024-04-25T02:28:12.356933+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:13:08.256311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":29378,"num_write":387,"num_write_kb":39136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"43'378","reported_seq":451,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.557173+0000","last_change":"2024-04-25T02:23:11.836289+0000","last_active":"2024-04-25T02:28:09.557173+0000","last_peered":"2024-04-25T02:28:09.557173+0000","last_clean":"2024-04-25T02:28:09.557173+0000","last_became_active":"2024-04-25T02:23:11.835958+0000","last_became_peered":"2024-04-25T02:23:11.835958+0000","last_unstale":"2024-04-25T02:28:09.557173+0000","last_undegraded":"2024-04-25T02:28:09.557173+0000","last_fullsized":"2024-04-25T02:28:09.557173+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:56:00.639964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18327,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":25799,"num_write":350,"num_write_kb":67037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"43'346","reported_seq":385,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.576223+0000","last_change":"2024-04-25T02:23:11.836468+0000","last_active":"2024-04-25T02:28:09.576223+0000","last_peered":"2024-04-25T02:28:09.576223+0000","last_clean":"2024-04-25T02:28:09.576223+0000","last_became_active":"2024-04-25T02:23:11.836214+0000","last_became_peered":"2024-04-25T02:23:11.836214+0000","last_unstale":"2024-04-25T02:28:09.576223+0000","last_undegraded":"2024-04-25T02:28:09.576223+0000","last_fullsized":"2024-04-25T02:28:09.576223+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:55:43.874015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2596,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7176,"num_write":334,"num_write_kb":37702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"43'328","reported_seq":369,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.577670+0000","last_change":"2024-04-25T02:23:13.847944+0000","last_active":"2024-04-25T02:28:09.577670+0000","last_peered":"2024-04-25T02:28:09.577670+0000","last_clean":"2024-04-25T02:28:09.577670+0000","last_became_active":"2024-04-25T02:23:13.847446+0000","last_became_peered":"2024-04-25T02:23:13.847446+0000","last_unstale":"2024-04-25T02:28:09.577670+0000","last_undegraded":"2024-04-25T02:28:09.577670+0000","last_fullsized":"2024-04-25T02:28:09.577670+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:18:53.324436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4160,"num_write":309,"num_write_kb":33908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"43'377","reported_seq":418,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.581321+0000","last_change":"2024-04-25T02:23:13.847825+0000","last_active":"2024-04-25T02:28:09.581321+0000","last_peered":"2024-04-25T02:28:09.581321+0000","last_clean":"2024-04-25T02:28:09.581321+0000","last_became_active":"2024-04-25T02:23:13.847009+0000","last_became_peered":"2024-04-25T02:23:13.847009+0000","last_unstale":"2024-04-25T02:28:09.581321+0000","last_undegraded":"2024-04-25T02:28:09.581321+0000","last_fullsized":"2024-04-25T02:28:09.581321+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:04:01.988527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4152,"num_write":352,"num_write_kb":42524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"43'442","reported_seq":520,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.566824+0000","last_change":"2024-04-25T02:23:12.841952+0000","last_active":"2024-04-25T02:28:09.566824+0000","last_peered":"2024-04-25T02:28:09.566824+0000","last_clean":"2024-04-25T02:28:09.566824+0000","last_became_active":"2024-04-25T02:23:12.841783+0000","last_became_peered":"2024-04-25T02:23:12.841783+0000","last_unstale":"2024-04-25T02:28:09.566824+0000","last_undegraded":"2024-04-25T02:28:09.566824+0000","last_fullsized":"2024-04-25T02:28:09.566824+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:42:53.655107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1192,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":46,"num_read_kb":25198,"num_write":420,"num_write_kb":88864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"43'430","reported_seq":521,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.351328+0000","last_change":"2024-04-25T02:23:11.836069+0000","last_active":"2024-04-25T02:28:12.351328+0000","last_peered":"2024-04-25T02:28:12.351328+0000","last_clean":"2024-04-25T02:28:12.351328+0000","last_became_active":"2024-04-25T02:23:11.835815+0000","last_became_peered":"2024-04-25T02:23:11.835815+0000","last_unstale":"2024-04-25T02:28:12.351328+0000","last_undegraded":"2024-04-25T02:28:12.351328+0000","last_fullsized":"2024-04-25T02:28:12.351328+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:07.444694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31947,"num_write":393,"num_write_kb":64059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"43'429","reported_seq":453,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.494254+0000","last_change":"2024-04-25T02:23:55.963552+0000","last_active":"2024-04-25T02:28:10.494254+0000","last_peered":"2024-04-25T02:28:10.494254+0000","last_clean":"2024-04-25T02:28:10.494254+0000","last_became_active":"2024-04-25T02:23:55.963259+0000","last_became_peered":"2024-04-25T02:23:55.963259+0000","last_unstale":"2024-04-25T02:28:10.494254+0000","last_undegraded":"2024-04-25T02:28:10.494254+0000","last_fullsized":"2024-04-25T02:28:10.494254+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:40:16.304418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":2639,"num_write":405,"num_write_kb":51451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"43'394","reported_seq":456,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.356439+0000","last_change":"2024-04-25T02:23:13.844591+0000","last_active":"2024-04-25T02:28:12.356439+0000","last_peered":"2024-04-25T02:28:12.356439+0000","last_clean":"2024-04-25T02:28:12.356439+0000","last_became_active":"2024-04-25T02:23:13.844343+0000","last_became_peered":"2024-04-25T02:23:13.844343+0000","last_unstale":"2024-04-25T02:28:12.356439+0000","last_undegraded":"2024-04-25T02:28:12.356439+0000","last_fullsized":"2024-04-25T02:28:12.356439+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:52:55.994134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9696,"num_write":367,"num_write_kb":33966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"43'391","reported_seq":470,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.347590+0000","last_change":"2024-04-25T02:23:12.848314+0000","last_active":"2024-04-25T02:28:12.347590+0000","last_peered":"2024-04-25T02:28:12.347590+0000","last_clean":"2024-04-25T02:28:12.347590+0000","last_became_active":"2024-04-25T02:23:12.848051+0000","last_became_peered":"2024-04-25T02:23:12.848051+0000","last_unstale":"2024-04-25T02:28:12.347590+0000","last_undegraded":"2024-04-25T02:28:12.347590+0000","last_fullsized":"2024-04-25T02:28:12.347590+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:53:59.236832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":13345,"num_write":357,"num_write_kb":38441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"43'422","reported_seq":532,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.565039+0000","last_change":"2024-04-25T02:23:13.848250+0000","last_active":"2024-04-25T02:28:09.565039+0000","last_peered":"2024-04-25T02:28:09.565039+0000","last_clean":"2024-04-25T02:28:09.565039+0000","last_became_active":"2024-04-25T02:23:13.847602+0000","last_became_peered":"2024-04-25T02:23:13.847602+0000","last_unstale":"2024-04-25T02:28:09.565039+0000","last_undegraded":"2024-04-25T02:28:09.565039+0000","last_fullsized":"2024-04-25T02:28:09.565039+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:36:05.652157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":37845,"num_write":400,"num_write_kb":88566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"43'428","reported_seq":503,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.528212+0000","last_change":"2024-04-25T02:23:13.846327+0000","last_active":"2024-04-25T02:28:09.528212+0000","last_peered":"2024-04-25T02:28:09.528212+0000","last_clean":"2024-04-25T02:28:09.528212+0000","last_became_active":"2024-04-25T02:23:13.845934+0000","last_became_peered":"2024-04-25T02:23:13.845934+0000","last_unstale":"2024-04-25T02:28:09.528212+0000","last_undegraded":"2024-04-25T02:28:09.528212+0000","last_fullsized":"2024-04-25T02:28:09.528212+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:01:47.261604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13003,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":40,"num_read_kb":22073,"num_write":411,"num_write_kb":67090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"43'402","reported_seq":494,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.563914+0000","last_change":"2024-04-25T02:23:13.847117+0000","last_active":"2024-04-25T02:28:09.563914+0000","last_peered":"2024-04-25T02:28:09.563914+0000","last_clean":"2024-04-25T02:28:09.563914+0000","last_became_active":"2024-04-25T02:23:13.846758+0000","last_became_peered":"2024-04-25T02:23:13.846758+0000","last_unstale":"2024-04-25T02:28:09.563914+0000","last_undegraded":"2024-04-25T02:28:09.563914+0000","last_fullsized":"2024-04-25T02:28:09.563914+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:53:10.872495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3856,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":57,"num_read_kb":24525,"num_write":377,"num_write_kb":100342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"43'445","reported_seq":518,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.366186+0000","last_change":"2024-04-25T02:23:11.835581+0000","last_active":"2024-04-25T02:28:12.366186+0000","last_peered":"2024-04-25T02:28:12.366186+0000","last_clean":"2024-04-25T02:28:12.366186+0000","last_became_active":"2024-04-25T02:23:11.835319+0000","last_became_peered":"2024-04-25T02:23:11.835319+0000","last_unstale":"2024-04-25T02:28:12.366186+0000","last_undegraded":"2024-04-25T02:28:12.366186+0000","last_fullsized":"2024-04-25T02:28:12.366186+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:19:02.978966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":18532,"num_write":411,"num_write_kb":84101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"43'400","reported_seq":507,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.567502+0000","last_change":"2024-04-25T02:23:13.840011+0000","last_active":"2024-04-25T02:28:09.567502+0000","last_peered":"2024-04-25T02:28:09.567502+0000","last_clean":"2024-04-25T02:28:09.567502+0000","last_became_active":"2024-04-25T02:23:13.838917+0000","last_became_peered":"2024-04-25T02:23:13.838917+0000","last_unstale":"2024-04-25T02:28:09.567502+0000","last_undegraded":"2024-04-25T02:28:09.567502+0000","last_fullsized":"2024-04-25T02:28:09.567502+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:53:06.476265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":25750,"num_write":380,"num_write_kb":75795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"43'442","reported_seq":507,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.549105+0000","last_change":"2024-04-25T02:23:13.846482+0000","last_active":"2024-04-25T02:28:09.549105+0000","last_peered":"2024-04-25T02:28:09.549105+0000","last_clean":"2024-04-25T02:28:09.549105+0000","last_became_active":"2024-04-25T02:23:13.845814+0000","last_became_peered":"2024-04-25T02:23:13.845814+0000","last_unstale":"2024-04-25T02:28:09.549105+0000","last_undegraded":"2024-04-25T02:28:09.549105+0000","last_fullsized":"2024-04-25T02:28:09.549105+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:33:00.487666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22530,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":30,"num_read_kb":13960,"num_write":425,"num_write_kb":96160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"43'393","reported_seq":445,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.534083+0000","last_change":"2024-04-25T02:23:13.852668+0000","last_active":"2024-04-25T02:28:09.534083+0000","last_peered":"2024-04-25T02:28:09.534083+0000","last_clean":"2024-04-25T02:28:09.534083+0000","last_became_active":"2024-04-25T02:23:13.852093+0000","last_became_peered":"2024-04-25T02:23:13.852093+0000","last_unstale":"2024-04-25T02:28:09.534083+0000","last_undegraded":"2024-04-25T02:28:09.534083+0000","last_fullsized":"2024-04-25T02:28:09.534083+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:57.422935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5787,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":3870,"num_write":381,"num_write_kb":17738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"43'468","reported_seq":549,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.576547+0000","last_change":"2024-04-25T02:23:12.841653+0000","last_active":"2024-04-25T02:28:09.576547+0000","last_peered":"2024-04-25T02:28:09.576547+0000","last_clean":"2024-04-25T02:28:09.576547+0000","last_became_active":"2024-04-25T02:23:12.841477+0000","last_became_peered":"2024-04-25T02:23:12.841477+0000","last_unstale":"2024-04-25T02:28:09.576547+0000","last_undegraded":"2024-04-25T02:28:09.576547+0000","last_fullsized":"2024-04-25T02:28:09.576547+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:16:17.108262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35897,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":49,"num_read_kb":24645,"num_write":443,"num_write_kb":96750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"43'378","reported_seq":451,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.565831+0000","last_change":"2024-04-25T02:23:13.842553+0000","last_active":"2024-04-25T02:28:09.565831+0000","last_peered":"2024-04-25T02:28:09.565831+0000","last_clean":"2024-04-25T02:28:09.565831+0000","last_became_active":"2024-04-25T02:23:13.840422+0000","last_became_peered":"2024-04-25T02:23:13.840422+0000","last_unstale":"2024-04-25T02:28:09.565831+0000","last_undegraded":"2024-04-25T02:28:09.565831+0000","last_fullsized":"2024-04-25T02:28:09.565831+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:44:38.010033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":6130,"num_write":356,"num_write_kb":25986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"43'565","reported_seq":598,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.506214+0000","last_change":"2024-04-25T02:23:12.846241+0000","last_active":"2024-04-25T02:28:08.506214+0000","last_peered":"2024-04-25T02:28:08.506214+0000","last_clean":"2024-04-25T02:28:08.506214+0000","last_became_active":"2024-04-25T02:23:12.845923+0000","last_became_peered":"2024-04-25T02:23:12.845923+0000","last_unstale":"2024-04-25T02:28:08.506214+0000","last_undegraded":"2024-04-25T02:28:08.506214+0000","last_fullsized":"2024-04-25T02:28:08.506214+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:59:31.094638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":494,"num_write_kb":12610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"43'405","reported_seq":520,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.494514+0000","last_change":"2024-04-25T02:23:13.850625+0000","last_active":"2024-04-25T02:28:10.494514+0000","last_peered":"2024-04-25T02:28:10.494514+0000","last_clean":"2024-04-25T02:28:10.494514+0000","last_became_active":"2024-04-25T02:23:13.848844+0000","last_became_peered":"2024-04-25T02:23:13.848844+0000","last_unstale":"2024-04-25T02:28:10.494514+0000","last_undegraded":"2024-04-25T02:28:10.494514+0000","last_fullsized":"2024-04-25T02:28:10.494514+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:32.796023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":41312,"num_write":376,"num_write_kb":112833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"43'382","reported_seq":417,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:07.523305+0000","last_change":"2024-04-25T02:23:13.850242+0000","last_active":"2024-04-25T02:28:07.523305+0000","last_peered":"2024-04-25T02:28:07.523305+0000","last_clean":"2024-04-25T02:28:07.523305+0000","last_became_active":"2024-04-25T02:23:13.846821+0000","last_became_peered":"2024-04-25T02:23:13.846821+0000","last_unstale":"2024-04-25T02:28:07.523305+0000","last_undegraded":"2024-04-25T02:28:07.523305+0000","last_fullsized":"2024-04-25T02:28:07.523305+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:16.733579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":334,"num_write_kb":4317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"43'428","reported_seq":521,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.365345+0000","last_change":"2024-04-25T02:23:11.840787+0000","last_active":"2024-04-25T02:28:12.365345+0000","last_peered":"2024-04-25T02:28:12.365345+0000","last_clean":"2024-04-25T02:28:12.365345+0000","last_became_active":"2024-04-25T02:23:11.840274+0000","last_became_peered":"2024-04-25T02:23:11.840274+0000","last_unstale":"2024-04-25T02:28:12.365345+0000","last_undegraded":"2024-04-25T02:28:12.365345+0000","last_fullsized":"2024-04-25T02:28:12.365345+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:26:15.381838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":28196,"num_write":410,"num_write_kb":104265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"43'875","reported_seq":921,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.487831+0000","last_change":"2024-04-25T02:23:13.839791+0000","last_active":"2024-04-25T02:28:10.487831+0000","last_peered":"2024-04-25T02:28:10.487831+0000","last_clean":"2024-04-25T02:28:10.487831+0000","last_became_active":"2024-04-25T02:23:13.839361+0000","last_became_peered":"2024-04-25T02:23:13.839361+0000","last_unstale":"2024-04-25T02:28:10.487831+0000","last_undegraded":"2024-04-25T02:28:10.487831+0000","last_fullsized":"2024-04-25T02:28:10.487831+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":875,"log_dups_size":0,"ondisk_log_size":875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:48:03.634232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":809,"num_write_kb":8568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"43'359","reported_seq":437,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.539747+0000","last_change":"2024-04-25T02:23:13.844099+0000","last_active":"2024-04-25T02:28:09.539747+0000","last_peered":"2024-04-25T02:28:09.539747+0000","last_clean":"2024-04-25T02:28:09.539747+0000","last_became_active":"2024-04-25T02:23:13.843656+0000","last_became_peered":"2024-04-25T02:23:13.843656+0000","last_unstale":"2024-04-25T02:28:09.539747+0000","last_undegraded":"2024-04-25T02:28:09.539747+0000","last_fullsized":"2024-04-25T02:28:09.539747+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:18:44.036616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":25136,"num_write":341,"num_write_kb":38831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"43'56","reported_seq":95,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:06.534335+0000","last_change":"2024-04-25T02:23:13.842946+0000","last_active":"2024-04-25T02:28:06.534335+0000","last_peered":"2024-04-25T02:28:06.534335+0000","last_clean":"2024-04-25T02:28:06.534335+0000","last_became_active":"2024-04-25T02:23:13.842598+0000","last_became_peered":"2024-04-25T02:23:13.842598+0000","last_unstale":"2024-04-25T02:28:06.534335+0000","last_undegraded":"2024-04-25T02:28:06.534335+0000","last_fullsized":"2024-04-25T02:28:06.534335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:27.597908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"43'461","reported_seq":536,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.561722+0000","last_change":"2024-04-25T02:23:13.849957+0000","last_active":"2024-04-25T02:28:09.561722+0000","last_peered":"2024-04-25T02:28:09.561722+0000","last_clean":"2024-04-25T02:28:09.561722+0000","last_became_active":"2024-04-25T02:23:13.848675+0000","last_became_peered":"2024-04-25T02:23:13.848675+0000","last_unstale":"2024-04-25T02:28:09.561722+0000","last_undegraded":"2024-04-25T02:28:09.561722+0000","last_fullsized":"2024-04-25T02:28:09.561722+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:09:49.581897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":13580,"num_write":443,"num_write_kb":92928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"43'340","reported_seq":374,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.479090+0000","last_change":"2024-04-25T02:23:13.847353+0000","last_active":"2024-04-25T02:28:08.479090+0000","last_peered":"2024-04-25T02:28:08.479090+0000","last_clean":"2024-04-25T02:28:08.479090+0000","last_became_active":"2024-04-25T02:23:13.846764+0000","last_became_peered":"2024-04-25T02:23:13.846764+0000","last_unstale":"2024-04-25T02:28:08.479090+0000","last_undegraded":"2024-04-25T02:28:08.479090+0000","last_fullsized":"2024-04-25T02:28:08.479090+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":340,"log_dups_size":0,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:38:36.095151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":281,"num_write_kb":4273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"43'471","reported_seq":570,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.509616+0000","last_change":"2024-04-25T02:23:13.844687+0000","last_active":"2024-04-25T02:28:10.509616+0000","last_peered":"2024-04-25T02:28:10.509616+0000","last_clean":"2024-04-25T02:28:10.509616+0000","last_became_active":"2024-04-25T02:23:13.839702+0000","last_became_peered":"2024-04-25T02:23:13.839702+0000","last_unstale":"2024-04-25T02:28:10.509616+0000","last_undegraded":"2024-04-25T02:28:10.509616+0000","last_fullsized":"2024-04-25T02:28:10.509616+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:10:23.178715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":30102,"num_write":452,"num_write_kb":97286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"43'136","reported_seq":178,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.515488+0000","last_change":"2024-04-25T02:23:13.844668+0000","last_active":"2024-04-25T02:28:10.515488+0000","last_peered":"2024-04-25T02:28:10.515488+0000","last_clean":"2024-04-25T02:28:10.515488+0000","last_became_active":"2024-04-25T02:23:13.843625+0000","last_became_peered":"2024-04-25T02:23:13.843625+0000","last_unstale":"2024-04-25T02:28:10.515488+0000","last_undegraded":"2024-04-25T02:28:10.515488+0000","last_fullsized":"2024-04-25T02:28:10.515488+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:19:41.521042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":72,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"43'409","reported_seq":482,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.540770+0000","last_change":"2024-04-25T02:23:13.851184+0000","last_active":"2024-04-25T02:28:09.540770+0000","last_peered":"2024-04-25T02:28:09.540770+0000","last_clean":"2024-04-25T02:28:09.540770+0000","last_became_active":"2024-04-25T02:23:13.850845+0000","last_became_peered":"2024-04-25T02:23:13.850845+0000","last_unstale":"2024-04-25T02:28:09.540770+0000","last_undegraded":"2024-04-25T02:28:09.540770+0000","last_fullsized":"2024-04-25T02:28:09.540770+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:07:20.048534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19125,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":38,"num_read_kb":24672,"num_write":387,"num_write_kb":75497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"43'341","reported_seq":385,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:11.203375+0000","last_change":"2024-04-25T02:23:13.849389+0000","last_active":"2024-04-25T02:28:11.203375+0000","last_peered":"2024-04-25T02:28:11.203375+0000","last_clean":"2024-04-25T02:28:11.203375+0000","last_became_active":"2024-04-25T02:23:13.845176+0000","last_became_peered":"2024-04-25T02:23:13.845176+0000","last_unstale":"2024-04-25T02:28:11.203375+0000","last_undegraded":"2024-04-25T02:28:11.203375+0000","last_fullsized":"2024-04-25T02:28:11.203375+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:50:14.041957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10355158,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":7,"num_read_kb":10,"num_write":287,"num_write_kb":10305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"43'390","reported_seq":457,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.576280+0000","last_change":"2024-04-25T02:23:55.964120+0000","last_active":"2024-04-25T02:28:09.576280+0000","last_peered":"2024-04-25T02:28:09.576280+0000","last_clean":"2024-04-25T02:28:09.576280+0000","last_became_active":"2024-04-25T02:23:55.963655+0000","last_became_peered":"2024-04-25T02:23:55.963655+0000","last_unstale":"2024-04-25T02:28:09.576280+0000","last_undegraded":"2024-04-25T02:28:09.576280+0000","last_fullsized":"2024-04-25T02:28:09.576280+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:04:44.724602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":11609,"num_write":365,"num_write_kb":76437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"43'493","reported_seq":541,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:06.537420+0000","last_change":"2024-04-25T02:23:13.839481+0000","last_active":"2024-04-25T02:28:06.537420+0000","last_peered":"2024-04-25T02:28:06.537420+0000","last_clean":"2024-04-25T02:28:06.537420+0000","last_became_active":"2024-04-25T02:23:13.839158+0000","last_became_peered":"2024-04-25T02:23:13.839158+0000","last_unstale":"2024-04-25T02:28:06.537420+0000","last_undegraded":"2024-04-25T02:28:06.537420+0000","last_fullsized":"2024-04-25T02:28:06.537420+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:07:04.590892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":7,"num_write":435,"num_write_kb":8384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"43'398","reported_seq":477,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.574056+0000","last_change":"2024-04-25T02:23:13.843740+0000","last_active":"2024-04-25T02:28:09.574056+0000","last_peered":"2024-04-25T02:28:09.574056+0000","last_clean":"2024-04-25T02:28:09.574056+0000","last_became_active":"2024-04-25T02:23:13.843441+0000","last_became_peered":"2024-04-25T02:23:13.843441+0000","last_unstale":"2024-04-25T02:28:09.574056+0000","last_undegraded":"2024-04-25T02:28:09.574056+0000","last_fullsized":"2024-04-25T02:28:09.574056+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:53:20.763788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":25550,"num_write":379,"num_write_kb":104949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"43'51","reported_seq":89,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.480443+0000","last_change":"2024-04-25T02:23:13.844290+0000","last_active":"2024-04-25T02:28:08.480443+0000","last_peered":"2024-04-25T02:28:08.480443+0000","last_clean":"2024-04-25T02:28:08.480443+0000","last_became_active":"2024-04-25T02:23:13.841976+0000","last_became_peered":"2024-04-25T02:23:13.841976+0000","last_unstale":"2024-04-25T02:28:08.480443+0000","last_undegraded":"2024-04-25T02:28:08.480443+0000","last_fullsized":"2024-04-25T02:28:08.480443+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:16:25.998330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"43'401","reported_seq":486,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.511676+0000","last_change":"2024-04-25T02:23:13.843455+0000","last_active":"2024-04-25T02:28:10.511676+0000","last_peered":"2024-04-25T02:28:10.511676+0000","last_clean":"2024-04-25T02:28:10.511676+0000","last_became_active":"2024-04-25T02:23:13.842163+0000","last_became_peered":"2024-04-25T02:23:13.842163+0000","last_unstale":"2024-04-25T02:28:10.511676+0000","last_undegraded":"2024-04-25T02:28:10.511676+0000","last_fullsized":"2024-04-25T02:28:10.511676+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:59:59.924648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":18209,"num_write":378,"num_write_kb":67140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"43'57","reported_seq":96,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:06.534681+0000","last_change":"2024-04-25T02:23:13.839221+0000","last_active":"2024-04-25T02:28:06.534681+0000","last_peered":"2024-04-25T02:28:06.534681+0000","last_clean":"2024-04-25T02:28:06.534681+0000","last_became_active":"2024-04-25T02:23:13.838616+0000","last_became_peered":"2024-04-25T02:23:13.838616+0000","last_unstale":"2024-04-25T02:28:06.534681+0000","last_undegraded":"2024-04-25T02:28:06.534681+0000","last_fullsized":"2024-04-25T02:28:06.534681+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:24:48.817920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"43'445","reported_seq":564,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.358374+0000","last_change":"2024-04-25T02:23:13.842908+0000","last_active":"2024-04-25T02:28:12.358374+0000","last_peered":"2024-04-25T02:28:12.358374+0000","last_clean":"2024-04-25T02:28:12.358374+0000","last_became_active":"2024-04-25T02:23:13.842649+0000","last_became_peered":"2024-04-25T02:23:13.842649+0000","last_unstale":"2024-04-25T02:28:12.358374+0000","last_undegraded":"2024-04-25T02:28:12.358374+0000","last_fullsized":"2024-04-25T02:28:12.358374+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:04:07.758366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":37870,"num_write":411,"num_write_kb":80233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"43'62","reported_seq":99,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:06.530408+0000","last_change":"2024-04-25T02:23:11.835951+0000","last_active":"2024-04-25T02:28:06.530408+0000","last_peered":"2024-04-25T02:28:06.530408+0000","last_clean":"2024-04-25T02:28:06.530408+0000","last_became_active":"2024-04-25T02:23:11.835077+0000","last_became_peered":"2024-04-25T02:23:11.835077+0000","last_unstale":"2024-04-25T02:28:06.530408+0000","last_undegraded":"2024-04-25T02:28:06.530408+0000","last_fullsized":"2024-04-25T02:28:06.530408+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:24:42.651723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"43'381","reported_seq":511,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.565366+0000","last_change":"2024-04-25T02:23:13.843899+0000","last_active":"2024-04-25T02:28:09.565366+0000","last_peered":"2024-04-25T02:28:09.565366+0000","last_clean":"2024-04-25T02:28:09.565366+0000","last_became_active":"2024-04-25T02:23:13.843347+0000","last_became_peered":"2024-04-25T02:23:13.843347+0000","last_unstale":"2024-04-25T02:28:09.565366+0000","last_undegraded":"2024-04-25T02:28:09.565366+0000","last_fullsized":"2024-04-25T02:28:09.565366+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:46:23.518991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":42863,"num_write":360,"num_write_kb":59443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"43'199","reported_seq":236,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.531368+0000","last_change":"2024-04-25T02:23:11.839659+0000","last_active":"2024-04-25T02:28:09.531368+0000","last_peered":"2024-04-25T02:28:09.531368+0000","last_clean":"2024-04-25T02:28:09.531368+0000","last_became_active":"2024-04-25T02:23:11.839157+0000","last_became_peered":"2024-04-25T02:23:11.839157+0000","last_unstale":"2024-04-25T02:28:09.531368+0000","last_undegraded":"2024-04-25T02:28:09.531368+0000","last_fullsized":"2024-04-25T02:28:09.531368+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:06:42.930490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":142,"num_write_kb":4183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"43'395","reported_seq":461,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.523641+0000","last_change":"2024-04-25T02:23:13.841226+0000","last_active":"2024-04-25T02:28:09.523641+0000","last_peered":"2024-04-25T02:28:09.523641+0000","last_clean":"2024-04-25T02:28:09.523641+0000","last_became_active":"2024-04-25T02:23:13.840951+0000","last_became_peered":"2024-04-25T02:23:13.840951+0000","last_unstale":"2024-04-25T02:28:09.523641+0000","last_undegraded":"2024-04-25T02:28:09.523641+0000","last_fullsized":"2024-04-25T02:28:09.523641+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:16:58.212703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12931,"num_write":370,"num_write_kb":42530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"43'366","reported_seq":410,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:06.537151+0000","last_change":"2024-04-25T02:23:12.848098+0000","last_active":"2024-04-25T02:28:06.537151+0000","last_peered":"2024-04-25T02:28:06.537151+0000","last_clean":"2024-04-25T02:28:06.537151+0000","last_became_active":"2024-04-25T02:23:12.847813+0000","last_became_peered":"2024-04-25T02:23:12.847813+0000","last_unstale":"2024-04-25T02:28:06.537151+0000","last_undegraded":"2024-04-25T02:28:06.537151+0000","last_fullsized":"2024-04-25T02:28:06.537151+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:31:10.538399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":311,"num_write_kb":4273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"43'440","reported_seq":489,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.513229+0000","last_change":"2024-04-25T02:23:55.963573+0000","last_active":"2024-04-25T02:28:10.513229+0000","last_peered":"2024-04-25T02:28:10.513229+0000","last_clean":"2024-04-25T02:28:10.513229+0000","last_became_active":"2024-04-25T02:23:55.963234+0000","last_became_peered":"2024-04-25T02:23:55.963234+0000","last_unstale":"2024-04-25T02:28:10.513229+0000","last_undegraded":"2024-04-25T02:28:10.513229+0000","last_fullsized":"2024-04-25T02:28:10.513229+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:52:59.926648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21039,"num_write":415,"num_write_kb":62968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"43'594","reported_seq":637,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.538648+0000","last_change":"2024-04-25T02:23:13.848143+0000","last_active":"2024-04-25T02:28:08.538648+0000","last_peered":"2024-04-25T02:28:08.538648+0000","last_clean":"2024-04-25T02:28:08.538648+0000","last_became_active":"2024-04-25T02:23:13.843704+0000","last_became_peered":"2024-04-25T02:23:13.843704+0000","last_unstale":"2024-04-25T02:28:08.538648+0000","last_undegraded":"2024-04-25T02:28:08.538648+0000","last_fullsized":"2024-04-25T02:28:08.538648+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:54:31.975503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":532,"num_write_kb":4350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"43'406","reported_seq":491,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.513466+0000","last_change":"2024-04-25T02:23:13.847842+0000","last_active":"2024-04-25T02:28:10.513466+0000","last_peered":"2024-04-25T02:28:10.513466+0000","last_clean":"2024-04-25T02:28:10.513466+0000","last_became_active":"2024-04-25T02:23:13.845782+0000","last_became_peered":"2024-04-25T02:23:13.845782+0000","last_unstale":"2024-04-25T02:28:10.513466+0000","last_undegraded":"2024-04-25T02:28:10.513466+0000","last_fullsized":"2024-04-25T02:28:10.513466+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:56:46.820624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":24562,"num_write":375,"num_write_kb":59351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"43'59","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.490375+0000","last_change":"2024-04-25T02:23:13.842426+0000","last_active":"2024-04-25T02:28:09.490375+0000","last_peered":"2024-04-25T02:28:09.490375+0000","last_clean":"2024-04-25T02:28:09.490375+0000","last_became_active":"2024-04-25T02:23:13.841815+0000","last_became_peered":"2024-04-25T02:23:13.841815+0000","last_unstale":"2024-04-25T02:28:09.490375+0000","last_undegraded":"2024-04-25T02:28:09.490375+0000","last_fullsized":"2024-04-25T02:28:09.490375+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:20:54.760986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"43'457","reported_seq":573,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.366271+0000","last_change":"2024-04-25T02:23:11.839840+0000","last_active":"2024-04-25T02:28:12.366271+0000","last_peered":"2024-04-25T02:28:12.366271+0000","last_clean":"2024-04-25T02:28:12.366271+0000","last_became_active":"2024-04-25T02:23:11.837258+0000","last_became_peered":"2024-04-25T02:23:11.837258+0000","last_unstale":"2024-04-25T02:28:12.366271+0000","last_undegraded":"2024-04-25T02:28:12.366271+0000","last_fullsized":"2024-04-25T02:28:12.366271+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:49:17.616748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":40530,"num_write":421,"num_write_kb":133096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"43'128","reported_seq":175,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.513945+0000","last_change":"2024-04-25T02:23:13.838948+0000","last_active":"2024-04-25T02:28:08.513945+0000","last_peered":"2024-04-25T02:28:08.513945+0000","last_clean":"2024-04-25T02:28:08.513945+0000","last_became_active":"2024-04-25T02:23:13.838665+0000","last_became_peered":"2024-04-25T02:23:13.838665+0000","last_unstale":"2024-04-25T02:28:08.513945+0000","last_undegraded":"2024-04-25T02:28:08.513945+0000","last_fullsized":"2024-04-25T02:28:08.513945+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:29:28.670027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":66,"num_write_kb":8229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"43'438","reported_seq":515,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.346657+0000","last_change":"2024-04-25T02:23:55.963989+0000","last_active":"2024-04-25T02:28:12.346657+0000","last_peered":"2024-04-25T02:28:12.346657+0000","last_clean":"2024-04-25T02:28:12.346657+0000","last_became_active":"2024-04-25T02:23:55.963557+0000","last_became_peered":"2024-04-25T02:23:55.963557+0000","last_unstale":"2024-04-25T02:28:12.346657+0000","last_undegraded":"2024-04-25T02:28:12.346657+0000","last_fullsized":"2024-04-25T02:28:12.346657+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:01:58.293756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":25759,"num_write":403,"num_write_kb":59138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"43'254","reported_seq":296,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.515045+0000","last_change":"2024-04-25T02:23:13.843937+0000","last_active":"2024-04-25T02:28:08.515045+0000","last_peered":"2024-04-25T02:28:08.515045+0000","last_clean":"2024-04-25T02:28:08.515045+0000","last_became_active":"2024-04-25T02:23:13.843652+0000","last_became_peered":"2024-04-25T02:23:13.843652+0000","last_unstale":"2024-04-25T02:28:08.515045+0000","last_undegraded":"2024-04-25T02:28:08.515045+0000","last_fullsized":"2024-04-25T02:28:08.515045+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:13:15.374851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":4213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"43'382","reported_seq":415,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.507975+0000","last_change":"2024-04-25T02:23:56.302316+0000","last_active":"2024-04-25T02:28:09.507975+0000","last_peered":"2024-04-25T02:28:09.507975+0000","last_clean":"2024-04-25T02:28:09.507975+0000","last_became_active":"2024-04-25T02:23:56.301997+0000","last_became_peered":"2024-04-25T02:23:56.301997+0000","last_unstale":"2024-04-25T02:28:09.507975+0000","last_undegraded":"2024-04-25T02:28:09.507975+0000","last_fullsized":"2024-04-25T02:28:09.507975+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:39:22.081330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13585,"num_write":362,"num_write_kb":34032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"43'63","reported_seq":102,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.513793+0000","last_change":"2024-04-25T02:23:13.842533+0000","last_active":"2024-04-25T02:28:08.513793+0000","last_peered":"2024-04-25T02:28:08.513793+0000","last_clean":"2024-04-25T02:28:08.513793+0000","last_became_active":"2024-04-25T02:23:13.841049+0000","last_became_peered":"2024-04-25T02:23:13.841049+0000","last_unstale":"2024-04-25T02:28:08.513793+0000","last_undegraded":"2024-04-25T02:28:08.513793+0000","last_fullsized":"2024-04-25T02:28:08.513793+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:26:00.892546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"43'355","reported_seq":417,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.577849+0000","last_change":"2024-04-25T02:23:13.847171+0000","last_active":"2024-04-25T02:28:09.577849+0000","last_peered":"2024-04-25T02:28:09.577849+0000","last_clean":"2024-04-25T02:28:09.577849+0000","last_became_active":"2024-04-25T02:23:13.846425+0000","last_became_peered":"2024-04-25T02:23:13.846425+0000","last_unstale":"2024-04-25T02:28:09.577849+0000","last_undegraded":"2024-04-25T02:28:09.577849+0000","last_fullsized":"2024-04-25T02:28:09.577849+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:40:12.956129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":12898,"num_write":328,"num_write_kb":42412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"43'565","reported_seq":607,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.489808+0000","last_change":"2024-04-25T02:23:13.841178+0000","last_active":"2024-04-25T02:28:08.489808+0000","last_peered":"2024-04-25T02:28:08.489808+0000","last_clean":"2024-04-25T02:28:08.489808+0000","last_became_active":"2024-04-25T02:23:13.840876+0000","last_became_peered":"2024-04-25T02:23:13.840876+0000","last_unstale":"2024-04-25T02:28:08.489808+0000","last_undegraded":"2024-04-25T02:28:08.489808+0000","last_fullsized":"2024-04-25T02:28:08.489808+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:29:47.026682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":506,"num_write_kb":4331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"43'376","reported_seq":453,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.567149+0000","last_change":"2024-04-25T02:23:13.852754+0000","last_active":"2024-04-25T02:28:09.567149+0000","last_peered":"2024-04-25T02:28:09.567149+0000","last_clean":"2024-04-25T02:28:09.567149+0000","last_became_active":"2024-04-25T02:23:13.852398+0000","last_became_peered":"2024-04-25T02:23:13.852398+0000","last_unstale":"2024-04-25T02:28:09.567149+0000","last_undegraded":"2024-04-25T02:28:09.567149+0000","last_fullsized":"2024-04-25T02:28:09.567149+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:48:40.857184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31433,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":42,"num_read_kb":28255,"num_write":352,"num_write_kb":58406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":32,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T02:23:56.300797+0000","last_change":"2024-04-25T02:23:11.834419+0000","last_active":"2024-04-25T02:23:56.300797+0000","last_peered":"2024-04-25T02:23:56.300797+0000","last_clean":"2024-04-25T02:23:56.300797+0000","last_became_active":"2024-04-25T02:23:11.834171+0000","last_became_peered":"2024-04-25T02:23:11.834171+0000","last_unstale":"2024-04-25T02:23:56.300797+0000","last_undegraded":"2024-04-25T02:23:56.300797+0000","last_fullsized":"2024-04-25T02:23:56.300797+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:13:40.419554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"43'431","reported_seq":466,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.550365+0000","last_change":"2024-04-25T02:23:13.848449+0000","last_active":"2024-04-25T02:28:09.550365+0000","last_peered":"2024-04-25T02:28:09.550365+0000","last_clean":"2024-04-25T02:28:09.550365+0000","last_became_active":"2024-04-25T02:23:13.847970+0000","last_became_peered":"2024-04-25T02:23:13.847970+0000","last_unstale":"2024-04-25T02:28:09.550365+0000","last_undegraded":"2024-04-25T02:28:09.550365+0000","last_fullsized":"2024-04-25T02:28:09.550365+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:00:21.733260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":371,"num_write_kb":4349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"43'348","reported_seq":400,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.546640+0000","last_change":"2024-04-25T02:23:13.850097+0000","last_active":"2024-04-25T02:28:09.546640+0000","last_peered":"2024-04-25T02:28:09.546640+0000","last_clean":"2024-04-25T02:28:09.546640+0000","last_became_active":"2024-04-25T02:23:13.849556+0000","last_became_peered":"2024-04-25T02:23:13.849556+0000","last_unstale":"2024-04-25T02:28:09.546640+0000","last_undegraded":"2024-04-25T02:28:09.546640+0000","last_fullsized":"2024-04-25T02:28:09.546640+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:25:42.876612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2833,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":8777,"num_write":322,"num_write_kb":25948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T02:23:55.954130+0000","last_change":"2024-04-25T02:23:13.848430+0000","last_active":"2024-04-25T02:23:55.954130+0000","last_peered":"2024-04-25T02:23:55.954130+0000","last_clean":"2024-04-25T02:23:55.954130+0000","last_became_active":"2024-04-25T02:23:13.847888+0000","last_became_peered":"2024-04-25T02:23:13.847888+0000","last_unstale":"2024-04-25T02:23:55.954130+0000","last_undegraded":"2024-04-25T02:23:55.954130+0000","last_fullsized":"2024-04-25T02:23:55.954130+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:57:11.831417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"43'70","reported_seq":111,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.500879+0000","last_change":"2024-04-25T02:23:12.848598+0000","last_active":"2024-04-25T02:28:10.500879+0000","last_peered":"2024-04-25T02:28:10.500879+0000","last_clean":"2024-04-25T02:28:10.500879+0000","last_became_active":"2024-04-25T02:23:12.848312+0000","last_became_peered":"2024-04-25T02:23:12.848312+0000","last_unstale":"2024-04-25T02:28:10.500879+0000","last_undegraded":"2024-04-25T02:28:10.500879+0000","last_fullsized":"2024-04-25T02:28:10.500879+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:58:41.830406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"43'374","reported_seq":455,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.527667+0000","last_change":"2024-04-25T02:23:12.842182+0000","last_active":"2024-04-25T02:28:09.527667+0000","last_peered":"2024-04-25T02:28:09.527667+0000","last_clean":"2024-04-25T02:28:09.527667+0000","last_became_active":"2024-04-25T02:23:12.841408+0000","last_became_peered":"2024-04-25T02:23:12.841408+0000","last_unstale":"2024-04-25T02:28:09.527667+0000","last_undegraded":"2024-04-25T02:28:09.527667+0000","last_fullsized":"2024-04-25T02:28:09.527667+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:06:31.558059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5875,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":49,"num_read_kb":27937,"num_write":346,"num_write_kb":51359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T02:23:55.955840+0000","last_change":"2024-04-25T02:23:13.848743+0000","last_active":"2024-04-25T02:23:55.955840+0000","last_peered":"2024-04-25T02:23:55.955840+0000","last_clean":"2024-04-25T02:23:55.955840+0000","last_became_active":"2024-04-25T02:23:13.848076+0000","last_became_peered":"2024-04-25T02:23:13.848076+0000","last_unstale":"2024-04-25T02:23:55.955840+0000","last_undegraded":"2024-04-25T02:23:55.955840+0000","last_fullsized":"2024-04-25T02:23:55.955840+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:08:43.341421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"43'394","reported_seq":428,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:07.507384+0000","last_change":"2024-04-25T02:23:12.848506+0000","last_active":"2024-04-25T02:28:07.507384+0000","last_peered":"2024-04-25T02:28:07.507384+0000","last_clean":"2024-04-25T02:28:07.507384+0000","last_became_active":"2024-04-25T02:23:12.848229+0000","last_became_peered":"2024-04-25T02:23:12.848229+0000","last_unstale":"2024-04-25T02:28:07.507384+0000","last_undegraded":"2024-04-25T02:28:07.507384+0000","last_fullsized":"2024-04-25T02:28:07.507384+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:24:34.129737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":337,"num_write_kb":8338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"43'343","reported_seq":393,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.527852+0000","last_change":"2024-04-25T02:23:11.835239+0000","last_active":"2024-04-25T02:28:09.527852+0000","last_peered":"2024-04-25T02:28:09.527852+0000","last_clean":"2024-04-25T02:28:09.527852+0000","last_became_active":"2024-04-25T02:23:11.834994+0000","last_became_peered":"2024-04-25T02:23:11.834994+0000","last_unstale":"2024-04-25T02:28:09.527852+0000","last_undegraded":"2024-04-25T02:28:09.527852+0000","last_fullsized":"2024-04-25T02:28:09.527852+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:51.196318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1068,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":11931,"num_write":324,"num_write_kb":25986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":42,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T02:23:55.951912+0000","last_change":"2024-04-25T02:23:13.849321+0000","last_active":"2024-04-25T02:23:55.951912+0000","last_peered":"2024-04-25T02:23:55.951912+0000","last_clean":"2024-04-25T02:23:55.951912+0000","last_became_active":"2024-04-25T02:23:13.848628+0000","last_became_peered":"2024-04-25T02:23:13.848628+0000","last_unstale":"2024-04-25T02:23:55.951912+0000","last_undegraded":"2024-04-25T02:23:55.951912+0000","last_fullsized":"2024-04-25T02:23:55.951912+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:46:12.919462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"22'115","reported_seq":192,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T02:23:56.300317+0000","last_change":"2024-04-25T02:23:11.836134+0000","last_active":"2024-04-25T02:23:56.300317+0000","last_peered":"2024-04-25T02:23:56.300317+0000","last_clean":"2024-04-25T02:23:56.300317+0000","last_became_active":"2024-04-25T02:23:11.835430+0000","last_became_peered":"2024-04-25T02:23:11.835430+0000","last_unstale":"2024-04-25T02:23:56.300317+0000","last_undegraded":"2024-04-25T02:23:56.300317+0000","last_fullsized":"2024-04-25T02:23:56.300317+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:08.432182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:08.432182+0000","last_clean_scrub_stamp":"2024-04-25T02:20:08.432182+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:45:18.572525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"43'573","reported_seq":612,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:06.518918+0000","last_change":"2024-04-25T02:23:13.848149+0000","last_active":"2024-04-25T02:28:06.518918+0000","last_peered":"2024-04-25T02:28:06.518918+0000","last_clean":"2024-04-25T02:28:06.518918+0000","last_became_active":"2024-04-25T02:23:13.845029+0000","last_became_peered":"2024-04-25T02:23:13.845029+0000","last_unstale":"2024-04-25T02:28:06.518918+0000","last_undegraded":"2024-04-25T02:28:06.518918+0000","last_fullsized":"2024-04-25T02:28:06.518918+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":573,"log_dups_size":0,"ondisk_log_size":573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:17.775866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":507,"num_write_kb":8447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"43'444","reported_seq":555,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.494479+0000","last_change":"2024-04-25T02:23:13.848481+0000","last_active":"2024-04-25T02:28:10.494479+0000","last_peered":"2024-04-25T02:28:10.494479+0000","last_clean":"2024-04-25T02:28:10.494479+0000","last_became_active":"2024-04-25T02:23:13.844018+0000","last_became_peered":"2024-04-25T02:23:13.844018+0000","last_unstale":"2024-04-25T02:28:10.494479+0000","last_undegraded":"2024-04-25T02:28:10.494479+0000","last_fullsized":"2024-04-25T02:28:10.494479+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:28:48.151869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":31679,"num_write":414,"num_write_kb":80533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T02:23:55.950509+0000","last_change":"2024-04-25T02:23:13.848526+0000","last_active":"2024-04-25T02:23:55.950509+0000","last_peered":"2024-04-25T02:23:55.950509+0000","last_clean":"2024-04-25T02:23:55.950509+0000","last_became_active":"2024-04-25T02:23:13.844753+0000","last_became_peered":"2024-04-25T02:23:13.844753+0000","last_unstale":"2024-04-25T02:23:55.950509+0000","last_undegraded":"2024-04-25T02:23:55.950509+0000","last_fullsized":"2024-04-25T02:23:55.950509+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:01:01.038928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"43'252","reported_seq":474,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.479947+0000","last_change":"2024-04-25T02:23:12.845945+0000","last_active":"2024-04-25T02:28:12.479947+0000","last_peered":"2024-04-25T02:28:12.479947+0000","last_clean":"2024-04-25T02:28:12.479947+0000","last_became_active":"2024-04-25T02:23:12.845638+0000","last_became_peered":"2024-04-25T02:23:12.845638+0000","last_unstale":"2024-04-25T02:28:12.479947+0000","last_undegraded":"2024-04-25T02:28:12.479947+0000","last_fullsized":"2024-04-25T02:28:12.479947+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:47:37.213557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1460763,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":182,"num_read_kb":1548,"num_write":182,"num_write_kb":1548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"43'454","reported_seq":572,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.366366+0000","last_change":"2024-04-25T02:23:11.840630+0000","last_active":"2024-04-25T02:28:12.366366+0000","last_peered":"2024-04-25T02:28:12.366366+0000","last_clean":"2024-04-25T02:28:12.366366+0000","last_became_active":"2024-04-25T02:23:11.840215+0000","last_became_peered":"2024-04-25T02:23:11.840215+0000","last_unstale":"2024-04-25T02:28:12.366366+0000","last_undegraded":"2024-04-25T02:28:12.366366+0000","last_fullsized":"2024-04-25T02:28:12.366366+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:18:40.221229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":42224,"num_write":426,"num_write_kb":96444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T02:23:55.953079+0000","last_change":"2024-04-25T02:23:13.845169+0000","last_active":"2024-04-25T02:23:55.953079+0000","last_peered":"2024-04-25T02:23:55.953079+0000","last_clean":"2024-04-25T02:23:55.953079+0000","last_became_active":"2024-04-25T02:23:13.841324+0000","last_became_peered":"2024-04-25T02:23:13.841324+0000","last_unstale":"2024-04-25T02:23:55.953079+0000","last_undegraded":"2024-04-25T02:23:55.953079+0000","last_fullsized":"2024-04-25T02:23:55.953079+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:23.490432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"43'52","reported_seq":84,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.493200+0000","last_change":"2024-04-25T02:23:12.842493+0000","last_active":"2024-04-25T02:28:09.493200+0000","last_peered":"2024-04-25T02:28:09.493200+0000","last_clean":"2024-04-25T02:28:09.493200+0000","last_became_active":"2024-04-25T02:23:12.841930+0000","last_became_peered":"2024-04-25T02:23:12.841930+0000","last_unstale":"2024-04-25T02:28:09.493200+0000","last_undegraded":"2024-04-25T02:28:09.493200+0000","last_fullsized":"2024-04-25T02:28:09.493200+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:36:52.589994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"43'427","reported_seq":585,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.347197+0000","last_change":"2024-04-25T02:23:12.848221+0000","last_active":"2024-04-25T02:28:12.347197+0000","last_peered":"2024-04-25T02:28:12.347197+0000","last_clean":"2024-04-25T02:28:12.347197+0000","last_became_active":"2024-04-25T02:23:12.847949+0000","last_became_peered":"2024-04-25T02:23:12.847949+0000","last_unstale":"2024-04-25T02:28:12.347197+0000","last_undegraded":"2024-04-25T02:28:12.347197+0000","last_fullsized":"2024-04-25T02:28:12.347197+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:17.728665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":62452,"num_write":394,"num_write_kb":105065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"43'65","reported_seq":108,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.539979+0000","last_change":"2024-04-25T02:23:13.844968+0000","last_active":"2024-04-25T02:28:09.539979+0000","last_peered":"2024-04-25T02:28:09.539979+0000","last_clean":"2024-04-25T02:28:09.539979+0000","last_became_active":"2024-04-25T02:23:13.844133+0000","last_became_peered":"2024-04-25T02:23:13.844133+0000","last_unstale":"2024-04-25T02:28:09.539979+0000","last_undegraded":"2024-04-25T02:28:09.539979+0000","last_fullsized":"2024-04-25T02:28:09.539979+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:02.533959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":32,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T02:23:56.301608+0000","last_change":"2024-04-25T02:23:11.837086+0000","last_active":"2024-04-25T02:23:56.301608+0000","last_peered":"2024-04-25T02:23:56.301608+0000","last_clean":"2024-04-25T02:23:56.301608+0000","last_became_active":"2024-04-25T02:23:11.836737+0000","last_became_peered":"2024-04-25T02:23:11.836737+0000","last_unstale":"2024-04-25T02:23:56.301608+0000","last_undegraded":"2024-04-25T02:23:56.301608+0000","last_fullsized":"2024-04-25T02:23:56.301608+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:10:23.058045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"43'426","reported_seq":558,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.498442+0000","last_change":"2024-04-25T02:23:13.848280+0000","last_active":"2024-04-25T02:28:09.498442+0000","last_peered":"2024-04-25T02:28:09.498442+0000","last_clean":"2024-04-25T02:28:09.498442+0000","last_became_active":"2024-04-25T02:23:13.843915+0000","last_became_peered":"2024-04-25T02:23:13.843915+0000","last_unstale":"2024-04-25T02:28:09.498442+0000","last_undegraded":"2024-04-25T02:28:09.498442+0000","last_fullsized":"2024-04-25T02:28:09.498442+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:25:56.800969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":48451,"num_write":406,"num_write_kb":112597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T02:23:55.954435+0000","last_change":"2024-04-25T02:23:13.839018+0000","last_active":"2024-04-25T02:23:55.954435+0000","last_peered":"2024-04-25T02:23:55.954435+0000","last_clean":"2024-04-25T02:23:55.954435+0000","last_became_active":"2024-04-25T02:23:13.838746+0000","last_became_peered":"2024-04-25T02:23:13.838746+0000","last_unstale":"2024-04-25T02:23:55.954435+0000","last_undegraded":"2024-04-25T02:23:55.954435+0000","last_fullsized":"2024-04-25T02:23:55.954435+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:33:00.283023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"43'85","reported_seq":124,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.494558+0000","last_change":"2024-04-25T02:23:11.840837+0000","last_active":"2024-04-25T02:28:10.494558+0000","last_peered":"2024-04-25T02:28:10.494558+0000","last_clean":"2024-04-25T02:28:10.494558+0000","last_became_active":"2024-04-25T02:23:11.840553+0000","last_became_peered":"2024-04-25T02:23:11.840553+0000","last_unstale":"2024-04-25T02:28:10.494558+0000","last_undegraded":"2024-04-25T02:28:10.494558+0000","last_fullsized":"2024-04-25T02:28:10.494558+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:56:05.056497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":72,"num_write_kb":962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"43'392","reported_seq":479,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.563733+0000","last_change":"2024-04-25T02:23:13.848907+0000","last_active":"2024-04-25T02:28:09.563733+0000","last_peered":"2024-04-25T02:28:09.563733+0000","last_clean":"2024-04-25T02:28:09.563733+0000","last_became_active":"2024-04-25T02:23:13.848374+0000","last_became_peered":"2024-04-25T02:23:13.848374+0000","last_unstale":"2024-04-25T02:28:09.563733+0000","last_undegraded":"2024-04-25T02:28:09.563733+0000","last_fullsized":"2024-04-25T02:28:09.563733+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:31:18.538296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":25341,"num_write":367,"num_write_kb":104771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"43'122","reported_seq":163,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:07.496913+0000","last_change":"2024-04-25T02:23:13.842766+0000","last_active":"2024-04-25T02:28:07.496913+0000","last_peered":"2024-04-25T02:28:07.496913+0000","last_clean":"2024-04-25T02:28:07.496913+0000","last_became_active":"2024-04-25T02:23:13.842438+0000","last_became_peered":"2024-04-25T02:23:13.842438+0000","last_unstale":"2024-04-25T02:28:07.496913+0000","last_undegraded":"2024-04-25T02:28:07.496913+0000","last_fullsized":"2024-04-25T02:28:07.496913+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:25:58.471982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4196548,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"43'364","reported_seq":446,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.565407+0000","last_change":"2024-04-25T02:23:12.844587+0000","last_active":"2024-04-25T02:28:09.565407+0000","last_peered":"2024-04-25T02:28:09.565407+0000","last_clean":"2024-04-25T02:28:09.565407+0000","last_became_active":"2024-04-25T02:23:12.844258+0000","last_became_peered":"2024-04-25T02:23:12.844258+0000","last_unstale":"2024-04-25T02:28:09.565407+0000","last_undegraded":"2024-04-25T02:28:09.565407+0000","last_fullsized":"2024-04-25T02:28:09.565407+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:32:01.305698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":25157,"num_write":340,"num_write_kb":59328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"43'316","reported_seq":349,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.539079+0000","last_change":"2024-04-25T02:23:11.833629+0000","last_active":"2024-04-25T02:28:08.539079+0000","last_peered":"2024-04-25T02:28:08.539079+0000","last_clean":"2024-04-25T02:28:08.539079+0000","last_became_active":"2024-04-25T02:23:11.833348+0000","last_became_peered":"2024-04-25T02:23:11.833348+0000","last_unstale":"2024-04-25T02:28:08.539079+0000","last_undegraded":"2024-04-25T02:28:08.539079+0000","last_fullsized":"2024-04-25T02:28:08.539079+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:10:06.587875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":262,"num_write_kb":4264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"43'363","reported_seq":452,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.576469+0000","last_change":"2024-04-25T02:23:55.963928+0000","last_active":"2024-04-25T02:28:09.576469+0000","last_peered":"2024-04-25T02:28:09.576469+0000","last_clean":"2024-04-25T02:28:09.576469+0000","last_became_active":"2024-04-25T02:23:55.963467+0000","last_became_peered":"2024-04-25T02:23:55.963467+0000","last_unstale":"2024-04-25T02:28:09.576469+0000","last_undegraded":"2024-04-25T02:28:09.576469+0000","last_fullsized":"2024-04-25T02:28:09.576469+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:16:59.986839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":32821,"num_write":343,"num_write_kb":62943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"43'323","reported_seq":370,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.542548+0000","last_change":"2024-04-25T02:23:13.842735+0000","last_active":"2024-04-25T02:28:08.542548+0000","last_peered":"2024-04-25T02:28:08.542548+0000","last_clean":"2024-04-25T02:28:08.542548+0000","last_became_active":"2024-04-25T02:23:13.840492+0000","last_became_peered":"2024-04-25T02:23:13.840492+0000","last_unstale":"2024-04-25T02:28:08.542548+0000","last_undegraded":"2024-04-25T02:28:08.542548+0000","last_fullsized":"2024-04-25T02:28:08.542548+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:25:52.486919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":257,"num_write_kb":12449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"43'377","reported_seq":436,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.550631+0000","last_change":"2024-04-25T02:23:13.848028+0000","last_active":"2024-04-25T02:28:09.550631+0000","last_peered":"2024-04-25T02:28:09.550631+0000","last_clean":"2024-04-25T02:28:09.550631+0000","last_became_active":"2024-04-25T02:23:13.847264+0000","last_became_peered":"2024-04-25T02:23:13.847264+0000","last_unstale":"2024-04-25T02:28:09.550631+0000","last_undegraded":"2024-04-25T02:28:09.550631+0000","last_fullsized":"2024-04-25T02:28:09.550631+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:16.329989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":15655,"num_write":352,"num_write_kb":42131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"43'93","reported_seq":132,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.520240+0000","last_change":"2024-04-25T02:23:13.848227+0000","last_active":"2024-04-25T02:28:09.520240+0000","last_peered":"2024-04-25T02:28:09.520240+0000","last_clean":"2024-04-25T02:28:09.520240+0000","last_became_active":"2024-04-25T02:23:13.845143+0000","last_became_peered":"2024-04-25T02:23:13.845143+0000","last_unstale":"2024-04-25T02:28:09.520240+0000","last_undegraded":"2024-04-25T02:28:09.520240+0000","last_fullsized":"2024-04-25T02:28:09.520240+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:54.494068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":4121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"43'427","reported_seq":461,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.348765+0000","last_change":"2024-04-25T02:23:55.957176+0000","last_active":"2024-04-25T02:28:12.348765+0000","last_peered":"2024-04-25T02:28:12.348765+0000","last_clean":"2024-04-25T02:28:12.348765+0000","last_became_active":"2024-04-25T02:23:55.956828+0000","last_became_peered":"2024-04-25T02:23:55.956828+0000","last_unstale":"2024-04-25T02:28:12.348765+0000","last_undegraded":"2024-04-25T02:28:12.348765+0000","last_fullsized":"2024-04-25T02:28:12.348765+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:36:31.942552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":14079,"num_write":394,"num_write_kb":87521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"43'111","reported_seq":146,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.475749+0000","last_change":"2024-04-25T02:23:11.839479+0000","last_active":"2024-04-25T02:28:09.475749+0000","last_peered":"2024-04-25T02:28:09.475749+0000","last_clean":"2024-04-25T02:28:09.475749+0000","last_became_active":"2024-04-25T02:23:11.838807+0000","last_became_peered":"2024-04-25T02:23:11.838807+0000","last_unstale":"2024-04-25T02:28:09.475749+0000","last_undegraded":"2024-04-25T02:28:09.475749+0000","last_fullsized":"2024-04-25T02:28:09.475749+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:08:41.334897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":59,"num_write_kb":4127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"43'439","reported_seq":512,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.539487+0000","last_change":"2024-04-25T02:23:12.845755+0000","last_active":"2024-04-25T02:28:09.539487+0000","last_peered":"2024-04-25T02:28:09.539487+0000","last_clean":"2024-04-25T02:28:09.539487+0000","last_became_active":"2024-04-25T02:23:12.845497+0000","last_became_peered":"2024-04-25T02:23:12.845497+0000","last_unstale":"2024-04-25T02:28:09.539487+0000","last_undegraded":"2024-04-25T02:28:09.539487+0000","last_fullsized":"2024-04-25T02:28:09.539487+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:04:37.689024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15742,"num_write":414,"num_write_kb":51315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"43'409","reported_seq":474,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.566592+0000","last_change":"2024-04-25T02:23:12.847086+0000","last_active":"2024-04-25T02:28:09.566592+0000","last_peered":"2024-04-25T02:28:09.566592+0000","last_clean":"2024-04-25T02:28:09.566592+0000","last_became_active":"2024-04-25T02:23:12.846719+0000","last_became_peered":"2024-04-25T02:23:12.846719+0000","last_unstale":"2024-04-25T02:28:09.566592+0000","last_undegraded":"2024-04-25T02:28:09.566592+0000","last_fullsized":"2024-04-25T02:28:09.566592+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:19.196820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6904,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":16944,"num_write":388,"num_write_kb":35957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"43'428","reported_seq":472,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.490081+0000","last_change":"2024-04-25T02:23:56.302118+0000","last_active":"2024-04-25T02:28:10.490081+0000","last_peered":"2024-04-25T02:28:10.490081+0000","last_clean":"2024-04-25T02:28:10.490081+0000","last_became_active":"2024-04-25T02:23:56.301745+0000","last_became_peered":"2024-04-25T02:23:56.301745+0000","last_unstale":"2024-04-25T02:28:10.490081+0000","last_undegraded":"2024-04-25T02:28:10.490081+0000","last_fullsized":"2024-04-25T02:28:10.490081+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:22:47.665187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":12557,"num_write":410,"num_write_kb":77332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"43'492","reported_seq":560,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.356441+0000","last_change":"2024-04-25T02:23:13.844518+0000","last_active":"2024-04-25T02:28:12.356441+0000","last_peered":"2024-04-25T02:28:12.356441+0000","last_clean":"2024-04-25T02:28:12.356441+0000","last_became_active":"2024-04-25T02:23:13.844235+0000","last_became_peered":"2024-04-25T02:23:13.844235+0000","last_unstale":"2024-04-25T02:28:12.356441+0000","last_undegraded":"2024-04-25T02:28:12.356441+0000","last_fullsized":"2024-04-25T02:28:12.356441+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:01:33.237637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14237,"num_write":458,"num_write_kb":116854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"43'385","reported_seq":464,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.522953+0000","last_change":"2024-04-25T02:23:13.849525+0000","last_active":"2024-04-25T02:28:09.522953+0000","last_peered":"2024-04-25T02:28:09.522953+0000","last_clean":"2024-04-25T02:28:09.522953+0000","last_became_active":"2024-04-25T02:23:13.845193+0000","last_became_peered":"2024-04-25T02:23:13.845193+0000","last_unstale":"2024-04-25T02:28:09.522953+0000","last_undegraded":"2024-04-25T02:28:09.522953+0000","last_fullsized":"2024-04-25T02:28:09.522953+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:17:33.318731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":36152,"num_write":360,"num_write_kb":54497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"43'396","reported_seq":497,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.509416+0000","last_change":"2024-04-25T02:23:12.842342+0000","last_active":"2024-04-25T02:28:09.509416+0000","last_peered":"2024-04-25T02:28:09.509416+0000","last_clean":"2024-04-25T02:28:09.509416+0000","last_became_active":"2024-04-25T02:23:12.841677+0000","last_became_peered":"2024-04-25T02:23:12.841677+0000","last_unstale":"2024-04-25T02:28:09.509416+0000","last_undegraded":"2024-04-25T02:28:09.509416+0000","last_fullsized":"2024-04-25T02:28:09.509416+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:27.480264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1755,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":69,"num_read_kb":32628,"num_write":373,"num_write_kb":79888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":191495,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":2779,"num_read_kb":1446401,"num_write":24360,"num_write_kb":4320360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":446464,"data_stored":307859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25946,"ondisk_log_size":25946,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":129260201,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":231,"num_read_kb":1603,"num_write":6638,"num_write_kb":130844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":258179072,"data_stored":258078095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39115,"internal_metadata":0},"log_size":8473,"ondisk_log_size":8473,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":31,"seq":133143986238,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":389720,"kb_used_data":88336,"kb_used_omap":9,"kb_used_meta":301366,"kb_avail":93982120,"statfs":{"total":96636764160,"available":96237690880,"internally_reserved":0,"allocated":90456064,"data_stored":90215784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9975,"internal_metadata":308599049},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:27:15 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.35799999999999998,"15min":0.34100000000000003},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":3.5409999999999999,"5min":3.5409999999999999,"15min":3.5409999999999999},"last":0.307},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.40899999999999997,"15min":0.36899999999999999},"min":{"1min":0.161,"5min":0.161,"15min":0.161},"max":{"1min":3.613,"5min":3.613,"15min":3.613},"last":0.29399999999999998}]},{"osd":1,"last update":"Thu Apr 25 02:27:15 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.38900000000000001,"15min":0.36499999999999999},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":3.0009999999999999,"5min":3.0009999999999999,"15min":3.0009999999999999},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.39800000000000002,"15min":0.373},"min":{"1min":0.157,"5min":0.157,"15min":0.157},"max":{"1min":4.9720000000000004,"5min":4.9720000000000004,"15min":4.9720000000000004},"last":0.34399999999999997}]},{"osd":2,"last update":"Thu Apr 25 02:27:15 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.43099999999999999,"15min":0.38},"min":{"1min":0.17599999999999999,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":4.883,"5min":4.883,"15min":4.883},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.40300000000000002,"15min":0.38500000000000001},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":3.0550000000000002,"5min":3.0550000000000002,"15min":3.0550000000000002},"last":0.32200000000000001}]}]},{"osd":2,"up_from":30,"seq":128849018942,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":362480,"kb_used_data":57064,"kb_used_omap":8,"kb_used_meta":305399,"kb_avail":94009360,"statfs":{"total":96636764160,"available":96265584640,"internally_reserved":0,"allocated":58433536,"data_stored":58118799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8387,"internal_metadata":312729405},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:27:18 2024","interfaces":[{"interface":"back","average":{"1min":0.248,"5min":0.313,"15min":0.32000000000000001},"min":{"1min":0.14199999999999999,"5min":0.14199999999999999,"15min":0.14199999999999999},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.251,"5min":0.32700000000000001,"15min":0.33000000000000002},"min":{"1min":0.16400000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.38800000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"last":0.29599999999999999}]},{"osd":1,"last update":"Thu Apr 25 02:27:18 2024","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.34499999999999997,"15min":0.34599999999999997},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.32500000000000001,"5min":0.35199999999999998,"15min":0.34999999999999998},"min":{"1min":0.17599999999999999,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.313}]},{"osd":3,"last update":"Thu Apr 25 02:27:18 2024","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.35299999999999998,"15min":0.35499999999999998},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.36799999999999999}]}]},{"osd":0,"up_from":28,"seq":120259084351,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369380,"kb_used_data":59740,"kb_used_omap":15,"kb_used_meta":309616,"kb_avail":94002460,"statfs":{"total":96636764160,"available":96258519040,"internally_reserved":0,"allocated":61173760,"data_stored":60940630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15790,"internal_metadata":317047378},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 25 02:27:16 2024","interfaces":[{"interface":"back","average":{"1min":0.23100000000000001,"5min":0.32500000000000001,"15min":0.33600000000000002},"min":{"1min":0.14799999999999999,"5min":0.14799999999999999,"15min":0.14799999999999999},"max":{"1min":0.375,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.307},{"interface":"front","average":{"1min":0.27500000000000002,"5min":0.34599999999999997,"15min":0.35799999999999998},"min":{"1min":0.17000000000000001,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.32500000000000001}]},{"osd":2,"last update":"Thu Apr 25 02:27:16 2024","interfaces":[{"interface":"back","average":{"1min":0.30099999999999999,"5min":0.36399999999999999,"15min":0.378},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.42699999999999999,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.28000000000000003,"5min":0.36499999999999999,"15min":0.38300000000000001},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.41399999999999998,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.378}]},{"osd":3,"last update":"Thu Apr 25 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.39000000000000001,"15min":0.38400000000000001},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":2.8069999999999999,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.30099999999999999,"5min":0.39900000000000002,"15min":0.42099999999999999},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.47499999999999998,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.40999999999999998}]}]},{"osd":1,"up_from":29,"seq":124554051646,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":351096,"kb_used_data":53744,"kb_used_omap":4,"kb_used_meta":297339,"kb_avail":94020744,"statfs":{"total":96636764160,"available":96277241856,"internally_reserved":0,"allocated":55033856,"data_stored":54197308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4963,"internal_metadata":304475293},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:27:13 2024","interfaces":[{"interface":"back","average":{"1min":0.248,"5min":0.313,"15min":0.32700000000000001},"min":{"1min":0.155,"5min":0.155,"15min":0.155},"max":{"1min":0.41799999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.219},{"interface":"front","average":{"1min":0.26000000000000001,"5min":0.33300000000000002,"15min":0.35099999999999998},"min":{"1min":0.17599999999999999,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.39600000000000002,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.245}]},{"osd":2,"last update":"Thu Apr 25 02:27:13 2024","interfaces":[{"interface":"back","average":{"1min":0.28599999999999998,"5min":0.34499999999999997,"15min":0.35199999999999998},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.437,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.35899999999999999,"15min":0.36299999999999999},"min":{"1min":0.17000000000000001,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.20399999999999999}]},{"osd":3,"last update":"Thu Apr 25 02:27:13 2024","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.38400000000000001,"15min":0.39800000000000002},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.46899999999999997,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.378,"15min":0.39000000000000001},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.23499999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":60215296,"data_stored":60184605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15790,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":50343936,"data_stored":50332293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4963,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57528320,"data_stored":57511070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8387,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90091520,"data_stored":90050127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9975,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":446464,"data_stored":307859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:28:16.002 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-25T02:28:16.003 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:28:16.155 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.152+0000 7f574333c700 1 Processor -- start 2024-04-25T02:28:16.156 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.152+0000 7f574333c700 1 -- start start 2024-04-25T02:28:16.161 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.153+0000 7f574333c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f573c0a2600 0x7f573c0a4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:16.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.153+0000 7f574333c700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f573c0a31c0 0x7f573c13f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:16.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.153+0000 7f574333c700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f573c0a3f40 con 0x7f573c06dab0 2024-04-25T02:28:16.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.153+0000 7f574333c700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f573c0a4980 con 0x7f573c0a31c0 2024-04-25T02:28:16.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.153+0000 7f574333c700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f573c0a4b90 con 0x7f573c0a2600 2024-04-25T02:28:16.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.153+0000 7f57410d8700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f573c0a2600 0x7f573c0a4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:16.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.153+0000 7f57410d8700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f573c0a2600 0x7f573c0a4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:51814/0 (socket says 172.21.15.111:51814) 2024-04-25T02:28:16.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.153+0000 7f57410d8700 1 -- 172.21.15.111:0/77999284 learned_addr learned my addr 172.21.15.111:0/77999284 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:28:16.162 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.153+0000 7f57408d7700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f573c0a31c0 0x7f573c13f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:16.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.153+0000 7f57418d9700 1 --1- 172.21.15.111:0/77999284 >> v1:172.21.15.111:6789/0 conn(0x7f573c06dab0 0x7f573c06def0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:33418/0 (socket says 172.21.15.111:33418) 2024-04-25T02:28:16.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.153+0000 7f57410d8700 1 -- 172.21.15.111:0/77999284 >> v2:172.21.15.111:3300/0 conn(0x7f573c0a31c0 msgr2=0x7f573c13f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:16.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.153+0000 7f57410d8700 1 --2- 172.21.15.111:0/77999284 >> v2:172.21.15.111:3300/0 conn(0x7f573c0a31c0 0x7f573c13f040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:16.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.153+0000 7f57410d8700 1 -- 172.21.15.111:0/77999284 >> v1:172.21.15.111:6789/0 conn(0x7f573c06dab0 legacy=0x7f573c06def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:16.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.153+0000 7f57410d8700 1 -- 172.21.15.111:0/77999284 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f573c13e8e0 con 0x7f573c0a2600 2024-04-25T02:28:16.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.153+0000 7f5733fff700 1 -- 172.21.15.111:0/77999284 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3394546196 0 0) 0x7f573c0a3f40 con 0x7f573c06dab0 2024-04-25T02:28:16.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.153+0000 7f57408d7700 1 --2- 172.21.15.111:0/77999284 >> v2:172.21.15.111:3300/0 conn(0x7f573c0a31c0 0x7f573c13f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:16.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.153+0000 7f57410d8700 1 --2- 172.21.15.111:0/77999284 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f573c0a2600 0x7f573c0a4440 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f572c00bc50 tx=0x7f572c00b4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5ffff84a3c0d4e1b server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:16.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.153+0000 7f5733fff700 1 -- 172.21.15.111:0/77999284 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572c00dbf0 con 0x7f573c0a2600 2024-04-25T02:28:16.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.153+0000 7f5733fff700 1 -- 172.21.15.111:0/77999284 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f572c00dd50 con 0x7f573c0a2600 2024-04-25T02:28:16.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.153+0000 7f5733fff700 1 -- 172.21.15.111:0/77999284 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f572c0196b0 con 0x7f573c0a2600 2024-04-25T02:28:16.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.154+0000 7f574333c700 1 -- 172.21.15.111:0/77999284 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f573c0a2600 msgr2=0x7f573c0a4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:16.163 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.154+0000 7f574333c700 1 --2- 172.21.15.111:0/77999284 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f573c0a2600 0x7f573c0a4440 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f572c00bc50 tx=0x7f572c00b4f0 comp rx=0 tx=0).stop 2024-04-25T02:28:16.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.154+0000 7f574333c700 1 -- 172.21.15.111:0/77999284 shutdown_connections 2024-04-25T02:28:16.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.154+0000 7f574333c700 1 --2- 172.21.15.111:0/77999284 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f573c0a2600 0x7f573c0a4440 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:16.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.154+0000 7f574333c700 1 --2- 172.21.15.111:0/77999284 >> v2:172.21.15.111:3300/0 conn(0x7f573c0a31c0 0x7f573c13f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:16.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.154+0000 7f574333c700 1 -- 172.21.15.111:0/77999284 >> 172.21.15.111:0/77999284 conn(0x7f573c06d200 msgr2=0x7f573c06aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:16.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.154+0000 7f574333c700 1 -- 172.21.15.111:0/77999284 shutdown_connections 2024-04-25T02:28:16.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.154+0000 7f574333c700 1 -- 172.21.15.111:0/77999284 wait complete. 2024-04-25T02:28:16.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.155+0000 7f574333c700 1 Processor -- start 2024-04-25T02:28:16.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.155+0000 7f574333c700 1 -- start start 2024-04-25T02:28:16.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.156+0000 7f574333c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f573c06dab0 0x7f573c0ab3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:16.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.156+0000 7f574333c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f573c0a2600 0x7f573c0aa6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:16.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.156+0000 7f574333c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f573c0a31c0 0x7f573c14d490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:16.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.156+0000 7f574333c700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f573c0ab0b0 con 0x7f573c0a2600 2024-04-25T02:28:16.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.156+0000 7f574333c700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f573c0ab900 con 0x7f573c0a31c0 2024-04-25T02:28:16.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.156+0000 7f574333c700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f573c0abf40 con 0x7f573c06dab0 2024-04-25T02:28:16.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.156+0000 7f57410d8700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f573c06dab0 0x7f573c0ab3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:16.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.156+0000 7f57408d7700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f573c0a2600 0x7f573c0aa6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:16.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.156+0000 7f57410d8700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f573c06dab0 0x7f573c0ab3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:51828/0 (socket says 172.21.15.111:51828) 2024-04-25T02:28:16.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.156+0000 7f57418d9700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f573c0a31c0 0x7f573c14d490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:16.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.156+0000 7f57410d8700 1 -- 172.21.15.111:0/3353829749 learned_addr learned my addr 172.21.15.111:0/3353829749 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:28:16.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.156+0000 7f57408d7700 1 -- 172.21.15.111:0/3353829749 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f573c06dab0 msgr2=0x7f573c0ab3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:16.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.156+0000 7f57408d7700 1 --2- 172.21.15.111:0/3353829749 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f573c06dab0 0x7f573c0ab3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:16.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.156+0000 7f57408d7700 1 -- 172.21.15.111:0/3353829749 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f573c0a31c0 msgr2=0x7f573c14d490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:16.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.156+0000 7f57408d7700 1 --2- 172.21.15.111:0/3353829749 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f573c0a31c0 0x7f573c14d490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:16.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.156+0000 7f57408d7700 1 -- 172.21.15.111:0/3353829749 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5738009420 con 0x7f573c0a2600 2024-04-25T02:28:16.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.156+0000 7f57410d8700 1 --2- 172.21.15.111:0/3353829749 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f573c06dab0 0x7f573c0ab3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:16.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.156+0000 7f57408d7700 1 --2- 172.21.15.111:0/3353829749 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f573c0a2600 0x7f573c0aa6e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f573c06ab30 tx=0x7f57380091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:16.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.156+0000 7f57317fa700 1 -- 172.21.15.111:0/3353829749 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5738015070 con 0x7f573c0a2600 2024-04-25T02:28:16.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.156+0000 7f57317fa700 1 -- 172.21.15.111:0/3353829749 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f573800b970 con 0x7f573c0a2600 2024-04-25T02:28:16.165 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.156+0000 7f574333c700 1 -- 172.21.15.111:0/3353829749 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f572c00b790 con 0x7f573c0a2600 2024-04-25T02:28:16.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.156+0000 7f57317fa700 1 -- 172.21.15.111:0/3353829749 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f573800bd30 con 0x7f573c0a2600 2024-04-25T02:28:16.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.156+0000 7f574333c700 1 -- 172.21.15.111:0/3353829749 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f573c0aac20 con 0x7f573c0a2600 2024-04-25T02:28:16.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.157+0000 7f57317fa700 1 -- 172.21.15.111:0/3353829749 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f5738019620 con 0x7f573c0a2600 2024-04-25T02:28:16.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.157+0000 7f574333c700 1 -- 172.21.15.111:0/3353829749 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f573c071790 con 0x7f573c0a2600 2024-04-25T02:28:16.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.157+0000 7f57317fa700 1 -- 172.21.15.111:0/3353829749 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4158+0+0 (secure 0 0 0) 0x7f573805ee90 con 0x7f573c0a2600 2024-04-25T02:28:16.166 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.161+0000 7f57317fa700 1 -- 172.21.15.111:0/3353829749 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f573803d0c0 con 0x7f573c0a2600 2024-04-25T02:28:16.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.316+0000 7f574333c700 1 -- 172.21.15.111:0/3353829749 --> v1:172.21.15.111:6816/46482 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f573c0ac0b0 con 0x7f5720045ef0 2024-04-25T02:28:16.326 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.323+0000 7f57317fa700 1 -- 172.21.15.111:0/3353829749 <== mgr.14107 v1:172.21.15.111:6816/46482 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278423 (unknown 2965378022 0 1197470410) 0x7f573c0ac0b0 con 0x7f5720045ef0 2024-04-25T02:28:16.330 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:28:16.332 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.325+0000 7f574333c700 1 -- 172.21.15.111:0/3353829749 >> v1:172.21.15.111:6816/46482 conn(0x7f5720045ef0 legacy=0x7f57200483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:16.332 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.325+0000 7f574333c700 1 -- 172.21.15.111:0/3353829749 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f573c0a2600 msgr2=0x7f573c0aa6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:16.332 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.325+0000 7f574333c700 1 --2- 172.21.15.111:0/3353829749 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f573c0a2600 0x7f573c0aa6e0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f573c06ab30 tx=0x7f57380091a0 comp rx=0 tx=0).stop 2024-04-25T02:28:16.332 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.325+0000 7f574333c700 1 -- 172.21.15.111:0/3353829749 shutdown_connections 2024-04-25T02:28:16.332 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.325+0000 7f574333c700 1 --2- 172.21.15.111:0/3353829749 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f573c0a31c0 0x7f573c14d490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:16.332 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.326+0000 7f574333c700 1 --2- 172.21.15.111:0/3353829749 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f573c06dab0 0x7f573c0ab3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:16.332 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.326+0000 7f574333c700 1 --2- 172.21.15.111:0/3353829749 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f573c0a2600 0x7f573c0aa6e0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:16.332 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.326+0000 7f574333c700 1 -- 172.21.15.111:0/3353829749 >> 172.21.15.111:0/3353829749 conn(0x7f573c06d200 msgr2=0x7f573c13bb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:16.333 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.326+0000 7f574333c700 1 -- 172.21.15.111:0/3353829749 shutdown_connections 2024-04-25T02:28:16.333 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.326+0000 7f574333c700 1 -- 172.21.15.111:0/3353829749 wait complete. 2024-04-25T02:28:16.333 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2024-04-25T02:28:16.340 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":186,"stamp":"2024-04-25T02:28:14.801784+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":130042064,"num_objects":104,"num_object_clones":0,"num_object_copies":208,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":104,"num_whiteouts":0,"num_read":3127,"num_read_kb":1448109,"num_write":31155,"num_write_kb":4453495,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34534,"ondisk_log_size":34534,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1472676,"kb_used_data":258884,"kb_used_omap":38,"kb_used_meta":1213721,"kb_avail":376014684,"statfs":{"total":386547056640,"available":385039036416,"internally_reserved":0,"allocated":265097216,"data_stored":263472521,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39115,"internal_metadata":1242851125},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-10028628,"num_objects":-2263,"num_object_clones":0,"num_object_copies":-4526,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-2263,"num_whiteouts":0,"num_read":37,"num_read_kb":339,"num_write":2996,"num_write_kb":8699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002487"},"pg_stats":[{"pgid":"4.3f","version":"43'394","reported_seq":466,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.537907+0000","last_change":"2024-04-25T02:23:13.846111+0000","last_active":"2024-04-25T02:28:09.537907+0000","last_peered":"2024-04-25T02:28:09.537907+0000","last_clean":"2024-04-25T02:28:09.537907+0000","last_became_active":"2024-04-25T02:23:13.845848+0000","last_became_peered":"2024-04-25T02:23:13.845848+0000","last_unstale":"2024-04-25T02:28:09.537907+0000","last_undegraded":"2024-04-25T02:28:09.537907+0000","last_fullsized":"2024-04-25T02:28:09.537907+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:48:53.653719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":15113,"num_write":370,"num_write_kb":51033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"43'432","reported_seq":516,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.566159+0000","last_change":"2024-04-25T02:23:12.845761+0000","last_active":"2024-04-25T02:28:09.566159+0000","last_peered":"2024-04-25T02:28:09.566159+0000","last_clean":"2024-04-25T02:28:09.566159+0000","last_became_active":"2024-04-25T02:23:12.845429+0000","last_became_peered":"2024-04-25T02:23:12.845429+0000","last_unstale":"2024-04-25T02:28:09.566159+0000","last_undegraded":"2024-04-25T02:28:09.566159+0000","last_fullsized":"2024-04-25T02:28:09.566159+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:39:23.193473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22592,"num_write":405,"num_write_kb":75650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"43'370","reported_seq":430,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.365156+0000","last_change":"2024-04-25T02:23:11.838311+0000","last_active":"2024-04-25T02:28:12.365156+0000","last_peered":"2024-04-25T02:28:12.365156+0000","last_clean":"2024-04-25T02:28:12.365156+0000","last_became_active":"2024-04-25T02:23:11.838054+0000","last_became_peered":"2024-04-25T02:23:11.838054+0000","last_unstale":"2024-04-25T02:28:12.365156+0000","last_undegraded":"2024-04-25T02:28:12.365156+0000","last_fullsized":"2024-04-25T02:28:12.365156+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:55:20.837592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":15817,"num_write":338,"num_write_kb":46402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"43'393","reported_seq":474,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.365982+0000","last_change":"2024-04-25T02:23:11.837015+0000","last_active":"2024-04-25T02:28:12.365982+0000","last_peered":"2024-04-25T02:28:12.365982+0000","last_clean":"2024-04-25T02:28:12.365982+0000","last_became_active":"2024-04-25T02:23:11.836681+0000","last_became_peered":"2024-04-25T02:23:11.836681+0000","last_unstale":"2024-04-25T02:28:12.365982+0000","last_undegraded":"2024-04-25T02:28:12.365982+0000","last_fullsized":"2024-04-25T02:28:12.365982+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:57:52.130438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22923,"num_write":365,"num_write_kb":51318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"43'406","reported_seq":475,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.358191+0000","last_change":"2024-04-25T02:23:13.843174+0000","last_active":"2024-04-25T02:28:12.358191+0000","last_peered":"2024-04-25T02:28:12.358191+0000","last_clean":"2024-04-25T02:28:12.358191+0000","last_became_active":"2024-04-25T02:23:13.842918+0000","last_became_peered":"2024-04-25T02:23:13.842918+0000","last_unstale":"2024-04-25T02:28:12.358191+0000","last_undegraded":"2024-04-25T02:28:12.358191+0000","last_fullsized":"2024-04-25T02:28:12.358191+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:18:04.676996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14619,"num_write":384,"num_write_kb":71611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"43'360","reported_seq":421,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.512947+0000","last_change":"2024-04-25T02:23:13.848493+0000","last_active":"2024-04-25T02:28:09.512947+0000","last_peered":"2024-04-25T02:28:09.512947+0000","last_clean":"2024-04-25T02:28:09.512947+0000","last_became_active":"2024-04-25T02:23:13.848160+0000","last_became_peered":"2024-04-25T02:23:13.848160+0000","last_unstale":"2024-04-25T02:28:09.512947+0000","last_undegraded":"2024-04-25T02:28:09.512947+0000","last_fullsized":"2024-04-25T02:28:09.512947+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:40:38.221942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12472,"num_write":338,"num_write_kb":33864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"43'436","reported_seq":554,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.574046+0000","last_change":"2024-04-25T02:23:13.842324+0000","last_active":"2024-04-25T02:28:09.574046+0000","last_peered":"2024-04-25T02:28:09.574046+0000","last_clean":"2024-04-25T02:28:09.574046+0000","last_became_active":"2024-04-25T02:23:13.840374+0000","last_became_peered":"2024-04-25T02:23:13.840374+0000","last_unstale":"2024-04-25T02:28:09.574046+0000","last_undegraded":"2024-04-25T02:28:09.574046+0000","last_fullsized":"2024-04-25T02:28:09.574046+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:04:41.899219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":40192,"num_write":416,"num_write_kb":101787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"43'352","reported_seq":418,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.540107+0000","last_change":"2024-04-25T02:23:11.835781+0000","last_active":"2024-04-25T02:28:09.540107+0000","last_peered":"2024-04-25T02:28:09.540107+0000","last_clean":"2024-04-25T02:28:09.540107+0000","last_became_active":"2024-04-25T02:23:11.834759+0000","last_became_peered":"2024-04-25T02:23:11.834759+0000","last_unstale":"2024-04-25T02:28:09.540107+0000","last_undegraded":"2024-04-25T02:28:09.540107+0000","last_fullsized":"2024-04-25T02:28:09.540107+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:17:37.320529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19314,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":34,"num_read_kb":18431,"num_write":327,"num_write_kb":66835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"43'425","reported_seq":514,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.356933+0000","last_change":"2024-04-25T02:23:13.842786+0000","last_active":"2024-04-25T02:28:12.356933+0000","last_peered":"2024-04-25T02:28:12.356933+0000","last_clean":"2024-04-25T02:28:12.356933+0000","last_became_active":"2024-04-25T02:23:13.841883+0000","last_became_peered":"2024-04-25T02:23:13.841883+0000","last_unstale":"2024-04-25T02:28:12.356933+0000","last_undegraded":"2024-04-25T02:28:12.356933+0000","last_fullsized":"2024-04-25T02:28:12.356933+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:13:08.256311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":29378,"num_write":387,"num_write_kb":39136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"43'378","reported_seq":451,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.557173+0000","last_change":"2024-04-25T02:23:11.836289+0000","last_active":"2024-04-25T02:28:09.557173+0000","last_peered":"2024-04-25T02:28:09.557173+0000","last_clean":"2024-04-25T02:28:09.557173+0000","last_became_active":"2024-04-25T02:23:11.835958+0000","last_became_peered":"2024-04-25T02:23:11.835958+0000","last_unstale":"2024-04-25T02:28:09.557173+0000","last_undegraded":"2024-04-25T02:28:09.557173+0000","last_fullsized":"2024-04-25T02:28:09.557173+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:56:00.639964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":18327,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":41,"num_read_kb":25799,"num_write":350,"num_write_kb":67037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"43'346","reported_seq":385,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.576223+0000","last_change":"2024-04-25T02:23:11.836468+0000","last_active":"2024-04-25T02:28:09.576223+0000","last_peered":"2024-04-25T02:28:09.576223+0000","last_clean":"2024-04-25T02:28:09.576223+0000","last_became_active":"2024-04-25T02:23:11.836214+0000","last_became_peered":"2024-04-25T02:23:11.836214+0000","last_unstale":"2024-04-25T02:28:09.576223+0000","last_undegraded":"2024-04-25T02:28:09.576223+0000","last_fullsized":"2024-04-25T02:28:09.576223+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":346,"log_dups_size":0,"ondisk_log_size":346,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:55:43.874015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2596,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":7,"num_read_kb":7176,"num_write":334,"num_write_kb":37702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"43'328","reported_seq":369,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.577670+0000","last_change":"2024-04-25T02:23:13.847944+0000","last_active":"2024-04-25T02:28:09.577670+0000","last_peered":"2024-04-25T02:28:09.577670+0000","last_clean":"2024-04-25T02:28:09.577670+0000","last_became_active":"2024-04-25T02:23:13.847446+0000","last_became_peered":"2024-04-25T02:23:13.847446+0000","last_unstale":"2024-04-25T02:28:09.577670+0000","last_undegraded":"2024-04-25T02:28:09.577670+0000","last_fullsized":"2024-04-25T02:28:09.577670+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":328,"log_dups_size":0,"ondisk_log_size":328,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:18:53.324436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4160,"num_write":309,"num_write_kb":33908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"43'377","reported_seq":418,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.581321+0000","last_change":"2024-04-25T02:23:13.847825+0000","last_active":"2024-04-25T02:28:09.581321+0000","last_peered":"2024-04-25T02:28:09.581321+0000","last_clean":"2024-04-25T02:28:09.581321+0000","last_became_active":"2024-04-25T02:23:13.847009+0000","last_became_peered":"2024-04-25T02:23:13.847009+0000","last_unstale":"2024-04-25T02:28:09.581321+0000","last_undegraded":"2024-04-25T02:28:09.581321+0000","last_fullsized":"2024-04-25T02:28:09.581321+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:04:01.988527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4152,"num_write":352,"num_write_kb":42524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"43'442","reported_seq":520,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.566824+0000","last_change":"2024-04-25T02:23:12.841952+0000","last_active":"2024-04-25T02:28:09.566824+0000","last_peered":"2024-04-25T02:28:09.566824+0000","last_clean":"2024-04-25T02:28:09.566824+0000","last_became_active":"2024-04-25T02:23:12.841783+0000","last_became_peered":"2024-04-25T02:23:12.841783+0000","last_unstale":"2024-04-25T02:28:09.566824+0000","last_undegraded":"2024-04-25T02:28:09.566824+0000","last_fullsized":"2024-04-25T02:28:09.566824+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:42:53.655107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1192,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":46,"num_read_kb":25198,"num_write":420,"num_write_kb":88864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"43'430","reported_seq":521,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.351328+0000","last_change":"2024-04-25T02:23:11.836069+0000","last_active":"2024-04-25T02:28:12.351328+0000","last_peered":"2024-04-25T02:28:12.351328+0000","last_clean":"2024-04-25T02:28:12.351328+0000","last_became_active":"2024-04-25T02:23:11.835815+0000","last_became_peered":"2024-04-25T02:23:11.835815+0000","last_unstale":"2024-04-25T02:28:12.351328+0000","last_undegraded":"2024-04-25T02:28:12.351328+0000","last_fullsized":"2024-04-25T02:28:12.351328+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:07.444694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31947,"num_write":393,"num_write_kb":64059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"43'429","reported_seq":453,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.494254+0000","last_change":"2024-04-25T02:23:55.963552+0000","last_active":"2024-04-25T02:28:10.494254+0000","last_peered":"2024-04-25T02:28:10.494254+0000","last_clean":"2024-04-25T02:28:10.494254+0000","last_became_active":"2024-04-25T02:23:55.963259+0000","last_became_peered":"2024-04-25T02:23:55.963259+0000","last_unstale":"2024-04-25T02:28:10.494254+0000","last_undegraded":"2024-04-25T02:28:10.494254+0000","last_fullsized":"2024-04-25T02:28:10.494254+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:40:16.304418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":2639,"num_write":405,"num_write_kb":51451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"43'394","reported_seq":456,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.356439+0000","last_change":"2024-04-25T02:23:13.844591+0000","last_active":"2024-04-25T02:28:12.356439+0000","last_peered":"2024-04-25T02:28:12.356439+0000","last_clean":"2024-04-25T02:28:12.356439+0000","last_became_active":"2024-04-25T02:23:13.844343+0000","last_became_peered":"2024-04-25T02:23:13.844343+0000","last_unstale":"2024-04-25T02:28:12.356439+0000","last_undegraded":"2024-04-25T02:28:12.356439+0000","last_fullsized":"2024-04-25T02:28:12.356439+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:52:55.994134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9696,"num_write":367,"num_write_kb":33966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"43'391","reported_seq":470,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.347590+0000","last_change":"2024-04-25T02:23:12.848314+0000","last_active":"2024-04-25T02:28:12.347590+0000","last_peered":"2024-04-25T02:28:12.347590+0000","last_clean":"2024-04-25T02:28:12.347590+0000","last_became_active":"2024-04-25T02:23:12.848051+0000","last_became_peered":"2024-04-25T02:23:12.848051+0000","last_unstale":"2024-04-25T02:28:12.347590+0000","last_undegraded":"2024-04-25T02:28:12.347590+0000","last_fullsized":"2024-04-25T02:28:12.347590+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:53:59.236832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":13345,"num_write":357,"num_write_kb":38441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"43'422","reported_seq":532,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.565039+0000","last_change":"2024-04-25T02:23:13.848250+0000","last_active":"2024-04-25T02:28:09.565039+0000","last_peered":"2024-04-25T02:28:09.565039+0000","last_clean":"2024-04-25T02:28:09.565039+0000","last_became_active":"2024-04-25T02:23:13.847602+0000","last_became_peered":"2024-04-25T02:23:13.847602+0000","last_unstale":"2024-04-25T02:28:09.565039+0000","last_undegraded":"2024-04-25T02:28:09.565039+0000","last_fullsized":"2024-04-25T02:28:09.565039+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:36:05.652157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":37845,"num_write":400,"num_write_kb":88566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"43'428","reported_seq":503,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.528212+0000","last_change":"2024-04-25T02:23:13.846327+0000","last_active":"2024-04-25T02:28:09.528212+0000","last_peered":"2024-04-25T02:28:09.528212+0000","last_clean":"2024-04-25T02:28:09.528212+0000","last_became_active":"2024-04-25T02:23:13.845934+0000","last_became_peered":"2024-04-25T02:23:13.845934+0000","last_unstale":"2024-04-25T02:28:09.528212+0000","last_undegraded":"2024-04-25T02:28:09.528212+0000","last_fullsized":"2024-04-25T02:28:09.528212+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:01:47.261604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":13003,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":40,"num_read_kb":22073,"num_write":411,"num_write_kb":67090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"43'402","reported_seq":494,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.563914+0000","last_change":"2024-04-25T02:23:13.847117+0000","last_active":"2024-04-25T02:28:09.563914+0000","last_peered":"2024-04-25T02:28:09.563914+0000","last_clean":"2024-04-25T02:28:09.563914+0000","last_became_active":"2024-04-25T02:23:13.846758+0000","last_became_peered":"2024-04-25T02:23:13.846758+0000","last_unstale":"2024-04-25T02:28:09.563914+0000","last_undegraded":"2024-04-25T02:28:09.563914+0000","last_fullsized":"2024-04-25T02:28:09.563914+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:53:10.872495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3856,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":57,"num_read_kb":24525,"num_write":377,"num_write_kb":100342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"43'445","reported_seq":518,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.366186+0000","last_change":"2024-04-25T02:23:11.835581+0000","last_active":"2024-04-25T02:28:12.366186+0000","last_peered":"2024-04-25T02:28:12.366186+0000","last_clean":"2024-04-25T02:28:12.366186+0000","last_became_active":"2024-04-25T02:23:11.835319+0000","last_became_peered":"2024-04-25T02:23:11.835319+0000","last_unstale":"2024-04-25T02:28:12.366186+0000","last_undegraded":"2024-04-25T02:28:12.366186+0000","last_fullsized":"2024-04-25T02:28:12.366186+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:19:02.978966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":18532,"num_write":411,"num_write_kb":84101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"43'400","reported_seq":507,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.567502+0000","last_change":"2024-04-25T02:23:13.840011+0000","last_active":"2024-04-25T02:28:09.567502+0000","last_peered":"2024-04-25T02:28:09.567502+0000","last_clean":"2024-04-25T02:28:09.567502+0000","last_became_active":"2024-04-25T02:23:13.838917+0000","last_became_peered":"2024-04-25T02:23:13.838917+0000","last_unstale":"2024-04-25T02:28:09.567502+0000","last_undegraded":"2024-04-25T02:28:09.567502+0000","last_fullsized":"2024-04-25T02:28:09.567502+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":400,"log_dups_size":0,"ondisk_log_size":400,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:53:06.476265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":25750,"num_write":380,"num_write_kb":75795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"43'442","reported_seq":507,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.549105+0000","last_change":"2024-04-25T02:23:13.846482+0000","last_active":"2024-04-25T02:28:09.549105+0000","last_peered":"2024-04-25T02:28:09.549105+0000","last_clean":"2024-04-25T02:28:09.549105+0000","last_became_active":"2024-04-25T02:23:13.845814+0000","last_became_peered":"2024-04-25T02:23:13.845814+0000","last_unstale":"2024-04-25T02:28:09.549105+0000","last_undegraded":"2024-04-25T02:28:09.549105+0000","last_fullsized":"2024-04-25T02:28:09.549105+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:33:00.487666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22530,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":30,"num_read_kb":13960,"num_write":425,"num_write_kb":96160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"43'393","reported_seq":445,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.534083+0000","last_change":"2024-04-25T02:23:13.852668+0000","last_active":"2024-04-25T02:28:09.534083+0000","last_peered":"2024-04-25T02:28:09.534083+0000","last_clean":"2024-04-25T02:28:09.534083+0000","last_became_active":"2024-04-25T02:23:13.852093+0000","last_became_peered":"2024-04-25T02:23:13.852093+0000","last_unstale":"2024-04-25T02:28:09.534083+0000","last_undegraded":"2024-04-25T02:28:09.534083+0000","last_fullsized":"2024-04-25T02:28:09.534083+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:57.422935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5787,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":3870,"num_write":381,"num_write_kb":17738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"43'468","reported_seq":549,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.576547+0000","last_change":"2024-04-25T02:23:12.841653+0000","last_active":"2024-04-25T02:28:09.576547+0000","last_peered":"2024-04-25T02:28:09.576547+0000","last_clean":"2024-04-25T02:28:09.576547+0000","last_became_active":"2024-04-25T02:23:12.841477+0000","last_became_peered":"2024-04-25T02:23:12.841477+0000","last_unstale":"2024-04-25T02:28:09.576547+0000","last_undegraded":"2024-04-25T02:28:09.576547+0000","last_fullsized":"2024-04-25T02:28:09.576547+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":468,"log_dups_size":0,"ondisk_log_size":468,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:16:17.108262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":35897,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":49,"num_read_kb":24645,"num_write":443,"num_write_kb":96750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"43'378","reported_seq":451,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.565831+0000","last_change":"2024-04-25T02:23:13.842553+0000","last_active":"2024-04-25T02:28:09.565831+0000","last_peered":"2024-04-25T02:28:09.565831+0000","last_clean":"2024-04-25T02:28:09.565831+0000","last_became_active":"2024-04-25T02:23:13.840422+0000","last_became_peered":"2024-04-25T02:23:13.840422+0000","last_unstale":"2024-04-25T02:28:09.565831+0000","last_undegraded":"2024-04-25T02:28:09.565831+0000","last_fullsized":"2024-04-25T02:28:09.565831+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":378,"log_dups_size":0,"ondisk_log_size":378,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:44:38.010033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":6130,"num_write":356,"num_write_kb":25986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"43'565","reported_seq":598,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.506214+0000","last_change":"2024-04-25T02:23:12.846241+0000","last_active":"2024-04-25T02:28:08.506214+0000","last_peered":"2024-04-25T02:28:08.506214+0000","last_clean":"2024-04-25T02:28:08.506214+0000","last_became_active":"2024-04-25T02:23:12.845923+0000","last_became_peered":"2024-04-25T02:23:12.845923+0000","last_unstale":"2024-04-25T02:28:08.506214+0000","last_undegraded":"2024-04-25T02:28:08.506214+0000","last_fullsized":"2024-04-25T02:28:08.506214+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:59:31.094638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":494,"num_write_kb":12610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"43'405","reported_seq":520,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.494514+0000","last_change":"2024-04-25T02:23:13.850625+0000","last_active":"2024-04-25T02:28:10.494514+0000","last_peered":"2024-04-25T02:28:10.494514+0000","last_clean":"2024-04-25T02:28:10.494514+0000","last_became_active":"2024-04-25T02:23:13.848844+0000","last_became_peered":"2024-04-25T02:23:13.848844+0000","last_unstale":"2024-04-25T02:28:10.494514+0000","last_undegraded":"2024-04-25T02:28:10.494514+0000","last_fullsized":"2024-04-25T02:28:10.494514+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:32.796023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":41312,"num_write":376,"num_write_kb":112833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"43'382","reported_seq":417,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:07.523305+0000","last_change":"2024-04-25T02:23:13.850242+0000","last_active":"2024-04-25T02:28:07.523305+0000","last_peered":"2024-04-25T02:28:07.523305+0000","last_clean":"2024-04-25T02:28:07.523305+0000","last_became_active":"2024-04-25T02:23:13.846821+0000","last_became_peered":"2024-04-25T02:23:13.846821+0000","last_unstale":"2024-04-25T02:28:07.523305+0000","last_undegraded":"2024-04-25T02:28:07.523305+0000","last_fullsized":"2024-04-25T02:28:07.523305+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:16.733579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":334,"num_write_kb":4317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"43'428","reported_seq":521,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.365345+0000","last_change":"2024-04-25T02:23:11.840787+0000","last_active":"2024-04-25T02:28:12.365345+0000","last_peered":"2024-04-25T02:28:12.365345+0000","last_clean":"2024-04-25T02:28:12.365345+0000","last_became_active":"2024-04-25T02:23:11.840274+0000","last_became_peered":"2024-04-25T02:23:11.840274+0000","last_unstale":"2024-04-25T02:28:12.365345+0000","last_undegraded":"2024-04-25T02:28:12.365345+0000","last_fullsized":"2024-04-25T02:28:12.365345+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:26:15.381838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":28196,"num_write":410,"num_write_kb":104265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"43'875","reported_seq":921,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.487831+0000","last_change":"2024-04-25T02:23:13.839791+0000","last_active":"2024-04-25T02:28:10.487831+0000","last_peered":"2024-04-25T02:28:10.487831+0000","last_clean":"2024-04-25T02:28:10.487831+0000","last_became_active":"2024-04-25T02:23:13.839361+0000","last_became_peered":"2024-04-25T02:23:13.839361+0000","last_unstale":"2024-04-25T02:28:10.487831+0000","last_undegraded":"2024-04-25T02:28:10.487831+0000","last_fullsized":"2024-04-25T02:28:10.487831+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":875,"log_dups_size":0,"ondisk_log_size":875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:48:03.634232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":809,"num_write_kb":8568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"43'359","reported_seq":437,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.539747+0000","last_change":"2024-04-25T02:23:13.844099+0000","last_active":"2024-04-25T02:28:09.539747+0000","last_peered":"2024-04-25T02:28:09.539747+0000","last_clean":"2024-04-25T02:28:09.539747+0000","last_became_active":"2024-04-25T02:23:13.843656+0000","last_became_peered":"2024-04-25T02:23:13.843656+0000","last_unstale":"2024-04-25T02:28:09.539747+0000","last_undegraded":"2024-04-25T02:28:09.539747+0000","last_fullsized":"2024-04-25T02:28:09.539747+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":359,"log_dups_size":0,"ondisk_log_size":359,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:18:44.036616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":25136,"num_write":341,"num_write_kb":38831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"43'56","reported_seq":95,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:06.534335+0000","last_change":"2024-04-25T02:23:13.842946+0000","last_active":"2024-04-25T02:28:06.534335+0000","last_peered":"2024-04-25T02:28:06.534335+0000","last_clean":"2024-04-25T02:28:06.534335+0000","last_became_active":"2024-04-25T02:23:13.842598+0000","last_became_peered":"2024-04-25T02:23:13.842598+0000","last_unstale":"2024-04-25T02:28:06.534335+0000","last_undegraded":"2024-04-25T02:28:06.534335+0000","last_fullsized":"2024-04-25T02:28:06.534335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:27.597908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"43'461","reported_seq":536,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.561722+0000","last_change":"2024-04-25T02:23:13.849957+0000","last_active":"2024-04-25T02:28:09.561722+0000","last_peered":"2024-04-25T02:28:09.561722+0000","last_clean":"2024-04-25T02:28:09.561722+0000","last_became_active":"2024-04-25T02:23:13.848675+0000","last_became_peered":"2024-04-25T02:23:13.848675+0000","last_unstale":"2024-04-25T02:28:09.561722+0000","last_undegraded":"2024-04-25T02:28:09.561722+0000","last_fullsized":"2024-04-25T02:28:09.561722+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":461,"log_dups_size":0,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:09:49.581897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":13580,"num_write":443,"num_write_kb":92928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"43'340","reported_seq":374,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.479090+0000","last_change":"2024-04-25T02:23:13.847353+0000","last_active":"2024-04-25T02:28:08.479090+0000","last_peered":"2024-04-25T02:28:08.479090+0000","last_clean":"2024-04-25T02:28:08.479090+0000","last_became_active":"2024-04-25T02:23:13.846764+0000","last_became_peered":"2024-04-25T02:23:13.846764+0000","last_unstale":"2024-04-25T02:28:08.479090+0000","last_undegraded":"2024-04-25T02:28:08.479090+0000","last_fullsized":"2024-04-25T02:28:08.479090+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":340,"log_dups_size":0,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:38:36.095151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":281,"num_write_kb":4273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"43'471","reported_seq":570,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.509616+0000","last_change":"2024-04-25T02:23:13.844687+0000","last_active":"2024-04-25T02:28:10.509616+0000","last_peered":"2024-04-25T02:28:10.509616+0000","last_clean":"2024-04-25T02:28:10.509616+0000","last_became_active":"2024-04-25T02:23:13.839702+0000","last_became_peered":"2024-04-25T02:23:13.839702+0000","last_unstale":"2024-04-25T02:28:10.509616+0000","last_undegraded":"2024-04-25T02:28:10.509616+0000","last_fullsized":"2024-04-25T02:28:10.509616+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":471,"log_dups_size":0,"ondisk_log_size":471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:10:23.178715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":30102,"num_write":452,"num_write_kb":97286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"43'136","reported_seq":178,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.515488+0000","last_change":"2024-04-25T02:23:13.844668+0000","last_active":"2024-04-25T02:28:10.515488+0000","last_peered":"2024-04-25T02:28:10.515488+0000","last_clean":"2024-04-25T02:28:10.515488+0000","last_became_active":"2024-04-25T02:23:13.843625+0000","last_became_peered":"2024-04-25T02:23:13.843625+0000","last_unstale":"2024-04-25T02:28:10.515488+0000","last_undegraded":"2024-04-25T02:28:10.515488+0000","last_fullsized":"2024-04-25T02:28:10.515488+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:19:41.521042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":72,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"43'409","reported_seq":482,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.540770+0000","last_change":"2024-04-25T02:23:13.851184+0000","last_active":"2024-04-25T02:28:09.540770+0000","last_peered":"2024-04-25T02:28:09.540770+0000","last_clean":"2024-04-25T02:28:09.540770+0000","last_became_active":"2024-04-25T02:23:13.850845+0000","last_became_peered":"2024-04-25T02:23:13.850845+0000","last_unstale":"2024-04-25T02:28:09.540770+0000","last_undegraded":"2024-04-25T02:28:09.540770+0000","last_fullsized":"2024-04-25T02:28:09.540770+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:07:20.048534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":19125,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":38,"num_read_kb":24672,"num_write":387,"num_write_kb":75497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"43'341","reported_seq":385,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:11.203375+0000","last_change":"2024-04-25T02:23:13.849389+0000","last_active":"2024-04-25T02:28:11.203375+0000","last_peered":"2024-04-25T02:28:11.203375+0000","last_clean":"2024-04-25T02:28:11.203375+0000","last_became_active":"2024-04-25T02:23:13.845176+0000","last_became_peered":"2024-04-25T02:23:13.845176+0000","last_unstale":"2024-04-25T02:28:11.203375+0000","last_undegraded":"2024-04-25T02:28:11.203375+0000","last_fullsized":"2024-04-25T02:28:11.203375+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":341,"log_dups_size":0,"ondisk_log_size":341,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:50:14.041957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10355158,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":7,"num_read_kb":10,"num_write":287,"num_write_kb":10305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"43'390","reported_seq":457,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.576280+0000","last_change":"2024-04-25T02:23:55.964120+0000","last_active":"2024-04-25T02:28:09.576280+0000","last_peered":"2024-04-25T02:28:09.576280+0000","last_clean":"2024-04-25T02:28:09.576280+0000","last_became_active":"2024-04-25T02:23:55.963655+0000","last_became_peered":"2024-04-25T02:23:55.963655+0000","last_unstale":"2024-04-25T02:28:09.576280+0000","last_undegraded":"2024-04-25T02:28:09.576280+0000","last_fullsized":"2024-04-25T02:28:09.576280+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:04:44.724602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":11609,"num_write":365,"num_write_kb":76437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"43'493","reported_seq":541,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:06.537420+0000","last_change":"2024-04-25T02:23:13.839481+0000","last_active":"2024-04-25T02:28:06.537420+0000","last_peered":"2024-04-25T02:28:06.537420+0000","last_clean":"2024-04-25T02:28:06.537420+0000","last_became_active":"2024-04-25T02:23:13.839158+0000","last_became_peered":"2024-04-25T02:23:13.839158+0000","last_unstale":"2024-04-25T02:28:06.537420+0000","last_undegraded":"2024-04-25T02:28:06.537420+0000","last_fullsized":"2024-04-25T02:28:06.537420+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:07:04.590892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":7,"num_write":435,"num_write_kb":8384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"43'398","reported_seq":477,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.574056+0000","last_change":"2024-04-25T02:23:13.843740+0000","last_active":"2024-04-25T02:28:09.574056+0000","last_peered":"2024-04-25T02:28:09.574056+0000","last_clean":"2024-04-25T02:28:09.574056+0000","last_became_active":"2024-04-25T02:23:13.843441+0000","last_became_peered":"2024-04-25T02:23:13.843441+0000","last_unstale":"2024-04-25T02:28:09.574056+0000","last_undegraded":"2024-04-25T02:28:09.574056+0000","last_fullsized":"2024-04-25T02:28:09.574056+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":398,"log_dups_size":0,"ondisk_log_size":398,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:53:20.763788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":25550,"num_write":379,"num_write_kb":104949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"43'51","reported_seq":89,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.480443+0000","last_change":"2024-04-25T02:23:13.844290+0000","last_active":"2024-04-25T02:28:08.480443+0000","last_peered":"2024-04-25T02:28:08.480443+0000","last_clean":"2024-04-25T02:28:08.480443+0000","last_became_active":"2024-04-25T02:23:13.841976+0000","last_became_peered":"2024-04-25T02:23:13.841976+0000","last_unstale":"2024-04-25T02:28:08.480443+0000","last_undegraded":"2024-04-25T02:28:08.480443+0000","last_fullsized":"2024-04-25T02:28:08.480443+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:16:25.998330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"43'401","reported_seq":486,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.511676+0000","last_change":"2024-04-25T02:23:13.843455+0000","last_active":"2024-04-25T02:28:10.511676+0000","last_peered":"2024-04-25T02:28:10.511676+0000","last_clean":"2024-04-25T02:28:10.511676+0000","last_became_active":"2024-04-25T02:23:13.842163+0000","last_became_peered":"2024-04-25T02:23:13.842163+0000","last_unstale":"2024-04-25T02:28:10.511676+0000","last_undegraded":"2024-04-25T02:28:10.511676+0000","last_fullsized":"2024-04-25T02:28:10.511676+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":401,"log_dups_size":0,"ondisk_log_size":401,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:59:59.924648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":18209,"num_write":378,"num_write_kb":67140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"43'57","reported_seq":96,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:06.534681+0000","last_change":"2024-04-25T02:23:13.839221+0000","last_active":"2024-04-25T02:28:06.534681+0000","last_peered":"2024-04-25T02:28:06.534681+0000","last_clean":"2024-04-25T02:28:06.534681+0000","last_became_active":"2024-04-25T02:23:13.838616+0000","last_became_peered":"2024-04-25T02:23:13.838616+0000","last_unstale":"2024-04-25T02:28:06.534681+0000","last_undegraded":"2024-04-25T02:28:06.534681+0000","last_fullsized":"2024-04-25T02:28:06.534681+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:24:48.817920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"43'445","reported_seq":564,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.358374+0000","last_change":"2024-04-25T02:23:13.842908+0000","last_active":"2024-04-25T02:28:12.358374+0000","last_peered":"2024-04-25T02:28:12.358374+0000","last_clean":"2024-04-25T02:28:12.358374+0000","last_became_active":"2024-04-25T02:23:13.842649+0000","last_became_peered":"2024-04-25T02:23:13.842649+0000","last_unstale":"2024-04-25T02:28:12.358374+0000","last_undegraded":"2024-04-25T02:28:12.358374+0000","last_fullsized":"2024-04-25T02:28:12.358374+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:04:07.758366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":37870,"num_write":411,"num_write_kb":80233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"43'62","reported_seq":99,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:06.530408+0000","last_change":"2024-04-25T02:23:11.835951+0000","last_active":"2024-04-25T02:28:06.530408+0000","last_peered":"2024-04-25T02:28:06.530408+0000","last_clean":"2024-04-25T02:28:06.530408+0000","last_became_active":"2024-04-25T02:23:11.835077+0000","last_became_peered":"2024-04-25T02:23:11.835077+0000","last_unstale":"2024-04-25T02:28:06.530408+0000","last_undegraded":"2024-04-25T02:28:06.530408+0000","last_fullsized":"2024-04-25T02:28:06.530408+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:24:42.651723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"43'381","reported_seq":511,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.565366+0000","last_change":"2024-04-25T02:23:13.843899+0000","last_active":"2024-04-25T02:28:09.565366+0000","last_peered":"2024-04-25T02:28:09.565366+0000","last_clean":"2024-04-25T02:28:09.565366+0000","last_became_active":"2024-04-25T02:23:13.843347+0000","last_became_peered":"2024-04-25T02:23:13.843347+0000","last_unstale":"2024-04-25T02:28:09.565366+0000","last_undegraded":"2024-04-25T02:28:09.565366+0000","last_fullsized":"2024-04-25T02:28:09.565366+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":381,"log_dups_size":0,"ondisk_log_size":381,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:46:23.518991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":42863,"num_write":360,"num_write_kb":59443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"43'199","reported_seq":236,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.531368+0000","last_change":"2024-04-25T02:23:11.839659+0000","last_active":"2024-04-25T02:28:09.531368+0000","last_peered":"2024-04-25T02:28:09.531368+0000","last_clean":"2024-04-25T02:28:09.531368+0000","last_became_active":"2024-04-25T02:23:11.839157+0000","last_became_peered":"2024-04-25T02:23:11.839157+0000","last_unstale":"2024-04-25T02:28:09.531368+0000","last_undegraded":"2024-04-25T02:28:09.531368+0000","last_fullsized":"2024-04-25T02:28:09.531368+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:06:42.930490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":142,"num_write_kb":4183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"43'395","reported_seq":461,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.523641+0000","last_change":"2024-04-25T02:23:13.841226+0000","last_active":"2024-04-25T02:28:09.523641+0000","last_peered":"2024-04-25T02:28:09.523641+0000","last_clean":"2024-04-25T02:28:09.523641+0000","last_became_active":"2024-04-25T02:23:13.840951+0000","last_became_peered":"2024-04-25T02:23:13.840951+0000","last_unstale":"2024-04-25T02:28:09.523641+0000","last_undegraded":"2024-04-25T02:28:09.523641+0000","last_fullsized":"2024-04-25T02:28:09.523641+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":395,"log_dups_size":0,"ondisk_log_size":395,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:16:58.212703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12931,"num_write":370,"num_write_kb":42530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"43'366","reported_seq":410,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:06.537151+0000","last_change":"2024-04-25T02:23:12.848098+0000","last_active":"2024-04-25T02:28:06.537151+0000","last_peered":"2024-04-25T02:28:06.537151+0000","last_clean":"2024-04-25T02:28:06.537151+0000","last_became_active":"2024-04-25T02:23:12.847813+0000","last_became_peered":"2024-04-25T02:23:12.847813+0000","last_unstale":"2024-04-25T02:28:06.537151+0000","last_undegraded":"2024-04-25T02:28:06.537151+0000","last_fullsized":"2024-04-25T02:28:06.537151+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:31:10.538399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":311,"num_write_kb":4273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"43'440","reported_seq":489,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.513229+0000","last_change":"2024-04-25T02:23:55.963573+0000","last_active":"2024-04-25T02:28:10.513229+0000","last_peered":"2024-04-25T02:28:10.513229+0000","last_clean":"2024-04-25T02:28:10.513229+0000","last_became_active":"2024-04-25T02:23:55.963234+0000","last_became_peered":"2024-04-25T02:23:55.963234+0000","last_unstale":"2024-04-25T02:28:10.513229+0000","last_undegraded":"2024-04-25T02:28:10.513229+0000","last_fullsized":"2024-04-25T02:28:10.513229+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:52:59.926648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21039,"num_write":415,"num_write_kb":62968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"43'594","reported_seq":637,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.538648+0000","last_change":"2024-04-25T02:23:13.848143+0000","last_active":"2024-04-25T02:28:08.538648+0000","last_peered":"2024-04-25T02:28:08.538648+0000","last_clean":"2024-04-25T02:28:08.538648+0000","last_became_active":"2024-04-25T02:23:13.843704+0000","last_became_peered":"2024-04-25T02:23:13.843704+0000","last_unstale":"2024-04-25T02:28:08.538648+0000","last_undegraded":"2024-04-25T02:28:08.538648+0000","last_fullsized":"2024-04-25T02:28:08.538648+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:54:31.975503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":532,"num_write_kb":4350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"43'406","reported_seq":491,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.513466+0000","last_change":"2024-04-25T02:23:13.847842+0000","last_active":"2024-04-25T02:28:10.513466+0000","last_peered":"2024-04-25T02:28:10.513466+0000","last_clean":"2024-04-25T02:28:10.513466+0000","last_became_active":"2024-04-25T02:23:13.845782+0000","last_became_peered":"2024-04-25T02:23:13.845782+0000","last_unstale":"2024-04-25T02:28:10.513466+0000","last_undegraded":"2024-04-25T02:28:10.513466+0000","last_fullsized":"2024-04-25T02:28:10.513466+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:56:46.820624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":24562,"num_write":375,"num_write_kb":59351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"43'59","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.490375+0000","last_change":"2024-04-25T02:23:13.842426+0000","last_active":"2024-04-25T02:28:09.490375+0000","last_peered":"2024-04-25T02:28:09.490375+0000","last_clean":"2024-04-25T02:28:09.490375+0000","last_became_active":"2024-04-25T02:23:13.841815+0000","last_became_peered":"2024-04-25T02:23:13.841815+0000","last_unstale":"2024-04-25T02:28:09.490375+0000","last_undegraded":"2024-04-25T02:28:09.490375+0000","last_fullsized":"2024-04-25T02:28:09.490375+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:20:54.760986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"43'457","reported_seq":573,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.366271+0000","last_change":"2024-04-25T02:23:11.839840+0000","last_active":"2024-04-25T02:28:12.366271+0000","last_peered":"2024-04-25T02:28:12.366271+0000","last_clean":"2024-04-25T02:28:12.366271+0000","last_became_active":"2024-04-25T02:23:11.837258+0000","last_became_peered":"2024-04-25T02:23:11.837258+0000","last_unstale":"2024-04-25T02:28:12.366271+0000","last_undegraded":"2024-04-25T02:28:12.366271+0000","last_fullsized":"2024-04-25T02:28:12.366271+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:49:17.616748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":40530,"num_write":421,"num_write_kb":133096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"43'128","reported_seq":175,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.513945+0000","last_change":"2024-04-25T02:23:13.838948+0000","last_active":"2024-04-25T02:28:08.513945+0000","last_peered":"2024-04-25T02:28:08.513945+0000","last_clean":"2024-04-25T02:28:08.513945+0000","last_became_active":"2024-04-25T02:23:13.838665+0000","last_became_peered":"2024-04-25T02:23:13.838665+0000","last_unstale":"2024-04-25T02:28:08.513945+0000","last_undegraded":"2024-04-25T02:28:08.513945+0000","last_fullsized":"2024-04-25T02:28:08.513945+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:29:28.670027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":66,"num_write_kb":8229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"43'438","reported_seq":515,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.346657+0000","last_change":"2024-04-25T02:23:55.963989+0000","last_active":"2024-04-25T02:28:12.346657+0000","last_peered":"2024-04-25T02:28:12.346657+0000","last_clean":"2024-04-25T02:28:12.346657+0000","last_became_active":"2024-04-25T02:23:55.963557+0000","last_became_peered":"2024-04-25T02:23:55.963557+0000","last_unstale":"2024-04-25T02:28:12.346657+0000","last_undegraded":"2024-04-25T02:28:12.346657+0000","last_fullsized":"2024-04-25T02:28:12.346657+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:01:58.293756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":25759,"num_write":403,"num_write_kb":59138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"43'254","reported_seq":296,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.515045+0000","last_change":"2024-04-25T02:23:13.843937+0000","last_active":"2024-04-25T02:28:08.515045+0000","last_peered":"2024-04-25T02:28:08.515045+0000","last_clean":"2024-04-25T02:28:08.515045+0000","last_became_active":"2024-04-25T02:23:13.843652+0000","last_became_peered":"2024-04-25T02:23:13.843652+0000","last_unstale":"2024-04-25T02:28:08.515045+0000","last_undegraded":"2024-04-25T02:28:08.515045+0000","last_fullsized":"2024-04-25T02:28:08.515045+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:13:15.374851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":4213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"43'382","reported_seq":415,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.507975+0000","last_change":"2024-04-25T02:23:56.302316+0000","last_active":"2024-04-25T02:28:09.507975+0000","last_peered":"2024-04-25T02:28:09.507975+0000","last_clean":"2024-04-25T02:28:09.507975+0000","last_became_active":"2024-04-25T02:23:56.301997+0000","last_became_peered":"2024-04-25T02:23:56.301997+0000","last_unstale":"2024-04-25T02:28:09.507975+0000","last_undegraded":"2024-04-25T02:28:09.507975+0000","last_fullsized":"2024-04-25T02:28:09.507975+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":382,"log_dups_size":0,"ondisk_log_size":382,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:39:22.081330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13585,"num_write":362,"num_write_kb":34032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"43'63","reported_seq":102,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.513793+0000","last_change":"2024-04-25T02:23:13.842533+0000","last_active":"2024-04-25T02:28:08.513793+0000","last_peered":"2024-04-25T02:28:08.513793+0000","last_clean":"2024-04-25T02:28:08.513793+0000","last_became_active":"2024-04-25T02:23:13.841049+0000","last_became_peered":"2024-04-25T02:23:13.841049+0000","last_unstale":"2024-04-25T02:28:08.513793+0000","last_undegraded":"2024-04-25T02:28:08.513793+0000","last_fullsized":"2024-04-25T02:28:08.513793+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:26:00.892546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"43'355","reported_seq":417,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.577849+0000","last_change":"2024-04-25T02:23:13.847171+0000","last_active":"2024-04-25T02:28:09.577849+0000","last_peered":"2024-04-25T02:28:09.577849+0000","last_clean":"2024-04-25T02:28:09.577849+0000","last_became_active":"2024-04-25T02:23:13.846425+0000","last_became_peered":"2024-04-25T02:23:13.846425+0000","last_unstale":"2024-04-25T02:28:09.577849+0000","last_undegraded":"2024-04-25T02:28:09.577849+0000","last_fullsized":"2024-04-25T02:28:09.577849+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":355,"log_dups_size":0,"ondisk_log_size":355,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:40:12.956129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":12898,"num_write":328,"num_write_kb":42412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"43'565","reported_seq":607,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.489808+0000","last_change":"2024-04-25T02:23:13.841178+0000","last_active":"2024-04-25T02:28:08.489808+0000","last_peered":"2024-04-25T02:28:08.489808+0000","last_clean":"2024-04-25T02:28:08.489808+0000","last_became_active":"2024-04-25T02:23:13.840876+0000","last_became_peered":"2024-04-25T02:23:13.840876+0000","last_unstale":"2024-04-25T02:28:08.489808+0000","last_undegraded":"2024-04-25T02:28:08.489808+0000","last_fullsized":"2024-04-25T02:28:08.489808+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:29:47.026682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":506,"num_write_kb":4331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"43'376","reported_seq":453,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.567149+0000","last_change":"2024-04-25T02:23:13.852754+0000","last_active":"2024-04-25T02:28:09.567149+0000","last_peered":"2024-04-25T02:28:09.567149+0000","last_clean":"2024-04-25T02:28:09.567149+0000","last_became_active":"2024-04-25T02:23:13.852398+0000","last_became_peered":"2024-04-25T02:23:13.852398+0000","last_unstale":"2024-04-25T02:28:09.567149+0000","last_undegraded":"2024-04-25T02:28:09.567149+0000","last_fullsized":"2024-04-25T02:28:09.567149+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":376,"log_dups_size":0,"ondisk_log_size":376,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:48:40.857184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":31433,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":42,"num_read_kb":28255,"num_write":352,"num_write_kb":58406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":32,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T02:23:56.300797+0000","last_change":"2024-04-25T02:23:11.834419+0000","last_active":"2024-04-25T02:23:56.300797+0000","last_peered":"2024-04-25T02:23:56.300797+0000","last_clean":"2024-04-25T02:23:56.300797+0000","last_became_active":"2024-04-25T02:23:11.834171+0000","last_became_peered":"2024-04-25T02:23:11.834171+0000","last_unstale":"2024-04-25T02:23:56.300797+0000","last_undegraded":"2024-04-25T02:23:56.300797+0000","last_fullsized":"2024-04-25T02:23:56.300797+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:13:40.419554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"43'431","reported_seq":466,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.550365+0000","last_change":"2024-04-25T02:23:13.848449+0000","last_active":"2024-04-25T02:28:09.550365+0000","last_peered":"2024-04-25T02:28:09.550365+0000","last_clean":"2024-04-25T02:28:09.550365+0000","last_became_active":"2024-04-25T02:23:13.847970+0000","last_became_peered":"2024-04-25T02:23:13.847970+0000","last_unstale":"2024-04-25T02:28:09.550365+0000","last_undegraded":"2024-04-25T02:28:09.550365+0000","last_fullsized":"2024-04-25T02:28:09.550365+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:00:21.733260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":371,"num_write_kb":4349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"43'348","reported_seq":400,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.546640+0000","last_change":"2024-04-25T02:23:13.850097+0000","last_active":"2024-04-25T02:28:09.546640+0000","last_peered":"2024-04-25T02:28:09.546640+0000","last_clean":"2024-04-25T02:28:09.546640+0000","last_became_active":"2024-04-25T02:23:13.849556+0000","last_became_peered":"2024-04-25T02:23:13.849556+0000","last_unstale":"2024-04-25T02:28:09.546640+0000","last_undegraded":"2024-04-25T02:28:09.546640+0000","last_fullsized":"2024-04-25T02:28:09.546640+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":348,"log_dups_size":0,"ondisk_log_size":348,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:25:42.876612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2833,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":8777,"num_write":322,"num_write_kb":25948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T02:23:55.954130+0000","last_change":"2024-04-25T02:23:13.848430+0000","last_active":"2024-04-25T02:23:55.954130+0000","last_peered":"2024-04-25T02:23:55.954130+0000","last_clean":"2024-04-25T02:23:55.954130+0000","last_became_active":"2024-04-25T02:23:13.847888+0000","last_became_peered":"2024-04-25T02:23:13.847888+0000","last_unstale":"2024-04-25T02:23:55.954130+0000","last_undegraded":"2024-04-25T02:23:55.954130+0000","last_fullsized":"2024-04-25T02:23:55.954130+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:57:11.831417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"43'70","reported_seq":111,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.500879+0000","last_change":"2024-04-25T02:23:12.848598+0000","last_active":"2024-04-25T02:28:10.500879+0000","last_peered":"2024-04-25T02:28:10.500879+0000","last_clean":"2024-04-25T02:28:10.500879+0000","last_became_active":"2024-04-25T02:23:12.848312+0000","last_became_peered":"2024-04-25T02:23:12.848312+0000","last_unstale":"2024-04-25T02:28:10.500879+0000","last_undegraded":"2024-04-25T02:28:10.500879+0000","last_fullsized":"2024-04-25T02:28:10.500879+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:58:41.830406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"43'374","reported_seq":455,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.527667+0000","last_change":"2024-04-25T02:23:12.842182+0000","last_active":"2024-04-25T02:28:09.527667+0000","last_peered":"2024-04-25T02:28:09.527667+0000","last_clean":"2024-04-25T02:28:09.527667+0000","last_became_active":"2024-04-25T02:23:12.841408+0000","last_became_peered":"2024-04-25T02:23:12.841408+0000","last_unstale":"2024-04-25T02:28:09.527667+0000","last_undegraded":"2024-04-25T02:28:09.527667+0000","last_fullsized":"2024-04-25T02:28:09.527667+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":374,"log_dups_size":0,"ondisk_log_size":374,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:06:31.558059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5875,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":49,"num_read_kb":27937,"num_write":346,"num_write_kb":51359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T02:23:55.955840+0000","last_change":"2024-04-25T02:23:13.848743+0000","last_active":"2024-04-25T02:23:55.955840+0000","last_peered":"2024-04-25T02:23:55.955840+0000","last_clean":"2024-04-25T02:23:55.955840+0000","last_became_active":"2024-04-25T02:23:13.848076+0000","last_became_peered":"2024-04-25T02:23:13.848076+0000","last_unstale":"2024-04-25T02:23:55.955840+0000","last_undegraded":"2024-04-25T02:23:55.955840+0000","last_fullsized":"2024-04-25T02:23:55.955840+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:08:43.341421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"43'394","reported_seq":428,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:07.507384+0000","last_change":"2024-04-25T02:23:12.848506+0000","last_active":"2024-04-25T02:28:07.507384+0000","last_peered":"2024-04-25T02:28:07.507384+0000","last_clean":"2024-04-25T02:28:07.507384+0000","last_became_active":"2024-04-25T02:23:12.848229+0000","last_became_peered":"2024-04-25T02:23:12.848229+0000","last_unstale":"2024-04-25T02:28:07.507384+0000","last_undegraded":"2024-04-25T02:28:07.507384+0000","last_fullsized":"2024-04-25T02:28:07.507384+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:24:34.129737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":337,"num_write_kb":8338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"43'343","reported_seq":393,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.527852+0000","last_change":"2024-04-25T02:23:11.835239+0000","last_active":"2024-04-25T02:28:09.527852+0000","last_peered":"2024-04-25T02:28:09.527852+0000","last_clean":"2024-04-25T02:28:09.527852+0000","last_became_active":"2024-04-25T02:23:11.834994+0000","last_became_peered":"2024-04-25T02:23:11.834994+0000","last_unstale":"2024-04-25T02:28:09.527852+0000","last_undegraded":"2024-04-25T02:28:09.527852+0000","last_fullsized":"2024-04-25T02:28:09.527852+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":343,"log_dups_size":0,"ondisk_log_size":343,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:51.196318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1068,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":18,"num_read_kb":11931,"num_write":324,"num_write_kb":25986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":42,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T02:23:55.951912+0000","last_change":"2024-04-25T02:23:13.849321+0000","last_active":"2024-04-25T02:23:55.951912+0000","last_peered":"2024-04-25T02:23:55.951912+0000","last_clean":"2024-04-25T02:23:55.951912+0000","last_became_active":"2024-04-25T02:23:13.848628+0000","last_became_peered":"2024-04-25T02:23:13.848628+0000","last_unstale":"2024-04-25T02:23:55.951912+0000","last_undegraded":"2024-04-25T02:23:55.951912+0000","last_fullsized":"2024-04-25T02:23:55.951912+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:46:12.919462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"22'115","reported_seq":192,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T02:23:56.300317+0000","last_change":"2024-04-25T02:23:11.836134+0000","last_active":"2024-04-25T02:23:56.300317+0000","last_peered":"2024-04-25T02:23:56.300317+0000","last_clean":"2024-04-25T02:23:56.300317+0000","last_became_active":"2024-04-25T02:23:11.835430+0000","last_became_peered":"2024-04-25T02:23:11.835430+0000","last_unstale":"2024-04-25T02:23:56.300317+0000","last_undegraded":"2024-04-25T02:23:56.300317+0000","last_fullsized":"2024-04-25T02:23:56.300317+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:08.432182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:08.432182+0000","last_clean_scrub_stamp":"2024-04-25T02:20:08.432182+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:45:18.572525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"43'573","reported_seq":612,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:06.518918+0000","last_change":"2024-04-25T02:23:13.848149+0000","last_active":"2024-04-25T02:28:06.518918+0000","last_peered":"2024-04-25T02:28:06.518918+0000","last_clean":"2024-04-25T02:28:06.518918+0000","last_became_active":"2024-04-25T02:23:13.845029+0000","last_became_peered":"2024-04-25T02:23:13.845029+0000","last_unstale":"2024-04-25T02:28:06.518918+0000","last_undegraded":"2024-04-25T02:28:06.518918+0000","last_fullsized":"2024-04-25T02:28:06.518918+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":573,"log_dups_size":0,"ondisk_log_size":573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:17.775866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":507,"num_write_kb":8447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"43'444","reported_seq":555,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.494479+0000","last_change":"2024-04-25T02:23:13.848481+0000","last_active":"2024-04-25T02:28:10.494479+0000","last_peered":"2024-04-25T02:28:10.494479+0000","last_clean":"2024-04-25T02:28:10.494479+0000","last_became_active":"2024-04-25T02:23:13.844018+0000","last_became_peered":"2024-04-25T02:23:13.844018+0000","last_unstale":"2024-04-25T02:28:10.494479+0000","last_undegraded":"2024-04-25T02:28:10.494479+0000","last_fullsized":"2024-04-25T02:28:10.494479+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":444,"log_dups_size":0,"ondisk_log_size":444,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:28:48.151869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":31679,"num_write":414,"num_write_kb":80533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T02:23:55.950509+0000","last_change":"2024-04-25T02:23:13.848526+0000","last_active":"2024-04-25T02:23:55.950509+0000","last_peered":"2024-04-25T02:23:55.950509+0000","last_clean":"2024-04-25T02:23:55.950509+0000","last_became_active":"2024-04-25T02:23:13.844753+0000","last_became_peered":"2024-04-25T02:23:13.844753+0000","last_unstale":"2024-04-25T02:23:55.950509+0000","last_undegraded":"2024-04-25T02:23:55.950509+0000","last_fullsized":"2024-04-25T02:23:55.950509+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:01:01.038928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"43'252","reported_seq":474,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.479947+0000","last_change":"2024-04-25T02:23:12.845945+0000","last_active":"2024-04-25T02:28:12.479947+0000","last_peered":"2024-04-25T02:28:12.479947+0000","last_clean":"2024-04-25T02:28:12.479947+0000","last_became_active":"2024-04-25T02:23:12.845638+0000","last_became_peered":"2024-04-25T02:23:12.845638+0000","last_unstale":"2024-04-25T02:28:12.479947+0000","last_undegraded":"2024-04-25T02:28:12.479947+0000","last_fullsized":"2024-04-25T02:28:12.479947+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:47:37.213557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1460763,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":182,"num_read_kb":1548,"num_write":182,"num_write_kb":1548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"43'454","reported_seq":572,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.366366+0000","last_change":"2024-04-25T02:23:11.840630+0000","last_active":"2024-04-25T02:28:12.366366+0000","last_peered":"2024-04-25T02:28:12.366366+0000","last_clean":"2024-04-25T02:28:12.366366+0000","last_became_active":"2024-04-25T02:23:11.840215+0000","last_became_peered":"2024-04-25T02:23:11.840215+0000","last_unstale":"2024-04-25T02:28:12.366366+0000","last_undegraded":"2024-04-25T02:28:12.366366+0000","last_fullsized":"2024-04-25T02:28:12.366366+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:18:40.221229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":42224,"num_write":426,"num_write_kb":96444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T02:23:55.953079+0000","last_change":"2024-04-25T02:23:13.845169+0000","last_active":"2024-04-25T02:23:55.953079+0000","last_peered":"2024-04-25T02:23:55.953079+0000","last_clean":"2024-04-25T02:23:55.953079+0000","last_became_active":"2024-04-25T02:23:13.841324+0000","last_became_peered":"2024-04-25T02:23:13.841324+0000","last_unstale":"2024-04-25T02:23:55.953079+0000","last_undegraded":"2024-04-25T02:23:55.953079+0000","last_fullsized":"2024-04-25T02:23:55.953079+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:23.490432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"43'52","reported_seq":84,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.493200+0000","last_change":"2024-04-25T02:23:12.842493+0000","last_active":"2024-04-25T02:28:09.493200+0000","last_peered":"2024-04-25T02:28:09.493200+0000","last_clean":"2024-04-25T02:28:09.493200+0000","last_became_active":"2024-04-25T02:23:12.841930+0000","last_became_peered":"2024-04-25T02:23:12.841930+0000","last_unstale":"2024-04-25T02:28:09.493200+0000","last_undegraded":"2024-04-25T02:28:09.493200+0000","last_fullsized":"2024-04-25T02:28:09.493200+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:36:52.589994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"43'427","reported_seq":585,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.347197+0000","last_change":"2024-04-25T02:23:12.848221+0000","last_active":"2024-04-25T02:28:12.347197+0000","last_peered":"2024-04-25T02:28:12.347197+0000","last_clean":"2024-04-25T02:28:12.347197+0000","last_became_active":"2024-04-25T02:23:12.847949+0000","last_became_peered":"2024-04-25T02:23:12.847949+0000","last_unstale":"2024-04-25T02:28:12.347197+0000","last_undegraded":"2024-04-25T02:28:12.347197+0000","last_fullsized":"2024-04-25T02:28:12.347197+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:17.728665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":62452,"num_write":394,"num_write_kb":105065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"43'65","reported_seq":108,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.539979+0000","last_change":"2024-04-25T02:23:13.844968+0000","last_active":"2024-04-25T02:28:09.539979+0000","last_peered":"2024-04-25T02:28:09.539979+0000","last_clean":"2024-04-25T02:28:09.539979+0000","last_became_active":"2024-04-25T02:23:13.844133+0000","last_became_peered":"2024-04-25T02:23:13.844133+0000","last_unstale":"2024-04-25T02:28:09.539979+0000","last_undegraded":"2024-04-25T02:28:09.539979+0000","last_fullsized":"2024-04-25T02:28:09.539979+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:02.533959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":32,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T02:23:56.301608+0000","last_change":"2024-04-25T02:23:11.837086+0000","last_active":"2024-04-25T02:23:56.301608+0000","last_peered":"2024-04-25T02:23:56.301608+0000","last_clean":"2024-04-25T02:23:56.301608+0000","last_became_active":"2024-04-25T02:23:11.836737+0000","last_became_peered":"2024-04-25T02:23:11.836737+0000","last_unstale":"2024-04-25T02:23:56.301608+0000","last_undegraded":"2024-04-25T02:23:56.301608+0000","last_fullsized":"2024-04-25T02:23:56.301608+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:10:23.058045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"43'426","reported_seq":558,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.498442+0000","last_change":"2024-04-25T02:23:13.848280+0000","last_active":"2024-04-25T02:28:09.498442+0000","last_peered":"2024-04-25T02:28:09.498442+0000","last_clean":"2024-04-25T02:28:09.498442+0000","last_became_active":"2024-04-25T02:23:13.843915+0000","last_became_peered":"2024-04-25T02:23:13.843915+0000","last_unstale":"2024-04-25T02:28:09.498442+0000","last_undegraded":"2024-04-25T02:28:09.498442+0000","last_fullsized":"2024-04-25T02:28:09.498442+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":426,"log_dups_size":0,"ondisk_log_size":426,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:25:56.800969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":48451,"num_write":406,"num_write_kb":112597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T02:23:55.954435+0000","last_change":"2024-04-25T02:23:13.839018+0000","last_active":"2024-04-25T02:23:55.954435+0000","last_peered":"2024-04-25T02:23:55.954435+0000","last_clean":"2024-04-25T02:23:55.954435+0000","last_became_active":"2024-04-25T02:23:13.838746+0000","last_became_peered":"2024-04-25T02:23:13.838746+0000","last_unstale":"2024-04-25T02:23:55.954435+0000","last_undegraded":"2024-04-25T02:23:55.954435+0000","last_fullsized":"2024-04-25T02:23:55.954435+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:33:00.283023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"43'85","reported_seq":124,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.494558+0000","last_change":"2024-04-25T02:23:11.840837+0000","last_active":"2024-04-25T02:28:10.494558+0000","last_peered":"2024-04-25T02:28:10.494558+0000","last_clean":"2024-04-25T02:28:10.494558+0000","last_became_active":"2024-04-25T02:23:11.840553+0000","last_became_peered":"2024-04-25T02:23:11.840553+0000","last_unstale":"2024-04-25T02:28:10.494558+0000","last_undegraded":"2024-04-25T02:28:10.494558+0000","last_fullsized":"2024-04-25T02:28:10.494558+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:56:05.056497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":72,"num_write_kb":962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"43'392","reported_seq":479,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.563733+0000","last_change":"2024-04-25T02:23:13.848907+0000","last_active":"2024-04-25T02:28:09.563733+0000","last_peered":"2024-04-25T02:28:09.563733+0000","last_clean":"2024-04-25T02:28:09.563733+0000","last_became_active":"2024-04-25T02:23:13.848374+0000","last_became_peered":"2024-04-25T02:23:13.848374+0000","last_unstale":"2024-04-25T02:28:09.563733+0000","last_undegraded":"2024-04-25T02:28:09.563733+0000","last_fullsized":"2024-04-25T02:28:09.563733+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:31:18.538296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":25341,"num_write":367,"num_write_kb":104771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"43'122","reported_seq":163,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:07.496913+0000","last_change":"2024-04-25T02:23:13.842766+0000","last_active":"2024-04-25T02:28:07.496913+0000","last_peered":"2024-04-25T02:28:07.496913+0000","last_clean":"2024-04-25T02:28:07.496913+0000","last_became_active":"2024-04-25T02:23:13.842438+0000","last_became_peered":"2024-04-25T02:23:13.842438+0000","last_unstale":"2024-04-25T02:28:07.496913+0000","last_undegraded":"2024-04-25T02:28:07.496913+0000","last_fullsized":"2024-04-25T02:28:07.496913+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:25:58.471982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4196548,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"43'364","reported_seq":446,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.565407+0000","last_change":"2024-04-25T02:23:12.844587+0000","last_active":"2024-04-25T02:28:09.565407+0000","last_peered":"2024-04-25T02:28:09.565407+0000","last_clean":"2024-04-25T02:28:09.565407+0000","last_became_active":"2024-04-25T02:23:12.844258+0000","last_became_peered":"2024-04-25T02:23:12.844258+0000","last_unstale":"2024-04-25T02:28:09.565407+0000","last_undegraded":"2024-04-25T02:28:09.565407+0000","last_fullsized":"2024-04-25T02:28:09.565407+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:32:01.305698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":25157,"num_write":340,"num_write_kb":59328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"43'316","reported_seq":349,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.539079+0000","last_change":"2024-04-25T02:23:11.833629+0000","last_active":"2024-04-25T02:28:08.539079+0000","last_peered":"2024-04-25T02:28:08.539079+0000","last_clean":"2024-04-25T02:28:08.539079+0000","last_became_active":"2024-04-25T02:23:11.833348+0000","last_became_peered":"2024-04-25T02:23:11.833348+0000","last_unstale":"2024-04-25T02:28:08.539079+0000","last_undegraded":"2024-04-25T02:28:08.539079+0000","last_fullsized":"2024-04-25T02:28:08.539079+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:10:06.587875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":262,"num_write_kb":4264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"43'363","reported_seq":452,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.576469+0000","last_change":"2024-04-25T02:23:55.963928+0000","last_active":"2024-04-25T02:28:09.576469+0000","last_peered":"2024-04-25T02:28:09.576469+0000","last_clean":"2024-04-25T02:28:09.576469+0000","last_became_active":"2024-04-25T02:23:55.963467+0000","last_became_peered":"2024-04-25T02:23:55.963467+0000","last_unstale":"2024-04-25T02:28:09.576469+0000","last_undegraded":"2024-04-25T02:28:09.576469+0000","last_fullsized":"2024-04-25T02:28:09.576469+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":363,"log_dups_size":0,"ondisk_log_size":363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:16:59.986839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":32821,"num_write":343,"num_write_kb":62943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"43'323","reported_seq":370,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.542548+0000","last_change":"2024-04-25T02:23:13.842735+0000","last_active":"2024-04-25T02:28:08.542548+0000","last_peered":"2024-04-25T02:28:08.542548+0000","last_clean":"2024-04-25T02:28:08.542548+0000","last_became_active":"2024-04-25T02:23:13.840492+0000","last_became_peered":"2024-04-25T02:23:13.840492+0000","last_unstale":"2024-04-25T02:28:08.542548+0000","last_undegraded":"2024-04-25T02:28:08.542548+0000","last_fullsized":"2024-04-25T02:28:08.542548+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:25:52.486919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":257,"num_write_kb":12449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"43'377","reported_seq":436,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.550631+0000","last_change":"2024-04-25T02:23:13.848028+0000","last_active":"2024-04-25T02:28:09.550631+0000","last_peered":"2024-04-25T02:28:09.550631+0000","last_clean":"2024-04-25T02:28:09.550631+0000","last_became_active":"2024-04-25T02:23:13.847264+0000","last_became_peered":"2024-04-25T02:23:13.847264+0000","last_unstale":"2024-04-25T02:28:09.550631+0000","last_undegraded":"2024-04-25T02:28:09.550631+0000","last_fullsized":"2024-04-25T02:28:09.550631+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":377,"log_dups_size":0,"ondisk_log_size":377,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:16.329989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":15655,"num_write":352,"num_write_kb":42131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"43'93","reported_seq":132,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.520240+0000","last_change":"2024-04-25T02:23:13.848227+0000","last_active":"2024-04-25T02:28:09.520240+0000","last_peered":"2024-04-25T02:28:09.520240+0000","last_clean":"2024-04-25T02:28:09.520240+0000","last_became_active":"2024-04-25T02:23:13.845143+0000","last_became_peered":"2024-04-25T02:23:13.845143+0000","last_unstale":"2024-04-25T02:28:09.520240+0000","last_undegraded":"2024-04-25T02:28:09.520240+0000","last_fullsized":"2024-04-25T02:28:09.520240+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:54.494068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":4121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"43'427","reported_seq":461,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.348765+0000","last_change":"2024-04-25T02:23:55.957176+0000","last_active":"2024-04-25T02:28:12.348765+0000","last_peered":"2024-04-25T02:28:12.348765+0000","last_clean":"2024-04-25T02:28:12.348765+0000","last_became_active":"2024-04-25T02:23:55.956828+0000","last_became_peered":"2024-04-25T02:23:55.956828+0000","last_unstale":"2024-04-25T02:28:12.348765+0000","last_undegraded":"2024-04-25T02:28:12.348765+0000","last_fullsized":"2024-04-25T02:28:12.348765+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:36:31.942552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":14079,"num_write":394,"num_write_kb":87521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"43'111","reported_seq":146,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.475749+0000","last_change":"2024-04-25T02:23:11.839479+0000","last_active":"2024-04-25T02:28:09.475749+0000","last_peered":"2024-04-25T02:28:09.475749+0000","last_clean":"2024-04-25T02:28:09.475749+0000","last_became_active":"2024-04-25T02:23:11.838807+0000","last_became_peered":"2024-04-25T02:23:11.838807+0000","last_unstale":"2024-04-25T02:28:09.475749+0000","last_undegraded":"2024-04-25T02:28:09.475749+0000","last_fullsized":"2024-04-25T02:28:09.475749+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:08:41.334897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":59,"num_write_kb":4127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"43'439","reported_seq":512,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.539487+0000","last_change":"2024-04-25T02:23:12.845755+0000","last_active":"2024-04-25T02:28:09.539487+0000","last_peered":"2024-04-25T02:28:09.539487+0000","last_clean":"2024-04-25T02:28:09.539487+0000","last_became_active":"2024-04-25T02:23:12.845497+0000","last_became_peered":"2024-04-25T02:23:12.845497+0000","last_unstale":"2024-04-25T02:28:09.539487+0000","last_undegraded":"2024-04-25T02:28:09.539487+0000","last_fullsized":"2024-04-25T02:28:09.539487+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":439,"log_dups_size":0,"ondisk_log_size":439,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:04:37.689024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15742,"num_write":414,"num_write_kb":51315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"43'409","reported_seq":474,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.566592+0000","last_change":"2024-04-25T02:23:12.847086+0000","last_active":"2024-04-25T02:28:09.566592+0000","last_peered":"2024-04-25T02:28:09.566592+0000","last_clean":"2024-04-25T02:28:09.566592+0000","last_became_active":"2024-04-25T02:23:12.846719+0000","last_became_peered":"2024-04-25T02:23:12.846719+0000","last_unstale":"2024-04-25T02:28:09.566592+0000","last_undegraded":"2024-04-25T02:28:09.566592+0000","last_fullsized":"2024-04-25T02:28:09.566592+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:19.196820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":6904,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":16944,"num_write":388,"num_write_kb":35957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"43'428","reported_seq":472,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.490081+0000","last_change":"2024-04-25T02:23:56.302118+0000","last_active":"2024-04-25T02:28:10.490081+0000","last_peered":"2024-04-25T02:28:10.490081+0000","last_clean":"2024-04-25T02:28:10.490081+0000","last_became_active":"2024-04-25T02:23:56.301745+0000","last_became_peered":"2024-04-25T02:23:56.301745+0000","last_unstale":"2024-04-25T02:28:10.490081+0000","last_undegraded":"2024-04-25T02:28:10.490081+0000","last_fullsized":"2024-04-25T02:28:10.490081+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:22:47.665187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":12557,"num_write":410,"num_write_kb":77332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"43'492","reported_seq":560,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.356441+0000","last_change":"2024-04-25T02:23:13.844518+0000","last_active":"2024-04-25T02:28:12.356441+0000","last_peered":"2024-04-25T02:28:12.356441+0000","last_clean":"2024-04-25T02:28:12.356441+0000","last_became_active":"2024-04-25T02:23:13.844235+0000","last_became_peered":"2024-04-25T02:23:13.844235+0000","last_unstale":"2024-04-25T02:28:12.356441+0000","last_undegraded":"2024-04-25T02:28:12.356441+0000","last_fullsized":"2024-04-25T02:28:12.356441+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:01:33.237637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14237,"num_write":458,"num_write_kb":116854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"43'385","reported_seq":464,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.522953+0000","last_change":"2024-04-25T02:23:13.849525+0000","last_active":"2024-04-25T02:28:09.522953+0000","last_peered":"2024-04-25T02:28:09.522953+0000","last_clean":"2024-04-25T02:28:09.522953+0000","last_became_active":"2024-04-25T02:23:13.845193+0000","last_became_peered":"2024-04-25T02:23:13.845193+0000","last_unstale":"2024-04-25T02:28:09.522953+0000","last_undegraded":"2024-04-25T02:28:09.522953+0000","last_fullsized":"2024-04-25T02:28:09.522953+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:17:33.318731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":36152,"num_write":360,"num_write_kb":54497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"43'396","reported_seq":497,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.509416+0000","last_change":"2024-04-25T02:23:12.842342+0000","last_active":"2024-04-25T02:28:09.509416+0000","last_peered":"2024-04-25T02:28:09.509416+0000","last_clean":"2024-04-25T02:28:09.509416+0000","last_became_active":"2024-04-25T02:23:12.841677+0000","last_became_peered":"2024-04-25T02:23:12.841677+0000","last_unstale":"2024-04-25T02:28:09.509416+0000","last_undegraded":"2024-04-25T02:28:09.509416+0000","last_fullsized":"2024-04-25T02:28:09.509416+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:27.480264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1755,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":69,"num_read_kb":32628,"num_write":373,"num_write_kb":79888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":191495,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":2779,"num_read_kb":1446401,"num_write":24360,"num_write_kb":4320360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":446464,"data_stored":307859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":25946,"ondisk_log_size":25946,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":129260201,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":231,"num_read_kb":1603,"num_write":6638,"num_write_kb":130844,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":258179072,"data_stored":258078095,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39115,"internal_metadata":0},"log_size":8473,"ondisk_log_size":8473,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":31,"seq":133143986238,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":389720,"kb_used_data":88336,"kb_used_omap":9,"kb_used_meta":301366,"kb_avail":93982120,"statfs":{"total":96636764160,"available":96237690880,"internally_reserved":0,"allocated":90456064,"data_stored":90215784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9975,"internal_metadata":308599049},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:27:15 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.35799999999999998,"15min":0.34100000000000003},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":3.5409999999999999,"5min":3.5409999999999999,"15min":3.5409999999999999},"last":0.307},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.40899999999999997,"15min":0.36899999999999999},"min":{"1min":0.161,"5min":0.161,"15min":0.161},"max":{"1min":3.613,"5min":3.613,"15min":3.613},"last":0.29399999999999998}]},{"osd":1,"last update":"Thu Apr 25 02:27:15 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.38900000000000001,"15min":0.36499999999999999},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":3.0009999999999999,"5min":3.0009999999999999,"15min":3.0009999999999999},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.39800000000000002,"15min":0.373},"min":{"1min":0.157,"5min":0.157,"15min":0.157},"max":{"1min":4.9720000000000004,"5min":4.9720000000000004,"15min":4.9720000000000004},"last":0.34399999999999997}]},{"osd":2,"last update":"Thu Apr 25 02:27:15 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.43099999999999999,"15min":0.38},"min":{"1min":0.17599999999999999,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":4.883,"5min":4.883,"15min":4.883},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.40300000000000002,"15min":0.38500000000000001},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":3.0550000000000002,"5min":3.0550000000000002,"15min":3.0550000000000002},"last":0.32200000000000001}]}]},{"osd":2,"up_from":30,"seq":128849018942,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":362480,"kb_used_data":57064,"kb_used_omap":8,"kb_used_meta":305399,"kb_avail":94009360,"statfs":{"total":96636764160,"available":96265584640,"internally_reserved":0,"allocated":58433536,"data_stored":58118799,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8387,"internal_metadata":312729405},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:27:18 2024","interfaces":[{"interface":"back","average":{"1min":0.248,"5min":0.313,"15min":0.32000000000000001},"min":{"1min":0.14199999999999999,"5min":0.14199999999999999,"15min":0.14199999999999999},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.251,"5min":0.32700000000000001,"15min":0.33000000000000002},"min":{"1min":0.16400000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.38800000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"last":0.29599999999999999}]},{"osd":1,"last update":"Thu Apr 25 02:27:18 2024","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.34499999999999997,"15min":0.34599999999999997},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.32500000000000001,"5min":0.35199999999999998,"15min":0.34999999999999998},"min":{"1min":0.17599999999999999,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.313}]},{"osd":3,"last update":"Thu Apr 25 02:27:18 2024","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.35299999999999998,"15min":0.35499999999999998},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.36799999999999999}]}]},{"osd":0,"up_from":28,"seq":120259084351,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369380,"kb_used_data":59740,"kb_used_omap":15,"kb_used_meta":309616,"kb_avail":94002460,"statfs":{"total":96636764160,"available":96258519040,"internally_reserved":0,"allocated":61173760,"data_stored":60940630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15790,"internal_metadata":317047378},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 25 02:27:16 2024","interfaces":[{"interface":"back","average":{"1min":0.23100000000000001,"5min":0.32500000000000001,"15min":0.33600000000000002},"min":{"1min":0.14799999999999999,"5min":0.14799999999999999,"15min":0.14799999999999999},"max":{"1min":0.375,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.307},{"interface":"front","average":{"1min":0.27500000000000002,"5min":0.34599999999999997,"15min":0.35799999999999998},"min":{"1min":0.17000000000000001,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.32500000000000001}]},{"osd":2,"last update":"Thu Apr 25 02:27:16 2024","interfaces":[{"interface":"back","average":{"1min":0.30099999999999999,"5min":0.36399999999999999,"15min":0.378},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.42699999999999999,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.28000000000000003,"5min":0.36499999999999999,"15min":0.38300000000000001},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.41399999999999998,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.378}]},{"osd":3,"last update":"Thu Apr 25 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.39000000000000001,"15min":0.38400000000000001},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":2.8069999999999999,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.30099999999999999,"5min":0.39900000000000002,"15min":0.42099999999999999},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.47499999999999998,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.40999999999999998}]}]},{"osd":1,"up_from":29,"seq":124554051646,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":351096,"kb_used_data":53744,"kb_used_omap":4,"kb_used_meta":297339,"kb_avail":94020744,"statfs":{"total":96636764160,"available":96277241856,"internally_reserved":0,"allocated":55033856,"data_stored":54197308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4963,"internal_metadata":304475293},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:27:13 2024","interfaces":[{"interface":"back","average":{"1min":0.248,"5min":0.313,"15min":0.32700000000000001},"min":{"1min":0.155,"5min":0.155,"15min":0.155},"max":{"1min":0.41799999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.219},{"interface":"front","average":{"1min":0.26000000000000001,"5min":0.33300000000000002,"15min":0.35099999999999998},"min":{"1min":0.17599999999999999,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.39600000000000002,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.245}]},{"osd":2,"last update":"Thu Apr 25 02:27:13 2024","interfaces":[{"interface":"back","average":{"1min":0.28599999999999998,"5min":0.34499999999999997,"15min":0.35199999999999998},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.437,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.35899999999999999,"15min":0.36299999999999999},"min":{"1min":0.17000000000000001,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":1.0149999999999999,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.20399999999999999}]},{"osd":3,"last update":"Thu Apr 25 02:27:13 2024","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.38400000000000001,"15min":0.39800000000000002},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.46899999999999997,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.28199999999999997},{"interface":"front","average":{"1min":0.33700000000000002,"5min":0.378,"15min":0.39000000000000001},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.23499999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":60215296,"data_stored":60184605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15790,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":50343936,"data_stored":50332293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4963,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57528320,"data_stored":57511070,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8387,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90091520,"data_stored":90050127,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9975,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":446464,"data_stored":307859,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:28:16.345 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:28:16.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.493+0000 7f998e254700 1 Processor -- start 2024-04-25T02:28:16.497 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.493+0000 7f998e254700 1 -- start start 2024-04-25T02:28:16.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.494+0000 7f998e254700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f99880a3410 0x7f99880a4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:16.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.494+0000 7f998e254700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f998813ed30 0x7f9988145b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:16.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.494+0000 7f998e254700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f998806da60 con 0x7f99880a22a0 2024-04-25T02:28:16.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.494+0000 7f998e254700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99880a2a20 con 0x7f998813ed30 2024-04-25T02:28:16.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.494+0000 7f998e254700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f99880a3c80 con 0x7f99880a3410 2024-04-25T02:28:16.499 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.494+0000 7f99877fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f99880a3410 0x7f99880a4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:16.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.494+0000 7f9987fff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f998813ed30 0x7f9988145b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:16.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.494+0000 7f9986ffd700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f99880a22a0 0x7f998813e620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:33424/0 (socket says 172.21.15.111:33424) 2024-04-25T02:28:16.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.494+0000 7f9986ffd700 1 -- 172.21.15.111:0/1728259681 learned_addr learned my addr 172.21.15.111:0/1728259681 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:28:16.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.494+0000 7f99867fc700 1 -- 172.21.15.111:0/1728259681 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2370433161 0 0) 0x7f998806da60 con 0x7f99880a22a0 2024-04-25T02:28:16.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.494+0000 7f99867fc700 1 -- 172.21.15.111:0/1728259681 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9974003570 con 0x7f99880a22a0 2024-04-25T02:28:16.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.494+0000 7f9987fff700 1 -- 172.21.15.111:0/1728259681 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f99880a3410 msgr2=0x7f99880a4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:16.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.494+0000 7f9987fff700 1 --2- 172.21.15.111:0/1728259681 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f99880a3410 0x7f99880a4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:16.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.494+0000 7f9987fff700 1 -- 172.21.15.111:0/1728259681 >> v1:172.21.15.111:6789/0 conn(0x7f99880a22a0 legacy=0x7f998813e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:16.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.494+0000 7f9987fff700 1 -- 172.21.15.111:0/1728259681 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99880a37e0 con 0x7f998813ed30 2024-04-25T02:28:16.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.495+0000 7f99877fe700 1 --2- 172.21.15.111:0/1728259681 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f99880a3410 0x7f99880a4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:16.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.495+0000 7f9987fff700 1 --2- 172.21.15.111:0/1728259681 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f998813ed30 0x7f9988145b70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9980009e90 tx=0x7f9980009780 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e3b9c211e204c948 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:16.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.495+0000 7f99867fc700 1 -- 172.21.15.111:0/1728259681 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f998000e070 con 0x7f998813ed30 2024-04-25T02:28:16.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.495+0000 7f99867fc700 1 -- 172.21.15.111:0/1728259681 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f998000bb80 con 0x7f998813ed30 2024-04-25T02:28:16.500 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.495+0000 7f99867fc700 1 -- 172.21.15.111:0/1728259681 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9980012430 con 0x7f998813ed30 2024-04-25T02:28:16.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.495+0000 7f998e254700 1 -- 172.21.15.111:0/1728259681 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f998813ed30 msgr2=0x7f9988145b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:16.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.495+0000 7f998e254700 1 --2- 172.21.15.111:0/1728259681 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f998813ed30 0x7f9988145b70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f9980009e90 tx=0x7f9980009780 comp rx=0 tx=0).stop 2024-04-25T02:28:16.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.495+0000 7f998e254700 1 -- 172.21.15.111:0/1728259681 shutdown_connections 2024-04-25T02:28:16.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.495+0000 7f998e254700 1 --2- 172.21.15.111:0/1728259681 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f99880a3410 0x7f99880a4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:16.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.495+0000 7f998e254700 1 --2- 172.21.15.111:0/1728259681 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f998813ed30 0x7f9988145b70 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:16.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.495+0000 7f998e254700 1 -- 172.21.15.111:0/1728259681 >> 172.21.15.111:0/1728259681 conn(0x7f99880b1cf0 msgr2=0x7f99880b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:16.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.495+0000 7f998e254700 1 -- 172.21.15.111:0/1728259681 shutdown_connections 2024-04-25T02:28:16.501 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.495+0000 7f998e254700 1 -- 172.21.15.111:0/1728259681 wait complete. 2024-04-25T02:28:16.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.496+0000 7f998e254700 1 Processor -- start 2024-04-25T02:28:16.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.497+0000 7f998e254700 1 -- start start 2024-04-25T02:28:16.503 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.497+0000 7f998e254700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f99880a22a0 0x7f998814a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:16.504 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.497+0000 7f998e254700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f99880a3410 0x7f99880ab250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:16.504 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.497+0000 7f998e254700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f998813ed30 0x7f99880acb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:16.504 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.497+0000 7f998e254700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99880ac320 con 0x7f998813ed30 2024-04-25T02:28:16.504 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.497+0000 7f998e254700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f998814a8e0 con 0x7f99880a22a0 2024-04-25T02:28:16.504 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.497+0000 7f998e254700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f998814ab80 con 0x7f99880a3410 2024-04-25T02:28:16.504 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.497+0000 7f99877fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f99880a22a0 0x7f998814a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:16.504 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.497+0000 7f9987fff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f998813ed30 0x7f99880acb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:16.504 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.497+0000 7f9986ffd700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f99880a3410 0x7f99880ab250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:16.504 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.497+0000 7f99877fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f99880a22a0 0x7f998814a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:53846/0 (socket says 172.21.15.111:53846) 2024-04-25T02:28:16.504 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.497+0000 7f99877fe700 1 -- 172.21.15.111:0/1261603065 learned_addr learned my addr 172.21.15.111:0/1261603065 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:28:16.504 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.497+0000 7f99877fe700 1 -- 172.21.15.111:0/1261603065 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f99880a3410 msgr2=0x7f99880ab250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:16.504 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.497+0000 7f99877fe700 1 --2- 172.21.15.111:0/1261603065 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f99880a3410 0x7f99880ab250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:16.504 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.497+0000 7f99877fe700 1 -- 172.21.15.111:0/1261603065 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f998813ed30 msgr2=0x7f99880acb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:16.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.497+0000 7f99877fe700 1 --2- 172.21.15.111:0/1261603065 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f998813ed30 0x7f99880acb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:16.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.497+0000 7f99877fe700 1 -- 172.21.15.111:0/1261603065 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9970009420 con 0x7f99880a22a0 2024-04-25T02:28:16.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.497+0000 7f9987fff700 1 --2- 172.21.15.111:0/1261603065 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f998813ed30 0x7f99880acb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:16.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.498+0000 7f99877fe700 1 --2- 172.21.15.111:0/1261603065 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f99880a22a0 0x7f998814a2c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f997000ec80 tx=0x7f99700091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:16.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.498+0000 7f997f7fe700 1 -- 172.21.15.111:0/1261603065 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997000c9b0 con 0x7f99880a22a0 2024-04-25T02:28:16.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.498+0000 7f997f7fe700 1 -- 172.21.15.111:0/1261603065 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f997000cb10 con 0x7f99880a22a0 2024-04-25T02:28:16.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.498+0000 7f998e254700 1 -- 172.21.15.111:0/1261603065 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9980009a20 con 0x7f99880a22a0 2024-04-25T02:28:16.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.498+0000 7f997f7fe700 1 -- 172.21.15.111:0/1261603065 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f997000ce90 con 0x7f99880a22a0 2024-04-25T02:28:16.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.498+0000 7f998e254700 1 -- 172.21.15.111:0/1261603065 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99880a9760 con 0x7f99880a22a0 2024-04-25T02:28:16.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.499+0000 7f997f7fe700 1 -- 172.21.15.111:0/1261603065 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f9970013680 con 0x7f99880a22a0 2024-04-25T02:28:16.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.499+0000 7f998e254700 1 -- 172.21.15.111:0/1261603065 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99880008d0 con 0x7f99880a22a0 2024-04-25T02:28:16.505 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.499+0000 7f997f7fe700 1 -- 172.21.15.111:0/1261603065 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4158+0+0 (secure 0 0 0) 0x7f997005b560 con 0x7f99880a22a0 2024-04-25T02:28:16.506 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.503+0000 7f997f7fe700 1 -- 172.21.15.111:0/1261603065 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f9970039790 con 0x7f99880a22a0 2024-04-25T02:28:16.662 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.659+0000 7f998e254700 1 -- 172.21.15.111:0/1261603065 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f99880ab790 con 0x7f99880a22a0 2024-04-25T02:28:16.663 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.659+0000 7f997f7fe700 1 -- 172.21.15.111:0/1261603065 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+12106 (secure 0 0 0) 0x7f9970021020 con 0x7f99880a22a0 2024-04-25T02:28:16.663 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:28:16.663 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":43,"fsid":"4643f974-f93a-4436-93b8-460ff320e62e","created":"2024-04-25T02:20:05.450475+0000","modified":"2024-04-25T02:25:10.060341+0000","last_up_change":"2024-04-25T02:23:12.818028+0000","last_in_change":"2024-04-25T02:20:10.439204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:20:07.471248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:20:14.420378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:20:22.251868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T02:20:23.128289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"df3f17ca-3b12-42c8-8cf7-8f1b7189e587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":41,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6800","nonce":48862}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6801","nonce":48862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6803","nonce":48862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6802","nonce":48862}]},"public_addr":"172.21.15.111:6800/48862","cluster_addr":"172.21.15.111:6801/48862","heartbeat_back_addr":"172.21.15.111:6803/48862","heartbeat_front_addr":"172.21.15.111:6802/48862","state":["exists","up"]},{"osd":1,"uuid":"93d54815-f215-4285-bba6-32f2d1cabf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":29,"up_thru":31,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6804","nonce":48960}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6805","nonce":48960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6807","nonce":48960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6806","nonce":48960}]},"public_addr":"172.21.15.111:6804/48960","cluster_addr":"172.21.15.111:6805/48960","heartbeat_back_addr":"172.21.15.111:6807/48960","heartbeat_front_addr":"172.21.15.111:6806/48960","state":["exists","up"]},{"osd":2,"uuid":"b26b2104-2a2e-408f-9ce7-3587a32a2ebe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":41,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6808","nonce":49070}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6809","nonce":49070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6811","nonce":49070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6810","nonce":49070}]},"public_addr":"172.21.15.111:6808/49070","cluster_addr":"172.21.15.111:6809/49070","heartbeat_back_addr":"172.21.15.111:6811/49070","heartbeat_front_addr":"172.21.15.111:6810/49070","state":["exists","up"]},{"osd":3,"uuid":"43c25820-1edc-4031-badf-72e87dd6bf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":31,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6812","nonce":49243}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6813","nonce":49243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6815","nonce":49243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6814","nonce":49243}]},"public_addr":"172.21.15.111:6812/49243","cluster_addr":"172.21.15.111:6813/49243","heartbeat_back_addr":"172.21.15.111:6815/49243","heartbeat_front_addr":"172.21.15.111:6814/49243","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.372427+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.411480+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.361508+0000","dead_epoch":25},{"osd":3,"down_stamp":"2024-04-25T02:23:06.771296+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.377212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.d","mappings":[{"from":3,"to":2}]},{"pgid":"4.13","mappings":[{"from":3,"to":0}]},{"pgid":"4.19","mappings":[{"from":3,"to":0}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.30","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.186:0/1473940677":"2024-04-25T03:25:09.063135+0000","172.21.15.111:6819/4003866251":"2024-04-26T02:23:16.839679+0000","172.21.15.111:0/2148931273":"2024-04-26T02:22:54.713254+0000","172.21.15.111:6816/39585":"2024-04-26T02:22:54.713254+0000","172.21.15.111:0/3911588907":"2024-04-26T02:22:54.713254+0000","172.21.15.111:0/1276843622":"2024-04-26T02:22:54.713254+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:28:16.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.661+0000 7f998e254700 1 -- 172.21.15.111:0/1261603065 >> v1:172.21.15.111:6816/46482 conn(0x7f9968045ef0 legacy=0x7f99680483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:16.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.661+0000 7f998e254700 1 -- 172.21.15.111:0/1261603065 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f99880a22a0 msgr2=0x7f998814a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:16.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.661+0000 7f998e254700 1 --2- 172.21.15.111:0/1261603065 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f99880a22a0 0x7f998814a2c0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f997000ec80 tx=0x7f99700091a0 comp rx=0 tx=0).stop 2024-04-25T02:28:16.665 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.661+0000 7f998e254700 1 -- 172.21.15.111:0/1261603065 shutdown_connections 2024-04-25T02:28:16.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.661+0000 7f998e254700 1 --2- 172.21.15.111:0/1261603065 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f998813ed30 0x7f99880acb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:16.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.661+0000 7f998e254700 1 --2- 172.21.15.111:0/1261603065 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f99880a22a0 0x7f998814a2c0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:16.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.661+0000 7f998e254700 1 --2- 172.21.15.111:0/1261603065 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f99880a3410 0x7f99880ab250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:16.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.661+0000 7f998e254700 1 -- 172.21.15.111:0/1261603065 >> 172.21.15.111:0/1261603065 conn(0x7f99880b1cf0 msgr2=0x7f99880b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:16.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.661+0000 7f998e254700 1 -- 172.21.15.111:0/1261603065 shutdown_connections 2024-04-25T02:28:16.666 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:16.661+0000 7f998e254700 1 -- 172.21.15.111:0/1261603065 wait complete. 2024-04-25T02:28:17.678 INFO:tasks.ceph:Scrubbing osd.0 2024-04-25T02:28:17.678 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-25T02:28:17.817 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.813+0000 7f419d394700 1 Processor -- start 2024-04-25T02:28:17.817 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.813+0000 7f419d394700 1 -- start start 2024-04-25T02:28:17.819 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.814+0000 7f419d394700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f419806e380 0x7f419806ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:17.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.814+0000 7f419d394700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f419813b4e0 0x7f419813e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:17.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.814+0000 7f419d394700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f419813a9c0 con 0x7f419813b090 2024-04-25T02:28:17.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.814+0000 7f419d394700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f419806dca0 con 0x7f419806e380 2024-04-25T02:28:17.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.814+0000 7f419d394700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f41980ac6a0 con 0x7f419813b4e0 2024-04-25T02:28:17.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.814+0000 7f4196ffd700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f419806e380 0x7f419806ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:17.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.814+0000 7f41977fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f419813b4e0 0x7f419813e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:17.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.814+0000 7f41967fc700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f419813b090 0x7f419813deb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:33438/0 (socket says 172.21.15.111:33438) 2024-04-25T02:28:17.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.814+0000 7f41967fc700 1 -- 172.21.15.111:0/1683625495 learned_addr learned my addr 172.21.15.111:0/1683625495 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:28:17.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.814+0000 7f41977fe700 1 -- 172.21.15.111:0/1683625495 >> v2:172.21.15.111:3300/0 conn(0x7f419806e380 msgr2=0x7f419806ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:17.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.814+0000 7f41977fe700 1 --2- 172.21.15.111:0/1683625495 >> v2:172.21.15.111:3300/0 conn(0x7f419806e380 0x7f419806ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:17.820 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.814+0000 7f41977fe700 1 -- 172.21.15.111:0/1683625495 >> v1:172.21.15.111:6789/0 conn(0x7f419813b090 legacy=0x7f419813deb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:17.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.814+0000 7f4195ffb700 1 -- 172.21.15.111:0/1683625495 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1347858388 0 0) 0x7f419813a9c0 con 0x7f419813b090 2024-04-25T02:28:17.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.814+0000 7f41977fe700 1 -- 172.21.15.111:0/1683625495 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f419813ac40 con 0x7f419813b4e0 2024-04-25T02:28:17.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.814+0000 7f4196ffd700 1 --2- 172.21.15.111:0/1683625495 >> v2:172.21.15.111:3300/0 conn(0x7f419806e380 0x7f419806ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:17.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.815+0000 7f41977fe700 1 --2- 172.21.15.111:0/1683625495 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f419813b4e0 0x7f419813e5c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f419000af70 tx=0x7f419000a890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e2a911c008f81c22 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:17.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.815+0000 7f4195ffb700 1 -- 172.21.15.111:0/1683625495 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419000f070 con 0x7f419813b4e0 2024-04-25T02:28:17.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.815+0000 7f4195ffb700 1 -- 172.21.15.111:0/1683625495 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f419000a2e0 con 0x7f419813b4e0 2024-04-25T02:28:17.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.815+0000 7f4195ffb700 1 -- 172.21.15.111:0/1683625495 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f419000cc70 con 0x7f419813b4e0 2024-04-25T02:28:17.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.815+0000 7f419d394700 1 -- 172.21.15.111:0/1683625495 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f419813b4e0 msgr2=0x7f419813e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:17.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.815+0000 7f419d394700 1 --2- 172.21.15.111:0/1683625495 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f419813b4e0 0x7f419813e5c0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f419000af70 tx=0x7f419000a890 comp rx=0 tx=0).stop 2024-04-25T02:28:17.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.815+0000 7f419d394700 1 -- 172.21.15.111:0/1683625495 shutdown_connections 2024-04-25T02:28:17.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.815+0000 7f419d394700 1 --2- 172.21.15.111:0/1683625495 >> v2:172.21.15.111:3300/0 conn(0x7f419806e380 0x7f419806ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:17.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.815+0000 7f419d394700 1 --2- 172.21.15.111:0/1683625495 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f419813b4e0 0x7f419813e5c0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:17.821 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.815+0000 7f419d394700 1 -- 172.21.15.111:0/1683625495 >> 172.21.15.111:0/1683625495 conn(0x7f41980b1400 msgr2=0x7f41980b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:17.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.815+0000 7f419d394700 1 -- 172.21.15.111:0/1683625495 shutdown_connections 2024-04-25T02:28:17.822 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.815+0000 7f419d394700 1 -- 172.21.15.111:0/1683625495 wait complete. 2024-04-25T02:28:17.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.817+0000 7f419d394700 1 Processor -- start 2024-04-25T02:28:17.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.817+0000 7f419d394700 1 -- start start 2024-04-25T02:28:17.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.818+0000 7f419d394700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f419806e380 0x7f41981375f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:17.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.818+0000 7f419d394700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f419813b090 0x7f4198130630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:17.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.818+0000 7f419d394700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f419813b4e0 0x7f4198130b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:17.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.818+0000 7f419d394700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f41980a5950 con 0x7f419806e380 2024-04-25T02:28:17.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.818+0000 7f419d394700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4198136500 con 0x7f419813b4e0 2024-04-25T02:28:17.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.818+0000 7f419d394700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f4198138160 con 0x7f419813b090 2024-04-25T02:28:17.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.818+0000 7f4196ffd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f419806e380 0x7f41981375f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:17.826 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.818+0000 7f4196ffd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f419806e380 0x7f41981375f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48594/0 (socket says 172.21.15.111:48594) 2024-04-25T02:28:17.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.818+0000 7f4196ffd700 1 -- 172.21.15.111:0/2204977793 learned_addr learned my addr 172.21.15.111:0/2204977793 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:28:17.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.818+0000 7f41967fc700 1 --2- 172.21.15.111:0/2204977793 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f419813b090 0x7f4198130630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:17.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.818+0000 7f41977fe700 1 --2- 172.21.15.111:0/2204977793 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f419813b4e0 0x7f4198130b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:17.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.818+0000 7f4196ffd700 1 -- 172.21.15.111:0/2204977793 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f419813b090 msgr2=0x7f4198130630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:17.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.818+0000 7f4196ffd700 1 --2- 172.21.15.111:0/2204977793 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f419813b090 0x7f4198130630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:17.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.818+0000 7f4196ffd700 1 -- 172.21.15.111:0/2204977793 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f419813b4e0 msgr2=0x7f4198130b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:17.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.818+0000 7f4196ffd700 1 --2- 172.21.15.111:0/2204977793 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f419813b4e0 0x7f4198130b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:17.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.818+0000 7f4196ffd700 1 -- 172.21.15.111:0/2204977793 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f418c009420 con 0x7f419806e380 2024-04-25T02:28:17.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.818+0000 7f4196ffd700 1 --2- 172.21.15.111:0/2204977793 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f419806e380 0x7f41981375f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f418c00ece0 tx=0x7f418c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:17.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.818+0000 7f417effd700 1 -- 172.21.15.111:0/2204977793 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418c00c920 con 0x7f419806e380 2024-04-25T02:28:17.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.818+0000 7f417effd700 1 -- 172.21.15.111:0/2204977793 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f418c00ca80 con 0x7f419806e380 2024-04-25T02:28:17.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.818+0000 7f417effd700 1 -- 172.21.15.111:0/2204977793 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f418c00ce00 con 0x7f419806e380 2024-04-25T02:28:17.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.818+0000 7f419d394700 1 -- 172.21.15.111:0/2204977793 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f419000ab30 con 0x7f419806e380 2024-04-25T02:28:17.827 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.819+0000 7f419d394700 1 -- 172.21.15.111:0/2204977793 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41981310b0 con 0x7f419806e380 2024-04-25T02:28:17.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.819+0000 7f419d394700 1 -- 172.21.15.111:0/2204977793 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f41981396c0 con 0x7f419806e380 2024-04-25T02:28:17.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.820+0000 7f417effd700 1 -- 172.21.15.111:0/2204977793 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f418c013680 con 0x7f419806e380 2024-04-25T02:28:17.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.820+0000 7f417effd700 1 -- 172.21.15.111:0/2204977793 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4158+0+0 (secure 0 0 0) 0x7f418c05b3a0 con 0x7f419806e380 2024-04-25T02:28:17.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.820+0000 7f417effd700 1 -- 172.21.15.111:0/2204977793 --> v1:172.21.15.111:6800/48862 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f4184052dc0 con 0x7f418404f0c0 2024-04-25T02:28:17.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.820+0000 7f417effd700 1 -- 172.21.15.111:0/2204977793 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f418c05d9e0 con 0x7f419806e380 2024-04-25T02:28:17.828 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.821+0000 7f417effd700 1 -- 172.21.15.111:0/2204977793 <== osd.0 v1:172.21.15.111:6800/48862 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (unknown 0 0 1173804961) 0x7f4184052dc0 con 0x7f418404f0c0 2024-04-25T02:28:17.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.835+0000 7f419d394700 1 -- 172.21.15.111:0/2204977793 --> v1:172.21.15.111:6800/48862 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f4198065190 con 0x7f418404f0c0 2024-04-25T02:28:17.838 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.835+0000 7f417effd700 1 -- 172.21.15.111:0/2204977793 <== osd.0 v1:172.21.15.111:6800/48862 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (unknown 0 0 119112422) 0x7f4198065190 con 0x7f418404f0c0 2024-04-25T02:28:17.838 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-25T02:28:17.839 INFO:teuthology.orchestra.run.smithi111.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T02:28:17.839 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-25T02:28:17.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.835+0000 7f419d394700 1 -- 172.21.15.111:0/2204977793 >> v1:172.21.15.111:6800/48862 conn(0x7f418404f0c0 legacy=0x7f4184051550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:17.839 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.835+0000 7f419d394700 1 -- 172.21.15.111:0/2204977793 >> v1:172.21.15.111:6816/46482 conn(0x7f4184045f20 legacy=0x7f41840483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:17.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.835+0000 7f419d394700 1 -- 172.21.15.111:0/2204977793 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f419806e380 msgr2=0x7f41981375f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:17.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.835+0000 7f419d394700 1 --2- 172.21.15.111:0/2204977793 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f419806e380 0x7f41981375f0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f418c00ece0 tx=0x7f418c0091a0 comp rx=0 tx=0).stop 2024-04-25T02:28:17.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.835+0000 7f41977fe700 1 -- 172.21.15.111:0/2204977793 reap_dead start 2024-04-25T02:28:17.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.835+0000 7f419d394700 1 -- 172.21.15.111:0/2204977793 shutdown_connections 2024-04-25T02:28:17.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.835+0000 7f419d394700 1 -- 172.21.15.111:0/2204977793 >> 172.21.15.111:0/2204977793 conn(0x7f41980b1400 msgr2=0x7f41980b17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:17.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.835+0000 7f419d394700 1 -- 172.21.15.111:0/2204977793 shutdown_connections 2024-04-25T02:28:17.840 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.835+0000 7f419d394700 1 -- 172.21.15.111:0/2204977793 wait complete. 2024-04-25T02:28:17.851 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-25T02:28:17.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.965+0000 7f9b31050700 1 Processor -- start 2024-04-25T02:28:17.968 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.965+0000 7f9b31050700 1 -- start start 2024-04-25T02:28:17.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.965+0000 7f9b31050700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f9b2c06e540 0x7f9b2c0a5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:17.970 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.965+0000 7f9b31050700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9b2c06f260 0x7f9b2c068370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:17.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.965+0000 7f9b31050700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9b2c06dee0 con 0x7f9b2c0688b0 2024-04-25T02:28:17.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.965+0000 7f9b31050700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b2c0a6430 con 0x7f9b2c06e540 2024-04-25T02:28:17.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.965+0000 7f9b31050700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2c069930 con 0x7f9b2c06f260 2024-04-25T02:28:17.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.965+0000 7f9b2a59c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9b2c06f260 0x7f9b2c068370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:17.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.965+0000 7f9b2ad9d700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f9b2c06e540 0x7f9b2c0a5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:17.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.965+0000 7f9b2b59e700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f9b2c0688b0 0x7f9b2c13f740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:33446/0 (socket says 172.21.15.111:33446) 2024-04-25T02:28:17.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.965+0000 7f9b2b59e700 1 -- 172.21.15.111:0/3193293786 learned_addr learned my addr 172.21.15.111:0/3193293786 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:28:17.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.965+0000 7f9b2a59c700 1 --2- 172.21.15.111:0/3193293786 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9b2c06f260 0x7f9b2c068370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:53864/0 (socket says 172.21.15.111:53864) 2024-04-25T02:28:17.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.966+0000 7f9b2ad9d700 1 -- 172.21.15.111:0/3193293786 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9b2c06f260 msgr2=0x7f9b2c068370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:17.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.966+0000 7f9b2ad9d700 1 --2- 172.21.15.111:0/3193293786 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9b2c06f260 0x7f9b2c068370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:17.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.966+0000 7f9b2ad9d700 1 -- 172.21.15.111:0/3193293786 >> v1:172.21.15.111:6789/0 conn(0x7f9b2c0688b0 legacy=0x7f9b2c13f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:17.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.966+0000 7f9b2ad9d700 1 -- 172.21.15.111:0/3193293786 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b2c067c80 con 0x7f9b2c06e540 2024-04-25T02:28:17.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.966+0000 7f9b29d9b700 1 -- 172.21.15.111:0/3193293786 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2290371044 0 0) 0x7f9b2c06dee0 con 0x7f9b2c0688b0 2024-04-25T02:28:17.971 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.966+0000 7f9b2a59c700 1 --2- 172.21.15.111:0/3193293786 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9b2c06f260 0x7f9b2c068370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:17.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.966+0000 7f9b2ad9d700 1 --2- 172.21.15.111:0/3193293786 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b2c06e540 0x7f9b2c0a5ef0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c009910 tx=0x7f9b1c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f96191e303ea2d7 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:17.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.966+0000 7f9b29d9b700 1 -- 172.21.15.111:0/3193293786 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c00b6d0 con 0x7f9b2c06e540 2024-04-25T02:28:17.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.966+0000 7f9b29d9b700 1 -- 172.21.15.111:0/3193293786 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b1c00b830 con 0x7f9b2c06e540 2024-04-25T02:28:17.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.966+0000 7f9b29d9b700 1 -- 172.21.15.111:0/3193293786 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b1c00bbf0 con 0x7f9b2c06e540 2024-04-25T02:28:17.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.966+0000 7f9b31050700 1 -- 172.21.15.111:0/3193293786 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b2c06e540 msgr2=0x7f9b2c0a5ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:17.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.966+0000 7f9b31050700 1 --2- 172.21.15.111:0/3193293786 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b2c06e540 0x7f9b2c0a5ef0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f9b1c009910 tx=0x7f9b1c0091a0 comp rx=0 tx=0).stop 2024-04-25T02:28:17.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.966+0000 7f9b31050700 1 -- 172.21.15.111:0/3193293786 shutdown_connections 2024-04-25T02:28:17.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.966+0000 7f9b31050700 1 --2- 172.21.15.111:0/3193293786 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b2c06e540 0x7f9b2c0a5ef0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:17.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.966+0000 7f9b31050700 1 --2- 172.21.15.111:0/3193293786 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9b2c06f260 0x7f9b2c068370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:17.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.966+0000 7f9b31050700 1 -- 172.21.15.111:0/3193293786 >> 172.21.15.111:0/3193293786 conn(0x7f9b2c06ce40 msgr2=0x7f9b2c06af80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:17.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.966+0000 7f9b31050700 1 -- 172.21.15.111:0/3193293786 shutdown_connections 2024-04-25T02:28:17.972 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.966+0000 7f9b31050700 1 -- 172.21.15.111:0/3193293786 wait complete. 2024-04-25T02:28:17.974 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.967+0000 7f9b31050700 1 Processor -- start 2024-04-25T02:28:17.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.968+0000 7f9b31050700 1 -- start start 2024-04-25T02:28:17.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.968+0000 7f9b31050700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9b2c0688b0 0x7f9b2c0a3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:17.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.968+0000 7f9b31050700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b2c06e540 0x7f9b2c151430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:17.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.968+0000 7f9b31050700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9b2c06f260 0x7f9b2c151970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:17.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.968+0000 7f9b31050700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2c0a2d00 con 0x7f9b2c06e540 2024-04-25T02:28:17.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.968+0000 7f9b31050700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2c0971a0 con 0x7f9b2c06f260 2024-04-25T02:28:17.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.968+0000 7f9b31050700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f9b2c0a15d0 con 0x7f9b2c0688b0 2024-04-25T02:28:17.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.968+0000 7f9b2a59c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b2c06e540 0x7f9b2c151430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:17.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.968+0000 7f9b2ad9d700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9b2c0688b0 0x7f9b2c0a3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:17.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.968+0000 7f9b2b59e700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9b2c06f260 0x7f9b2c151970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:17.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.968+0000 7f9b2a59c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b2c06e540 0x7f9b2c151430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48622/0 (socket says 172.21.15.111:48622) 2024-04-25T02:28:17.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.968+0000 7f9b2ad9d700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9b2c0688b0 0x7f9b2c0a3430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:51858/0 (socket says 172.21.15.111:51858) 2024-04-25T02:28:17.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.968+0000 7f9b2a59c700 1 -- 172.21.15.111:0/1551060749 learned_addr learned my addr 172.21.15.111:0/1551060749 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:28:17.975 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.968+0000 7f9b2a59c700 1 -- 172.21.15.111:0/1551060749 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9b2c0688b0 msgr2=0x7f9b2c0a3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:17.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.968+0000 7f9b2a59c700 1 --2- 172.21.15.111:0/1551060749 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9b2c0688b0 0x7f9b2c0a3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:17.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.968+0000 7f9b2a59c700 1 -- 172.21.15.111:0/1551060749 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9b2c06f260 msgr2=0x7f9b2c151970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:17.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.968+0000 7f9b2a59c700 1 --2- 172.21.15.111:0/1551060749 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9b2c06f260 0x7f9b2c151970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:17.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.968+0000 7f9b2a59c700 1 -- 172.21.15.111:0/1551060749 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b20009420 con 0x7f9b2c06e540 2024-04-25T02:28:17.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.968+0000 7f9b2b59e700 1 --2- 172.21.15.111:0/1551060749 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9b2c06f260 0x7f9b2c151970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:17.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.969+0000 7f9b2a59c700 1 --2- 172.21.15.111:0/1551060749 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b2c06e540 0x7f9b2c151430 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9b2000ecb0 tx=0x7f9b200091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:17.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.969+0000 7f9b12ffd700 1 -- 172.21.15.111:0/1551060749 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2000c850 con 0x7f9b2c06e540 2024-04-25T02:28:17.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.969+0000 7f9b12ffd700 1 -- 172.21.15.111:0/1551060749 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b2000c9b0 con 0x7f9b2c06e540 2024-04-25T02:28:17.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.969+0000 7f9b31050700 1 -- 172.21.15.111:0/1551060749 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b1c009420 con 0x7f9b2c06e540 2024-04-25T02:28:17.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.969+0000 7f9b12ffd700 1 -- 172.21.15.111:0/1551060749 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b2000cd30 con 0x7f9b2c06e540 2024-04-25T02:28:17.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.969+0000 7f9b31050700 1 -- 172.21.15.111:0/1551060749 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b2c097710 con 0x7f9b2c06e540 2024-04-25T02:28:17.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.970+0000 7f9b31050700 1 -- 172.21.15.111:0/1551060749 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b2c0a1920 con 0x7f9b2c06e540 2024-04-25T02:28:17.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.970+0000 7f9b12ffd700 1 -- 172.21.15.111:0/1551060749 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f9b20013680 con 0x7f9b2c06e540 2024-04-25T02:28:17.976 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.970+0000 7f9b12ffd700 1 -- 172.21.15.111:0/1551060749 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4158+0+0 (secure 0 0 0) 0x7f9b2005b360 con 0x7f9b2c06e540 2024-04-25T02:28:17.977 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:17.974+0000 7f9b12ffd700 1 -- 172.21.15.111:0/1551060749 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f9b200395f0 con 0x7f9b2c06e540 2024-04-25T02:28:18.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.132+0000 7f9b31050700 1 -- 172.21.15.111:0/1551060749 --> v1:172.21.15.111:6816/46482 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7f9b2c0a1710 con 0x7f9b18045ef0 2024-04-25T02:28:18.136 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.132+0000 7f9b12ffd700 1 -- 172.21.15.111:0/1551060749 <== mgr.14107 v1:172.21.15.111:6816/46482 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (unknown 2057319476 0 0) 0x7f9b2c0a1710 con 0x7f9b18045ef0 2024-04-25T02:28:18.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.134+0000 7f9b31050700 1 -- 172.21.15.111:0/1551060749 >> v1:172.21.15.111:6816/46482 conn(0x7f9b18045ef0 legacy=0x7f9b180483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:18.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.134+0000 7f9b31050700 1 -- 172.21.15.111:0/1551060749 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b2c06e540 msgr2=0x7f9b2c151430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:18.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.134+0000 7f9b31050700 1 --2- 172.21.15.111:0/1551060749 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b2c06e540 0x7f9b2c151430 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f9b2000ecb0 tx=0x7f9b200091a0 comp rx=0 tx=0).stop 2024-04-25T02:28:18.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.134+0000 7f9b31050700 1 -- 172.21.15.111:0/1551060749 shutdown_connections 2024-04-25T02:28:18.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.134+0000 7f9b31050700 1 --2- 172.21.15.111:0/1551060749 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f9b2c06f260 0x7f9b2c151970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:18.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.134+0000 7f9b31050700 1 --2- 172.21.15.111:0/1551060749 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f9b2c0688b0 0x7f9b2c0a3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:18.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.134+0000 7f9b31050700 1 --2- 172.21.15.111:0/1551060749 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f9b2c06e540 0x7f9b2c151430 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:18.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.134+0000 7f9b31050700 1 -- 172.21.15.111:0/1551060749 >> 172.21.15.111:0/1551060749 conn(0x7f9b2c06ce40 msgr2=0x7f9b2c0b15b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:18.138 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.134+0000 7f9b31050700 1 -- 172.21.15.111:0/1551060749 shutdown_connections 2024-04-25T02:28:18.139 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.134+0000 7f9b31050700 1 -- 172.21.15.111:0/1551060749 wait complete. 2024-04-25T02:28:18.139 INFO:teuthology.orchestra.run.smithi111.stderr:instructed osd(s) 0 to deep-scrub 2024-04-25T02:28:18.149 INFO:tasks.ceph:Scrubbing osd.1 2024-04-25T02:28:18.149 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-25T02:28:18.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.267+0000 7f817773f700 1 Processor -- start 2024-04-25T02:28:18.271 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.267+0000 7f817773f700 1 -- start start 2024-04-25T02:28:18.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.268+0000 7f817773f700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f81700aad90 0x7f817006f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:18.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.268+0000 7f817773f700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8170146bf0 0x7f8170148fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:18.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.268+0000 7f817773f700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f817006f930 con 0x7f8170063c90 2024-04-25T02:28:18.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.268+0000 7f817773f700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81700aa0d0 con 0x7f81700aad90 2024-04-25T02:28:18.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.268+0000 7f817773f700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f817006fb90 con 0x7f8170146bf0 2024-04-25T02:28:18.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.268+0000 7f8175cdc700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8170146bf0 0x7f8170148fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:18.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.268+0000 7f81754db700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f8170063c90 0x7f817013eac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:33462/0 (socket says 172.21.15.111:33462) 2024-04-25T02:28:18.273 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.268+0000 7f81754db700 1 -- 172.21.15.111:0/254538136 learned_addr learned my addr 172.21.15.111:0/254538136 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:28:18.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.268+0000 7f8174cda700 1 --2- 172.21.15.111:0/254538136 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f81700aad90 0x7f817006f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:18.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.268+0000 7f8175cdc700 1 -- 172.21.15.111:0/254538136 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f81700aad90 msgr2=0x7f817006f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:18.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.268+0000 7f8175cdc700 1 --2- 172.21.15.111:0/254538136 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f81700aad90 0x7f817006f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:18.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.268+0000 7f8167fff700 1 -- 172.21.15.111:0/254538136 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4247435528 0 0) 0x7f817006f930 con 0x7f8170063c90 2024-04-25T02:28:18.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.268+0000 7f8175cdc700 1 -- 172.21.15.111:0/254538136 >> v1:172.21.15.111:6789/0 conn(0x7f8170063c90 legacy=0x7f817013eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:18.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.268+0000 7f8175cdc700 1 -- 172.21.15.111:0/254538136 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81700adc70 con 0x7f8170146bf0 2024-04-25T02:28:18.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.268+0000 7f8174cda700 1 --2- 172.21.15.111:0/254538136 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f81700aad90 0x7f817006f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:18.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.268+0000 7f8175cdc700 1 --2- 172.21.15.111:0/254538136 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8170146bf0 0x7f8170148fd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8168009e90 tx=0x7f8168009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1be691930d24abc3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:18.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.269+0000 7f8167fff700 1 -- 172.21.15.111:0/254538136 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f816800e070 con 0x7f8170146bf0 2024-04-25T02:28:18.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.269+0000 7f8167fff700 1 -- 172.21.15.111:0/254538136 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f816800bc30 con 0x7f8170146bf0 2024-04-25T02:28:18.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.269+0000 7f8167fff700 1 -- 172.21.15.111:0/254538136 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8168012430 con 0x7f8170146bf0 2024-04-25T02:28:18.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.269+0000 7f817773f700 1 -- 172.21.15.111:0/254538136 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8170146bf0 msgr2=0x7f8170148fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:18.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.269+0000 7f817773f700 1 --2- 172.21.15.111:0/254538136 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8170146bf0 0x7f8170148fd0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8168009e90 tx=0x7f8168009780 comp rx=0 tx=0).stop 2024-04-25T02:28:18.274 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.269+0000 7f817773f700 1 -- 172.21.15.111:0/254538136 shutdown_connections 2024-04-25T02:28:18.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.269+0000 7f817773f700 1 --2- 172.21.15.111:0/254538136 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8170146bf0 0x7f8170148fd0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:18.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.269+0000 7f817773f700 1 --2- 172.21.15.111:0/254538136 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f81700aad90 0x7f817006f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:18.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.269+0000 7f817773f700 1 -- 172.21.15.111:0/254538136 >> 172.21.15.111:0/254538136 conn(0x7f81700b1e80 msgr2=0x7f81700adef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:18.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.269+0000 7f817773f700 1 -- 172.21.15.111:0/254538136 shutdown_connections 2024-04-25T02:28:18.275 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.269+0000 7f817773f700 1 -- 172.21.15.111:0/254538136 wait complete. 2024-04-25T02:28:18.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.270+0000 7f817773f700 1 Processor -- start 2024-04-25T02:28:18.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.270+0000 7f817773f700 1 -- start start 2024-04-25T02:28:18.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.271+0000 7f817773f700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8170063c90 0x7f817011b400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:18.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.271+0000 7f817773f700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8170146bf0 0x7f8170151140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:18.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.271+0000 7f817773f700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f817011c8e0 0x7f8170151680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:18.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.271+0000 7f817773f700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f817011bcb0 con 0x7f8170063c90 2024-04-25T02:28:18.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.271+0000 7f817773f700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81701451c0 con 0x7f8170146bf0 2024-04-25T02:28:18.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.271+0000 7f817773f700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8170145460 con 0x7f817011c8e0 2024-04-25T02:28:18.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.271+0000 7f81754db700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8170063c90 0x7f817011b400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:18.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.271+0000 7f8175cdc700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f817011c8e0 0x7f8170151680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:18.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.271+0000 7f81754db700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8170063c90 0x7f817011b400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48630/0 (socket says 172.21.15.111:48630) 2024-04-25T02:28:18.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.271+0000 7f81754db700 1 -- 172.21.15.111:0/3093093720 learned_addr learned my addr 172.21.15.111:0/3093093720 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:28:18.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.271+0000 7f8174cda700 1 --2- 172.21.15.111:0/3093093720 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8170146bf0 0x7f8170151140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:18.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.271+0000 7f8175cdc700 1 -- 172.21.15.111:0/3093093720 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8170146bf0 msgr2=0x7f8170151140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:18.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.271+0000 7f8175cdc700 1 --2- 172.21.15.111:0/3093093720 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8170146bf0 0x7f8170151140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:18.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.271+0000 7f8175cdc700 1 -- 172.21.15.111:0/3093093720 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8170063c90 msgr2=0x7f817011b400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:18.278 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.271+0000 7f8175cdc700 1 --2- 172.21.15.111:0/3093093720 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8170063c90 0x7f817011b400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:18.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.271+0000 7f8175cdc700 1 -- 172.21.15.111:0/3093093720 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f816c009420 con 0x7f817011c8e0 2024-04-25T02:28:18.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.271+0000 7f8174cda700 1 --2- 172.21.15.111:0/3093093720 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8170146bf0 0x7f8170151140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:18.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.271+0000 7f81754db700 1 --2- 172.21.15.111:0/3093093720 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8170063c90 0x7f817011b400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:18.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.272+0000 7f8175cdc700 1 --2- 172.21.15.111:0/3093093720 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f817011c8e0 0x7f8170151680 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8168016000 tx=0x7f8168019000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:18.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.272+0000 7f81657fa700 1 -- 172.21.15.111:0/3093093720 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8168027470 con 0x7f817011c8e0 2024-04-25T02:28:18.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.272+0000 7f81657fa700 1 -- 172.21.15.111:0/3093093720 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f81680275d0 con 0x7f817011c8e0 2024-04-25T02:28:18.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.272+0000 7f81657fa700 1 -- 172.21.15.111:0/3093093720 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8168027990 con 0x7f817011c8e0 2024-04-25T02:28:18.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.272+0000 7f817773f700 1 -- 172.21.15.111:0/3093093720 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8168009a20 con 0x7f817011c8e0 2024-04-25T02:28:18.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.272+0000 7f817773f700 1 -- 172.21.15.111:0/3093093720 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f817011b940 con 0x7f817011c8e0 2024-04-25T02:28:18.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.273+0000 7f81657fa700 1 -- 172.21.15.111:0/3093093720 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f8168024070 con 0x7f817011c8e0 2024-04-25T02:28:18.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.273+0000 7f817773f700 1 -- 172.21.15.111:0/3093093720 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8170065190 con 0x7f817011c8e0 2024-04-25T02:28:18.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.273+0000 7f81657fa700 1 -- 172.21.15.111:0/3093093720 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4158+0+0 (secure 0 0 0) 0x7f816805d7d0 con 0x7f817011c8e0 2024-04-25T02:28:18.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.273+0000 7f81657fa700 1 -- 172.21.15.111:0/3093093720 --> v1:172.21.15.111:6804/48960 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8154052d10 con 0x7f815404f010 2024-04-25T02:28:18.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.273+0000 7f81657fa700 1 -- 172.21.15.111:0/3093093720 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f816801fb10 con 0x7f817011c8e0 2024-04-25T02:28:18.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.274+0000 7f81657fa700 1 -- 172.21.15.111:0/3093093720 <== osd.1 v1:172.21.15.111:6804/48960 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (unknown 0 0 1173804961) 0x7f8154052d10 con 0x7f815404f010 2024-04-25T02:28:18.291 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.288+0000 7f817773f700 1 -- 172.21.15.111:0/3093093720 --> v1:172.21.15.111:6804/48960 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f81700aece0 con 0x7f815404f010 2024-04-25T02:28:18.291 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.288+0000 7f81657fa700 1 -- 172.21.15.111:0/3093093720 <== osd.1 v1:172.21.15.111:6804/48960 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (unknown 0 0 119112422) 0x7f81700aece0 con 0x7f815404f010 2024-04-25T02:28:18.291 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-25T02:28:18.292 INFO:teuthology.orchestra.run.smithi111.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T02:28:18.292 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-25T02:28:18.293 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.288+0000 7f817773f700 1 -- 172.21.15.111:0/3093093720 >> v1:172.21.15.111:6804/48960 conn(0x7f815404f010 legacy=0x7f81540514a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:18.293 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.288+0000 7f817773f700 1 -- 172.21.15.111:0/3093093720 >> v1:172.21.15.111:6816/46482 conn(0x7f8154045ef0 legacy=0x7f81540483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:18.293 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.288+0000 7f817773f700 1 -- 172.21.15.111:0/3093093720 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f817011c8e0 msgr2=0x7f8170151680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:18.293 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.288+0000 7f817773f700 1 --2- 172.21.15.111:0/3093093720 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f817011c8e0 0x7f8170151680 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8168016000 tx=0x7f8168019000 comp rx=0 tx=0).stop 2024-04-25T02:28:18.293 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.288+0000 7f8175cdc700 1 -- 172.21.15.111:0/3093093720 reap_dead start 2024-04-25T02:28:18.293 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.288+0000 7f817773f700 1 -- 172.21.15.111:0/3093093720 shutdown_connections 2024-04-25T02:28:18.293 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.288+0000 7f817773f700 1 -- 172.21.15.111:0/3093093720 >> 172.21.15.111:0/3093093720 conn(0x7f81700b1e80 msgr2=0x7f817013e890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:18.293 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.288+0000 7f817773f700 1 -- 172.21.15.111:0/3093093720 shutdown_connections 2024-04-25T02:28:18.293 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.288+0000 7f817773f700 1 -- 172.21.15.111:0/3093093720 wait complete. 2024-04-25T02:28:18.303 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-25T02:28:18.419 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.415+0000 7f5536d5e700 1 Processor -- start 2024-04-25T02:28:18.419 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.415+0000 7f5536d5e700 1 -- start start 2024-04-25T02:28:18.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.416+0000 7f5536d5e700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f553006ed70 0x7f55300a5270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:18.421 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.416+0000 7f5536d5e700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f55300a4030 0x7f5530146a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:18.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.416+0000 7f5536d5e700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55300a44d0 con 0x7f55300a7110 2024-04-25T02:28:18.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.416+0000 7f5536d5e700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55300a33c0 con 0x7f553006ed70 2024-04-25T02:28:18.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.416+0000 7f5536d5e700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f55300a3660 con 0x7f55300a4030 2024-04-25T02:28:18.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.416+0000 7f5534afa700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f553006ed70 0x7f55300a5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:18.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.416+0000 7f552ffff700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f55300a7110 0x7f55300a3920 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:33464/0 (socket says 172.21.15.111:33464) 2024-04-25T02:28:18.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.416+0000 7f552ffff700 1 -- 172.21.15.111:0/169541715 learned_addr learned my addr 172.21.15.111:0/169541715 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:28:18.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.416+0000 7f55352fb700 1 --2- 172.21.15.111:0/169541715 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f55300a4030 0x7f5530146a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:18.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.416+0000 7f552f7fe700 1 -- 172.21.15.111:0/169541715 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2796149665 0 0) 0x7f55300a44d0 con 0x7f55300a7110 2024-04-25T02:28:18.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.416+0000 7f552f7fe700 1 -- 172.21.15.111:0/169541715 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5520003570 con 0x7f55300a7110 2024-04-25T02:28:18.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.416+0000 7f55352fb700 1 -- 172.21.15.111:0/169541715 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f553006ed70 msgr2=0x7f55300a5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:18.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.416+0000 7f55352fb700 1 --2- 172.21.15.111:0/169541715 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f553006ed70 0x7f55300a5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:18.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.416+0000 7f55352fb700 1 -- 172.21.15.111:0/169541715 >> v1:172.21.15.111:6789/0 conn(0x7f55300a7110 legacy=0x7f55300a3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:18.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.416+0000 7f55352fb700 1 -- 172.21.15.111:0/169541715 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f553006faf0 con 0x7f55300a4030 2024-04-25T02:28:18.422 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.416+0000 7f5534afa700 1 --2- 172.21.15.111:0/169541715 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f553006ed70 0x7f55300a5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:18.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.417+0000 7f55352fb700 1 --2- 172.21.15.111:0/169541715 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f55300a4030 0x7f5530146a10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5528009e90 tx=0x7f5528009780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=321fc9bcc16cbe59 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:18.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.417+0000 7f552f7fe700 1 -- 172.21.15.111:0/169541715 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552800e070 con 0x7f55300a4030 2024-04-25T02:28:18.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.417+0000 7f552f7fe700 1 -- 172.21.15.111:0/169541715 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f552800bb80 con 0x7f55300a4030 2024-04-25T02:28:18.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.417+0000 7f552f7fe700 1 -- 172.21.15.111:0/169541715 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5528012430 con 0x7f55300a4030 2024-04-25T02:28:18.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.417+0000 7f5536d5e700 1 -- 172.21.15.111:0/169541715 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f55300a4030 msgr2=0x7f5530146a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:18.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.417+0000 7f5536d5e700 1 --2- 172.21.15.111:0/169541715 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f55300a4030 0x7f5530146a10 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f5528009e90 tx=0x7f5528009780 comp rx=0 tx=0).stop 2024-04-25T02:28:18.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.417+0000 7f5536d5e700 1 -- 172.21.15.111:0/169541715 shutdown_connections 2024-04-25T02:28:18.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.417+0000 7f5536d5e700 1 --2- 172.21.15.111:0/169541715 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f55300a4030 0x7f5530146a10 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:18.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.417+0000 7f5536d5e700 1 --2- 172.21.15.111:0/169541715 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f553006ed70 0x7f55300a5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:18.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.417+0000 7f5536d5e700 1 -- 172.21.15.111:0/169541715 >> 172.21.15.111:0/169541715 conn(0x7f5530067940 msgr2=0x7f5530067d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:18.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.417+0000 7f5536d5e700 1 -- 172.21.15.111:0/169541715 shutdown_connections 2024-04-25T02:28:18.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.417+0000 7f5536d5e700 1 -- 172.21.15.111:0/169541715 wait complete. 2024-04-25T02:28:18.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.418+0000 7f5536d5e700 1 Processor -- start 2024-04-25T02:28:18.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.418+0000 7f5536d5e700 1 -- start start 2024-04-25T02:28:18.425 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.419+0000 7f5536d5e700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f553006ed70 0x7f55300a8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:18.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.419+0000 7f5536d5e700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f55300a4030 0x7f55300a7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:18.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.419+0000 7f5536d5e700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f55300a7110 0x7f553014eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:18.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.419+0000 7f5536d5e700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55300a7a70 con 0x7f55300a4030 2024-04-25T02:28:18.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.419+0000 7f5536d5e700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5530137d80 con 0x7f553006ed70 2024-04-25T02:28:18.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.419+0000 7f5536d5e700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f5530138040 con 0x7f55300a7110 2024-04-25T02:28:18.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.419+0000 7f5534afa700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f553006ed70 0x7f55300a8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:18.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.419+0000 7f552ffff700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f55300a4030 0x7f55300a7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:18.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.419+0000 7f5534afa700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f553006ed70 0x7f55300a8fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:53922/0 (socket says 172.21.15.111:53922) 2024-04-25T02:28:18.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.419+0000 7f5534afa700 1 -- 172.21.15.111:0/1357253213 learned_addr learned my addr 172.21.15.111:0/1357253213 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:28:18.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.419+0000 7f55352fb700 1 --2- 172.21.15.111:0/1357253213 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f55300a7110 0x7f553014eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:18.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.419+0000 7f5534afa700 1 -- 172.21.15.111:0/1357253213 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f55300a7110 msgr2=0x7f553014eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:18.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.419+0000 7f5534afa700 1 --2- 172.21.15.111:0/1357253213 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f55300a7110 0x7f553014eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:18.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.419+0000 7f5534afa700 1 -- 172.21.15.111:0/1357253213 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f55300a4030 msgr2=0x7f55300a7f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:18.426 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.419+0000 7f5534afa700 1 --2- 172.21.15.111:0/1357253213 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f55300a4030 0x7f55300a7f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:18.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.419+0000 7f5534afa700 1 -- 172.21.15.111:0/1357253213 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5524009420 con 0x7f553006ed70 2024-04-25T02:28:18.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.419+0000 7f552ffff700 1 --2- 172.21.15.111:0/1357253213 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f55300a4030 0x7f55300a7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:18.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.420+0000 7f5534afa700 1 --2- 172.21.15.111:0/1357253213 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f553006ed70 0x7f55300a8fd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f552400ec80 tx=0x7f55240091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:18.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.420+0000 7f552cff9700 1 -- 172.21.15.111:0/1357253213 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552400c920 con 0x7f553006ed70 2024-04-25T02:28:18.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.420+0000 7f552cff9700 1 -- 172.21.15.111:0/1357253213 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f552400ca80 con 0x7f553006ed70 2024-04-25T02:28:18.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.420+0000 7f5536d5e700 1 -- 172.21.15.111:0/1357253213 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5528009a20 con 0x7f553006ed70 2024-04-25T02:28:18.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.420+0000 7f552cff9700 1 -- 172.21.15.111:0/1357253213 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f552400ce00 con 0x7f553006ed70 2024-04-25T02:28:18.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.420+0000 7f5536d5e700 1 -- 172.21.15.111:0/1357253213 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55300a8470 con 0x7f553006ed70 2024-04-25T02:28:18.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.421+0000 7f552cff9700 1 -- 172.21.15.111:0/1357253213 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f5524013680 con 0x7f553006ed70 2024-04-25T02:28:18.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.421+0000 7f5536d5e700 1 -- 172.21.15.111:0/1357253213 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5530071790 con 0x7f553006ed70 2024-04-25T02:28:18.427 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.421+0000 7f552cff9700 1 -- 172.21.15.111:0/1357253213 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4158+0+0 (secure 0 0 0) 0x7f552405b540 con 0x7f553006ed70 2024-04-25T02:28:18.428 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.425+0000 7f552cff9700 1 -- 172.21.15.111:0/1357253213 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f5524039770 con 0x7f553006ed70 2024-04-25T02:28:18.583 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.579+0000 7f5536d5e700 1 -- 172.21.15.111:0/1357253213 --> v1:172.21.15.111:6816/46482 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7f55300b0070 con 0x7f5514045ef0 2024-04-25T02:28:18.583 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.580+0000 7f552cff9700 1 -- 172.21.15.111:0/1357253213 <== mgr.14107 v1:172.21.15.111:6816/46482 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (unknown 489605429 0 0) 0x7f55300b0070 con 0x7f5514045ef0 2024-04-25T02:28:18.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.582+0000 7f5536d5e700 1 -- 172.21.15.111:0/1357253213 >> v1:172.21.15.111:6816/46482 conn(0x7f5514045ef0 legacy=0x7f55140483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:18.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.582+0000 7f5536d5e700 1 -- 172.21.15.111:0/1357253213 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f553006ed70 msgr2=0x7f55300a8fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:18.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.582+0000 7f5536d5e700 1 --2- 172.21.15.111:0/1357253213 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f553006ed70 0x7f55300a8fd0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f552400ec80 tx=0x7f55240091a0 comp rx=0 tx=0).stop 2024-04-25T02:28:18.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.582+0000 7f5536d5e700 1 -- 172.21.15.111:0/1357253213 shutdown_connections 2024-04-25T02:28:18.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.582+0000 7f5536d5e700 1 --2- 172.21.15.111:0/1357253213 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f55300a7110 0x7f553014eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:18.586 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.582+0000 7f5536d5e700 1 --2- 172.21.15.111:0/1357253213 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f553006ed70 0x7f55300a8fd0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:18.587 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.582+0000 7f5536d5e700 1 --2- 172.21.15.111:0/1357253213 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f55300a4030 0x7f55300a7f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:18.587 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.582+0000 7f5536d5e700 1 -- 172.21.15.111:0/1357253213 >> 172.21.15.111:0/1357253213 conn(0x7f5530067940 msgr2=0x7f5530067d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:18.587 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.582+0000 7f5536d5e700 1 -- 172.21.15.111:0/1357253213 shutdown_connections 2024-04-25T02:28:18.587 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.582+0000 7f5536d5e700 1 -- 172.21.15.111:0/1357253213 wait complete. 2024-04-25T02:28:18.587 INFO:teuthology.orchestra.run.smithi111.stderr:instructed osd(s) 1 to deep-scrub 2024-04-25T02:28:18.597 INFO:tasks.ceph:Scrubbing osd.2 2024-04-25T02:28:18.597 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-25T02:28:18.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.712+0000 7fe1836a5700 1 Processor -- start 2024-04-25T02:28:18.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.713+0000 7fe1836a5700 1 -- start start 2024-04-25T02:28:18.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.713+0000 7fe1836a5700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fe17c0aad90 0x7fe17c06f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:18.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.713+0000 7fe1836a5700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe17c146bf0 0x7fe17c148fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:18.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.713+0000 7fe1836a5700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe17c06f930 con 0x7fe17c063c90 2024-04-25T02:28:18.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.713+0000 7fe1836a5700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe17c0aa0d0 con 0x7fe17c0aad90 2024-04-25T02:28:18.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.713+0000 7fe1836a5700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c06fb90 con 0x7fe17c146bf0 2024-04-25T02:28:18.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.713+0000 7fe181c42700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe17c146bf0 0x7fe17c148fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:18.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.713+0000 7fe180c40700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fe17c0aad90 0x7fe17c06f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:18.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.713+0000 7fe181c42700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe17c146bf0 0x7fe17c148fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:51926/0 (socket says 172.21.15.111:51926) 2024-04-25T02:28:18.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.713+0000 7fe180c40700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7fe17c0aad90 0x7fe17c06f3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48636/0 (socket says 172.21.15.111:48636) 2024-04-25T02:28:18.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.713+0000 7fe181c42700 1 -- 172.21.15.111:0/712352495 learned_addr learned my addr 172.21.15.111:0/712352495 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:28:18.719 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.713+0000 7fe181441700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7fe17c063c90 0x7fe17c13eac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:33476/0 (socket says 172.21.15.111:33476) 2024-04-25T02:28:18.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.714+0000 7fe180c40700 1 -- 172.21.15.111:0/712352495 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe17c146bf0 msgr2=0x7fe17c148fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:18.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.714+0000 7fe180c40700 1 --2- 172.21.15.111:0/712352495 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe17c146bf0 0x7fe17c148fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:18.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.714+0000 7fe180c40700 1 -- 172.21.15.111:0/712352495 >> v1:172.21.15.111:6789/0 conn(0x7fe17c063c90 legacy=0x7fe17c13eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:18.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.714+0000 7fe180c40700 1 -- 172.21.15.111:0/712352495 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe17c0adc70 con 0x7fe17c0aad90 2024-04-25T02:28:18.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.714+0000 7fe173fff700 1 -- 172.21.15.111:0/712352495 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1965102353 0 0) 0x7fe17c06f930 con 0x7fe17c063c90 2024-04-25T02:28:18.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.714+0000 7fe181c42700 1 --2- 172.21.15.111:0/712352495 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe17c146bf0 0x7fe17c148fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:18.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.714+0000 7fe180c40700 1 --2- 172.21.15.111:0/712352495 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe17c0aad90 0x7fe17c06f3f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe1780098e0 tx=0x7fe1780091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81e3b1af8fc07c02 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:18.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.714+0000 7fe173fff700 1 -- 172.21.15.111:0/712352495 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17800b640 con 0x7fe17c0aad90 2024-04-25T02:28:18.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.714+0000 7fe173fff700 1 -- 172.21.15.111:0/712352495 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe17800b7a0 con 0x7fe17c0aad90 2024-04-25T02:28:18.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.714+0000 7fe173fff700 1 -- 172.21.15.111:0/712352495 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17800bb40 con 0x7fe17c0aad90 2024-04-25T02:28:18.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.714+0000 7fe1836a5700 1 -- 172.21.15.111:0/712352495 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe17c0aad90 msgr2=0x7fe17c06f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:18.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.714+0000 7fe1836a5700 1 --2- 172.21.15.111:0/712352495 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe17c0aad90 0x7fe17c06f3f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fe1780098e0 tx=0x7fe1780091a0 comp rx=0 tx=0).stop 2024-04-25T02:28:18.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.715+0000 7fe1836a5700 1 -- 172.21.15.111:0/712352495 shutdown_connections 2024-04-25T02:28:18.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.715+0000 7fe1836a5700 1 --2- 172.21.15.111:0/712352495 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe17c146bf0 0x7fe17c148fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:18.720 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.715+0000 7fe1836a5700 1 --2- 172.21.15.111:0/712352495 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe17c0aad90 0x7fe17c06f3f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:18.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.715+0000 7fe1836a5700 1 -- 172.21.15.111:0/712352495 >> 172.21.15.111:0/712352495 conn(0x7fe17c0b1e80 msgr2=0x7fe17c0adef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:18.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.715+0000 7fe1836a5700 1 -- 172.21.15.111:0/712352495 shutdown_connections 2024-04-25T02:28:18.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.715+0000 7fe1836a5700 1 -- 172.21.15.111:0/712352495 wait complete. 2024-04-25T02:28:18.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.716+0000 7fe1836a5700 1 Processor -- start 2024-04-25T02:28:18.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.716+0000 7fe1836a5700 1 -- start start 2024-04-25T02:28:18.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.717+0000 7fe1836a5700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe17c063c90 0x7fe17c1196d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:18.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.717+0000 7fe1836a5700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe17c146bf0 0x7fe17c141830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:18.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.717+0000 7fe1836a5700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe17c151450 0x7fe17c1518f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:18.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.717+0000 7fe1836a5700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c1423b0 con 0x7fe17c151450 2024-04-25T02:28:18.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.717+0000 7fe1836a5700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c144100 con 0x7fe17c146bf0 2024-04-25T02:28:18.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.717+0000 7fe1836a5700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7fe17c1426b0 con 0x7fe17c063c90 2024-04-25T02:28:18.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.717+0000 7fe180c40700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe17c146bf0 0x7fe17c141830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:18.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.717+0000 7fe181441700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe17c063c90 0x7fe17c1196d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:18.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.717+0000 7fe181c42700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe17c151450 0x7fe17c1518f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:18.724 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.717+0000 7fe180c40700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe17c146bf0 0x7fe17c141830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:53924/0 (socket says 172.21.15.111:53924) 2024-04-25T02:28:18.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.717+0000 7fe181c42700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe17c151450 0x7fe17c1518f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48650/0 (socket says 172.21.15.111:48650) 2024-04-25T02:28:18.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.717+0000 7fe180c40700 1 -- 172.21.15.111:0/3651716270 learned_addr learned my addr 172.21.15.111:0/3651716270 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:28:18.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.717+0000 7fe181441700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe17c063c90 0x7fe17c1196d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:51934/0 (socket says 172.21.15.111:51934) 2024-04-25T02:28:18.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.717+0000 7fe181441700 1 -- 172.21.15.111:0/3651716270 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe17c146bf0 msgr2=0x7fe17c141830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:18.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.717+0000 7fe181441700 1 --2- 172.21.15.111:0/3651716270 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7fe17c146bf0 0x7fe17c141830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:18.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.717+0000 7fe181441700 1 -- 172.21.15.111:0/3651716270 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe17c151450 msgr2=0x7fe17c1518f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:18.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.717+0000 7fe181441700 1 --2- 172.21.15.111:0/3651716270 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7fe17c151450 0x7fe17c1518f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:18.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.717+0000 7fe181441700 1 -- 172.21.15.111:0/3651716270 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe174009ae0 con 0x7fe17c063c90 2024-04-25T02:28:18.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.717+0000 7fe181441700 1 --2- 172.21.15.111:0/3651716270 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe17c063c90 0x7fe17c1196d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe16c0011e0 tx=0x7fe16c007d30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:18.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.717+0000 7fe1717fa700 1 -- 172.21.15.111:0/3651716270 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16c005a70 con 0x7fe17c063c90 2024-04-25T02:28:18.725 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.717+0000 7fe1717fa700 1 -- 172.21.15.111:0/3651716270 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe16c005bf0 con 0x7fe17c063c90 2024-04-25T02:28:18.726 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.717+0000 7fe1836a5700 1 -- 172.21.15.111:0/3651716270 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe178009420 con 0x7fe17c063c90 2024-04-25T02:28:18.726 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.717+0000 7fe1717fa700 1 -- 172.21.15.111:0/3651716270 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16c0070d0 con 0x7fe17c063c90 2024-04-25T02:28:18.726 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.718+0000 7fe1836a5700 1 -- 172.21.15.111:0/3651716270 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe17c141d70 con 0x7fe17c063c90 2024-04-25T02:28:18.726 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.718+0000 7fe1836a5700 1 -- 172.21.15.111:0/3651716270 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fe17c065190 con 0x7fe17c063c90 2024-04-25T02:28:18.726 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.718+0000 7fe1717fa700 1 -- 172.21.15.111:0/3651716270 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7fe16c007440 con 0x7fe17c063c90 2024-04-25T02:28:18.726 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.719+0000 7fe1717fa700 1 -- 172.21.15.111:0/3651716270 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4158+0+0 (secure 0 0 0) 0x7fe16c05a5b0 con 0x7fe17c063c90 2024-04-25T02:28:18.726 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.719+0000 7fe1717fa700 1 -- 172.21.15.111:0/3651716270 --> v1:172.21.15.111:6808/49070 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe160052d90 con 0x7fe16004f090 2024-04-25T02:28:18.726 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.719+0000 7fe1717fa700 1 -- 172.21.15.111:0/3651716270 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7fe16c05cbf0 con 0x7fe17c063c90 2024-04-25T02:28:18.726 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.720+0000 7fe1717fa700 1 -- 172.21.15.111:0/3651716270 <== osd.2 v1:172.21.15.111:6808/49070 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (unknown 0 0 1173804961) 0x7fe160052d90 con 0x7fe16004f090 2024-04-25T02:28:18.737 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.733+0000 7fe1836a5700 1 -- 172.21.15.111:0/3651716270 --> v1:172.21.15.111:6808/49070 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fe17c0aece0 con 0x7fe16004f090 2024-04-25T02:28:18.737 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.733+0000 7fe1717fa700 1 -- 172.21.15.111:0/3651716270 <== osd.2 v1:172.21.15.111:6808/49070 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (unknown 0 0 119112422) 0x7fe17c0aece0 con 0x7fe16004f090 2024-04-25T02:28:18.737 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-25T02:28:18.737 INFO:teuthology.orchestra.run.smithi111.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T02:28:18.737 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-25T02:28:18.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.734+0000 7fe1836a5700 1 -- 172.21.15.111:0/3651716270 >> v1:172.21.15.111:6808/49070 conn(0x7fe16004f090 legacy=0x7fe160051520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:18.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.734+0000 7fe1836a5700 1 -- 172.21.15.111:0/3651716270 >> v1:172.21.15.111:6816/46482 conn(0x7fe160045ef0 legacy=0x7fe1600483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:18.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.734+0000 7fe1836a5700 1 -- 172.21.15.111:0/3651716270 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe17c063c90 msgr2=0x7fe17c1196d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:18.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.734+0000 7fe1836a5700 1 --2- 172.21.15.111:0/3651716270 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7fe17c063c90 0x7fe17c1196d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fe16c0011e0 tx=0x7fe16c007d30 comp rx=0 tx=0).stop 2024-04-25T02:28:18.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.734+0000 7fe181c42700 1 -- 172.21.15.111:0/3651716270 reap_dead start 2024-04-25T02:28:18.738 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.734+0000 7fe1836a5700 1 -- 172.21.15.111:0/3651716270 shutdown_connections 2024-04-25T02:28:18.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.734+0000 7fe1836a5700 1 -- 172.21.15.111:0/3651716270 >> 172.21.15.111:0/3651716270 conn(0x7fe17c0b1e80 msgr2=0x7fe17c13e890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:18.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.734+0000 7fe1836a5700 1 -- 172.21.15.111:0/3651716270 shutdown_connections 2024-04-25T02:28:18.739 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.734+0000 7fe1836a5700 1 -- 172.21.15.111:0/3651716270 wait complete. 2024-04-25T02:28:18.748 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-25T02:28:18.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.862+0000 7f8d894d7700 1 Processor -- start 2024-04-25T02:28:18.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.862+0000 7f8d894d7700 1 -- start start 2024-04-25T02:28:18.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.862+0000 7f8d894d7700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f8d840b4fd0 0x7f8d840a2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:18.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.862+0000 7f8d894d7700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8d840a3980 0x7f8d840a3d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:18.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.862+0000 7f8d894d7700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8d8413ea00 0x7f8d8413eea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:18.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.862+0000 7f8d894d7700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d840a6710 con 0x7f8d840b4fd0 2024-04-25T02:28:18.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.862+0000 7f8d894d7700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d840a46d0 con 0x7f8d840a3980 2024-04-25T02:28:18.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.862+0000 7f8d894d7700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d8413f3e0 con 0x7f8d8413ea00 2024-04-25T02:28:18.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.862+0000 7f8d827fc700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8d840a3980 0x7f8d840a3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:18.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.862+0000 7f8d82ffd700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f8d840b4fd0 0x7f8d840a2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:18.868 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.862+0000 7f8d837fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8d8413ea00 0x7f8d8413eea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:18.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.862+0000 7f8d827fc700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8d840a3980 0x7f8d840a3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:53926/0 (socket says 172.21.15.111:53926) 2024-04-25T02:28:18.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.862+0000 7f8d837fe700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8d8413ea00 0x7f8d8413eea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:51950/0 (socket says 172.21.15.111:51950) 2024-04-25T02:28:18.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.862+0000 7f8d82ffd700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f8d840b4fd0 0x7f8d840a2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48662/0 (socket says 172.21.15.111:48662) 2024-04-25T02:28:18.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.862+0000 7f8d827fc700 1 -- 172.21.15.111:0/3852064182 learned_addr learned my addr 172.21.15.111:0/3852064182 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:28:18.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.863+0000 7f8d827fc700 1 -- 172.21.15.111:0/3852064182 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8d8413ea00 msgr2=0x7f8d8413eea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:18.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.863+0000 7f8d827fc700 1 --2- 172.21.15.111:0/3852064182 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8d8413ea00 0x7f8d8413eea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:18.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.863+0000 7f8d827fc700 1 -- 172.21.15.111:0/3852064182 >> v2:172.21.15.111:3300/0 conn(0x7f8d840b4fd0 msgr2=0x7f8d840a2560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:18.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.863+0000 7f8d827fc700 1 --2- 172.21.15.111:0/3852064182 >> v2:172.21.15.111:3300/0 conn(0x7f8d840b4fd0 0x7f8d840a2560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:18.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.863+0000 7f8d827fc700 1 -- 172.21.15.111:0/3852064182 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d840a4930 con 0x7f8d840a3980 2024-04-25T02:28:18.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.863+0000 7f8d837fe700 1 --2- 172.21.15.111:0/3852064182 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8d8413ea00 0x7f8d8413eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:18.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.863+0000 7f8d82ffd700 1 --2- 172.21.15.111:0/3852064182 >> v2:172.21.15.111:3300/0 conn(0x7f8d840b4fd0 0x7f8d840a2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:18.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.863+0000 7f8d827fc700 1 --2- 172.21.15.111:0/3852064182 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8d840a3980 0x7f8d840a3d50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8d780099e0 tx=0x7f8d78009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f7706aae0d1bff2 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:18.869 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.863+0000 7f8d81ffb700 1 -- 172.21.15.111:0/3852064182 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d7800b640 con 0x7f8d840a3980 2024-04-25T02:28:18.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.863+0000 7f8d81ffb700 1 -- 172.21.15.111:0/3852064182 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d7800b7a0 con 0x7f8d840a3980 2024-04-25T02:28:18.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.863+0000 7f8d81ffb700 1 -- 172.21.15.111:0/3852064182 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d7800bb40 con 0x7f8d840a3980 2024-04-25T02:28:18.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.864+0000 7f8d894d7700 1 -- 172.21.15.111:0/3852064182 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8d840a3980 msgr2=0x7f8d840a3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:18.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.864+0000 7f8d894d7700 1 --2- 172.21.15.111:0/3852064182 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8d840a3980 0x7f8d840a3d50 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8d780099e0 tx=0x7f8d78009250 comp rx=0 tx=0).stop 2024-04-25T02:28:18.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.864+0000 7f8d894d7700 1 -- 172.21.15.111:0/3852064182 shutdown_connections 2024-04-25T02:28:18.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.864+0000 7f8d894d7700 1 --2- 172.21.15.111:0/3852064182 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8d8413ea00 0x7f8d8413eea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:18.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.864+0000 7f8d894d7700 1 --2- 172.21.15.111:0/3852064182 >> v2:172.21.15.111:3300/0 conn(0x7f8d840b4fd0 0x7f8d840a2560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:18.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.864+0000 7f8d894d7700 1 --2- 172.21.15.111:0/3852064182 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8d840a3980 0x7f8d840a3d50 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:18.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.864+0000 7f8d894d7700 1 -- 172.21.15.111:0/3852064182 >> 172.21.15.111:0/3852064182 conn(0x7f8d840883e0 msgr2=0x7f8d84068b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:18.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.864+0000 7f8d894d7700 1 -- 172.21.15.111:0/3852064182 shutdown_connections 2024-04-25T02:28:18.870 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.864+0000 7f8d894d7700 1 -- 172.21.15.111:0/3852064182 wait complete. 2024-04-25T02:28:18.872 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.865+0000 7f8d894d7700 1 Processor -- start 2024-04-25T02:28:18.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.865+0000 7f8d894d7700 1 -- start start 2024-04-25T02:28:18.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.865+0000 7f8d894d7700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8d840a3980 0x7f8d840abdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:18.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.865+0000 7f8d894d7700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8d840b4fd0 0x7f8d8413c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:18.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.865+0000 7f8d894d7700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8d8413ea00 0x7f8d8413ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:18.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.865+0000 7f8d894d7700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d840ada70 con 0x7f8d840a3980 2024-04-25T02:28:18.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.865+0000 7f8d894d7700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d840ac730 con 0x7f8d8413ea00 2024-04-25T02:28:18.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.865+0000 7f8d894d7700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8d840adc70 con 0x7f8d840b4fd0 2024-04-25T02:28:18.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.865+0000 7f8d82ffd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8d840a3980 0x7f8d840abdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:18.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.865+0000 7f8d837fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8d8413ea00 0x7f8d8413ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:18.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.865+0000 7f8d827fc700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8d840b4fd0 0x7f8d8413c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:18.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.865+0000 7f8d82ffd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8d840a3980 0x7f8d840abdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48668/0 (socket says 172.21.15.111:48668) 2024-04-25T02:28:18.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.865+0000 7f8d82ffd700 1 -- 172.21.15.111:0/3961777637 learned_addr learned my addr 172.21.15.111:0/3961777637 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:28:18.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.866+0000 7f8d82ffd700 1 -- 172.21.15.111:0/3961777637 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8d840b4fd0 msgr2=0x7f8d8413c8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:18.873 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.866+0000 7f8d82ffd700 1 --2- 172.21.15.111:0/3961777637 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8d840b4fd0 0x7f8d8413c8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:18.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.866+0000 7f8d82ffd700 1 -- 172.21.15.111:0/3961777637 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8d8413ea00 msgr2=0x7f8d8413ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:18.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.866+0000 7f8d82ffd700 1 --2- 172.21.15.111:0/3961777637 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8d8413ea00 0x7f8d8413ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:18.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.866+0000 7f8d82ffd700 1 -- 172.21.15.111:0/3961777637 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d74009420 con 0x7f8d840a3980 2024-04-25T02:28:18.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.866+0000 7f8d827fc700 1 --2- 172.21.15.111:0/3961777637 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8d840b4fd0 0x7f8d8413c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:18.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.866+0000 7f8d837fe700 1 --2- 172.21.15.111:0/3961777637 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8d8413ea00 0x7f8d8413ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:18.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.866+0000 7f8d82ffd700 1 --2- 172.21.15.111:0/3961777637 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8d840a3980 0x7f8d840abdb0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8d7400ecb0 tx=0x7f8d740091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:18.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.866+0000 7f8d6affd700 1 -- 172.21.15.111:0/3961777637 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d7400c950 con 0x7f8d840a3980 2024-04-25T02:28:18.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.866+0000 7f8d6affd700 1 -- 172.21.15.111:0/3961777637 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d7400cab0 con 0x7f8d840a3980 2024-04-25T02:28:18.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.866+0000 7f8d894d7700 1 -- 172.21.15.111:0/3961777637 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d7c009a20 con 0x7f8d840a3980 2024-04-25T02:28:18.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.866+0000 7f8d6affd700 1 -- 172.21.15.111:0/3961777637 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d7400ce30 con 0x7f8d840a3980 2024-04-25T02:28:18.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.866+0000 7f8d894d7700 1 -- 172.21.15.111:0/3961777637 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d780094f0 con 0x7f8d840a3980 2024-04-25T02:28:18.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.867+0000 7f8d894d7700 1 -- 172.21.15.111:0/3961777637 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d84065190 con 0x7f8d840a3980 2024-04-25T02:28:18.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.867+0000 7f8d6affd700 1 -- 172.21.15.111:0/3961777637 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f8d74013680 con 0x7f8d840a3980 2024-04-25T02:28:18.874 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.867+0000 7f8d6affd700 1 -- 172.21.15.111:0/3961777637 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4158+0+0 (secure 0 0 0) 0x7f8d7405b3d0 con 0x7f8d840a3980 2024-04-25T02:28:18.875 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:18.871+0000 7f8d6affd700 1 -- 172.21.15.111:0/3961777637 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f8d74039720 con 0x7f8d840a3980 2024-04-25T02:28:19.028 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.025+0000 7f8d894d7700 1 -- 172.21.15.111:0/3961777637 --> v1:172.21.15.111:6816/46482 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f8d840a2ee0 con 0x7f8d70045ef0 2024-04-25T02:28:19.029 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.025+0000 7f8d6affd700 1 -- 172.21.15.111:0/3961777637 <== mgr.14107 v1:172.21.15.111:6816/46482 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (unknown 3049115190 0 0) 0x7f8d840a2ee0 con 0x7f8d70045ef0 2024-04-25T02:28:19.031 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.027+0000 7f8d894d7700 1 -- 172.21.15.111:0/3961777637 >> v1:172.21.15.111:6816/46482 conn(0x7f8d70045ef0 legacy=0x7f8d700483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:19.032 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.027+0000 7f8d894d7700 1 -- 172.21.15.111:0/3961777637 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8d840a3980 msgr2=0x7f8d840abdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:19.032 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.027+0000 7f8d894d7700 1 --2- 172.21.15.111:0/3961777637 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8d840a3980 0x7f8d840abdb0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f8d7400ecb0 tx=0x7f8d740091a0 comp rx=0 tx=0).stop 2024-04-25T02:28:19.032 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.027+0000 7f8d894d7700 1 -- 172.21.15.111:0/3961777637 shutdown_connections 2024-04-25T02:28:19.032 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.027+0000 7f8d894d7700 1 --2- 172.21.15.111:0/3961777637 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8d8413ea00 0x7f8d8413ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:19.032 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.027+0000 7f8d894d7700 1 --2- 172.21.15.111:0/3961777637 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8d840a3980 0x7f8d840abdb0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:19.032 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.027+0000 7f8d894d7700 1 --2- 172.21.15.111:0/3961777637 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8d840b4fd0 0x7f8d8413c8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:19.033 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.027+0000 7f8d894d7700 1 -- 172.21.15.111:0/3961777637 >> 172.21.15.111:0/3961777637 conn(0x7f8d840883e0 msgr2=0x7f8d84063d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:19.033 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.027+0000 7f8d894d7700 1 -- 172.21.15.111:0/3961777637 shutdown_connections 2024-04-25T02:28:19.033 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.027+0000 7f8d894d7700 1 -- 172.21.15.111:0/3961777637 wait complete. 2024-04-25T02:28:19.033 INFO:teuthology.orchestra.run.smithi111.stderr:instructed osd(s) 2 to deep-scrub 2024-04-25T02:28:19.042 INFO:tasks.ceph:Scrubbing osd.3 2024-04-25T02:28:19.042 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-25T02:28:19.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.160+0000 7f1105144700 1 Processor -- start 2024-04-25T02:28:19.164 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.160+0000 7f1105144700 1 -- start start 2024-04-25T02:28:19.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.161+0000 7f1105144700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f110013baf0 0x7f11000a45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:19.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.161+0000 7f1105144700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1100143850 0x7f1100145c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:19.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.161+0000 7f1105144700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f11001388c0 con 0x7f11000a30f0 2024-04-25T02:28:19.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.161+0000 7f1105144700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f11000a3f40 con 0x7f110013baf0 2024-04-25T02:28:19.168 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.161+0000 7f1105144700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f11000a4b10 con 0x7f1100143850 2024-04-25T02:28:19.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.161+0000 7f10ff59e700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1100143850 0x7f1100145c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:19.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.161+0000 7f10fed9d700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f110013baf0 0x7f11000a45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:19.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.161+0000 7f10ff59e700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1100143850 0x7f1100145c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:51964/0 (socket says 172.21.15.111:51964) 2024-04-25T02:28:19.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.161+0000 7f10fe59c700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f11000a30f0 0x7f11000b22f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:33484/0 (socket says 172.21.15.111:33484) 2024-04-25T02:28:19.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.161+0000 7f10ff59e700 1 -- 172.21.15.111:0/4243909506 learned_addr learned my addr 172.21.15.111:0/4243909506 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:28:19.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.161+0000 7f10fed9d700 1 -- 172.21.15.111:0/4243909506 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1100143850 msgr2=0x7f1100145c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:19.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.161+0000 7f10fed9d700 1 --2- 172.21.15.111:0/4243909506 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1100143850 0x7f1100145c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:19.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.161+0000 7f10fed9d700 1 -- 172.21.15.111:0/4243909506 >> v1:172.21.15.111:6789/0 conn(0x7f11000a30f0 legacy=0x7f11000b22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:19.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.161+0000 7f10fdd9b700 1 -- 172.21.15.111:0/4243909506 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 479472887 0 0) 0x7f10f0001110 con 0x7f11000a30f0 2024-04-25T02:28:19.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.161+0000 7f10fed9d700 1 -- 172.21.15.111:0/4243909506 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f110013b1d0 con 0x7f110013baf0 2024-04-25T02:28:19.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.161+0000 7f10ff59e700 1 --2- 172.21.15.111:0/4243909506 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1100143850 0x7f1100145c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:19.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.161+0000 7f10fed9d700 1 --2- 172.21.15.111:0/4243909506 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f110013baf0 0x7f11000a45d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f10f400bb90 tx=0x7f10f400b430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a029058d49ba10f server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:19.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.161+0000 7f10fdd9b700 1 -- 172.21.15.111:0/4243909506 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f400db40 con 0x7f110013baf0 2024-04-25T02:28:19.169 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.161+0000 7f10fdd9b700 1 -- 172.21.15.111:0/4243909506 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f400dca0 con 0x7f110013baf0 2024-04-25T02:28:19.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.161+0000 7f10fdd9b700 1 -- 172.21.15.111:0/4243909506 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f40196b0 con 0x7f110013baf0 2024-04-25T02:28:19.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.162+0000 7f1105144700 1 -- 172.21.15.111:0/4243909506 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f110013baf0 msgr2=0x7f11000a45d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:19.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.162+0000 7f1105144700 1 --2- 172.21.15.111:0/4243909506 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f110013baf0 0x7f11000a45d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f10f400bb90 tx=0x7f10f400b430 comp rx=0 tx=0).stop 2024-04-25T02:28:19.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.162+0000 7f1105144700 1 -- 172.21.15.111:0/4243909506 shutdown_connections 2024-04-25T02:28:19.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.162+0000 7f1105144700 1 --2- 172.21.15.111:0/4243909506 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1100143850 0x7f1100145c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:19.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.162+0000 7f1105144700 1 --2- 172.21.15.111:0/4243909506 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f110013baf0 0x7f11000a45d0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:19.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.162+0000 7f1105144700 1 -- 172.21.15.111:0/4243909506 >> 172.21.15.111:0/4243909506 conn(0x7f110006d200 msgr2=0x7f110006af90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:19.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.162+0000 7f1105144700 1 -- 172.21.15.111:0/4243909506 shutdown_connections 2024-04-25T02:28:19.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.162+0000 7f1105144700 1 -- 172.21.15.111:0/4243909506 wait complete. 2024-04-25T02:28:19.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.163+0000 7f1105144700 1 Processor -- start 2024-04-25T02:28:19.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.163+0000 7f1105144700 1 -- start start 2024-04-25T02:28:19.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.163+0000 7f1105144700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f11000a30f0 0x7f1100140830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:19.170 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.163+0000 7f1105144700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f110013baf0 0x7f11001393b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:19.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.163+0000 7f1105144700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1100143850 0x7f1100068910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:19.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.163+0000 7f1105144700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f110013ff50 con 0x7f110013baf0 2024-04-25T02:28:19.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.164+0000 7f1105144700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f110013fce0 con 0x7f11000a30f0 2024-04-25T02:28:19.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.164+0000 7f1105144700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f110013a140 con 0x7f1100143850 2024-04-25T02:28:19.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.164+0000 7f10fed9d700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f11000a30f0 0x7f1100140830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:19.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.164+0000 7f10ff59e700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1100143850 0x7f1100068910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:19.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.164+0000 7f10fe59c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f110013baf0 0x7f11001393b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:19.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.164+0000 7f10fed9d700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f11000a30f0 0x7f1100140830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:53938/0 (socket says 172.21.15.111:53938) 2024-04-25T02:28:19.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.164+0000 7f10ff59e700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1100143850 0x7f1100068910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:51976/0 (socket says 172.21.15.111:51976) 2024-04-25T02:28:19.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.164+0000 7f10fed9d700 1 -- 172.21.15.111:0/1294614228 learned_addr learned my addr 172.21.15.111:0/1294614228 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:28:19.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.164+0000 7f10ff59e700 1 -- 172.21.15.111:0/1294614228 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f11000a30f0 msgr2=0x7f1100140830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:19.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.164+0000 7f10ff59e700 1 --2- 172.21.15.111:0/1294614228 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f11000a30f0 0x7f1100140830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:19.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.164+0000 7f10ff59e700 1 -- 172.21.15.111:0/1294614228 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f110013baf0 msgr2=0x7f11001393b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:19.171 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.164+0000 7f10ff59e700 1 --2- 172.21.15.111:0/1294614228 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f110013baf0 0x7f11001393b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:19.172 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.164+0000 7f10ff59e700 1 -- 172.21.15.111:0/1294614228 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f8009ae0 con 0x7f1100143850 2024-04-25T02:28:19.172 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.164+0000 7f10fe59c700 1 --2- 172.21.15.111:0/1294614228 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f110013baf0 0x7f11001393b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:19.172 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.164+0000 7f10ff59e700 1 --2- 172.21.15.111:0/1294614228 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1100143850 0x7f1100068910 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f10f8009e70 tx=0x7f10f800b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:19.172 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.164+0000 7f10e6ffd700 1 -- 172.21.15.111:0/1294614228 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f8018070 con 0x7f1100143850 2024-04-25T02:28:19.172 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.164+0000 7f10e6ffd700 1 -- 172.21.15.111:0/1294614228 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f10f800f040 con 0x7f1100143850 2024-04-25T02:28:19.172 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.164+0000 7f1105144700 1 -- 172.21.15.111:0/1294614228 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10f400b6d0 con 0x7f1100143850 2024-04-25T02:28:19.172 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.164+0000 7f10e6ffd700 1 -- 172.21.15.111:0/1294614228 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f10f800cb00 con 0x7f1100143850 2024-04-25T02:28:19.172 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.164+0000 7f1105144700 1 -- 172.21.15.111:0/1294614228 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1100139cb0 con 0x7f1100143850 2024-04-25T02:28:19.172 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.165+0000 7f1105144700 1 -- 172.21.15.111:0/1294614228 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f11000b1750 con 0x7f1100143850 2024-04-25T02:28:19.173 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.165+0000 7f10e6ffd700 1 -- 172.21.15.111:0/1294614228 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f10f8003020 con 0x7f1100143850 2024-04-25T02:28:19.173 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.165+0000 7f10e6ffd700 1 -- 172.21.15.111:0/1294614228 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4158+0+0 (secure 0 0 0) 0x7f10f805b3e0 con 0x7f1100143850 2024-04-25T02:28:19.173 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.166+0000 7f10e6ffd700 1 -- 172.21.15.111:0/1294614228 --> v1:172.21.15.111:6812/49243 -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f10ec052d90 con 0x7f10ec04f090 2024-04-25T02:28:19.173 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.166+0000 7f10e6ffd700 1 -- 172.21.15.111:0/1294614228 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_get_version_reply(handle=1 version=43) v2 ==== 24+0+0 (secure 0 0 0) 0x7f10f805da20 con 0x7f1100143850 2024-04-25T02:28:19.173 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.166+0000 7f10e6ffd700 1 -- 172.21.15.111:0/1294614228 <== osd.3 v1:172.21.15.111:6812/49243 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+24147 (unknown 0 0 1173804961) 0x7f10ec052d90 con 0x7f10ec04f090 2024-04-25T02:28:19.183 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.180+0000 7f1105144700 1 -- 172.21.15.111:0/1294614228 --> v1:172.21.15.111:6812/49243 -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f1100140450 con 0x7f10ec04f090 2024-04-25T02:28:19.184 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.180+0000 7f10e6ffd700 1 -- 172.21.15.111:0/1294614228 <== osd.3 v1:172.21.15.111:6812/49243 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+97 (unknown 0 0 119112422) 0x7f1100140450 con 0x7f10ec04f090 2024-04-25T02:28:19.184 INFO:teuthology.orchestra.run.smithi111.stdout:{ 2024-04-25T02:28:19.184 INFO:teuthology.orchestra.run.smithi111.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-25T02:28:19.184 INFO:teuthology.orchestra.run.smithi111.stdout:} 2024-04-25T02:28:19.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.180+0000 7f1105144700 1 -- 172.21.15.111:0/1294614228 >> v1:172.21.15.111:6812/49243 conn(0x7f10ec04f090 legacy=0x7f10ec051520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:19.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.181+0000 7f1105144700 1 -- 172.21.15.111:0/1294614228 >> v1:172.21.15.111:6816/46482 conn(0x7f10ec045ef0 legacy=0x7f10ec0483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:19.185 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.181+0000 7f1105144700 1 -- 172.21.15.111:0/1294614228 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1100143850 msgr2=0x7f1100068910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:19.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.181+0000 7f1105144700 1 --2- 172.21.15.111:0/1294614228 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1100143850 0x7f1100068910 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f10f8009e70 tx=0x7f10f800b040 comp rx=0 tx=0).stop 2024-04-25T02:28:19.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.181+0000 7f10ff59e700 1 -- 172.21.15.111:0/1294614228 reap_dead start 2024-04-25T02:28:19.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.181+0000 7f1105144700 1 -- 172.21.15.111:0/1294614228 shutdown_connections 2024-04-25T02:28:19.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.181+0000 7f1105144700 1 -- 172.21.15.111:0/1294614228 >> 172.21.15.111:0/1294614228 conn(0x7f110006d200 msgr2=0x7f1100064900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:19.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.181+0000 7f1105144700 1 -- 172.21.15.111:0/1294614228 shutdown_connections 2024-04-25T02:28:19.186 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.181+0000 7f1105144700 1 -- 172.21.15.111:0/1294614228 wait complete. 2024-04-25T02:28:19.195 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-25T02:28:19.312 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.309+0000 7f6bc3c76700 1 Processor -- start 2024-04-25T02:28:19.312 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.309+0000 7f6bc3c76700 1 -- start start 2024-04-25T02:28:19.314 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.309+0000 7f6bc3c76700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6bbc0a3410 0x7f6bbc0a4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:19.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.309+0000 7f6bc3c76700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f6bbc0a22a0 0x7f6bbc13e620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:19.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.309+0000 7f6bc3c76700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6bbc06da60 con 0x7f6bbc13eb60 2024-04-25T02:28:19.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.309+0000 7f6bc3c76700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6bbc0a2a20 con 0x7f6bbc0a22a0 2024-04-25T02:28:19.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.309+0000 7f6bc3c76700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc0a3c80 con 0x7f6bbc0a3410 2024-04-25T02:28:19.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.310+0000 7f6bc1a12700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6bbc0a3410 0x7f6bbc0a4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:19.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.310+0000 7f6bc1211700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f6bbc0a22a0 0x7f6bbc13e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:19.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.310+0000 7f6bc2213700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f6bbc13eb60 0x7f6bbc13b480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:33492/0 (socket says 172.21.15.111:33492) 2024-04-25T02:28:19.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.310+0000 7f6bc2213700 1 -- 172.21.15.111:0/279807019 learned_addr learned my addr 172.21.15.111:0/279807019 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:28:19.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.310+0000 7f6bc1211700 1 -- 172.21.15.111:0/279807019 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6bbc0a3410 msgr2=0x7f6bbc0a4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:19.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.310+0000 7f6bc1211700 1 --2- 172.21.15.111:0/279807019 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6bbc0a3410 0x7f6bbc0a4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:19.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.310+0000 7f6bc1211700 1 -- 172.21.15.111:0/279807019 >> v1:172.21.15.111:6789/0 conn(0x7f6bbc13eb60 legacy=0x7f6bbc13b480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:19.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.310+0000 7f6bc1211700 1 -- 172.21.15.111:0/279807019 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bbc0a37e0 con 0x7f6bbc0a22a0 2024-04-25T02:28:19.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.310+0000 7f6bc0a10700 1 -- 172.21.15.111:0/279807019 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1203077940 0 0) 0x7f6bbc06da60 con 0x7f6bbc13eb60 2024-04-25T02:28:19.315 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.310+0000 7f6bc1a12700 1 --2- 172.21.15.111:0/279807019 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6bbc0a3410 0x7f6bbc0a4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:19.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.310+0000 7f6bc1211700 1 --2- 172.21.15.111:0/279807019 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6bbc0a22a0 0x7f6bbc13e620 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6bac0098e0 tx=0x7f6bac0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=914cc094c6be4aa8 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:19.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.310+0000 7f6bc0a10700 1 -- 172.21.15.111:0/279807019 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac00b640 con 0x7f6bbc0a22a0 2024-04-25T02:28:19.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.310+0000 7f6bc0a10700 1 -- 172.21.15.111:0/279807019 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bac00b7a0 con 0x7f6bbc0a22a0 2024-04-25T02:28:19.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.310+0000 7f6bc0a10700 1 -- 172.21.15.111:0/279807019 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bac00bb40 con 0x7f6bbc0a22a0 2024-04-25T02:28:19.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.311+0000 7f6bc3c76700 1 -- 172.21.15.111:0/279807019 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6bbc0a22a0 msgr2=0x7f6bbc13e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:19.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.311+0000 7f6bc3c76700 1 --2- 172.21.15.111:0/279807019 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6bbc0a22a0 0x7f6bbc13e620 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f6bac0098e0 tx=0x7f6bac0091a0 comp rx=0 tx=0).stop 2024-04-25T02:28:19.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.311+0000 7f6bc3c76700 1 -- 172.21.15.111:0/279807019 shutdown_connections 2024-04-25T02:28:19.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.311+0000 7f6bc3c76700 1 --2- 172.21.15.111:0/279807019 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6bbc0a3410 0x7f6bbc0a4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:19.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.311+0000 7f6bc3c76700 1 --2- 172.21.15.111:0/279807019 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6bbc0a22a0 0x7f6bbc13e620 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:19.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.311+0000 7f6bc3c76700 1 -- 172.21.15.111:0/279807019 >> 172.21.15.111:0/279807019 conn(0x7f6bbc0b1cf0 msgr2=0x7f6bbc0b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:19.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.311+0000 7f6bc3c76700 1 -- 172.21.15.111:0/279807019 shutdown_connections 2024-04-25T02:28:19.316 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.311+0000 7f6bc3c76700 1 -- 172.21.15.111:0/279807019 wait complete. 2024-04-25T02:28:19.318 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.312+0000 7f6bc3c76700 1 Processor -- start 2024-04-25T02:28:19.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.312+0000 7f6bc3c76700 1 -- start start 2024-04-25T02:28:19.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.312+0000 7f6bc3c76700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6bbc0a22a0 0x7f6bbc0ab630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:19.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.312+0000 7f6bc3c76700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6bbc0a3410 0x7f6bbc0ac800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:19.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.312+0000 7f6bc3c76700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6bbc13eb60 0x7f6bbc149a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:19.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.312+0000 7f6bc3c76700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc0ac020 con 0x7f6bbc0a22a0 2024-04-25T02:28:19.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.312+0000 7f6bc3c76700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc0abb70 con 0x7f6bbc0a3410 2024-04-25T02:28:19.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.312+0000 7f6bc3c76700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc1497b0 con 0x7f6bbc13eb60 2024-04-25T02:28:19.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.312+0000 7f6bc1211700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6bbc0a3410 0x7f6bbc0ac800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:19.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.312+0000 7f6bc1a12700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6bbc0a22a0 0x7f6bbc0ab630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:19.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.312+0000 7f6bc2213700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6bbc13eb60 0x7f6bbc149a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:19.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.312+0000 7f6bc1211700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6bbc0a3410 0x7f6bbc0ac800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:53952/0 (socket says 172.21.15.111:53952) 2024-04-25T02:28:19.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.312+0000 7f6bc1a12700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6bbc0a22a0 0x7f6bbc0ab630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48690/0 (socket says 172.21.15.111:48690) 2024-04-25T02:28:19.319 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.312+0000 7f6bc1211700 1 -- 172.21.15.111:0/2550939064 learned_addr learned my addr 172.21.15.111:0/2550939064 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:28:19.320 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.313+0000 7f6bc1a12700 1 -- 172.21.15.111:0/2550939064 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6bbc13eb60 msgr2=0x7f6bbc149a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:19.320 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.313+0000 7f6bc1a12700 1 --2- 172.21.15.111:0/2550939064 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6bbc13eb60 0x7f6bbc149a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:19.320 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.313+0000 7f6bc1a12700 1 -- 172.21.15.111:0/2550939064 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6bbc0a3410 msgr2=0x7f6bbc0ac800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:19.320 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.313+0000 7f6bc1a12700 1 --2- 172.21.15.111:0/2550939064 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6bbc0a3410 0x7f6bbc0ac800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:19.320 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.313+0000 7f6bc1a12700 1 -- 172.21.15.111:0/2550939064 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bb8009420 con 0x7f6bbc0a22a0 2024-04-25T02:28:19.320 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.313+0000 7f6bc2213700 1 --2- 172.21.15.111:0/2550939064 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6bbc13eb60 0x7f6bbc149a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:19.320 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.313+0000 7f6bc1211700 1 --2- 172.21.15.111:0/2550939064 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6bbc0a3410 0x7f6bbc0ac800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:19.320 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.313+0000 7f6bc1a12700 1 --2- 172.21.15.111:0/2550939064 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6bbc0a22a0 0x7f6bbc0ab630 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6bb800ec80 tx=0x7f6bb80091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:19.320 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.313+0000 7f6bb1ffb700 1 -- 172.21.15.111:0/2550939064 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb800c850 con 0x7f6bbc0a22a0 2024-04-25T02:28:19.320 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.313+0000 7f6bb1ffb700 1 -- 172.21.15.111:0/2550939064 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bb800c9b0 con 0x7f6bbc0a22a0 2024-04-25T02:28:19.320 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.313+0000 7f6bc3c76700 1 -- 172.21.15.111:0/2550939064 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bac009420 con 0x7f6bbc0a22a0 2024-04-25T02:28:19.320 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.313+0000 7f6bb1ffb700 1 -- 172.21.15.111:0/2550939064 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bb800cd70 con 0x7f6bbc0a22a0 2024-04-25T02:28:19.320 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.313+0000 7f6bc3c76700 1 -- 172.21.15.111:0/2550939064 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bbc0aa3b0 con 0x7f6bbc0a22a0 2024-04-25T02:28:19.320 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.314+0000 7f6bb1ffb700 1 -- 172.21.15.111:0/2550939064 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f6bb8013680 con 0x7f6bbc0a22a0 2024-04-25T02:28:19.320 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.314+0000 7f6bc3c76700 1 -- 172.21.15.111:0/2550939064 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bbc0ab360 con 0x7f6bbc0a22a0 2024-04-25T02:28:19.321 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.314+0000 7f6bb1ffb700 1 -- 172.21.15.111:0/2550939064 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4158+0+0 (secure 0 0 0) 0x7f6bb805b710 con 0x7f6bbc0a22a0 2024-04-25T02:28:19.321 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.318+0000 7f6bb1ffb700 1 -- 172.21.15.111:0/2550939064 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f6bb803d540 con 0x7f6bbc0a22a0 2024-04-25T02:28:19.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.472+0000 7f6bc3c76700 1 -- 172.21.15.111:0/2550939064 --> v1:172.21.15.111:6816/46482 -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f6bbc06a150 con 0x7f6ba0045ef0 2024-04-25T02:28:19.475 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.472+0000 7f6bb1ffb700 1 -- 172.21.15.111:0/2550939064 <== mgr.14107 v1:172.21.15.111:6816/46482 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (unknown 3526570807 0 0) 0x7f6bbc06a150 con 0x7f6ba0045ef0 2024-04-25T02:28:19.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.474+0000 7f6bc3c76700 1 -- 172.21.15.111:0/2550939064 >> v1:172.21.15.111:6816/46482 conn(0x7f6ba0045ef0 legacy=0x7f6ba00483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:19.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.474+0000 7f6bc3c76700 1 -- 172.21.15.111:0/2550939064 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6bbc0a22a0 msgr2=0x7f6bbc0ab630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:19.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.474+0000 7f6bc3c76700 1 --2- 172.21.15.111:0/2550939064 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6bbc0a22a0 0x7f6bbc0ab630 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f6bb800ec80 tx=0x7f6bb80091a0 comp rx=0 tx=0).stop 2024-04-25T02:28:19.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.474+0000 7f6bc3c76700 1 -- 172.21.15.111:0/2550939064 shutdown_connections 2024-04-25T02:28:19.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.474+0000 7f6bc3c76700 1 --2- 172.21.15.111:0/2550939064 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f6bbc13eb60 0x7f6bbc149a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:19.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.474+0000 7f6bc3c76700 1 --2- 172.21.15.111:0/2550939064 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f6bbc0a22a0 0x7f6bbc0ab630 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:19.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.474+0000 7f6bc3c76700 1 --2- 172.21.15.111:0/2550939064 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f6bbc0a3410 0x7f6bbc0ac800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:19.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.474+0000 7f6bc3c76700 1 -- 172.21.15.111:0/2550939064 >> 172.21.15.111:0/2550939064 conn(0x7f6bbc0b1cf0 msgr2=0x7f6bbc13f600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:19.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.474+0000 7f6bc3c76700 1 -- 172.21.15.111:0/2550939064 shutdown_connections 2024-04-25T02:28:19.478 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.474+0000 7f6bc3c76700 1 -- 172.21.15.111:0/2550939064 wait complete. 2024-04-25T02:28:19.479 INFO:teuthology.orchestra.run.smithi111.stderr:instructed osd(s) 3 to deep-scrub 2024-04-25T02:28:19.489 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:28:19.605 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.602+0000 7f0fb77bb700 1 Processor -- start 2024-04-25T02:28:19.606 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.602+0000 7f0fb77bb700 1 -- start start 2024-04-25T02:28:19.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.603+0000 7f0fb77bb700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f0fb0144500 0x7f0fb01468e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:19.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.603+0000 7f0fb77bb700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0fb0146e20 0x7f0fb0149200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:19.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.603+0000 7f0fb77bb700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fb006f6d0 con 0x7f0fb0067b90 2024-04-25T02:28:19.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.603+0000 7f0fb77bb700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fb00af280 con 0x7f0fb0144500 2024-04-25T02:28:19.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.603+0000 7f0fb77bb700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb00a2e60 con 0x7f0fb0146e20 2024-04-25T02:28:19.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.603+0000 7f0fb4d56700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f0fb0144500 0x7f0fb01468e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:19.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.603+0000 7f0fb5d58700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0fb0146e20 0x7f0fb0149200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:19.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.603+0000 7f0fb5557700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f0fb0067b90 0x7f0fb00a3510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:33496/0 (socket says 172.21.15.111:33496) 2024-04-25T02:28:19.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.603+0000 7f0fb5557700 1 -- 172.21.15.111:0/3493825753 learned_addr learned my addr 172.21.15.111:0/3493825753 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:28:19.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.603+0000 7f0fb4d56700 1 -- 172.21.15.111:0/3493825753 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0fb0146e20 msgr2=0x7f0fb0149200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:19.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.603+0000 7f0fb4d56700 1 --2- 172.21.15.111:0/3493825753 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0fb0146e20 0x7f0fb0149200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:19.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.603+0000 7f0fb4d56700 1 -- 172.21.15.111:0/3493825753 >> v1:172.21.15.111:6789/0 conn(0x7f0fb0067b90 legacy=0x7f0fb00a3510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:19.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.603+0000 7f0fa7fff700 1 -- 172.21.15.111:0/3493825753 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3338174562 0 0) 0x7f0fb006f6d0 con 0x7f0fb0067b90 2024-04-25T02:28:19.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.603+0000 7f0fb4d56700 1 -- 172.21.15.111:0/3493825753 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb006f900 con 0x7f0fb0144500 2024-04-25T02:28:19.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.603+0000 7f0fb4d56700 1 --2- 172.21.15.111:0/3493825753 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0fb0144500 0x7f0fb01468e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0fa00098e0 tx=0x7f0fa00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a904ad7dc0241956 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:19.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.603+0000 7f0fa7fff700 1 -- 172.21.15.111:0/3493825753 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa000b640 con 0x7f0fb0144500 2024-04-25T02:28:19.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.603+0000 7f0fa7fff700 1 -- 172.21.15.111:0/3493825753 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa000b7a0 con 0x7f0fb0144500 2024-04-25T02:28:19.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.603+0000 7f0fa7fff700 1 -- 172.21.15.111:0/3493825753 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa000bb40 con 0x7f0fb0144500 2024-04-25T02:28:19.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.604+0000 7f0fb77bb700 1 -- 172.21.15.111:0/3493825753 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0fb0144500 msgr2=0x7f0fb01468e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:19.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.604+0000 7f0fb77bb700 1 --2- 172.21.15.111:0/3493825753 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0fb0144500 0x7f0fb01468e0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f0fa00098e0 tx=0x7f0fa00091a0 comp rx=0 tx=0).stop 2024-04-25T02:28:19.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.604+0000 7f0fb77bb700 1 -- 172.21.15.111:0/3493825753 shutdown_connections 2024-04-25T02:28:19.610 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.604+0000 7f0fb77bb700 1 --2- 172.21.15.111:0/3493825753 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0fb0146e20 0x7f0fb0149200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:19.610 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.604+0000 7f0fb77bb700 1 --2- 172.21.15.111:0/3493825753 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0fb0144500 0x7f0fb01468e0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:19.610 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.604+0000 7f0fb77bb700 1 -- 172.21.15.111:0/3493825753 >> 172.21.15.111:0/3493825753 conn(0x7f0fb00b1cf0 msgr2=0x7f0fb00b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:19.610 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.604+0000 7f0fb77bb700 1 -- 172.21.15.111:0/3493825753 shutdown_connections 2024-04-25T02:28:19.610 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.604+0000 7f0fb77bb700 1 -- 172.21.15.111:0/3493825753 wait complete. 2024-04-25T02:28:19.610 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.605+0000 7f0fb77bb700 1 Processor -- start 2024-04-25T02:28:19.610 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.605+0000 7f0fb77bb700 1 -- start start 2024-04-25T02:28:19.612 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.605+0000 7f0fb77bb700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0fb0067b90 0x7f0fb0098580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:19.612 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.605+0000 7f0fb77bb700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0fb0144500 0x7f0fb0151bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:19.612 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.606+0000 7f0fb77bb700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0fb0146e20 0x7f0fb0152110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:19.612 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.606+0000 7f0fb77bb700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb0098ac0 con 0x7f0fb0144500 2024-04-25T02:28:19.612 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.606+0000 7f0fb77bb700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb0097300 con 0x7f0fb0146e20 2024-04-25T02:28:19.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.606+0000 7f0fb77bb700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb0098cd0 con 0x7f0fb0067b90 2024-04-25T02:28:19.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.606+0000 7f0fb5557700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0fb0067b90 0x7f0fb0098580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:19.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.606+0000 7f0fb4d56700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0fb0144500 0x7f0fb0151bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:19.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.606+0000 7f0fb4d56700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0fb0144500 0x7f0fb0151bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:48708/0 (socket says 172.21.15.111:48708) 2024-04-25T02:28:19.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.606+0000 7f0fb4d56700 1 -- 172.21.15.111:0/3220435903 learned_addr learned my addr 172.21.15.111:0/3220435903 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:28:19.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.606+0000 7f0fb5d58700 1 --2- 172.21.15.111:0/3220435903 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0fb0146e20 0x7f0fb0152110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:19.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.606+0000 7f0fb5d58700 1 -- 172.21.15.111:0/3220435903 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0fb0067b90 msgr2=0x7f0fb0098580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:19.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.606+0000 7f0fb5d58700 1 --2- 172.21.15.111:0/3220435903 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0fb0067b90 0x7f0fb0098580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:19.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.606+0000 7f0fb5d58700 1 -- 172.21.15.111:0/3220435903 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0fb0144500 msgr2=0x7f0fb0151bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:19.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.606+0000 7f0fb5d58700 1 --2- 172.21.15.111:0/3220435903 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0fb0144500 0x7f0fb0151bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:19.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.606+0000 7f0fb5d58700 1 -- 172.21.15.111:0/3220435903 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa0009420 con 0x7f0fb0146e20 2024-04-25T02:28:19.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.606+0000 7f0fb5557700 1 --2- 172.21.15.111:0/3220435903 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0fb0067b90 0x7f0fb0098580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:19.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.606+0000 7f0fb4d56700 1 --2- 172.21.15.111:0/3220435903 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0fb0144500 0x7f0fb0151bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:19.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.606+0000 7f0fb5d58700 1 --2- 172.21.15.111:0/3220435903 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0fb0146e20 0x7f0fb0152110 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0fa800ecc0 tx=0x7f0fa800b040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:19.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.606+0000 7f0fa57fa700 1 -- 172.21.15.111:0/3220435903 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa800c8c0 con 0x7f0fb0146e20 2024-04-25T02:28:19.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.606+0000 7f0fa57fa700 1 -- 172.21.15.111:0/3220435903 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa800f040 con 0x7f0fb0146e20 2024-04-25T02:28:19.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.606+0000 7f0fa57fa700 1 -- 172.21.15.111:0/3220435903 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa800cc90 con 0x7f0fb0146e20 2024-04-25T02:28:19.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.606+0000 7f0fb77bb700 1 -- 172.21.15.111:0/3220435903 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fb0097750 con 0x7f0fb0146e20 2024-04-25T02:28:19.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.606+0000 7f0fb77bb700 1 -- 172.21.15.111:0/3220435903 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fb00a1820 con 0x7f0fb0146e20 2024-04-25T02:28:19.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.607+0000 7f0fa57fa700 1 -- 172.21.15.111:0/3220435903 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f0fa8014480 con 0x7f0fb0146e20 2024-04-25T02:28:19.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.607+0000 7f0fb77bb700 1 -- 172.21.15.111:0/3220435903 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fb00b1210 con 0x7f0fb0146e20 2024-04-25T02:28:19.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.607+0000 7f0fa57fa700 1 -- 172.21.15.111:0/3220435903 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4158+0+0 (secure 0 0 0) 0x7f0fa805ba90 con 0x7f0fb0146e20 2024-04-25T02:28:19.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.611+0000 7f0fa57fa700 1 -- 172.21.15.111:0/3220435903 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f0fa8039cc0 con 0x7f0fb0146e20 2024-04-25T02:28:19.767 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.763+0000 7f0fb77bb700 1 -- 172.21.15.111:0/3220435903 --> v1:172.21.15.111:6816/46482 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0fb0146c60 con 0x7f0f94045f20 2024-04-25T02:28:19.773 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.770+0000 7f0fa57fa700 1 -- 172.21.15.111:0/3220435903 <== mgr.14107 v1:172.21.15.111:6816/46482 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278388 (unknown 2965378022 0 3258441349) 0x7f0fb0146c60 con 0x7f0f94045f20 2024-04-25T02:28:19.777 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:28:19.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.773+0000 7f0fb77bb700 1 -- 172.21.15.111:0/3220435903 >> v1:172.21.15.111:6816/46482 conn(0x7f0f94045f20 legacy=0x7f0f940483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:19.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.773+0000 7f0fb77bb700 1 -- 172.21.15.111:0/3220435903 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0fb0146e20 msgr2=0x7f0fb0152110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:19.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.773+0000 7f0fb77bb700 1 --2- 172.21.15.111:0/3220435903 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0fb0146e20 0x7f0fb0152110 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0fa800ecc0 tx=0x7f0fa800b040 comp rx=0 tx=0).stop 2024-04-25T02:28:19.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.773+0000 7f0fb77bb700 1 -- 172.21.15.111:0/3220435903 shutdown_connections 2024-04-25T02:28:19.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.773+0000 7f0fb77bb700 1 --2- 172.21.15.111:0/3220435903 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f0fb0146e20 0x7f0fb0152110 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:19.779 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.773+0000 7f0fb77bb700 1 --2- 172.21.15.111:0/3220435903 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f0fb0067b90 0x7f0fb0098580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:19.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.773+0000 7f0fb77bb700 1 --2- 172.21.15.111:0/3220435903 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f0fb0144500 0x7f0fb0151bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:19.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.773+0000 7f0fb77bb700 1 -- 172.21.15.111:0/3220435903 >> 172.21.15.111:0/3220435903 conn(0x7f0fb00b1cf0 msgr2=0x7f0fb0069160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:19.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.773+0000 7f0fb77bb700 1 -- 172.21.15.111:0/3220435903 shutdown_connections 2024-04-25T02:28:19.780 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:19.773+0000 7f0fb77bb700 1 -- 172.21.15.111:0/3220435903 wait complete. 2024-04-25T02:28:19.780 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2024-04-25T02:28:19.788 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":188,"stamp":"2024-04-25T02:28:18.802510+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129851417,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":3127,"num_read_kb":1448109,"num_write":31189,"num_write_kb":4453499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34946,"ondisk_log_size":34946,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1468944,"kb_used_data":255152,"kb_used_omap":38,"kb_used_meta":1213721,"kb_avail":376018416,"statfs":{"total":386547056640,"available":385042857984,"internally_reserved":0,"allocated":261275648,"data_stored":260364264,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39115,"internal_metadata":1242851125},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":35,"apply_latency_ms":35,"commit_latency_ns":35000000,"apply_latency_ns":35000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6827492,"num_objects":-1424,"num_object_clones":0,"num_object_copies":-2848,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1424,"num_whiteouts":0,"num_read":22,"num_read_kb":189,"num_write":1717,"num_write_kb":4386,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002493"},"pg_stats":[{"pgid":"4.3f","version":"43'402","reported_seq":474,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.364350+0000","last_change":"2024-04-25T02:23:13.846111+0000","last_active":"2024-04-25T02:28:12.364350+0000","last_peered":"2024-04-25T02:28:12.364350+0000","last_clean":"2024-04-25T02:28:12.364350+0000","last_became_active":"2024-04-25T02:23:13.845848+0000","last_became_peered":"2024-04-25T02:23:13.845848+0000","last_unstale":"2024-04-25T02:28:12.364350+0000","last_undegraded":"2024-04-25T02:28:12.364350+0000","last_fullsized":"2024-04-25T02:28:12.364350+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:48:53.653719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":15113,"num_write":370,"num_write_kb":51033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"43'436","reported_seq":520,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.362049+0000","last_change":"2024-04-25T02:23:12.845761+0000","last_active":"2024-04-25T02:28:12.362049+0000","last_peered":"2024-04-25T02:28:12.362049+0000","last_clean":"2024-04-25T02:28:12.362049+0000","last_became_active":"2024-04-25T02:23:12.845429+0000","last_became_peered":"2024-04-25T02:23:12.845429+0000","last_unstale":"2024-04-25T02:28:12.362049+0000","last_undegraded":"2024-04-25T02:28:12.362049+0000","last_fullsized":"2024-04-25T02:28:12.362049+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:39:23.193473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22592,"num_write":405,"num_write_kb":75650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"43'370","reported_seq":430,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.365156+0000","last_change":"2024-04-25T02:23:11.838311+0000","last_active":"2024-04-25T02:28:12.365156+0000","last_peered":"2024-04-25T02:28:12.365156+0000","last_clean":"2024-04-25T02:28:12.365156+0000","last_became_active":"2024-04-25T02:23:11.838054+0000","last_became_peered":"2024-04-25T02:23:11.838054+0000","last_unstale":"2024-04-25T02:28:12.365156+0000","last_undegraded":"2024-04-25T02:28:12.365156+0000","last_fullsized":"2024-04-25T02:28:12.365156+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:55:20.837592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":15817,"num_write":338,"num_write_kb":46402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"43'393","reported_seq":474,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.365982+0000","last_change":"2024-04-25T02:23:11.837015+0000","last_active":"2024-04-25T02:28:12.365982+0000","last_peered":"2024-04-25T02:28:12.365982+0000","last_clean":"2024-04-25T02:28:12.365982+0000","last_became_active":"2024-04-25T02:23:11.836681+0000","last_became_peered":"2024-04-25T02:23:11.836681+0000","last_unstale":"2024-04-25T02:28:12.365982+0000","last_undegraded":"2024-04-25T02:28:12.365982+0000","last_fullsized":"2024-04-25T02:28:12.365982+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:57:52.130438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22923,"num_write":365,"num_write_kb":51318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"43'406","reported_seq":475,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.358191+0000","last_change":"2024-04-25T02:23:13.843174+0000","last_active":"2024-04-25T02:28:12.358191+0000","last_peered":"2024-04-25T02:28:12.358191+0000","last_clean":"2024-04-25T02:28:12.358191+0000","last_became_active":"2024-04-25T02:23:13.842918+0000","last_became_peered":"2024-04-25T02:23:13.842918+0000","last_unstale":"2024-04-25T02:28:12.358191+0000","last_undegraded":"2024-04-25T02:28:12.358191+0000","last_fullsized":"2024-04-25T02:28:12.358191+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:18:04.676996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14619,"num_write":384,"num_write_kb":71611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"43'366","reported_seq":427,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.364503+0000","last_change":"2024-04-25T02:23:13.848493+0000","last_active":"2024-04-25T02:28:12.364503+0000","last_peered":"2024-04-25T02:28:12.364503+0000","last_clean":"2024-04-25T02:28:12.364503+0000","last_became_active":"2024-04-25T02:23:13.848160+0000","last_became_peered":"2024-04-25T02:23:13.848160+0000","last_unstale":"2024-04-25T02:28:12.364503+0000","last_undegraded":"2024-04-25T02:28:12.364503+0000","last_fullsized":"2024-04-25T02:28:12.364503+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:40:38.221942+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12472,"num_write":338,"num_write_kb":33864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"43'441","reported_seq":559,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.350695+0000","last_change":"2024-04-25T02:23:13.842324+0000","last_active":"2024-04-25T02:28:12.350695+0000","last_peered":"2024-04-25T02:28:12.350695+0000","last_clean":"2024-04-25T02:28:12.350695+0000","last_became_active":"2024-04-25T02:23:13.840374+0000","last_became_peered":"2024-04-25T02:23:13.840374+0000","last_unstale":"2024-04-25T02:28:12.350695+0000","last_undegraded":"2024-04-25T02:28:12.350695+0000","last_fullsized":"2024-04-25T02:28:12.350695+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:04:41.899219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":40192,"num_write":416,"num_write_kb":101787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"43'364","reported_seq":430,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.369138+0000","last_change":"2024-04-25T02:23:11.835781+0000","last_active":"2024-04-25T02:28:12.369138+0000","last_peered":"2024-04-25T02:28:12.369138+0000","last_clean":"2024-04-25T02:28:12.369138+0000","last_became_active":"2024-04-25T02:23:11.834759+0000","last_became_peered":"2024-04-25T02:23:11.834759+0000","last_unstale":"2024-04-25T02:28:12.369138+0000","last_undegraded":"2024-04-25T02:28:12.369138+0000","last_fullsized":"2024-04-25T02:28:12.369138+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:17:37.320529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18431,"num_write":330,"num_write_kb":66835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"43'425","reported_seq":514,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.356933+0000","last_change":"2024-04-25T02:23:13.842786+0000","last_active":"2024-04-25T02:28:12.356933+0000","last_peered":"2024-04-25T02:28:12.356933+0000","last_clean":"2024-04-25T02:28:12.356933+0000","last_became_active":"2024-04-25T02:23:13.841883+0000","last_became_peered":"2024-04-25T02:23:13.841883+0000","last_unstale":"2024-04-25T02:28:12.356933+0000","last_undegraded":"2024-04-25T02:28:12.356933+0000","last_fullsized":"2024-04-25T02:28:12.356933+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:13:08.256311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":29378,"num_write":387,"num_write_kb":39136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"43'396","reported_seq":469,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.361169+0000","last_change":"2024-04-25T02:23:11.836289+0000","last_active":"2024-04-25T02:28:12.361169+0000","last_peered":"2024-04-25T02:28:12.361169+0000","last_clean":"2024-04-25T02:28:12.361169+0000","last_became_active":"2024-04-25T02:23:11.835958+0000","last_became_peered":"2024-04-25T02:23:11.835958+0000","last_unstale":"2024-04-25T02:28:12.361169+0000","last_undegraded":"2024-04-25T02:28:12.361169+0000","last_fullsized":"2024-04-25T02:28:12.361169+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:56:00.639964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":25799,"num_write":352,"num_write_kb":67037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"43'354","reported_seq":393,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.359310+0000","last_change":"2024-04-25T02:23:11.836468+0000","last_active":"2024-04-25T02:28:12.359310+0000","last_peered":"2024-04-25T02:28:12.359310+0000","last_clean":"2024-04-25T02:28:12.359310+0000","last_became_active":"2024-04-25T02:23:11.836214+0000","last_became_peered":"2024-04-25T02:23:11.836214+0000","last_unstale":"2024-04-25T02:28:12.359310+0000","last_undegraded":"2024-04-25T02:28:12.359310+0000","last_fullsized":"2024-04-25T02:28:12.359310+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:55:43.874015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7176,"num_write":336,"num_write_kb":37702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"43'335","reported_seq":376,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.367704+0000","last_change":"2024-04-25T02:23:13.847944+0000","last_active":"2024-04-25T02:28:12.367704+0000","last_peered":"2024-04-25T02:28:12.367704+0000","last_clean":"2024-04-25T02:28:12.367704+0000","last_became_active":"2024-04-25T02:23:13.847446+0000","last_became_peered":"2024-04-25T02:23:13.847446+0000","last_unstale":"2024-04-25T02:28:12.367704+0000","last_undegraded":"2024-04-25T02:28:12.367704+0000","last_fullsized":"2024-04-25T02:28:12.367704+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:18:53.324436+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4160,"num_write":309,"num_write_kb":33908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"43'387","reported_seq":428,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.367104+0000","last_change":"2024-04-25T02:23:13.847825+0000","last_active":"2024-04-25T02:28:12.367104+0000","last_peered":"2024-04-25T02:28:12.367104+0000","last_clean":"2024-04-25T02:28:12.367104+0000","last_became_active":"2024-04-25T02:23:13.847009+0000","last_became_peered":"2024-04-25T02:23:13.847009+0000","last_unstale":"2024-04-25T02:28:12.367104+0000","last_undegraded":"2024-04-25T02:28:12.367104+0000","last_fullsized":"2024-04-25T02:28:12.367104+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:04:01.988527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4152,"num_write":352,"num_write_kb":42524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"43'450","reported_seq":528,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.361823+0000","last_change":"2024-04-25T02:23:12.841952+0000","last_active":"2024-04-25T02:28:12.361823+0000","last_peered":"2024-04-25T02:28:12.361823+0000","last_clean":"2024-04-25T02:28:12.361823+0000","last_became_active":"2024-04-25T02:23:12.841783+0000","last_became_peered":"2024-04-25T02:23:12.841783+0000","last_unstale":"2024-04-25T02:28:12.361823+0000","last_undegraded":"2024-04-25T02:28:12.361823+0000","last_fullsized":"2024-04-25T02:28:12.361823+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:42:53.655107+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":25198,"num_write":421,"num_write_kb":88864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"43'430","reported_seq":521,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.351328+0000","last_change":"2024-04-25T02:23:11.836069+0000","last_active":"2024-04-25T02:28:12.351328+0000","last_peered":"2024-04-25T02:28:12.351328+0000","last_clean":"2024-04-25T02:28:12.351328+0000","last_became_active":"2024-04-25T02:23:11.835815+0000","last_became_peered":"2024-04-25T02:23:11.835815+0000","last_unstale":"2024-04-25T02:28:12.351328+0000","last_undegraded":"2024-04-25T02:28:12.351328+0000","last_fullsized":"2024-04-25T02:28:12.351328+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:25:07.444694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31947,"num_write":393,"num_write_kb":64059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"43'438","reported_seq":462,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.356532+0000","last_change":"2024-04-25T02:23:55.963552+0000","last_active":"2024-04-25T02:28:12.356532+0000","last_peered":"2024-04-25T02:28:12.356532+0000","last_clean":"2024-04-25T02:28:12.356532+0000","last_became_active":"2024-04-25T02:23:55.963259+0000","last_became_peered":"2024-04-25T02:23:55.963259+0000","last_unstale":"2024-04-25T02:28:12.356532+0000","last_undegraded":"2024-04-25T02:28:12.356532+0000","last_fullsized":"2024-04-25T02:28:12.356532+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:40:16.304418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":2639,"num_write":405,"num_write_kb":51451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"43'394","reported_seq":456,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.356439+0000","last_change":"2024-04-25T02:23:13.844591+0000","last_active":"2024-04-25T02:28:12.356439+0000","last_peered":"2024-04-25T02:28:12.356439+0000","last_clean":"2024-04-25T02:28:12.356439+0000","last_became_active":"2024-04-25T02:23:13.844343+0000","last_became_peered":"2024-04-25T02:23:13.844343+0000","last_unstale":"2024-04-25T02:28:12.356439+0000","last_undegraded":"2024-04-25T02:28:12.356439+0000","last_fullsized":"2024-04-25T02:28:12.356439+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:52:55.994134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9696,"num_write":367,"num_write_kb":33966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"43'391","reported_seq":470,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.347590+0000","last_change":"2024-04-25T02:23:12.848314+0000","last_active":"2024-04-25T02:28:12.347590+0000","last_peered":"2024-04-25T02:28:12.347590+0000","last_clean":"2024-04-25T02:28:12.347590+0000","last_became_active":"2024-04-25T02:23:12.848051+0000","last_became_peered":"2024-04-25T02:23:12.848051+0000","last_unstale":"2024-04-25T02:28:12.347590+0000","last_undegraded":"2024-04-25T02:28:12.347590+0000","last_fullsized":"2024-04-25T02:28:12.347590+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:53:59.236832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":13345,"num_write":357,"num_write_kb":38441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"43'429","reported_seq":539,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.366569+0000","last_change":"2024-04-25T02:23:13.848250+0000","last_active":"2024-04-25T02:28:12.366569+0000","last_peered":"2024-04-25T02:28:12.366569+0000","last_clean":"2024-04-25T02:28:12.366569+0000","last_became_active":"2024-04-25T02:23:13.847602+0000","last_became_peered":"2024-04-25T02:23:13.847602+0000","last_unstale":"2024-04-25T02:28:12.366569+0000","last_undegraded":"2024-04-25T02:28:12.366569+0000","last_fullsized":"2024-04-25T02:28:12.366569+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:36:05.652157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":37845,"num_write":400,"num_write_kb":88566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"43'437","reported_seq":512,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.364680+0000","last_change":"2024-04-25T02:23:13.846327+0000","last_active":"2024-04-25T02:28:12.364680+0000","last_peered":"2024-04-25T02:28:12.364680+0000","last_clean":"2024-04-25T02:28:12.364680+0000","last_became_active":"2024-04-25T02:23:13.845934+0000","last_became_peered":"2024-04-25T02:23:13.845934+0000","last_unstale":"2024-04-25T02:28:12.364680+0000","last_undegraded":"2024-04-25T02:28:12.364680+0000","last_fullsized":"2024-04-25T02:28:12.364680+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:01:47.261604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":22073,"num_write":412,"num_write_kb":67090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"43'414","reported_seq":506,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.365646+0000","last_change":"2024-04-25T02:23:13.847117+0000","last_active":"2024-04-25T02:28:12.365646+0000","last_peered":"2024-04-25T02:28:12.365646+0000","last_clean":"2024-04-25T02:28:12.365646+0000","last_became_active":"2024-04-25T02:23:13.846758+0000","last_became_peered":"2024-04-25T02:23:13.846758+0000","last_unstale":"2024-04-25T02:28:12.365646+0000","last_undegraded":"2024-04-25T02:28:12.365646+0000","last_fullsized":"2024-04-25T02:28:12.365646+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:53:10.872495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":24525,"num_write":378,"num_write_kb":100342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"43'445","reported_seq":518,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.366186+0000","last_change":"2024-04-25T02:23:11.835581+0000","last_active":"2024-04-25T02:28:12.366186+0000","last_peered":"2024-04-25T02:28:12.366186+0000","last_clean":"2024-04-25T02:28:12.366186+0000","last_became_active":"2024-04-25T02:23:11.835319+0000","last_became_peered":"2024-04-25T02:23:11.835319+0000","last_unstale":"2024-04-25T02:28:12.366186+0000","last_undegraded":"2024-04-25T02:28:12.366186+0000","last_fullsized":"2024-04-25T02:28:12.366186+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:19:02.978966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":18532,"num_write":411,"num_write_kb":84101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"43'408","reported_seq":515,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.351163+0000","last_change":"2024-04-25T02:23:13.840011+0000","last_active":"2024-04-25T02:28:12.351163+0000","last_peered":"2024-04-25T02:28:12.351163+0000","last_clean":"2024-04-25T02:28:12.351163+0000","last_became_active":"2024-04-25T02:23:13.838917+0000","last_became_peered":"2024-04-25T02:23:13.838917+0000","last_unstale":"2024-04-25T02:28:12.351163+0000","last_undegraded":"2024-04-25T02:28:12.351163+0000","last_fullsized":"2024-04-25T02:28:12.351163+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:53:06.476265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":25750,"num_write":380,"num_write_kb":75795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"43'451","reported_seq":516,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.369298+0000","last_change":"2024-04-25T02:23:13.846482+0000","last_active":"2024-04-25T02:28:12.369298+0000","last_peered":"2024-04-25T02:28:12.369298+0000","last_clean":"2024-04-25T02:28:12.369298+0000","last_became_active":"2024-04-25T02:23:13.845814+0000","last_became_peered":"2024-04-25T02:23:13.845814+0000","last_unstale":"2024-04-25T02:28:12.369298+0000","last_undegraded":"2024-04-25T02:28:12.369298+0000","last_fullsized":"2024-04-25T02:28:12.369298+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:33:00.487666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13960,"num_write":428,"num_write_kb":96160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"43'397","reported_seq":449,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.363463+0000","last_change":"2024-04-25T02:23:13.852668+0000","last_active":"2024-04-25T02:28:12.363463+0000","last_peered":"2024-04-25T02:28:12.363463+0000","last_clean":"2024-04-25T02:28:12.363463+0000","last_became_active":"2024-04-25T02:23:13.852093+0000","last_became_peered":"2024-04-25T02:23:13.852093+0000","last_unstale":"2024-04-25T02:28:12.363463+0000","last_undegraded":"2024-04-25T02:28:12.363463+0000","last_fullsized":"2024-04-25T02:28:12.363463+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:26:57.422935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":3870,"num_write":383,"num_write_kb":17738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"43'485","reported_seq":566,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.363064+0000","last_change":"2024-04-25T02:23:12.841653+0000","last_active":"2024-04-25T02:28:12.363064+0000","last_peered":"2024-04-25T02:28:12.363064+0000","last_clean":"2024-04-25T02:28:12.363064+0000","last_became_active":"2024-04-25T02:23:12.841477+0000","last_became_peered":"2024-04-25T02:23:12.841477+0000","last_unstale":"2024-04-25T02:28:12.363064+0000","last_undegraded":"2024-04-25T02:28:12.363064+0000","last_fullsized":"2024-04-25T02:28:12.363064+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:16:17.108262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24645,"num_write":445,"num_write_kb":96750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"43'384","reported_seq":457,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.354470+0000","last_change":"2024-04-25T02:23:13.842553+0000","last_active":"2024-04-25T02:28:12.354470+0000","last_peered":"2024-04-25T02:28:12.354470+0000","last_clean":"2024-04-25T02:28:12.354470+0000","last_became_active":"2024-04-25T02:23:13.840422+0000","last_became_peered":"2024-04-25T02:23:13.840422+0000","last_unstale":"2024-04-25T02:28:12.354470+0000","last_undegraded":"2024-04-25T02:28:12.354470+0000","last_fullsized":"2024-04-25T02:28:12.354470+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:44:38.010033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":6130,"num_write":356,"num_write_kb":25986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"43'566","reported_seq":599,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.546717+0000","last_change":"2024-04-25T02:23:12.846241+0000","last_active":"2024-04-25T02:28:09.546717+0000","last_peered":"2024-04-25T02:28:09.546717+0000","last_clean":"2024-04-25T02:28:09.546717+0000","last_became_active":"2024-04-25T02:23:12.845923+0000","last_became_peered":"2024-04-25T02:23:12.845923+0000","last_unstale":"2024-04-25T02:28:09.546717+0000","last_undegraded":"2024-04-25T02:28:09.546717+0000","last_fullsized":"2024-04-25T02:28:09.546717+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":566,"log_dups_size":0,"ondisk_log_size":566,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:59:31.094638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":494,"num_write_kb":12610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"43'420","reported_seq":535,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.368146+0000","last_change":"2024-04-25T02:23:13.850625+0000","last_active":"2024-04-25T02:28:12.368146+0000","last_peered":"2024-04-25T02:28:12.368146+0000","last_clean":"2024-04-25T02:28:12.368146+0000","last_became_active":"2024-04-25T02:23:13.848844+0000","last_became_peered":"2024-04-25T02:23:13.848844+0000","last_unstale":"2024-04-25T02:28:12.368146+0000","last_undegraded":"2024-04-25T02:28:12.368146+0000","last_fullsized":"2024-04-25T02:28:12.368146+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:51:32.796023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":41312,"num_write":376,"num_write_kb":112833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"43'383","reported_seq":418,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.526644+0000","last_change":"2024-04-25T02:23:13.850242+0000","last_active":"2024-04-25T02:28:08.526644+0000","last_peered":"2024-04-25T02:28:08.526644+0000","last_clean":"2024-04-25T02:28:08.526644+0000","last_became_active":"2024-04-25T02:23:13.846821+0000","last_became_peered":"2024-04-25T02:23:13.846821+0000","last_unstale":"2024-04-25T02:28:08.526644+0000","last_undegraded":"2024-04-25T02:28:08.526644+0000","last_fullsized":"2024-04-25T02:28:08.526644+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:16.733579+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":334,"num_write_kb":4317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"43'428","reported_seq":521,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.365345+0000","last_change":"2024-04-25T02:23:11.840787+0000","last_active":"2024-04-25T02:28:12.365345+0000","last_peered":"2024-04-25T02:28:12.365345+0000","last_clean":"2024-04-25T02:28:12.365345+0000","last_became_active":"2024-04-25T02:23:11.840274+0000","last_became_peered":"2024-04-25T02:23:11.840274+0000","last_unstale":"2024-04-25T02:28:12.365345+0000","last_undegraded":"2024-04-25T02:28:12.365345+0000","last_fullsized":"2024-04-25T02:28:12.365345+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:26:15.381838+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":28196,"num_write":410,"num_write_kb":104265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"43'875","reported_seq":921,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.487831+0000","last_change":"2024-04-25T02:23:13.839791+0000","last_active":"2024-04-25T02:28:10.487831+0000","last_peered":"2024-04-25T02:28:10.487831+0000","last_clean":"2024-04-25T02:28:10.487831+0000","last_became_active":"2024-04-25T02:23:13.839361+0000","last_became_peered":"2024-04-25T02:23:13.839361+0000","last_unstale":"2024-04-25T02:28:10.487831+0000","last_undegraded":"2024-04-25T02:28:10.487831+0000","last_fullsized":"2024-04-25T02:28:10.487831+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":875,"log_dups_size":0,"ondisk_log_size":875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:48:03.634232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":809,"num_write_kb":8568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"43'365","reported_seq":443,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.353635+0000","last_change":"2024-04-25T02:23:13.844099+0000","last_active":"2024-04-25T02:28:12.353635+0000","last_peered":"2024-04-25T02:28:12.353635+0000","last_clean":"2024-04-25T02:28:12.353635+0000","last_became_active":"2024-04-25T02:23:13.843656+0000","last_became_peered":"2024-04-25T02:23:13.843656+0000","last_unstale":"2024-04-25T02:28:12.353635+0000","last_undegraded":"2024-04-25T02:28:12.353635+0000","last_fullsized":"2024-04-25T02:28:12.353635+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:18:44.036616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":25136,"num_write":341,"num_write_kb":38831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"43'56","reported_seq":95,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:06.534335+0000","last_change":"2024-04-25T02:23:13.842946+0000","last_active":"2024-04-25T02:28:06.534335+0000","last_peered":"2024-04-25T02:28:06.534335+0000","last_clean":"2024-04-25T02:28:06.534335+0000","last_became_active":"2024-04-25T02:23:13.842598+0000","last_became_peered":"2024-04-25T02:23:13.842598+0000","last_unstale":"2024-04-25T02:28:06.534335+0000","last_undegraded":"2024-04-25T02:28:06.534335+0000","last_fullsized":"2024-04-25T02:28:06.534335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:11:27.597908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"43'467","reported_seq":542,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.364553+0000","last_change":"2024-04-25T02:23:13.849957+0000","last_active":"2024-04-25T02:28:12.364553+0000","last_peered":"2024-04-25T02:28:12.364553+0000","last_clean":"2024-04-25T02:28:12.364553+0000","last_became_active":"2024-04-25T02:23:13.848675+0000","last_became_peered":"2024-04-25T02:23:13.848675+0000","last_unstale":"2024-04-25T02:28:12.364553+0000","last_undegraded":"2024-04-25T02:28:12.364553+0000","last_fullsized":"2024-04-25T02:28:12.364553+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:09:49.581897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":13580,"num_write":443,"num_write_kb":92928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"43'340","reported_seq":374,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.479090+0000","last_change":"2024-04-25T02:23:13.847353+0000","last_active":"2024-04-25T02:28:08.479090+0000","last_peered":"2024-04-25T02:28:08.479090+0000","last_clean":"2024-04-25T02:28:08.479090+0000","last_became_active":"2024-04-25T02:23:13.846764+0000","last_became_peered":"2024-04-25T02:23:13.846764+0000","last_unstale":"2024-04-25T02:28:08.479090+0000","last_undegraded":"2024-04-25T02:28:08.479090+0000","last_fullsized":"2024-04-25T02:28:08.479090+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":340,"log_dups_size":0,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:38:36.095151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":281,"num_write_kb":4273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"43'477","reported_seq":576,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.350613+0000","last_change":"2024-04-25T02:23:13.844687+0000","last_active":"2024-04-25T02:28:12.350613+0000","last_peered":"2024-04-25T02:28:12.350613+0000","last_clean":"2024-04-25T02:28:12.350613+0000","last_became_active":"2024-04-25T02:23:13.839702+0000","last_became_peered":"2024-04-25T02:23:13.839702+0000","last_unstale":"2024-04-25T02:28:12.350613+0000","last_undegraded":"2024-04-25T02:28:12.350613+0000","last_fullsized":"2024-04-25T02:28:12.350613+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:10:23.178715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":30102,"num_write":452,"num_write_kb":97286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"43'136","reported_seq":178,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.515488+0000","last_change":"2024-04-25T02:23:13.844668+0000","last_active":"2024-04-25T02:28:10.515488+0000","last_peered":"2024-04-25T02:28:10.515488+0000","last_clean":"2024-04-25T02:28:10.515488+0000","last_became_active":"2024-04-25T02:23:13.843625+0000","last_became_peered":"2024-04-25T02:23:13.843625+0000","last_unstale":"2024-04-25T02:28:10.515488+0000","last_undegraded":"2024-04-25T02:28:10.515488+0000","last_fullsized":"2024-04-25T02:28:10.515488+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:19:41.521042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":72,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"43'422","reported_seq":495,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.365115+0000","last_change":"2024-04-25T02:23:13.851184+0000","last_active":"2024-04-25T02:28:12.365115+0000","last_peered":"2024-04-25T02:28:12.365115+0000","last_clean":"2024-04-25T02:28:12.365115+0000","last_became_active":"2024-04-25T02:23:13.850845+0000","last_became_peered":"2024-04-25T02:23:13.850845+0000","last_unstale":"2024-04-25T02:28:12.365115+0000","last_undegraded":"2024-04-25T02:28:12.365115+0000","last_fullsized":"2024-04-25T02:28:12.365115+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:07:20.048534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":24672,"num_write":391,"num_write_kb":75497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"43'345","reported_seq":389,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:16.198722+0000","last_change":"2024-04-25T02:23:13.849389+0000","last_active":"2024-04-25T02:28:16.198722+0000","last_peered":"2024-04-25T02:28:16.198722+0000","last_clean":"2024-04-25T02:28:16.198722+0000","last_became_active":"2024-04-25T02:23:13.845176+0000","last_became_peered":"2024-04-25T02:23:13.845176+0000","last_unstale":"2024-04-25T02:28:16.198722+0000","last_undegraded":"2024-04-25T02:28:16.198722+0000","last_fullsized":"2024-04-25T02:28:16.198722+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:50:14.041957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10356006,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":7,"num_read_kb":10,"num_write":291,"num_write_kb":10309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"43'405","reported_seq":472,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.367658+0000","last_change":"2024-04-25T02:23:55.964120+0000","last_active":"2024-04-25T02:28:12.367658+0000","last_peered":"2024-04-25T02:28:12.367658+0000","last_clean":"2024-04-25T02:28:12.367658+0000","last_became_active":"2024-04-25T02:23:55.963655+0000","last_became_peered":"2024-04-25T02:23:55.963655+0000","last_unstale":"2024-04-25T02:28:12.367658+0000","last_undegraded":"2024-04-25T02:28:12.367658+0000","last_fullsized":"2024-04-25T02:28:12.367658+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:04:44.724602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":11609,"num_write":365,"num_write_kb":76437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"43'493","reported_seq":541,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:06.537420+0000","last_change":"2024-04-25T02:23:13.839481+0000","last_active":"2024-04-25T02:28:06.537420+0000","last_peered":"2024-04-25T02:28:06.537420+0000","last_clean":"2024-04-25T02:28:06.537420+0000","last_became_active":"2024-04-25T02:23:13.839158+0000","last_became_peered":"2024-04-25T02:23:13.839158+0000","last_unstale":"2024-04-25T02:28:06.537420+0000","last_undegraded":"2024-04-25T02:28:06.537420+0000","last_fullsized":"2024-04-25T02:28:06.537420+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:07:04.590892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":7,"num_write":435,"num_write_kb":8384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"43'409","reported_seq":488,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.353609+0000","last_change":"2024-04-25T02:23:13.843740+0000","last_active":"2024-04-25T02:28:12.353609+0000","last_peered":"2024-04-25T02:28:12.353609+0000","last_clean":"2024-04-25T02:28:12.353609+0000","last_became_active":"2024-04-25T02:23:13.843441+0000","last_became_peered":"2024-04-25T02:23:13.843441+0000","last_unstale":"2024-04-25T02:28:12.353609+0000","last_undegraded":"2024-04-25T02:28:12.353609+0000","last_fullsized":"2024-04-25T02:28:12.353609+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:53:20.763788+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":25550,"num_write":379,"num_write_kb":104949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"43'51","reported_seq":89,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.480443+0000","last_change":"2024-04-25T02:23:13.844290+0000","last_active":"2024-04-25T02:28:08.480443+0000","last_peered":"2024-04-25T02:28:08.480443+0000","last_clean":"2024-04-25T02:28:08.480443+0000","last_became_active":"2024-04-25T02:23:13.841976+0000","last_became_peered":"2024-04-25T02:23:13.841976+0000","last_unstale":"2024-04-25T02:28:08.480443+0000","last_undegraded":"2024-04-25T02:28:08.480443+0000","last_fullsized":"2024-04-25T02:28:08.480443+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:16:25.998330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"43'407","reported_seq":492,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.354334+0000","last_change":"2024-04-25T02:23:13.843455+0000","last_active":"2024-04-25T02:28:12.354334+0000","last_peered":"2024-04-25T02:28:12.354334+0000","last_clean":"2024-04-25T02:28:12.354334+0000","last_became_active":"2024-04-25T02:23:13.842163+0000","last_became_peered":"2024-04-25T02:23:13.842163+0000","last_unstale":"2024-04-25T02:28:12.354334+0000","last_undegraded":"2024-04-25T02:28:12.354334+0000","last_fullsized":"2024-04-25T02:28:12.354334+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:59:59.924648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":18209,"num_write":378,"num_write_kb":67140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"43'57","reported_seq":96,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:06.534681+0000","last_change":"2024-04-25T02:23:13.839221+0000","last_active":"2024-04-25T02:28:06.534681+0000","last_peered":"2024-04-25T02:28:06.534681+0000","last_clean":"2024-04-25T02:28:06.534681+0000","last_became_active":"2024-04-25T02:23:13.838616+0000","last_became_peered":"2024-04-25T02:23:13.838616+0000","last_unstale":"2024-04-25T02:28:06.534681+0000","last_undegraded":"2024-04-25T02:28:06.534681+0000","last_fullsized":"2024-04-25T02:28:06.534681+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:24:48.817920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"43'445","reported_seq":564,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.358374+0000","last_change":"2024-04-25T02:23:13.842908+0000","last_active":"2024-04-25T02:28:12.358374+0000","last_peered":"2024-04-25T02:28:12.358374+0000","last_clean":"2024-04-25T02:28:12.358374+0000","last_became_active":"2024-04-25T02:23:13.842649+0000","last_became_peered":"2024-04-25T02:23:13.842649+0000","last_unstale":"2024-04-25T02:28:12.358374+0000","last_undegraded":"2024-04-25T02:28:12.358374+0000","last_fullsized":"2024-04-25T02:28:12.358374+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:04:07.758366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":37870,"num_write":411,"num_write_kb":80233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"43'63","reported_seq":100,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.492174+0000","last_change":"2024-04-25T02:23:11.835951+0000","last_active":"2024-04-25T02:28:08.492174+0000","last_peered":"2024-04-25T02:28:08.492174+0000","last_clean":"2024-04-25T02:28:08.492174+0000","last_became_active":"2024-04-25T02:23:11.835077+0000","last_became_peered":"2024-04-25T02:23:11.835077+0000","last_unstale":"2024-04-25T02:28:08.492174+0000","last_undegraded":"2024-04-25T02:28:08.492174+0000","last_fullsized":"2024-04-25T02:28:08.492174+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:24:42.651723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"43'390","reported_seq":520,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.353763+0000","last_change":"2024-04-25T02:23:13.843899+0000","last_active":"2024-04-25T02:28:12.353763+0000","last_peered":"2024-04-25T02:28:12.353763+0000","last_clean":"2024-04-25T02:28:12.353763+0000","last_became_active":"2024-04-25T02:23:13.843347+0000","last_became_peered":"2024-04-25T02:23:13.843347+0000","last_unstale":"2024-04-25T02:28:12.353763+0000","last_undegraded":"2024-04-25T02:28:12.353763+0000","last_fullsized":"2024-04-25T02:28:12.353763+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:46:23.518991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":42863,"num_write":360,"num_write_kb":59443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"43'199","reported_seq":236,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.531368+0000","last_change":"2024-04-25T02:23:11.839659+0000","last_active":"2024-04-25T02:28:09.531368+0000","last_peered":"2024-04-25T02:28:09.531368+0000","last_clean":"2024-04-25T02:28:09.531368+0000","last_became_active":"2024-04-25T02:23:11.839157+0000","last_became_peered":"2024-04-25T02:23:11.839157+0000","last_unstale":"2024-04-25T02:28:09.531368+0000","last_undegraded":"2024-04-25T02:28:09.531368+0000","last_fullsized":"2024-04-25T02:28:09.531368+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:06:42.930490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":142,"num_write_kb":4183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"43'404","reported_seq":470,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.368101+0000","last_change":"2024-04-25T02:23:13.841226+0000","last_active":"2024-04-25T02:28:12.368101+0000","last_peered":"2024-04-25T02:28:12.368101+0000","last_clean":"2024-04-25T02:28:12.368101+0000","last_became_active":"2024-04-25T02:23:13.840951+0000","last_became_peered":"2024-04-25T02:23:13.840951+0000","last_unstale":"2024-04-25T02:28:12.368101+0000","last_undegraded":"2024-04-25T02:28:12.368101+0000","last_fullsized":"2024-04-25T02:28:12.368101+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:16:58.212703+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12931,"num_write":370,"num_write_kb":42530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"43'366","reported_seq":410,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:06.537151+0000","last_change":"2024-04-25T02:23:12.848098+0000","last_active":"2024-04-25T02:28:06.537151+0000","last_peered":"2024-04-25T02:28:06.537151+0000","last_clean":"2024-04-25T02:28:06.537151+0000","last_became_active":"2024-04-25T02:23:12.847813+0000","last_became_peered":"2024-04-25T02:23:12.847813+0000","last_unstale":"2024-04-25T02:28:06.537151+0000","last_undegraded":"2024-04-25T02:28:06.537151+0000","last_fullsized":"2024-04-25T02:28:06.537151+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:31:10.538399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":311,"num_write_kb":4273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"43'442","reported_seq":491,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.343940+0000","last_change":"2024-04-25T02:23:55.963573+0000","last_active":"2024-04-25T02:28:12.343940+0000","last_peered":"2024-04-25T02:28:12.343940+0000","last_clean":"2024-04-25T02:28:12.343940+0000","last_became_active":"2024-04-25T02:23:55.963234+0000","last_became_peered":"2024-04-25T02:23:55.963234+0000","last_unstale":"2024-04-25T02:28:12.343940+0000","last_undegraded":"2024-04-25T02:28:12.343940+0000","last_fullsized":"2024-04-25T02:28:12.343940+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:52:59.926648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21039,"num_write":415,"num_write_kb":62968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"43'594","reported_seq":637,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.538648+0000","last_change":"2024-04-25T02:23:13.848143+0000","last_active":"2024-04-25T02:28:08.538648+0000","last_peered":"2024-04-25T02:28:08.538648+0000","last_clean":"2024-04-25T02:28:08.538648+0000","last_became_active":"2024-04-25T02:23:13.843704+0000","last_became_peered":"2024-04-25T02:23:13.843704+0000","last_unstale":"2024-04-25T02:28:08.538648+0000","last_undegraded":"2024-04-25T02:28:08.538648+0000","last_fullsized":"2024-04-25T02:28:08.538648+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:54:31.975503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":532,"num_write_kb":4350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"43'411","reported_seq":496,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.367382+0000","last_change":"2024-04-25T02:23:13.847842+0000","last_active":"2024-04-25T02:28:12.367382+0000","last_peered":"2024-04-25T02:28:12.367382+0000","last_clean":"2024-04-25T02:28:12.367382+0000","last_became_active":"2024-04-25T02:23:13.845782+0000","last_became_peered":"2024-04-25T02:23:13.845782+0000","last_unstale":"2024-04-25T02:28:12.367382+0000","last_undegraded":"2024-04-25T02:28:12.367382+0000","last_fullsized":"2024-04-25T02:28:12.367382+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:56:46.820624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":24562,"num_write":375,"num_write_kb":59351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"43'59","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.490375+0000","last_change":"2024-04-25T02:23:13.842426+0000","last_active":"2024-04-25T02:28:09.490375+0000","last_peered":"2024-04-25T02:28:09.490375+0000","last_clean":"2024-04-25T02:28:09.490375+0000","last_became_active":"2024-04-25T02:23:13.841815+0000","last_became_peered":"2024-04-25T02:23:13.841815+0000","last_unstale":"2024-04-25T02:28:09.490375+0000","last_undegraded":"2024-04-25T02:28:09.490375+0000","last_fullsized":"2024-04-25T02:28:09.490375+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:20:54.760986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"43'457","reported_seq":573,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.366271+0000","last_change":"2024-04-25T02:23:11.839840+0000","last_active":"2024-04-25T02:28:12.366271+0000","last_peered":"2024-04-25T02:28:12.366271+0000","last_clean":"2024-04-25T02:28:12.366271+0000","last_became_active":"2024-04-25T02:23:11.837258+0000","last_became_peered":"2024-04-25T02:23:11.837258+0000","last_unstale":"2024-04-25T02:28:12.366271+0000","last_undegraded":"2024-04-25T02:28:12.366271+0000","last_fullsized":"2024-04-25T02:28:12.366271+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:49:17.616748+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":40530,"num_write":421,"num_write_kb":133096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"43'128","reported_seq":175,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.513945+0000","last_change":"2024-04-25T02:23:13.838948+0000","last_active":"2024-04-25T02:28:08.513945+0000","last_peered":"2024-04-25T02:28:08.513945+0000","last_clean":"2024-04-25T02:28:08.513945+0000","last_became_active":"2024-04-25T02:23:13.838665+0000","last_became_peered":"2024-04-25T02:23:13.838665+0000","last_unstale":"2024-04-25T02:28:08.513945+0000","last_undegraded":"2024-04-25T02:28:08.513945+0000","last_fullsized":"2024-04-25T02:28:08.513945+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:29:28.670027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":66,"num_write_kb":8229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"43'438","reported_seq":515,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.346657+0000","last_change":"2024-04-25T02:23:55.963989+0000","last_active":"2024-04-25T02:28:12.346657+0000","last_peered":"2024-04-25T02:28:12.346657+0000","last_clean":"2024-04-25T02:28:12.346657+0000","last_became_active":"2024-04-25T02:23:55.963557+0000","last_became_peered":"2024-04-25T02:23:55.963557+0000","last_unstale":"2024-04-25T02:28:12.346657+0000","last_undegraded":"2024-04-25T02:28:12.346657+0000","last_fullsized":"2024-04-25T02:28:12.346657+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:01:58.293756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":25759,"num_write":403,"num_write_kb":59138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"43'254","reported_seq":296,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.515045+0000","last_change":"2024-04-25T02:23:13.843937+0000","last_active":"2024-04-25T02:28:08.515045+0000","last_peered":"2024-04-25T02:28:08.515045+0000","last_clean":"2024-04-25T02:28:08.515045+0000","last_became_active":"2024-04-25T02:23:13.843652+0000","last_became_peered":"2024-04-25T02:23:13.843652+0000","last_unstale":"2024-04-25T02:28:08.515045+0000","last_undegraded":"2024-04-25T02:28:08.515045+0000","last_fullsized":"2024-04-25T02:28:08.515045+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:13:15.374851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":4213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"43'389","reported_seq":422,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.367510+0000","last_change":"2024-04-25T02:23:56.302316+0000","last_active":"2024-04-25T02:28:12.367510+0000","last_peered":"2024-04-25T02:28:12.367510+0000","last_clean":"2024-04-25T02:28:12.367510+0000","last_became_active":"2024-04-25T02:23:56.301997+0000","last_became_peered":"2024-04-25T02:23:56.301997+0000","last_unstale":"2024-04-25T02:28:12.367510+0000","last_undegraded":"2024-04-25T02:28:12.367510+0000","last_fullsized":"2024-04-25T02:28:12.367510+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:39:22.081330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13585,"num_write":362,"num_write_kb":34032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"43'63","reported_seq":102,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.513793+0000","last_change":"2024-04-25T02:23:13.842533+0000","last_active":"2024-04-25T02:28:08.513793+0000","last_peered":"2024-04-25T02:28:08.513793+0000","last_clean":"2024-04-25T02:28:08.513793+0000","last_became_active":"2024-04-25T02:23:13.841049+0000","last_became_peered":"2024-04-25T02:23:13.841049+0000","last_unstale":"2024-04-25T02:28:08.513793+0000","last_undegraded":"2024-04-25T02:28:08.513793+0000","last_fullsized":"2024-04-25T02:28:08.513793+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:26:00.892546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"43'360","reported_seq":422,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.367318+0000","last_change":"2024-04-25T02:23:13.847171+0000","last_active":"2024-04-25T02:28:12.367318+0000","last_peered":"2024-04-25T02:28:12.367318+0000","last_clean":"2024-04-25T02:28:12.367318+0000","last_became_active":"2024-04-25T02:23:13.846425+0000","last_became_peered":"2024-04-25T02:23:13.846425+0000","last_unstale":"2024-04-25T02:28:12.367318+0000","last_undegraded":"2024-04-25T02:28:12.367318+0000","last_fullsized":"2024-04-25T02:28:12.367318+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:40:12.956129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":12898,"num_write":328,"num_write_kb":42412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"43'565","reported_seq":607,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.489808+0000","last_change":"2024-04-25T02:23:13.841178+0000","last_active":"2024-04-25T02:28:08.489808+0000","last_peered":"2024-04-25T02:28:08.489808+0000","last_clean":"2024-04-25T02:28:08.489808+0000","last_became_active":"2024-04-25T02:23:13.840876+0000","last_became_peered":"2024-04-25T02:23:13.840876+0000","last_unstale":"2024-04-25T02:28:08.489808+0000","last_undegraded":"2024-04-25T02:28:08.489808+0000","last_fullsized":"2024-04-25T02:28:08.489808+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:29:47.026682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":506,"num_write_kb":4331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"43'387","reported_seq":464,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.365037+0000","last_change":"2024-04-25T02:23:13.852754+0000","last_active":"2024-04-25T02:28:12.365037+0000","last_peered":"2024-04-25T02:28:12.365037+0000","last_clean":"2024-04-25T02:28:12.365037+0000","last_became_active":"2024-04-25T02:23:13.852398+0000","last_became_peered":"2024-04-25T02:23:13.852398+0000","last_unstale":"2024-04-25T02:28:12.365037+0000","last_undegraded":"2024-04-25T02:28:12.365037+0000","last_fullsized":"2024-04-25T02:28:12.365037+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:48:40.857184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":28255,"num_write":354,"num_write_kb":58406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":32,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T02:23:56.300797+0000","last_change":"2024-04-25T02:23:11.834419+0000","last_active":"2024-04-25T02:23:56.300797+0000","last_peered":"2024-04-25T02:23:56.300797+0000","last_clean":"2024-04-25T02:23:56.300797+0000","last_became_active":"2024-04-25T02:23:11.834171+0000","last_became_peered":"2024-04-25T02:23:11.834171+0000","last_unstale":"2024-04-25T02:23:56.300797+0000","last_undegraded":"2024-04-25T02:23:56.300797+0000","last_fullsized":"2024-04-25T02:23:56.300797+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:13:40.419554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"43'431","reported_seq":466,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.550365+0000","last_change":"2024-04-25T02:23:13.848449+0000","last_active":"2024-04-25T02:28:09.550365+0000","last_peered":"2024-04-25T02:28:09.550365+0000","last_clean":"2024-04-25T02:28:09.550365+0000","last_became_active":"2024-04-25T02:23:13.847970+0000","last_became_peered":"2024-04-25T02:23:13.847970+0000","last_unstale":"2024-04-25T02:28:09.550365+0000","last_undegraded":"2024-04-25T02:28:09.550365+0000","last_fullsized":"2024-04-25T02:28:09.550365+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":431,"log_dups_size":0,"ondisk_log_size":431,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:00:21.733260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":371,"num_write_kb":4349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"43'357","reported_seq":409,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.364606+0000","last_change":"2024-04-25T02:23:13.850097+0000","last_active":"2024-04-25T02:28:12.364606+0000","last_peered":"2024-04-25T02:28:12.364606+0000","last_clean":"2024-04-25T02:28:12.364606+0000","last_became_active":"2024-04-25T02:23:13.849556+0000","last_became_peered":"2024-04-25T02:23:13.849556+0000","last_unstale":"2024-04-25T02:28:12.364606+0000","last_undegraded":"2024-04-25T02:28:12.364606+0000","last_fullsized":"2024-04-25T02:28:12.364606+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:25:42.876612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8777,"num_write":323,"num_write_kb":25948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T02:23:55.954130+0000","last_change":"2024-04-25T02:23:13.848430+0000","last_active":"2024-04-25T02:23:55.954130+0000","last_peered":"2024-04-25T02:23:55.954130+0000","last_clean":"2024-04-25T02:23:55.954130+0000","last_became_active":"2024-04-25T02:23:13.847888+0000","last_became_peered":"2024-04-25T02:23:13.847888+0000","last_unstale":"2024-04-25T02:23:55.954130+0000","last_undegraded":"2024-04-25T02:23:55.954130+0000","last_fullsized":"2024-04-25T02:23:55.954130+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:57:11.831417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"43'70","reported_seq":111,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.500879+0000","last_change":"2024-04-25T02:23:12.848598+0000","last_active":"2024-04-25T02:28:10.500879+0000","last_peered":"2024-04-25T02:28:10.500879+0000","last_clean":"2024-04-25T02:28:10.500879+0000","last_became_active":"2024-04-25T02:23:12.848312+0000","last_became_peered":"2024-04-25T02:23:12.848312+0000","last_unstale":"2024-04-25T02:28:10.500879+0000","last_undegraded":"2024-04-25T02:28:10.500879+0000","last_fullsized":"2024-04-25T02:28:10.500879+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:58:41.830406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"43'385","reported_seq":466,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.360333+0000","last_change":"2024-04-25T02:23:12.842182+0000","last_active":"2024-04-25T02:28:12.360333+0000","last_peered":"2024-04-25T02:28:12.360333+0000","last_clean":"2024-04-25T02:28:12.360333+0000","last_became_active":"2024-04-25T02:23:12.841408+0000","last_became_peered":"2024-04-25T02:23:12.841408+0000","last_unstale":"2024-04-25T02:28:12.360333+0000","last_undegraded":"2024-04-25T02:28:12.360333+0000","last_fullsized":"2024-04-25T02:28:12.360333+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:06:31.558059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":27937,"num_write":348,"num_write_kb":51359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":33,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T02:23:55.955840+0000","last_change":"2024-04-25T02:23:13.848743+0000","last_active":"2024-04-25T02:23:55.955840+0000","last_peered":"2024-04-25T02:23:55.955840+0000","last_clean":"2024-04-25T02:23:55.955840+0000","last_became_active":"2024-04-25T02:23:13.848076+0000","last_became_peered":"2024-04-25T02:23:13.848076+0000","last_unstale":"2024-04-25T02:23:55.955840+0000","last_undegraded":"2024-04-25T02:23:55.955840+0000","last_fullsized":"2024-04-25T02:23:55.955840+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:08:43.341421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"43'394","reported_seq":428,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:07.507384+0000","last_change":"2024-04-25T02:23:12.848506+0000","last_active":"2024-04-25T02:28:07.507384+0000","last_peered":"2024-04-25T02:28:07.507384+0000","last_clean":"2024-04-25T02:28:07.507384+0000","last_became_active":"2024-04-25T02:23:12.848229+0000","last_became_peered":"2024-04-25T02:23:12.848229+0000","last_unstale":"2024-04-25T02:28:07.507384+0000","last_undegraded":"2024-04-25T02:28:07.507384+0000","last_fullsized":"2024-04-25T02:28:07.507384+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:24:34.129737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":337,"num_write_kb":8338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"43'349","reported_seq":399,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.357324+0000","last_change":"2024-04-25T02:23:11.835239+0000","last_active":"2024-04-25T02:28:12.357324+0000","last_peered":"2024-04-25T02:28:12.357324+0000","last_clean":"2024-04-25T02:28:12.357324+0000","last_became_active":"2024-04-25T02:23:11.834994+0000","last_became_peered":"2024-04-25T02:23:11.834994+0000","last_unstale":"2024-04-25T02:28:12.357324+0000","last_undegraded":"2024-04-25T02:28:12.357324+0000","last_fullsized":"2024-04-25T02:28:12.357324+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:15:51.196318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":11931,"num_write":325,"num_write_kb":25986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":42,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T02:23:55.951912+0000","last_change":"2024-04-25T02:23:13.849321+0000","last_active":"2024-04-25T02:23:55.951912+0000","last_peered":"2024-04-25T02:23:55.951912+0000","last_clean":"2024-04-25T02:23:55.951912+0000","last_became_active":"2024-04-25T02:23:13.848628+0000","last_became_peered":"2024-04-25T02:23:13.848628+0000","last_unstale":"2024-04-25T02:23:55.951912+0000","last_undegraded":"2024-04-25T02:23:55.951912+0000","last_fullsized":"2024-04-25T02:23:55.951912+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:46:12.919462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"22'115","reported_seq":192,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T02:23:56.300317+0000","last_change":"2024-04-25T02:23:11.836134+0000","last_active":"2024-04-25T02:23:56.300317+0000","last_peered":"2024-04-25T02:23:56.300317+0000","last_clean":"2024-04-25T02:23:56.300317+0000","last_became_active":"2024-04-25T02:23:11.835430+0000","last_became_peered":"2024-04-25T02:23:11.835430+0000","last_unstale":"2024-04-25T02:23:56.300317+0000","last_undegraded":"2024-04-25T02:23:56.300317+0000","last_fullsized":"2024-04-25T02:23:56.300317+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:08.432182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:08.432182+0000","last_clean_scrub_stamp":"2024-04-25T02:20:08.432182+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:45:18.572525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"43'573","reported_seq":612,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:06.518918+0000","last_change":"2024-04-25T02:23:13.848149+0000","last_active":"2024-04-25T02:28:06.518918+0000","last_peered":"2024-04-25T02:28:06.518918+0000","last_clean":"2024-04-25T02:28:06.518918+0000","last_became_active":"2024-04-25T02:23:13.845029+0000","last_became_peered":"2024-04-25T02:23:13.845029+0000","last_unstale":"2024-04-25T02:28:06.518918+0000","last_undegraded":"2024-04-25T02:28:06.518918+0000","last_fullsized":"2024-04-25T02:28:06.518918+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":573,"log_dups_size":0,"ondisk_log_size":573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:57:17.775866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":507,"num_write_kb":8447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"43'449","reported_seq":560,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.367766+0000","last_change":"2024-04-25T02:23:13.848481+0000","last_active":"2024-04-25T02:28:12.367766+0000","last_peered":"2024-04-25T02:28:12.367766+0000","last_clean":"2024-04-25T02:28:12.367766+0000","last_became_active":"2024-04-25T02:23:13.844018+0000","last_became_peered":"2024-04-25T02:23:13.844018+0000","last_unstale":"2024-04-25T02:28:12.367766+0000","last_undegraded":"2024-04-25T02:28:12.367766+0000","last_fullsized":"2024-04-25T02:28:12.367766+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:28:48.151869+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":31679,"num_write":414,"num_write_kb":80533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":45,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T02:23:55.950509+0000","last_change":"2024-04-25T02:23:13.848526+0000","last_active":"2024-04-25T02:23:55.950509+0000","last_peered":"2024-04-25T02:23:55.950509+0000","last_clean":"2024-04-25T02:23:55.950509+0000","last_became_active":"2024-04-25T02:23:13.844753+0000","last_became_peered":"2024-04-25T02:23:13.844753+0000","last_unstale":"2024-04-25T02:23:55.950509+0000","last_undegraded":"2024-04-25T02:23:55.950509+0000","last_fullsized":"2024-04-25T02:23:55.950509+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:01:01.038928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"43'252","reported_seq":474,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.479947+0000","last_change":"2024-04-25T02:23:12.845945+0000","last_active":"2024-04-25T02:28:12.479947+0000","last_peered":"2024-04-25T02:28:12.479947+0000","last_clean":"2024-04-25T02:28:12.479947+0000","last_became_active":"2024-04-25T02:23:12.845638+0000","last_became_peered":"2024-04-25T02:23:12.845638+0000","last_unstale":"2024-04-25T02:28:12.479947+0000","last_undegraded":"2024-04-25T02:28:12.479947+0000","last_fullsized":"2024-04-25T02:28:12.479947+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:47:37.213557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1460763,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":182,"num_read_kb":1548,"num_write":182,"num_write_kb":1548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"43'454","reported_seq":572,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.366366+0000","last_change":"2024-04-25T02:23:11.840630+0000","last_active":"2024-04-25T02:28:12.366366+0000","last_peered":"2024-04-25T02:28:12.366366+0000","last_clean":"2024-04-25T02:28:12.366366+0000","last_became_active":"2024-04-25T02:23:11.840215+0000","last_became_peered":"2024-04-25T02:23:11.840215+0000","last_unstale":"2024-04-25T02:28:12.366366+0000","last_undegraded":"2024-04-25T02:28:12.366366+0000","last_fullsized":"2024-04-25T02:28:12.366366+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:18:40.221229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":42224,"num_write":426,"num_write_kb":96444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T02:23:55.953079+0000","last_change":"2024-04-25T02:23:13.845169+0000","last_active":"2024-04-25T02:23:55.953079+0000","last_peered":"2024-04-25T02:23:55.953079+0000","last_clean":"2024-04-25T02:23:55.953079+0000","last_became_active":"2024-04-25T02:23:13.841324+0000","last_became_peered":"2024-04-25T02:23:13.841324+0000","last_unstale":"2024-04-25T02:23:55.953079+0000","last_undegraded":"2024-04-25T02:23:55.953079+0000","last_fullsized":"2024-04-25T02:23:55.953079+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:23.490432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"43'53","reported_seq":85,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.547848+0000","last_change":"2024-04-25T02:23:12.842493+0000","last_active":"2024-04-25T02:28:09.547848+0000","last_peered":"2024-04-25T02:28:09.547848+0000","last_clean":"2024-04-25T02:28:09.547848+0000","last_became_active":"2024-04-25T02:23:12.841930+0000","last_became_peered":"2024-04-25T02:23:12.841930+0000","last_unstale":"2024-04-25T02:28:09.547848+0000","last_undegraded":"2024-04-25T02:28:09.547848+0000","last_fullsized":"2024-04-25T02:28:09.547848+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:36:52.589994+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"43'427","reported_seq":585,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.347197+0000","last_change":"2024-04-25T02:23:12.848221+0000","last_active":"2024-04-25T02:28:12.347197+0000","last_peered":"2024-04-25T02:28:12.347197+0000","last_clean":"2024-04-25T02:28:12.347197+0000","last_became_active":"2024-04-25T02:23:12.847949+0000","last_became_peered":"2024-04-25T02:23:12.847949+0000","last_unstale":"2024-04-25T02:28:12.347197+0000","last_undegraded":"2024-04-25T02:28:12.347197+0000","last_fullsized":"2024-04-25T02:28:12.347197+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:56:17.728665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":62452,"num_write":394,"num_write_kb":105065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"43'65","reported_seq":108,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.539979+0000","last_change":"2024-04-25T02:23:13.844968+0000","last_active":"2024-04-25T02:28:09.539979+0000","last_peered":"2024-04-25T02:28:09.539979+0000","last_clean":"2024-04-25T02:28:09.539979+0000","last_became_active":"2024-04-25T02:23:13.844133+0000","last_became_peered":"2024-04-25T02:23:13.844133+0000","last_unstale":"2024-04-25T02:28:09.539979+0000","last_undegraded":"2024-04-25T02:28:09.539979+0000","last_fullsized":"2024-04-25T02:28:09.539979+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:09:02.533959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":32,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T02:23:56.301608+0000","last_change":"2024-04-25T02:23:11.837086+0000","last_active":"2024-04-25T02:23:56.301608+0000","last_peered":"2024-04-25T02:23:56.301608+0000","last_clean":"2024-04-25T02:23:56.301608+0000","last_became_active":"2024-04-25T02:23:11.836737+0000","last_became_peered":"2024-04-25T02:23:11.836737+0000","last_unstale":"2024-04-25T02:23:56.301608+0000","last_undegraded":"2024-04-25T02:23:56.301608+0000","last_fullsized":"2024-04-25T02:23:56.301608+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:10:23.058045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"43'434","reported_seq":566,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.367949+0000","last_change":"2024-04-25T02:23:13.848280+0000","last_active":"2024-04-25T02:28:12.367949+0000","last_peered":"2024-04-25T02:28:12.367949+0000","last_clean":"2024-04-25T02:28:12.367949+0000","last_became_active":"2024-04-25T02:23:13.843915+0000","last_became_peered":"2024-04-25T02:23:13.843915+0000","last_unstale":"2024-04-25T02:28:12.367949+0000","last_undegraded":"2024-04-25T02:28:12.367949+0000","last_fullsized":"2024-04-25T02:28:12.367949+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:25:56.800969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":48451,"num_write":406,"num_write_kb":112597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":49,"reported_epoch":42,"state":"active+clean","last_fresh":"2024-04-25T02:23:55.954435+0000","last_change":"2024-04-25T02:23:13.839018+0000","last_active":"2024-04-25T02:23:55.954435+0000","last_peered":"2024-04-25T02:23:55.954435+0000","last_clean":"2024-04-25T02:23:55.954435+0000","last_became_active":"2024-04-25T02:23:13.838746+0000","last_became_peered":"2024-04-25T02:23:13.838746+0000","last_unstale":"2024-04-25T02:23:55.954435+0000","last_undegraded":"2024-04-25T02:23:55.954435+0000","last_fullsized":"2024-04-25T02:23:55.954435+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:33:00.283023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"43'85","reported_seq":124,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.494558+0000","last_change":"2024-04-25T02:23:11.840837+0000","last_active":"2024-04-25T02:28:10.494558+0000","last_peered":"2024-04-25T02:28:10.494558+0000","last_clean":"2024-04-25T02:28:10.494558+0000","last_became_active":"2024-04-25T02:23:11.840553+0000","last_became_peered":"2024-04-25T02:23:11.840553+0000","last_unstale":"2024-04-25T02:28:10.494558+0000","last_undegraded":"2024-04-25T02:28:10.494558+0000","last_fullsized":"2024-04-25T02:28:10.494558+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:56:05.056497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":72,"num_write_kb":962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"43'397","reported_seq":484,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.366569+0000","last_change":"2024-04-25T02:23:13.848907+0000","last_active":"2024-04-25T02:28:12.366569+0000","last_peered":"2024-04-25T02:28:12.366569+0000","last_clean":"2024-04-25T02:28:12.366569+0000","last_became_active":"2024-04-25T02:23:13.848374+0000","last_became_peered":"2024-04-25T02:23:13.848374+0000","last_unstale":"2024-04-25T02:28:12.366569+0000","last_undegraded":"2024-04-25T02:28:12.366569+0000","last_fullsized":"2024-04-25T02:28:12.366569+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:31:18.538296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":25341,"num_write":367,"num_write_kb":104771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"43'122","reported_seq":163,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:07.496913+0000","last_change":"2024-04-25T02:23:13.842766+0000","last_active":"2024-04-25T02:28:07.496913+0000","last_peered":"2024-04-25T02:28:07.496913+0000","last_clean":"2024-04-25T02:28:07.496913+0000","last_became_active":"2024-04-25T02:23:13.842438+0000","last_became_peered":"2024-04-25T02:23:13.842438+0000","last_unstale":"2024-04-25T02:28:07.496913+0000","last_undegraded":"2024-04-25T02:28:07.496913+0000","last_fullsized":"2024-04-25T02:28:07.496913+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:25:58.471982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4196548,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"43'373","reported_seq":455,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.368112+0000","last_change":"2024-04-25T02:23:12.844587+0000","last_active":"2024-04-25T02:28:12.368112+0000","last_peered":"2024-04-25T02:28:12.368112+0000","last_clean":"2024-04-25T02:28:12.368112+0000","last_became_active":"2024-04-25T02:23:12.844258+0000","last_became_peered":"2024-04-25T02:23:12.844258+0000","last_unstale":"2024-04-25T02:28:12.368112+0000","last_undegraded":"2024-04-25T02:28:12.368112+0000","last_fullsized":"2024-04-25T02:28:12.368112+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:32:01.305698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":25157,"num_write":340,"num_write_kb":59328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"43'316","reported_seq":349,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.539079+0000","last_change":"2024-04-25T02:23:11.833629+0000","last_active":"2024-04-25T02:28:08.539079+0000","last_peered":"2024-04-25T02:28:08.539079+0000","last_clean":"2024-04-25T02:28:08.539079+0000","last_became_active":"2024-04-25T02:23:11.833348+0000","last_became_peered":"2024-04-25T02:23:11.833348+0000","last_unstale":"2024-04-25T02:28:08.539079+0000","last_undegraded":"2024-04-25T02:28:08.539079+0000","last_fullsized":"2024-04-25T02:28:08.539079+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:10:06.587875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":262,"num_write_kb":4264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"43'371","reported_seq":460,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.362665+0000","last_change":"2024-04-25T02:23:55.963928+0000","last_active":"2024-04-25T02:28:12.362665+0000","last_peered":"2024-04-25T02:28:12.362665+0000","last_clean":"2024-04-25T02:28:12.362665+0000","last_became_active":"2024-04-25T02:23:55.963467+0000","last_became_peered":"2024-04-25T02:23:55.963467+0000","last_unstale":"2024-04-25T02:28:12.362665+0000","last_undegraded":"2024-04-25T02:28:12.362665+0000","last_fullsized":"2024-04-25T02:28:12.362665+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:16:59.986839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":32821,"num_write":343,"num_write_kb":62943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"43'323","reported_seq":370,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.542548+0000","last_change":"2024-04-25T02:23:13.842735+0000","last_active":"2024-04-25T02:28:08.542548+0000","last_peered":"2024-04-25T02:28:08.542548+0000","last_clean":"2024-04-25T02:28:08.542548+0000","last_became_active":"2024-04-25T02:23:13.840492+0000","last_became_peered":"2024-04-25T02:23:13.840492+0000","last_unstale":"2024-04-25T02:28:08.542548+0000","last_undegraded":"2024-04-25T02:28:08.542548+0000","last_fullsized":"2024-04-25T02:28:08.542548+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:25:52.486919+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":257,"num_write_kb":12449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"43'384","reported_seq":443,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.367223+0000","last_change":"2024-04-25T02:23:13.848028+0000","last_active":"2024-04-25T02:28:12.367223+0000","last_peered":"2024-04-25T02:28:12.367223+0000","last_clean":"2024-04-25T02:28:12.367223+0000","last_became_active":"2024-04-25T02:23:13.847264+0000","last_became_peered":"2024-04-25T02:23:13.847264+0000","last_unstale":"2024-04-25T02:28:12.367223+0000","last_undegraded":"2024-04-25T02:28:12.367223+0000","last_fullsized":"2024-04-25T02:28:12.367223+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:41:16.329989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":15655,"num_write":352,"num_write_kb":42131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"43'93","reported_seq":132,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.520240+0000","last_change":"2024-04-25T02:23:13.848227+0000","last_active":"2024-04-25T02:28:09.520240+0000","last_peered":"2024-04-25T02:28:09.520240+0000","last_clean":"2024-04-25T02:28:09.520240+0000","last_became_active":"2024-04-25T02:23:13.845143+0000","last_became_peered":"2024-04-25T02:23:13.845143+0000","last_unstale":"2024-04-25T02:28:09.520240+0000","last_undegraded":"2024-04-25T02:28:09.520240+0000","last_fullsized":"2024-04-25T02:28:09.520240+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:34:54.494068+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":4121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"43'427","reported_seq":461,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.348765+0000","last_change":"2024-04-25T02:23:55.957176+0000","last_active":"2024-04-25T02:28:12.348765+0000","last_peered":"2024-04-25T02:28:12.348765+0000","last_clean":"2024-04-25T02:28:12.348765+0000","last_became_active":"2024-04-25T02:23:55.956828+0000","last_became_peered":"2024-04-25T02:23:55.956828+0000","last_unstale":"2024-04-25T02:28:12.348765+0000","last_undegraded":"2024-04-25T02:28:12.348765+0000","last_fullsized":"2024-04-25T02:28:12.348765+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:36:31.942552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":14079,"num_write":394,"num_write_kb":87521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"43'111","reported_seq":146,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.475749+0000","last_change":"2024-04-25T02:23:11.839479+0000","last_active":"2024-04-25T02:28:09.475749+0000","last_peered":"2024-04-25T02:28:09.475749+0000","last_clean":"2024-04-25T02:28:09.475749+0000","last_became_active":"2024-04-25T02:23:11.838807+0000","last_became_peered":"2024-04-25T02:23:11.838807+0000","last_unstale":"2024-04-25T02:28:09.475749+0000","last_undegraded":"2024-04-25T02:28:09.475749+0000","last_fullsized":"2024-04-25T02:28:09.475749+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":111,"log_dups_size":0,"ondisk_log_size":111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:08:41.334897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":59,"num_write_kb":4127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"43'447","reported_seq":520,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.367605+0000","last_change":"2024-04-25T02:23:12.845755+0000","last_active":"2024-04-25T02:28:12.367605+0000","last_peered":"2024-04-25T02:28:12.367605+0000","last_clean":"2024-04-25T02:28:12.367605+0000","last_became_active":"2024-04-25T02:23:12.845497+0000","last_became_peered":"2024-04-25T02:23:12.845497+0000","last_unstale":"2024-04-25T02:28:12.367605+0000","last_undegraded":"2024-04-25T02:28:12.367605+0000","last_fullsized":"2024-04-25T02:28:12.367605+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:04:37.689024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15742,"num_write":414,"num_write_kb":51315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"43'419","reported_seq":484,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.369513+0000","last_change":"2024-04-25T02:23:12.847086+0000","last_active":"2024-04-25T02:28:12.369513+0000","last_peered":"2024-04-25T02:28:12.369513+0000","last_clean":"2024-04-25T02:28:12.369513+0000","last_became_active":"2024-04-25T02:23:12.846719+0000","last_became_peered":"2024-04-25T02:23:12.846719+0000","last_unstale":"2024-04-25T02:28:12.369513+0000","last_undegraded":"2024-04-25T02:28:12.369513+0000","last_fullsized":"2024-04-25T02:28:12.369513+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:19.196820+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":16944,"num_write":389,"num_write_kb":35957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"43'440","reported_seq":484,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.357398+0000","last_change":"2024-04-25T02:23:56.302118+0000","last_active":"2024-04-25T02:28:12.357398+0000","last_peered":"2024-04-25T02:28:12.357398+0000","last_clean":"2024-04-25T02:28:12.357398+0000","last_became_active":"2024-04-25T02:23:56.301745+0000","last_became_peered":"2024-04-25T02:23:56.301745+0000","last_unstale":"2024-04-25T02:28:12.357398+0000","last_undegraded":"2024-04-25T02:28:12.357398+0000","last_fullsized":"2024-04-25T02:28:12.357398+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:22:47.665187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":12557,"num_write":410,"num_write_kb":77332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"43'492","reported_seq":560,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.356441+0000","last_change":"2024-04-25T02:23:13.844518+0000","last_active":"2024-04-25T02:28:12.356441+0000","last_peered":"2024-04-25T02:28:12.356441+0000","last_clean":"2024-04-25T02:28:12.356441+0000","last_became_active":"2024-04-25T02:23:13.844235+0000","last_became_peered":"2024-04-25T02:23:13.844235+0000","last_unstale":"2024-04-25T02:28:12.356441+0000","last_undegraded":"2024-04-25T02:28:12.356441+0000","last_fullsized":"2024-04-25T02:28:12.356441+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:01:33.237637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14237,"num_write":458,"num_write_kb":116854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"43'392","reported_seq":471,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.356202+0000","last_change":"2024-04-25T02:23:13.849525+0000","last_active":"2024-04-25T02:28:12.356202+0000","last_peered":"2024-04-25T02:28:12.356202+0000","last_clean":"2024-04-25T02:28:12.356202+0000","last_became_active":"2024-04-25T02:23:13.845193+0000","last_became_peered":"2024-04-25T02:23:13.845193+0000","last_unstale":"2024-04-25T02:28:12.356202+0000","last_undegraded":"2024-04-25T02:28:12.356202+0000","last_fullsized":"2024-04-25T02:28:12.356202+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:17:33.318731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":36152,"num_write":360,"num_write_kb":54497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"43'402","reported_seq":503,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.360417+0000","last_change":"2024-04-25T02:23:12.842342+0000","last_active":"2024-04-25T02:28:12.360417+0000","last_peered":"2024-04-25T02:28:12.360417+0000","last_clean":"2024-04-25T02:28:12.360417+0000","last_became_active":"2024-04-25T02:23:12.841677+0000","last_became_peered":"2024-04-25T02:23:12.841677+0000","last_unstale":"2024-04-25T02:28:12.360417+0000","last_undegraded":"2024-04-25T02:28:12.360417+0000","last_fullsized":"2024-04-25T02:28:12.360417+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:24:27.480264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":32628,"num_write":375,"num_write_kb":79888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2779,"num_read_kb":1446401,"num_write":24390,"num_write_kb":4320360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26350,"ondisk_log_size":26350,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":129261049,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":231,"num_read_kb":1603,"num_write":6642,"num_write_kb":130848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":258629632,"data_stored":258521499,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39115,"internal_metadata":0},"log_size":8481,"ondisk_log_size":8481,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":31,"seq":133143986239,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":389724,"kb_used_data":88340,"kb_used_omap":9,"kb_used_meta":301366,"kb_avail":93982116,"statfs":{"total":96636764160,"available":96237686784,"internally_reserved":0,"allocated":90460160,"data_stored":90216033,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9975,"internal_metadata":308599049},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:27:15 2024","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.35799999999999998,"15min":0.34100000000000003},"min":{"1min":0.159,"5min":0.159,"15min":0.159},"max":{"1min":3.5409999999999999,"5min":3.5409999999999999,"15min":3.5409999999999999},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.40899999999999997,"15min":0.36899999999999999},"min":{"1min":0.161,"5min":0.161,"15min":0.161},"max":{"1min":3.613,"5min":3.613,"15min":3.613},"last":0.30199999999999999}]},{"osd":1,"last update":"Thu Apr 25 02:27:15 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.38900000000000001,"15min":0.36499999999999999},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":3.0009999999999999,"5min":3.0009999999999999,"15min":3.0009999999999999},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.39800000000000002,"15min":0.373},"min":{"1min":0.157,"5min":0.157,"15min":0.157},"max":{"1min":4.9720000000000004,"5min":4.9720000000000004,"15min":4.9720000000000004},"last":0.25}]},{"osd":2,"last update":"Thu Apr 25 02:27:15 2024","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.43099999999999999,"15min":0.38},"min":{"1min":0.17599999999999999,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":4.883,"5min":4.883,"15min":4.883},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.40300000000000002,"15min":0.38500000000000001},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":3.0550000000000002,"5min":3.0550000000000002,"15min":3.0550000000000002},"last":0.313}]}]},{"osd":2,"up_from":30,"seq":128849018943,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":362388,"kb_used_data":56972,"kb_used_omap":8,"kb_used_meta":305399,"kb_avail":94009452,"statfs":{"total":96636764160,"available":96265678848,"internally_reserved":0,"allocated":58339328,"data_stored":58119283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8387,"internal_metadata":312729405},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:27:18 2024","interfaces":[{"interface":"back","average":{"1min":0.248,"5min":0.313,"15min":0.32000000000000001},"min":{"1min":0.14199999999999999,"5min":0.14199999999999999,"15min":0.14199999999999999},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.251,"5min":0.32700000000000001,"15min":0.33000000000000002},"min":{"1min":0.16400000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.38800000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"last":0.28299999999999997}]},{"osd":1,"last update":"Thu Apr 25 02:27:18 2024","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.34499999999999997,"15min":0.34599999999999997},"min":{"1min":0.19,"5min":0.19,"15min":0.19},"max":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.313},{"interface":"front","average":{"1min":0.32500000000000001,"5min":0.35199999999999998,"15min":0.34999999999999998},"min":{"1min":0.17599999999999999,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.29899999999999999}]},{"osd":3,"last update":"Thu Apr 25 02:27:18 2024","interfaces":[{"interface":"back","average":{"1min":0.317,"5min":0.35299999999999998,"15min":0.35499999999999998},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.36399999999999999}]}]},{"osd":0,"up_from":28,"seq":120259084351,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369380,"kb_used_data":59740,"kb_used_omap":15,"kb_used_meta":309616,"kb_avail":94002460,"statfs":{"total":96636764160,"available":96258519040,"internally_reserved":0,"allocated":61173760,"data_stored":60940630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15790,"internal_metadata":317047378},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 25 02:27:16 2024","interfaces":[{"interface":"back","average":{"1min":0.23100000000000001,"5min":0.32500000000000001,"15min":0.33600000000000002},"min":{"1min":0.14799999999999999,"5min":0.14799999999999999,"15min":0.14799999999999999},"max":{"1min":0.375,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.307},{"interface":"front","average":{"1min":0.27500000000000002,"5min":0.34599999999999997,"15min":0.35799999999999998},"min":{"1min":0.17000000000000001,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"last":0.32500000000000001}]},{"osd":2,"last update":"Thu Apr 25 02:27:16 2024","interfaces":[{"interface":"back","average":{"1min":0.30099999999999999,"5min":0.36399999999999999,"15min":0.378},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.42699999999999999,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.34499999999999997},{"interface":"front","average":{"1min":0.28000000000000003,"5min":0.36499999999999999,"15min":0.38300000000000001},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.41399999999999998,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.378}]},{"osd":3,"last update":"Thu Apr 25 02:27:26 2024","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.39000000000000001,"15min":0.38400000000000001},"min":{"1min":0.186,"5min":0.186,"15min":0.186},"max":{"1min":2.8069999999999999,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.30099999999999999,"5min":0.39900000000000002,"15min":0.42099999999999999},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.47499999999999998,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.40999999999999998}]}]},{"osd":1,"up_from":29,"seq":124554051647,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":347452,"kb_used_data":50100,"kb_used_omap":4,"kb_used_meta":297339,"kb_avail":94024388,"statfs":{"total":96636764160,"available":96280973312,"internally_reserved":0,"allocated":51302400,"data_stored":51088318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4963,"internal_metadata":304475293},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:28:13 2024","interfaces":[{"interface":"back","average":{"1min":0.23499999999999999,"5min":0.29299999999999998,"15min":0.32100000000000001},"min":{"1min":0.16700000000000001,"5min":0.155,"15min":0.155},"max":{"1min":0.36699999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.26600000000000001,"5min":0.314,"15min":0.34399999999999997},"min":{"1min":0.189,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.40699999999999997,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.29799999999999999}]},{"osd":2,"last update":"Thu Apr 25 02:28:13 2024","interfaces":[{"interface":"back","average":{"1min":0.26200000000000001,"5min":0.32600000000000001,"15min":0.34599999999999997},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.33900000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.27300000000000002,"5min":0.34100000000000003,"15min":0.35699999999999998},"min":{"1min":0.20399999999999999,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.35099999999999998,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.27800000000000002}]},{"osd":3,"last update":"Thu Apr 25 02:28:13 2024","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.36099999999999999,"15min":0.39000000000000001},"min":{"1min":0.222,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.40500000000000003,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.28000000000000003,"5min":0.35499999999999998,"15min":0.38300000000000001},"min":{"1min":0.20599999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.38300000000000001,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.315}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":60215296,"data_stored":60184605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15790,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":50343936,"data_stored":50332293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4963,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57974784,"data_stored":57953626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8387,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90095616,"data_stored":90050975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9975,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:28:19.795 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.795 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.795 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.796 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.796 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.796 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.796 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.796 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.796 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.796 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.796 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.796 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.797 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.797 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.797 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.797 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.797 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.797 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.797 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.797 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.797 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.797 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.798 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.798 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.798 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.798 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.798 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.798 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.798 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.798 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.798 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.798 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.799 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.799 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.799 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.799 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.799 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.799 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.799 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.799 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.799 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.799 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.799 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.800 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.800 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.800 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.800 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.800 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.800 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.800 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.800 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.800 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.801 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.801 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.801 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.801 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.801 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.801 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.801 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.801 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.801 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.801 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.802 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.802 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.802 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.802 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-25T02:20:14.468721+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.802 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.802 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.802 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-25T02:20:14.468721+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.802 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.802 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.803 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-25T02:20:14.468721+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.803 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.803 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.803 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-25T02:20:14.468721+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.803 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-25T02:20:08.432182+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.803 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.803 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.803 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-25T02:20:14.468721+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.803 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.804 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.804 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-25T02:20:14.468721+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.804 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.804 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.804 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.804 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-25T02:20:14.468721+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.804 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.804 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-25T02:20:14.468721+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.804 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.805 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.805 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.805 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.805 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.805 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.805 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.805 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.805 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.805 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.805 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.806 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.806 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.806 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.806 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.806 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.806 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:19.806 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T02:28:39.807 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:28:39.945 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.943+0000 7f8bcb945700 1 Processor -- start 2024-04-25T02:28:39.946 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.943+0000 7f8bcb945700 1 -- start start 2024-04-25T02:28:39.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.944+0000 7f8bcb945700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8bc406ed70 0x7f8bc40a5270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:39.948 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.944+0000 7f8bcb945700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8bc40a7110 0x7f8bc40a3920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:39.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.944+0000 7f8bcb945700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f8bc40a3e60 0x7f8bc413f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:39.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.944+0000 7f8bcb945700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8bc40a33c0 con 0x7f8bc40a3e60 2024-04-25T02:28:39.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.944+0000 7f8bcb945700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc40a3660 con 0x7f8bc40a7110 2024-04-25T02:28:39.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.944+0000 7f8bcb945700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc406faf0 con 0x7f8bc406ed70 2024-04-25T02:28:39.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.944+0000 7f8bc9ee2700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f8bc40a3e60 0x7f8bc413f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:39.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.944+0000 7f8bc8ee0700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8bc40a7110 0x7f8bc40a3920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:39.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.944+0000 7f8bc96e1700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8bc406ed70 0x7f8bc40a5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:39.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.944+0000 7f8bc9ee2700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f8bc40a3e60 0x7f8bc413f6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:57954/0 (socket says 172.21.15.111:57954) 2024-04-25T02:28:39.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.944+0000 7f8bc8ee0700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8bc40a7110 0x7f8bc40a3920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:52594/0 (socket says 172.21.15.111:52594) 2024-04-25T02:28:39.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.944+0000 7f8bc9ee2700 1 -- 172.21.15.111:0/789798241 learned_addr learned my addr 172.21.15.111:0/789798241 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:28:39.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.944+0000 7f8bc96e1700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8bc406ed70 0x7f8bc40a5270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:59432/0 (socket says 172.21.15.111:59432) 2024-04-25T02:28:39.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.944+0000 7f8bc96e1700 1 -- 172.21.15.111:0/789798241 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8bc40a7110 msgr2=0x7f8bc40a3920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:39.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.944+0000 7f8bc96e1700 1 --2- 172.21.15.111:0/789798241 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8bc40a7110 0x7f8bc40a3920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:39.949 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.944+0000 7f8bc96e1700 1 -- 172.21.15.111:0/789798241 >> v2:172.21.15.111:3300/0 conn(0x7f8bc40a3e60 msgr2=0x7f8bc413f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:28:39.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.944+0000 7f8bc96e1700 1 --2- 172.21.15.111:0/789798241 >> v2:172.21.15.111:3300/0 conn(0x7f8bc40a3e60 0x7f8bc413f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:39.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.944+0000 7f8bc96e1700 1 -- 172.21.15.111:0/789798241 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bc40a5d60 con 0x7f8bc406ed70 2024-04-25T02:28:39.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.944+0000 7f8bc9ee2700 1 --2- 172.21.15.111:0/789798241 >> v2:172.21.15.111:3300/0 conn(0x7f8bc40a3e60 0x7f8bc413f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:39.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.944+0000 7f8bc8ee0700 1 --2- 172.21.15.111:0/789798241 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8bc40a7110 0x7f8bc40a3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:39.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.944+0000 7f8bc96e1700 1 --2- 172.21.15.111:0/789798241 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8bc406ed70 0x7f8bc40a5270 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0009910 tx=0x7f8bc00091a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f19370ea4775b5c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:39.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.944+0000 7f8bbbfff700 1 -- 172.21.15.111:0/789798241 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc0011630 con 0x7f8bc406ed70 2024-04-25T02:28:39.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.945+0000 7f8bbbfff700 1 -- 172.21.15.111:0/789798241 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc0011790 con 0x7f8bc406ed70 2024-04-25T02:28:39.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.945+0000 7f8bbbfff700 1 -- 172.21.15.111:0/789798241 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc0011b30 con 0x7f8bc406ed70 2024-04-25T02:28:39.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.945+0000 7f8bcb945700 1 -- 172.21.15.111:0/789798241 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8bc406ed70 msgr2=0x7f8bc40a5270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:39.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.945+0000 7f8bcb945700 1 --2- 172.21.15.111:0/789798241 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8bc406ed70 0x7f8bc40a5270 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f8bc0009910 tx=0x7f8bc00091a0 comp rx=0 tx=0).stop 2024-04-25T02:28:39.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.945+0000 7f8bcb945700 1 -- 172.21.15.111:0/789798241 shutdown_connections 2024-04-25T02:28:39.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.945+0000 7f8bcb945700 1 --2- 172.21.15.111:0/789798241 >> v2:172.21.15.111:3300/0 conn(0x7f8bc40a3e60 0x7f8bc413f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:39.950 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.945+0000 7f8bcb945700 1 --2- 172.21.15.111:0/789798241 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8bc406ed70 0x7f8bc40a5270 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:39.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.945+0000 7f8bcb945700 1 --2- 172.21.15.111:0/789798241 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8bc40a7110 0x7f8bc40a3920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:39.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.945+0000 7f8bcb945700 1 -- 172.21.15.111:0/789798241 >> 172.21.15.111:0/789798241 conn(0x7f8bc4067940 msgr2=0x7f8bc4067d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:39.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.945+0000 7f8bcb945700 1 -- 172.21.15.111:0/789798241 shutdown_connections 2024-04-25T02:28:39.951 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.945+0000 7f8bcb945700 1 -- 172.21.15.111:0/789798241 wait complete. 2024-04-25T02:28:39.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.947+0000 7f8bcb945700 1 Processor -- start 2024-04-25T02:28:39.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.947+0000 7f8bcb945700 1 -- start start 2024-04-25T02:28:39.953 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.948+0000 7f8bcb945700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8bc406ed70 0x7f8bc40abbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:39.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.948+0000 7f8bcb945700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8bc40a3e60 0x7f8bc414f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:39.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.948+0000 7f8bcb945700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8bc40a7110 0x7f8bc414f870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:28:39.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.948+0000 7f8bcb945700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc40a2d50 con 0x7f8bc406ed70 2024-04-25T02:28:39.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.948+0000 7f8bcb945700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc40ac510 con 0x7f8bc40a3e60 2024-04-25T02:28:39.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.948+0000 7f8bcb945700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8bc40ac7d0 con 0x7f8bc40a7110 2024-04-25T02:28:39.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.948+0000 7f8bc96e1700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8bc406ed70 0x7f8bc40abbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:39.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.948+0000 7f8bc96e1700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8bc406ed70 0x7f8bc40abbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:57970/0 (socket says 172.21.15.111:57970) 2024-04-25T02:28:39.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.948+0000 7f8bc96e1700 1 -- 172.21.15.111:0/1822493914 learned_addr learned my addr 172.21.15.111:0/1822493914 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:28:39.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.948+0000 7f8bc9ee2700 1 --2- 172.21.15.111:0/1822493914 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8bc40a7110 0x7f8bc414f870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:39.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.948+0000 7f8bc8ee0700 1 --2- 172.21.15.111:0/1822493914 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8bc40a3e60 0x7f8bc414f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:28:39.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.948+0000 7f8bc96e1700 1 -- 172.21.15.111:0/1822493914 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8bc40a7110 msgr2=0x7f8bc414f870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:39.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.948+0000 7f8bc96e1700 1 --2- 172.21.15.111:0/1822493914 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8bc40a7110 0x7f8bc414f870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:39.954 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.948+0000 7f8bc96e1700 1 -- 172.21.15.111:0/1822493914 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8bc40a3e60 msgr2=0x7f8bc414f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:39.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.948+0000 7f8bc96e1700 1 --2- 172.21.15.111:0/1822493914 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8bc40a3e60 0x7f8bc414f330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:39.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.948+0000 7f8bc96e1700 1 -- 172.21.15.111:0/1822493914 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8bbc009ae0 con 0x7f8bc406ed70 2024-04-25T02:28:39.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.948+0000 7f8bc9ee2700 1 --2- 172.21.15.111:0/1822493914 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8bc40a7110 0x7f8bc414f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:28:39.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.948+0000 7f8bc96e1700 1 --2- 172.21.15.111:0/1822493914 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8bc406ed70 0x7f8bc40abbe0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8bc406fc30 tx=0x7f8bc0017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:28:39.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.948+0000 7f8bb97fa700 1 -- 172.21.15.111:0/1822493914 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc0000d10 con 0x7f8bc406ed70 2024-04-25T02:28:39.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.948+0000 7f8bb97fa700 1 -- 172.21.15.111:0/1822493914 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8bc0011900 con 0x7f8bc406ed70 2024-04-25T02:28:39.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.948+0000 7f8bb97fa700 1 -- 172.21.15.111:0/1822493914 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8bc0026430 con 0x7f8bc406ed70 2024-04-25T02:28:39.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.948+0000 7f8bcb945700 1 -- 172.21.15.111:0/1822493914 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bb4009420 con 0x7f8bc406ed70 2024-04-25T02:28:39.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.948+0000 7f8bcb945700 1 -- 172.21.15.111:0/1822493914 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bc0009420 con 0x7f8bc406ed70 2024-04-25T02:28:39.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.949+0000 7f8bcb945700 1 -- 172.21.15.111:0/1822493914 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bc40b0070 con 0x7f8bc406ed70 2024-04-25T02:28:39.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.949+0000 7f8bb97fa700 1 -- 172.21.15.111:0/1822493914 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f8bc0023030 con 0x7f8bc406ed70 2024-04-25T02:28:39.955 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.950+0000 7f8bb97fa700 1 -- 172.21.15.111:0/1822493914 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4158+0+0 (secure 0 0 0) 0x7f8bc005c6a0 con 0x7f8bc406ed70 2024-04-25T02:28:39.956 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:39.953+0000 7f8bb97fa700 1 -- 172.21.15.111:0/1822493914 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f8bc0005f50 con 0x7f8bc406ed70 2024-04-25T02:28:40.107 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:40.105+0000 7f8bcb945700 1 -- 172.21.15.111:0/1822493914 --> v1:172.21.15.111:6816/46482 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8bc406fd50 con 0x7f8ba8045ef0 2024-04-25T02:28:40.114 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:40.111+0000 7f8bb97fa700 1 -- 172.21.15.111:0/1822493914 <== mgr.14107 v1:172.21.15.111:6816/46482 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+275130 (unknown 2965378022 0 1317289084) 0x7f8bc406fd50 con 0x7f8ba8045ef0 2024-04-25T02:28:40.117 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:28:40.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:40.114+0000 7f8bcb945700 1 -- 172.21.15.111:0/1822493914 >> v1:172.21.15.111:6816/46482 conn(0x7f8ba8045ef0 legacy=0x7f8ba80483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:40.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:40.114+0000 7f8bcb945700 1 -- 172.21.15.111:0/1822493914 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8bc406ed70 msgr2=0x7f8bc40abbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:28:40.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:40.114+0000 7f8bcb945700 1 --2- 172.21.15.111:0/1822493914 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8bc406ed70 0x7f8bc40abbe0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f8bc406fc30 tx=0x7f8bc0017000 comp rx=0 tx=0).stop 2024-04-25T02:28:40.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:40.114+0000 7f8bcb945700 1 -- 172.21.15.111:0/1822493914 shutdown_connections 2024-04-25T02:28:40.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:40.114+0000 7f8bcb945700 1 --2- 172.21.15.111:0/1822493914 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8bc40a7110 0x7f8bc414f870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:40.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:40.114+0000 7f8bcb945700 1 --2- 172.21.15.111:0/1822493914 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8bc406ed70 0x7f8bc40abbe0 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:40.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:40.114+0000 7f8bcb945700 1 --2- 172.21.15.111:0/1822493914 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8bc40a3e60 0x7f8bc414f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:28:40.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:40.114+0000 7f8bcb945700 1 -- 172.21.15.111:0/1822493914 >> 172.21.15.111:0/1822493914 conn(0x7f8bc4067940 msgr2=0x7f8bc413ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:28:40.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:40.114+0000 7f8bcb945700 1 -- 172.21.15.111:0/1822493914 shutdown_connections 2024-04-25T02:28:40.120 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:28:40.114+0000 7f8bcb945700 1 -- 172.21.15.111:0/1822493914 wait complete. 2024-04-25T02:28:40.120 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2024-04-25T02:28:40.129 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":198,"stamp":"2024-04-25T02:28:38.808524+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129851417,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":3127,"num_read_kb":1448109,"num_write":31191,"num_write_kb":4453499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34953,"ondisk_log_size":34953,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1468944,"kb_used_data":255152,"kb_used_omap":38,"kb_used_meta":1213721,"kb_avail":376018416,"statfs":{"total":386547056640,"available":385042857984,"internally_reserved":0,"allocated":261275648,"data_stored":260365462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39115,"internal_metadata":1242851125},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003601"},"pg_stats":[{"pgid":"4.3f","version":"43'402","reported_seq":475,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.364437+0000","last_change":"2024-04-25T02:23:13.846111+0000","last_active":"2024-04-25T02:28:12.364437+0000","last_peered":"2024-04-25T02:28:12.364437+0000","last_clean":"2024-04-25T02:28:12.364437+0000","last_became_active":"2024-04-25T02:23:13.845848+0000","last_became_peered":"2024-04-25T02:23:13.845848+0000","last_unstale":"2024-04-25T02:28:12.364437+0000","last_undegraded":"2024-04-25T02:28:12.364437+0000","last_fullsized":"2024-04-25T02:28:12.364437+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":15113,"num_write":370,"num_write_kb":51033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"43'436","reported_seq":521,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.367424+0000","last_change":"2024-04-25T02:23:12.845761+0000","last_active":"2024-04-25T02:28:12.367424+0000","last_peered":"2024-04-25T02:28:12.367424+0000","last_clean":"2024-04-25T02:28:12.367424+0000","last_became_active":"2024-04-25T02:23:12.845429+0000","last_became_peered":"2024-04-25T02:23:12.845429+0000","last_unstale":"2024-04-25T02:28:12.367424+0000","last_undegraded":"2024-04-25T02:28:12.367424+0000","last_fullsized":"2024-04-25T02:28:12.367424+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22592,"num_write":405,"num_write_kb":75650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"43'370","reported_seq":431,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.365759+0000","last_change":"2024-04-25T02:23:11.838311+0000","last_active":"2024-04-25T02:28:12.365759+0000","last_peered":"2024-04-25T02:28:12.365759+0000","last_clean":"2024-04-25T02:28:12.365759+0000","last_became_active":"2024-04-25T02:23:11.838054+0000","last_became_peered":"2024-04-25T02:23:11.838054+0000","last_unstale":"2024-04-25T02:28:12.365759+0000","last_undegraded":"2024-04-25T02:28:12.365759+0000","last_fullsized":"2024-04-25T02:28:12.365759+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":15817,"num_write":338,"num_write_kb":46402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"43'393","reported_seq":475,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.366073+0000","last_change":"2024-04-25T02:23:11.837015+0000","last_active":"2024-04-25T02:28:12.366073+0000","last_peered":"2024-04-25T02:28:12.366073+0000","last_clean":"2024-04-25T02:28:12.366073+0000","last_became_active":"2024-04-25T02:23:11.836681+0000","last_became_peered":"2024-04-25T02:23:11.836681+0000","last_unstale":"2024-04-25T02:28:12.366073+0000","last_undegraded":"2024-04-25T02:28:12.366073+0000","last_fullsized":"2024-04-25T02:28:12.366073+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22923,"num_write":365,"num_write_kb":51318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"43'406","reported_seq":476,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.358278+0000","last_change":"2024-04-25T02:23:13.843174+0000","last_active":"2024-04-25T02:28:12.358278+0000","last_peered":"2024-04-25T02:28:12.358278+0000","last_clean":"2024-04-25T02:28:12.358278+0000","last_became_active":"2024-04-25T02:23:13.842918+0000","last_became_peered":"2024-04-25T02:23:13.842918+0000","last_unstale":"2024-04-25T02:28:12.358278+0000","last_undegraded":"2024-04-25T02:28:12.358278+0000","last_fullsized":"2024-04-25T02:28:12.358278+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14619,"num_write":384,"num_write_kb":71611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"43'366","reported_seq":428,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.364802+0000","last_change":"2024-04-25T02:23:13.848493+0000","last_active":"2024-04-25T02:28:12.364802+0000","last_peered":"2024-04-25T02:28:12.364802+0000","last_clean":"2024-04-25T02:28:12.364802+0000","last_became_active":"2024-04-25T02:23:13.848160+0000","last_became_peered":"2024-04-25T02:23:13.848160+0000","last_unstale":"2024-04-25T02:28:12.364802+0000","last_undegraded":"2024-04-25T02:28:12.364802+0000","last_fullsized":"2024-04-25T02:28:12.364802+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12472,"num_write":338,"num_write_kb":33864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"43'441","reported_seq":560,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.351267+0000","last_change":"2024-04-25T02:23:13.842324+0000","last_active":"2024-04-25T02:28:12.351267+0000","last_peered":"2024-04-25T02:28:12.351267+0000","last_clean":"2024-04-25T02:28:12.351267+0000","last_became_active":"2024-04-25T02:23:13.840374+0000","last_became_peered":"2024-04-25T02:23:13.840374+0000","last_unstale":"2024-04-25T02:28:12.351267+0000","last_undegraded":"2024-04-25T02:28:12.351267+0000","last_fullsized":"2024-04-25T02:28:12.351267+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":40192,"num_write":416,"num_write_kb":101787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"43'364","reported_seq":431,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.369227+0000","last_change":"2024-04-25T02:23:11.835781+0000","last_active":"2024-04-25T02:28:12.369227+0000","last_peered":"2024-04-25T02:28:12.369227+0000","last_clean":"2024-04-25T02:28:12.369227+0000","last_became_active":"2024-04-25T02:23:11.834759+0000","last_became_peered":"2024-04-25T02:23:11.834759+0000","last_unstale":"2024-04-25T02:28:12.369227+0000","last_undegraded":"2024-04-25T02:28:12.369227+0000","last_fullsized":"2024-04-25T02:28:12.369227+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18431,"num_write":330,"num_write_kb":66835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"43'425","reported_seq":525,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:22.157783+0000","last_change":"2024-04-25T02:28:22.157736+0000","last_active":"2024-04-25T02:28:22.157783+0000","last_peered":"2024-04-25T02:28:22.157783+0000","last_clean":"2024-04-25T02:28:22.157783+0000","last_became_active":"2024-04-25T02:23:13.841883+0000","last_became_peered":"2024-04-25T02:23:13.841883+0000","last_unstale":"2024-04-25T02:28:22.157783+0000","last_undegraded":"2024-04-25T02:28:22.157783+0000","last_fullsized":"2024-04-25T02:28:22.157783+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'425","last_scrub_stamp":"2024-04-25T02:28:22.157614+0000","last_deep_scrub":"43'425","last_deep_scrub_stamp":"2024-04-25T02:28:22.157614+0000","last_clean_scrub_stamp":"2024-04-25T02:28:22.157614+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:28:28.713838+0000","scrub_duration":0.0023306529999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":29378,"num_write":387,"num_write_kb":39136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"43'396","reported_seq":470,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.364878+0000","last_change":"2024-04-25T02:23:11.836289+0000","last_active":"2024-04-25T02:28:12.364878+0000","last_peered":"2024-04-25T02:28:12.364878+0000","last_clean":"2024-04-25T02:28:12.364878+0000","last_became_active":"2024-04-25T02:23:11.835958+0000","last_became_peered":"2024-04-25T02:23:11.835958+0000","last_unstale":"2024-04-25T02:28:12.364878+0000","last_undegraded":"2024-04-25T02:28:12.364878+0000","last_fullsized":"2024-04-25T02:28:12.364878+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":25799,"num_write":352,"num_write_kb":67037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"43'354","reported_seq":394,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.359391+0000","last_change":"2024-04-25T02:23:11.836468+0000","last_active":"2024-04-25T02:28:12.359391+0000","last_peered":"2024-04-25T02:28:12.359391+0000","last_clean":"2024-04-25T02:28:12.359391+0000","last_became_active":"2024-04-25T02:23:11.836214+0000","last_became_peered":"2024-04-25T02:23:11.836214+0000","last_unstale":"2024-04-25T02:28:12.359391+0000","last_undegraded":"2024-04-25T02:28:12.359391+0000","last_fullsized":"2024-04-25T02:28:12.359391+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7176,"num_write":336,"num_write_kb":37702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"43'335","reported_seq":377,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.367786+0000","last_change":"2024-04-25T02:23:13.847944+0000","last_active":"2024-04-25T02:28:12.367786+0000","last_peered":"2024-04-25T02:28:12.367786+0000","last_clean":"2024-04-25T02:28:12.367786+0000","last_became_active":"2024-04-25T02:23:13.847446+0000","last_became_peered":"2024-04-25T02:23:13.847446+0000","last_unstale":"2024-04-25T02:28:12.367786+0000","last_undegraded":"2024-04-25T02:28:12.367786+0000","last_fullsized":"2024-04-25T02:28:12.367786+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4160,"num_write":309,"num_write_kb":33908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"43'387","reported_seq":439,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:26.212350+0000","last_change":"2024-04-25T02:28:26.212320+0000","last_active":"2024-04-25T02:28:26.212350+0000","last_peered":"2024-04-25T02:28:26.212350+0000","last_clean":"2024-04-25T02:28:26.212350+0000","last_became_active":"2024-04-25T02:23:13.847009+0000","last_became_peered":"2024-04-25T02:23:13.847009+0000","last_unstale":"2024-04-25T02:28:26.212350+0000","last_undegraded":"2024-04-25T02:28:26.212350+0000","last_fullsized":"2024-04-25T02:28:26.212350+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'387","last_scrub_stamp":"2024-04-25T02:28:26.212204+0000","last_deep_scrub":"43'387","last_deep_scrub_stamp":"2024-04-25T02:28:26.212204+0000","last_clean_scrub_stamp":"2024-04-25T02:28:26.212204+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:25:07.412842+0000","scrub_duration":0.0024916069999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4152,"num_write":352,"num_write_kb":42524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"43'450","reported_seq":539,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:20.974106+0000","last_change":"2024-04-25T02:28:20.974062+0000","last_active":"2024-04-25T02:28:20.974106+0000","last_peered":"2024-04-25T02:28:20.974106+0000","last_clean":"2024-04-25T02:28:20.974106+0000","last_became_active":"2024-04-25T02:23:12.841783+0000","last_became_peered":"2024-04-25T02:23:12.841783+0000","last_unstale":"2024-04-25T02:28:20.974106+0000","last_undegraded":"2024-04-25T02:28:20.974106+0000","last_fullsized":"2024-04-25T02:28:20.974106+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'450","last_scrub_stamp":"2024-04-25T02:28:20.973929+0000","last_deep_scrub":"43'450","last_deep_scrub_stamp":"2024-04-25T02:28:20.973929+0000","last_clean_scrub_stamp":"2024-04-25T02:28:20.973929+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:56:11.043992+0000","scrub_duration":0.002462386,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":25198,"num_write":421,"num_write_kb":88864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"43'430","reported_seq":522,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.351413+0000","last_change":"2024-04-25T02:23:11.836069+0000","last_active":"2024-04-25T02:28:12.351413+0000","last_peered":"2024-04-25T02:28:12.351413+0000","last_clean":"2024-04-25T02:28:12.351413+0000","last_became_active":"2024-04-25T02:23:11.835815+0000","last_became_peered":"2024-04-25T02:23:11.835815+0000","last_unstale":"2024-04-25T02:28:12.351413+0000","last_undegraded":"2024-04-25T02:28:12.351413+0000","last_fullsized":"2024-04-25T02:28:12.351413+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31947,"num_write":393,"num_write_kb":64059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"43'438","reported_seq":463,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.356599+0000","last_change":"2024-04-25T02:23:55.963552+0000","last_active":"2024-04-25T02:28:12.356599+0000","last_peered":"2024-04-25T02:28:12.356599+0000","last_clean":"2024-04-25T02:28:12.356599+0000","last_became_active":"2024-04-25T02:23:55.963259+0000","last_became_peered":"2024-04-25T02:23:55.963259+0000","last_unstale":"2024-04-25T02:28:12.356599+0000","last_undegraded":"2024-04-25T02:28:12.356599+0000","last_fullsized":"2024-04-25T02:28:12.356599+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":2639,"num_write":405,"num_write_kb":51451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"43'394","reported_seq":457,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.356518+0000","last_change":"2024-04-25T02:23:13.844591+0000","last_active":"2024-04-25T02:28:12.356518+0000","last_peered":"2024-04-25T02:28:12.356518+0000","last_clean":"2024-04-25T02:28:12.356518+0000","last_became_active":"2024-04-25T02:23:13.844343+0000","last_became_peered":"2024-04-25T02:23:13.844343+0000","last_unstale":"2024-04-25T02:28:12.356518+0000","last_undegraded":"2024-04-25T02:28:12.356518+0000","last_fullsized":"2024-04-25T02:28:12.356518+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9696,"num_write":367,"num_write_kb":33966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"43'391","reported_seq":471,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.361179+0000","last_change":"2024-04-25T02:23:12.848314+0000","last_active":"2024-04-25T02:28:12.361179+0000","last_peered":"2024-04-25T02:28:12.361179+0000","last_clean":"2024-04-25T02:28:12.361179+0000","last_became_active":"2024-04-25T02:23:12.848051+0000","last_became_peered":"2024-04-25T02:23:12.848051+0000","last_unstale":"2024-04-25T02:28:12.361179+0000","last_undegraded":"2024-04-25T02:28:12.361179+0000","last_fullsized":"2024-04-25T02:28:12.361179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":13345,"num_write":357,"num_write_kb":38441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"43'429","reported_seq":540,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.366660+0000","last_change":"2024-04-25T02:23:13.848250+0000","last_active":"2024-04-25T02:28:12.366660+0000","last_peered":"2024-04-25T02:28:12.366660+0000","last_clean":"2024-04-25T02:28:12.366660+0000","last_became_active":"2024-04-25T02:23:13.847602+0000","last_became_peered":"2024-04-25T02:23:13.847602+0000","last_unstale":"2024-04-25T02:28:12.366660+0000","last_undegraded":"2024-04-25T02:28:12.366660+0000","last_fullsized":"2024-04-25T02:28:12.366660+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":37845,"num_write":400,"num_write_kb":88566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"43'437","reported_seq":513,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.364761+0000","last_change":"2024-04-25T02:23:13.846327+0000","last_active":"2024-04-25T02:28:12.364761+0000","last_peered":"2024-04-25T02:28:12.364761+0000","last_clean":"2024-04-25T02:28:12.364761+0000","last_became_active":"2024-04-25T02:23:13.845934+0000","last_became_peered":"2024-04-25T02:23:13.845934+0000","last_unstale":"2024-04-25T02:28:12.364761+0000","last_undegraded":"2024-04-25T02:28:12.364761+0000","last_fullsized":"2024-04-25T02:28:12.364761+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":22073,"num_write":412,"num_write_kb":67090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"43'414","reported_seq":507,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.365755+0000","last_change":"2024-04-25T02:23:13.847117+0000","last_active":"2024-04-25T02:28:12.365755+0000","last_peered":"2024-04-25T02:28:12.365755+0000","last_clean":"2024-04-25T02:28:12.365755+0000","last_became_active":"2024-04-25T02:23:13.846758+0000","last_became_peered":"2024-04-25T02:23:13.846758+0000","last_unstale":"2024-04-25T02:28:12.365755+0000","last_undegraded":"2024-04-25T02:28:12.365755+0000","last_fullsized":"2024-04-25T02:28:12.365755+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":24525,"num_write":378,"num_write_kb":100342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"43'445","reported_seq":519,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.366288+0000","last_change":"2024-04-25T02:23:11.835581+0000","last_active":"2024-04-25T02:28:12.366288+0000","last_peered":"2024-04-25T02:28:12.366288+0000","last_clean":"2024-04-25T02:28:12.366288+0000","last_became_active":"2024-04-25T02:23:11.835319+0000","last_became_peered":"2024-04-25T02:23:11.835319+0000","last_unstale":"2024-04-25T02:28:12.366288+0000","last_undegraded":"2024-04-25T02:28:12.366288+0000","last_fullsized":"2024-04-25T02:28:12.366288+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":18532,"num_write":411,"num_write_kb":84101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"43'408","reported_seq":526,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:29.377058+0000","last_change":"2024-04-25T02:28:29.377031+0000","last_active":"2024-04-25T02:28:29.377058+0000","last_peered":"2024-04-25T02:28:29.377058+0000","last_clean":"2024-04-25T02:28:29.377058+0000","last_became_active":"2024-04-25T02:23:13.838917+0000","last_became_peered":"2024-04-25T02:23:13.838917+0000","last_unstale":"2024-04-25T02:28:29.377058+0000","last_undegraded":"2024-04-25T02:28:29.377058+0000","last_fullsized":"2024-04-25T02:28:29.377058+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'408","last_scrub_stamp":"2024-04-25T02:28:29.376935+0000","last_deep_scrub":"43'408","last_deep_scrub_stamp":"2024-04-25T02:28:29.376935+0000","last_clean_scrub_stamp":"2024-04-25T02:28:29.376935+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:25:26.084049+0000","scrub_duration":0.002236952,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":25750,"num_write":380,"num_write_kb":75795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"43'451","reported_seq":517,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.369417+0000","last_change":"2024-04-25T02:23:13.846482+0000","last_active":"2024-04-25T02:28:12.369417+0000","last_peered":"2024-04-25T02:28:12.369417+0000","last_clean":"2024-04-25T02:28:12.369417+0000","last_became_active":"2024-04-25T02:23:13.845814+0000","last_became_peered":"2024-04-25T02:23:13.845814+0000","last_unstale":"2024-04-25T02:28:12.369417+0000","last_undegraded":"2024-04-25T02:28:12.369417+0000","last_fullsized":"2024-04-25T02:28:12.369417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13960,"num_write":428,"num_write_kb":96160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"43'397","reported_seq":450,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.363550+0000","last_change":"2024-04-25T02:23:13.852668+0000","last_active":"2024-04-25T02:28:12.363550+0000","last_peered":"2024-04-25T02:28:12.363550+0000","last_clean":"2024-04-25T02:28:12.363550+0000","last_became_active":"2024-04-25T02:23:13.852093+0000","last_became_peered":"2024-04-25T02:23:13.852093+0000","last_unstale":"2024-04-25T02:28:12.363550+0000","last_undegraded":"2024-04-25T02:28:12.363550+0000","last_fullsized":"2024-04-25T02:28:12.363550+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":3870,"num_write":383,"num_write_kb":17738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"43'485","reported_seq":567,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.363147+0000","last_change":"2024-04-25T02:23:12.841653+0000","last_active":"2024-04-25T02:28:12.363147+0000","last_peered":"2024-04-25T02:28:12.363147+0000","last_clean":"2024-04-25T02:28:12.363147+0000","last_became_active":"2024-04-25T02:23:12.841477+0000","last_became_peered":"2024-04-25T02:23:12.841477+0000","last_unstale":"2024-04-25T02:28:12.363147+0000","last_undegraded":"2024-04-25T02:28:12.363147+0000","last_fullsized":"2024-04-25T02:28:12.363147+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24645,"num_write":445,"num_write_kb":96750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"43'384","reported_seq":458,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.354521+0000","last_change":"2024-04-25T02:23:13.842553+0000","last_active":"2024-04-25T02:28:12.354521+0000","last_peered":"2024-04-25T02:28:12.354521+0000","last_clean":"2024-04-25T02:28:12.354521+0000","last_became_active":"2024-04-25T02:23:13.840422+0000","last_became_peered":"2024-04-25T02:23:13.840422+0000","last_unstale":"2024-04-25T02:28:12.354521+0000","last_undegraded":"2024-04-25T02:28:12.354521+0000","last_fullsized":"2024-04-25T02:28:12.354521+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":6130,"num_write":356,"num_write_kb":25986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"43'568","reported_seq":612,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:30.058301+0000","last_change":"2024-04-25T02:28:30.058267+0000","last_active":"2024-04-25T02:28:30.058301+0000","last_peered":"2024-04-25T02:28:30.058301+0000","last_clean":"2024-04-25T02:28:30.058301+0000","last_became_active":"2024-04-25T02:23:12.845923+0000","last_became_peered":"2024-04-25T02:23:12.845923+0000","last_unstale":"2024-04-25T02:28:30.058301+0000","last_undegraded":"2024-04-25T02:28:30.058301+0000","last_fullsized":"2024-04-25T02:28:30.058301+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'568","last_scrub_stamp":"2024-04-25T02:28:30.058171+0000","last_deep_scrub":"43'568","last_deep_scrub_stamp":"2024-04-25T02:28:30.058171+0000","last_clean_scrub_stamp":"2024-04-25T02:28:30.058171+0000","objects_scrubbed":3,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:07:27.211762+0000","scrub_duration":0.028959043,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":494,"num_write_kb":12610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"43'420","reported_seq":536,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.368189+0000","last_change":"2024-04-25T02:23:13.850625+0000","last_active":"2024-04-25T02:28:12.368189+0000","last_peered":"2024-04-25T02:28:12.368189+0000","last_clean":"2024-04-25T02:28:12.368189+0000","last_became_active":"2024-04-25T02:23:13.848844+0000","last_became_peered":"2024-04-25T02:23:13.848844+0000","last_unstale":"2024-04-25T02:28:12.368189+0000","last_undegraded":"2024-04-25T02:28:12.368189+0000","last_fullsized":"2024-04-25T02:28:12.368189+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":41312,"num_write":376,"num_write_kb":112833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"43'383","reported_seq":419,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.489134+0000","last_change":"2024-04-25T02:23:13.850242+0000","last_active":"2024-04-25T02:28:10.489134+0000","last_peered":"2024-04-25T02:28:10.489134+0000","last_clean":"2024-04-25T02:28:10.489134+0000","last_became_active":"2024-04-25T02:23:13.846821+0000","last_became_peered":"2024-04-25T02:23:13.846821+0000","last_unstale":"2024-04-25T02:28:10.489134+0000","last_undegraded":"2024-04-25T02:28:10.489134+0000","last_fullsized":"2024-04-25T02:28:10.489134+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":383,"log_dups_size":0,"ondisk_log_size":383,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":334,"num_write_kb":4317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"43'428","reported_seq":522,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.366276+0000","last_change":"2024-04-25T02:23:11.840787+0000","last_active":"2024-04-25T02:28:12.366276+0000","last_peered":"2024-04-25T02:28:12.366276+0000","last_clean":"2024-04-25T02:28:12.366276+0000","last_became_active":"2024-04-25T02:23:11.840274+0000","last_became_peered":"2024-04-25T02:23:11.840274+0000","last_unstale":"2024-04-25T02:28:12.366276+0000","last_undegraded":"2024-04-25T02:28:12.366276+0000","last_fullsized":"2024-04-25T02:28:12.366276+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":28196,"num_write":410,"num_write_kb":104265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"43'875","reported_seq":922,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.488161+0000","last_change":"2024-04-25T02:23:13.839791+0000","last_active":"2024-04-25T02:28:10.488161+0000","last_peered":"2024-04-25T02:28:10.488161+0000","last_clean":"2024-04-25T02:28:10.488161+0000","last_became_active":"2024-04-25T02:23:13.839361+0000","last_became_peered":"2024-04-25T02:23:13.839361+0000","last_unstale":"2024-04-25T02:28:10.488161+0000","last_undegraded":"2024-04-25T02:28:10.488161+0000","last_fullsized":"2024-04-25T02:28:10.488161+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":875,"log_dups_size":0,"ondisk_log_size":875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":809,"num_write_kb":8568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"43'365","reported_seq":444,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.353721+0000","last_change":"2024-04-25T02:23:13.844099+0000","last_active":"2024-04-25T02:28:12.353721+0000","last_peered":"2024-04-25T02:28:12.353721+0000","last_clean":"2024-04-25T02:28:12.353721+0000","last_became_active":"2024-04-25T02:23:13.843656+0000","last_became_peered":"2024-04-25T02:23:13.843656+0000","last_unstale":"2024-04-25T02:28:12.353721+0000","last_undegraded":"2024-04-25T02:28:12.353721+0000","last_fullsized":"2024-04-25T02:28:12.353721+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":25136,"num_write":341,"num_write_kb":38831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"43'56","reported_seq":96,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.527159+0000","last_change":"2024-04-25T02:23:13.842946+0000","last_active":"2024-04-25T02:28:08.527159+0000","last_peered":"2024-04-25T02:28:08.527159+0000","last_clean":"2024-04-25T02:28:08.527159+0000","last_became_active":"2024-04-25T02:23:13.842598+0000","last_became_peered":"2024-04-25T02:23:13.842598+0000","last_unstale":"2024-04-25T02:28:08.527159+0000","last_undegraded":"2024-04-25T02:28:08.527159+0000","last_fullsized":"2024-04-25T02:28:08.527159+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"43'467","reported_seq":543,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.367867+0000","last_change":"2024-04-25T02:23:13.849957+0000","last_active":"2024-04-25T02:28:12.367867+0000","last_peered":"2024-04-25T02:28:12.367867+0000","last_clean":"2024-04-25T02:28:12.367867+0000","last_became_active":"2024-04-25T02:23:13.848675+0000","last_became_peered":"2024-04-25T02:23:13.848675+0000","last_unstale":"2024-04-25T02:28:12.367867+0000","last_undegraded":"2024-04-25T02:28:12.367867+0000","last_fullsized":"2024-04-25T02:28:12.367867+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":13580,"num_write":443,"num_write_kb":92928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"43'340","reported_seq":375,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.479650+0000","last_change":"2024-04-25T02:23:13.847353+0000","last_active":"2024-04-25T02:28:08.479650+0000","last_peered":"2024-04-25T02:28:08.479650+0000","last_clean":"2024-04-25T02:28:08.479650+0000","last_became_active":"2024-04-25T02:23:13.846764+0000","last_became_peered":"2024-04-25T02:23:13.846764+0000","last_unstale":"2024-04-25T02:28:08.479650+0000","last_undegraded":"2024-04-25T02:28:08.479650+0000","last_fullsized":"2024-04-25T02:28:08.479650+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":340,"log_dups_size":0,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":281,"num_write_kb":4273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"43'477","reported_seq":577,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.351447+0000","last_change":"2024-04-25T02:23:13.844687+0000","last_active":"2024-04-25T02:28:12.351447+0000","last_peered":"2024-04-25T02:28:12.351447+0000","last_clean":"2024-04-25T02:28:12.351447+0000","last_became_active":"2024-04-25T02:23:13.839702+0000","last_became_peered":"2024-04-25T02:23:13.839702+0000","last_unstale":"2024-04-25T02:28:12.351447+0000","last_undegraded":"2024-04-25T02:28:12.351447+0000","last_fullsized":"2024-04-25T02:28:12.351447+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":30102,"num_write":452,"num_write_kb":97286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"43'136","reported_seq":179,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.482458+0000","last_change":"2024-04-25T02:23:13.844668+0000","last_active":"2024-04-25T02:28:12.482458+0000","last_peered":"2024-04-25T02:28:12.482458+0000","last_clean":"2024-04-25T02:28:12.482458+0000","last_became_active":"2024-04-25T02:23:13.843625+0000","last_became_peered":"2024-04-25T02:23:13.843625+0000","last_unstale":"2024-04-25T02:28:12.482458+0000","last_undegraded":"2024-04-25T02:28:12.482458+0000","last_fullsized":"2024-04-25T02:28:12.482458+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":72,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"43'422","reported_seq":496,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.366583+0000","last_change":"2024-04-25T02:23:13.851184+0000","last_active":"2024-04-25T02:28:12.366583+0000","last_peered":"2024-04-25T02:28:12.366583+0000","last_clean":"2024-04-25T02:28:12.366583+0000","last_became_active":"2024-04-25T02:23:13.850845+0000","last_became_peered":"2024-04-25T02:23:13.850845+0000","last_unstale":"2024-04-25T02:28:12.366583+0000","last_undegraded":"2024-04-25T02:28:12.366583+0000","last_fullsized":"2024-04-25T02:28:12.366583+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":24672,"num_write":391,"num_write_kb":75497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"43'345","reported_seq":390,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:16.200776+0000","last_change":"2024-04-25T02:23:13.849389+0000","last_active":"2024-04-25T02:28:16.200776+0000","last_peered":"2024-04-25T02:28:16.200776+0000","last_clean":"2024-04-25T02:28:16.200776+0000","last_became_active":"2024-04-25T02:23:13.845176+0000","last_became_peered":"2024-04-25T02:23:13.845176+0000","last_unstale":"2024-04-25T02:28:16.200776+0000","last_undegraded":"2024-04-25T02:28:16.200776+0000","last_fullsized":"2024-04-25T02:28:16.200776+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10356006,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":7,"num_read_kb":10,"num_write":291,"num_write_kb":10309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"43'405","reported_seq":483,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:30.146025+0000","last_change":"2024-04-25T02:28:30.145967+0000","last_active":"2024-04-25T02:28:30.146025+0000","last_peered":"2024-04-25T02:28:30.146025+0000","last_clean":"2024-04-25T02:28:30.146025+0000","last_became_active":"2024-04-25T02:23:55.963655+0000","last_became_peered":"2024-04-25T02:23:55.963655+0000","last_unstale":"2024-04-25T02:28:30.146025+0000","last_undegraded":"2024-04-25T02:28:30.146025+0000","last_fullsized":"2024-04-25T02:28:30.146025+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'405","last_scrub_stamp":"2024-04-25T02:28:30.145854+0000","last_deep_scrub":"43'405","last_deep_scrub_stamp":"2024-04-25T02:28:30.145854+0000","last_clean_scrub_stamp":"2024-04-25T02:28:30.145854+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:49.219885+0000","scrub_duration":0.0021986240000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":11609,"num_write":365,"num_write_kb":76437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"43'493","reported_seq":542,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.542775+0000","last_change":"2024-04-25T02:23:13.839481+0000","last_active":"2024-04-25T02:28:08.542775+0000","last_peered":"2024-04-25T02:28:08.542775+0000","last_clean":"2024-04-25T02:28:08.542775+0000","last_became_active":"2024-04-25T02:23:13.839158+0000","last_became_peered":"2024-04-25T02:23:13.839158+0000","last_unstale":"2024-04-25T02:28:08.542775+0000","last_undegraded":"2024-04-25T02:28:08.542775+0000","last_fullsized":"2024-04-25T02:28:08.542775+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":493,"log_dups_size":0,"ondisk_log_size":493,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":7,"num_write":435,"num_write_kb":8384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"43'409","reported_seq":489,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.363014+0000","last_change":"2024-04-25T02:23:13.843740+0000","last_active":"2024-04-25T02:28:12.363014+0000","last_peered":"2024-04-25T02:28:12.363014+0000","last_clean":"2024-04-25T02:28:12.363014+0000","last_became_active":"2024-04-25T02:23:13.843441+0000","last_became_peered":"2024-04-25T02:23:13.843441+0000","last_unstale":"2024-04-25T02:28:12.363014+0000","last_undegraded":"2024-04-25T02:28:12.363014+0000","last_fullsized":"2024-04-25T02:28:12.363014+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":25550,"num_write":379,"num_write_kb":104949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"43'51","reported_seq":90,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.488257+0000","last_change":"2024-04-25T02:23:13.844290+0000","last_active":"2024-04-25T02:28:10.488257+0000","last_peered":"2024-04-25T02:28:10.488257+0000","last_clean":"2024-04-25T02:28:10.488257+0000","last_became_active":"2024-04-25T02:23:13.841976+0000","last_became_peered":"2024-04-25T02:23:13.841976+0000","last_unstale":"2024-04-25T02:28:10.488257+0000","last_undegraded":"2024-04-25T02:28:10.488257+0000","last_fullsized":"2024-04-25T02:28:10.488257+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"43'407","reported_seq":493,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.354407+0000","last_change":"2024-04-25T02:23:13.843455+0000","last_active":"2024-04-25T02:28:12.354407+0000","last_peered":"2024-04-25T02:28:12.354407+0000","last_clean":"2024-04-25T02:28:12.354407+0000","last_became_active":"2024-04-25T02:23:13.842163+0000","last_became_peered":"2024-04-25T02:23:13.842163+0000","last_unstale":"2024-04-25T02:28:12.354407+0000","last_undegraded":"2024-04-25T02:28:12.354407+0000","last_fullsized":"2024-04-25T02:28:12.354407+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":18209,"num_write":378,"num_write_kb":67140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"43'57","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:07.528969+0000","last_change":"2024-04-25T02:23:13.839221+0000","last_active":"2024-04-25T02:28:07.528969+0000","last_peered":"2024-04-25T02:28:07.528969+0000","last_clean":"2024-04-25T02:28:07.528969+0000","last_became_active":"2024-04-25T02:23:13.838616+0000","last_became_peered":"2024-04-25T02:23:13.838616+0000","last_unstale":"2024-04-25T02:28:07.528969+0000","last_undegraded":"2024-04-25T02:28:07.528969+0000","last_fullsized":"2024-04-25T02:28:07.528969+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"43'445","reported_seq":565,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.358482+0000","last_change":"2024-04-25T02:23:13.842908+0000","last_active":"2024-04-25T02:28:12.358482+0000","last_peered":"2024-04-25T02:28:12.358482+0000","last_clean":"2024-04-25T02:28:12.358482+0000","last_became_active":"2024-04-25T02:23:13.842649+0000","last_became_peered":"2024-04-25T02:23:13.842649+0000","last_unstale":"2024-04-25T02:28:12.358482+0000","last_undegraded":"2024-04-25T02:28:12.358482+0000","last_fullsized":"2024-04-25T02:28:12.358482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":37870,"num_write":411,"num_write_kb":80233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"43'63","reported_seq":101,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.481170+0000","last_change":"2024-04-25T02:23:11.835951+0000","last_active":"2024-04-25T02:28:12.481170+0000","last_peered":"2024-04-25T02:28:12.481170+0000","last_clean":"2024-04-25T02:28:12.481170+0000","last_became_active":"2024-04-25T02:23:11.835077+0000","last_became_peered":"2024-04-25T02:23:11.835077+0000","last_unstale":"2024-04-25T02:28:12.481170+0000","last_undegraded":"2024-04-25T02:28:12.481170+0000","last_fullsized":"2024-04-25T02:28:12.481170+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"43'390","reported_seq":521,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.354460+0000","last_change":"2024-04-25T02:23:13.843899+0000","last_active":"2024-04-25T02:28:12.354460+0000","last_peered":"2024-04-25T02:28:12.354460+0000","last_clean":"2024-04-25T02:28:12.354460+0000","last_became_active":"2024-04-25T02:23:13.843347+0000","last_became_peered":"2024-04-25T02:23:13.843347+0000","last_unstale":"2024-04-25T02:28:12.354460+0000","last_undegraded":"2024-04-25T02:28:12.354460+0000","last_fullsized":"2024-04-25T02:28:12.354460+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":42863,"num_write":360,"num_write_kb":59443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"43'199","reported_seq":237,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.513156+0000","last_change":"2024-04-25T02:23:11.839659+0000","last_active":"2024-04-25T02:28:10.513156+0000","last_peered":"2024-04-25T02:28:10.513156+0000","last_clean":"2024-04-25T02:28:10.513156+0000","last_became_active":"2024-04-25T02:23:11.839157+0000","last_became_peered":"2024-04-25T02:23:11.839157+0000","last_unstale":"2024-04-25T02:28:10.513156+0000","last_undegraded":"2024-04-25T02:28:10.513156+0000","last_fullsized":"2024-04-25T02:28:10.513156+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":142,"num_write_kb":4183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"43'404","reported_seq":471,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.368273+0000","last_change":"2024-04-25T02:23:13.841226+0000","last_active":"2024-04-25T02:28:12.368273+0000","last_peered":"2024-04-25T02:28:12.368273+0000","last_clean":"2024-04-25T02:28:12.368273+0000","last_became_active":"2024-04-25T02:23:13.840951+0000","last_became_peered":"2024-04-25T02:23:13.840951+0000","last_unstale":"2024-04-25T02:28:12.368273+0000","last_undegraded":"2024-04-25T02:28:12.368273+0000","last_fullsized":"2024-04-25T02:28:12.368273+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12931,"num_write":370,"num_write_kb":42530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"43'366","reported_seq":411,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.503886+0000","last_change":"2024-04-25T02:23:12.848098+0000","last_active":"2024-04-25T02:28:08.503886+0000","last_peered":"2024-04-25T02:28:08.503886+0000","last_clean":"2024-04-25T02:28:08.503886+0000","last_became_active":"2024-04-25T02:23:12.847813+0000","last_became_peered":"2024-04-25T02:23:12.847813+0000","last_unstale":"2024-04-25T02:28:08.503886+0000","last_undegraded":"2024-04-25T02:28:08.503886+0000","last_fullsized":"2024-04-25T02:28:08.503886+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":311,"num_write_kb":4273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"43'442","reported_seq":492,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.365654+0000","last_change":"2024-04-25T02:23:55.963573+0000","last_active":"2024-04-25T02:28:12.365654+0000","last_peered":"2024-04-25T02:28:12.365654+0000","last_clean":"2024-04-25T02:28:12.365654+0000","last_became_active":"2024-04-25T02:23:55.963234+0000","last_became_peered":"2024-04-25T02:23:55.963234+0000","last_unstale":"2024-04-25T02:28:12.365654+0000","last_undegraded":"2024-04-25T02:28:12.365654+0000","last_fullsized":"2024-04-25T02:28:12.365654+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21039,"num_write":415,"num_write_kb":62968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"43'594","reported_seq":638,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.556488+0000","last_change":"2024-04-25T02:23:13.848143+0000","last_active":"2024-04-25T02:28:09.556488+0000","last_peered":"2024-04-25T02:28:09.556488+0000","last_clean":"2024-04-25T02:28:09.556488+0000","last_became_active":"2024-04-25T02:23:13.843704+0000","last_became_peered":"2024-04-25T02:23:13.843704+0000","last_unstale":"2024-04-25T02:28:09.556488+0000","last_undegraded":"2024-04-25T02:28:09.556488+0000","last_fullsized":"2024-04-25T02:28:09.556488+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":532,"num_write_kb":4350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"43'411","reported_seq":497,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.367461+0000","last_change":"2024-04-25T02:23:13.847842+0000","last_active":"2024-04-25T02:28:12.367461+0000","last_peered":"2024-04-25T02:28:12.367461+0000","last_clean":"2024-04-25T02:28:12.367461+0000","last_became_active":"2024-04-25T02:23:13.845782+0000","last_became_peered":"2024-04-25T02:23:13.845782+0000","last_unstale":"2024-04-25T02:28:12.367461+0000","last_undegraded":"2024-04-25T02:28:12.367461+0000","last_fullsized":"2024-04-25T02:28:12.367461+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":24562,"num_write":375,"num_write_kb":59351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"43'59","reported_seq":98,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.520722+0000","last_change":"2024-04-25T02:23:13.842426+0000","last_active":"2024-04-25T02:28:09.520722+0000","last_peered":"2024-04-25T02:28:09.520722+0000","last_clean":"2024-04-25T02:28:09.520722+0000","last_became_active":"2024-04-25T02:23:13.841815+0000","last_became_peered":"2024-04-25T02:23:13.841815+0000","last_unstale":"2024-04-25T02:28:09.520722+0000","last_undegraded":"2024-04-25T02:28:09.520722+0000","last_fullsized":"2024-04-25T02:28:09.520722+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"43'457","reported_seq":574,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.366373+0000","last_change":"2024-04-25T02:23:11.839840+0000","last_active":"2024-04-25T02:28:12.366373+0000","last_peered":"2024-04-25T02:28:12.366373+0000","last_clean":"2024-04-25T02:28:12.366373+0000","last_became_active":"2024-04-25T02:23:11.837258+0000","last_became_peered":"2024-04-25T02:23:11.837258+0000","last_unstale":"2024-04-25T02:28:12.366373+0000","last_undegraded":"2024-04-25T02:28:12.366373+0000","last_fullsized":"2024-04-25T02:28:12.366373+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":40530,"num_write":421,"num_write_kb":133096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"43'128","reported_seq":176,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.545027+0000","last_change":"2024-04-25T02:23:13.838948+0000","last_active":"2024-04-25T02:28:08.545027+0000","last_peered":"2024-04-25T02:28:08.545027+0000","last_clean":"2024-04-25T02:28:08.545027+0000","last_became_active":"2024-04-25T02:23:13.838665+0000","last_became_peered":"2024-04-25T02:23:13.838665+0000","last_unstale":"2024-04-25T02:28:08.545027+0000","last_undegraded":"2024-04-25T02:28:08.545027+0000","last_fullsized":"2024-04-25T02:28:08.545027+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":128,"log_dups_size":0,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":66,"num_write_kb":8229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"43'438","reported_seq":526,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.101612+0000","last_change":"2024-04-25T02:28:28.101582+0000","last_active":"2024-04-25T02:28:28.101612+0000","last_peered":"2024-04-25T02:28:28.101612+0000","last_clean":"2024-04-25T02:28:28.101612+0000","last_became_active":"2024-04-25T02:23:55.963557+0000","last_became_peered":"2024-04-25T02:23:55.963557+0000","last_unstale":"2024-04-25T02:28:28.101612+0000","last_undegraded":"2024-04-25T02:28:28.101612+0000","last_fullsized":"2024-04-25T02:28:28.101612+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'438","last_scrub_stamp":"2024-04-25T02:28:28.101477+0000","last_deep_scrub":"43'438","last_deep_scrub_stamp":"2024-04-25T02:28:28.101477+0000","last_clean_scrub_stamp":"2024-04-25T02:28:28.101477+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:13:04.055307+0000","scrub_duration":0.0022093569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":25759,"num_write":403,"num_write_kb":59138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"43'254","reported_seq":297,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.519109+0000","last_change":"2024-04-25T02:23:13.843937+0000","last_active":"2024-04-25T02:28:09.519109+0000","last_peered":"2024-04-25T02:28:09.519109+0000","last_clean":"2024-04-25T02:28:09.519109+0000","last_became_active":"2024-04-25T02:23:13.843652+0000","last_became_peered":"2024-04-25T02:23:13.843652+0000","last_unstale":"2024-04-25T02:28:09.519109+0000","last_undegraded":"2024-04-25T02:28:09.519109+0000","last_fullsized":"2024-04-25T02:28:09.519109+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":254,"log_dups_size":0,"ondisk_log_size":254,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":4213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"43'389","reported_seq":423,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.367602+0000","last_change":"2024-04-25T02:23:56.302316+0000","last_active":"2024-04-25T02:28:12.367602+0000","last_peered":"2024-04-25T02:28:12.367602+0000","last_clean":"2024-04-25T02:28:12.367602+0000","last_became_active":"2024-04-25T02:23:56.301997+0000","last_became_peered":"2024-04-25T02:23:56.301997+0000","last_unstale":"2024-04-25T02:28:12.367602+0000","last_undegraded":"2024-04-25T02:28:12.367602+0000","last_fullsized":"2024-04-25T02:28:12.367602+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13585,"num_write":362,"num_write_kb":34032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"43'63","reported_seq":103,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.518277+0000","last_change":"2024-04-25T02:23:13.842533+0000","last_active":"2024-04-25T02:28:08.518277+0000","last_peered":"2024-04-25T02:28:08.518277+0000","last_clean":"2024-04-25T02:28:08.518277+0000","last_became_active":"2024-04-25T02:23:13.841049+0000","last_became_peered":"2024-04-25T02:23:13.841049+0000","last_unstale":"2024-04-25T02:28:08.518277+0000","last_undegraded":"2024-04-25T02:28:08.518277+0000","last_fullsized":"2024-04-25T02:28:08.518277+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"43'360","reported_seq":433,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:29.186993+0000","last_change":"2024-04-25T02:28:29.186947+0000","last_active":"2024-04-25T02:28:29.186993+0000","last_peered":"2024-04-25T02:28:29.186993+0000","last_clean":"2024-04-25T02:28:29.186993+0000","last_became_active":"2024-04-25T02:23:13.846425+0000","last_became_peered":"2024-04-25T02:23:13.846425+0000","last_unstale":"2024-04-25T02:28:29.186993+0000","last_undegraded":"2024-04-25T02:28:29.186993+0000","last_fullsized":"2024-04-25T02:28:29.186993+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'360","last_scrub_stamp":"2024-04-25T02:28:29.186834+0000","last_deep_scrub":"43'360","last_deep_scrub_stamp":"2024-04-25T02:28:29.186834+0000","last_clean_scrub_stamp":"2024-04-25T02:28:29.186834+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:38:30.162583+0000","scrub_duration":0.002422633,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":12898,"num_write":328,"num_write_kb":42412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"43'565","reported_seq":608,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.497795+0000","last_change":"2024-04-25T02:23:13.841178+0000","last_active":"2024-04-25T02:28:08.497795+0000","last_peered":"2024-04-25T02:28:08.497795+0000","last_clean":"2024-04-25T02:28:08.497795+0000","last_became_active":"2024-04-25T02:23:13.840876+0000","last_became_peered":"2024-04-25T02:23:13.840876+0000","last_unstale":"2024-04-25T02:28:08.497795+0000","last_undegraded":"2024-04-25T02:28:08.497795+0000","last_fullsized":"2024-04-25T02:28:08.497795+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":565,"log_dups_size":0,"ondisk_log_size":565,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":506,"num_write_kb":4331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"43'387","reported_seq":465,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.365549+0000","last_change":"2024-04-25T02:23:13.852754+0000","last_active":"2024-04-25T02:28:12.365549+0000","last_peered":"2024-04-25T02:28:12.365549+0000","last_clean":"2024-04-25T02:28:12.365549+0000","last_became_active":"2024-04-25T02:23:13.852398+0000","last_became_peered":"2024-04-25T02:23:13.852398+0000","last_unstale":"2024-04-25T02:28:12.365549+0000","last_undegraded":"2024-04-25T02:28:12.365549+0000","last_fullsized":"2024-04-25T02:28:12.365549+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":28255,"num_write":354,"num_write_kb":58406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:25:10.065939+0000","last_change":"2024-04-25T02:23:11.834419+0000","last_active":"2024-04-25T02:25:10.065939+0000","last_peered":"2024-04-25T02:25:10.065939+0000","last_clean":"2024-04-25T02:25:10.065939+0000","last_became_active":"2024-04-25T02:23:11.834171+0000","last_became_peered":"2024-04-25T02:23:11.834171+0000","last_unstale":"2024-04-25T02:25:10.065939+0000","last_undegraded":"2024-04-25T02:25:10.065939+0000","last_fullsized":"2024-04-25T02:25:10.065939+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"43'432","reported_seq":478,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:32.100599+0000","last_change":"2024-04-25T02:28:32.100572+0000","last_active":"2024-04-25T02:28:32.100599+0000","last_peered":"2024-04-25T02:28:32.100599+0000","last_clean":"2024-04-25T02:28:32.100599+0000","last_became_active":"2024-04-25T02:23:13.847970+0000","last_became_peered":"2024-04-25T02:23:13.847970+0000","last_unstale":"2024-04-25T02:28:32.100599+0000","last_undegraded":"2024-04-25T02:28:32.100599+0000","last_fullsized":"2024-04-25T02:28:32.100599+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'432","last_scrub_stamp":"2024-04-25T02:28:32.100463+0000","last_deep_scrub":"43'432","last_deep_scrub_stamp":"2024-04-25T02:28:32.100463+0000","last_clean_scrub_stamp":"2024-04-25T02:28:32.100463+0000","objects_scrubbed":2,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:01:10.912094+0000","scrub_duration":0.014522729,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":371,"num_write_kb":4349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"43'357","reported_seq":420,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:22.964197+0000","last_change":"2024-04-25T02:28:22.964168+0000","last_active":"2024-04-25T02:28:22.964197+0000","last_peered":"2024-04-25T02:28:22.964197+0000","last_clean":"2024-04-25T02:28:22.964197+0000","last_became_active":"2024-04-25T02:23:13.849556+0000","last_became_peered":"2024-04-25T02:23:13.849556+0000","last_unstale":"2024-04-25T02:28:22.964197+0000","last_undegraded":"2024-04-25T02:28:22.964197+0000","last_fullsized":"2024-04-25T02:28:22.964197+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'357","last_scrub_stamp":"2024-04-25T02:28:22.964054+0000","last_deep_scrub":"43'357","last_deep_scrub_stamp":"2024-04-25T02:28:22.964054+0000","last_clean_scrub_stamp":"2024-04-25T02:28:22.964054+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:33:24.355131+0000","scrub_duration":0.002218271,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8777,"num_write":323,"num_write_kb":25948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:25:10.069025+0000","last_change":"2024-04-25T02:23:13.848430+0000","last_active":"2024-04-25T02:25:10.069025+0000","last_peered":"2024-04-25T02:25:10.069025+0000","last_clean":"2024-04-25T02:25:10.069025+0000","last_became_active":"2024-04-25T02:23:13.847888+0000","last_became_peered":"2024-04-25T02:23:13.847888+0000","last_unstale":"2024-04-25T02:25:10.069025+0000","last_undegraded":"2024-04-25T02:25:10.069025+0000","last_fullsized":"2024-04-25T02:25:10.069025+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"43'70","reported_seq":112,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.506972+0000","last_change":"2024-04-25T02:23:12.848598+0000","last_active":"2024-04-25T02:28:10.506972+0000","last_peered":"2024-04-25T02:28:10.506972+0000","last_clean":"2024-04-25T02:28:10.506972+0000","last_became_active":"2024-04-25T02:23:12.848312+0000","last_became_peered":"2024-04-25T02:23:12.848312+0000","last_unstale":"2024-04-25T02:28:10.506972+0000","last_undegraded":"2024-04-25T02:28:10.506972+0000","last_fullsized":"2024-04-25T02:28:10.506972+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"43'385","reported_seq":467,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.360578+0000","last_change":"2024-04-25T02:23:12.842182+0000","last_active":"2024-04-25T02:28:12.360578+0000","last_peered":"2024-04-25T02:28:12.360578+0000","last_clean":"2024-04-25T02:28:12.360578+0000","last_became_active":"2024-04-25T02:23:12.841408+0000","last_became_peered":"2024-04-25T02:23:12.841408+0000","last_unstale":"2024-04-25T02:28:12.360578+0000","last_undegraded":"2024-04-25T02:28:12.360578+0000","last_fullsized":"2024-04-25T02:28:12.360578+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":27937,"num_write":348,"num_write_kb":51359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":34,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:25:10.067085+0000","last_change":"2024-04-25T02:23:13.848743+0000","last_active":"2024-04-25T02:25:10.067085+0000","last_peered":"2024-04-25T02:25:10.067085+0000","last_clean":"2024-04-25T02:25:10.067085+0000","last_became_active":"2024-04-25T02:23:13.848076+0000","last_became_peered":"2024-04-25T02:23:13.848076+0000","last_unstale":"2024-04-25T02:25:10.067085+0000","last_undegraded":"2024-04-25T02:25:10.067085+0000","last_fullsized":"2024-04-25T02:25:10.067085+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"43'394","reported_seq":429,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.513323+0000","last_change":"2024-04-25T02:23:12.848506+0000","last_active":"2024-04-25T02:28:08.513323+0000","last_peered":"2024-04-25T02:28:08.513323+0000","last_clean":"2024-04-25T02:28:08.513323+0000","last_became_active":"2024-04-25T02:23:12.848229+0000","last_became_peered":"2024-04-25T02:23:12.848229+0000","last_unstale":"2024-04-25T02:28:08.513323+0000","last_undegraded":"2024-04-25T02:28:08.513323+0000","last_fullsized":"2024-04-25T02:28:08.513323+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":337,"num_write_kb":8338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"43'349","reported_seq":400,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.357426+0000","last_change":"2024-04-25T02:23:11.835239+0000","last_active":"2024-04-25T02:28:12.357426+0000","last_peered":"2024-04-25T02:28:12.357426+0000","last_clean":"2024-04-25T02:28:12.357426+0000","last_became_active":"2024-04-25T02:23:11.834994+0000","last_became_peered":"2024-04-25T02:23:11.834994+0000","last_unstale":"2024-04-25T02:28:12.357426+0000","last_undegraded":"2024-04-25T02:28:12.357426+0000","last_fullsized":"2024-04-25T02:28:12.357426+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":11931,"num_write":325,"num_write_kb":25986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":43,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:25:10.069508+0000","last_change":"2024-04-25T02:23:13.849321+0000","last_active":"2024-04-25T02:25:10.069508+0000","last_peered":"2024-04-25T02:25:10.069508+0000","last_clean":"2024-04-25T02:25:10.069508+0000","last_became_active":"2024-04-25T02:23:13.848628+0000","last_became_peered":"2024-04-25T02:23:13.848628+0000","last_unstale":"2024-04-25T02:25:10.069508+0000","last_undegraded":"2024-04-25T02:25:10.069508+0000","last_fullsized":"2024-04-25T02:25:10.069508+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"22'115","reported_seq":193,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:25:10.064467+0000","last_change":"2024-04-25T02:23:11.836134+0000","last_active":"2024-04-25T02:25:10.064467+0000","last_peered":"2024-04-25T02:25:10.064467+0000","last_clean":"2024-04-25T02:25:10.064467+0000","last_became_active":"2024-04-25T02:23:11.835430+0000","last_became_peered":"2024-04-25T02:23:11.835430+0000","last_unstale":"2024-04-25T02:25:10.064467+0000","last_undegraded":"2024-04-25T02:25:10.064467+0000","last_fullsized":"2024-04-25T02:25:10.064467+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:08.432182+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:08.432182+0000","last_clean_scrub_stamp":"2024-04-25T02:20:08.432182+0000","objects_scrubbed":0,"log_size":115,"log_dups_size":0,"ondisk_log_size":115,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"43'573","reported_seq":613,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:06.519039+0000","last_change":"2024-04-25T02:23:13.848149+0000","last_active":"2024-04-25T02:28:06.519039+0000","last_peered":"2024-04-25T02:28:06.519039+0000","last_clean":"2024-04-25T02:28:06.519039+0000","last_became_active":"2024-04-25T02:23:13.845029+0000","last_became_peered":"2024-04-25T02:23:13.845029+0000","last_unstale":"2024-04-25T02:28:06.519039+0000","last_undegraded":"2024-04-25T02:28:06.519039+0000","last_fullsized":"2024-04-25T02:28:06.519039+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":573,"log_dups_size":0,"ondisk_log_size":573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":507,"num_write_kb":8447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"43'449","reported_seq":571,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:22.192884+0000","last_change":"2024-04-25T02:28:22.192856+0000","last_active":"2024-04-25T02:28:22.192884+0000","last_peered":"2024-04-25T02:28:22.192884+0000","last_clean":"2024-04-25T02:28:22.192884+0000","last_became_active":"2024-04-25T02:23:13.844018+0000","last_became_peered":"2024-04-25T02:23:13.844018+0000","last_unstale":"2024-04-25T02:28:22.192884+0000","last_undegraded":"2024-04-25T02:28:22.192884+0000","last_fullsized":"2024-04-25T02:28:22.192884+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'449","last_scrub_stamp":"2024-04-25T02:28:22.192764+0000","last_deep_scrub":"43'449","last_deep_scrub_stamp":"2024-04-25T02:28:22.192764+0000","last_clean_scrub_stamp":"2024-04-25T02:28:22.192764+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:28.942878+0000","scrub_duration":0.0021300249999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":31679,"num_write":414,"num_write_kb":80533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:25:10.068836+0000","last_change":"2024-04-25T02:23:13.848526+0000","last_active":"2024-04-25T02:25:10.068836+0000","last_peered":"2024-04-25T02:25:10.068836+0000","last_clean":"2024-04-25T02:25:10.068836+0000","last_became_active":"2024-04-25T02:23:13.844753+0000","last_became_peered":"2024-04-25T02:23:13.844753+0000","last_unstale":"2024-04-25T02:25:10.068836+0000","last_undegraded":"2024-04-25T02:25:10.068836+0000","last_fullsized":"2024-04-25T02:25:10.068836+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"43'252","reported_seq":475,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.480206+0000","last_change":"2024-04-25T02:23:12.845945+0000","last_active":"2024-04-25T02:28:12.480206+0000","last_peered":"2024-04-25T02:28:12.480206+0000","last_clean":"2024-04-25T02:28:12.480206+0000","last_became_active":"2024-04-25T02:23:12.845638+0000","last_became_peered":"2024-04-25T02:23:12.845638+0000","last_unstale":"2024-04-25T02:28:12.480206+0000","last_undegraded":"2024-04-25T02:28:12.480206+0000","last_fullsized":"2024-04-25T02:28:12.480206+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1460763,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":182,"num_read_kb":1548,"num_write":182,"num_write_kb":1548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"43'454","reported_seq":573,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.366445+0000","last_change":"2024-04-25T02:23:11.840630+0000","last_active":"2024-04-25T02:28:12.366445+0000","last_peered":"2024-04-25T02:28:12.366445+0000","last_clean":"2024-04-25T02:28:12.366445+0000","last_became_active":"2024-04-25T02:23:11.840215+0000","last_became_peered":"2024-04-25T02:23:11.840215+0000","last_unstale":"2024-04-25T02:28:12.366445+0000","last_undegraded":"2024-04-25T02:28:12.366445+0000","last_fullsized":"2024-04-25T02:28:12.366445+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":42224,"num_write":426,"num_write_kb":96444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":50,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:25:10.069694+0000","last_change":"2024-04-25T02:23:13.845169+0000","last_active":"2024-04-25T02:25:10.069694+0000","last_peered":"2024-04-25T02:25:10.069694+0000","last_clean":"2024-04-25T02:25:10.069694+0000","last_became_active":"2024-04-25T02:23:13.841324+0000","last_became_peered":"2024-04-25T02:23:13.841324+0000","last_unstale":"2024-04-25T02:25:10.069694+0000","last_undegraded":"2024-04-25T02:25:10.069694+0000","last_fullsized":"2024-04-25T02:25:10.069694+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"43'53","reported_seq":86,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.512310+0000","last_change":"2024-04-25T02:23:12.842493+0000","last_active":"2024-04-25T02:28:10.512310+0000","last_peered":"2024-04-25T02:28:10.512310+0000","last_clean":"2024-04-25T02:28:10.512310+0000","last_became_active":"2024-04-25T02:23:12.841930+0000","last_became_peered":"2024-04-25T02:23:12.841930+0000","last_unstale":"2024-04-25T02:28:10.512310+0000","last_undegraded":"2024-04-25T02:28:10.512310+0000","last_fullsized":"2024-04-25T02:28:10.512310+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"43'427","reported_seq":586,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.347295+0000","last_change":"2024-04-25T02:23:12.848221+0000","last_active":"2024-04-25T02:28:12.347295+0000","last_peered":"2024-04-25T02:28:12.347295+0000","last_clean":"2024-04-25T02:28:12.347295+0000","last_became_active":"2024-04-25T02:23:12.847949+0000","last_became_peered":"2024-04-25T02:23:12.847949+0000","last_unstale":"2024-04-25T02:28:12.347295+0000","last_undegraded":"2024-04-25T02:28:12.347295+0000","last_fullsized":"2024-04-25T02:28:12.347295+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":62452,"num_write":394,"num_write_kb":105065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"43'65","reported_seq":109,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.480554+0000","last_change":"2024-04-25T02:23:13.844968+0000","last_active":"2024-04-25T02:28:10.480554+0000","last_peered":"2024-04-25T02:28:10.480554+0000","last_clean":"2024-04-25T02:28:10.480554+0000","last_became_active":"2024-04-25T02:23:13.844133+0000","last_became_peered":"2024-04-25T02:23:13.844133+0000","last_unstale":"2024-04-25T02:28:10.480554+0000","last_undegraded":"2024-04-25T02:28:10.480554+0000","last_fullsized":"2024-04-25T02:28:10.480554+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":33,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:25:10.066270+0000","last_change":"2024-04-25T02:23:11.837086+0000","last_active":"2024-04-25T02:25:10.066270+0000","last_peered":"2024-04-25T02:25:10.066270+0000","last_clean":"2024-04-25T02:25:10.066270+0000","last_became_active":"2024-04-25T02:23:11.836737+0000","last_became_peered":"2024-04-25T02:23:11.836737+0000","last_unstale":"2024-04-25T02:25:10.066270+0000","last_undegraded":"2024-04-25T02:25:10.066270+0000","last_fullsized":"2024-04-25T02:25:10.066270+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"43'434","reported_seq":567,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.368187+0000","last_change":"2024-04-25T02:23:13.848280+0000","last_active":"2024-04-25T02:28:12.368187+0000","last_peered":"2024-04-25T02:28:12.368187+0000","last_clean":"2024-04-25T02:28:12.368187+0000","last_became_active":"2024-04-25T02:23:13.843915+0000","last_became_peered":"2024-04-25T02:23:13.843915+0000","last_unstale":"2024-04-25T02:28:12.368187+0000","last_undegraded":"2024-04-25T02:28:12.368187+0000","last_fullsized":"2024-04-25T02:28:12.368187+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":48451,"num_write":406,"num_write_kb":112597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":50,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:25:10.069269+0000","last_change":"2024-04-25T02:23:13.839018+0000","last_active":"2024-04-25T02:25:10.069269+0000","last_peered":"2024-04-25T02:25:10.069269+0000","last_clean":"2024-04-25T02:25:10.069269+0000","last_became_active":"2024-04-25T02:23:13.838746+0000","last_became_peered":"2024-04-25T02:23:13.838746+0000","last_unstale":"2024-04-25T02:25:10.069269+0000","last_undegraded":"2024-04-25T02:25:10.069269+0000","last_fullsized":"2024-04-25T02:25:10.069269+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"43'86","reported_seq":126,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:16.198349+0000","last_change":"2024-04-25T02:23:11.840837+0000","last_active":"2024-04-25T02:28:16.198349+0000","last_peered":"2024-04-25T02:28:16.198349+0000","last_clean":"2024-04-25T02:28:16.198349+0000","last_became_active":"2024-04-25T02:23:11.840553+0000","last_became_peered":"2024-04-25T02:23:11.840553+0000","last_unstale":"2024-04-25T02:28:16.198349+0000","last_undegraded":"2024-04-25T02:28:16.198349+0000","last_fullsized":"2024-04-25T02:28:16.198349+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":74,"num_write_kb":962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"43'397","reported_seq":485,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.366683+0000","last_change":"2024-04-25T02:23:13.848907+0000","last_active":"2024-04-25T02:28:12.366683+0000","last_peered":"2024-04-25T02:28:12.366683+0000","last_clean":"2024-04-25T02:28:12.366683+0000","last_became_active":"2024-04-25T02:23:13.848374+0000","last_became_peered":"2024-04-25T02:23:13.848374+0000","last_unstale":"2024-04-25T02:28:12.366683+0000","last_undegraded":"2024-04-25T02:28:12.366683+0000","last_fullsized":"2024-04-25T02:28:12.366683+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":25341,"num_write":367,"num_write_kb":104771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"43'122","reported_seq":164,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:07.500111+0000","last_change":"2024-04-25T02:23:13.842766+0000","last_active":"2024-04-25T02:28:07.500111+0000","last_peered":"2024-04-25T02:28:07.500111+0000","last_clean":"2024-04-25T02:28:07.500111+0000","last_became_active":"2024-04-25T02:23:13.842438+0000","last_became_peered":"2024-04-25T02:23:13.842438+0000","last_unstale":"2024-04-25T02:28:07.500111+0000","last_undegraded":"2024-04-25T02:28:07.500111+0000","last_fullsized":"2024-04-25T02:28:07.500111+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4196548,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"43'373","reported_seq":456,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.368180+0000","last_change":"2024-04-25T02:23:12.844587+0000","last_active":"2024-04-25T02:28:12.368180+0000","last_peered":"2024-04-25T02:28:12.368180+0000","last_clean":"2024-04-25T02:28:12.368180+0000","last_became_active":"2024-04-25T02:23:12.844258+0000","last_became_peered":"2024-04-25T02:23:12.844258+0000","last_unstale":"2024-04-25T02:28:12.368180+0000","last_undegraded":"2024-04-25T02:28:12.368180+0000","last_fullsized":"2024-04-25T02:28:12.368180+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":25157,"num_write":340,"num_write_kb":59328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"43'316","reported_seq":350,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.528093+0000","last_change":"2024-04-25T02:23:11.833629+0000","last_active":"2024-04-25T02:28:09.528093+0000","last_peered":"2024-04-25T02:28:09.528093+0000","last_clean":"2024-04-25T02:28:09.528093+0000","last_became_active":"2024-04-25T02:23:11.833348+0000","last_became_peered":"2024-04-25T02:23:11.833348+0000","last_unstale":"2024-04-25T02:28:09.528093+0000","last_undegraded":"2024-04-25T02:28:09.528093+0000","last_fullsized":"2024-04-25T02:28:09.528093+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":262,"num_write_kb":4264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"43'371","reported_seq":471,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:20.223269+0000","last_change":"2024-04-25T02:28:20.223232+0000","last_active":"2024-04-25T02:28:20.223269+0000","last_peered":"2024-04-25T02:28:20.223269+0000","last_clean":"2024-04-25T02:28:20.223269+0000","last_became_active":"2024-04-25T02:23:55.963467+0000","last_became_peered":"2024-04-25T02:23:55.963467+0000","last_unstale":"2024-04-25T02:28:20.223269+0000","last_undegraded":"2024-04-25T02:28:20.223269+0000","last_fullsized":"2024-04-25T02:28:20.223269+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'371","last_scrub_stamp":"2024-04-25T02:28:20.223133+0000","last_deep_scrub":"43'371","last_deep_scrub_stamp":"2024-04-25T02:28:20.223133+0000","last_clean_scrub_stamp":"2024-04-25T02:28:20.223133+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:12.999404+0000","scrub_duration":0.0022911020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":32821,"num_write":343,"num_write_kb":62943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"43'323","reported_seq":371,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.489175+0000","last_change":"2024-04-25T02:23:13.842735+0000","last_active":"2024-04-25T02:28:09.489175+0000","last_peered":"2024-04-25T02:28:09.489175+0000","last_clean":"2024-04-25T02:28:09.489175+0000","last_became_active":"2024-04-25T02:23:13.840492+0000","last_became_peered":"2024-04-25T02:23:13.840492+0000","last_unstale":"2024-04-25T02:28:09.489175+0000","last_undegraded":"2024-04-25T02:28:09.489175+0000","last_fullsized":"2024-04-25T02:28:09.489175+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":257,"num_write_kb":12449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"43'384","reported_seq":454,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:25.236814+0000","last_change":"2024-04-25T02:28:25.236776+0000","last_active":"2024-04-25T02:28:25.236814+0000","last_peered":"2024-04-25T02:28:25.236814+0000","last_clean":"2024-04-25T02:28:25.236814+0000","last_became_active":"2024-04-25T02:23:13.847264+0000","last_became_peered":"2024-04-25T02:23:13.847264+0000","last_unstale":"2024-04-25T02:28:25.236814+0000","last_undegraded":"2024-04-25T02:28:25.236814+0000","last_fullsized":"2024-04-25T02:28:25.236814+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'384","last_scrub_stamp":"2024-04-25T02:28:25.236669+0000","last_deep_scrub":"43'384","last_deep_scrub_stamp":"2024-04-25T02:28:25.236669+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.236669+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:51.748406+0000","scrub_duration":0.002112685,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":15655,"num_write":352,"num_write_kb":42131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"43'93","reported_seq":133,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.558208+0000","last_change":"2024-04-25T02:23:13.848227+0000","last_active":"2024-04-25T02:28:09.558208+0000","last_peered":"2024-04-25T02:28:09.558208+0000","last_clean":"2024-04-25T02:28:09.558208+0000","last_became_active":"2024-04-25T02:23:13.845143+0000","last_became_peered":"2024-04-25T02:23:13.845143+0000","last_unstale":"2024-04-25T02:28:09.558208+0000","last_undegraded":"2024-04-25T02:28:09.558208+0000","last_fullsized":"2024-04-25T02:28:09.558208+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":4121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"43'427","reported_seq":462,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.348849+0000","last_change":"2024-04-25T02:23:55.957176+0000","last_active":"2024-04-25T02:28:12.348849+0000","last_peered":"2024-04-25T02:28:12.348849+0000","last_clean":"2024-04-25T02:28:12.348849+0000","last_became_active":"2024-04-25T02:23:55.956828+0000","last_became_peered":"2024-04-25T02:23:55.956828+0000","last_unstale":"2024-04-25T02:28:12.348849+0000","last_undegraded":"2024-04-25T02:28:12.348849+0000","last_fullsized":"2024-04-25T02:28:12.348849+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":14079,"num_write":394,"num_write_kb":87521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"43'114","reported_seq":160,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:20.198034+0000","last_change":"2024-04-25T02:28:20.198001+0000","last_active":"2024-04-25T02:28:20.198034+0000","last_peered":"2024-04-25T02:28:20.198034+0000","last_clean":"2024-04-25T02:28:20.198034+0000","last_became_active":"2024-04-25T02:23:11.838807+0000","last_became_peered":"2024-04-25T02:23:11.838807+0000","last_unstale":"2024-04-25T02:28:20.198034+0000","last_undegraded":"2024-04-25T02:28:20.198034+0000","last_fullsized":"2024-04-25T02:28:20.198034+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'114","last_scrub_stamp":"2024-04-25T02:28:20.197907+0000","last_deep_scrub":"43'114","last_deep_scrub_stamp":"2024-04-25T02:28:20.197907+0000","last_clean_scrub_stamp":"2024-04-25T02:28:20.197907+0000","objects_scrubbed":3,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:47:55.330863+0000","scrub_duration":0.011784594000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":59,"num_write_kb":4127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"43'447","reported_seq":521,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.367783+0000","last_change":"2024-04-25T02:23:12.845755+0000","last_active":"2024-04-25T02:28:12.367783+0000","last_peered":"2024-04-25T02:28:12.367783+0000","last_clean":"2024-04-25T02:28:12.367783+0000","last_became_active":"2024-04-25T02:23:12.845497+0000","last_became_peered":"2024-04-25T02:23:12.845497+0000","last_unstale":"2024-04-25T02:28:12.367783+0000","last_undegraded":"2024-04-25T02:28:12.367783+0000","last_fullsized":"2024-04-25T02:28:12.367783+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15742,"num_write":414,"num_write_kb":51315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"43'419","reported_seq":485,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.369706+0000","last_change":"2024-04-25T02:23:12.847086+0000","last_active":"2024-04-25T02:28:12.369706+0000","last_peered":"2024-04-25T02:28:12.369706+0000","last_clean":"2024-04-25T02:28:12.369706+0000","last_became_active":"2024-04-25T02:23:12.846719+0000","last_became_peered":"2024-04-25T02:23:12.846719+0000","last_unstale":"2024-04-25T02:28:12.369706+0000","last_undegraded":"2024-04-25T02:28:12.369706+0000","last_fullsized":"2024-04-25T02:28:12.369706+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":16944,"num_write":389,"num_write_kb":35957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"43'440","reported_seq":485,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.367687+0000","last_change":"2024-04-25T02:23:56.302118+0000","last_active":"2024-04-25T02:28:12.367687+0000","last_peered":"2024-04-25T02:28:12.367687+0000","last_clean":"2024-04-25T02:28:12.367687+0000","last_became_active":"2024-04-25T02:23:56.301745+0000","last_became_peered":"2024-04-25T02:23:56.301745+0000","last_unstale":"2024-04-25T02:28:12.367687+0000","last_undegraded":"2024-04-25T02:28:12.367687+0000","last_fullsized":"2024-04-25T02:28:12.367687+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":12557,"num_write":410,"num_write_kb":77332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"43'492","reported_seq":571,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:24.176583+0000","last_change":"2024-04-25T02:28:24.176533+0000","last_active":"2024-04-25T02:28:24.176583+0000","last_peered":"2024-04-25T02:28:24.176583+0000","last_clean":"2024-04-25T02:28:24.176583+0000","last_became_active":"2024-04-25T02:23:13.844235+0000","last_became_peered":"2024-04-25T02:23:13.844235+0000","last_unstale":"2024-04-25T02:28:24.176583+0000","last_undegraded":"2024-04-25T02:28:24.176583+0000","last_fullsized":"2024-04-25T02:28:24.176583+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'492","last_scrub_stamp":"2024-04-25T02:28:24.176384+0000","last_deep_scrub":"43'492","last_deep_scrub_stamp":"2024-04-25T02:28:24.176384+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.176384+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:15.054028+0000","scrub_duration":0.002556961,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14237,"num_write":458,"num_write_kb":116854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"43'392","reported_seq":472,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.363169+0000","last_change":"2024-04-25T02:23:13.849525+0000","last_active":"2024-04-25T02:28:12.363169+0000","last_peered":"2024-04-25T02:28:12.363169+0000","last_clean":"2024-04-25T02:28:12.363169+0000","last_became_active":"2024-04-25T02:23:13.845193+0000","last_became_peered":"2024-04-25T02:23:13.845193+0000","last_unstale":"2024-04-25T02:28:12.363169+0000","last_undegraded":"2024-04-25T02:28:12.363169+0000","last_fullsized":"2024-04-25T02:28:12.363169+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":36152,"num_write":360,"num_write_kb":54497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"43'402","reported_seq":504,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.360499+0000","last_change":"2024-04-25T02:23:12.842342+0000","last_active":"2024-04-25T02:28:12.360499+0000","last_peered":"2024-04-25T02:28:12.360499+0000","last_clean":"2024-04-25T02:28:12.360499+0000","last_became_active":"2024-04-25T02:23:12.841677+0000","last_became_peered":"2024-04-25T02:23:12.841677+0000","last_unstale":"2024-04-25T02:28:12.360499+0000","last_undegraded":"2024-04-25T02:28:12.360499+0000","last_fullsized":"2024-04-25T02:28:12.360499+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":32628,"num_write":375,"num_write_kb":79888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2779,"num_read_kb":1446401,"num_write":24390,"num_write_kb":4320360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26350,"ondisk_log_size":26350,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":129261049,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":231,"num_read_kb":1603,"num_write":6644,"num_write_kb":130848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":258629632,"data_stored":258522098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39115,"internal_metadata":0},"log_size":8488,"ondisk_log_size":8488,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":115,"ondisk_log_size":115,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":31,"seq":133143986243,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":389724,"kb_used_data":88340,"kb_used_omap":9,"kb_used_meta":301366,"kb_avail":93982116,"statfs":{"total":96636764160,"available":96237686784,"internally_reserved":0,"allocated":90460160,"data_stored":90216632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9975,"internal_metadata":308599049},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.22,"5min":0.33600000000000002,"15min":0.33400000000000002},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.33400000000000002,"5min":3.5409999999999999,"15min":3.5409999999999999},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.25600000000000001,"5min":0.39000000000000001,"15min":0.36299999999999999},"min":{"1min":0.20100000000000001,"5min":0.161,"15min":0.161},"max":{"1min":0.38200000000000001,"5min":3.613,"15min":3.613},"last":0.36299999999999999}]},{"osd":1,"last update":"Thu Apr 25 02:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.27800000000000002,"5min":0.374,"15min":0.35999999999999999},"min":{"1min":0.19900000000000001,"5min":0.184,"15min":0.184},"max":{"1min":0.86799999999999999,"5min":3.0009999999999999,"15min":3.0009999999999999},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.27200000000000002,"5min":0.38,"15min":0.36699999999999999},"min":{"1min":0.20899999999999999,"5min":0.157,"15min":0.157},"max":{"1min":0.36899999999999999,"5min":4.9720000000000004,"15min":4.9720000000000004},"last":0.33300000000000002}]},{"osd":2,"last update":"Thu Apr 25 02:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.28000000000000003,"5min":0.41599999999999998,"15min":0.375},"min":{"1min":0.182,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.41699999999999998,"5min":4.883,"15min":4.883},"last":0.313},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.39400000000000002,"15min":0.38200000000000001},"min":{"1min":0.214,"5min":0.184,"15min":0.184},"max":{"1min":1.004,"5min":3.0550000000000002,"15min":3.0550000000000002},"last":0.34899999999999998}]}]},{"osd":2,"up_from":30,"seq":128849018947,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":362388,"kb_used_data":56972,"kb_used_omap":8,"kb_used_meta":305399,"kb_avail":94009452,"statfs":{"total":96636764160,"available":96265678848,"internally_reserved":0,"allocated":58339328,"data_stored":58119882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8387,"internal_metadata":312729405},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:28:19 2024","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.32000000000000001,"15min":0.32200000000000001},"min":{"1min":0.16600000000000001,"5min":0.14199999999999999,"15min":0.14199999999999999},"max":{"1min":2.419,"5min":2.419,"15min":2.419},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.28100000000000003,"5min":0.316,"15min":0.32600000000000001},"min":{"1min":0.192,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.45800000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"last":0.39300000000000002}]},{"osd":1,"last update":"Thu Apr 25 02:28:19 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.19600000000000001,"5min":0.19,"15min":0.19},"max":{"1min":0.89500000000000002,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.314,"5min":0.34499999999999997,"15min":0.34699999999999998},"min":{"1min":0.20399999999999999,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.58899999999999997,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.435}]},{"osd":3,"last update":"Thu Apr 25 02:28:19 2024","interfaces":[{"interface":"back","average":{"1min":0.29699999999999999,"5min":0.34100000000000003,"15min":0.35099999999999998},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.49099999999999999,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.39100000000000001,"15min":0.39900000000000002},"min":{"1min":0.26000000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.55900000000000005,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.48199999999999998}]}]},{"osd":0,"up_from":28,"seq":120259084355,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369380,"kb_used_data":59740,"kb_used_omap":15,"kb_used_meta":309616,"kb_avail":94002460,"statfs":{"total":96636764160,"available":96258519040,"internally_reserved":0,"allocated":61173760,"data_stored":60940630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15790,"internal_metadata":317047378},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 25 02:28:16 2024","interfaces":[{"interface":"back","average":{"1min":0.245,"5min":0.30599999999999999,"15min":0.33000000000000002},"min":{"1min":0.157,"5min":0.14799999999999999,"15min":0.14799999999999999},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.27500000000000002},{"interface":"front","average":{"1min":0.29999999999999999,"5min":0.33300000000000002,"15min":0.35399999999999998},"min":{"1min":0.192,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.34000000000000002}]},{"osd":2,"last update":"Thu Apr 25 02:28:16 2024","interfaces":[{"interface":"back","average":{"1min":0.28299999999999997,"5min":0.34300000000000003,"15min":0.371},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.311,"5min":0.34899999999999998,"15min":0.378},"min":{"1min":0.20499999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.29299999999999998}]},{"osd":3,"last update":"Thu Apr 25 02:28:26 2024","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.374,"15min":0.378},"min":{"1min":0.217,"5min":0.186,"15min":0.186},"max":{"1min":0.433,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":0.38400000000000001},{"interface":"front","average":{"1min":0.315,"5min":0.375,"15min":0.41299999999999998},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.52100000000000002,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.374}]}]},{"osd":1,"up_from":29,"seq":124554051651,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":347452,"kb_used_data":50100,"kb_used_omap":4,"kb_used_meta":297339,"kb_avail":94024388,"statfs":{"total":96636764160,"available":96280973312,"internally_reserved":0,"allocated":51302400,"data_stored":51088318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4963,"internal_metadata":304475293},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:28:13 2024","interfaces":[{"interface":"back","average":{"1min":0.23499999999999999,"5min":0.29299999999999998,"15min":0.32100000000000001},"min":{"1min":0.16700000000000001,"5min":0.155,"15min":0.155},"max":{"1min":0.36699999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.26600000000000001,"5min":0.314,"15min":0.34399999999999997},"min":{"1min":0.189,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.40699999999999997,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.27600000000000002}]},{"osd":2,"last update":"Thu Apr 25 02:28:13 2024","interfaces":[{"interface":"back","average":{"1min":0.26200000000000001,"5min":0.32600000000000001,"15min":0.34599999999999997},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.33900000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.27300000000000002,"5min":0.34100000000000003,"15min":0.35699999999999998},"min":{"1min":0.20399999999999999,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.35099999999999998,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.35499999999999998}]},{"osd":3,"last update":"Thu Apr 25 02:28:13 2024","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.36099999999999999,"15min":0.39000000000000001},"min":{"1min":0.222,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.40500000000000003,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.378},{"interface":"front","average":{"1min":0.28000000000000003,"5min":0.35499999999999998,"15min":0.38300000000000001},"min":{"1min":0.20599999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.38300000000000001,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.38900000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":60215296,"data_stored":60184605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15790,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":50343936,"data_stored":50332293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4963,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57974784,"data_stored":57954225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8387,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90095616,"data_stored":90050975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9975,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:28:40.134 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.134 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.134 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.134 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.134 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.134 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.135 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.135 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.135 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.135 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.135 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.135 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.135 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.135 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.135 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.136 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.136 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.136 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.136 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.136 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.136 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.136 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.136 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.137 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.137 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.137 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.137 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.137 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.137 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.137 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.137 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.138 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.138 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.138 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.138 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.138 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.138 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.138 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.138 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.139 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.139 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.139 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.139 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.139 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.139 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.139 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.139 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.139 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.140 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.140 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.140 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.140 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.140 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.140 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.140 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.140 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.141 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.141 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-25T02:20:14.468721+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.141 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-25T02:20:14.468721+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.141 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.141 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.141 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-25T02:20:14.468721+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.141 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.141 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.141 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-25T02:20:14.468721+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.142 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-25T02:20:08.432182+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=8, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.142 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.142 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-25T02:20:14.468721+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.142 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.142 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.142 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-25T02:20:14.468721+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.142 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.142 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.142 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.143 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-25T02:20:14.468721+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.143 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.143 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-25T02:20:14.468721+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.143 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.143 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.143 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.143 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.143 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.143 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.143 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.144 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.144 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.144 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.144 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.144 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.144 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:28:40.144 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T02:29:00.145 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:29:00.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.273+0000 7f8dd938b700 1 Processor -- start 2024-04-25T02:29:00.277 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.273+0000 7f8dd938b700 1 -- start start 2024-04-25T02:29:00.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.274+0000 7f8dd938b700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8dd4063c00 0x7f8dd40ac2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:00.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.274+0000 7f8dd938b700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f8dd4139cf0 0x7f8dd40a5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:00.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.274+0000 7f8dd938b700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8dd40ada20 con 0x7f8dd40a5b10 2024-04-25T02:29:00.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.274+0000 7f8dd938b700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8dd4063fd0 con 0x7f8dd4139cf0 2024-04-25T02:29:00.279 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.274+0000 7f8dd938b700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd40aad40 con 0x7f8dd4063c00 2024-04-25T02:29:00.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.274+0000 7f8dd2ffd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8dd4063c00 0x7f8dd40ac2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:00.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.274+0000 7f8dd37fe700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f8dd4139cf0 0x7f8dd40a5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:00.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.274+0000 7f8dd2ffd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8dd4063c00 0x7f8dd40ac2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:44098/0 (socket says 172.21.15.111:44098) 2024-04-25T02:29:00.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.274+0000 7f8dd2ffd700 1 -- 172.21.15.111:0/1482170984 learned_addr learned my addr 172.21.15.111:0/1482170984 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:29:00.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.274+0000 7f8dd27fc700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f8dd40a5b10 0x7f8dd41395e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:48134/0 (socket says 172.21.15.111:48134) 2024-04-25T02:29:00.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.274+0000 7f8dd2ffd700 1 -- 172.21.15.111:0/1482170984 >> v2:172.21.15.111:3300/0 conn(0x7f8dd4139cf0 msgr2=0x7f8dd40a5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:00.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.274+0000 7f8dd2ffd700 1 --2- 172.21.15.111:0/1482170984 >> v2:172.21.15.111:3300/0 conn(0x7f8dd4139cf0 0x7f8dd40a5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:00.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.274+0000 7f8dd2ffd700 1 -- 172.21.15.111:0/1482170984 >> v1:172.21.15.111:6789/0 conn(0x7f8dd40a5b10 legacy=0x7f8dd41395e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:00.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.274+0000 7f8dd2ffd700 1 -- 172.21.15.111:0/1482170984 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd40ab000 con 0x7f8dd4063c00 2024-04-25T02:29:00.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.274+0000 7f8dd1ffb700 1 -- 172.21.15.111:0/1482170984 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2461574258 0 0) 0x7f8dd40ada20 con 0x7f8dd40a5b10 2024-04-25T02:29:00.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.274+0000 7f8dd37fe700 1 --2- 172.21.15.111:0/1482170984 >> v2:172.21.15.111:3300/0 conn(0x7f8dd4139cf0 0x7f8dd40a5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:29:00.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.274+0000 7f8dd2ffd700 1 --2- 172.21.15.111:0/1482170984 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8dd4063c00 0x7f8dd40ac2b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8dc80099b0 tx=0x7f8dc8009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d1a72632a2e049a3 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:00.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.275+0000 7f8dd1ffb700 1 -- 172.21.15.111:0/1482170984 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc8009ea0 con 0x7f8dd4063c00 2024-04-25T02:29:00.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.275+0000 7f8dd1ffb700 1 -- 172.21.15.111:0/1482170984 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc800b860 con 0x7f8dd4063c00 2024-04-25T02:29:00.280 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.275+0000 7f8dd1ffb700 1 -- 172.21.15.111:0/1482170984 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc800bc00 con 0x7f8dd4063c00 2024-04-25T02:29:00.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.275+0000 7f8dd938b700 1 -- 172.21.15.111:0/1482170984 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8dd4063c00 msgr2=0x7f8dd40ac2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:00.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.275+0000 7f8dd938b700 1 --2- 172.21.15.111:0/1482170984 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8dd4063c00 0x7f8dd40ac2b0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f8dc80099b0 tx=0x7f8dc8009250 comp rx=0 tx=0).stop 2024-04-25T02:29:00.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.275+0000 7f8dd938b700 1 -- 172.21.15.111:0/1482170984 shutdown_connections 2024-04-25T02:29:00.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.275+0000 7f8dd938b700 1 --2- 172.21.15.111:0/1482170984 >> v2:172.21.15.111:3300/0 conn(0x7f8dd4139cf0 0x7f8dd40a5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:00.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.275+0000 7f8dd938b700 1 --2- 172.21.15.111:0/1482170984 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8dd4063c00 0x7f8dd40ac2b0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:00.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.275+0000 7f8dd938b700 1 -- 172.21.15.111:0/1482170984 >> 172.21.15.111:0/1482170984 conn(0x7f8dd40b1390 msgr2=0x7f8dd40b1760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:00.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.275+0000 7f8dd938b700 1 -- 172.21.15.111:0/1482170984 shutdown_connections 2024-04-25T02:29:00.281 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.275+0000 7f8dd938b700 1 -- 172.21.15.111:0/1482170984 wait complete. 2024-04-25T02:29:00.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.277+0000 7f8dd938b700 1 Processor -- start 2024-04-25T02:29:00.283 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.277+0000 7f8dd938b700 1 -- start start 2024-04-25T02:29:00.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.277+0000 7f8dd938b700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8dd4063c00 0x7f8dd413cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:00.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.277+0000 7f8dd938b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8dd40a5b10 0x7f8dd414f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:00.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.277+0000 7f8dd938b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8dd4139cf0 0x7f8dd4132110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:00.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.277+0000 7f8dd938b700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd4138110 con 0x7f8dd4139cf0 2024-04-25T02:29:00.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.277+0000 7f8dd938b700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd413c1a0 con 0x7f8dd4063c00 2024-04-25T02:29:00.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.277+0000 7f8dd938b700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8dd41501a0 con 0x7f8dd40a5b10 2024-04-25T02:29:00.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.277+0000 7f8dd2ffd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8dd4063c00 0x7f8dd413cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:00.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.278+0000 7f8dd2ffd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8dd4063c00 0x7f8dd413cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:44106/0 (socket says 172.21.15.111:44106) 2024-04-25T02:29:00.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.278+0000 7f8dd37fe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8dd4139cf0 0x7f8dd4132110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:00.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.278+0000 7f8dd2ffd700 1 -- 172.21.15.111:0/719353190 learned_addr learned my addr 172.21.15.111:0/719353190 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:29:00.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.278+0000 7f8dd27fc700 1 --2- 172.21.15.111:0/719353190 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8dd40a5b10 0x7f8dd414f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:00.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.278+0000 7f8dd2ffd700 1 -- 172.21.15.111:0/719353190 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8dd40a5b10 msgr2=0x7f8dd414f7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:00.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.278+0000 7f8dd2ffd700 1 --2- 172.21.15.111:0/719353190 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8dd40a5b10 0x7f8dd414f7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:00.284 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.278+0000 7f8dd2ffd700 1 -- 172.21.15.111:0/719353190 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8dd4139cf0 msgr2=0x7f8dd4132110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:00.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.278+0000 7f8dd2ffd700 1 --2- 172.21.15.111:0/719353190 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8dd4139cf0 0x7f8dd4132110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:00.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.278+0000 7f8dd2ffd700 1 -- 172.21.15.111:0/719353190 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dcc009a20 con 0x7f8dd4063c00 2024-04-25T02:29:00.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.278+0000 7f8dd37fe700 1 --2- 172.21.15.111:0/719353190 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8dd4139cf0 0x7f8dd4132110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:29:00.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.278+0000 7f8dd27fc700 1 --2- 172.21.15.111:0/719353190 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8dd40a5b10 0x7f8dd414f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:29:00.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.278+0000 7f8dd2ffd700 1 --2- 172.21.15.111:0/719353190 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8dd4063c00 0x7f8dd413cdc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8dc8006fd0 tx=0x7f8dc8017000 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:00.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.278+0000 7f8dbaffd700 1 -- 172.21.15.111:0/719353190 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc800bbe0 con 0x7f8dd4063c00 2024-04-25T02:29:00.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.278+0000 7f8dbaffd700 1 -- 172.21.15.111:0/719353190 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dc8011420 con 0x7f8dd4063c00 2024-04-25T02:29:00.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.278+0000 7f8dd938b700 1 -- 172.21.15.111:0/719353190 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8dc80094f0 con 0x7f8dd4063c00 2024-04-25T02:29:00.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.278+0000 7f8dbaffd700 1 -- 172.21.15.111:0/719353190 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dc80117e0 con 0x7f8dd4063c00 2024-04-25T02:29:00.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.278+0000 7f8dd938b700 1 -- 172.21.15.111:0/719353190 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8dd414fce0 con 0x7f8dd4063c00 2024-04-25T02:29:00.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.279+0000 7f8dd938b700 1 -- 172.21.15.111:0/719353190 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8dd40ad400 con 0x7f8dd4063c00 2024-04-25T02:29:00.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.279+0000 7f8dbaffd700 1 -- 172.21.15.111:0/719353190 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f8dc8011bd0 con 0x7f8dd4063c00 2024-04-25T02:29:00.285 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.279+0000 7f8dbaffd700 1 -- 172.21.15.111:0/719353190 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4158+0+0 (secure 0 0 0) 0x7f8dc805c880 con 0x7f8dd4063c00 2024-04-25T02:29:00.286 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.283+0000 7f8dbaffd700 1 -- 172.21.15.111:0/719353190 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f8dc801deb0 con 0x7f8dd4063c00 2024-04-25T02:29:00.440 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.436+0000 7f8dd938b700 1 -- 172.21.15.111:0/719353190 --> v1:172.21.15.111:6816/46482 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8dd413a230 con 0x7f8dc0045ef0 2024-04-25T02:29:00.446 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.443+0000 7f8dbaffd700 1 -- 172.21.15.111:0/719353190 <== mgr.14107 v1:172.21.15.111:6816/46482 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276750 (unknown 2965378022 0 3716481395) 0x7f8dd413a230 con 0x7f8dc0045ef0 2024-04-25T02:29:00.450 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:29:00.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.446+0000 7f8dd938b700 1 -- 172.21.15.111:0/719353190 >> v1:172.21.15.111:6816/46482 conn(0x7f8dc0045ef0 legacy=0x7f8dc00483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:00.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.446+0000 7f8dd938b700 1 -- 172.21.15.111:0/719353190 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8dd4063c00 msgr2=0x7f8dd413cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:00.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.446+0000 7f8dd938b700 1 --2- 172.21.15.111:0/719353190 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8dd4063c00 0x7f8dd413cdc0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f8dc8006fd0 tx=0x7f8dc8017000 comp rx=0 tx=0).stop 2024-04-25T02:29:00.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.446+0000 7f8dd938b700 1 -- 172.21.15.111:0/719353190 shutdown_connections 2024-04-25T02:29:00.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.446+0000 7f8dd938b700 1 --2- 172.21.15.111:0/719353190 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8dd4139cf0 0x7f8dd4132110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:00.452 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.446+0000 7f8dd938b700 1 --2- 172.21.15.111:0/719353190 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8dd4063c00 0x7f8dd413cdc0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:00.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.446+0000 7f8dd938b700 1 --2- 172.21.15.111:0/719353190 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8dd40a5b10 0x7f8dd414f7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:00.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.446+0000 7f8dd938b700 1 -- 172.21.15.111:0/719353190 >> 172.21.15.111:0/719353190 conn(0x7f8dd40b1390 msgr2=0x7f8dd40b1a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:00.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.446+0000 7f8dd938b700 1 -- 172.21.15.111:0/719353190 shutdown_connections 2024-04-25T02:29:00.453 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:00.446+0000 7f8dd938b700 1 -- 172.21.15.111:0/719353190 wait complete. 2024-04-25T02:29:00.453 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2024-04-25T02:29:00.461 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":208,"stamp":"2024-04-25T02:28:58.814005+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129851417,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":3127,"num_read_kb":1448109,"num_write":31191,"num_write_kb":4453499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34982,"ondisk_log_size":34982,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1468944,"kb_used_data":255152,"kb_used_omap":38,"kb_used_meta":1213721,"kb_avail":376018416,"statfs":{"total":386547056640,"available":385042857984,"internally_reserved":0,"allocated":261275648,"data_stored":260365462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39115,"internal_metadata":1242851125},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003443"},"pg_stats":[{"pgid":"4.3f","version":"43'402","reported_seq":485,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:48.101234+0000","last_change":"2024-04-25T02:28:48.101190+0000","last_active":"2024-04-25T02:28:48.101234+0000","last_peered":"2024-04-25T02:28:48.101234+0000","last_clean":"2024-04-25T02:28:48.101234+0000","last_became_active":"2024-04-25T02:23:13.845848+0000","last_became_peered":"2024-04-25T02:23:13.845848+0000","last_unstale":"2024-04-25T02:28:48.101234+0000","last_undegraded":"2024-04-25T02:28:48.101234+0000","last_fullsized":"2024-04-25T02:28:48.101234+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'402","last_scrub_stamp":"2024-04-25T02:28:48.101084+0000","last_deep_scrub":"43'402","last_deep_scrub_stamp":"2024-04-25T02:28:48.101084+0000","last_clean_scrub_stamp":"2024-04-25T02:28:48.101084+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:09:02.892301+0000","scrub_duration":0.0017175580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":15113,"num_write":370,"num_write_kb":51033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"43'436","reported_seq":521,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.367424+0000","last_change":"2024-04-25T02:23:12.845761+0000","last_active":"2024-04-25T02:28:12.367424+0000","last_peered":"2024-04-25T02:28:12.367424+0000","last_clean":"2024-04-25T02:28:12.367424+0000","last_became_active":"2024-04-25T02:23:12.845429+0000","last_became_peered":"2024-04-25T02:23:12.845429+0000","last_unstale":"2024-04-25T02:28:12.367424+0000","last_undegraded":"2024-04-25T02:28:12.367424+0000","last_fullsized":"2024-04-25T02:28:12.367424+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22592,"num_write":405,"num_write_kb":75650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"43'370","reported_seq":431,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.365759+0000","last_change":"2024-04-25T02:23:11.838311+0000","last_active":"2024-04-25T02:28:12.365759+0000","last_peered":"2024-04-25T02:28:12.365759+0000","last_clean":"2024-04-25T02:28:12.365759+0000","last_became_active":"2024-04-25T02:23:11.838054+0000","last_became_peered":"2024-04-25T02:23:11.838054+0000","last_unstale":"2024-04-25T02:28:12.365759+0000","last_undegraded":"2024-04-25T02:28:12.365759+0000","last_fullsized":"2024-04-25T02:28:12.365759+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":15817,"num_write":338,"num_write_kb":46402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"43'393","reported_seq":485,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:47.102595+0000","last_change":"2024-04-25T02:28:47.102563+0000","last_active":"2024-04-25T02:28:47.102595+0000","last_peered":"2024-04-25T02:28:47.102595+0000","last_clean":"2024-04-25T02:28:47.102595+0000","last_became_active":"2024-04-25T02:23:11.836681+0000","last_became_peered":"2024-04-25T02:23:11.836681+0000","last_unstale":"2024-04-25T02:28:47.102595+0000","last_undegraded":"2024-04-25T02:28:47.102595+0000","last_fullsized":"2024-04-25T02:28:47.102595+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'393","last_scrub_stamp":"2024-04-25T02:28:47.102463+0000","last_deep_scrub":"43'393","last_deep_scrub_stamp":"2024-04-25T02:28:47.102463+0000","last_clean_scrub_stamp":"2024-04-25T02:28:47.102463+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:03.660053+0000","scrub_duration":0.0021321360000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22923,"num_write":365,"num_write_kb":51318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"43'406","reported_seq":476,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.358278+0000","last_change":"2024-04-25T02:23:13.843174+0000","last_active":"2024-04-25T02:28:12.358278+0000","last_peered":"2024-04-25T02:28:12.358278+0000","last_clean":"2024-04-25T02:28:12.358278+0000","last_became_active":"2024-04-25T02:23:13.842918+0000","last_became_peered":"2024-04-25T02:23:13.842918+0000","last_unstale":"2024-04-25T02:28:12.358278+0000","last_undegraded":"2024-04-25T02:28:12.358278+0000","last_fullsized":"2024-04-25T02:28:12.358278+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14619,"num_write":384,"num_write_kb":71611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"43'366","reported_seq":438,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:39.393603+0000","last_change":"2024-04-25T02:28:39.393572+0000","last_active":"2024-04-25T02:28:39.393603+0000","last_peered":"2024-04-25T02:28:39.393603+0000","last_clean":"2024-04-25T02:28:39.393603+0000","last_became_active":"2024-04-25T02:23:13.848160+0000","last_became_peered":"2024-04-25T02:23:13.848160+0000","last_unstale":"2024-04-25T02:28:39.393603+0000","last_undegraded":"2024-04-25T02:28:39.393603+0000","last_fullsized":"2024-04-25T02:28:39.393603+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'366","last_scrub_stamp":"2024-04-25T02:28:39.393471+0000","last_deep_scrub":"43'366","last_deep_scrub_stamp":"2024-04-25T02:28:39.393471+0000","last_clean_scrub_stamp":"2024-04-25T02:28:39.393471+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:09:44.749626+0000","scrub_duration":0.0023219040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12472,"num_write":338,"num_write_kb":33864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"43'441","reported_seq":560,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.351267+0000","last_change":"2024-04-25T02:23:13.842324+0000","last_active":"2024-04-25T02:28:12.351267+0000","last_peered":"2024-04-25T02:28:12.351267+0000","last_clean":"2024-04-25T02:28:12.351267+0000","last_became_active":"2024-04-25T02:23:13.840374+0000","last_became_peered":"2024-04-25T02:23:13.840374+0000","last_unstale":"2024-04-25T02:28:12.351267+0000","last_undegraded":"2024-04-25T02:28:12.351267+0000","last_fullsized":"2024-04-25T02:28:12.351267+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":40192,"num_write":416,"num_write_kb":101787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"43'364","reported_seq":431,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.369227+0000","last_change":"2024-04-25T02:23:11.835781+0000","last_active":"2024-04-25T02:28:12.369227+0000","last_peered":"2024-04-25T02:28:12.369227+0000","last_clean":"2024-04-25T02:28:12.369227+0000","last_became_active":"2024-04-25T02:23:11.834759+0000","last_became_peered":"2024-04-25T02:23:11.834759+0000","last_unstale":"2024-04-25T02:28:12.369227+0000","last_undegraded":"2024-04-25T02:28:12.369227+0000","last_fullsized":"2024-04-25T02:28:12.369227+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18431,"num_write":330,"num_write_kb":66835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"43'425","reported_seq":525,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:22.157783+0000","last_change":"2024-04-25T02:28:22.157736+0000","last_active":"2024-04-25T02:28:22.157783+0000","last_peered":"2024-04-25T02:28:22.157783+0000","last_clean":"2024-04-25T02:28:22.157783+0000","last_became_active":"2024-04-25T02:23:13.841883+0000","last_became_peered":"2024-04-25T02:23:13.841883+0000","last_unstale":"2024-04-25T02:28:22.157783+0000","last_undegraded":"2024-04-25T02:28:22.157783+0000","last_fullsized":"2024-04-25T02:28:22.157783+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'425","last_scrub_stamp":"2024-04-25T02:28:22.157614+0000","last_deep_scrub":"43'425","last_deep_scrub_stamp":"2024-04-25T02:28:22.157614+0000","last_clean_scrub_stamp":"2024-04-25T02:28:22.157614+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:28:28.713838+0000","scrub_duration":0.0023306529999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":29378,"num_write":387,"num_write_kb":39136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"43'396","reported_seq":480,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:45.945484+0000","last_change":"2024-04-25T02:28:45.945437+0000","last_active":"2024-04-25T02:28:45.945484+0000","last_peered":"2024-04-25T02:28:45.945484+0000","last_clean":"2024-04-25T02:28:45.945484+0000","last_became_active":"2024-04-25T02:23:11.835958+0000","last_became_peered":"2024-04-25T02:23:11.835958+0000","last_unstale":"2024-04-25T02:28:45.945484+0000","last_undegraded":"2024-04-25T02:28:45.945484+0000","last_fullsized":"2024-04-25T02:28:45.945484+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'396","last_scrub_stamp":"2024-04-25T02:28:45.945325+0000","last_deep_scrub":"43'396","last_deep_scrub_stamp":"2024-04-25T02:28:45.945325+0000","last_clean_scrub_stamp":"2024-04-25T02:28:45.945325+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:53:01.215968+0000","scrub_duration":0.002346295,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":25799,"num_write":352,"num_write_kb":67037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"43'354","reported_seq":394,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.359391+0000","last_change":"2024-04-25T02:23:11.836468+0000","last_active":"2024-04-25T02:28:12.359391+0000","last_peered":"2024-04-25T02:28:12.359391+0000","last_clean":"2024-04-25T02:28:12.359391+0000","last_became_active":"2024-04-25T02:23:11.836214+0000","last_became_peered":"2024-04-25T02:23:11.836214+0000","last_unstale":"2024-04-25T02:28:12.359391+0000","last_undegraded":"2024-04-25T02:28:12.359391+0000","last_fullsized":"2024-04-25T02:28:12.359391+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7176,"num_write":336,"num_write_kb":37702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"43'335","reported_seq":377,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.367786+0000","last_change":"2024-04-25T02:23:13.847944+0000","last_active":"2024-04-25T02:28:12.367786+0000","last_peered":"2024-04-25T02:28:12.367786+0000","last_clean":"2024-04-25T02:28:12.367786+0000","last_became_active":"2024-04-25T02:23:13.847446+0000","last_became_peered":"2024-04-25T02:23:13.847446+0000","last_unstale":"2024-04-25T02:28:12.367786+0000","last_undegraded":"2024-04-25T02:28:12.367786+0000","last_fullsized":"2024-04-25T02:28:12.367786+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4160,"num_write":309,"num_write_kb":33908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"43'387","reported_seq":439,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:26.212350+0000","last_change":"2024-04-25T02:28:26.212320+0000","last_active":"2024-04-25T02:28:26.212350+0000","last_peered":"2024-04-25T02:28:26.212350+0000","last_clean":"2024-04-25T02:28:26.212350+0000","last_became_active":"2024-04-25T02:23:13.847009+0000","last_became_peered":"2024-04-25T02:23:13.847009+0000","last_unstale":"2024-04-25T02:28:26.212350+0000","last_undegraded":"2024-04-25T02:28:26.212350+0000","last_fullsized":"2024-04-25T02:28:26.212350+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'387","last_scrub_stamp":"2024-04-25T02:28:26.212204+0000","last_deep_scrub":"43'387","last_deep_scrub_stamp":"2024-04-25T02:28:26.212204+0000","last_clean_scrub_stamp":"2024-04-25T02:28:26.212204+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:25:07.412842+0000","scrub_duration":0.0024916069999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4152,"num_write":352,"num_write_kb":42524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"43'450","reported_seq":539,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:20.974106+0000","last_change":"2024-04-25T02:28:20.974062+0000","last_active":"2024-04-25T02:28:20.974106+0000","last_peered":"2024-04-25T02:28:20.974106+0000","last_clean":"2024-04-25T02:28:20.974106+0000","last_became_active":"2024-04-25T02:23:12.841783+0000","last_became_peered":"2024-04-25T02:23:12.841783+0000","last_unstale":"2024-04-25T02:28:20.974106+0000","last_undegraded":"2024-04-25T02:28:20.974106+0000","last_fullsized":"2024-04-25T02:28:20.974106+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'450","last_scrub_stamp":"2024-04-25T02:28:20.973929+0000","last_deep_scrub":"43'450","last_deep_scrub_stamp":"2024-04-25T02:28:20.973929+0000","last_clean_scrub_stamp":"2024-04-25T02:28:20.973929+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:56:11.043992+0000","scrub_duration":0.002462386,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":25198,"num_write":421,"num_write_kb":88864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"43'430","reported_seq":532,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:44.037754+0000","last_change":"2024-04-25T02:28:44.037712+0000","last_active":"2024-04-25T02:28:44.037754+0000","last_peered":"2024-04-25T02:28:44.037754+0000","last_clean":"2024-04-25T02:28:44.037754+0000","last_became_active":"2024-04-25T02:23:11.835815+0000","last_became_peered":"2024-04-25T02:23:11.835815+0000","last_unstale":"2024-04-25T02:28:44.037754+0000","last_undegraded":"2024-04-25T02:28:44.037754+0000","last_fullsized":"2024-04-25T02:28:44.037754+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'430","last_scrub_stamp":"2024-04-25T02:28:44.037608+0000","last_deep_scrub":"43'430","last_deep_scrub_stamp":"2024-04-25T02:28:44.037608+0000","last_clean_scrub_stamp":"2024-04-25T02:28:44.037608+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:53:08.207544+0000","scrub_duration":0.0021441519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31947,"num_write":393,"num_write_kb":64059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"43'438","reported_seq":463,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.356599+0000","last_change":"2024-04-25T02:23:55.963552+0000","last_active":"2024-04-25T02:28:12.356599+0000","last_peered":"2024-04-25T02:28:12.356599+0000","last_clean":"2024-04-25T02:28:12.356599+0000","last_became_active":"2024-04-25T02:23:55.963259+0000","last_became_peered":"2024-04-25T02:23:55.963259+0000","last_unstale":"2024-04-25T02:28:12.356599+0000","last_undegraded":"2024-04-25T02:28:12.356599+0000","last_fullsized":"2024-04-25T02:28:12.356599+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":2639,"num_write":405,"num_write_kb":51451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"43'394","reported_seq":457,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.356518+0000","last_change":"2024-04-25T02:23:13.844591+0000","last_active":"2024-04-25T02:28:12.356518+0000","last_peered":"2024-04-25T02:28:12.356518+0000","last_clean":"2024-04-25T02:28:12.356518+0000","last_became_active":"2024-04-25T02:23:13.844343+0000","last_became_peered":"2024-04-25T02:23:13.844343+0000","last_unstale":"2024-04-25T02:28:12.356518+0000","last_undegraded":"2024-04-25T02:28:12.356518+0000","last_fullsized":"2024-04-25T02:28:12.356518+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9696,"num_write":367,"num_write_kb":33966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"43'391","reported_seq":471,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.361179+0000","last_change":"2024-04-25T02:23:12.848314+0000","last_active":"2024-04-25T02:28:12.361179+0000","last_peered":"2024-04-25T02:28:12.361179+0000","last_clean":"2024-04-25T02:28:12.361179+0000","last_became_active":"2024-04-25T02:23:12.848051+0000","last_became_peered":"2024-04-25T02:23:12.848051+0000","last_unstale":"2024-04-25T02:28:12.361179+0000","last_undegraded":"2024-04-25T02:28:12.361179+0000","last_fullsized":"2024-04-25T02:28:12.361179+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":13345,"num_write":357,"num_write_kb":38441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"43'429","reported_seq":550,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:52.924323+0000","last_change":"2024-04-25T02:28:52.924295+0000","last_active":"2024-04-25T02:28:52.924323+0000","last_peered":"2024-04-25T02:28:52.924323+0000","last_clean":"2024-04-25T02:28:52.924323+0000","last_became_active":"2024-04-25T02:23:13.847602+0000","last_became_peered":"2024-04-25T02:23:13.847602+0000","last_unstale":"2024-04-25T02:28:52.924323+0000","last_undegraded":"2024-04-25T02:28:52.924323+0000","last_fullsized":"2024-04-25T02:28:52.924323+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'429","last_scrub_stamp":"2024-04-25T02:28:52.924165+0000","last_deep_scrub":"43'429","last_deep_scrub_stamp":"2024-04-25T02:28:52.924165+0000","last_clean_scrub_stamp":"2024-04-25T02:28:52.924165+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:54:54.792159+0000","scrub_duration":0.0025521599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":37845,"num_write":400,"num_write_kb":88566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"43'437","reported_seq":523,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:44.934901+0000","last_change":"2024-04-25T02:28:44.934874+0000","last_active":"2024-04-25T02:28:44.934901+0000","last_peered":"2024-04-25T02:28:44.934901+0000","last_clean":"2024-04-25T02:28:44.934901+0000","last_became_active":"2024-04-25T02:23:13.845934+0000","last_became_peered":"2024-04-25T02:23:13.845934+0000","last_unstale":"2024-04-25T02:28:44.934901+0000","last_undegraded":"2024-04-25T02:28:44.934901+0000","last_fullsized":"2024-04-25T02:28:44.934901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'437","last_scrub_stamp":"2024-04-25T02:28:44.934771+0000","last_deep_scrub":"43'437","last_deep_scrub_stamp":"2024-04-25T02:28:44.934771+0000","last_clean_scrub_stamp":"2024-04-25T02:28:44.934771+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:07.359904+0000","scrub_duration":0.002337244,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":22073,"num_write":412,"num_write_kb":67090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"43'414","reported_seq":507,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.365755+0000","last_change":"2024-04-25T02:23:13.847117+0000","last_active":"2024-04-25T02:28:12.365755+0000","last_peered":"2024-04-25T02:28:12.365755+0000","last_clean":"2024-04-25T02:28:12.365755+0000","last_became_active":"2024-04-25T02:23:13.846758+0000","last_became_peered":"2024-04-25T02:23:13.846758+0000","last_unstale":"2024-04-25T02:28:12.365755+0000","last_undegraded":"2024-04-25T02:28:12.365755+0000","last_fullsized":"2024-04-25T02:28:12.365755+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":24525,"num_write":378,"num_write_kb":100342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"43'445","reported_seq":519,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.366288+0000","last_change":"2024-04-25T02:23:11.835581+0000","last_active":"2024-04-25T02:28:12.366288+0000","last_peered":"2024-04-25T02:28:12.366288+0000","last_clean":"2024-04-25T02:28:12.366288+0000","last_became_active":"2024-04-25T02:23:11.835319+0000","last_became_peered":"2024-04-25T02:23:11.835319+0000","last_unstale":"2024-04-25T02:28:12.366288+0000","last_undegraded":"2024-04-25T02:28:12.366288+0000","last_fullsized":"2024-04-25T02:28:12.366288+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":18532,"num_write":411,"num_write_kb":84101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"43'408","reported_seq":526,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:29.377058+0000","last_change":"2024-04-25T02:28:29.377031+0000","last_active":"2024-04-25T02:28:29.377058+0000","last_peered":"2024-04-25T02:28:29.377058+0000","last_clean":"2024-04-25T02:28:29.377058+0000","last_became_active":"2024-04-25T02:23:13.838917+0000","last_became_peered":"2024-04-25T02:23:13.838917+0000","last_unstale":"2024-04-25T02:28:29.377058+0000","last_undegraded":"2024-04-25T02:28:29.377058+0000","last_fullsized":"2024-04-25T02:28:29.377058+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'408","last_scrub_stamp":"2024-04-25T02:28:29.376935+0000","last_deep_scrub":"43'408","last_deep_scrub_stamp":"2024-04-25T02:28:29.376935+0000","last_clean_scrub_stamp":"2024-04-25T02:28:29.376935+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:25:26.084049+0000","scrub_duration":0.002236952,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":25750,"num_write":380,"num_write_kb":75795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"43'451","reported_seq":517,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.369417+0000","last_change":"2024-04-25T02:23:13.846482+0000","last_active":"2024-04-25T02:28:12.369417+0000","last_peered":"2024-04-25T02:28:12.369417+0000","last_clean":"2024-04-25T02:28:12.369417+0000","last_became_active":"2024-04-25T02:23:13.845814+0000","last_became_peered":"2024-04-25T02:23:13.845814+0000","last_unstale":"2024-04-25T02:28:12.369417+0000","last_undegraded":"2024-04-25T02:28:12.369417+0000","last_fullsized":"2024-04-25T02:28:12.369417+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13960,"num_write":428,"num_write_kb":96160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"43'397","reported_seq":460,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:38.013962+0000","last_change":"2024-04-25T02:28:38.013905+0000","last_active":"2024-04-25T02:28:38.013962+0000","last_peered":"2024-04-25T02:28:38.013962+0000","last_clean":"2024-04-25T02:28:38.013962+0000","last_became_active":"2024-04-25T02:23:13.852093+0000","last_became_peered":"2024-04-25T02:23:13.852093+0000","last_unstale":"2024-04-25T02:28:38.013962+0000","last_undegraded":"2024-04-25T02:28:38.013962+0000","last_fullsized":"2024-04-25T02:28:38.013962+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'397","last_scrub_stamp":"2024-04-25T02:28:38.013798+0000","last_deep_scrub":"43'397","last_deep_scrub_stamp":"2024-04-25T02:28:38.013798+0000","last_clean_scrub_stamp":"2024-04-25T02:28:38.013798+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:40:41.237724+0000","scrub_duration":0.0021175439999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":3870,"num_write":383,"num_write_kb":17738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"43'485","reported_seq":567,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.363147+0000","last_change":"2024-04-25T02:23:12.841653+0000","last_active":"2024-04-25T02:28:12.363147+0000","last_peered":"2024-04-25T02:28:12.363147+0000","last_clean":"2024-04-25T02:28:12.363147+0000","last_became_active":"2024-04-25T02:23:12.841477+0000","last_became_peered":"2024-04-25T02:23:12.841477+0000","last_unstale":"2024-04-25T02:28:12.363147+0000","last_undegraded":"2024-04-25T02:28:12.363147+0000","last_fullsized":"2024-04-25T02:28:12.363147+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24645,"num_write":445,"num_write_kb":96750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"43'384","reported_seq":458,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.354521+0000","last_change":"2024-04-25T02:23:13.842553+0000","last_active":"2024-04-25T02:28:12.354521+0000","last_peered":"2024-04-25T02:28:12.354521+0000","last_clean":"2024-04-25T02:28:12.354521+0000","last_became_active":"2024-04-25T02:23:13.840422+0000","last_became_peered":"2024-04-25T02:23:13.840422+0000","last_unstale":"2024-04-25T02:28:12.354521+0000","last_undegraded":"2024-04-25T02:28:12.354521+0000","last_fullsized":"2024-04-25T02:28:12.354521+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":6130,"num_write":356,"num_write_kb":25986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"43'568","reported_seq":612,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:30.058301+0000","last_change":"2024-04-25T02:28:30.058267+0000","last_active":"2024-04-25T02:28:30.058301+0000","last_peered":"2024-04-25T02:28:30.058301+0000","last_clean":"2024-04-25T02:28:30.058301+0000","last_became_active":"2024-04-25T02:23:12.845923+0000","last_became_peered":"2024-04-25T02:23:12.845923+0000","last_unstale":"2024-04-25T02:28:30.058301+0000","last_undegraded":"2024-04-25T02:28:30.058301+0000","last_fullsized":"2024-04-25T02:28:30.058301+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'568","last_scrub_stamp":"2024-04-25T02:28:30.058171+0000","last_deep_scrub":"43'568","last_deep_scrub_stamp":"2024-04-25T02:28:30.058171+0000","last_clean_scrub_stamp":"2024-04-25T02:28:30.058171+0000","objects_scrubbed":3,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:07:27.211762+0000","scrub_duration":0.028959043,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":494,"num_write_kb":12610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"43'420","reported_seq":536,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.368189+0000","last_change":"2024-04-25T02:23:13.850625+0000","last_active":"2024-04-25T02:28:12.368189+0000","last_peered":"2024-04-25T02:28:12.368189+0000","last_clean":"2024-04-25T02:28:12.368189+0000","last_became_active":"2024-04-25T02:23:13.848844+0000","last_became_peered":"2024-04-25T02:23:13.848844+0000","last_unstale":"2024-04-25T02:28:12.368189+0000","last_undegraded":"2024-04-25T02:28:12.368189+0000","last_fullsized":"2024-04-25T02:28:12.368189+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":41312,"num_write":376,"num_write_kb":112833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"43'384","reported_seq":430,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:50.931544+0000","last_change":"2024-04-25T02:28:50.931513+0000","last_active":"2024-04-25T02:28:50.931544+0000","last_peered":"2024-04-25T02:28:50.931544+0000","last_clean":"2024-04-25T02:28:50.931544+0000","last_became_active":"2024-04-25T02:23:13.846821+0000","last_became_peered":"2024-04-25T02:23:13.846821+0000","last_unstale":"2024-04-25T02:28:50.931544+0000","last_undegraded":"2024-04-25T02:28:50.931544+0000","last_fullsized":"2024-04-25T02:28:50.931544+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'384","last_scrub_stamp":"2024-04-25T02:28:50.931418+0000","last_deep_scrub":"43'384","last_deep_scrub_stamp":"2024-04-25T02:28:50.931418+0000","last_clean_scrub_stamp":"2024-04-25T02:28:50.931418+0000","objects_scrubbed":1,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:34:41.263744+0000","scrub_duration":0.013025725,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":334,"num_write_kb":4317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"43'428","reported_seq":522,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.366276+0000","last_change":"2024-04-25T02:23:11.840787+0000","last_active":"2024-04-25T02:28:12.366276+0000","last_peered":"2024-04-25T02:28:12.366276+0000","last_clean":"2024-04-25T02:28:12.366276+0000","last_became_active":"2024-04-25T02:23:11.840274+0000","last_became_peered":"2024-04-25T02:23:11.840274+0000","last_unstale":"2024-04-25T02:28:12.366276+0000","last_undegraded":"2024-04-25T02:28:12.366276+0000","last_fullsized":"2024-04-25T02:28:12.366276+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":28196,"num_write":410,"num_write_kb":104265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"43'875","reported_seq":922,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.488161+0000","last_change":"2024-04-25T02:23:13.839791+0000","last_active":"2024-04-25T02:28:10.488161+0000","last_peered":"2024-04-25T02:28:10.488161+0000","last_clean":"2024-04-25T02:28:10.488161+0000","last_became_active":"2024-04-25T02:23:13.839361+0000","last_became_peered":"2024-04-25T02:23:13.839361+0000","last_unstale":"2024-04-25T02:28:10.488161+0000","last_undegraded":"2024-04-25T02:28:10.488161+0000","last_fullsized":"2024-04-25T02:28:10.488161+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":875,"log_dups_size":0,"ondisk_log_size":875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":809,"num_write_kb":8568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"43'365","reported_seq":444,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.353721+0000","last_change":"2024-04-25T02:23:13.844099+0000","last_active":"2024-04-25T02:28:12.353721+0000","last_peered":"2024-04-25T02:28:12.353721+0000","last_clean":"2024-04-25T02:28:12.353721+0000","last_became_active":"2024-04-25T02:23:13.843656+0000","last_became_peered":"2024-04-25T02:23:13.843656+0000","last_unstale":"2024-04-25T02:28:12.353721+0000","last_undegraded":"2024-04-25T02:28:12.353721+0000","last_fullsized":"2024-04-25T02:28:12.353721+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":25136,"num_write":341,"num_write_kb":38831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"43'56","reported_seq":96,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.527159+0000","last_change":"2024-04-25T02:23:13.842946+0000","last_active":"2024-04-25T02:28:08.527159+0000","last_peered":"2024-04-25T02:28:08.527159+0000","last_clean":"2024-04-25T02:28:08.527159+0000","last_became_active":"2024-04-25T02:23:13.842598+0000","last_became_peered":"2024-04-25T02:23:13.842598+0000","last_unstale":"2024-04-25T02:28:08.527159+0000","last_undegraded":"2024-04-25T02:28:08.527159+0000","last_fullsized":"2024-04-25T02:28:08.527159+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"43'467","reported_seq":543,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.367867+0000","last_change":"2024-04-25T02:23:13.849957+0000","last_active":"2024-04-25T02:28:12.367867+0000","last_peered":"2024-04-25T02:28:12.367867+0000","last_clean":"2024-04-25T02:28:12.367867+0000","last_became_active":"2024-04-25T02:23:13.848675+0000","last_became_peered":"2024-04-25T02:23:13.848675+0000","last_unstale":"2024-04-25T02:28:12.367867+0000","last_undegraded":"2024-04-25T02:28:12.367867+0000","last_fullsized":"2024-04-25T02:28:12.367867+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":13580,"num_write":443,"num_write_kb":92928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"43'342","reported_seq":387,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:50.982472+0000","last_change":"2024-04-25T02:28:50.982445+0000","last_active":"2024-04-25T02:28:50.982472+0000","last_peered":"2024-04-25T02:28:50.982472+0000","last_clean":"2024-04-25T02:28:50.982472+0000","last_became_active":"2024-04-25T02:23:13.846764+0000","last_became_peered":"2024-04-25T02:23:13.846764+0000","last_unstale":"2024-04-25T02:28:50.982472+0000","last_undegraded":"2024-04-25T02:28:50.982472+0000","last_fullsized":"2024-04-25T02:28:50.982472+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'342","last_scrub_stamp":"2024-04-25T02:28:50.982355+0000","last_deep_scrub":"43'342","last_deep_scrub_stamp":"2024-04-25T02:28:50.982355+0000","last_clean_scrub_stamp":"2024-04-25T02:28:50.982355+0000","objects_scrubbed":2,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:42:20.126126+0000","scrub_duration":0.013249924999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":281,"num_write_kb":4273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"43'477","reported_seq":577,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.351447+0000","last_change":"2024-04-25T02:23:13.844687+0000","last_active":"2024-04-25T02:28:12.351447+0000","last_peered":"2024-04-25T02:28:12.351447+0000","last_clean":"2024-04-25T02:28:12.351447+0000","last_became_active":"2024-04-25T02:23:13.839702+0000","last_became_peered":"2024-04-25T02:23:13.839702+0000","last_unstale":"2024-04-25T02:28:12.351447+0000","last_undegraded":"2024-04-25T02:28:12.351447+0000","last_fullsized":"2024-04-25T02:28:12.351447+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":30102,"num_write":452,"num_write_kb":97286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"43'139","reported_seq":192,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:46.068929+0000","last_change":"2024-04-25T02:28:46.068904+0000","last_active":"2024-04-25T02:28:46.068929+0000","last_peered":"2024-04-25T02:28:46.068929+0000","last_clean":"2024-04-25T02:28:46.068929+0000","last_became_active":"2024-04-25T02:23:13.843625+0000","last_became_peered":"2024-04-25T02:23:13.843625+0000","last_unstale":"2024-04-25T02:28:46.068929+0000","last_undegraded":"2024-04-25T02:28:46.068929+0000","last_fullsized":"2024-04-25T02:28:46.068929+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'139","last_scrub_stamp":"2024-04-25T02:28:46.068815+0000","last_deep_scrub":"43'139","last_deep_scrub_stamp":"2024-04-25T02:28:46.068815+0000","last_clean_scrub_stamp":"2024-04-25T02:28:46.068815+0000","objects_scrubbed":3,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:26.672574+0000","scrub_duration":0.0037700569999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":72,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"43'422","reported_seq":496,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.366583+0000","last_change":"2024-04-25T02:23:13.851184+0000","last_active":"2024-04-25T02:28:12.366583+0000","last_peered":"2024-04-25T02:28:12.366583+0000","last_clean":"2024-04-25T02:28:12.366583+0000","last_became_active":"2024-04-25T02:23:13.850845+0000","last_became_peered":"2024-04-25T02:23:13.850845+0000","last_unstale":"2024-04-25T02:28:12.366583+0000","last_undegraded":"2024-04-25T02:28:12.366583+0000","last_fullsized":"2024-04-25T02:28:12.366583+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":24672,"num_write":391,"num_write_kb":75497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"43'345","reported_seq":390,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:16.200776+0000","last_change":"2024-04-25T02:23:13.849389+0000","last_active":"2024-04-25T02:28:16.200776+0000","last_peered":"2024-04-25T02:28:16.200776+0000","last_clean":"2024-04-25T02:28:16.200776+0000","last_became_active":"2024-04-25T02:23:13.845176+0000","last_became_peered":"2024-04-25T02:23:13.845176+0000","last_unstale":"2024-04-25T02:28:16.200776+0000","last_undegraded":"2024-04-25T02:28:16.200776+0000","last_fullsized":"2024-04-25T02:28:16.200776+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":345,"log_dups_size":0,"ondisk_log_size":345,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10356006,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":7,"num_read_kb":10,"num_write":291,"num_write_kb":10309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"43'405","reported_seq":483,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:30.146025+0000","last_change":"2024-04-25T02:28:30.145967+0000","last_active":"2024-04-25T02:28:30.146025+0000","last_peered":"2024-04-25T02:28:30.146025+0000","last_clean":"2024-04-25T02:28:30.146025+0000","last_became_active":"2024-04-25T02:23:55.963655+0000","last_became_peered":"2024-04-25T02:23:55.963655+0000","last_unstale":"2024-04-25T02:28:30.146025+0000","last_undegraded":"2024-04-25T02:28:30.146025+0000","last_fullsized":"2024-04-25T02:28:30.146025+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'405","last_scrub_stamp":"2024-04-25T02:28:30.145854+0000","last_deep_scrub":"43'405","last_deep_scrub_stamp":"2024-04-25T02:28:30.145854+0000","last_clean_scrub_stamp":"2024-04-25T02:28:30.145854+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:49.219885+0000","scrub_duration":0.0021986240000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":11609,"num_write":365,"num_write_kb":76437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"43'498","reported_seq":557,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:53.568295+0000","last_change":"2024-04-25T02:28:53.568258+0000","last_active":"2024-04-25T02:28:53.568295+0000","last_peered":"2024-04-25T02:28:53.568295+0000","last_clean":"2024-04-25T02:28:53.568295+0000","last_became_active":"2024-04-25T02:23:13.839158+0000","last_became_peered":"2024-04-25T02:23:13.839158+0000","last_unstale":"2024-04-25T02:28:53.568295+0000","last_undegraded":"2024-04-25T02:28:53.568295+0000","last_fullsized":"2024-04-25T02:28:53.568295+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'498","last_scrub_stamp":"2024-04-25T02:28:53.568128+0000","last_deep_scrub":"43'498","last_deep_scrub_stamp":"2024-04-25T02:28:53.568128+0000","last_clean_scrub_stamp":"2024-04-25T02:28:53.568128+0000","objects_scrubbed":5,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:05.588274+0000","scrub_duration":0.023077066,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":7,"num_write":435,"num_write_kb":8384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"43'409","reported_seq":489,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.363014+0000","last_change":"2024-04-25T02:23:13.843740+0000","last_active":"2024-04-25T02:28:12.363014+0000","last_peered":"2024-04-25T02:28:12.363014+0000","last_clean":"2024-04-25T02:28:12.363014+0000","last_became_active":"2024-04-25T02:23:13.843441+0000","last_became_peered":"2024-04-25T02:23:13.843441+0000","last_unstale":"2024-04-25T02:28:12.363014+0000","last_undegraded":"2024-04-25T02:28:12.363014+0000","last_fullsized":"2024-04-25T02:28:12.363014+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":25550,"num_write":379,"num_write_kb":104949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"43'51","reported_seq":90,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.488257+0000","last_change":"2024-04-25T02:23:13.844290+0000","last_active":"2024-04-25T02:28:10.488257+0000","last_peered":"2024-04-25T02:28:10.488257+0000","last_clean":"2024-04-25T02:28:10.488257+0000","last_became_active":"2024-04-25T02:23:13.841976+0000","last_became_peered":"2024-04-25T02:23:13.841976+0000","last_unstale":"2024-04-25T02:28:10.488257+0000","last_undegraded":"2024-04-25T02:28:10.488257+0000","last_fullsized":"2024-04-25T02:28:10.488257+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"43'407","reported_seq":493,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.354407+0000","last_change":"2024-04-25T02:23:13.843455+0000","last_active":"2024-04-25T02:28:12.354407+0000","last_peered":"2024-04-25T02:28:12.354407+0000","last_clean":"2024-04-25T02:28:12.354407+0000","last_became_active":"2024-04-25T02:23:13.842163+0000","last_became_peered":"2024-04-25T02:23:13.842163+0000","last_unstale":"2024-04-25T02:28:12.354407+0000","last_undegraded":"2024-04-25T02:28:12.354407+0000","last_fullsized":"2024-04-25T02:28:12.354407+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":18209,"num_write":378,"num_write_kb":67140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"43'57","reported_seq":97,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:07.528969+0000","last_change":"2024-04-25T02:23:13.839221+0000","last_active":"2024-04-25T02:28:07.528969+0000","last_peered":"2024-04-25T02:28:07.528969+0000","last_clean":"2024-04-25T02:28:07.528969+0000","last_became_active":"2024-04-25T02:23:13.838616+0000","last_became_peered":"2024-04-25T02:23:13.838616+0000","last_unstale":"2024-04-25T02:28:07.528969+0000","last_undegraded":"2024-04-25T02:28:07.528969+0000","last_fullsized":"2024-04-25T02:28:07.528969+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"43'445","reported_seq":565,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.358482+0000","last_change":"2024-04-25T02:23:13.842908+0000","last_active":"2024-04-25T02:28:12.358482+0000","last_peered":"2024-04-25T02:28:12.358482+0000","last_clean":"2024-04-25T02:28:12.358482+0000","last_became_active":"2024-04-25T02:23:13.842649+0000","last_became_peered":"2024-04-25T02:23:13.842649+0000","last_unstale":"2024-04-25T02:28:12.358482+0000","last_undegraded":"2024-04-25T02:28:12.358482+0000","last_fullsized":"2024-04-25T02:28:12.358482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":37870,"num_write":411,"num_write_kb":80233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"43'68","reported_seq":116,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:51.908386+0000","last_change":"2024-04-25T02:28:51.908344+0000","last_active":"2024-04-25T02:28:51.908386+0000","last_peered":"2024-04-25T02:28:51.908386+0000","last_clean":"2024-04-25T02:28:51.908386+0000","last_became_active":"2024-04-25T02:23:11.835077+0000","last_became_peered":"2024-04-25T02:23:11.835077+0000","last_unstale":"2024-04-25T02:28:51.908386+0000","last_undegraded":"2024-04-25T02:28:51.908386+0000","last_fullsized":"2024-04-25T02:28:51.908386+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'68","last_scrub_stamp":"2024-04-25T02:28:51.908233+0000","last_deep_scrub":"43'68","last_deep_scrub_stamp":"2024-04-25T02:28:51.908233+0000","last_clean_scrub_stamp":"2024-04-25T02:28:51.908233+0000","objects_scrubbed":5,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:49.010130+0000","scrub_duration":0.0047405470000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"43'390","reported_seq":531,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:49.471264+0000","last_change":"2024-04-25T02:28:49.471228+0000","last_active":"2024-04-25T02:28:49.471264+0000","last_peered":"2024-04-25T02:28:49.471264+0000","last_clean":"2024-04-25T02:28:49.471264+0000","last_became_active":"2024-04-25T02:23:13.843347+0000","last_became_peered":"2024-04-25T02:23:13.843347+0000","last_unstale":"2024-04-25T02:28:49.471264+0000","last_undegraded":"2024-04-25T02:28:49.471264+0000","last_fullsized":"2024-04-25T02:28:49.471264+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'390","last_scrub_stamp":"2024-04-25T02:28:49.471125+0000","last_deep_scrub":"43'390","last_deep_scrub_stamp":"2024-04-25T02:28:49.471125+0000","last_clean_scrub_stamp":"2024-04-25T02:28:49.471125+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:04:13.159114+0000","scrub_duration":0.0021407000000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":42863,"num_write":360,"num_write_kb":59443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"43'199","reported_seq":237,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.513156+0000","last_change":"2024-04-25T02:23:11.839659+0000","last_active":"2024-04-25T02:28:10.513156+0000","last_peered":"2024-04-25T02:28:10.513156+0000","last_clean":"2024-04-25T02:28:10.513156+0000","last_became_active":"2024-04-25T02:23:11.839157+0000","last_became_peered":"2024-04-25T02:23:11.839157+0000","last_unstale":"2024-04-25T02:28:10.513156+0000","last_undegraded":"2024-04-25T02:28:10.513156+0000","last_fullsized":"2024-04-25T02:28:10.513156+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":142,"num_write_kb":4183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"43'404","reported_seq":471,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.368273+0000","last_change":"2024-04-25T02:23:13.841226+0000","last_active":"2024-04-25T02:28:12.368273+0000","last_peered":"2024-04-25T02:28:12.368273+0000","last_clean":"2024-04-25T02:28:12.368273+0000","last_became_active":"2024-04-25T02:23:13.840951+0000","last_became_peered":"2024-04-25T02:23:13.840951+0000","last_unstale":"2024-04-25T02:28:12.368273+0000","last_undegraded":"2024-04-25T02:28:12.368273+0000","last_fullsized":"2024-04-25T02:28:12.368273+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12931,"num_write":370,"num_write_kb":42530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"43'366","reported_seq":411,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.503886+0000","last_change":"2024-04-25T02:23:12.848098+0000","last_active":"2024-04-25T02:28:08.503886+0000","last_peered":"2024-04-25T02:28:08.503886+0000","last_clean":"2024-04-25T02:28:08.503886+0000","last_became_active":"2024-04-25T02:23:12.847813+0000","last_became_peered":"2024-04-25T02:23:12.847813+0000","last_unstale":"2024-04-25T02:28:08.503886+0000","last_undegraded":"2024-04-25T02:28:08.503886+0000","last_fullsized":"2024-04-25T02:28:08.503886+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":311,"num_write_kb":4273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"43'442","reported_seq":492,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.365654+0000","last_change":"2024-04-25T02:23:55.963573+0000","last_active":"2024-04-25T02:28:12.365654+0000","last_peered":"2024-04-25T02:28:12.365654+0000","last_clean":"2024-04-25T02:28:12.365654+0000","last_became_active":"2024-04-25T02:23:55.963234+0000","last_became_peered":"2024-04-25T02:23:55.963234+0000","last_unstale":"2024-04-25T02:28:12.365654+0000","last_undegraded":"2024-04-25T02:28:12.365654+0000","last_fullsized":"2024-04-25T02:28:12.365654+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21039,"num_write":415,"num_write_kb":62968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"43'594","reported_seq":638,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.556488+0000","last_change":"2024-04-25T02:23:13.848143+0000","last_active":"2024-04-25T02:28:09.556488+0000","last_peered":"2024-04-25T02:28:09.556488+0000","last_clean":"2024-04-25T02:28:09.556488+0000","last_became_active":"2024-04-25T02:23:13.843704+0000","last_became_peered":"2024-04-25T02:23:13.843704+0000","last_unstale":"2024-04-25T02:28:09.556488+0000","last_undegraded":"2024-04-25T02:28:09.556488+0000","last_fullsized":"2024-04-25T02:28:09.556488+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":594,"log_dups_size":0,"ondisk_log_size":594,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":532,"num_write_kb":4350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"43'411","reported_seq":497,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.367461+0000","last_change":"2024-04-25T02:23:13.847842+0000","last_active":"2024-04-25T02:28:12.367461+0000","last_peered":"2024-04-25T02:28:12.367461+0000","last_clean":"2024-04-25T02:28:12.367461+0000","last_became_active":"2024-04-25T02:23:13.845782+0000","last_became_peered":"2024-04-25T02:23:13.845782+0000","last_unstale":"2024-04-25T02:28:12.367461+0000","last_undegraded":"2024-04-25T02:28:12.367461+0000","last_fullsized":"2024-04-25T02:28:12.367461+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":24562,"num_write":375,"num_write_kb":59351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"43'59","reported_seq":108,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:50.131386+0000","last_change":"2024-04-25T02:28:50.131363+0000","last_active":"2024-04-25T02:28:50.131386+0000","last_peered":"2024-04-25T02:28:50.131386+0000","last_clean":"2024-04-25T02:28:50.131386+0000","last_became_active":"2024-04-25T02:23:13.841815+0000","last_became_peered":"2024-04-25T02:23:13.841815+0000","last_unstale":"2024-04-25T02:28:50.131386+0000","last_undegraded":"2024-04-25T02:28:50.131386+0000","last_fullsized":"2024-04-25T02:28:50.131386+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'59","last_scrub_stamp":"2024-04-25T02:28:50.131276+0000","last_deep_scrub":"43'59","last_deep_scrub_stamp":"2024-04-25T02:28:50.131276+0000","last_clean_scrub_stamp":"2024-04-25T02:28:50.131276+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:39:19.674948+0000","scrub_duration":0.0013339000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"43'457","reported_seq":584,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:39.003748+0000","last_change":"2024-04-25T02:28:39.003715+0000","last_active":"2024-04-25T02:28:39.003748+0000","last_peered":"2024-04-25T02:28:39.003748+0000","last_clean":"2024-04-25T02:28:39.003748+0000","last_became_active":"2024-04-25T02:23:11.837258+0000","last_became_peered":"2024-04-25T02:23:11.837258+0000","last_unstale":"2024-04-25T02:28:39.003748+0000","last_undegraded":"2024-04-25T02:28:39.003748+0000","last_fullsized":"2024-04-25T02:28:39.003748+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'457","last_scrub_stamp":"2024-04-25T02:28:39.003606+0000","last_deep_scrub":"43'457","last_deep_scrub_stamp":"2024-04-25T02:28:39.003606+0000","last_clean_scrub_stamp":"2024-04-25T02:28:39.003606+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:51.514685+0000","scrub_duration":0.0023379960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":40530,"num_write":421,"num_write_kb":133096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"43'132","reported_seq":190,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:38.375455+0000","last_change":"2024-04-25T02:28:38.375418+0000","last_active":"2024-04-25T02:28:38.375455+0000","last_peered":"2024-04-25T02:28:38.375455+0000","last_clean":"2024-04-25T02:28:38.375455+0000","last_became_active":"2024-04-25T02:23:13.838665+0000","last_became_peered":"2024-04-25T02:23:13.838665+0000","last_unstale":"2024-04-25T02:28:38.375455+0000","last_undegraded":"2024-04-25T02:28:38.375455+0000","last_fullsized":"2024-04-25T02:28:38.375455+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'132","last_scrub_stamp":"2024-04-25T02:28:38.375296+0000","last_deep_scrub":"43'132","last_deep_scrub_stamp":"2024-04-25T02:28:38.375296+0000","last_clean_scrub_stamp":"2024-04-25T02:28:38.375296+0000","objects_scrubbed":4,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:47:08.874698+0000","scrub_duration":0.018905228,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":66,"num_write_kb":8229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"43'438","reported_seq":526,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.101612+0000","last_change":"2024-04-25T02:28:28.101582+0000","last_active":"2024-04-25T02:28:28.101612+0000","last_peered":"2024-04-25T02:28:28.101612+0000","last_clean":"2024-04-25T02:28:28.101612+0000","last_became_active":"2024-04-25T02:23:55.963557+0000","last_became_peered":"2024-04-25T02:23:55.963557+0000","last_unstale":"2024-04-25T02:28:28.101612+0000","last_undegraded":"2024-04-25T02:28:28.101612+0000","last_fullsized":"2024-04-25T02:28:28.101612+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'438","last_scrub_stamp":"2024-04-25T02:28:28.101477+0000","last_deep_scrub":"43'438","last_deep_scrub_stamp":"2024-04-25T02:28:28.101477+0000","last_clean_scrub_stamp":"2024-04-25T02:28:28.101477+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:13:04.055307+0000","scrub_duration":0.0022093569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":25759,"num_write":403,"num_write_kb":59138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"43'256","reported_seq":309,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:54.577347+0000","last_change":"2024-04-25T02:28:54.577309+0000","last_active":"2024-04-25T02:28:54.577347+0000","last_peered":"2024-04-25T02:28:54.577347+0000","last_clean":"2024-04-25T02:28:54.577347+0000","last_became_active":"2024-04-25T02:23:13.843652+0000","last_became_peered":"2024-04-25T02:23:13.843652+0000","last_unstale":"2024-04-25T02:28:54.577347+0000","last_undegraded":"2024-04-25T02:28:54.577347+0000","last_fullsized":"2024-04-25T02:28:54.577347+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'256","last_scrub_stamp":"2024-04-25T02:28:54.577189+0000","last_deep_scrub":"43'256","last_deep_scrub_stamp":"2024-04-25T02:28:54.577189+0000","last_clean_scrub_stamp":"2024-04-25T02:28:54.577189+0000","objects_scrubbed":2,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:57:05.312089+0000","scrub_duration":0.01333373,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":4213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"43'389","reported_seq":423,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.367602+0000","last_change":"2024-04-25T02:23:56.302316+0000","last_active":"2024-04-25T02:28:12.367602+0000","last_peered":"2024-04-25T02:28:12.367602+0000","last_clean":"2024-04-25T02:28:12.367602+0000","last_became_active":"2024-04-25T02:23:56.301997+0000","last_became_peered":"2024-04-25T02:23:56.301997+0000","last_unstale":"2024-04-25T02:28:12.367602+0000","last_undegraded":"2024-04-25T02:28:12.367602+0000","last_fullsized":"2024-04-25T02:28:12.367602+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13585,"num_write":362,"num_write_kb":34032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"43'63","reported_seq":103,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.518277+0000","last_change":"2024-04-25T02:23:13.842533+0000","last_active":"2024-04-25T02:28:08.518277+0000","last_peered":"2024-04-25T02:28:08.518277+0000","last_clean":"2024-04-25T02:28:08.518277+0000","last_became_active":"2024-04-25T02:23:13.841049+0000","last_became_peered":"2024-04-25T02:23:13.841049+0000","last_unstale":"2024-04-25T02:28:08.518277+0000","last_undegraded":"2024-04-25T02:28:08.518277+0000","last_fullsized":"2024-04-25T02:28:08.518277+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"43'360","reported_seq":433,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:29.186993+0000","last_change":"2024-04-25T02:28:29.186947+0000","last_active":"2024-04-25T02:28:29.186993+0000","last_peered":"2024-04-25T02:28:29.186993+0000","last_clean":"2024-04-25T02:28:29.186993+0000","last_became_active":"2024-04-25T02:23:13.846425+0000","last_became_peered":"2024-04-25T02:23:13.846425+0000","last_unstale":"2024-04-25T02:28:29.186993+0000","last_undegraded":"2024-04-25T02:28:29.186993+0000","last_fullsized":"2024-04-25T02:28:29.186993+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'360","last_scrub_stamp":"2024-04-25T02:28:29.186834+0000","last_deep_scrub":"43'360","last_deep_scrub_stamp":"2024-04-25T02:28:29.186834+0000","last_clean_scrub_stamp":"2024-04-25T02:28:29.186834+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:38:30.162583+0000","scrub_duration":0.002422633,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":12898,"num_write":328,"num_write_kb":42412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"43'567","reported_seq":620,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:43.405130+0000","last_change":"2024-04-25T02:28:43.405100+0000","last_active":"2024-04-25T02:28:43.405130+0000","last_peered":"2024-04-25T02:28:43.405130+0000","last_clean":"2024-04-25T02:28:43.405130+0000","last_became_active":"2024-04-25T02:23:13.840876+0000","last_became_peered":"2024-04-25T02:23:13.840876+0000","last_unstale":"2024-04-25T02:28:43.405130+0000","last_undegraded":"2024-04-25T02:28:43.405130+0000","last_fullsized":"2024-04-25T02:28:43.405130+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'567","last_scrub_stamp":"2024-04-25T02:28:43.405002+0000","last_deep_scrub":"43'567","last_deep_scrub_stamp":"2024-04-25T02:28:43.405002+0000","last_clean_scrub_stamp":"2024-04-25T02:28:43.405002+0000","objects_scrubbed":2,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:17:38.360428+0000","scrub_duration":0.013702443,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":506,"num_write_kb":4331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"43'387","reported_seq":465,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.365549+0000","last_change":"2024-04-25T02:23:13.852754+0000","last_active":"2024-04-25T02:28:12.365549+0000","last_peered":"2024-04-25T02:28:12.365549+0000","last_clean":"2024-04-25T02:28:12.365549+0000","last_became_active":"2024-04-25T02:23:13.852398+0000","last_became_peered":"2024-04-25T02:23:13.852398+0000","last_unstale":"2024-04-25T02:28:12.365549+0000","last_undegraded":"2024-04-25T02:28:12.365549+0000","last_fullsized":"2024-04-25T02:28:12.365549+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":28255,"num_write":354,"num_write_kb":58406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":33,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:25:10.065939+0000","last_change":"2024-04-25T02:23:11.834419+0000","last_active":"2024-04-25T02:25:10.065939+0000","last_peered":"2024-04-25T02:25:10.065939+0000","last_clean":"2024-04-25T02:25:10.065939+0000","last_became_active":"2024-04-25T02:23:11.834171+0000","last_became_peered":"2024-04-25T02:23:11.834171+0000","last_unstale":"2024-04-25T02:25:10.065939+0000","last_undegraded":"2024-04-25T02:25:10.065939+0000","last_fullsized":"2024-04-25T02:25:10.065939+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"43'432","reported_seq":478,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:32.100599+0000","last_change":"2024-04-25T02:28:32.100572+0000","last_active":"2024-04-25T02:28:32.100599+0000","last_peered":"2024-04-25T02:28:32.100599+0000","last_clean":"2024-04-25T02:28:32.100599+0000","last_became_active":"2024-04-25T02:23:13.847970+0000","last_became_peered":"2024-04-25T02:23:13.847970+0000","last_unstale":"2024-04-25T02:28:32.100599+0000","last_undegraded":"2024-04-25T02:28:32.100599+0000","last_fullsized":"2024-04-25T02:28:32.100599+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'432","last_scrub_stamp":"2024-04-25T02:28:32.100463+0000","last_deep_scrub":"43'432","last_deep_scrub_stamp":"2024-04-25T02:28:32.100463+0000","last_clean_scrub_stamp":"2024-04-25T02:28:32.100463+0000","objects_scrubbed":2,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:01:10.912094+0000","scrub_duration":0.014522729,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":371,"num_write_kb":4349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"43'357","reported_seq":420,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:22.964197+0000","last_change":"2024-04-25T02:28:22.964168+0000","last_active":"2024-04-25T02:28:22.964197+0000","last_peered":"2024-04-25T02:28:22.964197+0000","last_clean":"2024-04-25T02:28:22.964197+0000","last_became_active":"2024-04-25T02:23:13.849556+0000","last_became_peered":"2024-04-25T02:23:13.849556+0000","last_unstale":"2024-04-25T02:28:22.964197+0000","last_undegraded":"2024-04-25T02:28:22.964197+0000","last_fullsized":"2024-04-25T02:28:22.964197+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'357","last_scrub_stamp":"2024-04-25T02:28:22.964054+0000","last_deep_scrub":"43'357","last_deep_scrub_stamp":"2024-04-25T02:28:22.964054+0000","last_clean_scrub_stamp":"2024-04-25T02:28:22.964054+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:33:24.355131+0000","scrub_duration":0.002218271,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8777,"num_write":323,"num_write_kb":25948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:25:10.069025+0000","last_change":"2024-04-25T02:23:13.848430+0000","last_active":"2024-04-25T02:25:10.069025+0000","last_peered":"2024-04-25T02:25:10.069025+0000","last_clean":"2024-04-25T02:25:10.069025+0000","last_became_active":"2024-04-25T02:23:13.847888+0000","last_became_peered":"2024-04-25T02:23:13.847888+0000","last_unstale":"2024-04-25T02:25:10.069025+0000","last_undegraded":"2024-04-25T02:25:10.069025+0000","last_fullsized":"2024-04-25T02:25:10.069025+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"43'72","reported_seq":124,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:37.052787+0000","last_change":"2024-04-25T02:28:37.052732+0000","last_active":"2024-04-25T02:28:37.052787+0000","last_peered":"2024-04-25T02:28:37.052787+0000","last_clean":"2024-04-25T02:28:37.052787+0000","last_became_active":"2024-04-25T02:23:12.848312+0000","last_became_peered":"2024-04-25T02:23:12.848312+0000","last_unstale":"2024-04-25T02:28:37.052787+0000","last_undegraded":"2024-04-25T02:28:37.052787+0000","last_fullsized":"2024-04-25T02:28:37.052787+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'72","last_scrub_stamp":"2024-04-25T02:28:37.052632+0000","last_deep_scrub":"43'72","last_deep_scrub_stamp":"2024-04-25T02:28:37.052632+0000","last_clean_scrub_stamp":"2024-04-25T02:28:37.052632+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:06:14.430755+0000","scrub_duration":0.0037485779999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"43'385","reported_seq":477,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:47.914656+0000","last_change":"2024-04-25T02:28:47.914600+0000","last_active":"2024-04-25T02:28:47.914656+0000","last_peered":"2024-04-25T02:28:47.914656+0000","last_clean":"2024-04-25T02:28:47.914656+0000","last_became_active":"2024-04-25T02:23:12.841408+0000","last_became_peered":"2024-04-25T02:23:12.841408+0000","last_unstale":"2024-04-25T02:28:47.914656+0000","last_undegraded":"2024-04-25T02:28:47.914656+0000","last_fullsized":"2024-04-25T02:28:47.914656+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'385","last_scrub_stamp":"2024-04-25T02:28:47.914480+0000","last_deep_scrub":"43'385","last_deep_scrub_stamp":"2024-04-25T02:28:47.914480+0000","last_clean_scrub_stamp":"2024-04-25T02:28:47.914480+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:56.748268+0000","scrub_duration":0.0025485909999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":27937,"num_write":348,"num_write_kb":51359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":34,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:25:10.067085+0000","last_change":"2024-04-25T02:23:13.848743+0000","last_active":"2024-04-25T02:25:10.067085+0000","last_peered":"2024-04-25T02:25:10.067085+0000","last_clean":"2024-04-25T02:25:10.067085+0000","last_became_active":"2024-04-25T02:23:13.848076+0000","last_became_peered":"2024-04-25T02:23:13.848076+0000","last_unstale":"2024-04-25T02:25:10.067085+0000","last_undegraded":"2024-04-25T02:25:10.067085+0000","last_fullsized":"2024-04-25T02:25:10.067085+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"43'394","reported_seq":429,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.513323+0000","last_change":"2024-04-25T02:23:12.848506+0000","last_active":"2024-04-25T02:28:08.513323+0000","last_peered":"2024-04-25T02:28:08.513323+0000","last_clean":"2024-04-25T02:28:08.513323+0000","last_became_active":"2024-04-25T02:23:12.848229+0000","last_became_peered":"2024-04-25T02:23:12.848229+0000","last_unstale":"2024-04-25T02:28:08.513323+0000","last_undegraded":"2024-04-25T02:28:08.513323+0000","last_fullsized":"2024-04-25T02:28:08.513323+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":337,"num_write_kb":8338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"43'349","reported_seq":400,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.357426+0000","last_change":"2024-04-25T02:23:11.835239+0000","last_active":"2024-04-25T02:28:12.357426+0000","last_peered":"2024-04-25T02:28:12.357426+0000","last_clean":"2024-04-25T02:28:12.357426+0000","last_became_active":"2024-04-25T02:23:11.834994+0000","last_became_peered":"2024-04-25T02:23:11.834994+0000","last_unstale":"2024-04-25T02:28:12.357426+0000","last_undegraded":"2024-04-25T02:28:12.357426+0000","last_fullsized":"2024-04-25T02:28:12.357426+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":11931,"num_write":325,"num_write_kb":25986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":53,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:48.471620+0000","last_change":"2024-04-25T02:28:48.471576+0000","last_active":"2024-04-25T02:28:48.471620+0000","last_peered":"2024-04-25T02:28:48.471620+0000","last_clean":"2024-04-25T02:28:48.471620+0000","last_became_active":"2024-04-25T02:23:13.848628+0000","last_became_peered":"2024-04-25T02:23:13.848628+0000","last_unstale":"2024-04-25T02:28:48.471620+0000","last_undegraded":"2024-04-25T02:28:48.471620+0000","last_fullsized":"2024-04-25T02:28:48.471620+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:48.471463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:48.471463+0000","last_clean_scrub_stamp":"2024-04-25T02:28:48.471463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:16:32.732598+0000","scrub_duration":0.0015455829999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"43'117","reported_seq":205,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:43.952390+0000","last_change":"2024-04-25T02:28:43.952355+0000","last_active":"2024-04-25T02:28:43.952390+0000","last_peered":"2024-04-25T02:28:43.952390+0000","last_clean":"2024-04-25T02:28:43.952390+0000","last_became_active":"2024-04-25T02:23:11.835430+0000","last_became_peered":"2024-04-25T02:23:11.835430+0000","last_unstale":"2024-04-25T02:28:43.952390+0000","last_undegraded":"2024-04-25T02:28:43.952390+0000","last_fullsized":"2024-04-25T02:28:43.952390+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'117","last_scrub_stamp":"2024-04-25T02:28:43.952236+0000","last_deep_scrub":"43'117","last_deep_scrub_stamp":"2024-04-25T02:28:43.952236+0000","last_clean_scrub_stamp":"2024-04-25T02:28:43.952236+0000","objects_scrubbed":2,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:46:14.784576+0000","scrub_duration":0.005143936,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"43'573","reported_seq":613,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:06.519039+0000","last_change":"2024-04-25T02:23:13.848149+0000","last_active":"2024-04-25T02:28:06.519039+0000","last_peered":"2024-04-25T02:28:06.519039+0000","last_clean":"2024-04-25T02:28:06.519039+0000","last_became_active":"2024-04-25T02:23:13.845029+0000","last_became_peered":"2024-04-25T02:23:13.845029+0000","last_unstale":"2024-04-25T02:28:06.519039+0000","last_undegraded":"2024-04-25T02:28:06.519039+0000","last_fullsized":"2024-04-25T02:28:06.519039+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":573,"log_dups_size":0,"ondisk_log_size":573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":507,"num_write_kb":8447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"43'449","reported_seq":571,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:22.192884+0000","last_change":"2024-04-25T02:28:22.192856+0000","last_active":"2024-04-25T02:28:22.192884+0000","last_peered":"2024-04-25T02:28:22.192884+0000","last_clean":"2024-04-25T02:28:22.192884+0000","last_became_active":"2024-04-25T02:23:13.844018+0000","last_became_peered":"2024-04-25T02:23:13.844018+0000","last_unstale":"2024-04-25T02:28:22.192884+0000","last_undegraded":"2024-04-25T02:28:22.192884+0000","last_fullsized":"2024-04-25T02:28:22.192884+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'449","last_scrub_stamp":"2024-04-25T02:28:22.192764+0000","last_deep_scrub":"43'449","last_deep_scrub_stamp":"2024-04-25T02:28:22.192764+0000","last_clean_scrub_stamp":"2024-04-25T02:28:22.192764+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:28.942878+0000","scrub_duration":0.0021300249999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":31679,"num_write":414,"num_write_kb":80533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:25:10.068836+0000","last_change":"2024-04-25T02:23:13.848526+0000","last_active":"2024-04-25T02:25:10.068836+0000","last_peered":"2024-04-25T02:25:10.068836+0000","last_clean":"2024-04-25T02:25:10.068836+0000","last_became_active":"2024-04-25T02:23:13.844753+0000","last_became_peered":"2024-04-25T02:23:13.844753+0000","last_unstale":"2024-04-25T02:25:10.068836+0000","last_undegraded":"2024-04-25T02:25:10.068836+0000","last_fullsized":"2024-04-25T02:25:10.068836+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"43'252","reported_seq":475,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.480206+0000","last_change":"2024-04-25T02:23:12.845945+0000","last_active":"2024-04-25T02:28:12.480206+0000","last_peered":"2024-04-25T02:28:12.480206+0000","last_clean":"2024-04-25T02:28:12.480206+0000","last_became_active":"2024-04-25T02:23:12.845638+0000","last_became_peered":"2024-04-25T02:23:12.845638+0000","last_unstale":"2024-04-25T02:28:12.480206+0000","last_undegraded":"2024-04-25T02:28:12.480206+0000","last_fullsized":"2024-04-25T02:28:12.480206+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":252,"log_dups_size":0,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1460763,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":182,"num_read_kb":1548,"num_write":182,"num_write_kb":1548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"43'454","reported_seq":573,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.366445+0000","last_change":"2024-04-25T02:23:11.840630+0000","last_active":"2024-04-25T02:28:12.366445+0000","last_peered":"2024-04-25T02:28:12.366445+0000","last_clean":"2024-04-25T02:28:12.366445+0000","last_became_active":"2024-04-25T02:23:11.840215+0000","last_became_peered":"2024-04-25T02:23:11.840215+0000","last_unstale":"2024-04-25T02:28:12.366445+0000","last_undegraded":"2024-04-25T02:28:12.366445+0000","last_fullsized":"2024-04-25T02:28:12.366445+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":42224,"num_write":426,"num_write_kb":96444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":50,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:25:10.069694+0000","last_change":"2024-04-25T02:23:13.845169+0000","last_active":"2024-04-25T02:25:10.069694+0000","last_peered":"2024-04-25T02:25:10.069694+0000","last_clean":"2024-04-25T02:25:10.069694+0000","last_became_active":"2024-04-25T02:23:13.841324+0000","last_became_peered":"2024-04-25T02:23:13.841324+0000","last_unstale":"2024-04-25T02:25:10.069694+0000","last_undegraded":"2024-04-25T02:25:10.069694+0000","last_fullsized":"2024-04-25T02:25:10.069694+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"43'53","reported_seq":86,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.512310+0000","last_change":"2024-04-25T02:23:12.842493+0000","last_active":"2024-04-25T02:28:10.512310+0000","last_peered":"2024-04-25T02:28:10.512310+0000","last_clean":"2024-04-25T02:28:10.512310+0000","last_became_active":"2024-04-25T02:23:12.841930+0000","last_became_peered":"2024-04-25T02:23:12.841930+0000","last_unstale":"2024-04-25T02:28:10.512310+0000","last_undegraded":"2024-04-25T02:28:10.512310+0000","last_fullsized":"2024-04-25T02:28:10.512310+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"43'427","reported_seq":596,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:35.112665+0000","last_change":"2024-04-25T02:28:35.112631+0000","last_active":"2024-04-25T02:28:35.112665+0000","last_peered":"2024-04-25T02:28:35.112665+0000","last_clean":"2024-04-25T02:28:35.112665+0000","last_became_active":"2024-04-25T02:23:12.847949+0000","last_became_peered":"2024-04-25T02:23:12.847949+0000","last_unstale":"2024-04-25T02:28:35.112665+0000","last_undegraded":"2024-04-25T02:28:35.112665+0000","last_fullsized":"2024-04-25T02:28:35.112665+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'427","last_scrub_stamp":"2024-04-25T02:28:35.112522+0000","last_deep_scrub":"43'427","last_deep_scrub_stamp":"2024-04-25T02:28:35.112522+0000","last_clean_scrub_stamp":"2024-04-25T02:28:35.112522+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:01.667215+0000","scrub_duration":0.0025605430000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":62452,"num_write":394,"num_write_kb":105065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"43'65","reported_seq":109,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.480554+0000","last_change":"2024-04-25T02:23:13.844968+0000","last_active":"2024-04-25T02:28:10.480554+0000","last_peered":"2024-04-25T02:28:10.480554+0000","last_clean":"2024-04-25T02:28:10.480554+0000","last_became_active":"2024-04-25T02:23:13.844133+0000","last_became_peered":"2024-04-25T02:23:13.844133+0000","last_unstale":"2024-04-25T02:28:10.480554+0000","last_undegraded":"2024-04-25T02:28:10.480554+0000","last_fullsized":"2024-04-25T02:28:10.480554+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":33,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:25:10.066270+0000","last_change":"2024-04-25T02:23:11.837086+0000","last_active":"2024-04-25T02:25:10.066270+0000","last_peered":"2024-04-25T02:25:10.066270+0000","last_clean":"2024-04-25T02:25:10.066270+0000","last_became_active":"2024-04-25T02:23:11.836737+0000","last_became_peered":"2024-04-25T02:23:11.836737+0000","last_unstale":"2024-04-25T02:25:10.066270+0000","last_undegraded":"2024-04-25T02:25:10.066270+0000","last_fullsized":"2024-04-25T02:25:10.066270+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"43'434","reported_seq":567,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.368187+0000","last_change":"2024-04-25T02:23:13.848280+0000","last_active":"2024-04-25T02:28:12.368187+0000","last_peered":"2024-04-25T02:28:12.368187+0000","last_clean":"2024-04-25T02:28:12.368187+0000","last_became_active":"2024-04-25T02:23:13.843915+0000","last_became_peered":"2024-04-25T02:23:13.843915+0000","last_unstale":"2024-04-25T02:28:12.368187+0000","last_undegraded":"2024-04-25T02:28:12.368187+0000","last_fullsized":"2024-04-25T02:28:12.368187+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":48451,"num_write":406,"num_write_kb":112597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":60,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:45.426103+0000","last_change":"2024-04-25T02:28:45.426067+0000","last_active":"2024-04-25T02:28:45.426103+0000","last_peered":"2024-04-25T02:28:45.426103+0000","last_clean":"2024-04-25T02:28:45.426103+0000","last_became_active":"2024-04-25T02:23:13.838746+0000","last_became_peered":"2024-04-25T02:23:13.838746+0000","last_unstale":"2024-04-25T02:28:45.426103+0000","last_undegraded":"2024-04-25T02:28:45.426103+0000","last_fullsized":"2024-04-25T02:28:45.426103+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:45.425965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:45.425965+0000","last_clean_scrub_stamp":"2024-04-25T02:28:45.425965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:51.800756+0000","scrub_duration":0.0014993350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"43'86","reported_seq":126,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:16.198349+0000","last_change":"2024-04-25T02:23:11.840837+0000","last_active":"2024-04-25T02:28:16.198349+0000","last_peered":"2024-04-25T02:28:16.198349+0000","last_clean":"2024-04-25T02:28:16.198349+0000","last_became_active":"2024-04-25T02:23:11.840553+0000","last_became_peered":"2024-04-25T02:23:11.840553+0000","last_unstale":"2024-04-25T02:28:16.198349+0000","last_undegraded":"2024-04-25T02:28:16.198349+0000","last_fullsized":"2024-04-25T02:28:16.198349+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":74,"num_write_kb":962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"43'397","reported_seq":485,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.366683+0000","last_change":"2024-04-25T02:23:13.848907+0000","last_active":"2024-04-25T02:28:12.366683+0000","last_peered":"2024-04-25T02:28:12.366683+0000","last_clean":"2024-04-25T02:28:12.366683+0000","last_became_active":"2024-04-25T02:23:13.848374+0000","last_became_peered":"2024-04-25T02:23:13.848374+0000","last_unstale":"2024-04-25T02:28:12.366683+0000","last_undegraded":"2024-04-25T02:28:12.366683+0000","last_fullsized":"2024-04-25T02:28:12.366683+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":25341,"num_write":367,"num_write_kb":104771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"43'122","reported_seq":164,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:07.500111+0000","last_change":"2024-04-25T02:23:13.842766+0000","last_active":"2024-04-25T02:28:07.500111+0000","last_peered":"2024-04-25T02:28:07.500111+0000","last_clean":"2024-04-25T02:28:07.500111+0000","last_became_active":"2024-04-25T02:23:13.842438+0000","last_became_peered":"2024-04-25T02:23:13.842438+0000","last_unstale":"2024-04-25T02:28:07.500111+0000","last_undegraded":"2024-04-25T02:28:07.500111+0000","last_fullsized":"2024-04-25T02:28:07.500111+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4196548,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"43'373","reported_seq":456,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.368180+0000","last_change":"2024-04-25T02:23:12.844587+0000","last_active":"2024-04-25T02:28:12.368180+0000","last_peered":"2024-04-25T02:28:12.368180+0000","last_clean":"2024-04-25T02:28:12.368180+0000","last_became_active":"2024-04-25T02:23:12.844258+0000","last_became_peered":"2024-04-25T02:23:12.844258+0000","last_unstale":"2024-04-25T02:28:12.368180+0000","last_undegraded":"2024-04-25T02:28:12.368180+0000","last_fullsized":"2024-04-25T02:28:12.368180+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":25157,"num_write":340,"num_write_kb":59328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"43'316","reported_seq":350,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.528093+0000","last_change":"2024-04-25T02:23:11.833629+0000","last_active":"2024-04-25T02:28:09.528093+0000","last_peered":"2024-04-25T02:28:09.528093+0000","last_clean":"2024-04-25T02:28:09.528093+0000","last_became_active":"2024-04-25T02:23:11.833348+0000","last_became_peered":"2024-04-25T02:23:11.833348+0000","last_unstale":"2024-04-25T02:28:09.528093+0000","last_undegraded":"2024-04-25T02:28:09.528093+0000","last_fullsized":"2024-04-25T02:28:09.528093+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":316,"log_dups_size":0,"ondisk_log_size":316,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":262,"num_write_kb":4264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"43'371","reported_seq":471,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:20.223269+0000","last_change":"2024-04-25T02:28:20.223232+0000","last_active":"2024-04-25T02:28:20.223269+0000","last_peered":"2024-04-25T02:28:20.223269+0000","last_clean":"2024-04-25T02:28:20.223269+0000","last_became_active":"2024-04-25T02:23:55.963467+0000","last_became_peered":"2024-04-25T02:23:55.963467+0000","last_unstale":"2024-04-25T02:28:20.223269+0000","last_undegraded":"2024-04-25T02:28:20.223269+0000","last_fullsized":"2024-04-25T02:28:20.223269+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'371","last_scrub_stamp":"2024-04-25T02:28:20.223133+0000","last_deep_scrub":"43'371","last_deep_scrub_stamp":"2024-04-25T02:28:20.223133+0000","last_clean_scrub_stamp":"2024-04-25T02:28:20.223133+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:12.999404+0000","scrub_duration":0.0022911020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":32821,"num_write":343,"num_write_kb":62943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"43'323","reported_seq":371,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:09.489175+0000","last_change":"2024-04-25T02:23:13.842735+0000","last_active":"2024-04-25T02:28:09.489175+0000","last_peered":"2024-04-25T02:28:09.489175+0000","last_clean":"2024-04-25T02:28:09.489175+0000","last_became_active":"2024-04-25T02:23:13.840492+0000","last_became_peered":"2024-04-25T02:23:13.840492+0000","last_unstale":"2024-04-25T02:28:09.489175+0000","last_undegraded":"2024-04-25T02:28:09.489175+0000","last_fullsized":"2024-04-25T02:28:09.489175+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":323,"log_dups_size":0,"ondisk_log_size":323,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":257,"num_write_kb":12449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"43'384","reported_seq":454,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:25.236814+0000","last_change":"2024-04-25T02:28:25.236776+0000","last_active":"2024-04-25T02:28:25.236814+0000","last_peered":"2024-04-25T02:28:25.236814+0000","last_clean":"2024-04-25T02:28:25.236814+0000","last_became_active":"2024-04-25T02:23:13.847264+0000","last_became_peered":"2024-04-25T02:23:13.847264+0000","last_unstale":"2024-04-25T02:28:25.236814+0000","last_undegraded":"2024-04-25T02:28:25.236814+0000","last_fullsized":"2024-04-25T02:28:25.236814+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'384","last_scrub_stamp":"2024-04-25T02:28:25.236669+0000","last_deep_scrub":"43'384","last_deep_scrub_stamp":"2024-04-25T02:28:25.236669+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.236669+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:51.748406+0000","scrub_duration":0.002112685,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":15655,"num_write":352,"num_write_kb":42131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"43'94","reported_seq":144,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:50.478023+0000","last_change":"2024-04-25T02:28:50.477980+0000","last_active":"2024-04-25T02:28:50.478023+0000","last_peered":"2024-04-25T02:28:50.478023+0000","last_clean":"2024-04-25T02:28:50.478023+0000","last_became_active":"2024-04-25T02:23:13.845143+0000","last_became_peered":"2024-04-25T02:23:13.845143+0000","last_unstale":"2024-04-25T02:28:50.478023+0000","last_undegraded":"2024-04-25T02:28:50.478023+0000","last_fullsized":"2024-04-25T02:28:50.478023+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'94","last_scrub_stamp":"2024-04-25T02:28:50.477893+0000","last_deep_scrub":"43'94","last_deep_scrub_stamp":"2024-04-25T02:28:50.477893+0000","last_clean_scrub_stamp":"2024-04-25T02:28:50.477893+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:47:38.664790+0000","scrub_duration":0.0099647699999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":4121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"43'427","reported_seq":462,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.348849+0000","last_change":"2024-04-25T02:23:55.957176+0000","last_active":"2024-04-25T02:28:12.348849+0000","last_peered":"2024-04-25T02:28:12.348849+0000","last_clean":"2024-04-25T02:28:12.348849+0000","last_became_active":"2024-04-25T02:23:55.956828+0000","last_became_peered":"2024-04-25T02:23:55.956828+0000","last_unstale":"2024-04-25T02:28:12.348849+0000","last_undegraded":"2024-04-25T02:28:12.348849+0000","last_fullsized":"2024-04-25T02:28:12.348849+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":14079,"num_write":394,"num_write_kb":87521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"43'114","reported_seq":160,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:20.198034+0000","last_change":"2024-04-25T02:28:20.198001+0000","last_active":"2024-04-25T02:28:20.198034+0000","last_peered":"2024-04-25T02:28:20.198034+0000","last_clean":"2024-04-25T02:28:20.198034+0000","last_became_active":"2024-04-25T02:23:11.838807+0000","last_became_peered":"2024-04-25T02:23:11.838807+0000","last_unstale":"2024-04-25T02:28:20.198034+0000","last_undegraded":"2024-04-25T02:28:20.198034+0000","last_fullsized":"2024-04-25T02:28:20.198034+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'114","last_scrub_stamp":"2024-04-25T02:28:20.197907+0000","last_deep_scrub":"43'114","last_deep_scrub_stamp":"2024-04-25T02:28:20.197907+0000","last_clean_scrub_stamp":"2024-04-25T02:28:20.197907+0000","objects_scrubbed":3,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:47:55.330863+0000","scrub_duration":0.011784594000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":59,"num_write_kb":4127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"43'447","reported_seq":531,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:53.887469+0000","last_change":"2024-04-25T02:28:53.887441+0000","last_active":"2024-04-25T02:28:53.887469+0000","last_peered":"2024-04-25T02:28:53.887469+0000","last_clean":"2024-04-25T02:28:53.887469+0000","last_became_active":"2024-04-25T02:23:12.845497+0000","last_became_peered":"2024-04-25T02:23:12.845497+0000","last_unstale":"2024-04-25T02:28:53.887469+0000","last_undegraded":"2024-04-25T02:28:53.887469+0000","last_fullsized":"2024-04-25T02:28:53.887469+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'447","last_scrub_stamp":"2024-04-25T02:28:53.887343+0000","last_deep_scrub":"43'447","last_deep_scrub_stamp":"2024-04-25T02:28:53.887343+0000","last_clean_scrub_stamp":"2024-04-25T02:28:53.887343+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:59:00.846583+0000","scrub_duration":0.0022684239999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15742,"num_write":414,"num_write_kb":51315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"43'419","reported_seq":485,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.369706+0000","last_change":"2024-04-25T02:23:12.847086+0000","last_active":"2024-04-25T02:28:12.369706+0000","last_peered":"2024-04-25T02:28:12.369706+0000","last_clean":"2024-04-25T02:28:12.369706+0000","last_became_active":"2024-04-25T02:23:12.846719+0000","last_became_peered":"2024-04-25T02:23:12.846719+0000","last_unstale":"2024-04-25T02:28:12.369706+0000","last_undegraded":"2024-04-25T02:28:12.369706+0000","last_fullsized":"2024-04-25T02:28:12.369706+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":16944,"num_write":389,"num_write_kb":35957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"43'440","reported_seq":485,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.367687+0000","last_change":"2024-04-25T02:23:56.302118+0000","last_active":"2024-04-25T02:28:12.367687+0000","last_peered":"2024-04-25T02:28:12.367687+0000","last_clean":"2024-04-25T02:28:12.367687+0000","last_became_active":"2024-04-25T02:23:56.301745+0000","last_became_peered":"2024-04-25T02:23:56.301745+0000","last_unstale":"2024-04-25T02:28:12.367687+0000","last_undegraded":"2024-04-25T02:28:12.367687+0000","last_fullsized":"2024-04-25T02:28:12.367687+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":12557,"num_write":410,"num_write_kb":77332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"43'492","reported_seq":571,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:24.176583+0000","last_change":"2024-04-25T02:28:24.176533+0000","last_active":"2024-04-25T02:28:24.176583+0000","last_peered":"2024-04-25T02:28:24.176583+0000","last_clean":"2024-04-25T02:28:24.176583+0000","last_became_active":"2024-04-25T02:23:13.844235+0000","last_became_peered":"2024-04-25T02:23:13.844235+0000","last_unstale":"2024-04-25T02:28:24.176583+0000","last_undegraded":"2024-04-25T02:28:24.176583+0000","last_fullsized":"2024-04-25T02:28:24.176583+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'492","last_scrub_stamp":"2024-04-25T02:28:24.176384+0000","last_deep_scrub":"43'492","last_deep_scrub_stamp":"2024-04-25T02:28:24.176384+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.176384+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:15.054028+0000","scrub_duration":0.002556961,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14237,"num_write":458,"num_write_kb":116854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"43'392","reported_seq":472,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.363169+0000","last_change":"2024-04-25T02:23:13.849525+0000","last_active":"2024-04-25T02:28:12.363169+0000","last_peered":"2024-04-25T02:28:12.363169+0000","last_clean":"2024-04-25T02:28:12.363169+0000","last_became_active":"2024-04-25T02:23:13.845193+0000","last_became_peered":"2024-04-25T02:23:13.845193+0000","last_unstale":"2024-04-25T02:28:12.363169+0000","last_undegraded":"2024-04-25T02:28:12.363169+0000","last_fullsized":"2024-04-25T02:28:12.363169+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":36152,"num_write":360,"num_write_kb":54497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"43'402","reported_seq":504,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.360499+0000","last_change":"2024-04-25T02:23:12.842342+0000","last_active":"2024-04-25T02:28:12.360499+0000","last_peered":"2024-04-25T02:28:12.360499+0000","last_clean":"2024-04-25T02:28:12.360499+0000","last_became_active":"2024-04-25T02:23:12.841677+0000","last_became_peered":"2024-04-25T02:23:12.841677+0000","last_unstale":"2024-04-25T02:28:12.360499+0000","last_undegraded":"2024-04-25T02:28:12.360499+0000","last_fullsized":"2024-04-25T02:28:12.360499+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":32628,"num_write":375,"num_write_kb":79888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2779,"num_read_kb":1446401,"num_write":24390,"num_write_kb":4320360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26350,"ondisk_log_size":26350,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":129261049,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":231,"num_read_kb":1603,"num_write":6644,"num_write_kb":130848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":258629632,"data_stored":258522098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39115,"internal_metadata":0},"log_size":8515,"ondisk_log_size":8515,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":31,"seq":133143986247,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":389724,"kb_used_data":88340,"kb_used_omap":9,"kb_used_meta":301366,"kb_avail":93982116,"statfs":{"total":96636764160,"available":96237686784,"internally_reserved":0,"allocated":90460160,"data_stored":90216632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9975,"internal_metadata":308599049},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.22,"5min":0.33600000000000002,"15min":0.33400000000000002},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.33400000000000002,"5min":3.5409999999999999,"15min":3.5409999999999999},"last":0.372},{"interface":"front","average":{"1min":0.25600000000000001,"5min":0.39000000000000001,"15min":0.36299999999999999},"min":{"1min":0.20100000000000001,"5min":0.161,"15min":0.161},"max":{"1min":0.38200000000000001,"5min":3.613,"15min":3.613},"last":0.308}]},{"osd":1,"last update":"Thu Apr 25 02:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.27800000000000002,"5min":0.374,"15min":0.35999999999999999},"min":{"1min":0.19900000000000001,"5min":0.184,"15min":0.184},"max":{"1min":0.86799999999999999,"5min":3.0009999999999999,"15min":3.0009999999999999},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.27200000000000002,"5min":0.38,"15min":0.36699999999999999},"min":{"1min":0.20899999999999999,"5min":0.157,"15min":0.157},"max":{"1min":0.36899999999999999,"5min":4.9720000000000004,"15min":4.9720000000000004},"last":0.32300000000000001}]},{"osd":2,"last update":"Thu Apr 25 02:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.28000000000000003,"5min":0.41599999999999998,"15min":0.375},"min":{"1min":0.182,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.41699999999999998,"5min":4.883,"15min":4.883},"last":0.38300000000000001},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.39400000000000002,"15min":0.38200000000000001},"min":{"1min":0.214,"5min":0.184,"15min":0.184},"max":{"1min":1.004,"5min":3.0550000000000002,"15min":3.0550000000000002},"last":0.34699999999999998}]}]},{"osd":2,"up_from":30,"seq":128849018951,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":362388,"kb_used_data":56972,"kb_used_omap":8,"kb_used_meta":305399,"kb_avail":94009452,"statfs":{"total":96636764160,"available":96265678848,"internally_reserved":0,"allocated":58339328,"data_stored":58119882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8387,"internal_metadata":312729405},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:28:19 2024","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.32000000000000001,"15min":0.32200000000000001},"min":{"1min":0.16600000000000001,"5min":0.14199999999999999,"15min":0.14199999999999999},"max":{"1min":2.419,"5min":2.419,"15min":2.419},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.28100000000000003,"5min":0.316,"15min":0.32600000000000001},"min":{"1min":0.192,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.45800000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"last":0.47799999999999998}]},{"osd":1,"last update":"Thu Apr 25 02:28:19 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.19600000000000001,"5min":0.19,"15min":0.19},"max":{"1min":0.89500000000000002,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.314,"5min":0.34499999999999997,"15min":0.34699999999999998},"min":{"1min":0.20399999999999999,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.58899999999999997,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.48799999999999999}]},{"osd":3,"last update":"Thu Apr 25 02:28:19 2024","interfaces":[{"interface":"back","average":{"1min":0.29699999999999999,"5min":0.34100000000000003,"15min":0.35099999999999998},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.49099999999999999,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.39100000000000001,"15min":0.39900000000000002},"min":{"1min":0.26000000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.55900000000000005,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.55800000000000005}]}]},{"osd":0,"up_from":28,"seq":120259084359,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369380,"kb_used_data":59740,"kb_used_omap":15,"kb_used_meta":309616,"kb_avail":94002460,"statfs":{"total":96636764160,"available":96258519040,"internally_reserved":0,"allocated":61173760,"data_stored":60940630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15790,"internal_metadata":317047378},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 25 02:28:16 2024","interfaces":[{"interface":"back","average":{"1min":0.245,"5min":0.30599999999999999,"15min":0.33000000000000002},"min":{"1min":0.157,"5min":0.14799999999999999,"15min":0.14799999999999999},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.29999999999999999,"5min":0.33300000000000002,"15min":0.35399999999999998},"min":{"1min":0.192,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.307}]},{"osd":2,"last update":"Thu Apr 25 02:28:16 2024","interfaces":[{"interface":"back","average":{"1min":0.28299999999999997,"5min":0.34300000000000003,"15min":0.371},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.311,"5min":0.34899999999999998,"15min":0.378},"min":{"1min":0.20499999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.378}]},{"osd":3,"last update":"Thu Apr 25 02:28:26 2024","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.374,"15min":0.378},"min":{"1min":0.217,"5min":0.186,"15min":0.186},"max":{"1min":0.433,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.315,"5min":0.375,"15min":0.41299999999999998},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.52100000000000002,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.34000000000000002}]}]},{"osd":1,"up_from":29,"seq":124554051655,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":347452,"kb_used_data":50100,"kb_used_omap":4,"kb_used_meta":297339,"kb_avail":94024388,"statfs":{"total":96636764160,"available":96280973312,"internally_reserved":0,"allocated":51302400,"data_stored":51088318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4963,"internal_metadata":304475293},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:28:13 2024","interfaces":[{"interface":"back","average":{"1min":0.23499999999999999,"5min":0.29299999999999998,"15min":0.32100000000000001},"min":{"1min":0.16700000000000001,"5min":0.155,"15min":0.155},"max":{"1min":0.36699999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.26600000000000001,"5min":0.314,"15min":0.34399999999999997},"min":{"1min":0.189,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.40699999999999997,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.35199999999999998}]},{"osd":2,"last update":"Thu Apr 25 02:28:13 2024","interfaces":[{"interface":"back","average":{"1min":0.26200000000000001,"5min":0.32600000000000001,"15min":0.34599999999999997},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.33900000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.27300000000000002,"5min":0.34100000000000003,"15min":0.35699999999999998},"min":{"1min":0.20399999999999999,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.35099999999999998,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.29099999999999998}]},{"osd":3,"last update":"Thu Apr 25 02:28:13 2024","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.36099999999999999,"15min":0.39000000000000001},"min":{"1min":0.222,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.40500000000000003,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.28000000000000003,"5min":0.35499999999999998,"15min":0.38300000000000001},"min":{"1min":0.20599999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.38300000000000001,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.32300000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":60215296,"data_stored":60184605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15790,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":50343936,"data_stored":50332293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4963,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57974784,"data_stored":57954225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8387,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90095616,"data_stored":90050975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9975,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:29:00.466 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.466 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.466 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.466 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.466 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.466 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.467 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.467 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.467 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.467 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.467 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.467 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.467 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.467 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.468 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.468 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.468 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.468 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.468 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.468 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.468 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.468 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.468 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.469 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.469 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.469 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.469 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.469 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.469 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.469 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.469 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.469 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.470 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.470 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.470 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.470 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.470 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.470 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.470 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-25T02:20:14.468721+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.470 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-25T02:20:14.468721+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.471 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-25T02:20:14.468721+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.471 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.471 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.471 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.471 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-25T02:20:14.468721+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.471 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.471 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.471 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-25T02:20:14.468721+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.472 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.472 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.472 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-25T02:20:14.468721+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.472 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.472 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.472 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.472 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.472 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.472 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.473 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.473 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.473 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.473 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.473 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.473 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:00.473 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T02:29:20.475 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:29:20.605 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.601+0000 7f782af59700 1 Processor -- start 2024-04-25T02:29:20.605 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.601+0000 7f782af59700 1 -- start start 2024-04-25T02:29:20.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.602+0000 7f782af59700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f78240a31c0 0x7f78240a4440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:20.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.602+0000 7f782af59700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7824143b70 0x7f7824145f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:20.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.602+0000 7f782af59700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78240a3f40 con 0x7f78240a2600 2024-04-25T02:29:20.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.602+0000 7f782af59700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f782413f750 con 0x7f78240a31c0 2024-04-25T02:29:20.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.602+0000 7f782af59700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f78240a4980 con 0x7f7824143b70 2024-04-25T02:29:20.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.603+0000 7f7828cf5700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f78240a2600 0x7f782413f040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:45760/0 (socket says 172.21.15.111:45760) 2024-04-25T02:29:20.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.603+0000 7f7828cf5700 1 -- 172.21.15.111:0/1944716477 learned_addr learned my addr 172.21.15.111:0/1944716477 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:29:20.608 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.603+0000 7f78294f6700 1 --2- 172.21.15.111:0/1944716477 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7824143b70 0x7f7824145f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:20.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.603+0000 7f7823fff700 1 --2- 172.21.15.111:0/1944716477 >> v2:172.21.15.111:3300/0 conn(0x7f78240a31c0 0x7f78240a4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:20.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.603+0000 7f78237fe700 1 -- 172.21.15.111:0/1944716477 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4121002570 0 0) 0x7f78240a3f40 con 0x7f78240a2600 2024-04-25T02:29:20.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.603+0000 7f78237fe700 1 -- 172.21.15.111:0/1944716477 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7814003570 con 0x7f78240a2600 2024-04-25T02:29:20.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.603+0000 7f7823fff700 1 -- 172.21.15.111:0/1944716477 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7824143b70 msgr2=0x7f7824145f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:20.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.603+0000 7f7823fff700 1 --2- 172.21.15.111:0/1944716477 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7824143b70 0x7f7824145f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:20.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.603+0000 7f7823fff700 1 -- 172.21.15.111:0/1944716477 >> v1:172.21.15.111:6789/0 conn(0x7f78240a2600 legacy=0x7f782413f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:20.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.603+0000 7f7823fff700 1 -- 172.21.15.111:0/1944716477 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78240a4b90 con 0x7f78240a31c0 2024-04-25T02:29:20.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.603+0000 7f78294f6700 1 --2- 172.21.15.111:0/1944716477 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7824143b70 0x7f7824145f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:29:20.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.603+0000 7f7823fff700 1 --2- 172.21.15.111:0/1944716477 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78240a31c0 0x7f78240a4440 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f78100098e0 tx=0x7f78100091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f33cd4907075c00 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:20.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.603+0000 7f78237fe700 1 -- 172.21.15.111:0/1944716477 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7810011630 con 0x7f78240a31c0 2024-04-25T02:29:20.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.603+0000 7f78237fe700 1 -- 172.21.15.111:0/1944716477 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7810011790 con 0x7f78240a31c0 2024-04-25T02:29:20.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.603+0000 7f78237fe700 1 -- 172.21.15.111:0/1944716477 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7810011b30 con 0x7f78240a31c0 2024-04-25T02:29:20.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.604+0000 7f782af59700 1 -- 172.21.15.111:0/1944716477 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78240a31c0 msgr2=0x7f78240a4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:20.609 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.604+0000 7f782af59700 1 --2- 172.21.15.111:0/1944716477 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78240a31c0 0x7f78240a4440 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f78100098e0 tx=0x7f78100091a0 comp rx=0 tx=0).stop 2024-04-25T02:29:20.610 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.604+0000 7f782af59700 1 -- 172.21.15.111:0/1944716477 shutdown_connections 2024-04-25T02:29:20.610 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.604+0000 7f782af59700 1 --2- 172.21.15.111:0/1944716477 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7824143b70 0x7f7824145f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:20.610 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.604+0000 7f782af59700 1 --2- 172.21.15.111:0/1944716477 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78240a31c0 0x7f78240a4440 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:20.610 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.604+0000 7f782af59700 1 -- 172.21.15.111:0/1944716477 >> 172.21.15.111:0/1944716477 conn(0x7f782406d200 msgr2=0x7f782406aea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:20.610 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.604+0000 7f782af59700 1 -- 172.21.15.111:0/1944716477 shutdown_connections 2024-04-25T02:29:20.610 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.604+0000 7f782af59700 1 -- 172.21.15.111:0/1944716477 wait complete. 2024-04-25T02:29:20.612 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.605+0000 7f782af59700 1 Processor -- start 2024-04-25T02:29:20.612 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.605+0000 7f782af59700 1 -- start start 2024-04-25T02:29:20.612 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.606+0000 7f782af59700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78240a2600 0x7f78240aa470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:20.612 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.606+0000 7f782af59700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f78240a31c0 0x7f78240a8620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:20.612 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.606+0000 7f782af59700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7824143b70 0x7f782413a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:20.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.606+0000 7f782af59700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f782414bf00 con 0x7f78240a2600 2024-04-25T02:29:20.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.606+0000 7f782af59700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78240a8190 con 0x7f78240a31c0 2024-04-25T02:29:20.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.606+0000 7f782af59700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f782414b2e0 con 0x7f7824143b70 2024-04-25T02:29:20.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.606+0000 7f7828cf5700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78240a2600 0x7f78240aa470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:20.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.606+0000 7f7828cf5700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78240a2600 0x7f78240aa470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:40060/0 (socket says 172.21.15.111:40060) 2024-04-25T02:29:20.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.606+0000 7f7828cf5700 1 -- 172.21.15.111:0/3538930633 learned_addr learned my addr 172.21.15.111:0/3538930633 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:29:20.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.606+0000 7f7823fff700 1 --2- 172.21.15.111:0/3538930633 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f78240a31c0 0x7f78240a8620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:20.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.606+0000 7f78294f6700 1 --2- 172.21.15.111:0/3538930633 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7824143b70 0x7f782413a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:20.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.606+0000 7f7828cf5700 1 -- 172.21.15.111:0/3538930633 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7824143b70 msgr2=0x7f782413a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:20.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.606+0000 7f7828cf5700 1 --2- 172.21.15.111:0/3538930633 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7824143b70 0x7f782413a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:20.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.606+0000 7f7828cf5700 1 -- 172.21.15.111:0/3538930633 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f78240a31c0 msgr2=0x7f78240a8620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:20.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.606+0000 7f7828cf5700 1 --2- 172.21.15.111:0/3538930633 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f78240a31c0 0x7f78240a8620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:20.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.606+0000 7f7828cf5700 1 -- 172.21.15.111:0/3538930633 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f781c009a20 con 0x7f78240a2600 2024-04-25T02:29:20.613 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.607+0000 7f7828cf5700 1 --2- 172.21.15.111:0/3538930633 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78240a2600 0x7f78240aa470 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f781800e9a0 tx=0x7f7818007e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:20.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.607+0000 7f7820ff9700 1 -- 172.21.15.111:0/3538930633 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781800ee30 con 0x7f78240a2600 2024-04-25T02:29:20.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.607+0000 7f7820ff9700 1 -- 172.21.15.111:0/3538930633 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7818005b30 con 0x7f78240a2600 2024-04-25T02:29:20.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.607+0000 7f782af59700 1 -- 172.21.15.111:0/3538930633 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7810009420 con 0x7f78240a2600 2024-04-25T02:29:20.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.607+0000 7f7820ff9700 1 -- 172.21.15.111:0/3538930633 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f781800c7e0 con 0x7f78240a2600 2024-04-25T02:29:20.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.607+0000 7f782af59700 1 -- 172.21.15.111:0/3538930633 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78240a7d30 con 0x7f78240a2600 2024-04-25T02:29:20.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.608+0000 7f782af59700 1 -- 172.21.15.111:0/3538930633 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78240a8470 con 0x7f78240a2600 2024-04-25T02:29:20.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.608+0000 7f7820ff9700 1 -- 172.21.15.111:0/3538930633 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f781800cbd0 con 0x7f78240a2600 2024-04-25T02:29:20.614 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.608+0000 7f7820ff9700 1 -- 172.21.15.111:0/3538930633 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4158+0+0 (secure 0 0 0) 0x7f781805d3c0 con 0x7f78240a2600 2024-04-25T02:29:20.615 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.612+0000 7f7820ff9700 1 -- 172.21.15.111:0/3538930633 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f781803b790 con 0x7f78240a2600 2024-04-25T02:29:20.764 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.761+0000 7f782af59700 1 -- 172.21.15.111:0/3538930633 --> v1:172.21.15.111:6816/46482 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f78240aaa60 con 0x7f7808045ef0 2024-04-25T02:29:20.771 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.768+0000 7f7820ff9700 1 -- 172.21.15.111:0/3538930633 <== mgr.14107 v1:172.21.15.111:6816/46482 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+278405 (unknown 2965378022 0 3131390385) 0x7f7810000bc0 con 0x7f7808045ef0 2024-04-25T02:29:20.774 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:29:20.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.771+0000 7f782af59700 1 -- 172.21.15.111:0/3538930633 >> v1:172.21.15.111:6816/46482 conn(0x7f7808045ef0 legacy=0x7f78080483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:20.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.771+0000 7f782af59700 1 -- 172.21.15.111:0/3538930633 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78240a2600 msgr2=0x7f78240aa470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:20.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.771+0000 7f782af59700 1 --2- 172.21.15.111:0/3538930633 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78240a2600 0x7f78240aa470 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f781800e9a0 tx=0x7f7818007e90 comp rx=0 tx=0).stop 2024-04-25T02:29:20.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.771+0000 7f782af59700 1 -- 172.21.15.111:0/3538930633 shutdown_connections 2024-04-25T02:29:20.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.771+0000 7f782af59700 1 --2- 172.21.15.111:0/3538930633 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7824143b70 0x7f782413a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:20.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.771+0000 7f782af59700 1 --2- 172.21.15.111:0/3538930633 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f78240a2600 0x7f78240aa470 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:20.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.771+0000 7f782af59700 1 --2- 172.21.15.111:0/3538930633 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f78240a31c0 0x7f78240a8620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:20.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.771+0000 7f782af59700 1 -- 172.21.15.111:0/3538930633 >> 172.21.15.111:0/3538930633 conn(0x7f782406d200 msgr2=0x7f782413ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:20.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.771+0000 7f782af59700 1 -- 172.21.15.111:0/3538930633 shutdown_connections 2024-04-25T02:29:20.777 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:20.771+0000 7f782af59700 1 -- 172.21.15.111:0/3538930633 wait complete. 2024-04-25T02:29:20.777 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2024-04-25T02:29:20.785 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":218,"stamp":"2024-04-25T02:29:18.818816+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129851417,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":3127,"num_read_kb":1448109,"num_write":31191,"num_write_kb":4453499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35005,"ondisk_log_size":35005,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1481232,"kb_used_data":255152,"kb_used_omap":38,"kb_used_meta":1226009,"kb_avail":376006128,"statfs":{"total":386547056640,"available":385030275072,"internally_reserved":0,"allocated":261275648,"data_stored":260365462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39115,"internal_metadata":1255434037},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002815"},"pg_stats":[{"pgid":"4.3f","version":"43'402","reported_seq":485,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:48.101234+0000","last_change":"2024-04-25T02:28:48.101190+0000","last_active":"2024-04-25T02:28:48.101234+0000","last_peered":"2024-04-25T02:28:48.101234+0000","last_clean":"2024-04-25T02:28:48.101234+0000","last_became_active":"2024-04-25T02:23:13.845848+0000","last_became_peered":"2024-04-25T02:23:13.845848+0000","last_unstale":"2024-04-25T02:28:48.101234+0000","last_undegraded":"2024-04-25T02:28:48.101234+0000","last_fullsized":"2024-04-25T02:28:48.101234+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'402","last_scrub_stamp":"2024-04-25T02:28:48.101084+0000","last_deep_scrub":"43'402","last_deep_scrub_stamp":"2024-04-25T02:28:48.101084+0000","last_clean_scrub_stamp":"2024-04-25T02:28:48.101084+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:09:02.892301+0000","scrub_duration":0.0017175580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":15113,"num_write":370,"num_write_kb":51033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"43'436","reported_seq":531,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:57.901623+0000","last_change":"2024-04-25T02:28:57.901586+0000","last_active":"2024-04-25T02:28:57.901623+0000","last_peered":"2024-04-25T02:28:57.901623+0000","last_clean":"2024-04-25T02:28:57.901623+0000","last_became_active":"2024-04-25T02:23:12.845429+0000","last_became_peered":"2024-04-25T02:23:12.845429+0000","last_unstale":"2024-04-25T02:28:57.901623+0000","last_undegraded":"2024-04-25T02:28:57.901623+0000","last_fullsized":"2024-04-25T02:28:57.901623+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'436","last_scrub_stamp":"2024-04-25T02:28:57.901454+0000","last_deep_scrub":"43'436","last_deep_scrub_stamp":"2024-04-25T02:28:57.901454+0000","last_clean_scrub_stamp":"2024-04-25T02:28:57.901454+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:48:22.177582+0000","scrub_duration":0.0024754489999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22592,"num_write":405,"num_write_kb":75650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"43'370","reported_seq":441,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:02.954241+0000","last_change":"2024-04-25T02:29:02.954173+0000","last_active":"2024-04-25T02:29:02.954241+0000","last_peered":"2024-04-25T02:29:02.954241+0000","last_clean":"2024-04-25T02:29:02.954241+0000","last_became_active":"2024-04-25T02:23:11.838054+0000","last_became_peered":"2024-04-25T02:23:11.838054+0000","last_unstale":"2024-04-25T02:29:02.954241+0000","last_undegraded":"2024-04-25T02:29:02.954241+0000","last_fullsized":"2024-04-25T02:29:02.954241+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'370","last_scrub_stamp":"2024-04-25T02:29:02.954067+0000","last_deep_scrub":"43'370","last_deep_scrub_stamp":"2024-04-25T02:29:02.954067+0000","last_clean_scrub_stamp":"2024-04-25T02:29:02.954067+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:35:19.757284+0000","scrub_duration":0.0024131999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":15817,"num_write":338,"num_write_kb":46402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"43'393","reported_seq":485,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:47.102595+0000","last_change":"2024-04-25T02:28:47.102563+0000","last_active":"2024-04-25T02:28:47.102595+0000","last_peered":"2024-04-25T02:28:47.102595+0000","last_clean":"2024-04-25T02:28:47.102595+0000","last_became_active":"2024-04-25T02:23:11.836681+0000","last_became_peered":"2024-04-25T02:23:11.836681+0000","last_unstale":"2024-04-25T02:28:47.102595+0000","last_undegraded":"2024-04-25T02:28:47.102595+0000","last_fullsized":"2024-04-25T02:28:47.102595+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'393","last_scrub_stamp":"2024-04-25T02:28:47.102463+0000","last_deep_scrub":"43'393","last_deep_scrub_stamp":"2024-04-25T02:28:47.102463+0000","last_clean_scrub_stamp":"2024-04-25T02:28:47.102463+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:03.660053+0000","scrub_duration":0.0021321360000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22923,"num_write":365,"num_write_kb":51318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"43'406","reported_seq":486,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:08.984923+0000","last_change":"2024-04-25T02:29:08.984891+0000","last_active":"2024-04-25T02:29:08.984923+0000","last_peered":"2024-04-25T02:29:08.984923+0000","last_clean":"2024-04-25T02:29:08.984923+0000","last_became_active":"2024-04-25T02:23:13.842918+0000","last_became_peered":"2024-04-25T02:23:13.842918+0000","last_unstale":"2024-04-25T02:29:08.984923+0000","last_undegraded":"2024-04-25T02:29:08.984923+0000","last_fullsized":"2024-04-25T02:29:08.984923+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'406","last_scrub_stamp":"2024-04-25T02:29:08.984789+0000","last_deep_scrub":"43'406","last_deep_scrub_stamp":"2024-04-25T02:29:08.984789+0000","last_clean_scrub_stamp":"2024-04-25T02:29:08.984789+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:26:07.312359+0000","scrub_duration":0.0021373719999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14619,"num_write":384,"num_write_kb":71611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"43'366","reported_seq":438,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:39.393603+0000","last_change":"2024-04-25T02:28:39.393572+0000","last_active":"2024-04-25T02:28:39.393603+0000","last_peered":"2024-04-25T02:28:39.393603+0000","last_clean":"2024-04-25T02:28:39.393603+0000","last_became_active":"2024-04-25T02:23:13.848160+0000","last_became_peered":"2024-04-25T02:23:13.848160+0000","last_unstale":"2024-04-25T02:28:39.393603+0000","last_undegraded":"2024-04-25T02:28:39.393603+0000","last_fullsized":"2024-04-25T02:28:39.393603+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'366","last_scrub_stamp":"2024-04-25T02:28:39.393471+0000","last_deep_scrub":"43'366","last_deep_scrub_stamp":"2024-04-25T02:28:39.393471+0000","last_clean_scrub_stamp":"2024-04-25T02:28:39.393471+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:09:44.749626+0000","scrub_duration":0.0023219040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12472,"num_write":338,"num_write_kb":33864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"43'441","reported_seq":560,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.351267+0000","last_change":"2024-04-25T02:23:13.842324+0000","last_active":"2024-04-25T02:28:12.351267+0000","last_peered":"2024-04-25T02:28:12.351267+0000","last_clean":"2024-04-25T02:28:12.351267+0000","last_became_active":"2024-04-25T02:23:13.840374+0000","last_became_peered":"2024-04-25T02:23:13.840374+0000","last_unstale":"2024-04-25T02:28:12.351267+0000","last_undegraded":"2024-04-25T02:28:12.351267+0000","last_fullsized":"2024-04-25T02:28:12.351267+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":40192,"num_write":416,"num_write_kb":101787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"43'364","reported_seq":441,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:03.943257+0000","last_change":"2024-04-25T02:29:03.943200+0000","last_active":"2024-04-25T02:29:03.943257+0000","last_peered":"2024-04-25T02:29:03.943257+0000","last_clean":"2024-04-25T02:29:03.943257+0000","last_became_active":"2024-04-25T02:23:11.834759+0000","last_became_peered":"2024-04-25T02:23:11.834759+0000","last_unstale":"2024-04-25T02:29:03.943257+0000","last_undegraded":"2024-04-25T02:29:03.943257+0000","last_fullsized":"2024-04-25T02:29:03.943257+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'364","last_scrub_stamp":"2024-04-25T02:29:03.943064+0000","last_deep_scrub":"43'364","last_deep_scrub_stamp":"2024-04-25T02:29:03.943064+0000","last_clean_scrub_stamp":"2024-04-25T02:29:03.943064+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:43:03.314177+0000","scrub_duration":0.0023381109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18431,"num_write":330,"num_write_kb":66835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"43'425","reported_seq":525,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:22.157783+0000","last_change":"2024-04-25T02:28:22.157736+0000","last_active":"2024-04-25T02:28:22.157783+0000","last_peered":"2024-04-25T02:28:22.157783+0000","last_clean":"2024-04-25T02:28:22.157783+0000","last_became_active":"2024-04-25T02:23:13.841883+0000","last_became_peered":"2024-04-25T02:23:13.841883+0000","last_unstale":"2024-04-25T02:28:22.157783+0000","last_undegraded":"2024-04-25T02:28:22.157783+0000","last_fullsized":"2024-04-25T02:28:22.157783+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'425","last_scrub_stamp":"2024-04-25T02:28:22.157614+0000","last_deep_scrub":"43'425","last_deep_scrub_stamp":"2024-04-25T02:28:22.157614+0000","last_clean_scrub_stamp":"2024-04-25T02:28:22.157614+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:28:28.713838+0000","scrub_duration":0.0023306529999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":29378,"num_write":387,"num_write_kb":39136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"43'396","reported_seq":480,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:45.945484+0000","last_change":"2024-04-25T02:28:45.945437+0000","last_active":"2024-04-25T02:28:45.945484+0000","last_peered":"2024-04-25T02:28:45.945484+0000","last_clean":"2024-04-25T02:28:45.945484+0000","last_became_active":"2024-04-25T02:23:11.835958+0000","last_became_peered":"2024-04-25T02:23:11.835958+0000","last_unstale":"2024-04-25T02:28:45.945484+0000","last_undegraded":"2024-04-25T02:28:45.945484+0000","last_fullsized":"2024-04-25T02:28:45.945484+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'396","last_scrub_stamp":"2024-04-25T02:28:45.945325+0000","last_deep_scrub":"43'396","last_deep_scrub_stamp":"2024-04-25T02:28:45.945325+0000","last_clean_scrub_stamp":"2024-04-25T02:28:45.945325+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:53:01.215968+0000","scrub_duration":0.002346295,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":25799,"num_write":352,"num_write_kb":67037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"43'354","reported_seq":404,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:00.899398+0000","last_change":"2024-04-25T02:29:00.899373+0000","last_active":"2024-04-25T02:29:00.899398+0000","last_peered":"2024-04-25T02:29:00.899398+0000","last_clean":"2024-04-25T02:29:00.899398+0000","last_became_active":"2024-04-25T02:23:11.836214+0000","last_became_peered":"2024-04-25T02:23:11.836214+0000","last_unstale":"2024-04-25T02:29:00.899398+0000","last_undegraded":"2024-04-25T02:29:00.899398+0000","last_fullsized":"2024-04-25T02:29:00.899398+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'354","last_scrub_stamp":"2024-04-25T02:29:00.899283+0000","last_deep_scrub":"43'354","last_deep_scrub_stamp":"2024-04-25T02:29:00.899283+0000","last_clean_scrub_stamp":"2024-04-25T02:29:00.899283+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:45.783246+0000","scrub_duration":0.0018755740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7176,"num_write":336,"num_write_kb":37702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"43'335","reported_seq":387,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:58.900017+0000","last_change":"2024-04-25T02:28:58.899981+0000","last_active":"2024-04-25T02:28:58.900017+0000","last_peered":"2024-04-25T02:28:58.900017+0000","last_clean":"2024-04-25T02:28:58.900017+0000","last_became_active":"2024-04-25T02:23:13.847446+0000","last_became_peered":"2024-04-25T02:23:13.847446+0000","last_unstale":"2024-04-25T02:28:58.900017+0000","last_undegraded":"2024-04-25T02:28:58.900017+0000","last_fullsized":"2024-04-25T02:28:58.900017+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'335","last_scrub_stamp":"2024-04-25T02:28:58.899850+0000","last_deep_scrub":"43'335","last_deep_scrub_stamp":"2024-04-25T02:28:58.899850+0000","last_clean_scrub_stamp":"2024-04-25T02:28:58.899850+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:53:40.661144+0000","scrub_duration":0.0020817689999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4160,"num_write":309,"num_write_kb":33908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"43'387","reported_seq":439,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:26.212350+0000","last_change":"2024-04-25T02:28:26.212320+0000","last_active":"2024-04-25T02:28:26.212350+0000","last_peered":"2024-04-25T02:28:26.212350+0000","last_clean":"2024-04-25T02:28:26.212350+0000","last_became_active":"2024-04-25T02:23:13.847009+0000","last_became_peered":"2024-04-25T02:23:13.847009+0000","last_unstale":"2024-04-25T02:28:26.212350+0000","last_undegraded":"2024-04-25T02:28:26.212350+0000","last_fullsized":"2024-04-25T02:28:26.212350+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'387","last_scrub_stamp":"2024-04-25T02:28:26.212204+0000","last_deep_scrub":"43'387","last_deep_scrub_stamp":"2024-04-25T02:28:26.212204+0000","last_clean_scrub_stamp":"2024-04-25T02:28:26.212204+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:25:07.412842+0000","scrub_duration":0.0024916069999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4152,"num_write":352,"num_write_kb":42524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"43'450","reported_seq":539,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:20.974106+0000","last_change":"2024-04-25T02:28:20.974062+0000","last_active":"2024-04-25T02:28:20.974106+0000","last_peered":"2024-04-25T02:28:20.974106+0000","last_clean":"2024-04-25T02:28:20.974106+0000","last_became_active":"2024-04-25T02:23:12.841783+0000","last_became_peered":"2024-04-25T02:23:12.841783+0000","last_unstale":"2024-04-25T02:28:20.974106+0000","last_undegraded":"2024-04-25T02:28:20.974106+0000","last_fullsized":"2024-04-25T02:28:20.974106+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'450","last_scrub_stamp":"2024-04-25T02:28:20.973929+0000","last_deep_scrub":"43'450","last_deep_scrub_stamp":"2024-04-25T02:28:20.973929+0000","last_clean_scrub_stamp":"2024-04-25T02:28:20.973929+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:56:11.043992+0000","scrub_duration":0.002462386,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":25198,"num_write":421,"num_write_kb":88864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"43'430","reported_seq":532,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:44.037754+0000","last_change":"2024-04-25T02:28:44.037712+0000","last_active":"2024-04-25T02:28:44.037754+0000","last_peered":"2024-04-25T02:28:44.037754+0000","last_clean":"2024-04-25T02:28:44.037754+0000","last_became_active":"2024-04-25T02:23:11.835815+0000","last_became_peered":"2024-04-25T02:23:11.835815+0000","last_unstale":"2024-04-25T02:28:44.037754+0000","last_undegraded":"2024-04-25T02:28:44.037754+0000","last_fullsized":"2024-04-25T02:28:44.037754+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'430","last_scrub_stamp":"2024-04-25T02:28:44.037608+0000","last_deep_scrub":"43'430","last_deep_scrub_stamp":"2024-04-25T02:28:44.037608+0000","last_clean_scrub_stamp":"2024-04-25T02:28:44.037608+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:53:08.207544+0000","scrub_duration":0.0021441519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31947,"num_write":393,"num_write_kb":64059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"43'438","reported_seq":463,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.356599+0000","last_change":"2024-04-25T02:23:55.963552+0000","last_active":"2024-04-25T02:28:12.356599+0000","last_peered":"2024-04-25T02:28:12.356599+0000","last_clean":"2024-04-25T02:28:12.356599+0000","last_became_active":"2024-04-25T02:23:55.963259+0000","last_became_peered":"2024-04-25T02:23:55.963259+0000","last_unstale":"2024-04-25T02:28:12.356599+0000","last_undegraded":"2024-04-25T02:28:12.356599+0000","last_fullsized":"2024-04-25T02:28:12.356599+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":2639,"num_write":405,"num_write_kb":51451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"43'394","reported_seq":457,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.356518+0000","last_change":"2024-04-25T02:23:13.844591+0000","last_active":"2024-04-25T02:28:12.356518+0000","last_peered":"2024-04-25T02:28:12.356518+0000","last_clean":"2024-04-25T02:28:12.356518+0000","last_became_active":"2024-04-25T02:23:13.844343+0000","last_became_peered":"2024-04-25T02:23:13.844343+0000","last_unstale":"2024-04-25T02:28:12.356518+0000","last_undegraded":"2024-04-25T02:28:12.356518+0000","last_fullsized":"2024-04-25T02:28:12.356518+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9696,"num_write":367,"num_write_kb":33966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"43'391","reported_seq":481,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:58.011960+0000","last_change":"2024-04-25T02:28:58.011911+0000","last_active":"2024-04-25T02:28:58.011960+0000","last_peered":"2024-04-25T02:28:58.011960+0000","last_clean":"2024-04-25T02:28:58.011960+0000","last_became_active":"2024-04-25T02:23:12.848051+0000","last_became_peered":"2024-04-25T02:23:12.848051+0000","last_unstale":"2024-04-25T02:28:58.011960+0000","last_undegraded":"2024-04-25T02:28:58.011960+0000","last_fullsized":"2024-04-25T02:28:58.011960+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'391","last_scrub_stamp":"2024-04-25T02:28:58.011806+0000","last_deep_scrub":"43'391","last_deep_scrub_stamp":"2024-04-25T02:28:58.011806+0000","last_clean_scrub_stamp":"2024-04-25T02:28:58.011806+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:06.338277+0000","scrub_duration":0.0021863519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":13345,"num_write":357,"num_write_kb":38441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"43'429","reported_seq":550,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:52.924323+0000","last_change":"2024-04-25T02:28:52.924295+0000","last_active":"2024-04-25T02:28:52.924323+0000","last_peered":"2024-04-25T02:28:52.924323+0000","last_clean":"2024-04-25T02:28:52.924323+0000","last_became_active":"2024-04-25T02:23:13.847602+0000","last_became_peered":"2024-04-25T02:23:13.847602+0000","last_unstale":"2024-04-25T02:28:52.924323+0000","last_undegraded":"2024-04-25T02:28:52.924323+0000","last_fullsized":"2024-04-25T02:28:52.924323+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'429","last_scrub_stamp":"2024-04-25T02:28:52.924165+0000","last_deep_scrub":"43'429","last_deep_scrub_stamp":"2024-04-25T02:28:52.924165+0000","last_clean_scrub_stamp":"2024-04-25T02:28:52.924165+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:54:54.792159+0000","scrub_duration":0.0025521599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":37845,"num_write":400,"num_write_kb":88566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"43'437","reported_seq":523,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:44.934901+0000","last_change":"2024-04-25T02:28:44.934874+0000","last_active":"2024-04-25T02:28:44.934901+0000","last_peered":"2024-04-25T02:28:44.934901+0000","last_clean":"2024-04-25T02:28:44.934901+0000","last_became_active":"2024-04-25T02:23:13.845934+0000","last_became_peered":"2024-04-25T02:23:13.845934+0000","last_unstale":"2024-04-25T02:28:44.934901+0000","last_undegraded":"2024-04-25T02:28:44.934901+0000","last_fullsized":"2024-04-25T02:28:44.934901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'437","last_scrub_stamp":"2024-04-25T02:28:44.934771+0000","last_deep_scrub":"43'437","last_deep_scrub_stamp":"2024-04-25T02:28:44.934771+0000","last_clean_scrub_stamp":"2024-04-25T02:28:44.934771+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:07.359904+0000","scrub_duration":0.002337244,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":22073,"num_write":412,"num_write_kb":67090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"43'414","reported_seq":517,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:04.980449+0000","last_change":"2024-04-25T02:29:04.980413+0000","last_active":"2024-04-25T02:29:04.980449+0000","last_peered":"2024-04-25T02:29:04.980449+0000","last_clean":"2024-04-25T02:29:04.980449+0000","last_became_active":"2024-04-25T02:23:13.846758+0000","last_became_peered":"2024-04-25T02:23:13.846758+0000","last_unstale":"2024-04-25T02:29:04.980449+0000","last_undegraded":"2024-04-25T02:29:04.980449+0000","last_fullsized":"2024-04-25T02:29:04.980449+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'414","last_scrub_stamp":"2024-04-25T02:29:04.980312+0000","last_deep_scrub":"43'414","last_deep_scrub_stamp":"2024-04-25T02:29:04.980312+0000","last_clean_scrub_stamp":"2024-04-25T02:29:04.980312+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:54:37.287485+0000","scrub_duration":0.0022436330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":24525,"num_write":378,"num_write_kb":100342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"43'445","reported_seq":529,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:54.117074+0000","last_change":"2024-04-25T02:28:54.117045+0000","last_active":"2024-04-25T02:28:54.117074+0000","last_peered":"2024-04-25T02:28:54.117074+0000","last_clean":"2024-04-25T02:28:54.117074+0000","last_became_active":"2024-04-25T02:23:11.835319+0000","last_became_peered":"2024-04-25T02:23:11.835319+0000","last_unstale":"2024-04-25T02:28:54.117074+0000","last_undegraded":"2024-04-25T02:28:54.117074+0000","last_fullsized":"2024-04-25T02:28:54.117074+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'445","last_scrub_stamp":"2024-04-25T02:28:54.116947+0000","last_deep_scrub":"43'445","last_deep_scrub_stamp":"2024-04-25T02:28:54.116947+0000","last_clean_scrub_stamp":"2024-04-25T02:28:54.116947+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:58:51.124066+0000","scrub_duration":0.0023452529999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":18532,"num_write":411,"num_write_kb":84101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"43'408","reported_seq":526,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:29.377058+0000","last_change":"2024-04-25T02:28:29.377031+0000","last_active":"2024-04-25T02:28:29.377058+0000","last_peered":"2024-04-25T02:28:29.377058+0000","last_clean":"2024-04-25T02:28:29.377058+0000","last_became_active":"2024-04-25T02:23:13.838917+0000","last_became_peered":"2024-04-25T02:23:13.838917+0000","last_unstale":"2024-04-25T02:28:29.377058+0000","last_undegraded":"2024-04-25T02:28:29.377058+0000","last_fullsized":"2024-04-25T02:28:29.377058+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'408","last_scrub_stamp":"2024-04-25T02:28:29.376935+0000","last_deep_scrub":"43'408","last_deep_scrub_stamp":"2024-04-25T02:28:29.376935+0000","last_clean_scrub_stamp":"2024-04-25T02:28:29.376935+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:25:26.084049+0000","scrub_duration":0.002236952,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":25750,"num_write":380,"num_write_kb":75795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"43'451","reported_seq":527,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:12.994175+0000","last_change":"2024-04-25T02:29:12.994140+0000","last_active":"2024-04-25T02:29:12.994175+0000","last_peered":"2024-04-25T02:29:12.994175+0000","last_clean":"2024-04-25T02:29:12.994175+0000","last_became_active":"2024-04-25T02:23:13.845814+0000","last_became_peered":"2024-04-25T02:23:13.845814+0000","last_unstale":"2024-04-25T02:29:12.994175+0000","last_undegraded":"2024-04-25T02:29:12.994175+0000","last_fullsized":"2024-04-25T02:29:12.994175+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'451","last_scrub_stamp":"2024-04-25T02:29:12.994028+0000","last_deep_scrub":"43'451","last_deep_scrub_stamp":"2024-04-25T02:29:12.994028+0000","last_clean_scrub_stamp":"2024-04-25T02:29:12.994028+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:57:15.232896+0000","scrub_duration":0.0023399319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13960,"num_write":428,"num_write_kb":96160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"43'397","reported_seq":460,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:38.013962+0000","last_change":"2024-04-25T02:28:38.013905+0000","last_active":"2024-04-25T02:28:38.013962+0000","last_peered":"2024-04-25T02:28:38.013962+0000","last_clean":"2024-04-25T02:28:38.013962+0000","last_became_active":"2024-04-25T02:23:13.852093+0000","last_became_peered":"2024-04-25T02:23:13.852093+0000","last_unstale":"2024-04-25T02:28:38.013962+0000","last_undegraded":"2024-04-25T02:28:38.013962+0000","last_fullsized":"2024-04-25T02:28:38.013962+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'397","last_scrub_stamp":"2024-04-25T02:28:38.013798+0000","last_deep_scrub":"43'397","last_deep_scrub_stamp":"2024-04-25T02:28:38.013798+0000","last_clean_scrub_stamp":"2024-04-25T02:28:38.013798+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:40:41.237724+0000","scrub_duration":0.0021175439999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":3870,"num_write":383,"num_write_kb":17738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"43'485","reported_seq":567,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.363147+0000","last_change":"2024-04-25T02:23:12.841653+0000","last_active":"2024-04-25T02:28:12.363147+0000","last_peered":"2024-04-25T02:28:12.363147+0000","last_clean":"2024-04-25T02:28:12.363147+0000","last_became_active":"2024-04-25T02:23:12.841477+0000","last_became_peered":"2024-04-25T02:23:12.841477+0000","last_unstale":"2024-04-25T02:28:12.363147+0000","last_undegraded":"2024-04-25T02:28:12.363147+0000","last_fullsized":"2024-04-25T02:28:12.363147+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24645,"num_write":445,"num_write_kb":96750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"43'384","reported_seq":468,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:57.542986+0000","last_change":"2024-04-25T02:28:57.542945+0000","last_active":"2024-04-25T02:28:57.542986+0000","last_peered":"2024-04-25T02:28:57.542986+0000","last_clean":"2024-04-25T02:28:57.542986+0000","last_became_active":"2024-04-25T02:23:13.840422+0000","last_became_peered":"2024-04-25T02:23:13.840422+0000","last_unstale":"2024-04-25T02:28:57.542986+0000","last_undegraded":"2024-04-25T02:28:57.542986+0000","last_fullsized":"2024-04-25T02:28:57.542986+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'384","last_scrub_stamp":"2024-04-25T02:28:57.542849+0000","last_deep_scrub":"43'384","last_deep_scrub_stamp":"2024-04-25T02:28:57.542849+0000","last_clean_scrub_stamp":"2024-04-25T02:28:57.542849+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:56:54.046678+0000","scrub_duration":0.002320112,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":6130,"num_write":356,"num_write_kb":25986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"43'568","reported_seq":612,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:30.058301+0000","last_change":"2024-04-25T02:28:30.058267+0000","last_active":"2024-04-25T02:28:30.058301+0000","last_peered":"2024-04-25T02:28:30.058301+0000","last_clean":"2024-04-25T02:28:30.058301+0000","last_became_active":"2024-04-25T02:23:12.845923+0000","last_became_peered":"2024-04-25T02:23:12.845923+0000","last_unstale":"2024-04-25T02:28:30.058301+0000","last_undegraded":"2024-04-25T02:28:30.058301+0000","last_fullsized":"2024-04-25T02:28:30.058301+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'568","last_scrub_stamp":"2024-04-25T02:28:30.058171+0000","last_deep_scrub":"43'568","last_deep_scrub_stamp":"2024-04-25T02:28:30.058171+0000","last_clean_scrub_stamp":"2024-04-25T02:28:30.058171+0000","objects_scrubbed":3,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:07:27.211762+0000","scrub_duration":0.028959043,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":494,"num_write_kb":12610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"43'420","reported_seq":536,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.368189+0000","last_change":"2024-04-25T02:23:13.850625+0000","last_active":"2024-04-25T02:28:12.368189+0000","last_peered":"2024-04-25T02:28:12.368189+0000","last_clean":"2024-04-25T02:28:12.368189+0000","last_became_active":"2024-04-25T02:23:13.848844+0000","last_became_peered":"2024-04-25T02:23:13.848844+0000","last_unstale":"2024-04-25T02:28:12.368189+0000","last_undegraded":"2024-04-25T02:28:12.368189+0000","last_fullsized":"2024-04-25T02:28:12.368189+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":41312,"num_write":376,"num_write_kb":112833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"43'384","reported_seq":430,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:50.931544+0000","last_change":"2024-04-25T02:28:50.931513+0000","last_active":"2024-04-25T02:28:50.931544+0000","last_peered":"2024-04-25T02:28:50.931544+0000","last_clean":"2024-04-25T02:28:50.931544+0000","last_became_active":"2024-04-25T02:23:13.846821+0000","last_became_peered":"2024-04-25T02:23:13.846821+0000","last_unstale":"2024-04-25T02:28:50.931544+0000","last_undegraded":"2024-04-25T02:28:50.931544+0000","last_fullsized":"2024-04-25T02:28:50.931544+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'384","last_scrub_stamp":"2024-04-25T02:28:50.931418+0000","last_deep_scrub":"43'384","last_deep_scrub_stamp":"2024-04-25T02:28:50.931418+0000","last_clean_scrub_stamp":"2024-04-25T02:28:50.931418+0000","objects_scrubbed":1,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:34:41.263744+0000","scrub_duration":0.013025725,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":334,"num_write_kb":4317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"43'428","reported_seq":522,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.366276+0000","last_change":"2024-04-25T02:23:11.840787+0000","last_active":"2024-04-25T02:28:12.366276+0000","last_peered":"2024-04-25T02:28:12.366276+0000","last_clean":"2024-04-25T02:28:12.366276+0000","last_became_active":"2024-04-25T02:23:11.840274+0000","last_became_peered":"2024-04-25T02:23:11.840274+0000","last_unstale":"2024-04-25T02:28:12.366276+0000","last_undegraded":"2024-04-25T02:28:12.366276+0000","last_fullsized":"2024-04-25T02:28:12.366276+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":28196,"num_write":410,"num_write_kb":104265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"43'875","reported_seq":922,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.488161+0000","last_change":"2024-04-25T02:23:13.839791+0000","last_active":"2024-04-25T02:28:10.488161+0000","last_peered":"2024-04-25T02:28:10.488161+0000","last_clean":"2024-04-25T02:28:10.488161+0000","last_became_active":"2024-04-25T02:23:13.839361+0000","last_became_peered":"2024-04-25T02:23:13.839361+0000","last_unstale":"2024-04-25T02:28:10.488161+0000","last_undegraded":"2024-04-25T02:28:10.488161+0000","last_fullsized":"2024-04-25T02:28:10.488161+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":875,"log_dups_size":0,"ondisk_log_size":875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":809,"num_write_kb":8568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"43'365","reported_seq":444,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.353721+0000","last_change":"2024-04-25T02:23:13.844099+0000","last_active":"2024-04-25T02:28:12.353721+0000","last_peered":"2024-04-25T02:28:12.353721+0000","last_clean":"2024-04-25T02:28:12.353721+0000","last_became_active":"2024-04-25T02:23:13.843656+0000","last_became_peered":"2024-04-25T02:23:13.843656+0000","last_unstale":"2024-04-25T02:28:12.353721+0000","last_undegraded":"2024-04-25T02:28:12.353721+0000","last_fullsized":"2024-04-25T02:28:12.353721+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":25136,"num_write":341,"num_write_kb":38831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"43'58","reported_seq":108,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:11.928495+0000","last_change":"2024-04-25T02:29:11.928453+0000","last_active":"2024-04-25T02:29:11.928495+0000","last_peered":"2024-04-25T02:29:11.928495+0000","last_clean":"2024-04-25T02:29:11.928495+0000","last_became_active":"2024-04-25T02:23:13.842598+0000","last_became_peered":"2024-04-25T02:23:13.842598+0000","last_unstale":"2024-04-25T02:29:11.928495+0000","last_undegraded":"2024-04-25T02:29:11.928495+0000","last_fullsized":"2024-04-25T02:29:11.928495+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'58","last_scrub_stamp":"2024-04-25T02:29:11.928351+0000","last_deep_scrub":"43'58","last_deep_scrub_stamp":"2024-04-25T02:29:11.928351+0000","last_clean_scrub_stamp":"2024-04-25T02:29:11.928351+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:20:47.749490+0000","scrub_duration":0.0035073959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"43'467","reported_seq":543,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.367867+0000","last_change":"2024-04-25T02:23:13.849957+0000","last_active":"2024-04-25T02:28:12.367867+0000","last_peered":"2024-04-25T02:28:12.367867+0000","last_clean":"2024-04-25T02:28:12.367867+0000","last_became_active":"2024-04-25T02:23:13.848675+0000","last_became_peered":"2024-04-25T02:23:13.848675+0000","last_unstale":"2024-04-25T02:28:12.367867+0000","last_undegraded":"2024-04-25T02:28:12.367867+0000","last_fullsized":"2024-04-25T02:28:12.367867+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":13580,"num_write":443,"num_write_kb":92928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"43'342","reported_seq":387,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:50.982472+0000","last_change":"2024-04-25T02:28:50.982445+0000","last_active":"2024-04-25T02:28:50.982472+0000","last_peered":"2024-04-25T02:28:50.982472+0000","last_clean":"2024-04-25T02:28:50.982472+0000","last_became_active":"2024-04-25T02:23:13.846764+0000","last_became_peered":"2024-04-25T02:23:13.846764+0000","last_unstale":"2024-04-25T02:28:50.982472+0000","last_undegraded":"2024-04-25T02:28:50.982472+0000","last_fullsized":"2024-04-25T02:28:50.982472+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'342","last_scrub_stamp":"2024-04-25T02:28:50.982355+0000","last_deep_scrub":"43'342","last_deep_scrub_stamp":"2024-04-25T02:28:50.982355+0000","last_clean_scrub_stamp":"2024-04-25T02:28:50.982355+0000","objects_scrubbed":2,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:42:20.126126+0000","scrub_duration":0.013249924999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":281,"num_write_kb":4273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"43'477","reported_seq":577,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.351447+0000","last_change":"2024-04-25T02:23:13.844687+0000","last_active":"2024-04-25T02:28:12.351447+0000","last_peered":"2024-04-25T02:28:12.351447+0000","last_clean":"2024-04-25T02:28:12.351447+0000","last_became_active":"2024-04-25T02:23:13.839702+0000","last_became_peered":"2024-04-25T02:23:13.839702+0000","last_unstale":"2024-04-25T02:28:12.351447+0000","last_undegraded":"2024-04-25T02:28:12.351447+0000","last_fullsized":"2024-04-25T02:28:12.351447+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":30102,"num_write":452,"num_write_kb":97286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"43'139","reported_seq":192,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:46.068929+0000","last_change":"2024-04-25T02:28:46.068904+0000","last_active":"2024-04-25T02:28:46.068929+0000","last_peered":"2024-04-25T02:28:46.068929+0000","last_clean":"2024-04-25T02:28:46.068929+0000","last_became_active":"2024-04-25T02:23:13.843625+0000","last_became_peered":"2024-04-25T02:23:13.843625+0000","last_unstale":"2024-04-25T02:28:46.068929+0000","last_undegraded":"2024-04-25T02:28:46.068929+0000","last_fullsized":"2024-04-25T02:28:46.068929+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'139","last_scrub_stamp":"2024-04-25T02:28:46.068815+0000","last_deep_scrub":"43'139","last_deep_scrub_stamp":"2024-04-25T02:28:46.068815+0000","last_clean_scrub_stamp":"2024-04-25T02:28:46.068815+0000","objects_scrubbed":3,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:26.672574+0000","scrub_duration":0.0037700569999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":72,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"43'422","reported_seq":506,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:10.977270+0000","last_change":"2024-04-25T02:29:10.977195+0000","last_active":"2024-04-25T02:29:10.977270+0000","last_peered":"2024-04-25T02:29:10.977270+0000","last_clean":"2024-04-25T02:29:10.977270+0000","last_became_active":"2024-04-25T02:23:13.850845+0000","last_became_peered":"2024-04-25T02:23:13.850845+0000","last_unstale":"2024-04-25T02:29:10.977270+0000","last_undegraded":"2024-04-25T02:29:10.977270+0000","last_fullsized":"2024-04-25T02:29:10.977270+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'422","last_scrub_stamp":"2024-04-25T02:29:10.977055+0000","last_deep_scrub":"43'422","last_deep_scrub_stamp":"2024-04-25T02:29:10.977055+0000","last_clean_scrub_stamp":"2024-04-25T02:29:10.977055+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:29:00.511972+0000","scrub_duration":0.002540123,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":24672,"num_write":391,"num_write_kb":75497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"43'352","reported_seq":407,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:59.567581+0000","last_change":"2024-04-25T02:28:59.567554+0000","last_active":"2024-04-25T02:28:59.567581+0000","last_peered":"2024-04-25T02:28:59.567581+0000","last_clean":"2024-04-25T02:28:59.567581+0000","last_became_active":"2024-04-25T02:23:13.845176+0000","last_became_peered":"2024-04-25T02:23:13.845176+0000","last_unstale":"2024-04-25T02:28:59.567581+0000","last_undegraded":"2024-04-25T02:28:59.567581+0000","last_fullsized":"2024-04-25T02:28:59.567581+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'352","last_scrub_stamp":"2024-04-25T02:28:59.567461+0000","last_deep_scrub":"43'352","last_deep_scrub_stamp":"2024-04-25T02:28:59.567461+0000","last_clean_scrub_stamp":"2024-04-25T02:28:59.567461+0000","objects_scrubbed":7,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:49.240975+0000","scrub_duration":0.026732694000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10356006,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":7,"num_read_kb":10,"num_write":291,"num_write_kb":10309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"43'405","reported_seq":483,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:30.146025+0000","last_change":"2024-04-25T02:28:30.145967+0000","last_active":"2024-04-25T02:28:30.146025+0000","last_peered":"2024-04-25T02:28:30.146025+0000","last_clean":"2024-04-25T02:28:30.146025+0000","last_became_active":"2024-04-25T02:23:55.963655+0000","last_became_peered":"2024-04-25T02:23:55.963655+0000","last_unstale":"2024-04-25T02:28:30.146025+0000","last_undegraded":"2024-04-25T02:28:30.146025+0000","last_fullsized":"2024-04-25T02:28:30.146025+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'405","last_scrub_stamp":"2024-04-25T02:28:30.145854+0000","last_deep_scrub":"43'405","last_deep_scrub_stamp":"2024-04-25T02:28:30.145854+0000","last_clean_scrub_stamp":"2024-04-25T02:28:30.145854+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:49.219885+0000","scrub_duration":0.0021986240000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":11609,"num_write":365,"num_write_kb":76437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"43'498","reported_seq":557,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:53.568295+0000","last_change":"2024-04-25T02:28:53.568258+0000","last_active":"2024-04-25T02:28:53.568295+0000","last_peered":"2024-04-25T02:28:53.568295+0000","last_clean":"2024-04-25T02:28:53.568295+0000","last_became_active":"2024-04-25T02:23:13.839158+0000","last_became_peered":"2024-04-25T02:23:13.839158+0000","last_unstale":"2024-04-25T02:28:53.568295+0000","last_undegraded":"2024-04-25T02:28:53.568295+0000","last_fullsized":"2024-04-25T02:28:53.568295+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'498","last_scrub_stamp":"2024-04-25T02:28:53.568128+0000","last_deep_scrub":"43'498","last_deep_scrub_stamp":"2024-04-25T02:28:53.568128+0000","last_clean_scrub_stamp":"2024-04-25T02:28:53.568128+0000","objects_scrubbed":5,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:05.588274+0000","scrub_duration":0.023077066,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":7,"num_write":435,"num_write_kb":8384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"43'409","reported_seq":489,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.363014+0000","last_change":"2024-04-25T02:23:13.843740+0000","last_active":"2024-04-25T02:28:12.363014+0000","last_peered":"2024-04-25T02:28:12.363014+0000","last_clean":"2024-04-25T02:28:12.363014+0000","last_became_active":"2024-04-25T02:23:13.843441+0000","last_became_peered":"2024-04-25T02:23:13.843441+0000","last_unstale":"2024-04-25T02:28:12.363014+0000","last_undegraded":"2024-04-25T02:28:12.363014+0000","last_fullsized":"2024-04-25T02:28:12.363014+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":25550,"num_write":379,"num_write_kb":104949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"43'52","reported_seq":101,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:57.048479+0000","last_change":"2024-04-25T02:28:57.048450+0000","last_active":"2024-04-25T02:28:57.048479+0000","last_peered":"2024-04-25T02:28:57.048479+0000","last_clean":"2024-04-25T02:28:57.048479+0000","last_became_active":"2024-04-25T02:23:13.841976+0000","last_became_peered":"2024-04-25T02:23:13.841976+0000","last_unstale":"2024-04-25T02:28:57.048479+0000","last_undegraded":"2024-04-25T02:28:57.048479+0000","last_fullsized":"2024-04-25T02:28:57.048479+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'52","last_scrub_stamp":"2024-04-25T02:28:57.048342+0000","last_deep_scrub":"43'52","last_deep_scrub_stamp":"2024-04-25T02:28:57.048342+0000","last_clean_scrub_stamp":"2024-04-25T02:28:57.048342+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:56.353296+0000","scrub_duration":0.0026068649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"43'407","reported_seq":493,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.354407+0000","last_change":"2024-04-25T02:23:13.843455+0000","last_active":"2024-04-25T02:28:12.354407+0000","last_peered":"2024-04-25T02:28:12.354407+0000","last_clean":"2024-04-25T02:28:12.354407+0000","last_became_active":"2024-04-25T02:23:13.842163+0000","last_became_peered":"2024-04-25T02:23:13.842163+0000","last_unstale":"2024-04-25T02:28:12.354407+0000","last_undegraded":"2024-04-25T02:28:12.354407+0000","last_fullsized":"2024-04-25T02:28:12.354407+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":18209,"num_write":378,"num_write_kb":67140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"43'57","reported_seq":107,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:06.608522+0000","last_change":"2024-04-25T02:29:06.608493+0000","last_active":"2024-04-25T02:29:06.608522+0000","last_peered":"2024-04-25T02:29:06.608522+0000","last_clean":"2024-04-25T02:29:06.608522+0000","last_became_active":"2024-04-25T02:23:13.838616+0000","last_became_peered":"2024-04-25T02:23:13.838616+0000","last_unstale":"2024-04-25T02:29:06.608522+0000","last_undegraded":"2024-04-25T02:29:06.608522+0000","last_fullsized":"2024-04-25T02:29:06.608522+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'57","last_scrub_stamp":"2024-04-25T02:29:06.608385+0000","last_deep_scrub":"43'57","last_deep_scrub_stamp":"2024-04-25T02:29:06.608385+0000","last_clean_scrub_stamp":"2024-04-25T02:29:06.608385+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:29:37.490299+0000","scrub_duration":0.0015486569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"43'445","reported_seq":565,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.358482+0000","last_change":"2024-04-25T02:23:13.842908+0000","last_active":"2024-04-25T02:28:12.358482+0000","last_peered":"2024-04-25T02:28:12.358482+0000","last_clean":"2024-04-25T02:28:12.358482+0000","last_became_active":"2024-04-25T02:23:13.842649+0000","last_became_peered":"2024-04-25T02:23:13.842649+0000","last_unstale":"2024-04-25T02:28:12.358482+0000","last_undegraded":"2024-04-25T02:28:12.358482+0000","last_fullsized":"2024-04-25T02:28:12.358482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":37870,"num_write":411,"num_write_kb":80233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"43'68","reported_seq":116,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:51.908386+0000","last_change":"2024-04-25T02:28:51.908344+0000","last_active":"2024-04-25T02:28:51.908386+0000","last_peered":"2024-04-25T02:28:51.908386+0000","last_clean":"2024-04-25T02:28:51.908386+0000","last_became_active":"2024-04-25T02:23:11.835077+0000","last_became_peered":"2024-04-25T02:23:11.835077+0000","last_unstale":"2024-04-25T02:28:51.908386+0000","last_undegraded":"2024-04-25T02:28:51.908386+0000","last_fullsized":"2024-04-25T02:28:51.908386+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'68","last_scrub_stamp":"2024-04-25T02:28:51.908233+0000","last_deep_scrub":"43'68","last_deep_scrub_stamp":"2024-04-25T02:28:51.908233+0000","last_clean_scrub_stamp":"2024-04-25T02:28:51.908233+0000","objects_scrubbed":5,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:49.010130+0000","scrub_duration":0.0047405470000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"43'390","reported_seq":531,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:49.471264+0000","last_change":"2024-04-25T02:28:49.471228+0000","last_active":"2024-04-25T02:28:49.471264+0000","last_peered":"2024-04-25T02:28:49.471264+0000","last_clean":"2024-04-25T02:28:49.471264+0000","last_became_active":"2024-04-25T02:23:13.843347+0000","last_became_peered":"2024-04-25T02:23:13.843347+0000","last_unstale":"2024-04-25T02:28:49.471264+0000","last_undegraded":"2024-04-25T02:28:49.471264+0000","last_fullsized":"2024-04-25T02:28:49.471264+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'390","last_scrub_stamp":"2024-04-25T02:28:49.471125+0000","last_deep_scrub":"43'390","last_deep_scrub_stamp":"2024-04-25T02:28:49.471125+0000","last_clean_scrub_stamp":"2024-04-25T02:28:49.471125+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:04:13.159114+0000","scrub_duration":0.0021407000000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":42863,"num_write":360,"num_write_kb":59443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"43'201","reported_seq":249,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:00.019630+0000","last_change":"2024-04-25T02:29:00.019602+0000","last_active":"2024-04-25T02:29:00.019630+0000","last_peered":"2024-04-25T02:29:00.019630+0000","last_clean":"2024-04-25T02:29:00.019630+0000","last_became_active":"2024-04-25T02:23:11.839157+0000","last_became_peered":"2024-04-25T02:23:11.839157+0000","last_unstale":"2024-04-25T02:29:00.019630+0000","last_undegraded":"2024-04-25T02:29:00.019630+0000","last_fullsized":"2024-04-25T02:29:00.019630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'201","last_scrub_stamp":"2024-04-25T02:29:00.019504+0000","last_deep_scrub":"43'201","last_deep_scrub_stamp":"2024-04-25T02:29:00.019504+0000","last_clean_scrub_stamp":"2024-04-25T02:29:00.019504+0000","objects_scrubbed":2,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:17.465468+0000","scrub_duration":0.01223805,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":142,"num_write_kb":4183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"43'404","reported_seq":471,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.368273+0000","last_change":"2024-04-25T02:23:13.841226+0000","last_active":"2024-04-25T02:28:12.368273+0000","last_peered":"2024-04-25T02:28:12.368273+0000","last_clean":"2024-04-25T02:28:12.368273+0000","last_became_active":"2024-04-25T02:23:13.840951+0000","last_became_peered":"2024-04-25T02:23:13.840951+0000","last_unstale":"2024-04-25T02:28:12.368273+0000","last_undegraded":"2024-04-25T02:28:12.368273+0000","last_fullsized":"2024-04-25T02:28:12.368273+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12931,"num_write":370,"num_write_kb":42530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"43'366","reported_seq":411,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.503886+0000","last_change":"2024-04-25T02:23:12.848098+0000","last_active":"2024-04-25T02:28:08.503886+0000","last_peered":"2024-04-25T02:28:08.503886+0000","last_clean":"2024-04-25T02:28:08.503886+0000","last_became_active":"2024-04-25T02:23:12.847813+0000","last_became_peered":"2024-04-25T02:23:12.847813+0000","last_unstale":"2024-04-25T02:28:08.503886+0000","last_undegraded":"2024-04-25T02:28:08.503886+0000","last_fullsized":"2024-04-25T02:28:08.503886+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":311,"num_write_kb":4273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"43'442","reported_seq":492,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.365654+0000","last_change":"2024-04-25T02:23:55.963573+0000","last_active":"2024-04-25T02:28:12.365654+0000","last_peered":"2024-04-25T02:28:12.365654+0000","last_clean":"2024-04-25T02:28:12.365654+0000","last_became_active":"2024-04-25T02:23:55.963234+0000","last_became_peered":"2024-04-25T02:23:55.963234+0000","last_unstale":"2024-04-25T02:28:12.365654+0000","last_undegraded":"2024-04-25T02:28:12.365654+0000","last_fullsized":"2024-04-25T02:28:12.365654+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21039,"num_write":415,"num_write_kb":62968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"43'596","reported_seq":650,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:12.598908+0000","last_change":"2024-04-25T02:29:12.598859+0000","last_active":"2024-04-25T02:29:12.598908+0000","last_peered":"2024-04-25T02:29:12.598908+0000","last_clean":"2024-04-25T02:29:12.598908+0000","last_became_active":"2024-04-25T02:23:13.843704+0000","last_became_peered":"2024-04-25T02:23:13.843704+0000","last_unstale":"2024-04-25T02:29:12.598908+0000","last_undegraded":"2024-04-25T02:29:12.598908+0000","last_fullsized":"2024-04-25T02:29:12.598908+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'596","last_scrub_stamp":"2024-04-25T02:29:12.598768+0000","last_deep_scrub":"43'596","last_deep_scrub_stamp":"2024-04-25T02:29:12.598768+0000","last_clean_scrub_stamp":"2024-04-25T02:29:12.598768+0000","objects_scrubbed":2,"log_size":596,"log_dups_size":0,"ondisk_log_size":596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:48:20.391354+0000","scrub_duration":0.014912345,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":532,"num_write_kb":4350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"43'411","reported_seq":497,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.367461+0000","last_change":"2024-04-25T02:23:13.847842+0000","last_active":"2024-04-25T02:28:12.367461+0000","last_peered":"2024-04-25T02:28:12.367461+0000","last_clean":"2024-04-25T02:28:12.367461+0000","last_became_active":"2024-04-25T02:23:13.845782+0000","last_became_peered":"2024-04-25T02:23:13.845782+0000","last_unstale":"2024-04-25T02:28:12.367461+0000","last_undegraded":"2024-04-25T02:28:12.367461+0000","last_fullsized":"2024-04-25T02:28:12.367461+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":24562,"num_write":375,"num_write_kb":59351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"43'59","reported_seq":108,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:50.131386+0000","last_change":"2024-04-25T02:28:50.131363+0000","last_active":"2024-04-25T02:28:50.131386+0000","last_peered":"2024-04-25T02:28:50.131386+0000","last_clean":"2024-04-25T02:28:50.131386+0000","last_became_active":"2024-04-25T02:23:13.841815+0000","last_became_peered":"2024-04-25T02:23:13.841815+0000","last_unstale":"2024-04-25T02:28:50.131386+0000","last_undegraded":"2024-04-25T02:28:50.131386+0000","last_fullsized":"2024-04-25T02:28:50.131386+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'59","last_scrub_stamp":"2024-04-25T02:28:50.131276+0000","last_deep_scrub":"43'59","last_deep_scrub_stamp":"2024-04-25T02:28:50.131276+0000","last_clean_scrub_stamp":"2024-04-25T02:28:50.131276+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:39:19.674948+0000","scrub_duration":0.0013339000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"43'457","reported_seq":584,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:39.003748+0000","last_change":"2024-04-25T02:28:39.003715+0000","last_active":"2024-04-25T02:28:39.003748+0000","last_peered":"2024-04-25T02:28:39.003748+0000","last_clean":"2024-04-25T02:28:39.003748+0000","last_became_active":"2024-04-25T02:23:11.837258+0000","last_became_peered":"2024-04-25T02:23:11.837258+0000","last_unstale":"2024-04-25T02:28:39.003748+0000","last_undegraded":"2024-04-25T02:28:39.003748+0000","last_fullsized":"2024-04-25T02:28:39.003748+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'457","last_scrub_stamp":"2024-04-25T02:28:39.003606+0000","last_deep_scrub":"43'457","last_deep_scrub_stamp":"2024-04-25T02:28:39.003606+0000","last_clean_scrub_stamp":"2024-04-25T02:28:39.003606+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:51.514685+0000","scrub_duration":0.0023379960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":40530,"num_write":421,"num_write_kb":133096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"43'132","reported_seq":190,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:38.375455+0000","last_change":"2024-04-25T02:28:38.375418+0000","last_active":"2024-04-25T02:28:38.375455+0000","last_peered":"2024-04-25T02:28:38.375455+0000","last_clean":"2024-04-25T02:28:38.375455+0000","last_became_active":"2024-04-25T02:23:13.838665+0000","last_became_peered":"2024-04-25T02:23:13.838665+0000","last_unstale":"2024-04-25T02:28:38.375455+0000","last_undegraded":"2024-04-25T02:28:38.375455+0000","last_fullsized":"2024-04-25T02:28:38.375455+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'132","last_scrub_stamp":"2024-04-25T02:28:38.375296+0000","last_deep_scrub":"43'132","last_deep_scrub_stamp":"2024-04-25T02:28:38.375296+0000","last_clean_scrub_stamp":"2024-04-25T02:28:38.375296+0000","objects_scrubbed":4,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:47:08.874698+0000","scrub_duration":0.018905228,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":66,"num_write_kb":8229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"43'438","reported_seq":526,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.101612+0000","last_change":"2024-04-25T02:28:28.101582+0000","last_active":"2024-04-25T02:28:28.101612+0000","last_peered":"2024-04-25T02:28:28.101612+0000","last_clean":"2024-04-25T02:28:28.101612+0000","last_became_active":"2024-04-25T02:23:55.963557+0000","last_became_peered":"2024-04-25T02:23:55.963557+0000","last_unstale":"2024-04-25T02:28:28.101612+0000","last_undegraded":"2024-04-25T02:28:28.101612+0000","last_fullsized":"2024-04-25T02:28:28.101612+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'438","last_scrub_stamp":"2024-04-25T02:28:28.101477+0000","last_deep_scrub":"43'438","last_deep_scrub_stamp":"2024-04-25T02:28:28.101477+0000","last_clean_scrub_stamp":"2024-04-25T02:28:28.101477+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:13:04.055307+0000","scrub_duration":0.0022093569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":25759,"num_write":403,"num_write_kb":59138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"43'256","reported_seq":309,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:54.577347+0000","last_change":"2024-04-25T02:28:54.577309+0000","last_active":"2024-04-25T02:28:54.577347+0000","last_peered":"2024-04-25T02:28:54.577347+0000","last_clean":"2024-04-25T02:28:54.577347+0000","last_became_active":"2024-04-25T02:23:13.843652+0000","last_became_peered":"2024-04-25T02:23:13.843652+0000","last_unstale":"2024-04-25T02:28:54.577347+0000","last_undegraded":"2024-04-25T02:28:54.577347+0000","last_fullsized":"2024-04-25T02:28:54.577347+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'256","last_scrub_stamp":"2024-04-25T02:28:54.577189+0000","last_deep_scrub":"43'256","last_deep_scrub_stamp":"2024-04-25T02:28:54.577189+0000","last_clean_scrub_stamp":"2024-04-25T02:28:54.577189+0000","objects_scrubbed":2,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:57:05.312089+0000","scrub_duration":0.01333373,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":4213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"43'389","reported_seq":423,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.367602+0000","last_change":"2024-04-25T02:23:56.302316+0000","last_active":"2024-04-25T02:28:12.367602+0000","last_peered":"2024-04-25T02:28:12.367602+0000","last_clean":"2024-04-25T02:28:12.367602+0000","last_became_active":"2024-04-25T02:23:56.301997+0000","last_became_peered":"2024-04-25T02:23:56.301997+0000","last_unstale":"2024-04-25T02:28:12.367602+0000","last_undegraded":"2024-04-25T02:28:12.367602+0000","last_fullsized":"2024-04-25T02:28:12.367602+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13585,"num_write":362,"num_write_kb":34032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"43'63","reported_seq":103,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.518277+0000","last_change":"2024-04-25T02:23:13.842533+0000","last_active":"2024-04-25T02:28:08.518277+0000","last_peered":"2024-04-25T02:28:08.518277+0000","last_clean":"2024-04-25T02:28:08.518277+0000","last_became_active":"2024-04-25T02:23:13.841049+0000","last_became_peered":"2024-04-25T02:23:13.841049+0000","last_unstale":"2024-04-25T02:28:08.518277+0000","last_undegraded":"2024-04-25T02:28:08.518277+0000","last_fullsized":"2024-04-25T02:28:08.518277+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"43'360","reported_seq":433,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:29.186993+0000","last_change":"2024-04-25T02:28:29.186947+0000","last_active":"2024-04-25T02:28:29.186993+0000","last_peered":"2024-04-25T02:28:29.186993+0000","last_clean":"2024-04-25T02:28:29.186993+0000","last_became_active":"2024-04-25T02:23:13.846425+0000","last_became_peered":"2024-04-25T02:23:13.846425+0000","last_unstale":"2024-04-25T02:28:29.186993+0000","last_undegraded":"2024-04-25T02:28:29.186993+0000","last_fullsized":"2024-04-25T02:28:29.186993+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'360","last_scrub_stamp":"2024-04-25T02:28:29.186834+0000","last_deep_scrub":"43'360","last_deep_scrub_stamp":"2024-04-25T02:28:29.186834+0000","last_clean_scrub_stamp":"2024-04-25T02:28:29.186834+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:38:30.162583+0000","scrub_duration":0.002422633,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":12898,"num_write":328,"num_write_kb":42412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"43'567","reported_seq":620,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:43.405130+0000","last_change":"2024-04-25T02:28:43.405100+0000","last_active":"2024-04-25T02:28:43.405130+0000","last_peered":"2024-04-25T02:28:43.405130+0000","last_clean":"2024-04-25T02:28:43.405130+0000","last_became_active":"2024-04-25T02:23:13.840876+0000","last_became_peered":"2024-04-25T02:23:13.840876+0000","last_unstale":"2024-04-25T02:28:43.405130+0000","last_undegraded":"2024-04-25T02:28:43.405130+0000","last_fullsized":"2024-04-25T02:28:43.405130+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'567","last_scrub_stamp":"2024-04-25T02:28:43.405002+0000","last_deep_scrub":"43'567","last_deep_scrub_stamp":"2024-04-25T02:28:43.405002+0000","last_clean_scrub_stamp":"2024-04-25T02:28:43.405002+0000","objects_scrubbed":2,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:17:38.360428+0000","scrub_duration":0.013702443,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":506,"num_write_kb":4331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"43'387","reported_seq":465,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.365549+0000","last_change":"2024-04-25T02:23:13.852754+0000","last_active":"2024-04-25T02:28:12.365549+0000","last_peered":"2024-04-25T02:28:12.365549+0000","last_clean":"2024-04-25T02:28:12.365549+0000","last_became_active":"2024-04-25T02:23:13.852398+0000","last_became_peered":"2024-04-25T02:23:13.852398+0000","last_unstale":"2024-04-25T02:28:12.365549+0000","last_undegraded":"2024-04-25T02:28:12.365549+0000","last_fullsized":"2024-04-25T02:28:12.365549+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":28255,"num_write":354,"num_write_kb":58406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:58.871823+0000","last_change":"2024-04-25T02:28:58.871778+0000","last_active":"2024-04-25T02:28:58.871823+0000","last_peered":"2024-04-25T02:28:58.871823+0000","last_clean":"2024-04-25T02:28:58.871823+0000","last_became_active":"2024-04-25T02:23:11.834171+0000","last_became_peered":"2024-04-25T02:23:11.834171+0000","last_unstale":"2024-04-25T02:28:58.871823+0000","last_undegraded":"2024-04-25T02:28:58.871823+0000","last_fullsized":"2024-04-25T02:28:58.871823+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:58.871661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:58.871661+0000","last_clean_scrub_stamp":"2024-04-25T02:28:58.871661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:46.274931+0000","scrub_duration":0.0016855539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"43'432","reported_seq":478,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:32.100599+0000","last_change":"2024-04-25T02:28:32.100572+0000","last_active":"2024-04-25T02:28:32.100599+0000","last_peered":"2024-04-25T02:28:32.100599+0000","last_clean":"2024-04-25T02:28:32.100599+0000","last_became_active":"2024-04-25T02:23:13.847970+0000","last_became_peered":"2024-04-25T02:23:13.847970+0000","last_unstale":"2024-04-25T02:28:32.100599+0000","last_undegraded":"2024-04-25T02:28:32.100599+0000","last_fullsized":"2024-04-25T02:28:32.100599+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'432","last_scrub_stamp":"2024-04-25T02:28:32.100463+0000","last_deep_scrub":"43'432","last_deep_scrub_stamp":"2024-04-25T02:28:32.100463+0000","last_clean_scrub_stamp":"2024-04-25T02:28:32.100463+0000","objects_scrubbed":2,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:01:10.912094+0000","scrub_duration":0.014522729,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":371,"num_write_kb":4349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"43'357","reported_seq":420,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:22.964197+0000","last_change":"2024-04-25T02:28:22.964168+0000","last_active":"2024-04-25T02:28:22.964197+0000","last_peered":"2024-04-25T02:28:22.964197+0000","last_clean":"2024-04-25T02:28:22.964197+0000","last_became_active":"2024-04-25T02:23:13.849556+0000","last_became_peered":"2024-04-25T02:23:13.849556+0000","last_unstale":"2024-04-25T02:28:22.964197+0000","last_undegraded":"2024-04-25T02:28:22.964197+0000","last_fullsized":"2024-04-25T02:28:22.964197+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'357","last_scrub_stamp":"2024-04-25T02:28:22.964054+0000","last_deep_scrub":"43'357","last_deep_scrub_stamp":"2024-04-25T02:28:22.964054+0000","last_clean_scrub_stamp":"2024-04-25T02:28:22.964054+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:33:24.355131+0000","scrub_duration":0.002218271,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8777,"num_write":323,"num_write_kb":25948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":46,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:25:10.069025+0000","last_change":"2024-04-25T02:23:13.848430+0000","last_active":"2024-04-25T02:25:10.069025+0000","last_peered":"2024-04-25T02:25:10.069025+0000","last_clean":"2024-04-25T02:25:10.069025+0000","last_became_active":"2024-04-25T02:23:13.847888+0000","last_became_peered":"2024-04-25T02:23:13.847888+0000","last_unstale":"2024-04-25T02:25:10.069025+0000","last_undegraded":"2024-04-25T02:25:10.069025+0000","last_fullsized":"2024-04-25T02:25:10.069025+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"43'72","reported_seq":124,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:37.052787+0000","last_change":"2024-04-25T02:28:37.052732+0000","last_active":"2024-04-25T02:28:37.052787+0000","last_peered":"2024-04-25T02:28:37.052787+0000","last_clean":"2024-04-25T02:28:37.052787+0000","last_became_active":"2024-04-25T02:23:12.848312+0000","last_became_peered":"2024-04-25T02:23:12.848312+0000","last_unstale":"2024-04-25T02:28:37.052787+0000","last_undegraded":"2024-04-25T02:28:37.052787+0000","last_fullsized":"2024-04-25T02:28:37.052787+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'72","last_scrub_stamp":"2024-04-25T02:28:37.052632+0000","last_deep_scrub":"43'72","last_deep_scrub_stamp":"2024-04-25T02:28:37.052632+0000","last_clean_scrub_stamp":"2024-04-25T02:28:37.052632+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:06:14.430755+0000","scrub_duration":0.0037485779999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"43'385","reported_seq":477,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:47.914656+0000","last_change":"2024-04-25T02:28:47.914600+0000","last_active":"2024-04-25T02:28:47.914656+0000","last_peered":"2024-04-25T02:28:47.914656+0000","last_clean":"2024-04-25T02:28:47.914656+0000","last_became_active":"2024-04-25T02:23:12.841408+0000","last_became_peered":"2024-04-25T02:23:12.841408+0000","last_unstale":"2024-04-25T02:28:47.914656+0000","last_undegraded":"2024-04-25T02:28:47.914656+0000","last_fullsized":"2024-04-25T02:28:47.914656+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'385","last_scrub_stamp":"2024-04-25T02:28:47.914480+0000","last_deep_scrub":"43'385","last_deep_scrub_stamp":"2024-04-25T02:28:47.914480+0000","last_clean_scrub_stamp":"2024-04-25T02:28:47.914480+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:56.748268+0000","scrub_duration":0.0025485909999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":27937,"num_write":348,"num_write_kb":51359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":44,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:07.821153+0000","last_change":"2024-04-25T02:29:07.821126+0000","last_active":"2024-04-25T02:29:07.821153+0000","last_peered":"2024-04-25T02:29:07.821153+0000","last_clean":"2024-04-25T02:29:07.821153+0000","last_became_active":"2024-04-25T02:23:13.848076+0000","last_became_peered":"2024-04-25T02:23:13.848076+0000","last_unstale":"2024-04-25T02:29:07.821153+0000","last_undegraded":"2024-04-25T02:29:07.821153+0000","last_fullsized":"2024-04-25T02:29:07.821153+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:07.821012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:07.821012+0000","last_clean_scrub_stamp":"2024-04-25T02:29:07.821012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:19.428497+0000","scrub_duration":0.001478198,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"43'394","reported_seq":429,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.513323+0000","last_change":"2024-04-25T02:23:12.848506+0000","last_active":"2024-04-25T02:28:08.513323+0000","last_peered":"2024-04-25T02:28:08.513323+0000","last_clean":"2024-04-25T02:28:08.513323+0000","last_became_active":"2024-04-25T02:23:12.848229+0000","last_became_peered":"2024-04-25T02:23:12.848229+0000","last_unstale":"2024-04-25T02:28:08.513323+0000","last_undegraded":"2024-04-25T02:28:08.513323+0000","last_fullsized":"2024-04-25T02:28:08.513323+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":337,"num_write_kb":8338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"43'349","reported_seq":410,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:07.926117+0000","last_change":"2024-04-25T02:29:07.926087+0000","last_active":"2024-04-25T02:29:07.926117+0000","last_peered":"2024-04-25T02:29:07.926117+0000","last_clean":"2024-04-25T02:29:07.926117+0000","last_became_active":"2024-04-25T02:23:11.834994+0000","last_became_peered":"2024-04-25T02:23:11.834994+0000","last_unstale":"2024-04-25T02:29:07.926117+0000","last_undegraded":"2024-04-25T02:29:07.926117+0000","last_fullsized":"2024-04-25T02:29:07.926117+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'349","last_scrub_stamp":"2024-04-25T02:29:07.925985+0000","last_deep_scrub":"43'349","last_deep_scrub_stamp":"2024-04-25T02:29:07.925985+0000","last_clean_scrub_stamp":"2024-04-25T02:29:07.925985+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:48:50.879001+0000","scrub_duration":0.002053675,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":11931,"num_write":325,"num_write_kb":25986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":53,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:48.471620+0000","last_change":"2024-04-25T02:28:48.471576+0000","last_active":"2024-04-25T02:28:48.471620+0000","last_peered":"2024-04-25T02:28:48.471620+0000","last_clean":"2024-04-25T02:28:48.471620+0000","last_became_active":"2024-04-25T02:23:13.848628+0000","last_became_peered":"2024-04-25T02:23:13.848628+0000","last_unstale":"2024-04-25T02:28:48.471620+0000","last_undegraded":"2024-04-25T02:28:48.471620+0000","last_fullsized":"2024-04-25T02:28:48.471620+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:48.471463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:48.471463+0000","last_clean_scrub_stamp":"2024-04-25T02:28:48.471463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:16:32.732598+0000","scrub_duration":0.0015455829999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"43'117","reported_seq":205,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:43.952390+0000","last_change":"2024-04-25T02:28:43.952355+0000","last_active":"2024-04-25T02:28:43.952390+0000","last_peered":"2024-04-25T02:28:43.952390+0000","last_clean":"2024-04-25T02:28:43.952390+0000","last_became_active":"2024-04-25T02:23:11.835430+0000","last_became_peered":"2024-04-25T02:23:11.835430+0000","last_unstale":"2024-04-25T02:28:43.952390+0000","last_undegraded":"2024-04-25T02:28:43.952390+0000","last_fullsized":"2024-04-25T02:28:43.952390+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'117","last_scrub_stamp":"2024-04-25T02:28:43.952236+0000","last_deep_scrub":"43'117","last_deep_scrub_stamp":"2024-04-25T02:28:43.952236+0000","last_clean_scrub_stamp":"2024-04-25T02:28:43.952236+0000","objects_scrubbed":2,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:46:14.784576+0000","scrub_duration":0.005143936,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"43'575","reported_seq":625,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:04.637560+0000","last_change":"2024-04-25T02:29:04.637520+0000","last_active":"2024-04-25T02:29:04.637560+0000","last_peered":"2024-04-25T02:29:04.637560+0000","last_clean":"2024-04-25T02:29:04.637560+0000","last_became_active":"2024-04-25T02:23:13.845029+0000","last_became_peered":"2024-04-25T02:23:13.845029+0000","last_unstale":"2024-04-25T02:29:04.637560+0000","last_undegraded":"2024-04-25T02:29:04.637560+0000","last_fullsized":"2024-04-25T02:29:04.637560+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'575","last_scrub_stamp":"2024-04-25T02:29:04.637429+0000","last_deep_scrub":"43'575","last_deep_scrub_stamp":"2024-04-25T02:29:04.637429+0000","last_clean_scrub_stamp":"2024-04-25T02:29:04.637429+0000","objects_scrubbed":2,"log_size":575,"log_dups_size":0,"ondisk_log_size":575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:27:33.911843+0000","scrub_duration":0.022099299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":507,"num_write_kb":8447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"43'449","reported_seq":571,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:22.192884+0000","last_change":"2024-04-25T02:28:22.192856+0000","last_active":"2024-04-25T02:28:22.192884+0000","last_peered":"2024-04-25T02:28:22.192884+0000","last_clean":"2024-04-25T02:28:22.192884+0000","last_became_active":"2024-04-25T02:23:13.844018+0000","last_became_peered":"2024-04-25T02:23:13.844018+0000","last_unstale":"2024-04-25T02:28:22.192884+0000","last_undegraded":"2024-04-25T02:28:22.192884+0000","last_fullsized":"2024-04-25T02:28:22.192884+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'449","last_scrub_stamp":"2024-04-25T02:28:22.192764+0000","last_deep_scrub":"43'449","last_deep_scrub_stamp":"2024-04-25T02:28:22.192764+0000","last_clean_scrub_stamp":"2024-04-25T02:28:22.192764+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:28.942878+0000","scrub_duration":0.0021300249999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":31679,"num_write":414,"num_write_kb":80533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":46,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:25:10.068836+0000","last_change":"2024-04-25T02:23:13.848526+0000","last_active":"2024-04-25T02:25:10.068836+0000","last_peered":"2024-04-25T02:25:10.068836+0000","last_clean":"2024-04-25T02:25:10.068836+0000","last_became_active":"2024-04-25T02:23:13.844753+0000","last_became_peered":"2024-04-25T02:23:13.844753+0000","last_unstale":"2024-04-25T02:25:10.068836+0000","last_undegraded":"2024-04-25T02:25:10.068836+0000","last_fullsized":"2024-04-25T02:25:10.068836+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"43'253","reported_seq":486,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:09.943734+0000","last_change":"2024-04-25T02:29:09.943689+0000","last_active":"2024-04-25T02:29:09.943734+0000","last_peered":"2024-04-25T02:29:09.943734+0000","last_clean":"2024-04-25T02:29:09.943734+0000","last_became_active":"2024-04-25T02:23:12.845638+0000","last_became_peered":"2024-04-25T02:23:12.845638+0000","last_unstale":"2024-04-25T02:29:09.943734+0000","last_undegraded":"2024-04-25T02:29:09.943734+0000","last_fullsized":"2024-04-25T02:29:09.943734+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'253","last_scrub_stamp":"2024-04-25T02:29:09.943582+0000","last_deep_scrub":"43'253","last_deep_scrub_stamp":"2024-04-25T02:29:09.943582+0000","last_clean_scrub_stamp":"2024-04-25T02:29:09.943582+0000","objects_scrubbed":1,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:41:32.698316+0000","scrub_duration":0.0070356070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1460763,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":182,"num_read_kb":1548,"num_write":182,"num_write_kb":1548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"43'454","reported_seq":573,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.366445+0000","last_change":"2024-04-25T02:23:11.840630+0000","last_active":"2024-04-25T02:28:12.366445+0000","last_peered":"2024-04-25T02:28:12.366445+0000","last_clean":"2024-04-25T02:28:12.366445+0000","last_became_active":"2024-04-25T02:23:11.840215+0000","last_became_peered":"2024-04-25T02:23:11.840215+0000","last_unstale":"2024-04-25T02:28:12.366445+0000","last_undegraded":"2024-04-25T02:28:12.366445+0000","last_fullsized":"2024-04-25T02:28:12.366445+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":42224,"num_write":426,"num_write_kb":96444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":50,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:25:10.069694+0000","last_change":"2024-04-25T02:23:13.845169+0000","last_active":"2024-04-25T02:25:10.069694+0000","last_peered":"2024-04-25T02:25:10.069694+0000","last_clean":"2024-04-25T02:25:10.069694+0000","last_became_active":"2024-04-25T02:23:13.841324+0000","last_became_peered":"2024-04-25T02:23:13.841324+0000","last_unstale":"2024-04-25T02:25:10.069694+0000","last_undegraded":"2024-04-25T02:25:10.069694+0000","last_fullsized":"2024-04-25T02:25:10.069694+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"43'53","reported_seq":86,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.512310+0000","last_change":"2024-04-25T02:23:12.842493+0000","last_active":"2024-04-25T02:28:10.512310+0000","last_peered":"2024-04-25T02:28:10.512310+0000","last_clean":"2024-04-25T02:28:10.512310+0000","last_became_active":"2024-04-25T02:23:12.841930+0000","last_became_peered":"2024-04-25T02:23:12.841930+0000","last_unstale":"2024-04-25T02:28:10.512310+0000","last_undegraded":"2024-04-25T02:28:10.512310+0000","last_fullsized":"2024-04-25T02:28:10.512310+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"43'427","reported_seq":596,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:35.112665+0000","last_change":"2024-04-25T02:28:35.112631+0000","last_active":"2024-04-25T02:28:35.112665+0000","last_peered":"2024-04-25T02:28:35.112665+0000","last_clean":"2024-04-25T02:28:35.112665+0000","last_became_active":"2024-04-25T02:23:12.847949+0000","last_became_peered":"2024-04-25T02:23:12.847949+0000","last_unstale":"2024-04-25T02:28:35.112665+0000","last_undegraded":"2024-04-25T02:28:35.112665+0000","last_fullsized":"2024-04-25T02:28:35.112665+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'427","last_scrub_stamp":"2024-04-25T02:28:35.112522+0000","last_deep_scrub":"43'427","last_deep_scrub_stamp":"2024-04-25T02:28:35.112522+0000","last_clean_scrub_stamp":"2024-04-25T02:28:35.112522+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:01.667215+0000","scrub_duration":0.0025605430000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":62452,"num_write":394,"num_write_kb":105065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"43'65","reported_seq":109,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.480554+0000","last_change":"2024-04-25T02:23:13.844968+0000","last_active":"2024-04-25T02:28:10.480554+0000","last_peered":"2024-04-25T02:28:10.480554+0000","last_clean":"2024-04-25T02:28:10.480554+0000","last_became_active":"2024-04-25T02:23:13.844133+0000","last_became_peered":"2024-04-25T02:23:13.844133+0000","last_unstale":"2024-04-25T02:28:10.480554+0000","last_undegraded":"2024-04-25T02:28:10.480554+0000","last_fullsized":"2024-04-25T02:28:10.480554+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:56.954217+0000","last_change":"2024-04-25T02:28:56.954190+0000","last_active":"2024-04-25T02:28:56.954217+0000","last_peered":"2024-04-25T02:28:56.954217+0000","last_clean":"2024-04-25T02:28:56.954217+0000","last_became_active":"2024-04-25T02:23:11.836737+0000","last_became_peered":"2024-04-25T02:23:11.836737+0000","last_unstale":"2024-04-25T02:28:56.954217+0000","last_undegraded":"2024-04-25T02:28:56.954217+0000","last_fullsized":"2024-04-25T02:28:56.954217+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:56.954079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:56.954079+0000","last_clean_scrub_stamp":"2024-04-25T02:28:56.954079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:31:33.715989+0000","scrub_duration":0.001439145,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"43'434","reported_seq":567,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.368187+0000","last_change":"2024-04-25T02:23:13.848280+0000","last_active":"2024-04-25T02:28:12.368187+0000","last_peered":"2024-04-25T02:28:12.368187+0000","last_clean":"2024-04-25T02:28:12.368187+0000","last_became_active":"2024-04-25T02:23:13.843915+0000","last_became_peered":"2024-04-25T02:23:13.843915+0000","last_unstale":"2024-04-25T02:28:12.368187+0000","last_undegraded":"2024-04-25T02:28:12.368187+0000","last_fullsized":"2024-04-25T02:28:12.368187+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":48451,"num_write":406,"num_write_kb":112597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":60,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:45.426103+0000","last_change":"2024-04-25T02:28:45.426067+0000","last_active":"2024-04-25T02:28:45.426103+0000","last_peered":"2024-04-25T02:28:45.426103+0000","last_clean":"2024-04-25T02:28:45.426103+0000","last_became_active":"2024-04-25T02:23:13.838746+0000","last_became_peered":"2024-04-25T02:23:13.838746+0000","last_unstale":"2024-04-25T02:28:45.426103+0000","last_undegraded":"2024-04-25T02:28:45.426103+0000","last_fullsized":"2024-04-25T02:28:45.426103+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:45.425965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:45.425965+0000","last_clean_scrub_stamp":"2024-04-25T02:28:45.425965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:51.800756+0000","scrub_duration":0.0014993350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"43'86","reported_seq":126,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:16.198349+0000","last_change":"2024-04-25T02:23:11.840837+0000","last_active":"2024-04-25T02:28:16.198349+0000","last_peered":"2024-04-25T02:28:16.198349+0000","last_clean":"2024-04-25T02:28:16.198349+0000","last_became_active":"2024-04-25T02:23:11.840553+0000","last_became_peered":"2024-04-25T02:23:11.840553+0000","last_unstale":"2024-04-25T02:28:16.198349+0000","last_undegraded":"2024-04-25T02:28:16.198349+0000","last_fullsized":"2024-04-25T02:28:16.198349+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":74,"num_write_kb":962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"43'397","reported_seq":495,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:02.785656+0000","last_change":"2024-04-25T02:29:02.785610+0000","last_active":"2024-04-25T02:29:02.785656+0000","last_peered":"2024-04-25T02:29:02.785656+0000","last_clean":"2024-04-25T02:29:02.785656+0000","last_became_active":"2024-04-25T02:23:13.848374+0000","last_became_peered":"2024-04-25T02:23:13.848374+0000","last_unstale":"2024-04-25T02:29:02.785656+0000","last_undegraded":"2024-04-25T02:29:02.785656+0000","last_fullsized":"2024-04-25T02:29:02.785656+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'397","last_scrub_stamp":"2024-04-25T02:29:02.785490+0000","last_deep_scrub":"43'397","last_deep_scrub_stamp":"2024-04-25T02:29:02.785490+0000","last_clean_scrub_stamp":"2024-04-25T02:29:02.785490+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:46:45.303985+0000","scrub_duration":0.0024422020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":25341,"num_write":367,"num_write_kb":104771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"43'122","reported_seq":164,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:07.500111+0000","last_change":"2024-04-25T02:23:13.842766+0000","last_active":"2024-04-25T02:28:07.500111+0000","last_peered":"2024-04-25T02:28:07.500111+0000","last_clean":"2024-04-25T02:28:07.500111+0000","last_became_active":"2024-04-25T02:23:13.842438+0000","last_became_peered":"2024-04-25T02:23:13.842438+0000","last_unstale":"2024-04-25T02:28:07.500111+0000","last_undegraded":"2024-04-25T02:28:07.500111+0000","last_fullsized":"2024-04-25T02:28:07.500111+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4196548,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"43'373","reported_seq":466,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:13.969575+0000","last_change":"2024-04-25T02:29:13.969547+0000","last_active":"2024-04-25T02:29:13.969575+0000","last_peered":"2024-04-25T02:29:13.969575+0000","last_clean":"2024-04-25T02:29:13.969575+0000","last_became_active":"2024-04-25T02:23:12.844258+0000","last_became_peered":"2024-04-25T02:23:12.844258+0000","last_unstale":"2024-04-25T02:29:13.969575+0000","last_undegraded":"2024-04-25T02:29:13.969575+0000","last_fullsized":"2024-04-25T02:29:13.969575+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'373","last_scrub_stamp":"2024-04-25T02:29:13.969449+0000","last_deep_scrub":"43'373","last_deep_scrub_stamp":"2024-04-25T02:29:13.969449+0000","last_clean_scrub_stamp":"2024-04-25T02:29:13.969449+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:55:34.895544+0000","scrub_duration":0.0022595229999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":25157,"num_write":340,"num_write_kb":59328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"43'318","reported_seq":362,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:06.939622+0000","last_change":"2024-04-25T02:29:06.939592+0000","last_active":"2024-04-25T02:29:06.939622+0000","last_peered":"2024-04-25T02:29:06.939622+0000","last_clean":"2024-04-25T02:29:06.939622+0000","last_became_active":"2024-04-25T02:23:11.833348+0000","last_became_peered":"2024-04-25T02:23:11.833348+0000","last_unstale":"2024-04-25T02:29:06.939622+0000","last_undegraded":"2024-04-25T02:29:06.939622+0000","last_fullsized":"2024-04-25T02:29:06.939622+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'318","last_scrub_stamp":"2024-04-25T02:29:06.939488+0000","last_deep_scrub":"43'318","last_deep_scrub_stamp":"2024-04-25T02:29:06.939488+0000","last_clean_scrub_stamp":"2024-04-25T02:29:06.939488+0000","objects_scrubbed":2,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:26:24.204337+0000","scrub_duration":0.013407262,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":262,"num_write_kb":4264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"43'371","reported_seq":471,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:20.223269+0000","last_change":"2024-04-25T02:28:20.223232+0000","last_active":"2024-04-25T02:28:20.223269+0000","last_peered":"2024-04-25T02:28:20.223269+0000","last_clean":"2024-04-25T02:28:20.223269+0000","last_became_active":"2024-04-25T02:23:55.963467+0000","last_became_peered":"2024-04-25T02:23:55.963467+0000","last_unstale":"2024-04-25T02:28:20.223269+0000","last_undegraded":"2024-04-25T02:28:20.223269+0000","last_fullsized":"2024-04-25T02:28:20.223269+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'371","last_scrub_stamp":"2024-04-25T02:28:20.223133+0000","last_deep_scrub":"43'371","last_deep_scrub_stamp":"2024-04-25T02:28:20.223133+0000","last_clean_scrub_stamp":"2024-04-25T02:28:20.223133+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:12.999404+0000","scrub_duration":0.0022911020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":32821,"num_write":343,"num_write_kb":62943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"43'327","reported_seq":385,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:11.615512+0000","last_change":"2024-04-25T02:29:11.615484+0000","last_active":"2024-04-25T02:29:11.615512+0000","last_peered":"2024-04-25T02:29:11.615512+0000","last_clean":"2024-04-25T02:29:11.615512+0000","last_became_active":"2024-04-25T02:23:13.840492+0000","last_became_peered":"2024-04-25T02:23:13.840492+0000","last_unstale":"2024-04-25T02:29:11.615512+0000","last_undegraded":"2024-04-25T02:29:11.615512+0000","last_fullsized":"2024-04-25T02:29:11.615512+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'327","last_scrub_stamp":"2024-04-25T02:29:11.615400+0000","last_deep_scrub":"43'327","last_deep_scrub_stamp":"2024-04-25T02:29:11.615400+0000","last_clean_scrub_stamp":"2024-04-25T02:29:11.615400+0000","objects_scrubbed":4,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:49:15.104618+0000","scrub_duration":0.029271986,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":257,"num_write_kb":12449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"43'384","reported_seq":454,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:25.236814+0000","last_change":"2024-04-25T02:28:25.236776+0000","last_active":"2024-04-25T02:28:25.236814+0000","last_peered":"2024-04-25T02:28:25.236814+0000","last_clean":"2024-04-25T02:28:25.236814+0000","last_became_active":"2024-04-25T02:23:13.847264+0000","last_became_peered":"2024-04-25T02:23:13.847264+0000","last_unstale":"2024-04-25T02:28:25.236814+0000","last_undegraded":"2024-04-25T02:28:25.236814+0000","last_fullsized":"2024-04-25T02:28:25.236814+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'384","last_scrub_stamp":"2024-04-25T02:28:25.236669+0000","last_deep_scrub":"43'384","last_deep_scrub_stamp":"2024-04-25T02:28:25.236669+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.236669+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:51.748406+0000","scrub_duration":0.002112685,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":15655,"num_write":352,"num_write_kb":42131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"43'94","reported_seq":144,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:50.478023+0000","last_change":"2024-04-25T02:28:50.477980+0000","last_active":"2024-04-25T02:28:50.478023+0000","last_peered":"2024-04-25T02:28:50.478023+0000","last_clean":"2024-04-25T02:28:50.478023+0000","last_became_active":"2024-04-25T02:23:13.845143+0000","last_became_peered":"2024-04-25T02:23:13.845143+0000","last_unstale":"2024-04-25T02:28:50.478023+0000","last_undegraded":"2024-04-25T02:28:50.478023+0000","last_fullsized":"2024-04-25T02:28:50.478023+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'94","last_scrub_stamp":"2024-04-25T02:28:50.477893+0000","last_deep_scrub":"43'94","last_deep_scrub_stamp":"2024-04-25T02:28:50.477893+0000","last_clean_scrub_stamp":"2024-04-25T02:28:50.477893+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:47:38.664790+0000","scrub_duration":0.0099647699999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":4121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"43'427","reported_seq":462,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.348849+0000","last_change":"2024-04-25T02:23:55.957176+0000","last_active":"2024-04-25T02:28:12.348849+0000","last_peered":"2024-04-25T02:28:12.348849+0000","last_clean":"2024-04-25T02:28:12.348849+0000","last_became_active":"2024-04-25T02:23:55.956828+0000","last_became_peered":"2024-04-25T02:23:55.956828+0000","last_unstale":"2024-04-25T02:28:12.348849+0000","last_undegraded":"2024-04-25T02:28:12.348849+0000","last_fullsized":"2024-04-25T02:28:12.348849+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":14079,"num_write":394,"num_write_kb":87521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"43'114","reported_seq":160,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:20.198034+0000","last_change":"2024-04-25T02:28:20.198001+0000","last_active":"2024-04-25T02:28:20.198034+0000","last_peered":"2024-04-25T02:28:20.198034+0000","last_clean":"2024-04-25T02:28:20.198034+0000","last_became_active":"2024-04-25T02:23:11.838807+0000","last_became_peered":"2024-04-25T02:23:11.838807+0000","last_unstale":"2024-04-25T02:28:20.198034+0000","last_undegraded":"2024-04-25T02:28:20.198034+0000","last_fullsized":"2024-04-25T02:28:20.198034+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'114","last_scrub_stamp":"2024-04-25T02:28:20.197907+0000","last_deep_scrub":"43'114","last_deep_scrub_stamp":"2024-04-25T02:28:20.197907+0000","last_clean_scrub_stamp":"2024-04-25T02:28:20.197907+0000","objects_scrubbed":3,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:47:55.330863+0000","scrub_duration":0.011784594000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":59,"num_write_kb":4127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"43'447","reported_seq":531,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:53.887469+0000","last_change":"2024-04-25T02:28:53.887441+0000","last_active":"2024-04-25T02:28:53.887469+0000","last_peered":"2024-04-25T02:28:53.887469+0000","last_clean":"2024-04-25T02:28:53.887469+0000","last_became_active":"2024-04-25T02:23:12.845497+0000","last_became_peered":"2024-04-25T02:23:12.845497+0000","last_unstale":"2024-04-25T02:28:53.887469+0000","last_undegraded":"2024-04-25T02:28:53.887469+0000","last_fullsized":"2024-04-25T02:28:53.887469+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'447","last_scrub_stamp":"2024-04-25T02:28:53.887343+0000","last_deep_scrub":"43'447","last_deep_scrub_stamp":"2024-04-25T02:28:53.887343+0000","last_clean_scrub_stamp":"2024-04-25T02:28:53.887343+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:59:00.846583+0000","scrub_duration":0.0022684239999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15742,"num_write":414,"num_write_kb":51315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"43'419","reported_seq":485,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.369706+0000","last_change":"2024-04-25T02:23:12.847086+0000","last_active":"2024-04-25T02:28:12.369706+0000","last_peered":"2024-04-25T02:28:12.369706+0000","last_clean":"2024-04-25T02:28:12.369706+0000","last_became_active":"2024-04-25T02:23:12.846719+0000","last_became_peered":"2024-04-25T02:23:12.846719+0000","last_unstale":"2024-04-25T02:28:12.369706+0000","last_undegraded":"2024-04-25T02:28:12.369706+0000","last_fullsized":"2024-04-25T02:28:12.369706+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":16944,"num_write":389,"num_write_kb":35957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"43'440","reported_seq":485,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.367687+0000","last_change":"2024-04-25T02:23:56.302118+0000","last_active":"2024-04-25T02:28:12.367687+0000","last_peered":"2024-04-25T02:28:12.367687+0000","last_clean":"2024-04-25T02:28:12.367687+0000","last_became_active":"2024-04-25T02:23:56.301745+0000","last_became_peered":"2024-04-25T02:23:56.301745+0000","last_unstale":"2024-04-25T02:28:12.367687+0000","last_undegraded":"2024-04-25T02:28:12.367687+0000","last_fullsized":"2024-04-25T02:28:12.367687+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":12557,"num_write":410,"num_write_kb":77332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"43'492","reported_seq":571,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:24.176583+0000","last_change":"2024-04-25T02:28:24.176533+0000","last_active":"2024-04-25T02:28:24.176583+0000","last_peered":"2024-04-25T02:28:24.176583+0000","last_clean":"2024-04-25T02:28:24.176583+0000","last_became_active":"2024-04-25T02:23:13.844235+0000","last_became_peered":"2024-04-25T02:23:13.844235+0000","last_unstale":"2024-04-25T02:28:24.176583+0000","last_undegraded":"2024-04-25T02:28:24.176583+0000","last_fullsized":"2024-04-25T02:28:24.176583+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'492","last_scrub_stamp":"2024-04-25T02:28:24.176384+0000","last_deep_scrub":"43'492","last_deep_scrub_stamp":"2024-04-25T02:28:24.176384+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.176384+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:15.054028+0000","scrub_duration":0.002556961,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14237,"num_write":458,"num_write_kb":116854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"43'392","reported_seq":482,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:13.587928+0000","last_change":"2024-04-25T02:29:13.587897+0000","last_active":"2024-04-25T02:29:13.587928+0000","last_peered":"2024-04-25T02:29:13.587928+0000","last_clean":"2024-04-25T02:29:13.587928+0000","last_became_active":"2024-04-25T02:23:13.845193+0000","last_became_peered":"2024-04-25T02:23:13.845193+0000","last_unstale":"2024-04-25T02:29:13.587928+0000","last_undegraded":"2024-04-25T02:29:13.587928+0000","last_fullsized":"2024-04-25T02:29:13.587928+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'392","last_scrub_stamp":"2024-04-25T02:29:13.587800+0000","last_deep_scrub":"43'392","last_deep_scrub_stamp":"2024-04-25T02:29:13.587800+0000","last_clean_scrub_stamp":"2024-04-25T02:29:13.587800+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:00:48.741712+0000","scrub_duration":0.002153206,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":36152,"num_write":360,"num_write_kb":54497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"43'402","reported_seq":504,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.360499+0000","last_change":"2024-04-25T02:23:12.842342+0000","last_active":"2024-04-25T02:28:12.360499+0000","last_peered":"2024-04-25T02:28:12.360499+0000","last_clean":"2024-04-25T02:28:12.360499+0000","last_became_active":"2024-04-25T02:23:12.841677+0000","last_became_peered":"2024-04-25T02:23:12.841677+0000","last_unstale":"2024-04-25T02:28:12.360499+0000","last_undegraded":"2024-04-25T02:28:12.360499+0000","last_fullsized":"2024-04-25T02:28:12.360499+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":32628,"num_write":375,"num_write_kb":79888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2779,"num_read_kb":1446401,"num_write":24390,"num_write_kb":4320360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26350,"ondisk_log_size":26350,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":129261049,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":231,"num_read_kb":1603,"num_write":6644,"num_write_kb":130848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":258629632,"data_stored":258522098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39115,"internal_metadata":0},"log_size":8538,"ondisk_log_size":8538,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":31,"seq":133143986251,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":393820,"kb_used_data":88340,"kb_used_omap":9,"kb_used_meta":305462,"kb_avail":93978020,"statfs":{"total":96636764160,"available":96233492480,"internally_reserved":0,"allocated":90460160,"data_stored":90216632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9975,"internal_metadata":312793353},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.22,"5min":0.33600000000000002,"15min":0.33400000000000002},"min":{"1min":0.156,"5min":0.156,"15min":0.156},"max":{"1min":0.33400000000000002,"5min":3.5409999999999999,"15min":3.5409999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.25600000000000001,"5min":0.39000000000000001,"15min":0.36299999999999999},"min":{"1min":0.20100000000000001,"5min":0.161,"15min":0.161},"max":{"1min":0.38200000000000001,"5min":3.613,"15min":3.613},"last":0.442}]},{"osd":1,"last update":"Thu Apr 25 02:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.27800000000000002,"5min":0.374,"15min":0.35999999999999999},"min":{"1min":0.19900000000000001,"5min":0.184,"15min":0.184},"max":{"1min":0.86799999999999999,"5min":3.0009999999999999,"15min":3.0009999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.27200000000000002,"5min":0.38,"15min":0.36699999999999999},"min":{"1min":0.20899999999999999,"5min":0.157,"15min":0.157},"max":{"1min":0.36899999999999999,"5min":4.9720000000000004,"15min":4.9720000000000004},"last":0.47799999999999998}]},{"osd":2,"last update":"Thu Apr 25 02:28:17 2024","interfaces":[{"interface":"back","average":{"1min":0.28000000000000003,"5min":0.41599999999999998,"15min":0.375},"min":{"1min":0.182,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.41699999999999998,"5min":4.883,"15min":4.883},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.32800000000000001,"5min":0.39400000000000002,"15min":0.38200000000000001},"min":{"1min":0.214,"5min":0.184,"15min":0.184},"max":{"1min":1.004,"5min":3.0550000000000002,"15min":3.0550000000000002},"last":0.56399999999999995}]}]},{"osd":2,"up_from":30,"seq":128849018955,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":366484,"kb_used_data":56972,"kb_used_omap":8,"kb_used_meta":309495,"kb_avail":94005356,"statfs":{"total":96636764160,"available":96261484544,"internally_reserved":0,"allocated":58339328,"data_stored":58119882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8387,"internal_metadata":316923709},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:28:19 2024","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.32000000000000001,"15min":0.32200000000000001},"min":{"1min":0.16600000000000001,"5min":0.14199999999999999,"15min":0.14199999999999999},"max":{"1min":2.419,"5min":2.419,"15min":2.419},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.28100000000000003,"5min":0.316,"15min":0.32600000000000001},"min":{"1min":0.192,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.45800000000000002,"5min":0.51300000000000001,"15min":0.51300000000000001},"last":0.31}]},{"osd":1,"last update":"Thu Apr 25 02:28:19 2024","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"min":{"1min":0.19600000000000001,"5min":0.19,"15min":0.19},"max":{"1min":0.89500000000000002,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.314,"5min":0.34499999999999997,"15min":0.34699999999999998},"min":{"1min":0.20399999999999999,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.58899999999999997,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.34799999999999998}]},{"osd":3,"last update":"Thu Apr 25 02:28:19 2024","interfaces":[{"interface":"back","average":{"1min":0.29699999999999999,"5min":0.34100000000000003,"15min":0.35099999999999998},"min":{"1min":0.19800000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.49099999999999999,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.37},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.39100000000000001,"15min":0.39900000000000002},"min":{"1min":0.26000000000000001,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.55900000000000005,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.40500000000000003}]}]},{"osd":0,"up_from":28,"seq":120259084363,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369380,"kb_used_data":59740,"kb_used_omap":15,"kb_used_meta":309616,"kb_avail":94002460,"statfs":{"total":96636764160,"available":96258519040,"internally_reserved":0,"allocated":61173760,"data_stored":60940630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15790,"internal_metadata":317047378},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 25 02:28:16 2024","interfaces":[{"interface":"back","average":{"1min":0.245,"5min":0.30599999999999999,"15min":0.33000000000000002},"min":{"1min":0.157,"5min":0.14799999999999999,"15min":0.14799999999999999},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.436},{"interface":"front","average":{"1min":0.29999999999999999,"5min":0.33300000000000002,"15min":0.35399999999999998},"min":{"1min":0.192,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.51900000000000002}]},{"osd":2,"last update":"Thu Apr 25 02:28:16 2024","interfaces":[{"interface":"back","average":{"1min":0.28299999999999997,"5min":0.34300000000000003,"15min":0.371},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.501},{"interface":"front","average":{"1min":0.311,"5min":0.34899999999999998,"15min":0.378},"min":{"1min":0.20499999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":1.2070000000000001,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.46000000000000002}]},{"osd":3,"last update":"Thu Apr 25 02:28:26 2024","interfaces":[{"interface":"back","average":{"1min":0.29999999999999999,"5min":0.374,"15min":0.378},"min":{"1min":0.217,"5min":0.186,"15min":0.186},"max":{"1min":0.433,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.315,"5min":0.375,"15min":0.41299999999999998},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.52100000000000002,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.55100000000000005}]}]},{"osd":1,"up_from":29,"seq":124554051659,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":351548,"kb_used_data":50100,"kb_used_omap":4,"kb_used_meta":301435,"kb_avail":94020292,"statfs":{"total":96636764160,"available":96276779008,"internally_reserved":0,"allocated":51302400,"data_stored":51088318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4963,"internal_metadata":308669597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:28:13 2024","interfaces":[{"interface":"back","average":{"1min":0.23499999999999999,"5min":0.29299999999999998,"15min":0.32100000000000001},"min":{"1min":0.16700000000000001,"5min":0.155,"15min":0.155},"max":{"1min":0.36699999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.373},{"interface":"front","average":{"1min":0.26600000000000001,"5min":0.314,"15min":0.34399999999999997},"min":{"1min":0.189,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.40699999999999997,"5min":0.54000000000000004,"15min":0.54000000000000004},"last":0.40300000000000002}]},{"osd":2,"last update":"Thu Apr 25 02:28:13 2024","interfaces":[{"interface":"back","average":{"1min":0.26200000000000001,"5min":0.32600000000000001,"15min":0.34599999999999997},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.33900000000000002,"5min":0.49199999999999999,"15min":0.49199999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.27300000000000002,"5min":0.34100000000000003,"15min":0.35699999999999998},"min":{"1min":0.20399999999999999,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.35099999999999998,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.47899999999999998}]},{"osd":3,"last update":"Thu Apr 25 02:28:13 2024","interfaces":[{"interface":"back","average":{"1min":0.28999999999999998,"5min":0.36099999999999999,"15min":0.39000000000000001},"min":{"1min":0.222,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.40500000000000003,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.496},{"interface":"front","average":{"1min":0.28000000000000003,"5min":0.35499999999999998,"15min":0.38300000000000001},"min":{"1min":0.20599999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.38300000000000001,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.51500000000000001}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":60215296,"data_stored":60184605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15790,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":50343936,"data_stored":50332293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4963,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57974784,"data_stored":57954225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8387,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90095616,"data_stored":90050975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9975,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:29:20.790 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:20.790 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:20.791 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:20.791 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:20.791 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:20.791 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:20.791 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:20.791 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:20.791 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:20.791 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:20.792 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:20.792 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:20.792 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:20.792 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:20.792 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:20.792 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:20.792 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:20.793 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:20.793 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:20.793 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:20.793 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-25T02:20:14.468721+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:20.793 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:20.793 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-25T02:20:14.468721+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:20.793 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:20.793 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-25T02:20:14.468721+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:20.794 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:20.794 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:20.794 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:20.794 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:20.794 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:20.794 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:20.794 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:20.795 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:20.795 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:20.795 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T02:29:40.795 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:29:40.925 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.923+0000 7f71d759b700 1 Processor -- start 2024-04-25T02:29:40.925 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.923+0000 7f71d759b700 1 -- start start 2024-04-25T02:29:40.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.924+0000 7f71d759b700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f71d00ad430 0x7f71d0131100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:40.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.924+0000 7f71d759b700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f71d0131640 0x7f71d01459a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:40.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.924+0000 7f71d759b700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71d006e580 con 0x7f71d0063d10 2024-04-25T02:29:40.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.924+0000 7f71d759b700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71d006e3a0 con 0x7f71d00ad430 2024-04-25T02:29:40.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.924+0000 7f71d759b700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d013e660 con 0x7f71d0131640 2024-04-25T02:29:40.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.924+0000 7f71d5b38700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f71d0131640 0x7f71d01459a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:40.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.924+0000 7f71d4b36700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f71d00ad430 0x7f71d0131100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:40.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.924+0000 7f71d5b38700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f71d0131640 0x7f71d01459a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:46840/0 (socket says 172.21.15.111:46840) 2024-04-25T02:29:40.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.924+0000 7f71d5b38700 1 -- 172.21.15.111:0/2006389276 learned_addr learned my addr 172.21.15.111:0/2006389276 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:29:40.927 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.924+0000 7f71d4b36700 1 -- 172.21.15.111:0/2006389276 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f71d0131640 msgr2=0x7f71d01459a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:29:40.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.924+0000 7f71d4b36700 1 --2- 172.21.15.111:0/2006389276 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f71d0131640 0x7f71d01459a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:40.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.924+0000 7f71d4b36700 1 -- 172.21.15.111:0/2006389276 >> v1:172.21.15.111:6789/0 conn(0x7f71d0063d10 legacy=0x7f71d006eca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:40.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.924+0000 7f71d4b36700 1 -- 172.21.15.111:0/2006389276 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d013e900 con 0x7f71d00ad430 2024-04-25T02:29:40.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.924+0000 7f71d5b38700 1 --2- 172.21.15.111:0/2006389276 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f71d0131640 0x7f71d01459a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:29:40.928 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.924+0000 7f71d4b36700 1 --2- 172.21.15.111:0/2006389276 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f71d00ad430 0x7f71d0131100 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f71c00098e0 tx=0x7f71c00091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed02a769de7367e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:40.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.926+0000 7f71c7fff700 1 -- 172.21.15.111:0/2006389276 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c000b640 con 0x7f71d00ad430 2024-04-25T02:29:40.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.926+0000 7f71c7fff700 1 -- 172.21.15.111:0/2006389276 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c000b7a0 con 0x7f71d00ad430 2024-04-25T02:29:40.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.926+0000 7f71c7fff700 1 -- 172.21.15.111:0/2006389276 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c000bb40 con 0x7f71d00ad430 2024-04-25T02:29:40.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.926+0000 7f71d759b700 1 -- 172.21.15.111:0/2006389276 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f71d00ad430 msgr2=0x7f71d0131100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:40.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.926+0000 7f71d759b700 1 --2- 172.21.15.111:0/2006389276 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f71d00ad430 0x7f71d0131100 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f71c00098e0 tx=0x7f71c00091a0 comp rx=0 tx=0).stop 2024-04-25T02:29:40.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.926+0000 7f71d759b700 1 -- 172.21.15.111:0/2006389276 shutdown_connections 2024-04-25T02:29:40.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.926+0000 7f71d759b700 1 --2- 172.21.15.111:0/2006389276 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f71d0131640 0x7f71d01459a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:40.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.926+0000 7f71d759b700 1 --2- 172.21.15.111:0/2006389276 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f71d00ad430 0x7f71d0131100 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:40.929 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.926+0000 7f71d759b700 1 -- 172.21.15.111:0/2006389276 >> 172.21.15.111:0/2006389276 conn(0x7f71d00b1e10 msgr2=0x7f71d00ade80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:40.930 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.927+0000 7f71d759b700 1 -- 172.21.15.111:0/2006389276 shutdown_connections 2024-04-25T02:29:40.930 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.927+0000 7f71d759b700 1 -- 172.21.15.111:0/2006389276 wait complete. 2024-04-25T02:29:40.930 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.927+0000 7f71d759b700 1 Processor -- start 2024-04-25T02:29:40.930 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.928+0000 7f71d759b700 1 -- start start 2024-04-25T02:29:40.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.928+0000 7f71d759b700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f71d0063d10 0x7f71d0132620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:40.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.928+0000 7f71d759b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f71d00ad430 0x7f71d014e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:40.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.928+0000 7f71d759b700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f71d01331c0 0x7f71d014eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:29:40.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.928+0000 7f71d759b700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d00ab7a0 con 0x7f71d0063d10 2024-04-25T02:29:40.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.928+0000 7f71d759b700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d014e180 con 0x7f71d01331c0 2024-04-25T02:29:40.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.928+0000 7f71d759b700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f71d0134720 con 0x7f71d00ad430 2024-04-25T02:29:40.932 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.928+0000 7f71d4b36700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f71d00ad430 0x7f71d014e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:40.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.928+0000 7f71d5337700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f71d0063d10 0x7f71d0132620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:40.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.928+0000 7f71d5b38700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f71d01331c0 0x7f71d014eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:29:40.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.928+0000 7f71d4b36700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f71d00ad430 0x7f71d014e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:47528/0 (socket says 172.21.15.111:47528) 2024-04-25T02:29:40.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.928+0000 7f71d5337700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f71d0063d10 0x7f71d0132620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:50420/0 (socket says 172.21.15.111:50420) 2024-04-25T02:29:40.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.928+0000 7f71d4b36700 1 -- 172.21.15.111:0/3612900393 learned_addr learned my addr 172.21.15.111:0/3612900393 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:29:40.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.929+0000 7f71d5b38700 1 -- 172.21.15.111:0/3612900393 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f71d00ad430 msgr2=0x7f71d014e5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:40.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.929+0000 7f71d5b38700 1 --2- 172.21.15.111:0/3612900393 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f71d00ad430 0x7f71d014e5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:40.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.929+0000 7f71d5b38700 1 -- 172.21.15.111:0/3612900393 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f71d0063d10 msgr2=0x7f71d0132620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:40.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.929+0000 7f71d5b38700 1 --2- 172.21.15.111:0/3612900393 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f71d0063d10 0x7f71d0132620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:40.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.929+0000 7f71d5b38700 1 -- 172.21.15.111:0/3612900393 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c800bcf0 con 0x7f71d01331c0 2024-04-25T02:29:40.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.929+0000 7f71d4b36700 1 --2- 172.21.15.111:0/3612900393 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f71d00ad430 0x7f71d014e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:29:40.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.929+0000 7f71d5b38700 1 --2- 172.21.15.111:0/3612900393 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f71d01331c0 0x7f71d014eaf0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f71d0069830 tx=0x7f71c800d040 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:29:40.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.929+0000 7f71c57fa700 1 -- 172.21.15.111:0/3612900393 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c8018070 con 0x7f71d01331c0 2024-04-25T02:29:40.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.929+0000 7f71c57fa700 1 -- 172.21.15.111:0/3612900393 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c800ee20 con 0x7f71d01331c0 2024-04-25T02:29:40.933 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.929+0000 7f71d759b700 1 -- 172.21.15.111:0/3612900393 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71c0009420 con 0x7f71d01331c0 2024-04-25T02:29:40.934 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.929+0000 7f71d759b700 1 -- 172.21.15.111:0/3612900393 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71d00b0e50 con 0x7f71d01331c0 2024-04-25T02:29:40.934 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.929+0000 7f71c57fa700 1 -- 172.21.15.111:0/3612900393 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c8010040 con 0x7f71d01331c0 2024-04-25T02:29:40.934 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.930+0000 7f71d759b700 1 -- 172.21.15.111:0/3612900393 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71b00052b0 con 0x7f71d01331c0 2024-04-25T02:29:40.934 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.930+0000 7f71c57fa700 1 -- 172.21.15.111:0/3612900393 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f71c8003020 con 0x7f71d01331c0 2024-04-25T02:29:40.934 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.931+0000 7f71c57fa700 1 -- 172.21.15.111:0/3612900393 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4158+0+0 (secure 0 0 0) 0x7f71c805b230 con 0x7f71d01331c0 2024-04-25T02:29:40.938 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:40.936+0000 7f71c57fa700 1 -- 172.21.15.111:0/3612900393 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f71c80394c0 con 0x7f71d01331c0 2024-04-25T02:29:41.088 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:41.085+0000 7f71d759b700 1 -- 172.21.15.111:0/3612900393 --> v1:172.21.15.111:6816/46482 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f71b0000bc0 con 0x7f71b4045f20 2024-04-25T02:29:41.095 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:41.092+0000 7f71c57fa700 1 -- 172.21.15.111:0/3612900393 <== mgr.14107 v1:172.21.15.111:6816/46482 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+279814 (unknown 2965378022 0 252899127) 0x7f71b0000bc0 con 0x7f71b4045f20 2024-04-25T02:29:41.099 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:29:41.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:41.095+0000 7f71d759b700 1 -- 172.21.15.111:0/3612900393 >> v1:172.21.15.111:6816/46482 conn(0x7f71b4045f20 legacy=0x7f71b40483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:41.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:41.095+0000 7f71d759b700 1 -- 172.21.15.111:0/3612900393 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f71d01331c0 msgr2=0x7f71d014eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:29:41.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:41.095+0000 7f71d759b700 1 --2- 172.21.15.111:0/3612900393 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f71d01331c0 0x7f71d014eaf0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f71d0069830 tx=0x7f71c800d040 comp rx=0 tx=0).stop 2024-04-25T02:29:41.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:41.095+0000 7f71d759b700 1 -- 172.21.15.111:0/3612900393 shutdown_connections 2024-04-25T02:29:41.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:41.095+0000 7f71d759b700 1 --2- 172.21.15.111:0/3612900393 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f71d01331c0 0x7f71d014eaf0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:41.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:41.095+0000 7f71d759b700 1 --2- 172.21.15.111:0/3612900393 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f71d0063d10 0x7f71d0132620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:41.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:41.095+0000 7f71d759b700 1 --2- 172.21.15.111:0/3612900393 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f71d00ad430 0x7f71d014e5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:29:41.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:41.095+0000 7f71d759b700 1 -- 172.21.15.111:0/3612900393 >> 172.21.15.111:0/3612900393 conn(0x7f71d00b1e10 msgr2=0x7f71d013c5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:29:41.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:41.095+0000 7f71d759b700 1 -- 172.21.15.111:0/3612900393 shutdown_connections 2024-04-25T02:29:41.101 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:29:41.095+0000 7f71d759b700 1 -- 172.21.15.111:0/3612900393 wait complete. 2024-04-25T02:29:41.101 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2024-04-25T02:29:41.109 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":229,"stamp":"2024-04-25T02:29:40.824775+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129851417,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":3127,"num_read_kb":1448109,"num_write":31191,"num_write_kb":4453499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35014,"ondisk_log_size":35014,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1481232,"kb_used_data":255152,"kb_used_omap":38,"kb_used_meta":1226009,"kb_avail":376006128,"statfs":{"total":386547056640,"available":385030275072,"internally_reserved":0,"allocated":261275648,"data_stored":260365462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39115,"internal_metadata":1255434037},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003252"},"pg_stats":[{"pgid":"4.3f","version":"43'402","reported_seq":485,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:48.101234+0000","last_change":"2024-04-25T02:28:48.101190+0000","last_active":"2024-04-25T02:28:48.101234+0000","last_peered":"2024-04-25T02:28:48.101234+0000","last_clean":"2024-04-25T02:28:48.101234+0000","last_became_active":"2024-04-25T02:23:13.845848+0000","last_became_peered":"2024-04-25T02:23:13.845848+0000","last_unstale":"2024-04-25T02:28:48.101234+0000","last_undegraded":"2024-04-25T02:28:48.101234+0000","last_fullsized":"2024-04-25T02:28:48.101234+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'402","last_scrub_stamp":"2024-04-25T02:28:48.101084+0000","last_deep_scrub":"43'402","last_deep_scrub_stamp":"2024-04-25T02:28:48.101084+0000","last_clean_scrub_stamp":"2024-04-25T02:28:48.101084+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:09:02.892301+0000","scrub_duration":0.0017175580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":15113,"num_write":370,"num_write_kb":51033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"43'436","reported_seq":531,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:57.901623+0000","last_change":"2024-04-25T02:28:57.901586+0000","last_active":"2024-04-25T02:28:57.901623+0000","last_peered":"2024-04-25T02:28:57.901623+0000","last_clean":"2024-04-25T02:28:57.901623+0000","last_became_active":"2024-04-25T02:23:12.845429+0000","last_became_peered":"2024-04-25T02:23:12.845429+0000","last_unstale":"2024-04-25T02:28:57.901623+0000","last_undegraded":"2024-04-25T02:28:57.901623+0000","last_fullsized":"2024-04-25T02:28:57.901623+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'436","last_scrub_stamp":"2024-04-25T02:28:57.901454+0000","last_deep_scrub":"43'436","last_deep_scrub_stamp":"2024-04-25T02:28:57.901454+0000","last_clean_scrub_stamp":"2024-04-25T02:28:57.901454+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:48:22.177582+0000","scrub_duration":0.0024754489999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22592,"num_write":405,"num_write_kb":75650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"43'370","reported_seq":441,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:02.954241+0000","last_change":"2024-04-25T02:29:02.954173+0000","last_active":"2024-04-25T02:29:02.954241+0000","last_peered":"2024-04-25T02:29:02.954241+0000","last_clean":"2024-04-25T02:29:02.954241+0000","last_became_active":"2024-04-25T02:23:11.838054+0000","last_became_peered":"2024-04-25T02:23:11.838054+0000","last_unstale":"2024-04-25T02:29:02.954241+0000","last_undegraded":"2024-04-25T02:29:02.954241+0000","last_fullsized":"2024-04-25T02:29:02.954241+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'370","last_scrub_stamp":"2024-04-25T02:29:02.954067+0000","last_deep_scrub":"43'370","last_deep_scrub_stamp":"2024-04-25T02:29:02.954067+0000","last_clean_scrub_stamp":"2024-04-25T02:29:02.954067+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:35:19.757284+0000","scrub_duration":0.0024131999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":15817,"num_write":338,"num_write_kb":46402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"43'393","reported_seq":485,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:47.102595+0000","last_change":"2024-04-25T02:28:47.102563+0000","last_active":"2024-04-25T02:28:47.102595+0000","last_peered":"2024-04-25T02:28:47.102595+0000","last_clean":"2024-04-25T02:28:47.102595+0000","last_became_active":"2024-04-25T02:23:11.836681+0000","last_became_peered":"2024-04-25T02:23:11.836681+0000","last_unstale":"2024-04-25T02:28:47.102595+0000","last_undegraded":"2024-04-25T02:28:47.102595+0000","last_fullsized":"2024-04-25T02:28:47.102595+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'393","last_scrub_stamp":"2024-04-25T02:28:47.102463+0000","last_deep_scrub":"43'393","last_deep_scrub_stamp":"2024-04-25T02:28:47.102463+0000","last_clean_scrub_stamp":"2024-04-25T02:28:47.102463+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:03.660053+0000","scrub_duration":0.0021321360000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22923,"num_write":365,"num_write_kb":51318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"43'406","reported_seq":486,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:08.984923+0000","last_change":"2024-04-25T02:29:08.984891+0000","last_active":"2024-04-25T02:29:08.984923+0000","last_peered":"2024-04-25T02:29:08.984923+0000","last_clean":"2024-04-25T02:29:08.984923+0000","last_became_active":"2024-04-25T02:23:13.842918+0000","last_became_peered":"2024-04-25T02:23:13.842918+0000","last_unstale":"2024-04-25T02:29:08.984923+0000","last_undegraded":"2024-04-25T02:29:08.984923+0000","last_fullsized":"2024-04-25T02:29:08.984923+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'406","last_scrub_stamp":"2024-04-25T02:29:08.984789+0000","last_deep_scrub":"43'406","last_deep_scrub_stamp":"2024-04-25T02:29:08.984789+0000","last_clean_scrub_stamp":"2024-04-25T02:29:08.984789+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:26:07.312359+0000","scrub_duration":0.0021373719999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14619,"num_write":384,"num_write_kb":71611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"43'366","reported_seq":438,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:39.393603+0000","last_change":"2024-04-25T02:28:39.393572+0000","last_active":"2024-04-25T02:28:39.393603+0000","last_peered":"2024-04-25T02:28:39.393603+0000","last_clean":"2024-04-25T02:28:39.393603+0000","last_became_active":"2024-04-25T02:23:13.848160+0000","last_became_peered":"2024-04-25T02:23:13.848160+0000","last_unstale":"2024-04-25T02:28:39.393603+0000","last_undegraded":"2024-04-25T02:28:39.393603+0000","last_fullsized":"2024-04-25T02:28:39.393603+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'366","last_scrub_stamp":"2024-04-25T02:28:39.393471+0000","last_deep_scrub":"43'366","last_deep_scrub_stamp":"2024-04-25T02:28:39.393471+0000","last_clean_scrub_stamp":"2024-04-25T02:28:39.393471+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:09:44.749626+0000","scrub_duration":0.0023219040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12472,"num_write":338,"num_write_kb":33864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"43'441","reported_seq":560,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.351267+0000","last_change":"2024-04-25T02:23:13.842324+0000","last_active":"2024-04-25T02:28:12.351267+0000","last_peered":"2024-04-25T02:28:12.351267+0000","last_clean":"2024-04-25T02:28:12.351267+0000","last_became_active":"2024-04-25T02:23:13.840374+0000","last_became_peered":"2024-04-25T02:23:13.840374+0000","last_unstale":"2024-04-25T02:28:12.351267+0000","last_undegraded":"2024-04-25T02:28:12.351267+0000","last_fullsized":"2024-04-25T02:28:12.351267+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":40192,"num_write":416,"num_write_kb":101787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"43'364","reported_seq":441,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:03.943257+0000","last_change":"2024-04-25T02:29:03.943200+0000","last_active":"2024-04-25T02:29:03.943257+0000","last_peered":"2024-04-25T02:29:03.943257+0000","last_clean":"2024-04-25T02:29:03.943257+0000","last_became_active":"2024-04-25T02:23:11.834759+0000","last_became_peered":"2024-04-25T02:23:11.834759+0000","last_unstale":"2024-04-25T02:29:03.943257+0000","last_undegraded":"2024-04-25T02:29:03.943257+0000","last_fullsized":"2024-04-25T02:29:03.943257+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'364","last_scrub_stamp":"2024-04-25T02:29:03.943064+0000","last_deep_scrub":"43'364","last_deep_scrub_stamp":"2024-04-25T02:29:03.943064+0000","last_clean_scrub_stamp":"2024-04-25T02:29:03.943064+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:43:03.314177+0000","scrub_duration":0.0023381109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18431,"num_write":330,"num_write_kb":66835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"43'425","reported_seq":525,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:22.157783+0000","last_change":"2024-04-25T02:28:22.157736+0000","last_active":"2024-04-25T02:28:22.157783+0000","last_peered":"2024-04-25T02:28:22.157783+0000","last_clean":"2024-04-25T02:28:22.157783+0000","last_became_active":"2024-04-25T02:23:13.841883+0000","last_became_peered":"2024-04-25T02:23:13.841883+0000","last_unstale":"2024-04-25T02:28:22.157783+0000","last_undegraded":"2024-04-25T02:28:22.157783+0000","last_fullsized":"2024-04-25T02:28:22.157783+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'425","last_scrub_stamp":"2024-04-25T02:28:22.157614+0000","last_deep_scrub":"43'425","last_deep_scrub_stamp":"2024-04-25T02:28:22.157614+0000","last_clean_scrub_stamp":"2024-04-25T02:28:22.157614+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:28:28.713838+0000","scrub_duration":0.0023306529999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":29378,"num_write":387,"num_write_kb":39136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"43'396","reported_seq":480,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:45.945484+0000","last_change":"2024-04-25T02:28:45.945437+0000","last_active":"2024-04-25T02:28:45.945484+0000","last_peered":"2024-04-25T02:28:45.945484+0000","last_clean":"2024-04-25T02:28:45.945484+0000","last_became_active":"2024-04-25T02:23:11.835958+0000","last_became_peered":"2024-04-25T02:23:11.835958+0000","last_unstale":"2024-04-25T02:28:45.945484+0000","last_undegraded":"2024-04-25T02:28:45.945484+0000","last_fullsized":"2024-04-25T02:28:45.945484+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'396","last_scrub_stamp":"2024-04-25T02:28:45.945325+0000","last_deep_scrub":"43'396","last_deep_scrub_stamp":"2024-04-25T02:28:45.945325+0000","last_clean_scrub_stamp":"2024-04-25T02:28:45.945325+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:53:01.215968+0000","scrub_duration":0.002346295,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":25799,"num_write":352,"num_write_kb":67037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"43'354","reported_seq":404,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:00.899398+0000","last_change":"2024-04-25T02:29:00.899373+0000","last_active":"2024-04-25T02:29:00.899398+0000","last_peered":"2024-04-25T02:29:00.899398+0000","last_clean":"2024-04-25T02:29:00.899398+0000","last_became_active":"2024-04-25T02:23:11.836214+0000","last_became_peered":"2024-04-25T02:23:11.836214+0000","last_unstale":"2024-04-25T02:29:00.899398+0000","last_undegraded":"2024-04-25T02:29:00.899398+0000","last_fullsized":"2024-04-25T02:29:00.899398+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'354","last_scrub_stamp":"2024-04-25T02:29:00.899283+0000","last_deep_scrub":"43'354","last_deep_scrub_stamp":"2024-04-25T02:29:00.899283+0000","last_clean_scrub_stamp":"2024-04-25T02:29:00.899283+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:45.783246+0000","scrub_duration":0.0018755740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7176,"num_write":336,"num_write_kb":37702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"43'335","reported_seq":387,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:58.900017+0000","last_change":"2024-04-25T02:28:58.899981+0000","last_active":"2024-04-25T02:28:58.900017+0000","last_peered":"2024-04-25T02:28:58.900017+0000","last_clean":"2024-04-25T02:28:58.900017+0000","last_became_active":"2024-04-25T02:23:13.847446+0000","last_became_peered":"2024-04-25T02:23:13.847446+0000","last_unstale":"2024-04-25T02:28:58.900017+0000","last_undegraded":"2024-04-25T02:28:58.900017+0000","last_fullsized":"2024-04-25T02:28:58.900017+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'335","last_scrub_stamp":"2024-04-25T02:28:58.899850+0000","last_deep_scrub":"43'335","last_deep_scrub_stamp":"2024-04-25T02:28:58.899850+0000","last_clean_scrub_stamp":"2024-04-25T02:28:58.899850+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:53:40.661144+0000","scrub_duration":0.0020817689999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4160,"num_write":309,"num_write_kb":33908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"43'387","reported_seq":439,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:26.212350+0000","last_change":"2024-04-25T02:28:26.212320+0000","last_active":"2024-04-25T02:28:26.212350+0000","last_peered":"2024-04-25T02:28:26.212350+0000","last_clean":"2024-04-25T02:28:26.212350+0000","last_became_active":"2024-04-25T02:23:13.847009+0000","last_became_peered":"2024-04-25T02:23:13.847009+0000","last_unstale":"2024-04-25T02:28:26.212350+0000","last_undegraded":"2024-04-25T02:28:26.212350+0000","last_fullsized":"2024-04-25T02:28:26.212350+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'387","last_scrub_stamp":"2024-04-25T02:28:26.212204+0000","last_deep_scrub":"43'387","last_deep_scrub_stamp":"2024-04-25T02:28:26.212204+0000","last_clean_scrub_stamp":"2024-04-25T02:28:26.212204+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:25:07.412842+0000","scrub_duration":0.0024916069999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4152,"num_write":352,"num_write_kb":42524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"43'450","reported_seq":539,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:20.974106+0000","last_change":"2024-04-25T02:28:20.974062+0000","last_active":"2024-04-25T02:28:20.974106+0000","last_peered":"2024-04-25T02:28:20.974106+0000","last_clean":"2024-04-25T02:28:20.974106+0000","last_became_active":"2024-04-25T02:23:12.841783+0000","last_became_peered":"2024-04-25T02:23:12.841783+0000","last_unstale":"2024-04-25T02:28:20.974106+0000","last_undegraded":"2024-04-25T02:28:20.974106+0000","last_fullsized":"2024-04-25T02:28:20.974106+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'450","last_scrub_stamp":"2024-04-25T02:28:20.973929+0000","last_deep_scrub":"43'450","last_deep_scrub_stamp":"2024-04-25T02:28:20.973929+0000","last_clean_scrub_stamp":"2024-04-25T02:28:20.973929+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:56:11.043992+0000","scrub_duration":0.002462386,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":25198,"num_write":421,"num_write_kb":88864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"43'430","reported_seq":532,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:44.037754+0000","last_change":"2024-04-25T02:28:44.037712+0000","last_active":"2024-04-25T02:28:44.037754+0000","last_peered":"2024-04-25T02:28:44.037754+0000","last_clean":"2024-04-25T02:28:44.037754+0000","last_became_active":"2024-04-25T02:23:11.835815+0000","last_became_peered":"2024-04-25T02:23:11.835815+0000","last_unstale":"2024-04-25T02:28:44.037754+0000","last_undegraded":"2024-04-25T02:28:44.037754+0000","last_fullsized":"2024-04-25T02:28:44.037754+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'430","last_scrub_stamp":"2024-04-25T02:28:44.037608+0000","last_deep_scrub":"43'430","last_deep_scrub_stamp":"2024-04-25T02:28:44.037608+0000","last_clean_scrub_stamp":"2024-04-25T02:28:44.037608+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:53:08.207544+0000","scrub_duration":0.0021441519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31947,"num_write":393,"num_write_kb":64059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"43'438","reported_seq":473,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:20.052051+0000","last_change":"2024-04-25T02:29:20.052012+0000","last_active":"2024-04-25T02:29:20.052051+0000","last_peered":"2024-04-25T02:29:20.052051+0000","last_clean":"2024-04-25T02:29:20.052051+0000","last_became_active":"2024-04-25T02:23:55.963259+0000","last_became_peered":"2024-04-25T02:23:55.963259+0000","last_unstale":"2024-04-25T02:29:20.052051+0000","last_undegraded":"2024-04-25T02:29:20.052051+0000","last_fullsized":"2024-04-25T02:29:20.052051+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'438","last_scrub_stamp":"2024-04-25T02:29:20.051907+0000","last_deep_scrub":"43'438","last_deep_scrub_stamp":"2024-04-25T02:29:20.051907+0000","last_clean_scrub_stamp":"2024-04-25T02:29:20.051907+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:10:04.030325+0000","scrub_duration":0.00216768,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":2639,"num_write":405,"num_write_kb":51451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"43'394","reported_seq":457,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.356518+0000","last_change":"2024-04-25T02:23:13.844591+0000","last_active":"2024-04-25T02:28:12.356518+0000","last_peered":"2024-04-25T02:28:12.356518+0000","last_clean":"2024-04-25T02:28:12.356518+0000","last_became_active":"2024-04-25T02:23:13.844343+0000","last_became_peered":"2024-04-25T02:23:13.844343+0000","last_unstale":"2024-04-25T02:28:12.356518+0000","last_undegraded":"2024-04-25T02:28:12.356518+0000","last_fullsized":"2024-04-25T02:28:12.356518+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9696,"num_write":367,"num_write_kb":33966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"43'391","reported_seq":481,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:58.011960+0000","last_change":"2024-04-25T02:28:58.011911+0000","last_active":"2024-04-25T02:28:58.011960+0000","last_peered":"2024-04-25T02:28:58.011960+0000","last_clean":"2024-04-25T02:28:58.011960+0000","last_became_active":"2024-04-25T02:23:12.848051+0000","last_became_peered":"2024-04-25T02:23:12.848051+0000","last_unstale":"2024-04-25T02:28:58.011960+0000","last_undegraded":"2024-04-25T02:28:58.011960+0000","last_fullsized":"2024-04-25T02:28:58.011960+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'391","last_scrub_stamp":"2024-04-25T02:28:58.011806+0000","last_deep_scrub":"43'391","last_deep_scrub_stamp":"2024-04-25T02:28:58.011806+0000","last_clean_scrub_stamp":"2024-04-25T02:28:58.011806+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:06.338277+0000","scrub_duration":0.0021863519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":13345,"num_write":357,"num_write_kb":38441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"43'429","reported_seq":550,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:52.924323+0000","last_change":"2024-04-25T02:28:52.924295+0000","last_active":"2024-04-25T02:28:52.924323+0000","last_peered":"2024-04-25T02:28:52.924323+0000","last_clean":"2024-04-25T02:28:52.924323+0000","last_became_active":"2024-04-25T02:23:13.847602+0000","last_became_peered":"2024-04-25T02:23:13.847602+0000","last_unstale":"2024-04-25T02:28:52.924323+0000","last_undegraded":"2024-04-25T02:28:52.924323+0000","last_fullsized":"2024-04-25T02:28:52.924323+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'429","last_scrub_stamp":"2024-04-25T02:28:52.924165+0000","last_deep_scrub":"43'429","last_deep_scrub_stamp":"2024-04-25T02:28:52.924165+0000","last_clean_scrub_stamp":"2024-04-25T02:28:52.924165+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:54:54.792159+0000","scrub_duration":0.0025521599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":37845,"num_write":400,"num_write_kb":88566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"43'437","reported_seq":523,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:44.934901+0000","last_change":"2024-04-25T02:28:44.934874+0000","last_active":"2024-04-25T02:28:44.934901+0000","last_peered":"2024-04-25T02:28:44.934901+0000","last_clean":"2024-04-25T02:28:44.934901+0000","last_became_active":"2024-04-25T02:23:13.845934+0000","last_became_peered":"2024-04-25T02:23:13.845934+0000","last_unstale":"2024-04-25T02:28:44.934901+0000","last_undegraded":"2024-04-25T02:28:44.934901+0000","last_fullsized":"2024-04-25T02:28:44.934901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'437","last_scrub_stamp":"2024-04-25T02:28:44.934771+0000","last_deep_scrub":"43'437","last_deep_scrub_stamp":"2024-04-25T02:28:44.934771+0000","last_clean_scrub_stamp":"2024-04-25T02:28:44.934771+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:07.359904+0000","scrub_duration":0.002337244,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":22073,"num_write":412,"num_write_kb":67090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"43'414","reported_seq":517,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:04.980449+0000","last_change":"2024-04-25T02:29:04.980413+0000","last_active":"2024-04-25T02:29:04.980449+0000","last_peered":"2024-04-25T02:29:04.980449+0000","last_clean":"2024-04-25T02:29:04.980449+0000","last_became_active":"2024-04-25T02:23:13.846758+0000","last_became_peered":"2024-04-25T02:23:13.846758+0000","last_unstale":"2024-04-25T02:29:04.980449+0000","last_undegraded":"2024-04-25T02:29:04.980449+0000","last_fullsized":"2024-04-25T02:29:04.980449+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'414","last_scrub_stamp":"2024-04-25T02:29:04.980312+0000","last_deep_scrub":"43'414","last_deep_scrub_stamp":"2024-04-25T02:29:04.980312+0000","last_clean_scrub_stamp":"2024-04-25T02:29:04.980312+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:54:37.287485+0000","scrub_duration":0.0022436330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":24525,"num_write":378,"num_write_kb":100342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"43'445","reported_seq":529,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:54.117074+0000","last_change":"2024-04-25T02:28:54.117045+0000","last_active":"2024-04-25T02:28:54.117074+0000","last_peered":"2024-04-25T02:28:54.117074+0000","last_clean":"2024-04-25T02:28:54.117074+0000","last_became_active":"2024-04-25T02:23:11.835319+0000","last_became_peered":"2024-04-25T02:23:11.835319+0000","last_unstale":"2024-04-25T02:28:54.117074+0000","last_undegraded":"2024-04-25T02:28:54.117074+0000","last_fullsized":"2024-04-25T02:28:54.117074+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'445","last_scrub_stamp":"2024-04-25T02:28:54.116947+0000","last_deep_scrub":"43'445","last_deep_scrub_stamp":"2024-04-25T02:28:54.116947+0000","last_clean_scrub_stamp":"2024-04-25T02:28:54.116947+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:58:51.124066+0000","scrub_duration":0.0023452529999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":18532,"num_write":411,"num_write_kb":84101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"43'408","reported_seq":526,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:29.377058+0000","last_change":"2024-04-25T02:28:29.377031+0000","last_active":"2024-04-25T02:28:29.377058+0000","last_peered":"2024-04-25T02:28:29.377058+0000","last_clean":"2024-04-25T02:28:29.377058+0000","last_became_active":"2024-04-25T02:23:13.838917+0000","last_became_peered":"2024-04-25T02:23:13.838917+0000","last_unstale":"2024-04-25T02:28:29.377058+0000","last_undegraded":"2024-04-25T02:28:29.377058+0000","last_fullsized":"2024-04-25T02:28:29.377058+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'408","last_scrub_stamp":"2024-04-25T02:28:29.376935+0000","last_deep_scrub":"43'408","last_deep_scrub_stamp":"2024-04-25T02:28:29.376935+0000","last_clean_scrub_stamp":"2024-04-25T02:28:29.376935+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:25:26.084049+0000","scrub_duration":0.002236952,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":25750,"num_write":380,"num_write_kb":75795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"43'451","reported_seq":527,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:12.994175+0000","last_change":"2024-04-25T02:29:12.994140+0000","last_active":"2024-04-25T02:29:12.994175+0000","last_peered":"2024-04-25T02:29:12.994175+0000","last_clean":"2024-04-25T02:29:12.994175+0000","last_became_active":"2024-04-25T02:23:13.845814+0000","last_became_peered":"2024-04-25T02:23:13.845814+0000","last_unstale":"2024-04-25T02:29:12.994175+0000","last_undegraded":"2024-04-25T02:29:12.994175+0000","last_fullsized":"2024-04-25T02:29:12.994175+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'451","last_scrub_stamp":"2024-04-25T02:29:12.994028+0000","last_deep_scrub":"43'451","last_deep_scrub_stamp":"2024-04-25T02:29:12.994028+0000","last_clean_scrub_stamp":"2024-04-25T02:29:12.994028+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:57:15.232896+0000","scrub_duration":0.0023399319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13960,"num_write":428,"num_write_kb":96160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"43'397","reported_seq":460,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:38.013962+0000","last_change":"2024-04-25T02:28:38.013905+0000","last_active":"2024-04-25T02:28:38.013962+0000","last_peered":"2024-04-25T02:28:38.013962+0000","last_clean":"2024-04-25T02:28:38.013962+0000","last_became_active":"2024-04-25T02:23:13.852093+0000","last_became_peered":"2024-04-25T02:23:13.852093+0000","last_unstale":"2024-04-25T02:28:38.013962+0000","last_undegraded":"2024-04-25T02:28:38.013962+0000","last_fullsized":"2024-04-25T02:28:38.013962+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'397","last_scrub_stamp":"2024-04-25T02:28:38.013798+0000","last_deep_scrub":"43'397","last_deep_scrub_stamp":"2024-04-25T02:28:38.013798+0000","last_clean_scrub_stamp":"2024-04-25T02:28:38.013798+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:40:41.237724+0000","scrub_duration":0.0021175439999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":3870,"num_write":383,"num_write_kb":17738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"43'485","reported_seq":577,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:20.987687+0000","last_change":"2024-04-25T02:29:20.987666+0000","last_active":"2024-04-25T02:29:20.987687+0000","last_peered":"2024-04-25T02:29:20.987687+0000","last_clean":"2024-04-25T02:29:20.987687+0000","last_became_active":"2024-04-25T02:23:12.841477+0000","last_became_peered":"2024-04-25T02:23:12.841477+0000","last_unstale":"2024-04-25T02:29:20.987687+0000","last_undegraded":"2024-04-25T02:29:20.987687+0000","last_fullsized":"2024-04-25T02:29:20.987687+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'485","last_scrub_stamp":"2024-04-25T02:29:20.987575+0000","last_deep_scrub":"43'485","last_deep_scrub_stamp":"2024-04-25T02:29:20.987575+0000","last_clean_scrub_stamp":"2024-04-25T02:29:20.987575+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:34:13.118720+0000","scrub_duration":0.001798006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24645,"num_write":445,"num_write_kb":96750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"43'384","reported_seq":468,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:57.542986+0000","last_change":"2024-04-25T02:28:57.542945+0000","last_active":"2024-04-25T02:28:57.542986+0000","last_peered":"2024-04-25T02:28:57.542986+0000","last_clean":"2024-04-25T02:28:57.542986+0000","last_became_active":"2024-04-25T02:23:13.840422+0000","last_became_peered":"2024-04-25T02:23:13.840422+0000","last_unstale":"2024-04-25T02:28:57.542986+0000","last_undegraded":"2024-04-25T02:28:57.542986+0000","last_fullsized":"2024-04-25T02:28:57.542986+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'384","last_scrub_stamp":"2024-04-25T02:28:57.542849+0000","last_deep_scrub":"43'384","last_deep_scrub_stamp":"2024-04-25T02:28:57.542849+0000","last_clean_scrub_stamp":"2024-04-25T02:28:57.542849+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:56:54.046678+0000","scrub_duration":0.002320112,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":6130,"num_write":356,"num_write_kb":25986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"43'568","reported_seq":612,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:30.058301+0000","last_change":"2024-04-25T02:28:30.058267+0000","last_active":"2024-04-25T02:28:30.058301+0000","last_peered":"2024-04-25T02:28:30.058301+0000","last_clean":"2024-04-25T02:28:30.058301+0000","last_became_active":"2024-04-25T02:23:12.845923+0000","last_became_peered":"2024-04-25T02:23:12.845923+0000","last_unstale":"2024-04-25T02:28:30.058301+0000","last_undegraded":"2024-04-25T02:28:30.058301+0000","last_fullsized":"2024-04-25T02:28:30.058301+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'568","last_scrub_stamp":"2024-04-25T02:28:30.058171+0000","last_deep_scrub":"43'568","last_deep_scrub_stamp":"2024-04-25T02:28:30.058171+0000","last_clean_scrub_stamp":"2024-04-25T02:28:30.058171+0000","objects_scrubbed":3,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:07:27.211762+0000","scrub_duration":0.028959043,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":494,"num_write_kb":12610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"43'420","reported_seq":546,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:28.561650+0000","last_change":"2024-04-25T02:29:28.561602+0000","last_active":"2024-04-25T02:29:28.561650+0000","last_peered":"2024-04-25T02:29:28.561650+0000","last_clean":"2024-04-25T02:29:28.561650+0000","last_became_active":"2024-04-25T02:23:13.848844+0000","last_became_peered":"2024-04-25T02:23:13.848844+0000","last_unstale":"2024-04-25T02:29:28.561650+0000","last_undegraded":"2024-04-25T02:29:28.561650+0000","last_fullsized":"2024-04-25T02:29:28.561650+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'420","last_scrub_stamp":"2024-04-25T02:29:28.561478+0000","last_deep_scrub":"43'420","last_deep_scrub_stamp":"2024-04-25T02:29:28.561478+0000","last_clean_scrub_stamp":"2024-04-25T02:29:28.561478+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:18:30.047716+0000","scrub_duration":0.0024681999999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":41312,"num_write":376,"num_write_kb":112833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"43'384","reported_seq":430,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:50.931544+0000","last_change":"2024-04-25T02:28:50.931513+0000","last_active":"2024-04-25T02:28:50.931544+0000","last_peered":"2024-04-25T02:28:50.931544+0000","last_clean":"2024-04-25T02:28:50.931544+0000","last_became_active":"2024-04-25T02:23:13.846821+0000","last_became_peered":"2024-04-25T02:23:13.846821+0000","last_unstale":"2024-04-25T02:28:50.931544+0000","last_undegraded":"2024-04-25T02:28:50.931544+0000","last_fullsized":"2024-04-25T02:28:50.931544+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'384","last_scrub_stamp":"2024-04-25T02:28:50.931418+0000","last_deep_scrub":"43'384","last_deep_scrub_stamp":"2024-04-25T02:28:50.931418+0000","last_clean_scrub_stamp":"2024-04-25T02:28:50.931418+0000","objects_scrubbed":1,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:34:41.263744+0000","scrub_duration":0.013025725,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":334,"num_write_kb":4317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"43'428","reported_seq":532,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.942722+0000","last_change":"2024-04-25T02:29:19.942675+0000","last_active":"2024-04-25T02:29:19.942722+0000","last_peered":"2024-04-25T02:29:19.942722+0000","last_clean":"2024-04-25T02:29:19.942722+0000","last_became_active":"2024-04-25T02:23:11.840274+0000","last_became_peered":"2024-04-25T02:23:11.840274+0000","last_unstale":"2024-04-25T02:29:19.942722+0000","last_undegraded":"2024-04-25T02:29:19.942722+0000","last_fullsized":"2024-04-25T02:29:19.942722+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'428","last_scrub_stamp":"2024-04-25T02:29:19.942571+0000","last_deep_scrub":"43'428","last_deep_scrub_stamp":"2024-04-25T02:29:19.942571+0000","last_clean_scrub_stamp":"2024-04-25T02:29:19.942571+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:00:33.792441+0000","scrub_duration":0.0026123420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":28196,"num_write":410,"num_write_kb":104265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"43'875","reported_seq":922,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:10.488161+0000","last_change":"2024-04-25T02:23:13.839791+0000","last_active":"2024-04-25T02:28:10.488161+0000","last_peered":"2024-04-25T02:28:10.488161+0000","last_clean":"2024-04-25T02:28:10.488161+0000","last_became_active":"2024-04-25T02:23:13.839361+0000","last_became_peered":"2024-04-25T02:23:13.839361+0000","last_unstale":"2024-04-25T02:28:10.488161+0000","last_undegraded":"2024-04-25T02:28:10.488161+0000","last_fullsized":"2024-04-25T02:28:10.488161+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":875,"log_dups_size":0,"ondisk_log_size":875,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":809,"num_write_kb":8568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"43'365","reported_seq":454,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:29.545278+0000","last_change":"2024-04-25T02:29:29.545240+0000","last_active":"2024-04-25T02:29:29.545278+0000","last_peered":"2024-04-25T02:29:29.545278+0000","last_clean":"2024-04-25T02:29:29.545278+0000","last_became_active":"2024-04-25T02:23:13.843656+0000","last_became_peered":"2024-04-25T02:23:13.843656+0000","last_unstale":"2024-04-25T02:29:29.545278+0000","last_undegraded":"2024-04-25T02:29:29.545278+0000","last_fullsized":"2024-04-25T02:29:29.545278+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'365","last_scrub_stamp":"2024-04-25T02:29:29.545140+0000","last_deep_scrub":"43'365","last_deep_scrub_stamp":"2024-04-25T02:29:29.545140+0000","last_clean_scrub_stamp":"2024-04-25T02:29:29.545140+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:41:01.806067+0000","scrub_duration":0.001924748,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":25136,"num_write":341,"num_write_kb":38831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"43'58","reported_seq":108,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:11.928495+0000","last_change":"2024-04-25T02:29:11.928453+0000","last_active":"2024-04-25T02:29:11.928495+0000","last_peered":"2024-04-25T02:29:11.928495+0000","last_clean":"2024-04-25T02:29:11.928495+0000","last_became_active":"2024-04-25T02:23:13.842598+0000","last_became_peered":"2024-04-25T02:23:13.842598+0000","last_unstale":"2024-04-25T02:29:11.928495+0000","last_undegraded":"2024-04-25T02:29:11.928495+0000","last_fullsized":"2024-04-25T02:29:11.928495+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'58","last_scrub_stamp":"2024-04-25T02:29:11.928351+0000","last_deep_scrub":"43'58","last_deep_scrub_stamp":"2024-04-25T02:29:11.928351+0000","last_clean_scrub_stamp":"2024-04-25T02:29:11.928351+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:20:47.749490+0000","scrub_duration":0.0035073959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"43'467","reported_seq":543,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.367867+0000","last_change":"2024-04-25T02:23:13.849957+0000","last_active":"2024-04-25T02:28:12.367867+0000","last_peered":"2024-04-25T02:28:12.367867+0000","last_clean":"2024-04-25T02:28:12.367867+0000","last_became_active":"2024-04-25T02:23:13.848675+0000","last_became_peered":"2024-04-25T02:23:13.848675+0000","last_unstale":"2024-04-25T02:28:12.367867+0000","last_undegraded":"2024-04-25T02:28:12.367867+0000","last_fullsized":"2024-04-25T02:28:12.367867+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":13580,"num_write":443,"num_write_kb":92928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"43'342","reported_seq":387,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:50.982472+0000","last_change":"2024-04-25T02:28:50.982445+0000","last_active":"2024-04-25T02:28:50.982472+0000","last_peered":"2024-04-25T02:28:50.982472+0000","last_clean":"2024-04-25T02:28:50.982472+0000","last_became_active":"2024-04-25T02:23:13.846764+0000","last_became_peered":"2024-04-25T02:23:13.846764+0000","last_unstale":"2024-04-25T02:28:50.982472+0000","last_undegraded":"2024-04-25T02:28:50.982472+0000","last_fullsized":"2024-04-25T02:28:50.982472+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'342","last_scrub_stamp":"2024-04-25T02:28:50.982355+0000","last_deep_scrub":"43'342","last_deep_scrub_stamp":"2024-04-25T02:28:50.982355+0000","last_clean_scrub_stamp":"2024-04-25T02:28:50.982355+0000","objects_scrubbed":2,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:42:20.126126+0000","scrub_duration":0.013249924999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":281,"num_write_kb":4273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"43'477","reported_seq":577,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.351447+0000","last_change":"2024-04-25T02:23:13.844687+0000","last_active":"2024-04-25T02:28:12.351447+0000","last_peered":"2024-04-25T02:28:12.351447+0000","last_clean":"2024-04-25T02:28:12.351447+0000","last_became_active":"2024-04-25T02:23:13.839702+0000","last_became_peered":"2024-04-25T02:23:13.839702+0000","last_unstale":"2024-04-25T02:28:12.351447+0000","last_undegraded":"2024-04-25T02:28:12.351447+0000","last_fullsized":"2024-04-25T02:28:12.351447+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":30102,"num_write":452,"num_write_kb":97286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"43'139","reported_seq":192,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:46.068929+0000","last_change":"2024-04-25T02:28:46.068904+0000","last_active":"2024-04-25T02:28:46.068929+0000","last_peered":"2024-04-25T02:28:46.068929+0000","last_clean":"2024-04-25T02:28:46.068929+0000","last_became_active":"2024-04-25T02:23:13.843625+0000","last_became_peered":"2024-04-25T02:23:13.843625+0000","last_unstale":"2024-04-25T02:28:46.068929+0000","last_undegraded":"2024-04-25T02:28:46.068929+0000","last_fullsized":"2024-04-25T02:28:46.068929+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'139","last_scrub_stamp":"2024-04-25T02:28:46.068815+0000","last_deep_scrub":"43'139","last_deep_scrub_stamp":"2024-04-25T02:28:46.068815+0000","last_clean_scrub_stamp":"2024-04-25T02:28:46.068815+0000","objects_scrubbed":3,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:26.672574+0000","scrub_duration":0.0037700569999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":72,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"43'422","reported_seq":506,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:10.977270+0000","last_change":"2024-04-25T02:29:10.977195+0000","last_active":"2024-04-25T02:29:10.977270+0000","last_peered":"2024-04-25T02:29:10.977270+0000","last_clean":"2024-04-25T02:29:10.977270+0000","last_became_active":"2024-04-25T02:23:13.850845+0000","last_became_peered":"2024-04-25T02:23:13.850845+0000","last_unstale":"2024-04-25T02:29:10.977270+0000","last_undegraded":"2024-04-25T02:29:10.977270+0000","last_fullsized":"2024-04-25T02:29:10.977270+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'422","last_scrub_stamp":"2024-04-25T02:29:10.977055+0000","last_deep_scrub":"43'422","last_deep_scrub_stamp":"2024-04-25T02:29:10.977055+0000","last_clean_scrub_stamp":"2024-04-25T02:29:10.977055+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:29:00.511972+0000","scrub_duration":0.002540123,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":24672,"num_write":391,"num_write_kb":75497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"43'352","reported_seq":407,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:59.567581+0000","last_change":"2024-04-25T02:28:59.567554+0000","last_active":"2024-04-25T02:28:59.567581+0000","last_peered":"2024-04-25T02:28:59.567581+0000","last_clean":"2024-04-25T02:28:59.567581+0000","last_became_active":"2024-04-25T02:23:13.845176+0000","last_became_peered":"2024-04-25T02:23:13.845176+0000","last_unstale":"2024-04-25T02:28:59.567581+0000","last_undegraded":"2024-04-25T02:28:59.567581+0000","last_fullsized":"2024-04-25T02:28:59.567581+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'352","last_scrub_stamp":"2024-04-25T02:28:59.567461+0000","last_deep_scrub":"43'352","last_deep_scrub_stamp":"2024-04-25T02:28:59.567461+0000","last_clean_scrub_stamp":"2024-04-25T02:28:59.567461+0000","objects_scrubbed":7,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:49.240975+0000","scrub_duration":0.026732694000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10356006,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":7,"num_read_kb":10,"num_write":291,"num_write_kb":10309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"43'405","reported_seq":483,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:30.146025+0000","last_change":"2024-04-25T02:28:30.145967+0000","last_active":"2024-04-25T02:28:30.146025+0000","last_peered":"2024-04-25T02:28:30.146025+0000","last_clean":"2024-04-25T02:28:30.146025+0000","last_became_active":"2024-04-25T02:23:55.963655+0000","last_became_peered":"2024-04-25T02:23:55.963655+0000","last_unstale":"2024-04-25T02:28:30.146025+0000","last_undegraded":"2024-04-25T02:28:30.146025+0000","last_fullsized":"2024-04-25T02:28:30.146025+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'405","last_scrub_stamp":"2024-04-25T02:28:30.145854+0000","last_deep_scrub":"43'405","last_deep_scrub_stamp":"2024-04-25T02:28:30.145854+0000","last_clean_scrub_stamp":"2024-04-25T02:28:30.145854+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:49.219885+0000","scrub_duration":0.0021986240000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":11609,"num_write":365,"num_write_kb":76437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"43'498","reported_seq":557,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:53.568295+0000","last_change":"2024-04-25T02:28:53.568258+0000","last_active":"2024-04-25T02:28:53.568295+0000","last_peered":"2024-04-25T02:28:53.568295+0000","last_clean":"2024-04-25T02:28:53.568295+0000","last_became_active":"2024-04-25T02:23:13.839158+0000","last_became_peered":"2024-04-25T02:23:13.839158+0000","last_unstale":"2024-04-25T02:28:53.568295+0000","last_undegraded":"2024-04-25T02:28:53.568295+0000","last_fullsized":"2024-04-25T02:28:53.568295+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'498","last_scrub_stamp":"2024-04-25T02:28:53.568128+0000","last_deep_scrub":"43'498","last_deep_scrub_stamp":"2024-04-25T02:28:53.568128+0000","last_clean_scrub_stamp":"2024-04-25T02:28:53.568128+0000","objects_scrubbed":5,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:05.588274+0000","scrub_duration":0.023077066,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":7,"num_write":435,"num_write_kb":8384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"43'409","reported_seq":499,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:17.565528+0000","last_change":"2024-04-25T02:29:17.565499+0000","last_active":"2024-04-25T02:29:17.565528+0000","last_peered":"2024-04-25T02:29:17.565528+0000","last_clean":"2024-04-25T02:29:17.565528+0000","last_became_active":"2024-04-25T02:23:13.843441+0000","last_became_peered":"2024-04-25T02:23:13.843441+0000","last_unstale":"2024-04-25T02:29:17.565528+0000","last_undegraded":"2024-04-25T02:29:17.565528+0000","last_fullsized":"2024-04-25T02:29:17.565528+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'409","last_scrub_stamp":"2024-04-25T02:29:17.565355+0000","last_deep_scrub":"43'409","last_deep_scrub_stamp":"2024-04-25T02:29:17.565355+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.565355+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:21:28.285231+0000","scrub_duration":0.002262787,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":25550,"num_write":379,"num_write_kb":104949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"43'52","reported_seq":101,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:57.048479+0000","last_change":"2024-04-25T02:28:57.048450+0000","last_active":"2024-04-25T02:28:57.048479+0000","last_peered":"2024-04-25T02:28:57.048479+0000","last_clean":"2024-04-25T02:28:57.048479+0000","last_became_active":"2024-04-25T02:23:13.841976+0000","last_became_peered":"2024-04-25T02:23:13.841976+0000","last_unstale":"2024-04-25T02:28:57.048479+0000","last_undegraded":"2024-04-25T02:28:57.048479+0000","last_fullsized":"2024-04-25T02:28:57.048479+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'52","last_scrub_stamp":"2024-04-25T02:28:57.048342+0000","last_deep_scrub":"43'52","last_deep_scrub_stamp":"2024-04-25T02:28:57.048342+0000","last_clean_scrub_stamp":"2024-04-25T02:28:57.048342+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:56.353296+0000","scrub_duration":0.0026068649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"43'407","reported_seq":493,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.354407+0000","last_change":"2024-04-25T02:23:13.843455+0000","last_active":"2024-04-25T02:28:12.354407+0000","last_peered":"2024-04-25T02:28:12.354407+0000","last_clean":"2024-04-25T02:28:12.354407+0000","last_became_active":"2024-04-25T02:23:13.842163+0000","last_became_peered":"2024-04-25T02:23:13.842163+0000","last_unstale":"2024-04-25T02:28:12.354407+0000","last_undegraded":"2024-04-25T02:28:12.354407+0000","last_fullsized":"2024-04-25T02:28:12.354407+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":18209,"num_write":378,"num_write_kb":67140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"43'57","reported_seq":107,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:06.608522+0000","last_change":"2024-04-25T02:29:06.608493+0000","last_active":"2024-04-25T02:29:06.608522+0000","last_peered":"2024-04-25T02:29:06.608522+0000","last_clean":"2024-04-25T02:29:06.608522+0000","last_became_active":"2024-04-25T02:23:13.838616+0000","last_became_peered":"2024-04-25T02:23:13.838616+0000","last_unstale":"2024-04-25T02:29:06.608522+0000","last_undegraded":"2024-04-25T02:29:06.608522+0000","last_fullsized":"2024-04-25T02:29:06.608522+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'57","last_scrub_stamp":"2024-04-25T02:29:06.608385+0000","last_deep_scrub":"43'57","last_deep_scrub_stamp":"2024-04-25T02:29:06.608385+0000","last_clean_scrub_stamp":"2024-04-25T02:29:06.608385+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:29:37.490299+0000","scrub_duration":0.0015486569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"43'445","reported_seq":565,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.358482+0000","last_change":"2024-04-25T02:23:13.842908+0000","last_active":"2024-04-25T02:28:12.358482+0000","last_peered":"2024-04-25T02:28:12.358482+0000","last_clean":"2024-04-25T02:28:12.358482+0000","last_became_active":"2024-04-25T02:23:13.842649+0000","last_became_peered":"2024-04-25T02:23:13.842649+0000","last_unstale":"2024-04-25T02:28:12.358482+0000","last_undegraded":"2024-04-25T02:28:12.358482+0000","last_fullsized":"2024-04-25T02:28:12.358482+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":37870,"num_write":411,"num_write_kb":80233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"43'68","reported_seq":116,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:51.908386+0000","last_change":"2024-04-25T02:28:51.908344+0000","last_active":"2024-04-25T02:28:51.908386+0000","last_peered":"2024-04-25T02:28:51.908386+0000","last_clean":"2024-04-25T02:28:51.908386+0000","last_became_active":"2024-04-25T02:23:11.835077+0000","last_became_peered":"2024-04-25T02:23:11.835077+0000","last_unstale":"2024-04-25T02:28:51.908386+0000","last_undegraded":"2024-04-25T02:28:51.908386+0000","last_fullsized":"2024-04-25T02:28:51.908386+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'68","last_scrub_stamp":"2024-04-25T02:28:51.908233+0000","last_deep_scrub":"43'68","last_deep_scrub_stamp":"2024-04-25T02:28:51.908233+0000","last_clean_scrub_stamp":"2024-04-25T02:28:51.908233+0000","objects_scrubbed":5,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:49.010130+0000","scrub_duration":0.0047405470000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"43'390","reported_seq":531,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:49.471264+0000","last_change":"2024-04-25T02:28:49.471228+0000","last_active":"2024-04-25T02:28:49.471264+0000","last_peered":"2024-04-25T02:28:49.471264+0000","last_clean":"2024-04-25T02:28:49.471264+0000","last_became_active":"2024-04-25T02:23:13.843347+0000","last_became_peered":"2024-04-25T02:23:13.843347+0000","last_unstale":"2024-04-25T02:28:49.471264+0000","last_undegraded":"2024-04-25T02:28:49.471264+0000","last_fullsized":"2024-04-25T02:28:49.471264+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'390","last_scrub_stamp":"2024-04-25T02:28:49.471125+0000","last_deep_scrub":"43'390","last_deep_scrub_stamp":"2024-04-25T02:28:49.471125+0000","last_clean_scrub_stamp":"2024-04-25T02:28:49.471125+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:04:13.159114+0000","scrub_duration":0.0021407000000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":42863,"num_write":360,"num_write_kb":59443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"43'201","reported_seq":249,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:00.019630+0000","last_change":"2024-04-25T02:29:00.019602+0000","last_active":"2024-04-25T02:29:00.019630+0000","last_peered":"2024-04-25T02:29:00.019630+0000","last_clean":"2024-04-25T02:29:00.019630+0000","last_became_active":"2024-04-25T02:23:11.839157+0000","last_became_peered":"2024-04-25T02:23:11.839157+0000","last_unstale":"2024-04-25T02:29:00.019630+0000","last_undegraded":"2024-04-25T02:29:00.019630+0000","last_fullsized":"2024-04-25T02:29:00.019630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'201","last_scrub_stamp":"2024-04-25T02:29:00.019504+0000","last_deep_scrub":"43'201","last_deep_scrub_stamp":"2024-04-25T02:29:00.019504+0000","last_clean_scrub_stamp":"2024-04-25T02:29:00.019504+0000","objects_scrubbed":2,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:17.465468+0000","scrub_duration":0.01223805,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":142,"num_write_kb":4183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"43'404","reported_seq":471,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.368273+0000","last_change":"2024-04-25T02:23:13.841226+0000","last_active":"2024-04-25T02:28:12.368273+0000","last_peered":"2024-04-25T02:28:12.368273+0000","last_clean":"2024-04-25T02:28:12.368273+0000","last_became_active":"2024-04-25T02:23:13.840951+0000","last_became_peered":"2024-04-25T02:23:13.840951+0000","last_unstale":"2024-04-25T02:28:12.368273+0000","last_undegraded":"2024-04-25T02:28:12.368273+0000","last_fullsized":"2024-04-25T02:28:12.368273+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12931,"num_write":370,"num_write_kb":42530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"43'368","reported_seq":423,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:15.999378+0000","last_change":"2024-04-25T02:29:15.999350+0000","last_active":"2024-04-25T02:29:15.999378+0000","last_peered":"2024-04-25T02:29:15.999378+0000","last_clean":"2024-04-25T02:29:15.999378+0000","last_became_active":"2024-04-25T02:23:12.847813+0000","last_became_peered":"2024-04-25T02:23:12.847813+0000","last_unstale":"2024-04-25T02:29:15.999378+0000","last_undegraded":"2024-04-25T02:29:15.999378+0000","last_fullsized":"2024-04-25T02:29:15.999378+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'368","last_scrub_stamp":"2024-04-25T02:29:15.999218+0000","last_deep_scrub":"43'368","last_deep_scrub_stamp":"2024-04-25T02:29:15.999218+0000","last_clean_scrub_stamp":"2024-04-25T02:29:15.999218+0000","objects_scrubbed":2,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:42:23.358864+0000","scrub_duration":0.013353834,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":311,"num_write_kb":4273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"43'442","reported_seq":502,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:24.178739+0000","last_change":"2024-04-25T02:29:24.178707+0000","last_active":"2024-04-25T02:29:24.178739+0000","last_peered":"2024-04-25T02:29:24.178739+0000","last_clean":"2024-04-25T02:29:24.178739+0000","last_became_active":"2024-04-25T02:23:55.963234+0000","last_became_peered":"2024-04-25T02:23:55.963234+0000","last_unstale":"2024-04-25T02:29:24.178739+0000","last_undegraded":"2024-04-25T02:29:24.178739+0000","last_fullsized":"2024-04-25T02:29:24.178739+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'442","last_scrub_stamp":"2024-04-25T02:29:24.178598+0000","last_deep_scrub":"43'442","last_deep_scrub_stamp":"2024-04-25T02:29:24.178598+0000","last_clean_scrub_stamp":"2024-04-25T02:29:24.178598+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:37:43.717819+0000","scrub_duration":0.0021811489999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21039,"num_write":415,"num_write_kb":62968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"43'596","reported_seq":650,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:12.598908+0000","last_change":"2024-04-25T02:29:12.598859+0000","last_active":"2024-04-25T02:29:12.598908+0000","last_peered":"2024-04-25T02:29:12.598908+0000","last_clean":"2024-04-25T02:29:12.598908+0000","last_became_active":"2024-04-25T02:23:13.843704+0000","last_became_peered":"2024-04-25T02:23:13.843704+0000","last_unstale":"2024-04-25T02:29:12.598908+0000","last_undegraded":"2024-04-25T02:29:12.598908+0000","last_fullsized":"2024-04-25T02:29:12.598908+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'596","last_scrub_stamp":"2024-04-25T02:29:12.598768+0000","last_deep_scrub":"43'596","last_deep_scrub_stamp":"2024-04-25T02:29:12.598768+0000","last_clean_scrub_stamp":"2024-04-25T02:29:12.598768+0000","objects_scrubbed":2,"log_size":596,"log_dups_size":0,"ondisk_log_size":596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:48:20.391354+0000","scrub_duration":0.014912345,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":532,"num_write_kb":4350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"43'411","reported_seq":507,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:17.022137+0000","last_change":"2024-04-25T02:29:17.022100+0000","last_active":"2024-04-25T02:29:17.022137+0000","last_peered":"2024-04-25T02:29:17.022137+0000","last_clean":"2024-04-25T02:29:17.022137+0000","last_became_active":"2024-04-25T02:23:13.845782+0000","last_became_peered":"2024-04-25T02:23:13.845782+0000","last_unstale":"2024-04-25T02:29:17.022137+0000","last_undegraded":"2024-04-25T02:29:17.022137+0000","last_fullsized":"2024-04-25T02:29:17.022137+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'411","last_scrub_stamp":"2024-04-25T02:29:17.021916+0000","last_deep_scrub":"43'411","last_deep_scrub_stamp":"2024-04-25T02:29:17.021916+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.021916+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:53:37.771149+0000","scrub_duration":0.0025137620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":24562,"num_write":375,"num_write_kb":59351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"43'59","reported_seq":108,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:50.131386+0000","last_change":"2024-04-25T02:28:50.131363+0000","last_active":"2024-04-25T02:28:50.131386+0000","last_peered":"2024-04-25T02:28:50.131386+0000","last_clean":"2024-04-25T02:28:50.131386+0000","last_became_active":"2024-04-25T02:23:13.841815+0000","last_became_peered":"2024-04-25T02:23:13.841815+0000","last_unstale":"2024-04-25T02:28:50.131386+0000","last_undegraded":"2024-04-25T02:28:50.131386+0000","last_fullsized":"2024-04-25T02:28:50.131386+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'59","last_scrub_stamp":"2024-04-25T02:28:50.131276+0000","last_deep_scrub":"43'59","last_deep_scrub_stamp":"2024-04-25T02:28:50.131276+0000","last_clean_scrub_stamp":"2024-04-25T02:28:50.131276+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:39:19.674948+0000","scrub_duration":0.0013339000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"43'457","reported_seq":584,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:39.003748+0000","last_change":"2024-04-25T02:28:39.003715+0000","last_active":"2024-04-25T02:28:39.003748+0000","last_peered":"2024-04-25T02:28:39.003748+0000","last_clean":"2024-04-25T02:28:39.003748+0000","last_became_active":"2024-04-25T02:23:11.837258+0000","last_became_peered":"2024-04-25T02:23:11.837258+0000","last_unstale":"2024-04-25T02:28:39.003748+0000","last_undegraded":"2024-04-25T02:28:39.003748+0000","last_fullsized":"2024-04-25T02:28:39.003748+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'457","last_scrub_stamp":"2024-04-25T02:28:39.003606+0000","last_deep_scrub":"43'457","last_deep_scrub_stamp":"2024-04-25T02:28:39.003606+0000","last_clean_scrub_stamp":"2024-04-25T02:28:39.003606+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:51.514685+0000","scrub_duration":0.0023379960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":40530,"num_write":421,"num_write_kb":133096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"43'132","reported_seq":190,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:38.375455+0000","last_change":"2024-04-25T02:28:38.375418+0000","last_active":"2024-04-25T02:28:38.375455+0000","last_peered":"2024-04-25T02:28:38.375455+0000","last_clean":"2024-04-25T02:28:38.375455+0000","last_became_active":"2024-04-25T02:23:13.838665+0000","last_became_peered":"2024-04-25T02:23:13.838665+0000","last_unstale":"2024-04-25T02:28:38.375455+0000","last_undegraded":"2024-04-25T02:28:38.375455+0000","last_fullsized":"2024-04-25T02:28:38.375455+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'132","last_scrub_stamp":"2024-04-25T02:28:38.375296+0000","last_deep_scrub":"43'132","last_deep_scrub_stamp":"2024-04-25T02:28:38.375296+0000","last_clean_scrub_stamp":"2024-04-25T02:28:38.375296+0000","objects_scrubbed":4,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:47:08.874698+0000","scrub_duration":0.018905228,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":66,"num_write_kb":8229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"43'438","reported_seq":526,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.101612+0000","last_change":"2024-04-25T02:28:28.101582+0000","last_active":"2024-04-25T02:28:28.101612+0000","last_peered":"2024-04-25T02:28:28.101612+0000","last_clean":"2024-04-25T02:28:28.101612+0000","last_became_active":"2024-04-25T02:23:55.963557+0000","last_became_peered":"2024-04-25T02:23:55.963557+0000","last_unstale":"2024-04-25T02:28:28.101612+0000","last_undegraded":"2024-04-25T02:28:28.101612+0000","last_fullsized":"2024-04-25T02:28:28.101612+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'438","last_scrub_stamp":"2024-04-25T02:28:28.101477+0000","last_deep_scrub":"43'438","last_deep_scrub_stamp":"2024-04-25T02:28:28.101477+0000","last_clean_scrub_stamp":"2024-04-25T02:28:28.101477+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:13:04.055307+0000","scrub_duration":0.0022093569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":25759,"num_write":403,"num_write_kb":59138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"43'256","reported_seq":309,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:54.577347+0000","last_change":"2024-04-25T02:28:54.577309+0000","last_active":"2024-04-25T02:28:54.577347+0000","last_peered":"2024-04-25T02:28:54.577347+0000","last_clean":"2024-04-25T02:28:54.577347+0000","last_became_active":"2024-04-25T02:23:13.843652+0000","last_became_peered":"2024-04-25T02:23:13.843652+0000","last_unstale":"2024-04-25T02:28:54.577347+0000","last_undegraded":"2024-04-25T02:28:54.577347+0000","last_fullsized":"2024-04-25T02:28:54.577347+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'256","last_scrub_stamp":"2024-04-25T02:28:54.577189+0000","last_deep_scrub":"43'256","last_deep_scrub_stamp":"2024-04-25T02:28:54.577189+0000","last_clean_scrub_stamp":"2024-04-25T02:28:54.577189+0000","objects_scrubbed":2,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:57:05.312089+0000","scrub_duration":0.01333373,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":4213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"43'389","reported_seq":433,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.044248+0000","last_change":"2024-04-25T02:29:18.044209+0000","last_active":"2024-04-25T02:29:18.044248+0000","last_peered":"2024-04-25T02:29:18.044248+0000","last_clean":"2024-04-25T02:29:18.044248+0000","last_became_active":"2024-04-25T02:23:56.301997+0000","last_became_peered":"2024-04-25T02:23:56.301997+0000","last_unstale":"2024-04-25T02:29:18.044248+0000","last_undegraded":"2024-04-25T02:29:18.044248+0000","last_fullsized":"2024-04-25T02:29:18.044248+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'389","last_scrub_stamp":"2024-04-25T02:29:18.044094+0000","last_deep_scrub":"43'389","last_deep_scrub_stamp":"2024-04-25T02:29:18.044094+0000","last_clean_scrub_stamp":"2024-04-25T02:29:18.044094+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:48.289864+0000","scrub_duration":0.0023398820000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13585,"num_write":362,"num_write_kb":34032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"43'63","reported_seq":103,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:08.518277+0000","last_change":"2024-04-25T02:23:13.842533+0000","last_active":"2024-04-25T02:28:08.518277+0000","last_peered":"2024-04-25T02:28:08.518277+0000","last_clean":"2024-04-25T02:28:08.518277+0000","last_became_active":"2024-04-25T02:23:13.841049+0000","last_became_peered":"2024-04-25T02:23:13.841049+0000","last_unstale":"2024-04-25T02:28:08.518277+0000","last_undegraded":"2024-04-25T02:28:08.518277+0000","last_fullsized":"2024-04-25T02:28:08.518277+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"43'360","reported_seq":433,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:29.186993+0000","last_change":"2024-04-25T02:28:29.186947+0000","last_active":"2024-04-25T02:28:29.186993+0000","last_peered":"2024-04-25T02:28:29.186993+0000","last_clean":"2024-04-25T02:28:29.186993+0000","last_became_active":"2024-04-25T02:23:13.846425+0000","last_became_peered":"2024-04-25T02:23:13.846425+0000","last_unstale":"2024-04-25T02:28:29.186993+0000","last_undegraded":"2024-04-25T02:28:29.186993+0000","last_fullsized":"2024-04-25T02:28:29.186993+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'360","last_scrub_stamp":"2024-04-25T02:28:29.186834+0000","last_deep_scrub":"43'360","last_deep_scrub_stamp":"2024-04-25T02:28:29.186834+0000","last_clean_scrub_stamp":"2024-04-25T02:28:29.186834+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:38:30.162583+0000","scrub_duration":0.002422633,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":12898,"num_write":328,"num_write_kb":42412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"43'567","reported_seq":620,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:43.405130+0000","last_change":"2024-04-25T02:28:43.405100+0000","last_active":"2024-04-25T02:28:43.405130+0000","last_peered":"2024-04-25T02:28:43.405130+0000","last_clean":"2024-04-25T02:28:43.405130+0000","last_became_active":"2024-04-25T02:23:13.840876+0000","last_became_peered":"2024-04-25T02:23:13.840876+0000","last_unstale":"2024-04-25T02:28:43.405130+0000","last_undegraded":"2024-04-25T02:28:43.405130+0000","last_fullsized":"2024-04-25T02:28:43.405130+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'567","last_scrub_stamp":"2024-04-25T02:28:43.405002+0000","last_deep_scrub":"43'567","last_deep_scrub_stamp":"2024-04-25T02:28:43.405002+0000","last_clean_scrub_stamp":"2024-04-25T02:28:43.405002+0000","objects_scrubbed":2,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:17:38.360428+0000","scrub_duration":0.013702443,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":506,"num_write_kb":4331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"43'387","reported_seq":475,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:24.007241+0000","last_change":"2024-04-25T02:29:24.007198+0000","last_active":"2024-04-25T02:29:24.007241+0000","last_peered":"2024-04-25T02:29:24.007241+0000","last_clean":"2024-04-25T02:29:24.007241+0000","last_became_active":"2024-04-25T02:23:13.852398+0000","last_became_peered":"2024-04-25T02:23:13.852398+0000","last_unstale":"2024-04-25T02:29:24.007241+0000","last_undegraded":"2024-04-25T02:29:24.007241+0000","last_fullsized":"2024-04-25T02:29:24.007241+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'387","last_scrub_stamp":"2024-04-25T02:29:24.007081+0000","last_deep_scrub":"43'387","last_deep_scrub_stamp":"2024-04-25T02:29:24.007081+0000","last_clean_scrub_stamp":"2024-04-25T02:29:24.007081+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:07:38.625480+0000","scrub_duration":0.0022561479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":28255,"num_write":354,"num_write_kb":58406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:58.871823+0000","last_change":"2024-04-25T02:28:58.871778+0000","last_active":"2024-04-25T02:28:58.871823+0000","last_peered":"2024-04-25T02:28:58.871823+0000","last_clean":"2024-04-25T02:28:58.871823+0000","last_became_active":"2024-04-25T02:23:11.834171+0000","last_became_peered":"2024-04-25T02:23:11.834171+0000","last_unstale":"2024-04-25T02:28:58.871823+0000","last_undegraded":"2024-04-25T02:28:58.871823+0000","last_fullsized":"2024-04-25T02:28:58.871823+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:58.871661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:58.871661+0000","last_clean_scrub_stamp":"2024-04-25T02:28:58.871661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:46.274931+0000","scrub_duration":0.0016855539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"43'432","reported_seq":478,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:32.100599+0000","last_change":"2024-04-25T02:28:32.100572+0000","last_active":"2024-04-25T02:28:32.100599+0000","last_peered":"2024-04-25T02:28:32.100599+0000","last_clean":"2024-04-25T02:28:32.100599+0000","last_became_active":"2024-04-25T02:23:13.847970+0000","last_became_peered":"2024-04-25T02:23:13.847970+0000","last_unstale":"2024-04-25T02:28:32.100599+0000","last_undegraded":"2024-04-25T02:28:32.100599+0000","last_fullsized":"2024-04-25T02:28:32.100599+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'432","last_scrub_stamp":"2024-04-25T02:28:32.100463+0000","last_deep_scrub":"43'432","last_deep_scrub_stamp":"2024-04-25T02:28:32.100463+0000","last_clean_scrub_stamp":"2024-04-25T02:28:32.100463+0000","objects_scrubbed":2,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:01:10.912094+0000","scrub_duration":0.014522729,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":371,"num_write_kb":4349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"43'357","reported_seq":420,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:22.964197+0000","last_change":"2024-04-25T02:28:22.964168+0000","last_active":"2024-04-25T02:28:22.964197+0000","last_peered":"2024-04-25T02:28:22.964197+0000","last_clean":"2024-04-25T02:28:22.964197+0000","last_became_active":"2024-04-25T02:23:13.849556+0000","last_became_peered":"2024-04-25T02:23:13.849556+0000","last_unstale":"2024-04-25T02:28:22.964197+0000","last_undegraded":"2024-04-25T02:28:22.964197+0000","last_fullsized":"2024-04-25T02:28:22.964197+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'357","last_scrub_stamp":"2024-04-25T02:28:22.964054+0000","last_deep_scrub":"43'357","last_deep_scrub_stamp":"2024-04-25T02:28:22.964054+0000","last_clean_scrub_stamp":"2024-04-25T02:28:22.964054+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:33:24.355131+0000","scrub_duration":0.002218271,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8777,"num_write":323,"num_write_kb":25948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":56,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:20.584868+0000","last_change":"2024-04-25T02:29:20.584847+0000","last_active":"2024-04-25T02:29:20.584868+0000","last_peered":"2024-04-25T02:29:20.584868+0000","last_clean":"2024-04-25T02:29:20.584868+0000","last_became_active":"2024-04-25T02:23:13.847888+0000","last_became_peered":"2024-04-25T02:23:13.847888+0000","last_unstale":"2024-04-25T02:29:20.584868+0000","last_undegraded":"2024-04-25T02:29:20.584868+0000","last_fullsized":"2024-04-25T02:29:20.584868+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:20.584764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:20.584764+0000","last_clean_scrub_stamp":"2024-04-25T02:29:20.584764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:08:06.936034+0000","scrub_duration":0.001196421,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"43'72","reported_seq":124,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:37.052787+0000","last_change":"2024-04-25T02:28:37.052732+0000","last_active":"2024-04-25T02:28:37.052787+0000","last_peered":"2024-04-25T02:28:37.052787+0000","last_clean":"2024-04-25T02:28:37.052787+0000","last_became_active":"2024-04-25T02:23:12.848312+0000","last_became_peered":"2024-04-25T02:23:12.848312+0000","last_unstale":"2024-04-25T02:28:37.052787+0000","last_undegraded":"2024-04-25T02:28:37.052787+0000","last_fullsized":"2024-04-25T02:28:37.052787+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'72","last_scrub_stamp":"2024-04-25T02:28:37.052632+0000","last_deep_scrub":"43'72","last_deep_scrub_stamp":"2024-04-25T02:28:37.052632+0000","last_clean_scrub_stamp":"2024-04-25T02:28:37.052632+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:06:14.430755+0000","scrub_duration":0.0037485779999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"43'385","reported_seq":477,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:47.914656+0000","last_change":"2024-04-25T02:28:47.914600+0000","last_active":"2024-04-25T02:28:47.914656+0000","last_peered":"2024-04-25T02:28:47.914656+0000","last_clean":"2024-04-25T02:28:47.914656+0000","last_became_active":"2024-04-25T02:23:12.841408+0000","last_became_peered":"2024-04-25T02:23:12.841408+0000","last_unstale":"2024-04-25T02:28:47.914656+0000","last_undegraded":"2024-04-25T02:28:47.914656+0000","last_fullsized":"2024-04-25T02:28:47.914656+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'385","last_scrub_stamp":"2024-04-25T02:28:47.914480+0000","last_deep_scrub":"43'385","last_deep_scrub_stamp":"2024-04-25T02:28:47.914480+0000","last_clean_scrub_stamp":"2024-04-25T02:28:47.914480+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:56.748268+0000","scrub_duration":0.0025485909999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":27937,"num_write":348,"num_write_kb":51359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":44,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:07.821153+0000","last_change":"2024-04-25T02:29:07.821126+0000","last_active":"2024-04-25T02:29:07.821153+0000","last_peered":"2024-04-25T02:29:07.821153+0000","last_clean":"2024-04-25T02:29:07.821153+0000","last_became_active":"2024-04-25T02:23:13.848076+0000","last_became_peered":"2024-04-25T02:23:13.848076+0000","last_unstale":"2024-04-25T02:29:07.821153+0000","last_undegraded":"2024-04-25T02:29:07.821153+0000","last_fullsized":"2024-04-25T02:29:07.821153+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:07.821012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:07.821012+0000","last_clean_scrub_stamp":"2024-04-25T02:29:07.821012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:19.428497+0000","scrub_duration":0.001478198,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"43'396","reported_seq":441,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:28.988989+0000","last_change":"2024-04-25T02:29:28.988963+0000","last_active":"2024-04-25T02:29:28.988989+0000","last_peered":"2024-04-25T02:29:28.988989+0000","last_clean":"2024-04-25T02:29:28.988989+0000","last_became_active":"2024-04-25T02:23:12.848229+0000","last_became_peered":"2024-04-25T02:23:12.848229+0000","last_unstale":"2024-04-25T02:29:28.988989+0000","last_undegraded":"2024-04-25T02:29:28.988989+0000","last_fullsized":"2024-04-25T02:29:28.988989+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'396","last_scrub_stamp":"2024-04-25T02:29:28.988885+0000","last_deep_scrub":"43'396","last_deep_scrub_stamp":"2024-04-25T02:29:28.988885+0000","last_clean_scrub_stamp":"2024-04-25T02:29:28.988885+0000","objects_scrubbed":2,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:31:18.956508+0000","scrub_duration":0.018703045000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":337,"num_write_kb":8338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"43'349","reported_seq":410,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:07.926117+0000","last_change":"2024-04-25T02:29:07.926087+0000","last_active":"2024-04-25T02:29:07.926117+0000","last_peered":"2024-04-25T02:29:07.926117+0000","last_clean":"2024-04-25T02:29:07.926117+0000","last_became_active":"2024-04-25T02:23:11.834994+0000","last_became_peered":"2024-04-25T02:23:11.834994+0000","last_unstale":"2024-04-25T02:29:07.926117+0000","last_undegraded":"2024-04-25T02:29:07.926117+0000","last_fullsized":"2024-04-25T02:29:07.926117+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'349","last_scrub_stamp":"2024-04-25T02:29:07.925985+0000","last_deep_scrub":"43'349","last_deep_scrub_stamp":"2024-04-25T02:29:07.925985+0000","last_clean_scrub_stamp":"2024-04-25T02:29:07.925985+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:48:50.879001+0000","scrub_duration":0.002053675,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":11931,"num_write":325,"num_write_kb":25986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":53,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:48.471620+0000","last_change":"2024-04-25T02:28:48.471576+0000","last_active":"2024-04-25T02:28:48.471620+0000","last_peered":"2024-04-25T02:28:48.471620+0000","last_clean":"2024-04-25T02:28:48.471620+0000","last_became_active":"2024-04-25T02:23:13.848628+0000","last_became_peered":"2024-04-25T02:23:13.848628+0000","last_unstale":"2024-04-25T02:28:48.471620+0000","last_undegraded":"2024-04-25T02:28:48.471620+0000","last_fullsized":"2024-04-25T02:28:48.471620+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:48.471463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:48.471463+0000","last_clean_scrub_stamp":"2024-04-25T02:28:48.471463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:16:32.732598+0000","scrub_duration":0.0015455829999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"43'117","reported_seq":205,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:43.952390+0000","last_change":"2024-04-25T02:28:43.952355+0000","last_active":"2024-04-25T02:28:43.952390+0000","last_peered":"2024-04-25T02:28:43.952390+0000","last_clean":"2024-04-25T02:28:43.952390+0000","last_became_active":"2024-04-25T02:23:11.835430+0000","last_became_peered":"2024-04-25T02:23:11.835430+0000","last_unstale":"2024-04-25T02:28:43.952390+0000","last_undegraded":"2024-04-25T02:28:43.952390+0000","last_fullsized":"2024-04-25T02:28:43.952390+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'117","last_scrub_stamp":"2024-04-25T02:28:43.952236+0000","last_deep_scrub":"43'117","last_deep_scrub_stamp":"2024-04-25T02:28:43.952236+0000","last_clean_scrub_stamp":"2024-04-25T02:28:43.952236+0000","objects_scrubbed":2,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:46:14.784576+0000","scrub_duration":0.005143936,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"43'575","reported_seq":625,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:04.637560+0000","last_change":"2024-04-25T02:29:04.637520+0000","last_active":"2024-04-25T02:29:04.637560+0000","last_peered":"2024-04-25T02:29:04.637560+0000","last_clean":"2024-04-25T02:29:04.637560+0000","last_became_active":"2024-04-25T02:23:13.845029+0000","last_became_peered":"2024-04-25T02:23:13.845029+0000","last_unstale":"2024-04-25T02:29:04.637560+0000","last_undegraded":"2024-04-25T02:29:04.637560+0000","last_fullsized":"2024-04-25T02:29:04.637560+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'575","last_scrub_stamp":"2024-04-25T02:29:04.637429+0000","last_deep_scrub":"43'575","last_deep_scrub_stamp":"2024-04-25T02:29:04.637429+0000","last_clean_scrub_stamp":"2024-04-25T02:29:04.637429+0000","objects_scrubbed":2,"log_size":575,"log_dups_size":0,"ondisk_log_size":575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:27:33.911843+0000","scrub_duration":0.022099299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":507,"num_write_kb":8447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"43'449","reported_seq":571,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:22.192884+0000","last_change":"2024-04-25T02:28:22.192856+0000","last_active":"2024-04-25T02:28:22.192884+0000","last_peered":"2024-04-25T02:28:22.192884+0000","last_clean":"2024-04-25T02:28:22.192884+0000","last_became_active":"2024-04-25T02:23:13.844018+0000","last_became_peered":"2024-04-25T02:23:13.844018+0000","last_unstale":"2024-04-25T02:28:22.192884+0000","last_undegraded":"2024-04-25T02:28:22.192884+0000","last_fullsized":"2024-04-25T02:28:22.192884+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'449","last_scrub_stamp":"2024-04-25T02:28:22.192764+0000","last_deep_scrub":"43'449","last_deep_scrub_stamp":"2024-04-25T02:28:22.192764+0000","last_clean_scrub_stamp":"2024-04-25T02:28:22.192764+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:28.942878+0000","scrub_duration":0.0021300249999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":31679,"num_write":414,"num_write_kb":80533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:23.639479+0000","last_change":"2024-04-25T02:29:23.639437+0000","last_active":"2024-04-25T02:29:23.639479+0000","last_peered":"2024-04-25T02:29:23.639479+0000","last_clean":"2024-04-25T02:29:23.639479+0000","last_became_active":"2024-04-25T02:23:13.844753+0000","last_became_peered":"2024-04-25T02:23:13.844753+0000","last_unstale":"2024-04-25T02:29:23.639479+0000","last_undegraded":"2024-04-25T02:29:23.639479+0000","last_fullsized":"2024-04-25T02:29:23.639479+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:23.639330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:23.639330+0000","last_clean_scrub_stamp":"2024-04-25T02:29:23.639330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:36:28.214106+0000","scrub_duration":0.001562251,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"43'253","reported_seq":486,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:09.943734+0000","last_change":"2024-04-25T02:29:09.943689+0000","last_active":"2024-04-25T02:29:09.943734+0000","last_peered":"2024-04-25T02:29:09.943734+0000","last_clean":"2024-04-25T02:29:09.943734+0000","last_became_active":"2024-04-25T02:23:12.845638+0000","last_became_peered":"2024-04-25T02:23:12.845638+0000","last_unstale":"2024-04-25T02:29:09.943734+0000","last_undegraded":"2024-04-25T02:29:09.943734+0000","last_fullsized":"2024-04-25T02:29:09.943734+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'253","last_scrub_stamp":"2024-04-25T02:29:09.943582+0000","last_deep_scrub":"43'253","last_deep_scrub_stamp":"2024-04-25T02:29:09.943582+0000","last_clean_scrub_stamp":"2024-04-25T02:29:09.943582+0000","objects_scrubbed":1,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:41:32.698316+0000","scrub_duration":0.0070356070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1460763,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":182,"num_read_kb":1548,"num_write":182,"num_write_kb":1548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"43'454","reported_seq":583,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:13.968762+0000","last_change":"2024-04-25T02:29:13.968733+0000","last_active":"2024-04-25T02:29:13.968762+0000","last_peered":"2024-04-25T02:29:13.968762+0000","last_clean":"2024-04-25T02:29:13.968762+0000","last_became_active":"2024-04-25T02:23:11.840215+0000","last_became_peered":"2024-04-25T02:23:11.840215+0000","last_unstale":"2024-04-25T02:29:13.968762+0000","last_undegraded":"2024-04-25T02:29:13.968762+0000","last_fullsized":"2024-04-25T02:29:13.968762+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'454","last_scrub_stamp":"2024-04-25T02:29:13.968625+0000","last_deep_scrub":"43'454","last_deep_scrub_stamp":"2024-04-25T02:29:13.968625+0000","last_clean_scrub_stamp":"2024-04-25T02:29:13.968625+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:44:53.105094+0000","scrub_duration":0.0025024790000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":42224,"num_write":426,"num_write_kb":96444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":50,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:25:10.069694+0000","last_change":"2024-04-25T02:23:13.845169+0000","last_active":"2024-04-25T02:25:10.069694+0000","last_peered":"2024-04-25T02:25:10.069694+0000","last_clean":"2024-04-25T02:25:10.069694+0000","last_became_active":"2024-04-25T02:23:13.841324+0000","last_became_peered":"2024-04-25T02:23:13.841324+0000","last_unstale":"2024-04-25T02:25:10.069694+0000","last_undegraded":"2024-04-25T02:25:10.069694+0000","last_fullsized":"2024-04-25T02:25:10.069694+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:14.468721+0000","last_clean_scrub_stamp":"2024-04-25T02:20:14.468721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"43'53","reported_seq":96,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:23.045057+0000","last_change":"2024-04-25T02:29:23.045018+0000","last_active":"2024-04-25T02:29:23.045057+0000","last_peered":"2024-04-25T02:29:23.045057+0000","last_clean":"2024-04-25T02:29:23.045057+0000","last_became_active":"2024-04-25T02:23:12.841930+0000","last_became_peered":"2024-04-25T02:23:12.841930+0000","last_unstale":"2024-04-25T02:29:23.045057+0000","last_undegraded":"2024-04-25T02:29:23.045057+0000","last_fullsized":"2024-04-25T02:29:23.045057+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'53","last_scrub_stamp":"2024-04-25T02:29:23.044876+0000","last_deep_scrub":"43'53","last_deep_scrub_stamp":"2024-04-25T02:29:23.044876+0000","last_clean_scrub_stamp":"2024-04-25T02:29:23.044876+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:46:33.497718+0000","scrub_duration":0.0016291229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"43'427","reported_seq":596,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:35.112665+0000","last_change":"2024-04-25T02:28:35.112631+0000","last_active":"2024-04-25T02:28:35.112665+0000","last_peered":"2024-04-25T02:28:35.112665+0000","last_clean":"2024-04-25T02:28:35.112665+0000","last_became_active":"2024-04-25T02:23:12.847949+0000","last_became_peered":"2024-04-25T02:23:12.847949+0000","last_unstale":"2024-04-25T02:28:35.112665+0000","last_undegraded":"2024-04-25T02:28:35.112665+0000","last_fullsized":"2024-04-25T02:28:35.112665+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'427","last_scrub_stamp":"2024-04-25T02:28:35.112522+0000","last_deep_scrub":"43'427","last_deep_scrub_stamp":"2024-04-25T02:28:35.112522+0000","last_clean_scrub_stamp":"2024-04-25T02:28:35.112522+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:01.667215+0000","scrub_duration":0.0025605430000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":62452,"num_write":394,"num_write_kb":105065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"43'67","reported_seq":121,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:22.607900+0000","last_change":"2024-04-25T02:29:22.607869+0000","last_active":"2024-04-25T02:29:22.607900+0000","last_peered":"2024-04-25T02:29:22.607900+0000","last_clean":"2024-04-25T02:29:22.607900+0000","last_became_active":"2024-04-25T02:23:13.844133+0000","last_became_peered":"2024-04-25T02:23:13.844133+0000","last_unstale":"2024-04-25T02:29:22.607900+0000","last_undegraded":"2024-04-25T02:29:22.607900+0000","last_fullsized":"2024-04-25T02:29:22.607900+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'67","last_scrub_stamp":"2024-04-25T02:29:22.607757+0000","last_deep_scrub":"43'67","last_deep_scrub_stamp":"2024-04-25T02:29:22.607757+0000","last_clean_scrub_stamp":"2024-04-25T02:29:22.607757+0000","objects_scrubbed":2,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:08:11.568613+0000","scrub_duration":0.0035088860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:56.954217+0000","last_change":"2024-04-25T02:28:56.954190+0000","last_active":"2024-04-25T02:28:56.954217+0000","last_peered":"2024-04-25T02:28:56.954217+0000","last_clean":"2024-04-25T02:28:56.954217+0000","last_became_active":"2024-04-25T02:23:11.836737+0000","last_became_peered":"2024-04-25T02:23:11.836737+0000","last_unstale":"2024-04-25T02:28:56.954217+0000","last_undegraded":"2024-04-25T02:28:56.954217+0000","last_fullsized":"2024-04-25T02:28:56.954217+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:56.954079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:56.954079+0000","last_clean_scrub_stamp":"2024-04-25T02:28:56.954079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:31:33.715989+0000","scrub_duration":0.001439145,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"43'434","reported_seq":577,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.571439+0000","last_change":"2024-04-25T02:29:19.571393+0000","last_active":"2024-04-25T02:29:19.571439+0000","last_peered":"2024-04-25T02:29:19.571439+0000","last_clean":"2024-04-25T02:29:19.571439+0000","last_became_active":"2024-04-25T02:23:13.843915+0000","last_became_peered":"2024-04-25T02:23:13.843915+0000","last_unstale":"2024-04-25T02:29:19.571439+0000","last_undegraded":"2024-04-25T02:29:19.571439+0000","last_fullsized":"2024-04-25T02:29:19.571439+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'434","last_scrub_stamp":"2024-04-25T02:29:19.571275+0000","last_deep_scrub":"43'434","last_deep_scrub_stamp":"2024-04-25T02:29:19.571275+0000","last_clean_scrub_stamp":"2024-04-25T02:29:19.571275+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:49.263428+0000","scrub_duration":0.0026546920000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":48451,"num_write":406,"num_write_kb":112597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":60,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:45.426103+0000","last_change":"2024-04-25T02:28:45.426067+0000","last_active":"2024-04-25T02:28:45.426103+0000","last_peered":"2024-04-25T02:28:45.426103+0000","last_clean":"2024-04-25T02:28:45.426103+0000","last_became_active":"2024-04-25T02:23:13.838746+0000","last_became_peered":"2024-04-25T02:23:13.838746+0000","last_unstale":"2024-04-25T02:28:45.426103+0000","last_undegraded":"2024-04-25T02:28:45.426103+0000","last_fullsized":"2024-04-25T02:28:45.426103+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:45.425965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:45.425965+0000","last_clean_scrub_stamp":"2024-04-25T02:28:45.425965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:51.800756+0000","scrub_duration":0.0014993350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"43'86","reported_seq":126,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:16.198349+0000","last_change":"2024-04-25T02:23:11.840837+0000","last_active":"2024-04-25T02:28:16.198349+0000","last_peered":"2024-04-25T02:28:16.198349+0000","last_clean":"2024-04-25T02:28:16.198349+0000","last_became_active":"2024-04-25T02:23:11.840553+0000","last_became_peered":"2024-04-25T02:23:11.840553+0000","last_unstale":"2024-04-25T02:28:16.198349+0000","last_undegraded":"2024-04-25T02:28:16.198349+0000","last_fullsized":"2024-04-25T02:28:16.198349+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:22.830146+0000","last_clean_scrub_stamp":"2024-04-25T02:20:22.830146+0000","objects_scrubbed":0,"log_size":86,"log_dups_size":0,"ondisk_log_size":86,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":74,"num_write_kb":962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"43'397","reported_seq":495,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:02.785656+0000","last_change":"2024-04-25T02:29:02.785610+0000","last_active":"2024-04-25T02:29:02.785656+0000","last_peered":"2024-04-25T02:29:02.785656+0000","last_clean":"2024-04-25T02:29:02.785656+0000","last_became_active":"2024-04-25T02:23:13.848374+0000","last_became_peered":"2024-04-25T02:23:13.848374+0000","last_unstale":"2024-04-25T02:29:02.785656+0000","last_undegraded":"2024-04-25T02:29:02.785656+0000","last_fullsized":"2024-04-25T02:29:02.785656+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'397","last_scrub_stamp":"2024-04-25T02:29:02.785490+0000","last_deep_scrub":"43'397","last_deep_scrub_stamp":"2024-04-25T02:29:02.785490+0000","last_clean_scrub_stamp":"2024-04-25T02:29:02.785490+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:46:45.303985+0000","scrub_duration":0.0024422020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":25341,"num_write":367,"num_write_kb":104771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"43'125","reported_seq":177,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:23.889117+0000","last_change":"2024-04-25T02:29:23.889067+0000","last_active":"2024-04-25T02:29:23.889117+0000","last_peered":"2024-04-25T02:29:23.889117+0000","last_clean":"2024-04-25T02:29:23.889117+0000","last_became_active":"2024-04-25T02:23:13.842438+0000","last_became_peered":"2024-04-25T02:23:13.842438+0000","last_unstale":"2024-04-25T02:29:23.889117+0000","last_undegraded":"2024-04-25T02:29:23.889117+0000","last_fullsized":"2024-04-25T02:29:23.889117+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'125","last_scrub_stamp":"2024-04-25T02:29:23.888952+0000","last_deep_scrub":"43'125","last_deep_scrub_stamp":"2024-04-25T02:29:23.888952+0000","last_clean_scrub_stamp":"2024-04-25T02:29:23.888952+0000","objects_scrubbed":3,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:02:18.364587+0000","scrub_duration":0.010573489,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4196548,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"43'373","reported_seq":466,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:13.969575+0000","last_change":"2024-04-25T02:29:13.969547+0000","last_active":"2024-04-25T02:29:13.969575+0000","last_peered":"2024-04-25T02:29:13.969575+0000","last_clean":"2024-04-25T02:29:13.969575+0000","last_became_active":"2024-04-25T02:23:12.844258+0000","last_became_peered":"2024-04-25T02:23:12.844258+0000","last_unstale":"2024-04-25T02:29:13.969575+0000","last_undegraded":"2024-04-25T02:29:13.969575+0000","last_fullsized":"2024-04-25T02:29:13.969575+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'373","last_scrub_stamp":"2024-04-25T02:29:13.969449+0000","last_deep_scrub":"43'373","last_deep_scrub_stamp":"2024-04-25T02:29:13.969449+0000","last_clean_scrub_stamp":"2024-04-25T02:29:13.969449+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:55:34.895544+0000","scrub_duration":0.0022595229999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":25157,"num_write":340,"num_write_kb":59328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"43'318","reported_seq":362,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:06.939622+0000","last_change":"2024-04-25T02:29:06.939592+0000","last_active":"2024-04-25T02:29:06.939622+0000","last_peered":"2024-04-25T02:29:06.939622+0000","last_clean":"2024-04-25T02:29:06.939622+0000","last_became_active":"2024-04-25T02:23:11.833348+0000","last_became_peered":"2024-04-25T02:23:11.833348+0000","last_unstale":"2024-04-25T02:29:06.939622+0000","last_undegraded":"2024-04-25T02:29:06.939622+0000","last_fullsized":"2024-04-25T02:29:06.939622+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'318","last_scrub_stamp":"2024-04-25T02:29:06.939488+0000","last_deep_scrub":"43'318","last_deep_scrub_stamp":"2024-04-25T02:29:06.939488+0000","last_clean_scrub_stamp":"2024-04-25T02:29:06.939488+0000","objects_scrubbed":2,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:26:24.204337+0000","scrub_duration":0.013407262,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":262,"num_write_kb":4264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"43'371","reported_seq":471,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:20.223269+0000","last_change":"2024-04-25T02:28:20.223232+0000","last_active":"2024-04-25T02:28:20.223269+0000","last_peered":"2024-04-25T02:28:20.223269+0000","last_clean":"2024-04-25T02:28:20.223269+0000","last_became_active":"2024-04-25T02:23:55.963467+0000","last_became_peered":"2024-04-25T02:23:55.963467+0000","last_unstale":"2024-04-25T02:28:20.223269+0000","last_undegraded":"2024-04-25T02:28:20.223269+0000","last_fullsized":"2024-04-25T02:28:20.223269+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'371","last_scrub_stamp":"2024-04-25T02:28:20.223133+0000","last_deep_scrub":"43'371","last_deep_scrub_stamp":"2024-04-25T02:28:20.223133+0000","last_clean_scrub_stamp":"2024-04-25T02:28:20.223133+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:12.999404+0000","scrub_duration":0.0022911020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":32821,"num_write":343,"num_write_kb":62943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"43'327","reported_seq":385,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:11.615512+0000","last_change":"2024-04-25T02:29:11.615484+0000","last_active":"2024-04-25T02:29:11.615512+0000","last_peered":"2024-04-25T02:29:11.615512+0000","last_clean":"2024-04-25T02:29:11.615512+0000","last_became_active":"2024-04-25T02:23:13.840492+0000","last_became_peered":"2024-04-25T02:23:13.840492+0000","last_unstale":"2024-04-25T02:29:11.615512+0000","last_undegraded":"2024-04-25T02:29:11.615512+0000","last_fullsized":"2024-04-25T02:29:11.615512+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'327","last_scrub_stamp":"2024-04-25T02:29:11.615400+0000","last_deep_scrub":"43'327","last_deep_scrub_stamp":"2024-04-25T02:29:11.615400+0000","last_clean_scrub_stamp":"2024-04-25T02:29:11.615400+0000","objects_scrubbed":4,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:49:15.104618+0000","scrub_duration":0.029271986,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":257,"num_write_kb":12449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"43'384","reported_seq":454,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:25.236814+0000","last_change":"2024-04-25T02:28:25.236776+0000","last_active":"2024-04-25T02:28:25.236814+0000","last_peered":"2024-04-25T02:28:25.236814+0000","last_clean":"2024-04-25T02:28:25.236814+0000","last_became_active":"2024-04-25T02:23:13.847264+0000","last_became_peered":"2024-04-25T02:23:13.847264+0000","last_unstale":"2024-04-25T02:28:25.236814+0000","last_undegraded":"2024-04-25T02:28:25.236814+0000","last_fullsized":"2024-04-25T02:28:25.236814+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'384","last_scrub_stamp":"2024-04-25T02:28:25.236669+0000","last_deep_scrub":"43'384","last_deep_scrub_stamp":"2024-04-25T02:28:25.236669+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.236669+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:51.748406+0000","scrub_duration":0.002112685,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":15655,"num_write":352,"num_write_kb":42131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"43'94","reported_seq":144,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:50.478023+0000","last_change":"2024-04-25T02:28:50.477980+0000","last_active":"2024-04-25T02:28:50.478023+0000","last_peered":"2024-04-25T02:28:50.478023+0000","last_clean":"2024-04-25T02:28:50.478023+0000","last_became_active":"2024-04-25T02:23:13.845143+0000","last_became_peered":"2024-04-25T02:23:13.845143+0000","last_unstale":"2024-04-25T02:28:50.478023+0000","last_undegraded":"2024-04-25T02:28:50.478023+0000","last_fullsized":"2024-04-25T02:28:50.478023+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'94","last_scrub_stamp":"2024-04-25T02:28:50.477893+0000","last_deep_scrub":"43'94","last_deep_scrub_stamp":"2024-04-25T02:28:50.477893+0000","last_clean_scrub_stamp":"2024-04-25T02:28:50.477893+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:47:38.664790+0000","scrub_duration":0.0099647699999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":4121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"43'427","reported_seq":462,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.348849+0000","last_change":"2024-04-25T02:23:55.957176+0000","last_active":"2024-04-25T02:28:12.348849+0000","last_peered":"2024-04-25T02:28:12.348849+0000","last_clean":"2024-04-25T02:28:12.348849+0000","last_became_active":"2024-04-25T02:23:55.956828+0000","last_became_peered":"2024-04-25T02:23:55.956828+0000","last_unstale":"2024-04-25T02:28:12.348849+0000","last_undegraded":"2024-04-25T02:28:12.348849+0000","last_fullsized":"2024-04-25T02:28:12.348849+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":14079,"num_write":394,"num_write_kb":87521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"43'114","reported_seq":160,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:20.198034+0000","last_change":"2024-04-25T02:28:20.198001+0000","last_active":"2024-04-25T02:28:20.198034+0000","last_peered":"2024-04-25T02:28:20.198034+0000","last_clean":"2024-04-25T02:28:20.198034+0000","last_became_active":"2024-04-25T02:23:11.838807+0000","last_became_peered":"2024-04-25T02:23:11.838807+0000","last_unstale":"2024-04-25T02:28:20.198034+0000","last_undegraded":"2024-04-25T02:28:20.198034+0000","last_fullsized":"2024-04-25T02:28:20.198034+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'114","last_scrub_stamp":"2024-04-25T02:28:20.197907+0000","last_deep_scrub":"43'114","last_deep_scrub_stamp":"2024-04-25T02:28:20.197907+0000","last_clean_scrub_stamp":"2024-04-25T02:28:20.197907+0000","objects_scrubbed":3,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:47:55.330863+0000","scrub_duration":0.011784594000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":59,"num_write_kb":4127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"43'447","reported_seq":531,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:53.887469+0000","last_change":"2024-04-25T02:28:53.887441+0000","last_active":"2024-04-25T02:28:53.887469+0000","last_peered":"2024-04-25T02:28:53.887469+0000","last_clean":"2024-04-25T02:28:53.887469+0000","last_became_active":"2024-04-25T02:23:12.845497+0000","last_became_peered":"2024-04-25T02:23:12.845497+0000","last_unstale":"2024-04-25T02:28:53.887469+0000","last_undegraded":"2024-04-25T02:28:53.887469+0000","last_fullsized":"2024-04-25T02:28:53.887469+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'447","last_scrub_stamp":"2024-04-25T02:28:53.887343+0000","last_deep_scrub":"43'447","last_deep_scrub_stamp":"2024-04-25T02:28:53.887343+0000","last_clean_scrub_stamp":"2024-04-25T02:28:53.887343+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:59:00.846583+0000","scrub_duration":0.0022684239999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15742,"num_write":414,"num_write_kb":51315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"43'419","reported_seq":495,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:24.999907+0000","last_change":"2024-04-25T02:29:24.999876+0000","last_active":"2024-04-25T02:29:24.999907+0000","last_peered":"2024-04-25T02:29:24.999907+0000","last_clean":"2024-04-25T02:29:24.999907+0000","last_became_active":"2024-04-25T02:23:12.846719+0000","last_became_peered":"2024-04-25T02:23:12.846719+0000","last_unstale":"2024-04-25T02:29:24.999907+0000","last_undegraded":"2024-04-25T02:29:24.999907+0000","last_fullsized":"2024-04-25T02:29:24.999907+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'419","last_scrub_stamp":"2024-04-25T02:29:24.999777+0000","last_deep_scrub":"43'419","last_deep_scrub_stamp":"2024-04-25T02:29:24.999777+0000","last_clean_scrub_stamp":"2024-04-25T02:29:24.999777+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:06:01.639473+0000","scrub_duration":0.0022050609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":16944,"num_write":389,"num_write_kb":35957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"43'440","reported_seq":495,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:21.088417+0000","last_change":"2024-04-25T02:29:21.088396+0000","last_active":"2024-04-25T02:29:21.088417+0000","last_peered":"2024-04-25T02:29:21.088417+0000","last_clean":"2024-04-25T02:29:21.088417+0000","last_became_active":"2024-04-25T02:23:56.301745+0000","last_became_peered":"2024-04-25T02:23:56.301745+0000","last_unstale":"2024-04-25T02:29:21.088417+0000","last_undegraded":"2024-04-25T02:29:21.088417+0000","last_fullsized":"2024-04-25T02:29:21.088417+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'440","last_scrub_stamp":"2024-04-25T02:29:21.088323+0000","last_deep_scrub":"43'440","last_deep_scrub_stamp":"2024-04-25T02:29:21.088323+0000","last_clean_scrub_stamp":"2024-04-25T02:29:21.088323+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:48:29.034833+0000","scrub_duration":0.0017322780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":12557,"num_write":410,"num_write_kb":77332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"43'492","reported_seq":571,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:24.176583+0000","last_change":"2024-04-25T02:28:24.176533+0000","last_active":"2024-04-25T02:28:24.176583+0000","last_peered":"2024-04-25T02:28:24.176583+0000","last_clean":"2024-04-25T02:28:24.176583+0000","last_became_active":"2024-04-25T02:23:13.844235+0000","last_became_peered":"2024-04-25T02:23:13.844235+0000","last_unstale":"2024-04-25T02:28:24.176583+0000","last_undegraded":"2024-04-25T02:28:24.176583+0000","last_fullsized":"2024-04-25T02:28:24.176583+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'492","last_scrub_stamp":"2024-04-25T02:28:24.176384+0000","last_deep_scrub":"43'492","last_deep_scrub_stamp":"2024-04-25T02:28:24.176384+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.176384+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:15.054028+0000","scrub_duration":0.002556961,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14237,"num_write":458,"num_write_kb":116854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"43'392","reported_seq":482,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:13.587928+0000","last_change":"2024-04-25T02:29:13.587897+0000","last_active":"2024-04-25T02:29:13.587928+0000","last_peered":"2024-04-25T02:29:13.587928+0000","last_clean":"2024-04-25T02:29:13.587928+0000","last_became_active":"2024-04-25T02:23:13.845193+0000","last_became_peered":"2024-04-25T02:23:13.845193+0000","last_unstale":"2024-04-25T02:29:13.587928+0000","last_undegraded":"2024-04-25T02:29:13.587928+0000","last_fullsized":"2024-04-25T02:29:13.587928+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'392","last_scrub_stamp":"2024-04-25T02:29:13.587800+0000","last_deep_scrub":"43'392","last_deep_scrub_stamp":"2024-04-25T02:29:13.587800+0000","last_clean_scrub_stamp":"2024-04-25T02:29:13.587800+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:00:48.741712+0000","scrub_duration":0.002153206,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":36152,"num_write":360,"num_write_kb":54497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"43'402","reported_seq":514,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.963419+0000","last_change":"2024-04-25T02:29:19.963389+0000","last_active":"2024-04-25T02:29:19.963419+0000","last_peered":"2024-04-25T02:29:19.963419+0000","last_clean":"2024-04-25T02:29:19.963419+0000","last_became_active":"2024-04-25T02:23:12.841677+0000","last_became_peered":"2024-04-25T02:23:12.841677+0000","last_unstale":"2024-04-25T02:29:19.963419+0000","last_undegraded":"2024-04-25T02:29:19.963419+0000","last_fullsized":"2024-04-25T02:29:19.963419+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'402","last_scrub_stamp":"2024-04-25T02:29:19.963285+0000","last_deep_scrub":"43'402","last_deep_scrub_stamp":"2024-04-25T02:29:19.963285+0000","last_clean_scrub_stamp":"2024-04-25T02:29:19.963285+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:36:14.054555+0000","scrub_duration":0.002042412,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":32628,"num_write":375,"num_write_kb":79888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2779,"num_read_kb":1446401,"num_write":24390,"num_write_kb":4320360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26350,"ondisk_log_size":26350,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":129261049,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":231,"num_read_kb":1603,"num_write":6644,"num_write_kb":130848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":258629632,"data_stored":258522098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39115,"internal_metadata":0},"log_size":8547,"ondisk_log_size":8547,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":31,"seq":133143986255,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":393820,"kb_used_data":88340,"kb_used_omap":9,"kb_used_meta":305462,"kb_avail":93978020,"statfs":{"total":96636764160,"available":96233492480,"internally_reserved":0,"allocated":90460160,"data_stored":90216632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9975,"internal_metadata":312793353},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:29:18 2024","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.33900000000000002,"15min":0.33500000000000002},"min":{"1min":0.222,"5min":0.156,"15min":0.156},"max":{"1min":0.51000000000000001,"5min":3.5409999999999999,"15min":3.5409999999999999},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.39500000000000002,"15min":0.36499999999999999},"min":{"1min":0.247,"5min":0.161,"15min":0.161},"max":{"1min":0.54000000000000004,"5min":3.613,"15min":3.613},"last":0.38800000000000001}]},{"osd":1,"last update":"Thu Apr 25 02:29:18 2024","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.378,"15min":0.36199999999999999},"min":{"1min":0.26500000000000001,"5min":0.184,"15min":0.184},"max":{"1min":0.51000000000000001,"5min":3.0009999999999999,"15min":3.0009999999999999},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.36899999999999999},"min":{"1min":0.27800000000000002,"5min":0.157,"15min":0.157},"max":{"1min":0.56000000000000005,"5min":4.9720000000000004,"15min":4.9720000000000004},"last":0.40100000000000002}]},{"osd":2,"last update":"Thu Apr 25 02:29:18 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.42499999999999999,"15min":0.378},"min":{"1min":0.28799999999999998,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.505,"5min":4.883,"15min":4.883},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40000000000000002,"15min":0.38400000000000001},"min":{"1min":0.30299999999999999,"5min":0.184,"15min":0.184},"max":{"1min":0.56699999999999995,"5min":3.0550000000000002,"15min":3.0550000000000002},"last":0.42099999999999999}]}]},{"osd":2,"up_from":30,"seq":128849018959,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":366484,"kb_used_data":56972,"kb_used_omap":8,"kb_used_meta":309495,"kb_avail":94005356,"statfs":{"total":96636764160,"available":96261484544,"internally_reserved":0,"allocated":58339328,"data_stored":58119882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8387,"internal_metadata":316923709},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.32600000000000001,"15min":0.32400000000000001},"min":{"1min":0.26700000000000002,"5min":0.14199999999999999,"15min":0.14199999999999999},"max":{"1min":0.52100000000000002,"5min":2.419,"15min":2.419},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.32100000000000001,"15min":0.32800000000000001},"min":{"1min":0.27200000000000002,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.47799999999999998,"5min":0.49299999999999999,"15min":0.51300000000000001},"last":0.52800000000000002}]},{"osd":1,"last update":"Thu Apr 25 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.35199999999999998,"15min":0.34799999999999998},"min":{"1min":0.249,"5min":0.19,"15min":0.19},"max":{"1min":0.47499999999999998,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.375,"5min":0.34999999999999998,"15min":0.34899999999999998},"min":{"1min":0.27900000000000003,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.48799999999999999,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.48899999999999999}]},{"osd":3,"last update":"Thu Apr 25 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.34799999999999998,"15min":0.35399999999999998},"min":{"1min":0.26200000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.51200000000000001,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.435,"5min":0.39700000000000002,"15min":0.40100000000000002},"min":{"1min":0.35599999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.55800000000000005,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.55900000000000005}]}]},{"osd":0,"up_from":28,"seq":120259084368,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369380,"kb_used_data":59740,"kb_used_omap":15,"kb_used_meta":309616,"kb_avail":94002460,"statfs":{"total":96636764160,"available":96258519040,"internally_reserved":0,"allocated":61173760,"data_stored":60940630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15790,"internal_metadata":317047378},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 25 02:29:17 2024","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.30599999999999999,"15min":0.33000000000000002},"min":{"1min":0.255,"5min":0.14799999999999999,"15min":0.14799999999999999},"max":{"1min":0.46800000000000003,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.33600000000000002,"15min":0.35499999999999998},"min":{"1min":0.28699999999999998,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.51900000000000002,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.40000000000000002}]},{"osd":2,"last update":"Thu Apr 25 02:29:17 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.34200000000000003,"15min":0.37},"min":{"1min":0.309,"5min":0.188,"15min":0.188},"max":{"1min":0.501,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.34799999999999998,"15min":0.378},"min":{"1min":0.29299999999999998,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.497,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.436}]},{"osd":3,"last update":"Thu Apr 25 02:29:31 2024","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.374,"15min":0.378},"min":{"1min":0.31900000000000001,"5min":0.186,"15min":0.186},"max":{"1min":0.47799999999999998,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.371,"15min":0.41199999999999998},"min":{"1min":0.33700000000000002,"5min":0.221,"15min":0.221},"max":{"1min":0.55100000000000005,"5min":0.57299999999999995,"15min":0.63100000000000001},"last":0.35699999999999998}]}]},{"osd":1,"up_from":29,"seq":124554051664,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":351548,"kb_used_data":50100,"kb_used_omap":4,"kb_used_meta":301435,"kb_avail":94020292,"statfs":{"total":96636764160,"available":96276779008,"internally_reserved":0,"allocated":51302400,"data_stored":51088318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4963,"internal_metadata":308669597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:29:14 2024","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.29299999999999998,"15min":0.32100000000000001},"min":{"1min":0.23599999999999999,"5min":0.155,"15min":0.155},"max":{"1min":0.42399999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.29799999999999999},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.315,"15min":0.34499999999999997},"min":{"1min":0.25900000000000001,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.48399999999999999,"5min":0.53600000000000003,"15min":0.54000000000000004},"last":0.41899999999999998}]},{"osd":2,"last update":"Thu Apr 25 02:29:14 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.33000000000000002,"15min":0.34699999999999998},"min":{"1min":0.26200000000000001,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.34499999999999997,"15min":0.35899999999999999},"min":{"1min":0.26900000000000002,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.54400000000000004,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.39500000000000002}]},{"osd":3,"last update":"Thu Apr 25 02:29:14 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.36599999999999999,"15min":0.39200000000000002},"min":{"1min":0.32700000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.55000000000000004,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.376},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.35699999999999998,"15min":0.38300000000000001},"min":{"1min":0.307,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.52900000000000003,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.36399999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":60215296,"data_stored":60184605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15790,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":50343936,"data_stored":50332293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4963,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57974784,"data_stored":57954225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8387,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90095616,"data_stored":90050975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9975,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:29:41.114 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:41.114 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:41.114 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:41.115 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:41.115 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:41.115 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:41.115 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:41.115 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:41.115 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:41.116 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-25T02:20:14.468721+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=14, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:41.116 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-25T02:20:22.830146+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=22, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:41.116 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:29:41.116 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T02:30:01.118 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:30:01.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.246+0000 7f2b3a59e700 1 Processor -- start 2024-04-25T02:30:01.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.246+0000 7f2b3a59e700 1 -- start start 2024-04-25T02:30:01.252 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.247+0000 7f2b3a59e700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2b340a5470 0x7f2b3413fb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:01.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.247+0000 7f2b3a59e700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f2b340b06c0 0x7f2b341400d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:01.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.247+0000 7f2b3a59e700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2b340a4720 0x7f2b3406eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:01.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.247+0000 7f2b3a59e700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b340a3860 con 0x7f2b340b06c0 2024-04-25T02:30:01.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.247+0000 7f2b3a59e700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b340a42c0 con 0x7f2b340a5470 2024-04-25T02:30:01.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.247+0000 7f2b3a59e700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b340a71a0 con 0x7f2b340a4720 2024-04-25T02:30:01.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.247+0000 7f2b337fe700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f2b340b06c0 0x7f2b341400d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:01.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.247+0000 7f2b38b3b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2b340a4720 0x7f2b3406eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:01.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.247+0000 7f2b33fff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2b340a5470 0x7f2b3413fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:01.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.247+0000 7f2b337fe700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f2b340b06c0 0x7f2b341400d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:33582/0 (socket says 172.21.15.111:33582) 2024-04-25T02:30:01.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.247+0000 7f2b38b3b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2b340a4720 0x7f2b3406eb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:35038/0 (socket says 172.21.15.111:35038) 2024-04-25T02:30:01.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.247+0000 7f2b337fe700 1 -- 172.21.15.111:0/3531456709 learned_addr learned my addr 172.21.15.111:0/3531456709 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:30:01.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.247+0000 7f2b33fff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2b340a5470 0x7f2b3413fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:43110/0 (socket says 172.21.15.111:43110) 2024-04-25T02:30:01.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.247+0000 7f2b33fff700 1 -- 172.21.15.111:0/3531456709 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2b340a4720 msgr2=0x7f2b3406eb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:30:01.253 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.247+0000 7f2b33fff700 1 --2- 172.21.15.111:0/3531456709 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2b340a4720 0x7f2b3406eb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:01.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.247+0000 7f2b33fff700 1 -- 172.21.15.111:0/3531456709 >> v2:172.21.15.111:3300/0 conn(0x7f2b340b06c0 msgr2=0x7f2b341400d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:30:01.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.247+0000 7f2b33fff700 1 --2- 172.21.15.111:0/3531456709 >> v2:172.21.15.111:3300/0 conn(0x7f2b340b06c0 0x7f2b341400d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:01.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.248+0000 7f2b33fff700 1 -- 172.21.15.111:0/3531456709 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b340a5da0 con 0x7f2b340a5470 2024-04-25T02:30:01.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.248+0000 7f2b38b3b700 1 --2- 172.21.15.111:0/3531456709 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2b340a4720 0x7f2b3406eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:30:01.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.248+0000 7f2b337fe700 1 --2- 172.21.15.111:0/3531456709 >> v2:172.21.15.111:3300/0 conn(0x7f2b340b06c0 0x7f2b341400d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:30:01.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.248+0000 7f2b33fff700 1 --2- 172.21.15.111:0/3531456709 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2b340a5470 0x7f2b3413fb90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2b240098e0 tx=0x7f2b240091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fb12ebe14230675c server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:30:01.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.248+0000 7f2b32ffd700 1 -- 172.21.15.111:0/3531456709 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b24011630 con 0x7f2b340a5470 2024-04-25T02:30:01.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.248+0000 7f2b32ffd700 1 -- 172.21.15.111:0/3531456709 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b24011790 con 0x7f2b340a5470 2024-04-25T02:30:01.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.248+0000 7f2b32ffd700 1 -- 172.21.15.111:0/3531456709 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b24011b30 con 0x7f2b340a5470 2024-04-25T02:30:01.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.248+0000 7f2b3a59e700 1 -- 172.21.15.111:0/3531456709 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2b340a5470 msgr2=0x7f2b3413fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:01.254 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.248+0000 7f2b3a59e700 1 --2- 172.21.15.111:0/3531456709 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2b340a5470 0x7f2b3413fb90 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2b240098e0 tx=0x7f2b240091a0 comp rx=0 tx=0).stop 2024-04-25T02:30:01.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.248+0000 7f2b3a59e700 1 -- 172.21.15.111:0/3531456709 shutdown_connections 2024-04-25T02:30:01.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.248+0000 7f2b3a59e700 1 --2- 172.21.15.111:0/3531456709 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2b340a4720 0x7f2b3406eb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:01.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.248+0000 7f2b3a59e700 1 --2- 172.21.15.111:0/3531456709 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2b340a5470 0x7f2b3413fb90 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:01.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.248+0000 7f2b3a59e700 1 --2- 172.21.15.111:0/3531456709 >> v2:172.21.15.111:3300/0 conn(0x7f2b340b06c0 0x7f2b341400d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:01.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.248+0000 7f2b3a59e700 1 -- 172.21.15.111:0/3531456709 >> 172.21.15.111:0/3531456709 conn(0x7f2b3406bd70 msgr2=0x7f2b3406c170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:30:01.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.248+0000 7f2b3a59e700 1 -- 172.21.15.111:0/3531456709 shutdown_connections 2024-04-25T02:30:01.255 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.248+0000 7f2b3a59e700 1 -- 172.21.15.111:0/3531456709 wait complete. 2024-04-25T02:30:01.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.250+0000 7f2b3a59e700 1 Processor -- start 2024-04-25T02:30:01.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.250+0000 7f2b3a59e700 1 -- start start 2024-04-25T02:30:01.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.250+0000 7f2b3a59e700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2b340a4720 0x7f2b340ad180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:01.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.250+0000 7f2b3a59e700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b340a5470 0x7f2b34151180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:01.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.250+0000 7f2b3a59e700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2b340b06c0 0x7f2b341516c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:01.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.250+0000 7f2b3a59e700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b3409b900 con 0x7f2b340a5470 2024-04-25T02:30:01.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.250+0000 7f2b3a59e700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b340aee00 con 0x7f2b340a4720 2024-04-25T02:30:01.257 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.250+0000 7f2b3a59e700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f2b340adb50 con 0x7f2b340b06c0 2024-04-25T02:30:01.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.250+0000 7f2b33fff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2b340a4720 0x7f2b340ad180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:01.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.250+0000 7f2b38b3b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2b340b06c0 0x7f2b341516c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:01.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.250+0000 7f2b33fff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2b340a4720 0x7f2b340ad180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:43120/0 (socket says 172.21.15.111:43120) 2024-04-25T02:30:01.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.251+0000 7f2b33fff700 1 -- 172.21.15.111:0/284583343 learned_addr learned my addr 172.21.15.111:0/284583343 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:30:01.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.251+0000 7f2b337fe700 1 --2- 172.21.15.111:0/284583343 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b340a5470 0x7f2b34151180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:01.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.251+0000 7f2b38b3b700 1 -- 172.21.15.111:0/284583343 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2b340a4720 msgr2=0x7f2b340ad180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:01.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.251+0000 7f2b38b3b700 1 --2- 172.21.15.111:0/284583343 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2b340a4720 0x7f2b340ad180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:01.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.251+0000 7f2b38b3b700 1 -- 172.21.15.111:0/284583343 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b340a5470 msgr2=0x7f2b34151180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:01.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.251+0000 7f2b38b3b700 1 --2- 172.21.15.111:0/284583343 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b340a5470 0x7f2b34151180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:01.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.251+0000 7f2b38b3b700 1 -- 172.21.15.111:0/284583343 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b2c009a20 con 0x7f2b340b06c0 2024-04-25T02:30:01.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.251+0000 7f2b33fff700 1 --2- 172.21.15.111:0/284583343 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2b340a4720 0x7f2b340ad180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:30:01.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.251+0000 7f2b337fe700 1 --2- 172.21.15.111:0/284583343 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b340a5470 0x7f2b34151180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:30:01.258 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.251+0000 7f2b38b3b700 1 --2- 172.21.15.111:0/284583343 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2b340b06c0 0x7f2b341516c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2b3406bc20 tx=0x7f2b2c00b040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:30:01.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.251+0000 7f2b1bfff700 1 -- 172.21.15.111:0/284583343 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2c00caa0 con 0x7f2b340b06c0 2024-04-25T02:30:01.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.251+0000 7f2b1bfff700 1 -- 172.21.15.111:0/284583343 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b2c00f040 con 0x7f2b340b06c0 2024-04-25T02:30:01.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.251+0000 7f2b1bfff700 1 -- 172.21.15.111:0/284583343 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b2c00ce70 con 0x7f2b340b06c0 2024-04-25T02:30:01.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.251+0000 7f2b3a59e700 1 -- 172.21.15.111:0/284583343 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b280094f0 con 0x7f2b340b06c0 2024-04-25T02:30:01.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.251+0000 7f2b3a59e700 1 -- 172.21.15.111:0/284583343 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b24009420 con 0x7f2b340b06c0 2024-04-25T02:30:01.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.252+0000 7f2b3a59e700 1 -- 172.21.15.111:0/284583343 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b340acea0 con 0x7f2b340b06c0 2024-04-25T02:30:01.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.252+0000 7f2b1bfff700 1 -- 172.21.15.111:0/284583343 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f2b2c014690 con 0x7f2b340b06c0 2024-04-25T02:30:01.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.252+0000 7f2b1bfff700 1 -- 172.21.15.111:0/284583343 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4158+0+0 (secure 0 0 0) 0x7f2b2c05bce0 con 0x7f2b340b06c0 2024-04-25T02:30:01.259 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.256+0000 7f2b1bfff700 1 -- 172.21.15.111:0/284583343 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f2b340acea0 con 0x7f2b340b06c0 2024-04-25T02:30:01.410 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.407+0000 7f2b3a59e700 1 -- 172.21.15.111:0/284583343 --> v1:172.21.15.111:6816/46482 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2b340acea0 con 0x7f2b20045ef0 2024-04-25T02:30:01.417 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.414+0000 7f2b1bfff700 1 -- 172.21.15.111:0/284583343 <== mgr.14107 v1:172.21.15.111:6816/46482 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+280447 (unknown 2965378022 0 1296499496) 0x7f2b340acea0 con 0x7f2b20045ef0 2024-04-25T02:30:01.421 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:30:01.423 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.417+0000 7f2b3a59e700 1 -- 172.21.15.111:0/284583343 >> v1:172.21.15.111:6816/46482 conn(0x7f2b20045ef0 legacy=0x7f2b200483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:01.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.417+0000 7f2b3a59e700 1 -- 172.21.15.111:0/284583343 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2b340b06c0 msgr2=0x7f2b341516c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:01.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.417+0000 7f2b3a59e700 1 --2- 172.21.15.111:0/284583343 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2b340b06c0 0x7f2b341516c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f2b3406bc20 tx=0x7f2b2c00b040 comp rx=0 tx=0).stop 2024-04-25T02:30:01.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.417+0000 7f2b3a59e700 1 -- 172.21.15.111:0/284583343 shutdown_connections 2024-04-25T02:30:01.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.417+0000 7f2b3a59e700 1 --2- 172.21.15.111:0/284583343 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f2b340b06c0 0x7f2b341516c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:01.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.417+0000 7f2b3a59e700 1 --2- 172.21.15.111:0/284583343 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f2b340a4720 0x7f2b340ad180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:01.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.417+0000 7f2b3a59e700 1 --2- 172.21.15.111:0/284583343 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f2b340a5470 0x7f2b34151180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:01.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.417+0000 7f2b3a59e700 1 -- 172.21.15.111:0/284583343 >> 172.21.15.111:0/284583343 conn(0x7f2b3406bd70 msgr2=0x7f2b3406f3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:30:01.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.417+0000 7f2b3a59e700 1 -- 172.21.15.111:0/284583343 shutdown_connections 2024-04-25T02:30:01.424 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:01.417+0000 7f2b3a59e700 1 -- 172.21.15.111:0/284583343 wait complete. 2024-04-25T02:30:01.424 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2024-04-25T02:30:01.432 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":239,"stamp":"2024-04-25T02:30:00.830357+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129851417,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":3127,"num_read_kb":1448109,"num_write":31191,"num_write_kb":4453499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35019,"ondisk_log_size":35019,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1481232,"kb_used_data":255152,"kb_used_omap":38,"kb_used_meta":1226009,"kb_avail":376006128,"statfs":{"total":386547056640,"available":385030275072,"internally_reserved":0,"allocated":261275648,"data_stored":260365462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39115,"internal_metadata":1255434037},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003371"},"pg_stats":[{"pgid":"4.3f","version":"43'402","reported_seq":485,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:48.101234+0000","last_change":"2024-04-25T02:28:48.101190+0000","last_active":"2024-04-25T02:28:48.101234+0000","last_peered":"2024-04-25T02:28:48.101234+0000","last_clean":"2024-04-25T02:28:48.101234+0000","last_became_active":"2024-04-25T02:23:13.845848+0000","last_became_peered":"2024-04-25T02:23:13.845848+0000","last_unstale":"2024-04-25T02:28:48.101234+0000","last_undegraded":"2024-04-25T02:28:48.101234+0000","last_fullsized":"2024-04-25T02:28:48.101234+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'402","last_scrub_stamp":"2024-04-25T02:28:48.101084+0000","last_deep_scrub":"43'402","last_deep_scrub_stamp":"2024-04-25T02:28:48.101084+0000","last_clean_scrub_stamp":"2024-04-25T02:28:48.101084+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:09:02.892301+0000","scrub_duration":0.0017175580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":15113,"num_write":370,"num_write_kb":51033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"43'436","reported_seq":531,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:57.901623+0000","last_change":"2024-04-25T02:28:57.901586+0000","last_active":"2024-04-25T02:28:57.901623+0000","last_peered":"2024-04-25T02:28:57.901623+0000","last_clean":"2024-04-25T02:28:57.901623+0000","last_became_active":"2024-04-25T02:23:12.845429+0000","last_became_peered":"2024-04-25T02:23:12.845429+0000","last_unstale":"2024-04-25T02:28:57.901623+0000","last_undegraded":"2024-04-25T02:28:57.901623+0000","last_fullsized":"2024-04-25T02:28:57.901623+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'436","last_scrub_stamp":"2024-04-25T02:28:57.901454+0000","last_deep_scrub":"43'436","last_deep_scrub_stamp":"2024-04-25T02:28:57.901454+0000","last_clean_scrub_stamp":"2024-04-25T02:28:57.901454+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:48:22.177582+0000","scrub_duration":0.0024754489999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22592,"num_write":405,"num_write_kb":75650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"43'370","reported_seq":441,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:02.954241+0000","last_change":"2024-04-25T02:29:02.954173+0000","last_active":"2024-04-25T02:29:02.954241+0000","last_peered":"2024-04-25T02:29:02.954241+0000","last_clean":"2024-04-25T02:29:02.954241+0000","last_became_active":"2024-04-25T02:23:11.838054+0000","last_became_peered":"2024-04-25T02:23:11.838054+0000","last_unstale":"2024-04-25T02:29:02.954241+0000","last_undegraded":"2024-04-25T02:29:02.954241+0000","last_fullsized":"2024-04-25T02:29:02.954241+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'370","last_scrub_stamp":"2024-04-25T02:29:02.954067+0000","last_deep_scrub":"43'370","last_deep_scrub_stamp":"2024-04-25T02:29:02.954067+0000","last_clean_scrub_stamp":"2024-04-25T02:29:02.954067+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:35:19.757284+0000","scrub_duration":0.0024131999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":15817,"num_write":338,"num_write_kb":46402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"43'393","reported_seq":485,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:47.102595+0000","last_change":"2024-04-25T02:28:47.102563+0000","last_active":"2024-04-25T02:28:47.102595+0000","last_peered":"2024-04-25T02:28:47.102595+0000","last_clean":"2024-04-25T02:28:47.102595+0000","last_became_active":"2024-04-25T02:23:11.836681+0000","last_became_peered":"2024-04-25T02:23:11.836681+0000","last_unstale":"2024-04-25T02:28:47.102595+0000","last_undegraded":"2024-04-25T02:28:47.102595+0000","last_fullsized":"2024-04-25T02:28:47.102595+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'393","last_scrub_stamp":"2024-04-25T02:28:47.102463+0000","last_deep_scrub":"43'393","last_deep_scrub_stamp":"2024-04-25T02:28:47.102463+0000","last_clean_scrub_stamp":"2024-04-25T02:28:47.102463+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:03.660053+0000","scrub_duration":0.0021321360000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22923,"num_write":365,"num_write_kb":51318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"43'406","reported_seq":486,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:08.984923+0000","last_change":"2024-04-25T02:29:08.984891+0000","last_active":"2024-04-25T02:29:08.984923+0000","last_peered":"2024-04-25T02:29:08.984923+0000","last_clean":"2024-04-25T02:29:08.984923+0000","last_became_active":"2024-04-25T02:23:13.842918+0000","last_became_peered":"2024-04-25T02:23:13.842918+0000","last_unstale":"2024-04-25T02:29:08.984923+0000","last_undegraded":"2024-04-25T02:29:08.984923+0000","last_fullsized":"2024-04-25T02:29:08.984923+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'406","last_scrub_stamp":"2024-04-25T02:29:08.984789+0000","last_deep_scrub":"43'406","last_deep_scrub_stamp":"2024-04-25T02:29:08.984789+0000","last_clean_scrub_stamp":"2024-04-25T02:29:08.984789+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:26:07.312359+0000","scrub_duration":0.0021373719999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14619,"num_write":384,"num_write_kb":71611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"43'366","reported_seq":438,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:39.393603+0000","last_change":"2024-04-25T02:28:39.393572+0000","last_active":"2024-04-25T02:28:39.393603+0000","last_peered":"2024-04-25T02:28:39.393603+0000","last_clean":"2024-04-25T02:28:39.393603+0000","last_became_active":"2024-04-25T02:23:13.848160+0000","last_became_peered":"2024-04-25T02:23:13.848160+0000","last_unstale":"2024-04-25T02:28:39.393603+0000","last_undegraded":"2024-04-25T02:28:39.393603+0000","last_fullsized":"2024-04-25T02:28:39.393603+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'366","last_scrub_stamp":"2024-04-25T02:28:39.393471+0000","last_deep_scrub":"43'366","last_deep_scrub_stamp":"2024-04-25T02:28:39.393471+0000","last_clean_scrub_stamp":"2024-04-25T02:28:39.393471+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:09:44.749626+0000","scrub_duration":0.0023219040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12472,"num_write":338,"num_write_kb":33864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"43'441","reported_seq":570,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:56.387424+0000","last_change":"2024-04-25T02:29:56.387374+0000","last_active":"2024-04-25T02:29:56.387424+0000","last_peered":"2024-04-25T02:29:56.387424+0000","last_clean":"2024-04-25T02:29:56.387424+0000","last_became_active":"2024-04-25T02:23:13.840374+0000","last_became_peered":"2024-04-25T02:23:13.840374+0000","last_unstale":"2024-04-25T02:29:56.387424+0000","last_undegraded":"2024-04-25T02:29:56.387424+0000","last_fullsized":"2024-04-25T02:29:56.387424+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'441","last_scrub_stamp":"2024-04-25T02:29:56.387259+0000","last_deep_scrub":"43'441","last_deep_scrub_stamp":"2024-04-25T02:29:56.387259+0000","last_clean_scrub_stamp":"2024-04-25T02:29:56.387259+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:26:50.416924+0000","scrub_duration":0.0024312380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":40192,"num_write":416,"num_write_kb":101787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"43'364","reported_seq":441,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:03.943257+0000","last_change":"2024-04-25T02:29:03.943200+0000","last_active":"2024-04-25T02:29:03.943257+0000","last_peered":"2024-04-25T02:29:03.943257+0000","last_clean":"2024-04-25T02:29:03.943257+0000","last_became_active":"2024-04-25T02:23:11.834759+0000","last_became_peered":"2024-04-25T02:23:11.834759+0000","last_unstale":"2024-04-25T02:29:03.943257+0000","last_undegraded":"2024-04-25T02:29:03.943257+0000","last_fullsized":"2024-04-25T02:29:03.943257+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'364","last_scrub_stamp":"2024-04-25T02:29:03.943064+0000","last_deep_scrub":"43'364","last_deep_scrub_stamp":"2024-04-25T02:29:03.943064+0000","last_clean_scrub_stamp":"2024-04-25T02:29:03.943064+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:43:03.314177+0000","scrub_duration":0.0023381109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18431,"num_write":330,"num_write_kb":66835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"43'425","reported_seq":525,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:22.157783+0000","last_change":"2024-04-25T02:28:22.157736+0000","last_active":"2024-04-25T02:28:22.157783+0000","last_peered":"2024-04-25T02:28:22.157783+0000","last_clean":"2024-04-25T02:28:22.157783+0000","last_became_active":"2024-04-25T02:23:13.841883+0000","last_became_peered":"2024-04-25T02:23:13.841883+0000","last_unstale":"2024-04-25T02:28:22.157783+0000","last_undegraded":"2024-04-25T02:28:22.157783+0000","last_fullsized":"2024-04-25T02:28:22.157783+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'425","last_scrub_stamp":"2024-04-25T02:28:22.157614+0000","last_deep_scrub":"43'425","last_deep_scrub_stamp":"2024-04-25T02:28:22.157614+0000","last_clean_scrub_stamp":"2024-04-25T02:28:22.157614+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:28:28.713838+0000","scrub_duration":0.0023306529999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":29378,"num_write":387,"num_write_kb":39136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"43'396","reported_seq":480,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:45.945484+0000","last_change":"2024-04-25T02:28:45.945437+0000","last_active":"2024-04-25T02:28:45.945484+0000","last_peered":"2024-04-25T02:28:45.945484+0000","last_clean":"2024-04-25T02:28:45.945484+0000","last_became_active":"2024-04-25T02:23:11.835958+0000","last_became_peered":"2024-04-25T02:23:11.835958+0000","last_unstale":"2024-04-25T02:28:45.945484+0000","last_undegraded":"2024-04-25T02:28:45.945484+0000","last_fullsized":"2024-04-25T02:28:45.945484+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'396","last_scrub_stamp":"2024-04-25T02:28:45.945325+0000","last_deep_scrub":"43'396","last_deep_scrub_stamp":"2024-04-25T02:28:45.945325+0000","last_clean_scrub_stamp":"2024-04-25T02:28:45.945325+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:53:01.215968+0000","scrub_duration":0.002346295,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":25799,"num_write":352,"num_write_kb":67037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"43'354","reported_seq":404,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:00.899398+0000","last_change":"2024-04-25T02:29:00.899373+0000","last_active":"2024-04-25T02:29:00.899398+0000","last_peered":"2024-04-25T02:29:00.899398+0000","last_clean":"2024-04-25T02:29:00.899398+0000","last_became_active":"2024-04-25T02:23:11.836214+0000","last_became_peered":"2024-04-25T02:23:11.836214+0000","last_unstale":"2024-04-25T02:29:00.899398+0000","last_undegraded":"2024-04-25T02:29:00.899398+0000","last_fullsized":"2024-04-25T02:29:00.899398+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'354","last_scrub_stamp":"2024-04-25T02:29:00.899283+0000","last_deep_scrub":"43'354","last_deep_scrub_stamp":"2024-04-25T02:29:00.899283+0000","last_clean_scrub_stamp":"2024-04-25T02:29:00.899283+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:45.783246+0000","scrub_duration":0.0018755740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7176,"num_write":336,"num_write_kb":37702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"43'335","reported_seq":387,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:58.900017+0000","last_change":"2024-04-25T02:28:58.899981+0000","last_active":"2024-04-25T02:28:58.900017+0000","last_peered":"2024-04-25T02:28:58.900017+0000","last_clean":"2024-04-25T02:28:58.900017+0000","last_became_active":"2024-04-25T02:23:13.847446+0000","last_became_peered":"2024-04-25T02:23:13.847446+0000","last_unstale":"2024-04-25T02:28:58.900017+0000","last_undegraded":"2024-04-25T02:28:58.900017+0000","last_fullsized":"2024-04-25T02:28:58.900017+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'335","last_scrub_stamp":"2024-04-25T02:28:58.899850+0000","last_deep_scrub":"43'335","last_deep_scrub_stamp":"2024-04-25T02:28:58.899850+0000","last_clean_scrub_stamp":"2024-04-25T02:28:58.899850+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:53:40.661144+0000","scrub_duration":0.0020817689999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4160,"num_write":309,"num_write_kb":33908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"43'387","reported_seq":439,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:26.212350+0000","last_change":"2024-04-25T02:28:26.212320+0000","last_active":"2024-04-25T02:28:26.212350+0000","last_peered":"2024-04-25T02:28:26.212350+0000","last_clean":"2024-04-25T02:28:26.212350+0000","last_became_active":"2024-04-25T02:23:13.847009+0000","last_became_peered":"2024-04-25T02:23:13.847009+0000","last_unstale":"2024-04-25T02:28:26.212350+0000","last_undegraded":"2024-04-25T02:28:26.212350+0000","last_fullsized":"2024-04-25T02:28:26.212350+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'387","last_scrub_stamp":"2024-04-25T02:28:26.212204+0000","last_deep_scrub":"43'387","last_deep_scrub_stamp":"2024-04-25T02:28:26.212204+0000","last_clean_scrub_stamp":"2024-04-25T02:28:26.212204+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:25:07.412842+0000","scrub_duration":0.0024916069999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4152,"num_write":352,"num_write_kb":42524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"43'450","reported_seq":539,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:20.974106+0000","last_change":"2024-04-25T02:28:20.974062+0000","last_active":"2024-04-25T02:28:20.974106+0000","last_peered":"2024-04-25T02:28:20.974106+0000","last_clean":"2024-04-25T02:28:20.974106+0000","last_became_active":"2024-04-25T02:23:12.841783+0000","last_became_peered":"2024-04-25T02:23:12.841783+0000","last_unstale":"2024-04-25T02:28:20.974106+0000","last_undegraded":"2024-04-25T02:28:20.974106+0000","last_fullsized":"2024-04-25T02:28:20.974106+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'450","last_scrub_stamp":"2024-04-25T02:28:20.973929+0000","last_deep_scrub":"43'450","last_deep_scrub_stamp":"2024-04-25T02:28:20.973929+0000","last_clean_scrub_stamp":"2024-04-25T02:28:20.973929+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:56:11.043992+0000","scrub_duration":0.002462386,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":25198,"num_write":421,"num_write_kb":88864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"43'430","reported_seq":532,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:44.037754+0000","last_change":"2024-04-25T02:28:44.037712+0000","last_active":"2024-04-25T02:28:44.037754+0000","last_peered":"2024-04-25T02:28:44.037754+0000","last_clean":"2024-04-25T02:28:44.037754+0000","last_became_active":"2024-04-25T02:23:11.835815+0000","last_became_peered":"2024-04-25T02:23:11.835815+0000","last_unstale":"2024-04-25T02:28:44.037754+0000","last_undegraded":"2024-04-25T02:28:44.037754+0000","last_fullsized":"2024-04-25T02:28:44.037754+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'430","last_scrub_stamp":"2024-04-25T02:28:44.037608+0000","last_deep_scrub":"43'430","last_deep_scrub_stamp":"2024-04-25T02:28:44.037608+0000","last_clean_scrub_stamp":"2024-04-25T02:28:44.037608+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:53:08.207544+0000","scrub_duration":0.0021441519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31947,"num_write":393,"num_write_kb":64059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"43'438","reported_seq":473,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:20.052051+0000","last_change":"2024-04-25T02:29:20.052012+0000","last_active":"2024-04-25T02:29:20.052051+0000","last_peered":"2024-04-25T02:29:20.052051+0000","last_clean":"2024-04-25T02:29:20.052051+0000","last_became_active":"2024-04-25T02:23:55.963259+0000","last_became_peered":"2024-04-25T02:23:55.963259+0000","last_unstale":"2024-04-25T02:29:20.052051+0000","last_undegraded":"2024-04-25T02:29:20.052051+0000","last_fullsized":"2024-04-25T02:29:20.052051+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'438","last_scrub_stamp":"2024-04-25T02:29:20.051907+0000","last_deep_scrub":"43'438","last_deep_scrub_stamp":"2024-04-25T02:29:20.051907+0000","last_clean_scrub_stamp":"2024-04-25T02:29:20.051907+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:10:04.030325+0000","scrub_duration":0.00216768,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":2639,"num_write":405,"num_write_kb":51451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"43'394","reported_seq":467,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:38.963150+0000","last_change":"2024-04-25T02:29:38.963119+0000","last_active":"2024-04-25T02:29:38.963150+0000","last_peered":"2024-04-25T02:29:38.963150+0000","last_clean":"2024-04-25T02:29:38.963150+0000","last_became_active":"2024-04-25T02:23:13.844343+0000","last_became_peered":"2024-04-25T02:23:13.844343+0000","last_unstale":"2024-04-25T02:29:38.963150+0000","last_undegraded":"2024-04-25T02:29:38.963150+0000","last_fullsized":"2024-04-25T02:29:38.963150+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'394","last_scrub_stamp":"2024-04-25T02:29:38.963016+0000","last_deep_scrub":"43'394","last_deep_scrub_stamp":"2024-04-25T02:29:38.963016+0000","last_clean_scrub_stamp":"2024-04-25T02:29:38.963016+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:24:22.202965+0000","scrub_duration":0.0021597349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9696,"num_write":367,"num_write_kb":33966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"43'391","reported_seq":481,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:58.011960+0000","last_change":"2024-04-25T02:28:58.011911+0000","last_active":"2024-04-25T02:28:58.011960+0000","last_peered":"2024-04-25T02:28:58.011960+0000","last_clean":"2024-04-25T02:28:58.011960+0000","last_became_active":"2024-04-25T02:23:12.848051+0000","last_became_peered":"2024-04-25T02:23:12.848051+0000","last_unstale":"2024-04-25T02:28:58.011960+0000","last_undegraded":"2024-04-25T02:28:58.011960+0000","last_fullsized":"2024-04-25T02:28:58.011960+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'391","last_scrub_stamp":"2024-04-25T02:28:58.011806+0000","last_deep_scrub":"43'391","last_deep_scrub_stamp":"2024-04-25T02:28:58.011806+0000","last_clean_scrub_stamp":"2024-04-25T02:28:58.011806+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:06.338277+0000","scrub_duration":0.0021863519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":13345,"num_write":357,"num_write_kb":38441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"43'429","reported_seq":550,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:52.924323+0000","last_change":"2024-04-25T02:28:52.924295+0000","last_active":"2024-04-25T02:28:52.924323+0000","last_peered":"2024-04-25T02:28:52.924323+0000","last_clean":"2024-04-25T02:28:52.924323+0000","last_became_active":"2024-04-25T02:23:13.847602+0000","last_became_peered":"2024-04-25T02:23:13.847602+0000","last_unstale":"2024-04-25T02:28:52.924323+0000","last_undegraded":"2024-04-25T02:28:52.924323+0000","last_fullsized":"2024-04-25T02:28:52.924323+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'429","last_scrub_stamp":"2024-04-25T02:28:52.924165+0000","last_deep_scrub":"43'429","last_deep_scrub_stamp":"2024-04-25T02:28:52.924165+0000","last_clean_scrub_stamp":"2024-04-25T02:28:52.924165+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:54:54.792159+0000","scrub_duration":0.0025521599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":37845,"num_write":400,"num_write_kb":88566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"43'437","reported_seq":523,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:44.934901+0000","last_change":"2024-04-25T02:28:44.934874+0000","last_active":"2024-04-25T02:28:44.934901+0000","last_peered":"2024-04-25T02:28:44.934901+0000","last_clean":"2024-04-25T02:28:44.934901+0000","last_became_active":"2024-04-25T02:23:13.845934+0000","last_became_peered":"2024-04-25T02:23:13.845934+0000","last_unstale":"2024-04-25T02:28:44.934901+0000","last_undegraded":"2024-04-25T02:28:44.934901+0000","last_fullsized":"2024-04-25T02:28:44.934901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'437","last_scrub_stamp":"2024-04-25T02:28:44.934771+0000","last_deep_scrub":"43'437","last_deep_scrub_stamp":"2024-04-25T02:28:44.934771+0000","last_clean_scrub_stamp":"2024-04-25T02:28:44.934771+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:07.359904+0000","scrub_duration":0.002337244,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":22073,"num_write":412,"num_write_kb":67090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"43'414","reported_seq":517,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:04.980449+0000","last_change":"2024-04-25T02:29:04.980413+0000","last_active":"2024-04-25T02:29:04.980449+0000","last_peered":"2024-04-25T02:29:04.980449+0000","last_clean":"2024-04-25T02:29:04.980449+0000","last_became_active":"2024-04-25T02:23:13.846758+0000","last_became_peered":"2024-04-25T02:23:13.846758+0000","last_unstale":"2024-04-25T02:29:04.980449+0000","last_undegraded":"2024-04-25T02:29:04.980449+0000","last_fullsized":"2024-04-25T02:29:04.980449+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'414","last_scrub_stamp":"2024-04-25T02:29:04.980312+0000","last_deep_scrub":"43'414","last_deep_scrub_stamp":"2024-04-25T02:29:04.980312+0000","last_clean_scrub_stamp":"2024-04-25T02:29:04.980312+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:54:37.287485+0000","scrub_duration":0.0022436330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":24525,"num_write":378,"num_write_kb":100342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"43'445","reported_seq":529,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:54.117074+0000","last_change":"2024-04-25T02:28:54.117045+0000","last_active":"2024-04-25T02:28:54.117074+0000","last_peered":"2024-04-25T02:28:54.117074+0000","last_clean":"2024-04-25T02:28:54.117074+0000","last_became_active":"2024-04-25T02:23:11.835319+0000","last_became_peered":"2024-04-25T02:23:11.835319+0000","last_unstale":"2024-04-25T02:28:54.117074+0000","last_undegraded":"2024-04-25T02:28:54.117074+0000","last_fullsized":"2024-04-25T02:28:54.117074+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'445","last_scrub_stamp":"2024-04-25T02:28:54.116947+0000","last_deep_scrub":"43'445","last_deep_scrub_stamp":"2024-04-25T02:28:54.116947+0000","last_clean_scrub_stamp":"2024-04-25T02:28:54.116947+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:58:51.124066+0000","scrub_duration":0.0023452529999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":18532,"num_write":411,"num_write_kb":84101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"43'408","reported_seq":526,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:29.377058+0000","last_change":"2024-04-25T02:28:29.377031+0000","last_active":"2024-04-25T02:28:29.377058+0000","last_peered":"2024-04-25T02:28:29.377058+0000","last_clean":"2024-04-25T02:28:29.377058+0000","last_became_active":"2024-04-25T02:23:13.838917+0000","last_became_peered":"2024-04-25T02:23:13.838917+0000","last_unstale":"2024-04-25T02:28:29.377058+0000","last_undegraded":"2024-04-25T02:28:29.377058+0000","last_fullsized":"2024-04-25T02:28:29.377058+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'408","last_scrub_stamp":"2024-04-25T02:28:29.376935+0000","last_deep_scrub":"43'408","last_deep_scrub_stamp":"2024-04-25T02:28:29.376935+0000","last_clean_scrub_stamp":"2024-04-25T02:28:29.376935+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:25:26.084049+0000","scrub_duration":0.002236952,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":25750,"num_write":380,"num_write_kb":75795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"43'451","reported_seq":527,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:12.994175+0000","last_change":"2024-04-25T02:29:12.994140+0000","last_active":"2024-04-25T02:29:12.994175+0000","last_peered":"2024-04-25T02:29:12.994175+0000","last_clean":"2024-04-25T02:29:12.994175+0000","last_became_active":"2024-04-25T02:23:13.845814+0000","last_became_peered":"2024-04-25T02:23:13.845814+0000","last_unstale":"2024-04-25T02:29:12.994175+0000","last_undegraded":"2024-04-25T02:29:12.994175+0000","last_fullsized":"2024-04-25T02:29:12.994175+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'451","last_scrub_stamp":"2024-04-25T02:29:12.994028+0000","last_deep_scrub":"43'451","last_deep_scrub_stamp":"2024-04-25T02:29:12.994028+0000","last_clean_scrub_stamp":"2024-04-25T02:29:12.994028+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:57:15.232896+0000","scrub_duration":0.0023399319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13960,"num_write":428,"num_write_kb":96160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"43'397","reported_seq":460,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:38.013962+0000","last_change":"2024-04-25T02:28:38.013905+0000","last_active":"2024-04-25T02:28:38.013962+0000","last_peered":"2024-04-25T02:28:38.013962+0000","last_clean":"2024-04-25T02:28:38.013962+0000","last_became_active":"2024-04-25T02:23:13.852093+0000","last_became_peered":"2024-04-25T02:23:13.852093+0000","last_unstale":"2024-04-25T02:28:38.013962+0000","last_undegraded":"2024-04-25T02:28:38.013962+0000","last_fullsized":"2024-04-25T02:28:38.013962+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'397","last_scrub_stamp":"2024-04-25T02:28:38.013798+0000","last_deep_scrub":"43'397","last_deep_scrub_stamp":"2024-04-25T02:28:38.013798+0000","last_clean_scrub_stamp":"2024-04-25T02:28:38.013798+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:40:41.237724+0000","scrub_duration":0.0021175439999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":3870,"num_write":383,"num_write_kb":17738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"43'485","reported_seq":577,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:20.987687+0000","last_change":"2024-04-25T02:29:20.987666+0000","last_active":"2024-04-25T02:29:20.987687+0000","last_peered":"2024-04-25T02:29:20.987687+0000","last_clean":"2024-04-25T02:29:20.987687+0000","last_became_active":"2024-04-25T02:23:12.841477+0000","last_became_peered":"2024-04-25T02:23:12.841477+0000","last_unstale":"2024-04-25T02:29:20.987687+0000","last_undegraded":"2024-04-25T02:29:20.987687+0000","last_fullsized":"2024-04-25T02:29:20.987687+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'485","last_scrub_stamp":"2024-04-25T02:29:20.987575+0000","last_deep_scrub":"43'485","last_deep_scrub_stamp":"2024-04-25T02:29:20.987575+0000","last_clean_scrub_stamp":"2024-04-25T02:29:20.987575+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:34:13.118720+0000","scrub_duration":0.001798006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24645,"num_write":445,"num_write_kb":96750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"43'384","reported_seq":468,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:57.542986+0000","last_change":"2024-04-25T02:28:57.542945+0000","last_active":"2024-04-25T02:28:57.542986+0000","last_peered":"2024-04-25T02:28:57.542986+0000","last_clean":"2024-04-25T02:28:57.542986+0000","last_became_active":"2024-04-25T02:23:13.840422+0000","last_became_peered":"2024-04-25T02:23:13.840422+0000","last_unstale":"2024-04-25T02:28:57.542986+0000","last_undegraded":"2024-04-25T02:28:57.542986+0000","last_fullsized":"2024-04-25T02:28:57.542986+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'384","last_scrub_stamp":"2024-04-25T02:28:57.542849+0000","last_deep_scrub":"43'384","last_deep_scrub_stamp":"2024-04-25T02:28:57.542849+0000","last_clean_scrub_stamp":"2024-04-25T02:28:57.542849+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:56:54.046678+0000","scrub_duration":0.002320112,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":6130,"num_write":356,"num_write_kb":25986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"43'568","reported_seq":612,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:30.058301+0000","last_change":"2024-04-25T02:28:30.058267+0000","last_active":"2024-04-25T02:28:30.058301+0000","last_peered":"2024-04-25T02:28:30.058301+0000","last_clean":"2024-04-25T02:28:30.058301+0000","last_became_active":"2024-04-25T02:23:12.845923+0000","last_became_peered":"2024-04-25T02:23:12.845923+0000","last_unstale":"2024-04-25T02:28:30.058301+0000","last_undegraded":"2024-04-25T02:28:30.058301+0000","last_fullsized":"2024-04-25T02:28:30.058301+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'568","last_scrub_stamp":"2024-04-25T02:28:30.058171+0000","last_deep_scrub":"43'568","last_deep_scrub_stamp":"2024-04-25T02:28:30.058171+0000","last_clean_scrub_stamp":"2024-04-25T02:28:30.058171+0000","objects_scrubbed":3,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:07:27.211762+0000","scrub_duration":0.028959043,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":494,"num_write_kb":12610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"43'420","reported_seq":546,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:28.561650+0000","last_change":"2024-04-25T02:29:28.561602+0000","last_active":"2024-04-25T02:29:28.561650+0000","last_peered":"2024-04-25T02:29:28.561650+0000","last_clean":"2024-04-25T02:29:28.561650+0000","last_became_active":"2024-04-25T02:23:13.848844+0000","last_became_peered":"2024-04-25T02:23:13.848844+0000","last_unstale":"2024-04-25T02:29:28.561650+0000","last_undegraded":"2024-04-25T02:29:28.561650+0000","last_fullsized":"2024-04-25T02:29:28.561650+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'420","last_scrub_stamp":"2024-04-25T02:29:28.561478+0000","last_deep_scrub":"43'420","last_deep_scrub_stamp":"2024-04-25T02:29:28.561478+0000","last_clean_scrub_stamp":"2024-04-25T02:29:28.561478+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:18:30.047716+0000","scrub_duration":0.0024681999999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":41312,"num_write":376,"num_write_kb":112833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"43'384","reported_seq":430,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:50.931544+0000","last_change":"2024-04-25T02:28:50.931513+0000","last_active":"2024-04-25T02:28:50.931544+0000","last_peered":"2024-04-25T02:28:50.931544+0000","last_clean":"2024-04-25T02:28:50.931544+0000","last_became_active":"2024-04-25T02:23:13.846821+0000","last_became_peered":"2024-04-25T02:23:13.846821+0000","last_unstale":"2024-04-25T02:28:50.931544+0000","last_undegraded":"2024-04-25T02:28:50.931544+0000","last_fullsized":"2024-04-25T02:28:50.931544+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'384","last_scrub_stamp":"2024-04-25T02:28:50.931418+0000","last_deep_scrub":"43'384","last_deep_scrub_stamp":"2024-04-25T02:28:50.931418+0000","last_clean_scrub_stamp":"2024-04-25T02:28:50.931418+0000","objects_scrubbed":1,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:34:41.263744+0000","scrub_duration":0.013025725,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":334,"num_write_kb":4317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"43'428","reported_seq":532,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.942722+0000","last_change":"2024-04-25T02:29:19.942675+0000","last_active":"2024-04-25T02:29:19.942722+0000","last_peered":"2024-04-25T02:29:19.942722+0000","last_clean":"2024-04-25T02:29:19.942722+0000","last_became_active":"2024-04-25T02:23:11.840274+0000","last_became_peered":"2024-04-25T02:23:11.840274+0000","last_unstale":"2024-04-25T02:29:19.942722+0000","last_undegraded":"2024-04-25T02:29:19.942722+0000","last_fullsized":"2024-04-25T02:29:19.942722+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'428","last_scrub_stamp":"2024-04-25T02:29:19.942571+0000","last_deep_scrub":"43'428","last_deep_scrub_stamp":"2024-04-25T02:29:19.942571+0000","last_clean_scrub_stamp":"2024-04-25T02:29:19.942571+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:00:33.792441+0000","scrub_duration":0.0026123420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":28196,"num_write":410,"num_write_kb":104265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"43'877","reported_seq":934,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:51.504360+0000","last_change":"2024-04-25T02:29:51.504333+0000","last_active":"2024-04-25T02:29:51.504360+0000","last_peered":"2024-04-25T02:29:51.504360+0000","last_clean":"2024-04-25T02:29:51.504360+0000","last_became_active":"2024-04-25T02:23:13.839361+0000","last_became_peered":"2024-04-25T02:23:13.839361+0000","last_unstale":"2024-04-25T02:29:51.504360+0000","last_undegraded":"2024-04-25T02:29:51.504360+0000","last_fullsized":"2024-04-25T02:29:51.504360+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'877","last_scrub_stamp":"2024-04-25T02:29:51.504233+0000","last_deep_scrub":"43'877","last_deep_scrub_stamp":"2024-04-25T02:29:51.504233+0000","last_clean_scrub_stamp":"2024-04-25T02:29:51.504233+0000","objects_scrubbed":2,"log_size":877,"log_dups_size":0,"ondisk_log_size":877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:00:50.430903+0000","scrub_duration":0.023179807,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":809,"num_write_kb":8568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"43'365","reported_seq":454,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:29.545278+0000","last_change":"2024-04-25T02:29:29.545240+0000","last_active":"2024-04-25T02:29:29.545278+0000","last_peered":"2024-04-25T02:29:29.545278+0000","last_clean":"2024-04-25T02:29:29.545278+0000","last_became_active":"2024-04-25T02:23:13.843656+0000","last_became_peered":"2024-04-25T02:23:13.843656+0000","last_unstale":"2024-04-25T02:29:29.545278+0000","last_undegraded":"2024-04-25T02:29:29.545278+0000","last_fullsized":"2024-04-25T02:29:29.545278+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'365","last_scrub_stamp":"2024-04-25T02:29:29.545140+0000","last_deep_scrub":"43'365","last_deep_scrub_stamp":"2024-04-25T02:29:29.545140+0000","last_clean_scrub_stamp":"2024-04-25T02:29:29.545140+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:41:01.806067+0000","scrub_duration":0.001924748,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":25136,"num_write":341,"num_write_kb":38831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"43'58","reported_seq":108,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:11.928495+0000","last_change":"2024-04-25T02:29:11.928453+0000","last_active":"2024-04-25T02:29:11.928495+0000","last_peered":"2024-04-25T02:29:11.928495+0000","last_clean":"2024-04-25T02:29:11.928495+0000","last_became_active":"2024-04-25T02:23:13.842598+0000","last_became_peered":"2024-04-25T02:23:13.842598+0000","last_unstale":"2024-04-25T02:29:11.928495+0000","last_undegraded":"2024-04-25T02:29:11.928495+0000","last_fullsized":"2024-04-25T02:29:11.928495+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'58","last_scrub_stamp":"2024-04-25T02:29:11.928351+0000","last_deep_scrub":"43'58","last_deep_scrub_stamp":"2024-04-25T02:29:11.928351+0000","last_clean_scrub_stamp":"2024-04-25T02:29:11.928351+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:20:47.749490+0000","scrub_duration":0.0035073959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"43'467","reported_seq":553,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:43.405508+0000","last_change":"2024-04-25T02:29:43.405465+0000","last_active":"2024-04-25T02:29:43.405508+0000","last_peered":"2024-04-25T02:29:43.405508+0000","last_clean":"2024-04-25T02:29:43.405508+0000","last_became_active":"2024-04-25T02:23:13.848675+0000","last_became_peered":"2024-04-25T02:23:13.848675+0000","last_unstale":"2024-04-25T02:29:43.405508+0000","last_undegraded":"2024-04-25T02:29:43.405508+0000","last_fullsized":"2024-04-25T02:29:43.405508+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'467","last_scrub_stamp":"2024-04-25T02:29:43.405348+0000","last_deep_scrub":"43'467","last_deep_scrub_stamp":"2024-04-25T02:29:43.405348+0000","last_clean_scrub_stamp":"2024-04-25T02:29:43.405348+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:13:05.345571+0000","scrub_duration":0.0022427039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":13580,"num_write":443,"num_write_kb":92928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"43'342","reported_seq":387,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:50.982472+0000","last_change":"2024-04-25T02:28:50.982445+0000","last_active":"2024-04-25T02:28:50.982472+0000","last_peered":"2024-04-25T02:28:50.982472+0000","last_clean":"2024-04-25T02:28:50.982472+0000","last_became_active":"2024-04-25T02:23:13.846764+0000","last_became_peered":"2024-04-25T02:23:13.846764+0000","last_unstale":"2024-04-25T02:28:50.982472+0000","last_undegraded":"2024-04-25T02:28:50.982472+0000","last_fullsized":"2024-04-25T02:28:50.982472+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'342","last_scrub_stamp":"2024-04-25T02:28:50.982355+0000","last_deep_scrub":"43'342","last_deep_scrub_stamp":"2024-04-25T02:28:50.982355+0000","last_clean_scrub_stamp":"2024-04-25T02:28:50.982355+0000","objects_scrubbed":2,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:42:20.126126+0000","scrub_duration":0.013249924999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":281,"num_write_kb":4273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"43'477","reported_seq":587,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:42.432082+0000","last_change":"2024-04-25T02:29:42.432052+0000","last_active":"2024-04-25T02:29:42.432082+0000","last_peered":"2024-04-25T02:29:42.432082+0000","last_clean":"2024-04-25T02:29:42.432082+0000","last_became_active":"2024-04-25T02:23:13.839702+0000","last_became_peered":"2024-04-25T02:23:13.839702+0000","last_unstale":"2024-04-25T02:29:42.432082+0000","last_undegraded":"2024-04-25T02:29:42.432082+0000","last_fullsized":"2024-04-25T02:29:42.432082+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'477","last_scrub_stamp":"2024-04-25T02:29:42.431949+0000","last_deep_scrub":"43'477","last_deep_scrub_stamp":"2024-04-25T02:29:42.431949+0000","last_clean_scrub_stamp":"2024-04-25T02:29:42.431949+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:05:59.797416+0000","scrub_duration":0.0023962509999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":30102,"num_write":452,"num_write_kb":97286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"43'139","reported_seq":192,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:46.068929+0000","last_change":"2024-04-25T02:28:46.068904+0000","last_active":"2024-04-25T02:28:46.068929+0000","last_peered":"2024-04-25T02:28:46.068929+0000","last_clean":"2024-04-25T02:28:46.068929+0000","last_became_active":"2024-04-25T02:23:13.843625+0000","last_became_peered":"2024-04-25T02:23:13.843625+0000","last_unstale":"2024-04-25T02:28:46.068929+0000","last_undegraded":"2024-04-25T02:28:46.068929+0000","last_fullsized":"2024-04-25T02:28:46.068929+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'139","last_scrub_stamp":"2024-04-25T02:28:46.068815+0000","last_deep_scrub":"43'139","last_deep_scrub_stamp":"2024-04-25T02:28:46.068815+0000","last_clean_scrub_stamp":"2024-04-25T02:28:46.068815+0000","objects_scrubbed":3,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:26.672574+0000","scrub_duration":0.0037700569999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":72,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"43'422","reported_seq":506,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:10.977270+0000","last_change":"2024-04-25T02:29:10.977195+0000","last_active":"2024-04-25T02:29:10.977270+0000","last_peered":"2024-04-25T02:29:10.977270+0000","last_clean":"2024-04-25T02:29:10.977270+0000","last_became_active":"2024-04-25T02:23:13.850845+0000","last_became_peered":"2024-04-25T02:23:13.850845+0000","last_unstale":"2024-04-25T02:29:10.977270+0000","last_undegraded":"2024-04-25T02:29:10.977270+0000","last_fullsized":"2024-04-25T02:29:10.977270+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'422","last_scrub_stamp":"2024-04-25T02:29:10.977055+0000","last_deep_scrub":"43'422","last_deep_scrub_stamp":"2024-04-25T02:29:10.977055+0000","last_clean_scrub_stamp":"2024-04-25T02:29:10.977055+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:29:00.511972+0000","scrub_duration":0.002540123,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":24672,"num_write":391,"num_write_kb":75497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"43'352","reported_seq":407,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:59.567581+0000","last_change":"2024-04-25T02:28:59.567554+0000","last_active":"2024-04-25T02:28:59.567581+0000","last_peered":"2024-04-25T02:28:59.567581+0000","last_clean":"2024-04-25T02:28:59.567581+0000","last_became_active":"2024-04-25T02:23:13.845176+0000","last_became_peered":"2024-04-25T02:23:13.845176+0000","last_unstale":"2024-04-25T02:28:59.567581+0000","last_undegraded":"2024-04-25T02:28:59.567581+0000","last_fullsized":"2024-04-25T02:28:59.567581+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'352","last_scrub_stamp":"2024-04-25T02:28:59.567461+0000","last_deep_scrub":"43'352","last_deep_scrub_stamp":"2024-04-25T02:28:59.567461+0000","last_clean_scrub_stamp":"2024-04-25T02:28:59.567461+0000","objects_scrubbed":7,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:49.240975+0000","scrub_duration":0.026732694000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10356006,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":7,"num_read_kb":10,"num_write":291,"num_write_kb":10309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"43'405","reported_seq":483,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:30.146025+0000","last_change":"2024-04-25T02:28:30.145967+0000","last_active":"2024-04-25T02:28:30.146025+0000","last_peered":"2024-04-25T02:28:30.146025+0000","last_clean":"2024-04-25T02:28:30.146025+0000","last_became_active":"2024-04-25T02:23:55.963655+0000","last_became_peered":"2024-04-25T02:23:55.963655+0000","last_unstale":"2024-04-25T02:28:30.146025+0000","last_undegraded":"2024-04-25T02:28:30.146025+0000","last_fullsized":"2024-04-25T02:28:30.146025+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'405","last_scrub_stamp":"2024-04-25T02:28:30.145854+0000","last_deep_scrub":"43'405","last_deep_scrub_stamp":"2024-04-25T02:28:30.145854+0000","last_clean_scrub_stamp":"2024-04-25T02:28:30.145854+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:49.219885+0000","scrub_duration":0.0021986240000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":11609,"num_write":365,"num_write_kb":76437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"43'498","reported_seq":557,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:53.568295+0000","last_change":"2024-04-25T02:28:53.568258+0000","last_active":"2024-04-25T02:28:53.568295+0000","last_peered":"2024-04-25T02:28:53.568295+0000","last_clean":"2024-04-25T02:28:53.568295+0000","last_became_active":"2024-04-25T02:23:13.839158+0000","last_became_peered":"2024-04-25T02:23:13.839158+0000","last_unstale":"2024-04-25T02:28:53.568295+0000","last_undegraded":"2024-04-25T02:28:53.568295+0000","last_fullsized":"2024-04-25T02:28:53.568295+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'498","last_scrub_stamp":"2024-04-25T02:28:53.568128+0000","last_deep_scrub":"43'498","last_deep_scrub_stamp":"2024-04-25T02:28:53.568128+0000","last_clean_scrub_stamp":"2024-04-25T02:28:53.568128+0000","objects_scrubbed":5,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:05.588274+0000","scrub_duration":0.023077066,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":7,"num_write":435,"num_write_kb":8384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"43'409","reported_seq":499,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:17.565528+0000","last_change":"2024-04-25T02:29:17.565499+0000","last_active":"2024-04-25T02:29:17.565528+0000","last_peered":"2024-04-25T02:29:17.565528+0000","last_clean":"2024-04-25T02:29:17.565528+0000","last_became_active":"2024-04-25T02:23:13.843441+0000","last_became_peered":"2024-04-25T02:23:13.843441+0000","last_unstale":"2024-04-25T02:29:17.565528+0000","last_undegraded":"2024-04-25T02:29:17.565528+0000","last_fullsized":"2024-04-25T02:29:17.565528+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'409","last_scrub_stamp":"2024-04-25T02:29:17.565355+0000","last_deep_scrub":"43'409","last_deep_scrub_stamp":"2024-04-25T02:29:17.565355+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.565355+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:21:28.285231+0000","scrub_duration":0.002262787,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":25550,"num_write":379,"num_write_kb":104949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"43'52","reported_seq":101,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:57.048479+0000","last_change":"2024-04-25T02:28:57.048450+0000","last_active":"2024-04-25T02:28:57.048479+0000","last_peered":"2024-04-25T02:28:57.048479+0000","last_clean":"2024-04-25T02:28:57.048479+0000","last_became_active":"2024-04-25T02:23:13.841976+0000","last_became_peered":"2024-04-25T02:23:13.841976+0000","last_unstale":"2024-04-25T02:28:57.048479+0000","last_undegraded":"2024-04-25T02:28:57.048479+0000","last_fullsized":"2024-04-25T02:28:57.048479+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'52","last_scrub_stamp":"2024-04-25T02:28:57.048342+0000","last_deep_scrub":"43'52","last_deep_scrub_stamp":"2024-04-25T02:28:57.048342+0000","last_clean_scrub_stamp":"2024-04-25T02:28:57.048342+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:56.353296+0000","scrub_duration":0.0026068649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"43'407","reported_seq":493,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:12.354407+0000","last_change":"2024-04-25T02:23:13.843455+0000","last_active":"2024-04-25T02:28:12.354407+0000","last_peered":"2024-04-25T02:28:12.354407+0000","last_clean":"2024-04-25T02:28:12.354407+0000","last_became_active":"2024-04-25T02:23:13.842163+0000","last_became_peered":"2024-04-25T02:23:13.842163+0000","last_unstale":"2024-04-25T02:28:12.354407+0000","last_undegraded":"2024-04-25T02:28:12.354407+0000","last_fullsized":"2024-04-25T02:28:12.354407+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:20:23.840633+0000","last_clean_scrub_stamp":"2024-04-25T02:20:23.840633+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":18209,"num_write":378,"num_write_kb":67140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"43'57","reported_seq":107,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:06.608522+0000","last_change":"2024-04-25T02:29:06.608493+0000","last_active":"2024-04-25T02:29:06.608522+0000","last_peered":"2024-04-25T02:29:06.608522+0000","last_clean":"2024-04-25T02:29:06.608522+0000","last_became_active":"2024-04-25T02:23:13.838616+0000","last_became_peered":"2024-04-25T02:23:13.838616+0000","last_unstale":"2024-04-25T02:29:06.608522+0000","last_undegraded":"2024-04-25T02:29:06.608522+0000","last_fullsized":"2024-04-25T02:29:06.608522+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'57","last_scrub_stamp":"2024-04-25T02:29:06.608385+0000","last_deep_scrub":"43'57","last_deep_scrub_stamp":"2024-04-25T02:29:06.608385+0000","last_clean_scrub_stamp":"2024-04-25T02:29:06.608385+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:29:37.490299+0000","scrub_duration":0.0015486569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"43'445","reported_seq":575,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:39.963470+0000","last_change":"2024-04-25T02:29:39.963435+0000","last_active":"2024-04-25T02:29:39.963470+0000","last_peered":"2024-04-25T02:29:39.963470+0000","last_clean":"2024-04-25T02:29:39.963470+0000","last_became_active":"2024-04-25T02:23:13.842649+0000","last_became_peered":"2024-04-25T02:23:13.842649+0000","last_unstale":"2024-04-25T02:29:39.963470+0000","last_undegraded":"2024-04-25T02:29:39.963470+0000","last_fullsized":"2024-04-25T02:29:39.963470+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'445","last_scrub_stamp":"2024-04-25T02:29:39.963327+0000","last_deep_scrub":"43'445","last_deep_scrub_stamp":"2024-04-25T02:29:39.963327+0000","last_clean_scrub_stamp":"2024-04-25T02:29:39.963327+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:30:25.914338+0000","scrub_duration":0.002187615,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":37870,"num_write":411,"num_write_kb":80233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"43'68","reported_seq":116,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:51.908386+0000","last_change":"2024-04-25T02:28:51.908344+0000","last_active":"2024-04-25T02:28:51.908386+0000","last_peered":"2024-04-25T02:28:51.908386+0000","last_clean":"2024-04-25T02:28:51.908386+0000","last_became_active":"2024-04-25T02:23:11.835077+0000","last_became_peered":"2024-04-25T02:23:11.835077+0000","last_unstale":"2024-04-25T02:28:51.908386+0000","last_undegraded":"2024-04-25T02:28:51.908386+0000","last_fullsized":"2024-04-25T02:28:51.908386+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'68","last_scrub_stamp":"2024-04-25T02:28:51.908233+0000","last_deep_scrub":"43'68","last_deep_scrub_stamp":"2024-04-25T02:28:51.908233+0000","last_clean_scrub_stamp":"2024-04-25T02:28:51.908233+0000","objects_scrubbed":5,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:49.010130+0000","scrub_duration":0.0047405470000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"43'390","reported_seq":531,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:49.471264+0000","last_change":"2024-04-25T02:28:49.471228+0000","last_active":"2024-04-25T02:28:49.471264+0000","last_peered":"2024-04-25T02:28:49.471264+0000","last_clean":"2024-04-25T02:28:49.471264+0000","last_became_active":"2024-04-25T02:23:13.843347+0000","last_became_peered":"2024-04-25T02:23:13.843347+0000","last_unstale":"2024-04-25T02:28:49.471264+0000","last_undegraded":"2024-04-25T02:28:49.471264+0000","last_fullsized":"2024-04-25T02:28:49.471264+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'390","last_scrub_stamp":"2024-04-25T02:28:49.471125+0000","last_deep_scrub":"43'390","last_deep_scrub_stamp":"2024-04-25T02:28:49.471125+0000","last_clean_scrub_stamp":"2024-04-25T02:28:49.471125+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:04:13.159114+0000","scrub_duration":0.0021407000000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":42863,"num_write":360,"num_write_kb":59443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"43'201","reported_seq":249,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:00.019630+0000","last_change":"2024-04-25T02:29:00.019602+0000","last_active":"2024-04-25T02:29:00.019630+0000","last_peered":"2024-04-25T02:29:00.019630+0000","last_clean":"2024-04-25T02:29:00.019630+0000","last_became_active":"2024-04-25T02:23:11.839157+0000","last_became_peered":"2024-04-25T02:23:11.839157+0000","last_unstale":"2024-04-25T02:29:00.019630+0000","last_undegraded":"2024-04-25T02:29:00.019630+0000","last_fullsized":"2024-04-25T02:29:00.019630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'201","last_scrub_stamp":"2024-04-25T02:29:00.019504+0000","last_deep_scrub":"43'201","last_deep_scrub_stamp":"2024-04-25T02:29:00.019504+0000","last_clean_scrub_stamp":"2024-04-25T02:29:00.019504+0000","objects_scrubbed":2,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:17.465468+0000","scrub_duration":0.01223805,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":142,"num_write_kb":4183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"43'404","reported_seq":481,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:39.499704+0000","last_change":"2024-04-25T02:29:39.499674+0000","last_active":"2024-04-25T02:29:39.499704+0000","last_peered":"2024-04-25T02:29:39.499704+0000","last_clean":"2024-04-25T02:29:39.499704+0000","last_became_active":"2024-04-25T02:23:13.840951+0000","last_became_peered":"2024-04-25T02:23:13.840951+0000","last_unstale":"2024-04-25T02:29:39.499704+0000","last_undegraded":"2024-04-25T02:29:39.499704+0000","last_fullsized":"2024-04-25T02:29:39.499704+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'404","last_scrub_stamp":"2024-04-25T02:29:39.499537+0000","last_deep_scrub":"43'404","last_deep_scrub_stamp":"2024-04-25T02:29:39.499537+0000","last_clean_scrub_stamp":"2024-04-25T02:29:39.499537+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:42:15.999610+0000","scrub_duration":0.002371059,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12931,"num_write":370,"num_write_kb":42530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"43'368","reported_seq":423,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:15.999378+0000","last_change":"2024-04-25T02:29:15.999350+0000","last_active":"2024-04-25T02:29:15.999378+0000","last_peered":"2024-04-25T02:29:15.999378+0000","last_clean":"2024-04-25T02:29:15.999378+0000","last_became_active":"2024-04-25T02:23:12.847813+0000","last_became_peered":"2024-04-25T02:23:12.847813+0000","last_unstale":"2024-04-25T02:29:15.999378+0000","last_undegraded":"2024-04-25T02:29:15.999378+0000","last_fullsized":"2024-04-25T02:29:15.999378+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'368","last_scrub_stamp":"2024-04-25T02:29:15.999218+0000","last_deep_scrub":"43'368","last_deep_scrub_stamp":"2024-04-25T02:29:15.999218+0000","last_clean_scrub_stamp":"2024-04-25T02:29:15.999218+0000","objects_scrubbed":2,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:42:23.358864+0000","scrub_duration":0.013353834,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":311,"num_write_kb":4273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"43'442","reported_seq":502,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:24.178739+0000","last_change":"2024-04-25T02:29:24.178707+0000","last_active":"2024-04-25T02:29:24.178739+0000","last_peered":"2024-04-25T02:29:24.178739+0000","last_clean":"2024-04-25T02:29:24.178739+0000","last_became_active":"2024-04-25T02:23:55.963234+0000","last_became_peered":"2024-04-25T02:23:55.963234+0000","last_unstale":"2024-04-25T02:29:24.178739+0000","last_undegraded":"2024-04-25T02:29:24.178739+0000","last_fullsized":"2024-04-25T02:29:24.178739+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'442","last_scrub_stamp":"2024-04-25T02:29:24.178598+0000","last_deep_scrub":"43'442","last_deep_scrub_stamp":"2024-04-25T02:29:24.178598+0000","last_clean_scrub_stamp":"2024-04-25T02:29:24.178598+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:37:43.717819+0000","scrub_duration":0.0021811489999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21039,"num_write":415,"num_write_kb":62968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"43'596","reported_seq":650,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:12.598908+0000","last_change":"2024-04-25T02:29:12.598859+0000","last_active":"2024-04-25T02:29:12.598908+0000","last_peered":"2024-04-25T02:29:12.598908+0000","last_clean":"2024-04-25T02:29:12.598908+0000","last_became_active":"2024-04-25T02:23:13.843704+0000","last_became_peered":"2024-04-25T02:23:13.843704+0000","last_unstale":"2024-04-25T02:29:12.598908+0000","last_undegraded":"2024-04-25T02:29:12.598908+0000","last_fullsized":"2024-04-25T02:29:12.598908+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'596","last_scrub_stamp":"2024-04-25T02:29:12.598768+0000","last_deep_scrub":"43'596","last_deep_scrub_stamp":"2024-04-25T02:29:12.598768+0000","last_clean_scrub_stamp":"2024-04-25T02:29:12.598768+0000","objects_scrubbed":2,"log_size":596,"log_dups_size":0,"ondisk_log_size":596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:48:20.391354+0000","scrub_duration":0.014912345,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":532,"num_write_kb":4350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"43'411","reported_seq":507,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:17.022137+0000","last_change":"2024-04-25T02:29:17.022100+0000","last_active":"2024-04-25T02:29:17.022137+0000","last_peered":"2024-04-25T02:29:17.022137+0000","last_clean":"2024-04-25T02:29:17.022137+0000","last_became_active":"2024-04-25T02:23:13.845782+0000","last_became_peered":"2024-04-25T02:23:13.845782+0000","last_unstale":"2024-04-25T02:29:17.022137+0000","last_undegraded":"2024-04-25T02:29:17.022137+0000","last_fullsized":"2024-04-25T02:29:17.022137+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'411","last_scrub_stamp":"2024-04-25T02:29:17.021916+0000","last_deep_scrub":"43'411","last_deep_scrub_stamp":"2024-04-25T02:29:17.021916+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.021916+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:53:37.771149+0000","scrub_duration":0.0025137620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":24562,"num_write":375,"num_write_kb":59351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"43'59","reported_seq":108,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:50.131386+0000","last_change":"2024-04-25T02:28:50.131363+0000","last_active":"2024-04-25T02:28:50.131386+0000","last_peered":"2024-04-25T02:28:50.131386+0000","last_clean":"2024-04-25T02:28:50.131386+0000","last_became_active":"2024-04-25T02:23:13.841815+0000","last_became_peered":"2024-04-25T02:23:13.841815+0000","last_unstale":"2024-04-25T02:28:50.131386+0000","last_undegraded":"2024-04-25T02:28:50.131386+0000","last_fullsized":"2024-04-25T02:28:50.131386+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'59","last_scrub_stamp":"2024-04-25T02:28:50.131276+0000","last_deep_scrub":"43'59","last_deep_scrub_stamp":"2024-04-25T02:28:50.131276+0000","last_clean_scrub_stamp":"2024-04-25T02:28:50.131276+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:39:19.674948+0000","scrub_duration":0.0013339000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"43'457","reported_seq":584,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:39.003748+0000","last_change":"2024-04-25T02:28:39.003715+0000","last_active":"2024-04-25T02:28:39.003748+0000","last_peered":"2024-04-25T02:28:39.003748+0000","last_clean":"2024-04-25T02:28:39.003748+0000","last_became_active":"2024-04-25T02:23:11.837258+0000","last_became_peered":"2024-04-25T02:23:11.837258+0000","last_unstale":"2024-04-25T02:28:39.003748+0000","last_undegraded":"2024-04-25T02:28:39.003748+0000","last_fullsized":"2024-04-25T02:28:39.003748+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'457","last_scrub_stamp":"2024-04-25T02:28:39.003606+0000","last_deep_scrub":"43'457","last_deep_scrub_stamp":"2024-04-25T02:28:39.003606+0000","last_clean_scrub_stamp":"2024-04-25T02:28:39.003606+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:51.514685+0000","scrub_duration":0.0023379960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":40530,"num_write":421,"num_write_kb":133096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"43'132","reported_seq":190,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:38.375455+0000","last_change":"2024-04-25T02:28:38.375418+0000","last_active":"2024-04-25T02:28:38.375455+0000","last_peered":"2024-04-25T02:28:38.375455+0000","last_clean":"2024-04-25T02:28:38.375455+0000","last_became_active":"2024-04-25T02:23:13.838665+0000","last_became_peered":"2024-04-25T02:23:13.838665+0000","last_unstale":"2024-04-25T02:28:38.375455+0000","last_undegraded":"2024-04-25T02:28:38.375455+0000","last_fullsized":"2024-04-25T02:28:38.375455+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'132","last_scrub_stamp":"2024-04-25T02:28:38.375296+0000","last_deep_scrub":"43'132","last_deep_scrub_stamp":"2024-04-25T02:28:38.375296+0000","last_clean_scrub_stamp":"2024-04-25T02:28:38.375296+0000","objects_scrubbed":4,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:47:08.874698+0000","scrub_duration":0.018905228,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":66,"num_write_kb":8229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"43'438","reported_seq":526,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.101612+0000","last_change":"2024-04-25T02:28:28.101582+0000","last_active":"2024-04-25T02:28:28.101612+0000","last_peered":"2024-04-25T02:28:28.101612+0000","last_clean":"2024-04-25T02:28:28.101612+0000","last_became_active":"2024-04-25T02:23:55.963557+0000","last_became_peered":"2024-04-25T02:23:55.963557+0000","last_unstale":"2024-04-25T02:28:28.101612+0000","last_undegraded":"2024-04-25T02:28:28.101612+0000","last_fullsized":"2024-04-25T02:28:28.101612+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'438","last_scrub_stamp":"2024-04-25T02:28:28.101477+0000","last_deep_scrub":"43'438","last_deep_scrub_stamp":"2024-04-25T02:28:28.101477+0000","last_clean_scrub_stamp":"2024-04-25T02:28:28.101477+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:13:04.055307+0000","scrub_duration":0.0022093569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":25759,"num_write":403,"num_write_kb":59138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"43'256","reported_seq":309,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:54.577347+0000","last_change":"2024-04-25T02:28:54.577309+0000","last_active":"2024-04-25T02:28:54.577347+0000","last_peered":"2024-04-25T02:28:54.577347+0000","last_clean":"2024-04-25T02:28:54.577347+0000","last_became_active":"2024-04-25T02:23:13.843652+0000","last_became_peered":"2024-04-25T02:23:13.843652+0000","last_unstale":"2024-04-25T02:28:54.577347+0000","last_undegraded":"2024-04-25T02:28:54.577347+0000","last_fullsized":"2024-04-25T02:28:54.577347+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'256","last_scrub_stamp":"2024-04-25T02:28:54.577189+0000","last_deep_scrub":"43'256","last_deep_scrub_stamp":"2024-04-25T02:28:54.577189+0000","last_clean_scrub_stamp":"2024-04-25T02:28:54.577189+0000","objects_scrubbed":2,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:57:05.312089+0000","scrub_duration":0.01333373,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":4213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"43'389","reported_seq":433,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.044248+0000","last_change":"2024-04-25T02:29:18.044209+0000","last_active":"2024-04-25T02:29:18.044248+0000","last_peered":"2024-04-25T02:29:18.044248+0000","last_clean":"2024-04-25T02:29:18.044248+0000","last_became_active":"2024-04-25T02:23:56.301997+0000","last_became_peered":"2024-04-25T02:23:56.301997+0000","last_unstale":"2024-04-25T02:29:18.044248+0000","last_undegraded":"2024-04-25T02:29:18.044248+0000","last_fullsized":"2024-04-25T02:29:18.044248+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'389","last_scrub_stamp":"2024-04-25T02:29:18.044094+0000","last_deep_scrub":"43'389","last_deep_scrub_stamp":"2024-04-25T02:29:18.044094+0000","last_clean_scrub_stamp":"2024-04-25T02:29:18.044094+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:48.289864+0000","scrub_duration":0.0023398820000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13585,"num_write":362,"num_write_kb":34032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"43'65","reported_seq":115,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:50.476437+0000","last_change":"2024-04-25T02:29:50.476392+0000","last_active":"2024-04-25T02:29:50.476437+0000","last_peered":"2024-04-25T02:29:50.476437+0000","last_clean":"2024-04-25T02:29:50.476437+0000","last_became_active":"2024-04-25T02:23:13.841049+0000","last_became_peered":"2024-04-25T02:23:13.841049+0000","last_unstale":"2024-04-25T02:29:50.476437+0000","last_undegraded":"2024-04-25T02:29:50.476437+0000","last_fullsized":"2024-04-25T02:29:50.476437+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'65","last_scrub_stamp":"2024-04-25T02:29:50.476294+0000","last_deep_scrub":"43'65","last_deep_scrub_stamp":"2024-04-25T02:29:50.476294+0000","last_clean_scrub_stamp":"2024-04-25T02:29:50.476294+0000","objects_scrubbed":2,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:16:27.543651+0000","scrub_duration":0.0034481350000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"43'360","reported_seq":433,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:29.186993+0000","last_change":"2024-04-25T02:28:29.186947+0000","last_active":"2024-04-25T02:28:29.186993+0000","last_peered":"2024-04-25T02:28:29.186993+0000","last_clean":"2024-04-25T02:28:29.186993+0000","last_became_active":"2024-04-25T02:23:13.846425+0000","last_became_peered":"2024-04-25T02:23:13.846425+0000","last_unstale":"2024-04-25T02:28:29.186993+0000","last_undegraded":"2024-04-25T02:28:29.186993+0000","last_fullsized":"2024-04-25T02:28:29.186993+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'360","last_scrub_stamp":"2024-04-25T02:28:29.186834+0000","last_deep_scrub":"43'360","last_deep_scrub_stamp":"2024-04-25T02:28:29.186834+0000","last_clean_scrub_stamp":"2024-04-25T02:28:29.186834+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:38:30.162583+0000","scrub_duration":0.002422633,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":12898,"num_write":328,"num_write_kb":42412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"43'567","reported_seq":620,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:43.405130+0000","last_change":"2024-04-25T02:28:43.405100+0000","last_active":"2024-04-25T02:28:43.405130+0000","last_peered":"2024-04-25T02:28:43.405130+0000","last_clean":"2024-04-25T02:28:43.405130+0000","last_became_active":"2024-04-25T02:23:13.840876+0000","last_became_peered":"2024-04-25T02:23:13.840876+0000","last_unstale":"2024-04-25T02:28:43.405130+0000","last_undegraded":"2024-04-25T02:28:43.405130+0000","last_fullsized":"2024-04-25T02:28:43.405130+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'567","last_scrub_stamp":"2024-04-25T02:28:43.405002+0000","last_deep_scrub":"43'567","last_deep_scrub_stamp":"2024-04-25T02:28:43.405002+0000","last_clean_scrub_stamp":"2024-04-25T02:28:43.405002+0000","objects_scrubbed":2,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:17:38.360428+0000","scrub_duration":0.013702443,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":506,"num_write_kb":4331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"43'387","reported_seq":475,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:24.007241+0000","last_change":"2024-04-25T02:29:24.007198+0000","last_active":"2024-04-25T02:29:24.007241+0000","last_peered":"2024-04-25T02:29:24.007241+0000","last_clean":"2024-04-25T02:29:24.007241+0000","last_became_active":"2024-04-25T02:23:13.852398+0000","last_became_peered":"2024-04-25T02:23:13.852398+0000","last_unstale":"2024-04-25T02:29:24.007241+0000","last_undegraded":"2024-04-25T02:29:24.007241+0000","last_fullsized":"2024-04-25T02:29:24.007241+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'387","last_scrub_stamp":"2024-04-25T02:29:24.007081+0000","last_deep_scrub":"43'387","last_deep_scrub_stamp":"2024-04-25T02:29:24.007081+0000","last_clean_scrub_stamp":"2024-04-25T02:29:24.007081+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:07:38.625480+0000","scrub_duration":0.0022561479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":28255,"num_write":354,"num_write_kb":58406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:58.871823+0000","last_change":"2024-04-25T02:28:58.871778+0000","last_active":"2024-04-25T02:28:58.871823+0000","last_peered":"2024-04-25T02:28:58.871823+0000","last_clean":"2024-04-25T02:28:58.871823+0000","last_became_active":"2024-04-25T02:23:11.834171+0000","last_became_peered":"2024-04-25T02:23:11.834171+0000","last_unstale":"2024-04-25T02:28:58.871823+0000","last_undegraded":"2024-04-25T02:28:58.871823+0000","last_fullsized":"2024-04-25T02:28:58.871823+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:58.871661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:58.871661+0000","last_clean_scrub_stamp":"2024-04-25T02:28:58.871661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:46.274931+0000","scrub_duration":0.0016855539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"43'432","reported_seq":478,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:32.100599+0000","last_change":"2024-04-25T02:28:32.100572+0000","last_active":"2024-04-25T02:28:32.100599+0000","last_peered":"2024-04-25T02:28:32.100599+0000","last_clean":"2024-04-25T02:28:32.100599+0000","last_became_active":"2024-04-25T02:23:13.847970+0000","last_became_peered":"2024-04-25T02:23:13.847970+0000","last_unstale":"2024-04-25T02:28:32.100599+0000","last_undegraded":"2024-04-25T02:28:32.100599+0000","last_fullsized":"2024-04-25T02:28:32.100599+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'432","last_scrub_stamp":"2024-04-25T02:28:32.100463+0000","last_deep_scrub":"43'432","last_deep_scrub_stamp":"2024-04-25T02:28:32.100463+0000","last_clean_scrub_stamp":"2024-04-25T02:28:32.100463+0000","objects_scrubbed":2,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:01:10.912094+0000","scrub_duration":0.014522729,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":371,"num_write_kb":4349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"43'357","reported_seq":420,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:22.964197+0000","last_change":"2024-04-25T02:28:22.964168+0000","last_active":"2024-04-25T02:28:22.964197+0000","last_peered":"2024-04-25T02:28:22.964197+0000","last_clean":"2024-04-25T02:28:22.964197+0000","last_became_active":"2024-04-25T02:23:13.849556+0000","last_became_peered":"2024-04-25T02:23:13.849556+0000","last_unstale":"2024-04-25T02:28:22.964197+0000","last_undegraded":"2024-04-25T02:28:22.964197+0000","last_fullsized":"2024-04-25T02:28:22.964197+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'357","last_scrub_stamp":"2024-04-25T02:28:22.964054+0000","last_deep_scrub":"43'357","last_deep_scrub_stamp":"2024-04-25T02:28:22.964054+0000","last_clean_scrub_stamp":"2024-04-25T02:28:22.964054+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:33:24.355131+0000","scrub_duration":0.002218271,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8777,"num_write":323,"num_write_kb":25948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":56,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:20.584868+0000","last_change":"2024-04-25T02:29:20.584847+0000","last_active":"2024-04-25T02:29:20.584868+0000","last_peered":"2024-04-25T02:29:20.584868+0000","last_clean":"2024-04-25T02:29:20.584868+0000","last_became_active":"2024-04-25T02:23:13.847888+0000","last_became_peered":"2024-04-25T02:23:13.847888+0000","last_unstale":"2024-04-25T02:29:20.584868+0000","last_undegraded":"2024-04-25T02:29:20.584868+0000","last_fullsized":"2024-04-25T02:29:20.584868+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:20.584764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:20.584764+0000","last_clean_scrub_stamp":"2024-04-25T02:29:20.584764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:08:06.936034+0000","scrub_duration":0.001196421,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"43'72","reported_seq":124,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:37.052787+0000","last_change":"2024-04-25T02:28:37.052732+0000","last_active":"2024-04-25T02:28:37.052787+0000","last_peered":"2024-04-25T02:28:37.052787+0000","last_clean":"2024-04-25T02:28:37.052787+0000","last_became_active":"2024-04-25T02:23:12.848312+0000","last_became_peered":"2024-04-25T02:23:12.848312+0000","last_unstale":"2024-04-25T02:28:37.052787+0000","last_undegraded":"2024-04-25T02:28:37.052787+0000","last_fullsized":"2024-04-25T02:28:37.052787+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'72","last_scrub_stamp":"2024-04-25T02:28:37.052632+0000","last_deep_scrub":"43'72","last_deep_scrub_stamp":"2024-04-25T02:28:37.052632+0000","last_clean_scrub_stamp":"2024-04-25T02:28:37.052632+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:06:14.430755+0000","scrub_duration":0.0037485779999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"43'385","reported_seq":477,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:47.914656+0000","last_change":"2024-04-25T02:28:47.914600+0000","last_active":"2024-04-25T02:28:47.914656+0000","last_peered":"2024-04-25T02:28:47.914656+0000","last_clean":"2024-04-25T02:28:47.914656+0000","last_became_active":"2024-04-25T02:23:12.841408+0000","last_became_peered":"2024-04-25T02:23:12.841408+0000","last_unstale":"2024-04-25T02:28:47.914656+0000","last_undegraded":"2024-04-25T02:28:47.914656+0000","last_fullsized":"2024-04-25T02:28:47.914656+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'385","last_scrub_stamp":"2024-04-25T02:28:47.914480+0000","last_deep_scrub":"43'385","last_deep_scrub_stamp":"2024-04-25T02:28:47.914480+0000","last_clean_scrub_stamp":"2024-04-25T02:28:47.914480+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:56.748268+0000","scrub_duration":0.0025485909999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":27937,"num_write":348,"num_write_kb":51359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":44,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:07.821153+0000","last_change":"2024-04-25T02:29:07.821126+0000","last_active":"2024-04-25T02:29:07.821153+0000","last_peered":"2024-04-25T02:29:07.821153+0000","last_clean":"2024-04-25T02:29:07.821153+0000","last_became_active":"2024-04-25T02:23:13.848076+0000","last_became_peered":"2024-04-25T02:23:13.848076+0000","last_unstale":"2024-04-25T02:29:07.821153+0000","last_undegraded":"2024-04-25T02:29:07.821153+0000","last_fullsized":"2024-04-25T02:29:07.821153+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:07.821012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:07.821012+0000","last_clean_scrub_stamp":"2024-04-25T02:29:07.821012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:19.428497+0000","scrub_duration":0.001478198,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"43'396","reported_seq":441,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:28.988989+0000","last_change":"2024-04-25T02:29:28.988963+0000","last_active":"2024-04-25T02:29:28.988989+0000","last_peered":"2024-04-25T02:29:28.988989+0000","last_clean":"2024-04-25T02:29:28.988989+0000","last_became_active":"2024-04-25T02:23:12.848229+0000","last_became_peered":"2024-04-25T02:23:12.848229+0000","last_unstale":"2024-04-25T02:29:28.988989+0000","last_undegraded":"2024-04-25T02:29:28.988989+0000","last_fullsized":"2024-04-25T02:29:28.988989+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'396","last_scrub_stamp":"2024-04-25T02:29:28.988885+0000","last_deep_scrub":"43'396","last_deep_scrub_stamp":"2024-04-25T02:29:28.988885+0000","last_clean_scrub_stamp":"2024-04-25T02:29:28.988885+0000","objects_scrubbed":2,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:31:18.956508+0000","scrub_duration":0.018703045000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":337,"num_write_kb":8338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"43'349","reported_seq":410,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:07.926117+0000","last_change":"2024-04-25T02:29:07.926087+0000","last_active":"2024-04-25T02:29:07.926117+0000","last_peered":"2024-04-25T02:29:07.926117+0000","last_clean":"2024-04-25T02:29:07.926117+0000","last_became_active":"2024-04-25T02:23:11.834994+0000","last_became_peered":"2024-04-25T02:23:11.834994+0000","last_unstale":"2024-04-25T02:29:07.926117+0000","last_undegraded":"2024-04-25T02:29:07.926117+0000","last_fullsized":"2024-04-25T02:29:07.926117+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'349","last_scrub_stamp":"2024-04-25T02:29:07.925985+0000","last_deep_scrub":"43'349","last_deep_scrub_stamp":"2024-04-25T02:29:07.925985+0000","last_clean_scrub_stamp":"2024-04-25T02:29:07.925985+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:48:50.879001+0000","scrub_duration":0.002053675,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":11931,"num_write":325,"num_write_kb":25986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":53,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:48.471620+0000","last_change":"2024-04-25T02:28:48.471576+0000","last_active":"2024-04-25T02:28:48.471620+0000","last_peered":"2024-04-25T02:28:48.471620+0000","last_clean":"2024-04-25T02:28:48.471620+0000","last_became_active":"2024-04-25T02:23:13.848628+0000","last_became_peered":"2024-04-25T02:23:13.848628+0000","last_unstale":"2024-04-25T02:28:48.471620+0000","last_undegraded":"2024-04-25T02:28:48.471620+0000","last_fullsized":"2024-04-25T02:28:48.471620+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:48.471463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:48.471463+0000","last_clean_scrub_stamp":"2024-04-25T02:28:48.471463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:16:32.732598+0000","scrub_duration":0.0015455829999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"43'117","reported_seq":205,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:43.952390+0000","last_change":"2024-04-25T02:28:43.952355+0000","last_active":"2024-04-25T02:28:43.952390+0000","last_peered":"2024-04-25T02:28:43.952390+0000","last_clean":"2024-04-25T02:28:43.952390+0000","last_became_active":"2024-04-25T02:23:11.835430+0000","last_became_peered":"2024-04-25T02:23:11.835430+0000","last_unstale":"2024-04-25T02:28:43.952390+0000","last_undegraded":"2024-04-25T02:28:43.952390+0000","last_fullsized":"2024-04-25T02:28:43.952390+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'117","last_scrub_stamp":"2024-04-25T02:28:43.952236+0000","last_deep_scrub":"43'117","last_deep_scrub_stamp":"2024-04-25T02:28:43.952236+0000","last_clean_scrub_stamp":"2024-04-25T02:28:43.952236+0000","objects_scrubbed":2,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:46:14.784576+0000","scrub_duration":0.005143936,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"43'575","reported_seq":625,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:04.637560+0000","last_change":"2024-04-25T02:29:04.637520+0000","last_active":"2024-04-25T02:29:04.637560+0000","last_peered":"2024-04-25T02:29:04.637560+0000","last_clean":"2024-04-25T02:29:04.637560+0000","last_became_active":"2024-04-25T02:23:13.845029+0000","last_became_peered":"2024-04-25T02:23:13.845029+0000","last_unstale":"2024-04-25T02:29:04.637560+0000","last_undegraded":"2024-04-25T02:29:04.637560+0000","last_fullsized":"2024-04-25T02:29:04.637560+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'575","last_scrub_stamp":"2024-04-25T02:29:04.637429+0000","last_deep_scrub":"43'575","last_deep_scrub_stamp":"2024-04-25T02:29:04.637429+0000","last_clean_scrub_stamp":"2024-04-25T02:29:04.637429+0000","objects_scrubbed":2,"log_size":575,"log_dups_size":0,"ondisk_log_size":575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:27:33.911843+0000","scrub_duration":0.022099299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":507,"num_write_kb":8447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"43'449","reported_seq":571,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:22.192884+0000","last_change":"2024-04-25T02:28:22.192856+0000","last_active":"2024-04-25T02:28:22.192884+0000","last_peered":"2024-04-25T02:28:22.192884+0000","last_clean":"2024-04-25T02:28:22.192884+0000","last_became_active":"2024-04-25T02:23:13.844018+0000","last_became_peered":"2024-04-25T02:23:13.844018+0000","last_unstale":"2024-04-25T02:28:22.192884+0000","last_undegraded":"2024-04-25T02:28:22.192884+0000","last_fullsized":"2024-04-25T02:28:22.192884+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'449","last_scrub_stamp":"2024-04-25T02:28:22.192764+0000","last_deep_scrub":"43'449","last_deep_scrub_stamp":"2024-04-25T02:28:22.192764+0000","last_clean_scrub_stamp":"2024-04-25T02:28:22.192764+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:28.942878+0000","scrub_duration":0.0021300249999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":31679,"num_write":414,"num_write_kb":80533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:23.639479+0000","last_change":"2024-04-25T02:29:23.639437+0000","last_active":"2024-04-25T02:29:23.639479+0000","last_peered":"2024-04-25T02:29:23.639479+0000","last_clean":"2024-04-25T02:29:23.639479+0000","last_became_active":"2024-04-25T02:23:13.844753+0000","last_became_peered":"2024-04-25T02:23:13.844753+0000","last_unstale":"2024-04-25T02:29:23.639479+0000","last_undegraded":"2024-04-25T02:29:23.639479+0000","last_fullsized":"2024-04-25T02:29:23.639479+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:23.639330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:23.639330+0000","last_clean_scrub_stamp":"2024-04-25T02:29:23.639330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:36:28.214106+0000","scrub_duration":0.001562251,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"43'253","reported_seq":486,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:09.943734+0000","last_change":"2024-04-25T02:29:09.943689+0000","last_active":"2024-04-25T02:29:09.943734+0000","last_peered":"2024-04-25T02:29:09.943734+0000","last_clean":"2024-04-25T02:29:09.943734+0000","last_became_active":"2024-04-25T02:23:12.845638+0000","last_became_peered":"2024-04-25T02:23:12.845638+0000","last_unstale":"2024-04-25T02:29:09.943734+0000","last_undegraded":"2024-04-25T02:29:09.943734+0000","last_fullsized":"2024-04-25T02:29:09.943734+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'253","last_scrub_stamp":"2024-04-25T02:29:09.943582+0000","last_deep_scrub":"43'253","last_deep_scrub_stamp":"2024-04-25T02:29:09.943582+0000","last_clean_scrub_stamp":"2024-04-25T02:29:09.943582+0000","objects_scrubbed":1,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:41:32.698316+0000","scrub_duration":0.0070356070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1460763,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":182,"num_read_kb":1548,"num_write":182,"num_write_kb":1548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"43'454","reported_seq":583,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:13.968762+0000","last_change":"2024-04-25T02:29:13.968733+0000","last_active":"2024-04-25T02:29:13.968762+0000","last_peered":"2024-04-25T02:29:13.968762+0000","last_clean":"2024-04-25T02:29:13.968762+0000","last_became_active":"2024-04-25T02:23:11.840215+0000","last_became_peered":"2024-04-25T02:23:11.840215+0000","last_unstale":"2024-04-25T02:29:13.968762+0000","last_undegraded":"2024-04-25T02:29:13.968762+0000","last_fullsized":"2024-04-25T02:29:13.968762+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'454","last_scrub_stamp":"2024-04-25T02:29:13.968625+0000","last_deep_scrub":"43'454","last_deep_scrub_stamp":"2024-04-25T02:29:13.968625+0000","last_clean_scrub_stamp":"2024-04-25T02:29:13.968625+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:44:53.105094+0000","scrub_duration":0.0025024790000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":42224,"num_write":426,"num_write_kb":96444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":60,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:48.451882+0000","last_change":"2024-04-25T02:29:48.451854+0000","last_active":"2024-04-25T02:29:48.451882+0000","last_peered":"2024-04-25T02:29:48.451882+0000","last_clean":"2024-04-25T02:29:48.451882+0000","last_became_active":"2024-04-25T02:23:13.841324+0000","last_became_peered":"2024-04-25T02:23:13.841324+0000","last_unstale":"2024-04-25T02:29:48.451882+0000","last_undegraded":"2024-04-25T02:29:48.451882+0000","last_fullsized":"2024-04-25T02:29:48.451882+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:48.451751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:48.451751+0000","last_clean_scrub_stamp":"2024-04-25T02:29:48.451751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:06.119683+0000","scrub_duration":0.0014257740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"43'53","reported_seq":96,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:23.045057+0000","last_change":"2024-04-25T02:29:23.045018+0000","last_active":"2024-04-25T02:29:23.045057+0000","last_peered":"2024-04-25T02:29:23.045057+0000","last_clean":"2024-04-25T02:29:23.045057+0000","last_became_active":"2024-04-25T02:23:12.841930+0000","last_became_peered":"2024-04-25T02:23:12.841930+0000","last_unstale":"2024-04-25T02:29:23.045057+0000","last_undegraded":"2024-04-25T02:29:23.045057+0000","last_fullsized":"2024-04-25T02:29:23.045057+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'53","last_scrub_stamp":"2024-04-25T02:29:23.044876+0000","last_deep_scrub":"43'53","last_deep_scrub_stamp":"2024-04-25T02:29:23.044876+0000","last_clean_scrub_stamp":"2024-04-25T02:29:23.044876+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:46:33.497718+0000","scrub_duration":0.0016291229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"43'427","reported_seq":596,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:35.112665+0000","last_change":"2024-04-25T02:28:35.112631+0000","last_active":"2024-04-25T02:28:35.112665+0000","last_peered":"2024-04-25T02:28:35.112665+0000","last_clean":"2024-04-25T02:28:35.112665+0000","last_became_active":"2024-04-25T02:23:12.847949+0000","last_became_peered":"2024-04-25T02:23:12.847949+0000","last_unstale":"2024-04-25T02:28:35.112665+0000","last_undegraded":"2024-04-25T02:28:35.112665+0000","last_fullsized":"2024-04-25T02:28:35.112665+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'427","last_scrub_stamp":"2024-04-25T02:28:35.112522+0000","last_deep_scrub":"43'427","last_deep_scrub_stamp":"2024-04-25T02:28:35.112522+0000","last_clean_scrub_stamp":"2024-04-25T02:28:35.112522+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:01.667215+0000","scrub_duration":0.0025605430000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":62452,"num_write":394,"num_write_kb":105065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"43'67","reported_seq":121,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:22.607900+0000","last_change":"2024-04-25T02:29:22.607869+0000","last_active":"2024-04-25T02:29:22.607900+0000","last_peered":"2024-04-25T02:29:22.607900+0000","last_clean":"2024-04-25T02:29:22.607900+0000","last_became_active":"2024-04-25T02:23:13.844133+0000","last_became_peered":"2024-04-25T02:23:13.844133+0000","last_unstale":"2024-04-25T02:29:22.607900+0000","last_undegraded":"2024-04-25T02:29:22.607900+0000","last_fullsized":"2024-04-25T02:29:22.607900+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'67","last_scrub_stamp":"2024-04-25T02:29:22.607757+0000","last_deep_scrub":"43'67","last_deep_scrub_stamp":"2024-04-25T02:29:22.607757+0000","last_clean_scrub_stamp":"2024-04-25T02:29:22.607757+0000","objects_scrubbed":2,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:08:11.568613+0000","scrub_duration":0.0035088860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:56.954217+0000","last_change":"2024-04-25T02:28:56.954190+0000","last_active":"2024-04-25T02:28:56.954217+0000","last_peered":"2024-04-25T02:28:56.954217+0000","last_clean":"2024-04-25T02:28:56.954217+0000","last_became_active":"2024-04-25T02:23:11.836737+0000","last_became_peered":"2024-04-25T02:23:11.836737+0000","last_unstale":"2024-04-25T02:28:56.954217+0000","last_undegraded":"2024-04-25T02:28:56.954217+0000","last_fullsized":"2024-04-25T02:28:56.954217+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:56.954079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:56.954079+0000","last_clean_scrub_stamp":"2024-04-25T02:28:56.954079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:31:33.715989+0000","scrub_duration":0.001439145,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"43'434","reported_seq":577,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.571439+0000","last_change":"2024-04-25T02:29:19.571393+0000","last_active":"2024-04-25T02:29:19.571439+0000","last_peered":"2024-04-25T02:29:19.571439+0000","last_clean":"2024-04-25T02:29:19.571439+0000","last_became_active":"2024-04-25T02:23:13.843915+0000","last_became_peered":"2024-04-25T02:23:13.843915+0000","last_unstale":"2024-04-25T02:29:19.571439+0000","last_undegraded":"2024-04-25T02:29:19.571439+0000","last_fullsized":"2024-04-25T02:29:19.571439+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'434","last_scrub_stamp":"2024-04-25T02:29:19.571275+0000","last_deep_scrub":"43'434","last_deep_scrub_stamp":"2024-04-25T02:29:19.571275+0000","last_clean_scrub_stamp":"2024-04-25T02:29:19.571275+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:49.263428+0000","scrub_duration":0.0026546920000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":48451,"num_write":406,"num_write_kb":112597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":60,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:45.426103+0000","last_change":"2024-04-25T02:28:45.426067+0000","last_active":"2024-04-25T02:28:45.426103+0000","last_peered":"2024-04-25T02:28:45.426103+0000","last_clean":"2024-04-25T02:28:45.426103+0000","last_became_active":"2024-04-25T02:23:13.838746+0000","last_became_peered":"2024-04-25T02:23:13.838746+0000","last_unstale":"2024-04-25T02:28:45.426103+0000","last_undegraded":"2024-04-25T02:28:45.426103+0000","last_fullsized":"2024-04-25T02:28:45.426103+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:45.425965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:45.425965+0000","last_clean_scrub_stamp":"2024-04-25T02:28:45.425965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:51.800756+0000","scrub_duration":0.0014993350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"43'87","reported_seq":137,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:47.924326+0000","last_change":"2024-04-25T02:29:47.924299+0000","last_active":"2024-04-25T02:29:47.924326+0000","last_peered":"2024-04-25T02:29:47.924326+0000","last_clean":"2024-04-25T02:29:47.924326+0000","last_became_active":"2024-04-25T02:23:11.840553+0000","last_became_peered":"2024-04-25T02:23:11.840553+0000","last_unstale":"2024-04-25T02:29:47.924326+0000","last_undegraded":"2024-04-25T02:29:47.924326+0000","last_fullsized":"2024-04-25T02:29:47.924326+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'87","last_scrub_stamp":"2024-04-25T02:29:47.924192+0000","last_deep_scrub":"43'87","last_deep_scrub_stamp":"2024-04-25T02:29:47.924192+0000","last_clean_scrub_stamp":"2024-04-25T02:29:47.924192+0000","objects_scrubbed":1,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:40:06.104136+0000","scrub_duration":0.006347129,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":74,"num_write_kb":962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"43'397","reported_seq":495,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:02.785656+0000","last_change":"2024-04-25T02:29:02.785610+0000","last_active":"2024-04-25T02:29:02.785656+0000","last_peered":"2024-04-25T02:29:02.785656+0000","last_clean":"2024-04-25T02:29:02.785656+0000","last_became_active":"2024-04-25T02:23:13.848374+0000","last_became_peered":"2024-04-25T02:23:13.848374+0000","last_unstale":"2024-04-25T02:29:02.785656+0000","last_undegraded":"2024-04-25T02:29:02.785656+0000","last_fullsized":"2024-04-25T02:29:02.785656+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'397","last_scrub_stamp":"2024-04-25T02:29:02.785490+0000","last_deep_scrub":"43'397","last_deep_scrub_stamp":"2024-04-25T02:29:02.785490+0000","last_clean_scrub_stamp":"2024-04-25T02:29:02.785490+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:46:45.303985+0000","scrub_duration":0.0024422020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":25341,"num_write":367,"num_write_kb":104771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"43'125","reported_seq":177,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:23.889117+0000","last_change":"2024-04-25T02:29:23.889067+0000","last_active":"2024-04-25T02:29:23.889117+0000","last_peered":"2024-04-25T02:29:23.889117+0000","last_clean":"2024-04-25T02:29:23.889117+0000","last_became_active":"2024-04-25T02:23:13.842438+0000","last_became_peered":"2024-04-25T02:23:13.842438+0000","last_unstale":"2024-04-25T02:29:23.889117+0000","last_undegraded":"2024-04-25T02:29:23.889117+0000","last_fullsized":"2024-04-25T02:29:23.889117+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'125","last_scrub_stamp":"2024-04-25T02:29:23.888952+0000","last_deep_scrub":"43'125","last_deep_scrub_stamp":"2024-04-25T02:29:23.888952+0000","last_clean_scrub_stamp":"2024-04-25T02:29:23.888952+0000","objects_scrubbed":3,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:02:18.364587+0000","scrub_duration":0.010573489,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4196548,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"43'373","reported_seq":466,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:13.969575+0000","last_change":"2024-04-25T02:29:13.969547+0000","last_active":"2024-04-25T02:29:13.969575+0000","last_peered":"2024-04-25T02:29:13.969575+0000","last_clean":"2024-04-25T02:29:13.969575+0000","last_became_active":"2024-04-25T02:23:12.844258+0000","last_became_peered":"2024-04-25T02:23:12.844258+0000","last_unstale":"2024-04-25T02:29:13.969575+0000","last_undegraded":"2024-04-25T02:29:13.969575+0000","last_fullsized":"2024-04-25T02:29:13.969575+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'373","last_scrub_stamp":"2024-04-25T02:29:13.969449+0000","last_deep_scrub":"43'373","last_deep_scrub_stamp":"2024-04-25T02:29:13.969449+0000","last_clean_scrub_stamp":"2024-04-25T02:29:13.969449+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:55:34.895544+0000","scrub_duration":0.0022595229999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":25157,"num_write":340,"num_write_kb":59328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"43'318","reported_seq":362,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:06.939622+0000","last_change":"2024-04-25T02:29:06.939592+0000","last_active":"2024-04-25T02:29:06.939622+0000","last_peered":"2024-04-25T02:29:06.939622+0000","last_clean":"2024-04-25T02:29:06.939622+0000","last_became_active":"2024-04-25T02:23:11.833348+0000","last_became_peered":"2024-04-25T02:23:11.833348+0000","last_unstale":"2024-04-25T02:29:06.939622+0000","last_undegraded":"2024-04-25T02:29:06.939622+0000","last_fullsized":"2024-04-25T02:29:06.939622+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'318","last_scrub_stamp":"2024-04-25T02:29:06.939488+0000","last_deep_scrub":"43'318","last_deep_scrub_stamp":"2024-04-25T02:29:06.939488+0000","last_clean_scrub_stamp":"2024-04-25T02:29:06.939488+0000","objects_scrubbed":2,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:26:24.204337+0000","scrub_duration":0.013407262,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":262,"num_write_kb":4264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"43'371","reported_seq":471,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:20.223269+0000","last_change":"2024-04-25T02:28:20.223232+0000","last_active":"2024-04-25T02:28:20.223269+0000","last_peered":"2024-04-25T02:28:20.223269+0000","last_clean":"2024-04-25T02:28:20.223269+0000","last_became_active":"2024-04-25T02:23:55.963467+0000","last_became_peered":"2024-04-25T02:23:55.963467+0000","last_unstale":"2024-04-25T02:28:20.223269+0000","last_undegraded":"2024-04-25T02:28:20.223269+0000","last_fullsized":"2024-04-25T02:28:20.223269+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'371","last_scrub_stamp":"2024-04-25T02:28:20.223133+0000","last_deep_scrub":"43'371","last_deep_scrub_stamp":"2024-04-25T02:28:20.223133+0000","last_clean_scrub_stamp":"2024-04-25T02:28:20.223133+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:12.999404+0000","scrub_duration":0.0022911020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":32821,"num_write":343,"num_write_kb":62943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"43'327","reported_seq":385,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:11.615512+0000","last_change":"2024-04-25T02:29:11.615484+0000","last_active":"2024-04-25T02:29:11.615512+0000","last_peered":"2024-04-25T02:29:11.615512+0000","last_clean":"2024-04-25T02:29:11.615512+0000","last_became_active":"2024-04-25T02:23:13.840492+0000","last_became_peered":"2024-04-25T02:23:13.840492+0000","last_unstale":"2024-04-25T02:29:11.615512+0000","last_undegraded":"2024-04-25T02:29:11.615512+0000","last_fullsized":"2024-04-25T02:29:11.615512+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'327","last_scrub_stamp":"2024-04-25T02:29:11.615400+0000","last_deep_scrub":"43'327","last_deep_scrub_stamp":"2024-04-25T02:29:11.615400+0000","last_clean_scrub_stamp":"2024-04-25T02:29:11.615400+0000","objects_scrubbed":4,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:49:15.104618+0000","scrub_duration":0.029271986,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":257,"num_write_kb":12449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"43'384","reported_seq":454,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:25.236814+0000","last_change":"2024-04-25T02:28:25.236776+0000","last_active":"2024-04-25T02:28:25.236814+0000","last_peered":"2024-04-25T02:28:25.236814+0000","last_clean":"2024-04-25T02:28:25.236814+0000","last_became_active":"2024-04-25T02:23:13.847264+0000","last_became_peered":"2024-04-25T02:23:13.847264+0000","last_unstale":"2024-04-25T02:28:25.236814+0000","last_undegraded":"2024-04-25T02:28:25.236814+0000","last_fullsized":"2024-04-25T02:28:25.236814+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'384","last_scrub_stamp":"2024-04-25T02:28:25.236669+0000","last_deep_scrub":"43'384","last_deep_scrub_stamp":"2024-04-25T02:28:25.236669+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.236669+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:51.748406+0000","scrub_duration":0.002112685,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":15655,"num_write":352,"num_write_kb":42131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"43'94","reported_seq":144,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:50.478023+0000","last_change":"2024-04-25T02:28:50.477980+0000","last_active":"2024-04-25T02:28:50.478023+0000","last_peered":"2024-04-25T02:28:50.478023+0000","last_clean":"2024-04-25T02:28:50.478023+0000","last_became_active":"2024-04-25T02:23:13.845143+0000","last_became_peered":"2024-04-25T02:23:13.845143+0000","last_unstale":"2024-04-25T02:28:50.478023+0000","last_undegraded":"2024-04-25T02:28:50.478023+0000","last_fullsized":"2024-04-25T02:28:50.478023+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'94","last_scrub_stamp":"2024-04-25T02:28:50.477893+0000","last_deep_scrub":"43'94","last_deep_scrub_stamp":"2024-04-25T02:28:50.477893+0000","last_clean_scrub_stamp":"2024-04-25T02:28:50.477893+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:47:38.664790+0000","scrub_duration":0.0099647699999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":4121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"43'427","reported_seq":472,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:51.875426+0000","last_change":"2024-04-25T02:29:51.875388+0000","last_active":"2024-04-25T02:29:51.875426+0000","last_peered":"2024-04-25T02:29:51.875426+0000","last_clean":"2024-04-25T02:29:51.875426+0000","last_became_active":"2024-04-25T02:23:55.956828+0000","last_became_peered":"2024-04-25T02:23:55.956828+0000","last_unstale":"2024-04-25T02:29:51.875426+0000","last_undegraded":"2024-04-25T02:29:51.875426+0000","last_fullsized":"2024-04-25T02:29:51.875426+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'427","last_scrub_stamp":"2024-04-25T02:29:51.875289+0000","last_deep_scrub":"43'427","last_deep_scrub_stamp":"2024-04-25T02:29:51.875289+0000","last_clean_scrub_stamp":"2024-04-25T02:29:51.875289+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:09.686813+0000","scrub_duration":0.002199351,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":14079,"num_write":394,"num_write_kb":87521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"43'114","reported_seq":160,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:20.198034+0000","last_change":"2024-04-25T02:28:20.198001+0000","last_active":"2024-04-25T02:28:20.198034+0000","last_peered":"2024-04-25T02:28:20.198034+0000","last_clean":"2024-04-25T02:28:20.198034+0000","last_became_active":"2024-04-25T02:23:11.838807+0000","last_became_peered":"2024-04-25T02:23:11.838807+0000","last_unstale":"2024-04-25T02:28:20.198034+0000","last_undegraded":"2024-04-25T02:28:20.198034+0000","last_fullsized":"2024-04-25T02:28:20.198034+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'114","last_scrub_stamp":"2024-04-25T02:28:20.197907+0000","last_deep_scrub":"43'114","last_deep_scrub_stamp":"2024-04-25T02:28:20.197907+0000","last_clean_scrub_stamp":"2024-04-25T02:28:20.197907+0000","objects_scrubbed":3,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:47:55.330863+0000","scrub_duration":0.011784594000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":59,"num_write_kb":4127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"43'447","reported_seq":531,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:53.887469+0000","last_change":"2024-04-25T02:28:53.887441+0000","last_active":"2024-04-25T02:28:53.887469+0000","last_peered":"2024-04-25T02:28:53.887469+0000","last_clean":"2024-04-25T02:28:53.887469+0000","last_became_active":"2024-04-25T02:23:12.845497+0000","last_became_peered":"2024-04-25T02:23:12.845497+0000","last_unstale":"2024-04-25T02:28:53.887469+0000","last_undegraded":"2024-04-25T02:28:53.887469+0000","last_fullsized":"2024-04-25T02:28:53.887469+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'447","last_scrub_stamp":"2024-04-25T02:28:53.887343+0000","last_deep_scrub":"43'447","last_deep_scrub_stamp":"2024-04-25T02:28:53.887343+0000","last_clean_scrub_stamp":"2024-04-25T02:28:53.887343+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:59:00.846583+0000","scrub_duration":0.0022684239999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15742,"num_write":414,"num_write_kb":51315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"43'419","reported_seq":495,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:24.999907+0000","last_change":"2024-04-25T02:29:24.999876+0000","last_active":"2024-04-25T02:29:24.999907+0000","last_peered":"2024-04-25T02:29:24.999907+0000","last_clean":"2024-04-25T02:29:24.999907+0000","last_became_active":"2024-04-25T02:23:12.846719+0000","last_became_peered":"2024-04-25T02:23:12.846719+0000","last_unstale":"2024-04-25T02:29:24.999907+0000","last_undegraded":"2024-04-25T02:29:24.999907+0000","last_fullsized":"2024-04-25T02:29:24.999907+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'419","last_scrub_stamp":"2024-04-25T02:29:24.999777+0000","last_deep_scrub":"43'419","last_deep_scrub_stamp":"2024-04-25T02:29:24.999777+0000","last_clean_scrub_stamp":"2024-04-25T02:29:24.999777+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:06:01.639473+0000","scrub_duration":0.0022050609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":16944,"num_write":389,"num_write_kb":35957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"43'440","reported_seq":495,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:21.088417+0000","last_change":"2024-04-25T02:29:21.088396+0000","last_active":"2024-04-25T02:29:21.088417+0000","last_peered":"2024-04-25T02:29:21.088417+0000","last_clean":"2024-04-25T02:29:21.088417+0000","last_became_active":"2024-04-25T02:23:56.301745+0000","last_became_peered":"2024-04-25T02:23:56.301745+0000","last_unstale":"2024-04-25T02:29:21.088417+0000","last_undegraded":"2024-04-25T02:29:21.088417+0000","last_fullsized":"2024-04-25T02:29:21.088417+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'440","last_scrub_stamp":"2024-04-25T02:29:21.088323+0000","last_deep_scrub":"43'440","last_deep_scrub_stamp":"2024-04-25T02:29:21.088323+0000","last_clean_scrub_stamp":"2024-04-25T02:29:21.088323+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:48:29.034833+0000","scrub_duration":0.0017322780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":12557,"num_write":410,"num_write_kb":77332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"43'492","reported_seq":571,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:24.176583+0000","last_change":"2024-04-25T02:28:24.176533+0000","last_active":"2024-04-25T02:28:24.176583+0000","last_peered":"2024-04-25T02:28:24.176583+0000","last_clean":"2024-04-25T02:28:24.176583+0000","last_became_active":"2024-04-25T02:23:13.844235+0000","last_became_peered":"2024-04-25T02:23:13.844235+0000","last_unstale":"2024-04-25T02:28:24.176583+0000","last_undegraded":"2024-04-25T02:28:24.176583+0000","last_fullsized":"2024-04-25T02:28:24.176583+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'492","last_scrub_stamp":"2024-04-25T02:28:24.176384+0000","last_deep_scrub":"43'492","last_deep_scrub_stamp":"2024-04-25T02:28:24.176384+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.176384+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:15.054028+0000","scrub_duration":0.002556961,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14237,"num_write":458,"num_write_kb":116854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"43'392","reported_seq":482,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:13.587928+0000","last_change":"2024-04-25T02:29:13.587897+0000","last_active":"2024-04-25T02:29:13.587928+0000","last_peered":"2024-04-25T02:29:13.587928+0000","last_clean":"2024-04-25T02:29:13.587928+0000","last_became_active":"2024-04-25T02:23:13.845193+0000","last_became_peered":"2024-04-25T02:23:13.845193+0000","last_unstale":"2024-04-25T02:29:13.587928+0000","last_undegraded":"2024-04-25T02:29:13.587928+0000","last_fullsized":"2024-04-25T02:29:13.587928+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'392","last_scrub_stamp":"2024-04-25T02:29:13.587800+0000","last_deep_scrub":"43'392","last_deep_scrub_stamp":"2024-04-25T02:29:13.587800+0000","last_clean_scrub_stamp":"2024-04-25T02:29:13.587800+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:00:48.741712+0000","scrub_duration":0.002153206,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":36152,"num_write":360,"num_write_kb":54497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"43'402","reported_seq":514,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.963419+0000","last_change":"2024-04-25T02:29:19.963389+0000","last_active":"2024-04-25T02:29:19.963419+0000","last_peered":"2024-04-25T02:29:19.963419+0000","last_clean":"2024-04-25T02:29:19.963419+0000","last_became_active":"2024-04-25T02:23:12.841677+0000","last_became_peered":"2024-04-25T02:23:12.841677+0000","last_unstale":"2024-04-25T02:29:19.963419+0000","last_undegraded":"2024-04-25T02:29:19.963419+0000","last_fullsized":"2024-04-25T02:29:19.963419+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'402","last_scrub_stamp":"2024-04-25T02:29:19.963285+0000","last_deep_scrub":"43'402","last_deep_scrub_stamp":"2024-04-25T02:29:19.963285+0000","last_clean_scrub_stamp":"2024-04-25T02:29:19.963285+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:36:14.054555+0000","scrub_duration":0.002042412,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":32628,"num_write":375,"num_write_kb":79888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2779,"num_read_kb":1446401,"num_write":24390,"num_write_kb":4320360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26350,"ondisk_log_size":26350,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":129261049,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":231,"num_read_kb":1603,"num_write":6644,"num_write_kb":130848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":258629632,"data_stored":258522098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39115,"internal_metadata":0},"log_size":8552,"ondisk_log_size":8552,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":31,"seq":133143986259,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":393820,"kb_used_data":88340,"kb_used_omap":9,"kb_used_meta":305462,"kb_avail":93978020,"statfs":{"total":96636764160,"available":96233492480,"internally_reserved":0,"allocated":90460160,"data_stored":90216632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9975,"internal_metadata":312793353},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:29:18 2024","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.33900000000000002,"15min":0.33500000000000002},"min":{"1min":0.222,"5min":0.156,"15min":0.156},"max":{"1min":0.51000000000000001,"5min":3.5409999999999999,"15min":3.5409999999999999},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.373,"5min":0.39500000000000002,"15min":0.36499999999999999},"min":{"1min":0.247,"5min":0.161,"15min":0.161},"max":{"1min":0.54000000000000004,"5min":3.613,"15min":3.613},"last":0.44500000000000001}]},{"osd":1,"last update":"Thu Apr 25 02:29:18 2024","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.378,"15min":0.36199999999999999},"min":{"1min":0.26500000000000001,"5min":0.184,"15min":0.184},"max":{"1min":0.51000000000000001,"5min":3.0009999999999999,"15min":3.0009999999999999},"last":0.42299999999999999},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.36899999999999999},"min":{"1min":0.27800000000000002,"5min":0.157,"15min":0.157},"max":{"1min":0.56000000000000005,"5min":4.9720000000000004,"15min":4.9720000000000004},"last":0.40999999999999998}]},{"osd":2,"last update":"Thu Apr 25 02:29:18 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.42499999999999999,"15min":0.378},"min":{"1min":0.28799999999999998,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.505,"5min":4.883,"15min":4.883},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40000000000000002,"15min":0.38400000000000001},"min":{"1min":0.30299999999999999,"5min":0.184,"15min":0.184},"max":{"1min":0.56699999999999995,"5min":3.0550000000000002,"15min":3.0550000000000002},"last":0.46999999999999997}]}]},{"osd":2,"up_from":30,"seq":128849018963,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":366484,"kb_used_data":56972,"kb_used_omap":8,"kb_used_meta":309495,"kb_avail":94005356,"statfs":{"total":96636764160,"available":96261484544,"internally_reserved":0,"allocated":58339328,"data_stored":58119882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8387,"internal_metadata":316923709},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.32600000000000001,"15min":0.32400000000000001},"min":{"1min":0.26700000000000002,"5min":0.14199999999999999,"15min":0.14199999999999999},"max":{"1min":0.52100000000000002,"5min":2.419,"15min":2.419},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.32100000000000001,"15min":0.32800000000000001},"min":{"1min":0.27200000000000002,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.47799999999999998,"5min":0.49299999999999999,"15min":0.51300000000000001},"last":0.39700000000000002}]},{"osd":1,"last update":"Thu Apr 25 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.35199999999999998,"15min":0.34799999999999998},"min":{"1min":0.249,"5min":0.19,"15min":0.19},"max":{"1min":0.47499999999999998,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.375,"5min":0.34999999999999998,"15min":0.34899999999999998},"min":{"1min":0.27900000000000003,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.48799999999999999,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.41199999999999998}]},{"osd":3,"last update":"Thu Apr 25 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.34799999999999998,"15min":0.35399999999999998},"min":{"1min":0.26200000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.51200000000000001,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.435,"5min":0.39700000000000002,"15min":0.40100000000000002},"min":{"1min":0.35599999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.55800000000000005,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.48499999999999999}]}]},{"osd":0,"up_from":28,"seq":120259084372,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369380,"kb_used_data":59740,"kb_used_omap":15,"kb_used_meta":309616,"kb_avail":94002460,"statfs":{"total":96636764160,"available":96258519040,"internally_reserved":0,"allocated":61173760,"data_stored":60940630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15790,"internal_metadata":317047378},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 25 02:29:17 2024","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.30599999999999999,"15min":0.33000000000000002},"min":{"1min":0.255,"5min":0.14799999999999999,"15min":0.14799999999999999},"max":{"1min":0.46800000000000003,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.27300000000000002},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.33600000000000002,"15min":0.35499999999999998},"min":{"1min":0.28699999999999998,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.51900000000000002,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.379}]},{"osd":2,"last update":"Thu Apr 25 02:29:17 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.34200000000000003,"15min":0.37},"min":{"1min":0.309,"5min":0.188,"15min":0.188},"max":{"1min":0.501,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.34799999999999998,"15min":0.378},"min":{"1min":0.29299999999999998,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.497,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.434}]},{"osd":3,"last update":"Thu Apr 25 02:29:31 2024","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.374,"15min":0.378},"min":{"1min":0.31900000000000001,"5min":0.186,"15min":0.186},"max":{"1min":0.47799999999999998,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.371,"15min":0.41199999999999998},"min":{"1min":0.33700000000000002,"5min":0.221,"15min":0.221},"max":{"1min":0.55100000000000005,"5min":0.57299999999999995,"15min":0.63100000000000001},"last":0.41299999999999998}]}]},{"osd":1,"up_from":29,"seq":124554051668,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":351548,"kb_used_data":50100,"kb_used_omap":4,"kb_used_meta":301435,"kb_avail":94020292,"statfs":{"total":96636764160,"available":96276779008,"internally_reserved":0,"allocated":51302400,"data_stored":51088318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4963,"internal_metadata":308669597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:29:14 2024","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.29299999999999998,"15min":0.32100000000000001},"min":{"1min":0.23599999999999999,"5min":0.155,"15min":0.155},"max":{"1min":0.42399999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.36099999999999999,"5min":0.315,"15min":0.34499999999999997},"min":{"1min":0.25900000000000001,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.48399999999999999,"5min":0.53600000000000003,"15min":0.54000000000000004},"last":0.48799999999999999}]},{"osd":2,"last update":"Thu Apr 25 02:29:14 2024","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.33000000000000002,"15min":0.34699999999999998},"min":{"1min":0.26200000000000001,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.34499999999999997,"15min":0.35899999999999999},"min":{"1min":0.26900000000000002,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.54400000000000004,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.51100000000000001}]},{"osd":3,"last update":"Thu Apr 25 02:29:14 2024","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.36599999999999999,"15min":0.39200000000000002},"min":{"1min":0.32700000000000001,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.55000000000000004,"5min":0.57799999999999996,"15min":0.57799999999999996},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.35699999999999998,"15min":0.38300000000000001},"min":{"1min":0.307,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.52900000000000003,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.46500000000000002}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":60215296,"data_stored":60184605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15790,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":50343936,"data_stored":50332293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4963,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57974784,"data_stored":57954225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8387,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90095616,"data_stored":90050975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9975,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:30:01.438 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-25T02:20:23.840633+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=20, tm_sec=23, tm_wday=3, tm_yday=116, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=25, tm_hour=2, tm_min=28, tm_sec=16, tm_wday=3, tm_yday=116, tm_isdst=0) 2024-04-25T02:30:01.439 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-25T02:30:21.440 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-25T02:30:21.570 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.566+0000 7f396c62c700 1 Processor -- start 2024-04-25T02:30:21.570 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.566+0000 7f396c62c700 1 -- start start 2024-04-25T02:30:21.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.567+0000 7f396c62c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f39640b2410 0x7f39640a22a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:21.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.567+0000 7f396c62c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f39640a3590 0x7f396413ee00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:21.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.567+0000 7f396c62c700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39640a2960 con 0x7f396413f340 2024-04-25T02:30:21.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.567+0000 7f396c62c700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f396413f7e0 con 0x7f39640b2410 2024-04-25T02:30:21.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.567+0000 7f396c62c700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f396413e8a0 con 0x7f39640a3590 2024-04-25T02:30:21.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.567+0000 7f3969bc7700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f39640a3590 0x7f396413ee00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:21.572 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.567+0000 7f396a3c8700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f39640b2410 0x7f39640a22a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:21.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.567+0000 7f3969bc7700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f39640a3590 0x7f396413ee00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:36020/0 (socket says 172.21.15.111:36020) 2024-04-25T02:30:21.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.567+0000 7f396a3c8700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f39640b2410 0x7f39640a22a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:54638/0 (socket says 172.21.15.111:54638) 2024-04-25T02:30:21.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.567+0000 7f396abc9700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f396413f340 0x7f396406da70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:59330/0 (socket says 172.21.15.111:59330) 2024-04-25T02:30:21.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.567+0000 7f3969bc7700 1 -- 172.21.15.111:0/259101594 learned_addr learned my addr 172.21.15.111:0/259101594 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:30:21.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.567+0000 7f39693c6700 1 -- 172.21.15.111:0/259101594 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3039366319 0 0) 0x7f39640a2960 con 0x7f396413f340 2024-04-25T02:30:21.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.567+0000 7f396a3c8700 1 -- 172.21.15.111:0/259101594 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f39640a3590 msgr2=0x7f396413ee00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:30:21.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.567+0000 7f396a3c8700 1 --2- 172.21.15.111:0/259101594 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f39640a3590 0x7f396413ee00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:21.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.567+0000 7f396a3c8700 1 -- 172.21.15.111:0/259101594 >> v1:172.21.15.111:6789/0 conn(0x7f396413f340 legacy=0x7f396406da70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:21.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.567+0000 7f396a3c8700 1 -- 172.21.15.111:0/259101594 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f396406ec90 con 0x7f39640b2410 2024-04-25T02:30:21.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.567+0000 7f3969bc7700 1 --2- 172.21.15.111:0/259101594 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f39640a3590 0x7f396413ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:30:21.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.567+0000 7f396a3c8700 1 --2- 172.21.15.111:0/259101594 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f39640b2410 0x7f39640a22a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3954009910 tx=0x7f39540091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1b54be75c3f5cdcc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:30:21.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.568+0000 7f39693c6700 1 -- 172.21.15.111:0/259101594 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395400b680 con 0x7f39640b2410 2024-04-25T02:30:21.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.568+0000 7f39693c6700 1 -- 172.21.15.111:0/259101594 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f395400b7e0 con 0x7f39640b2410 2024-04-25T02:30:21.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.568+0000 7f39693c6700 1 -- 172.21.15.111:0/259101594 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f395400bba0 con 0x7f39640b2410 2024-04-25T02:30:21.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.568+0000 7f396c62c700 1 -- 172.21.15.111:0/259101594 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f39640b2410 msgr2=0x7f39640a22a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:21.573 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.568+0000 7f396c62c700 1 --2- 172.21.15.111:0/259101594 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f39640b2410 0x7f39640a22a0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f3954009910 tx=0x7f39540091a0 comp rx=0 tx=0).stop 2024-04-25T02:30:21.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.568+0000 7f396c62c700 1 -- 172.21.15.111:0/259101594 shutdown_connections 2024-04-25T02:30:21.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.568+0000 7f396c62c700 1 --2- 172.21.15.111:0/259101594 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f39640b2410 0x7f39640a22a0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:21.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.568+0000 7f396c62c700 1 --2- 172.21.15.111:0/259101594 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f39640a3590 0x7f396413ee00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:21.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.568+0000 7f396c62c700 1 -- 172.21.15.111:0/259101594 >> 172.21.15.111:0/259101594 conn(0x7f396406abb0 msgr2=0x7f396406afb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:30:21.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.568+0000 7f396c62c700 1 -- 172.21.15.111:0/259101594 shutdown_connections 2024-04-25T02:30:21.574 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.568+0000 7f396c62c700 1 -- 172.21.15.111:0/259101594 wait complete. 2024-04-25T02:30:21.576 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.569+0000 7f396c62c700 1 Processor -- start 2024-04-25T02:30:21.576 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.569+0000 7f396c62c700 1 -- start start 2024-04-25T02:30:21.576 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.570+0000 7f396c62c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39640b2410 0x7f396409b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:21.576 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.570+0000 7f396c62c700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f396413f340 0x7f3964151c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:21.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.570+0000 7f396c62c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3964099840 0x7f3964099cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:21.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.570+0000 7f396c62c700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3964151850 con 0x7f39640b2410 2024-04-25T02:30:21.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.570+0000 7f396c62c700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3964099350 con 0x7f3964099840 2024-04-25T02:30:21.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.570+0000 7f396c62c700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f396409ab40 con 0x7f396413f340 2024-04-25T02:30:21.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.570+0000 7f396a3c8700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39640b2410 0x7f396409b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:21.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.570+0000 7f3969bc7700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f396413f340 0x7f3964151c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:21.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.570+0000 7f396a3c8700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39640b2410 0x7f396409b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:60720/0 (socket says 172.21.15.111:60720) 2024-04-25T02:30:21.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.570+0000 7f396abc9700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3964099840 0x7f3964099cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:21.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.570+0000 7f396a3c8700 1 -- 172.21.15.111:0/3993382150 learned_addr learned my addr 172.21.15.111:0/3993382150 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:30:21.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.570+0000 7f3969bc7700 1 -- 172.21.15.111:0/3993382150 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3964099840 msgr2=0x7f3964099cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:21.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.570+0000 7f3969bc7700 1 --2- 172.21.15.111:0/3993382150 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3964099840 0x7f3964099cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:21.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.570+0000 7f3969bc7700 1 -- 172.21.15.111:0/3993382150 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39640b2410 msgr2=0x7f396409b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:21.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.570+0000 7f3969bc7700 1 --2- 172.21.15.111:0/3993382150 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39640b2410 0x7f396409b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:21.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.570+0000 7f3969bc7700 1 -- 172.21.15.111:0/3993382150 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f396000b790 con 0x7f396413f340 2024-04-25T02:30:21.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.570+0000 7f396abc9700 1 --2- 172.21.15.111:0/3993382150 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3964099840 0x7f3964099cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:30:21.577 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.570+0000 7f396a3c8700 1 --2- 172.21.15.111:0/3993382150 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39640b2410 0x7f396409b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:30:21.578 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.570+0000 7f3969bc7700 1 --2- 172.21.15.111:0/3993382150 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f396413f340 0x7f3964151c70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3964070070 tx=0x7f396000b4f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:30:21.578 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.570+0000 7f395a7fc700 1 -- 172.21.15.111:0/3993382150 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f396000eeb0 con 0x7f396413f340 2024-04-25T02:30:21.578 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.571+0000 7f395a7fc700 1 -- 172.21.15.111:0/3993382150 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f396000dd00 con 0x7f396413f340 2024-04-25T02:30:21.578 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.571+0000 7f396c62c700 1 -- 172.21.15.111:0/3993382150 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3954009420 con 0x7f396413f340 2024-04-25T02:30:21.578 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.571+0000 7f395a7fc700 1 -- 172.21.15.111:0/3993382150 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3960010670 con 0x7f396413f340 2024-04-25T02:30:21.578 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.571+0000 7f396c62c700 1 -- 172.21.15.111:0/3993382150 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3964098ed0 con 0x7f396413f340 2024-04-25T02:30:21.578 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.571+0000 7f395a7fc700 1 -- 172.21.15.111:0/3993382150 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f3960010a20 con 0x7f396413f340 2024-04-25T02:30:21.578 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.571+0000 7f396c62c700 1 -- 172.21.15.111:0/3993382150 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3964151990 con 0x7f396413f340 2024-04-25T02:30:21.578 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.572+0000 7f395a7fc700 1 -- 172.21.15.111:0/3993382150 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4158+0+0 (secure 0 0 0) 0x7f396005b7b0 con 0x7f396413f340 2024-04-25T02:30:21.579 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.575+0000 7f395a7fc700 1 -- 172.21.15.111:0/3993382150 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f3964151990 con 0x7f396413f340 2024-04-25T02:30:21.730 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.726+0000 7f396c62c700 1 -- 172.21.15.111:0/3993382150 --> v1:172.21.15.111:6816/46482 -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3964151990 con 0x7f3948045ef0 2024-04-25T02:30:21.736 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.733+0000 7f395a7fc700 1 -- 172.21.15.111:0/3993382150 <== mgr.14107 v1:172.21.15.111:6816/46482 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+280416 (unknown 2965378022 0 1998076263) 0x7f3964151990 con 0x7f3948045ef0 2024-04-25T02:30:21.740 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:30:21.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.736+0000 7f396c62c700 1 -- 172.21.15.111:0/3993382150 >> v1:172.21.15.111:6816/46482 conn(0x7f3948045ef0 legacy=0x7f39480483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:21.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.736+0000 7f396c62c700 1 -- 172.21.15.111:0/3993382150 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f396413f340 msgr2=0x7f3964151c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:21.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.736+0000 7f396c62c700 1 --2- 172.21.15.111:0/3993382150 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f396413f340 0x7f3964151c70 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f3964070070 tx=0x7f396000b4f0 comp rx=0 tx=0).stop 2024-04-25T02:30:21.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.736+0000 7f396c62c700 1 -- 172.21.15.111:0/3993382150 shutdown_connections 2024-04-25T02:30:21.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.736+0000 7f396c62c700 1 --2- 172.21.15.111:0/3993382150 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3964099840 0x7f3964099cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:21.742 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.736+0000 7f396c62c700 1 --2- 172.21.15.111:0/3993382150 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f39640b2410 0x7f396409b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:21.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.736+0000 7f396c62c700 1 --2- 172.21.15.111:0/3993382150 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f396413f340 0x7f3964151c70 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:21.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.736+0000 7f396c62c700 1 -- 172.21.15.111:0/3993382150 >> 172.21.15.111:0/3993382150 conn(0x7f396406abb0 msgr2=0x7f396413dff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:30:21.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.736+0000 7f396c62c700 1 -- 172.21.15.111:0/3993382150 shutdown_connections 2024-04-25T02:30:21.743 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.736+0000 7f396c62c700 1 -- 172.21.15.111:0/3993382150 wait complete. 2024-04-25T02:30:21.743 INFO:teuthology.orchestra.run.smithi111.stderr:dumped all 2024-04-25T02:30:21.751 INFO:teuthology.orchestra.run.smithi111.stdout:{"pg_ready":true,"pg_map":{"version":249,"stamp":"2024-04-25T02:30:20.835807+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":129851417,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":74,"num_whiteouts":0,"num_read":3127,"num_read_kb":1448109,"num_write":31191,"num_write_kb":4453499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35019,"ondisk_log_size":35019,"up":210,"acting":210,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":210,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":1481232,"kb_used_data":255152,"kb_used_omap":38,"kb_used_meta":1226009,"kb_avail":376006128,"statfs":{"total":386547056640,"available":385030275072,"internally_reserved":0,"allocated":261275648,"data_stored":260365462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39115,"internal_metadata":1255434037},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003344"},"pg_stats":[{"pgid":"4.3f","version":"43'402","reported_seq":485,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:48.101234+0000","last_change":"2024-04-25T02:28:48.101190+0000","last_active":"2024-04-25T02:28:48.101234+0000","last_peered":"2024-04-25T02:28:48.101234+0000","last_clean":"2024-04-25T02:28:48.101234+0000","last_became_active":"2024-04-25T02:23:13.845848+0000","last_became_peered":"2024-04-25T02:23:13.845848+0000","last_unstale":"2024-04-25T02:28:48.101234+0000","last_undegraded":"2024-04-25T02:28:48.101234+0000","last_fullsized":"2024-04-25T02:28:48.101234+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'402","last_scrub_stamp":"2024-04-25T02:28:48.101084+0000","last_deep_scrub":"43'402","last_deep_scrub_stamp":"2024-04-25T02:28:48.101084+0000","last_clean_scrub_stamp":"2024-04-25T02:28:48.101084+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:09:02.892301+0000","scrub_duration":0.0017175580000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":15113,"num_write":370,"num_write_kb":51033,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3e","version":"43'436","reported_seq":531,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:57.901623+0000","last_change":"2024-04-25T02:28:57.901586+0000","last_active":"2024-04-25T02:28:57.901623+0000","last_peered":"2024-04-25T02:28:57.901623+0000","last_clean":"2024-04-25T02:28:57.901623+0000","last_became_active":"2024-04-25T02:23:12.845429+0000","last_became_peered":"2024-04-25T02:23:12.845429+0000","last_unstale":"2024-04-25T02:28:57.901623+0000","last_undegraded":"2024-04-25T02:28:57.901623+0000","last_fullsized":"2024-04-25T02:28:57.901623+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'436","last_scrub_stamp":"2024-04-25T02:28:57.901454+0000","last_deep_scrub":"43'436","last_deep_scrub_stamp":"2024-04-25T02:28:57.901454+0000","last_clean_scrub_stamp":"2024-04-25T02:28:57.901454+0000","objects_scrubbed":0,"log_size":436,"log_dups_size":0,"ondisk_log_size":436,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:48:22.177582+0000","scrub_duration":0.0024754489999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":45,"num_read_kb":22592,"num_write":405,"num_write_kb":75650,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"43'370","reported_seq":441,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:02.954241+0000","last_change":"2024-04-25T02:29:02.954173+0000","last_active":"2024-04-25T02:29:02.954241+0000","last_peered":"2024-04-25T02:29:02.954241+0000","last_clean":"2024-04-25T02:29:02.954241+0000","last_became_active":"2024-04-25T02:23:11.838054+0000","last_became_peered":"2024-04-25T02:23:11.838054+0000","last_unstale":"2024-04-25T02:29:02.954241+0000","last_undegraded":"2024-04-25T02:29:02.954241+0000","last_fullsized":"2024-04-25T02:29:02.954241+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'370","last_scrub_stamp":"2024-04-25T02:29:02.954067+0000","last_deep_scrub":"43'370","last_deep_scrub_stamp":"2024-04-25T02:29:02.954067+0000","last_clean_scrub_stamp":"2024-04-25T02:29:02.954067+0000","objects_scrubbed":0,"log_size":370,"log_dups_size":0,"ondisk_log_size":370,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:35:19.757284+0000","scrub_duration":0.0024131999999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":15817,"num_write":338,"num_write_kb":46402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3c","version":"43'393","reported_seq":485,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:47.102595+0000","last_change":"2024-04-25T02:28:47.102563+0000","last_active":"2024-04-25T02:28:47.102595+0000","last_peered":"2024-04-25T02:28:47.102595+0000","last_clean":"2024-04-25T02:28:47.102595+0000","last_became_active":"2024-04-25T02:23:11.836681+0000","last_became_peered":"2024-04-25T02:23:11.836681+0000","last_unstale":"2024-04-25T02:28:47.102595+0000","last_undegraded":"2024-04-25T02:28:47.102595+0000","last_fullsized":"2024-04-25T02:28:47.102595+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'393","last_scrub_stamp":"2024-04-25T02:28:47.102463+0000","last_deep_scrub":"43'393","last_deep_scrub_stamp":"2024-04-25T02:28:47.102463+0000","last_clean_scrub_stamp":"2024-04-25T02:28:47.102463+0000","objects_scrubbed":0,"log_size":393,"log_dups_size":0,"ondisk_log_size":393,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:57:03.660053+0000","scrub_duration":0.0021321360000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":22923,"num_write":365,"num_write_kb":51318,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3b","version":"43'406","reported_seq":486,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:08.984923+0000","last_change":"2024-04-25T02:29:08.984891+0000","last_active":"2024-04-25T02:29:08.984923+0000","last_peered":"2024-04-25T02:29:08.984923+0000","last_clean":"2024-04-25T02:29:08.984923+0000","last_became_active":"2024-04-25T02:23:13.842918+0000","last_became_peered":"2024-04-25T02:23:13.842918+0000","last_unstale":"2024-04-25T02:29:08.984923+0000","last_undegraded":"2024-04-25T02:29:08.984923+0000","last_fullsized":"2024-04-25T02:29:08.984923+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'406","last_scrub_stamp":"2024-04-25T02:29:08.984789+0000","last_deep_scrub":"43'406","last_deep_scrub_stamp":"2024-04-25T02:29:08.984789+0000","last_clean_scrub_stamp":"2024-04-25T02:29:08.984789+0000","objects_scrubbed":0,"log_size":406,"log_dups_size":0,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:26:07.312359+0000","scrub_duration":0.0021373719999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":14619,"num_write":384,"num_write_kb":71611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"43'366","reported_seq":438,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:39.393603+0000","last_change":"2024-04-25T02:28:39.393572+0000","last_active":"2024-04-25T02:28:39.393603+0000","last_peered":"2024-04-25T02:28:39.393603+0000","last_clean":"2024-04-25T02:28:39.393603+0000","last_became_active":"2024-04-25T02:23:13.848160+0000","last_became_peered":"2024-04-25T02:23:13.848160+0000","last_unstale":"2024-04-25T02:28:39.393603+0000","last_undegraded":"2024-04-25T02:28:39.393603+0000","last_fullsized":"2024-04-25T02:28:39.393603+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'366","last_scrub_stamp":"2024-04-25T02:28:39.393471+0000","last_deep_scrub":"43'366","last_deep_scrub_stamp":"2024-04-25T02:28:39.393471+0000","last_clean_scrub_stamp":"2024-04-25T02:28:39.393471+0000","objects_scrubbed":0,"log_size":366,"log_dups_size":0,"ondisk_log_size":366,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:09:44.749626+0000","scrub_duration":0.0023219040000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":12472,"num_write":338,"num_write_kb":33864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.39","version":"43'441","reported_seq":570,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:56.387424+0000","last_change":"2024-04-25T02:29:56.387374+0000","last_active":"2024-04-25T02:29:56.387424+0000","last_peered":"2024-04-25T02:29:56.387424+0000","last_clean":"2024-04-25T02:29:56.387424+0000","last_became_active":"2024-04-25T02:23:13.840374+0000","last_became_peered":"2024-04-25T02:23:13.840374+0000","last_unstale":"2024-04-25T02:29:56.387424+0000","last_undegraded":"2024-04-25T02:29:56.387424+0000","last_fullsized":"2024-04-25T02:29:56.387424+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'441","last_scrub_stamp":"2024-04-25T02:29:56.387259+0000","last_deep_scrub":"43'441","last_deep_scrub_stamp":"2024-04-25T02:29:56.387259+0000","last_clean_scrub_stamp":"2024-04-25T02:29:56.387259+0000","objects_scrubbed":0,"log_size":441,"log_dups_size":0,"ondisk_log_size":441,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:26:50.416924+0000","scrub_duration":0.0024312380000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":73,"num_read_kb":40192,"num_write":416,"num_write_kb":101787,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.38","version":"43'364","reported_seq":441,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:03.943257+0000","last_change":"2024-04-25T02:29:03.943200+0000","last_active":"2024-04-25T02:29:03.943257+0000","last_peered":"2024-04-25T02:29:03.943257+0000","last_clean":"2024-04-25T02:29:03.943257+0000","last_became_active":"2024-04-25T02:23:11.834759+0000","last_became_peered":"2024-04-25T02:23:11.834759+0000","last_unstale":"2024-04-25T02:29:03.943257+0000","last_undegraded":"2024-04-25T02:29:03.943257+0000","last_fullsized":"2024-04-25T02:29:03.943257+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'364","last_scrub_stamp":"2024-04-25T02:29:03.943064+0000","last_deep_scrub":"43'364","last_deep_scrub_stamp":"2024-04-25T02:29:03.943064+0000","last_clean_scrub_stamp":"2024-04-25T02:29:03.943064+0000","objects_scrubbed":0,"log_size":364,"log_dups_size":0,"ondisk_log_size":364,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:43:03.314177+0000","scrub_duration":0.0023381109999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":18431,"num_write":330,"num_write_kb":66835,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.37","version":"43'425","reported_seq":525,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:22.157783+0000","last_change":"2024-04-25T02:28:22.157736+0000","last_active":"2024-04-25T02:28:22.157783+0000","last_peered":"2024-04-25T02:28:22.157783+0000","last_clean":"2024-04-25T02:28:22.157783+0000","last_became_active":"2024-04-25T02:23:13.841883+0000","last_became_peered":"2024-04-25T02:23:13.841883+0000","last_unstale":"2024-04-25T02:28:22.157783+0000","last_undegraded":"2024-04-25T02:28:22.157783+0000","last_fullsized":"2024-04-25T02:28:22.157783+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'425","last_scrub_stamp":"2024-04-25T02:28:22.157614+0000","last_deep_scrub":"43'425","last_deep_scrub_stamp":"2024-04-25T02:28:22.157614+0000","last_clean_scrub_stamp":"2024-04-25T02:28:22.157614+0000","objects_scrubbed":0,"log_size":425,"log_dups_size":0,"ondisk_log_size":425,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:28:28.713838+0000","scrub_duration":0.0023306529999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":29378,"num_write":387,"num_write_kb":39136,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"43'396","reported_seq":480,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:45.945484+0000","last_change":"2024-04-25T02:28:45.945437+0000","last_active":"2024-04-25T02:28:45.945484+0000","last_peered":"2024-04-25T02:28:45.945484+0000","last_clean":"2024-04-25T02:28:45.945484+0000","last_became_active":"2024-04-25T02:23:11.835958+0000","last_became_peered":"2024-04-25T02:23:11.835958+0000","last_unstale":"2024-04-25T02:28:45.945484+0000","last_undegraded":"2024-04-25T02:28:45.945484+0000","last_fullsized":"2024-04-25T02:28:45.945484+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'396","last_scrub_stamp":"2024-04-25T02:28:45.945325+0000","last_deep_scrub":"43'396","last_deep_scrub_stamp":"2024-04-25T02:28:45.945325+0000","last_clean_scrub_stamp":"2024-04-25T02:28:45.945325+0000","objects_scrubbed":0,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:53:01.215968+0000","scrub_duration":0.002346295,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":25799,"num_write":352,"num_write_kb":67037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.35","version":"43'354","reported_seq":404,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:00.899398+0000","last_change":"2024-04-25T02:29:00.899373+0000","last_active":"2024-04-25T02:29:00.899398+0000","last_peered":"2024-04-25T02:29:00.899398+0000","last_clean":"2024-04-25T02:29:00.899398+0000","last_became_active":"2024-04-25T02:23:11.836214+0000","last_became_peered":"2024-04-25T02:23:11.836214+0000","last_unstale":"2024-04-25T02:29:00.899398+0000","last_undegraded":"2024-04-25T02:29:00.899398+0000","last_fullsized":"2024-04-25T02:29:00.899398+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'354","last_scrub_stamp":"2024-04-25T02:29:00.899283+0000","last_deep_scrub":"43'354","last_deep_scrub_stamp":"2024-04-25T02:29:00.899283+0000","last_clean_scrub_stamp":"2024-04-25T02:29:00.899283+0000","objects_scrubbed":0,"log_size":354,"log_dups_size":0,"ondisk_log_size":354,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:31:45.783246+0000","scrub_duration":0.0018755740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7176,"num_write":336,"num_write_kb":37702,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"43'335","reported_seq":387,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:58.900017+0000","last_change":"2024-04-25T02:28:58.899981+0000","last_active":"2024-04-25T02:28:58.900017+0000","last_peered":"2024-04-25T02:28:58.900017+0000","last_clean":"2024-04-25T02:28:58.900017+0000","last_became_active":"2024-04-25T02:23:13.847446+0000","last_became_peered":"2024-04-25T02:23:13.847446+0000","last_unstale":"2024-04-25T02:28:58.900017+0000","last_undegraded":"2024-04-25T02:28:58.900017+0000","last_fullsized":"2024-04-25T02:28:58.900017+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'335","last_scrub_stamp":"2024-04-25T02:28:58.899850+0000","last_deep_scrub":"43'335","last_deep_scrub_stamp":"2024-04-25T02:28:58.899850+0000","last_clean_scrub_stamp":"2024-04-25T02:28:58.899850+0000","objects_scrubbed":0,"log_size":335,"log_dups_size":0,"ondisk_log_size":335,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:53:40.661144+0000","scrub_duration":0.0020817689999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4160,"num_write":309,"num_write_kb":33908,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.33","version":"43'387","reported_seq":439,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:26.212350+0000","last_change":"2024-04-25T02:28:26.212320+0000","last_active":"2024-04-25T02:28:26.212350+0000","last_peered":"2024-04-25T02:28:26.212350+0000","last_clean":"2024-04-25T02:28:26.212350+0000","last_became_active":"2024-04-25T02:23:13.847009+0000","last_became_peered":"2024-04-25T02:23:13.847009+0000","last_unstale":"2024-04-25T02:28:26.212350+0000","last_undegraded":"2024-04-25T02:28:26.212350+0000","last_fullsized":"2024-04-25T02:28:26.212350+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'387","last_scrub_stamp":"2024-04-25T02:28:26.212204+0000","last_deep_scrub":"43'387","last_deep_scrub_stamp":"2024-04-25T02:28:26.212204+0000","last_clean_scrub_stamp":"2024-04-25T02:28:26.212204+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:25:07.412842+0000","scrub_duration":0.0024916069999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":4152,"num_write":352,"num_write_kb":42524,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"43'450","reported_seq":539,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:20.974106+0000","last_change":"2024-04-25T02:28:20.974062+0000","last_active":"2024-04-25T02:28:20.974106+0000","last_peered":"2024-04-25T02:28:20.974106+0000","last_clean":"2024-04-25T02:28:20.974106+0000","last_became_active":"2024-04-25T02:23:12.841783+0000","last_became_peered":"2024-04-25T02:23:12.841783+0000","last_unstale":"2024-04-25T02:28:20.974106+0000","last_undegraded":"2024-04-25T02:28:20.974106+0000","last_fullsized":"2024-04-25T02:28:20.974106+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'450","last_scrub_stamp":"2024-04-25T02:28:20.973929+0000","last_deep_scrub":"43'450","last_deep_scrub_stamp":"2024-04-25T02:28:20.973929+0000","last_clean_scrub_stamp":"2024-04-25T02:28:20.973929+0000","objects_scrubbed":0,"log_size":450,"log_dups_size":0,"ondisk_log_size":450,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:56:11.043992+0000","scrub_duration":0.002462386,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":25198,"num_write":421,"num_write_kb":88864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"43'430","reported_seq":532,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:44.037754+0000","last_change":"2024-04-25T02:28:44.037712+0000","last_active":"2024-04-25T02:28:44.037754+0000","last_peered":"2024-04-25T02:28:44.037754+0000","last_clean":"2024-04-25T02:28:44.037754+0000","last_became_active":"2024-04-25T02:23:11.835815+0000","last_became_peered":"2024-04-25T02:23:11.835815+0000","last_unstale":"2024-04-25T02:28:44.037754+0000","last_undegraded":"2024-04-25T02:28:44.037754+0000","last_fullsized":"2024-04-25T02:28:44.037754+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'430","last_scrub_stamp":"2024-04-25T02:28:44.037608+0000","last_deep_scrub":"43'430","last_deep_scrub_stamp":"2024-04-25T02:28:44.037608+0000","last_clean_scrub_stamp":"2024-04-25T02:28:44.037608+0000","objects_scrubbed":0,"log_size":430,"log_dups_size":0,"ondisk_log_size":430,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:53:08.207544+0000","scrub_duration":0.0021441519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":31947,"num_write":393,"num_write_kb":64059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.30","version":"43'438","reported_seq":473,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:20.052051+0000","last_change":"2024-04-25T02:29:20.052012+0000","last_active":"2024-04-25T02:29:20.052051+0000","last_peered":"2024-04-25T02:29:20.052051+0000","last_clean":"2024-04-25T02:29:20.052051+0000","last_became_active":"2024-04-25T02:23:55.963259+0000","last_became_peered":"2024-04-25T02:23:55.963259+0000","last_unstale":"2024-04-25T02:29:20.052051+0000","last_undegraded":"2024-04-25T02:29:20.052051+0000","last_fullsized":"2024-04-25T02:29:20.052051+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'438","last_scrub_stamp":"2024-04-25T02:29:20.051907+0000","last_deep_scrub":"43'438","last_deep_scrub_stamp":"2024-04-25T02:29:20.051907+0000","last_clean_scrub_stamp":"2024-04-25T02:29:20.051907+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:10:04.030325+0000","scrub_duration":0.00216768,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":2639,"num_write":405,"num_write_kb":51451,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2f","version":"43'394","reported_seq":467,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:38.963150+0000","last_change":"2024-04-25T02:29:38.963119+0000","last_active":"2024-04-25T02:29:38.963150+0000","last_peered":"2024-04-25T02:29:38.963150+0000","last_clean":"2024-04-25T02:29:38.963150+0000","last_became_active":"2024-04-25T02:23:13.844343+0000","last_became_peered":"2024-04-25T02:23:13.844343+0000","last_unstale":"2024-04-25T02:29:38.963150+0000","last_undegraded":"2024-04-25T02:29:38.963150+0000","last_fullsized":"2024-04-25T02:29:38.963150+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'394","last_scrub_stamp":"2024-04-25T02:29:38.963016+0000","last_deep_scrub":"43'394","last_deep_scrub_stamp":"2024-04-25T02:29:38.963016+0000","last_clean_scrub_stamp":"2024-04-25T02:29:38.963016+0000","objects_scrubbed":0,"log_size":394,"log_dups_size":0,"ondisk_log_size":394,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:24:22.202965+0000","scrub_duration":0.0021597349999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":9696,"num_write":367,"num_write_kb":33966,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2e","version":"43'391","reported_seq":481,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:58.011960+0000","last_change":"2024-04-25T02:28:58.011911+0000","last_active":"2024-04-25T02:28:58.011960+0000","last_peered":"2024-04-25T02:28:58.011960+0000","last_clean":"2024-04-25T02:28:58.011960+0000","last_became_active":"2024-04-25T02:23:12.848051+0000","last_became_peered":"2024-04-25T02:23:12.848051+0000","last_unstale":"2024-04-25T02:28:58.011960+0000","last_undegraded":"2024-04-25T02:28:58.011960+0000","last_fullsized":"2024-04-25T02:28:58.011960+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'391","last_scrub_stamp":"2024-04-25T02:28:58.011806+0000","last_deep_scrub":"43'391","last_deep_scrub_stamp":"2024-04-25T02:28:58.011806+0000","last_clean_scrub_stamp":"2024-04-25T02:28:58.011806+0000","objects_scrubbed":0,"log_size":391,"log_dups_size":0,"ondisk_log_size":391,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:35:06.338277+0000","scrub_duration":0.0021863519999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":41,"num_read_kb":13345,"num_write":357,"num_write_kb":38441,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"43'429","reported_seq":550,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:52.924323+0000","last_change":"2024-04-25T02:28:52.924295+0000","last_active":"2024-04-25T02:28:52.924323+0000","last_peered":"2024-04-25T02:28:52.924323+0000","last_clean":"2024-04-25T02:28:52.924323+0000","last_became_active":"2024-04-25T02:23:13.847602+0000","last_became_peered":"2024-04-25T02:23:13.847602+0000","last_unstale":"2024-04-25T02:28:52.924323+0000","last_undegraded":"2024-04-25T02:28:52.924323+0000","last_fullsized":"2024-04-25T02:28:52.924323+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'429","last_scrub_stamp":"2024-04-25T02:28:52.924165+0000","last_deep_scrub":"43'429","last_deep_scrub_stamp":"2024-04-25T02:28:52.924165+0000","last_clean_scrub_stamp":"2024-04-25T02:28:52.924165+0000","objects_scrubbed":0,"log_size":429,"log_dups_size":0,"ondisk_log_size":429,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:54:54.792159+0000","scrub_duration":0.0025521599999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":37845,"num_write":400,"num_write_kb":88566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2c","version":"43'437","reported_seq":523,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:44.934901+0000","last_change":"2024-04-25T02:28:44.934874+0000","last_active":"2024-04-25T02:28:44.934901+0000","last_peered":"2024-04-25T02:28:44.934901+0000","last_clean":"2024-04-25T02:28:44.934901+0000","last_became_active":"2024-04-25T02:23:13.845934+0000","last_became_peered":"2024-04-25T02:23:13.845934+0000","last_unstale":"2024-04-25T02:28:44.934901+0000","last_undegraded":"2024-04-25T02:28:44.934901+0000","last_fullsized":"2024-04-25T02:28:44.934901+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'437","last_scrub_stamp":"2024-04-25T02:28:44.934771+0000","last_deep_scrub":"43'437","last_deep_scrub_stamp":"2024-04-25T02:28:44.934771+0000","last_clean_scrub_stamp":"2024-04-25T02:28:44.934771+0000","objects_scrubbed":0,"log_size":437,"log_dups_size":0,"ondisk_log_size":437,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:30:07.359904+0000","scrub_duration":0.002337244,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":22073,"num_write":412,"num_write_kb":67090,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"43'414","reported_seq":517,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:04.980449+0000","last_change":"2024-04-25T02:29:04.980413+0000","last_active":"2024-04-25T02:29:04.980449+0000","last_peered":"2024-04-25T02:29:04.980449+0000","last_clean":"2024-04-25T02:29:04.980449+0000","last_became_active":"2024-04-25T02:23:13.846758+0000","last_became_peered":"2024-04-25T02:23:13.846758+0000","last_unstale":"2024-04-25T02:29:04.980449+0000","last_undegraded":"2024-04-25T02:29:04.980449+0000","last_fullsized":"2024-04-25T02:29:04.980449+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'414","last_scrub_stamp":"2024-04-25T02:29:04.980312+0000","last_deep_scrub":"43'414","last_deep_scrub_stamp":"2024-04-25T02:29:04.980312+0000","last_clean_scrub_stamp":"2024-04-25T02:29:04.980312+0000","objects_scrubbed":0,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:54:37.287485+0000","scrub_duration":0.0022436330000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":57,"num_read_kb":24525,"num_write":378,"num_write_kb":100342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2a","version":"43'445","reported_seq":529,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:54.117074+0000","last_change":"2024-04-25T02:28:54.117045+0000","last_active":"2024-04-25T02:28:54.117074+0000","last_peered":"2024-04-25T02:28:54.117074+0000","last_clean":"2024-04-25T02:28:54.117074+0000","last_became_active":"2024-04-25T02:23:11.835319+0000","last_became_peered":"2024-04-25T02:23:11.835319+0000","last_unstale":"2024-04-25T02:28:54.117074+0000","last_undegraded":"2024-04-25T02:28:54.117074+0000","last_fullsized":"2024-04-25T02:28:54.117074+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'445","last_scrub_stamp":"2024-04-25T02:28:54.116947+0000","last_deep_scrub":"43'445","last_deep_scrub_stamp":"2024-04-25T02:28:54.116947+0000","last_clean_scrub_stamp":"2024-04-25T02:28:54.116947+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:58:51.124066+0000","scrub_duration":0.0023452529999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":18532,"num_write":411,"num_write_kb":84101,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.29","version":"43'408","reported_seq":526,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:29.377058+0000","last_change":"2024-04-25T02:28:29.377031+0000","last_active":"2024-04-25T02:28:29.377058+0000","last_peered":"2024-04-25T02:28:29.377058+0000","last_clean":"2024-04-25T02:28:29.377058+0000","last_became_active":"2024-04-25T02:23:13.838917+0000","last_became_peered":"2024-04-25T02:23:13.838917+0000","last_unstale":"2024-04-25T02:28:29.377058+0000","last_undegraded":"2024-04-25T02:28:29.377058+0000","last_fullsized":"2024-04-25T02:28:29.377058+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'408","last_scrub_stamp":"2024-04-25T02:28:29.376935+0000","last_deep_scrub":"43'408","last_deep_scrub_stamp":"2024-04-25T02:28:29.376935+0000","last_clean_scrub_stamp":"2024-04-25T02:28:29.376935+0000","objects_scrubbed":0,"log_size":408,"log_dups_size":0,"ondisk_log_size":408,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:25:26.084049+0000","scrub_duration":0.002236952,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":25750,"num_write":380,"num_write_kb":75795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.28","version":"43'451","reported_seq":527,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:12.994175+0000","last_change":"2024-04-25T02:29:12.994140+0000","last_active":"2024-04-25T02:29:12.994175+0000","last_peered":"2024-04-25T02:29:12.994175+0000","last_clean":"2024-04-25T02:29:12.994175+0000","last_became_active":"2024-04-25T02:23:13.845814+0000","last_became_peered":"2024-04-25T02:23:13.845814+0000","last_unstale":"2024-04-25T02:29:12.994175+0000","last_undegraded":"2024-04-25T02:29:12.994175+0000","last_fullsized":"2024-04-25T02:29:12.994175+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'451","last_scrub_stamp":"2024-04-25T02:29:12.994028+0000","last_deep_scrub":"43'451","last_deep_scrub_stamp":"2024-04-25T02:29:12.994028+0000","last_clean_scrub_stamp":"2024-04-25T02:29:12.994028+0000","objects_scrubbed":0,"log_size":451,"log_dups_size":0,"ondisk_log_size":451,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:57:15.232896+0000","scrub_duration":0.0023399319999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":13960,"num_write":428,"num_write_kb":96160,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.27","version":"43'397","reported_seq":460,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:38.013962+0000","last_change":"2024-04-25T02:28:38.013905+0000","last_active":"2024-04-25T02:28:38.013962+0000","last_peered":"2024-04-25T02:28:38.013962+0000","last_clean":"2024-04-25T02:28:38.013962+0000","last_became_active":"2024-04-25T02:23:13.852093+0000","last_became_peered":"2024-04-25T02:23:13.852093+0000","last_unstale":"2024-04-25T02:28:38.013962+0000","last_undegraded":"2024-04-25T02:28:38.013962+0000","last_fullsized":"2024-04-25T02:28:38.013962+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'397","last_scrub_stamp":"2024-04-25T02:28:38.013798+0000","last_deep_scrub":"43'397","last_deep_scrub_stamp":"2024-04-25T02:28:38.013798+0000","last_clean_scrub_stamp":"2024-04-25T02:28:38.013798+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:40:41.237724+0000","scrub_duration":0.0021175439999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":3870,"num_write":383,"num_write_kb":17738,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.26","version":"43'485","reported_seq":577,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:20.987687+0000","last_change":"2024-04-25T02:29:20.987666+0000","last_active":"2024-04-25T02:29:20.987687+0000","last_peered":"2024-04-25T02:29:20.987687+0000","last_clean":"2024-04-25T02:29:20.987687+0000","last_became_active":"2024-04-25T02:23:12.841477+0000","last_became_peered":"2024-04-25T02:23:12.841477+0000","last_unstale":"2024-04-25T02:29:20.987687+0000","last_undegraded":"2024-04-25T02:29:20.987687+0000","last_fullsized":"2024-04-25T02:29:20.987687+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'485","last_scrub_stamp":"2024-04-25T02:29:20.987575+0000","last_deep_scrub":"43'485","last_deep_scrub_stamp":"2024-04-25T02:29:20.987575+0000","last_clean_scrub_stamp":"2024-04-25T02:29:20.987575+0000","objects_scrubbed":0,"log_size":485,"log_dups_size":0,"ondisk_log_size":485,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:34:13.118720+0000","scrub_duration":0.001798006,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":24645,"num_write":445,"num_write_kb":96750,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.25","version":"43'384","reported_seq":468,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:57.542986+0000","last_change":"2024-04-25T02:28:57.542945+0000","last_active":"2024-04-25T02:28:57.542986+0000","last_peered":"2024-04-25T02:28:57.542986+0000","last_clean":"2024-04-25T02:28:57.542986+0000","last_became_active":"2024-04-25T02:23:13.840422+0000","last_became_peered":"2024-04-25T02:23:13.840422+0000","last_unstale":"2024-04-25T02:28:57.542986+0000","last_undegraded":"2024-04-25T02:28:57.542986+0000","last_fullsized":"2024-04-25T02:28:57.542986+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'384","last_scrub_stamp":"2024-04-25T02:28:57.542849+0000","last_deep_scrub":"43'384","last_deep_scrub_stamp":"2024-04-25T02:28:57.542849+0000","last_clean_scrub_stamp":"2024-04-25T02:28:57.542849+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:56:54.046678+0000","scrub_duration":0.002320112,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":6130,"num_write":356,"num_write_kb":25986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"43'568","reported_seq":612,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:30.058301+0000","last_change":"2024-04-25T02:28:30.058267+0000","last_active":"2024-04-25T02:28:30.058301+0000","last_peered":"2024-04-25T02:28:30.058301+0000","last_clean":"2024-04-25T02:28:30.058301+0000","last_became_active":"2024-04-25T02:23:12.845923+0000","last_became_peered":"2024-04-25T02:23:12.845923+0000","last_unstale":"2024-04-25T02:28:30.058301+0000","last_undegraded":"2024-04-25T02:28:30.058301+0000","last_fullsized":"2024-04-25T02:28:30.058301+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'568","last_scrub_stamp":"2024-04-25T02:28:30.058171+0000","last_deep_scrub":"43'568","last_deep_scrub_stamp":"2024-04-25T02:28:30.058171+0000","last_clean_scrub_stamp":"2024-04-25T02:28:30.058171+0000","objects_scrubbed":3,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:07:27.211762+0000","scrub_duration":0.028959043,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":494,"num_write_kb":12610,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1d","version":"43'420","reported_seq":546,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:28.561650+0000","last_change":"2024-04-25T02:29:28.561602+0000","last_active":"2024-04-25T02:29:28.561650+0000","last_peered":"2024-04-25T02:29:28.561650+0000","last_clean":"2024-04-25T02:29:28.561650+0000","last_became_active":"2024-04-25T02:23:13.848844+0000","last_became_peered":"2024-04-25T02:23:13.848844+0000","last_unstale":"2024-04-25T02:29:28.561650+0000","last_undegraded":"2024-04-25T02:29:28.561650+0000","last_fullsized":"2024-04-25T02:29:28.561650+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'420","last_scrub_stamp":"2024-04-25T02:29:28.561478+0000","last_deep_scrub":"43'420","last_deep_scrub_stamp":"2024-04-25T02:29:28.561478+0000","last_clean_scrub_stamp":"2024-04-25T02:29:28.561478+0000","objects_scrubbed":0,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:18:30.047716+0000","scrub_duration":0.0024681999999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":74,"num_read_kb":41312,"num_write":376,"num_write_kb":112833,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.19","version":"43'384","reported_seq":430,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:50.931544+0000","last_change":"2024-04-25T02:28:50.931513+0000","last_active":"2024-04-25T02:28:50.931544+0000","last_peered":"2024-04-25T02:28:50.931544+0000","last_clean":"2024-04-25T02:28:50.931544+0000","last_became_active":"2024-04-25T02:23:13.846821+0000","last_became_peered":"2024-04-25T02:23:13.846821+0000","last_unstale":"2024-04-25T02:28:50.931544+0000","last_undegraded":"2024-04-25T02:28:50.931544+0000","last_fullsized":"2024-04-25T02:28:50.931544+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'384","last_scrub_stamp":"2024-04-25T02:28:50.931418+0000","last_deep_scrub":"43'384","last_deep_scrub_stamp":"2024-04-25T02:28:50.931418+0000","last_clean_scrub_stamp":"2024-04-25T02:28:50.931418+0000","objects_scrubbed":1,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:34:41.263744+0000","scrub_duration":0.013025725,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":334,"num_write_kb":4317,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1e","version":"43'428","reported_seq":532,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.942722+0000","last_change":"2024-04-25T02:29:19.942675+0000","last_active":"2024-04-25T02:29:19.942722+0000","last_peered":"2024-04-25T02:29:19.942722+0000","last_clean":"2024-04-25T02:29:19.942722+0000","last_became_active":"2024-04-25T02:23:11.840274+0000","last_became_peered":"2024-04-25T02:23:11.840274+0000","last_unstale":"2024-04-25T02:29:19.942722+0000","last_undegraded":"2024-04-25T02:29:19.942722+0000","last_fullsized":"2024-04-25T02:29:19.942722+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'428","last_scrub_stamp":"2024-04-25T02:29:19.942571+0000","last_deep_scrub":"43'428","last_deep_scrub_stamp":"2024-04-25T02:29:19.942571+0000","last_clean_scrub_stamp":"2024-04-25T02:29:19.942571+0000","objects_scrubbed":0,"log_size":428,"log_dups_size":0,"ondisk_log_size":428,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:00:33.792441+0000","scrub_duration":0.0026123420000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":28196,"num_write":410,"num_write_kb":104265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.18","version":"43'877","reported_seq":934,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:51.504360+0000","last_change":"2024-04-25T02:29:51.504333+0000","last_active":"2024-04-25T02:29:51.504360+0000","last_peered":"2024-04-25T02:29:51.504360+0000","last_clean":"2024-04-25T02:29:51.504360+0000","last_became_active":"2024-04-25T02:23:13.839361+0000","last_became_peered":"2024-04-25T02:23:13.839361+0000","last_unstale":"2024-04-25T02:29:51.504360+0000","last_undegraded":"2024-04-25T02:29:51.504360+0000","last_fullsized":"2024-04-25T02:29:51.504360+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'877","last_scrub_stamp":"2024-04-25T02:29:51.504233+0000","last_deep_scrub":"43'877","last_deep_scrub_stamp":"2024-04-25T02:29:51.504233+0000","last_clean_scrub_stamp":"2024-04-25T02:29:51.504233+0000","objects_scrubbed":2,"log_size":877,"log_dups_size":0,"ondisk_log_size":877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:00:50.430903+0000","scrub_duration":0.023179807,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":809,"num_write_kb":8568,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1f","version":"43'365","reported_seq":454,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:29.545278+0000","last_change":"2024-04-25T02:29:29.545240+0000","last_active":"2024-04-25T02:29:29.545278+0000","last_peered":"2024-04-25T02:29:29.545278+0000","last_clean":"2024-04-25T02:29:29.545278+0000","last_became_active":"2024-04-25T02:23:13.843656+0000","last_became_peered":"2024-04-25T02:23:13.843656+0000","last_unstale":"2024-04-25T02:29:29.545278+0000","last_undegraded":"2024-04-25T02:29:29.545278+0000","last_fullsized":"2024-04-25T02:29:29.545278+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'365","last_scrub_stamp":"2024-04-25T02:29:29.545140+0000","last_deep_scrub":"43'365","last_deep_scrub_stamp":"2024-04-25T02:29:29.545140+0000","last_clean_scrub_stamp":"2024-04-25T02:29:29.545140+0000","objects_scrubbed":0,"log_size":365,"log_dups_size":0,"ondisk_log_size":365,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:41:01.806067+0000","scrub_duration":0.001924748,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":37,"num_read_kb":25136,"num_write":341,"num_write_kb":38831,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"43'58","reported_seq":108,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:11.928495+0000","last_change":"2024-04-25T02:29:11.928453+0000","last_active":"2024-04-25T02:29:11.928495+0000","last_peered":"2024-04-25T02:29:11.928495+0000","last_clean":"2024-04-25T02:29:11.928495+0000","last_became_active":"2024-04-25T02:23:13.842598+0000","last_became_peered":"2024-04-25T02:23:13.842598+0000","last_unstale":"2024-04-25T02:29:11.928495+0000","last_undegraded":"2024-04-25T02:29:11.928495+0000","last_fullsized":"2024-04-25T02:29:11.928495+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'58","last_scrub_stamp":"2024-04-25T02:29:11.928351+0000","last_deep_scrub":"43'58","last_deep_scrub_stamp":"2024-04-25T02:29:11.928351+0000","last_clean_scrub_stamp":"2024-04-25T02:29:11.928351+0000","objects_scrubbed":2,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:20:47.749490+0000","scrub_duration":0.0035073959999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.10","version":"43'467","reported_seq":553,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:43.405508+0000","last_change":"2024-04-25T02:29:43.405465+0000","last_active":"2024-04-25T02:29:43.405508+0000","last_peered":"2024-04-25T02:29:43.405508+0000","last_clean":"2024-04-25T02:29:43.405508+0000","last_became_active":"2024-04-25T02:23:13.848675+0000","last_became_peered":"2024-04-25T02:23:13.848675+0000","last_unstale":"2024-04-25T02:29:43.405508+0000","last_undegraded":"2024-04-25T02:29:43.405508+0000","last_fullsized":"2024-04-25T02:29:43.405508+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'467","last_scrub_stamp":"2024-04-25T02:29:43.405348+0000","last_deep_scrub":"43'467","last_deep_scrub_stamp":"2024-04-25T02:29:43.405348+0000","last_clean_scrub_stamp":"2024-04-25T02:29:43.405348+0000","objects_scrubbed":0,"log_size":467,"log_dups_size":0,"ondisk_log_size":467,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:13:05.345571+0000","scrub_duration":0.0022427039999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":13580,"num_write":443,"num_write_kb":92928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"43'342","reported_seq":387,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:50.982472+0000","last_change":"2024-04-25T02:28:50.982445+0000","last_active":"2024-04-25T02:28:50.982472+0000","last_peered":"2024-04-25T02:28:50.982472+0000","last_clean":"2024-04-25T02:28:50.982472+0000","last_became_active":"2024-04-25T02:23:13.846764+0000","last_became_peered":"2024-04-25T02:23:13.846764+0000","last_unstale":"2024-04-25T02:28:50.982472+0000","last_undegraded":"2024-04-25T02:28:50.982472+0000","last_fullsized":"2024-04-25T02:28:50.982472+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'342","last_scrub_stamp":"2024-04-25T02:28:50.982355+0000","last_deep_scrub":"43'342","last_deep_scrub_stamp":"2024-04-25T02:28:50.982355+0000","last_clean_scrub_stamp":"2024-04-25T02:28:50.982355+0000","objects_scrubbed":2,"log_size":342,"log_dups_size":0,"ondisk_log_size":342,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:42:20.126126+0000","scrub_duration":0.013249924999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":281,"num_write_kb":4273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.11","version":"43'477","reported_seq":587,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:42.432082+0000","last_change":"2024-04-25T02:29:42.432052+0000","last_active":"2024-04-25T02:29:42.432082+0000","last_peered":"2024-04-25T02:29:42.432082+0000","last_clean":"2024-04-25T02:29:42.432082+0000","last_became_active":"2024-04-25T02:23:13.839702+0000","last_became_peered":"2024-04-25T02:23:13.839702+0000","last_unstale":"2024-04-25T02:29:42.432082+0000","last_undegraded":"2024-04-25T02:29:42.432082+0000","last_fullsized":"2024-04-25T02:29:42.432082+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'477","last_scrub_stamp":"2024-04-25T02:29:42.431949+0000","last_deep_scrub":"43'477","last_deep_scrub_stamp":"2024-04-25T02:29:42.431949+0000","last_clean_scrub_stamp":"2024-04-25T02:29:42.431949+0000","objects_scrubbed":0,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:05:59.797416+0000","scrub_duration":0.0023962509999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":30102,"num_write":452,"num_write_kb":97286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.15","version":"43'139","reported_seq":192,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:46.068929+0000","last_change":"2024-04-25T02:28:46.068904+0000","last_active":"2024-04-25T02:28:46.068929+0000","last_peered":"2024-04-25T02:28:46.068929+0000","last_clean":"2024-04-25T02:28:46.068929+0000","last_became_active":"2024-04-25T02:23:13.843625+0000","last_became_peered":"2024-04-25T02:23:13.843625+0000","last_unstale":"2024-04-25T02:28:46.068929+0000","last_undegraded":"2024-04-25T02:28:46.068929+0000","last_fullsized":"2024-04-25T02:28:46.068929+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'139","last_scrub_stamp":"2024-04-25T02:28:46.068815+0000","last_deep_scrub":"43'139","last_deep_scrub_stamp":"2024-04-25T02:28:46.068815+0000","last_clean_scrub_stamp":"2024-04-25T02:28:46.068815+0000","objects_scrubbed":3,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:12:26.672574+0000","scrub_duration":0.0037700569999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":643,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":72,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"43'422","reported_seq":506,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:10.977270+0000","last_change":"2024-04-25T02:29:10.977195+0000","last_active":"2024-04-25T02:29:10.977270+0000","last_peered":"2024-04-25T02:29:10.977270+0000","last_clean":"2024-04-25T02:29:10.977270+0000","last_became_active":"2024-04-25T02:23:13.850845+0000","last_became_peered":"2024-04-25T02:23:13.850845+0000","last_unstale":"2024-04-25T02:29:10.977270+0000","last_undegraded":"2024-04-25T02:29:10.977270+0000","last_fullsized":"2024-04-25T02:29:10.977270+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'422","last_scrub_stamp":"2024-04-25T02:29:10.977055+0000","last_deep_scrub":"43'422","last_deep_scrub_stamp":"2024-04-25T02:29:10.977055+0000","last_clean_scrub_stamp":"2024-04-25T02:29:10.977055+0000","objects_scrubbed":0,"log_size":422,"log_dups_size":0,"ondisk_log_size":422,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:29:00.511972+0000","scrub_duration":0.002540123,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":24672,"num_write":391,"num_write_kb":75497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"43'352","reported_seq":407,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:59.567581+0000","last_change":"2024-04-25T02:28:59.567554+0000","last_active":"2024-04-25T02:28:59.567581+0000","last_peered":"2024-04-25T02:28:59.567581+0000","last_clean":"2024-04-25T02:28:59.567581+0000","last_became_active":"2024-04-25T02:23:13.845176+0000","last_became_peered":"2024-04-25T02:23:13.845176+0000","last_unstale":"2024-04-25T02:28:59.567581+0000","last_undegraded":"2024-04-25T02:28:59.567581+0000","last_fullsized":"2024-04-25T02:28:59.567581+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'352","last_scrub_stamp":"2024-04-25T02:28:59.567461+0000","last_deep_scrub":"43'352","last_deep_scrub_stamp":"2024-04-25T02:28:59.567461+0000","last_clean_scrub_stamp":"2024-04-25T02:28:59.567461+0000","objects_scrubbed":7,"log_size":352,"log_dups_size":0,"ondisk_log_size":352,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:49:49.240975+0000","scrub_duration":0.026732694000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":10356006,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":7,"num_read_kb":10,"num_write":291,"num_write_kb":10309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.13","version":"43'405","reported_seq":483,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:30.146025+0000","last_change":"2024-04-25T02:28:30.145967+0000","last_active":"2024-04-25T02:28:30.146025+0000","last_peered":"2024-04-25T02:28:30.146025+0000","last_clean":"2024-04-25T02:28:30.146025+0000","last_became_active":"2024-04-25T02:23:55.963655+0000","last_became_peered":"2024-04-25T02:23:55.963655+0000","last_unstale":"2024-04-25T02:28:30.146025+0000","last_undegraded":"2024-04-25T02:28:30.146025+0000","last_fullsized":"2024-04-25T02:28:30.146025+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'405","last_scrub_stamp":"2024-04-25T02:28:30.145854+0000","last_deep_scrub":"43'405","last_deep_scrub_stamp":"2024-04-25T02:28:30.145854+0000","last_clean_scrub_stamp":"2024-04-25T02:28:30.145854+0000","objects_scrubbed":0,"log_size":405,"log_dups_size":0,"ondisk_log_size":405,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:14:49.219885+0000","scrub_duration":0.0021986240000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":11609,"num_write":365,"num_write_kb":76437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.13","version":"43'498","reported_seq":557,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:53.568295+0000","last_change":"2024-04-25T02:28:53.568258+0000","last_active":"2024-04-25T02:28:53.568295+0000","last_peered":"2024-04-25T02:28:53.568295+0000","last_clean":"2024-04-25T02:28:53.568295+0000","last_became_active":"2024-04-25T02:23:13.839158+0000","last_became_peered":"2024-04-25T02:23:13.839158+0000","last_unstale":"2024-04-25T02:28:53.568295+0000","last_undegraded":"2024-04-25T02:28:53.568295+0000","last_fullsized":"2024-04-25T02:28:53.568295+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'498","last_scrub_stamp":"2024-04-25T02:28:53.568128+0000","last_deep_scrub":"43'498","last_deep_scrub_stamp":"2024-04-25T02:28:53.568128+0000","last_clean_scrub_stamp":"2024-04-25T02:28:53.568128+0000","objects_scrubbed":5,"log_size":498,"log_dups_size":0,"ondisk_log_size":498,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:44:05.588274+0000","scrub_duration":0.023077066,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388642,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":7,"num_write":435,"num_write_kb":8384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.14","version":"43'409","reported_seq":499,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:17.565528+0000","last_change":"2024-04-25T02:29:17.565499+0000","last_active":"2024-04-25T02:29:17.565528+0000","last_peered":"2024-04-25T02:29:17.565528+0000","last_clean":"2024-04-25T02:29:17.565528+0000","last_became_active":"2024-04-25T02:23:13.843441+0000","last_became_peered":"2024-04-25T02:23:13.843441+0000","last_unstale":"2024-04-25T02:29:17.565528+0000","last_undegraded":"2024-04-25T02:29:17.565528+0000","last_fullsized":"2024-04-25T02:29:17.565528+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'409","last_scrub_stamp":"2024-04-25T02:29:17.565355+0000","last_deep_scrub":"43'409","last_deep_scrub_stamp":"2024-04-25T02:29:17.565355+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.565355+0000","objects_scrubbed":0,"log_size":409,"log_dups_size":0,"ondisk_log_size":409,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:21:28.285231+0000","scrub_duration":0.002262787,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":25550,"num_write":379,"num_write_kb":104949,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"43'52","reported_seq":101,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:57.048479+0000","last_change":"2024-04-25T02:28:57.048450+0000","last_active":"2024-04-25T02:28:57.048479+0000","last_peered":"2024-04-25T02:28:57.048479+0000","last_clean":"2024-04-25T02:28:57.048479+0000","last_became_active":"2024-04-25T02:23:13.841976+0000","last_became_peered":"2024-04-25T02:23:13.841976+0000","last_unstale":"2024-04-25T02:28:57.048479+0000","last_undegraded":"2024-04-25T02:28:57.048479+0000","last_fullsized":"2024-04-25T02:28:57.048479+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'52","last_scrub_stamp":"2024-04-25T02:28:57.048342+0000","last_deep_scrub":"43'52","last_deep_scrub_stamp":"2024-04-25T02:28:57.048342+0000","last_clean_scrub_stamp":"2024-04-25T02:28:57.048342+0000","objects_scrubbed":1,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:17:56.353296+0000","scrub_duration":0.0026068649999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"43'407","reported_seq":503,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:57.433408+0000","last_change":"2024-04-25T02:29:57.433378+0000","last_active":"2024-04-25T02:29:57.433408+0000","last_peered":"2024-04-25T02:29:57.433408+0000","last_clean":"2024-04-25T02:29:57.433408+0000","last_became_active":"2024-04-25T02:23:13.842163+0000","last_became_peered":"2024-04-25T02:23:13.842163+0000","last_unstale":"2024-04-25T02:29:57.433408+0000","last_undegraded":"2024-04-25T02:29:57.433408+0000","last_fullsized":"2024-04-25T02:29:57.433408+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'407","last_scrub_stamp":"2024-04-25T02:29:57.433263+0000","last_deep_scrub":"43'407","last_deep_scrub_stamp":"2024-04-25T02:29:57.433263+0000","last_clean_scrub_stamp":"2024-04-25T02:29:57.433263+0000","objects_scrubbed":0,"log_size":407,"log_dups_size":0,"ondisk_log_size":407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:56:39.591971+0000","scrub_duration":0.002398556,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":18209,"num_write":378,"num_write_kb":67140,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"43'57","reported_seq":107,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:06.608522+0000","last_change":"2024-04-25T02:29:06.608493+0000","last_active":"2024-04-25T02:29:06.608522+0000","last_peered":"2024-04-25T02:29:06.608522+0000","last_clean":"2024-04-25T02:29:06.608522+0000","last_became_active":"2024-04-25T02:23:13.838616+0000","last_became_peered":"2024-04-25T02:23:13.838616+0000","last_unstale":"2024-04-25T02:29:06.608522+0000","last_undegraded":"2024-04-25T02:29:06.608522+0000","last_fullsized":"2024-04-25T02:29:06.608522+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'57","last_scrub_stamp":"2024-04-25T02:29:06.608385+0000","last_deep_scrub":"43'57","last_deep_scrub_stamp":"2024-04-25T02:29:06.608385+0000","last_clean_scrub_stamp":"2024-04-25T02:29:06.608385+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:29:37.490299+0000","scrub_duration":0.0015486569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"43'445","reported_seq":575,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:39.963470+0000","last_change":"2024-04-25T02:29:39.963435+0000","last_active":"2024-04-25T02:29:39.963470+0000","last_peered":"2024-04-25T02:29:39.963470+0000","last_clean":"2024-04-25T02:29:39.963470+0000","last_became_active":"2024-04-25T02:23:13.842649+0000","last_became_peered":"2024-04-25T02:23:13.842649+0000","last_unstale":"2024-04-25T02:29:39.963470+0000","last_undegraded":"2024-04-25T02:29:39.963470+0000","last_fullsized":"2024-04-25T02:29:39.963470+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'445","last_scrub_stamp":"2024-04-25T02:29:39.963327+0000","last_deep_scrub":"43'445","last_deep_scrub_stamp":"2024-04-25T02:29:39.963327+0000","last_clean_scrub_stamp":"2024-04-25T02:29:39.963327+0000","objects_scrubbed":0,"log_size":445,"log_dups_size":0,"ondisk_log_size":445,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:30:25.914338+0000","scrub_duration":0.002187615,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":37870,"num_write":411,"num_write_kb":80233,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"43'68","reported_seq":116,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:51.908386+0000","last_change":"2024-04-25T02:28:51.908344+0000","last_active":"2024-04-25T02:28:51.908386+0000","last_peered":"2024-04-25T02:28:51.908386+0000","last_clean":"2024-04-25T02:28:51.908386+0000","last_became_active":"2024-04-25T02:23:11.835077+0000","last_became_peered":"2024-04-25T02:23:11.835077+0000","last_unstale":"2024-04-25T02:28:51.908386+0000","last_undegraded":"2024-04-25T02:28:51.908386+0000","last_fullsized":"2024-04-25T02:28:51.908386+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'68","last_scrub_stamp":"2024-04-25T02:28:51.908233+0000","last_deep_scrub":"43'68","last_deep_scrub_stamp":"2024-04-25T02:28:51.908233+0000","last_clean_scrub_stamp":"2024-04-25T02:28:51.908233+0000","objects_scrubbed":5,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:52:49.010130+0000","scrub_duration":0.0047405470000000003,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":15,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.17","version":"43'390","reported_seq":531,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:49.471264+0000","last_change":"2024-04-25T02:28:49.471228+0000","last_active":"2024-04-25T02:28:49.471264+0000","last_peered":"2024-04-25T02:28:49.471264+0000","last_clean":"2024-04-25T02:28:49.471264+0000","last_became_active":"2024-04-25T02:23:13.843347+0000","last_became_peered":"2024-04-25T02:23:13.843347+0000","last_unstale":"2024-04-25T02:28:49.471264+0000","last_undegraded":"2024-04-25T02:28:49.471264+0000","last_fullsized":"2024-04-25T02:28:49.471264+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'390","last_scrub_stamp":"2024-04-25T02:28:49.471125+0000","last_deep_scrub":"43'390","last_deep_scrub_stamp":"2024-04-25T02:28:49.471125+0000","last_clean_scrub_stamp":"2024-04-25T02:28:49.471125+0000","objects_scrubbed":0,"log_size":390,"log_dups_size":0,"ondisk_log_size":390,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:04:13.159114+0000","scrub_duration":0.0021407000000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":89,"num_read_kb":42863,"num_write":360,"num_write_kb":59443,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"43'201","reported_seq":249,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:00.019630+0000","last_change":"2024-04-25T02:29:00.019602+0000","last_active":"2024-04-25T02:29:00.019630+0000","last_peered":"2024-04-25T02:29:00.019630+0000","last_clean":"2024-04-25T02:29:00.019630+0000","last_became_active":"2024-04-25T02:23:11.839157+0000","last_became_peered":"2024-04-25T02:23:11.839157+0000","last_unstale":"2024-04-25T02:29:00.019630+0000","last_undegraded":"2024-04-25T02:29:00.019630+0000","last_fullsized":"2024-04-25T02:29:00.019630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'201","last_scrub_stamp":"2024-04-25T02:29:00.019504+0000","last_deep_scrub":"43'201","last_deep_scrub_stamp":"2024-04-25T02:29:00.019504+0000","last_clean_scrub_stamp":"2024-04-25T02:29:00.019504+0000","objects_scrubbed":2,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:39:17.465468+0000","scrub_duration":0.01223805,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":142,"num_write_kb":4183,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"43'404","reported_seq":481,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:39.499704+0000","last_change":"2024-04-25T02:29:39.499674+0000","last_active":"2024-04-25T02:29:39.499704+0000","last_peered":"2024-04-25T02:29:39.499704+0000","last_clean":"2024-04-25T02:29:39.499704+0000","last_became_active":"2024-04-25T02:23:13.840951+0000","last_became_peered":"2024-04-25T02:23:13.840951+0000","last_unstale":"2024-04-25T02:29:39.499704+0000","last_undegraded":"2024-04-25T02:29:39.499704+0000","last_fullsized":"2024-04-25T02:29:39.499704+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'404","last_scrub_stamp":"2024-04-25T02:29:39.499537+0000","last_deep_scrub":"43'404","last_deep_scrub_stamp":"2024-04-25T02:29:39.499537+0000","last_clean_scrub_stamp":"2024-04-25T02:29:39.499537+0000","objects_scrubbed":0,"log_size":404,"log_dups_size":0,"ondisk_log_size":404,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:42:15.999610+0000","scrub_duration":0.002371059,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":12931,"num_write":370,"num_write_kb":42530,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.e","version":"43'368","reported_seq":423,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:15.999378+0000","last_change":"2024-04-25T02:29:15.999350+0000","last_active":"2024-04-25T02:29:15.999378+0000","last_peered":"2024-04-25T02:29:15.999378+0000","last_clean":"2024-04-25T02:29:15.999378+0000","last_became_active":"2024-04-25T02:23:12.847813+0000","last_became_peered":"2024-04-25T02:23:12.847813+0000","last_unstale":"2024-04-25T02:29:15.999378+0000","last_undegraded":"2024-04-25T02:29:15.999378+0000","last_fullsized":"2024-04-25T02:29:15.999378+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'368","last_scrub_stamp":"2024-04-25T02:29:15.999218+0000","last_deep_scrub":"43'368","last_deep_scrub_stamp":"2024-04-25T02:29:15.999218+0000","last_clean_scrub_stamp":"2024-04-25T02:29:15.999218+0000","objects_scrubbed":2,"log_size":368,"log_dups_size":0,"ondisk_log_size":368,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:42:23.358864+0000","scrub_duration":0.013353834,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":311,"num_write_kb":4273,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"43'442","reported_seq":502,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:24.178739+0000","last_change":"2024-04-25T02:29:24.178707+0000","last_active":"2024-04-25T02:29:24.178739+0000","last_peered":"2024-04-25T02:29:24.178739+0000","last_clean":"2024-04-25T02:29:24.178739+0000","last_became_active":"2024-04-25T02:23:55.963234+0000","last_became_peered":"2024-04-25T02:23:55.963234+0000","last_unstale":"2024-04-25T02:29:24.178739+0000","last_undegraded":"2024-04-25T02:29:24.178739+0000","last_fullsized":"2024-04-25T02:29:24.178739+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'442","last_scrub_stamp":"2024-04-25T02:29:24.178598+0000","last_deep_scrub":"43'442","last_deep_scrub_stamp":"2024-04-25T02:29:24.178598+0000","last_clean_scrub_stamp":"2024-04-25T02:29:24.178598+0000","objects_scrubbed":0,"log_size":442,"log_dups_size":0,"ondisk_log_size":442,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:37:43.717819+0000","scrub_duration":0.0021811489999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":21039,"num_write":415,"num_write_kb":62968,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"43'596","reported_seq":650,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:12.598908+0000","last_change":"2024-04-25T02:29:12.598859+0000","last_active":"2024-04-25T02:29:12.598908+0000","last_peered":"2024-04-25T02:29:12.598908+0000","last_clean":"2024-04-25T02:29:12.598908+0000","last_became_active":"2024-04-25T02:23:13.843704+0000","last_became_peered":"2024-04-25T02:23:13.843704+0000","last_unstale":"2024-04-25T02:29:12.598908+0000","last_undegraded":"2024-04-25T02:29:12.598908+0000","last_fullsized":"2024-04-25T02:29:12.598908+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'596","last_scrub_stamp":"2024-04-25T02:29:12.598768+0000","last_deep_scrub":"43'596","last_deep_scrub_stamp":"2024-04-25T02:29:12.598768+0000","last_clean_scrub_stamp":"2024-04-25T02:29:12.598768+0000","objects_scrubbed":2,"log_size":596,"log_dups_size":0,"ondisk_log_size":596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:48:20.391354+0000","scrub_duration":0.014912345,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":532,"num_write_kb":4350,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.a","version":"43'411","reported_seq":507,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:17.022137+0000","last_change":"2024-04-25T02:29:17.022100+0000","last_active":"2024-04-25T02:29:17.022137+0000","last_peered":"2024-04-25T02:29:17.022137+0000","last_clean":"2024-04-25T02:29:17.022137+0000","last_became_active":"2024-04-25T02:23:13.845782+0000","last_became_peered":"2024-04-25T02:23:13.845782+0000","last_unstale":"2024-04-25T02:29:17.022137+0000","last_undegraded":"2024-04-25T02:29:17.022137+0000","last_fullsized":"2024-04-25T02:29:17.022137+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'411","last_scrub_stamp":"2024-04-25T02:29:17.021916+0000","last_deep_scrub":"43'411","last_deep_scrub_stamp":"2024-04-25T02:29:17.021916+0000","last_clean_scrub_stamp":"2024-04-25T02:29:17.021916+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:53:37.771149+0000","scrub_duration":0.0025137620000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":24562,"num_write":375,"num_write_kb":59351,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"43'59","reported_seq":108,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:50.131386+0000","last_change":"2024-04-25T02:28:50.131363+0000","last_active":"2024-04-25T02:28:50.131386+0000","last_peered":"2024-04-25T02:28:50.131386+0000","last_clean":"2024-04-25T02:28:50.131386+0000","last_became_active":"2024-04-25T02:23:13.841815+0000","last_became_peered":"2024-04-25T02:23:13.841815+0000","last_unstale":"2024-04-25T02:28:50.131386+0000","last_undegraded":"2024-04-25T02:28:50.131386+0000","last_fullsized":"2024-04-25T02:28:50.131386+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'59","last_scrub_stamp":"2024-04-25T02:28:50.131276+0000","last_deep_scrub":"43'59","last_deep_scrub_stamp":"2024-04-25T02:28:50.131276+0000","last_clean_scrub_stamp":"2024-04-25T02:28:50.131276+0000","objects_scrubbed":0,"log_size":59,"log_dups_size":0,"ondisk_log_size":59,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:39:19.674948+0000","scrub_duration":0.0013339000000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"43'457","reported_seq":584,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:39.003748+0000","last_change":"2024-04-25T02:28:39.003715+0000","last_active":"2024-04-25T02:28:39.003748+0000","last_peered":"2024-04-25T02:28:39.003748+0000","last_clean":"2024-04-25T02:28:39.003748+0000","last_became_active":"2024-04-25T02:23:11.837258+0000","last_became_peered":"2024-04-25T02:23:11.837258+0000","last_unstale":"2024-04-25T02:28:39.003748+0000","last_undegraded":"2024-04-25T02:28:39.003748+0000","last_fullsized":"2024-04-25T02:28:39.003748+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'457","last_scrub_stamp":"2024-04-25T02:28:39.003606+0000","last_deep_scrub":"43'457","last_deep_scrub_stamp":"2024-04-25T02:28:39.003606+0000","last_clean_scrub_stamp":"2024-04-25T02:28:39.003606+0000","objects_scrubbed":0,"log_size":457,"log_dups_size":0,"ondisk_log_size":457,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:25:51.514685+0000","scrub_duration":0.0023379960000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":81,"num_read_kb":40530,"num_write":421,"num_write_kb":133096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.b","version":"43'132","reported_seq":190,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:38.375455+0000","last_change":"2024-04-25T02:28:38.375418+0000","last_active":"2024-04-25T02:28:38.375455+0000","last_peered":"2024-04-25T02:28:38.375455+0000","last_clean":"2024-04-25T02:28:38.375455+0000","last_became_active":"2024-04-25T02:23:13.838665+0000","last_became_peered":"2024-04-25T02:23:13.838665+0000","last_unstale":"2024-04-25T02:28:38.375455+0000","last_undegraded":"2024-04-25T02:28:38.375455+0000","last_fullsized":"2024-04-25T02:28:38.375455+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'132","last_scrub_stamp":"2024-04-25T02:28:38.375296+0000","last_deep_scrub":"43'132","last_deep_scrub_stamp":"2024-04-25T02:28:38.375296+0000","last_clean_scrub_stamp":"2024-04-25T02:28:38.375296+0000","objects_scrubbed":4,"log_size":132,"log_dups_size":0,"ondisk_log_size":132,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:47:08.874698+0000","scrub_duration":0.018905228,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":66,"num_write_kb":8229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"43'438","reported_seq":526,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:28.101612+0000","last_change":"2024-04-25T02:28:28.101582+0000","last_active":"2024-04-25T02:28:28.101612+0000","last_peered":"2024-04-25T02:28:28.101612+0000","last_clean":"2024-04-25T02:28:28.101612+0000","last_became_active":"2024-04-25T02:23:55.963557+0000","last_became_peered":"2024-04-25T02:23:55.963557+0000","last_unstale":"2024-04-25T02:28:28.101612+0000","last_undegraded":"2024-04-25T02:28:28.101612+0000","last_fullsized":"2024-04-25T02:28:28.101612+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'438","last_scrub_stamp":"2024-04-25T02:28:28.101477+0000","last_deep_scrub":"43'438","last_deep_scrub_stamp":"2024-04-25T02:28:28.101477+0000","last_clean_scrub_stamp":"2024-04-25T02:28:28.101477+0000","objects_scrubbed":0,"log_size":438,"log_dups_size":0,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:13:04.055307+0000","scrub_duration":0.0022093569999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":25759,"num_write":403,"num_write_kb":59138,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.a","version":"43'256","reported_seq":309,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:54.577347+0000","last_change":"2024-04-25T02:28:54.577309+0000","last_active":"2024-04-25T02:28:54.577347+0000","last_peered":"2024-04-25T02:28:54.577347+0000","last_clean":"2024-04-25T02:28:54.577347+0000","last_became_active":"2024-04-25T02:23:13.843652+0000","last_became_peered":"2024-04-25T02:23:13.843652+0000","last_unstale":"2024-04-25T02:28:54.577347+0000","last_undegraded":"2024-04-25T02:28:54.577347+0000","last_fullsized":"2024-04-25T02:28:54.577347+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'256","last_scrub_stamp":"2024-04-25T02:28:54.577189+0000","last_deep_scrub":"43'256","last_deep_scrub_stamp":"2024-04-25T02:28:54.577189+0000","last_clean_scrub_stamp":"2024-04-25T02:28:54.577189+0000","objects_scrubbed":2,"log_size":256,"log_dups_size":0,"ondisk_log_size":256,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:57:05.312089+0000","scrub_duration":0.01333373,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":185,"num_write_kb":4213,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"43'389","reported_seq":433,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:18.044248+0000","last_change":"2024-04-25T02:29:18.044209+0000","last_active":"2024-04-25T02:29:18.044248+0000","last_peered":"2024-04-25T02:29:18.044248+0000","last_clean":"2024-04-25T02:29:18.044248+0000","last_became_active":"2024-04-25T02:23:56.301997+0000","last_became_peered":"2024-04-25T02:23:56.301997+0000","last_unstale":"2024-04-25T02:29:18.044248+0000","last_undegraded":"2024-04-25T02:29:18.044248+0000","last_fullsized":"2024-04-25T02:29:18.044248+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'389","last_scrub_stamp":"2024-04-25T02:29:18.044094+0000","last_deep_scrub":"43'389","last_deep_scrub_stamp":"2024-04-25T02:29:18.044094+0000","last_clean_scrub_stamp":"2024-04-25T02:29:18.044094+0000","objects_scrubbed":0,"log_size":389,"log_dups_size":0,"ondisk_log_size":389,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:56:48.289864+0000","scrub_duration":0.0023398820000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":13585,"num_write":362,"num_write_kb":34032,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"43'65","reported_seq":115,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:50.476437+0000","last_change":"2024-04-25T02:29:50.476392+0000","last_active":"2024-04-25T02:29:50.476437+0000","last_peered":"2024-04-25T02:29:50.476437+0000","last_clean":"2024-04-25T02:29:50.476437+0000","last_became_active":"2024-04-25T02:23:13.841049+0000","last_became_peered":"2024-04-25T02:23:13.841049+0000","last_unstale":"2024-04-25T02:29:50.476437+0000","last_undegraded":"2024-04-25T02:29:50.476437+0000","last_fullsized":"2024-04-25T02:29:50.476437+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'65","last_scrub_stamp":"2024-04-25T02:29:50.476294+0000","last_deep_scrub":"43'65","last_deep_scrub_stamp":"2024-04-25T02:29:50.476294+0000","last_clean_scrub_stamp":"2024-04-25T02:29:50.476294+0000","objects_scrubbed":2,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:16:27.543651+0000","scrub_duration":0.0034481350000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.e","version":"43'360","reported_seq":433,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:29.186993+0000","last_change":"2024-04-25T02:28:29.186947+0000","last_active":"2024-04-25T02:28:29.186993+0000","last_peered":"2024-04-25T02:28:29.186993+0000","last_clean":"2024-04-25T02:28:29.186993+0000","last_became_active":"2024-04-25T02:23:13.846425+0000","last_became_peered":"2024-04-25T02:23:13.846425+0000","last_unstale":"2024-04-25T02:28:29.186993+0000","last_undegraded":"2024-04-25T02:28:29.186993+0000","last_fullsized":"2024-04-25T02:28:29.186993+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'360","last_scrub_stamp":"2024-04-25T02:28:29.186834+0000","last_deep_scrub":"43'360","last_deep_scrub_stamp":"2024-04-25T02:28:29.186834+0000","last_clean_scrub_stamp":"2024-04-25T02:28:29.186834+0000","objects_scrubbed":0,"log_size":360,"log_dups_size":0,"ondisk_log_size":360,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:38:30.162583+0000","scrub_duration":0.002422633,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":12898,"num_write":328,"num_write_kb":42412,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.8","version":"43'567","reported_seq":620,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:43.405130+0000","last_change":"2024-04-25T02:28:43.405100+0000","last_active":"2024-04-25T02:28:43.405130+0000","last_peered":"2024-04-25T02:28:43.405130+0000","last_clean":"2024-04-25T02:28:43.405130+0000","last_became_active":"2024-04-25T02:23:13.840876+0000","last_became_peered":"2024-04-25T02:23:13.840876+0000","last_unstale":"2024-04-25T02:28:43.405130+0000","last_undegraded":"2024-04-25T02:28:43.405130+0000","last_fullsized":"2024-04-25T02:28:43.405130+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'567","last_scrub_stamp":"2024-04-25T02:28:43.405002+0000","last_deep_scrub":"43'567","last_deep_scrub_stamp":"2024-04-25T02:28:43.405002+0000","last_clean_scrub_stamp":"2024-04-25T02:28:43.405002+0000","objects_scrubbed":2,"log_size":567,"log_dups_size":0,"ondisk_log_size":567,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:17:38.360428+0000","scrub_duration":0.013702443,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":506,"num_write_kb":4331,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"43'387","reported_seq":475,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:24.007241+0000","last_change":"2024-04-25T02:29:24.007198+0000","last_active":"2024-04-25T02:29:24.007241+0000","last_peered":"2024-04-25T02:29:24.007241+0000","last_clean":"2024-04-25T02:29:24.007241+0000","last_became_active":"2024-04-25T02:23:13.852398+0000","last_became_peered":"2024-04-25T02:23:13.852398+0000","last_unstale":"2024-04-25T02:29:24.007241+0000","last_undegraded":"2024-04-25T02:29:24.007241+0000","last_fullsized":"2024-04-25T02:29:24.007241+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'387","last_scrub_stamp":"2024-04-25T02:29:24.007081+0000","last_deep_scrub":"43'387","last_deep_scrub_stamp":"2024-04-25T02:29:24.007081+0000","last_clean_scrub_stamp":"2024-04-25T02:29:24.007081+0000","objects_scrubbed":0,"log_size":387,"log_dups_size":0,"ondisk_log_size":387,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:07:38.625480+0000","scrub_duration":0.0022561479999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":28255,"num_write":354,"num_write_kb":58406,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:58.871823+0000","last_change":"2024-04-25T02:28:58.871778+0000","last_active":"2024-04-25T02:28:58.871823+0000","last_peered":"2024-04-25T02:28:58.871823+0000","last_clean":"2024-04-25T02:28:58.871823+0000","last_became_active":"2024-04-25T02:23:11.834171+0000","last_became_peered":"2024-04-25T02:23:11.834171+0000","last_unstale":"2024-04-25T02:28:58.871823+0000","last_undegraded":"2024-04-25T02:28:58.871823+0000","last_fullsized":"2024-04-25T02:28:58.871823+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:58.871661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:58.871661+0000","last_clean_scrub_stamp":"2024-04-25T02:28:58.871661+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:46:46.274931+0000","scrub_duration":0.0016855539999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"43'432","reported_seq":478,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:32.100599+0000","last_change":"2024-04-25T02:28:32.100572+0000","last_active":"2024-04-25T02:28:32.100599+0000","last_peered":"2024-04-25T02:28:32.100599+0000","last_clean":"2024-04-25T02:28:32.100599+0000","last_became_active":"2024-04-25T02:23:13.847970+0000","last_became_peered":"2024-04-25T02:23:13.847970+0000","last_unstale":"2024-04-25T02:28:32.100599+0000","last_undegraded":"2024-04-25T02:28:32.100599+0000","last_fullsized":"2024-04-25T02:28:32.100599+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'432","last_scrub_stamp":"2024-04-25T02:28:32.100463+0000","last_deep_scrub":"43'432","last_deep_scrub_stamp":"2024-04-25T02:28:32.100463+0000","last_clean_scrub_stamp":"2024-04-25T02:28:32.100463+0000","objects_scrubbed":2,"log_size":432,"log_dups_size":0,"ondisk_log_size":432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:01:10.912094+0000","scrub_duration":0.014522729,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":371,"num_write_kb":4349,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"43'357","reported_seq":420,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:22.964197+0000","last_change":"2024-04-25T02:28:22.964168+0000","last_active":"2024-04-25T02:28:22.964197+0000","last_peered":"2024-04-25T02:28:22.964197+0000","last_clean":"2024-04-25T02:28:22.964197+0000","last_became_active":"2024-04-25T02:23:13.849556+0000","last_became_peered":"2024-04-25T02:23:13.849556+0000","last_unstale":"2024-04-25T02:28:22.964197+0000","last_undegraded":"2024-04-25T02:28:22.964197+0000","last_fullsized":"2024-04-25T02:28:22.964197+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'357","last_scrub_stamp":"2024-04-25T02:28:22.964054+0000","last_deep_scrub":"43'357","last_deep_scrub_stamp":"2024-04-25T02:28:22.964054+0000","last_clean_scrub_stamp":"2024-04-25T02:28:22.964054+0000","objects_scrubbed":0,"log_size":357,"log_dups_size":0,"ondisk_log_size":357,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:33:24.355131+0000","scrub_duration":0.002218271,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":8777,"num_write":323,"num_write_kb":25948,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":56,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:20.584868+0000","last_change":"2024-04-25T02:29:20.584847+0000","last_active":"2024-04-25T02:29:20.584868+0000","last_peered":"2024-04-25T02:29:20.584868+0000","last_clean":"2024-04-25T02:29:20.584868+0000","last_became_active":"2024-04-25T02:23:13.847888+0000","last_became_peered":"2024-04-25T02:23:13.847888+0000","last_unstale":"2024-04-25T02:29:20.584868+0000","last_undegraded":"2024-04-25T02:29:20.584868+0000","last_fullsized":"2024-04-25T02:29:20.584868+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:20.584764+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:20.584764+0000","last_clean_scrub_stamp":"2024-04-25T02:29:20.584764+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T05:08:06.936034+0000","scrub_duration":0.001196421,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"43'72","reported_seq":124,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:37.052787+0000","last_change":"2024-04-25T02:28:37.052732+0000","last_active":"2024-04-25T02:28:37.052787+0000","last_peered":"2024-04-25T02:28:37.052787+0000","last_clean":"2024-04-25T02:28:37.052787+0000","last_became_active":"2024-04-25T02:23:12.848312+0000","last_became_peered":"2024-04-25T02:23:12.848312+0000","last_unstale":"2024-04-25T02:28:37.052787+0000","last_undegraded":"2024-04-25T02:28:37.052787+0000","last_fullsized":"2024-04-25T02:28:37.052787+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'72","last_scrub_stamp":"2024-04-25T02:28:37.052632+0000","last_deep_scrub":"43'72","last_deep_scrub_stamp":"2024-04-25T02:28:37.052632+0000","last_clean_scrub_stamp":"2024-04-25T02:28:37.052632+0000","objects_scrubbed":2,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:06:14.430755+0000","scrub_duration":0.0037485779999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":4710,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"43'385","reported_seq":477,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:47.914656+0000","last_change":"2024-04-25T02:28:47.914600+0000","last_active":"2024-04-25T02:28:47.914656+0000","last_peered":"2024-04-25T02:28:47.914656+0000","last_clean":"2024-04-25T02:28:47.914656+0000","last_became_active":"2024-04-25T02:23:12.841408+0000","last_became_peered":"2024-04-25T02:23:12.841408+0000","last_unstale":"2024-04-25T02:28:47.914656+0000","last_undegraded":"2024-04-25T02:28:47.914656+0000","last_fullsized":"2024-04-25T02:28:47.914656+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'385","last_scrub_stamp":"2024-04-25T02:28:47.914480+0000","last_deep_scrub":"43'385","last_deep_scrub_stamp":"2024-04-25T02:28:47.914480+0000","last_clean_scrub_stamp":"2024-04-25T02:28:47.914480+0000","objects_scrubbed":0,"log_size":385,"log_dups_size":0,"ondisk_log_size":385,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:55:56.748268+0000","scrub_duration":0.0025485909999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":27937,"num_write":348,"num_write_kb":51359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":44,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:07.821153+0000","last_change":"2024-04-25T02:29:07.821126+0000","last_active":"2024-04-25T02:29:07.821153+0000","last_peered":"2024-04-25T02:29:07.821153+0000","last_clean":"2024-04-25T02:29:07.821153+0000","last_became_active":"2024-04-25T02:23:13.848076+0000","last_became_peered":"2024-04-25T02:23:13.848076+0000","last_unstale":"2024-04-25T02:29:07.821153+0000","last_undegraded":"2024-04-25T02:29:07.821153+0000","last_fullsized":"2024-04-25T02:29:07.821153+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:07.821012+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:07.821012+0000","last_clean_scrub_stamp":"2024-04-25T02:29:07.821012+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:15:19.428497+0000","scrub_duration":0.001478198,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"43'396","reported_seq":441,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:28.988989+0000","last_change":"2024-04-25T02:29:28.988963+0000","last_active":"2024-04-25T02:29:28.988989+0000","last_peered":"2024-04-25T02:29:28.988989+0000","last_clean":"2024-04-25T02:29:28.988989+0000","last_became_active":"2024-04-25T02:23:12.848229+0000","last_became_peered":"2024-04-25T02:23:12.848229+0000","last_unstale":"2024-04-25T02:29:28.988989+0000","last_undegraded":"2024-04-25T02:29:28.988989+0000","last_fullsized":"2024-04-25T02:29:28.988989+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'396","last_scrub_stamp":"2024-04-25T02:29:28.988885+0000","last_deep_scrub":"43'396","last_deep_scrub_stamp":"2024-04-25T02:29:28.988885+0000","last_clean_scrub_stamp":"2024-04-25T02:29:28.988885+0000","objects_scrubbed":2,"log_size":396,"log_dups_size":0,"ondisk_log_size":396,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:31:18.956508+0000","scrub_duration":0.018703045000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":337,"num_write_kb":8338,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"43'349","reported_seq":410,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:07.926117+0000","last_change":"2024-04-25T02:29:07.926087+0000","last_active":"2024-04-25T02:29:07.926117+0000","last_peered":"2024-04-25T02:29:07.926117+0000","last_clean":"2024-04-25T02:29:07.926117+0000","last_became_active":"2024-04-25T02:23:11.834994+0000","last_became_peered":"2024-04-25T02:23:11.834994+0000","last_unstale":"2024-04-25T02:29:07.926117+0000","last_undegraded":"2024-04-25T02:29:07.926117+0000","last_fullsized":"2024-04-25T02:29:07.926117+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'349","last_scrub_stamp":"2024-04-25T02:29:07.925985+0000","last_deep_scrub":"43'349","last_deep_scrub_stamp":"2024-04-25T02:29:07.925985+0000","last_clean_scrub_stamp":"2024-04-25T02:29:07.925985+0000","objects_scrubbed":0,"log_size":349,"log_dups_size":0,"ondisk_log_size":349,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:48:50.879001+0000","scrub_duration":0.002053675,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":11931,"num_write":325,"num_write_kb":25986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":53,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:48.471620+0000","last_change":"2024-04-25T02:28:48.471576+0000","last_active":"2024-04-25T02:28:48.471620+0000","last_peered":"2024-04-25T02:28:48.471620+0000","last_clean":"2024-04-25T02:28:48.471620+0000","last_became_active":"2024-04-25T02:23:13.848628+0000","last_became_peered":"2024-04-25T02:23:13.848628+0000","last_unstale":"2024-04-25T02:28:48.471620+0000","last_undegraded":"2024-04-25T02:28:48.471620+0000","last_fullsized":"2024-04-25T02:28:48.471620+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:48.471463+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:48.471463+0000","last_clean_scrub_stamp":"2024-04-25T02:28:48.471463+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:16:32.732598+0000","scrub_duration":0.0015455829999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"43'117","reported_seq":205,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:43.952390+0000","last_change":"2024-04-25T02:28:43.952355+0000","last_active":"2024-04-25T02:28:43.952390+0000","last_peered":"2024-04-25T02:28:43.952390+0000","last_clean":"2024-04-25T02:28:43.952390+0000","last_became_active":"2024-04-25T02:23:11.835430+0000","last_became_peered":"2024-04-25T02:23:11.835430+0000","last_unstale":"2024-04-25T02:28:43.952390+0000","last_undegraded":"2024-04-25T02:28:43.952390+0000","last_fullsized":"2024-04-25T02:28:43.952390+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":7,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'117","last_scrub_stamp":"2024-04-25T02:28:43.952236+0000","last_deep_scrub":"43'117","last_deep_scrub_stamp":"2024-04-25T02:28:43.952236+0000","last_clean_scrub_stamp":"2024-04-25T02:28:43.952236+0000","objects_scrubbed":2,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:46:14.784576+0000","scrub_duration":0.005143936,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"43'575","reported_seq":625,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:04.637560+0000","last_change":"2024-04-25T02:29:04.637520+0000","last_active":"2024-04-25T02:29:04.637560+0000","last_peered":"2024-04-25T02:29:04.637560+0000","last_clean":"2024-04-25T02:29:04.637560+0000","last_became_active":"2024-04-25T02:23:13.845029+0000","last_became_peered":"2024-04-25T02:23:13.845029+0000","last_unstale":"2024-04-25T02:29:04.637560+0000","last_undegraded":"2024-04-25T02:29:04.637560+0000","last_fullsized":"2024-04-25T02:29:04.637560+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'575","last_scrub_stamp":"2024-04-25T02:29:04.637429+0000","last_deep_scrub":"43'575","last_deep_scrub_stamp":"2024-04-25T02:29:04.637429+0000","last_clean_scrub_stamp":"2024-04-25T02:29:04.637429+0000","objects_scrubbed":2,"log_size":575,"log_dups_size":0,"ondisk_log_size":575,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:27:33.911843+0000","scrub_duration":0.022099299999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":507,"num_write_kb":8447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.5","version":"43'449","reported_seq":571,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:22.192884+0000","last_change":"2024-04-25T02:28:22.192856+0000","last_active":"2024-04-25T02:28:22.192884+0000","last_peered":"2024-04-25T02:28:22.192884+0000","last_clean":"2024-04-25T02:28:22.192884+0000","last_became_active":"2024-04-25T02:23:13.844018+0000","last_became_peered":"2024-04-25T02:23:13.844018+0000","last_unstale":"2024-04-25T02:28:22.192884+0000","last_undegraded":"2024-04-25T02:28:22.192884+0000","last_fullsized":"2024-04-25T02:28:22.192884+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'449","last_scrub_stamp":"2024-04-25T02:28:22.192764+0000","last_deep_scrub":"43'449","last_deep_scrub_stamp":"2024-04-25T02:28:22.192764+0000","last_clean_scrub_stamp":"2024-04-25T02:28:22.192764+0000","objects_scrubbed":0,"log_size":449,"log_dups_size":0,"ondisk_log_size":449,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:20:28.942878+0000","scrub_duration":0.0021300249999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":31679,"num_write":414,"num_write_kb":80533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":56,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:23.639479+0000","last_change":"2024-04-25T02:29:23.639437+0000","last_active":"2024-04-25T02:29:23.639479+0000","last_peered":"2024-04-25T02:29:23.639479+0000","last_clean":"2024-04-25T02:29:23.639479+0000","last_became_active":"2024-04-25T02:23:13.844753+0000","last_became_peered":"2024-04-25T02:23:13.844753+0000","last_unstale":"2024-04-25T02:29:23.639479+0000","last_undegraded":"2024-04-25T02:29:23.639479+0000","last_fullsized":"2024-04-25T02:29:23.639479+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:23.639330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:23.639330+0000","last_clean_scrub_stamp":"2024-04-25T02:29:23.639330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:36:28.214106+0000","scrub_duration":0.001562251,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"43'253","reported_seq":486,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:09.943734+0000","last_change":"2024-04-25T02:29:09.943689+0000","last_active":"2024-04-25T02:29:09.943734+0000","last_peered":"2024-04-25T02:29:09.943734+0000","last_clean":"2024-04-25T02:29:09.943734+0000","last_became_active":"2024-04-25T02:23:12.845638+0000","last_became_peered":"2024-04-25T02:23:12.845638+0000","last_unstale":"2024-04-25T02:29:09.943734+0000","last_undegraded":"2024-04-25T02:29:09.943734+0000","last_fullsized":"2024-04-25T02:29:09.943734+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'253","last_scrub_stamp":"2024-04-25T02:29:09.943582+0000","last_deep_scrub":"43'253","last_deep_scrub_stamp":"2024-04-25T02:29:09.943582+0000","last_clean_scrub_stamp":"2024-04-25T02:29:09.943582+0000","objects_scrubbed":1,"log_size":253,"log_dups_size":0,"ondisk_log_size":253,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:41:32.698316+0000","scrub_duration":0.0070356070000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1460763,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":182,"num_read_kb":1548,"num_write":182,"num_write_kb":1548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.6","version":"43'454","reported_seq":583,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:13.968762+0000","last_change":"2024-04-25T02:29:13.968733+0000","last_active":"2024-04-25T02:29:13.968762+0000","last_peered":"2024-04-25T02:29:13.968762+0000","last_clean":"2024-04-25T02:29:13.968762+0000","last_became_active":"2024-04-25T02:23:11.840215+0000","last_became_peered":"2024-04-25T02:23:11.840215+0000","last_unstale":"2024-04-25T02:29:13.968762+0000","last_undegraded":"2024-04-25T02:29:13.968762+0000","last_fullsized":"2024-04-25T02:29:13.968762+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'454","last_scrub_stamp":"2024-04-25T02:29:13.968625+0000","last_deep_scrub":"43'454","last_deep_scrub_stamp":"2024-04-25T02:29:13.968625+0000","last_clean_scrub_stamp":"2024-04-25T02:29:13.968625+0000","objects_scrubbed":0,"log_size":454,"log_dups_size":0,"ondisk_log_size":454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:44:53.105094+0000","scrub_duration":0.0025024790000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":42224,"num_write":426,"num_write_kb":96444,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":60,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:48.451882+0000","last_change":"2024-04-25T02:29:48.451854+0000","last_active":"2024-04-25T02:29:48.451882+0000","last_peered":"2024-04-25T02:29:48.451882+0000","last_clean":"2024-04-25T02:29:48.451882+0000","last_became_active":"2024-04-25T02:23:13.841324+0000","last_became_peered":"2024-04-25T02:23:13.841324+0000","last_unstale":"2024-04-25T02:29:48.451882+0000","last_undegraded":"2024-04-25T02:29:48.451882+0000","last_fullsized":"2024-04-25T02:29:48.451882+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:29:48.451751+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:29:48.451751+0000","last_clean_scrub_stamp":"2024-04-25T02:29:48.451751+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:15:06.119683+0000","scrub_duration":0.0014257740000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"43'53","reported_seq":96,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:23.045057+0000","last_change":"2024-04-25T02:29:23.045018+0000","last_active":"2024-04-25T02:29:23.045057+0000","last_peered":"2024-04-25T02:29:23.045057+0000","last_clean":"2024-04-25T02:29:23.045057+0000","last_became_active":"2024-04-25T02:23:12.841930+0000","last_became_peered":"2024-04-25T02:23:12.841930+0000","last_unstale":"2024-04-25T02:29:23.045057+0000","last_undegraded":"2024-04-25T02:29:23.045057+0000","last_fullsized":"2024-04-25T02:29:23.045057+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'53","last_scrub_stamp":"2024-04-25T02:29:23.044876+0000","last_deep_scrub":"43'53","last_deep_scrub_stamp":"2024-04-25T02:29:23.044876+0000","last_clean_scrub_stamp":"2024-04-25T02:29:23.044876+0000","objects_scrubbed":0,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:46:33.497718+0000","scrub_duration":0.0016291229999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.3","version":"43'427","reported_seq":596,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:35.112665+0000","last_change":"2024-04-25T02:28:35.112631+0000","last_active":"2024-04-25T02:28:35.112665+0000","last_peered":"2024-04-25T02:28:35.112665+0000","last_clean":"2024-04-25T02:28:35.112665+0000","last_became_active":"2024-04-25T02:23:12.847949+0000","last_became_peered":"2024-04-25T02:23:12.847949+0000","last_unstale":"2024-04-25T02:28:35.112665+0000","last_undegraded":"2024-04-25T02:28:35.112665+0000","last_fullsized":"2024-04-25T02:28:35.112665+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'427","last_scrub_stamp":"2024-04-25T02:28:35.112522+0000","last_deep_scrub":"43'427","last_deep_scrub_stamp":"2024-04-25T02:28:35.112522+0000","last_clean_scrub_stamp":"2024-04-25T02:28:35.112522+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:19:01.667215+0000","scrub_duration":0.0025605430000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":120,"num_read_kb":62452,"num_write":394,"num_write_kb":105065,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.7","version":"43'67","reported_seq":121,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:22.607900+0000","last_change":"2024-04-25T02:29:22.607869+0000","last_active":"2024-04-25T02:29:22.607900+0000","last_peered":"2024-04-25T02:29:22.607900+0000","last_clean":"2024-04-25T02:29:22.607900+0000","last_became_active":"2024-04-25T02:23:13.844133+0000","last_became_peered":"2024-04-25T02:23:13.844133+0000","last_unstale":"2024-04-25T02:29:22.607900+0000","last_undegraded":"2024-04-25T02:29:22.607900+0000","last_fullsized":"2024-04-25T02:29:22.607900+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'67","last_scrub_stamp":"2024-04-25T02:29:22.607757+0000","last_deep_scrub":"43'67","last_deep_scrub_stamp":"2024-04-25T02:29:22.607757+0000","last_clean_scrub_stamp":"2024-04-25T02:29:22.607757+0000","objects_scrubbed":2,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:08:11.568613+0000","scrub_duration":0.0035088860000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":43,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:56.954217+0000","last_change":"2024-04-25T02:28:56.954190+0000","last_active":"2024-04-25T02:28:56.954217+0000","last_peered":"2024-04-25T02:28:56.954217+0000","last_clean":"2024-04-25T02:28:56.954217+0000","last_became_active":"2024-04-25T02:23:11.836737+0000","last_became_peered":"2024-04-25T02:23:11.836737+0000","last_unstale":"2024-04-25T02:28:56.954217+0000","last_undegraded":"2024-04-25T02:28:56.954217+0000","last_fullsized":"2024-04-25T02:28:56.954217+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:56.954079+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:56.954079+0000","last_clean_scrub_stamp":"2024-04-25T02:28:56.954079+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:31:33.715989+0000","scrub_duration":0.001439145,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"43'434","reported_seq":577,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.571439+0000","last_change":"2024-04-25T02:29:19.571393+0000","last_active":"2024-04-25T02:29:19.571439+0000","last_peered":"2024-04-25T02:29:19.571439+0000","last_clean":"2024-04-25T02:29:19.571439+0000","last_became_active":"2024-04-25T02:23:13.843915+0000","last_became_peered":"2024-04-25T02:23:13.843915+0000","last_unstale":"2024-04-25T02:29:19.571439+0000","last_undegraded":"2024-04-25T02:29:19.571439+0000","last_fullsized":"2024-04-25T02:29:19.571439+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'434","last_scrub_stamp":"2024-04-25T02:29:19.571275+0000","last_deep_scrub":"43'434","last_deep_scrub_stamp":"2024-04-25T02:29:19.571275+0000","last_clean_scrub_stamp":"2024-04-25T02:29:19.571275+0000","objects_scrubbed":0,"log_size":434,"log_dups_size":0,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:11:49.263428+0000","scrub_duration":0.0026546920000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":48451,"num_write":406,"num_write_kb":112597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":60,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:45.426103+0000","last_change":"2024-04-25T02:28:45.426067+0000","last_active":"2024-04-25T02:28:45.426103+0000","last_peered":"2024-04-25T02:28:45.426103+0000","last_clean":"2024-04-25T02:28:45.426103+0000","last_became_active":"2024-04-25T02:23:13.838746+0000","last_became_peered":"2024-04-25T02:23:13.838746+0000","last_unstale":"2024-04-25T02:28:45.426103+0000","last_undegraded":"2024-04-25T02:28:45.426103+0000","last_fullsized":"2024-04-25T02:28:45.426103+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":12,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-25T02:28:45.425965+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-25T02:28:45.425965+0000","last_clean_scrub_stamp":"2024-04-25T02:28:45.425965+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T14:02:51.800756+0000","scrub_duration":0.0014993350000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.6","version":"43'87","reported_seq":137,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:47.924326+0000","last_change":"2024-04-25T02:29:47.924299+0000","last_active":"2024-04-25T02:29:47.924326+0000","last_peered":"2024-04-25T02:29:47.924326+0000","last_clean":"2024-04-25T02:29:47.924326+0000","last_became_active":"2024-04-25T02:23:11.840553+0000","last_became_peered":"2024-04-25T02:23:11.840553+0000","last_unstale":"2024-04-25T02:29:47.924326+0000","last_undegraded":"2024-04-25T02:29:47.924326+0000","last_fullsized":"2024-04-25T02:29:47.924326+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'87","last_scrub_stamp":"2024-04-25T02:29:47.924192+0000","last_deep_scrub":"43'87","last_deep_scrub_stamp":"2024-04-25T02:29:47.924192+0000","last_clean_scrub_stamp":"2024-04-25T02:29:47.924192+0000","objects_scrubbed":1,"log_size":87,"log_dups_size":0,"ondisk_log_size":87,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:40:06.104136+0000","scrub_duration":0.006347129,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":74,"num_write_kb":962,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"43'397","reported_seq":495,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:02.785656+0000","last_change":"2024-04-25T02:29:02.785610+0000","last_active":"2024-04-25T02:29:02.785656+0000","last_peered":"2024-04-25T02:29:02.785656+0000","last_clean":"2024-04-25T02:29:02.785656+0000","last_became_active":"2024-04-25T02:23:13.848374+0000","last_became_peered":"2024-04-25T02:23:13.848374+0000","last_unstale":"2024-04-25T02:29:02.785656+0000","last_undegraded":"2024-04-25T02:29:02.785656+0000","last_fullsized":"2024-04-25T02:29:02.785656+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'397","last_scrub_stamp":"2024-04-25T02:29:02.785490+0000","last_deep_scrub":"43'397","last_deep_scrub_stamp":"2024-04-25T02:29:02.785490+0000","last_clean_scrub_stamp":"2024-04-25T02:29:02.785490+0000","objects_scrubbed":0,"log_size":397,"log_dups_size":0,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:46:45.303985+0000","scrub_duration":0.0024422020000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":54,"num_read_kb":25341,"num_write":367,"num_write_kb":104771,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"43'125","reported_seq":177,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:23.889117+0000","last_change":"2024-04-25T02:29:23.889067+0000","last_active":"2024-04-25T02:29:23.889117+0000","last_peered":"2024-04-25T02:29:23.889117+0000","last_clean":"2024-04-25T02:29:23.889117+0000","last_became_active":"2024-04-25T02:23:13.842438+0000","last_became_peered":"2024-04-25T02:23:13.842438+0000","last_unstale":"2024-04-25T02:29:23.889117+0000","last_undegraded":"2024-04-25T02:29:23.889117+0000","last_fullsized":"2024-04-25T02:29:23.889117+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'125","last_scrub_stamp":"2024-04-25T02:29:23.888952+0000","last_deep_scrub":"43'125","last_deep_scrub_stamp":"2024-04-25T02:29:23.888952+0000","last_clean_scrub_stamp":"2024-04-25T02:29:23.888952+0000","objects_scrubbed":3,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:02:18.364587+0000","scrub_duration":0.010573489,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4196548,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":55,"num_write_kb":4123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"43'373","reported_seq":466,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:13.969575+0000","last_change":"2024-04-25T02:29:13.969547+0000","last_active":"2024-04-25T02:29:13.969575+0000","last_peered":"2024-04-25T02:29:13.969575+0000","last_clean":"2024-04-25T02:29:13.969575+0000","last_became_active":"2024-04-25T02:23:12.844258+0000","last_became_peered":"2024-04-25T02:23:12.844258+0000","last_unstale":"2024-04-25T02:29:13.969575+0000","last_undegraded":"2024-04-25T02:29:13.969575+0000","last_fullsized":"2024-04-25T02:29:13.969575+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'373","last_scrub_stamp":"2024-04-25T02:29:13.969449+0000","last_deep_scrub":"43'373","last_deep_scrub_stamp":"2024-04-25T02:29:13.969449+0000","last_clean_scrub_stamp":"2024-04-25T02:29:13.969449+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:55:34.895544+0000","scrub_duration":0.0022595229999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":25157,"num_write":340,"num_write_kb":59328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"43'318","reported_seq":362,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:06.939622+0000","last_change":"2024-04-25T02:29:06.939592+0000","last_active":"2024-04-25T02:29:06.939622+0000","last_peered":"2024-04-25T02:29:06.939622+0000","last_clean":"2024-04-25T02:29:06.939622+0000","last_became_active":"2024-04-25T02:23:11.833348+0000","last_became_peered":"2024-04-25T02:23:11.833348+0000","last_unstale":"2024-04-25T02:29:06.939622+0000","last_undegraded":"2024-04-25T02:29:06.939622+0000","last_fullsized":"2024-04-25T02:29:06.939622+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'318","last_scrub_stamp":"2024-04-25T02:29:06.939488+0000","last_deep_scrub":"43'318","last_deep_scrub_stamp":"2024-04-25T02:29:06.939488+0000","last_clean_scrub_stamp":"2024-04-25T02:29:06.939488+0000","objects_scrubbed":2,"log_size":318,"log_dups_size":0,"ondisk_log_size":318,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T11:26:24.204337+0000","scrub_duration":0.013407262,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":262,"num_write_kb":4264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"43'371","reported_seq":471,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:20.223269+0000","last_change":"2024-04-25T02:28:20.223232+0000","last_active":"2024-04-25T02:28:20.223269+0000","last_peered":"2024-04-25T02:28:20.223269+0000","last_clean":"2024-04-25T02:28:20.223269+0000","last_became_active":"2024-04-25T02:23:55.963467+0000","last_became_peered":"2024-04-25T02:23:55.963467+0000","last_unstale":"2024-04-25T02:28:20.223269+0000","last_undegraded":"2024-04-25T02:28:20.223269+0000","last_fullsized":"2024-04-25T02:28:20.223269+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'371","last_scrub_stamp":"2024-04-25T02:28:20.223133+0000","last_deep_scrub":"43'371","last_deep_scrub_stamp":"2024-04-25T02:28:20.223133+0000","last_clean_scrub_stamp":"2024-04-25T02:28:20.223133+0000","objects_scrubbed":0,"log_size":371,"log_dups_size":0,"ondisk_log_size":371,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:15:12.999404+0000","scrub_duration":0.0022911020000000002,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":32821,"num_write":343,"num_write_kb":62943,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"43'327","reported_seq":385,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:11.615512+0000","last_change":"2024-04-25T02:29:11.615484+0000","last_active":"2024-04-25T02:29:11.615512+0000","last_peered":"2024-04-25T02:29:11.615512+0000","last_clean":"2024-04-25T02:29:11.615512+0000","last_became_active":"2024-04-25T02:23:13.840492+0000","last_became_peered":"2024-04-25T02:23:13.840492+0000","last_unstale":"2024-04-25T02:29:11.615512+0000","last_undegraded":"2024-04-25T02:29:11.615512+0000","last_fullsized":"2024-04-25T02:29:11.615512+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'327","last_scrub_stamp":"2024-04-25T02:29:11.615400+0000","last_deep_scrub":"43'327","last_deep_scrub_stamp":"2024-04-25T02:29:11.615400+0000","last_clean_scrub_stamp":"2024-04-25T02:29:11.615400+0000","objects_scrubbed":4,"log_size":327,"log_dups_size":0,"ondisk_log_size":327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:49:15.104618+0000","scrub_duration":0.029271986,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":257,"num_write_kb":12449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1a","version":"43'384","reported_seq":454,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:25.236814+0000","last_change":"2024-04-25T02:28:25.236776+0000","last_active":"2024-04-25T02:28:25.236814+0000","last_peered":"2024-04-25T02:28:25.236814+0000","last_clean":"2024-04-25T02:28:25.236814+0000","last_became_active":"2024-04-25T02:23:13.847264+0000","last_became_peered":"2024-04-25T02:23:13.847264+0000","last_unstale":"2024-04-25T02:28:25.236814+0000","last_undegraded":"2024-04-25T02:28:25.236814+0000","last_fullsized":"2024-04-25T02:28:25.236814+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'384","last_scrub_stamp":"2024-04-25T02:28:25.236669+0000","last_deep_scrub":"43'384","last_deep_scrub_stamp":"2024-04-25T02:28:25.236669+0000","last_clean_scrub_stamp":"2024-04-25T02:28:25.236669+0000","objects_scrubbed":0,"log_size":384,"log_dups_size":0,"ondisk_log_size":384,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T12:20:51.748406+0000","scrub_duration":0.002112685,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":15655,"num_write":352,"num_write_kb":42131,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1e","version":"43'94","reported_seq":144,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:50.478023+0000","last_change":"2024-04-25T02:28:50.477980+0000","last_active":"2024-04-25T02:28:50.478023+0000","last_peered":"2024-04-25T02:28:50.478023+0000","last_clean":"2024-04-25T02:28:50.478023+0000","last_became_active":"2024-04-25T02:23:13.845143+0000","last_became_peered":"2024-04-25T02:23:13.845143+0000","last_unstale":"2024-04-25T02:28:50.478023+0000","last_undegraded":"2024-04-25T02:28:50.478023+0000","last_fullsized":"2024-04-25T02:28:50.478023+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'94","last_scrub_stamp":"2024-04-25T02:28:50.477893+0000","last_deep_scrub":"43'94","last_deep_scrub_stamp":"2024-04-25T02:28:50.477893+0000","last_clean_scrub_stamp":"2024-04-25T02:28:50.477893+0000","objects_scrubbed":1,"log_size":94,"log_dups_size":0,"ondisk_log_size":94,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T04:47:38.664790+0000","scrub_duration":0.0099647699999999995,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":41,"num_write_kb":4121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"43'427","reported_seq":472,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:51.875426+0000","last_change":"2024-04-25T02:29:51.875388+0000","last_active":"2024-04-25T02:29:51.875426+0000","last_peered":"2024-04-25T02:29:51.875426+0000","last_clean":"2024-04-25T02:29:51.875426+0000","last_became_active":"2024-04-25T02:23:55.956828+0000","last_became_peered":"2024-04-25T02:23:55.956828+0000","last_unstale":"2024-04-25T02:29:51.875426+0000","last_undegraded":"2024-04-25T02:29:51.875426+0000","last_fullsized":"2024-04-25T02:29:51.875426+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'427","last_scrub_stamp":"2024-04-25T02:29:51.875289+0000","last_deep_scrub":"43'427","last_deep_scrub_stamp":"2024-04-25T02:29:51.875289+0000","last_clean_scrub_stamp":"2024-04-25T02:29:51.875289+0000","objects_scrubbed":0,"log_size":427,"log_dups_size":0,"ondisk_log_size":427,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T03:06:09.686813+0000","scrub_duration":0.002199351,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":14079,"num_write":394,"num_write_kb":87521,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1f","version":"43'114","reported_seq":160,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:20.198034+0000","last_change":"2024-04-25T02:28:20.198001+0000","last_active":"2024-04-25T02:28:20.198034+0000","last_peered":"2024-04-25T02:28:20.198034+0000","last_clean":"2024-04-25T02:28:20.198034+0000","last_became_active":"2024-04-25T02:23:11.838807+0000","last_became_peered":"2024-04-25T02:23:11.838807+0000","last_unstale":"2024-04-25T02:28:20.198034+0000","last_undegraded":"2024-04-25T02:28:20.198034+0000","last_fullsized":"2024-04-25T02:28:20.198034+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'114","last_scrub_stamp":"2024-04-25T02:28:20.197907+0000","last_deep_scrub":"43'114","last_deep_scrub_stamp":"2024-04-25T02:28:20.197907+0000","last_clean_scrub_stamp":"2024-04-25T02:28:20.197907+0000","objects_scrubbed":3,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T07:47:55.330863+0000","scrub_duration":0.011784594000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194857,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":59,"num_write_kb":4127,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"43'447","reported_seq":531,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:53.887469+0000","last_change":"2024-04-25T02:28:53.887441+0000","last_active":"2024-04-25T02:28:53.887469+0000","last_peered":"2024-04-25T02:28:53.887469+0000","last_clean":"2024-04-25T02:28:53.887469+0000","last_became_active":"2024-04-25T02:23:12.845497+0000","last_became_peered":"2024-04-25T02:23:12.845497+0000","last_unstale":"2024-04-25T02:28:53.887469+0000","last_undegraded":"2024-04-25T02:28:53.887469+0000","last_fullsized":"2024-04-25T02:28:53.887469+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'447","last_scrub_stamp":"2024-04-25T02:28:53.887343+0000","last_deep_scrub":"43'447","last_deep_scrub_stamp":"2024-04-25T02:28:53.887343+0000","last_clean_scrub_stamp":"2024-04-25T02:28:53.887343+0000","objects_scrubbed":0,"log_size":447,"log_dups_size":0,"ondisk_log_size":447,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T02:59:00.846583+0000","scrub_duration":0.0022684239999999998,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":15742,"num_write":414,"num_write_kb":51315,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"43'419","reported_seq":495,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:24.999907+0000","last_change":"2024-04-25T02:29:24.999876+0000","last_active":"2024-04-25T02:29:24.999907+0000","last_peered":"2024-04-25T02:29:24.999907+0000","last_clean":"2024-04-25T02:29:24.999907+0000","last_became_active":"2024-04-25T02:23:12.846719+0000","last_became_peered":"2024-04-25T02:23:12.846719+0000","last_unstale":"2024-04-25T02:29:24.999907+0000","last_undegraded":"2024-04-25T02:29:24.999907+0000","last_fullsized":"2024-04-25T02:29:24.999907+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'419","last_scrub_stamp":"2024-04-25T02:29:24.999777+0000","last_deep_scrub":"43'419","last_deep_scrub_stamp":"2024-04-25T02:29:24.999777+0000","last_clean_scrub_stamp":"2024-04-25T02:29:24.999777+0000","objects_scrubbed":0,"log_size":419,"log_dups_size":0,"ondisk_log_size":419,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T09:06:01.639473+0000","scrub_duration":0.0022050609999999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":16944,"num_write":389,"num_write_kb":35957,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"43'440","reported_seq":495,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:21.088417+0000","last_change":"2024-04-25T02:29:21.088396+0000","last_active":"2024-04-25T02:29:21.088417+0000","last_peered":"2024-04-25T02:29:21.088417+0000","last_clean":"2024-04-25T02:29:21.088417+0000","last_became_active":"2024-04-25T02:23:56.301745+0000","last_became_peered":"2024-04-25T02:23:56.301745+0000","last_unstale":"2024-04-25T02:29:21.088417+0000","last_undegraded":"2024-04-25T02:29:21.088417+0000","last_fullsized":"2024-04-25T02:29:21.088417+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'440","last_scrub_stamp":"2024-04-25T02:29:21.088323+0000","last_deep_scrub":"43'440","last_deep_scrub_stamp":"2024-04-25T02:29:21.088323+0000","last_clean_scrub_stamp":"2024-04-25T02:29:21.088323+0000","objects_scrubbed":0,"log_size":440,"log_dups_size":0,"ondisk_log_size":440,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T08:48:29.034833+0000","scrub_duration":0.0017322780000000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":12557,"num_write":410,"num_write_kb":77332,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.22","version":"43'492","reported_seq":571,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:28:24.176583+0000","last_change":"2024-04-25T02:28:24.176533+0000","last_active":"2024-04-25T02:28:24.176583+0000","last_peered":"2024-04-25T02:28:24.176583+0000","last_clean":"2024-04-25T02:28:24.176583+0000","last_became_active":"2024-04-25T02:23:13.844235+0000","last_became_peered":"2024-04-25T02:23:13.844235+0000","last_unstale":"2024-04-25T02:28:24.176583+0000","last_undegraded":"2024-04-25T02:28:24.176583+0000","last_fullsized":"2024-04-25T02:28:24.176583+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'492","last_scrub_stamp":"2024-04-25T02:28:24.176384+0000","last_deep_scrub":"43'492","last_deep_scrub_stamp":"2024-04-25T02:28:24.176384+0000","last_clean_scrub_stamp":"2024-04-25T02:28:24.176384+0000","objects_scrubbed":0,"log_size":492,"log_dups_size":0,"ondisk_log_size":492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T13:47:15.054028+0000","scrub_duration":0.002556961,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":14237,"num_write":458,"num_write_kb":116854,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"43'392","reported_seq":482,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:13.587928+0000","last_change":"2024-04-25T02:29:13.587897+0000","last_active":"2024-04-25T02:29:13.587928+0000","last_peered":"2024-04-25T02:29:13.587928+0000","last_clean":"2024-04-25T02:29:13.587928+0000","last_became_active":"2024-04-25T02:23:13.845193+0000","last_became_peered":"2024-04-25T02:23:13.845193+0000","last_unstale":"2024-04-25T02:29:13.587928+0000","last_undegraded":"2024-04-25T02:29:13.587928+0000","last_fullsized":"2024-04-25T02:29:13.587928+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'392","last_scrub_stamp":"2024-04-25T02:29:13.587800+0000","last_deep_scrub":"43'392","last_deep_scrub_stamp":"2024-04-25T02:29:13.587800+0000","last_clean_scrub_stamp":"2024-04-25T02:29:13.587800+0000","objects_scrubbed":0,"log_size":392,"log_dups_size":0,"ondisk_log_size":392,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T10:00:48.741712+0000","scrub_duration":0.002153206,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":38,"num_read_kb":36152,"num_write":360,"num_write_kb":54497,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"43'402","reported_seq":514,"reported_epoch":43,"state":"active+clean","last_fresh":"2024-04-25T02:29:19.963419+0000","last_change":"2024-04-25T02:29:19.963389+0000","last_active":"2024-04-25T02:29:19.963419+0000","last_peered":"2024-04-25T02:29:19.963419+0000","last_clean":"2024-04-25T02:29:19.963419+0000","last_became_active":"2024-04-25T02:23:12.841677+0000","last_became_peered":"2024-04-25T02:23:12.841677+0000","last_unstale":"2024-04-25T02:29:19.963419+0000","last_undegraded":"2024-04-25T02:29:19.963419+0000","last_fullsized":"2024-04-25T02:29:19.963419+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"43'402","last_scrub_stamp":"2024-04-25T02:29:19.963285+0000","last_deep_scrub":"43'402","last_deep_scrub_stamp":"2024-04-25T02:29:19.963285+0000","last_clean_scrub_stamp":"2024-04-25T02:29:19.963285+0000","objects_scrubbed":0,"log_size":402,"log_dups_size":0,"ondisk_log_size":402,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T06:36:14.054555+0000","scrub_duration":0.002042412,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":32628,"num_write":375,"num_write_kb":79888,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2779,"num_read_kb":1446401,"num_write":24390,"num_write_kb":4320360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26350,"ondisk_log_size":26350,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":32,"stat_sum":{"num_bytes":129261049,"num_objects":72,"num_object_clones":0,"num_object_copies":144,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":72,"num_whiteouts":0,"num_read":231,"num_read_kb":1603,"num_write":6644,"num_write_kb":130848,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":27,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":9420,"num_omap_keys":20,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":258629632,"data_stored":258522098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":39115,"internal_metadata":0},"log_size":8552,"ondisk_log_size":8552,"up":64,"acting":64,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":117,"num_read_kb":105,"num_write":157,"num_write_kb":2291,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":4}],"osd_stats":[{"osd":3,"up_from":31,"seq":133143986263,"num_pgs":63,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":393820,"kb_used_data":88340,"kb_used_omap":9,"kb_used_meta":305462,"kb_avail":93978020,"statfs":{"total":96636764160,"available":96233492480,"internally_reserved":0,"allocated":90460160,"data_stored":90216632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9975,"internal_metadata":312793353},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:29:18 2024","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.33900000000000002,"15min":0.33500000000000002},"min":{"1min":0.222,"5min":0.156,"15min":0.156},"max":{"1min":0.51000000000000001,"5min":3.5409999999999999,"15min":3.5409999999999999},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.373,"5min":0.39500000000000002,"15min":0.36499999999999999},"min":{"1min":0.247,"5min":0.161,"15min":0.161},"max":{"1min":0.54000000000000004,"5min":3.613,"15min":3.613},"last":0.314}]},{"osd":1,"last update":"Thu Apr 25 02:29:18 2024","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.378,"15min":0.36199999999999999},"min":{"1min":0.26500000000000001,"5min":0.184,"15min":0.184},"max":{"1min":0.51000000000000001,"5min":3.0009999999999999,"15min":3.0009999999999999},"last":0.29299999999999998},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.36899999999999999},"min":{"1min":0.27800000000000002,"5min":0.157,"15min":0.157},"max":{"1min":0.56000000000000005,"5min":4.9720000000000004,"15min":4.9720000000000004},"last":0.33900000000000002}]},{"osd":2,"last update":"Thu Apr 25 02:29:18 2024","interfaces":[{"interface":"back","average":{"1min":0.39800000000000002,"5min":0.42499999999999999,"15min":0.378},"min":{"1min":0.28799999999999998,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.505,"5min":4.883,"15min":4.883},"last":0.374},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.40000000000000002,"15min":0.38400000000000001},"min":{"1min":0.30299999999999999,"5min":0.184,"15min":0.184},"max":{"1min":0.56699999999999995,"5min":3.0550000000000002,"15min":3.0550000000000002},"last":0.36199999999999999}]}]},{"osd":2,"up_from":30,"seq":128849018967,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":366484,"kb_used_data":56972,"kb_used_omap":8,"kb_used_meta":309495,"kb_avail":94005356,"statfs":{"total":96636764160,"available":96261484544,"internally_reserved":0,"allocated":58339328,"data_stored":58119882,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8387,"internal_metadata":316923709},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.32600000000000001,"15min":0.32400000000000001},"min":{"1min":0.26700000000000002,"5min":0.14199999999999999,"15min":0.14199999999999999},"max":{"1min":0.52100000000000002,"5min":2.419,"15min":2.419},"last":0.311},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.32100000000000001,"15min":0.32800000000000001},"min":{"1min":0.27200000000000002,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.47799999999999998,"5min":0.49299999999999999,"15min":0.51300000000000001},"last":0.437}]},{"osd":1,"last update":"Thu Apr 25 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.35199999999999998,"15min":0.34799999999999998},"min":{"1min":0.249,"5min":0.19,"15min":0.19},"max":{"1min":0.47499999999999998,"5min":1.1140000000000001,"15min":1.1140000000000001},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.375,"5min":0.34999999999999998,"15min":0.34899999999999998},"min":{"1min":0.27900000000000003,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.48799999999999999,"5min":0.88300000000000001,"15min":0.88300000000000001},"last":0.372}]},{"osd":3,"last update":"Thu Apr 25 02:29:24 2024","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.34799999999999998,"15min":0.35399999999999998},"min":{"1min":0.26200000000000001,"5min":0.19800000000000001,"15min":0.19800000000000001},"max":{"1min":0.51200000000000001,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.435,"5min":0.39700000000000002,"15min":0.40100000000000002},"min":{"1min":0.35599999999999998,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.55800000000000005,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.46999999999999997}]}]},{"osd":0,"up_from":28,"seq":120259084376,"num_pgs":50,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":369380,"kb_used_data":59740,"kb_used_omap":15,"kb_used_meta":309616,"kb_avail":94002460,"statfs":{"total":96636764160,"available":96258519040,"internally_reserved":0,"allocated":61173760,"data_stored":60940630,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15790,"internal_metadata":317047378},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Apr 25 02:29:17 2024","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.30599999999999999,"15min":0.33000000000000002},"min":{"1min":0.255,"5min":0.14799999999999999,"15min":0.14799999999999999},"max":{"1min":0.46800000000000003,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.307},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.33600000000000002,"15min":0.35499999999999998},"min":{"1min":0.28699999999999998,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.51900000000000002,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":0.379}]},{"osd":2,"last update":"Thu Apr 25 02:29:17 2024","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.34200000000000003,"15min":0.37},"min":{"1min":0.309,"5min":0.188,"15min":0.188},"max":{"1min":0.501,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.34799999999999998,"15min":0.378},"min":{"1min":0.29299999999999998,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.497,"5min":1.2070000000000001,"15min":1.2070000000000001},"last":0.32600000000000001}]},{"osd":3,"last update":"Thu Apr 25 02:29:31 2024","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.374,"15min":0.378},"min":{"1min":0.31900000000000001,"5min":0.186,"15min":0.186},"max":{"1min":0.47799999999999998,"5min":2.8069999999999999,"15min":2.8069999999999999},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.371,"15min":0.41199999999999998},"min":{"1min":0.33700000000000002,"5min":0.221,"15min":0.221},"max":{"1min":0.55100000000000005,"5min":0.57299999999999995,"15min":0.63100000000000001},"last":0.41899999999999998}]}]},{"osd":1,"up_from":29,"seq":124554051672,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":351548,"kb_used_data":50100,"kb_used_omap":4,"kb_used_meta":301435,"kb_avail":94020292,"statfs":{"total":96636764160,"available":96276779008,"internally_reserved":0,"allocated":51302400,"data_stored":51088318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4963,"internal_metadata":308669597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Apr 25 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.32800000000000001,"5min":0.29599999999999999,"15min":0.32000000000000001},"min":{"1min":0.253,"5min":0.155,"15min":0.155},"max":{"1min":0.42299999999999999,"5min":0.47199999999999998,"15min":0.47199999999999998},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.32300000000000001,"15min":0.34599999999999997},"min":{"1min":0.24399999999999999,"5min":0.17599999999999999,"15min":0.17599999999999999},"max":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.54000000000000004},"last":0.38600000000000001}]},{"osd":2,"last update":"Thu Apr 25 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.32900000000000001,"15min":0.34799999999999998},"min":{"1min":0.28000000000000003,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.54800000000000004},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.35399999999999998,"15min":0.35999999999999999},"min":{"1min":0.28699999999999998,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.51100000000000001,"5min":1.0149999999999999,"15min":1.0149999999999999},"last":0.312}]},{"osd":3,"last update":"Thu Apr 25 02:30:17 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.36899999999999999,"15min":0.39200000000000002},"min":{"1min":0.309,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.51600000000000001,"5min":0.55000000000000004,"15min":0.57799999999999996},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.36299999999999999,"15min":0.38400000000000001},"min":{"1min":0.33000000000000002,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.505,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.35699999999999998}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":60215296,"data_stored":60184605,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":15790,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":50343936,"data_stored":50332293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4963,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57974784,"data_stored":57954225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8387,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":90095616,"data_stored":90050975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":9975,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-25T02:30:21.757 DEBUG:teuthology.orchestra.run.smithi111:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-25T02:30:21.906 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.903+0000 7f1be36b8700 1 Processor -- start 2024-04-25T02:30:21.906 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.903+0000 7f1be36b8700 1 -- start start 2024-04-25T02:30:21.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.903+0000 7f1be36b8700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1bdc06e5b0 0x7f1bdc06f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:21.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.903+0000 7f1be36b8700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f1bdc0a5e70 0x7f1bdc068490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:21.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.903+0000 7f1be36b8700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1bdc0689d0 0x7f1bdc13f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:21.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.903+0000 7f1be36b8700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bdc06fc60 con 0x7f1bdc0a5e70 2024-04-25T02:30:21.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.903+0000 7f1be36b8700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bdc067c50 con 0x7f1bdc06e5b0 2024-04-25T02:30:21.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.903+0000 7f1be36b8700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1bdc067f10 con 0x7f1bdc0689d0 2024-04-25T02:30:21.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.904+0000 7f1be1454700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1bdc06e5b0 0x7f1bdc06f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:21.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.904+0000 7f1be0c53700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f1bdc0a5e70 0x7f1bdc068490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:21.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.904+0000 7f1be1c55700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1bdc0689d0 0x7f1bdc13f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:21.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.904+0000 7f1be1454700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1bdc06e5b0 0x7f1bdc06f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:54660/0 (socket says 172.21.15.111:54660) 2024-04-25T02:30:21.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.904+0000 7f1be1c55700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1bdc0689d0 0x7f1bdc13f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:36038/0 (socket says 172.21.15.111:36038) 2024-04-25T02:30:21.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.904+0000 7f1be0c53700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f1bdc0a5e70 0x7f1bdc068490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:60724/0 (socket says 172.21.15.111:60724) 2024-04-25T02:30:21.909 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.904+0000 7f1be1454700 1 -- 172.21.15.111:0/2661794488 learned_addr learned my addr 172.21.15.111:0/2661794488 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:30:21.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.904+0000 7f1be1454700 1 -- 172.21.15.111:0/2661794488 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1bdc0689d0 msgr2=0x7f1bdc13f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:30:21.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.904+0000 7f1be1454700 1 --2- 172.21.15.111:0/2661794488 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1bdc0689d0 0x7f1bdc13f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:21.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.904+0000 7f1be1454700 1 -- 172.21.15.111:0/2661794488 >> v2:172.21.15.111:3300/0 conn(0x7f1bdc0a5e70 msgr2=0x7f1bdc068490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:30:21.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.904+0000 7f1be1454700 1 --2- 172.21.15.111:0/2661794488 >> v2:172.21.15.111:3300/0 conn(0x7f1bdc0a5e70 0x7f1bdc068490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:21.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.904+0000 7f1be1454700 1 -- 172.21.15.111:0/2661794488 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bdc069930 con 0x7f1bdc06e5b0 2024-04-25T02:30:21.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.904+0000 7f1be0c53700 1 --2- 172.21.15.111:0/2661794488 >> v2:172.21.15.111:3300/0 conn(0x7f1bdc0a5e70 0x7f1bdc068490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:30:21.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.904+0000 7f1be1c55700 1 --2- 172.21.15.111:0/2661794488 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1bdc0689d0 0x7f1bdc13f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:30:21.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.904+0000 7f1be1454700 1 --2- 172.21.15.111:0/2661794488 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1bdc06e5b0 0x7f1bdc06f3a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1bd80099b0 tx=0x7f1bd8009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a633fbdca4eb5ae9 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:30:21.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.904+0000 7f1bd3fff700 1 -- 172.21.15.111:0/2661794488 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd800b680 con 0x7f1bdc06e5b0 2024-04-25T02:30:21.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.904+0000 7f1bd3fff700 1 -- 172.21.15.111:0/2661794488 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bd800b7e0 con 0x7f1bdc06e5b0 2024-04-25T02:30:21.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.904+0000 7f1bd3fff700 1 -- 172.21.15.111:0/2661794488 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd800bb80 con 0x7f1bdc06e5b0 2024-04-25T02:30:21.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.905+0000 7f1be36b8700 1 -- 172.21.15.111:0/2661794488 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1bdc06e5b0 msgr2=0x7f1bdc06f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:21.910 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.905+0000 7f1be36b8700 1 --2- 172.21.15.111:0/2661794488 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1bdc06e5b0 0x7f1bdc06f3a0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f1bd80099b0 tx=0x7f1bd8009250 comp rx=0 tx=0).stop 2024-04-25T02:30:21.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.905+0000 7f1be36b8700 1 -- 172.21.15.111:0/2661794488 shutdown_connections 2024-04-25T02:30:21.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.905+0000 7f1be36b8700 1 --2- 172.21.15.111:0/2661794488 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1bdc0689d0 0x7f1bdc13f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:21.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.905+0000 7f1be36b8700 1 --2- 172.21.15.111:0/2661794488 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1bdc06e5b0 0x7f1bdc06f3a0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:21.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.905+0000 7f1be36b8700 1 --2- 172.21.15.111:0/2661794488 >> v2:172.21.15.111:3300/0 conn(0x7f1bdc0a5e70 0x7f1bdc068490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:21.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.905+0000 7f1be36b8700 1 -- 172.21.15.111:0/2661794488 >> 172.21.15.111:0/2661794488 conn(0x7f1bdc06ce40 msgr2=0x7f1bdc06af80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:30:21.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.905+0000 7f1be36b8700 1 -- 172.21.15.111:0/2661794488 shutdown_connections 2024-04-25T02:30:21.911 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.905+0000 7f1be36b8700 1 -- 172.21.15.111:0/2661794488 wait complete. 2024-04-25T02:30:21.913 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.906+0000 7f1be36b8700 1 Processor -- start 2024-04-25T02:30:21.913 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.906+0000 7f1be36b8700 1 -- start start 2024-04-25T02:30:21.913 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.906+0000 7f1be36b8700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1bdc0689d0 0x7f1bdc0aa5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:21.913 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.906+0000 7f1be36b8700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1bdc06e5b0 0x7f1bdc1513d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:21.913 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.906+0000 7f1be36b8700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1bdc0a5e70 0x7f1bdc151910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:21.913 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.906+0000 7f1be36b8700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bdc0ad4d0 con 0x7f1bdc0a5e70 2024-04-25T02:30:21.913 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.906+0000 7f1be36b8700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bdc0ac520 con 0x7f1bdc0689d0 2024-04-25T02:30:21.913 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.906+0000 7f1be36b8700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f1bdc0aae10 con 0x7f1bdc06e5b0 2024-04-25T02:30:21.913 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.906+0000 7f1be1454700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1bdc0689d0 0x7f1bdc0aa5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:21.914 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.906+0000 7f1be0c53700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1bdc06e5b0 0x7f1bdc1513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:21.914 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.906+0000 7f1be1c55700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1bdc0a5e70 0x7f1bdc151910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:21.914 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.906+0000 7f1be1454700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1bdc0689d0 0x7f1bdc0aa5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:54676/0 (socket says 172.21.15.111:54676) 2024-04-25T02:30:21.914 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.907+0000 7f1be1454700 1 -- 172.21.15.111:0/833489241 learned_addr learned my addr 172.21.15.111:0/833489241 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:30:21.914 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.907+0000 7f1be1c55700 1 -- 172.21.15.111:0/833489241 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1bdc06e5b0 msgr2=0x7f1bdc1513d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:21.914 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.907+0000 7f1be1c55700 1 --2- 172.21.15.111:0/833489241 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1bdc06e5b0 0x7f1bdc1513d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:21.914 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.907+0000 7f1be1c55700 1 -- 172.21.15.111:0/833489241 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1bdc0689d0 msgr2=0x7f1bdc0aa5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:21.914 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.907+0000 7f1be1c55700 1 --2- 172.21.15.111:0/833489241 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1bdc0689d0 0x7f1bdc0aa5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:21.914 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.907+0000 7f1be1c55700 1 -- 172.21.15.111:0/833489241 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd4009a20 con 0x7f1bdc0a5e70 2024-04-25T02:30:21.914 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.907+0000 7f1be1454700 1 --2- 172.21.15.111:0/833489241 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1bdc0689d0 0x7f1bdc0aa5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:30:21.914 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.907+0000 7f1be1c55700 1 --2- 172.21.15.111:0/833489241 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1bdc0a5e70 0x7f1bdc151910 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4009f10 tx=0x7f1bd400b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:30:21.914 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.907+0000 7f1bd17fa700 1 -- 172.21.15.111:0/833489241 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd400cb70 con 0x7f1bdc0a5e70 2024-04-25T02:30:21.914 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.907+0000 7f1bd17fa700 1 -- 172.21.15.111:0/833489241 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bd400f040 con 0x7f1bdc0a5e70 2024-04-25T02:30:21.914 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.907+0000 7f1be36b8700 1 -- 172.21.15.111:0/833489241 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bcc009420 con 0x7f1bdc0a5e70 2024-04-25T02:30:21.915 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.907+0000 7f1bd17fa700 1 -- 172.21.15.111:0/833489241 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd4014480 con 0x7f1bdc0a5e70 2024-04-25T02:30:21.915 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.907+0000 7f1be36b8700 1 -- 172.21.15.111:0/833489241 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bd80094f0 con 0x7f1bdc0a5e70 2024-04-25T02:30:21.915 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.908+0000 7f1be36b8700 1 -- 172.21.15.111:0/833489241 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bdc065190 con 0x7f1bdc0a5e70 2024-04-25T02:30:21.915 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.908+0000 7f1bd17fa700 1 -- 172.21.15.111:0/833489241 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f1bd4003020 con 0x7f1bdc0a5e70 2024-04-25T02:30:21.915 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.908+0000 7f1bd17fa700 1 -- 172.21.15.111:0/833489241 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4158+0+0 (secure 0 0 0) 0x7f1bd405b910 con 0x7f1bdc0a5e70 2024-04-25T02:30:21.915 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:21.912+0000 7f1bd17fa700 1 -- 172.21.15.111:0/833489241 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f1bd4039ba0 con 0x7f1bdc0a5e70 2024-04-25T02:30:22.072 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.069+0000 7f1be36b8700 1 -- 172.21.15.111:0/833489241 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f1bdc0a40c0 con 0x7f1bdc0a5e70 2024-04-25T02:30:22.076 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.073+0000 7f1bd17fa700 1 -- 172.21.15.111:0/833489241 <== mon.0 v2:172.21.15.111:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f1bd4039ba0 con 0x7f1bdc0a5e70 2024-04-25T02:30:22.078 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.074+0000 7f1bd17fa700 1 -- 172.21.15.111:0/833489241 <== mon.0 v2:172.21.15.111:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) v1 ==== 123+0+0 (secure 0 0 0) 0x7f1bd4018070 con 0x7f1bdc0a5e70 2024-04-25T02:30:22.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.076+0000 7f1be36b8700 1 -- 172.21.15.111:0/833489241 >> v1:172.21.15.111:6816/46482 conn(0x7f1bc0045ef0 legacy=0x7f1bc00483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:22.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.076+0000 7f1be36b8700 1 -- 172.21.15.111:0/833489241 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1bdc0a5e70 msgr2=0x7f1bdc151910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:22.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.076+0000 7f1be36b8700 1 --2- 172.21.15.111:0/833489241 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1bdc0a5e70 0x7f1bdc151910 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4009f10 tx=0x7f1bd400b040 comp rx=0 tx=0).stop 2024-04-25T02:30:22.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.076+0000 7f1be36b8700 1 -- 172.21.15.111:0/833489241 shutdown_connections 2024-04-25T02:30:22.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.076+0000 7f1be36b8700 1 --2- 172.21.15.111:0/833489241 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f1bdc0a5e70 0x7f1bdc151910 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:22.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.076+0000 7f1be36b8700 1 --2- 172.21.15.111:0/833489241 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f1bdc0689d0 0x7f1bdc0aa5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:22.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.076+0000 7f1be36b8700 1 --2- 172.21.15.111:0/833489241 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f1bdc06e5b0 0x7f1bdc1513d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:22.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.076+0000 7f1be36b8700 1 -- 172.21.15.111:0/833489241 >> 172.21.15.111:0/833489241 conn(0x7f1bdc06ce40 msgr2=0x7f1bdc0b1220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:30:22.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.076+0000 7f1be36b8700 1 -- 172.21.15.111:0/833489241 shutdown_connections 2024-04-25T02:30:22.080 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.076+0000 7f1be36b8700 1 -- 172.21.15.111:0/833489241 wait complete. 2024-04-25T02:30:22.091 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-25T02:30:22.092 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:30:22.209 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.203+0000 7f7be14e0700 1 Processor -- start 2024-04-25T02:30:22.209 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.203+0000 7f7be14e0700 1 -- start start 2024-04-25T02:30:22.209 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.204+0000 7f7be14e0700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f7bdc0b4fd0 0x7f7bdc0a2560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:22.209 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.204+0000 7f7be14e0700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7bdc13f110 0x7f7bdc0a3d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:22.209 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.204+0000 7f7be14e0700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7bdc0a46d0 con 0x7f7bdc0a3980 2024-04-25T02:30:22.209 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.204+0000 7f7be14e0700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7bdc0a6710 con 0x7f7bdc0b4fd0 2024-04-25T02:30:22.209 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.204+0000 7f7be14e0700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc0a4930 con 0x7f7bdc13f110 2024-04-25T02:30:22.209 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.204+0000 7f7bdb7fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7bdc13f110 0x7f7bdc0a3d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:22.209 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.204+0000 7f7bdaffd700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f7bdc0b4fd0 0x7f7bdc0a2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:22.209 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.204+0000 7f7bda7fc700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f7bdc0a3980 0x7f7bdc13ea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:59332/0 (socket says 172.21.15.111:59332) 2024-04-25T02:30:22.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.204+0000 7f7bda7fc700 1 -- 172.21.15.111:0/3773483328 learned_addr learned my addr 172.21.15.111:0/3773483328 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:30:22.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.204+0000 7f7bdaffd700 1 -- 172.21.15.111:0/3773483328 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7bdc13f110 msgr2=0x7f7bdc0a3d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:30:22.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.204+0000 7f7bdaffd700 1 --2- 172.21.15.111:0/3773483328 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7bdc13f110 0x7f7bdc0a3d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:22.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.204+0000 7f7bdaffd700 1 -- 172.21.15.111:0/3773483328 >> v1:172.21.15.111:6789/0 conn(0x7f7bdc0a3980 legacy=0x7f7bdc13ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:22.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.204+0000 7f7bdaffd700 1 -- 172.21.15.111:0/3773483328 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bdc0a31a0 con 0x7f7bdc0b4fd0 2024-04-25T02:30:22.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.204+0000 7f7bd9ffb700 1 -- 172.21.15.111:0/3773483328 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2676375600 0 0) 0x7f7bdc0a46d0 con 0x7f7bdc0a3980 2024-04-25T02:30:22.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.204+0000 7f7bdb7fe700 1 --2- 172.21.15.111:0/3773483328 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7bdc13f110 0x7f7bdc0a3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:30:22.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.204+0000 7f7bdaffd700 1 --2- 172.21.15.111:0/3773483328 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7bdc0b4fd0 0x7f7bdc0a2560 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc0098e0 tx=0x7f7bcc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d440d36286ebec2e server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:30:22.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.204+0000 7f7bd9ffb700 1 -- 172.21.15.111:0/3773483328 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc00b640 con 0x7f7bdc0b4fd0 2024-04-25T02:30:22.210 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.204+0000 7f7bd9ffb700 1 -- 172.21.15.111:0/3773483328 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7bcc00b7a0 con 0x7f7bdc0b4fd0 2024-04-25T02:30:22.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.204+0000 7f7bd9ffb700 1 -- 172.21.15.111:0/3773483328 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc00bb60 con 0x7f7bdc0b4fd0 2024-04-25T02:30:22.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.205+0000 7f7be14e0700 1 -- 172.21.15.111:0/3773483328 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7bdc0b4fd0 msgr2=0x7f7bdc0a2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:22.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.205+0000 7f7be14e0700 1 --2- 172.21.15.111:0/3773483328 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7bdc0b4fd0 0x7f7bdc0a2560 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f7bcc0098e0 tx=0x7f7bcc0091a0 comp rx=0 tx=0).stop 2024-04-25T02:30:22.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.205+0000 7f7be14e0700 1 -- 172.21.15.111:0/3773483328 shutdown_connections 2024-04-25T02:30:22.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.205+0000 7f7be14e0700 1 --2- 172.21.15.111:0/3773483328 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7bdc0b4fd0 0x7f7bdc0a2560 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:22.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.205+0000 7f7be14e0700 1 --2- 172.21.15.111:0/3773483328 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7bdc13f110 0x7f7bdc0a3d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:22.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.205+0000 7f7be14e0700 1 -- 172.21.15.111:0/3773483328 >> 172.21.15.111:0/3773483328 conn(0x7f7bdc0883e0 msgr2=0x7f7bdc068b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:30:22.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.205+0000 7f7be14e0700 1 -- 172.21.15.111:0/3773483328 shutdown_connections 2024-04-25T02:30:22.211 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.205+0000 7f7be14e0700 1 -- 172.21.15.111:0/3773483328 wait complete. 2024-04-25T02:30:22.213 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.206+0000 7f7be14e0700 1 Processor -- start 2024-04-25T02:30:22.213 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.206+0000 7f7be14e0700 1 -- start start 2024-04-25T02:30:22.213 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.206+0000 7f7be14e0700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7bdc0a3980 0x7f7bdc145aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:22.213 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.206+0000 7f7be14e0700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7bdc0b4fd0 0x7f7bdc14ea10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:22.213 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.206+0000 7f7be14e0700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7bdc13f110 0x7f7bdc146b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:22.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.206+0000 7f7be14e0700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc1452c0 con 0x7f7bdc0a3980 2024-04-25T02:30:22.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.206+0000 7f7be14e0700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc146860 con 0x7f7bdc13f110 2024-04-25T02:30:22.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.206+0000 7f7be14e0700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f7bdc145fe0 con 0x7f7bdc0b4fd0 2024-04-25T02:30:22.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.207+0000 7f7bdaffd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7bdc0a3980 0x7f7bdc145aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:22.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.207+0000 7f7bda7fc700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7bdc0b4fd0 0x7f7bdc14ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:22.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.207+0000 7f7bdb7fe700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7bdc13f110 0x7f7bdc146b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:22.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.207+0000 7f7bdaffd700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7bdc0a3980 0x7f7bdc145aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:60738/0 (socket says 172.21.15.111:60738) 2024-04-25T02:30:22.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.207+0000 7f7bdaffd700 1 -- 172.21.15.111:0/3926899260 learned_addr learned my addr 172.21.15.111:0/3926899260 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:30:22.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.207+0000 7f7bdaffd700 1 -- 172.21.15.111:0/3926899260 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7bdc0b4fd0 msgr2=0x7f7bdc14ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:22.214 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.207+0000 7f7bdaffd700 1 --2- 172.21.15.111:0/3926899260 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7bdc0b4fd0 0x7f7bdc14ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:22.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.207+0000 7f7bdaffd700 1 -- 172.21.15.111:0/3926899260 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7bdc13f110 msgr2=0x7f7bdc146b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:22.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.207+0000 7f7bdaffd700 1 --2- 172.21.15.111:0/3926899260 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7bdc13f110 0x7f7bdc146b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:22.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.207+0000 7f7bdaffd700 1 -- 172.21.15.111:0/3926899260 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bd4009a20 con 0x7f7bdc0a3980 2024-04-25T02:30:22.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.207+0000 7f7bdb7fe700 1 --2- 172.21.15.111:0/3926899260 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7bdc13f110 0x7f7bdc146b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:30:22.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.207+0000 7f7bdaffd700 1 --2- 172.21.15.111:0/3926899260 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7bdc0a3980 0x7f7bdc145aa0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc0a2b30 tx=0x7f7bcc0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:30:22.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.207+0000 7f7bc2ffd700 1 -- 172.21.15.111:0/3926899260 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc000d10 con 0x7f7bdc0a3980 2024-04-25T02:30:22.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.207+0000 7f7bc2ffd700 1 -- 172.21.15.111:0/3926899260 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f7bcc00bb20 con 0x7f7bdc0a3980 2024-04-25T02:30:22.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.207+0000 7f7bc2ffd700 1 -- 172.21.15.111:0/3926899260 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7bcc0116b0 con 0x7f7bdc0a3980 2024-04-25T02:30:22.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.207+0000 7f7be14e0700 1 -- 172.21.15.111:0/3926899260 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7bcc009420 con 0x7f7bdc0a3980 2024-04-25T02:30:22.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.207+0000 7f7be14e0700 1 -- 172.21.15.111:0/3926899260 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7bdc14f110 con 0x7f7bdc0a3980 2024-04-25T02:30:22.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.208+0000 7f7be14e0700 1 -- 172.21.15.111:0/3926899260 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7bdc14e750 con 0x7f7bdc0a3980 2024-04-25T02:30:22.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.208+0000 7f7bc2ffd700 1 -- 172.21.15.111:0/3926899260 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f7bcc011ae0 con 0x7f7bdc0a3980 2024-04-25T02:30:22.215 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.208+0000 7f7bc2ffd700 1 -- 172.21.15.111:0/3926899260 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4158+0+0 (secure 0 0 0) 0x7f7bcc05c770 con 0x7f7bdc0a3980 2024-04-25T02:30:22.216 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.212+0000 7f7bc2ffd700 1 -- 172.21.15.111:0/3926899260 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f7bcc055260 con 0x7f7bdc0a3980 2024-04-25T02:30:22.400 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.397+0000 7f7be14e0700 1 -- 172.21.15.111:0/3926899260 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7bdc0a2ee0 con 0x7f7bdc0a3980 2024-04-25T02:30:22.401 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.397+0000 7f7bc2ffd700 1 -- 172.21.15.111:0/3926899260 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+3701 (secure 0 0 0) 0x7f7bcc033e90 con 0x7f7bdc0a3980 2024-04-25T02:30:22.401 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:30:22.401 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":true},"standbys":[{"gid":14404,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6818/4022954817","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6818","nonce":4022954817}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":14405,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6817/1113530749","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6817","nonce":1113530749}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:20:24.150791+0000","modified":"2024-04-25T02:25:09.056753+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{"feature_14":"metric_collect"},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14417},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14417":{"gid":14417,"name":"b","rank":0,"incarnation":16,"state":"up:active","state_seq":4,"addr":"172.21.15.111:6819/696898730","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6819","nonce":696898730}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-25T02:30:22.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.399+0000 7f7be14e0700 1 -- 172.21.15.111:0/3926899260 >> v1:172.21.15.111:6816/46482 conn(0x7f7bc8045ef0 legacy=0x7f7bc80483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:22.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.399+0000 7f7be14e0700 1 -- 172.21.15.111:0/3926899260 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7bdc0a3980 msgr2=0x7f7bdc145aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:22.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.399+0000 7f7be14e0700 1 --2- 172.21.15.111:0/3926899260 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7bdc0a3980 0x7f7bdc145aa0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f7bdc0a2b30 tx=0x7f7bcc0091a0 comp rx=0 tx=0).stop 2024-04-25T02:30:22.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.399+0000 7f7be14e0700 1 -- 172.21.15.111:0/3926899260 shutdown_connections 2024-04-25T02:30:22.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.399+0000 7f7be14e0700 1 --2- 172.21.15.111:0/3926899260 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f7bdc13f110 0x7f7bdc146b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:22.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.399+0000 7f7be14e0700 1 --2- 172.21.15.111:0/3926899260 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f7bdc0a3980 0x7f7bdc145aa0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:22.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.399+0000 7f7be14e0700 1 --2- 172.21.15.111:0/3926899260 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f7bdc0b4fd0 0x7f7bdc14ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:22.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.399+0000 7f7be14e0700 1 -- 172.21.15.111:0/3926899260 >> 172.21.15.111:0/3926899260 conn(0x7f7bdc0883e0 msgr2=0x7f7bdc13e7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:30:22.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.399+0000 7f7be14e0700 1 -- 172.21.15.111:0/3926899260 shutdown_connections 2024-04-25T02:30:22.403 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.399+0000 7f7be14e0700 1 -- 172.21.15.111:0/3926899260 wait complete. 2024-04-25T02:30:22.404 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 20 2024-04-25T02:30:22.414 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-25T02:30:22.529 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.525+0000 7f69bcb11700 1 Processor -- start 2024-04-25T02:30:22.529 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.525+0000 7f69bcb11700 1 -- start start 2024-04-25T02:30:22.533 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.526+0000 7f69bcb11700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f69b80ad350 0x7f69b813e6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:22.533 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.526+0000 7f69bcb11700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f69b813ebf0 0x7f69b8148b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:22.533 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.526+0000 7f69bcb11700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69b80ac670 con 0x7f69b8063cd0 2024-04-25T02:30:22.533 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.526+0000 7f69bcb11700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69b806e230 con 0x7f69b80ad350 2024-04-25T02:30:22.533 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.526+0000 7f69bcb11700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f69b80ad720 con 0x7f69b813ebf0 2024-04-25T02:30:22.533 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.526+0000 7f69b659c700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f69b8063cd0 0x7f69b806db20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:59340/0 (socket says 172.21.15.111:59340) 2024-04-25T02:30:22.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.526+0000 7f69b659c700 1 -- 172.21.15.111:0/497468976 learned_addr learned my addr 172.21.15.111:0/497468976 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:30:22.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.526+0000 7f69b5d9b700 1 --2- 172.21.15.111:0/497468976 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f69b80ad350 0x7f69b813e6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:22.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.526+0000 7f69b6d9d700 1 --2- 172.21.15.111:0/497468976 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f69b813ebf0 0x7f69b8148b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:22.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.526+0000 7f69b559a700 1 -- 172.21.15.111:0/497468976 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4208952863 0 0) 0x7f69b80ac670 con 0x7f69b8063cd0 2024-04-25T02:30:22.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.526+0000 7f69b559a700 1 -- 172.21.15.111:0/497468976 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69a0003570 con 0x7f69b8063cd0 2024-04-25T02:30:22.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.526+0000 7f69b5d9b700 1 -- 172.21.15.111:0/497468976 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f69b813ebf0 msgr2=0x7f69b8148b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:30:22.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.526+0000 7f69b5d9b700 1 --2- 172.21.15.111:0/497468976 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f69b813ebf0 0x7f69b8148b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:22.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.526+0000 7f69b5d9b700 1 -- 172.21.15.111:0/497468976 >> v1:172.21.15.111:6789/0 conn(0x7f69b8063cd0 legacy=0x7f69b806db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:22.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.526+0000 7f69b5d9b700 1 -- 172.21.15.111:0/497468976 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69b80ac910 con 0x7f69b80ad350 2024-04-25T02:30:22.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.526+0000 7f69b6d9d700 1 --2- 172.21.15.111:0/497468976 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f69b813ebf0 0x7f69b8148b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:30:22.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.527+0000 7f69b5d9b700 1 --2- 172.21.15.111:0/497468976 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f69b80ad350 0x7f69b813e6b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f69ac009940 tx=0x7f69ac0091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d4abea7972d2f64 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:30:22.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.527+0000 7f69b559a700 1 -- 172.21.15.111:0/497468976 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ac011630 con 0x7f69b80ad350 2024-04-25T02:30:22.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.527+0000 7f69b559a700 1 -- 172.21.15.111:0/497468976 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f69ac011790 con 0x7f69b80ad350 2024-04-25T02:30:22.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.527+0000 7f69b559a700 1 -- 172.21.15.111:0/497468976 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69ac011b10 con 0x7f69b80ad350 2024-04-25T02:30:22.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.527+0000 7f69bcb11700 1 -- 172.21.15.111:0/497468976 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f69b80ad350 msgr2=0x7f69b813e6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:22.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.527+0000 7f69bcb11700 1 --2- 172.21.15.111:0/497468976 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f69b80ad350 0x7f69b813e6b0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f69ac009940 tx=0x7f69ac0091a0 comp rx=0 tx=0).stop 2024-04-25T02:30:22.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.527+0000 7f69bcb11700 1 -- 172.21.15.111:0/497468976 shutdown_connections 2024-04-25T02:30:22.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.527+0000 7f69bcb11700 1 --2- 172.21.15.111:0/497468976 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f69b813ebf0 0x7f69b8148b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:22.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.527+0000 7f69bcb11700 1 --2- 172.21.15.111:0/497468976 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f69b80ad350 0x7f69b813e6b0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:22.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.527+0000 7f69bcb11700 1 -- 172.21.15.111:0/497468976 >> 172.21.15.111:0/497468976 conn(0x7f69b80b1510 msgr2=0x7f69b80b1910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:30:22.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.527+0000 7f69bcb11700 1 -- 172.21.15.111:0/497468976 shutdown_connections 2024-04-25T02:30:22.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.527+0000 7f69bcb11700 1 -- 172.21.15.111:0/497468976 wait complete. 2024-04-25T02:30:22.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.528+0000 7f69bcb11700 1 Processor -- start 2024-04-25T02:30:22.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.528+0000 7f69bcb11700 1 -- start start 2024-04-25T02:30:22.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.529+0000 7f69bcb11700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f69b8063cd0 0x7f69b8119aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:22.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.529+0000 7f69bcb11700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f69b80ad350 0x7f69b811ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:22.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.529+0000 7f69bcb11700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f69b813ebf0 0x7f69b814e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:22.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.529+0000 7f69bcb11700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69b813d2c0 con 0x7f69b8063cd0 2024-04-25T02:30:22.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.529+0000 7f69bcb11700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69b811a9b0 con 0x7f69b80ad350 2024-04-25T02:30:22.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.529+0000 7f69bcb11700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f69b811bce0 con 0x7f69b813ebf0 2024-04-25T02:30:22.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.529+0000 7f69b659c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f69b8063cd0 0x7f69b8119aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:22.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.529+0000 7f69b5d9b700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f69b80ad350 0x7f69b811ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:22.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.529+0000 7f69b6d9d700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f69b813ebf0 0x7f69b814e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:22.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.529+0000 7f69b659c700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f69b8063cd0 0x7f69b8119aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:60748/0 (socket says 172.21.15.111:60748) 2024-04-25T02:30:22.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.529+0000 7f69b659c700 1 -- 172.21.15.111:0/1247375995 learned_addr learned my addr 172.21.15.111:0/1247375995 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:30:22.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.529+0000 7f69b659c700 1 -- 172.21.15.111:0/1247375995 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f69b813ebf0 msgr2=0x7f69b814e1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:22.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.529+0000 7f69b659c700 1 --2- 172.21.15.111:0/1247375995 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f69b813ebf0 0x7f69b814e1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:22.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.529+0000 7f69b659c700 1 -- 172.21.15.111:0/1247375995 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f69b80ad350 msgr2=0x7f69b811ae40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:22.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.529+0000 7f69b659c700 1 --2- 172.21.15.111:0/1247375995 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f69b80ad350 0x7f69b811ae40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:22.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.529+0000 7f69b659c700 1 -- 172.21.15.111:0/1247375995 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69a8009420 con 0x7f69b8063cd0 2024-04-25T02:30:22.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.529+0000 7f69b6d9d700 1 --2- 172.21.15.111:0/1247375995 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f69b813ebf0 0x7f69b814e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:30:22.536 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.529+0000 7f69b5d9b700 1 --2- 172.21.15.111:0/1247375995 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f69b80ad350 0x7f69b811ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:30:22.537 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.529+0000 7f69b659c700 1 --2- 172.21.15.111:0/1247375995 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f69b8063cd0 0x7f69b8119aa0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f69b000cc70 tx=0x7f69b0001a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:30:22.537 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.529+0000 7f69a67fc700 1 -- 172.21.15.111:0/1247375995 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b000a900 con 0x7f69b8063cd0 2024-04-25T02:30:22.537 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.529+0000 7f69a67fc700 1 -- 172.21.15.111:0/1247375995 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f69b000aa80 con 0x7f69b8063cd0 2024-04-25T02:30:22.537 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.529+0000 7f69a67fc700 1 -- 172.21.15.111:0/1247375995 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69b000ae60 con 0x7f69b8063cd0 2024-04-25T02:30:22.537 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.529+0000 7f69bcb11700 1 -- 172.21.15.111:0/1247375995 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69ac009420 con 0x7f69b8063cd0 2024-04-25T02:30:22.537 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.529+0000 7f69bcb11700 1 -- 172.21.15.111:0/1247375995 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69b814df00 con 0x7f69b8063cd0 2024-04-25T02:30:22.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.530+0000 7f69bcb11700 1 -- 172.21.15.111:0/1247375995 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69b811ac90 con 0x7f69b8063cd0 2024-04-25T02:30:22.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.530+0000 7f69a67fc700 1 -- 172.21.15.111:0/1247375995 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f69b0007300 con 0x7f69b8063cd0 2024-04-25T02:30:22.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.531+0000 7f69a67fc700 1 -- 172.21.15.111:0/1247375995 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4158+0+0 (secure 0 0 0) 0x7f69b005b350 con 0x7f69b8063cd0 2024-04-25T02:30:22.538 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.534+0000 7f69a67fc700 1 -- 172.21.15.111:0/1247375995 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f69b0039800 con 0x7f69b8063cd0 2024-04-25T02:30:22.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.714+0000 7f69bcb11700 1 -- 172.21.15.111:0/1247375995 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f69b81424c0 con 0x7f69b8063cd0 2024-04-25T02:30:22.718 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.715+0000 7f69a67fc700 1 -- 172.21.15.111:0/1247375995 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 20 v20) v1 ==== 94+0+3701 (secure 0 0 0) 0x7f69b003cff0 con 0x7f69b8063cd0 2024-04-25T02:30:22.719 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:30:22.719 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":false,"ever_enabled_multiple":true},"standbys":[{"gid":14404,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6818/4022954817","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6818","nonce":4022954817}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":14},{"gid":14405,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.111:6817/1113530749","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6817","nonce":1113530749}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":20,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-25T02:20:24.150791+0000","modified":"2024-04-25T02:25:09.056753+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{"feature_14":"metric_collect"},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":34,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":14417},"failed":[],"damaged":[],"stopped":[1],"info":{"gid_14417":{"gid":14417,"name":"b","rank":0,"incarnation":16,"state":"up:active","state_seq":4,"addr":"172.21.15.111:6819/696898730","addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6819","nonce":696898730}]},"join_fscid":-1,"export_targets":[],"features":4540138320759226367,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[4],"metadata_pool":3,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":0},"id":1}]} 2024-04-25T02:30:22.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.717+0000 7f69bcb11700 1 -- 172.21.15.111:0/1247375995 >> v1:172.21.15.111:6816/46482 conn(0x7f6998045ef0 legacy=0x7f69980483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:22.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.717+0000 7f69bcb11700 1 -- 172.21.15.111:0/1247375995 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f69b8063cd0 msgr2=0x7f69b8119aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:22.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.717+0000 7f69bcb11700 1 --2- 172.21.15.111:0/1247375995 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f69b8063cd0 0x7f69b8119aa0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f69b000cc70 tx=0x7f69b0001a70 comp rx=0 tx=0).stop 2024-04-25T02:30:22.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.717+0000 7f69bcb11700 1 -- 172.21.15.111:0/1247375995 shutdown_connections 2024-04-25T02:30:22.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.717+0000 7f69bcb11700 1 --2- 172.21.15.111:0/1247375995 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f69b813ebf0 0x7f69b814e1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:22.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.717+0000 7f69bcb11700 1 --2- 172.21.15.111:0/1247375995 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f69b8063cd0 0x7f69b8119aa0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:22.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.717+0000 7f69bcb11700 1 --2- 172.21.15.111:0/1247375995 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f69b80ad350 0x7f69b811ae40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:22.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.717+0000 7f69bcb11700 1 -- 172.21.15.111:0/1247375995 >> 172.21.15.111:0/1247375995 conn(0x7f69b80b1510 msgr2=0x7f69b8068230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:30:22.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.717+0000 7f69bcb11700 1 -- 172.21.15.111:0/1247375995 shutdown_connections 2024-04-25T02:30:22.721 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.717+0000 7f69bcb11700 1 -- 172.21.15.111:0/1247375995 wait complete. 2024-04-25T02:30:22.721 INFO:teuthology.orchestra.run.smithi111.stderr:dumped fsmap epoch 20 2024-04-25T02:30:22.732 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-25T02:30:22.847 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.843+0000 7f845b3d5700 1 Processor -- start 2024-04-25T02:30:22.847 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.843+0000 7f845b3d5700 1 -- start start 2024-04-25T02:30:22.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.844+0000 7f845b3d5700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f8454067940 0x7f8454146620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:22.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.844+0000 7f845b3d5700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8454146b60 0x7f8454148f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:22.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.844+0000 7f845b3d5700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f845406f890 con 0x7f8454068c10 2024-04-25T02:30:22.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.844+0000 7f845b3d5700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f845406ed40 con 0x7f8454067940 2024-04-25T02:30:22.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.844+0000 7f845b3d5700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84540a23f0 con 0x7f8454146b60 2024-04-25T02:30:22.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.844+0000 7f8459972700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8454146b60 0x7f8454148f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:22.849 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.844+0000 7f8458970700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f8454067940 0x7f8454146620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:22.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.844+0000 7f8459171700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f8454068c10 0x7f845406e350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:59342/0 (socket says 172.21.15.111:59342) 2024-04-25T02:30:22.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.844+0000 7f8459171700 1 -- 172.21.15.111:0/2403345167 learned_addr learned my addr 172.21.15.111:0/2403345167 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:30:22.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.844+0000 7f8458970700 1 -- 172.21.15.111:0/2403345167 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8454146b60 msgr2=0x7f8454148f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:30:22.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.844+0000 7f8458970700 1 --2- 172.21.15.111:0/2403345167 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8454146b60 0x7f8454148f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:22.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.844+0000 7f8458970700 1 -- 172.21.15.111:0/2403345167 >> v1:172.21.15.111:6789/0 conn(0x7f8454068c10 legacy=0x7f845406e350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:22.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.844+0000 7f8458970700 1 -- 172.21.15.111:0/2403345167 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84540680e0 con 0x7f8454067940 2024-04-25T02:30:22.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.844+0000 7f844bfff700 1 -- 172.21.15.111:0/2403345167 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2156358902 0 0) 0x7f845406f890 con 0x7f8454068c10 2024-04-25T02:30:22.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.844+0000 7f8459972700 1 --2- 172.21.15.111:0/2403345167 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8454146b60 0x7f8454148f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:30:22.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.845+0000 7f8458970700 1 --2- 172.21.15.111:0/2403345167 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8454067940 0x7f8454146620 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f84500098e0 tx=0x7f84500091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=808dea6c47fd56a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:30:22.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.845+0000 7f844bfff700 1 -- 172.21.15.111:0/2403345167 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845000b640 con 0x7f8454067940 2024-04-25T02:30:22.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.845+0000 7f844bfff700 1 -- 172.21.15.111:0/2403345167 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f845000b7a0 con 0x7f8454067940 2024-04-25T02:30:22.850 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.845+0000 7f844bfff700 1 -- 172.21.15.111:0/2403345167 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f845000bb60 con 0x7f8454067940 2024-04-25T02:30:22.851 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.845+0000 7f845b3d5700 1 -- 172.21.15.111:0/2403345167 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8454067940 msgr2=0x7f8454146620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:22.851 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.845+0000 7f845b3d5700 1 --2- 172.21.15.111:0/2403345167 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8454067940 0x7f8454146620 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f84500098e0 tx=0x7f84500091a0 comp rx=0 tx=0).stop 2024-04-25T02:30:22.851 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.845+0000 7f845b3d5700 1 -- 172.21.15.111:0/2403345167 shutdown_connections 2024-04-25T02:30:22.851 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.845+0000 7f845b3d5700 1 --2- 172.21.15.111:0/2403345167 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8454146b60 0x7f8454148f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:22.851 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.845+0000 7f845b3d5700 1 --2- 172.21.15.111:0/2403345167 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8454067940 0x7f8454146620 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:22.851 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.845+0000 7f845b3d5700 1 -- 172.21.15.111:0/2403345167 >> 172.21.15.111:0/2403345167 conn(0x7f845406ce40 msgr2=0x7f845406af80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:30:22.851 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.845+0000 7f845b3d5700 1 -- 172.21.15.111:0/2403345167 shutdown_connections 2024-04-25T02:30:22.851 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.845+0000 7f845b3d5700 1 -- 172.21.15.111:0/2403345167 wait complete. 2024-04-25T02:30:22.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.846+0000 7f845b3d5700 1 Processor -- start 2024-04-25T02:30:22.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.846+0000 7f845b3d5700 1 -- start start 2024-04-25T02:30:22.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.847+0000 7f845b3d5700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8454067940 0x7f845414e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:22.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.847+0000 7f845b3d5700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8454068c10 0x7f8454151620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:22.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.847+0000 7f845b3d5700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8454146b60 0x7f8454151b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:22.853 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.847+0000 7f845b3d5700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84540972b0 con 0x7f8454146b60 2024-04-25T02:30:22.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.847+0000 7f845b3d5700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84540ae4c0 con 0x7f8454068c10 2024-04-25T02:30:22.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.847+0000 7f845b3d5700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f8454098990 con 0x7f8454067940 2024-04-25T02:30:22.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.847+0000 7f8459171700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8454067940 0x7f845414e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:22.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.847+0000 7f8459972700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8454146b60 0x7f8454151b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:22.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.847+0000 7f8459972700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8454146b60 0x7f8454151b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:60768/0 (socket says 172.21.15.111:60768) 2024-04-25T02:30:22.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.847+0000 7f8459171700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8454067940 0x7f845414e900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:36092/0 (socket says 172.21.15.111:36092) 2024-04-25T02:30:22.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.847+0000 7f8459972700 1 -- 172.21.15.111:0/2078063424 learned_addr learned my addr 172.21.15.111:0/2078063424 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:30:22.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.847+0000 7f8458970700 1 --2- 172.21.15.111:0/2078063424 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8454068c10 0x7f8454151620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:22.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.847+0000 7f8459972700 1 -- 172.21.15.111:0/2078063424 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8454067940 msgr2=0x7f845414e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:22.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.847+0000 7f8459972700 1 --2- 172.21.15.111:0/2078063424 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8454067940 0x7f845414e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:22.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.847+0000 7f8459972700 1 -- 172.21.15.111:0/2078063424 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8454068c10 msgr2=0x7f8454151620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:22.854 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.847+0000 7f8459972700 1 --2- 172.21.15.111:0/2078063424 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8454068c10 0x7f8454151620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:22.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.847+0000 7f8459972700 1 -- 172.21.15.111:0/2078063424 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f844c009a20 con 0x7f8454146b60 2024-04-25T02:30:22.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.847+0000 7f8459972700 1 --2- 172.21.15.111:0/2078063424 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8454146b60 0x7f8454151b60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f844c009fc0 tx=0x7f844c00b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:30:22.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.848+0000 7f84497fa700 1 -- 172.21.15.111:0/2078063424 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c00cbd0 con 0x7f8454146b60 2024-04-25T02:30:22.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.848+0000 7f84497fa700 1 -- 172.21.15.111:0/2078063424 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f844c00f040 con 0x7f8454146b60 2024-04-25T02:30:22.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.848+0000 7f845b3d5700 1 -- 172.21.15.111:0/2078063424 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8450009420 con 0x7f8454146b60 2024-04-25T02:30:22.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.848+0000 7f84497fa700 1 -- 172.21.15.111:0/2078063424 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f844c014480 con 0x7f8454146b60 2024-04-25T02:30:22.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.848+0000 7f845b3d5700 1 -- 172.21.15.111:0/2078063424 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f845414ee40 con 0x7f8454146b60 2024-04-25T02:30:22.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.849+0000 7f845b3d5700 1 -- 172.21.15.111:0/2078063424 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84540aa3b0 con 0x7f8454146b60 2024-04-25T02:30:22.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.849+0000 7f84497fa700 1 -- 172.21.15.111:0/2078063424 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f844c003020 con 0x7f8454146b60 2024-04-25T02:30:22.855 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.849+0000 7f84497fa700 1 -- 172.21.15.111:0/2078063424 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4158+0+0 (secure 0 0 0) 0x7f844c05bcd0 con 0x7f8454146b60 2024-04-25T02:30:22.856 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:22.853+0000 7f84497fa700 1 -- 172.21.15.111:0/2078063424 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f844c039f80 con 0x7f8454146b60 2024-04-25T02:30:23.010 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.007+0000 7f845b3d5700 1 -- 172.21.15.111:0/2078063424 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f845414e620 con 0x7f8454146b60 2024-04-25T02:30:23.011 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.007+0000 7f84497fa700 1 -- 172.21.15.111:0/2078063424 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+12106 (secure 0 0 0) 0x7f845414e620 con 0x7f8454146b60 2024-04-25T02:30:23.011 INFO:teuthology.orchestra.run.smithi111.stdout: 2024-04-25T02:30:23.011 INFO:teuthology.orchestra.run.smithi111.stdout:{"epoch":43,"fsid":"4643f974-f93a-4436-93b8-460ff320e62e","created":"2024-04-25T02:20:05.450475+0000","modified":"2024-04-25T02:25:10.060341+0000","last_up_change":"2024-04-25T02:23:12.818028+0000","last_in_change":"2024-04-25T02:20:10.439204+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":8,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":4,"require_min_compat_client":"octopus","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-25T02:20:07.471248+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"37","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-25T02:20:14.420378+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"38","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"cephfs_metadata","create_time":"2024-04-25T02:20:22.251868+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"39","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":4,"pool_name":"cephfs_data","create_time":"2024-04-25T02:20:23.128289+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"40","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"df3f17ca-3b12-42c8-8cf7-8f1b7189e587","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":28,"up_thru":41,"down_at":23,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6800","nonce":48862}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6801","nonce":48862}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6803","nonce":48862}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6802","nonce":48862}]},"public_addr":"172.21.15.111:6800/48862","cluster_addr":"172.21.15.111:6801/48862","heartbeat_back_addr":"172.21.15.111:6803/48862","heartbeat_front_addr":"172.21.15.111:6802/48862","state":["exists","up"]},{"osd":1,"uuid":"93d54815-f215-4285-bba6-32f2d1cabf10","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":22,"up_from":29,"up_thru":31,"down_at":24,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6804","nonce":48960}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6805","nonce":48960}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6807","nonce":48960}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6806","nonce":48960}]},"public_addr":"172.21.15.111:6804/48960","cluster_addr":"172.21.15.111:6805/48960","heartbeat_back_addr":"172.21.15.111:6807/48960","heartbeat_front_addr":"172.21.15.111:6806/48960","state":["exists","up"]},{"osd":2,"uuid":"b26b2104-2a2e-408f-9ce7-3587a32a2ebe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":24,"up_from":30,"up_thru":41,"down_at":25,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6808","nonce":49070}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6809","nonce":49070}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6811","nonce":49070}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6810","nonce":49070}]},"public_addr":"172.21.15.111:6808/49070","cluster_addr":"172.21.15.111:6809/49070","heartbeat_back_addr":"172.21.15.111:6811/49070","heartbeat_front_addr":"172.21.15.111:6810/49070","state":["exists","up"]},{"osd":3,"uuid":"43c25820-1edc-4031-badf-72e87dd6bf15","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":25,"up_from":31,"up_thru":31,"down_at":26,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6812","nonce":49243}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6813","nonce":49243}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6815","nonce":49243}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.111:6814","nonce":49243}]},"public_addr":"172.21.15.111:6812/49243","cluster_addr":"172.21.15.111:6813/49243","heartbeat_back_addr":"172.21.15.111:6815/49243","heartbeat_front_addr":"172.21.15.111:6814/49243","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.372427+0000","dead_epoch":23},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.411480+0000","dead_epoch":24},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.361508+0000","dead_epoch":25},{"osd":3,"down_stamp":"2024-04-25T02:23:06.771296+0000","laggy_probability":0,"laggy_interval":0,"features":4540138320759226367,"old_weight":0,"last_purged_snaps_scrub":"2024-04-25T02:20:09.377212+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.9","mappings":[{"from":1,"to":2}]},{"pgid":"4.c","mappings":[{"from":3,"to":2}]},{"pgid":"4.d","mappings":[{"from":3,"to":2}]},{"pgid":"4.13","mappings":[{"from":3,"to":0}]},{"pgid":"4.19","mappings":[{"from":3,"to":0}]},{"pgid":"4.1b","mappings":[{"from":3,"to":0}]},{"pgid":"4.21","mappings":[{"from":3,"to":2}]},{"pgid":"4.30","mappings":[{"from":3,"to":2}]}],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.186:0/1473940677":"2024-04-25T03:25:09.063135+0000","172.21.15.111:6819/4003866251":"2024-04-26T02:23:16.839679+0000","172.21.15.111:0/2148931273":"2024-04-26T02:22:54.713254+0000","172.21.15.111:6816/39585":"2024-04-26T02:22:54.713254+0000","172.21.15.111:0/3911588907":"2024-04-26T02:22:54.713254+0000","172.21.15.111:0/1276843622":"2024-04-26T02:22:54.713254+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-25T02:30:23.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.009+0000 7f845b3d5700 1 -- 172.21.15.111:0/2078063424 >> v1:172.21.15.111:6816/46482 conn(0x7f8438045ef0 legacy=0x7f84380483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:23.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.009+0000 7f845b3d5700 1 -- 172.21.15.111:0/2078063424 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8454146b60 msgr2=0x7f8454151b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:23.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.009+0000 7f845b3d5700 1 --2- 172.21.15.111:0/2078063424 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8454146b60 0x7f8454151b60 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f844c009fc0 tx=0x7f844c00b040 comp rx=0 tx=0).stop 2024-04-25T02:30:23.013 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.009+0000 7f845b3d5700 1 -- 172.21.15.111:0/2078063424 shutdown_connections 2024-04-25T02:30:23.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.009+0000 7f845b3d5700 1 --2- 172.21.15.111:0/2078063424 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f8454146b60 0x7f8454151b60 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:23.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.009+0000 7f845b3d5700 1 --2- 172.21.15.111:0/2078063424 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f8454067940 0x7f845414e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:23.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.009+0000 7f845b3d5700 1 --2- 172.21.15.111:0/2078063424 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f8454068c10 0x7f8454151620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:23.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.009+0000 7f845b3d5700 1 -- 172.21.15.111:0/2078063424 >> 172.21.15.111:0/2078063424 conn(0x7f845406ce40 msgr2=0x7f8454144240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:30:23.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.009+0000 7f845b3d5700 1 -- 172.21.15.111:0/2078063424 shutdown_connections 2024-04-25T02:30:23.014 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.010+0000 7f845b3d5700 1 -- 172.21.15.111:0/2078063424 wait complete. 2024-04-25T02:30:23.025 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-25T02:30:23.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.140+0000 7f671ebfa700 1 Processor -- start 2024-04-25T02:30:23.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.140+0000 7f671ebfa700 1 -- start start 2024-04-25T02:30:23.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.141+0000 7f671ebfa700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f67180682a0 0x7f67180a3e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:23.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.141+0000 7f671ebfa700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f671806eae0 0x7f671806eed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:23.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.141+0000 7f671ebfa700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f671806f410 0x7f671813c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:23.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.141+0000 7f671ebfa700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67180a7090 con 0x7f67180682a0 2024-04-25T02:30:23.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.141+0000 7f671ebfa700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67180a7350 con 0x7f671806f410 2024-04-25T02:30:23.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.141+0000 7f671ebfa700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f67180a5640 con 0x7f671806eae0 2024-04-25T02:30:23.146 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.141+0000 7f671c996700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f67180682a0 0x7f67180a3e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:23.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.141+0000 7f671d197700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f671806f410 0x7f671813c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:23.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.141+0000 7f6717fff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f671806eae0 0x7f671806eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:23.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.141+0000 7f671c996700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f67180682a0 0x7f67180a3e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:60778/0 (socket says 172.21.15.111:60778) 2024-04-25T02:30:23.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.141+0000 7f671d197700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f671806f410 0x7f671813c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:54730/0 (socket says 172.21.15.111:54730) 2024-04-25T02:30:23.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.141+0000 7f671c996700 1 -- 172.21.15.111:0/3664853684 learned_addr learned my addr 172.21.15.111:0/3664853684 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:30:23.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.141+0000 7f671c996700 1 -- 172.21.15.111:0/3664853684 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f671806eae0 msgr2=0x7f671806eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:30:23.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.141+0000 7f671c996700 1 --2- 172.21.15.111:0/3664853684 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f671806eae0 0x7f671806eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:23.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.141+0000 7f671c996700 1 -- 172.21.15.111:0/3664853684 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f671806f410 msgr2=0x7f671813c530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:30:23.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.141+0000 7f671c996700 1 --2- 172.21.15.111:0/3664853684 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f671806f410 0x7f671813c530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:23.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.141+0000 7f671c996700 1 -- 172.21.15.111:0/3664853684 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f671806f890 con 0x7f67180682a0 2024-04-25T02:30:23.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.141+0000 7f6717fff700 1 --2- 172.21.15.111:0/3664853684 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f671806eae0 0x7f671806eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:30:23.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.141+0000 7f671d197700 1 --2- 172.21.15.111:0/3664853684 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f671806f410 0x7f671813c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:30:23.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.141+0000 7f671c996700 1 --2- 172.21.15.111:0/3664853684 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f67180682a0 0x7f67180a3e20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f670c0099b0 tx=0x7f670c009250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf66fe6587f68d02 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:30:23.147 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.141+0000 7f67177fe700 1 -- 172.21.15.111:0/3664853684 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670c00b710 con 0x7f67180682a0 2024-04-25T02:30:23.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.142+0000 7f67177fe700 1 -- 172.21.15.111:0/3664853684 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f670c00b870 con 0x7f67180682a0 2024-04-25T02:30:23.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.142+0000 7f67177fe700 1 -- 172.21.15.111:0/3664853684 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670c00bc30 con 0x7f67180682a0 2024-04-25T02:30:23.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.142+0000 7f671ebfa700 1 -- 172.21.15.111:0/3664853684 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f67180682a0 msgr2=0x7f67180a3e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:23.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.142+0000 7f671ebfa700 1 --2- 172.21.15.111:0/3664853684 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f67180682a0 0x7f67180a3e20 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f670c0099b0 tx=0x7f670c009250 comp rx=0 tx=0).stop 2024-04-25T02:30:23.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.142+0000 7f671ebfa700 1 -- 172.21.15.111:0/3664853684 shutdown_connections 2024-04-25T02:30:23.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.142+0000 7f671ebfa700 1 --2- 172.21.15.111:0/3664853684 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f671806f410 0x7f671813c530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:23.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.142+0000 7f671ebfa700 1 --2- 172.21.15.111:0/3664853684 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f67180682a0 0x7f67180a3e20 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:23.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.142+0000 7f671ebfa700 1 --2- 172.21.15.111:0/3664853684 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f671806eae0 0x7f671806eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:23.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.142+0000 7f671ebfa700 1 -- 172.21.15.111:0/3664853684 >> 172.21.15.111:0/3664853684 conn(0x7f671806beb0 msgr2=0x7f6718067940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:30:23.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.142+0000 7f671ebfa700 1 -- 172.21.15.111:0/3664853684 shutdown_connections 2024-04-25T02:30:23.148 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.142+0000 7f671ebfa700 1 -- 172.21.15.111:0/3664853684 wait complete. 2024-04-25T02:30:23.151 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.143+0000 7f671ebfa700 1 Processor -- start 2024-04-25T02:30:23.151 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.143+0000 7f671ebfa700 1 -- start start 2024-04-25T02:30:23.151 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.144+0000 7f671ebfa700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f67180682a0 0x7f6718098280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:23.151 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.144+0000 7f671ebfa700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f671806eae0 0x7f6718151840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:23.151 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.144+0000 7f671ebfa700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f671806f410 0x7f6718151d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:23.151 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.144+0000 7f671ebfa700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67180976e0 con 0x7f671806f410 2024-04-25T02:30:23.151 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.144+0000 7f671ebfa700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6718069510 con 0x7f67180682a0 2024-04-25T02:30:23.151 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.144+0000 7f671ebfa700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f671806a3e0 con 0x7f671806eae0 2024-04-25T02:30:23.151 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.144+0000 7f671c996700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f67180682a0 0x7f6718098280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:23.151 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.144+0000 7f671c996700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f67180682a0 0x7f6718098280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:54740/0 (socket says 172.21.15.111:54740) 2024-04-25T02:30:23.151 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.144+0000 7f671c996700 1 -- 172.21.15.111:0/895111182 learned_addr learned my addr 172.21.15.111:0/895111182 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:30:23.151 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.144+0000 7f6717fff700 1 --2- 172.21.15.111:0/895111182 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f671806eae0 0x7f6718151840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:23.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.144+0000 7f671d197700 1 --2- 172.21.15.111:0/895111182 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f671806f410 0x7f6718151d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:23.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.144+0000 7f671c996700 1 -- 172.21.15.111:0/895111182 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f671806eae0 msgr2=0x7f6718151840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:23.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.144+0000 7f671c996700 1 --2- 172.21.15.111:0/895111182 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f671806eae0 0x7f6718151840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:23.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.144+0000 7f671c996700 1 -- 172.21.15.111:0/895111182 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f671806f410 msgr2=0x7f6718151d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:23.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.144+0000 7f671c996700 1 --2- 172.21.15.111:0/895111182 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f671806f410 0x7f6718151d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:23.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.144+0000 7f671c996700 1 -- 172.21.15.111:0/895111182 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6704009420 con 0x7f67180682a0 2024-04-25T02:30:23.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.144+0000 7f671c996700 1 --2- 172.21.15.111:0/895111182 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f67180682a0 0x7f6718098280 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6718070160 tx=0x7f670c009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:30:23.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.144+0000 7f6714ff9700 1 -- 172.21.15.111:0/895111182 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670c000c40 con 0x7f67180682a0 2024-04-25T02:30:23.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.144+0000 7f6714ff9700 1 -- 172.21.15.111:0/895111182 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f670c00b9e0 con 0x7f67180682a0 2024-04-25T02:30:23.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.144+0000 7f6714ff9700 1 -- 172.21.15.111:0/895111182 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670c025420 con 0x7f67180682a0 2024-04-25T02:30:23.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.144+0000 7f671ebfa700 1 -- 172.21.15.111:0/895111182 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6710009a20 con 0x7f67180682a0 2024-04-25T02:30:23.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.144+0000 7f671ebfa700 1 -- 172.21.15.111:0/895111182 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f670c0094f0 con 0x7f67180682a0 2024-04-25T02:30:23.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.145+0000 7f671ebfa700 1 -- 172.21.15.111:0/895111182 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6718096e70 con 0x7f67180682a0 2024-04-25T02:30:23.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.145+0000 7f6714ff9700 1 -- 172.21.15.111:0/895111182 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f670c023070 con 0x7f67180682a0 2024-04-25T02:30:23.152 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.146+0000 7f6714ff9700 1 -- 172.21.15.111:0/895111182 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4158+0+0 (secure 0 0 0) 0x7f670c05c470 con 0x7f67180682a0 2024-04-25T02:30:23.153 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.149+0000 7f6714ff9700 1 -- 172.21.15.111:0/895111182 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f6718096e70 con 0x7f67180682a0 2024-04-25T02:30:23.340 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.336+0000 7f671ebfa700 1 -- 172.21.15.111:0/895111182 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f6718096e70 con 0x7f67180682a0 2024-04-25T02:30:23.344 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.340+0000 7f6714ff9700 1 -- 172.21.15.111:0/895111182 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v21) v1 ==== 161+0+0 (secure 0 0 0) 0x7f670c02a090 con 0x7f67180682a0 2024-04-25T02:30:23.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.343+0000 7f671ebfa700 1 -- 172.21.15.111:0/895111182 >> v1:172.21.15.111:6816/46482 conn(0x7f66fc045ee0 legacy=0x7f66fc048390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:23.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.343+0000 7f671ebfa700 1 -- 172.21.15.111:0/895111182 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f67180682a0 msgr2=0x7f6718098280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:23.346 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.343+0000 7f671ebfa700 1 --2- 172.21.15.111:0/895111182 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f67180682a0 0x7f6718098280 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6718070160 tx=0x7f670c009250 comp rx=0 tx=0).stop 2024-04-25T02:30:23.349 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.346+0000 7f671ebfa700 1 -- 172.21.15.111:0/895111182 shutdown_connections 2024-04-25T02:30:23.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.346+0000 7f671ebfa700 1 --2- 172.21.15.111:0/895111182 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f671806f410 0x7f6718151d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:23.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.346+0000 7f671ebfa700 1 --2- 172.21.15.111:0/895111182 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f67180682a0 0x7f6718098280 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:23.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.346+0000 7f671ebfa700 1 --2- 172.21.15.111:0/895111182 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f671806eae0 0x7f6718151840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:23.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.346+0000 7f671ebfa700 1 -- 172.21.15.111:0/895111182 >> 172.21.15.111:0/895111182 conn(0x7f671806beb0 msgr2=0x7f67180b34f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:30:23.350 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.347+0000 7f671ebfa700 1 -- 172.21.15.111:0/895111182 shutdown_connections 2024-04-25T02:30:23.351 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.347+0000 7f671ebfa700 1 -- 172.21.15.111:0/895111182 wait complete. 2024-04-25T02:30:23.353 INFO:teuthology.orchestra.run.smithi111.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-25T02:30:23.366 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-25T02:30:23.386 INFO:tasks.ceph.mds.b.smithi111.stdout:starting mds.b at 2024-04-25T02:30:23.484 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.480+0000 7f91d4161700 1 Processor -- start 2024-04-25T02:30:23.484 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.480+0000 7f91d4161700 1 -- start start 2024-04-25T02:30:23.487 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.481+0000 7f91d4161700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f91cc063c10 0x7f91cc0aabd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:23.487 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.481+0000 7f91d4161700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f91cc13b8a0 0x7f91cc148da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:23.487 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.481+0000 7f91d4161700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91cc0ab110 con 0x7f91cc0ad7c0 2024-04-25T02:30:23.487 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.481+0000 7f91d4161700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91cc068c70 con 0x7f91cc13b8a0 2024-04-25T02:30:23.487 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.481+0000 7f91d4161700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc0ac6a0 con 0x7f91cc063c10 2024-04-25T02:30:23.487 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.481+0000 7f91d1efd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f91cc063c10 0x7f91cc0aabd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:23.487 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.481+0000 7f91d26fe700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f91cc13b8a0 0x7f91cc148da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:23.487 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.481+0000 7f91d1efd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f91cc063c10 0x7f91cc0aabd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:54770/0 (socket says 172.21.15.111:54770) 2024-04-25T02:30:23.487 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.481+0000 7f91d1efd700 1 -- 172.21.15.111:0/2254682394 learned_addr learned my addr 172.21.15.111:0/2254682394 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:30:23.487 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.481+0000 7f91d26fe700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f91cc13b8a0 0x7f91cc148da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:60808/0 (socket says 172.21.15.111:60808) 2024-04-25T02:30:23.487 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.481+0000 7f91d16fc700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f91cc0ad7c0 0x7f91cc0aa040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:59354/0 (socket says 172.21.15.111:59354) 2024-04-25T02:30:23.488 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.481+0000 7f91d0efb700 1 -- 172.21.15.111:0/2254682394 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2951736416 0 0) 0x7f91cc0ab110 con 0x7f91cc0ad7c0 2024-04-25T02:30:23.488 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.482+0000 7f91d0efb700 1 -- 172.21.15.111:0/2254682394 --> v1:172.21.15.111:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f91b8003570 con 0x7f91cc0ad7c0 2024-04-25T02:30:23.488 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.482+0000 7f91d1efd700 1 -- 172.21.15.111:0/2254682394 >> v2:172.21.15.111:3300/0 conn(0x7f91cc13b8a0 msgr2=0x7f91cc148da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:30:23.488 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.482+0000 7f91d1efd700 1 --2- 172.21.15.111:0/2254682394 >> v2:172.21.15.111:3300/0 conn(0x7f91cc13b8a0 0x7f91cc148da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:23.488 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.482+0000 7f91d1efd700 1 -- 172.21.15.111:0/2254682394 >> v1:172.21.15.111:6789/0 conn(0x7f91cc0ad7c0 legacy=0x7f91cc0aa040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:23.488 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.482+0000 7f91d1efd700 1 -- 172.21.15.111:0/2254682394 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91cc0ac940 con 0x7f91cc063c10 2024-04-25T02:30:23.488 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.482+0000 7f91d26fe700 1 --2- 172.21.15.111:0/2254682394 >> v2:172.21.15.111:3300/0 conn(0x7f91cc13b8a0 0x7f91cc148da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:30:23.488 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.482+0000 7f91d1efd700 1 --2- 172.21.15.111:0/2254682394 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f91cc063c10 0x7f91cc0aabd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f91bc0099b0 tx=0x7f91bc009250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=359e4657fdc017bc server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:30:23.488 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.482+0000 7f91d0efb700 1 -- 172.21.15.111:0/2254682394 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91bc00b680 con 0x7f91cc063c10 2024-04-25T02:30:23.488 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.482+0000 7f91d0efb700 1 -- 172.21.15.111:0/2254682394 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f91bc00b7e0 con 0x7f91cc063c10 2024-04-25T02:30:23.488 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.482+0000 7f91d0efb700 1 -- 172.21.15.111:0/2254682394 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91bc00bba0 con 0x7f91cc063c10 2024-04-25T02:30:23.488 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.482+0000 7f91d4161700 1 -- 172.21.15.111:0/2254682394 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f91cc063c10 msgr2=0x7f91cc0aabd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:23.489 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.482+0000 7f91d4161700 1 --2- 172.21.15.111:0/2254682394 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f91cc063c10 0x7f91cc0aabd0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f91bc0099b0 tx=0x7f91bc009250 comp rx=0 tx=0).stop 2024-04-25T02:30:23.489 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.482+0000 7f91d4161700 1 -- 172.21.15.111:0/2254682394 shutdown_connections 2024-04-25T02:30:23.489 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.482+0000 7f91d4161700 1 --2- 172.21.15.111:0/2254682394 >> v2:172.21.15.111:3300/0 conn(0x7f91cc13b8a0 0x7f91cc148da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:23.489 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.482+0000 7f91d4161700 1 --2- 172.21.15.111:0/2254682394 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f91cc063c10 0x7f91cc0aabd0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:23.489 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.482+0000 7f91d4161700 1 -- 172.21.15.111:0/2254682394 >> 172.21.15.111:0/2254682394 conn(0x7f91cc0b1400 msgr2=0x7f91cc0b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:30:23.489 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.483+0000 7f91d4161700 1 -- 172.21.15.111:0/2254682394 shutdown_connections 2024-04-25T02:30:23.489 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.483+0000 7f91d4161700 1 -- 172.21.15.111:0/2254682394 wait complete. 2024-04-25T02:30:23.489 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.483+0000 7f91d4161700 1 Processor -- start 2024-04-25T02:30:23.489 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.483+0000 7f91d4161700 1 -- start start 2024-04-25T02:30:23.492 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.484+0000 7f91d4161700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f91cc063c10 0x7f91cc0aff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:23.492 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.484+0000 7f91d4161700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f91cc0ad7c0 0x7f91cc13c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:23.492 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.484+0000 7f91d4161700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f91cc13b8a0 0x7f91cc13c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:23.492 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.484+0000 7f91d4161700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc0b0d40 con 0x7f91cc13b8a0 2024-04-25T02:30:23.492 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.484+0000 7f91d4161700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc0b0600 con 0x7f91cc063c10 2024-04-25T02:30:23.492 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.484+0000 7f91d4161700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f91cc0b08c0 con 0x7f91cc0ad7c0 2024-04-25T02:30:23.492 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.484+0000 7f91d1efd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f91cc063c10 0x7f91cc0aff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:23.492 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.484+0000 7f91d26fe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f91cc13b8a0 0x7f91cc13c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:23.492 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.484+0000 7f91d16fc700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f91cc0ad7c0 0x7f91cc13c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:23.492 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.484+0000 7f91d1efd700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f91cc063c10 0x7f91cc0aff40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:54784/0 (socket says 172.21.15.111:54784) 2024-04-25T02:30:23.492 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.484+0000 7f91d26fe700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f91cc13b8a0 0x7f91cc13c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:60822/0 (socket says 172.21.15.111:60822) 2024-04-25T02:30:23.492 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.484+0000 7f91d1efd700 1 -- 172.21.15.111:0/3170977791 learned_addr learned my addr 172.21.15.111:0/3170977791 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:30:23.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.484+0000 7f91d16fc700 1 -- 172.21.15.111:0/3170977791 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f91cc063c10 msgr2=0x7f91cc0aff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:23.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.484+0000 7f91d16fc700 1 --2- 172.21.15.111:0/3170977791 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f91cc063c10 0x7f91cc0aff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:23.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.484+0000 7f91d16fc700 1 -- 172.21.15.111:0/3170977791 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f91cc13b8a0 msgr2=0x7f91cc13c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:23.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.484+0000 7f91d16fc700 1 --2- 172.21.15.111:0/3170977791 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f91cc13b8a0 0x7f91cc13c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:23.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.484+0000 7f91d16fc700 1 -- 172.21.15.111:0/3170977791 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91c4009a20 con 0x7f91cc0ad7c0 2024-04-25T02:30:23.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.484+0000 7f91d26fe700 1 --2- 172.21.15.111:0/3170977791 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f91cc13b8a0 0x7f91cc13c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:30:23.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.484+0000 7f91d16fc700 1 --2- 172.21.15.111:0/3170977791 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f91cc0ad7c0 0x7f91cc13c110 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f91c800c560 tx=0x7f91c8007d40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:30:23.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.485+0000 7f91c1ffb700 1 -- 172.21.15.111:0/3170977791 <== mon.2 v2:172.21.15.111:3302/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c8005a70 con 0x7f91cc0ad7c0 2024-04-25T02:30:23.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.485+0000 7f91c1ffb700 1 -- 172.21.15.111:0/3170977791 <== mon.2 v2:172.21.15.111:3302/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f91c8005bd0 con 0x7f91cc0ad7c0 2024-04-25T02:30:23.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.485+0000 7f91c1ffb700 1 -- 172.21.15.111:0/3170977791 <== mon.2 v2:172.21.15.111:3302/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91c80070d0 con 0x7f91cc0ad7c0 2024-04-25T02:30:23.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.485+0000 7f91d4161700 1 -- 172.21.15.111:0/3170977791 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91bc0094f0 con 0x7f91cc0ad7c0 2024-04-25T02:30:23.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.485+0000 7f91d4161700 1 -- 172.21.15.111:0/3170977791 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91cc13d4a0 con 0x7f91cc0ad7c0 2024-04-25T02:30:23.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.486+0000 7f91c1ffb700 1 -- 172.21.15.111:0/3170977791 <== mon.2 v2:172.21.15.111:3302/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f91c80074c0 con 0x7f91cc0ad7c0 2024-04-25T02:30:23.493 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.486+0000 7f91d4161700 1 -- 172.21.15.111:0/3170977791 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91cc065190 con 0x7f91cc0ad7c0 2024-04-25T02:30:23.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.486+0000 7f91c1ffb700 1 -- 172.21.15.111:0/3170977791 <== mon.2 v2:172.21.15.111:3302/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4201+0+0 (secure 0 0 0) 0x7f91c805a520 con 0x7f91cc0ad7c0 2024-04-25T02:30:23.494 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.490+0000 7f91c1ffb700 1 -- 172.21.15.111:0/3170977791 <== mon.2 v2:172.21.15.111:3302/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f91c80388c0 con 0x7f91cc0ad7c0 2024-04-25T02:30:23.676 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:23.673+0000 7f91d4161700 1 -- 172.21.15.111:0/3170977791 --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f91cc06d820 con 0x7f91cc0ad7c0 2024-04-25T02:30:24.345 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.341+0000 7f91c1ffb700 1 -- 172.21.15.111:0/3170977791 <== mon.2 v2:172.21.15.111:3302/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v22) v1 ==== 104+0+0 (secure 0 0 0) 0x7f91c80170a0 con 0x7f91cc0ad7c0 2024-04-25T02:30:24.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.344+0000 7f91d4161700 1 -- 172.21.15.111:0/3170977791 >> v1:172.21.15.111:6816/46482 conn(0x7f91b0045ef0 legacy=0x7f91b00483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:24.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.344+0000 7f91d4161700 1 -- 172.21.15.111:0/3170977791 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f91cc0ad7c0 msgr2=0x7f91cc13c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:24.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.344+0000 7f91d4161700 1 --2- 172.21.15.111:0/3170977791 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f91cc0ad7c0 0x7f91cc13c110 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f91c800c560 tx=0x7f91c8007d40 comp rx=0 tx=0).stop 2024-04-25T02:30:24.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.344+0000 7f91d4161700 1 -- 172.21.15.111:0/3170977791 shutdown_connections 2024-04-25T02:30:24.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.344+0000 7f91d4161700 1 --2- 172.21.15.111:0/3170977791 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f91cc13b8a0 0x7f91cc13c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:24.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.344+0000 7f91d4161700 1 --2- 172.21.15.111:0/3170977791 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f91cc063c10 0x7f91cc0aff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:24.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.344+0000 7f91d4161700 1 --2- 172.21.15.111:0/3170977791 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f91cc0ad7c0 0x7f91cc13c110 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:24.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.344+0000 7f91d4161700 1 -- 172.21.15.111:0/3170977791 >> 172.21.15.111:0/3170977791 conn(0x7f91cc0b1400 msgr2=0x7f91cc0b17d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:30:24.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.344+0000 7f91d4161700 1 -- 172.21.15.111:0/3170977791 shutdown_connections 2024-04-25T02:30:24.348 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.344+0000 7f91d4161700 1 -- 172.21.15.111:0/3170977791 wait complete. 2024-04-25T02:30:24.361 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-25T02:30:24.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.522+0000 7f3a8c8e9700 1 Processor -- start 2024-04-25T02:30:24.526 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.522+0000 7f3a8c8e9700 1 -- start start 2024-04-25T02:30:24.530 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.523+0000 7f3a8c8e9700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f3a880682a0 0x7f3a8813c530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:24.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.523+0000 7f3a8c8e9700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3a880b0670 0x7f3a8813ca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:24.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.523+0000 7f3a8c8e9700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3a880a3b30 con 0x7f3a880a3f60 2024-04-25T02:30:24.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.523+0000 7f3a8c8e9700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3a880a56f0 con 0x7f3a880682a0 2024-04-25T02:30:24.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.523+0000 7f3a8c8e9700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a880a7290 con 0x7f3a880b0670 2024-04-25T02:30:24.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.523+0000 7f3a85d9b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3a880b0670 0x7f3a8813ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:24.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.523+0000 7f3a8659c700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f3a880682a0 0x7f3a8813c530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:24.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.523+0000 7f3a85d9b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3a880b0670 0x7f3a8813ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3302/0 says I am v2:172.21.15.111:36130/0 (socket says 172.21.15.111:36130) 2024-04-25T02:30:24.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.523+0000 7f3a8659c700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f3a880682a0 0x7f3a8813c530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:60828/0 (socket says 172.21.15.111:60828) 2024-04-25T02:30:24.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.523+0000 7f3a85d9b700 1 -- 172.21.15.111:0/1282565212 learned_addr learned my addr 172.21.15.111:0/1282565212 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:30:24.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.523+0000 7f3a86d9d700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f3a880a3f60 0x7f3a8813f710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:59356/0 (socket says 172.21.15.111:59356) 2024-04-25T02:30:24.531 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.523+0000 7f3a8659c700 1 -- 172.21.15.111:0/1282565212 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3a880b0670 msgr2=0x7f3a8813ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:30:24.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.523+0000 7f3a8659c700 1 --2- 172.21.15.111:0/1282565212 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3a880b0670 0x7f3a8813ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:24.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.523+0000 7f3a8659c700 1 -- 172.21.15.111:0/1282565212 >> v1:172.21.15.111:6789/0 conn(0x7f3a880a3f60 legacy=0x7f3a8813f710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:24.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.523+0000 7f3a8559a700 1 -- 172.21.15.111:0/1282565212 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3667202338 0 0) 0x7f3a880a3b30 con 0x7f3a880a3f60 2024-04-25T02:30:24.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.523+0000 7f3a8659c700 1 -- 172.21.15.111:0/1282565212 --> v2:172.21.15.111:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a8806c700 con 0x7f3a880682a0 2024-04-25T02:30:24.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.523+0000 7f3a85d9b700 1 --2- 172.21.15.111:0/1282565212 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3a880b0670 0x7f3a8813ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:30:24.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.523+0000 7f3a8659c700 1 --2- 172.21.15.111:0/1282565212 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3a880682a0 0x7f3a8813c530 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c0098e0 tx=0x7f3a7c0091a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27d50979076e5422 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:30:24.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.523+0000 7f3a8559a700 1 -- 172.21.15.111:0/1282565212 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c00b640 con 0x7f3a880682a0 2024-04-25T02:30:24.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.523+0000 7f3a8559a700 1 -- 172.21.15.111:0/1282565212 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3a7c00b7a0 con 0x7f3a880682a0 2024-04-25T02:30:24.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.523+0000 7f3a8559a700 1 -- 172.21.15.111:0/1282565212 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a7c00bb60 con 0x7f3a880682a0 2024-04-25T02:30:24.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.524+0000 7f3a8c8e9700 1 -- 172.21.15.111:0/1282565212 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3a880682a0 msgr2=0x7f3a8813c530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:24.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.524+0000 7f3a8c8e9700 1 --2- 172.21.15.111:0/1282565212 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3a880682a0 0x7f3a8813c530 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f3a7c0098e0 tx=0x7f3a7c0091a0 comp rx=0 tx=0).stop 2024-04-25T02:30:24.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.524+0000 7f3a8c8e9700 1 -- 172.21.15.111:0/1282565212 shutdown_connections 2024-04-25T02:30:24.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.524+0000 7f3a8c8e9700 1 --2- 172.21.15.111:0/1282565212 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3a880682a0 0x7f3a8813c530 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:24.532 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.524+0000 7f3a8c8e9700 1 --2- 172.21.15.111:0/1282565212 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3a880b0670 0x7f3a8813ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:24.533 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.524+0000 7f3a8c8e9700 1 -- 172.21.15.111:0/1282565212 >> 172.21.15.111:0/1282565212 conn(0x7f3a8806bee0 msgr2=0x7f3a88067940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:30:24.533 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.524+0000 7f3a8c8e9700 1 -- 172.21.15.111:0/1282565212 shutdown_connections 2024-04-25T02:30:24.533 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.524+0000 7f3a8c8e9700 1 -- 172.21.15.111:0/1282565212 wait complete. 2024-04-25T02:30:24.533 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.525+0000 7f3a8c8e9700 1 Processor -- start 2024-04-25T02:30:24.533 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.525+0000 7f3a8c8e9700 1 -- start start 2024-04-25T02:30:24.533 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.525+0000 7f3a8c8e9700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3a880682a0 0x7f3a880abce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:24.533 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.525+0000 7f3a8c8e9700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3a880a3f60 0x7f3a8813a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:24.533 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.525+0000 7f3a8c8e9700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3a880b0670 0x7f3a8813aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:24.533 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.525+0000 7f3a8c8e9700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a880acf60 con 0x7f3a880b0670 2024-04-25T02:30:24.533 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.525+0000 7f3a8c8e9700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3a880ad150 con 0x7f3a880682a0 2024-04-25T02:30:24.533 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.526+0000 7f3a8c8e9700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f3a880af6d0 con 0x7f3a880a3f60 2024-04-25T02:30:24.533 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.526+0000 7f3a8659c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3a880682a0 0x7f3a880abce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:24.533 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.526+0000 7f3a86d9d700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3a880b0670 0x7f3a8813aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:24.533 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.526+0000 7f3a85d9b700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3a880a3f60 0x7f3a8813a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:24.533 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.526+0000 7f3a8659c700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3a880682a0 0x7f3a880abce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:54796/0 (socket says 172.21.15.111:54796) 2024-04-25T02:30:24.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.526+0000 7f3a8659c700 1 -- 172.21.15.111:0/1537102588 learned_addr learned my addr 172.21.15.111:0/1537102588 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:30:24.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.526+0000 7f3a86d9d700 1 -- 172.21.15.111:0/1537102588 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3a880a3f60 msgr2=0x7f3a8813a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:24.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.526+0000 7f3a86d9d700 1 --2- 172.21.15.111:0/1537102588 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3a880a3f60 0x7f3a8813a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:24.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.526+0000 7f3a86d9d700 1 -- 172.21.15.111:0/1537102588 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3a880682a0 msgr2=0x7f3a880abce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:24.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.526+0000 7f3a86d9d700 1 --2- 172.21.15.111:0/1537102588 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3a880682a0 0x7f3a880abce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:24.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.526+0000 7f3a86d9d700 1 -- 172.21.15.111:0/1537102588 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a780094f0 con 0x7f3a880b0670 2024-04-25T02:30:24.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.526+0000 7f3a86d9d700 1 --2- 172.21.15.111:0/1537102588 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3a880b0670 0x7f3a8813aa50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3a8000cc90 tx=0x7f3a80001a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:30:24.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.526+0000 7f3a767fc700 1 -- 172.21.15.111:0/1537102588 <== mon.0 v2:172.21.15.111:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a80005df0 con 0x7f3a880b0670 2024-04-25T02:30:24.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.526+0000 7f3a767fc700 1 -- 172.21.15.111:0/1537102588 <== mon.0 v2:172.21.15.111:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3a8000a6a0 con 0x7f3a880b0670 2024-04-25T02:30:24.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.526+0000 7f3a767fc700 1 -- 172.21.15.111:0/1537102588 <== mon.0 v2:172.21.15.111:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3a8000aa80 con 0x7f3a880b0670 2024-04-25T02:30:24.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.526+0000 7f3a8c8e9700 1 -- 172.21.15.111:0/1537102588 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a7c009420 con 0x7f3a880b0670 2024-04-25T02:30:24.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.526+0000 7f3a8c8e9700 1 -- 172.21.15.111:0/1537102588 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a880ac220 con 0x7f3a880b0670 2024-04-25T02:30:24.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.527+0000 7f3a8c8e9700 1 -- 172.21.15.111:0/1537102588 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a880ad480 con 0x7f3a880b0670 2024-04-25T02:30:24.534 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.527+0000 7f3a767fc700 1 -- 172.21.15.111:0/1537102588 <== mon.0 v2:172.21.15.111:3300/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f3a800070f0 con 0x7f3a880b0670 2024-04-25T02:30:24.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.527+0000 7f3a767fc700 1 -- 172.21.15.111:0/1537102588 <== mon.0 v2:172.21.15.111:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 4201+0+0 (secure 0 0 0) 0x7f3a8005b000 con 0x7f3a880b0670 2024-04-25T02:30:24.535 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.531+0000 7f3a767fc700 1 -- 172.21.15.111:0/1537102588 <== mon.0 v2:172.21.15.111:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f3a80039360 con 0x7f3a880b0670 2024-04-25T02:30:24.689 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:24.685+0000 7f3a8c8e9700 1 -- 172.21.15.111:0/1537102588 --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f3a88065190 con 0x7f3a880b0670 2024-04-25T02:30:25.355 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.351+0000 7f3a767fc700 1 -- 172.21.15.111:0/1537102588 <== mon.0 v2:172.21.15.111:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v45) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3a8003cb50 con 0x7f3a880b0670 2024-04-25T02:30:25.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.354+0000 7f3a8c8e9700 1 -- 172.21.15.111:0/1537102588 >> v1:172.21.15.111:6816/46482 conn(0x7f3a68045f20 legacy=0x7f3a680483d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:25.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.354+0000 7f3a8c8e9700 1 -- 172.21.15.111:0/1537102588 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3a880b0670 msgr2=0x7f3a8813aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:25.358 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.354+0000 7f3a8c8e9700 1 --2- 172.21.15.111:0/1537102588 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3a880b0670 0x7f3a8813aa50 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f3a8000cc90 tx=0x7f3a80001a60 comp rx=0 tx=0).stop 2024-04-25T02:30:25.361 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.358+0000 7f3a8c8e9700 1 -- 172.21.15.111:0/1537102588 shutdown_connections 2024-04-25T02:30:25.362 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.358+0000 7f3a8c8e9700 1 --2- 172.21.15.111:0/1537102588 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f3a880b0670 0x7f3a8813aa50 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:25.362 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.358+0000 7f3a8c8e9700 1 --2- 172.21.15.111:0/1537102588 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f3a880682a0 0x7f3a880abce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:25.362 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.358+0000 7f3a8c8e9700 1 --2- 172.21.15.111:0/1537102588 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f3a880a3f60 0x7f3a8813a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:25.362 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.358+0000 7f3a8c8e9700 1 -- 172.21.15.111:0/1537102588 >> 172.21.15.111:0/1537102588 conn(0x7f3a8806bee0 msgr2=0x7f3a880b34f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:30:25.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.361+0000 7f3a8c8e9700 1 -- 172.21.15.111:0/1537102588 shutdown_connections 2024-04-25T02:30:25.365 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.361+0000 7f3a8c8e9700 1 -- 172.21.15.111:0/1537102588 wait complete. 2024-04-25T02:30:25.375 INFO:teuthology.orchestra.run.smithi111.stderr:pool 'cephfs_metadata' removed 2024-04-25T02:30:25.386 DEBUG:teuthology.orchestra.run.smithi111:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-25T02:30:25.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.504+0000 7f2852cb4700 1 Processor -- start 2024-04-25T02:30:25.508 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.504+0000 7f2852cb4700 1 -- start start 2024-04-25T02:30:25.510 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.505+0000 7f2852cb4700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f284c068050 0x7f284c069b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:25.510 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.505+0000 7f2852cb4700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f284c0a3e00 0x7f284c06eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:25.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.505+0000 7f2852cb4700 1 -- --> v1:172.21.15.111:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f284c06c8e0 con 0x7f284c06f090 2024-04-25T02:30:25.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.505+0000 7f2852cb4700 1 -- --> v2:172.21.15.111:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f284c0a39e0 con 0x7f284c068050 2024-04-25T02:30:25.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.505+0000 7f2852cb4700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f284c06a080 con 0x7f284c0a3e00 2024-04-25T02:30:25.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.505+0000 7f2850a50700 1 --2- >> v2:172.21.15.111:3300/0 conn(0x7f284c068050 0x7f284c069b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:25.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.505+0000 7f284bfff700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f284c0a3e00 0x7f284c06eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:25.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.505+0000 7f2851251700 1 --1- >> v1:172.21.15.111:6789/0 conn(0x7f284c06f090 0x7f284c1486c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.111:6789/0 says I am v1:172.21.15.111:59368/0 (socket says 172.21.15.111:59368) 2024-04-25T02:30:25.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.505+0000 7f2851251700 1 -- 172.21.15.111:0/2409850833 learned_addr learned my addr 172.21.15.111:0/2409850833 (peer_addr_for_me v1:172.21.15.111:0/0) 2024-04-25T02:30:25.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.505+0000 7f284bfff700 1 -- 172.21.15.111:0/2409850833 >> v2:172.21.15.111:3300/0 conn(0x7f284c068050 msgr2=0x7f284c069b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-25T02:30:25.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.505+0000 7f284bfff700 1 --2- 172.21.15.111:0/2409850833 >> v2:172.21.15.111:3300/0 conn(0x7f284c068050 0x7f284c069b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:25.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.505+0000 7f284bfff700 1 -- 172.21.15.111:0/2409850833 >> v1:172.21.15.111:6789/0 conn(0x7f284c06f090 legacy=0x7f284c1486c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:25.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.505+0000 7f284bfff700 1 -- 172.21.15.111:0/2409850833 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f284c06a2e0 con 0x7f284c0a3e00 2024-04-25T02:30:25.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.505+0000 7f284b7fe700 1 -- 172.21.15.111:0/2409850833 <== mon.0 v1:172.21.15.111:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2427612791 0 0) 0x7f284c06c8e0 con 0x7f284c06f090 2024-04-25T02:30:25.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.505+0000 7f2850a50700 1 --2- 172.21.15.111:0/2409850833 >> v2:172.21.15.111:3300/0 conn(0x7f284c068050 0x7f284c069b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:30:25.511 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.505+0000 7f284bfff700 1 --2- 172.21.15.111:0/2409850833 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f284c0a3e00 0x7f284c06eb50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f28380098e0 tx=0x7f28380091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4a64c14890094b5d server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:30:25.512 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.505+0000 7f284b7fe700 1 -- 172.21.15.111:0/2409850833 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283800b640 con 0x7f284c0a3e00 2024-04-25T02:30:25.512 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.505+0000 7f284b7fe700 1 -- 172.21.15.111:0/2409850833 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f283800b7a0 con 0x7f284c0a3e00 2024-04-25T02:30:25.512 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.505+0000 7f284b7fe700 1 -- 172.21.15.111:0/2409850833 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f283800bb60 con 0x7f284c0a3e00 2024-04-25T02:30:25.512 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.506+0000 7f2852cb4700 1 -- 172.21.15.111:0/2409850833 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f284c0a3e00 msgr2=0x7f284c06eb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:25.512 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.506+0000 7f2852cb4700 1 --2- 172.21.15.111:0/2409850833 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f284c0a3e00 0x7f284c06eb50 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f28380098e0 tx=0x7f28380091a0 comp rx=0 tx=0).stop 2024-04-25T02:30:25.512 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.506+0000 7f2852cb4700 1 -- 172.21.15.111:0/2409850833 shutdown_connections 2024-04-25T02:30:25.512 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.506+0000 7f2852cb4700 1 --2- 172.21.15.111:0/2409850833 >> v2:172.21.15.111:3300/0 conn(0x7f284c068050 0x7f284c069b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:25.512 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.506+0000 7f2852cb4700 1 --2- 172.21.15.111:0/2409850833 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f284c0a3e00 0x7f284c06eb50 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:25.512 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.506+0000 7f2852cb4700 1 -- 172.21.15.111:0/2409850833 >> 172.21.15.111:0/2409850833 conn(0x7f284c06c080 msgr2=0x7f284c067940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:30:25.512 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.506+0000 7f2852cb4700 1 -- 172.21.15.111:0/2409850833 shutdown_connections 2024-04-25T02:30:25.512 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.506+0000 7f2852cb4700 1 -- 172.21.15.111:0/2409850833 wait complete. 2024-04-25T02:30:25.512 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.507+0000 7f2852cb4700 1 Processor -- start 2024-04-25T02:30:25.512 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.507+0000 7f2852cb4700 1 -- start start 2024-04-25T02:30:25.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.508+0000 7f2852cb4700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f284c068050 0x7f284c0986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:25.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.508+0000 7f2852cb4700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f284c06f090 0x7f284c151a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:25.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.508+0000 7f2852cb4700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f284c0a3e00 0x7f284c151f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-25T02:30:25.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.508+0000 7f2852cb4700 1 -- --> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f284c098bf0 con 0x7f284c0a3e00 2024-04-25T02:30:25.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.508+0000 7f2852cb4700 1 -- --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f284c0abd90 con 0x7f284c068050 2024-04-25T02:30:25.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.508+0000 7f2852cb4700 1 -- --> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] -- mon_getmap magic: 0 v1 -- 0x7f284c0ac030 con 0x7f284c06f090 2024-04-25T02:30:25.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.508+0000 7f2851251700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f284c0a3e00 0x7f284c151f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:25.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.508+0000 7f2850a50700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f284c068050 0x7f284c0986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:25.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.508+0000 7f284bfff700 1 --2- >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f284c06f090 0x7f284c151a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-25T02:30:25.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.508+0000 7f2851251700 1 --2- >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f284c0a3e00 0x7f284c151f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3300/0 says I am v2:172.21.15.111:60848/0 (socket says 172.21.15.111:60848) 2024-04-25T02:30:25.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.508+0000 7f2850a50700 1 --2- >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f284c068050 0x7f284c0986b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.111:3301/0 says I am v2:172.21.15.111:54818/0 (socket says 172.21.15.111:54818) 2024-04-25T02:30:25.515 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.508+0000 7f2851251700 1 -- 172.21.15.111:0/1764580778 learned_addr learned my addr 172.21.15.111:0/1764580778 (peer_addr_for_me v2:172.21.15.111:0/0) 2024-04-25T02:30:25.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.508+0000 7f2850a50700 1 -- 172.21.15.111:0/1764580778 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f284c06f090 msgr2=0x7f284c151a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:25.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.508+0000 7f2850a50700 1 --2- 172.21.15.111:0/1764580778 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f284c06f090 0x7f284c151a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:25.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.508+0000 7f2850a50700 1 -- 172.21.15.111:0/1764580778 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f284c0a3e00 msgr2=0x7f284c151f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:25.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.508+0000 7f2850a50700 1 --2- 172.21.15.111:0/1764580778 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f284c0a3e00 0x7f284c151f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:25.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.508+0000 7f2850a50700 1 -- 172.21.15.111:0/1764580778 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2840009420 con 0x7f284c068050 2024-04-25T02:30:25.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.508+0000 7f2851251700 1 --2- 172.21.15.111:0/1764580778 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f284c0a3e00 0x7f284c151f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:30:25.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.508+0000 7f284bfff700 1 --2- 172.21.15.111:0/1764580778 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f284c06f090 0x7f284c151a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-25T02:30:25.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.508+0000 7f2850a50700 1 --2- 172.21.15.111:0/1764580778 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f284c068050 0x7f284c0986b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f284000ea30 tx=0x7f28400091a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-25T02:30:25.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.508+0000 7f2848ff9700 1 -- 172.21.15.111:0/1764580778 <== mon.1 v2:172.21.15.111:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284000ee70 con 0x7f284c068050 2024-04-25T02:30:25.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.508+0000 7f2848ff9700 1 -- 172.21.15.111:0/1764580778 <== mon.1 v2:172.21.15.111:3301/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f284000c850 con 0x7f284c068050 2024-04-25T02:30:25.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.508+0000 7f2852cb4700 1 -- 172.21.15.111:0/1764580778 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2838009420 con 0x7f284c068050 2024-04-25T02:30:25.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.508+0000 7f2848ff9700 1 -- 172.21.15.111:0/1764580778 <== mon.1 v2:172.21.15.111:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f284000cc10 con 0x7f284c068050 2024-04-25T02:30:25.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.508+0000 7f2852cb4700 1 -- 172.21.15.111:0/1764580778 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f284c13f870 con 0x7f284c068050 2024-04-25T02:30:25.516 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.509+0000 7f2852cb4700 1 -- 172.21.15.111:0/1764580778 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f284c097d20 con 0x7f284c068050 2024-04-25T02:30:25.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.509+0000 7f2848ff9700 1 -- 172.21.15.111:0/1764580778 <== mon.1 v2:172.21.15.111:3301/0 4 ==== mgrmap(e 11) v1 ==== 53498+0+0 (secure 0 0 0) 0x7f2840013470 con 0x7f284c068050 2024-04-25T02:30:25.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.510+0000 7f2848ff9700 1 -- 172.21.15.111:0/1764580778 <== mon.1 v2:172.21.15.111:3301/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 3763+0+0 (secure 0 0 0) 0x7f284005b1f0 con 0x7f284c068050 2024-04-25T02:30:25.517 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.513+0000 7f2848ff9700 1 -- 172.21.15.111:0/1764580778 <== mon.1 v2:172.21.15.111:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+139852 (secure 0 0 0) 0x7f28400395a0 con 0x7f284c068050 2024-04-25T02:30:25.674 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:25.671+0000 7f2852cb4700 1 -- 172.21.15.111:0/1764580778 --> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f284c0983f0 con 0x7f284c068050 2024-04-25T02:30:26.366 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:26.362+0000 7f2848ff9700 1 -- 172.21.15.111:0/1764580778 <== mon.1 v2:172.21.15.111:3301/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v46) v1 ==== 169+0+0 (secure 0 0 0) 0x7f284c0983f0 con 0x7f284c068050 2024-04-25T02:30:26.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:26.365+0000 7f2852cb4700 1 -- 172.21.15.111:0/1764580778 >> v1:172.21.15.111:6816/46482 conn(0x7f2830045ef0 legacy=0x7f28300483a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:26.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:26.365+0000 7f2852cb4700 1 -- 172.21.15.111:0/1764580778 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f284c068050 msgr2=0x7f284c0986b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-25T02:30:26.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:26.365+0000 7f2852cb4700 1 --2- 172.21.15.111:0/1764580778 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f284c068050 0x7f284c0986b0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f284000ea30 tx=0x7f28400091a0 comp rx=0 tx=0).stop 2024-04-25T02:30:26.369 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:26.366+0000 7f2852cb4700 1 -- 172.21.15.111:0/1764580778 shutdown_connections 2024-04-25T02:30:26.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:26.366+0000 7f2852cb4700 1 --2- 172.21.15.111:0/1764580778 >> [v2:172.21.15.111:3300/0,v1:172.21.15.111:6789/0] conn(0x7f284c0a3e00 0x7f284c151f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:26.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:26.366+0000 7f2852cb4700 1 --2- 172.21.15.111:0/1764580778 >> [v2:172.21.15.111:3301/0,v1:172.21.15.111:6790/0] conn(0x7f284c068050 0x7f284c0986b0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:26.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:26.366+0000 7f2852cb4700 1 --2- 172.21.15.111:0/1764580778 >> [v2:172.21.15.111:3302/0,v1:172.21.15.111:6791/0] conn(0x7f284c06f090 0x7f284c151a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-25T02:30:26.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:26.366+0000 7f2852cb4700 1 -- 172.21.15.111:0/1764580778 >> 172.21.15.111:0/1764580778 conn(0x7f284c06c080 msgr2=0x7f284c145360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-25T02:30:26.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:26.366+0000 7f2852cb4700 1 -- 172.21.15.111:0/1764580778 shutdown_connections 2024-04-25T02:30:26.370 INFO:teuthology.orchestra.run.smithi111.stderr:2024-04-25T02:30:26.366+0000 7f2852cb4700 1 -- 172.21.15.111:0/1764580778 wait complete. 2024-04-25T02:30:26.376 INFO:teuthology.orchestra.run.smithi111.stderr:pool 'cephfs_data' removed 2024-04-25T02:30:26.403 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-25T02:30:26.404 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-25T02:30:26.404 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:30:26.417 INFO:tasks.ceph.mds.a:Stopped 2024-04-25T02:30:26.417 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-25T02:30:26.417 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:30:26.466 INFO:tasks.ceph.mds.b:Stopped 2024-04-25T02:30:26.466 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-25T02:30:26.466 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:30:26.515 INFO:tasks.ceph.mds.c:Stopped 2024-04-25T02:30:26.515 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-25T02:30:26.515 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-25T02:30:26.515 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:30:26.588 INFO:tasks.ceph.osd.0:Stopped 2024-04-25T02:30:26.588 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-25T02:30:26.588 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:30:26.659 INFO:tasks.ceph.osd.1:Stopped 2024-04-25T02:30:26.659 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-25T02:30:26.659 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:30:26.734 INFO:tasks.ceph.osd.2:Stopped 2024-04-25T02:30:26.734 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-25T02:30:26.735 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:30:26.804 INFO:tasks.ceph.osd.3:Stopped 2024-04-25T02:30:26.804 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-25T02:30:26.805 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-25T02:30:26.805 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:30:26.863 INFO:tasks.ceph.mgr.x:Stopped 2024-04-25T02:30:26.864 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-25T02:30:26.864 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:30:26.925 INFO:tasks.ceph.mgr.y:Stopped 2024-04-25T02:30:26.925 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-25T02:30:26.925 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-25T02:30:26.925 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:30:26.976 INFO:tasks.ceph.mon.a:Stopped 2024-04-25T02:30:26.976 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-25T02:30:26.976 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:30:27.026 INFO:tasks.ceph.mon.b:Stopped 2024-04-25T02:30:27.027 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-25T02:30:27.027 INFO:teuthology.orchestra.run:waiting for 300 2024-04-25T02:30:27.076 INFO:tasks.ceph.mon.c:Stopped 2024-04-25T02:30:27.076 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-25T02:30:27.077 DEBUG:teuthology.orchestra.run.smithi111:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'overall HEALTH_' | egrep -v '\(FS_' | egrep -v '\(MDS_' | egrep -v '\(OSD_' | egrep -v '\(MON_DOWN\)' | egrep -v '\(CACHE_POOL_' | egrep -v '\(POOL_' | egrep -v '\(MGR_DOWN\)' | egrep -v '\(PG_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v 'Monitor daemon marked osd' | egrep -v 'Behind on trimming' | egrep -v 'Manager daemon' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v 'scrub mismatch' | egrep -v ScrubResult | egrep -v 'wrongly marked' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v '\(SLOW_OPS\)' | egrep -v 'overall HEALTH_' | egrep -v '\(MON_MSGR2_NOT_ENABLED\)' | egrep -v 'slow request' | egrep -v 'missing required features' | head -n 1 2024-04-25T02:30:27.155 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi111.front.sepia.ceph.com 2024-04-25T02:30:27.155 DEBUG:teuthology.orchestra.run.smithi111:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-25T02:30:27.557 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi111.front.sepia.ceph.com 2024-04-25T02:30:27.557 DEBUG:teuthology.orchestra.run.smithi111:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-25T02:30:27.646 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi111.front.sepia.ceph.com 2024-04-25T02:30:27.646 DEBUG:teuthology.orchestra.run.smithi111:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-25T02:30:27.710 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi111.front.sepia.ceph.com 2024-04-25T02:30:27.711 DEBUG:teuthology.orchestra.run.smithi111:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-25T02:30:27.782 INFO:tasks.ceph:Archiving mon data... 2024-04-25T02:30:27.784 DEBUG:teuthology.misc:Transferring archived files from smithi111:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672379/data/mon.a.tgz 2024-04-25T02:30:27.784 DEBUG:teuthology.orchestra.run.smithi111:> mktemp 2024-04-25T02:30:27.802 INFO:teuthology.orchestra.run.smithi111.stdout:/tmp/tmp.Y0XRup6eDB 2024-04-25T02:30:27.802 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.Y0XRup6eDB 2024-04-25T02:30:27.954 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 0666 /tmp/tmp.Y0XRup6eDB 2024-04-25T02:30:28.039 DEBUG:teuthology.orchestra.remote:smithi111:/tmp/tmp.Y0XRup6eDB is 351KB 2024-04-25T02:30:28.134 DEBUG:teuthology.orchestra.run.smithi111:> rm -fr /tmp/tmp.Y0XRup6eDB 2024-04-25T02:30:28.151 DEBUG:teuthology.misc:Transferring archived files from smithi111:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672379/data/mon.b.tgz 2024-04-25T02:30:28.151 DEBUG:teuthology.orchestra.run.smithi111:> mktemp 2024-04-25T02:30:28.208 INFO:teuthology.orchestra.run.smithi111.stdout:/tmp/tmp.o4YHqEiv7K 2024-04-25T02:30:28.208 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.o4YHqEiv7K 2024-04-25T02:30:28.347 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 0666 /tmp/tmp.o4YHqEiv7K 2024-04-25T02:30:28.432 DEBUG:teuthology.orchestra.remote:smithi111:/tmp/tmp.o4YHqEiv7K is 354KB 2024-04-25T02:30:28.527 DEBUG:teuthology.orchestra.run.smithi111:> rm -fr /tmp/tmp.o4YHqEiv7K 2024-04-25T02:30:28.544 DEBUG:teuthology.misc:Transferring archived files from smithi111:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672379/data/mon.c.tgz 2024-04-25T02:30:28.544 DEBUG:teuthology.orchestra.run.smithi111:> mktemp 2024-04-25T02:30:28.601 INFO:teuthology.orchestra.run.smithi111.stdout:/tmp/tmp.FxfhII4Nqc 2024-04-25T02:30:28.601 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.FxfhII4Nqc 2024-04-25T02:30:28.739 DEBUG:teuthology.orchestra.run.smithi111:> sudo chmod 0666 /tmp/tmp.FxfhII4Nqc 2024-04-25T02:30:28.825 DEBUG:teuthology.orchestra.remote:smithi111:/tmp/tmp.FxfhII4Nqc is 354KB 2024-04-25T02:30:28.918 DEBUG:teuthology.orchestra.run.smithi111:> rm -fr /tmp/tmp.FxfhII4Nqc 2024-04-25T02:30:28.935 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-25T02:30:28.935 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T02:30:28.978 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T02:30:28.980 DEBUG:teuthology.orchestra.run.smithi186:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-25T02:30:29.058 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T02:30:29.078 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T02:30:29.100 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-25T02:30:29.100 INFO:tasks.ceph:Archiving crash dumps... 2024-04-25T02:30:29.102 DEBUG:teuthology.misc:Transferring archived files from smithi111:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672379/remote/smithi111/crash 2024-04-25T02:30:29.103 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T02:30:29.129 DEBUG:teuthology.misc:Transferring archived files from smithi114:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672379/remote/smithi114/crash 2024-04-25T02:30:29.130 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T02:30:29.160 DEBUG:teuthology.misc:Transferring archived files from smithi186:/var/lib/ceph/crash to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672379/remote/smithi186/crash 2024-04-25T02:30:29.161 DEBUG:teuthology.orchestra.run.smithi186:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-25T02:30:29.198 INFO:tasks.ceph:Compressing logs... 2024-04-25T02:30:29.198 DEBUG:teuthology.orchestra.run.smithi111:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T02:30:29.201 DEBUG:teuthology.orchestra.run.smithi114:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T02:30:29.205 DEBUG:teuthology.orchestra.run.smithi186:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-25T02:30:29.224 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53545.log 2024-04-25T02:30:29.232 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39056.log 2024-04-25T02:30:29.233 INFO:teuthology.orchestra.run.smithi114.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37442.log 2024-04-25T02:30:29.239 INFO:teuthology.orchestra.run.smithi114.stderr:/var/log/ceph/ceph-client.0.39056.log: /var/log/ceph/ceph-client.0.37442.log: 90.5% -- replaced with /var/log/ceph/ceph-client.0.37442.log.gz 2024-04-25T02:30:29.256 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54751.log 2024-04-25T02:30:29.257 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56983.log 2024-04-25T02:30:29.257 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.53545.log: /var/log/ceph/ceph-client.admin.54751.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52140.log 2024-04-25T02:30:29.257 INFO:teuthology.orchestra.run.smithi111.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53545.log.gz 2024-04-25T02:30:29.257 INFO:teuthology.orchestra.run.smithi111.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54751.log.gz 2024-04-25T02:30:29.257 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.56983.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52486.log 2024-04-25T02:30:29.257 INFO:teuthology.orchestra.run.smithi111.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.56983.log.gz 2024-04-25T02:30:29.257 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42809.log 2024-04-25T02:30:29.257 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.52140.log: /var/log/ceph/ceph-client.admin.52486.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54116.log 2024-04-25T02:30:29.257 INFO:teuthology.orchestra.run.smithi111.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52140.log.gz 2024-04-25T02:30:29.257 INFO:teuthology.orchestra.run.smithi111.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.52486.log.gz 2024-04-25T02:30:29.257 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.42809.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45073.log 2024-04-25T02:30:29.257 INFO:teuthology.orchestra.run.smithi111.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42809.log.gz 2024-04-25T02:30:29.257 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48187.log 2024-04-25T02:30:29.258 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.54116.log: /var/log/ceph/ceph-client.admin.45073.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46516.log 2024-04-25T02:30:29.258 INFO:teuthology.orchestra.run.smithi111.stderr: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.54116.log.gz 2024-04-25T02:30:29.258 INFO:teuthology.orchestra.run.smithi111.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45073.log.gz 2024-04-25T02:30:29.258 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.48187.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56875.log 2024-04-25T02:30:29.258 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.46516.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48187.log.gz 2024-04-25T02:30:29.258 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47840.log 2024-04-25T02:30:29.258 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.56875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43854.log 2024-04-25T02:30:29.258 INFO:teuthology.orchestra.run.smithi111.stderr: 92.4% -- replaced with /var/log/ceph/ceph-client.admin.46516.log.gz 2024-04-25T02:30:29.258 INFO:teuthology.orchestra.run.smithi111.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.56875.log.gz 2024-04-25T02:30:29.258 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.47840.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54557.log 2024-04-25T02:30:29.258 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.43854.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40212.log 2024-04-25T02:30:29.258 INFO:teuthology.orchestra.run.smithi111.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.47840.log.gz 2024-04-25T02:30:29.258 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54557.log: /var/log/ceph/ceph-client.admin.55982.log 2024-04-25T02:30:29.258 INFO:teuthology.orchestra.run.smithi111.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.43854.log.gz 2024-04-25T02:30:29.258 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.40212.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46607.log 2024-04-25T02:30:29.259 INFO:teuthology.orchestra.run.smithi111.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.54557.log.gz 2024-04-25T02:30:29.259 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.55982.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.40212.log.gz 2024-04-25T02:30:29.259 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43905.log 2024-04-25T02:30:29.259 INFO:teuthology.orchestra.run.smithi111.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55982.log.gz 2024-04-25T02:30:29.259 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52854.log 2024-04-25T02:30:29.259 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.46607.log: /var/log/ceph/ceph-client.admin.43905.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42324.log 2024-04-25T02:30:29.259 INFO:teuthology.orchestra.run.smithi111.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.46607.log.gz 2024-04-25T02:30:29.259 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.52854.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43905.log.gz 2024-04-25T02:30:29.259 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54410.log 2024-04-25T02:30:29.259 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.42324.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.52854.log.gz 2024-04-25T02:30:29.259 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53643.log 2024-04-25T02:30:29.259 INFO:teuthology.orchestra.run.smithi111.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42324.log.gz 2024-04-25T02:30:29.259 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.54410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48348.log 2024-04-25T02:30:29.259 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.53643.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.54410.log.gz 2024-04-25T02:30:29.260 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52164.log 2024-04-25T02:30:29.260 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.48348.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.53643.log.gz 2024-04-25T02:30:29.260 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57392.log 2024-04-25T02:30:29.260 INFO:teuthology.orchestra.run.smithi111.stderr: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.48348.log.gz 2024-04-25T02:30:29.260 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.52164.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42375.log 2024-04-25T02:30:29.260 INFO:teuthology.orchestra.run.smithi111.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52164.log.gz 2024-04-25T02:30:29.260 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.57392.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40316.log 2024-04-25T02:30:29.260 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.42375.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57392.log.gz 2024-04-25T02:30:29.260 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56276.log 2024-04-25T02:30:29.260 INFO:teuthology.orchestra.run.smithi111.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42375.log.gz 2024-04-25T02:30:29.260 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.40316.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48544.log 2024-04-25T02:30:29.260 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.56276.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.40316.log.gz 2024-04-25T02:30:29.260 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46789.log 2024-04-25T02:30:29.260 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.48544.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56276.log.gz 2024-04-25T02:30:29.260 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52214.log 2024-04-25T02:30:29.261 INFO:teuthology.orchestra.run.smithi111.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48544.log.gz 2024-04-25T02:30:29.261 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56826.log 2024-04-25T02:30:29.261 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.46789.log: /var/log/ceph/ceph-client.admin.52214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43803.log 2024-04-25T02:30:29.261 INFO:teuthology.orchestra.run.smithi111.stderr: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46789.log.gz 2024-04-25T02:30:29.261 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.56826.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56472.log 2024-04-25T02:30:29.261 INFO:teuthology.orchestra.run.smithi111.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52214.log.gz 2024-04-25T02:30:29.261 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.43803.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56826.log.gz 2024-04-25T02:30:29.261 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-25T02:30:29.261 INFO:teuthology.orchestra.run.smithi111.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.43803.log.gz 2024-04-25T02:30:29.261 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.56472.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48104.log 2024-04-25T02:30:29.261 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-osd.2.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56472.log.gz 2024-04-25T02:30:29.261 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52632.log 2024-04-25T02:30:29.261 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.48104.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47235.log 2024-04-25T02:30:29.261 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.52632.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48104.log.gz 2024-04-25T02:30:29.262 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41735.log 2024-04-25T02:30:29.262 INFO:teuthology.orchestra.run.smithi111.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52632.log.gz 2024-04-25T02:30:29.262 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40056.log 2024-04-25T02:30:29.262 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.47235.log: /var/log/ceph/ceph-client.admin.41735.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-25T02:30:29.262 INFO:teuthology.orchestra.run.smithi111.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.47235.log.gz 2024-04-25T02:30:29.262 INFO:teuthology.orchestra.run.smithi111.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.41735.log.gz 2024-04-25T02:30:29.262 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.40056.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55884.log 2024-04-25T02:30:29.262 INFO:teuthology.orchestra.run.smithi111.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.40056.log.gz 2024-04-25T02:30:29.262 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54704.log 2024-04-25T02:30:29.262 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.55884.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41480.log 2024-04-25T02:30:29.262 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.54704.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55884.log.gz 2024-04-25T02:30:29.262 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44410.log 2024-04-25T02:30:29.262 INFO:teuthology.orchestra.run.smithi111.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.54704.log.gz 2024-04-25T02:30:29.262 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41274.log 2024-04-25T02:30:29.262 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.41480.log: /var/log/ceph/ceph-client.admin.44410.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51732.log 2024-04-25T02:30:29.263 INFO:teuthology.orchestra.run.smithi111.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41480.log.gz 2024-04-25T02:30:29.263 INFO:teuthology.orchestra.run.smithi111.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44410.log.gz 2024-04-25T02:30:29.263 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.41274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53888.log 2024-04-25T02:30:29.263 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.51732.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.41274.log.gz 2024-04-25T02:30:29.263 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44767.log 2024-04-25T02:30:29.263 INFO:teuthology.orchestra.run.smithi111.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.51732.log.gz 2024-04-25T02:30:29.263 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.53888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52487.log 2024-04-25T02:30:29.263 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43752.log 2024-04-25T02:30:29.263 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.44767.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53888.log.gz 2024-04-25T02:30:29.263 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.52487.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39950.log 2024-04-25T02:30:29.263 INFO:teuthology.orchestra.run.smithi111.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.44767.log.gz 2024-04-25T02:30:29.263 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.43752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51184.log 2024-04-25T02:30:29.263 INFO:teuthology.orchestra.run.smithi111.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.52487.log.gz 2024-04-25T02:30:29.264 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.39950.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43752.log.gz 2024-04-25T02:30:29.264 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55043.log 2024-04-25T02:30:29.264 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44716.log 2024-04-25T02:30:29.264 INFO:teuthology.orchestra.run.smithi111.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.39950.log.gz 2024-04-25T02:30:29.264 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.51184.log: /var/log/ceph/ceph-client.admin.55043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56178.log 2024-04-25T02:30:29.264 INFO:teuthology.orchestra.run.smithi111.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.51184.log.gz 2024-04-25T02:30:29.264 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.44716.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.55043.log.gz 2024-04-25T02:30:29.264 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45175.log 2024-04-25T02:30:29.264 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.56178.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44716.log.gz 2024-04-25T02:30:29.264 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48691.log 2024-04-25T02:30:29.264 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.45175.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56178.log.gz 2024-04-25T02:30:29.264 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52684.log 2024-04-25T02:30:29.264 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41633.log 2024-04-25T02:30:29.264 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.48691.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.45175.log.gz 2024-04-25T02:30:29.264 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.52684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52629.log 2024-04-25T02:30:29.265 INFO:teuthology.orchestra.run.smithi111.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.48691.log.gz 2024-04-25T02:30:29.265 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.41633.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52684.log.gz 2024-04-25T02:30:29.265 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54798.log 2024-04-25T02:30:29.265 INFO:teuthology.orchestra.run.smithi111.stderr: 89.0%/var/log/ceph/ceph-client.admin.52629.log: -- replaced with /var/log/ceph/ceph-client.admin.41633.log.gz 2024-04-25T02:30:29.265 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53292.log 2024-04-25T02:30:29.265 INFO:teuthology.orchestra.run.smithi111.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52629.log.gz 2024-04-25T02:30:29.265 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.54798.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48446.log 2024-04-25T02:30:29.265 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52190.log 2024-04-25T02:30:29.265 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.53292.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54798.log.gz 2024-04-25T02:30:29.265 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.48446.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53292.log.gz 2024-04-25T02:30:29.265 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43344.log 2024-04-25T02:30:29.265 INFO:teuthology.orchestra.run.smithi111.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.48446.log.gz 2024-04-25T02:30:29.265 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47208.log 2024-04-25T02:30:29.265 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.52190.log: /var/log/ceph/ceph-client.admin.43344.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54165.log 2024-04-25T02:30:29.265 INFO:teuthology.orchestra.run.smithi111.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52190.log.gz 2024-04-25T02:30:29.266 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.47208.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.43344.log.gz 2024-04-25T02:30:29.266 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55688.log 2024-04-25T02:30:29.266 INFO:teuthology.orchestra.run.smithi111.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.47208.log.gz 2024-04-25T02:30:29.266 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.54165.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-25T02:30:29.266 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.55688.log: 89.8% -- replaced with /var/log/ceph/ceph-client.admin.54165.log.gz 2024-04-25T02:30:29.266 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46947.log 2024-04-25T02:30:29.266 INFO:teuthology.orchestra.run.smithi111.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55688.log.gz 2024-04-25T02:30:29.266 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47448.log 2024-04-25T02:30:29.266 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.46947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56227.log 2024-04-25T02:30:29.266 INFO:teuthology.orchestra.run.smithi111.stderr: 88.3%/var/log/ceph/ceph-client.admin.47448.log: -- replaced with /var/log/ceph/ceph-client.admin.46947.log.gz 2024-04-25T02:30:29.266 INFO:teuthology.orchestra.run.smithi111.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47448.log.gz 2024-04-25T02:30:29.266 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.56227.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.56227.log.gz 2024-04-25T02:30:29.266 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41788.log 2024-04-25T02:30:29.266 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54214.log 2024-04-25T02:30:29.267 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.41788.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55933.log 2024-04-25T02:30:29.267 INFO:teuthology.orchestra.run.smithi111.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41788.log.gz 2024-04-25T02:30:29.267 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.54214.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42053.log 2024-04-25T02:30:29.267 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.55933.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.54214.log.gzgzip 2024-04-25T02:30:29.267 INFO:teuthology.orchestra.run.smithi111.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.46661.log 2024-04-25T02:30:29.267 INFO:teuthology.orchestra.run.smithi111.stderr: 95.2% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-25T02:30:29.267 INFO:teuthology.orchestra.run.smithi111.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.55933.log.gz 2024-04-25T02:30:29.267 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.42053.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.42053.log.gz 2024-04-25T02:30:29.267 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.46661.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.46661.log.gz 2024-04-25T02:30:29.267 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57441.log 2024-04-25T02:30:29.267 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44818.log 2024-04-25T02:30:29.267 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.57441.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54035.log 2024-04-25T02:30:29.267 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.44818.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.57441.log.gz 2024-04-25T02:30:29.267 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52998.log 2024-04-25T02:30:29.267 INFO:teuthology.orchestra.run.smithi111.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.44818.log.gz 2024-04-25T02:30:29.268 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45379.log 2024-04-25T02:30:29.268 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.54035.log: /var/log/ceph/ceph-client.admin.52998.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44920.log 2024-04-25T02:30:29.268 INFO:teuthology.orchestra.run.smithi111.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52998.log.gz 2024-04-25T02:30:29.268 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.45379.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.54035.log.gz 2024-04-25T02:30:29.268 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.44920.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.45379.log.gz 2024-04-25T02:30:29.268 INFO:teuthology.orchestra.run.smithi111.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44920.log.gz 2024-04-25T02:30:29.268 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56521.log 2024-04-25T02:30:29.268 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52007.log 2024-04-25T02:30:29.268 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.56521.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43017.log 2024-04-25T02:30:29.268 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.52007.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45226.log 2024-04-25T02:30:29.268 INFO:teuthology.orchestra.run.smithi111.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56521.log.gz 2024-04-25T02:30:29.268 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.43017.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52007.log.gz 2024-04-25T02:30:29.268 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.37065.log 2024-04-25T02:30:29.268 INFO:teuthology.orchestra.run.smithi111.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43017.log.gz 2024-04-25T02:30:29.268 INFO:teuthology.orchestra.run.smithi111.stderr:gzip /var/log/ceph/ceph-client.admin.45226.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.39900.log 2024-04-25T02:30:29.269 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph.tmp-client.admin.37065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57128.log 2024-04-25T02:30:29.269 INFO:teuthology.orchestra.run.smithi111.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.45226.log.gz 2024-04-25T02:30:29.269 INFO:teuthology.orchestra.run.smithi111.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.37065.log.gz 2024-04-25T02:30:29.269 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.39900.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53398.log 2024-04-25T02:30:29.269 INFO:teuthology.orchestra.run.smithi111.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39900.log.gz 2024-04-25T02:30:29.269 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.57128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43497.log 2024-04-25T02:30:29.269 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47889.log 2024-04-25T02:30:29.269 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.53398.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.57128.log.gz 2024-04-25T02:30:29.269 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.43497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44971.log 2024-04-25T02:30:29.269 INFO:teuthology.orchestra.run.smithi111.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.53398.log.gz 2024-04-25T02:30:29.269 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose /var/log/ceph/ceph-client.admin.47889.log: -- /var/log/ceph/ceph-client.admin.47133.log 2024-04-25T02:30:29.269 INFO:teuthology.orchestra.run.smithi111.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43497.log.gz 2024-04-25T02:30:29.269 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.44971.log: 87.2%gzip -5 -- replaced with /var/log/ceph/ceph-client.admin.47889.log.gz--verbose 2024-04-25T02:30:29.269 INFO:teuthology.orchestra.run.smithi111.stderr:-- /var/log/ceph/ceph-client.admin.40920.log 2024-04-25T02:30:29.269 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-25T02:30:29.270 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.47133.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.44971.log.gz 2024-04-25T02:30:29.270 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.40920.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.47133.log.gz 2024-04-25T02:30:29.270 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56423.log 2024-04-25T02:30:29.270 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54459.log 2024-04-25T02:30:29.270 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-osd.3.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.40920.log.gz 2024-04-25T02:30:29.270 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.56423.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47570.log 2024-04-25T02:30:29.270 INFO:teuthology.orchestra.run.smithi111.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56423.log.gz 2024-04-25T02:30:29.270 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.54459.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52263.log 2024-04-25T02:30:29.270 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.47570.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42962.log 2024-04-25T02:30:29.270 INFO:teuthology.orchestra.run.smithi111.stderr: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.54459.log.gz 2024-04-25T02:30:29.270 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.52263.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.47570.log.gz 2024-04-25T02:30:29.270 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45328.log 2024-04-25T02:30:29.270 INFO:teuthology.orchestra.run.smithi111.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.52263.log.gz 2024-04-25T02:30:29.270 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.42962.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43140.log 2024-04-25T02:30:29.270 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.45328.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.42962.log.gz 2024-04-25T02:30:29.271 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.43140.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.45328.log.gz 2024-04-25T02:30:29.271 INFO:teuthology.orchestra.run.smithi111.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.43140.log.gz 2024-04-25T02:30:29.271 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41427.log 2024-04-25T02:30:29.271 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-25T02:30:29.271 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.41427.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41951.log 2024-04-25T02:30:29.271 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-osd.0.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41427.log.gz 2024-04-25T02:30:29.271 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.41951.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.41951.log.gz 2024-04-25T02:30:29.271 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53077.log 2024-04-25T02:30:29.280 INFO:teuthology.orchestra.run.smithi186.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.1.37471.log 2024-04-25T02:30:29.280 INFO:teuthology.orchestra.run.smithi186.stderr:/var/log/ceph/ceph-client.1.37471.log: 92.8% -- replaced with /var/log/ceph/ceph-client.1.37471.log.gz 2024-04-25T02:30:29.280 INFO:teuthology.orchestra.run.smithi186.stderr: 2024-04-25T02:30:29.280 INFO:teuthology.orchestra.run.smithi186.stderr:real 0m0.015s 2024-04-25T02:30:29.280 INFO:teuthology.orchestra.run.smithi186.stderr:user 0m0.013s 2024-04-25T02:30:29.280 INFO:teuthology.orchestra.run.smithi186.stderr:sys 0m0.010s 2024-04-25T02:30:29.286 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42604.log 2024-04-25T02:30:29.286 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.53077.log: /var/log/ceph/ceph-client.admin.42604.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.53077.log.gz 2024-04-25T02:30:29.286 INFO:teuthology.orchestra.run.smithi111.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.42604.log.gz 2024-04-25T02:30:29.286 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53243.log 2024-04-25T02:30:29.286 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55590.log 2024-04-25T02:30:29.286 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.53243.log: /var/log/ceph/ceph-client.admin.55590.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.53243.log.gz 2024-04-25T02:30:29.286 INFO:teuthology.orchestra.run.smithi111.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55590.log.gz 2024-04-25T02:30:29.287 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53594.log 2024-04-25T02:30:29.287 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47768.log 2024-04-25T02:30:29.287 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.53594.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46793.log 2024-04-25T02:30:29.287 INFO:teuthology.orchestra.run.smithi111.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53594.log.gz 2024-04-25T02:30:29.287 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.47768.log: /var/log/ceph/ceph-client.admin.46793.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.47768.log.gz 2024-04-25T02:30:29.287 INFO:teuthology.orchestra.run.smithi111.stderr: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.46793.log.gz 2024-04-25T02:30:29.287 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52116.log 2024-04-25T02:30:29.287 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52361.log 2024-04-25T02:30:29.287 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.52116.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56570.log 2024-04-25T02:30:29.287 INFO:teuthology.orchestra.run.smithi111.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.52116.log.gz 2024-04-25T02:30:29.287 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.52361.log: /var/log/ceph/ceph-client.admin.56570.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.52361.log.gz 2024-04-25T02:30:29.287 INFO:teuthology.orchestra.run.smithi111.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.56570.log.gz 2024-04-25T02:30:29.287 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46965.log 2024-04-25T02:30:29.287 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42603.log 2024-04-25T02:30:29.287 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.46965.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.46965.log.gz 2024-04-25T02:30:29.288 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.42603.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.42603.log.gz 2024-04-25T02:30:29.288 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41900.log 2024-04-25T02:30:29.288 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57275.log 2024-04-25T02:30:29.288 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.41900.log: /var/log/ceph/ceph-client.admin.57275.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.41900.log.gz 2024-04-25T02:30:29.288 INFO:teuthology.orchestra.run.smithi111.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.57275.log.gz 2024-04-25T02:30:29.288 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44665.log 2024-04-25T02:30:29.288 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52484.log 2024-04-25T02:30:29.288 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.44665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52882.log 2024-04-25T02:30:29.288 INFO:teuthology.orchestra.run.smithi111.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.44665.log.gz 2024-04-25T02:30:29.288 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.52484.log: /var/log/ceph/ceph-client.admin.52882.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.52484.log.gz 2024-04-25T02:30:29.288 INFO:teuthology.orchestra.run.smithi111.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.52882.log.gz 2024-04-25T02:30:29.288 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45124.log 2024-04-25T02:30:29.288 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56080.log 2024-04-25T02:30:29.288 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.45124.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42606.log 2024-04-25T02:30:29.288 INFO:teuthology.orchestra.run.smithi111.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.45124.log.gz 2024-04-25T02:30:29.289 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.56080.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41376.log 2024-04-25T02:30:29.289 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.42606.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.56080.log.gz 2024-04-25T02:30:29.289 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.41376.log: 87.1% -- replaced with /var/log/ceph/ceph-client.admin.42606.log.gz 2024-04-25T02:30:29.289 INFO:teuthology.orchestra.run.smithi111.stderr: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41376.log.gz 2024-04-25T02:30:29.289 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55492.log 2024-04-25T02:30:29.289 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46993.log 2024-04-25T02:30:29.289 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.55492.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55247.log 2024-04-25T02:30:29.289 INFO:teuthology.orchestra.run.smithi111.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.55492.log.gz 2024-04-25T02:30:29.289 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.46993.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.46993.log.gz 2024-04-25T02:30:29.289 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.55247.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.55247.log.gz 2024-04-25T02:30:29.289 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55541.log 2024-04-25T02:30:29.289 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44563.log 2024-04-25T02:30:29.289 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.55541.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55541.log.gz 2024-04-25T02:30:29.289 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.44563.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44563.log.gz 2024-04-25T02:30:29.289 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56932.log 2024-04-25T02:30:29.289 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54606.log 2024-04-25T02:30:29.290 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.56932.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41684.log 2024-04-25T02:30:29.290 INFO:teuthology.orchestra.run.smithi111.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.56932.log.gz 2024-04-25T02:30:29.290 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.54606.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.54606.log.gz 2024-04-25T02:30:29.290 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.41684.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.41684.log.gz 2024-04-25T02:30:29.290 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46964.log 2024-04-25T02:30:29.290 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55737.log 2024-04-25T02:30:29.290 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.46964.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.46964.log.gz 2024-04-25T02:30:29.290 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.55737.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.55737.log.gz 2024-04-25T02:30:29.290 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-25T02:30:29.290 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48740.log 2024-04-25T02:30:29.290 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-client.admin.48740.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.48740.log.gz 2024-04-25T02:30:29.290 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56717.log 2024-04-25T02:30:29.290 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45430.log 2024-04-25T02:30:29.290 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.56717.log: /var/log/ceph/ceph-client.admin.45430.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.56717.log.gz 2024-04-25T02:30:29.290 INFO:teuthology.orchestra.run.smithi111.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.45430.log.gz 2024-04-25T02:30:29.291 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52312.log 2024-04-25T02:30:29.291 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54508.log 2024-04-25T02:30:29.291 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.52312.log: /var/log/ceph/ceph-client.admin.54508.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.52312.log.gz 2024-04-25T02:30:29.291 INFO:teuthology.orchestra.run.smithi111.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.54508.log.gz 2024-04-25T02:30:29.291 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43446.log 2024-04-25T02:30:29.291 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48902.log 2024-04-25T02:30:29.291 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.43446.log: /var/log/ceph/ceph-client.admin.48902.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43446.log.gz 2024-04-25T02:30:29.291 INFO:teuthology.orchestra.run.smithi111.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.48902.log.gz 2024-04-25T02:30:29.291 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54945.log 2024-04-25T02:30:29.291 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56668.log 2024-04-25T02:30:29.291 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.54945.log: /var/log/ceph/ceph-client.admin.56668.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.54945.log.gz 2024-04-25T02:30:29.291 INFO:teuthology.orchestra.run.smithi111.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.56668.log.gz 2024-04-25T02:30:29.291 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51960.log 2024-04-25T02:30:29.291 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55786.log 2024-04-25T02:30:29.291 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.51960.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.51960.log.gz 2024-04-25T02:30:29.292 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.55786.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.55786.log.gz 2024-04-25T02:30:29.292 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55639.log 2024-04-25T02:30:29.292 INFO:teuthology.orchestra.run.smithi111.stderr: 93.6% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-25T02:30:29.292 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53741.log 2024-04-25T02:30:29.292 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.55639.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54361.log 2024-04-25T02:30:29.292 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.53741.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55639.log.gz 2024-04-25T02:30:29.292 INFO:teuthology.orchestra.run.smithi111.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53741.log.gz 2024-04-25T02:30:29.292 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.54361.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54361.log.gz 2024-04-25T02:30:29.292 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43293.log 2024-04-25T02:30:29.292 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56774.log 2024-04-25T02:30:29.292 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.43293.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47987.log 2024-04-25T02:30:29.292 INFO:teuthology.orchestra.run.smithi111.stderr: 89.3%/var/log/ceph/ceph-client.admin.56774.log: -- replaced with /var/log/ceph/ceph-client.admin.43293.log.gz 2024-04-25T02:30:29.292 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.47987.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.56774.log.gz 2024-04-25T02:30:29.292 INFO:teuthology.orchestra.run.smithi111.stderr: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.47987.log.gz 2024-04-25T02:30:29.292 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47186.log 2024-04-25T02:30:29.293 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45022.log 2024-04-25T02:30:29.293 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.47186.log: /var/log/ceph/ceph-client.admin.45022.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.47186.log.gz 2024-04-25T02:30:29.293 INFO:teuthology.orchestra.run.smithi111.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45022.log.gz 2024-04-25T02:30:29.293 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57342.log 2024-04-25T02:30:29.293 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42808.log 2024-04-25T02:30:29.293 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.57342.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44359.log 2024-04-25T02:30:29.293 INFO:teuthology.orchestra.run.smithi111.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.57342.log.gz 2024-04-25T02:30:29.293 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.42808.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57032.log 2024-04-25T02:30:29.293 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.44359.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42808.log.gz 2024-04-25T02:30:29.297 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44206.log 2024-04-25T02:30:29.297 INFO:teuthology.orchestra.run.smithi111.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.44359.log.gz 2024-04-25T02:30:29.297 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.57032.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53790.log 2024-04-25T02:30:29.297 INFO:teuthology.orchestra.run.smithi111.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.57032.log.gz 2024-04-25T02:30:29.297 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.44206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53076.log 2024-04-25T02:30:29.297 INFO:teuthology.orchestra.run.smithi111.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.44206.log.gz 2024-04-25T02:30:29.298 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.53790.log: /var/log/ceph/ceph-client.admin.53076.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.53790.log.gz 2024-04-25T02:30:29.298 INFO:teuthology.orchestra.run.smithi111.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53076.log.gz 2024-04-25T02:30:29.298 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44614.log 2024-04-25T02:30:29.298 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41168.log 2024-04-25T02:30:29.298 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.44614.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44308.log 2024-04-25T02:30:29.298 INFO:teuthology.orchestra.run.smithi111.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.44614.log.gz 2024-04-25T02:30:29.298 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.41168.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.41168.log.gz 2024-04-25T02:30:29.298 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.44308.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43650.log 2024-04-25T02:30:29.298 INFO:teuthology.orchestra.run.smithi111.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.44308.log.gzgzip 2024-04-25T02:30:29.298 INFO:teuthology.orchestra.run.smithi111.stderr:-5 --verbose -- /var/log/ceph/ceph-client.admin.42605.log 2024-04-25T02:30:29.298 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.43650.log: /var/log/ceph/ceph-client.admin.42605.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43650.log.gz 2024-04-25T02:30:29.298 INFO:teuthology.orchestra.run.smithi111.stderr: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.42605.log.gz 2024-04-25T02:30:29.298 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42002.log 2024-04-25T02:30:29.298 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-25T02:30:29.299 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.42002.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.42002.log.gz 2024-04-25T02:30:29.299 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57079.log 2024-04-25T02:30:29.299 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56129.log 2024-04-25T02:30:29.299 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.57079.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.57079.log.gz 2024-04-25T02:30:29.299 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.56129.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.56129.log.gz 2024-04-25T02:30:29.299 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47542.log 2024-04-25T02:30:29.299 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-25T02:30:29.299 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.47542.log: 89.9% -- replaced with /var/log/ceph/ceph-client.admin.47542.log.gz 2024-04-25T02:30:29.300 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-mds.a.log: 91.4% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-25T02:30:29.300 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-25T02:30:29.300 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39584.log 2024-04-25T02:30:29.300 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-mon.a.log: /var/log/ceph/ceph-client.admin.39584.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.39584.log.gz 2024-04-25T02:30:29.300 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55345.log 2024-04-25T02:30:29.301 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.55345.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55345.log.gz 2024-04-25T02:30:29.301 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43015.log 2024-04-25T02:30:29.302 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.43015.log: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.43015.log.gz 2024-04-25T02:30:29.302 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56031.log 2024-04-25T02:30:29.302 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.56031.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.56031.log.gz 2024-04-25T02:30:29.303 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49000.log 2024-04-25T02:30:29.303 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.49000.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.49000.log.gz 2024-04-25T02:30:29.303 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49242.log 2024-04-25T02:30:29.304 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.49242.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.49242.log.gz 2024-04-25T02:30:29.304 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41531.log 2024-04-25T02:30:29.305 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.41531.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.41531.log.gz 2024-04-25T02:30:29.305 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53447.log 2024-04-25T02:30:29.306 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.53447.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53447.log.gz 2024-04-25T02:30:29.306 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41582.log 2024-04-25T02:30:29.307 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.41582.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.41582.log.gz 2024-04-25T02:30:29.307 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45498.log 2024-04-25T02:30:29.308 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.45498.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.45498.log.gz 2024-04-25T02:30:29.308 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55394.log 2024-04-25T02:30:29.309 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.55394.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.55394.log.gz 2024-04-25T02:30:29.309 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51856.log 2024-04-25T02:30:29.310 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.51856.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.51856.log.gz 2024-04-25T02:30:29.310 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-25T02:30:29.321 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54655.log 2024-04-25T02:30:29.322 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.54655.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.54655.log.gz 2024-04-25T02:30:29.322 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44155.log 2024-04-25T02:30:29.323 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.44155.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.44155.log.gz 2024-04-25T02:30:29.323 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-25T02:30:29.327 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41042.log 2024-04-25T02:30:29.339 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.41042.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.41042.log.gz 2024-04-25T02:30:29.339 INFO:teuthology.orchestra.run.smithi111.stderr: 89.9% -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-25T02:30:29.340 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48299.log 2024-04-25T02:30:29.340 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.48299.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.48299.log.gz 2024-04-25T02:30:29.341 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56619.log 2024-04-25T02:30:29.342 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.56619.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.56619.log.gz 2024-04-25T02:30:29.342 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46792.log 2024-04-25T02:30:29.343 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.46792.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.46792.log.gz 2024-04-25T02:30:29.343 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-25T02:30:29.354 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-mds.b.log: 91.2% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-25T02:30:29.354 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54263.log 2024-04-25T02:30:29.355 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.54263.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.54263.log.gz 2024-04-25T02:30:29.358 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44257.log 2024-04-25T02:30:29.370 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.44257.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.44257.log.gz 2024-04-25T02:30:29.370 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55443.log 2024-04-25T02:30:29.376 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.55443.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.55443.log.gz 2024-04-25T02:30:29.381 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53839.log 2024-04-25T02:30:29.391 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.53839.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.53839.log.gz 2024-04-25T02:30:29.392 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40002.log 2024-04-25T02:30:29.397 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.40002.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.40002.log.gz 2024-04-25T02:30:29.400 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52067.log 2024-04-25T02:30:29.401 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.52067.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.52067.log.gz 2024-04-25T02:30:29.401 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53194.log 2024-04-25T02:30:29.402 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.53194.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.53194.log.gz 2024-04-25T02:30:29.403 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49110.log 2024-04-25T02:30:29.404 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.49110.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.49110.log.gz 2024-04-25T02:30:29.404 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-25T02:30:29.408 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph.log: 94.1% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-25T02:30:29.408 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54847.log 2024-04-25T02:30:29.409 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.54847.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.54847.log.gz 2024-04-25T02:30:29.410 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48495.log 2024-04-25T02:30:29.411 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.48495.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.48495.log.gz 2024-04-25T02:30:29.411 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45277.log 2024-04-25T02:30:29.412 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.45277.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.45277.log.gz 2024-04-25T02:30:29.412 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44082.log 2024-04-25T02:30:29.413 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.44082.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.44082.log.gz 2024-04-25T02:30:29.414 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43599.log 2024-04-25T02:30:29.415 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.43599.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.43599.log.gz 2024-04-25T02:30:29.415 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42112.log 2024-04-25T02:30:29.416 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.42112.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42112.log.gz 2024-04-25T02:30:29.416 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57177.log 2024-04-25T02:30:29.417 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.57177.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.57177.log.gz 2024-04-25T02:30:29.417 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45549.log 2024-04-25T02:30:29.419 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.45549.log: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.45549.log.gz 2024-04-25T02:30:29.419 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43191.log 2024-04-25T02:30:29.420 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.43191.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.43191.log.gz 2024-04-25T02:30:29.420 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43242.log 2024-04-25T02:30:29.421 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.43242.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.43242.log.gz 2024-04-25T02:30:29.421 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52488.log 2024-04-25T02:30:29.422 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.52488.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.52488.log.gz 2024-04-25T02:30:29.423 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44461.log 2024-04-25T02:30:29.424 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.44461.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44461.log.gz 2024-04-25T02:30:29.424 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47644.log 2024-04-25T02:30:29.425 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.47644.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47644.log.gz 2024-04-25T02:30:29.425 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53341.log 2024-04-25T02:30:29.426 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.53341.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.53341.log.gz 2024-04-25T02:30:29.426 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43956.log 2024-04-25T02:30:29.427 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.43956.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.43956.log.gz 2024-04-25T02:30:29.427 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42732.log 2024-04-25T02:30:29.429 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.42732.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.42732.log.gz 2024-04-25T02:30:29.429 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48036.log 2024-04-25T02:30:29.430 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.48036.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.48036.log.gz 2024-04-25T02:30:29.430 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43548.log 2024-04-25T02:30:29.431 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.43548.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.43548.log.gz 2024-04-25T02:30:29.431 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56325.log 2024-04-25T02:30:29.432 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.56325.log: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.56325.log.gz 2024-04-25T02:30:29.432 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53692.log 2024-04-25T02:30:29.433 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.53692.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.53692.log.gz 2024-04-25T02:30:29.434 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43395.log 2024-04-25T02:30:29.435 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.43395.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43395.log.gz 2024-04-25T02:30:29.435 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47938.log 2024-04-25T02:30:29.436 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.47938.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47938.log.gz 2024-04-25T02:30:29.436 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44512.log 2024-04-25T02:30:29.437 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.44512.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.44512.log.gz 2024-04-25T02:30:29.437 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48593.log 2024-04-25T02:30:29.438 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.48593.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48593.log.gz 2024-04-25T02:30:29.438 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46791.log 2024-04-25T02:30:29.440 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.46791.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.46791.log.gz 2024-04-25T02:30:29.440 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52827.log 2024-04-25T02:30:29.441 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.52827.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.52827.log.gz 2024-04-25T02:30:29.441 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43701.log 2024-04-25T02:30:29.442 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.43701.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.43701.log.gz 2024-04-25T02:30:29.442 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52828.log 2024-04-25T02:30:29.443 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.52828.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.52828.log.gz 2024-04-25T02:30:29.443 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47474.log 2024-04-25T02:30:29.445 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.47474.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.47474.log.gz 2024-04-25T02:30:29.445 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42163.log 2024-04-25T02:30:29.446 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.42163.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.42163.log.gz 2024-04-25T02:30:29.446 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55168.log 2024-04-25T02:30:29.447 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.55168.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55168.log.gz 2024-04-25T02:30:29.447 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47742.log 2024-04-25T02:30:29.448 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.47742.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.47742.log.gz 2024-04-25T02:30:29.448 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42214.log 2024-04-25T02:30:29.449 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.42214.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.42214.log.gz 2024-04-25T02:30:29.449 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54994.log 2024-04-25T02:30:29.451 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.54994.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.54994.log.gz 2024-04-25T02:30:29.451 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42426.log 2024-04-25T02:30:29.452 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.42426.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.42426.log.gz 2024-04-25T02:30:29.452 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42265.log 2024-04-25T02:30:29.453 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.42265.log: 87.2% -- replaced with /var/log/ceph/ceph-client.admin.42265.log.gz 2024-04-25T02:30:29.453 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44869.log 2024-04-25T02:30:29.454 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.44869.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.44869.log.gz 2024-04-25T02:30:29.455 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53986.log 2024-04-25T02:30:29.456 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.53986.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.53986.log.gz 2024-04-25T02:30:29.456 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47670.log 2024-04-25T02:30:29.457 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.47670.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.47670.log.gz 2024-04-25T02:30:29.457 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42810.log 2024-04-25T02:30:29.458 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.42810.log: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.42810.log.gz 2024-04-25T02:30:29.458 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53496.log 2024-04-25T02:30:29.459 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.53496.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.53496.log.gz 2024-04-25T02:30:29.460 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41841.log 2024-04-25T02:30:29.461 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.41841.log: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.41841.log.gz 2024-04-25T02:30:29.461 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55296.log 2024-04-25T02:30:29.462 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.55296.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.55296.log.gz 2024-04-25T02:30:29.462 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54896.log 2024-04-25T02:30:29.463 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.54896.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.54896.log.gz 2024-04-25T02:30:29.463 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48813.log 2024-04-25T02:30:29.464 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.48813.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.48813.log.gz 2024-04-25T02:30:29.464 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48642.log 2024-04-25T02:30:29.466 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.48642.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48642.log.gz 2024-04-25T02:30:29.466 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48397.log 2024-04-25T02:30:29.467 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.48397.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.48397.log.gz 2024-04-25T02:30:29.467 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-25T02:30:29.477 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48250.log 2024-04-25T02:30:29.489 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.48250.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.48250.log.gz 2024-04-25T02:30:29.489 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53937.log 2024-04-25T02:30:29.496 INFO:teuthology.orchestra.run.smithi111.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-25T02:30:29.498 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.53937.log: 89.6% -- replaced with /var/log/ceph/ceph-client.admin.53937.log.gz 2024-04-25T02:30:29.498 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42477.log 2024-04-25T02:30:29.506 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.42477.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.42477.log.gz 2024-04-25T02:30:29.506 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53024.log 2024-04-25T02:30:29.507 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.53024.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.53024.log.gz 2024-04-25T02:30:29.507 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52683.log 2024-04-25T02:30:29.508 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.52683.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.52683.log.gz 2024-04-25T02:30:29.508 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55092.log 2024-04-25T02:30:29.509 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.55092.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.55092.log.gz 2024-04-25T02:30:29.509 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55835.log 2024-04-25T02:30:29.510 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.55835.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.55835.log.gz 2024-04-25T02:30:29.510 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44007.log 2024-04-25T02:30:29.511 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.44007.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.44007.log.gz 2024-04-25T02:30:29.511 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40991.log 2024-04-25T02:30:29.512 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.40991.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.40991.log.gz 2024-04-25T02:30:29.512 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57226.log 2024-04-25T02:30:29.513 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.57226.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.57226.log.gz 2024-04-25T02:30:29.513 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42936.log 2024-04-25T02:30:29.514 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.42936.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.42936.log.gz 2024-04-25T02:30:29.514 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54312.log 2024-04-25T02:30:29.515 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.54312.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.54312.log.gz 2024-04-25T02:30:29.515 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56374.log 2024-04-25T02:30:29.516 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.56374.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.56374.log.gz 2024-04-25T02:30:29.516 INFO:teuthology.orchestra.run.smithi111.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41325.log 2024-04-25T02:30:29.517 INFO:teuthology.orchestra.run.smithi111.stderr:/var/log/ceph/ceph-client.admin.41325.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.41325.log.gz 2024-04-25T02:30:29.576 INFO:teuthology.orchestra.run.smithi111.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-25T02:30:29.816 INFO:teuthology.orchestra.run.smithi111.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-25T02:30:32.061 INFO:teuthology.orchestra.run.smithi111.stderr: 93.6% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-25T02:30:32.323 INFO:teuthology.orchestra.run.smithi111.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-25T02:30:32.382 INFO:teuthology.orchestra.run.smithi111.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-25T02:30:32.559 INFO:teuthology.orchestra.run.smithi111.stderr: 93.7% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-25T02:30:42.371 INFO:teuthology.orchestra.run.smithi114.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.0.39056.log.gz 2024-04-25T02:30:42.373 INFO:teuthology.orchestra.run.smithi114.stderr: 2024-04-25T02:30:42.373 INFO:teuthology.orchestra.run.smithi114.stderr:real 0m13.151s 2024-04-25T02:30:42.373 INFO:teuthology.orchestra.run.smithi114.stderr:user 0m12.718s 2024-04-25T02:30:42.373 INFO:teuthology.orchestra.run.smithi114.stderr:sys 0m0.426s 2024-04-25T02:31:08.634 INFO:teuthology.orchestra.run.smithi111.stderr: 93.3% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-25T02:31:08.635 INFO:teuthology.orchestra.run.smithi111.stderr: 2024-04-25T02:31:08.636 INFO:teuthology.orchestra.run.smithi111.stderr:real 0m39.420s 2024-04-25T02:31:08.636 INFO:teuthology.orchestra.run.smithi111.stderr:user 0m50.872s 2024-04-25T02:31:08.636 INFO:teuthology.orchestra.run.smithi111.stderr:sys 0m1.834s 2024-04-25T02:31:08.636 INFO:tasks.ceph:Archiving logs... 2024-04-25T02:31:08.636 DEBUG:teuthology.misc:Transferring archived files from smithi111:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672379/remote/smithi111/log 2024-04-25T02:31:08.638 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T02:31:16.948 DEBUG:teuthology.misc:Transferring archived files from smithi114:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672379/remote/smithi114/log 2024-04-25T02:31:16.949 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T02:31:19.116 DEBUG:teuthology.misc:Transferring archived files from smithi186:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672379/remote/smithi186/log 2024-04-25T02:31:19.117 DEBUG:teuthology.orchestra.run.smithi186:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-25T02:31:19.151 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-25T02:31:19.166 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-25T02:31:19.166 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T02:31:19.169 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T02:31:19.172 DEBUG:teuthology.orchestra.run.smithi186:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-25T02:31:19.311 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-25T02:31:19.331 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-25T02:31:19.331 DEBUG:teuthology.orchestra.run.smithi111:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T02:31:19.334 DEBUG:teuthology.orchestra.run.smithi114:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T02:31:19.337 DEBUG:teuthology.orchestra.run.smithi186:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-25T02:31:19.352 INFO:teuthology.orchestra.run.smithi111.stderr:bash: ntpq: command not found 2024-04-25T02:31:19.355 INFO:teuthology.orchestra.run.smithi114.stderr:bash: ntpq: command not found 2024-04-25T02:31:19.356 INFO:teuthology.orchestra.run.smithi186.stderr:bash: ntpq: command not found 2024-04-25T02:31:19.357 INFO:teuthology.orchestra.run.smithi111.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T02:31:19.357 INFO:teuthology.orchestra.run.smithi111.stdout:=============================================================================== 2024-04-25T02:31:19.357 INFO:teuthology.orchestra.run.smithi111.stdout:^- hv01.front.sepia.ceph.com 2 6 377 51 +1732us[+1737us] +/- 579ms 2024-04-25T02:31:19.358 INFO:teuthology.orchestra.run.smithi111.stdout:^* hv02.front.sepia.ceph.com 3 6 377 48 -266us[ -261us] +/- 60ms 2024-04-25T02:31:19.358 INFO:teuthology.orchestra.run.smithi111.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 49 +305us[ +310us] +/- 68ms 2024-04-25T02:31:19.358 INFO:teuthology.orchestra.run.smithi111.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:31:19.361 INFO:teuthology.orchestra.run.smithi114.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T02:31:19.361 INFO:teuthology.orchestra.run.smithi114.stdout:=============================================================================== 2024-04-25T02:31:19.361 INFO:teuthology.orchestra.run.smithi114.stdout:^- hv01.front.sepia.ceph.com 2 6 377 50 +1735us[+1725us] +/- 579ms 2024-04-25T02:31:19.361 INFO:teuthology.orchestra.run.smithi114.stdout:^* hv02.front.sepia.ceph.com 3 6 377 48 -275us[ -285us] +/- 60ms 2024-04-25T02:31:19.361 INFO:teuthology.orchestra.run.smithi114.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 49 +298us[ +288us] +/- 68ms 2024-04-25T02:31:19.361 INFO:teuthology.orchestra.run.smithi114.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:31:19.362 INFO:teuthology.orchestra.run.smithi186.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-04-25T02:31:19.362 INFO:teuthology.orchestra.run.smithi186.stdout:=============================================================================== 2024-04-25T02:31:19.363 INFO:teuthology.orchestra.run.smithi186.stdout:^- hv01.front.sepia.ceph.com 2 6 377 49 +1749us[+1749us] +/- 579ms 2024-04-25T02:31:19.363 INFO:teuthology.orchestra.run.smithi186.stdout:^* hv02.front.sepia.ceph.com 3 6 377 49 -261us[ -244us] +/- 60ms 2024-04-25T02:31:19.363 INFO:teuthology.orchestra.run.smithi186.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 45 +323us[ +323us] +/- 68ms 2024-04-25T02:31:19.363 INFO:teuthology.orchestra.run.smithi186.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-04-25T02:31:19.363 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-25T02:31:19.376 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-25T02:31:19.377 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-25T02:31:19.412 DEBUG:teuthology.orchestra.run.smithi111:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T02:31:19.487 DEBUG:teuthology.orchestra.run.smithi114:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T02:31:19.557 DEBUG:teuthology.orchestra.run.smithi186:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-04-25T02:31:19.625 DEBUG:teuthology.orchestra.run.smithi111:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-04-25T02:31:19.657 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:31:19.658 DEBUG:teuthology.orchestra.run.smithi114:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-04-25T02:31:19.690 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:31:19.691 DEBUG:teuthology.orchestra.run.smithi186:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 2024-04-25T02:31:19.723 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:31:19.723 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-25T02:31:19.738 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-25T02:31:19.849 INFO:teuthology.task.internal:Duration was 1186.798900 seconds 2024-04-25T02:31:19.850 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-25T02:31:19.873 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-25T02:31:19.873 DEBUG:teuthology.orchestra.run.smithi111:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T02:31:19.876 DEBUG:teuthology.orchestra.run.smithi114:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T02:31:19.879 DEBUG:teuthology.orchestra.run.smithi186:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-25T02:31:19.923 INFO:teuthology.orchestra.run.smithi111.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T02:31:19.929 INFO:teuthology.orchestra.run.smithi186.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T02:31:19.930 INFO:teuthology.orchestra.run.smithi114.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-04-25T02:31:20.408 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-25T02:31:20.408 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi111.front.sepia.ceph.com 2024-04-25T02:31:20.408 DEBUG:teuthology.orchestra.run.smithi111:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T02:31:20.435 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi114.front.sepia.ceph.com 2024-04-25T02:31:20.436 DEBUG:teuthology.orchestra.run.smithi114:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T02:31:20.461 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi186.front.sepia.ceph.com 2024-04-25T02:31:20.461 DEBUG:teuthology.orchestra.run.smithi186:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-25T02:31:20.488 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-25T02:31:20.488 DEBUG:teuthology.orchestra.run.smithi111:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T02:31:20.491 DEBUG:teuthology.orchestra.run.smithi114:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T02:31:20.504 DEBUG:teuthology.orchestra.run.smithi186:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-25T02:31:20.576 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-25T02:31:20.576 DEBUG:teuthology.orchestra.run.smithi111:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T02:31:20.579 DEBUG:teuthology.orchestra.run.smithi114:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T02:31:20.582 DEBUG:teuthology.orchestra.run.smithi186:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-25T02:31:20.655 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-25T02:31:20.677 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-25T02:31:20.678 DEBUG:teuthology.orchestra.run.smithi111:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T02:31:20.709 DEBUG:teuthology.orchestra.run.smithi114:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T02:31:20.737 DEBUG:teuthology.orchestra.run.smithi186:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-25T02:31:20.765 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-25T02:31:20.782 DEBUG:teuthology.orchestra.run.smithi111:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T02:31:20.784 DEBUG:teuthology.orchestra.run.smithi114:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T02:31:20.787 DEBUG:teuthology.orchestra.run.smithi186:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-25T02:31:20.809 INFO:teuthology.orchestra.run.smithi111.stdout:kernel.core_pattern = core 2024-04-25T02:31:20.811 INFO:teuthology.orchestra.run.smithi114.stdout:kernel.core_pattern = core 2024-04-25T02:31:20.833 INFO:teuthology.orchestra.run.smithi186.stdout:kernel.core_pattern = core 2024-04-25T02:31:20.846 DEBUG:teuthology.orchestra.run.smithi111:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T02:31:20.886 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:31:20.887 DEBUG:teuthology.orchestra.run.smithi114:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T02:31:20.904 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:31:20.905 DEBUG:teuthology.orchestra.run.smithi186:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-25T02:31:20.921 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-25T02:31:20.922 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-25T02:31:20.937 INFO:teuthology.task.internal:Transferring archived files... 2024-04-25T02:31:20.938 DEBUG:teuthology.misc:Transferring archived files from smithi111:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672379/remote/smithi111 2024-04-25T02:31:20.939 DEBUG:teuthology.orchestra.run.smithi111:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T02:31:20.977 DEBUG:teuthology.misc:Transferring archived files from smithi114:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672379/remote/smithi114 2024-04-25T02:31:20.978 DEBUG:teuthology.orchestra.run.smithi114:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T02:31:21.016 DEBUG:teuthology.misc:Transferring archived files from smithi186:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-04-24_21:24:02-fs-squid-distro-default-smithi/7672379/remote/smithi186 2024-04-25T02:31:21.016 DEBUG:teuthology.orchestra.run.smithi186:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-25T02:31:21.054 INFO:teuthology.task.internal:Removing archive directory... 2024-04-25T02:31:21.054 DEBUG:teuthology.orchestra.run.smithi111:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T02:31:21.057 DEBUG:teuthology.orchestra.run.smithi114:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T02:31:21.059 DEBUG:teuthology.orchestra.run.smithi186:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-25T02:31:21.105 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-25T02:31:21.122 INFO:teuthology.task.internal:Not uploading archives. 2024-04-25T02:31:21.122 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-25T02:31:21.140 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-25T02:31:21.140 DEBUG:teuthology.orchestra.run.smithi111:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T02:31:21.142 DEBUG:teuthology.orchestra.run.smithi114:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T02:31:21.144 DEBUG:teuthology.orchestra.run.smithi186:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-25T02:31:21.157 INFO:teuthology.orchestra.run.smithi111.stdout: 525357 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 02:31 /home/ubuntu/cephtest 2024-04-25T02:31:21.159 INFO:teuthology.orchestra.run.smithi114.stdout: 393224 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 02:31 /home/ubuntu/cephtest 2024-04-25T02:31:21.163 INFO:teuthology.orchestra.run.smithi186.stdout: 393224 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 25 02:31 /home/ubuntu/cephtest 2024-04-25T02:31:21.164 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-25T02:31:21.191 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-25T02:31:21.269 INFO:teuthology.run:Summary data: description: fs/upgrade/featureful_client/upgraded_client/{bluestore-bitmap centos_8.stream clusters/1-mds-2-client-micro conf/{client mds mgr mon osd} overrides/{ignorelist_health ignorelist_wrongly_marked_down multimds/yes pg-warn} tasks/{0-octopus 1-client 2-upgrade 3-client-upgrade 4-compat_client 5-client-sanity}} duration: 1186.7988996505737 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-04-25T02:31:21.269 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-25T02:31:21.351 INFO:teuthology.run:pass